diff --git "a/precomputed/example_visualization.html" "b/precomputed/example_visualization.html"
--- "a/precomputed/example_visualization.html"
+++ "b/precomputed/example_visualization.html"
@@ -279,7 +279,7 @@
     <div id="tooltip"></div>
         <div class="header">
             <div class="meta">
-                <div>Model A: RWKV7-G1D-1.5B</div>
+                <div>Model A: RWKV7-G1F-1.5B</div>
                 <div>Model B: Qwen3-1.7B-Base</div>
                 <div>RWKV Compression: 9.32%</div>
                 <div>Qwen Compression: 9.47%</div>
@@ -316,7 +316,7 @@
         </div>
     
     <div class="content"></div>
-    <script id="render-model" type="application/json">{"text": "The Bitter Lesson\nRich Sutton\nMarch 13, 2019\nThe biggest lesson that can be read from 70 years of AI research is that general methods that leverage computation are ultimately the most effective, and by a large margin. The ultimate reason for this is Moore's law, or rather its generalization of continued exponentially falling cost per unit of computation. Most AI research has been conducted as if the computation available to the agent were constant (in which case leveraging human knowledge would be one of the only ways to improve performance) but, over a slightly longer time than a typical research project, massively more computation inevitably becomes available. Seeking an improvement that makes a difference in the shorter term, researchers seek to leverage their human knowledge of the domain, but the only thing that matters in the long run is the leveraging of computation. These two need not run counter to each other, but in practice they tend to. Time spent on one is time not spent on the other. There are psychological commitments to investment in one approach or the other. And the human-knowledge approach tends to complicate methods in ways that make them less suited to taking advantage of general methods leveraging computation.  There were many examples of AI researchers' belated learning of this bitter lesson, and it is instructive to review some of the most prominent.\n\nIn computer chess, the methods that defeated the world champion, Kasparov, in 1997, were based on massive, deep search. At the time, this was looked upon with dismay by the majority of computer-chess researchers who had pursued methods that leveraged human understanding of the special structure of chess. When a simpler, search-based approach with special hardware and software proved vastly more effective, these human-knowledge-based chess researchers were not good losers. They said that ``brute force\" search may have won this time, but it was not a general strategy, and anyway it was not how people played chess. These researchers wanted methods based on human input to win and were disappointed when they did not.\n\nA similar pattern of research progress was seen in computer Go, only delayed by a further 20 years. Enormous initial efforts went into avoiding search by taking advantage of human knowledge, or of the special features of the game, but all those efforts proved irrelevant, or worse, once search was applied effectively at scale. Also important was the use of learning by self play to learn a value function (as it was in many other games and even in chess, although learning did not play a big role in the 1997 program that first beat a world champion). Learning by self play, and learning in general, is like search in that it enables massive computation to be brought to bear. Search and learning are the two most important classes of techniques for utilizing massive amounts of computation in AI research. In computer Go, as in computer chess, researchers' initial effort was directed towards utilizing human understanding (so that less search was needed) and only much later was much greater success had by embracing search and learning.\n\nIn speech recognition, there was an early competition, sponsored by DARPA, in the 1970s. Entrants included a host of special methods that took advantage of human knowledge---knowledge of words, of phonemes, of the human vocal tract, etc. On the other side were newer methods that were more statistical in nature and did much more computation, based on hidden Markov models (HMMs). Again, the statistical methods won out over the human-knowledge-based methods. This led to a major change in all of natural language processing, gradually over decades, where statistics and computation came to dominate the field. The recent rise of deep learning in speech recognition is the most recent step in this consistent direction. Deep learning methods rely even less on human knowledge, and use even more computation, together with learning on huge training sets, to produce dramatically better speech recognition systems. As in the games, researchers always tried to make systems that worked the way the researchers thought their own minds worked---they tried to put that knowledge in their systems---but it proved ultimately counterproductive, and a colossal waste of researcher's time, when, through Moore's law, massive computation became available and a means was found to put it to good use.\n\nIn computer vision, there has been a similar pattern. Early methods conceived of vision as searching for edges, or generalized cylinders, or in terms of SIFT features. But today all this is discarded. Modern deep-learning neural networks use only the notions of convolution and certain kinds of invariances, and perform much better.\n\nThis is a big lesson. As a field, we still have not thoroughly learned it, as we are continuing to make the same kind of mistakes. To see this, and to effectively resist it, we have to understand the appeal of these mistakes. We have to learn the bitter lesson that building in how we think we think does not work in the long run. The bitter lesson is based on the historical observations that 1) AI researchers have often tried to build knowledge into their agents, 2) this always helps in the short term, and is personally satisfying to the researcher, but 3) in the long run it plateaus and even inhibits further progress, and 4) breakthrough progress eventually arrives by an opposing approach based on scaling computation by search and learning. The eventual success is tinged with bitterness, and often incompletely digested, because it is success over a favored, human-centric approach.\n\nOne thing that should be learned from the bitter lesson is the great power of general purpose methods, of methods that continue to scale with increased computation even as the available computation becomes very great. The two methods that seem to scale arbitrarily in this way are search and learning.\n\nThe second general point to be learned from the bitter lesson is that the actual contents of minds are tremendously, irredeemably complex; we should stop trying to find simple ways to think about the contents of minds, such as simple ways to think about space, objects, multiple agents, or symmetries. All these are part of the arbitrary, intrinsically-complex, outside world. They are not what should be built in, as their complexity is endless; instead we should build in only the meta-methods that can find and capture this arbitrary complexity. Essential to these methods is that they can find good approximations, but the search for them should be by our methods, not by us. We want AI agents that can discover like we can, not which contain what we have discovered. Building in our discoveries only makes it harder to see how the discovering process can be done.\n", "tokens": [{"byte_start": 0, "byte_end": 3, "display": {"text": "The", "kind": "normal"}, "is_word": true, "word_id": 0, "word_key": "the", "bytes_hex": "54 68 65", "compression": {"rwkv": "21.88% 21.88% 21.88%", "qwen": "33.67% 33.67% 33.67%"}, "model_tokens": {"rwkv": [[6699, "The", "normal", 0.026203298941254616]], "qwen": [[785, "The", "normal", 0.003693073522299528]]}, "loss": {"rwkv": 21.884631805151592, "qwen": 33.67067739459524}, "topk": {"rwkv": [6699, 7, 0.026203298941254616, [[41775, 0.062368, "length", false], [34579, 0.049356, "https", false], [897, 0.046897, "CC", false], [24281, 0.043908, "User", false], [36, 0.035981, "#", false], [82, 0.03298, "Q", false], [6699, 0.026203, "The", false], [520, 0.020542, "**", false], [25623, 0.019473, "http", false], [1136, 0.018912, "In", false]]], "qwen": [785, 30, 0.003693073522299528, [[262, 0.036306, "   ", false], [286, 0.025112, "       ", false], [198, 0.021214, "\n", false], [310, 0.014187, "           ", false], [220, 0.012878, " ", false], [197, 0.01252, "\t", false], [16, 0.011983, "1", false], [2, 0.009983, "#", false], [256, 0.008925, "  ", false], [17, 0.008681, "2", false]]]}, "raw_delta": -0.6535571416219075, "tuned_delta": -0.6449853495913292}, {"byte_start": 3, "byte_end": 10, "display": {"text": " Bitter", "kind": "normal"}, "is_word": true, "word_id": 1, "word_key": " bitter", "bytes_hex": "20 42 69 74 74 65 72", "compression": {"rwkv": "40.58% 40.58% 40.58% 40.58% 8.97% 8.97% 8.97%", "qwen": "62.88% 62.88% 17.53% 17.53% 17.53% 17.53% 17.53%"}, "model_tokens": {"rwkv": [[19523, " Bit", "normal", 0.00012164174404460937], [8795, "ter", "normal", 0.2274768203496933]], "qwen": [[425, " B", "normal", 0.00093627575552091], [3248, "itter", "normal", 0.007752551697194576]]}, "loss": {"rwkv": 27.030405132727093, "qwen": 30.485520618743337}, "topk": {"rwkv": [19523, 1280, 0.00012164174404460937, [[32355, 0.028185, " user", false], [52569, 0.014494, " problem", false], [331, 0.012293, " `", false], [57009, 0.009806, " question", false], [45242, 0.008977, " author", false], [45010, 0.00747, " United", false], [32224, 0.007319, " text", false], [31894, 0.00697, " role", false], [39840, 0.006303, " study", false], [269, 0.005951, " \"", false]]], "qwen": [425, 134, 0.00093627575552091, [[2701, 0.032689, " following", false], [4226, 0.024054, " answer", false], [1156, 0.015003, " first", false], [4396, 0.011983, " correct", false], [1565, 0.011463, " `", false], [729, 0.010951, " function", false], [1887, 0.009331, " main", false], [2790, 0.008723, " total", false], [1372, 0.008478, " number", false], [3491, 0.00806, " problem", false]]]}, "raw_delta": -0.19159228461129324, "tuned_delta": -0.18302049258071498}, {"byte_start": 10, "byte_end": 17, "display": {"text": " Lesson", "kind": "normal"}, "is_word": true, "word_id": 2, "word_key": " lesson", "bytes_hex": "20 4c 65 73 73 6f 6e", "compression": {"rwkv": "19.61% 19.61% 19.61% 19.61% 19.61% 0.36% 0.36%", "qwen": "16.49% 16.49% 16.49% 16.49% 16.49% 16.49% 16.49%"}, "model_tokens": {"rwkv": [[29273, " Less", "normal", 0.004347627982497215], [2098, "on", "normal", 0.9603351354598999]], "qwen": [[48915, " Lesson", "normal", 0.0016589945880696177]]}, "loss": {"rwkv": 14.11083253799172, "qwen": 16.491920054712242}, "topk": {"rwkv": [29273, 22, 0.004347627982497215, [[37496, 0.206492, " Truth", false], [29584, 0.105174, " Pill", false], [26939, 0.042943, "root", false], [19826, 0.030786, " End", false], [29694, 0.029046, " Root", false], [44502, 0.025203, " Legacy", false], [44014, 0.021993, " Battle", false], [20979, 0.012415, " Tas", false], [46, 0.010383, "-", false], [21265, 0.009432, " and", false]]], "qwen": [48915, 78, 0.0016589945880696177, [[3972, 0.086547, " End", false], [18854, 0.033914, " Root", false], [2090, 0.0327, "ness", false], [2888, 0.032286, "root", false], [29098, 0.030777, " Truth", false], [34136, 0.021435, " Pill", false], [57981, 0.019807, " Taste", false], [323, 0.016665, " and", false], [26589, 0.016409, " Sweet", false], [55835, 0.013012, " Harvest", false]]]}, "raw_delta": -0.13203552791050505, "tuned_delta": -0.1234637358799268}, {"byte_start": 17, "byte_end": 18, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "33.67%", "qwen": "26.29%"}, "model_tokens": {"rwkv": [[11, "\n", "control", 0.1527043581008911]], "qwen": [[198, "\n", "control", 0.2327895313501358]]}, "loss": {"rwkv": 33.67227683324826, "qwen": 26.286273362980776}, "topk": {"rwkv": [11, 2, 0.1527043581008911, [[59, 0.368519, ":", false], [11, 0.152704, "\n", false], [261, 0.110118, "\n\n", false], [4600, 0.03812, " is", false], [4706, 0.029825, " of", false], [4450, 0.028067, " by", false], [275, 0.026209, " (", false], [280, 0.020331, " -", false], [45, 0.020245, ",", false], [3339, 0.012901, "  \n", false]]], "qwen": [198, 2, 0.2327895313501358, [[315, 0.281083, " of", false], [198, 0.23279, "\n", false], [25, 0.055722, ":", false], [271, 0.051887, "\n\n", false], [320, 0.027106, " (", false], [374, 0.02522, " is", false], [304, 0.019353, " in", false], [553, 0.013985, " by", false], [504, 0.013709, " from", false], [11, 0.013458, ",", false]]]}, "raw_delta": 0.4095669984817505, "tuned_delta": 0.4181387905123287}, {"byte_start": 18, "byte_end": 22, "display": {"text": "Rich", "kind": "normal"}, "is_word": true, "word_id": 3, "word_key": "rich", "bytes_hex": "52 69 63 68", "compression": {"rwkv": "42.55% 42.55% 42.55% 42.55%", "qwen": "39.68% 39.68% 39.68% 39.68%"}, "model_tokens": {"rwkv": [[24100, "Rich", "normal", 7.995641499292105e-05]], "qwen": [[27177, "Rich", "normal", 0.00015063985483720899]]}, "loss": {"rwkv": 42.54823265121747, "qwen": 39.67690060330372}, "topk": {"rwkv": [24100, 1367, 7.995641499292105e-05, [[6699, 0.09671, "The", false], [1782, 0.036423, "by", false], [66, 0.034416, "A", false], [1136, 0.030641, "In", false], [894, 0.02219, "By", false], [24242, 0.019256, "This", false], [74, 0.019003, "I", false], [35, 0.016756, "\"", false], [6018, 0.013143, "How", false], [24326, 0.011633, "What", false]]], "qwen": [27177, 744, 0.00015063985483720899, [[785, 0.164658, "The", false], [32, 0.037296, "A", false], [1359, 0.026936, "By", false], [1694, 0.024776, "by", false], [16, 0.017683, "1", false], [641, 0.01757, "In", false], [33, 0.01526, "B", false], [40, 0.012698, "I", false], [4498, 0.009365, "When", false], [25020, 0.00897, "Chapter", false]]]}, "raw_delta": 0.15922045707702637, "tuned_delta": 0.16779224910760462}, {"byte_start": 22, "byte_end": 29, "display": {"text": " Sutton", "kind": "normal"}, "is_word": true, "word_id": 4, "word_key": " sutton", "bytes_hex": "20 53 75 74 74 6f 6e", "compression": {"rwkv": "21.09% 21.09% 21.09% 21.09% 21.09% 21.09% 21.09%", "qwen": "23.54% 23.54% 23.54% 23.54% 23.54% 23.54% 23.54%"}, "model_tokens": {"rwkv": [[44940, " Sutton", "normal", 0.00026984905707649887]], "qwen": [[73013, " Sutton", "normal", 0.00010748509521363303]]}, "loss": {"rwkv": 21.09297437013998, "qwen": 23.54210068043684}, "topk": {"rwkv": [44940, 420, 0.00026984905707649887, [[46787, 0.056964, " people", false], [19712, 0.050819, " Dad", false], [21265, 0.048479, " and", false], [26269, 0.037071, "mond", false], [1941, 0.036013, "ie", false], [1858, 0.026592, "es", false], [8795, 0.025062, "ter", false], [4600, 0.023162, " is", false], [45, 0.02242, ",", false], [50202, 0.018359, " Epstein", false]]], "qwen": [73013, 761, 0.00010748509521363303, [[6712, 0.07193, "elle", false], [323, 0.065119, " and", false], [645, 0.064316, "ie", false], [12388, 0.06407, "mond", false], [288, 0.034253, "es", false], [32521, 0.028727, " Dad", false], [304, 0.027695, " in", false], [11, 0.024138, ",", false], [1933, 0.020337, "land", false], [2347, 0.01703, "ards", false]]]}, "raw_delta": -0.13580839974539605, "tuned_delta": -0.1272366077148178}, {"byte_start": 29, "byte_end": 30, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "36.91%", "qwen": "18.95%"}, "model_tokens": {"rwkv": [[11, "\n", "control", 0.12926216423511505]], "qwen": [[198, "\n", "control", 0.349587619304657]]}, "loss": {"rwkv": 36.91270514774496, "qwen": 18.95342543052871}, "topk": {"rwkv": [11, 3, 0.12926216423511505, [[45, 0.205069, ",", false], [21265, 0.136185, " and", false], [11, 0.129262, "\n", false], [4600, 0.094519, " is", false], [460, 0.059615, "'s", false], [28309, 0.032636, "’s", false], [21800, 0.029014, " has", false], [59, 0.020669, ":", false], [4712, 0.016245, " on", false], [275, 0.015072, " (", false]]], "qwen": [198, 1, 0.349587619304657, [[198, 0.349588, "\n", false], [11, 0.156176, ",", false], [323, 0.072967, " and", false], [594, 0.045174, "'s", false], [271, 0.036277, "\n\n", false], [320, 0.024252, " (", false], [374, 0.018142, " is", false], [748, 0.015414, "’s", false], [25, 0.013219, ":", false], [702, 0.013153, " has", false]]]}, "raw_delta": 0.9958739280700684, "tuned_delta": 1.0044457201006467}, {"byte_start": 30, "byte_end": 35, "display": {"text": "March", "kind": "normal"}, "is_word": true, "word_id": 5, "word_key": "march", "bytes_hex": "4d 61 72 63 68", "compression": {"rwkv": "21.19% 21.19% 21.19% 21.19% 21.19%", "qwen": "30.01% 30.01% 30.01% 30.01% 30.01%"}, "model_tokens": {"rwkv": [[33258, "March", "normal", 0.002797103952616453]], "qwen": [[27523, "March", "normal", 0.00024377863155677915]]}, "loss": {"rwkv": 21.18958341305665, "qwen": 30.005352182529908}, "topk": {"rwkv": [33258, 55, 0.002797103952616453, [[6699, 0.059922, "The", false], [640, 0.033635, "20", false], [66, 0.028625, "A", false], [58068, 0.027932, "Publisher", false], [1136, 0.02649, "In", false], [125, 0.018289, "|", false], [24242, 0.016773, "This", false], [41, 0.014946, "(", false], [37, 0.012467, "$", false], [58067, 0.011857, "Published", false]]], "qwen": [27523, 510, 0.00024377863155677915, [[785, 0.081713, "The", false], [16, 0.039271, "1", false], [32, 0.029568, "A", false], [1986, 0.018435, "This", false], [25020, 0.017801, "Chapter", false], [17, 0.015555, "2", false], [33, 0.014165, "B", false], [15, 0.011578, "0", false], [50, 0.010767, "S", false], [2082, 0.009907, "An", false]]]}, "raw_delta": -0.4888500213623046, "tuned_delta": -0.48027822933172637}, {"byte_start": 35, "byte_end": 38, "display": {"text": " 13", "kind": "normal"}, "is_word": true, "word_id": 6, "word_key": " 13", "bytes_hex": "20 31 33", "compression": {"rwkv": "23.29% 23.29% 23.29%", "qwen": "0.97% 20.04% 48.62%"}, "model_tokens": {"rwkv": [[3486, " 13", "normal", 0.020677877590060234]], "qwen": [[220, " ", "normal", 0.947685718536377], [16, "1", "normal", 0.32922863960266113], [18, "3", "normal", 0.0674586296081543]]}, "loss": {"rwkv": 23.29351368101972, "qwen": 23.209212465823803}, "topk": {"rwkv": [3486, 14, 0.020677877590060234, [[3493, 0.283004, " 20", false], [3492, 0.054418, " 19", false], [284, 0.033968, " 1", false], [3502, 0.025711, " 29", false], [3501, 0.025462, " 28", false], [3504, 0.023139, " 31", false], [3503, 0.022768, " 30", false], [290, 0.022622, " 7", false], [3487, 0.022213, " 14", false], [3485, 0.021901, " 12", false]]], "qwen": [220, 1, 0.947685718536377, [[220, 0.947686, " ", false], [11, 0.008321, ",", false], [315, 0.005407, " of", false], [287, 0.003772, "ing", false], [198, 0.003389, "\n", false], [374, 0.001193, " is", false], [4102, 0.001136, " ", false], [68, 0.000797, "e", false], [64, 0.000787, "a", false], [278, 0.000753, "al", false]]]}, "raw_delta": 0.004674651970466052, "tuned_delta": 0.0132464440010443}, {"byte_start": 38, "byte_end": 39, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "2.04%", "qwen": "1.07%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8922017812728882]], "qwen": [[11, ",", "normal", 0.9425589442253113]]}, "loss": {"rwkv": 2.042878720008786, "qwen": 1.0668151685550242}, "topk": {"rwkv": [45, 1, 0.8922017812728882, [[45, 0.892202, ",", false], [2209, 0.07081, "th", false], [3493, 0.014269, " 20", false], [11, 0.007555, "\n", false], [261, 0.002672, "\n\n", false], [46, 0.001494, "-", false], [9815, 0.001411, "–", false], [47, 0.001032, ".", false], [280, 0.000825, " -", false], [22897, 0.000727, " –", false]]], "qwen": [11, 1, 0.9425589442253113, [[11, 0.942559, ",", false], [339, 0.020566, "th", false], [220, 0.012831, " ", false], [198, 0.006914, "\n", false], [12, 0.00258, "-", false], [481, 0.002276, " -", false], [345, 0.001089, ",\n", false], [271, 0.001017, "\n\n", false], [13, 0.000906, ".", false], [15, 0.000865, "0", false]]]}, "raw_delta": 0.05412445589900017, "tuned_delta": 0.06269624792957841}, {"byte_start": 39, "byte_end": 42, "display": {"text": " 20", "kind": "normal"}, "is_word": true, "word_id": 7, "word_key": " 20", "bytes_hex": "20 32 30", "compression": {"rwkv": "0.32% 0.32% 0.32%", "qwen": "0.09% 1.65% 0.01%"}, "model_tokens": {"rwkv": [[3493, " 20", "normal", 0.9474717378616333]], "qwen": [[220, " ", "normal", 0.9952646493911743], [17, "2", "normal", 0.9127693772315979], [15, "0", "normal", 0.9992802739143372]]}, "loss": {"rwkv": 0.32433634850714205, "qwen": 0.5815180772308782}, "topk": {"rwkv": [3493, 1, 0.9474717378616333, [[3493, 0.947472, " 20", false], [3492, 0.048254, " 19", false], [11, 0.00068, "\n", false], [3491, 0.000552, " 18", false], [640, 0.000524, "20", false], [3490, 0.000169, " 17", false], [285, 8.2e-05, " 2", false], [284, 7.4e-05, " 1", false], [3485, 7.4e-05, " 12", false], [2430, 7e-05, " ", false]]], "qwen": [220, 1, 0.9952646493911743, [[220, 0.995265, " ", false], [17, 0.001133, "2", false], [4102, 0.000583, " ", false], [16, 0.000191, "1", false], [198, 7.9e-05, "\n", false], [715, 7e-05, " \n", false], [279, 5.3e-05, " the", false], [378, 5.2e-05, "\\xe2\\x80", true], [15585, 4.5e-05, " Chapter", false], [576, 3.2e-05, " The", false]]]}, "raw_delta": -0.014261183212511236, "tuned_delta": -0.005689391181932988}, {"byte_start": 42, "byte_end": 44, "display": {"text": "19", "kind": "normal"}, "is_word": true, "word_id": 8, "word_key": "19", "bytes_hex": "31 39", "compression": {"rwkv": "26.63% 26.63%", "qwen": "10.29% 37.86%"}, "model_tokens": {"rwkv": [[639, "19", "normal", 0.052171628922224045]], "qwen": [[16, "1", "normal", 0.5653393268585205], [24, "9", "normal", 0.12255670875310898]]}, "loss": {"rwkv": 26.627867453907623, "qwen": 24.070560140541627}, "topk": {"rwkv": [639, 8, 0.052171628922224045, [[636, 0.073967, "16", false], [637, 0.067844, "17", false], [638, 0.067624, "18", false], [635, 0.065077, "15", false], [634, 0.060304, "14", false], [633, 0.059129, "13", false], [640, 0.053509, "20", false], [639, 0.052172, "19", false], [632, 0.042047, "12", false], [641, 0.04079, "21", false]]], "qwen": [16, 1, 0.5653393268585205, [[16, 0.565339, "1", false], [15, 0.273209, "0", false], [17, 0.160743, "2", false], [18, 0.000155, "3", false], [19, 7.8e-05, "4", false], [20, 7.4e-05, "5", false], [24, 5.4e-05, "9", false], [220, 5e-05, " ", false], [21, 5e-05, "6", false], [198, 4.7e-05, "\n", false]]]}, "raw_delta": 0.14180722832679749, "tuned_delta": 0.15037902035737574}, {"byte_start": 44, "byte_end": 45, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "9.72%", "qwen": "5.68%"}, "model_tokens": {"rwkv": [[11, "\n", "control", 0.5851910710334778]], "qwen": [[198, "\n", "control", 0.7300056219100952]]}, "loss": {"rwkv": 9.721284943490085, "qwen": 5.675256033267606}, "topk": {"rwkv": [11, 1, 0.5851910710334778, [[11, 0.585191, "\n", false], [261, 0.248785, "\n\n", false], [45, 0.017942, ",", false], [280, 0.011406, " -", false], [4932, 0.010541, " ·", false], [359, 0.010516, " |", false], [22907, 0.00919, " •", false], [275, 0.005888, " (", false], [4424, 0.005582, " at", false], [3328, 0.003885, "\n\n\n", false]]], "qwen": [198, 1, 0.7300056219100952, [[198, 0.730006, "\n", false], [271, 0.076219, "\n\n", false], [220, 0.029873, " ", false], [11, 0.020279, ",", false], [481, 0.015444, " -", false], [760, 0.012802, " |", false], [7288, 0.010354, " •", false], [151643, 0.009148, "\u003c|endoftext|\u003e", false], [9592, 0.007784, " ·", false], [553, 0.007227, " by", false]]]}, "raw_delta": 0.22435948252677917, "tuned_delta": 0.23293127455735743}, {"byte_start": 45, "byte_end": 48, "display": {"text": "The", "kind": "normal"}, "is_word": true, "word_id": 9, "word_key": "the", "bytes_hex": "54 68 65", "compression": {"rwkv": "15.12% 15.12% 15.12%", "qwen": "15.35% 15.35% 15.35%"}, "model_tokens": {"rwkv": [[6699, "The", "normal", 0.08107690513134003]], "qwen": [[785, "The", "normal", 0.07778266817331314]]}, "loss": {"rwkv": 15.121998800984576, "qwen": 15.351697396288186}, "topk": {"rwkv": [6699, 1, 0.08107690513134003, [[6699, 0.081077, "The", false], [74, 0.04096, "I", false], [1136, 0.03956, "In", false], [24242, 0.029413, "This", false], [66, 0.024711, "A", false], [1141, 0.014467, "It", false], [35, 0.014443, "\"", false], [1589, 0.012034, "We", false], [24326, 0.011705, "What", false], [48743, 0.011603, "Summary", false]]], "qwen": [785, 1, 0.07778266817331314, [[785, 0.077783, "The", false], [16, 0.045669, "1", false], [1986, 0.029479, "This", false], [641, 0.02658, "In", false], [17, 0.021241, "2", false], [15949, 0.019793, "Abstract", false], [32, 0.017704, "A", false], [37155, 0.013513, "Introduction", false], [18, 0.013196, "3", false], [25020, 0.011838, "Chapter", false]]]}, "raw_delta": -0.012737194697062248, "tuned_delta": -0.004165402666484}, {"byte_start": 48, "byte_end": 56, "display": {"text": " biggest", "kind": "normal"}, "is_word": true, "word_id": 10, "word_key": " biggest", "bytes_hex": "20 62 69 67 67 65 73 74", "compression": {"rwkv": "15.08% 15.08% 15.08% 15.08% 15.08% 15.08% 15.08% 15.08%", "qwen": "17.46% 17.46% 17.46% 17.46% 17.46% 17.46% 17.46% 17.46%"}, "model_tokens": {"rwkv": [[51039, " biggest", "normal", 0.0012460439465939999]], "qwen": [[8538, " biggest", "normal", 0.00043262317194603384]]}, "loss": {"rwkv": 15.075036071788972, "qwen": 17.460315051400524}, "topk": {"rwkv": [51039, 78, 0.0012460439465939999, [[19523, 0.219893, " Bit", false], [30314, 0.013021, " book", false], [31461, 0.012643, " most", false], [59725, 0.012402, " following", false], [45315, 0.011792, " bitter", false], [46430, 0.011685, " lesson", false], [39966, 0.011423, " title", false], [21365, 0.010079, " bit", false], [39831, 0.009246, " story", false], [52569, 0.008596, " problem", false]]], "qwen": [8538, 212, 0.00043262317194603384, [[425, 0.396047, " B", false], [2701, 0.017174, " following", false], [1156, 0.01285, " first", false], [5795, 0.009658, " goal", false], [3491, 0.009548, " problem", false], [2311, 0.009273, " book", false], [17755, 0.005431, " lesson", false], [22079, 0.00476, " Problem", false], [220, 0.004692, " ", false], [1429, 0.004305, " most", false]]]}, "raw_delta": -0.13226795196533203, "tuned_delta": -0.12369615993475379}, {"byte_start": 56, "byte_end": 63, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 11, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"rwkv": "4.73% 4.73% 4.73% 4.73% 4.73% 4.73% 4.73%", "qwen": "4.68% 4.68% 4.68% 4.68% 4.68% 4.68% 4.68%"}, "model_tokens": {"rwkv": [[46430, " lesson", "normal", 0.15862658619880676]], "qwen": [[17755, " lesson", "normal", 0.16280625760555267]]}, "loss": {"rwkv": 4.729817726128715, "qwen": 4.676378416939369}, "topk": {"rwkv": [46430, 1, 0.15862658619880676, [[46430, 0.158627, " lesson", false], [52569, 0.092084, " problem", false], [59281, 0.053773, " challenge", false], [52245, 0.042922, " mistake", false], [47009, 0.029373, " reason", false], [56739, 0.023609, " obstacle", false], [39941, 0.01927, " thing", false], [31887, 0.018967, " risk", false], [47546, 0.011069, " threat", false], [52127, 0.010451, " lessons", false]]], "qwen": [17755, 1, 0.16280625760555267, [[17755, 0.162806, " lesson", false], [3491, 0.111456, " problem", false], [8645, 0.099703, " challenge", false], [16523, 0.061177, " mistake", false], [88374, 0.031043, " takeaway", false], [3166, 0.025807, " thing", false], [6672, 0.023547, " difference", false], [4265, 0.012921, " issue", false], [12761, 0.011748, " surprise", false], [323, 0.009962, " and", false]]]}, "raw_delta": 0.0029633045196533203, "tuned_delta": 0.011535096550231569}, {"byte_start": 63, "byte_end": 68, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 12, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "9.58% 9.58% 9.58% 9.58% 9.58%", "qwen": "9.58% 9.58% 9.58% 9.58% 9.58%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.07134293019771576]], "qwen": [[429, " that", "normal", 0.0701269581913948]]}, "loss": {"rwkv": 9.580396755903271, "qwen": 9.584716960092944}, "topk": {"rwkv": [32227, 3, 0.07134293019771576, [[308, 0.386223, " I", false], [4706, 0.107096, " of", false], [32227, 0.071343, " that", false], [4858, 0.06312, " we", false], [30917, 0.056591, " from", false], [4596, 0.049923, " in", false], [4811, 0.044091, " to", false], [22799, 0.033403, " you", false], [21700, 0.017966, " for", false], [4600, 0.013859, " is", false]]], "qwen": [429, 5, 0.0701269581913948, [[358, 0.284519, " I", false], [315, 0.126414, " of", false], [304, 0.088273, " in", false], [582, 0.079642, " we", false], [429, 0.070127, " that", false], [504, 0.051129, " from", false], [374, 0.033558, " is", false], [498, 0.0333, " you", false], [311, 0.024325, " to", false], [9498, 0.018782, " learned", false]]]}, "raw_delta": -0.0002395629882812056, "tuned_delta": 0.008332229042297043}, {"byte_start": 68, "byte_end": 72, "display": {"text": " can", "kind": "normal"}, "is_word": true, "word_id": 13, "word_key": " can", "bytes_hex": "20 63 61 6e", "compression": {"rwkv": "15.92% 15.92% 15.92% 15.92%", "qwen": "15.66% 15.66% 15.66% 15.66%"}, "model_tokens": {"rwkv": [[21413, " can", "normal", 0.029297227039933205]], "qwen": [[646, " can", "normal", 0.031018095090985298]]}, "loss": {"rwkv": 15.920365197309849, "qwen": 15.658581805299024}, "topk": {"rwkv": [21413, 7, 0.029297227039933205, [[308, 0.297925, " I", false], [52167, 0.06851, " machine", false], [3609, 0.05162, " AI", false], [22590, 0.036706, " the", false], [4858, 0.034413, " we", false], [61594, 0.029794, " artificial", false], [21413, 0.029297, " can", false], [332, 0.017781, " a", false], [22799, 0.017455, " you", false], [30597, 0.015215, " deep", false]]], "qwen": [646, 4, 0.031018095090985298, [[358, 0.439486, " I", false], [582, 0.078553, " we", false], [498, 0.037389, " you", false], [646, 0.031018, " can", false], [264, 0.028214, " a", false], [279, 0.026695, " the", false], [5662, 0.014207, " machine", false], [12677, 0.013768, " humans", false], [46069, 0.012944, " Rein", false], [4041, 0.011765, " comes", false]]]}, "raw_delta": 0.014516353607177734, "tuned_delta": 0.023088145637755984}, {"byte_start": 72, "byte_end": 75, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 14, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"rwkv": "0.73% 0.73% 0.73%", "qwen": "0.73% 0.73% 0.73%"}, "model_tokens": {"rwkv": [[4435, " be", "normal", 0.8857272863388062]], "qwen": [[387, " be", "normal", 0.8855698108673096]]}, "loss": {"rwkv": 0.7308574731065915, "qwen": 0.7305084468570671}, "topk": {"rwkv": [4435, 1, 0.8857272863388062, [[4435, 0.885727, " be", false], [30482, 0.03963, " come", false], [31073, 0.010376, " help", false], [39903, 0.009478, " teach", false], [30789, 0.00811, " ever", false], [56896, 0.006009, " possibly", false], [28310, 0.002412, "’t", false], [461, 0.002379, "'t", false], [45846, 0.00181, " emerge", false], [31946, 0.001196, " save", false]]], "qwen": [387, 1, 0.8855698108673096, [[387, 0.88557, " be", false], [2525, 0.048234, " come", false], [1492, 0.009508, " help", false], [3512, 0.005803, " ever", false], [4538, 0.003257, " teach", false], [10767, 0.002551, " possibly", false], [2297, 0.002033, " change", false], [32944, 0.001749, " emerge", false], [1281, 0.001438, " make", false], [944, 0.001403, "'t", false]]]}, "raw_delta": 1.9354124863944777e-05, "tuned_delta": 0.008591146155442193}, {"byte_start": 75, "byte_end": 80, "display": {"text": " read", "kind": "normal"}, "is_word": true, "word_id": 15, "word_key": " read", "bytes_hex": "20 72 65 61 64", "compression": {"rwkv": "26.15% 26.15% 26.15% 26.15% 26.15%", "qwen": "32.52% 32.52% 32.52% 32.52% 32.52%"}, "model_tokens": {"rwkv": [[31834, " read", "normal", 0.0006952342810109258]], "qwen": [[1349, " read", "normal", 0.00012139618047513068]]}, "loss": {"rwkv": 26.14884761611246, "qwen": 32.519972434549345}, "topk": {"rwkv": [31834, 15, 0.0006952342810109258, [[52112, 0.718141, " learned", false], [38297, 0.112894, " drawn", false], [39887, 0.04311, " taken", false], [47512, 0.02621, " taught", false], [46418, 0.022067, " learnt", false], [21762, 0.018003, " gle", false], [51438, 0.01264, " derived", false], [59697, 0.010629, " extracted", false], [46071, 0.005063, " gained", false], [50937, 0.001483, " applied", false]]], "qwen": [1349, 49, 0.00012139618047513068, [[9498, 0.829011, " learned", false], [49250, 0.066563, " learnt", false], [14764, 0.019995, " drawn", false], [15599, 0.019093, " taught", false], [4429, 0.013984, " taken", false], [14257, 0.008978, " derived", false], [18163, 0.006738, " gained", false], [94016, 0.005617, " glean", false], [27432, 0.004285, " extracted", false], [9251, 0.001362, " applied", false]]]}, "raw_delta": -0.35329017639160165, "tuned_delta": -0.3447183843610234}, {"byte_start": 80, "byte_end": 85, "display": {"text": " from", "kind": "normal"}, "is_word": true, "word_id": 16, "word_key": " from", "bytes_hex": "20 66 72 6f 6d", "compression": {"rwkv": "2.56% 2.56% 2.56% 2.56% 2.56%", "qwen": "1.74% 1.74% 1.74% 1.74% 1.74%"}, "model_tokens": {"rwkv": [[30917, " from", "normal", 0.491812527179718]], "qwen": [[504, " from", "normal", 0.6165587902069092]]}, "loss": {"rwkv": 2.564165014079993, "qwen": 1.7442240749686408}, "topk": {"rwkv": [30917, 1, 0.491812527179718, [[30917, 0.491813, " from", false], [31162, 0.325114, " into", false], [51035, 0.05571, " between", false], [4596, 0.047439, " in", false], [22249, 0.03067, " out", false], [22218, 0.006695, " off", false], [4450, 0.005362, " by", false], [4811, 0.003151, " to", false], [4712, 0.002252, " on", false], [11, 0.001954, "\n", false]]], "qwen": [504, 1, 0.6165587902069092, [[504, 0.616559, " from", false], [304, 0.120954, " in", false], [1119, 0.042574, " into", false], [700, 0.032714, " out", false], [911, 0.024167, " about", false], [1588, 0.015949, " here", false], [374, 0.013519, " is", false], [1007, 0.01317, " off", false], [389, 0.011411, " on", false], [1948, 0.010526, " between", false]]]}, "raw_delta": 0.04546718001365661, "tuned_delta": 0.05403897204423486}, {"byte_start": 85, "byte_end": 88, "display": {"text": " 70", "kind": "normal"}, "is_word": true, "word_id": 17, "word_key": " 70", "bytes_hex": "20 37 30", "compression": {"rwkv": "63.12% 63.12% 63.12%", "qwen": "94.00% 66.29% 22.98%"}, "model_tokens": {"rwkv": [[3543, " 70", "normal", 2.7540681912796572e-05]], "qwen": [[220, " ", "normal", 0.005448168609291315], [22, "7", "normal", 0.025329088792204857], [15, "0", "normal", 0.2796103358268738]]}, "loss": {"rwkv": 63.11790803889214, "qwen": 61.08993448195813}, "topk": {"rwkv": [3543, 1343, 2.7540681912796572e-05, [[22590, 0.397948, " the", false], [32234, 0.092111, " this", false], [332, 0.029461, " a", false], [44940, 0.016768, " Sutton", false], [28753, 0.015545, " Deep", false], [51929, 0.015387, " history", false], [3609, 0.014973, " AI", false], [4677, 0.014567, " my", false], [52167, 0.011005, " machine", false], [21256, 0.009521, " all", false]]], "qwen": [220, 15, 0.005448168609291315, [[279, 0.268288, " the", false], [419, 0.195308, " this", false], [73013, 0.057031, " Sutton", false], [1493, 0.041197, " these", false], [678, 0.032129, " all", false], [576, 0.020956, " The", false], [264, 0.020694, " a", false], [894, 0.015734, " any", false], [847, 0.015447, " my", false], [1039, 0.013623, " our", false]]]}, "raw_delta": 0.11245473225911458, "tuned_delta": 0.12102652428969282}, {"byte_start": 88, "byte_end": 94, "display": {"text": " years", "kind": "normal"}, "is_word": true, "word_id": 18, "word_key": " years", "bytes_hex": "20 79 65 61 72 73", "compression": {"rwkv": "0.94% 0.94% 0.94% 0.94% 0.94% 0.94%", "qwen": "2.10% 2.10% 2.10% 2.10% 2.10% 2.10%"}, "model_tokens": {"rwkv": [[40237, " years", "normal", 0.7334799766540527]], "qwen": [[1635, " years", "normal", 0.49800431728363037]]}, "loss": {"rwkv": 0.9392545839120855, "qwen": 2.0953538514617325}, "topk": {"rwkv": [40237, 1, 0.7334799766540527, [[40237, 0.73348, " years", false], [49, 0.083016, "0", false], [44, 0.033759, "+", false], [45, 0.019636, ",", false], [46, 0.019306, "-", false], [620, 0.016608, "00", false], [38, 0.015833, "%", false], [52232, 0.007649, " million", false], [116, 0.004217, "s", false], [51041, 0.004031, " billion", false]]], "qwen": [1635, 1, 0.49800431728363037, [[1635, 0.498004, " years", false], [15, 0.166918, "0", false], [11, 0.063044, ",", false], [10, 0.057261, "+", false], [82, 0.035846, "s", false], [4, 0.020973, "%", false], [594, 0.014383, "'s", false], [748, 0.011282, "’s", false], [3526, 0.011117, " million", false], [4666, 0.00788, "-year", false]]]}, "raw_delta": -0.06410775581995644, "tuned_delta": -0.05553596378937819}, {"byte_start": 94, "byte_end": 97, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 19, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.25% 0.25% 0.25%", "qwen": "0.21% 0.21% 0.21%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9601571559906006]], "qwen": [[315, " of", "normal", 0.9662426114082336]]}, "loss": {"rwkv": 0.2450867429895598, "qwen": 0.20642770791094583}, "topk": {"rwkv": [4706, 1, 0.9601571559906006, [[4706, 0.960157, " of", false], [4596, 0.009767, " in", false], [40218, 0.005726, " worth", false], [9820, 0.003616, "’", false], [40, 0.00344, "'", false], [4715, 0.002236, " or", false], [21240, 0.00155, " ago", false], [21265, 0.001358, " and", false], [11, 0.001258, "\n", false], [32487, 0.00109, " with", false]]], "qwen": [315, 1, 0.9662426114082336, [[315, 0.966243, " of", false], [304, 0.005526, " in", false], [5802, 0.004527, " worth", false], [198, 0.002633, "\n", false], [4134, 0.002496, " ago", false], [527, 0.00184, "’", false], [323, 0.001746, " and", false], [6, 0.001554, "'", false], [320, 0.001478, " (", false], [374, 0.000932, " is", false]]]}, "raw_delta": 0.002143712093432743, "tuned_delta": 0.010715504124010991}, {"byte_start": 97, "byte_end": 100, "display": {"text": " AI", "kind": "normal"}, "is_word": true, "word_id": 20, "word_key": " ai", "bytes_hex": "20 41 49", "compression": {"rwkv": "9.16% 9.16% 9.16%", "qwen": "18.81% 18.81% 18.81%"}, "model_tokens": {"rwkv": [[3609, " AI", "normal", 0.21808527410030365]], "qwen": [[15235, " AI", "normal", 0.04373104125261307]]}, "loss": {"rwkv": 9.157732193142833, "qwen": 18.813326929947113}, "topk": {"rwkv": [3609, 1, 0.21808527410030365, [[3609, 0.218085, " AI", false], [61594, 0.101622, " artificial", false], [52167, 0.064662, " machine", false], [51929, 0.050904, " history", false], [59346, 0.042182, " computing", false], [55809, 0.034715, " computer", false], [57103, 0.033097, " research", false], [22590, 0.023331, " the", false], [56950, 0.017641, " progress", false], [61290, 0.015472, " Artificial", false]]], "qwen": [15235, 3, 0.04373104125261307, [[3412, 0.184863, " research", false], [71278, 0.146839, " reinforcement", false], [15235, 0.043731, " AI", false], [5662, 0.039956, " machine", false], [3139, 0.035446, " experience", false], [975, 0.034034, " work", false], [6366, 0.015723, " computer", false], [3738, 0.015547, " human", false], [279, 0.013831, " the", false], [20443, 0.012459, " artificial", false]]]}, "raw_delta": -0.5354198614756267, "tuned_delta": -0.5268480694450485}, {"byte_start": 100, "byte_end": 109, "display": {"text": " research", "kind": "normal"}, "is_word": true, "word_id": 21, "word_key": " research", "bytes_hex": "20 72 65 73 65 61 72 63 68", "compression": {"rwkv": "1.38% 1.38% 1.38% 1.38% 1.38% 1.38% 1.38% 1.38% 1.38%", "qwen": "0.93% 0.93% 0.93% 0.93% 0.93% 0.93% 0.93% 0.93% 0.93%"}, "model_tokens": {"rwkv": [[57103, " research", "normal", 0.5041630268096924]], "qwen": [[3412, " research", "normal", 0.6299545168876648]]}, "loss": {"rwkv": 1.3775733897377254, "qwen": 0.925945037653647}, "topk": {"rwkv": [57103, 1, 0.5041630268096924, [[57103, 0.504163, " research", false], [4600, 0.147673, " is", false], [63469, 0.086549, " development", false], [56950, 0.071011, " progress", false], [51929, 0.057797, " history", false], [32499, 0.012227, " work", false], [21265, 0.006548, " and", false], [45, 0.006184, ",", false], [59, 0.005794, ":", false], [62183, 0.00323, " literature", false]]], "qwen": [3412, 1, 0.6299545168876648, [[3412, 0.629955, " research", false], [374, 0.16431, " is", false], [3840, 0.03876, " history", false], [3139, 0.016074, " experience", false], [323, 0.013818, " and", false], [4401, 0.013259, " development", false], [198, 0.012023, "\n", false], [5098, 0.008429, " progress", false], [11, 0.00837, ",", false], [975, 0.006823, " work", false]]]}, "raw_delta": 0.025043593512641068, "tuned_delta": 0.033615385543219314}, {"byte_start": 109, "byte_end": 112, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 22, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "1.34% 1.34% 1.34%", "qwen": "1.30% 1.30% 1.30%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.800688624382019]], "qwen": [[374, " is", "normal", 0.8059275150299072]]}, "loss": {"rwkv": 1.3384377820747217, "qwen": 1.2969914859798395}, "topk": {"rwkv": [4600, 1, 0.800688624382019, [[4600, 0.800689, " is", false], [45, 0.045093, ",", false], [59, 0.029849, ":", false], [21265, 0.016647, " and", false], [11, 0.007777, "\n", false], [275, 0.007463, " (", false], [4596, 0.007396, " in", false], [64, 0.004961, "?", false], [47, 0.004035, ".", false], [32227, 0.003329, " that", false]]], "qwen": [374, 1, 0.8059275150299072, [[374, 0.805928, " is", false], [323, 0.036311, " and", false], [11, 0.033098, ",", false], [198, 0.017596, "\n", false], [304, 0.013902, " in", false], [25, 0.01129, ":", false], [320, 0.008696, " (", false], [389, 0.0061, " on", false], [13, 0.003515, ".", false], [429, 0.002065, " that", false]]]}, "raw_delta": 0.002298270662625626, "tuned_delta": 0.010870062693203874}, {"byte_start": 112, "byte_end": 117, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 23, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "1.85% 1.85% 1.85% 1.85% 1.85%", "qwen": "2.50% 2.50% 2.50% 2.50% 2.50%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.5976323485374451]], "qwen": [[429, " that", "normal", 0.500173807144165]]}, "loss": {"rwkv": 1.8456352573872479, "qwen": 2.4987466833014254}, "topk": {"rwkv": [32227, 1, 0.5976323485374451, [[32227, 0.597632, " that", false], [32234, 0.139602, " this", false], [22187, 0.042725, " not", false], [59, 0.036704, ":", false], [22590, 0.035134, " the", false], [332, 0.011383, " a", false], [4811, 0.009509, " to", false], [21835, 0.008283, " how", false], [45, 0.007729, ",", false], [269, 0.006636, " \"", false]]], "qwen": [429, 1, 0.500173807144165, [[429, 0.500174, " that", false], [279, 0.096222, " the", false], [419, 0.095586, " this", false], [25, 0.052095, ":", false], [537, 0.02853, " not", false], [1246, 0.021607, " how", false], [311, 0.019934, " to", false], [825, 0.013768, " one", false], [11, 0.011314, ",", false], [4658, 0.010545, " probably", false]]]}, "raw_delta": -0.03621618747711182, "tuned_delta": -0.02764439544653357}, {"byte_start": 117, "byte_end": 125, "display": {"text": " general", "kind": "normal"}, "is_word": true, "word_id": 24, "word_key": " general", "bytes_hex": "20 67 65 6e 65 72 61 6c", "compression": {"rwkv": "14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09%", "qwen": "13.08% 13.08% 13.08% 13.08% 13.08% 13.08% 13.08% 13.08%"}, "model_tokens": {"rwkv": [[51832, " general", "normal", 0.0019046157831326127]], "qwen": [[4586, " general", "normal", 0.0030250304844230413]]}, "loss": {"rwkv": 14.088818758681281, "qwen": 13.076304223365101}, "topk": {"rwkv": [51832, 69, 0.0019046157831326127, [[22590, 0.104384, " the", false], [4601, 0.10392, " it", false], [4858, 0.056042, " we", false], [3609, 0.054266, " AI", false], [39934, 0.032553, " there", false], [45, 0.027136, ",", false], [22799, 0.021851, " you", false], [56950, 0.021794, " progress", false], [269, 0.018809, " \"", false], [4588, 0.018808, " if", false]]], "qwen": [4586, 48, 0.0030250304844230413, [[279, 0.099251, " the", false], [432, 0.067776, " it", false], [1052, 0.061612, " there", false], [582, 0.054925, " we", false], [498, 0.053064, " you", false], [264, 0.028246, " a", false], [12677, 0.0213, " humans", false], [6832, 0.019795, " learning", false], [421, 0.018688, " if", false], [902, 0.017065, " no", false]]]}, "raw_delta": 0.05614572763442993, "tuned_delta": 0.06471751966500817}, {"byte_start": 125, "byte_end": 133, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 25, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "11.55% 11.55% 11.55% 11.55% 11.55% 11.55% 11.55% 11.55%", "qwen": "9.43% 9.43% 9.43% 9.43% 9.43% 9.43% 9.43% 9.43%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.0059340461157262325]], "qwen": [[5413, " methods", "normal", 0.015259837731719017]]}, "loss": {"rwkv": 11.55283138211865, "qwen": 9.42830712328745}, "topk": {"rwkv": [52224, 13, 0.0059340461157262325, [[64452, 0.322388, " intelligence", false], [3609, 0.237909, " AI", false], [46, 0.129946, "-", false], [61594, 0.064977, " artificial", false], [52610, 0.041545, " purpose", false], [45, 0.022353, ",", false], [7919, 0.019636, "ist", false], [7933, 0.012819, "ity", false], [63659, 0.010023, " intelligent", false], [52167, 0.009209, " machine", false]]], "qwen": [5413, 11, 0.015259837731719017, [[2022, 0.265766, "ization", false], [11229, 0.17726, " intelligence", false], [58238, 0.089942, "-purpose", false], [3491, 0.04714, " problem", false], [15235, 0.046259, " AI", false], [4849, 0.044556, "izing", false], [7428, 0.026199, " purpose", false], [6832, 0.025554, " learning", false], [7923, 0.019115, "isation", false], [6540, 0.018468, " knowledge", false]]]}, "raw_delta": 0.11780864000320435, "tuned_delta": 0.1263804320337826}, {"byte_start": 133, "byte_end": 138, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 26, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "10.99% 10.99% 10.99% 10.99% 10.99%", "qwen": "10.81% 10.81% 10.81% 10.81% 10.81%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.04722457751631737]], "qwen": [[429, " that", "normal", 0.049904197454452515]]}, "loss": {"rwkv": 10.9892786317714, "qwen": 10.811737501632706}, "topk": {"rwkv": [32227, 4, 0.04722457751631737, [[21286, 0.158583, " are", false], [21700, 0.137361, " for", false], [4706, 0.104041, " of", false], [32227, 0.047225, " that", false], [21265, 0.044263, " and", false], [21413, 0.039054, " can", false], [21556, 0.03469, " don", false], [32475, 0.034499, " will", false], [45, 0.029011, ",", false], [4491, 0.0267, " do", false]]], "qwen": [429, 4, 0.049904197454452515, [[525, 0.289964, " are", false], [369, 0.190641, " for", false], [315, 0.055679, " of", false], [429, 0.049904, " that", false], [653, 0.046371, " do", false], [323, 0.030326, " and", false], [11, 0.025965, ",", false], [311, 0.023332, " to", false], [1513, 0.022734, " don", false], [614, 0.017888, " have", false]]]}, "raw_delta": 0.009844970703124956, "tuned_delta": 0.018416762733703206}, {"byte_start": 138, "byte_end": 147, "display": {"text": " leverage", "kind": "normal"}, "is_word": true, "word_id": 27, "word_key": " leverage", "bytes_hex": "20 6c 65 76 65 72 61 67 65", "compression": {"rwkv": "14.46% 14.46% 14.46% 14.46% 14.46% 14.46% 14.46% 14.46% 14.46%", "qwen": "14.46% 14.46% 14.46% 14.46% 14.46% 14.46% 14.46% 14.46% 14.46%"}, "model_tokens": {"rwkv": [[56540, " leverage", "normal", 0.0007237948011606932]], "qwen": [[32064, " leverage", "normal", 0.0007328909123316407]]}, "loss": {"rwkv": 14.464520592246116, "qwen": 14.464046684497074}, "topk": {"rwkv": [56540, 96, 0.0007237948011606932, [[32499, 0.409284, " work", false], [21286, 0.063323, " are", false], [31967, 0.047712, " seem", false], [31059, 0.02765, " have", false], [31324, 0.027242, " look", false], [21413, 0.023612, " can", false], [45185, 0.01999, " appear", false], [32462, 0.013896, " were", false], [39740, 0.01338, " solve", false], [53051, 0.013376, " succeed", false]]], "qwen": [32064, 95, 0.0007328909123316407, [[975, 0.316427, " work", false], [646, 0.150735, " can", false], [525, 0.097766, " are", false], [3796, 0.039363, " apply", false], [614, 0.021262, " have", false], [11625, 0.01701, " solve", false], [5452, 0.016156, " scale", false], [653, 0.015514, " do", false], [686, 0.013696, " will", false], [2138, 0.012736, " allow", false]]]}, "raw_delta": 2.6279025607700568e-05, "tuned_delta": 0.008598071056185949}, {"byte_start": 147, "byte_end": 159, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 28, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "8.97% 8.97% 8.97% 8.97% 8.97% 8.97% 8.97% 8.97% 8.97% 8.97% 8.97% 8.97%", "qwen": "11.05% 11.05% 11.05% 11.05% 11.05% 11.05% 11.05% 11.05% 11.05% 11.05% 11.05% 11.05%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.002536177635192871]], "qwen": [[34447, " computation", "normal", 0.0006424598395824432]]}, "loss": {"rwkv": 8.969881276360415, "qwen": 11.04594404885318}, "topk": {"rwkv": [63370, 65, 0.002536177635192871, [[22590, 0.130945, " the", false], [30597, 0.045286, " deep", false], [63885, 0.044737, " statistical", false], [332, 0.031537, " a", false], [30579, 0.027136, " data", false], [52167, 0.023547, " machine", false], [38864, 0.02346, " large", false], [52195, 0.022602, " massive", false], [55465, 0.019176, " advances", false], [38720, 0.019159, " human", false]]], "qwen": [34447, 201, 0.0006424598395824432, [[279, 0.123796, " the", false], [3738, 0.062438, " human", false], [264, 0.041242, " a", false], [821, 0.029322, " data", false], [4867, 0.02503, " prior", false], [7947, 0.023999, " domain", false], [28464, 0.021281, " statistical", false], [3460, 0.021071, " large", false], [6540, 0.018823, " knowledge", false], [3139, 0.015167, " experience", false]]]}, "raw_delta": -0.11512136459350587, "tuned_delta": -0.10654957256292763}, {"byte_start": 159, "byte_end": 163, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 29, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"rwkv": "9.09% 9.09% 9.09% 9.09%", "qwen": "5.74% 5.74% 5.74% 5.74%"}, "model_tokens": {"rwkv": [[21286, " are", "normal", 0.13226008415222168]], "qwen": [[525, " are", "normal", 0.2796705365180969]]}, "loss": {"rwkv": 9.087288099349427, "qwen": 5.744374248312017}, "topk": {"rwkv": [21286, 3, 0.13226008415222168, [[4811, 0.149732, " to", false], [21265, 0.141678, " and", false], [21286, 0.13226, " are", false], [32475, 0.041961, " will", false], [45, 0.040492, ",", false], [4596, 0.035777, " in", false], [21413, 0.034579, " can", false], [39339, 0.033575, " power", false], [31059, 0.03172, " have", false], [4491, 0.016033, " do", false]]], "qwen": [525, 1, 0.2796705365180969, [[525, 0.279671, " are", false], [323, 0.119331, " and", false], [311, 0.113936, " to", false], [2355, 0.060554, " power", false], [11, 0.03411, ",", false], [614, 0.030285, " have", false], [653, 0.027643, " do", false], [646, 0.026449, " can", false], [304, 0.024634, " in", false], [369, 0.016129, " for", false]]]}, "raw_delta": 0.18537050485610962, "tuned_delta": 0.19394229688668788}, {"byte_start": 163, "byte_end": 174, "display": {"text": " ultimately", "kind": "normal"}, "is_word": true, "word_id": 30, "word_key": " ultimately", "bytes_hex": "20 75 6c 74 69 6d 61 74 65 6c 79", "compression": {"rwkv": "9.38% 9.38% 9.38% 9.38% 9.38% 9.38% 9.38% 9.38% 9.38% 9.38% 9.38%", "qwen": "11.04% 11.04% 11.04% 11.04% 11.04% 11.04% 11.04% 11.04% 11.04% 11.04% 11.04%"}, "model_tokens": {"rwkv": [[62676, " ultimately", "normal", 0.0032697974238544703]], "qwen": [[13653, " ultimately", "normal", 0.0011913263006135821]]}, "loss": {"rwkv": 9.375468483049724, "qwen": 11.037744906263184}, "topk": {"rwkv": [62676, 53, 0.0032697974238544703, [[22590, 0.120008, " the", false], [22187, 0.062472, " not", false], [31458, 0.057449, " more", false], [46439, 0.040575, " likely", false], [31466, 0.038421, " much", false], [21660, 0.037073, " far", false], [332, 0.028238, " a", false], [38606, 0.027552, " going", false], [45145, 0.020359, " almost", false], [45301, 0.020349, " better", false]]], "qwen": [13653, 98, 0.0011913263006135821, [[537, 0.088327, " not", false], [803, 0.087442, " more", false], [279, 0.065257, " the", false], [1753, 0.050196, " much", false], [3041, 0.048153, " far", false], [2664, 0.031781, " better", false], [7565, 0.028479, " essential", false], [16353, 0.026478, " superior", false], [3545, 0.024984, " often", false], [1602, 0.021899, " very", false]]]}, "raw_delta": -0.09217617728493432, "tuned_delta": -0.08360438525435608}, {"byte_start": 174, "byte_end": 178, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 31, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "9.79% 9.79% 9.79% 9.79%", "qwen": "14.63% 14.63% 14.63% 14.63%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.11399377882480621]], "qwen": [[279, " the", "normal", 0.03898989409208298]]}, "loss": {"rwkv": 9.79172903728349, "qwen": 14.627363081809944}, "topk": {"rwkv": [22590, 2, 0.11399377882480621, [[31458, 0.160758, " more", false], [22590, 0.113994, " the", false], [45301, 0.055493, " better", false], [38606, 0.047442, " going", false], [45781, 0.043193, " doomed", false], [31466, 0.035475, " much", false], [31277, 0.033992, " less", false], [52140, 0.033616, " limited", false], [22187, 0.029268, " not", false], [57350, 0.027639, " superior", false]]], "qwen": [279, 7, 0.03898989409208298, [[803, 0.130619, " more", false], [7199, 0.071714, " limited", false], [16353, 0.06177, " superior", false], [2664, 0.047314, " better", false], [57637, 0.042213, " doomed", false], [537, 0.039317, " not", false], [279, 0.03899, " the", false], [1753, 0.037011, " much", false], [2686, 0.036432, " less", false], [37179, 0.020377, " inferior", false]]]}, "raw_delta": -0.26814448833465576, "tuned_delta": -0.25957269630407753}, {"byte_start": 178, "byte_end": 183, "display": {"text": " most", "kind": "normal"}, "is_word": true, "word_id": 32, "word_key": " most", "bytes_hex": "20 6d 6f 73 74", "compression": {"rwkv": "3.63% 3.63% 3.63% 3.63% 3.63%", "qwen": "4.69% 4.69% 4.69% 4.69% 4.69%"}, "model_tokens": {"rwkv": [[31461, " most", "normal", 0.35932987928390503]], "qwen": [[1429, " most", "normal", 0.272220253944397]]}, "loss": {"rwkv": 3.634915239739771, "qwen": 4.692884144744052}, "topk": {"rwkv": [31461, 1, 0.35932987928390503, [[31461, 0.35933, " most", false], [30273, 0.174263, " best", false], [31581, 0.123636, " only", false], [22752, 0.088107, " way", false], [21952, 0.051324, " key", false], [31580, 0.019204, " ones", false], [31637, 0.015273, " path", false], [39523, 0.011476, " right", false], [38879, 0.007943, " least", false], [51900, 0.006363, " hardest", false]]], "qwen": [1429, 1, 0.272220253944397, [[1429, 0.27222, " most", false], [1172, 0.173044, " only", false], [1850, 0.172389, " best", false], [1376, 0.117854, " key", false], [1616, 0.056885, " way", false], [6894, 0.021108, " keys", false], [6174, 0.015336, " ones", false], [1815, 0.009391, " path", false], [25648, 0.007474, " fastest", false], [2530, 0.006102, " source", false]]]}, "raw_delta": -0.05866625308990479, "tuned_delta": -0.05009446105932654}, {"byte_start": 183, "byte_end": 193, "display": {"text": " effective", "kind": "normal"}, "is_word": true, "word_id": 33, "word_key": " effective", "bytes_hex": "20 65 66 66 65 63 74 69 76 65", "compression": {"rwkv": "3.49% 3.49% 3.49% 3.49% 3.49% 3.49% 3.49% 3.49% 3.49% 3.49%", "qwen": "2.96% 2.96% 2.96% 2.96% 2.96% 2.96% 2.96% 2.96% 2.96% 2.96%"}, "model_tokens": {"rwkv": [[59593, " effective", "normal", 0.14336887001991272]], "qwen": [[7373, " effective", "normal", 0.19383913278579712]]}, "loss": {"rwkv": 3.4940270521529584, "qwen": 2.9588353158245524}, "topk": {"rwkv": [59593, 2, 0.14336887001991272, [[56900, 0.390074, " powerful", false], [59593, 0.143369, " effective", false], [60274, 0.102955, " promising", false], [59829, 0.102474, " important", false], [47687, 0.047406, " useful", false], [62603, 0.030807, " successful", false], [59594, 0.020389, " efficient", false], [56290, 0.020055, " fruitful", false], [47129, 0.013589, " robust", false], [57516, 0.012725, " valuable", false]]], "qwen": [7373, 2, 0.19383913278579712, [[7988, 0.240876, " powerful", false], [7373, 0.193839, " effective", false], [6849, 0.174028, " successful", false], [2989, 0.117221, " important", false], [5390, 0.059075, " useful", false], [15172, 0.055521, " valuable", false], [25383, 0.031705, " promising", false], [11050, 0.013268, " efficient", false], [88584, 0.011966, " fruitful", false], [21765, 0.011342, " robust", false]]]}, "raw_delta": 0.02967733144760132, "tuned_delta": 0.03824912347817957}, {"byte_start": 193, "byte_end": 194, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "48.18%", "qwen": "51.54%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.06937381625175476]], "qwen": [[11, ",", "normal", 0.057391125708818436]]}, "loss": {"rwkv": 48.183760154689985, "qwen": 51.53785610270818}, "topk": {"rwkv": [45, 3, 0.06937381625175476, [[47, 0.354282, ".", false], [22752, 0.212705, " way", false], [45, 0.069374, ",", false], [21700, 0.042457, " for", false], [21265, 0.039353, " and", false], [55532, 0.036333, " approach", false], [4424, 0.027216, " at", false], [31580, 0.024867, " ones", false], [32448, 0.020431, " ways", false], [39979, 0.015784, " tools", false]]], "qwen": [11, 5, 0.057391125708818436, [[13, 0.32337, ".", false], [1616, 0.101312, " way", false], [624, 0.098027, ".\n", false], [6174, 0.05969, " ones", false], [11, 0.057391, ",", false], [369, 0.041388, " for", false], [323, 0.03413, " and", false], [5413, 0.033294, " methods", false], [5486, 0.026549, " approach", false], [19827, 0.023389, " approaches", false]]]}, "raw_delta": -0.185990571975708, "tuned_delta": -0.17741877994512975}, {"byte_start": 194, "byte_end": 198, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 34, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "5.42% 5.42% 5.42% 5.42%", "qwen": "4.75% 4.75% 4.75% 4.75%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.3004497289657593]], "qwen": [[323, " and", "normal", 0.3485313057899475]]}, "loss": {"rwkv": 5.424195222092293, "qwen": 4.751999956303438}, "topk": {"rwkv": [21265, 1, 0.3004497289657593, [[21265, 0.30045, " and", false], [21400, 0.151419, " but", false], [40187, 0.091621, " while", false], [30788, 0.060656, " even", false], [22187, 0.02638, " not", false], [53339, 0.017655, " whereas", false], [51018, 0.015803, " because", false], [61953, 0.015454, " especially", false], [4423, 0.015271, " as", false], [51450, 0.012333, " despite", false]]], "qwen": [323, 1, 0.3485313057899475, [[323, 0.348531, " and", false], [714, 0.111823, " but", false], [1393, 0.062869, " while", false], [1496, 0.038513, " even", false], [537, 0.027169, " not", false], [1576, 0.026478, " because", false], [15484, 0.023397, " regardless", false], [518, 0.020713, " at", false], [438, 0.019853, " as", false], [5310, 0.019235, " especially", false]]]}, "raw_delta": 0.03727442026138306, "tuned_delta": 0.04584621229196131}, {"byte_start": 198, "byte_end": 201, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 35, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "38.32% 38.32% 38.32%", "qwen": "40.06% 40.06% 40.06%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.001680772635154426]], "qwen": [[553, " by", "normal", 0.0012753555784001946]]}, "loss": {"rwkv": 38.321587023613084, "qwen": 40.06201992019205}, "topk": {"rwkv": [4450, 55, 0.001680772635154426, [[32227, 0.390343, " that", false], [22590, 0.074397, " the", false], [32232, 0.029054, " they", false], [4858, 0.019176, " we", false], [4601, 0.014805, " it", false], [4788, 0.01335, " so", false], [4596, 0.010892, " in", false], [32239, 0.010173, " thus", false], [31461, 0.009507, " most", false], [32234, 0.009465, " this", false]]], "qwen": [553, 73, 0.0012753555784001946, [[429, 0.410987, " that", false], [279, 0.063035, " the", false], [4586, 0.027629, " general", false], [419, 0.023899, " this", false], [304, 0.018764, " in", false], [807, 0.014569, " they", false], [5413, 0.0122, " methods", false], [525, 0.009973, " are", false], [264, 0.009383, " a", false], [1846, 0.008567, " those", false]]]}, "raw_delta": -0.09651009241739894, "tuned_delta": -0.0879383003868207}, {"byte_start": 201, "byte_end": 203, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 36, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "17.82% 17.82%", "qwen": "34.47% 34.47%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.13725578784942627]], "qwen": [[264, " a", "normal", 0.021862488240003586]]}, "loss": {"rwkv": 17.82235572973182, "qwen": 34.47124158587966}, "topk": {"rwkv": [332, 2, 0.13725578784942627, [[21660, 0.43749, " far", false], [332, 0.137256, " a", false], [59695, 0.057826, " extension", false], [22590, 0.019556, " the", false], [63617, 0.019521, " implication", false], [22190, 0.019466, " now", false], [21265, 0.014707, " and", false], [55856, 0.013896, " contrast", false], [38888, 0.011271, " lever", false], [32234, 0.010589, " this", false]]], "qwen": [264, 10, 0.021862488240003586, [[3041, 0.264678, " far", false], [8894, 0.082611, " extension", false], [429, 0.061582, " that", false], [4586, 0.046859, " general", false], [76482, 0.036838, " leveraging", false], [419, 0.034214, " this", false], [44378, 0.027155, " inference", false], [12872, 0.023993, " contrast", false], [323, 0.022239, " and", false], [264, 0.021862, " a", false]]]}, "raw_delta": -0.9232102632522583, "tuned_delta": -0.9146384712216801}, {"byte_start": 203, "byte_end": 209, "display": {"text": " large", "kind": "normal"}, "is_word": true, "word_id": 37, "word_key": " large", "bytes_hex": "20 6c 61 72 67 65", "compression": {"rwkv": "5.10% 5.10% 5.10% 5.10% 5.10% 5.10%", "qwen": "5.14% 5.14% 5.14% 5.14% 5.14% 5.14%"}, "model_tokens": {"rwkv": [[38864, " large", "normal", 0.18366272747516632]], "qwen": [[3460, " large", "normal", 0.18076620995998383]]}, "loss": {"rwkv": 5.095456117723063, "qwen": 5.141256172539397}, "topk": {"rwkv": [38864, 2, 0.18366272747516632, [[32470, 0.397292, " wide", false], [38864, 0.183663, " large", false], [31323, 0.096898, " long", false], [31118, 0.093839, " huge", false], [32386, 0.053658, " very", false], [22031, 0.027433, " lot", false], [63870, 0.019972, " significant", false], [64313, 0.013458, " considerable", false], [21357, 0.012689, " big", false], [63893, 0.009749, " substantial", false]]], "qwen": [3460, 2, 0.18076620995998383, [[6884, 0.310814, " wide", false], [3460, 0.180766, " large", false], [1293, 0.126867, " long", false], [1602, 0.068904, " very", false], [6765, 0.045274, " huge", false], [8168, 0.035746, " factor", false], [5089, 0.029993, " significant", false], [11924, 0.013267, " substantial", false], [4745, 0.012768, " margin", false], [23839, 0.012653, " considerable", false]]]}, "raw_delta": -0.002539694309234619, "tuned_delta": 0.006032097721343629}, {"byte_start": 209, "byte_end": 216, "display": {"text": " margin", "kind": "normal"}, "is_word": true, "word_id": 38, "word_key": " margin", "bytes_hex": "20 6d 61 72 67 69 6e", "compression": {"rwkv": "0.21% 0.21% 0.21% 0.21% 0.21% 0.21% 0.21%", "qwen": "0.44% 0.44% 0.44% 0.44% 0.44% 0.44% 0.44%"}, "model_tokens": {"rwkv": [[46513, " margin", "normal", 0.9230954051017761]], "qwen": [[4745, " margin", "normal", 0.8445775508880615]]}, "loss": {"rwkv": 0.20630056039497588, "qwen": 0.43517526410812457}, "topk": {"rwkv": [46513, 1, 0.9230954051017761, [[46513, 0.923095, " margin", false], [45950, 0.014245, " factor", false], [45157, 0.014148, " amount", false], [39189, 0.013748, " order", false], [45690, 0.005961, " degree", false], [56024, 0.005351, " distance", false], [61863, 0.002691, " difference", false], [21732, 0.002382, " gap", false], [45865, 0.001953, " enough", false], [52208, 0.001923, " measure", false]]], "qwen": [4745, 1, 0.8445775508880615, [[4745, 0.844578, " margin", false], [8168, 0.082189, " factor", false], [8381, 0.016987, " degree", false], [3311, 0.01442, " amount", false], [12818, 0.003955, " extent", false], [14501, 0.003616, " stretch", false], [6629, 0.002516, " measure", false], [2990, 0.00228, " lead", false], [198, 0.001796, "\n", false], [323, 0.001686, " and", false]]]}, "raw_delta": -0.012691508446420944, "tuned_delta": -0.004119716415842696}, {"byte_start": 216, "byte_end": 217, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "2.25%", "qwen": "8.42%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.8820807337760925]], "qwen": [[13, ".", "normal", 0.6270043849945068]]}, "loss": {"rwkv": 2.254211001389005, "qwen": 8.418156274529066}, "topk": {"rwkv": [47, 1, 0.8820807337760925, [[47, 0.882081, ".", false], [45, 0.056219, ",", false], [59, 0.012809, ":", false], [275, 0.005843, " (", false], [60, 0.005022, ";", false], [11, 0.004298, "\n", false], [31601, 0.002773, " over", false], [9816, 0.002703, "—", false], [22590, 0.002614, " the", false], [34, 0.002302, "!", false]]], "qwen": [13, 1, 0.6270043849945068, [[13, 0.627004, ".", false], [624, 0.202733, ".\n", false], [11, 0.082328, ",", false], [320, 0.014542, " (", false], [382, 0.012179, ".\n\n", false], [198, 0.007495, "\n", false], [916, 0.006018, " over", false], [279, 0.004519, " the", false], [25, 0.003771, ":", false], [304, 0.002041, " in", false]]]}, "raw_delta": -0.3418017029762268, "tuned_delta": -0.3332299109456486}, {"byte_start": 217, "byte_end": 221, "display": {"text": " The", "kind": "normal"}, "is_word": true, "word_id": 39, "word_key": " the", "bytes_hex": "20 54 68 65", "compression": {"rwkv": "11.55% 11.55% 11.55% 11.55%", "qwen": "10.77% 10.77% 10.77% 10.77%"}, "model_tokens": {"rwkv": [[20996, " The", "normal", 0.07694127410650253]], "qwen": [[576, " The", "normal", 0.09180492162704468]]}, "loss": {"rwkv": 11.55283138211865, "qwen": 10.766514878566642}, "topk": {"rwkv": [20996, 2, 0.07694127410650253, [[11, 0.224108, "\n", false], [20996, 0.076941, " The", false], [29894, 0.071442, " This", false], [261, 0.058636, "\n\n", false], [3913, 0.035882, " In", false], [19555, 0.028653, " But", false], [3918, 0.021731, " It", false], [29889, 0.020379, " That", false], [37451, 0.016261, " There", false], [4331, 0.015068, " We", false]]], "qwen": [576, 2, 0.09180492162704468, [[1096, 0.102863, " This", false], [576, 0.091805, " The", false], [758, 0.053598, " In", false], [1084, 0.031458, " It", false], [358, 0.028216, " I", false], [2619, 0.027395, " There", false], [1205, 0.024915, " We", false], [1988, 0.020156, " But", false], [2938, 0.018816, " That", false], [1752, 0.018054, " For", false]]]}, "raw_delta": 0.04360264539718628, "tuned_delta": 0.05217443742776453}, {"byte_start": 221, "byte_end": 230, "display": {"text": " ultimate", "kind": "normal"}, "is_word": true, "word_id": 40, "word_key": " ultimate", "bytes_hex": "20 75 6c 74 69 6d 61 74 65", "compression": {"rwkv": "14.21% 14.21% 14.21% 14.21% 14.21% 14.21% 14.21% 14.21% 14.21%", "qwen": "12.07% 12.07% 12.07% 12.07% 12.07% 12.07% 12.07% 12.07% 12.07%"}, "model_tokens": {"rwkv": [[57481, " ultimate", "normal", 0.0008178133866749704]], "qwen": [[16724, " ultimate", "normal", 0.0024230415001511574]]}, "loss": {"rwkv": 14.214052703202896, "qwen": 12.068007323696538}, "topk": {"rwkv": [57481, 205, 0.0008178133866749704, [[31461, 0.033933, " most", false], [39193, 0.033696, " other", false], [47205, 0.030411, " second", false], [3609, 0.018932, " AI", false], [31581, 0.017685, " only", false], [46430, 0.017439, " lesson", false], [30273, 0.015236, " best", false], [47009, 0.01198, " reason", false], [38499, 0.011897, " first", false], [51929, 0.010594, " history", false]]], "qwen": [16724, 62, 0.0024230415001511574, [[1429, 0.049734, " most", false], [1850, 0.027735, " best", false], [17755, 0.025101, " lesson", false], [2874, 0.023272, " reason", false], [2070, 0.020655, " field", false], [2086, 0.019784, " second", false], [8538, 0.014146, " biggest", false], [1008, 0.013724, " other", false], [18366, 0.012607, " lessons", false], [1172, 0.012375, " only", false]]]}, "raw_delta": 0.11900202433268224, "tuned_delta": 0.12757381636326048}, {"byte_start": 230, "byte_end": 237, "display": {"text": " reason", "kind": "normal"}, "is_word": true, "word_id": 41, "word_key": " reason", "bytes_hex": "20 72 65 61 73 6f 6e", "compression": {"rwkv": "10.30% 10.30% 10.30% 10.30% 10.30% 10.30% 10.30%", "qwen": "10.78% 10.78% 10.78% 10.78% 10.78% 10.78% 10.78%"}, "model_tokens": {"rwkv": [[47009, " reason", "normal", 0.018070142716169357]], "qwen": [[2874, " reason", "normal", 0.015219236724078655]]}, "loss": {"rwkv": 10.304964577778307, "qwen": 10.782071477116876}, "topk": {"rwkv": [47009, 6, 0.018070142716169357, [[46430, 0.213371, " lesson", false], [30985, 0.0703, " goal", false], [32223, 0.023901, " test", false], [53052, 0.021456, " success", false], [39365, 0.021441, " proof", false], [47009, 0.01807, " reason", false], [51668, 0.017161, " example", false], [57009, 0.014925, " question", false], [3609, 0.014616, " AI", false], [22269, 0.012595, " pay", false]]], "qwen": [2874, 8, 0.015219236724078655, [[5795, 0.197554, " goal", false], [17755, 0.12357, " lesson", false], [4586, 0.046748, " general", false], [2393, 0.02311, " success", false], [9213, 0.020597, " aim", false], [3110, 0.016128, " example", false], [11064, 0.015232, " proof", false], [2874, 0.015219, " reason", false], [1273, 0.013686, " test", false], [1714, 0.013036, " method", false]]]}, "raw_delta": -0.02645642416817806, "tuned_delta": -0.01788463213759981}, {"byte_start": 237, "byte_end": 241, "display": {"text": " for", "kind": "normal"}, "is_word": true, "word_id": 42, "word_key": " for", "bytes_hex": "20 66 6f 72", "compression": {"rwkv": "6.09% 6.09% 6.09% 6.09%", "qwen": "3.90% 3.90% 3.90% 3.90%"}, "model_tokens": {"rwkv": [[21700, " for", "normal", 0.2587900459766388]], "qwen": [[369, " for", "normal", 0.4208017885684967]]}, "loss": {"rwkv": 6.093414113129654, "qwen": 3.902460211788234}, "topk": {"rwkv": [21700, 2, 0.2587900459766388, [[32227, 0.277901, " that", false], [21700, 0.25879, " for", false], [22763, 0.09179, " why", false], [4600, 0.074122, " is", false], [4858, 0.051622, " we", false], [4811, 0.046548, " to", false], [3609, 0.032191, " AI", false], [32234, 0.023367, " this", false], [22590, 0.019209, " the", false], [45290, 0.008831, " behind", false]]], "qwen": [369, 1, 0.4208017885684967, [[369, 0.420802, " for", false], [374, 0.30178, " is", false], [429, 0.070091, " that", false], [3170, 0.062996, " why", false], [4815, 0.032831, " behind", false], [419, 0.018419, " this", false], [582, 0.010519, " we", false], [11, 0.010184, ",", false], [1660, 0.004257, " being", false], [30, 0.004198, "?", false]]]}, "raw_delta": 0.12149228155612946, "tuned_delta": 0.1300640735867077}, {"byte_start": 241, "byte_end": 246, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 43, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "2.80% 2.80% 2.80% 2.80% 2.80%", "qwen": "0.38% 0.38% 0.38% 0.38% 0.38%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.4604005217552185]], "qwen": [[419, " this", "normal", 0.8994473218917847]]}, "loss": {"rwkv": 2.8036749329775748, "qwen": 0.3822233529835437}, "topk": {"rwkv": [32234, 1, 0.4604005217552185, [[32234, 0.460401, " this", false], [22590, 0.238819, " the", false], [32227, 0.073167, " that", false], [3609, 0.033307, " AI", false], [53052, 0.016651, " success", false], [22248, 0.010162, " our", false], [21256, 0.007483, " all", false], [56950, 0.006149, " progress", false], [4677, 0.004905, " my", false], [39936, 0.00456, " these", false]]], "qwen": [419, 1, 0.8994473218917847, [[419, 0.899447, " this", false], [429, 0.043323, " that", false], [279, 0.018447, " the", false], [3170, 0.004849, " why", false], [4586, 0.002428, " general", false], [1039, 0.00165, " our", false], [2393, 0.001436, " success", false], [862, 0.000959, " their", false], [678, 0.000934, " all", false], [1667, 0.000867, " using", false]]]}, "raw_delta": 0.134273786842823, "tuned_delta": 0.14284557887340127}, {"byte_start": 246, "byte_end": 249, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 44, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "1.70% 1.70% 1.70%", "qwen": "1.48% 1.48% 1.48%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.75510174036026]], "qwen": [[374, " is", "normal", 0.7817800045013428]]}, "loss": {"rwkv": 1.702398933340655, "qwen": 1.4798559807788028}, "topk": {"rwkv": [4600, 1, 0.75510174036026, [[4600, 0.755102, " is", false], [45, 0.028254, ",", false], [53052, 0.021732, " success", false], [46430, 0.012572, " lesson", false], [31291, 0.011227, " lies", false], [21800, 0.011028, " has", false], [22748, 0.008541, " was", false], [47092, 0.007684, " result", false], [30808, 0.006521, " fact", false], [21413, 0.006098, " can", false]]], "qwen": [374, 1, 0.7817800045013428, [[374, 0.78178, " is", false], [11, 0.022543, ",", false], [15448, 0.01882, " lies", false], [16688, 0.012301, " conclusion", false], [646, 0.009791, " can", false], [702, 0.009129, " has", false], [4977, 0.009058, " seems", false], [21930, 0.008822, " observation", false], [17755, 0.00673, " lesson", false], [1102, 0.006493, " result", false]]]}, "raw_delta": 0.012340401609738677, "tuned_delta": 0.020912193640316927}, {"byte_start": 249, "byte_end": 255, "display": {"text": " Moore", "kind": "normal"}, "is_word": true, "word_id": 45, "word_key": " moore", "bytes_hex": "20 4d 6f 6f 72 65", "compression": {"rwkv": "20.66% 20.66% 20.66% 20.66% 20.66% 20.66%", "qwen": "21.22% 21.22% 21.22% 21.22% 21.22% 21.22%"}, "model_tokens": {"rwkv": [[37045, " Moore", "normal", 0.0010319792199879885]], "qwen": [[20219, " Moore", "normal", 0.0008584775496274233]]}, "loss": {"rwkv": 20.66360084606588, "qwen": 21.22069134830696}, "topk": {"rwkv": [37045, 43, 0.0010319792199879885, [[32227, 0.64783, " that", false], [22590, 0.066861, " the", false], [51018, 0.038809, " because", false], [47284, 0.03059, " simple", false], [22187, 0.017243, " not", false], [47285, 0.015204, " simply", false], [332, 0.013898, " a", false], [45, 0.008819, ",", false], [56937, 0.004951, " probably", false], [4706, 0.004746, " of", false]]], "qwen": [20219, 42, 0.0008584775496274233, [[429, 0.652205, " that", false], [279, 0.065473, " the", false], [1576, 0.041846, " because", false], [4285, 0.032524, " simple", false], [537, 0.023759, " not", false], [4936, 0.023078, " simply", false], [264, 0.008186, " a", false], [54480, 0.007306, " computational", false], [11, 0.004318, ",", false], [4658, 0.003951, " probably", false]]]}, "raw_delta": -0.03089165687561035, "tuned_delta": -0.0223198648450321}, {"byte_start": 255, "byte_end": 257, "display": {"text": "'s", "kind": "normal"}, "is_word": true, "word_id": 46, "word_key": "'s", "bytes_hex": "27 73", "compression": {"rwkv": "6.62% 6.62%", "qwen": "8.29% 8.29%"}, "model_tokens": {"rwkv": [[460, "'s", "normal", 0.48003950715065]], "qwen": [[594, "'s", "normal", 0.3989563584327698]]}, "loss": {"rwkv": 6.621744816580202, "qwen": 8.285607095725963}, "topk": {"rwkv": [460, 2, 0.48003950715065, [[28309, 0.510863, "’s", false], [460, 0.48004, "'s", false], [116, 0.005299, "s", false], [45, 0.000361, ",", false], [21265, 0.000338, " and", false], [9819, 0.000336, "‘", false], [2496, 0.000312, "â", false], [46, 0.000228, "-", false], [47, 0.00013, ".", false], [9222, 0.000128, "´s", false]]], "qwen": [594, 2, 0.3989563584327698, [[748, 0.59176, "’s", false], [594, 0.398956, "'s", false], [527, 0.000957, "’", false], [17744, 0.000841, " ’", false], [42641, 0.000839, "‘s", false], [8835, 0.000813, "â", false], [75151, 0.000435, "’", false], [6, 0.000403, "'", false], [7506, 0.000396, " Law", false], [45149, 0.000378, "\u0026apos", false]]]}, "raw_delta": -0.09226411581039429, "tuned_delta": -0.08369232377981604}, {"byte_start": 257, "byte_end": 261, "display": {"text": " law", "kind": "normal"}, "is_word": true, "word_id": 47, "word_key": " law", "bytes_hex": "20 6c 61 77", "compression": {"rwkv": "4.39% 4.39% 4.39% 4.39%", "qwen": "3.23% 3.23% 3.23% 3.23%"}, "model_tokens": {"rwkv": [[21988, " law", "normal", 0.3774595856666565]], "qwen": [[2329, " law", "normal", 0.4886452555656433]]}, "loss": {"rwkv": 4.385144838639549, "qwen": 3.228564198816081}, "topk": {"rwkv": [21988, 2, 0.3774595856666565, [[20267, 0.617231, " Law", false], [21988, 0.37746, " law", false], [21265, 0.000485, " and", false], [45958, 0.000474, " famous", false], [275, 0.000372, " (", false], [47205, 0.000313, " second", false], [31259, 0.000256, " laws", false], [29262, 0.000249, " Laws", false], [53127, 0.000206, " theorem", false], [44847, 0.000162, " Second", false]]], "qwen": [2329, 2, 0.4886452555656433, [[7506, 0.505915, " Law", false], [2329, 0.488645, " law", false], [40989, 0.000736, " Laws", false], [198, 0.000675, "\n", false], [220, 0.000285, " ", false], [6872, 0.000245, " laws", false], [576, 0.000243, " The", false], [19915, 0.000168, "law", false], [323, 0.000159, " and", false], [57817, 0.000148, " theorem", false]]]}, "raw_delta": 0.06413444876670837, "tuned_delta": 0.07270624079728662}, {"byte_start": 261, "byte_end": 262, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "14.72%", "qwen": "17.39%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.4372738301753998]], "qwen": [[11, ",", "normal", 0.3811791241168976]]}, "loss": {"rwkv": 14.722815602821939, "qwen": 17.393237517997758}, "topk": {"rwkv": [45, 1, 0.4372738301753998, [[45, 0.437274, ",", false], [59, 0.225301, ":", false], [47, 0.130315, ".", false], [21265, 0.030338, " and", false], [275, 0.022843, " (", false], [9816, 0.01929, "—", false], [280, 0.018051, " -", false], [60, 0.014288, ";", false], [43274, 0.013256, "—the", false], [22898, 0.01146, " —", false]]], "qwen": [11, 1, 0.3811791241168976, [[11, 0.381179, ",", false], [25, 0.18403, ":", false], [13, 0.177942, ".", false], [323, 0.043685, " and", false], [624, 0.030055, ".\n", false], [26, 0.021415, ";", false], [481, 0.018391, " -", false], [1959, 0.016107, " —", false], [320, 0.014172, " (", false], [1177, 0.012551, " --", false]]]}, "raw_delta": -0.14807963371276855, "tuned_delta": -0.1395078416821903}, {"byte_start": 262, "byte_end": 265, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 48, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"rwkv": "27.05% 27.05% 27.05%", "qwen": "26.33% 26.33% 26.33%"}, "model_tokens": {"rwkv": [[4715, " or", "normal", 0.010971490293741226]], "qwen": [[476, " or", "normal", 0.012534013018012047]]}, "loss": {"rwkv": 27.05053201666806, "qwen": 26.325031803135847}, "topk": {"rwkv": [4715, 8, 0.010971490293741226, [[40186, 0.541628, " which", false], [21400, 0.117319, " but", false], [21265, 0.08488, " and", false], [22590, 0.079104, " the", false], [32227, 0.01547, " that", false], [332, 0.012908, " a", false], [340, 0.011832, " i", false], [4715, 0.010971, " or", false], [4596, 0.01015, " in", false], [4423, 0.008524, " as", false]]], "qwen": [476, 8, 0.012534013018012047, [[892, 0.639171, " which", false], [279, 0.084171, " the", false], [323, 0.051258, " and", false], [714, 0.029083, " but", false], [429, 0.024328, " that", false], [264, 0.018037, " a", false], [438, 0.014398, " as", false], [476, 0.012534, " or", false], [304, 0.011276, " in", false], [600, 0.007726, " i", false]]]}, "raw_delta": 0.04023027420043945, "tuned_delta": 0.0488020662310177}, {"byte_start": 265, "byte_end": 272, "display": {"text": " rather", "kind": "normal"}, "is_word": true, "word_id": 49, "word_key": " rather", "bytes_hex": "20 72 61 74 68 65 72", "compression": {"rwkv": "5.92% 5.92% 5.92% 5.92% 5.92% 5.92% 5.92%", "qwen": "5.90% 5.90% 5.90% 5.90% 5.90% 5.90% 5.90%"}, "model_tokens": {"rwkv": [[47001, " rather", "normal", 0.10089293122291565]], "qwen": [[4751, " rather", "normal", 0.10114416480064392]]}, "loss": {"rwkv": 5.9173038786461385, "qwen": 5.902705008482897}, "topk": {"rwkv": [47001, 4, 0.10089293122291565, [[22590, 0.238373, " the", false], [31458, 0.166759, " more", false], [4424, 0.123038, " at", false], [47001, 0.100893, " rather", false], [45, 0.038933, ",", false], [4596, 0.02585, " in", false], [52448, 0.019623, " perhaps", false], [332, 0.01609, " a", false], [37045, 0.013577, " Moore", false], [32074, 0.01318, " some", false]]], "qwen": [4751, 3, 0.10114416480064392, [[279, 0.211004, " the", false], [803, 0.133768, " more", false], [4751, 0.101144, " rather", false], [518, 0.099381, " at", false], [304, 0.062929, " in", false], [11, 0.049104, ",", false], [438, 0.029579, " as", false], [894, 0.023234, " any", false], [4936, 0.020661, " simply", false], [311, 0.016255, " to", false]]]}, "raw_delta": 0.0008095332554408641, "tuned_delta": 0.009381325286019112}, {"byte_start": 272, "byte_end": 276, "display": {"text": " its", "kind": "normal"}, "is_word": true, "word_id": 50, "word_key": " its", "bytes_hex": "20 69 74 73", "compression": {"rwkv": "10.14% 10.14% 10.14% 10.14%", "qwen": "14.29% 14.29% 14.29% 14.29%"}, "model_tokens": {"rwkv": [[21902, " its", "normal", 0.1046118214726448]], "qwen": [[1181, " its", "normal", 0.041973281651735306]]}, "loss": {"rwkv": 10.143949506250523, "qwen": 14.294952864439173}, "topk": {"rwkv": [21902, 3, 0.1046118214726448, [[45, 0.325682, ",", false], [22590, 0.303766, " the", false], [21902, 0.104612, " its", false], [32227, 0.04556, " that", false], [332, 0.037101, " a", false], [37045, 0.027419, " Moore", false], [21835, 0.011125, " how", false], [31458, 0.008867, " more", false], [4419, 0.006958, " an", false], [32464, 0.006922, " what", false]]], "qwen": [1181, 3, 0.041973281651735306, [[11, 0.411784, ",", false], [279, 0.324031, " the", false], [1181, 0.041973, " its", false], [264, 0.025174, " a", false], [429, 0.020966, " that", false], [20219, 0.015413, " Moore", false], [458, 0.008091, " an", false], [25, 0.007787, ":", false], [1128, 0.007512, " what", false], [1039, 0.007394, " our", false]]]}, "raw_delta": -0.2301805019378662, "tuned_delta": -0.22160870990728795}, {"byte_start": 276, "byte_end": 291, "display": {"text": " generalization", "kind": "normal"}, "is_word": true, "word_id": 51, "word_key": " generalization", "bytes_hex": "20 67 65 6e 65 72 61 6c 69 7a 61 74 69 6f 6e", "compression": {"rwkv": "7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29%", "qwen": "10.66% 10.66% 10.66% 10.66% 10.66% 10.66% 10.66% 10.66% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43%"}, "model_tokens": {"rwkv": [[65135, " generalization", "normal", 0.0022984459064900875]], "qwen": [[4586, " general", "normal", 0.008826144970953465], [2022, "ization", "normal", 0.8470881581306458]]}, "loss": {"rwkv": 7.288615571157784, "qwen": 5.886180447042385}, "topk": {"rwkv": [65135, 65, 0.0022984459064900875, [[52046, 0.062569, " inverse", false], [60588, 0.03859, " successor", false], [45606, 0.037796, " cousin", false], [21458, 0.037154, " cor", false], [63563, 0.029451, " exponential", false], [63774, 0.0237, " predecessor", false], [45828, 0.017706, " effect", false], [61841, 0.01581, " derivative", false], [31458, 0.014963, " more", false], [63454, 0.011169, " derivatives", false]]], "qwen": [4586, 20, 0.008826144970953465, [[1829, 0.076741, " cor", false], [9931, 0.057388, " reverse", false], [27949, 0.054086, " inverse", false], [33565, 0.046774, " successor", false], [14002, 0.029152, " opposite", false], [13578, 0.021762, " equivalent", false], [94240, 0.0146, " converse", false], [31805, 0.014345, " derivative", false], [3265, 0.014272, " close", false], [27397, 0.013097, " twin", false]]]}, "raw_delta": 0.07776751617590588, "tuned_delta": 0.08633930820648412}, {"byte_start": 291, "byte_end": 294, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 52, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "30.62% 30.62% 30.62%", "qwen": "37.00% 37.00% 37.00%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.006099262274801731]], "qwen": [[315, " of", "normal", 0.0021232785657048225]]}, "loss": {"rwkv": 30.619699435533988, "qwen": 36.99787668920725}, "topk": {"rwkv": [4706, 16, 0.006099262274801731, [[45, 0.249957, ",", false], [4811, 0.172878, " to", false], [116, 0.15567, "s", false], [59, 0.093979, ":", false], [32227, 0.058063, " that", false], [47, 0.057963, ".", false], [37045, 0.020132, " Moore", false], [38848, 0.014051, " known", false], [4596, 0.013601, " in", false], [4450, 0.01326, " by", false]]], "qwen": [315, 30, 0.0021232785657048225, [[11, 0.267544, ",", false], [25, 0.208771, ":", false], [311, 0.197383, " to", false], [13, 0.064783, ".", false], [429, 0.057587, " that", false], [481, 0.015406, " -", false], [892, 0.011045, " which", false], [624, 0.010519, ".\n", false], [320, 0.009481, " (", false], [369, 0.009388, " for", false]]]}, "raw_delta": -0.35368124643961596, "tuned_delta": -0.34510945440903773}, {"byte_start": 294, "byte_end": 304, "display": {"text": " continued", "kind": "normal"}, "is_word": true, "word_id": 53, "word_key": " continued", "bytes_hex": "20 63 6f 6e 74 69 6e 75 65 64", "compression": {"rwkv": "12.74% 12.74% 12.74% 12.74% 12.74% 12.74% 12.74% 12.74% 12.74% 12.74%", "qwen": "12.88% 12.88% 12.88% 12.88% 12.88% 12.88% 12.88% 12.88% 12.88% 12.88%"}, "model_tokens": {"rwkv": [[59392, " continued", "normal", 0.0008488447056151927]], "qwen": [[8570, " continued", "normal", 0.0007931358413770795]]}, "loss": {"rwkv": 12.736292157847878, "qwen": 12.875180187205157}, "topk": {"rwkv": [59392, 111, 0.0008488447056151927, [[22590, 0.228477, " the", false], [37045, 0.13122, " Moore", false], [63563, 0.044104, " exponential", false], [269, 0.031326, " \"", false], [32227, 0.024856, " that", false], [332, 0.021657, " a", false], [32234, 0.017551, " this", false], [4601, 0.012254, " it", false], [52805, 0.010373, " scaling", false], [62659, 0.010169, " transistor", false]]], "qwen": [8570, 110, 0.0007931358413770795, [[279, 0.276562, " the", false], [330, 0.038808, " \"", false], [20219, 0.037563, " Moore", false], [1036, 0.017845, " “", false], [429, 0.017202, " that", false], [71161, 0.014851, " Denn", false], [1128, 0.014283, " what", false], [58755, 0.013923, " exponential", false], [1246, 0.011885, " how", false], [24231, 0.011763, " computing", false]]]}, "raw_delta": -0.007701587677001909, "tuned_delta": 0.0008702043535763395}, {"byte_start": 304, "byte_end": 318, "display": {"text": " exponentially", "kind": "normal"}, "is_word": true, "word_id": 54, "word_key": " exponentially", "bytes_hex": "20 65 78 70 6f 6e 65 6e 74 69 61 6c 6c 79", "compression": {"rwkv": "8.98% 8.98% 8.98% 8.98% 8.98% 8.98% 8.98% 8.98% 8.98% 8.98% 8.98% 8.98% 8.98% 8.98%", "qwen": "7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29%"}, "model_tokens": {"rwkv": [[64911, " exponentially", "normal", 0.0009393105865456164]], "qwen": [[74151, " exponentially", "normal", 0.003478133585304022]]}, "loss": {"rwkv": 8.976590237674072, "qwen": 7.292385021382192}, "topk": {"rwkv": [64911, 39, 0.0009393105865456164, [[63563, 0.67353, " exponential", false], [46132, 0.05828, " growth", false], [63621, 0.032522, " improvement", false], [64423, 0.028943, " improvements", false], [56950, 0.018912, " progress", false], [59847, 0.013396, " increases", false], [46, 0.01233, "-", false], [37045, 0.012265, " Moore", false], [56045, 0.011355, " doubling", false], [52805, 0.008522, " scaling", false]]], "qwen": [74151, 35, 0.003478133585304022, [[58755, 0.241755, " exponential", false], [29016, 0.077583, " technological", false], [15673, 0.073068, " improvement", false], [5098, 0.061303, " progress", false], [18142, 0.050694, " improvements", false], [12703, 0.032734, " increases", false], [26943, 0.02385, " scaling", false], [6513, 0.023342, " growth", false], [5263, 0.022613, " increase", false], [54480, 0.017393, " computational", false]]]}, "raw_delta": 0.09339216777256557, "tuned_delta": 0.10196395980314381}, {"byte_start": 318, "byte_end": 326, "display": {"text": " falling", "kind": "normal"}, "is_word": true, "word_id": 55, "word_key": " falling", "bytes_hex": "20 66 61 6c 6c 69 6e 67", "compression": {"rwkv": "12.12% 12.12% 12.12% 12.12% 12.12% 12.12% 12.12% 12.12%", "qwen": "16.79% 16.79% 16.79% 16.79% 16.79% 16.79% 16.79% 16.79%"}, "model_tokens": {"rwkv": [[51709, " falling", "normal", 0.004628258291631937]], "qwen": [[15679, " falling", "normal", 0.0005811915034428239]]}, "loss": {"rwkv": 12.116384132465903, "qwen": 16.79484215747727}, "topk": {"rwkv": [51709, 19, 0.004628258291631937, [[62092, 0.341356, " increasing", false], [46, 0.12203, "-", false], [61816, 0.0991, " decreasing", false], [51876, 0.095055, " growing", false], [45961, 0.030608, " faster", false], [46132, 0.030241, " growth", false], [59832, 0.029976, " improving", false], [64230, 0.026563, " accelerating", false], [59453, 0.018792, " declining", false], [47122, 0.018043, " rising", false]]], "qwen": [15679, 81, 0.0005811915034428239, [[7703, 0.346143, " increasing", false], [18392, 0.14817, " improving", false], [68641, 0.054102, " accelerating", false], [7826, 0.047504, " growing", false], [10596, 0.044581, " faster", false], [43549, 0.021275, " decreasing", false], [4937, 0.01972, " fast", false], [2664, 0.016937, " better", false], [16062, 0.016582, " rising", false], [11048, 0.015995, " rapid", false]]]}, "raw_delta": -0.25942879915237427, "tuned_delta": -0.25085700712179604}, {"byte_start": 326, "byte_end": 331, "display": {"text": " cost", "kind": "normal"}, "is_word": true, "word_id": 56, "word_key": " cost", "bytes_hex": "20 63 6f 73 74", "compression": {"rwkv": "8.00% 8.00% 8.00% 8.00% 8.00%", "qwen": "8.69% 8.69% 8.69% 8.69% 8.69%"}, "model_tokens": {"rwkv": [[30510, " cost", "normal", 0.10817506164312363]], "qwen": [[2783, " cost", "normal", 0.08987583220005035]]}, "loss": {"rwkv": 8.002449054930967, "qwen": 8.689806956154829}, "topk": {"rwkv": [30510, 2, 0.10817506164312363, [[38124, 0.515085, " costs", false], [30510, 0.108175, " cost", false], [45860, 0.039054, " energy", false], [39339, 0.024575, " power", false], [46900, 0.024467, " prices", false], [56353, 0.022709, " hardware", false], [62659, 0.020326, " transistor", false], [22278, 0.016284, " per", false], [52805, 0.013065, " scaling", false], [32343, 0.0113, " unit", false]]], "qwen": [2783, 3, 0.08987583220005035, [[7049, 0.392977, " costs", false], [7576, 0.101625, " prices", false], [2783, 0.089876, " cost", false], [817, 0.047729, " per", false], [54480, 0.031836, " computational", false], [11773, 0.027092, " hardware", false], [34447, 0.025031, " computation", false], [24231, 0.023069, " computing", false], [304, 0.013094, " in", false], [4982, 0.012892, " unit", false]]]}, "raw_delta": -0.03811521530151368, "tuned_delta": -0.029543423270935433}, {"byte_start": 331, "byte_end": 335, "display": {"text": " per", "kind": "normal"}, "is_word": true, "word_id": 57, "word_key": " per", "bytes_hex": "20 70 65 72", "compression": {"rwkv": "5.28% 5.28% 5.28% 5.28%", "qwen": "9.24% 9.24% 9.24% 9.24%"}, "model_tokens": {"rwkv": [[22278, " per", "normal", 0.306733101606369]], "qwen": [[817, " per", "normal", 0.12882518768310547]]}, "loss": {"rwkv": 5.283307034505481, "qwen": 9.239104709507004}, "topk": {"rwkv": [22278, 1, 0.306733101606369, [[22278, 0.306733, " per", false], [47, 0.147779, ".", false], [4706, 0.123265, " of", false], [45, 0.076877, ",", false], [21700, 0.058715, " for", false], [45644, 0.038794, " curves", false], [4811, 0.031063, " to", false], [4596, 0.020581, " in", false], [21265, 0.019129, " and", false], [59, 0.016463, ":", false]]], "qwen": [817, 2, 0.12882518768310547, [[315, 0.442599, " of", false], [817, 0.128825, " per", false], [13, 0.073923, ".", false], [323, 0.053048, " and", false], [369, 0.040947, " for", false], [11, 0.03493, ",", false], [304, 0.031386, " in", false], [624, 0.021357, ".\n", false], [311, 0.016775, " to", false], [448, 0.014182, " with", false]]]}, "raw_delta": -0.2193560004234314, "tuned_delta": -0.21078420839285314}, {"byte_start": 335, "byte_end": 340, "display": {"text": " unit", "kind": "normal"}, "is_word": true, "word_id": 58, "word_key": " unit", "bytes_hex": "20 75 6e 69 74", "compression": {"rwkv": "4.51% 4.51% 4.51% 4.51% 4.51%", "qwen": "5.21% 5.21% 5.21% 5.21% 5.21%"}, "model_tokens": {"rwkv": [[32343, " unit", "normal", 0.2844639718532562]], "qwen": [[4982, " unit", "normal", 0.23570650815963745]]}, "loss": {"rwkv": 4.50842200277801, "qwen": 5.212341403323332}, "topk": {"rwkv": [32343, 1, 0.2844639718532562, [[32343, 0.284464, " unit", false], [63370, 0.099996, " computation", false], [62659, 0.099452, " transistor", false], [60096, 0.055853, " operation", false], [21365, 0.055329, " bit", false], [3806, 0.035438, " FL", false], [64862, 0.030839, " computational", false], [51266, 0.02392, " compute", false], [59346, 0.023771, " computing", false], [63750, 0.017952, " performance", false]]], "qwen": [4982, 1, 0.23570650815963745, [[4982, 0.235707, " unit", false], [2699, 0.213193, " bit", false], [34447, 0.047026, " computation", false], [97941, 0.026785, " transistor", false], [54480, 0.023907, " computational", false], [5068, 0.020639, " performance", false], [5666, 0.017223, " operation", false], [24231, 0.016224, " computing", false], [22302, 0.01419, " capability", false], [8692, 0.013948, " processing", false]]]}, "raw_delta": -0.03903357982635497, "tuned_delta": -0.03046178779577672}, {"byte_start": 340, "byte_end": 343, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 59, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "2.79% 2.79% 2.79%", "qwen": "1.60% 1.60% 1.60%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.6250545382499695]], "qwen": [[315, " of", "normal", 0.766579270362854]]}, "loss": {"rwkv": 2.794282387138454, "qwen": 1.5978879427888404}, "topk": {"rwkv": [4706, 1, 0.6250545382499695, [[4706, 0.625055, " of", false], [47, 0.089064, ".", false], [32251, 0.052469, " time", false], [45, 0.036225, ",", false], [63370, 0.027617, " computation", false], [59346, 0.009312, " computing", false], [63750, 0.008982, " performance", false], [275, 0.008307, " (", false], [21700, 0.00738, " for", false], [30173, 0.006321, " area", false]]], "qwen": [315, 1, 0.766579270362854, [[315, 0.766579, " of", false], [13, 0.030388, ".", false], [34447, 0.024931, " computation", false], [11, 0.01643, ",", false], [8692, 0.010762, " processing", false], [304, 0.010713, " in", false], [624, 0.007539, ".\n", false], [5666, 0.007468, " operation", false], [5068, 0.005944, " performance", false], [24231, 0.00588, " computing", false]]]}, "raw_delta": 0.06634219487508138, "tuned_delta": 0.07491398690565962}, {"byte_start": 343, "byte_end": 355, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 60, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49%", "qwen": "1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.37295469641685486]], "qwen": [[34447, " computation", "normal", 0.31194689869880676]]}, "loss": {"rwkv": 1.4851963108109854, "qwen": 1.750653682200866}, "topk": {"rwkv": [63370, 1, 0.37295469641685486, [[63370, 0.372955, " computation", false], [59346, 0.166053, " computing", false], [51266, 0.089957, " compute", false], [64862, 0.068879, " computational", false], [63750, 0.03173, " performance", false], [62378, 0.026331, " processing", false], [39339, 0.017784, " power", false], [63637, 0.01707, " information", false], [55809, 0.01283, " computer", false], [56353, 0.011179, " hardware", false]]], "qwen": [34447, 1, 0.31194689869880676, [[34447, 0.311947, " computation", false], [24231, 0.198532, " computing", false], [8692, 0.090849, " processing", false], [54480, 0.064271, " computational", false], [5068, 0.040201, " performance", false], [11773, 0.022831, " hardware", false], [6366, 0.01754, " computer", false], [882, 0.015558, " time", false], [12564, 0.013179, " compute", false], [1995, 0.011198, " information", false]]]}, "raw_delta": -0.01472008228302002, "tuned_delta": -0.006148290252441771}, {"byte_start": 355, "byte_end": 356, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "10.71%", "qwen": "12.53%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.5602073669433594]], "qwen": [[13, ".", "normal", 0.4991952180862427]]}, "loss": {"rwkv": 10.707502256597774, "qwen": 12.529050053861804}, "topk": {"rwkv": [47, 1, 0.5602073669433594, [[47, 0.560207, ".", false], [45, 0.163868, ",", false], [275, 0.035099, " (", false], [31601, 0.03259, " over", false], [59, 0.025043, ":", false], [4811, 0.018427, " to", false], [21265, 0.018182, " and", false], [39339, 0.017679, " power", false], [4423, 0.008745, " as", false], [4596, 0.008233, " in", false]]], "qwen": [13, 1, 0.4991952180862427, [[13, 0.499195, ".", false], [624, 0.12854, ".\n", false], [11, 0.104222, ",", false], [320, 0.03919, " (", false], [25, 0.023488, ":", false], [323, 0.020868, " and", false], [2355, 0.01891, " power", false], [311, 0.014753, " to", false], [429, 0.010954, " that", false], [304, 0.008801, " in", false]]]}, "raw_delta": -0.10100805759429932, "tuned_delta": -0.09243626556372107}, {"byte_start": 356, "byte_end": 361, "display": {"text": " Most", "kind": "normal"}, "is_word": true, "word_id": 61, "word_key": " most", "bytes_hex": "20 4d 6f 73 74", "compression": {"rwkv": "21.30% 21.30% 21.30% 21.30% 21.30%", "qwen": "19.99% 19.99% 19.99% 19.99% 19.99%"}, "model_tokens": {"rwkv": [[29425, " Most", "normal", 0.0027175736613571644]], "qwen": [[7496, " Most", "normal", 0.003920088987797499]]}, "loss": {"rwkv": 21.302293963126097, "qwen": 19.98724410174221}, "topk": {"rwkv": [29425, 49, 0.0027175736613571644, [[11, 0.159345, "\n", false], [20996, 0.101765, " The", false], [29894, 0.094614, " This", false], [261, 0.040463, "\n\n", false], [3913, 0.038089, " In", false], [19555, 0.037748, " But", false], [37045, 0.032184, " Moore", false], [3918, 0.029862, " It", false], [3641, 0.026704, " As", false], [3908, 0.021178, " If", false]]], "qwen": [7496, 44, 0.003920088987797499, [[1096, 0.116306, " This", false], [576, 0.11264, " The", false], [758, 0.047365, " In", false], [1084, 0.041821, " It", false], [1634, 0.034852, " As", false], [1416, 0.023749, " If", false], [1752, 0.019009, " For", false], [1205, 0.018853, " We", false], [2619, 0.018818, " There", false], [1988, 0.016239, " But", false]]]}, "raw_delta": 0.07292184829711901, "tuned_delta": 0.08149364032769725}, {"byte_start": 361, "byte_end": 364, "display": {"text": " AI", "kind": "normal"}, "is_word": true, "word_id": 62, "word_key": " ai", "bytes_hex": "20 41 49", "compression": {"rwkv": "13.06% 13.06% 13.06%", "qwen": "13.88% 13.88% 13.88%"}, "model_tokens": {"rwkv": [[3609, " AI", "normal", 0.11316458135843277]], "qwen": [[15235, " AI", "normal", 0.0993504747748375]]}, "loss": {"rwkv": 13.055638716377988, "qwen": 13.880539169353877}, "topk": {"rwkv": [3609, 2, 0.11316458135843277, [[4706, 0.296412, " of", false], [3609, 0.113165, " AI", false], [46787, 0.059094, " people", false], [39193, 0.034889, " other", false], [52224, 0.024476, " methods", false], [57103, 0.02051, " research", false], [47539, 0.010789, " things", false], [52167, 0.010439, " machine", false], [46588, 0.009972, " modern", false], [2030, 0.009561, "ly", false]]], "qwen": [15235, 2, 0.0993504747748375, [[315, 0.255866, " of", false], [15235, 0.09935, " AI", false], [5413, 0.047656, " methods", false], [1008, 0.034763, " other", false], [25185, 0.032398, " algorithms", false], [5662, 0.026303, " machine", false], [4586, 0.025553, " general", false], [3412, 0.024496, " research", false], [1251, 0.021594, " people", false], [5322, 0.020916, " problems", false]]]}, "raw_delta": -0.04574219385782874, "tuned_delta": -0.03717040182725049}, {"byte_start": 364, "byte_end": 373, "display": {"text": " research", "kind": "normal"}, "is_word": true, "word_id": 63, "word_key": " research", "bytes_hex": "20 72 65 73 65 61 72 63 68", "compression": {"rwkv": "2.86% 2.86% 2.86% 2.86% 2.86% 2.86% 2.86% 2.86% 2.86%", "qwen": "3.05% 3.05% 3.05% 3.05% 3.05% 3.05% 3.05% 3.05% 3.05%"}, "model_tokens": {"rwkv": [[57103, " research", "normal", 0.24100203812122345]], "qwen": [[3412, " research", "normal", 0.21799854934215546]]}, "loss": {"rwkv": 2.8647264809318607, "qwen": 3.0522353433308953}, "topk": {"rwkv": [57103, 1, 0.24100203812122345, [[57103, 0.241002, " research", false], [63843, 0.178493, " researchers", false], [52224, 0.077356, " methods", false], [53087, 0.07643, " systems", false], [62633, 0.025532, " techniques", false], [32499, 0.022854, " work", false], [56950, 0.022285, " progress", false], [61559, 0.020193, " algorithms", false], [64251, 0.019879, " applications", false], [4600, 0.016739, " is", false]]], "qwen": [3412, 1, 0.21799854934215546, [[3412, 0.217999, " research", false], [11811, 0.166973, " researchers", false], [5413, 0.156672, " methods", false], [25185, 0.064499, " algorithms", false], [12538, 0.055351, " techniques", false], [19827, 0.037726, " approaches", false], [5942, 0.036706, " systems", false], [5322, 0.027952, " problems", false], [8357, 0.013111, " applications", false], [374, 0.012034, " is", false]]]}, "raw_delta": -0.010397699144151479, "tuned_delta": -0.0018259071135732306}, {"byte_start": 373, "byte_end": 377, "display": {"text": " has", "kind": "normal"}, "is_word": true, "word_id": 64, "word_key": " has", "bytes_hex": "20 68 61 73", "compression": {"rwkv": "7.57% 7.57% 7.57% 7.57%", "qwen": "7.36% 7.36% 7.36% 7.36%"}, "model_tokens": {"rwkv": [[21800, " has", "normal", 0.18468452990055084]], "qwen": [[702, " has", "normal", 0.19522716104984283]]}, "loss": {"rwkv": 7.572740082791189, "qwen": 7.364920009609059}, "topk": {"rwkv": [21800, 1, 0.18468452990055084, [[21800, 0.184685, " has", false], [4600, 0.112504, " is", false], [4596, 0.045841, " in", false], [45, 0.045161, ",", false], [39971, 0.037255, " today", false], [31601, 0.026654, " over", false], [32227, 0.025539, " that", false], [56952, 0.024692, " projects", false], [46750, 0.023426, " papers", false], [51566, 0.020506, " efforts", false]]], "qwen": [702, 1, 0.19522716104984283, [[702, 0.195227, " has", false], [374, 0.139316, " is", false], [3351, 0.06346, " today", false], [304, 0.046102, " in", false], [11, 0.03967, ",", false], [916, 0.022977, " over", false], [23497, 0.017717, " focuses", false], [429, 0.016171, " that", false], [15689, 0.014485, " papers", false], [323, 0.014132, " and", false]]]}, "raw_delta": 0.011523991823196411, "tuned_delta": 0.02009578385377466}, {"byte_start": 377, "byte_end": 382, "display": {"text": " been", "kind": "normal"}, "is_word": true, "word_id": 65, "word_key": " been", "bytes_hex": "20 62 65 65 6e", "compression": {"rwkv": "3.92% 3.92% 3.92% 3.92% 3.92%", "qwen": "4.25% 4.25% 4.25% 4.25% 4.25%"}, "model_tokens": {"rwkv": [[30259, " been", "normal", 0.3382815420627594]], "qwen": [[1012, " been", "normal", 0.30757519602775574]]}, "loss": {"rwkv": 3.9166916149133963, "qwen": 4.252472262284453}, "topk": {"rwkv": [30259, 1, 0.3382815420627594, [[30259, 0.338282, " been", false], [51770, 0.149863, " focused", false], [56255, 0.021524, " followed", false], [39887, 0.021269, " taken", false], [22187, 0.016171, " not", false], [40013, 0.016112, " tried", false], [45953, 0.012666, " failed", false], [56540, 0.011556, " leverage", false], [64300, 0.011408, " concentrated", false], [56500, 0.011216, " involved", false]]], "qwen": [1012, 1, 0.30757519602775574, [[1012, 0.307575, " been", false], [10735, 0.185736, " focused", false], [8110, 0.022109, " followed", false], [37526, 0.018622, " concentrated", false], [537, 0.016617, " not", false], [4429, 0.015635, " taken", false], [6679, 0.014515, " tried", false], [7391, 0.009086, " spent", false], [1030, 0.008749, " had", false], [264, 0.008633, " a", false]]]}, "raw_delta": -0.01861963272094727, "tuned_delta": -0.010047840690369023}, {"byte_start": 382, "byte_end": 392, "display": {"text": " conducted", "kind": "normal"}, "is_word": true, "word_id": 66, "word_key": " conducted", "bytes_hex": "20 63 6f 6e 64 75 63 74 65 64", "compression": {"rwkv": "6.62% 6.62% 6.62% 6.62% 6.62% 6.62% 6.62% 6.62% 6.62% 6.62%", "qwen": "7.16% 7.16% 7.16% 7.16% 7.16% 7.16% 7.16% 7.16% 7.16% 7.16%"}, "model_tokens": {"rwkv": [[59355, " conducted", "normal", 0.025281056761741638]], "qwen": [[13075, " conducted", "normal", 0.01887700892984867]]}, "loss": {"rwkv": 6.621744816580202, "qwen": 7.159032376487684}, "topk": {"rwkv": [59355, 8, 0.025281056761741638, [[51770, 0.113002, " focused", false], [30666, 0.066695, " done", false], [45796, 0.035702, " driven", false], [37598, 0.034683, " about", false], [51459, 0.032152, " devoted", false], [37810, 0.028903, " based", false], [4596, 0.028449, " in", false], [59355, 0.025281, " conducted", false], [4712, 0.024528, " on", false], [332, 0.022119, " a", false]]], "qwen": [13075, 9, 0.01887700892984867, [[10735, 0.150755, " focused", false], [28229, 0.042238, " devoted", false], [304, 0.040494, " in", false], [911, 0.038982, " about", false], [16227, 0.037951, " driven", false], [3118, 0.033625, " based", false], [2814, 0.030086, " done", false], [264, 0.019769, " a", false], [13075, 0.018877, " conducted", false], [389, 0.018383, " on", false]]]}, "raw_delta": -0.029793548583984364, "tuned_delta": -0.021221756553406114}, {"byte_start": 392, "byte_end": 395, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 67, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"rwkv": "31.18% 31.18% 31.18%", "qwen": "28.91% 28.91% 28.91%"}, "model_tokens": {"rwkv": [[4423, " as", "normal", 0.005548461806029081]], "qwen": [[438, " as", "normal", 0.008154122158885002]]}, "loss": {"rwkv": 31.183252185881237, "qwen": 28.909395033008668}, "topk": {"rwkv": [4423, 14, 0.005548461806029081, [[4596, 0.222587, " in", false], [4712, 0.203379, " on", false], [32487, 0.118062, " with", false], [40085, 0.102983, " using", false], [4450, 0.086894, " by", false], [47806, 0.042485, " within", false], [40062, 0.034336, " under", false], [4424, 0.033606, " at", false], [31601, 0.012565, " over", false], [53356, 0.008114, " without", false]]], "qwen": [438, 16, 0.008154122158885002, [[304, 0.233193, " in", false], [389, 0.124188, " on", false], [553, 0.121443, " by", false], [448, 0.089342, " with", false], [1212, 0.067534, " under", false], [2878, 0.056427, " within", false], [1667, 0.0494, " using", false], [518, 0.029888, " at", false], [916, 0.023816, " over", false], [2163, 0.015385, " around", false]]]}, "raw_delta": 0.1260894139607749, "tuned_delta": 0.13466120599135314}, {"byte_start": 395, "byte_end": 398, "display": {"text": " if", "kind": "normal"}, "is_word": true, "word_id": 68, "word_key": " if", "bytes_hex": "20 69 66", "compression": {"rwkv": "9.11% 9.11% 9.11%", "qwen": "11.76% 11.76% 11.76%"}, "model_tokens": {"rwkv": [[4588, " if", "normal", 0.22035817801952362]], "qwen": [[421, " if", "normal", 0.14144553244113922]]}, "loss": {"rwkv": 9.11076946394723, "qwen": 11.757006318845464}, "topk": {"rwkv": [4588, 2, 0.22035817801952362, [[332, 0.289672, " a", false], [4588, 0.220358, " if", false], [4419, 0.105092, " an", false], [31633, 0.062675, " part", false], [47544, 0.060681, " though", false], [22590, 0.020766, " the", false], [269, 0.012641, " \"", false], [32074, 0.005624, " some", false], [57103, 0.005179, " research", false], [63625, 0.004966, " incremental", false]]], "qwen": [421, 2, 0.14144553244113922, [[264, 0.3322, " a", false], [421, 0.141446, " if", false], [458, 0.093673, " an", false], [949, 0.070602, " part", false], [3498, 0.029649, " though", false], [279, 0.018577, " the", false], [2987, 0.010033, " either", false], [330, 0.009308, " \"", false], [11017, 0.007624, " follows", false], [9251, 0.005406, " applied", false]]]}, "raw_delta": -0.14673852920532227, "tuned_delta": -0.138166737174744}, {"byte_start": 398, "byte_end": 402, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 69, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "8.00% 8.00% 8.00% 8.00%", "qwen": "8.42% 8.42% 8.42% 8.42%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.17217271029949188]], "qwen": [[279, " the", "normal", 0.1544894278049469]]}, "loss": {"rwkv": 7.995404645551628, "qwen": 8.420062594724723}, "topk": {"rwkv": [22590, 1, 0.17217271029949188, [[22590, 0.172173, " the", false], [32234, 0.123909, " this", false], [4601, 0.080611, " it", false], [4858, 0.077304, " we", false], [39934, 0.062592, " there", false], [37045, 0.0502, " Moore", false], [3609, 0.034168, " AI", false], [63370, 0.025696, " computation", false], [22226, 0.024657, " one", false], [51832, 0.016894, " general", false]]], "qwen": [279, 1, 0.1544894278049469, [[279, 0.154489, " the", false], [432, 0.100706, " it", false], [1052, 0.094937, " there", false], [419, 0.078101, " this", false], [582, 0.064453, " we", false], [34447, 0.05836, " computation", false], [20219, 0.025845, " Moore", false], [24231, 0.023952, " computing", false], [264, 0.020418, " a", false], [429, 0.016013, " that", false]]]}, "raw_delta": -0.023548036813735962, "tuned_delta": -0.014976244783157714}, {"byte_start": 402, "byte_end": 414, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 70, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "7.23% 7.23% 7.23% 7.23% 7.23% 7.23% 7.23% 7.23% 7.23% 7.23% 7.23% 7.23%", "qwen": "8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.008208324201405048]], "qwen": [[34447, " computation", "normal", 0.004578007850795984]]}, "loss": {"rwkv": 7.232260296123059, "qwen": 8.094858629573698}, "topk": {"rwkv": [63370, 15, 0.008208324201405048, [[30510, 0.16907, " cost", false], [31581, 0.043765, " only", false], [30985, 0.039155, " goal", false], [40213, 0.028927, " world", false], [52569, 0.027766, " problem", false], [64862, 0.021806, " computational", false], [57481, 0.018901, " ultimate", false], [46064, 0.017141, " future", false], [38124, 0.013501, " costs", false], [55809, 0.013307, " computer", false]]], "qwen": [34447, 29, 0.004578007850795984, [[2783, 0.218788, " cost", false], [3853, 0.04936, " future", false], [3491, 0.035279, " problem", false], [16724, 0.026408, " ultimate", false], [1879, 0.024884, " world", false], [1172, 0.024796, " only", false], [7049, 0.019743, " costs", false], [54480, 0.016114, " computational", false], [11773, 0.013483, " hardware", false], [6366, 0.01246, " computer", false]]]}, "raw_delta": -0.047832608222961426, "tuned_delta": -0.039260816192383176}, {"byte_start": 414, "byte_end": 424, "display": {"text": " available", "kind": "normal"}, "is_word": true, "word_id": 71, "word_key": " available", "bytes_hex": "20 61 76 61 69 6c 61 62 6c 65", "compression": {"rwkv": "7.66% 7.66% 7.66% 7.66% 7.66% 7.66% 7.66% 7.66% 7.66% 7.66%", "qwen": "4.96% 4.96% 4.96% 4.96% 4.96% 4.96% 4.96% 4.96% 4.96% 4.96%"}, "model_tokens": {"rwkv": [[59206, " available", "normal", 0.014257945120334625]], "qwen": [[2500, " available", "normal", 0.06380987167358398]]}, "loss": {"rwkv": 7.664317404722616, "qwen": 4.962595936959651}, "topk": {"rwkv": [59206, 11, 0.014257945120334625, [[22748, 0.226967, " was", false], [32462, 0.14286, " were", false], [4600, 0.099516, " is", false], [30510, 0.056174, " cost", false], [40219, 0.050933, " would", false], [38128, 0.036869, " could", false], [46342, 0.027247, " itself", false], [4706, 0.015667, " of", false], [52569, 0.015122, " problem", false], [21795, 0.014863, " had", false]]], "qwen": [2500, 4, 0.06380987167358398, [[2783, 0.125413, " cost", false], [374, 0.093354, " is", false], [572, 0.089454, " was", false], [2500, 0.06381, " available", false], [7049, 0.047193, " costs", false], [8039, 0.035703, " budget", false], [1033, 0.034068, " were", false], [315, 0.025528, " of", false], [686, 0.024158, " will", false], [3491, 0.023169, " problem", false]]]}, "raw_delta": 0.14981524944305422, "tuned_delta": 0.15838704147363247}, {"byte_start": 424, "byte_end": 427, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 72, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "6.95% 6.95% 6.95%", "qwen": "4.65% 4.65% 4.65%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.3134537637233734]], "qwen": [[311, " to", "normal", 0.4611510634422302]]}, "loss": {"rwkv": 6.9504839209494325, "qwen": 4.652869514643304}, "topk": {"rwkv": [4811, 1, 0.3134537637233734, [[4811, 0.313454, " to", false], [32462, 0.14886, " were", false], [22748, 0.139885, " was", false], [21700, 0.090638, " for", false], [4600, 0.084194, " is", false], [4596, 0.03288, " in", false], [40219, 0.024019, " would", false], [39971, 0.022133, " today", false], [4712, 0.020225, " on", false], [4424, 0.017158, " at", false]]], "qwen": [311, 1, 0.4611510634422302, [[311, 0.461151, " to", false], [572, 0.094041, " was", false], [3351, 0.084702, " today", false], [374, 0.061872, " is", false], [1033, 0.057448, " were", false], [304, 0.032404, " in", false], [1035, 0.02982, " would", false], [369, 0.024711, " for", false], [518, 0.024061, " at", false], [686, 0.020078, " will", false]]]}, "raw_delta": 0.12740679581960046, "tuned_delta": 0.13597858785017872}, {"byte_start": 427, "byte_end": 431, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 73, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "11.76% 11.76% 11.76% 11.76%", "qwen": "11.27% 11.27% 11.27% 11.27%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.0742250308394432]], "qwen": [[279, " the", "normal", 0.08203161507844925]]}, "loss": {"rwkv": 11.76416366349887, "qwen": 11.273987311142236}, "topk": {"rwkv": [22590, 5, 0.0742250308394432, [[63843, 0.190292, " researchers", false], [3609, 0.155574, " AI", false], [4835, 0.111417, " us", false], [4601, 0.082772, " it", false], [22590, 0.074225, " the", false], [332, 0.040541, " a", false], [39740, 0.034152, " solve", false], [4419, 0.025745, " an", false], [46227, 0.023081, " humans", false], [4491, 0.017032, " do", false]]], "qwen": [279, 3, 0.08203161507844925, [[601, 0.346554, " us", false], [432, 0.134368, " it", false], [279, 0.082032, " the", false], [264, 0.0735, " a", false], [11811, 0.03848, " researchers", false], [15235, 0.035806, " AI", false], [458, 0.03419, " an", false], [11625, 0.03216, " solve", false], [12677, 0.024675, " humans", false], [1105, 0.008507, " them", false]]]}, "raw_delta": 0.027181148529052734, "tuned_delta": 0.035752940559630984}, {"byte_start": 431, "byte_end": 437, "display": {"text": " agent", "kind": "normal"}, "is_word": true, "word_id": 74, "word_key": " agent", "bytes_hex": "20 61 67 65 6e 74", "compression": {"rwkv": "13.53% 13.53% 13.53% 13.53% 13.53% 13.53%", "qwen": "15.32% 15.32% 15.32% 15.32% 15.32% 15.32%"}, "model_tokens": {"rwkv": [[37636, " agent", "normal", 0.011057370342314243]], "qwen": [[8315, " agent", "normal", 0.006113724783062935]]}, "loss": {"rwkv": 13.52526600833403, "qwen": 15.320276165975551}, "topk": {"rwkv": [37636, 12, 0.011057370342314243, [[3609, 0.261469, " AI", false], [62496, 0.185476, " researcher", false], [63843, 0.140816, " researchers", false], [57103, 0.038766, " research", false], [52569, 0.030162, " problem", false], [59113, 0.022393, " algorithm", false], [52581, 0.0223, " project", false], [47487, 0.018635, " system", false], [40213, 0.016146, " world", false], [38478, 0.014444, " field", false]]], "qwen": [8315, 19, 0.006113724783062935, [[31085, 0.271469, " researcher", false], [15235, 0.14507, " AI", false], [2070, 0.099388, " field", false], [11811, 0.054255, " researchers", false], [3738, 0.051663, " human", false], [3412, 0.025836, " research", false], [5662, 0.024803, " machine", false], [1879, 0.024768, " world", false], [1849, 0.021812, " system", false], [12111, 0.016211, " algorithm", false]]]}, "raw_delta": -0.09953649838765466, "tuned_delta": -0.09096470635707642}, {"byte_start": 437, "byte_end": 442, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 75, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"rwkv": "6.06% 6.06% 6.06% 6.06% 6.06%", "qwen": "6.27% 6.27% 6.27% 6.27% 6.27%"}, "model_tokens": {"rwkv": [[32462, " were", "normal", 0.18527035415172577]], "qwen": [[1033, " were", "normal", 0.17594511806964874]]}, "loss": {"rwkv": 6.058192066232952, "qwen": 6.2670065216045385}, "topk": {"rwkv": [32462, 3, 0.18527035415172577, [[22748, 0.263561, " was", false], [4600, 0.210757, " is", false], [32462, 0.18527, " were", false], [40219, 0.064466, " would", false], [38128, 0.030505, " could", false], [4596, 0.021048, " in", false], [275, 0.018034, " (", false], [32475, 0.014222, " will", false], [21265, 0.010929, " and", false], [45, 0.010603, ",", false]]], "qwen": [1033, 3, 0.17594511806964874, [[374, 0.26816, " is", false], [572, 0.215074, " was", false], [1033, 0.175945, " were", false], [1035, 0.044511, " would", false], [686, 0.039311, " will", false], [1410, 0.025966, " could", false], [518, 0.021568, " at", false], [304, 0.018258, " in", false], [702, 0.016137, " has", false], [320, 0.014433, " (", false]]]}, "raw_delta": -0.011579132080078103, "tuned_delta": -0.0030073400494998546}, {"byte_start": 442, "byte_end": 451, "display": {"text": " constant", "kind": "normal"}, "is_word": true, "word_id": 76, "word_key": " constant", "bytes_hex": "20 63 6f 6e 73 74 61 6e 74", "compression": {"rwkv": "7.26% 7.26% 7.26% 7.26% 7.26% 7.26% 7.26% 7.26% 7.26%", "qwen": "8.21% 8.21% 8.21% 8.21% 8.21% 8.21% 8.21% 8.21% 8.21%"}, "model_tokens": {"rwkv": [[55836, " constant", "normal", 0.026913397014141083]], "qwen": [[6783, " constant", "normal", 0.01665637083351612]]}, "loss": {"rwkv": 7.2635687822534605, "qwen": 8.205253098838568}, "topk": {"rwkv": [55836, 8, 0.026913397014141083, [[38501, 0.153262, " fixed", false], [30911, 0.112204, " free", false], [56447, 0.110923, " infinite", false], [60706, 0.072948, " unlimited", false], [332, 0.043242, " a", false], [63507, 0.040686, " effectively", false], [22590, 0.029057, " the", false], [55836, 0.026913, " constant", false], [38594, 0.019031, " given", false], [22187, 0.016382, " not", false]]], "qwen": [6783, 8, 0.01665637083351612, [[23809, 0.144194, " infinite", false], [26764, 0.115091, " unlimited", false], [7199, 0.090128, " limited", false], [8356, 0.073454, " fixed", false], [264, 0.065811, " a", false], [1910, 0.037812, " free", false], [650, 0.032257, " un", false], [6783, 0.016656, " constant", false], [91559, 0.01608, " limitless", false], [537, 0.01543, " not", false]]]}, "raw_delta": -0.05221806632147896, "tuned_delta": -0.04364627429090071}, {"byte_start": 451, "byte_end": 453, "display": {"text": " (", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "20 28", "compression": {"rwkv": "29.87% 29.87%", "qwen": "29.14% 29.14%"}, "model_tokens": {"rwkv": [[275, " (", "normal", 0.03586556017398834]], "qwen": [[320, " (", "normal", 0.03947778046131134]]}, "loss": {"rwkv": 29.868295768404316, "qwen": 29.142595625040475}, "topk": {"rwkv": [275, 4, 0.03586556017398834, [[45, 0.506669, ",", false], [47, 0.216995, ".", false], [60, 0.040546, ";", false], [275, 0.035866, " (", false], [4715, 0.034542, " or", false], [31601, 0.033976, " over", false], [21265, 0.030495, " and", false], [4596, 0.017488, " in", false], [59, 0.007921, ":", false], [45093, 0.006493, " across", false]]], "qwen": [320, 5, 0.03947778046131134, [[11, 0.466767, ",", false], [13, 0.157859, ".", false], [476, 0.118998, " or", false], [323, 0.048784, " and", false], [320, 0.039478, " (", false], [624, 0.024425, ".\n", false], [304, 0.023464, " in", false], [26, 0.020988, ";", false], [916, 0.012563, " over", false], [25, 0.008847, ":", false]]]}, "raw_delta": 0.040241360664367676, "tuned_delta": 0.048813152694945926}, {"byte_start": 453, "byte_end": 455, "display": {"text": "in", "kind": "normal"}, "is_word": true, "word_id": 77, "word_key": "in", "bytes_hex": "69 6e", "compression": {"rwkv": "27.75% 27.75%", "qwen": "31.87% 31.87%"}, "model_tokens": {"rwkv": [[1950, "in", "normal", 0.046454381197690964]], "qwen": [[258, "in", "normal", 0.029175065457820892]]}, "loss": {"rwkv": 27.754972954602124, "qwen": 31.869503092109046}, "topk": {"rwkv": [1950, 4, 0.046454381197690964, [[2101, 0.249234, "or", false], [7005, 0.057784, "and", false], [106, 0.047246, "i", false], [1950, 0.046454, "in", false], [102, 0.035355, "e", false], [98, 0.031601, "a", false], [1751, 0.029916, "as", false], [36003, 0.027355, "which", false], [8801, 0.023637, "the", false], [1752, 0.017978, "at", false]]], "qwen": [258, 7, 0.029175065457820892, [[269, 0.199894, "or", false], [72, 0.072016, "i", false], [437, 0.065276, "and", false], [300, 0.051478, "as", false], [68, 0.049405, "e", false], [8206, 0.038289, "which", false], [258, 0.029175, "in", false], [4535, 0.027088, "though", false], [1782, 0.021445, "the", false], [1958, 0.018568, "for", false]]]}, "raw_delta": -0.22815799713134766, "tuned_delta": -0.2195862051007694}, {"byte_start": 455, "byte_end": 461, "display": {"text": " which", "kind": "normal"}, "is_word": true, "word_id": 78, "word_key": " which", "bytes_hex": "20 77 68 69 63 68", "compression": {"rwkv": "17.75% 17.75% 17.75% 17.75% 17.75% 17.75%", "qwen": "7.09% 7.09% 7.09% 7.09% 7.09% 7.09%"}, "model_tokens": {"rwkv": [[40186, " which", "normal", 0.0027163508348166943]], "qwen": [[892, " which", "normal", 0.09437352418899536]]}, "loss": {"rwkv": 17.751911635938416, "qwen": 7.0947379523325065}, "topk": {"rwkv": [40186, 45, 0.0027163508348166943, [[22590, 0.177608, " the", false], [30808, 0.075171, " fact", false], [39920, 0.073222, " terms", false], [62293, 0.069717, " particular", false], [32074, 0.042744, " some", false], [39193, 0.040109, " other", false], [332, 0.036753, " a", false], [32251, 0.031779, " time", false], [56901, 0.025685, " practice", false], [55856, 0.025613, " contrast", false]]], "qwen": [892, 3, 0.09437352418899536, [[279, 0.158246, " the", false], [2097, 0.094419, " fact", false], [892, 0.094374, " which", false], [3793, 0.060052, " terms", false], [6588, 0.042931, " practice", false], [264, 0.037449, " a", false], [37555, 0.036592, "dependent", false], [1045, 0.031777, " some", false], [1008, 0.031536, " other", false], [12872, 0.027771, " contrast", false]]]}, "raw_delta": 0.5909591913223267, "tuned_delta": 0.5995309833529049}, {"byte_start": 461, "byte_end": 466, "display": {"text": " case", "kind": "normal"}, "is_word": true, "word_id": 79, "word_key": " case", "bytes_hex": "20 63 61 73 65", "compression": {"rwkv": "0.13% 0.13% 0.13% 0.13% 0.13%", "qwen": "0.09% 0.09% 0.09% 0.09% 0.09%"}, "model_tokens": {"rwkv": [[30405, " case", "normal", 0.9655082821846008]], "qwen": [[1142, " case", "normal", 0.9761645793914795]]}, "loss": {"rwkv": 0.12591881765571397, "qwen": 0.08700916041125867}, "topk": {"rwkv": [30405, 1, 0.9655082821846008, [[30405, 0.965508, " case", false], [22590, 0.005911, " the", false], [4601, 0.00319, " it", false], [4858, 0.001724, " we", false], [37045, 0.001544, " Moore", false], [37970, 0.001112, " cases", false], [39631, 0.000927, " sense", false], [39934, 0.000776, " there", false], [332, 0.000761, " a", false], [45, 0.000534, ",", false]]], "qwen": [1142, 1, 0.9761645793914795, [[1142, 0.976165, " case", false], [432, 0.004039, " it", false], [279, 0.00354, " the", false], [5048, 0.002521, " cases", false], [374, 0.000955, " is", false], [582, 0.000813, " we", false], [11, 0.000769, ",", false], [5530, 0.000749, " sense", false], [498, 0.000373, " you", false], [678, 0.000372, " all", false]]]}, "raw_delta": 0.0021576095372438436, "tuned_delta": 0.010729401567822091}, {"byte_start": 466, "byte_end": 477, "display": {"text": " leveraging", "kind": "normal"}, "is_word": true, "word_id": 80, "word_key": " leveraging", "bytes_hex": "20 6c 65 76 65 72 61 67 69 6e 67", "compression": {"rwkv": "25.92% 25.92% 25.92% 25.92% 25.92% 25.92% 0.12% 0.12% 0.12% 0.12% 0.12%", "qwen": "13.60% 13.60% 13.60% 13.60% 13.60% 13.60% 13.60% 13.60% 13.60% 13.60% 13.60%"}, "model_tokens": {"rwkv": [[38888, " lever", "normal", 0.00018302799435332417], [33672, "aging", "normal", 0.9668365120887756]], "qwen": [[76482, " leveraging", "normal", 0.0002496717497706413]]}, "loss": {"rwkv": 14.195685650970148, "qwen": 13.59963599700304}, "topk": {"rwkv": [38888, 281, 0.00018302799435332417, [[22590, 0.243117, " the", false], [45, 0.114183, ",", false], [4601, 0.110919, " it", false], [4858, 0.044102, " we", false], [39934, 0.037523, " there", false], [22799, 0.02861, " you", false], [332, 0.020253, " a", false], [22226, 0.018473, " one", false], [3609, 0.013339, " AI", false], [21273, 0.012267, " any", false]]], "qwen": [76482, 226, 0.0002496717497706413, [[11, 0.249015, ",", false], [279, 0.172923, " the", false], [432, 0.080018, " it", false], [582, 0.052138, " we", false], [264, 0.025589, " a", false], [498, 0.025274, " you", false], [1052, 0.022696, " there", false], [825, 0.012884, " one", false], [1429, 0.012434, " most", false], [678, 0.010484, " all", false]]]}, "raw_delta": 0.03305201096968225, "tuned_delta": 0.0416238030002605}, {"byte_start": 477, "byte_end": 483, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 81, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "17.38% 17.38% 17.38% 17.38% 17.38% 17.38%", "qwen": "20.96% 20.96% 20.96% 20.96% 20.96% 20.96%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.0030587823130190372]], "qwen": [[3738, " human", "normal", 0.0009363950230181217]]}, "loss": {"rwkv": 17.37620980237358, "qwen": 20.959572955879473}, "topk": {"rwkv": [38720, 22, 0.0030587823130190372, [[63370, 0.494007, " computation", false], [22590, 0.091681, " the", false], [4601, 0.030275, " it", false], [51832, 0.028739, " general", false], [31458, 0.026942, " more", false], [64862, 0.018743, " computational", false], [32227, 0.016501, " that", false], [37045, 0.015856, " Moore", false], [3609, 0.010519, " AI", false], [51266, 0.009519, " compute", false]]], "qwen": [3738, 62, 0.0009363950230181217, [[34447, 0.467746, " computation", false], [432, 0.120113, " it", false], [279, 0.068171, " the", false], [803, 0.032484, " more", false], [264, 0.021402, " a", false], [54480, 0.01602, " computational", false], [429, 0.011881, " that", false], [24231, 0.01097, " computing", false], [4586, 0.008736, " general", false], [374, 0.008231, " is", false]]]}, "raw_delta": -0.19870384534200036, "tuned_delta": -0.1901320533114221}, {"byte_start": 483, "byte_end": 493, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 82, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "4.93% 4.93% 4.93% 4.93% 4.93% 4.93% 4.93% 4.93% 4.93% 4.93%", "qwen": "4.41% 4.41% 4.41% 4.41% 4.41% 4.41% 4.41% 4.41% 4.41% 4.41%"}, "model_tokens": {"rwkv": [[59943, " knowledge", "normal", 0.06464724987745285]], "qwen": [[6540, " knowledge", "normal", 0.08692403882741928]]}, "loss": {"rwkv": 4.931086565538449, "qwen": 4.405126212973418}, "topk": {"rwkv": [59943, 3, 0.06464724987745285, [[64452, 0.161429, " intelligence", false], [46, 0.126777, "-", false], [59943, 0.064647, " knowledge", false], [63370, 0.054055, " computation", false], [38853, 0.05125, " labor", false], [59917, 0.04144, " intuition", false], [59683, 0.02794, " expertise", false], [52022, 0.02161, " insight", false], [38775, 0.019138, " ingen", false], [59304, 0.018953, " cognition", false]]], "qwen": [6540, 3, 0.08692403882741928, [[11229, 0.127482, " intelligence", false], [18726, 0.106964, " expertise", false], [6540, 0.086924, " knowledge", false], [34447, 0.051886, " computation", false], [9327, 0.038036, " labor", false], [56251, 0.029934, " intuition", false], [20017, 0.020528, " insight", false], [27597, 0.01394, " creativity", false], [6203, 0.01205, " expert", false], [23389, 0.011551, " wisdom", false]]]}, "raw_delta": 0.029165434837341297, "tuned_delta": 0.03773722686791955}, {"byte_start": 493, "byte_end": 499, "display": {"text": " would", "kind": "normal"}, "is_word": true, "word_id": 83, "word_key": " would", "bytes_hex": "20 77 6f 75 6c 64", "compression": {"rwkv": "7.84% 7.84% 7.84% 7.84% 7.84% 7.84%", "qwen": "4.58% 4.58% 4.58% 4.58% 4.58% 4.58%"}, "model_tokens": {"rwkv": [[40219, " would", "normal", 0.07254761457443237]], "qwen": [[1035, " would", "normal", 0.21791388094425201]]}, "loss": {"rwkv": 7.842775775665913, "qwen": 4.579520705536263}, "topk": {"rwkv": [40219, 3, 0.07254761457443237, [[4600, 0.283654, " is", false], [21265, 0.121108, " and", false], [40219, 0.072548, " would", false], [4811, 0.044603, " to", false], [45, 0.034357, ",", false], [22748, 0.029148, " was", false], [4715, 0.02871, " or", false], [4596, 0.027646, " in", false], [4706, 0.021113, " of", false], [21413, 0.020752, " can", false]]], "qwen": [1035, 1, 0.21791388094425201, [[1035, 0.217914, " would", false], [374, 0.210744, " is", false], [323, 0.095186, " and", false], [311, 0.050285, " to", false], [11, 0.038354, ",", false], [476, 0.036735, " or", false], [572, 0.023529, " was", false], [304, 0.022526, " in", false], [4566, 0.020117, " via", false], [911, 0.017185, " about", false]]]}, "raw_delta": 0.18095328410466507, "tuned_delta": 0.18952507613524333}, {"byte_start": 499, "byte_end": 502, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 84, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"rwkv": "2.61% 2.61% 2.61%", "qwen": "2.55% 2.55% 2.55%"}, "model_tokens": {"rwkv": [[4435, " be", "normal", 0.6493578553199768]], "qwen": [[387, " be", "normal", 0.6547784805297852]]}, "loss": {"rwkv": 2.606431470356037, "qwen": 2.5455050039505354}, "topk": {"rwkv": [4435, 1, 0.6493578553199768, [[4435, 0.649358, " be", false], [31059, 0.078901, " have", false], [22187, 0.022228, " not", false], [31358, 0.014631, " make", false], [39820, 0.013749, " still", false], [45150, 0.013105, " always", false], [31967, 0.012157, " seem", false], [31581, 0.008333, " only", false], [52724, 0.006661, " require", false], [53056, 0.005835, " suffice", false]]], "qwen": [387, 1, 0.6547784805297852, [[387, 0.654778, " be", false], [614, 0.071888, " have", false], [537, 0.016801, " not", false], [2058, 0.015372, " still", false], [76156, 0.012673, " suffice", false], [1281, 0.011296, " make", false], [2677, 0.010566, " always", false], [2803, 0.008881, " seem", false], [4658, 0.008868, " probably", false], [4363, 0.008818, " likely", false]]]}, "raw_delta": 0.0033784806728363037, "tuned_delta": 0.011950272703414552}, {"byte_start": 502, "byte_end": 506, "display": {"text": " one", "kind": "normal"}, "is_word": true, "word_id": 85, "word_key": " one", "bytes_hex": "20 6f 6e 65", "compression": {"rwkv": "25.92% 25.92% 25.92% 25.92%", "qwen": "30.48% 30.48% 30.48% 30.48%"}, "model_tokens": {"rwkv": [[22226, " one", "normal", 0.003145243041217327]], "qwen": [[825, " one", "normal", 0.0011593190720304847]]}, "loss": {"rwkv": 25.92342651597356, "qwen": 30.476583356024122}, "topk": {"rwkv": [22226, 47, 0.003145243041217327, [[22590, 0.309162, " the", false], [332, 0.095442, " a", false], [52371, 0.032758, " optimal", false], [31458, 0.032095, " more", false], [31461, 0.028556, " most", false], [4419, 0.023288, " an", false], [31466, 0.016389, " much", false], [62606, 0.015595, " sufficient", false], [32386, 0.015147, " very", false], [59829, 0.013637, " important", false]]], "qwen": [825, 67, 0.0011593190720304847, [[279, 0.387049, " the", false], [803, 0.096544, " more", false], [264, 0.065433, " a", false], [22823, 0.037437, " optimal", false], [1429, 0.022295, " most", false], [458, 0.016741, " an", false], [1753, 0.01659, " much", false], [14016, 0.016242, " sufficient", false], [3041, 0.015432, " far", false], [2664, 0.014423, " better", false]]]}, "raw_delta": -0.2524806261062622, "tuned_delta": -0.24390883407568395}, {"byte_start": 506, "byte_end": 509, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 86, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "3.05% 3.05% 3.05%", "qwen": "4.45% 4.45% 4.45%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.6023615598678589]], "qwen": [[315, " of", "normal", 0.4768576920032501]]}, "loss": {"rwkv": 3.052577397714278, "qwen": 4.451538741005137}, "topk": {"rwkv": [4706, 1, 0.6023615598678589, [[4706, 0.602362, " of", false], [22752, 0.073385, " way", false], [39941, 0.05559, " thing", false], [460, 0.03488, "'s", false], [55532, 0.028022, " approach", false], [56895, 0.0144, " possible", false], [46713, 0.012885, " option", false], [46561, 0.01138, " method", false], [57260, 0.010802, " solution", false], [57317, 0.007598, " strategy", false]]], "qwen": [315, 1, 0.4768576920032501, [[315, 0.476858, " of", false], [1616, 0.127351, " way", false], [2999, 0.081661, " option", false], [5486, 0.029032, " approach", false], [6291, 0.027137, " solution", false], [3204, 0.023123, " possible", false], [594, 0.022702, "'s", false], [1714, 0.017687, " method", false], [7373, 0.012969, " effective", false], [8282, 0.008211, " strategy", false]]]}, "raw_delta": -0.07757488886515299, "tuned_delta": -0.06900309683457474}, {"byte_start": 509, "byte_end": 513, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 87, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "0.20% 0.20% 0.20% 0.20%", "qwen": "0.27% 0.27% 0.27% 0.27%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.9564296007156372]], "qwen": [[279, " the", "normal", 0.9428697228431702]]}, "loss": {"rwkv": 0.20142608069052145, "qwen": 0.26521777134132535}, "topk": {"rwkv": [22590, 1, 0.9564296007156372, [[22590, 0.95643, " the", false], [21902, 0.006275, " its", false], [52869, 0.005485, " several", false], [31370, 0.00482, " many", false], [22638, 0.003368, " two", false], [31581, 0.002841, " only", false], [21674, 0.002612, " few", false], [332, 0.002472, " a", false], [45, 0.00179, ",", false], [22248, 0.001758, " our", false]]], "qwen": [279, 1, 0.9428697228431702, [[279, 0.94287, " the", false], [1181, 0.008991, " its", false], [1172, 0.008451, " only", false], [1657, 0.007163, " many", false], [1039, 0.006467, " our", false], [3807, 0.004442, " several", false], [264, 0.00355, " a", false], [697, 0.003538, " your", false], [2421, 0.002282, " few", false], [1378, 0.00215, " two", false]]]}, "raw_delta": -0.003537362441420555, "tuned_delta": 0.005034429589157693}, {"byte_start": 513, "byte_end": 518, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 88, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"rwkv": "12.74% 12.74% 12.74% 12.74% 12.74%", "qwen": "9.09% 9.09% 9.09% 9.09% 9.09%"}, "model_tokens": {"rwkv": [[31581, " only", "normal", 0.02967231720685959]], "qwen": [[1172, " only", "normal", 0.08046524226665497]]}, "loss": {"rwkv": 12.73629215784788, "qwen": 9.08872587431064}, "topk": {"rwkv": [31581, 6, 0.02967231720685959, [[31461, 0.423654, " most", false], [30273, 0.101899, " best", false], [21674, 0.072791, " few", false], [51039, 0.051311, " biggest", false], [31458, 0.032277, " more", false], [31581, 0.029672, " only", false], [31356, 0.026761, " main", false], [51900, 0.013557, " hardest", false], [38879, 0.013002, " least", false], [51718, 0.012076, " fastest", false]]], "qwen": [1172, 4, 0.08046524226665497, [[1429, 0.287685, " most", false], [1850, 0.214394, " best", false], [2421, 0.089719, " few", false], [1172, 0.080465, " only", false], [1887, 0.038782, " main", false], [803, 0.03611, " more", false], [2664, 0.032344, " better", false], [6028, 0.021359, " primary", false], [1376, 0.015158, " key", false], [42049, 0.008197, " cheapest", false]]]}, "raw_delta": 0.20226402282714853, "tuned_delta": 0.2108358148577268}, {"byte_start": 518, "byte_end": 523, "display": {"text": " ways", "kind": "normal"}, "is_word": true, "word_id": 89, "word_key": " ways", "bytes_hex": "20 77 61 79 73", "compression": {"rwkv": "3.66% 3.66% 3.66% 3.66% 3.66%", "qwen": "6.60% 6.60% 6.60% 6.60% 6.60%"}, "model_tokens": {"rwkv": [[32448, " ways", "normal", 0.36083072423934937]], "qwen": [[5510, " ways", "normal", 0.16065028309822083]]}, "loss": {"rwkv": 3.6630928772571334, "qwen": 6.59501140337346}, "topk": {"rwkv": [32448, 1, 0.36083072423934937, [[32448, 0.360831, " ways", false], [59593, 0.078728, " effective", false], [47539, 0.069458, " things", false], [52373, 0.038043, " options", false], [52957, 0.023711, " sources", false], [56895, 0.02279, " possible", false], [47720, 0.021107, " viable", false], [52224, 0.020653, " methods", false], [60376, 0.019046, " remaining", false], [56212, 0.009926, " feasible", false]]], "qwen": [5510, 2, 0.16065028309822083, [[2606, 0.185292, " options", false], [5510, 0.16065, " ways", false], [7373, 0.121537, " effective", false], [30428, 0.061611, " viable", false], [5413, 0.035611, " methods", false], [3363, 0.030889, " means", false], [19827, 0.029106, " approaches", false], [3204, 0.028069, " possible", false], [2513, 0.027952, " things", false], [4586, 0.015256, " general", false]]]}, "raw_delta": -0.16258008480072023, "tuned_delta": -0.15400829277014197}, {"byte_start": 523, "byte_end": 526, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 90, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "1.25% 1.25% 1.25%", "qwen": "1.50% 1.50% 1.50%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.8142113089561462]], "qwen": [[311, " to", "normal", 0.7796909809112549]]}, "loss": {"rwkv": 1.2503826648329637, "qwen": 1.4959401207549632}, "topk": {"rwkv": [4811, 1, 0.8142113089561462, [[4811, 0.814211, " to", false], [4706, 0.04424, " of", false], [21700, 0.041475, " for", false], [4596, 0.02162, " in", false], [32227, 0.014735, " that", false], [22590, 0.010563, " the", false], [22799, 0.00714, " you", false], [51791, 0.005268, " forward", false], [4601, 0.004944, " it", false], [4858, 0.004208, " we", false]]], "qwen": [311, 1, 0.7796909809112549, [[311, 0.779691, " to", false], [315, 0.058685, " of", false], [429, 0.026445, " that", false], [582, 0.012324, " we", false], [458, 0.011095, " an", false], [369, 0.010228, " for", false], [498, 0.009548, " you", false], [4637, 0.009054, " forward", false], [701, 0.008555, "),", false], [279, 0.007961, " the", false]]]}, "raw_delta": -0.013616596659024552, "tuned_delta": -0.005044804628446304}, {"byte_start": 526, "byte_end": 534, "display": {"text": " improve", "kind": "normal"}, "is_word": true, "word_id": 91, "word_key": " improve", "bytes_hex": "20 69 6d 70 72 6f 76 65", "compression": {"rwkv": "3.15% 3.15% 3.15% 3.15% 3.15% 3.15% 3.15% 3.15%", "qwen": "3.96% 3.96% 3.96% 3.96% 3.96% 3.96% 3.96% 3.96%"}, "model_tokens": {"rwkv": [[51982, " improve", "normal", 0.24621953070163727]], "qwen": [[7269, " improve", "normal", 0.17285309731960297]]}, "loss": {"rwkv": 3.1523731972549367, "qwen": 3.9568462317260016}, "topk": {"rwkv": [51982, 1, 0.24621953070163727, [[51982, 0.24622, " improve", false], [21751, 0.111641, " get", false], [31358, 0.076892, " make", false], [30938, 0.068315, " gain", false], [56433, 0.067356, " increase", false], [50848, 0.02381, " achieve", false], [37886, 0.019291, " boost", false], [39590, 0.016851, " scale", false], [46694, 0.014257, " obtain", false], [56950, 0.011286, " progress", false]]], "qwen": [7269, 1, 0.17285309731960297, [[7269, 0.172853, " improve", false], [1281, 0.086589, " make", false], [633, 0.077066, " get", false], [8722, 0.046208, " gain", false], [11075, 0.041978, " achieve", false], [32064, 0.035684, " leverage", false], [653, 0.034434, " do", false], [11625, 0.030462, " solve", false], [7949, 0.025845, " reduce", false], [11912, 0.017287, " advance", false]]]}, "raw_delta": -0.04460945725440979, "tuned_delta": -0.03603766522383154}, {"byte_start": 534, "byte_end": 546, "display": {"text": " performance", "kind": "normal"}, "is_word": true, "word_id": 92, "word_key": " performance", "bytes_hex": "20 70 65 72 66 6f 72 6d 61 6e 63 65", "compression": {"rwkv": "1.50% 1.50% 1.50% 1.50% 1.50% 1.50% 1.50% 1.50% 1.50% 1.50% 1.50% 1.50%", "qwen": "0.92% 0.92% 0.92% 0.92% 0.92% 0.92% 0.92% 0.92% 0.92% 0.92% 0.92% 0.92%"}, "model_tokens": {"rwkv": [[63750, " performance", "normal", 0.36821308732032776]], "qwen": [[5068, " performance", "normal", 0.5418747663497925]]}, "loss": {"rwkv": 1.4969369931098861, "qwen": 0.9208005767516142}, "topk": {"rwkv": [63750, 1, 0.36821308732032776, [[63750, 0.368213, " performance", false], [22590, 0.107144, " the", false], [499, 0.100461, ").", false], [497, 0.084869, "),", false], [37636, 0.040538, " agent", false], [21902, 0.026867, " its", false], [42, 0.024772, ")", false], [3609, 0.021786, " AI", false], [52738, 0.016742, " results", false], [4712, 0.014022, " on", false]]], "qwen": [5068, 1, 0.5418747663497925, [[5068, 0.541875, " performance", false], [279, 0.105896, " the", false], [458, 0.056244, " an", false], [6832, 0.034256, " learning", false], [264, 0.028226, " a", false], [701, 0.014869, "),", false], [8315, 0.01308, " agent", false], [3059, 0.012277, " results", false], [432, 0.011117, " it", false], [1181, 0.009955, " its", false]]]}, "raw_delta": 0.03194778660933177, "tuned_delta": 0.04051957863991002}, {"byte_start": 546, "byte_end": 547, "display": {"text": ")", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29", "compression": {"rwkv": "52.13%", "qwen": "38.82%"}, "model_tokens": {"rwkv": [[42, ")", "normal", 0.05620365962386131]], "qwen": [[8, ")", "normal", 0.1161569133400917]]}, "loss": {"rwkv": 52.12862940712074, "qwen": 38.82316582572192}, "topk": {"rwkv": [42, 3, 0.05620365962386131, [[499, 0.436642, ").", false], [497, 0.350471, "),", false], [42, 0.056204, ")", false], [45, 0.039232, ",", false], [502, 0.022127, ");", false], [580, 0.012594, ".)", false], [31601, 0.004716, " over", false], [4712, 0.004529, " on", false], [45302, 0.003999, " beyond", false], [53356, 0.003695, " without", false]]], "qwen": [8, 3, 0.1161569133400917, [[701, 0.481042, "),", false], [568, 0.212925, ").", false], [8, 0.116157, ")", false], [11, 0.039897, ",", false], [4292, 0.036839, ").\n", false], [1215, 0.015695, ");", false], [11941, 0.009442, " significantly", false], [304, 0.008665, " in", false], [389, 0.006226, " on", false], [26, 0.005549, ";", false]]]}, "raw_delta": 0.7378115653991699, "tuned_delta": 0.7463833574297482}, {"byte_start": 547, "byte_end": 551, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 93, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"rwkv": "6.97% 6.97% 6.97% 6.97%", "qwen": "8.82% 8.82% 8.82% 8.82%"}, "model_tokens": {"rwkv": [[21400, " but", "normal", 0.21142247319221497]], "qwen": [[714, " but", "normal", 0.1414593905210495]]}, "loss": {"rwkv": 6.9739652855472345, "qwen": 8.817312958699693}, "topk": {"rwkv": [21400, 3, 0.21142247319221497, [[4715, 0.267768, " or", false], [21265, 0.226245, " and", false], [21400, 0.211422, " but", false], [47001, 0.030983, " rather", false], [40187, 0.030587, " while", false], [32465, 0.027229, " when", false], [53339, 0.01865, " whereas", false], [280, 0.015949, " -", false], [40186, 0.015909, " which", false], [4788, 0.014765, " so", false]]], "qwen": [714, 3, 0.1414593905210495, [[476, 0.532945, " or", false], [323, 0.185605, " and", false], [714, 0.141459, " but", false], [4751, 0.02819, " rather", false], [1177, 0.011847, " --", false], [1959, 0.011388, " —", false], [481, 0.010769, " -", false], [1365, 0.006627, " –", false], [19853, 0.006069, " whereas", false], [448, 0.005423, " with", false]]]}, "raw_delta": -0.10221689939498901, "tuned_delta": -0.09364510736441077}, {"byte_start": 551, "byte_end": 552, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "71.01%", "qwen": "57.75%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.01958964765071869]], "qwen": [[11, ",", "normal", 0.04066253453493118]]}, "loss": {"rwkv": 71.00764654375367, "qwen": 57.75195044194827}, "topk": {"rwkv": [45, 9, 0.01958964765071869, [[4596, 0.17061, " in", false], [32234, 0.147972, " this", false], [22590, 0.133822, " the", false], [32227, 0.077687, " that", false], [37045, 0.043538, " Moore", false], [4601, 0.039977, " it", false], [4423, 0.029204, " as", false], [4858, 0.026044, " we", false], [45, 0.01959, ",", false], [39934, 0.011875, " there", false]]], "qwen": [11, 6, 0.04066253453493118, [[304, 0.159878, " in", false], [279, 0.15586, " the", false], [419, 0.107942, " this", false], [438, 0.055029, " as", false], [429, 0.041814, " that", false], [11, 0.040663, ",", false], [432, 0.035516, " it", false], [582, 0.022734, " we", false], [448, 0.02131, " with", false], [1052, 0.014629, " there", false]]]}, "raw_delta": 0.7350518703460693, "tuned_delta": 0.7436236623766476}, {"byte_start": 552, "byte_end": 557, "display": {"text": " over", "kind": "normal"}, "is_word": true, "word_id": 94, "word_key": " over", "bytes_hex": "20 6f 76 65 72", "compression": {"rwkv": "19.16% 19.16% 19.16% 19.16% 19.16%", "qwen": "16.27% 16.27% 16.27% 16.27% 16.27%"}, "model_tokens": {"rwkv": [[31601, " over", "normal", 0.004932222422212362]], "qwen": [[916, " over", "normal", 0.010989399626851082]]}, "loss": {"rwkv": 19.160793511806542, "qwen": 16.269359271746694}, "topk": {"rwkv": [31601, 21, 0.004932222422212362, [[4596, 0.326112, " in", false], [4423, 0.296477, " as", false], [4706, 0.035262, " of", false], [32487, 0.018424, " with", false], [47532, 0.01812, " thanks", false], [21700, 0.016462, " for", false], [4588, 0.011504, " if", false], [4450, 0.009814, " by", false], [4811, 0.009197, " to", false], [4424, 0.008497, " at", false]]], "qwen": [916, 16, 0.010989399626851082, [[438, 0.261753, " as", false], [304, 0.210697, " in", false], [448, 0.049432, " with", false], [2474, 0.032234, " since", false], [369, 0.026634, " for", false], [2661, 0.020306, " given", false], [315, 0.019959, " of", false], [4518, 0.019633, " instead", false], [553, 0.016233, " by", false], [9339, 0.015698, " thanks", false]]]}, "raw_delta": 0.1603351593017578, "tuned_delta": 0.16890695133233605}, {"byte_start": 557, "byte_end": 559, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 95, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "40.86% 40.86%", "qwen": "44.14% 44.14%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.010926105082035065]], "qwen": [[264, " a", "normal", 0.007482042536139488]]}, "loss": {"rwkv": 40.857574400175714, "qwen": 44.1396999083741}, "topk": {"rwkv": [332, 5, 0.010926105082035065, [[22590, 0.661074, " the", false], [32251, 0.19141, " time", false], [3543, 0.027993, " 70", false], [51396, 0.013112, " decades", false], [332, 0.010926, " a", false], [32234, 0.0098, " this", false], [21265, 0.007761, " and", false], [37045, 0.005412, " Moore", false], [21256, 0.004755, " all", false], [31370, 0.004583, " many", false]]], "qwen": [264, 3, 0.007482042536139488, [[279, 0.658494, " the", false], [882, 0.28459, " time", false], [264, 0.007482, " a", false], [323, 0.004873, " and", false], [3213, 0.004735, " recent", false], [1657, 0.00455, " many", false], [220, 0.004311, " ", false], [10793, 0.00318, " decades", false], [1429, 0.002201, " most", false], [1293, 0.001318, " long", false]]]}, "raw_delta": -0.18199968338012695, "tuned_delta": -0.1734278913495487}, {"byte_start": 559, "byte_end": 568, "display": {"text": " slightly", "kind": "normal"}, "is_word": true, "word_id": 96, "word_key": " slightly", "bytes_hex": "20 73 6c 69 67 68 74 6c 79", "compression": {"rwkv": "16.41% 16.41% 16.41% 16.41% 16.41% 16.41% 16.41% 16.41% 16.41%", "qwen": "18.33% 18.33% 18.33% 18.33% 18.33% 18.33% 18.33% 18.33% 18.33%"}, "model_tokens": {"rwkv": [[57245, " slightly", "normal", 0.00027180774486623704]], "qwen": [[10078, " slightly", "normal", 0.00010625468712532893]]}, "loss": {"rwkv": 16.405646732331093, "qwen": 18.333591357686608}, "topk": {"rwkv": [57245, 160, 0.00027180774486623704, [[3543, 0.352651, " 70", false], [46790, 0.081259, " period", false], [31323, 0.072853, " long", false], [32251, 0.028968, " time", false], [32386, 0.028762, " very", false], [51158, 0.027304, " century", false], [46470, 0.024455, " longer", false], [32470, 0.019755, " wide", false], [39962, 0.019684, " times", false], [38864, 0.017952, " large", false]]], "qwen": [10078, 244, 0.00010625468712532893, [[4168, 0.154879, " period", false], [1293, 0.103377, " long", false], [9390, 0.074917, " span", false], [220, 0.070935, " ", false], [9294, 0.047748, " century", false], [3460, 0.046555, " large", false], [1602, 0.043272, " very", false], [2421, 0.028123, " few", false], [1753, 0.024449, " much", false], [6884, 0.024078, " wide", false]]]}, "raw_delta": -0.10690795050726998, "tuned_delta": -0.09833615847669173}, {"byte_start": 568, "byte_end": 575, "display": {"text": " longer", "kind": "normal"}, "is_word": true, "word_id": 97, "word_key": " longer", "bytes_hex": "20 6c 6f 6e 67 65 72", "compression": {"rwkv": "0.54% 0.54% 0.54% 0.54% 0.54% 0.54% 0.54%", "qwen": "1.14% 1.14% 1.14% 1.14% 1.14% 1.14% 1.14%"}, "model_tokens": {"rwkv": [[46470, " longer", "normal", 0.8115249872207642]], "qwen": [[5021, " longer", "normal", 0.6415794491767883]]}, "loss": {"rwkv": 0.5409100059136565, "qwen": 1.1433932558448097}, "topk": {"rwkv": [46470, 1, 0.8115249872207642, [[46470, 0.811525, " longer", false], [52888, 0.062396, " shorter", false], [46397, 0.029515, " larger", false], [31458, 0.02152, " more", false], [40192, 0.012926, " wider", false], [59513, 0.008585, " different", false], [51093, 0.007774, " broader", false], [31277, 0.007634, " less", false], [52932, 0.006084, " smaller", false], [56189, 0.005376, " extended", false]]], "qwen": [5021, 1, 0.6415794491767883, [[5021, 0.641579, " longer", false], [23327, 0.093429, " shorter", false], [803, 0.051857, " more", false], [2155, 0.041469, " different", false], [8131, 0.029925, " larger", false], [11577, 0.017777, " extended", false], [2686, 0.014145, " less", false], [9155, 0.013051, " smaller", false], [21864, 0.009469, " wider", false], [26829, 0.005714, " broader", false]]]}, "raw_delta": -0.03340876528194973, "tuned_delta": -0.024836973251371477}, {"byte_start": 575, "byte_end": 580, "display": {"text": " time", "kind": "normal"}, "is_word": true, "word_id": 98, "word_key": " time", "bytes_hex": "20 74 69 6d 65", "compression": {"rwkv": "2.86% 2.86% 2.86% 2.86% 2.86%", "qwen": "2.15% 2.15% 2.15% 2.15% 2.15%"}, "model_tokens": {"rwkv": [[32251, " time", "normal", 0.45157119631767273]], "qwen": [[882, " time", "normal", 0.551668107509613]]}, "loss": {"rwkv": 2.8600302080123003, "qwen": 2.145318681147023}, "topk": {"rwkv": [32251, 1, 0.45157119631767273, [[32251, 0.451571, " time", false], [46790, 0.231621, " period", false], [39962, 0.15603, " times", false], [51940, 0.057501, " horizon", false], [51929, 0.012244, " history", false], [57431, 0.010235, " timeline", false], [32219, 0.009432, " term", false], [32091, 0.006999, " span", false], [62061, 0.004207, " historical", false], [46, 0.004151, "-", false]]], "qwen": [882, 1, 0.551668107509613, [[882, 0.551668, " time", false], [3039, 0.204437, " times", false], [4168, 0.095723, " period", false], [4647, 0.016563, " term", false], [69953, 0.015943, " timeframe", false], [34074, 0.01331, " horizon", false], [9390, 0.011896, " span", false], [3840, 0.010853, " history", false], [13656, 0.010749, " historical", false], [1651, 0.009354, " view", false]]]}, "raw_delta": 0.03963202238082886, "tuned_delta": 0.04820381441140711}, {"byte_start": 580, "byte_end": 585, "display": {"text": " than", "kind": "normal"}, "is_word": true, "word_id": 99, "word_key": " than", "bytes_hex": "20 74 68 61 6e", "compression": {"rwkv": "18.71% 18.71% 18.71% 18.71% 18.71%", "qwen": "18.76% 18.76% 18.76% 18.76% 18.76%"}, "model_tokens": {"rwkv": [[32226, " than", "normal", 0.005589666310697794]], "qwen": [[1091, " than", "normal", 0.005510401912033558]]}, "loss": {"rwkv": 18.709951311528744, "qwen": 18.759066116962142}, "topk": {"rwkv": [32226, 11, 0.005589666310697794, [[51940, 0.228612, " horizon", false], [38549, 0.175132, " frame", false], [39590, 0.152856, " scale", false], [46790, 0.144326, " period", false], [34478, 0.11341, "frame", false], [32091, 0.061881, " span", false], [46, 0.059069, "-", false], [45, 0.023141, ",", false], [47797, 0.00688, " window", false], [56485, 0.006755, " interval", false]]], "qwen": [1091, 9, 0.005510401912033558, [[34074, 0.294978, " horizon", false], [5452, 0.278795, " scale", false], [4168, 0.118818, " period", false], [4034, 0.117693, " frame", false], [9390, 0.071881, " span", false], [11, 0.034453, ",", false], [12934, 0.018418, "-scale", false], [3241, 0.006431, " window", false], [1091, 0.00551, " than", false], [46767, 0.005317, "-frame", false]]]}, "raw_delta": -0.002723503112792791, "tuned_delta": 0.005848288917785457}, {"byte_start": 585, "byte_end": 587, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 100, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "33.11% 33.11%", "qwen": "33.10% 33.10%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.025658704340457916]], "qwen": [[264, " a", "normal", 0.025462068617343903]]}, "loss": {"rwkv": 33.10872408290101, "qwen": 33.09691532413615}, "topk": {"rwkv": [332, 8, 0.025658704340457916, [[22590, 0.213247, " the", false], [37045, 0.177998, " Moore", false], [32227, 0.119683, " that", false], [3543, 0.097836, " 70", false], [32234, 0.036235, " this", false], [4858, 0.034825, " we", false], [4601, 0.030683, " it", false], [332, 0.025659, " a", false], [22799, 0.02395, " you", false], [22226, 0.014899, " one", false]]], "qwen": [264, 9, 0.025462068617343903, [[20219, 0.190439, " Moore", false], [279, 0.189425, " the", false], [429, 0.086501, " that", false], [220, 0.058331, " ", false], [1429, 0.044907, " most", false], [582, 0.042566, " we", false], [358, 0.041866, " I", false], [1128, 0.027468, " what", false], [264, 0.025462, " a", false], [374, 0.022678, " is", false]]]}, "raw_delta": 0.0006548166275024414, "tuned_delta": 0.00922660865808069}, {"byte_start": 587, "byte_end": 595, "display": {"text": " typical", "kind": "normal"}, "is_word": true, "word_id": 101, "word_key": " typical", "bytes_hex": "20 74 79 70 69 63 61 6c", "compression": {"rwkv": "6.66% 6.66% 6.66% 6.66% 6.66% 6.66% 6.66% 6.66%", "qwen": "2.64% 2.64% 2.64% 2.64% 2.64% 2.64% 2.64% 2.64%"}, "model_tokens": {"rwkv": [[53216, " typical", "normal", 0.05195503309369087]], "qwen": [[14260, " typical", "normal", 0.30994606018066406]]}, "loss": {"rwkv": 6.656966863476906, "qwen": 2.640485647564225}, "topk": {"rwkv": [53216, 5, 0.05195503309369087, [[38720, 0.225584, " human", false], [51158, 0.140021, " century", false], [45674, 0.123761, " decade", false], [47289, 0.055681, " single", false], [53216, 0.051955, " typical", false], [3543, 0.046264, " 70", false], [32512, 0.041299, " year", false], [21674, 0.026703, " few", false], [62035, 0.023279, " generation", false], [56546, 0.022834, " lifetime", false]]], "qwen": [14260, 1, 0.30994606018066406, [[14260, 0.309946, " typical", false], [3175, 0.145236, " single", false], [3738, 0.103433, " human", false], [13212, 0.090959, " decade", false], [9471, 0.052553, " generation", false], [2421, 0.034489, " few", false], [9294, 0.033726, " century", false], [8338, 0.02265, " quarter", false], [6931, 0.017734, " career", false], [19031, 0.015397, " lifetime", false]]]}, "raw_delta": 0.22272101044654846, "tuned_delta": 0.23129280247712672}, {"byte_start": 595, "byte_end": 604, "display": {"text": " research", "kind": "normal"}, "is_word": true, "word_id": 102, "word_key": " research", "bytes_hex": "20 72 65 73 65 61 72 63 68", "compression": {"rwkv": "4.60% 4.60% 4.60% 4.60% 4.60% 4.60% 4.60% 4.60% 4.60%", "qwen": "4.11% 4.11% 4.11% 4.11% 4.11% 4.11% 4.11% 4.11% 4.11%"}, "model_tokens": {"rwkv": [[57103, " research", "normal", 0.10117557644844055]], "qwen": [[3412, " research", "normal", 0.12872017920017242]]}, "loss": {"rwkv": 4.602347461169218, "qwen": 4.107902594964088}, "topk": {"rwkv": [57103, 3, 0.10117557644844055, [[38720, 0.224203, " human", false], [3609, 0.155414, " AI", false], [57103, 0.101176, " research", false], [45418, 0.064269, " career", false], [56546, 0.034277, " lifetime", false], [37636, 0.032286, " agent", false], [46795, 0.023784, " person", false], [55427, 0.022258, " academic", false], [62496, 0.017639, " researcher", false], [31293, 0.016912, " life", false]]], "qwen": [3412, 1, 0.12872017920017242, [[3412, 0.12872, " research", false], [15235, 0.117699, " AI", false], [14250, 0.113605, " academic", false], [29561, 0.081167, " PhD", false], [3738, 0.06284, " human", false], [5567, 0.053965, " paper", false], [6931, 0.045386, " career", false], [220, 0.019262, " ", false], [31085, 0.01882, " researcher", false], [2390, 0.015059, " project", false]]]}, "raw_delta": 0.027417845196194113, "tuned_delta": 0.03598963722677236}, {"byte_start": 604, "byte_end": 612, "display": {"text": " project", "kind": "normal"}, "is_word": true, "word_id": 103, "word_key": " project", "bytes_hex": "20 70 72 6f 6a 65 63 74", "compression": {"rwkv": "6.87% 6.87% 6.87% 6.87% 6.87% 6.87% 6.87% 6.87%", "qwen": "2.24% 2.24% 2.24% 2.24% 2.24% 2.24% 2.24% 2.24%"}, "model_tokens": {"rwkv": [[52581, " project", "normal", 0.04778331145644188]], "qwen": [[2390, " project", "normal", 0.3694009780883789]]}, "loss": {"rwkv": 6.868299144857125, "qwen": 2.2449068743387732}, "topk": {"rwkv": [52581, 3, 0.04778331145644188, [[45418, 0.69158, " career", false], [56546, 0.070966, " lifetime", false], [52581, 0.047783, " project", false], [38172, 0.040292, " cycle", false], [46790, 0.021795, " period", false], [31293, 0.017644, " life", false], [52580, 0.012708, " program", false], [56545, 0.010023, " lifespan", false], [39227, 0.008893, " paper", false], [51136, 0.004323, " careers", false]]], "qwen": [2390, 1, 0.3694009780883789, [[2390, 0.369401, " project", false], [5567, 0.149084, " paper", false], [6931, 0.101524, " career", false], [2025, 0.099172, " program", false], [10775, 0.03564, " cycle", false], [2083, 0.016677, " team", false], [5041, 0.015622, " effort", false], [4168, 0.014426, " period", false], [4549, 0.013782, " article", false], [18402, 0.012573, " agenda", false]]]}, "raw_delta": 0.2563753053545952, "tuned_delta": 0.2649470973851734}, {"byte_start": 612, "byte_end": 613, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "4.51%", "qwen": "3.30%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.7766553163528442]], "qwen": [[11, ",", "normal", 0.832703709602356]]}, "loss": {"rwkv": 4.50842200277801, "qwen": 3.301560622637448}, "topk": {"rwkv": [45, 1, 0.7766553163528442, [[45, 0.776655, ",", false], [38867, 0.031888, " lasts", false], [40219, 0.021599, " would", false], [275, 0.019371, " (", false], [39751, 0.016786, " spans", false], [460, 0.012185, "'s", false], [4600, 0.007147, " is", false], [4596, 0.006393, " in", false], [39021, 0.006077, " might", false], [32091, 0.006073, " span", false]]], "qwen": [11, 1, 0.832703709602356, [[11, 0.832704, ",", false], [320, 0.039765, " (", false], [1035, 0.012515, " would", false], [39658, 0.008696, " lasts", false], [476, 0.008524, " or", false], [304, 0.005829, " in", false], [60861, 0.005639, " lifespan", false], [323, 0.005504, " and", false], [594, 0.005473, "'s", false], [44295, 0.004554, " spans", false]]]}, "raw_delta": 0.06692260503768921, "tuned_delta": 0.07549439706826745}, {"byte_start": 613, "byte_end": 623, "display": {"text": " massively", "kind": "normal"}, "is_word": true, "word_id": 104, "word_key": " massively", "bytes_hex": "20 6d 61 73 73 69 76 65 6c 79", "compression": {"rwkv": "15.44% 15.44% 15.44% 15.44% 15.44% 15.44% 15.44% 15.44% 15.44% 15.44%", "qwen": "16.97% 16.97% 16.97% 16.97% 16.97% 16.97% 16.97% 16.97% 16.97% 16.97%"}, "model_tokens": {"rwkv": [[59988, " massively", "normal", 0.00019152526510879397]], "qwen": [[63707, " massively", "normal", 8.201191667467356e-05]]}, "loss": {"rwkv": 15.441345359514685, "qwen": 16.967257989641936}, "topk": {"rwkv": [59988, 216, 0.00019152526510879397, [[22590, 0.256342, " the", false], [63370, 0.097579, " computation", false], [32234, 0.088188, " this", false], [37045, 0.069253, " Moore", false], [4858, 0.068895, " we", false], [4601, 0.035164, " it", false], [32227, 0.034894, " that", false], [39934, 0.025479, " there", false], [59346, 0.017852, " computing", false], [3609, 0.015093, " AI", false]]], "qwen": [63707, 349, 8.201191667467356e-05, [[279, 0.314859, " the", false], [419, 0.094283, " this", false], [34447, 0.08315, " computation", false], [20219, 0.059401, " Moore", false], [582, 0.056349, " we", false], [432, 0.035309, " it", false], [429, 0.026882, " that", false], [264, 0.017638, " a", false], [1052, 0.016266, " there", false], [58755, 0.015347, " exponential", false]]]}, "raw_delta": -0.0846145629882813, "tuned_delta": -0.07604277095770305}, {"byte_start": 623, "byte_end": 628, "display": {"text": " more", "kind": "normal"}, "is_word": true, "word_id": 105, "word_key": " more", "bytes_hex": "20 6d 6f 72 65", "compression": {"rwkv": "5.27% 5.27% 5.27% 5.27% 5.27%", "qwen": "5.55% 5.55% 5.55% 5.55% 5.55%"}, "model_tokens": {"rwkv": [[31458, " more", "normal", 0.23121775686740875]], "qwen": [[803, " more", "normal", 0.21473440527915955]]}, "loss": {"rwkv": 5.2692182157467995, "qwen": 5.548436778945468}, "topk": {"rwkv": [31458, 2, 0.23121775686740875, [[56812, 0.313952, " parallel", false], [31458, 0.231218, " more", false], [62092, 0.072949, " increasing", false], [59846, 0.053951, " increased", false], [56418, 0.049645, " improved", false], [56900, 0.023781, " powerful", false], [51178, 0.017607, " cheaper", false], [45301, 0.017191, " better", false], [45961, 0.01161, " faster", false], [59832, 0.011259, " improving", false]]], "qwen": [803, 1, 0.21473440527915955, [[803, 0.214734, " more", false], [23048, 0.151313, " cheaper", false], [7703, 0.085892, " increasing", false], [7172, 0.07638, " increased", false], [15279, 0.059274, " parallel", false], [12944, 0.033619, " improved", false], [4722, 0.026703, " lower", false], [11046, 0.023342, " reduced", false], [17719, 0.021584, " reducing", false], [15679, 0.019332, " falling", false]]]}, "raw_delta": -0.015483164787292503, "tuned_delta": -0.0069113727567142545}, {"byte_start": 628, "byte_end": 640, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 106, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75%", "qwen": "0.69% 0.69% 0.69% 0.69% 0.69% 0.69% 0.69% 0.69% 0.69% 0.69% 0.69% 0.69%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.3156513571739197]], "qwen": [[34447, " computation", "normal", 0.6322945952415466]]}, "loss": {"rwkv": 1.7493616625362591, "qwen": 0.6888867195008749}, "topk": {"rwkv": [63370, 1, 0.3156513571739197, [[63370, 0.315651, " computation", false], [59346, 0.137415, " computing", false], [51266, 0.083689, " compute", false], [64862, 0.048811, " computational", false], [56900, 0.037103, " powerful", false], [60406, 0.033935, " resources", false], [39339, 0.021235, " power", false], [21265, 0.016942, " and", false], [4600, 0.015517, " is", false], [59345, 0.014426, " computers", false]]], "qwen": [34447, 1, 0.6322945952415466, [[34447, 0.632295, " computation", false], [24231, 0.092921, " computing", false], [54480, 0.077247, " computational", false], [7988, 0.025779, " powerful", false], [2355, 0.017244, " power", false], [4963, 0.011984, " resources", false], [12564, 0.009854, " compute", false], [374, 0.006309, " is", false], [6366, 0.005893, " computer", false], [82599, 0.005062, " computations", false]]]}, "raw_delta": 0.058805217345555626, "tuned_delta": 0.06737700937613388}, {"byte_start": 640, "byte_end": 651, "display": {"text": " inevitably", "kind": "normal"}, "is_word": true, "word_id": 107, "word_key": " inevitably", "bytes_hex": "20 69 6e 65 76 69 74 61 62 6c 79", "compression": {"rwkv": "19.78% 19.78% 19.78% 19.78% 19.78% 19.78% 19.78% 19.78% 19.78% 19.78% 19.78%", "qwen": "18.37% 18.37% 18.37% 18.37% 18.37% 18.37% 18.37% 18.37% 18.37% 18.37% 18.37%"}, "model_tokens": {"rwkv": [[62110, " inevitably", "normal", 5.769015842815861e-06]], "qwen": [[39505, " inevitably", "normal", 1.3586168279289268e-05]]}, "loss": {"rwkv": 19.775578330367185, "qwen": 18.37216081236056}, "topk": {"rwkv": [62110, 463, 5.769015842815861e-06, [[21800, 0.462911, " has", false], [4600, 0.279003, " is", false], [45283, 0.052535, " became", false], [22748, 0.036816, " was", false], [51019, 0.033473, " becomes", false], [21265, 0.022726, " and", false], [32475, 0.015381, " will", false], [275, 0.012254, " (", false], [22278, 0.011554, " per", false], [45, 0.007277, ",", false]]], "qwen": [39505, 250, 1.3586168279289268e-05, [[374, 0.368706, " is", false], [9044, 0.210179, " becomes", false], [702, 0.163419, " has", false], [686, 0.063317, " will", false], [6116, 0.05747, " became", false], [646, 0.030104, " can", false], [572, 0.019347, " was", false], [1091, 0.017925, " than", false], [1035, 0.013141, " would", false], [320, 0.007676, " (", false]]]}, "raw_delta": 0.07782199166037818, "tuned_delta": 0.08639378369095642}, {"byte_start": 651, "byte_end": 659, "display": {"text": " becomes", "kind": "normal"}, "is_word": true, "word_id": 108, "word_key": " becomes", "bytes_hex": "20 62 65 63 6f 6d 65 73", "compression": {"rwkv": "0.74% 0.74% 0.74% 0.74% 0.74% 0.74% 0.74% 0.74%", "qwen": "0.36% 0.36% 0.36% 0.36% 0.36% 0.36% 0.36% 0.36%"}, "model_tokens": {"rwkv": [[51019, " becomes", "normal", 0.7213101983070374]], "qwen": [[9044, " becomes", "normal", 0.8512977361679077]]}, "loss": {"rwkv": 0.7440657406928552, "qwen": 0.3629129528386432}, "topk": {"rwkv": [51019, 1, 0.7213101983070374, [[51019, 0.72131, " becomes", false], [45283, 0.117142, " became", false], [38087, 0.01949, " comes", false], [50956, 0.017396, " arrives", false], [21800, 0.016516, " has", false], [4600, 0.008403, " is", false], [30965, 0.007021, " gets", false], [45199, 0.006348, " arises", false], [50935, 0.004519, " appears", false], [32475, 0.004497, " will", false]]], "qwen": [9044, 1, 0.8512977361679077, [[9044, 0.851298, " becomes", false], [6116, 0.030535, " became", false], [29682, 0.015827, " arrives", false], [4041, 0.014727, " comes", false], [374, 0.00821, " is", false], [5221, 0.007622, " gets", false], [686, 0.007398, " will", false], [17066, 0.007118, " falls", false], [3635, 0.005005, " become", false], [3643, 0.00425, " makes", false]]]}, "raw_delta": 0.021135598421096802, "tuned_delta": 0.02970739045167505}, {"byte_start": 659, "byte_end": 669, "display": {"text": " available", "kind": "normal"}, "is_word": true, "word_id": 109, "word_key": " available", "bytes_hex": "20 61 76 61 69 6c 61 62 6c 65", "compression": {"rwkv": "0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10%", "qwen": "0.05% 0.05% 0.05% 0.05% 0.05% 0.05% 0.05% 0.05% 0.05% 0.05%"}, "model_tokens": {"rwkv": [[59206, " available", "normal", 0.9487120509147644]], "qwen": [[2500, " available", "normal", 0.9704382419586182]]}, "loss": {"rwkv": 0.09553980220730743, "qwen": 0.054114593021693955}, "topk": {"rwkv": [59206, 1, 0.9487120509147644, [[59206, 0.948712, " available", false], [56895, 0.006483, " possible", false], [61551, 0.005481, " affordable", false], [51178, 0.004853, " cheaper", false], [38006, 0.004825, " cheap", false], [61519, 0.004383, " accessible", false], [56212, 0.00248, " feasible", false], [31458, 0.002234, " more", false], [30911, 0.001406, " free", false], [46042, 0.001353, " freely", false]]], "qwen": [2500, 1, 0.9704382419586182, [[2500, 0.970438, " available", false], [15614, 0.012816, " accessible", false], [3204, 0.003238, " possible", false], [42203, 0.000999, " feasible", false], [30268, 0.000741, " readily", false], [16637, 0.000601, " affordable", false], [264, 0.000533, " a", false], [13570, 0.000506, " widely", false], [25580, 0.000454, " freely", false], [518, 0.000437, " at", false]]]}, "raw_delta": 0.0022971013560891154, "tuned_delta": 0.010868893386667364}, {"byte_start": 669, "byte_end": 670, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "9.51%", "qwen": "17.36%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.592117428779602]], "qwen": [[13, ".", "normal", 0.3819284737110138]]}, "loss": {"rwkv": 9.509952662109866, "qwen": 17.357820915727263}, "topk": {"rwkv": [47, 1, 0.592117428779602, [[47, 0.592117, ".", false], [45, 0.158111, ",", false], [4811, 0.064404, " to", false], [21265, 0.028117, " and", false], [275, 0.02226, " (", false], [4423, 0.016115, " as", false], [4424, 0.011413, " at", false], [21700, 0.01025, " for", false], [32226, 0.007665, " than", false], [4596, 0.006672, " in", false]]], "qwen": [13, 1, 0.3819284737110138, [[13, 0.381928, ".", false], [11, 0.185065, ",", false], [624, 0.141005, ".\n", false], [311, 0.064201, " to", false], [323, 0.06305, " and", false], [320, 0.031207, " (", false], [1091, 0.014719, " than", false], [369, 0.012568, " for", false], [518, 0.010692, " at", false], [1526, 0.007702, " through", false]]]}, "raw_delta": -0.4351782202720642, "tuned_delta": -0.426606428241486}, {"byte_start": 670, "byte_end": 678, "display": {"text": " Seeking", "kind": "normal"}, "is_word": true, "word_id": 110, "word_key": " seeking", "bytes_hex": "20 53 65 65 6b 69 6e 67", "compression": {"rwkv": "39.45% 39.45% 39.45% 39.45% 39.45% 0.28% 0.28% 0.28%", "qwen": "25.58% 25.58% 25.58% 25.58% 25.58% 25.58% 25.58% 25.58%"}, "model_tokens": {"rwkv": [[29753, " Seek", "normal", 1.7948577806237154e-05], [7856, "ing", "normal", 0.9542503952980042]], "qwen": [[58705, " Seeking", "normal", 1.1795600585173815e-05]]}, "loss": {"rwkv": 24.761098968382353, "qwen": 25.580299629670897}, "topk": {"rwkv": [29753, 976, 1.7948577806237154e-05, [[11, 0.250401, "\n", false], [29894, 0.107308, " This", false], [20996, 0.08133, " The", false], [261, 0.076909, "\n\n", false], [3913, 0.032213, " In", false], [3918, 0.022645, " It", false], [3641, 0.021672, " As", false], [19417, 0.018662, " And", false], [19907, 0.017877, " For", false], [4217, 0.015427, " So", false]]], "qwen": [58705, 1520, 1.1795600585173815e-05, [[1096, 0.168432, " This", false], [576, 0.107964, " The", false], [1634, 0.050958, " As", false], [758, 0.048782, " In", false], [1084, 0.034836, " It", false], [1597, 0.029178, " And", false], [1752, 0.019607, " For", false], [14301, 0.016932, " Thus", false], [1416, 0.015635, " If", false], [1205, 0.013743, " We", false]]]}, "raw_delta": -0.045426130294799805, "tuned_delta": -0.036854338264221555}, {"byte_start": 678, "byte_end": 681, "display": {"text": " an", "kind": "normal"}, "is_word": true, "word_id": 111, "word_key": " an", "bytes_hex": "20 61 6e", "compression": {"rwkv": "26.30% 26.30% 26.30%", "qwen": "26.75% 26.75% 26.75%"}, "model_tokens": {"rwkv": [[4419, " an", "normal", 0.01238006167113781]], "qwen": [[458, " an", "normal", 0.011676748283207417]]}, "loss": {"rwkv": 26.299128349538393, "qwen": 26.750906708712392}, "topk": {"rwkv": [4419, 11, 0.01238006167113781, [[4811, 0.391225, " to", false], [22249, 0.066677, " out", false], [332, 0.05737, " a", false], [52224, 0.042022, " methods", false], [51832, 0.038991, " general", false], [22590, 0.038221, " the", false], [32448, 0.037766, " ways", false], [30789, 0.015751, " ever", false], [59943, 0.014556, " knowledge", false], [31458, 0.013507, " more", false]]], "qwen": [458, 12, 0.011676748283207417, [[311, 0.346544, " to", false], [4586, 0.095296, " general", false], [264, 0.068085, " a", false], [279, 0.039555, " the", false], [5413, 0.029232, " methods", false], [501, 0.022304, " new", false], [5510, 0.022205, " ways", false], [2664, 0.02123, " better", false], [803, 0.018443, " more", false], [700, 0.015659, " out", false]]]}, "raw_delta": -0.025051911671956528, "tuned_delta": -0.01648011964137828}, {"byte_start": 681, "byte_end": 693, "display": {"text": " improvement", "kind": "normal"}, "is_word": true, "word_id": 112, "word_key": " improvement", "bytes_hex": "20 69 6d 70 72 6f 76 65 6d 65 6e 74", "compression": {"rwkv": "4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88%", "qwen": "5.62% 5.62% 5.62% 5.62% 5.62% 5.62% 5.62% 5.62% 5.62% 5.62% 5.62% 5.62%"}, "model_tokens": {"rwkv": [[63621, " improvement", "normal", 0.038731444627046585]], "qwen": [[15673, " improvement", "normal", 0.023840148001909256]]}, "loss": {"rwkv": 4.884123836342845, "qwen": 5.61506586758611}, "topk": {"rwkv": [63621, 6, 0.038731444627046585, [[59093, 0.06188, " advantage", false], [3609, 0.052639, " AI", false], [63277, 0.046593, " alternative", false], [37636, 0.041842, " agent", false], [30729, 0.040861, " edge", false], [63621, 0.038731, " improvement", false], [55532, 0.033366, " approach", false], [30789, 0.033068, " ever", false], [52371, 0.029619, " optimal", false], [63560, 0.027929, " explanation", false]]], "qwen": [15673, 10, 0.023840148001909256, [[22823, 0.143534, " optimal", false], [10555, 0.058327, " alternative", false], [16148, 0.05473, " explanation", false], [7373, 0.047727, " effective", false], [8315, 0.041014, " agent", false], [12111, 0.034582, " algorithm", false], [4226, 0.030941, " answer", false], [5486, 0.029412, " approach", false], [11050, 0.024839, " efficient", false], [15673, 0.02384, " improvement", false]]]}, "raw_delta": -0.04053203264872235, "tuned_delta": -0.0319602406181441}, {"byte_start": 693, "byte_end": 698, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 113, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "12.79% 12.79% 12.79% 12.79% 12.79%", "qwen": "10.43% 10.43% 10.43% 10.43% 10.43%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.02857709303498268]], "qwen": [[429, " that", "normal", 0.05540107935667038]]}, "loss": {"rwkv": 12.792647432882603, "qwen": 10.4348555804452}, "topk": {"rwkv": [32227, 4, 0.02857709303498268, [[4596, 0.465974, " in", false], [4706, 0.139946, " of", false], [4450, 0.128926, " by", false], [32227, 0.028577, " that", false], [31601, 0.024199, " over", false], [4811, 0.022141, " to", false], [4712, 0.021024, " on", false], [30917, 0.01734, " from", false], [32487, 0.014041, " with", false], [53140, 0.009575, " through", false]]], "qwen": [429, 4, 0.05540107935667038, [[304, 0.462232, " in", false], [916, 0.084486, " over", false], [389, 0.059968, " on", false], [429, 0.055401, " that", false], [311, 0.045035, " to", false], [315, 0.032579, " of", false], [553, 0.02508, " by", false], [374, 0.018459, " is", false], [7797, 0.0181, " beyond", false], [504, 0.015775, " from", false]]]}, "raw_delta": 0.13074374198913574, "tuned_delta": 0.139315534019714}, {"byte_start": 698, "byte_end": 704, "display": {"text": " makes", "kind": "normal"}, "is_word": true, "word_id": 114, "word_key": " makes", "bytes_hex": "20 6d 61 6b 65 73", "compression": {"rwkv": "15.03% 15.03% 15.03% 15.03% 15.03% 15.03%", "qwen": "16.07% 16.07% 16.07% 16.07% 16.07% 16.07%"}, "model_tokens": {"rwkv": [[38964, " makes", "normal", 0.006612562574446201]], "qwen": [[3643, " makes", "normal", 0.004769652150571346]]}, "loss": {"rwkv": 15.028073342593368, "qwen": 16.066458726462773}, "topk": {"rwkv": [38964, 22, 0.006612562574446201, [[4600, 0.234174, " is", false], [56540, 0.084545, " leverage", false], [57102, 0.057831, " requires", false], [21413, 0.043576, " can", false], [40219, 0.03494, " would", false], [38278, 0.028772, " doesn", false], [30659, 0.026621, " does", false], [47181, 0.026218, " scales", false], [31581, 0.025952, " only", false], [38087, 0.023144, " comes", false]]], "qwen": [3643, 24, 0.004769652150571346, [[374, 0.189496, " is", false], [7460, 0.158147, " requires", false], [1558, 0.100576, " does", false], [646, 0.047346, " can", false], [3171, 0.046745, " doesn", false], [27505, 0.046031, " lever", false], [1035, 0.036799, " would", false], [33644, 0.034925, " relies", false], [4157, 0.025388, " cannot", false], [28405, 0.019711, " scales", false]]]}, "raw_delta": -0.057580312093098884, "tuned_delta": -0.049008520062520634}, {"byte_start": 704, "byte_end": 706, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 115, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "27.33% 27.33%", "qwen": "28.80% 28.80%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.04826342687010765]], "qwen": [[264, " a", "normal", 0.041008658707141876]]}, "loss": {"rwkv": 27.332308391841686, "qwen": 28.799548280713836}, "topk": {"rwkv": [332, 4, 0.04826342687010765, [[22681, 0.277007, " use", false], [22590, 0.117123, " the", false], [4692, 0.051472, " no", false], [332, 0.048263, " a", false], [45301, 0.028659, " better", false], [30992, 0.026593, " good", false], [4601, 0.02471, " it", false], [22799, 0.019972, " you", false], [30923, 0.014912, " full", false], [39631, 0.014822, " sense", false]]], "qwen": [264, 4, 0.041008658707141876, [[990, 0.383282, " use", false], [902, 0.161169, " no", false], [279, 0.054144, " the", false], [264, 0.041009, " a", false], [2632, 0.038358, " little", false], [5530, 0.03482, " sense", false], [2664, 0.028742, " better", false], [1661, 0.016088, " good", false], [803, 0.015047, " more", false], [8811, 0.012346, " heavy", false]]]}, "raw_delta": -0.08136105537414551, "tuned_delta": -0.07278926334356726}, {"byte_start": 706, "byte_end": 717, "display": {"text": " difference", "kind": "normal"}, "is_word": true, "word_id": 116, "word_key": " difference", "bytes_hex": "20 64 69 66 66 65 72 65 6e 63 65", "compression": {"rwkv": "4.76% 4.76% 4.76% 4.76% 4.76% 4.76% 4.76% 4.76% 4.76% 4.76% 4.76%", "qwen": "4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66%"}, "model_tokens": {"rwkv": [[61863, " difference", "normal", 0.0547851137816906]], "qwen": [[6672, " difference", "normal", 0.05831332132220268]]}, "loss": {"rwkv": 4.764582343844943, "qwen": 4.659125709293158}, "topk": {"rwkv": [61863, 1, 0.0547851137816906, [[61863, 0.054785, " difference", false], [38594, 0.053527, " given", false], [52232, 0.042096, " million", false], [3483, 0.037914, " 10", false], [39720, 0.035245, " small", false], [38864, 0.023804, " large", false], [21357, 0.023661, " big", false], [63870, 0.020131, " significant", false], [56587, 0.018945, " marginal", false], [47487, 0.014988, " system", false]]], "qwen": [6672, 4, 0.05831332132220268, [[2613, 0.104232, " small", false], [3460, 0.064247, " large", false], [5089, 0.060479, " significant", false], [6672, 0.058313, " difference", false], [8131, 0.038904, " larger", false], [9155, 0.029102, " smaller", false], [3175, 0.028157, " single", false], [2409, 0.02704, " big", false], [11924, 0.025355, " substantial", false], [6765, 0.014296, " huge", false]]]}, "raw_delta": 0.005847757512872864, "tuned_delta": 0.014419549543451112}, {"byte_start": 717, "byte_end": 720, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 117, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "10.24% 10.24% 10.24%", "qwen": "9.94% 9.94% 9.94%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.17996846139431]], "qwen": [[304, " in", "normal", 0.1915179193019867]]}, "loss": {"rwkv": 10.237874964641732, "qwen": 9.935203413982654}, "topk": {"rwkv": [4596, 1, 0.17996846139431, [[4596, 0.179968, " in", false], [4811, 0.127566, " to", false], [4600, 0.08251, " is", false], [45, 0.061347, ",", false], [57102, 0.047158, " requires", false], [39971, 0.0367, " today", false], [4450, 0.029391, " by", false], [4712, 0.026849, " on", false], [32475, 0.02497, " will", false], [31601, 0.023289, " over", false]]], "qwen": [304, 1, 0.1915179193019867, [[304, 0.191518, " in", false], [374, 0.095014, " is", false], [311, 0.071833, " to", false], [916, 0.063177, " over", false], [389, 0.062715, " on", false], [7460, 0.046699, " requires", false], [979, 0.029425, " when", false], [11, 0.02619, ",", false], [518, 0.025189, " at", false], [369, 0.024353, " for", false]]]}, "raw_delta": 0.01678367455800378, "tuned_delta": 0.02535546658858203}, {"byte_start": 720, "byte_end": 724, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 118, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "4.86% 4.86% 4.86% 4.86%", "qwen": "6.17% 6.17% 6.17% 6.17%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.3386668860912323]], "qwen": [[279, " the", "normal", 0.2544078826904297]]}, "loss": {"rwkv": 4.8606424717450425, "qwen": 6.171202403560686}, "topk": {"rwkv": [22590, 1, 0.3386668860912323, [[22590, 0.338667, " the", false], [332, 0.136816, " a", false], [39920, 0.057402, " terms", false], [32234, 0.052054, " this", false], [31835, 0.032513, " real", false], [56901, 0.025827, " practice", false], [4419, 0.019037, " an", false], [63750, 0.017274, " performance", false], [38720, 0.014218, " human", false], [3483, 0.011752, " 10", false]]], "qwen": [279, 1, 0.2544078826904297, [[279, 0.254408, " the", false], [264, 0.166713, " a", false], [5068, 0.083839, " performance", false], [419, 0.063061, " this", false], [6588, 0.04657, " practice", false], [3793, 0.026816, " terms", false], [458, 0.026541, " an", false], [1741, 0.026428, " such", false], [429, 0.022521, " that", false], [220, 0.018603, " ", false]]]}, "raw_delta": -0.07267287373542786, "tuned_delta": -0.06410108170484961}, {"byte_start": 724, "byte_end": 732, "display": {"text": " shorter", "kind": "normal"}, "is_word": true, "word_id": 119, "word_key": " shorter", "bytes_hex": "20 73 68 6f 72 74 65 72", "compression": {"rwkv": "16.84% 16.84% 16.84% 16.84% 16.84% 16.84% 16.84% 16.84%", "qwen": "12.48% 12.48% 12.48% 12.48% 12.48% 12.48% 12.48% 12.48%"}, "model_tokens": {"rwkv": [[52888, " shorter", "normal", 0.0005724717047996819]], "qwen": [[23327, " shorter", "normal", 0.003942768555134535]]}, "loss": {"rwkv": 16.83613841662413, "qwen": 12.479024600292085}, "topk": {"rwkv": [52888, 159, 0.0005724717047996819, [[31835, 0.144439, " real", false], [31323, 0.082976, " long", false], [40213, 0.079928, " world", false], [30807, 0.059039, " face", false], [39675, 0.048322, " short", false], [32251, 0.029652, " time", false], [31515, 0.029592, " next", false], [31503, 0.026197, " near", false], [46064, 0.01899, " future", false], [38621, 0.017262, " grand", false]]], "qwen": [23327, 38, 0.003942768555134535, [[2805, 0.128871, " short", false], [3143, 0.081736, " near", false], [882, 0.065915, " time", false], [1293, 0.049215, " long", false], [1790, 0.041966, " next", false], [1931, 0.032048, " real", false], [5068, 0.026856, " performance", false], [1879, 0.024192, " world", false], [3853, 0.015901, " future", false], [1482, 0.015439, " current", false]]]}, "raw_delta": 0.24160969257354736, "tuned_delta": 0.2501814846041256}, {"byte_start": 732, "byte_end": 737, "display": {"text": " term", "kind": "normal"}, "is_word": true, "word_id": 120, "word_key": " term", "bytes_hex": "20 74 65 72 6d", "compression": {"rwkv": "1.29% 1.29% 1.29% 1.29% 1.29%", "qwen": "2.21% 2.21% 2.21% 2.21% 2.21%"}, "model_tokens": {"rwkv": [[32219, " term", "normal", 0.700069785118103]], "qwen": [[4647, " term", "normal", 0.5424668192863464]]}, "loss": {"rwkv": 1.2891269164193373, "qwen": 2.205982766520802}, "topk": {"rwkv": [32219, 1, 0.700069785118103, [[32219, 0.70007, " term", false], [22418, 0.13028, " run", false], [32251, 0.061417, " time", false], [46, 0.051884, "-", false], [4715, 0.006238, " or", false], [51940, 0.006192, " horizon", false], [21265, 0.004017, " and", false], [39962, 0.003759, " times", false], [39920, 0.003246, " terms", false], [45, 0.002884, ",", false]]], "qwen": [4647, 1, 0.5424668192863464, [[4647, 0.542467, " term", false], [882, 0.221836, " time", false], [1598, 0.063362, " run", false], [9663, 0.045174, "-term", false], [3039, 0.035426, " times", false], [69953, 0.024584, " timeframe", false], [4168, 0.010569, " period", false], [11, 0.008014, ",", false], [3793, 0.003769, " terms", false], [34074, 0.003366, " horizon", false]]]}, "raw_delta": -0.05084128379821777, "tuned_delta": -0.04226949176763952}, {"byte_start": 737, "byte_end": 738, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "40.58%", "qwen": "43.78%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.10559233278036118]], "qwen": [[11, ",", "normal", 0.08825676888227463]]}, "loss": {"rwkv": 40.57579802500209, "qwen": 43.776868109848834}, "topk": {"rwkv": [45, 2, 0.10559233278036118, [[4600, 0.294404, " is", false], [45, 0.105592, ",", false], [275, 0.043816, " (", false], [32475, 0.042771, " will", false], [22074, 0.037044, " may", false], [21413, 0.035054, " can", false], [4450, 0.031371, " by", false], [57102, 0.028618, " requires", false], [40187, 0.020229, " while", false], [53356, 0.018118, " without", false]]], "qwen": [11, 2, 0.08825676888227463, [[374, 0.300275, " is", false], [11, 0.088257, ",", false], [320, 0.058578, " (", false], [646, 0.038089, " can", false], [7460, 0.036124, " requires", false], [686, 0.034283, " will", false], [702, 0.026786, " has", false], [9044, 0.025306, " becomes", false], [1231, 0.024479, " may", false], [3363, 0.018381, " means", false]]]}, "raw_delta": -0.1775050163269043, "tuned_delta": -0.16893322429632604}, {"byte_start": 738, "byte_end": 750, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 121, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"rwkv": "5.21% 5.21% 5.21% 5.21% 5.21% 5.21% 5.21% 5.21% 5.21% 5.21% 5.21% 5.21%", "qwen": "6.27% 6.27% 6.27% 6.27% 6.27% 6.27% 6.27% 6.27% 6.27% 6.27% 6.27% 6.27%"}, "model_tokens": {"rwkv": [[63843, " researchers", "normal", 0.03088589571416378]], "qwen": [[11811, " researchers", "normal", 0.015444123186171055]]}, "loss": {"rwkv": 5.212862940712074, "qwen": 6.267497818710502}, "topk": {"rwkv": [63843, 8, 0.03088589571416378, [[22590, 0.053903, " the", false], [40187, 0.053659, " while", false], [4858, 0.048107, " we", false], [21265, 0.048091, " and", false], [21400, 0.042607, " but", false], [4601, 0.033219, " it", false], [22226, 0.032401, " one", false], [63843, 0.030886, " researchers", false], [53356, 0.027334, " without", false], [32230, 0.025364, " then", false]]], "qwen": [11811, 19, 0.015444123186171055, [[323, 0.06536, " and", false], [476, 0.056072, " or", false], [1741, 0.053032, " such", false], [4764, 0.039624, " however", false], [279, 0.035106, " the", false], [304, 0.032476, " in", false], [438, 0.029488, " as", false], [1393, 0.027959, " while", false], [1221, 0.025311, " then", false], [714, 0.025235, " but", false]]]}, "raw_delta": -0.0584813753763835, "tuned_delta": -0.04990958334580525}, {"byte_start": 750, "byte_end": 755, "display": {"text": " seek", "kind": "normal"}, "is_word": true, "word_id": 122, "word_key": " seek", "bytes_hex": "20 73 65 65 6b", "compression": {"rwkv": "22.32% 22.32% 22.32% 22.32% 22.32%", "qwen": "20.72% 20.72% 20.72% 20.72% 20.72%"}, "model_tokens": {"rwkv": [[31966, " seek", "normal", 0.0020592890214174986]], "qwen": [[5931, " seek", "normal", 0.003198388498276472]]}, "loss": {"rwkv": 22.31668891375115, "qwen": 20.72109751262683}, "topk": {"rwkv": [31966, 47, 0.0020592890214174986, [[31059, 0.204132, " have", false], [39171, 0.084378, " often", false], [32475, 0.064248, " will", false], [21286, 0.055041, " are", false], [32216, 0.046471, " tend", false], [21413, 0.03194, " can", false], [47266, 0.030567, " should", false], [22074, 0.023417, " may", false], [60687, 0.02341, " typically", false], [4596, 0.015502, " in", false]]], "qwen": [5931, 37, 0.003198388498276472, [[614, 0.303681, " have", false], [525, 0.074676, " are", false], [8376, 0.058613, " tend", false], [686, 0.058181, " will", false], [3545, 0.05436, " often", false], [646, 0.025166, " can", false], [1969, 0.024153, " must", false], [11136, 0.020928, " typically", false], [1265, 0.02013, " should", false], [1231, 0.017721, " may", false]]]}, "raw_delta": 0.08847837448120122, "tuned_delta": 0.09705016651177946}, {"byte_start": 755, "byte_end": 758, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 123, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "6.86% 6.86% 6.86%", "qwen": "7.10% 7.10% 7.10%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.3204927444458008]], "qwen": [[311, " to", "normal", 0.30715322494506836]]}, "loss": {"rwkv": 6.856558462558223, "qwen": 7.095706787932366}, "topk": {"rwkv": [4811, 1, 0.3204927444458008, [[4811, 0.320493, " to", false], [332, 0.108657, " a", false], [52224, 0.06442, " methods", false], [22249, 0.05465, " out", false], [32448, 0.036887, " ways", false], [4419, 0.035138, " an", false], [22590, 0.033257, " the", false], [64423, 0.021824, " improvements", false], [22168, 0.013475, " new", false], [31458, 0.010424, " more", false]]], "qwen": [311, 1, 0.30715322494506836, [[311, 0.307153, " to", false], [264, 0.063881, " a", false], [5510, 0.056106, " ways", false], [5413, 0.046561, " methods", false], [18142, 0.034417, " improvements", false], [700, 0.029936, " out", false], [279, 0.022782, " the", false], [54920, 0.019494, " shortcuts", false], [9904, 0.01759, " solutions", false], [458, 0.01636, " an", false]]]}, "raw_delta": -0.013261198997497559, "tuned_delta": -0.00468940696691931}, {"byte_start": 758, "byte_end": 767, "display": {"text": " leverage", "kind": "normal"}, "is_word": true, "word_id": 124, "word_key": " leverage", "bytes_hex": "20 6c 65 76 65 72 61 67 65", "compression": {"rwkv": "4.48% 4.48% 4.48% 4.48% 4.48% 4.48% 4.48% 4.48% 4.48%", "qwen": "3.38% 3.38% 3.38% 3.38% 3.38% 3.38% 3.38% 3.38% 3.38%"}, "model_tokens": {"rwkv": [[56540, " leverage", "normal", 0.10792125761508942]], "qwen": [[32064, " leverage", "normal", 0.1850433498620987]]}, "loss": {"rwkv": 4.4771135166476075, "qwen": 3.3806455308803502}, "topk": {"rwkv": [56540, 2, 0.10792125761508942, [[51982, 0.134886, " improve", false], [56540, 0.107921, " leverage", false], [51690, 0.049896, " exploit", false], [30858, 0.043265, " find", false], [31358, 0.036314, " make", false], [22681, 0.032648, " use", false], [37730, 0.025428, " apply", false], [4491, 0.019004, " do", false], [56433, 0.018679, " increase", false], [37923, 0.016749, " build", false]]], "qwen": [32064, 1, 0.1850433498620987, [[32064, 0.185043, " leverage", false], [7269, 0.073056, " improve", false], [1477, 0.054696, " find", false], [32194, 0.050307, " exploit", false], [1936, 0.034749, " build", false], [1281, 0.033653, " make", false], [990, 0.031825, " use", false], [2225, 0.027895, " develop", false], [3796, 0.022643, " apply", false], [653, 0.016222, " do", false]]]}, "raw_delta": 0.06080109543270535, "tuned_delta": 0.0693728874632836}, {"byte_start": 767, "byte_end": 773, "display": {"text": " their", "kind": "normal"}, "is_word": true, "word_id": 125, "word_key": " their", "bytes_hex": "20 74 68 65 69 72", "compression": {"rwkv": "10.00% 10.00% 10.00% 10.00% 10.00% 10.00%", "qwen": "12.25% 12.25% 12.25% 12.25% 12.25% 12.25%"}, "model_tokens": {"rwkv": [[39931, " their", "normal", 0.03585086762905121]], "qwen": [[862, " their", "normal", 0.016973810270428658]]}, "loss": {"rwkv": 10.00306131866371, "qwen": 12.251136838983184}, "topk": {"rwkv": [39931, 5, 0.03585086762905121, [[22590, 0.205718, " the", false], [38720, 0.135048, " human", false], [32234, 0.09498, " this", false], [32227, 0.064918, " that", false], [39931, 0.035851, " their", false], [32464, 0.034969, " what", false], [56173, 0.032333, " existing", false], [63370, 0.023644, " computation", false], [57564, 0.021696, " whatever", false], [31458, 0.019699, " more", false]]], "qwen": [862, 9, 0.016973810270428658, [[419, 0.2792, " this", false], [279, 0.185648, " the", false], [429, 0.078367, " that", false], [432, 0.056268, " it", false], [3738, 0.041902, " human", false], [34447, 0.036121, " computation", false], [6350, 0.028696, " existing", false], [1493, 0.018124, " these", false], [862, 0.016974, " their", false], [6540, 0.015419, " knowledge", false]]]}, "raw_delta": -0.12465977668762207, "tuned_delta": -0.11608798465704383}, {"byte_start": 773, "byte_end": 779, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 126, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "8.74% 8.74% 8.74% 8.74% 8.74% 8.74%", "qwen": "11.94% 11.94% 11.94% 11.94% 11.94% 11.94%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.05500245839357376]], "qwen": [[3738, " human", "normal", 0.01883947290480137]]}, "loss": {"rwkv": 8.735067630382394, "qwen": 11.937703473946366}, "topk": {"rwkv": [38720, 6, 0.05500245839357376, [[52140, 0.143004, " limited", false], [56173, 0.094856, " existing", false], [59943, 0.086163, " knowledge", false], [51372, 0.080133, " current", false], [22251, 0.061264, " own", false], [38720, 0.055002, " human", false], [59206, 0.024007, " available", false], [39720, 0.016505, " small", false], [65034, 0.015487, " understanding", false], [50888, 0.011818, " already", false]]], "qwen": [3738, 9, 0.01883947290480137, [[6540, 0.180166, " knowledge", false], [6350, 0.092155, " existing", false], [1482, 0.06157, " current", false], [1828, 0.058436, " own", false], [501, 0.031776, " new", false], [7199, 0.030736, " limited", false], [54480, 0.02952, " computational", false], [2500, 0.021754, " available", false], [3738, 0.018839, " human", false], [8660, 0.018359, " understanding", false]]]}, "raw_delta": -0.17759184042612708, "tuned_delta": -0.16902004839554882}, {"byte_start": 779, "byte_end": 789, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 127, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45%", "qwen": "1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12%"}, "model_tokens": {"rwkv": [[59943, " knowledge", "normal", 0.77864009141922]], "qwen": [[6540, " knowledge", "normal", 0.5378748774528503]]}, "loss": {"rwkv": 0.450842200277801, "qwen": 1.1183219167583118}, "topk": {"rwkv": [59943, 1, 0.77864009141922, [[59943, 0.77864, " knowledge", false], [64452, 0.026841, " intelligence", false], [46, 0.021343, "-", false], [59683, 0.02036, " expertise", false], [59917, 0.01509, " intuition", false], [65034, 0.013241, " understanding", false], [59305, 0.006079, " cognitive", false], [45346, 0.005684, " brains", false], [39356, 0.003994, " prior", false], [21265, 0.00361, " and", false]]], "qwen": [6540, 1, 0.5378748774528503, [[6540, 0.537875, " knowledge", false], [18726, 0.053629, " expertise", false], [56251, 0.046322, " intuition", false], [11229, 0.029525, " intelligence", false], [8660, 0.015324, " understanding", false], [6749, 0.015121, " ing", false], [4963, 0.01493, " resources", false], [7361, 0.013789, " skills", false], [24675, 0.009583, " cognitive", false], [20017, 0.008713, " insight", false]]]}, "raw_delta": -0.03701293468475342, "tuned_delta": -0.028441142654175168}, {"byte_start": 789, "byte_end": 792, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 128, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "20.38% 20.38% 20.38%", "qwen": "21.13% 21.13% 21.13%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.0335969440639019]], "qwen": [[315, " of", "normal", 0.029736023396253586]]}, "loss": {"rwkv": 20.38182447089225, "qwen": 21.13185227681502}, "topk": {"rwkv": [4706, 7, 0.0335969440639019, [[45, 0.190964, ",", false], [47, 0.143869, ".", false], [4811, 0.140904, " to", false], [21265, 0.096775, " and", false], [4596, 0.074511, " in", false], [275, 0.034033, " (", false], [4706, 0.033597, " of", false], [4423, 0.027631, " as", false], [4450, 0.027111, " by", false], [60, 0.021583, ";", false]]], "qwen": [315, 8, 0.029736023396253586, [[11, 0.156832, ",", false], [323, 0.11761, " and", false], [304, 0.102445, " in", false], [311, 0.089361, " to", false], [13, 0.086746, ".", false], [553, 0.039992, " by", false], [320, 0.033706, " (", false], [315, 0.029736, " of", false], [803, 0.025906, " more", false], [438, 0.024378, " as", false]]]}, "raw_delta": -0.04159037272135424, "tuned_delta": -0.03301858069077599}, {"byte_start": 792, "byte_end": 796, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 129, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "2.57% 2.57% 2.57% 2.57%", "qwen": "2.29% 2.29% 2.29% 2.29%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.5697708129882812]], "qwen": [[279, " the", "normal", 0.6019660830497742]]}, "loss": {"rwkv": 2.571209423459334, "qwen": 2.2882684032718967}, "topk": {"rwkv": [22590, 1, 0.5697708129882812, [[22590, 0.569771, " the", false], [21835, 0.092198, " how", false], [32464, 0.048099, " what", false], [332, 0.047394, " a", false], [40186, 0.009853, " which", false], [3609, 0.008663, " AI", false], [39931, 0.007546, " their", false], [32074, 0.007401, " some", false], [4419, 0.006931, " an", false], [56939, 0.005957, " problems", false]]], "qwen": [279, 1, 0.6019660830497742, [[279, 0.601966, " the", false], [1246, 0.100687, " how", false], [1128, 0.06234, " what", false], [264, 0.047222, " a", false], [458, 0.008219, " an", false], [7947, 0.007775, " domain", false], [3491, 0.007697, " problem", false], [5322, 0.007279, " problems", false], [15235, 0.006428, " AI", false], [3151, 0.005127, " specific", false]]]}, "raw_delta": 0.015689581632614136, "tuned_delta": 0.024261373663192386}, {"byte_start": 796, "byte_end": 803, "display": {"text": " domain", "kind": "normal"}, "is_word": true, "word_id": 130, "word_key": " domain", "bytes_hex": "20 64 6f 6d 61 69 6e", "compression": {"rwkv": "5.15% 5.15% 5.15% 5.15% 5.15% 5.15% 5.15%", "qwen": "6.36% 6.36% 6.36% 6.36% 6.36% 6.36% 6.36%"}, "model_tokens": {"rwkv": [[45775, " domain", "normal", 0.1363827884197235]], "qwen": [[7947, " domain", "normal", 0.08477343618869781]]}, "loss": {"rwkv": 5.1524822888891535, "qwen": 6.357578236407423}, "topk": {"rwkv": [45775, 3, 0.1363827884197235, [[40213, 0.312212, " world", false], [52569, 0.229817, " problem", false], [45775, 0.136383, " domain", false], [32202, 0.071761, " task", false], [63536, 0.032826, " environment", false], [57074, 0.017141, " relevant", false], [60511, 0.012049, " situation", false], [47506, 0.010262, " target", false], [56939, 0.009762, " problems", false], [57271, 0.009494, " specific", false]]], "qwen": [7947, 5, 0.08477343618869781, [[3491, 0.312582, " problem", false], [1879, 0.210592, " world", false], [4573, 0.120185, " environment", false], [3383, 0.095531, " task", false], [7947, 0.084773, " domain", false], [3151, 0.011941, " specific", false], [1849, 0.011441, " system", false], [8315, 0.010717, " agent", false], [5322, 0.007905, " problems", false], [1931, 0.006768, " real", false]]]}, "raw_delta": -0.06682470866612028, "tuned_delta": -0.05825291663554203}, {"byte_start": 803, "byte_end": 804, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "27.61%", "qwen": "28.85%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.2151898294687271]], "qwen": [[11, ",", "normal", 0.20195549726486206]]}, "loss": {"rwkv": 27.614084767015314, "qwen": 28.848632129270083}, "topk": {"rwkv": [45, 1, 0.2151898294687271, [[45, 0.21519, ",", false], [47, 0.18634, ".", false], [4811, 0.090568, " to", false], [4596, 0.083972, " in", false], [21265, 0.076304, " and", false], [32232, 0.048032, " they", false], [4706, 0.042126, " of", false], [275, 0.032307, " (", false], [60, 0.020903, ";", false], [4424, 0.020117, " at", false]]], "qwen": [11, 1, 0.20195549726486206, [[11, 0.201955, ",", false], [311, 0.127244, " to", false], [13, 0.126718, ".", false], [304, 0.109078, " in", false], [323, 0.086082, " and", false], [320, 0.048249, " (", false], [553, 0.0362, " by", false], [624, 0.020436, ".\n", false], [438, 0.017697, " as", false], [26, 0.017592, ";", false]]]}, "raw_delta": -0.06845784187316895, "tuned_delta": -0.059886049842590695}, {"byte_start": 804, "byte_end": 808, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 131, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"rwkv": "6.20% 6.20% 6.20% 6.20%", "qwen": "6.62% 6.62% 6.62% 6.62%"}, "model_tokens": {"rwkv": [[21400, " but", "normal", 0.24974967539310455]], "qwen": [[714, " but", "normal", 0.23051802814006805]]}, "loss": {"rwkv": 6.199080253819764, "qwen": 6.615776481149479}, "topk": {"rwkv": [21400, 1, 0.24974967539310455, [[21400, 0.24975, " but", false], [21265, 0.137721, " and", false], [40186, 0.103089, " which", false], [40187, 0.046215, " while", false], [4715, 0.035718, " or", false], [47001, 0.020354, " rather", false], [22590, 0.018736, " the", false], [4811, 0.017924, " to", false], [4596, 0.015757, " in", false], [53339, 0.014284, " whereas", false]]], "qwen": [714, 1, 0.23051802814006805, [[714, 0.230518, " but", false], [323, 0.130085, " and", false], [892, 0.082421, " which", false], [1393, 0.053377, " while", false], [476, 0.041299, " or", false], [3545, 0.026077, " often", false], [19853, 0.024233, " whereas", false], [438, 0.01806, " as", false], [304, 0.015485, " in", false], [311, 0.014344, " to", false]]]}, "raw_delta": -0.023106545209884644, "tuned_delta": -0.014534753179306395}, {"byte_start": 808, "byte_end": 812, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 132, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "10.85% 10.85% 10.85% 10.85%", "qwen": "11.14% 11.14% 11.14% 11.14%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.09046445041894913]], "qwen": [[279, " the", "normal", 0.08452223241329193]]}, "loss": {"rwkv": 10.848390444184586, "qwen": 11.139142163950115}, "topk": {"rwkv": [22590, 3, 0.09046445041894913, [[32234, 0.127832, " this", false], [4596, 0.110596, " in", false], [22590, 0.090464, " the", false], [31601, 0.051364, " over", false], [32227, 0.050588, " that", false], [4423, 0.036298, " as", false], [4588, 0.026089, " if", false], [4601, 0.025836, " it", false], [32232, 0.023972, " they", false], [45, 0.018252, ",", false]]], "qwen": [279, 3, 0.08452223241329193, [[304, 0.141637, " in", false], [419, 0.093016, " this", false], [279, 0.084522, " the", false], [11, 0.068891, ",", false], [916, 0.061476, " over", false], [438, 0.060623, " as", false], [979, 0.027856, " when", false], [432, 0.024868, " it", false], [429, 0.024163, " that", false], [421, 0.023443, " if", false]]]}, "raw_delta": -0.01612269878387451, "tuned_delta": -0.0075509067532962635}, {"byte_start": 812, "byte_end": 817, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 133, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"rwkv": "12.51% 12.51% 12.51% 12.51% 12.51%", "qwen": "15.16% 15.16% 15.16% 15.16% 15.16%"}, "model_tokens": {"rwkv": [[31581, " only", "normal", 0.03128838539123535]], "qwen": [[1172, " only", "normal", 0.014963667839765549]]}, "loss": {"rwkv": 12.510871057708977, "qwen": 15.155981426244061}, "topk": {"rwkv": [31581, 4, 0.03128838539123535, [[46470, 0.078024, " longer", false], [31323, 0.068596, " long", false], [57481, 0.032231, " ultimate", false], [31581, 0.031288, " only", false], [31461, 0.029091, " most", false], [31835, 0.024336, " real", false], [30510, 0.019972, " cost", false], [31458, 0.019332, " more", false], [30273, 0.015125, " best", false], [30808, 0.013432, " fact", false]]], "qwen": [1172, 7, 0.014963667839765549, [[5021, 0.128067, " longer", false], [1293, 0.036176, " long", false], [803, 0.031229, " more", false], [16724, 0.0267, " ultimate", false], [2783, 0.025294, " cost", false], [3491, 0.017783, " problem", false], [1172, 0.014964, " only", false], [1429, 0.012337, " most", false], [882, 0.012052, " time", false], [8131, 0.011567, " larger", false]]]}, "raw_delta": -0.14667606353759766, "tuned_delta": -0.1381042715070194}, {"byte_start": 817, "byte_end": 823, "display": {"text": " thing", "kind": "normal"}, "is_word": true, "word_id": 134, "word_key": " thing", "bytes_hex": "20 74 68 69 6e 67", "compression": {"rwkv": "9.39% 9.39% 9.39% 9.39% 9.39% 9.39%", "qwen": "7.54% 7.54% 7.54% 7.54% 7.54% 7.54%"}, "model_tokens": {"rwkv": [[39941, " thing", "normal", 0.043682076036930084]], "qwen": [[3166, " thing", "normal", 0.08142250776290894]]}, "loss": {"rwkv": 9.392545839120855, "qwen": 7.538392281036371}, "topk": {"rwkv": [39941, 2, 0.043682076036930084, [[22752, 0.554354, " way", false], [39941, 0.043682, " thing", false], [47009, 0.025316, " reason", false], [31323, 0.020507, " long", false], [31835, 0.01794, " real", false], [59593, 0.013501, " effective", false], [51832, 0.010951, " general", false], [56540, 0.008277, " leverage", false], [57075, 0.00795, " reliable", false], [31104, 0.007377, " hope", false]]], "qwen": [3166, 2, 0.08142250776290894, [[1616, 0.515129, " way", false], [3166, 0.081423, " thing", false], [7373, 0.028958, " effective", false], [5510, 0.019747, " ways", false], [3900, 0.019326, " hope", false], [1931, 0.012952, " real", false], [15673, 0.011414, " improvement", false], [1714, 0.010554, " method", false], [5413, 0.007542, " methods", false], [1293, 0.00617, " long", false]]]}, "raw_delta": 0.10281610488891606, "tuned_delta": 0.1113878969194943}, {"byte_start": 823, "byte_end": 828, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 135, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "1.53% 1.53% 1.53% 1.53% 1.53%", "qwen": "1.79% 1.79% 1.79% 1.79% 1.79%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.652611255645752]], "qwen": [[429, " that", "normal", 0.6083807945251465]]}, "loss": {"rwkv": 1.528636835316919, "qwen": 1.7923837317548124}, "topk": {"rwkv": [32227, 1, 0.652611255645752, [[32227, 0.652611, " that", false], [32232, 0.093333, " they", false], [4858, 0.022613, " we", false], [32234, 0.01926, " this", false], [22799, 0.011452, " you", false], [52072, 0.010524, " keeping", false], [31458, 0.009231, " more", false], [4811, 0.009198, " to", false], [62364, 0.009072, " preventing", false], [59206, 0.008492, " available", false]]], "qwen": [429, 1, 0.6083807945251465, [[429, 0.608381, " that", false], [807, 0.079125, " they", false], [582, 0.034568, " we", false], [12677, 0.025728, " humans", false], [279, 0.016112, " the", false], [419, 0.013132, " this", false], [803, 0.011792, " more", false], [3738, 0.009933, " human", false], [311, 0.009811, " to", false], [264, 0.008783, " a", false]]]}, "raw_delta": -0.014625233411788938, "tuned_delta": -0.0060534413812106894}, {"byte_start": 828, "byte_end": 836, "display": {"text": " matters", "kind": "normal"}, "is_word": true, "word_id": 136, "word_key": " matters", "bytes_hex": "20 6d 61 74 74 65 72 73", "compression": {"rwkv": "4.05% 4.05% 4.05% 4.05% 4.05% 4.05% 4.05% 4.05%", "qwen": "6.37% 6.37% 6.37% 6.37% 6.37% 6.37% 6.37% 6.37%"}, "model_tokens": {"rwkv": [[52201, " matters", "normal", 0.16600041091442108]], "qwen": [[12850, " matters", "normal", 0.05914688482880592]]}, "loss": {"rwkv": 4.050535393120868, "qwen": 6.374303165313985}, "topk": {"rwkv": [52201, 1, 0.16600041091442108, [[52201, 0.166, " matters", false], [21413, 0.114239, " can", false], [4600, 0.06301, " is", false], [32475, 0.061078, " will", false], [38964, 0.050549, " makes", false], [47008, 0.036114, " really", false], [460, 0.033469, "'s", false], [56925, 0.021555, " prevents", false], [52701, 0.018729, " remains", false], [62047, 0.018302, " guarantees", false]]], "qwen": [12850, 4, 0.05914688482880592, [[646, 0.182452, " can", false], [686, 0.080467, " will", false], [374, 0.078371, " is", false], [12850, 0.059147, " matters", false], [3643, 0.056159, " makes", false], [2167, 0.040223, " really", false], [702, 0.032976, " has", false], [12677, 0.023099, " humans", false], [9428, 0.021145, " truly", false], [594, 0.017699, "'s", false]]]}, "raw_delta": -0.12885704636573792, "tuned_delta": -0.12028525433515967}, {"byte_start": 836, "byte_end": 839, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 137, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "2.78% 2.78% 2.78%", "qwen": "4.64% 4.64% 4.64%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.6330277919769287]], "qwen": [[304, " in", "normal", 0.46231386065483093]]}, "loss": {"rwkv": 2.782541704839553, "qwen": 4.637731458395485}, "topk": {"rwkv": [4596, 1, 0.6330277919769287, [[4596, 0.633028, " in", false], [4600, 0.082556, " is", false], [21700, 0.069619, " for", false], [31323, 0.05688, " long", false], [31601, 0.048866, " over", false], [4811, 0.010968, " to", false], [4712, 0.008525, " on", false], [46470, 0.008246, " longer", false], [4424, 0.007736, " at", false], [31458, 0.007216, " more", false]]], "qwen": [304, 1, 0.46231386065483093, [[304, 0.462314, " in", false], [374, 0.248756, " is", false], [369, 0.083671, " for", false], [311, 0.033057, " to", false], [1293, 0.031607, " long", false], [916, 0.020673, " over", false], [979, 0.019231, " when", false], [438, 0.009893, " as", false], [518, 0.007377, " at", false], [911, 0.006492, " about", false]]]}, "raw_delta": -0.10287356376647949, "tuned_delta": -0.09430177173590125}, {"byte_start": 839, "byte_end": 843, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 138, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "0.14% 0.14% 0.14% 0.14%", "qwen": "0.45% 0.45% 0.45% 0.45%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.9696335196495056]], "qwen": [[279, " the", "normal", 0.9055376052856445]]}, "loss": {"rwkv": 0.13923715413852986, "qwen": 0.44735475489420745}, "topk": {"rwkv": [22590, 1, 0.9696335196495056, [[22590, 0.969634, " the", false], [332, 0.005256, " a", false], [56901, 0.003081, " practice", false], [32234, 0.002627, " this", false], [39920, 0.002346, " terms", false], [31323, 0.001343, " long", false], [3609, 0.001281, " AI", false], [32227, 0.001277, " that", false], [46470, 0.001018, " longer", false], [4419, 0.001008, " an", false]]], "qwen": [279, 1, 0.9055376052856445, [[279, 0.905538, " the", false], [3793, 0.022919, " terms", false], [264, 0.016748, " a", false], [419, 0.00897, " this", false], [15235, 0.003279, " AI", false], [1293, 0.00291, " long", false], [220, 0.002771, " ", false], [5021, 0.00245, " longer", false], [6588, 0.002284, " practice", false], [458, 0.002251, " an", false]]]}, "raw_delta": -0.017085667699575424, "tuned_delta": -0.008513875668997176}, {"byte_start": 843, "byte_end": 848, "display": {"text": " long", "kind": "normal"}, "is_word": true, "word_id": 139, "word_key": " long", "bytes_hex": "20 6c 6f 6e 67", "compression": {"rwkv": "1.78% 1.78% 1.78% 1.78% 1.78%", "qwen": "1.11% 1.11% 1.11% 1.11% 1.11%"}, "model_tokens": {"rwkv": [[31323, " long", "normal", 0.6108350157737732]], "qwen": [[1293, " long", "normal", 0.7342362403869629]]}, "loss": {"rwkv": 1.7822355729731822, "qwen": 1.1142093816195549}, "topk": {"rwkv": [31323, 1, 0.6108350157737732, [[31323, 0.610835, " long", false], [46470, 0.35425, " longer", false], [21616, 0.008056, " end", false], [32386, 0.003407, " very", false], [39675, 0.003014, " short", false], [46536, 0.002008, " medium", false], [52888, 0.001715, " shorter", false], [46064, 0.001254, " future", false], [51310, 0.001077, " context", false], [46397, 0.000997, " larger", false]]], "qwen": [1293, 1, 0.7342362403869629, [[1293, 0.734236, " long", false], [5021, 0.195004, " longer", false], [835, 0.021934, " end", false], [11051, 0.00635, " medium", false], [1602, 0.005318, " very", false], [2805, 0.003325, " short", false], [3853, 0.00324, " future", false], [3930, 0.002214, " limit", false], [8131, 0.001688, " larger", false], [2266, 0.001613, " context", false]]]}, "raw_delta": 0.03704323768615723, "tuned_delta": 0.04561502971673548}, {"byte_start": 848, "byte_end": 852, "display": {"text": " run", "kind": "normal"}, "is_word": true, "word_id": 140, "word_key": " run", "bytes_hex": "20 72 75 6e", "compression": {"rwkv": "3.21% 3.21% 3.21% 3.21%", "qwen": "5.04% 5.04% 5.04% 5.04%"}, "model_tokens": {"rwkv": [[22418, " run", "normal", 0.4916808307170868]], "qwen": [[1598, " run", "normal", 0.3270103633403778]]}, "loss": {"rwkv": 3.2052062675999915, "qwen": 5.0393491068108025}, "topk": {"rwkv": [22418, 1, 0.4916808307170868, [[22418, 0.491681, " run", false], [32219, 0.473208, " term", false], [46, 0.024563, "-", false], [31057, 0.003239, " haul", false], [27132, 0.001216, "term", false], [30941, 0.0012, " game", false], [32186, 0.00047, " tail", false], [32398, 0.00035, " view", false], [8661, 0.000324, "run", false], [45, 0.000261, ",", false]]], "qwen": [1598, 2, 0.3270103633403778, [[4647, 0.632555, " term", false], [1598, 0.32701, " run", false], [9663, 0.027619, "-term", false], [22973, 0.003781, "-run", false], [37868, 0.001621, " haul", false], [4991, 0.00115, "term", false], [1809, 0.000715, " game", false], [11, 0.000508, ",", false], [882, 0.000435, " time", false], [1651, 0.000375, " view", false]]]}, "raw_delta": -0.10170647501945496, "tuned_delta": -0.09313468298887671}, {"byte_start": 852, "byte_end": 855, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 141, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "0.40% 0.40% 0.40%", "qwen": "0.50% 0.50% 0.50%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.9357764720916748]], "qwen": [[374, " is", "normal", 0.9206897020339966]]}, "loss": {"rwkv": 0.39918319816263637, "qwen": 0.49672136711353176}, "topk": {"rwkv": [4600, 1, 0.9357764720916748, [[4600, 0.935776, " is", false], [21286, 0.023424, " are", false], [45, 0.015538, ",", false], [275, 0.006279, " (", false], [21700, 0.003928, " for", false], [4596, 0.002353, " in", false], [32475, 0.001746, " will", false], [37598, 0.001062, " about", false], [4601, 0.000875, " it", false], [4706, 0.00058, " of", false]]], "qwen": [374, 1, 0.9206897020339966, [[374, 0.92069, " is", false], [525, 0.025628, " are", false], [11, 0.016065, ",", false], [320, 0.009669, " (", false], [369, 0.004831, " for", false], [304, 0.00204, " in", false], [323, 0.002032, " and", false], [311, 0.001394, " to", false], [686, 0.00132, " will", false], [979, 0.001138, " when", false]]]}, "raw_delta": -0.00540866454442342, "tuned_delta": 0.003163127486154828}, {"byte_start": 855, "byte_end": 859, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 142, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "5.60% 5.60% 5.60% 5.60%", "qwen": "8.19% 8.19% 8.19% 8.19%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.28981590270996094]], "qwen": [[279, " the", "normal", 0.16274243593215942]]}, "loss": {"rwkv": 5.60030545657581, "qwen": 8.185430426273081}, "topk": {"rwkv": [22590, 1, 0.28981590270996094, [[22590, 0.289816, " the", false], [21835, 0.173152, " how", false], [32227, 0.114558, " that", false], [53342, 0.077344, " whether", false], [32464, 0.042637, " what", false], [38888, 0.028964, " lever", false], [40186, 0.017427, " which", false], [332, 0.013229, " a", false], [59832, 0.009594, " improving", false], [4811, 0.009205, " to", false]]], "qwen": [279, 1, 0.16274243593215942, [[279, 0.162742, " the", false], [76482, 0.093711, " leveraging", false], [311, 0.092522, " to", false], [34447, 0.065545, " computation", false], [1246, 0.045012, " how", false], [429, 0.041316, " that", false], [264, 0.034883, " a", false], [3425, 0.029197, " whether", false], [4586, 0.025029, " general", false], [1128, 0.024177, " what", false]]]}, "raw_delta": -0.1433497667312622, "tuned_delta": -0.13477797470068395}, {"byte_start": 859, "byte_end": 870, "display": {"text": " leveraging", "kind": "normal"}, "is_word": true, "word_id": 143, "word_key": " leveraging", "bytes_hex": "20 6c 65 76 65 72 61 67 69 6e 67", "compression": {"rwkv": "15.03% 15.03% 15.03% 15.03% 15.03% 15.03% 0.92% 0.92% 0.92% 0.92% 0.92%", "qwen": "9.31% 9.31% 9.31% 9.31% 9.31% 9.31% 9.31% 9.31% 9.31% 9.31% 9.31%"}, "model_tokens": {"rwkv": [[38888, " lever", "normal", 0.006754220928996801], [33672, "aging", "normal", 0.7784444093704224]], "qwen": [[76482, " leveraging", "normal", 0.0034172760788351297]]}, "loss": {"rwkv": 8.613391468375601, "qwen": 9.31015572616661}, "topk": {"rwkv": [38888, 29, 0.006754220928996801, [[50836, 0.084235, " ability", false], [30510, 0.061397, " cost", false], [45157, 0.042197, " amount", false], [63621, 0.032166, " improvement", false], [51832, 0.020987, " general", false], [56540, 0.019203, " leverage", false], [63370, 0.018766, " computation", false], [64862, 0.017476, " computational", false], [57481, 0.017034, " ultimate", false], [39984, 0.01658, " total", false]]], "qwen": [76482, 47, 0.0034172760788351297, [[5726, 0.169427, " ability", false], [990, 0.040495, " use", false], [4586, 0.040453, " general", false], [34447, 0.029547, " computation", false], [3311, 0.026409, " amount", false], [4401, 0.021444, " development", false], [54480, 0.017618, " computational", false], [4271, 0.015834, " quality", false], [15673, 0.014703, " improvement", false], [12111, 0.014498, " algorithm", false]]]}, "raw_delta": -0.03863681446422232, "tuned_delta": -0.03006502243364407}, {"byte_start": 870, "byte_end": 873, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 144, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.18% 0.18% 0.18%", "qwen": "0.09% 0.09% 0.09%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9712008237838745]], "qwen": [[315, " of", "normal", 0.9853333830833435]]}, "loss": {"rwkv": 0.17611023448351604, "qwen": 0.08881744489753073}, "topk": {"rwkv": [4706, 1, 0.9712008237838745, [[4706, 0.971201, " of", false], [22590, 0.003842, " the", false], [63370, 0.003557, " computation", false], [32227, 0.003371, " that", false], [31458, 0.001212, " more", false], [21265, 0.001107, " and", false], [59206, 0.00097, " available", false], [51832, 0.000649, " general", false], [275, 0.000576, " (", false], [38720, 0.000543, " human", false]]], "qwen": [315, 1, 0.9853333830833435, [[315, 0.985333, " of", false], [279, 0.002407, " the", false], [323, 0.002221, " and", false], [429, 0.000901, " that", false], [320, 0.000591, " (", false], [34447, 0.000498, " computation", false], [11, 0.000456, ",", false], [2355, 0.000411, " power", false], [476, 0.000368, " or", false], [862, 0.000324, " their", false]]]}, "raw_delta": 0.004840540078779061, "tuned_delta": 0.01341233210935731}, {"byte_start": 873, "byte_end": 885, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 145, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "1.88% 1.88% 1.88% 1.88% 1.88% 1.88% 1.88% 1.88% 1.88% 1.88% 1.88% 1.88%", "qwen": "1.52% 1.52% 1.52% 1.52% 1.52% 1.52% 1.52% 1.52% 1.52% 1.52% 1.52% 1.52%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.2883734107017517]], "qwen": [[34447, " computation", "normal", 0.3631451427936554]]}, "loss": {"rwkv": 1.878509167824171, "qwen": 1.5222727248108976}, "topk": {"rwkv": [63370, 1, 0.2883734107017517, [[63370, 0.288373, " computation", false], [22590, 0.129442, " the", false], [30789, 0.054575, " ever", false], [31458, 0.04456, " more", false], [51832, 0.038161, " general", false], [64862, 0.03177, " computational", false], [59988, 0.030973, " massively", false], [52195, 0.021507, " massive", false], [64430, 0.018577, " increasingly", false], [37045, 0.017253, " Moore", false]]], "qwen": [34447, 1, 0.3631451427936554, [[34447, 0.363145, " computation", false], [279, 0.183433, " the", false], [54480, 0.059844, " computational", false], [10951, 0.026548, " massive", false], [419, 0.025934, " this", false], [2500, 0.025503, " available", false], [803, 0.013521, " more", false], [3512, 0.012963, " ever", false], [74151, 0.012141, " exponentially", false], [678, 0.009145, " all", false]]]}, "raw_delta": 0.01975394288698833, "tuned_delta": 0.028325734917566577}, {"byte_start": 885, "byte_end": 886, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "9.09%", "qwen": "20.20%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.6067418456077576]], "qwen": [[13, ".", "normal", 0.3262180685997009]]}, "loss": {"rwkv": 9.087288099349427, "qwen": 20.201142364273302}, "topk": {"rwkv": [47, 1, 0.6067418456077576, [[47, 0.606742, ".", false], [45, 0.129655, ",", false], [32227, 0.037035, " that", false], [4811, 0.03598, " to", false], [21265, 0.020088, " and", false], [59206, 0.017486, " available", false], [275, 0.016574, " (", false], [4596, 0.014383, " in", false], [31601, 0.009885, " over", false], [46342, 0.009815, " itself", false]]], "qwen": [13, 2, 0.3262180685997009, [[624, 0.391796, ".\n", false], [13, 0.326218, ".", false], [11, 0.057867, ",", false], [5086, 0.030455, " itself", false], [311, 0.021595, " to", false], [382, 0.019031, ".\n\n", false], [304, 0.014615, " in", false], [320, 0.014332, " (", false], [2355, 0.011719, " power", false], [323, 0.011194, " and", false]]]}, "raw_delta": -0.6162829399108887, "tuned_delta": -0.6077111478803104}, {"byte_start": 886, "byte_end": 892, "display": {"text": " These", "kind": "normal"}, "is_word": true, "word_id": 146, "word_key": " these", "bytes_hex": "20 54 68 65 73 65", "compression": {"rwkv": "22.17% 22.17% 22.17% 22.17% 22.17% 22.17%", "qwen": "18.64% 18.64% 18.64% 18.64% 18.64% 18.64%"}, "model_tokens": {"rwkv": [[37453, " These", "normal", 0.0006322221015579998]], "qwen": [[4220, " These", "normal", 0.0020231707021594048]]}, "loss": {"rwkv": 22.166408180325217, "qwen": 18.64409600149811}, "topk": {"rwkv": [37453, 90, 0.0006322221015579998, [[11, 0.361544, "\n", false], [261, 0.140946, "\n\n", false], [20996, 0.066386, " The", false], [29894, 0.047772, " This", false], [3913, 0.024106, " In", false], [3908, 0.017849, " If", false], [3918, 0.017349, " It", false], [3641, 0.01397, " As", false], [19417, 0.013264, " And", false], [0, 0.010645, "[0]", false]]], "qwen": [4220, 65, 0.0020231707021594048, [[1096, 0.122805, " This", false], [576, 0.101877, " The", false], [758, 0.053649, " In", false], [1084, 0.03342, " It", false], [151643, 0.031468, "\u003c|endoftext|\u003e", false], [1597, 0.031053, " And", false], [1634, 0.027537, " As", false], [2938, 0.021748, " That", false], [2055, 0.020372, " So", false], [1416, 0.020039, " If", false]]]}, "raw_delta": 0.19531846046447754, "tuned_delta": 0.2038902524950558}, {"byte_start": 892, "byte_end": 896, "display": {"text": " two", "kind": "normal"}, "is_word": true, "word_id": 147, "word_key": " two", "bytes_hex": "20 74 77 6f", "compression": {"rwkv": "9.30% 9.30% 9.30% 9.30%", "qwen": "9.48% 9.48% 9.48% 9.48%"}, "model_tokens": {"rwkv": [[22638, " two", "normal", 0.12694168090820312]], "qwen": [[1378, " two", "normal", 0.122063048183918]]}, "loss": {"rwkv": 9.298620380729647, "qwen": 9.482192512477472}, "topk": {"rwkv": [22638, 1, 0.12694168090820312, [[22638, 0.126942, " two", false], [52127, 0.116239, " lessons", false], [21286, 0.112441, " are", false], [30582, 0.077645, " days", false], [52738, 0.042056, " results", false], [64495, 0.024045, " observations", false], [47539, 0.02168, " things", false], [38735, 0.020151, " ideas", false], [56463, 0.019488, " insights", false], [38440, 0.018844, " facts", false]]], "qwen": [1378, 2, 0.122063048183918, [[18366, 0.141717, " lessons", false], [1378, 0.122063, " two", false], [2849, 0.100338, " days", false], [525, 0.08124, " are", false], [4586, 0.054305, " general", false], [23722, 0.028487, " observations", false], [25709, 0.026367, " insights", false], [6708, 0.024223, " ideas", false], [16170, 0.021039, " principles", false], [5413, 0.017733, " methods", false]]]}, "raw_delta": -0.010179400444030762, "tuned_delta": -0.0016076084134525135}, {"byte_start": 896, "byte_end": 901, "display": {"text": " need", "kind": "normal"}, "is_word": true, "word_id": 148, "word_key": " need", "bytes_hex": "20 6e 65 65 64", "compression": {"rwkv": "38.77% 38.77% 38.77% 38.77% 38.77%", "qwen": "30.38% 30.38% 30.38% 30.38% 30.38%"}, "model_tokens": {"rwkv": [[31506, " need", "normal", 2.2071797502576374e-05]], "qwen": [[1184, " need", "normal", 0.00021952726820018142]]}, "loss": {"rwkv": 38.77242922389089, "qwen": 30.38328061814791}, "topk": {"rwkv": [31506, 1015, 2.2071797502576374e-05, [[52127, 0.144082, " lessons", false], [46853, 0.092754, " points", false], [38440, 0.089346, " facts", false], [47539, 0.052153, " things", false], [38735, 0.044716, " ideas", false], [51703, 0.041901, " factors", false], [64495, 0.035346, " observations", false], [47613, 0.035015, " trends", false], [56463, 0.024941, " insights", false], [46022, 0.022422, " forces", false]]], "qwen": [1184, 323, 0.00021952726820018142, [[18366, 0.094548, " lessons", false], [6708, 0.061324, " ideas", false], [9363, 0.049633, " factors", false], [2513, 0.046846, " things", false], [23722, 0.043611, " observations", false], [3501, 0.031732, " points", false], [16170, 0.03025, " principles", false], [525, 0.028089, " are", false], [12239, 0.026806, " statements", false], [13064, 0.024781, " facts", false]]]}, "raw_delta": 0.46519317626953116, "tuned_delta": 0.4737649683001094}, {"byte_start": 901, "byte_end": 905, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 149, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "2.50% 2.50% 2.50% 2.50%", "qwen": "2.32% 2.32% 2.32% 2.32%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.5746027827262878]], "qwen": [[537, " not", "normal", 0.59713214635849]]}, "loss": {"rwkv": 2.5007653296659274, "qwen": 2.324618280146211}, "topk": {"rwkv": [22187, 1, 0.5746027827262878, [[22187, 0.574603, " not", false], [4811, 0.347578, " to", false], [111, 0.041622, "n", false], [30719, 0.016453, " each", false], [122, 0.003112, "y", false], [4435, 0.002024, " be", false], [7592, 0.001194, "ful", false], [31581, 0.000894, " only", false], [4692, 0.000877, " no", false], [332, 0.000782, " a", false]]], "qwen": [537, 1, 0.59713214635849, [[537, 0.597132, " not", false], [311, 0.290475, " to", false], [77, 0.057425, "n", false], [1817, 0.022967, " each", false], [2581, 0.006973, " never", false], [387, 0.004935, " be", false], [1172, 0.002542, " only", false], [264, 0.002226, " a", false], [1045, 0.000731, " some", false], [279, 0.000689, " the", false]]]}, "raw_delta": 0.009767666459083557, "tuned_delta": 0.018339458489661807}, {"byte_start": 905, "byte_end": 909, "display": {"text": " run", "kind": "normal"}, "is_word": true, "word_id": 150, "word_key": " run", "bytes_hex": "20 72 75 6e", "compression": {"rwkv": "28.88% 28.88% 28.88% 28.88%", "qwen": "29.47% 29.47% 29.47% 29.47%"}, "model_tokens": {"rwkv": [[22418, " run", "normal", 0.0016512158326804638]], "qwen": [[1598, " run", "normal", 0.0014501496916636825]]}, "loss": {"rwkv": 28.88207845529663, "qwen": 29.467445055122692}, "topk": {"rwkv": [22418, 25, 0.0016512158326804638, [[4435, 0.698907, " be", false], [55824, 0.089738, " conflict", false], [4559, 0.023159, " go", false], [51255, 0.022956, " compete", false], [63717, 0.020847, " necessarily", false], [61779, 0.014937, " contradict", false], [45150, 0.013822, " always", false], [30788, 0.00674, " even", false], [30482, 0.005506, " come", false], [55769, 0.004843, " coincide", false]]], "qwen": [1598, 23, 0.0014501496916636825, [[387, 0.701583, " be", false], [2677, 0.060365, " always", false], [12055, 0.055626, " conflict", false], [728, 0.034565, " go", false], [14312, 0.01243, " necessarily", false], [42461, 0.012189, " contradict", false], [2525, 0.007426, " come", false], [614, 0.006855, " have", false], [20259, 0.006407, " compete", false], [2803, 0.005127, " seem", false]]]}, "raw_delta": -0.03245961666107178, "tuned_delta": -0.023887824630493527}, {"byte_start": 909, "byte_end": 917, "display": {"text": " counter", "kind": "normal"}, "is_word": true, "word_id": 151, "word_key": " counter", "bytes_hex": "20 63 6f 75 6e 74 65 72", "compression": {"rwkv": "8.49% 8.49% 8.49% 8.49% 8.49% 8.49% 8.49% 8.49%", "qwen": "8.42% 8.42% 8.42% 8.42% 8.42% 8.42% 8.42% 8.42%"}, "model_tokens": {"rwkv": [[51336, " counter", "normal", 0.023207833990454674]], "qwen": [[5546, " counter", "normal", 0.02388518676161766]]}, "loss": {"rwkv": 8.488513302105472, "qwen": 8.418343843107662}, "topk": {"rwkv": [51336, 6, 0.023207833990454674, [[4596, 0.684405, " in", false], [64301, 0.070829, " concurrently", false], [57435, 0.055325, " together", false], [56812, 0.051997, " parallel", false], [65167, 0.034097, " simultaneously", false], [51336, 0.023208, " counter", false], [4424, 0.014395, " at", false], [31162, 0.006264, " into", false], [32011, 0.005742, " side", false], [31044, 0.005019, " hand", false]]], "qwen": [5546, 6, 0.02388518676161766, [[304, 0.442034, " in", false], [15279, 0.205334, " parallel", false], [1424, 0.089002, " hand", false], [78026, 0.040503, " concurrently", false], [3108, 0.029114, " side", false], [5546, 0.023885, " counter", false], [518, 0.021003, " at", false], [3786, 0.014364, " together", false], [1119, 0.01417, " into", false], [700, 0.013769, " out", false]]]}, "raw_delta": 0.0038910210132598877, "tuned_delta": 0.012462813043838136}, {"byte_start": 917, "byte_end": 920, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 152, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "1.07% 1.07% 1.07%", "qwen": "2.00% 2.00% 2.00%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.8370802402496338]], "qwen": [[311, " to", "normal", 0.717501699924469]]}, "loss": {"rwkv": 1.0684020891999972, "qwen": 1.9956076760817911}, "topk": {"rwkv": [4811, 1, 0.8370802402496338, [[4811, 0.83708, " to", false], [45, 0.046543, ",", false], [46, 0.03329, "-", false], [60, 0.017668, ";", false], [59, 0.014434, ":", false], [47, 0.011907, ".", false], [30719, 0.006606, " each", false], [4596, 0.002597, " in", false], [21400, 0.00197, " but", false], [35408, 0.001863, "point", false]]], "qwen": [311, 1, 0.717501699924469, [[311, 0.717502, " to", false], [11, 0.076769, ",", false], [13, 0.03808, ".", false], [26, 0.031395, ";", false], [304, 0.01582, " in", false], [25, 0.01469, ":", false], [624, 0.010889, ".\n", false], [396, 0.009218, "int", false], [20052, 0.006652, "-int", false], [1576, 0.006468, " because", false]]]}, "raw_delta": -0.051415195067723594, "tuned_delta": -0.042843403037145344}, {"byte_start": 920, "byte_end": 925, "display": {"text": " each", "kind": "normal"}, "is_word": true, "word_id": 153, "word_key": " each", "bytes_hex": "20 65 61 63 68", "compression": {"rwkv": "1.20% 1.20% 1.20% 1.20% 1.20%", "qwen": "1.14% 1.14% 1.14% 1.14% 1.14%"}, "model_tokens": {"rwkv": [[30719, " each", "normal", 0.7160350680351257]], "qwen": [[1817, " each", "normal", 0.7294825911521912]]}, "loss": {"rwkv": 1.2045940038672498, "qwen": 1.1376362133851459}, "topk": {"rwkv": [30719, 1, 0.7160350680351257, [[30719, 0.716035, " each", false], [22226, 0.280017, " one", false], [22590, 0.001423, " the", false], [332, 0.000392, " a", false], [50919, 0.000242, " another", false], [45, 0.000173, ",", false], [39193, 0.000154, " other", false], [21273, 0.000147, " any", false], [62643, 0.000101, " themselves", false], [4715, 6.5e-05, " or", false]]], "qwen": [1817, 1, 0.7294825911521912, [[1817, 0.729483, " each", false], [825, 0.256977, " one", false], [279, 0.003538, " the", false], [264, 0.001226, " a", false], [5577, 0.000648, " themselves", false], [862, 0.000487, " their", false], [894, 0.000421, " any", false], [2987, 0.00039, " either", false], [1008, 0.000318, " other", false], [387, 0.000254, " be", false]]]}, "raw_delta": 0.0037129282951355036, "tuned_delta": 0.012284720325713752}, {"byte_start": 925, "byte_end": 931, "display": {"text": " other", "kind": "normal"}, "is_word": true, "word_id": 154, "word_key": " other", "bytes_hex": "20 6f 74 68 65 72", "compression": {"rwkv": "0.02% 0.02% 0.02% 0.02% 0.02% 0.02%", "qwen": "0.01% 0.01% 0.01% 0.01% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[39193, " other", "normal", 0.9946094751358032]], "qwen": [[1008, " other", "normal", 0.9954625964164734]]}, "loss": {"rwkv": 0.016235162241449132, "qwen": 0.013668722862061278}, "topk": {"rwkv": [39193, 1, 0.9946094751358032, [[39193, 0.994609, " other", false], [46, 0.001437, "-", false], [35297, 0.001021, "other", false], [50919, 0.000863, " another", false], [46726, 0.000635, " others", false], [45, 0.000382, ",", false], [47, 0.000115, ".", false], [11, 7.3e-05, "\n", false], [4596, 6.4e-05, " in", false], [4811, 5.9e-05, " to", false]]], "qwen": [1008, 1, 0.9954625964164734, [[1008, 0.995463, " other", false], [1575, 0.001111, "other", false], [2441, 0.0007, " another", false], [72472, 0.000452, "-other", false], [11, 0.000449, ",", false], [3800, 0.000196, " others", false], [13, 0.000177, ".", false], [26, 0.000133, ";", false], [198, 9.8e-05, "\n", false], [304, 9.2e-05, " in", false]]]}, "raw_delta": 0.00014231361759205663, "tuned_delta": 0.008714105648170305}, {"byte_start": 931, "byte_end": 932, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "18.60%", "qwen": "18.97%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.34999677538871765]], "qwen": [[11, ",", "normal", 0.34930193424224854]]}, "loss": {"rwkv": 18.597240761459293, "qwen": 18.968168643273927}, "topk": {"rwkv": [45, 1, 0.34999677538871765, [[45, 0.349997, ",", false], [47, 0.20553, ".", false], [59, 0.148101, ":", false], [60, 0.105455, ";", false], [21400, 0.015337, " but", false], [4596, 0.01408, " in", false], [51018, 0.013786, " because", false], [275, 0.013734, " (", false], [4424, 0.013089, " at", false], [280, 0.013078, " -", false]]], "qwen": [11, 1, 0.34930193424224854, [[11, 0.349302, ",", false], [13, 0.165296, ".", false], [26, 0.099456, ";", false], [25, 0.069394, ":", false], [624, 0.048078, ".\n", false], [304, 0.028062, " in", false], [438, 0.026407, " as", false], [323, 0.024873, " and", false], [1576, 0.023704, " because", false], [714, 0.02264, " but", false]]]}, "raw_delta": -0.0205686092376709, "tuned_delta": -0.01199681720709265}, {"byte_start": 932, "byte_end": 936, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 155, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"rwkv": "5.25% 5.25% 5.25% 5.25%", "qwen": "5.57% 5.57% 5.57% 5.57%"}, "model_tokens": {"rwkv": [[21400, " but", "normal", 0.3121977150440216]], "qwen": [[714, " but", "normal", 0.2908656597137451]]}, "loss": {"rwkv": 5.248084987608777, "qwen": 5.567422373730841}, "topk": {"rwkv": [21400, 1, 0.3121977150440216, [[21400, 0.312198, " but", false], [4423, 0.149926, " as", false], [21265, 0.095056, " and", false], [51948, 0.061952, " however", false], [39690, 0.061606, " since", false], [4596, 0.052091, " in", false], [51018, 0.047472, " because", false], [47544, 0.043504, " though", false], [4706, 0.021436, " of", false], [21700, 0.012967, " for", false]]], "qwen": [714, 1, 0.2908656597137451, [[714, 0.290866, " but", false], [323, 0.15414, " and", false], [438, 0.137591, " as", false], [4764, 0.078339, " however", false], [3498, 0.045718, " though", false], [315, 0.043956, " of", false], [304, 0.034507, " in", false], [1576, 0.03194, " because", false], [2474, 0.028332, " since", false], [369, 0.015484, " for", false]]]}, "raw_delta": -0.01770782470703125, "tuned_delta": -0.009136032676453002}, {"byte_start": 936, "byte_end": 939, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 156, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "19.44% 19.44% 19.44%", "qwen": "16.65% 16.65% 16.65%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.03985238075256348]], "qwen": [[304, " in", "normal", 0.06268417090177536]]}, "loss": {"rwkv": 19.44256988698017, "qwen": 16.64897829682268}, "topk": {"rwkv": [4596, 4, 0.03985238075256348, [[32232, 0.228443, " they", false], [4601, 0.112102, " it", false], [22590, 0.076137, " the", false], [4596, 0.039852, " in", false], [4588, 0.027184, " if", false], [21286, 0.022559, " are", false], [39934, 0.02241, " there", false], [21700, 0.017828, " for", false], [47001, 0.016026, " rather", false], [22226, 0.015842, " one", false]]], "qwen": [304, 3, 0.06268417090177536, [[807, 0.221437, " they", false], [279, 0.135123, " the", false], [304, 0.062684, " in", false], [432, 0.059239, " it", false], [421, 0.030862, " if", false], [1052, 0.027152, " there", false], [979, 0.017533, " when", false], [438, 0.017005, " as", false], [825, 0.016756, " one", false], [11, 0.015249, ",", false]]]}, "raw_delta": 0.15490961074829102, "tuned_delta": 0.16348140277886927}, {"byte_start": 939, "byte_end": 948, "display": {"text": " practice", "kind": "normal"}, "is_word": true, "word_id": 157, "word_key": " practice", "bytes_hex": "20 70 72 61 63 74 69 63 65", "compression": {"rwkv": "2.41% 2.41% 2.41% 2.41% 2.41% 2.41% 2.41% 2.41% 2.41%", "qwen": "3.59% 3.59% 3.59% 3.59% 3.59% 3.59% 3.59% 3.59% 3.59%"}, "model_tokens": {"rwkv": [[56901, " practice", "normal", 0.3012830317020416]], "qwen": [[6588, " practice", "normal", 0.16660629212856293]]}, "loss": {"rwkv": 2.410753432041019, "qwen": 3.5909516491104214}, "topk": {"rwkv": [56901, 2, 0.3012830317020416, [[22590, 0.319479, " the", false], [56901, 0.301283, " practice", false], [30808, 0.047371, " fact", false], [31370, 0.036926, " many", false], [31461, 0.028251, " most", false], [39189, 0.02413, " order", false], [51832, 0.019897, " general", false], [32074, 0.018274, " some", false], [332, 0.017392, " a", false], [32234, 0.015541, " this", false]]], "qwen": [6588, 2, 0.16660629212856293, [[279, 0.245173, " the", false], [6588, 0.166606, " practice", false], [2097, 0.10056, " fact", false], [4586, 0.077328, " general", false], [1657, 0.065613, " many", false], [1429, 0.044612, " most", false], [1973, 0.030774, " order", false], [264, 0.029953, " a", false], [894, 0.020458, " any", false], [847, 0.018656, " my", false]]]}, "raw_delta": -0.06544408533308242, "tuned_delta": -0.05687229330250417}, {"byte_start": 948, "byte_end": 953, "display": {"text": " they", "kind": "normal"}, "is_word": true, "word_id": 158, "word_key": " they", "bytes_hex": "20 74 68 65 79", "compression": {"rwkv": "3.92% 3.92% 3.92% 3.92% 3.92%", "qwen": "3.45% 3.45% 3.45% 3.45% 3.45%"}, "model_tokens": {"rwkv": [[32232, " they", "normal", 0.3347264230251312]], "qwen": [[807, " they", "normal", 0.3845542073249817]]}, "loss": {"rwkv": 3.9166916149133963, "qwen": 3.4468526409779168}, "topk": {"rwkv": [32232, 1, 0.3347264230251312, [[32232, 0.334726, " they", false], [45, 0.116147, ",", false], [22590, 0.097098, " the", false], [4601, 0.07882, " it", false], [39934, 0.034956, " there", false], [32234, 0.023624, " this", false], [63843, 0.021321, " researchers", false], [31461, 0.019253, " most", false], [4858, 0.016567, " we", false], [31370, 0.015238, " many", false]]], "qwen": [807, 1, 0.3845542073249817, [[807, 0.384554, " they", false], [11, 0.197659, ",", false], [279, 0.096124, " the", false], [432, 0.056831, " it", false], [1052, 0.02848, " there", false], [419, 0.017806, " this", false], [825, 0.012207, " one", false], [1429, 0.008678, " most", false], [11811, 0.008366, " researchers", false], [582, 0.007938, " we", false]]]}, "raw_delta": 0.02605340480804444, "tuned_delta": 0.03462519683862269}, {"byte_start": 953, "byte_end": 958, "display": {"text": " tend", "kind": "normal"}, "is_word": true, "word_id": 159, "word_key": " tend", "bytes_hex": "20 74 65 6e 64", "compression": {"rwkv": "11.38% 11.38% 11.38% 11.38% 11.38%", "qwen": "9.85% 9.85% 9.85% 9.85% 9.85%"}, "model_tokens": {"rwkv": [[32216, " tend", "normal", 0.04244176670908928]], "qwen": [[8376, " tend", "normal", 0.06506852805614471]]}, "loss": {"rwkv": 11.383765557014476, "qwen": 9.854740040906607}, "topk": {"rwkv": [32216, 5, 0.04244176670908928, [[4491, 0.258109, " do", false], [31059, 0.177194, " have", false], [39171, 0.160973, " often", false], [21286, 0.098834, " are", false], [32216, 0.042442, " tend", false], [21413, 0.030162, " can", false], [31967, 0.02112, " seem", false], [60523, 0.020637, " sometimes", false], [53248, 0.013855, " usually", false], [45145, 0.010364, " almost", false]]], "qwen": [8376, 3, 0.06506852805614471, [[653, 0.352733, " do", false], [3545, 0.258844, " often", false], [8376, 0.065069, " tend", false], [614, 0.053291, " have", false], [525, 0.047206, " are", false], [646, 0.021988, " can", false], [686, 0.017243, " will", false], [5990, 0.016247, " usually", false], [13814, 0.015728, " frequently", false], [4558, 0.013145, " almost", false]]]}, "raw_delta": 0.08478717803955071, "tuned_delta": 0.09335897007012896}, {"byte_start": 958, "byte_end": 961, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 160, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.10% 0.10% 0.10%", "qwen": "0.10% 0.10% 0.10%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.9841216802597046]], "qwen": [[311, " to", "normal", 0.9841543436050415]]}, "loss": {"rwkv": 0.0961268363222525, "qwen": 0.09601448775983339}, "topk": {"rwkv": [4811, 1, 0.9841216802597046, [[4811, 0.984122, " to", false], [22187, 0.009021, " not", false], [4491, 0.000918, " do", false], [53169, 0.00074, " towards", false], [47585, 0.000636, " toward", false], [4596, 0.000334, " in", false], [22418, 0.000317, " run", false], [45, 0.000246, ",", false], [21700, 0.000188, " for", false], [22614, 0.000153, " too", false]]], "qwen": [311, 1, 0.9841543436050415, [[311, 0.984154, " to", false], [537, 0.008721, " not", false], [653, 0.002119, " do", false], [6974, 0.000615, " towards", false], [8841, 0.000587, " toward", false], [11, 0.000378, ",", false], [320, 0.000358, " (", false], [304, 0.000216, " in", false], [13, 0.000197, ".", false], [2238, 0.000171, " too", false]]]}, "raw_delta": 6.229927142460852e-06, "tuned_delta": 0.00857802195772071}, {"byte_start": 961, "byte_end": 962, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "30.15%", "qwen": "33.55%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.18680818378925323]], "qwen": [[13, ".", "normal", 0.15557077527046204]]}, "loss": {"rwkv": 30.150072143577944, "qwen": 33.55446226805783}, "topk": {"rwkv": [47, 1, 0.18680818378925323, [[47, 0.186808, ".", false], [4491, 0.14348, " do", false], [4435, 0.140456, " be", false], [22418, 0.075125, " run", false], [51255, 0.038406, " compete", false], [45, 0.036937, ",", false], [55824, 0.027529, " conflict", false], [4559, 0.021421, " go", false], [31059, 0.019723, " have", false], [59, 0.018619, ":", false]]], "qwen": [13, 2, 0.15557077527046204, [[653, 0.266169, " do", false], [13, 0.155571, ".", false], [624, 0.094433, ".\n", false], [11, 0.067669, ",", false], [387, 0.065015, " be", false], [1598, 0.059061, " run", false], [12055, 0.045034, " conflict", false], [20259, 0.038881, " compete", false], [26, 0.013864, ";", false], [1576, 0.011937, " because", false]]]}, "raw_delta": -0.18877947330474854, "tuned_delta": -0.18020768127417028}, {"byte_start": 962, "byte_end": 967, "display": {"text": " Time", "kind": "normal"}, "is_word": true, "word_id": 161, "word_key": " time", "bytes_hex": "20 54 69 6d 65", "compression": {"rwkv": "31.56% 31.56% 31.56% 31.56% 31.56%", "qwen": "31.47% 31.47% 31.47% 31.47% 31.47%"}, "model_tokens": {"rwkv": [[29904, " Time", "normal", 0.00015415129018947482]], "qwen": [[4120, " Time", "normal", 0.00016235960356425494]]}, "loss": {"rwkv": 31.55895401944607, "qwen": 31.471297901954316}, "topk": {"rwkv": [29904, 259, 0.00015415129018947482, [[11, 0.384399, "\n", false], [261, 0.132226, "\n\n", false], [20996, 0.067632, " The", false], [19907, 0.024179, " For", false], [3913, 0.023985, " In", false], [29894, 0.020572, " This", false], [3918, 0.017416, " It", false], [3908, 0.01347, " If", false], [300, 0.01145, " A", false], [3641, 0.0101, " As", false]]], "qwen": [4120, 388, 0.00016235960356425494, [[576, 0.118124, " The", false], [758, 0.058879, " In", false], [1752, 0.055984, " For", false], [1096, 0.052615, " This", false], [1084, 0.03124, " It", false], [362, 0.02583, " A", false], [2619, 0.022786, " There", false], [1634, 0.021489, " As", false], [1416, 0.021447, " If", false], [151643, 0.019918, "\u003c|endoftext|\u003e", false]]]}, "raw_delta": 0.004860687255859419, "tuned_delta": 0.013432479286437668}, {"byte_start": 967, "byte_end": 973, "display": {"text": " spent", "kind": "normal"}, "is_word": true, "word_id": 162, "word_key": " spent", "bytes_hex": "20 73 70 65 6e 74", "compression": {"rwkv": "8.17% 8.17% 8.17% 8.17% 8.17% 8.17%", "qwen": "10.61% 10.61% 10.61% 10.61% 10.61% 10.61%"}, "model_tokens": {"rwkv": [[39762, " spent", "normal", 0.06628917157649994]], "qwen": [[7391, " spent", "normal", 0.02930413745343685]]}, "loss": {"rwkv": 8.171514880035144, "qwen": 10.609899235855616}, "topk": {"rwkv": [39762, 4, 0.06628917157649994, [[21265, 0.224257, " and", false], [32475, 0.173081, " will", false], [4600, 0.143911, " is", false], [39762, 0.066289, " spent", false], [4811, 0.046215, " to", false], [62307, 0.045497, " permitting", false], [46, 0.038669, "-", false], [21800, 0.019, " has", false], [45, 0.017429, ",", false], [63396, 0.013565, " constraints", false]]], "qwen": [7391, 5, 0.02930413745343685, [[323, 0.213747, " and", false], [374, 0.143557, " is", false], [311, 0.109366, " to", false], [11, 0.035483, ",", false], [7391, 0.029304, " spent", false], [686, 0.027268, " will", false], [369, 0.02348, " for", false], [1283, 0.022726, " after", false], [702, 0.021844, " has", false], [16982, 0.011835, " constraints", false]]]}, "raw_delta": -0.13521273930867517, "tuned_delta": -0.1266409472780969}, {"byte_start": 973, "byte_end": 976, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 163, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"rwkv": "9.67% 9.67% 9.67%", "qwen": "7.70% 7.70% 7.70%"}, "model_tokens": {"rwkv": [[4712, " on", "normal", 0.20093382894992828]], "qwen": [[389, " on", "normal", 0.2779558300971985]]}, "loss": {"rwkv": 9.674322214294481, "qwen": 7.696135485002118}, "topk": {"rwkv": [4712, 1, 0.20093382894992828, [[4712, 0.200934, " on", false], [4596, 0.047296, " in", false], [47629, 0.041765, " trying", false], [61857, 0.030057, " developing", false], [52834, 0.029152, " seeking", false], [38888, 0.028236, " lever", false], [59832, 0.02465, " improving", false], [56537, 0.023161, " learning", false], [60463, 0.020666, " searching", false], [57419, 0.019835, " thinking", false]]], "qwen": [389, 1, 0.2779558300971985, [[389, 0.277956, " on", false], [304, 0.045176, " in", false], [6832, 0.044051, " learning", false], [11220, 0.035835, " developing", false], [18392, 0.032943, " improving", false], [4460, 0.031147, " trying", false], [76482, 0.024253, " leveraging", false], [10887, 0.023543, " seeking", false], [4752, 0.023109, " building", false], [553, 0.017318, " by", false]]]}, "raw_delta": 0.10969396432240808, "tuned_delta": 0.11826575635298632}, {"byte_start": 976, "byte_end": 980, "display": {"text": " one", "kind": "normal"}, "is_word": true, "word_id": 164, "word_key": " one", "bytes_hex": "20 6f 6e 65", "compression": {"rwkv": "20.71% 20.71% 20.71% 20.71%", "qwen": "16.67% 16.67% 16.67% 16.67%"}, "model_tokens": {"rwkv": [[22226, " one", "normal", 0.010251494124531746]], "qwen": [[825, " one", "normal", 0.024803495034575462]]}, "loss": {"rwkv": 20.710563575261485, "qwen": 16.666602218969846}, "topk": {"rwkv": [22226, 11, 0.010251494124531746, [[22590, 0.10022, " the", false], [38720, 0.068896, " human", false], [332, 0.053036, " a", false], [57103, 0.036788, " research", false], [38888, 0.029657, " lever", false], [59832, 0.023433, " improving", false], [45775, 0.014009, " domain", false], [45490, 0.012178, " clever", false], [61857, 0.01184, " developing", false], [55666, 0.011527, " building", false]]], "qwen": [825, 6, 0.024803495034575462, [[76482, 0.065829, " leveraging", false], [279, 0.063352, " the", false], [3738, 0.052422, " human", false], [264, 0.041404, " a", false], [4586, 0.038453, " general", false], [825, 0.024803, " one", false], [7947, 0.024309, " domain", false], [3412, 0.023295, " research", false], [6540, 0.019125, " knowledge", false], [11220, 0.01882, " developing", false]]]}, "raw_delta": 0.2242448329925537, "tuned_delta": 0.23281662502313197}, {"byte_start": 980, "byte_end": 983, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 165, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "11.04% 11.04% 11.04%", "qwen": "11.59% 11.59% 11.59%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.15896400809288025]], "qwen": [[374, " is", "normal", 0.14543162286281586]]}, "loss": {"rwkv": 11.036241360967004, "qwen": 11.589945954769224}, "topk": {"rwkv": [4600, 1, 0.15896400809288025, [[4600, 0.158964, " is", false], [21413, 0.055196, " can", false], [32475, 0.03613, " will", false], [39914, 0.034497, " tends", false], [4715, 0.031097, " or", false], [39941, 0.024198, " thing", false], [30659, 0.022441, " does", false], [4424, 0.019978, " at", false], [32202, 0.019124, " task", false], [22074, 0.018737, " may", false]]], "qwen": [374, 1, 0.14543162286281586, [[374, 0.145432, " is", false], [3545, 0.093406, " often", false], [646, 0.040591, " can", false], [27236, 0.036611, " tends", false], [1231, 0.035747, " may", false], [686, 0.033684, " will", false], [315, 0.02875, " of", false], [476, 0.026719, " or", false], [5990, 0.022938, " usually", false], [11, 0.021252, ",", false]]]}, "raw_delta": -0.03070390224456787, "tuned_delta": -0.02213211021398962}, {"byte_start": 983, "byte_end": 988, "display": {"text": " time", "kind": "normal"}, "is_word": true, "word_id": 166, "word_key": " time", "bytes_hex": "20 74 69 6d 65", "compression": {"rwkv": "2.16% 2.16% 2.16% 2.16% 2.16%", "qwen": "5.03% 5.03% 5.03% 5.03% 5.03%"}, "model_tokens": {"rwkv": [[32251, " time", "normal", 0.5482905507087708]], "qwen": [[882, " time", "normal", 0.24824698269367218]]}, "loss": {"rwkv": 2.155589270078236, "qwen": 5.025379923483627}, "topk": {"rwkv": [32251, 1, 0.5482905507087708, [[32251, 0.548291, " time", false], [62110, 0.095722, " inevitably", false], [39762, 0.038598, " spent", false], [39171, 0.022766, " often", false], [332, 0.021824, " a", false], [63717, 0.019603, " necessarily", false], [47768, 0.012613, " wasted", false], [53248, 0.012257, " usually", false], [22187, 0.010862, " not", false], [46439, 0.010774, " likely", false]]], "qwen": [882, 1, 0.24824698269367218, [[882, 0.248247, " time", false], [3545, 0.205592, " often", false], [38828, 0.053793, " wasted", false], [5558, 0.037867, " lost", false], [4363, 0.029061, " likely", false], [5990, 0.02739, " usually", false], [7391, 0.022486, " spent", false], [264, 0.019575, " a", false], [518, 0.017265, " at", false], [537, 0.015288, " not", false]]]}, "raw_delta": -0.15913498401641843, "tuned_delta": -0.15056319198584017}, {"byte_start": 988, "byte_end": 992, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 167, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "2.85% 2.85% 2.85% 2.85%", "qwen": "2.82% 2.82% 2.82% 2.82%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.5307666063308716]], "qwen": [[537, " not", "normal", 0.5350255966186523]]}, "loss": {"rwkv": 2.8529857986329596, "qwen": 2.819750688799506}, "topk": {"rwkv": [22187, 1, 0.5307666063308716, [[22187, 0.530767, " not", false], [39762, 0.19014, " spent", false], [31334, 0.082802, " lost", false], [32227, 0.055468, " that", false], [47768, 0.02939, " wasted", false], [30211, 0.028751, " away", false], [39887, 0.020838, " taken", false], [63954, 0.008373, " unavailable", false], [31277, 0.00542, " less", false], [22218, 0.002672, " off", false]]], "qwen": [537, 1, 0.5350255966186523, [[537, 0.535026, " not", false], [429, 0.126795, " that", false], [7391, 0.11351, " spent", false], [5558, 0.090603, " lost", false], [38828, 0.022851, " wasted", false], [4429, 0.022105, " taken", false], [13628, 0.007204, " missed", false], [2115, 0.005417, " left", false], [2686, 0.004425, " less", false], [369, 0.002363, " for", false]]]}, "raw_delta": 0.0018429458141326904, "tuned_delta": 0.010414737844710939}, {"byte_start": 992, "byte_end": 998, "display": {"text": " spent", "kind": "normal"}, "is_word": true, "word_id": 168, "word_key": " spent", "bytes_hex": "20 73 70 65 6e 74", "compression": {"rwkv": "0.10% 0.10% 0.10% 0.10% 0.10% 0.10%", "qwen": "0.38% 0.38% 0.38% 0.38% 0.38% 0.38%"}, "model_tokens": {"rwkv": [[39762, " spent", "normal", 0.9659992456436157]], "qwen": [[7391, " spent", "normal", 0.8816502690315247]]}, "loss": {"rwkv": 0.10419855540274699, "qwen": 0.37858661859731446}, "topk": {"rwkv": [39762, 1, 0.9659992456436157, [[39762, 0.965999, " spent", false], [59206, 0.018936, " available", false], [51459, 0.002126, " devoted", false], [4712, 0.002086, " on", false], [56495, 0.001979, " invested", false], [32354, 0.00123, " used", false], [39761, 0.001206, " spend", false], [57278, 0.000584, " spending", false], [22339, 0.000523, " put", false], [38594, 0.000351, " given", false]]], "qwen": [7391, 1, 0.8816502690315247, [[7391, 0.88165, " spent", false], [2500, 0.076201, " available", false], [1660, 0.00788, " being", false], [27991, 0.003958, " invested", false], [8329, 0.002552, " spend", false], [4429, 0.00148, " taken", false], [38828, 0.001363, " wasted", false], [2115, 0.001313, " left", false], [18163, 0.001256, " gained", false], [28229, 0.001159, " devoted", false]]]}, "raw_delta": -0.015215304990609484, "tuned_delta": -0.006643512960031236}, {"byte_start": 998, "byte_end": 1001, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 169, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"rwkv": "0.19% 0.19% 0.19%", "qwen": "0.26% 0.26% 0.26%"}, "model_tokens": {"rwkv": [[4712, " on", "normal", 0.9695765972137451]], "qwen": [[389, " on", "normal", 0.9569395780563354]]}, "loss": {"rwkv": 0.18564953885137314, "qwen": 0.2645843802881575}, "topk": {"rwkv": [4712, 1, 0.9695765972137451, [[4712, 0.969577, " on", false], [38279, 0.002605, " doing", false], [22590, 0.002081, " the", false], [4596, 0.001891, " in", false], [38888, 0.001312, " lever", false], [61857, 0.001299, " developing", false], [59832, 0.001283, " improving", false], [21700, 0.001013, " for", false], [53362, 0.000967, " working", false], [59608, 0.000956, " elsewhere", false]]], "qwen": [389, 1, 0.9569395780563354, [[389, 0.95694, " on", false], [304, 0.005158, " in", false], [3730, 0.00416, " doing", false], [76482, 0.001945, " leveraging", false], [3238, 0.001614, " working", false], [18392, 0.001541, " improving", false], [33018, 0.001485, " pursuing", false], [279, 0.001283, " the", false], [17920, 0.001109, " elsewhere", false], [448, 0.000944, " with", false]]]}, "raw_delta": -0.004377077023188274, "tuned_delta": 0.004194715007389974}, {"byte_start": 1001, "byte_end": 1005, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 170, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "0.10% 0.10% 0.10% 0.10%", "qwen": "0.17% 0.17% 0.17% 0.17%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.9790688157081604]], "qwen": [[279, " the", "normal", 0.9620660543441772]]}, "loss": {"rwkv": 0.09575994000041184, "qwen": 0.17435043544470694}, "topk": {"rwkv": [22590, 1, 0.9790688157081604, [[22590, 0.979069, " the", false], [50919, 0.009265, " another", false], [39193, 0.001319, " other", false], [59832, 0.001289, " improving", false], [38888, 0.00061, " lever", false], [45833, 0.000422, " either", false], [30322, 0.000383, " both", false], [332, 0.000368, " a", false], [31458, 0.000266, " more", false], [32464, 0.000255, " what", false]]], "qwen": [279, 1, 0.9620660543441772, [[279, 0.962066, " the", false], [2441, 0.015389, " another", false], [1008, 0.00288, " other", false], [34447, 0.001726, " computation", false], [2494, 0.001625, " something", false], [264, 0.00138, " a", false], [76482, 0.001128, " leveraging", false], [2176, 0.001003, " both", false], [2987, 0.000812, " either", false], [18392, 0.000755, " improving", false]]]}, "raw_delta": -0.00435798242688179, "tuned_delta": 0.004213809603696458}, {"byte_start": 1005, "byte_end": 1011, "display": {"text": " other", "kind": "normal"}, "is_word": true, "word_id": 171, "word_key": " other", "bytes_hex": "20 6f 74 68 65 72", "compression": {"rwkv": "0.01% 0.01% 0.01% 0.01% 0.01% 0.01%", "qwen": "0.02% 0.02% 0.02% 0.02% 0.02% 0.02%"}, "model_tokens": {"rwkv": [[39193, " other", "normal", 0.9952180981636047]], "qwen": [[1008, " other", "normal", 0.994239330291748]]}, "loss": {"rwkv": 0.014400680632245842, "qwen": 0.017364419809424003}, "topk": {"rwkv": [39193, 1, 0.9952180981636047, [[39193, 0.995218, " other", false], [31515, 0.000768, " next", false], [46726, 0.000403, " others", false], [46405, 0.000402, " latter", false], [45301, 0.000374, " better", false], [31458, 0.000253, " more", false], [47205, 0.000222, " second", false], [45961, 0.000105, " faster", false], [31323, 0.000104, " long", false], [56767, 7.7e-05, " opposite", false]]], "qwen": [1008, 1, 0.994239330291748, [[1008, 0.994239, " other", false], [2086, 0.000546, " second", false], [2664, 0.000468, " better", false], [1790, 0.000465, " next", false], [15271, 0.000428, " latter", false], [3800, 0.000427, " others", false], [803, 0.000415, " more", false], [825, 0.000179, " one", false], [279, 0.00012, " the", false], [10555, 8e-05, " alternative", false]]]}, "raw_delta": -0.00016434459636608756, "tuned_delta": 0.008407447434212161}, {"byte_start": 1011, "byte_end": 1012, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "8.49%", "qwen": "22.39%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.6266527771949768]], "qwen": [[13, ".", "normal", 0.28900769352912903]]}, "loss": {"rwkv": 8.488513302105472, "qwen": 22.38525108738749}, "topk": {"rwkv": [47, 1, 0.6266527771949768, [[47, 0.626653, ".", false], [45, 0.302841, ",", false], [60, 0.016374, ";", false], [21265, 0.015433, " and", false], [275, 0.01133, " (", false], [59, 0.002982, ":", false], [34, 0.001864, "!", false], [9816, 0.001804, "—", false], [4596, 0.001661, " in", false], [280, 0.001412, " -", false]]], "qwen": [13, 2, 0.28900769352912903, [[624, 0.336423, ".\n", false], [13, 0.289008, ".", false], [11, 0.257568, ",", false], [26, 0.023685, ";", false], [323, 0.020717, " and", false], [382, 0.016234, ".\n\n", false], [320, 0.014207, " (", false], [25, 0.006255, ":", false], [481, 0.002701, " -", false], [1959, 0.002082, " —", false]]]}, "raw_delta": -0.7705987691879272, "tuned_delta": -0.762026977157349}, {"byte_start": 1012, "byte_end": 1018, "display": {"text": " There", "kind": "normal"}, "is_word": true, "word_id": 172, "word_key": " there", "bytes_hex": "20 54 68 65 72 65", "compression": {"rwkv": "13.99% 13.99% 13.99% 13.99% 13.99% 13.99%", "qwen": "11.67% 11.67% 11.67% 11.67% 11.67% 11.67%"}, "model_tokens": {"rwkv": [[37451, " There", "normal", 0.00949584599584341]], "qwen": [[2619, " There", "normal", 0.020563559606671333]]}, "loss": {"rwkv": 13.994893300290073, "qwen": 11.674512690575982}, "topk": {"rwkv": [37451, 14, 0.00949584599584341, [[11, 0.367848, "\n", false], [261, 0.106152, "\n\n", false], [20996, 0.067001, " The", false], [29894, 0.032806, " This", false], [3913, 0.025539, " In", false], [19555, 0.021221, " But", false], [3918, 0.017725, " It", false], [19417, 0.016521, " And", false], [3908, 0.015247, " If", false], [4217, 0.011594, " So", false]]], "qwen": [2619, 11, 0.020563559606671333, [[576, 0.113834, " The", false], [1096, 0.077977, " This", false], [758, 0.055176, " In", false], [1084, 0.037365, " It", false], [151643, 0.031481, "\u003c|endoftext|\u003e", false], [1597, 0.026793, " And", false], [1752, 0.025339, " For", false], [362, 0.02348, " A", false], [1634, 0.023457, " As", false], [1416, 0.020591, " If", false]]]}, "raw_delta": 0.12866922219594312, "tuned_delta": 0.13724101422652138}, {"byte_start": 1018, "byte_end": 1022, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 173, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"rwkv": "6.06% 6.06% 6.06% 6.06%", "qwen": "4.50% 4.50% 4.50% 4.50%"}, "model_tokens": {"rwkv": [[21286, " are", "normal", 0.26257655024528503]], "qwen": [[525, " are", "normal", 0.36894965171813965]]}, "loss": {"rwkv": 6.058192066232952, "qwen": 4.495325255191915}, "topk": {"rwkv": [21286, 2, 0.26257655024528503, [[4600, 0.48708, " is", false], [21286, 0.262577, " are", false], [460, 0.125651, "'s", false], [32475, 0.018146, " will", false], [21800, 0.01806, " has", false], [31059, 0.016646, " have", false], [22074, 0.010557, " may", false], [22748, 0.006616, " was", false], [21413, 0.005096, " can", false], [21896, 0.003484, " isn", false]]], "qwen": [525, 2, 0.36894965171813965, [[374, 0.456053, " is", false], [525, 0.36895, " are", false], [594, 0.058748, "'s", false], [614, 0.019578, " have", false], [702, 0.015429, " has", false], [686, 0.010607, " will", false], [572, 0.008044, " was", false], [1231, 0.007163, " may", false], [646, 0.00578, " can", false], [258, 0.003887, "in", false]]]}, "raw_delta": 0.08666373789310455, "tuned_delta": 0.0952355299236828}, {"byte_start": 1022, "byte_end": 1036, "display": {"text": " psychological", "kind": "normal"}, "is_word": true, "word_id": 174, "word_key": " psychological", "bytes_hex": "20 70 73 79 63 68 6f 6c 6f 67 69 63 61 6c", "compression": {"rwkv": "13.93% 13.93% 13.93% 13.93% 13.93% 13.93% 13.93% 13.93% 13.93% 13.93% 13.93% 13.93% 13.93% 13.93%", "qwen": "13.97% 13.97% 13.97% 13.97% 13.97% 13.97% 13.97% 13.97% 13.97% 13.97% 13.97% 13.97% 13.97% 13.97%"}, "model_tokens": {"rwkv": [[64997, " psychological", "normal", 2.0256720745237544e-05]], "qwen": [[23187, " psychological", "normal", 1.9427410734351724e-05]]}, "loss": {"rwkv": 13.927803687153498, "qwen": 13.97459525266324}, "topk": {"rwkv": [64997, 1190, 2.0256720745237544e-05, [[31370, 0.112075, " many", false], [332, 0.061086, " a", false], [22638, 0.058616, " two", false], [32074, 0.057009, " some", false], [61963, 0.039627, " exceptions", false], [45, 0.028475, ",", false], [4692, 0.024944, " no", false], [32448, 0.023521, " ways", false], [39193, 0.022537, " other", false], [46844, 0.021992, " plenty", false]]], "qwen": [23187, 1076, 1.9427410734351724e-05, [[1657, 0.127512, " many", false], [1378, 0.086523, " two", false], [264, 0.079205, " a", false], [1045, 0.068575, " some", false], [19585, 0.064439, " exceptions", false], [11, 0.03917, ",", false], [5510, 0.029527, " ways", false], [1083, 0.024977, " also", false], [1008, 0.022655, " other", false], [902, 0.021747, " no", false]]]}, "raw_delta": -0.002594675336565211, "tuned_delta": 0.005977116694013037}, {"byte_start": 1036, "byte_end": 1048, "display": {"text": " commitments", "kind": "normal"}, "is_word": true, "word_id": 175, "word_key": " commitments", "bytes_hex": "20 63 6f 6d 6d 69 74 6d 65 6e 74 73", "compression": {"rwkv": "11.60% 11.60% 11.60% 11.60% 11.60% 11.60% 11.60% 11.60% 11.60% 11.60% 11.60% 11.60%", "qwen": "14.92% 14.92% 14.92% 14.92% 14.92% 14.92% 14.92% 14.92% 14.92% 14.92% 14.92% 14.92%"}, "model_tokens": {"rwkv": [[63351, " commitments", "normal", 0.0004456617753021419]], "qwen": [[41256, " commitments", "normal", 4.8848836740944535e-05]]}, "loss": {"rwkv": 11.599794111314257, "qwen": 14.918037409382585}, "topk": {"rwkv": [63351, 78, 0.0004456617753021419, [[52654, 0.273222, " reasons", false], [21265, 0.212049, " and", false], [55600, 0.049575, " barriers", false], [45304, 0.042014, " biases", false], [45, 0.039875, ",", false], [51703, 0.034032, " factors", false], [2030, 0.031716, "ly", false], [64392, 0.01762, " explanations", false], [38124, 0.01718, " costs", false], [62202, 0.015761, " mechanisms", false]]], "qwen": [41256, 380, 4.8848836740944535e-05, [[7966, 0.364535, " reasons", false], [323, 0.129478, " and", false], [29640, 0.075673, " barriers", false], [9363, 0.072835, " factors", false], [40841, 0.033968, " explanations", false], [11, 0.032794, ",", false], [49083, 0.028542, " biases", false], [13566, 0.018777, " aspects", false], [6239, 0.015736, " effects", false], [13388, 0.012311, " limits", false]]]}, "raw_delta": -0.18400247891743984, "tuned_delta": -0.1754306868868616}, {"byte_start": 1048, "byte_end": 1051, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 176, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "7.37% 7.37% 7.37%", "qwen": "5.65% 5.65% 5.65%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.2906183898448944]], "qwen": [[311, " to", "normal", 0.3906971216201782]]}, "loss": {"rwkv": 7.373148483709871, "qwen": 5.649489270047869}, "topk": {"rwkv": [4811, 2, 0.2906183898448944, [[32227, 0.315365, " that", false], [4811, 0.290618, " to", false], [21265, 0.070367, " and", false], [45, 0.052378, ",", false], [56500, 0.037443, " involved", false], [4596, 0.021359, " in", false], [4712, 0.016909, " on", false], [4424, 0.012488, " at", false], [4423, 0.012136, " as", false], [47, 0.009632, ".", false]]], "qwen": [311, 1, 0.3906971216201782, [[311, 0.390697, " to", false], [429, 0.278774, " that", false], [323, 0.05839, " and", false], [11, 0.050985, ",", false], [304, 0.031427, " in", false], [320, 0.016949, " (", false], [518, 0.014043, " at", false], [389, 0.013031, " on", false], [1865, 0.012849, " made", false], [6398, 0.010115, " involved", false]]]}, "raw_delta": 0.09557996193567914, "tuned_delta": 0.10415175396625738}, {"byte_start": 1051, "byte_end": 1062, "display": {"text": " investment", "kind": "normal"}, "is_word": true, "word_id": 177, "word_key": " investment", "bytes_hex": "20 69 6e 76 65 73 74 6d 65 6e 74", "compression": {"rwkv": "13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12%", "qwen": "15.02% 15.02% 15.02% 15.02% 15.02% 15.02% 15.02% 15.02% 15.02% 15.02% 15.02%"}, "model_tokens": {"rwkv": [[62157, " investment", "normal", 0.00032562969136051834]], "qwen": [[9162, " investment", "normal", 0.00010466409003129229]]}, "loss": {"rwkv": 13.11540946262694, "qwen": 15.024939089071282}, "topk": {"rwkv": [62157, 229, 0.00032562969136051834, [[22590, 0.115616, " the", false], [30322, 0.093345, " both", false], [22226, 0.069928, " one", false], [30719, 0.051907, " each", false], [38720, 0.042149, " human", false], [332, 0.029714, " a", false], [39936, 0.028816, " these", false], [45833, 0.020094, " either", false], [38279, 0.019657, " doing", false], [51161, 0.018073, " certain", false]]], "qwen": [9162, 575, 0.00010466409003129229, [[279, 0.175419, " the", false], [3738, 0.05676, " human", false], [825, 0.047213, " one", false], [264, 0.036088, " a", false], [3953, 0.027353, " particular", false], [2176, 0.026776, " both", false], [387, 0.023164, " be", false], [32064, 0.020483, " leverage", false], [3654, 0.019666, " certain", false], [2987, 0.01964, " either", false]]]}, "raw_delta": -0.10588680614124645, "tuned_delta": -0.0973150141106682}, {"byte_start": 1062, "byte_end": 1065, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 178, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "3.87% 3.87% 3.87%", "qwen": "3.51% 3.51% 3.51%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.5252020359039307]], "qwen": [[304, " in", "normal", 0.5578750967979431]]}, "loss": {"rwkv": 3.8744251586373526, "qwen": 3.508274453247622}, "topk": {"rwkv": [4596, 1, 0.5252020359039307, [[4596, 0.525202, " in", false], [32227, 0.062513, " that", false], [4706, 0.055642, " of", false], [45, 0.041935, ",", false], [21265, 0.037269, " and", false], [56832, 0.03132, " patterns", false], [62581, 0.017144, " strategies", false], [47, 0.013758, ".", false], [59451, 0.013242, " decisions", false], [4712, 0.012996, " on", false]]], "qwen": [304, 1, 0.5578750967979431, [[304, 0.557875, " in", false], [429, 0.184454, " that", false], [11, 0.043663, ",", false], [315, 0.028122, " of", false], [323, 0.020908, " and", false], [14830, 0.016038, " strategies", false], [320, 0.009569, " (", false], [389, 0.007911, " on", false], [1865, 0.007348, " made", false], [311, 0.004942, " to", false]]]}, "raw_delta": 0.020303706328074128, "tuned_delta": 0.028875498358652378}, {"byte_start": 1065, "byte_end": 1069, "display": {"text": " one", "kind": "normal"}, "is_word": true, "word_id": 179, "word_key": " one", "bytes_hex": "20 6f 6e 65", "compression": {"rwkv": "6.87% 6.87% 6.87% 6.87%", "qwen": "6.33% 6.33% 6.33% 6.33%"}, "model_tokens": {"rwkv": [[22226, " one", "normal", 0.2196863889694214]], "qwen": [[825, " one", "normal", 0.24557806551456451]]}, "loss": {"rwkv": 6.868299144857125, "qwen": 6.330457263368079}, "topk": {"rwkv": [22226, 1, 0.2196863889694214, [[22226, 0.219686, " one", false], [22590, 0.153073, " the", false], [38720, 0.078761, " human", false], [45833, 0.047795, " either", false], [332, 0.044905, " a", false], [30719, 0.03915, " each", false], [57103, 0.029351, " research", false], [30322, 0.026071, " both", false], [62293, 0.020847, " particular", false], [51161, 0.020613, " certain", false]]], "qwen": [825, 1, 0.24557806551456451, [[825, 0.245578, " one", false], [3738, 0.138559, " human", false], [279, 0.09495, " the", false], [2987, 0.048882, " either", false], [264, 0.036417, " a", false], [1817, 0.034237, " each", false], [3953, 0.033059, " particular", false], [6540, 0.031027, " knowledge", false], [2176, 0.030117, " both", false], [7947, 0.019244, " domain", false]]]}, "raw_delta": 0.029824286699295044, "tuned_delta": 0.038396078729873294}, {"byte_start": 1069, "byte_end": 1078, "display": {"text": " approach", "kind": "normal"}, "is_word": true, "word_id": 180, "word_key": " approach", "bytes_hex": "20 61 70 70 72 6f 61 63 68", "compression": {"rwkv": "11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83%", "qwen": "9.74% 9.74% 9.74% 9.74% 9.74% 9.74% 9.74% 9.74% 9.74%"}, "model_tokens": {"rwkv": [[55532, " approach", "normal", 0.002671432215720415]], "qwen": [[5486, " approach", "normal", 0.007759560830891132]]}, "loss": {"rwkv": 11.834607757292277, "qwen": 9.735846141263135}, "topk": {"rwkv": [55532, 27, 0.002671432215720415, [[4715, 0.464741, " or", false], [31601, 0.084309, " over", false], [47717, 0.07464, " versus", false], [32227, 0.053685, " that", false], [30173, 0.036155, " area", false], [45775, 0.035111, " domain", false], [47001, 0.033718, " rather", false], [45, 0.020318, ",", false], [4851, 0.017065, " vs", false], [21265, 0.016709, " and", false]]], "qwen": [5486, 12, 0.007759560830891132, [[476, 0.472018, " or", false], [429, 0.140561, " that", false], [3082, 0.041787, " area", false], [11, 0.038737, ",", false], [916, 0.038003, " over", false], [315, 0.026333, " of", false], [518, 0.022409, " at", false], [323, 0.021068, " and", false], [4751, 0.020208, " rather", false], [7947, 0.008771, " domain", false]]]}, "raw_delta": 0.11638005574544276, "tuned_delta": 0.124951847776021}, {"byte_start": 1078, "byte_end": 1081, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 181, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"rwkv": "5.00% 5.00% 5.00%", "qwen": "6.65% 6.65% 6.65%"}, "model_tokens": {"rwkv": [[4715, " or", "normal", 0.4309472441673279]], "qwen": [[476, " or", "normal", 0.3309338688850403]]}, "loss": {"rwkv": 5.001530659331855, "qwen": 6.647437591430349}, "topk": {"rwkv": [4715, 1, 0.4309472441673279, [[4715, 0.430947, " or", false], [31601, 0.249141, " over", false], [47001, 0.05921, " rather", false], [32227, 0.057201, " that", false], [47717, 0.044691, " versus", false], [45, 0.0351, ",", false], [21265, 0.015548, " and", false], [4424, 0.01188, " at", false], [4811, 0.009707, " to", false], [47, 0.009567, ".", false]]], "qwen": [476, 1, 0.3309338688850403, [[476, 0.330934, " or", false], [429, 0.311298, " that", false], [916, 0.093059, " over", false], [11, 0.073283, ",", false], [4751, 0.024069, " rather", false], [518, 0.022481, " at", false], [323, 0.018029, " and", false], [320, 0.017136, " (", false], [19041, 0.01512, " versus", false], [892, 0.009402, " which", false]]]}, "raw_delta": -0.09126845995585126, "tuned_delta": -0.08269666792527301}, {"byte_start": 1081, "byte_end": 1085, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 182, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "2.62% 2.62% 2.62% 2.62%", "qwen": "2.20% 2.20% 2.20% 2.20%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.5624184012413025]], "qwen": [[279, " the", "normal", 0.6140246987342834]]}, "loss": {"rwkv": 2.6240424938043887, "qwen": 2.198848039377469}, "topk": {"rwkv": [22590, 1, 0.5624184012413025, [[22590, 0.562418, " the", false], [50919, 0.413225, " another", false], [39193, 0.006013, " other", false], [46561, 0.001506, " method", false], [332, 0.001272, " a", false], [4811, 0.00108, " to", false], [4596, 0.001017, " in", false], [57317, 0.00086, " strategy", false], [45775, 0.000419, " domain", false], [60624, 0.000386, " technique", false]]], "qwen": [279, 1, 0.6140246987342834, [[279, 0.614025, " the", false], [2441, 0.35995, " another", false], [311, 0.006021, " to", false], [1008, 0.004131, " other", false], [304, 0.001888, " in", false], [1496, 0.00076, " even", false], [1714, 0.000687, " method", false], [14762, 0.000628, " technique", false], [264, 0.000546, " a", false], [8282, 0.000436, " strategy", false]]]}, "raw_delta": 0.02357778698205948, "tuned_delta": 0.03214957901263773}, {"byte_start": 1085, "byte_end": 1091, "display": {"text": " other", "kind": "normal"}, "is_word": true, "word_id": 183, "word_key": " other", "bytes_hex": "20 6f 74 68 65 72", "compression": {"rwkv": "0.00% 0.00% 0.00% 0.00% 0.00% 0.00%", "qwen": "0.01% 0.01% 0.01% 0.01% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[39193, " other", "normal", 0.9987265467643738]], "qwen": [[1008, " other", "normal", 0.9981380701065063]]}, "loss": {"rwkv": 0.003852411379326913, "qwen": 0.0056014114668144314}, "topk": {"rwkv": [39193, 1, 0.9987265467643738, [[39193, 0.998727, " other", false], [31515, 0.000458, " next", false], [50919, 0.000175, " another", false], [46726, 9.4e-05, " others", false], [11, 2.4e-05, "\n", false], [22590, 2.2e-05, " the", false], [22226, 1.1e-05, " one", false], [63277, 1e-05, " alternative", false], [31601, 8e-06, " over", false], [46561, 8e-06, " method", false]]], "qwen": [1008, 1, 0.9981380701065063, [[1008, 0.998138, " other", false], [1790, 0.000309, " next", false], [2441, 0.000148, " another", false], [3800, 0.000101, " others", false], [198, 9.3e-05, "\n", false], [297, 3.4e-05, " o", false], [2086, 3.2e-05, " second", false], [320, 1.9e-05, " (", false], [279, 1.6e-05, " the", false], [1575, 1.5e-05, "other", false]]]}, "raw_delta": -9.69851583552857e-05, "tuned_delta": 0.008474806872222962}, {"byte_start": 1091, "byte_end": 1092, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "24.51%", "qwen": "55.87%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.2571321725845337]], "qwen": [[13, ".", "normal", 0.04514032602310181]]}, "loss": {"rwkv": 24.51454464010543, "qwen": 55.86799229046926}, "topk": {"rwkv": [47, 2, 0.2571321725845337, [[45, 0.430291, ",", false], [47, 0.257132, ".", false], [32227, 0.161271, " that", false], [275, 0.019846, " (", false], [60, 0.017894, ";", false], [21265, 0.017701, " and", false], [59, 0.010773, ":", false], [40186, 0.00887, " which", false], [4423, 0.007191, " as", false], [21400, 0.006463, " but", false]]], "qwen": [13, 3, 0.04514032602310181, [[429, 0.454984, " that", false], [11, 0.318301, ",", false], [13, 0.04514, ".", false], [320, 0.032908, " (", false], [892, 0.01886, " which", false], [323, 0.018353, " and", false], [624, 0.01653, ".\n", false], [26, 0.014231, ";", false], [714, 0.009631, " but", false], [518, 0.005769, " at", false]]]}, "raw_delta": -1.7386043071746826, "tuned_delta": -1.7300325151441043}, {"byte_start": 1092, "byte_end": 1096, "display": {"text": " And", "kind": "normal"}, "is_word": true, "word_id": 184, "word_key": " and", "bytes_hex": "20 41 6e 64", "compression": {"rwkv": "15.15% 15.15% 15.15% 15.15%", "qwen": "15.35% 15.35% 15.35% 15.35%"}, "model_tokens": {"rwkv": [[19417, " And", "normal", 0.034856654703617096]], "qwen": [[1597, " And", "normal", 0.0332515574991703]]}, "loss": {"rwkv": 15.145480165582377, "qwen": 15.345106877788247}, "topk": {"rwkv": [19417, 6, 0.034856654703617096, [[11, 0.171391, "\n", false], [19555, 0.079497, " But", false], [20996, 0.078147, " The", false], [37451, 0.064133, " There", false], [261, 0.045926, "\n\n", false], [19417, 0.034857, " And", false], [3918, 0.027092, " It", false], [3913, 0.02621, " In", false], [29894, 0.02114, " This", false], [19907, 0.015376, " For", false]]], "qwen": [1597, 7, 0.0332515574991703, [[576, 0.096157, " The", false], [2619, 0.086248, " There", false], [758, 0.045308, " In", false], [1084, 0.041811, " It", false], [1988, 0.041437, " But", false], [1096, 0.038606, " This", false], [1597, 0.033252, " And", false], [1752, 0.025937, " For", false], [1205, 0.019243, " We", false], [362, 0.018521, " A", false]]]}, "raw_delta": -0.011069655418395996, "tuned_delta": -0.002497863387817748}, {"byte_start": 1096, "byte_end": 1100, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 185, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "11.55% 11.55% 11.55% 11.55%", "qwen": "10.92% 10.92% 10.92% 10.92%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.07773029059171677]], "qwen": [[279, " the", "normal", 0.08881886303424835]]}, "loss": {"rwkv": 11.55283138211865, "qwen": 10.915593739900798}, "topk": {"rwkv": [22590, 3, 0.07773029059171677, [[39934, 0.164008, " there", false], [45, 0.102711, ",", false], [22590, 0.07773, " the", false], [4788, 0.056664, " so", false], [4601, 0.033388, " it", false], [4596, 0.031255, " in", false], [22797, 0.028624, " yet", false], [4706, 0.025536, " of", false], [30788, 0.017429, " even", false], [32230, 0.016482, " then", false]]], "qwen": [279, 3, 0.08881886303424835, [[1052, 0.102656, " there", false], [11, 0.094348, ",", false], [279, 0.088819, " the", false], [304, 0.047588, " in", false], [432, 0.04032, " it", false], [773, 0.035085, " so", false], [419, 0.03046, " this", false], [1496, 0.024501, " even", false], [421, 0.024116, " if", false], [438, 0.023613, " as", false]]]}, "raw_delta": 0.0353359580039978, "tuned_delta": 0.04390775003457605}, {"byte_start": 1100, "byte_end": 1106, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 186, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "13.99% 13.99% 13.99% 13.99% 13.99% 13.99%", "qwen": "14.69% 14.69% 14.69% 14.69% 14.69% 14.69%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.009649490937590599]], "qwen": [[3738, " human", "normal", 0.007529765367507935]]}, "loss": {"rwkv": 13.994893300290073, "qwen": 14.694123163902994}, "topk": {"rwkv": [38720, 12, 0.009649490937590599, [[64997, 0.014975, " psychological", false], [22638, 0.013903, " two", false], [46470, 0.013478, " longer", false], [30808, 0.013178, " fact", false], [30510, 0.012707, " cost", false], [52738, 0.011157, " results", false], [32251, 0.010943, " time", false], [62157, 0.010694, " investment", false], [31461, 0.010628, " most", false], [31458, 0.010564, " more", false]]], "qwen": [3738, 22, 0.007529765367507935, [[803, 0.027121, " more", false], [1378, 0.022444, " two", false], [5021, 0.021849, " longer", false], [1850, 0.016703, " best", false], [2783, 0.014548, " cost", false], [1172, 0.01435, " only", false], [3412, 0.014166, " research", false], [2097, 0.013188, " fact", false], [7049, 0.011543, " costs", false], [1102, 0.011421, " result", false]]]}, "raw_delta": -0.038773536682128906, "tuned_delta": -0.030201744651550656}, {"byte_start": 1106, "byte_end": 1116, "display": {"text": "-knowledge", "kind": "normal"}, "is_word": true, "word_id": 187, "word_key": "-knowledge", "bytes_hex": "2d 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "68.19% 2.76% 2.76% 2.76% 2.76% 2.76% 2.76% 2.76% 2.76% 2.76%", "qwen": "70.27% 70.27% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.022694796323776245], [58313, "knowledge", "normal", 0.2548525035381317]], "qwen": [[12646, "-k", "normal", 0.0004126753774471581], [51186, "nowledge", "normal", 0.9992349147796631]]}, "loss": {"rwkv": 9.298620380729645, "qwen": 14.05476201086571}, "topk": {"rwkv": [46, 5, 0.022694796323776245, [[59943, 0.190607, " knowledge", false], [31427, 0.065097, " mind", false], [37898, 0.055387, " brain", false], [45775, 0.029708, " domain", false], [46, 0.022695, "-", false], [57404, 0.021891, " tendency", false], [34889, 0.018041, "ities", false], [32011, 0.017197, " side", false], [31506, 0.015147, " need", false], [59324, 0.01321, " community", false]]], "qwen": [12646, 214, 0.0004126753774471581, [[6540, 0.142265, " knowledge", false], [8109, 0.11091, " brain", false], [3971, 0.089827, " mind", false], [8168, 0.021975, " factor", false], [2783, 0.01864, " cost", false], [49083, 0.017235, " biases", false], [30854, 0.015653, " tendency", false], [24675, 0.014819, " cognitive", false], [5726, 0.014369, " ability", false], [15470, 0.012073, " bias", false]]]}, "raw_delta": -0.26373649290180773, "tuned_delta": -0.2551647008712295}, {"byte_start": 1116, "byte_end": 1125, "display": {"text": " approach", "kind": "normal"}, "is_word": true, "word_id": 188, "word_key": " approach", "bytes_hex": "20 61 70 70 72 6f 61 63 68", "compression": {"rwkv": "2.04% 2.04% 2.04% 2.04% 2.04% 2.04% 2.04% 2.04% 2.04%", "qwen": "2.10% 2.10% 2.10% 2.10% 2.10% 2.10% 2.10% 2.10% 2.10%"}, "model_tokens": {"rwkv": [[55532, " approach", "normal", 0.3655596077442169]], "qwen": [[5486, " approach", "normal", 0.34987860918045044]]}, "loss": {"rwkv": 2.035051598476185, "qwen": 2.1042688826934364}, "topk": {"rwkv": [55532, 1, 0.3655596077442169, [[55532, 0.36556, " approach", false], [46, 0.203702, "-", false], [61590, 0.039443, " approaches", false], [38888, 0.037742, " lever", false], [52224, 0.019657, " methods", false], [56540, 0.018951, " leverage", false], [37810, 0.018358, " based", false], [62157, 0.013646, " investment", false], [46561, 0.013374, " method", false], [39552, 0.012595, " route", false]]], "qwen": [5486, 1, 0.34987860918045044, [[5486, 0.349879, " approach", false], [5980, 0.078859, "-based", false], [27505, 0.03808, " lever", false], [31405, 0.022445, "-driven", false], [3108, 0.021996, " side", false], [19827, 0.021535, " approaches", false], [3692, 0.017431, " component", false], [949, 0.016315, " part", false], [32064, 0.016224, " leverage", false], [3419, 0.011277, "-in", false]]]}, "raw_delta": -0.003838221232096359, "tuned_delta": 0.004733570798481889}, {"byte_start": 1125, "byte_end": 1131, "display": {"text": " tends", "kind": "normal"}, "is_word": true, "word_id": 189, "word_key": " tends", "bytes_hex": "20 74 65 6e 64 73", "compression": {"rwkv": "9.53% 9.53% 9.53% 9.53% 9.53% 9.53%", "qwen": "8.36% 8.36% 8.36% 8.36% 8.36% 8.36%"}, "model_tokens": {"rwkv": [[39914, " tends", "normal", 0.042093440890312195]], "qwen": [[27236, " tends", "normal", 0.061878807842731476]]}, "loss": {"rwkv": 9.533434026707669, "qwen": 8.363355794317577}, "topk": {"rwkv": [39914, 4, 0.042093440890312195, [[4600, 0.343703, " is", false], [21800, 0.115277, " has", false], [21413, 0.069634, " can", false], [39914, 0.042093, " tends", false], [45, 0.039557, ",", false], [4811, 0.023464, " to", false], [39620, 0.022001, " seems", false], [32475, 0.020162, " will", false], [30659, 0.019683, " does", false], [57102, 0.018662, " requires", false]]], "qwen": [27236, 3, 0.061878807842731476, [[374, 0.292251, " is", false], [702, 0.086251, " has", false], [27236, 0.061879, " tends", false], [646, 0.058099, " can", false], [11, 0.045678, ",", false], [3545, 0.032364, " often", false], [7460, 0.022891, " requires", false], [686, 0.020688, " will", false], [311, 0.019517, " to", false], [1231, 0.018998, " may", false]]]}, "raw_delta": 0.06488291422526044, "tuned_delta": 0.07345470625583868}, {"byte_start": 1131, "byte_end": 1134, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 190, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.16% 0.16% 0.16%", "qwen": "0.15% 0.15% 0.15%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.9735610485076904]], "qwen": [[311, " to", "normal", 0.9761614203453064]]}, "loss": {"rwkv": 0.15996679632252706, "qwen": 0.1450348505328503}, "topk": {"rwkv": [4811, 1, 0.9735610485076904, [[4811, 0.973561, " to", false], [22187, 0.006555, " not", false], [47585, 0.004646, " toward", false], [53169, 0.002838, " towards", false], [45, 0.002173, ",", false], [31458, 0.001475, " more", false], [4435, 0.000919, " be", false], [4596, 0.000662, " in", false], [30135, 0.000516, " also", false], [60048, 0.00042, " naturally", false]]], "qwen": [311, 1, 0.9761614203453064, [[311, 0.976161, " to", false], [537, 0.007941, " not", false], [11, 0.002714, ",", false], [8841, 0.001297, " toward", false], [6974, 0.001067, " towards", false], [387, 0.00085, " be", false], [803, 0.000807, " more", false], [1083, 0.00072, " also", false], [320, 0.000687, " (", false], [304, 0.000529, " in", false]]]}, "raw_delta": 0.0008280028899510707, "tuned_delta": 0.009399794920529319}, {"byte_start": 1134, "byte_end": 1145, "display": {"text": " complicate", "kind": "normal"}, "is_word": true, "word_id": 191, "word_key": " complicate", "bytes_hex": "20 63 6f 6d 70 6c 69 63 61 74 65", "compression": {"rwkv": "22.54% 22.54% 22.54% 22.54% 22.54% 22.54% 22.54% 22.54% 0.00% 0.00% 0.00%", "qwen": "35.72% 35.72% 35.72% 35.72% 35.72% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[51259, " complic", "normal", 4.4977648940403014e-05], [7066, "ate", "normal", 0.9994739890098572]], "qwen": [[1367, " comp", "normal", 4.99966845382005e-05], [48795, "licate", "normal", 0.999305009841919]]}, "loss": {"rwkv": 16.395118614580696, "qwen": 16.23728544000862}, "topk": {"rwkv": [51259, 732, 4.4977648940403014e-05, [[4435, 0.382936, " be", false], [31059, 0.050838, " have", false], [32499, 0.037088, " work", false], [56041, 0.026311, " dominate", false], [52724, 0.025118, " require", false], [32187, 0.022907, " take", false], [21751, 0.019408, " get", false], [31358, 0.018071, " make", false], [52573, 0.01676, " produce", false], [40239, 0.015551, " yield", false]]], "qwen": [1367, 775, 4.99966845382005e-05, [[387, 0.36151, " be", false], [614, 0.042109, " have", false], [1373, 0.036102, " require", false], [975, 0.030456, " work", false], [633, 0.021392, " get", false], [3690, 0.017015, " fail", false], [1896, 0.015833, " take", false], [1281, 0.013949, " make", false], [5244, 0.013403, " focus", false], [7676, 0.013377, " suffer", false]]]}, "raw_delta": 0.008752129596277056, "tuned_delta": 0.017323921626855303}, {"byte_start": 1145, "byte_end": 1153, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 192, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "13.24% 13.24% 13.24% 13.24% 13.24% 13.24% 13.24% 13.24%", "qwen": "18.08% 18.08% 18.08% 18.08% 18.08% 18.08% 18.08% 18.08%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.00280464137904346]], "qwen": [[5413, " methods", "normal", 0.00032932707108557224]]}, "loss": {"rwkv": 13.243489633160404, "qwen": 18.075299213488297}, "topk": {"rwkv": [52224, 21, 0.00280464137904346, [[22590, 0.358809, " the", false], [47539, 0.191182, " things", false], [52201, 0.127774, " matters", false], [21265, 0.043588, " and", false], [332, 0.018348, " a", false], [3609, 0.013723, " AI", false], [57103, 0.013021, " research", false], [47001, 0.012551, " rather", false], [45, 0.008806, ",", false], [65137, 0.008605, " implementation", false]]], "qwen": [5413, 156, 0.00032932707108557224, [[279, 0.495973, " the", false], [2513, 0.067816, " things", false], [323, 0.064714, " and", false], [12850, 0.032657, " matters", false], [4751, 0.024639, " rather", false], [11, 0.02087, ",", false], [3412, 0.010926, " research", false], [8129, 0.009122, " implementation", false], [264, 0.008041, " a", false], [4401, 0.005654, " development", false]]]}, "raw_delta": -0.2679324150085449, "tuned_delta": -0.2593606229779667}, {"byte_start": 1153, "byte_end": 1156, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 193, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "18.41% 18.41% 18.41%", "qwen": "22.10% 22.10% 22.10%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.046689558774232864]], "qwen": [[304, " in", "normal", 0.025293856859207153]]}, "loss": {"rwkv": 18.409389844676873, "qwen": 22.104454296729404}, "topk": {"rwkv": [4596, 5, 0.046689558774232864, [[45, 0.203399, ",", false], [32227, 0.192105, " that", false], [21265, 0.114402, " and", false], [47, 0.057281, ".", false], [4596, 0.04669, " in", false], [4811, 0.029125, " to", false], [21700, 0.025323, " for", false], [4788, 0.019003, " so", false], [31458, 0.018146, " more", false], [4450, 0.016926, " by", false]]], "qwen": [304, 6, 0.025293856859207153, [[429, 0.390262, " that", false], [11, 0.095794, ",", false], [323, 0.070518, " and", false], [369, 0.041975, " for", false], [4751, 0.027086, " rather", false], [304, 0.025294, " in", false], [315, 0.022812, " of", false], [553, 0.022671, " by", false], [13, 0.020143, ".", false], [1576, 0.016294, " because", false]]]}, "raw_delta": -0.20489788055419922, "tuned_delta": -0.19632608852362096}, {"byte_start": 1156, "byte_end": 1161, "display": {"text": " ways", "kind": "normal"}, "is_word": true, "word_id": 194, "word_key": " ways", "bytes_hex": "20 77 61 79 73", "compression": {"rwkv": "2.16% 2.16% 2.16% 2.16% 2.16%", "qwen": "6.36% 6.36% 6.36% 6.36% 6.36%"}, "model_tokens": {"rwkv": [[32448, " ways", "normal", 0.55156010389328]], "qwen": [[5510, " ways", "normal", 0.17169059813022614]]}, "loss": {"rwkv": 2.155589270078236, "qwen": 6.355292525555081}, "topk": {"rwkv": [32448, 1, 0.55156010389328, [[32448, 0.55156, " ways", false], [332, 0.177929, " a", false], [22590, 0.036819, " the", false], [32139, 0.034377, " such", false], [4419, 0.010719, " an", false], [63667, 0.008524, " interesting", false], [22184, 0.00629, " non", false], [39189, 0.006261, " order", false], [47451, 0.005871, " subtle", false], [22659, 0.004923, " unf", false]]], "qwen": [5510, 2, 0.17169059813022614, [[279, 0.208881, " the", false], [5510, 0.171691, " ways", false], [264, 0.13501, " a", false], [1008, 0.060408, " other", false], [4586, 0.037049, " general", false], [1741, 0.024941, " such", false], [1657, 0.021943, " many", false], [1045, 0.018936, " some", false], [1973, 0.018058, " order", false], [458, 0.016294, " an", false]]]}, "raw_delta": -0.23288099765777587, "tuned_delta": -0.2243092056271976}, {"byte_start": 1161, "byte_end": 1166, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 195, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "0.17% 0.17% 0.17% 0.17% 0.17%", "qwen": "0.27% 0.27% 0.27% 0.27% 0.27%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.9540926814079285]], "qwen": [[429, " that", "normal", 0.9284818768501282]]}, "loss": {"rwkv": 0.16906582510417537, "qwen": 0.2676359078751071}, "topk": {"rwkv": [32227, 1, 0.9540926814079285, [[32227, 0.954093, " that", false], [40186, 0.007496, " which", false], [22590, 0.006251, " the", false], [22187, 0.003973, " not", false], [40185, 0.00326, " where", false], [4811, 0.001461, " to", false], [32232, 0.001204, " they", false], [275, 0.001064, " (", false], [4596, 0.000686, " in", false], [4858, 0.00066, " we", false]]], "qwen": [429, 1, 0.9284818768501282, [[429, 0.928482, " that", false], [279, 0.011645, " the", false], [537, 0.005787, " not", false], [892, 0.005376, " which", false], [34447, 0.004525, " computation", false], [304, 0.003858, " in", false], [1380, 0.002201, " where", false], [807, 0.002154, " they", false], [432, 0.001872, " it", false], [311, 0.001355, " to", false]]]}, "raw_delta": -0.005465885996818543, "tuned_delta": 0.0031059060337597054}, {"byte_start": 1166, "byte_end": 1171, "display": {"text": " make", "kind": "normal"}, "is_word": true, "word_id": 196, "word_key": " make", "bytes_hex": "20 6d 61 6b 65", "compression": {"rwkv": "4.25% 4.25% 4.25% 4.25% 4.25%", "qwen": "6.13% 6.13% 6.13% 6.13% 6.13%"}, "model_tokens": {"rwkv": [[31358, " make", "normal", 0.30952146649360657]], "qwen": [[1281, " make", "normal", 0.18291719257831573]]}, "loss": {"rwkv": 4.254823265121747, "qwen": 6.12684367084774}, "topk": {"rwkv": [31358, 1, 0.30952146649360657, [[31358, 0.309521, " make", false], [21286, 0.094172, " are", false], [22590, 0.037461, " the", false], [47030, 0.034891, " reduce", false], [21413, 0.024152, " can", false], [56433, 0.023898, " increase", false], [32053, 0.01603, " slow", false], [32216, 0.014736, " tend", false], [38900, 0.014169, " limit", false], [31123, 0.013632, " hurt", false]]], "qwen": [1281, 1, 0.18291719257831573, [[1281, 0.182917, " make", false], [525, 0.147376, " are", false], [279, 0.042186, " the", false], [646, 0.036885, " can", false], [1367, 0.018263, " comp", false], [7949, 0.014246, " reduce", false], [653, 0.013098, " do", false], [11, 0.011434, ",", false], [1373, 0.01119, " require", false], [1231, 0.010123, " may", false]]]}, "raw_delta": -0.10380685329437259, "tuned_delta": -0.09523506126379434}, {"byte_start": 1171, "byte_end": 1176, "display": {"text": " them", "kind": "normal"}, "is_word": true, "word_id": 197, "word_key": " them", "bytes_hex": "20 74 68 65 6d", "compression": {"rwkv": "2.99% 2.99% 2.99% 2.99% 2.99%", "qwen": "2.85% 2.85% 2.85% 2.85% 2.85%"}, "model_tokens": {"rwkv": [[32229, " them", "normal", 0.43699005246162415]], "qwen": [[1105, " them", "normal", 0.4536651372909546]]}, "loss": {"rwkv": 2.9868295768404316, "qwen": 2.850750669106684}, "topk": {"rwkv": [32229, 1, 0.43699005246162415, [[32229, 0.43699, " them", false], [4601, 0.213979, " it", false], [22590, 0.053347, " the", false], [63370, 0.050107, " computation", false], [39931, 0.032802, " their", false], [38888, 0.01781, " lever", false], [332, 0.007162, " a", false], [51832, 0.005641, " general", false], [52805, 0.005592, " scaling", false], [65135, 0.00494, " generalization", false]]], "qwen": [1105, 1, 0.4536651372909546, [[1105, 0.453665, " them", false], [432, 0.178793, " it", false], [279, 0.064649, " the", false], [76482, 0.037198, " leveraging", false], [862, 0.026683, " their", false], [34447, 0.023364, " computation", false], [32064, 0.012587, " leverage", false], [990, 0.008797, " use", false], [4623, 0.00801, " further", false], [4586, 0.00795, " general", false]]]}, "raw_delta": 0.007545816898345936, "tuned_delta": 0.016117608928924186}, {"byte_start": 1176, "byte_end": 1181, "display": {"text": " less", "kind": "normal"}, "is_word": true, "word_id": 198, "word_key": " less", "bytes_hex": "20 6c 65 73 73", "compression": {"rwkv": "3.97% 3.97% 3.97% 3.97% 3.97%", "qwen": "5.01% 5.01% 5.01% 5.01% 5.01%"}, "model_tokens": {"rwkv": [[31277, " less", "normal", 0.33282899856567383]], "qwen": [[2686, " less", "normal", 0.248989537358284]]}, "loss": {"rwkv": 3.9730468899481215, "qwen": 5.014607360190208}, "topk": {"rwkv": [31277, 1, 0.33282899856567383, [[31277, 0.332829, " less", false], [46162, 0.252715, " harder", false], [31458, 0.083044, " more", false], [31048, 0.046206, " hard", false], [59516, 0.031681, " difficult", false], [31466, 0.01761, " much", false], [40216, 0.012972, " worse", false], [47313, 0.009219, " slower", false], [62699, 0.00891, " unsuitable", false], [64425, 0.007354, " incompatible", false]]], "qwen": [2686, 1, 0.248989537358284, [[2686, 0.24899, " less", false], [15750, 0.230981, " harder", false], [803, 0.126236, " more", false], [5000, 0.041384, " difficult", false], [2588, 0.036845, " hard", false], [3716, 0.024595, " comput", false], [28393, 0.021285, " slower", false], [1753, 0.014994, " much", false], [94649, 0.009414, " brittle", false], [10960, 0.00875, " worse", false]]]}, "raw_delta": -0.05775637626647947, "tuned_delta": -0.04918458423590122}, {"byte_start": 1181, "byte_end": 1188, "display": {"text": " suited", "kind": "normal"}, "is_word": true, "word_id": 199, "word_key": " suited", "bytes_hex": "20 73 75 69 74 65 64", "compression": {"rwkv": "13.61% 13.61% 13.61% 13.61% 13.61% 13.61% 13.61%", "qwen": "15.30% 15.30% 15.30% 15.30% 15.30% 15.30% 15.30%"}, "model_tokens": {"rwkv": [[47460, " suited", "normal", 0.005090330261737108]], "qwen": [[31499, " suited", "normal", 0.002638147445395589]]}, "loss": {"rwkv": 13.605773544097923, "qwen": 15.296891234506983}, "topk": {"rwkv": [47460, 22, 0.005090330261737108, [[30140, 0.220185, " amen", false], [59593, 0.218613, " effective", false], [51832, 0.092297, " general", false], [59594, 0.043193, " efficient", false], [46439, 0.038388, " likely", false], [47687, 0.031806, " useful", false], [57160, 0.017752, " scalable", false], [47129, 0.01705, " robust", false], [56248, 0.015402, " flexible", false], [45820, 0.011947, " easily", false]]], "qwen": [31499, 38, 0.002638147445395589, [[4586, 0.170988, " general", false], [7373, 0.162518, " effective", false], [3716, 0.074594, " comput", false], [68211, 0.073624, " scalable", false], [1079, 0.056863, " am", false], [11050, 0.039339, " efficient", false], [21765, 0.022776, " robust", false], [6707, 0.021299, " easily", false], [41829, 0.016703, " tract", false], [93748, 0.015319, " adaptable", false]]]}, "raw_delta": -0.09377547672816688, "tuned_delta": -0.08520368469758864}, {"byte_start": 1188, "byte_end": 1191, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 200, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "1.49% 1.49% 1.49%", "qwen": "1.70% 1.70% 1.70%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.77960205078125]], "qwen": [[311, " to", "normal", 0.7539805173873901]]}, "loss": {"rwkv": 1.4910666519604356, "qwen": 1.6975033396946884}, "topk": {"rwkv": [4811, 1, 0.77960205078125, [[4811, 0.779602, " to", false], [21700, 0.199966, " for", false], [32226, 0.0045, " than", false], [4423, 0.003286, " as", false], [53169, 0.001679, " towards", false], [4596, 0.001553, " in", false], [45, 0.001517, ",", false], [4715, 0.00093, " or", false], [21265, 0.000782, " and", false], [275, 0.000782, " (", false]]], "qwen": [311, 1, 0.7539805173873901, [[311, 0.753981, " to", false], [369, 0.22766, " for", false], [1091, 0.004099, " than", false], [438, 0.001821, " as", false], [11, 0.001675, ",", false], [6974, 0.001194, " towards", false], [476, 0.000963, " or", false], [320, 0.000937, " (", false], [323, 0.000754, " and", false], [304, 0.000699, " in", false]]]}, "raw_delta": -0.011447280645370483, "tuned_delta": -0.002875488614792235}, {"byte_start": 1191, "byte_end": 1198, "display": {"text": " taking", "kind": "normal"}, "is_word": true, "word_id": 201, "word_key": " taking", "bytes_hex": "20 74 61 6b 69 6e 67", "compression": {"rwkv": "10.47% 10.47% 10.47% 10.47% 10.47% 10.47% 10.47%", "qwen": "12.58% 12.58% 12.58% 12.58% 12.58% 12.58% 12.58%"}, "model_tokens": {"rwkv": [[47497, " taking", "normal", 0.016814475879073143]], "qwen": [[4633, " taking", "normal", 0.007579374127089977]]}, "loss": {"rwkv": 10.465979649306096, "qwen": 12.578045761309482}, "topk": {"rwkv": [47497, 9, 0.016814475879073143, [[22590, 0.232486, " the", false], [38888, 0.078267, " lever", false], [52805, 0.049971, " scaling", false], [63370, 0.034423, " computation", false], [51832, 0.032748, " general", false], [37832, 0.029173, " being", false], [56540, 0.023992, " leverage", false], [31323, 0.023183, " long", false], [47497, 0.016814, " taking", false], [38864, 0.014913, " large", false]]], "qwen": [4633, 19, 0.007579374127089977, [[279, 0.168114, " the", false], [32064, 0.113406, " leverage", false], [76482, 0.088211, " leveraging", false], [34447, 0.035141, " computation", false], [26943, 0.030086, " scaling", false], [70601, 0.021356, " exploiting", false], [4586, 0.02086, " general", false], [39661, 0.020574, " exploitation", false], [3460, 0.018556, " large", false], [990, 0.013438, " use", false]]]}, "raw_delta": -0.11711781365530827, "tuned_delta": -0.10854602162473002}, {"byte_start": 1198, "byte_end": 1208, "display": {"text": " advantage", "kind": "normal"}, "is_word": true, "word_id": 202, "word_key": " advantage", "bytes_hex": "20 61 64 76 61 6e 74 61 67 65", "compression": {"rwkv": "0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43%", "qwen": "0.14% 0.14% 0.14% 0.14% 0.14% 0.14% 0.14% 0.14% 0.14% 0.14%"}, "model_tokens": {"rwkv": [[59093, " advantage", "normal", 0.788828432559967]], "qwen": [[9423, " advantage", "normal", 0.9232712388038635]]}, "loss": {"rwkv": 0.42794786979494404, "qwen": 0.14396693232400448}, "topk": {"rwkv": [59093, 1, 0.788828432559967, [[59093, 0.788828, " advantage", false], [30923, 0.179803, " full", false], [52204, 0.005016, " maximum", false], [22590, 0.003543, " the", false], [52203, 0.002685, " maximal", false], [56540, 0.002071, " leverage", false], [61544, 0.002046, " advantages", false], [30273, 0.00117, " best", false], [4712, 0.00068, " on", false], [51030, 0.000639, " benefit", false]]], "qwen": [9423, 1, 0.9232712388038635, [[9423, 0.923271, " advantage", false], [2480, 0.047825, " full", false], [279, 0.004137, " the", false], [22146, 0.001789, " advantages", false], [8760, 0.00139, " benefit", false], [54480, 0.001342, " computational", false], [389, 0.001265, " on", false], [32064, 0.00112, " leverage", false], [2664, 0.001028, " better", false], [7192, 0.00101, " maximum", false]]]}, "raw_delta": 0.015747246891260145, "tuned_delta": 0.02431903892183839}, {"byte_start": 1208, "byte_end": 1211, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 203, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.01% 0.01% 0.01%", "qwen": "0.02% 0.02% 0.02%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9979496598243713]], "qwen": [[315, " of", "normal", 0.9961793422698975]]}, "loss": {"rwkv": 0.012291026781662055, "qwen": 0.02301089239628658}, "topk": {"rwkv": [4706, 1, 0.9979496598243713, [[4706, 0.99795, " of", false], [22590, 0.000468, " the", false], [45, 0.000106, ",", false], [4715, 9.5e-05, " or", false], [4596, 8.7e-05, " in", false], [275, 8.2e-05, " (", false], [4811, 8.1e-05, " to", false], [21265, 6.9e-05, " and", false], [47, 5.4e-05, ".", false], [4423, 5.1e-05, " as", false]]], "qwen": [315, 1, 0.9961793422698975, [[315, 0.996179, " of", false], [279, 0.000355, " the", false], [916, 0.000197, " over", false], [11, 0.000181, ",", false], [320, 0.000174, " (", false], [304, 0.000158, " in", false], [979, 0.000141, " when", false], [13, 0.00014, ".", false], [624, 0.000134, ".\n", false], [3716, 0.000128, " comput", false]]]}, "raw_delta": -0.0005944355701406797, "tuned_delta": 0.007977356460437568}, {"byte_start": 1211, "byte_end": 1219, "display": {"text": " general", "kind": "normal"}, "is_word": true, "word_id": 204, "word_key": " general", "bytes_hex": "20 67 65 6e 65 72 61 6c", "compression": {"rwkv": "9.93% 9.93% 9.93% 9.93% 9.93% 9.93% 9.93% 9.93%", "qwen": "15.64% 15.64% 15.64% 15.64% 15.64% 15.64% 15.64% 15.64%"}, "model_tokens": {"rwkv": [[51832, " general", "normal", 0.01215451955795288]], "qwen": [[4586, " general", "normal", 0.0009715748601593077]]}, "loss": {"rwkv": 9.932617224870304, "qwen": 15.636542228590956}, "topk": {"rwkv": [51832, 14, 0.01215451955795288, [[22590, 0.310744, " the", false], [63370, 0.139045, " computation", false], [30789, 0.030225, " ever", false], [37045, 0.026895, " Moore", false], [59846, 0.024509, " increased", false], [46064, 0.024085, " future", false], [22168, 0.019915, " new", false], [64862, 0.018301, " computational", false], [52195, 0.018082, " massive", false], [31458, 0.017865, " more", false]]], "qwen": [4586, 78, 0.0009715748601593077, [[279, 0.377646, " the", false], [34447, 0.123759, " computation", false], [501, 0.036997, " new", false], [54480, 0.03647, " computational", false], [10951, 0.024283, " massive", false], [3853, 0.02029, " future", false], [7172, 0.017718, " increased", false], [74151, 0.014298, " exponentially", false], [264, 0.010983, " a", false], [419, 0.009906, " this", false]]]}, "raw_delta": -0.31629276275634766, "tuned_delta": -0.3077209707257694}, {"byte_start": 1219, "byte_end": 1227, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 205, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "3.50% 3.50% 3.50% 3.50% 3.50% 3.50% 3.50% 3.50%", "qwen": "3.72% 3.72% 3.72% 3.72% 3.72% 3.72% 3.72% 3.72%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.20908476412296295]], "qwen": [[5413, " methods", "normal", 0.19181130826473236]]}, "loss": {"rwkv": 3.504593666221969, "qwen": 3.722250340864776}, "topk": {"rwkv": [52224, 2, 0.20908476412296295, [[63370, 0.477301, " computation", false], [52224, 0.209085, " methods", false], [46, 0.047819, "-", false], [64862, 0.031764, " computational", false], [61590, 0.021465, " approaches", false], [7933, 0.017499, "ity", false], [45, 0.013975, ",", false], [59346, 0.013237, " computing", false], [62633, 0.009677, " techniques", false], [41729, 0.009659, "izable", false]]], "qwen": [5413, 2, 0.19181130826473236, [[58238, 0.214484, "-purpose", false], [5413, 0.191811, " methods", false], [34447, 0.178298, " computation", false], [18142, 0.0596, " improvements", false], [54480, 0.056473, " computational", false], [2022, 0.028061, "ization", false], [24231, 0.019293, " computing", false], [12538, 0.017913, " techniques", false], [11, 0.01274, ",", false], [15673, 0.012652, " improvement", false]]]}, "raw_delta": -0.012069448828697205, "tuned_delta": -0.0034976567981189564}, {"byte_start": 1227, "byte_end": 1238, "display": {"text": " leveraging", "kind": "normal"}, "is_word": true, "word_id": 206, "word_key": " leveraging", "bytes_hex": "20 6c 65 76 65 72 61 67 69 6e 67", "compression": {"rwkv": "14.84% 14.84% 14.84% 14.84% 14.84% 14.84% 0.01% 0.01% 0.01% 0.01% 0.01%", "qwen": "9.42% 9.42% 9.42% 9.42% 9.42% 9.42% 9.42% 9.42% 9.42% 9.42% 9.42%"}, "model_tokens": {"rwkv": [[38888, " lever", "normal", 0.007249490357935429], [33672, "aging", "normal", 0.9961600303649902]], "qwen": [[76482, " leveraging", "normal", 0.003186533460393548]]}, "loss": {"rwkv": 8.10097072360851, "qwen": 9.424768873398197}, "topk": {"rwkv": [38888, 12, 0.007249490357935429, [[47, 0.530161, ".", false], [32227, 0.134713, " that", false], [45, 0.079152, ",", false], [4706, 0.036582, " of", false], [21265, 0.02621, " and", false], [21700, 0.026183, " for", false], [275, 0.017644, " (", false], [31296, 0.014269, " like", false], [37810, 0.011557, " based", false], [4596, 0.01063, " in", false]]], "qwen": [76482, 22, 0.003186533460393548, [[624, 0.246874, ".\n", false], [13, 0.230331, ".", false], [429, 0.156389, " that", false], [11, 0.072402, ",", false], [315, 0.049732, " of", false], [323, 0.033619, " and", false], [369, 0.023689, " for", false], [382, 0.019129, ".\n\n", false], [320, 0.01717, " (", false], [304, 0.014904, " in", false]]]}, "raw_delta": -0.07340695641257554, "tuned_delta": -0.0648351643819973}, {"byte_start": 1238, "byte_end": 1250, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 207, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "0.19% 0.19% 0.19% 0.19% 0.19% 0.19% 0.19% 0.19% 0.19% 0.19% 0.19% 0.19%", "qwen": "0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.880954384803772]], "qwen": [[34447, " computation", "normal", 0.8454323410987854]]}, "loss": {"rwkv": 0.1907860873571423, "qwen": 0.25233207199651386}, "topk": {"rwkv": [63370, 1, 0.880954384803772, [[63370, 0.880954, " computation", false], [22590, 0.013913, " the", false], [52195, 0.007068, " massive", false], [64862, 0.005728, " computational", false], [31458, 0.003763, " more", false], [30789, 0.003295, " ever", false], [51832, 0.003042, " general", false], [59846, 0.00304, " increased", false], [64298, 0.002804, " computations", false], [59988, 0.002763, " massively", false]]], "qwen": [34447, 1, 0.8454323410987854, [[34447, 0.845432, " computation", false], [279, 0.034439, " the", false], [54480, 0.015215, " computational", false], [803, 0.007779, " more", false], [10951, 0.006185, " massive", false], [7172, 0.004161, " increased", false], [7703, 0.003956, " increasing", false], [74151, 0.003853, " exponentially", false], [8570, 0.003264, " continued", false], [3460, 0.002766, " large", false]]]}, "raw_delta": -0.0034128340582052848, "tuned_delta": 0.005158957972372964}, {"byte_start": 1250, "byte_end": 1251, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "2.61%", "qwen": "17.46%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.8655523657798767]], "qwen": [[13, ".", "normal", 0.37966933846473694]]}, "loss": {"rwkv": 2.606431470356037, "qwen": 17.464808098154315}, "topk": {"rwkv": [47, 1, 0.8655523657798767, [[47, 0.865552, ".", false], [45, 0.063992, ",", false], [275, 0.018223, " (", false], [32227, 0.004995, " that", false], [4596, 0.004488, " in", false], [4811, 0.003288, " to", false], [21265, 0.003213, " and", false], [60, 0.002744, ";", false], [4423, 0.002031, " as", false], [59, 0.001612, ":", false]]], "qwen": [13, 2, 0.37966933846473694, [[624, 0.447089, ".\n", false], [13, 0.379669, ".", false], [11, 0.054649, ",", false], [382, 0.028451, ".\n\n", false], [320, 0.017153, " (", false], [304, 0.008535, " in", false], [311, 0.006268, " to", false], [26, 0.00412, ";", false], [429, 0.004086, " that", false], [323, 0.003441, " and", false]]]}, "raw_delta": -0.8239233493804932, "tuned_delta": -0.8153515573499149}, {"byte_start": 1251, "byte_end": 1258, "display": {"text": "  There", "kind": "normal"}, "is_word": true, "word_id": 208, "word_key": "  there", "bytes_hex": "20 20 54 68 65 72 65", "compression": {"rwkv": "83.41% 83.41% 12.51% 12.51% 12.51% 12.51% 12.51%", "qwen": "101.92% 13.40% 13.40% 13.40% 13.40% 13.40% 13.40%"}, "model_tokens": {"rwkv": [[267, "  ", "normal", 9.398390830028802e-05], [33504, "There", "normal", 0.03126389905810356]], "qwen": [[220, " ", "normal", 0.0035120798274874687], [2619, " There", "normal", 0.011573479510843754]]}, "loss": {"rwkv": 32.76656705590446, "qwen": 26.047306847837543}, "topk": {"rwkv": [267, 311, 9.398390830028802e-05, [[11, 0.409219, "\n", false], [261, 0.095854, "\n\n", false], [20996, 0.0661, " The", false], [29894, 0.03316, " This", false], [19555, 0.028544, " But", false], [3913, 0.025988, " In", false], [3918, 0.020972, " It", false], [4217, 0.016173, " So", false], [37451, 0.012744, " There", false], [19907, 0.012099, " For", false]]], "qwen": [220, 44, 0.0035120798274874687, [[576, 0.122041, " The", false], [1096, 0.072077, " This", false], [758, 0.061168, " In", false], [1084, 0.035065, " It", false], [1988, 0.033449, " But", false], [2619, 0.027887, " There", false], [151643, 0.026966, "\u003c|endoftext|\u003e", false], [1752, 0.026654, " For", false], [2055, 0.021972, " So", false], [4220, 0.021806, " These", false]]]}, "raw_delta": 0.3725949014936175, "tuned_delta": 0.38116669352419574}, {"byte_start": 1258, "byte_end": 1263, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 209, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"rwkv": "18.03% 18.03% 18.03% 18.03% 18.03%", "qwen": "18.96% 18.96% 18.96% 18.96% 18.96%"}, "model_tokens": {"rwkv": [[32462, " were", "normal", 0.006788540631532669]], "qwen": [[1033, " were", "normal", 0.005216585472226143]]}, "loss": {"rwkv": 18.03368801111204, "qwen": 18.956696540548123}, "topk": {"rwkv": [32462, 8, 0.006788540631532669, [[21286, 0.508979, " are", false], [4600, 0.303864, " is", false], [460, 0.07777, "'s", false], [31059, 0.03083, " have", false], [21800, 0.018207, " has", false], [22748, 0.009371, " was", false], [22074, 0.007386, " may", false], [32462, 0.006789, " were", false], [32475, 0.005485, " will", false], [28309, 0.003928, "’s", false]]], "qwen": [1033, 8, 0.005216585472226143, [[525, 0.480714, " are", false], [374, 0.368058, " is", false], [594, 0.03353, "'s", false], [614, 0.032211, " have", false], [702, 0.02271, " has", false], [572, 0.008697, " was", false], [1231, 0.005935, " may", false], [1033, 0.005217, " were", false], [646, 0.003663, " can", false], [686, 0.003034, " will", false]]]}, "raw_delta": -0.051182460784912065, "tuned_delta": -0.042610668754333815}, {"byte_start": 1263, "byte_end": 1268, "display": {"text": " many", "kind": "normal"}, "is_word": true, "word_id": 210, "word_key": " many", "bytes_hex": "20 6d 61 6e 79", "compression": {"rwkv": "9.58% 9.58% 9.58% 9.58% 9.58%", "qwen": "8.42% 8.42% 8.42% 8.42% 8.42%"}, "model_tokens": {"rwkv": [[31370, " many", "normal", 0.07024678587913513]], "qwen": [[1657, " many", "normal", 0.09687885642051697]]}, "loss": {"rwkv": 9.580396755903271, "qwen": 8.41918623562942}, "topk": {"rwkv": [31370, 4, 0.07024678587913513, [[332, 0.115769, " a", false], [22638, 0.097938, " two", false], [32074, 0.086856, " some", false], [31370, 0.070247, " many", false], [52869, 0.047081, " several", false], [39193, 0.040242, " other", false], [39962, 0.03514, " times", false], [61963, 0.025771, " exceptions", false], [45, 0.022101, ",", false], [39946, 0.021296, " three", false]]], "qwen": [1657, 3, 0.09687885642051697, [[1378, 0.182187, " two", false], [264, 0.116732, " a", false], [1657, 0.096879, " many", false], [1045, 0.0537, " some", false], [2326, 0.037893, " three", false], [3807, 0.036552, " several", false], [11, 0.035038, ",", false], [1008, 0.023848, " other", false], [3039, 0.022582, " times", false], [19585, 0.018904, " exceptions", false]]]}, "raw_delta": 0.0643911838531494, "tuned_delta": 0.07296297588372765}, {"byte_start": 1268, "byte_end": 1277, "display": {"text": " examples", "kind": "normal"}, "is_word": true, "word_id": 211, "word_key": " examples", "bytes_hex": "20 65 78 61 6d 70 6c 65 73", "compression": {"rwkv": "5.85% 5.85% 5.85% 5.85% 5.85% 5.85% 5.85% 5.85% 5.85%", "qwen": "9.31% 9.31% 9.31% 9.31% 9.31% 9.31% 9.31% 9.31% 9.31%"}, "model_tokens": {"rwkv": [[56162, " examples", "normal", 0.053704049438238144]], "qwen": [[10295, " examples", "normal", 0.009600982069969177]]}, "loss": {"rwkv": 5.854686906385332, "qwen": 9.309170560900908}, "topk": {"rwkv": [56162, 2, 0.053704049438238144, [[39193, 0.081316, " other", false], [56162, 0.053704, " examples", false], [52654, 0.030805, " reasons", false], [39962, 0.027373, " times", false], [30992, 0.024856, " good", false], [3609, 0.023526, " AI", false], [32448, 0.021246, " ways", false], [46787, 0.020874, " people", false], [38328, 0.020161, " early", false], [32139, 0.01657, " such", false]]], "qwen": [10295, 13, 0.009600982069969177, [[7966, 0.098679, " reasons", false], [4124, 0.048259, " early", false], [1008, 0.04031, " other", false], [2989, 0.033604, " important", false], [19827, 0.031808, " approaches", false], [1661, 0.029696, " good", false], [18366, 0.028182, " lessons", false], [13553, 0.025138, " attempts", false], [2244, 0.024823, " great", false], [5510, 0.014277, " ways", false]]]}, "raw_delta": -0.19155724843343103, "tuned_delta": -0.18298545640285277}, {"byte_start": 1277, "byte_end": 1280, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 212, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "3.19% 3.19% 3.19%", "qwen": "2.10% 2.10% 2.10%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.5908578634262085]], "qwen": [[315, " of", "normal", 0.7047458291053772]]}, "loss": {"rwkv": 3.193465585301091, "qwen": 2.103437752646663}, "topk": {"rwkv": [4706, 1, 0.5908578634262085, [[4706, 0.590858, " of", false], [4596, 0.166289, " in", false], [45805, 0.027147, " during", false], [40185, 0.022259, " where", false], [62650, 0.021529, " throughout", false], [31601, 0.021349, " over", false], [32227, 0.019645, " that", false], [30917, 0.018284, " from", false], [45, 0.014583, ",", false], [37678, 0.013007, " along", false]]], "qwen": [315, 1, 0.7047458291053772, [[315, 0.704746, " of", false], [304, 0.100277, " in", false], [1380, 0.026316, " where", false], [429, 0.018377, " that", false], [6814, 0.015871, " throughout", false], [11, 0.011269, ",", false], [2337, 0.010415, " during", false], [4124, 0.010242, " early", false], [3156, 0.008302, " along", false], [1573, 0.008228, " before", false]]]}, "raw_delta": 0.06044397751490275, "tuned_delta": 0.069015769545481}, {"byte_start": 1280, "byte_end": 1283, "display": {"text": " AI", "kind": "normal"}, "is_word": true, "word_id": 213, "word_key": " ai", "bytes_hex": "20 41 49", "compression": {"rwkv": "19.54% 19.54% 19.54%", "qwen": "23.33% 23.33% 23.33%"}, "model_tokens": {"rwkv": [[3609, " AI", "normal", 0.038678500801324844]], "qwen": [[15235, " AI", "normal", 0.02062762901186943]]}, "loss": {"rwkv": 19.536495345371375, "qwen": 23.330326567436906}, "topk": {"rwkv": [3609, 3, 0.038678500801324844, [[32234, 0.464153, " this", false], [22590, 0.072009, " the", false], [3609, 0.038679, " AI", false], [57103, 0.021769, " research", false], [63843, 0.019411, " researchers", false], [39936, 0.018715, " these", false], [52224, 0.017412, " methods", false], [38328, 0.014735, " early", false], [32139, 0.01308, " such", false], [46787, 0.012245, " people", false]]], "qwen": [15235, 8, 0.02062762901186943, [[419, 0.215455, " this", false], [279, 0.10999, " the", false], [3738, 0.044208, " human", false], [11811, 0.023512, " researchers", false], [3412, 0.021636, " research", false], [4124, 0.02119, " early", false], [4586, 0.020909, " general", false], [15235, 0.020628, " AI", false], [1741, 0.016156, " such", false], [1493, 0.016148, " these", false]]]}, "raw_delta": -0.21037467320760106, "tuned_delta": -0.2018028811770228}, {"byte_start": 1283, "byte_end": 1295, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 214, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"rwkv": "3.43% 3.43% 3.43% 3.43% 3.43% 3.43% 3.43% 3.43% 3.43% 3.43% 3.43% 3.43%", "qwen": "2.33% 2.33% 2.33% 2.33% 2.33% 2.33% 2.33% 2.33% 2.33% 2.33% 2.33% 2.33%"}, "model_tokens": {"rwkv": [[63843, " researchers", "normal", 0.10274555534124374]], "qwen": [[11811, " researchers", "normal", 0.21270927786827087]]}, "loss": {"rwkv": 3.4282792312791117, "qwen": 2.3260886422367912}, "topk": {"rwkv": [63843, 3, 0.10274555534124374, [[57103, 0.265672, " research", false], [53087, 0.104197, " systems", false], [63843, 0.102746, " researchers", false], [56952, 0.069278, " projects", false], [32227, 0.053649, " that", false], [52224, 0.040734, " methods", false], [61590, 0.028977, " approaches", false], [4596, 0.018487, " in", false], [45124, 0.01775, " agents", false], [60587, 0.01372, " successes", false]]], "qwen": [11811, 2, 0.21270927786827087, [[3412, 0.24725, " research", false], [11811, 0.212709, " researchers", false], [5942, 0.050485, " systems", false], [5413, 0.049835, " methods", false], [304, 0.035385, " in", false], [429, 0.03287, " that", false], [19827, 0.027719, " approaches", false], [7079, 0.020352, " projects", false], [1660, 0.017214, " being", false], [13009, 0.015859, " agents", false]]]}, "raw_delta": 0.06111842393875122, "tuned_delta": 0.06969021596932946}, {"byte_start": 1295, "byte_end": 1296, "display": {"text": "'", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "27", "compression": {"rwkv": "90.73%", "qwen": "76.98%"}, "model_tokens": {"rwkv": [[40, "'", "normal", 0.006481685675680637]], "qwen": [[6, "'", "normal", 0.013998657464981079]]}, "loss": {"rwkv": 90.73199280590745, "qwen": 76.98210025728152}, "topk": {"rwkv": [40, 29, 0.006481685675680637, [[22762, 0.263142, " who", false], [4596, 0.05885, " in", false], [46500, 0.033743, " making", false], [31601, 0.021434, " over", false], [32227, 0.018717, " that", false], [45, 0.01864, ",", false], [47629, 0.018436, " trying", false], [51844, 0.01631, " getting", false], [51709, 0.016165, " falling", false], [47497, 0.013437, " taking", false]]], "qwen": [6, 13, 0.013998657464981079, [[879, 0.162335, " who", false], [304, 0.061561, " in", false], [3259, 0.037806, " making", false], [4460, 0.024903, " trying", false], [429, 0.023692, " that", false], [10164, 0.019427, " spending", false], [1660, 0.018906, " being", false], [19405, 0.016969, " attempting", false], [3238, 0.01593, " working", false], [10887, 0.015721, " seeking", false]]]}, "raw_delta": 0.762455940246582, "tuned_delta": 0.7710277322771603}, {"byte_start": 1296, "byte_end": 1300, "display": {"text": " bel", "kind": "normal"}, "is_word": true, "word_id": 215, "word_key": " bel", "bytes_hex": "20 62 65 6c", "compression": {"rwkv": "40.86% 40.86% 40.86% 40.86%", "qwen": "38.94% 38.94% 38.94% 38.94%"}, "model_tokens": {"rwkv": [[21344, " bel", "normal", 0.00011797981278505176]], "qwen": [[1656, " bel", "normal", 0.00017736996232997626]]}, "loss": {"rwkv": 40.857574400175714, "qwen": 38.94047089230917}, "topk": {"rwkv": [21344, 795, 0.00011797981278505176, [[51708, 0.053583, " failure", false], [61701, 0.036525, " commitment", false], [62157, 0.032617, " investment", false], [55572, 0.024009, " attempts", false], [59834, 0.019105, " inability", false], [31601, 0.017552, " over", false], [56652, 0.01724, " mistakes", false], [51566, 0.015452, " efforts", false], [38530, 0.01479, " focus", false], [63678, 0.014635, " investments", false]]], "qwen": [1656, 650, 0.00017736996232997626, [[7901, 0.056277, " failure", false], [13553, 0.052514, " attempts", false], [8869, 0.043999, " efforts", false], [27850, 0.018851, " failures", false], [37450, 0.017477, " inability", false], [4124, 0.015337, " early", false], [15155, 0.013318, " commitment", false], [23187, 0.012418, " psychological", false], [975, 0.011972, " work", false], [5786, 0.011803, " mis", false]]]}, "raw_delta": 0.10630679130554199, "tuned_delta": 0.11487858333612024}, {"byte_start": 1300, "byte_end": 1304, "display": {"text": "ated", "kind": "normal"}, "is_word": true, "word_id": 216, "word_key": "ated", "bytes_hex": "61 74 65 64", "compression": {"rwkv": "2.29% 2.29% 2.29% 2.29%", "qwen": "0.37% 0.37% 0.37% 0.37%"}, "model_tokens": {"rwkv": [[24738, "ated", "normal", 0.6016695499420166]], "qwen": [[657, "ated", "normal", 0.9212166666984558]]}, "loss": {"rwkv": 2.289433048285708, "qwen": 0.3699612855722067}, "topk": {"rwkv": [24738, 1, 0.6016695499420166, [[24738, 0.60167, "ated", false], [7931, 0.137252, "itt", false], [1840, 0.1047, "ea", false], [27525, 0.031826, "ying", false], [24385, 0.027527, "abor", false], [34907, 0.025719, "ittle", false], [1848, 0.018884, "ei", false], [33943, 0.006157, "ating", false], [1956, 0.004247, "it", false], [34116, 0.003747, "ching", false]]], "qwen": [657, 1, 0.9212166666984558, [[657, 0.921217, "ated", false], [1442, 0.039761, "itt", false], [415, 0.008735, "lic", false], [370, 0.00741, "ab", false], [550, 0.004834, "ies", false], [7272, 0.003059, "iger", false], [4324, 0.002297, "abor", false], [6711, 0.001472, "lying", false], [1122, 0.000989, "ied", false], [4738, 0.000925, "ief", false]]]}, "raw_delta": 0.10643811523914337, "tuned_delta": 0.11500990726972161}, {"byte_start": 1304, "byte_end": 1313, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 217, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "10.96% 10.96% 10.96% 10.96% 10.96% 10.96% 10.96% 10.96% 10.96%", "qwen": "12.19% 12.19% 12.19% 12.19% 12.19% 12.19% 12.19% 12.19% 12.19%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.0042425720021128654]], "qwen": [[6832, " learning", "normal", 0.0022810553200542927]]}, "loss": {"rwkv": 10.957970145640996, "qwen": 12.189003806792723}, "topk": {"rwkv": [56537, 19, 0.0042425720021128654, [[63821, 0.439509, " recognition", false], [63820, 0.237798, " realization", false], [59544, 0.060548, " discovery", false], [64253, 0.024141, " appreciation", false], [59209, 0.023919, " awareness", false], [65034, 0.019285, " understanding", false], [61518, 0.009576, " acceptance", false], [55572, 0.009001, " attempts", false], [63484, 0.0088, " discoveries", false], [21265, 0.008673, " and", false]]], "qwen": [6832, 34, 0.0022810553200542927, [[398, 0.201051, "ly", false], [1931, 0.200269, " real", false], [17843, 0.121466, " recognition", false], [48703, 0.045398, " realization", false], [34896, 0.044657, " appreciation", false], [323, 0.020546, " and", false], [8660, 0.01876, " understanding", false], [17526, 0.013366, " awareness", false], [18335, 0.012287, " discovery", false], [24376, 0.011437, " adoption", false]]]}, "raw_delta": -0.06826300091213655, "tuned_delta": -0.0596912088815583}, {"byte_start": 1313, "byte_end": 1316, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 218, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "2.85% 2.85% 2.85%", "qwen": "7.03% 7.03% 7.03%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.6208587884902954]], "qwen": [[315, " of", "normal", 0.31049299240112305]]}, "loss": {"rwkv": 2.8529857986329596, "qwen": 7.0306973459062245}, "topk": {"rwkv": [4706, 1, 0.6208587884902954, [[4706, 0.620859, " of", false], [32227, 0.127111, " that", false], [37598, 0.059985, " about", false], [30917, 0.045809, " from", false], [32234, 0.023264, " this", false], [4811, 0.020601, " to", false], [116, 0.016251, "s", false], [22590, 0.012485, " the", false], [4596, 0.011576, " in", false], [45, 0.010873, ",", false]]], "qwen": [315, 1, 0.31049299240112305, [[315, 0.310493, " of", false], [429, 0.251639, " that", false], [419, 0.092231, " this", false], [311, 0.089571, " to", false], [911, 0.055374, " about", false], [279, 0.032315, " the", false], [504, 0.026661, " from", false], [304, 0.021464, " in", false], [11, 0.015319, ",", false], [13, 0.012185, ".", false]]]}, "raw_delta": -0.23166151841481528, "tuned_delta": -0.22308972638423702}, {"byte_start": 1316, "byte_end": 1321, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 219, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "2.73% 2.73% 2.73% 2.73% 2.73%", "qwen": "2.70% 2.70% 2.70% 2.70% 2.70%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.47909310460090637]], "qwen": [[419, " this", "normal", 0.472516268491745]]}, "loss": {"rwkv": 2.7332308391841686, "qwen": 2.7039101619735093}, "topk": {"rwkv": [32234, 1, 0.47909310460090637, [[32234, 0.479093, " this", false], [22590, 0.293509, " the", false], [39936, 0.097901, " these", false], [51832, 0.014763, " general", false], [21835, 0.013698, " how", false], [37045, 0.012207, " Moore", false], [32227, 0.010701, " that", false], [32464, 0.009894, " what", false], [332, 0.007488, " a", false], [52127, 0.003534, " lessons", false]]], "qwen": [419, 1, 0.472516268491745, [[419, 0.472516, " this", false], [279, 0.384657, " the", false], [1493, 0.041137, " these", false], [1246, 0.019493, " how", false], [20219, 0.010266, " Moore", false], [429, 0.008741, " that", false], [1128, 0.007593, " what", false], [18366, 0.004646, " lessons", false], [862, 0.004166, " their", false], [4586, 0.002033, " general", false]]]}, "raw_delta": 0.0016258835792541393, "tuned_delta": 0.010197675609832388}, {"byte_start": 1321, "byte_end": 1328, "display": {"text": " bitter", "kind": "normal"}, "is_word": true, "word_id": 220, "word_key": " bitter", "bytes_hex": "20 62 69 74 74 65 72", "compression": {"rwkv": "18.11% 18.11% 18.11% 18.11% 18.11% 18.11% 18.11%", "qwen": "13.15% 13.15% 13.15% 13.15% 13.15% 13.15% 13.15%"}, "model_tokens": {"rwkv": [[45315, " bitter", "normal", 0.000874691060744226]], "qwen": [[25180, " bitter", "normal", 0.006068412680178881]]}, "loss": {"rwkv": 18.114195546875937, "qwen": 13.150830294665546}, "topk": {"rwkv": [45315, 46, 0.000874691060744226, [[46430, 0.570191, " lesson", false], [30808, 0.080296, " fact", false], [4596, 0.031999, " in", false], [45, 0.028183, ",", false], [47, 0.022626, ".", false], [45805, 0.018087, " during", false], [40029, 0.017817, " truth", false], [31601, 0.017807, " over", false], [39310, 0.016515, " point", false], [63591, 0.013891, " fundamental", false]]], "qwen": [25180, 16, 0.006068412680178881, [[17755, 0.46085, " lesson", false], [8046, 0.050063, " truth", false], [2097, 0.04775, " fact", false], [13, 0.041519, ".", false], [11, 0.03482, ",", false], [304, 0.03178, " in", false], [17508, 0.019368, " principle", false], [916, 0.016598, " over", false], [2989, 0.015332, " important", false], [504, 0.009869, " from", false]]]}, "raw_delta": 0.2752274104527066, "tuned_delta": 0.28379920248328483}, {"byte_start": 1328, "byte_end": 1335, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 221, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"rwkv": "0.08% 0.08% 0.08% 0.08% 0.08% 0.08% 0.08%", "qwen": "0.31% 0.31% 0.31% 0.31% 0.31% 0.31% 0.31%"}, "model_tokens": {"rwkv": [[46430, " lesson", "normal", 0.9681681990623474]], "qwen": [[17755, " lesson", "normal", 0.8855627179145813]]}, "loss": {"rwkv": 0.08365236137967011, "qwen": 0.31309572112121836}, "topk": {"rwkv": [46430, 1, 0.9681681990623474, [[46430, 0.968168, " lesson", false], [40029, 0.014764, " truth", false], [30808, 0.001671, " fact", false], [45, 0.001323, ",", false], [46454, 0.001276, " little", false], [21400, 0.000933, " but", false], [31683, 0.000757, " pill", false], [52127, 0.000645, " lessons", false], [21265, 0.000598, " and", false], [7513, 0.000549, "est", false]]], "qwen": [17755, 1, 0.8855627179145813, [[17755, 0.885563, " lesson", false], [8046, 0.06927, " truth", false], [8729, 0.00557, " reality", false], [11, 0.003873, ",", false], [320, 0.003319, " (", false], [323, 0.002949, " and", false], [714, 0.002562, " but", false], [3139, 0.001814, " experience", false], [2097, 0.001787, " fact", false], [15177, 0.001644, " pill", false]]]}, "raw_delta": -0.012723041432244437, "tuned_delta": -0.004151249401666189}, {"byte_start": 1335, "byte_end": 1336, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "30.01%", "qwen": "27.29%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.19484630227088928]], "qwen": [[11, ",", "normal", 0.22016479074954987]]}, "loss": {"rwkv": 30.00918395599113, "qwen": 27.29180432778036}, "topk": {"rwkv": [45, 2, 0.19484630227088928, [[47, 0.306842, ".", false], [45, 0.194846, ",", false], [4596, 0.158516, " in", false], [31601, 0.066778, " over", false], [45805, 0.048276, " during", false], [59, 0.021409, ":", false], [32227, 0.020235, " that", false], [37634, 0.014823, " after", false], [30917, 0.012115, " from", false], [4423, 0.011576, " as", false]]], "qwen": [11, 2, 0.22016479074954987, [[13, 0.405673, ".", false], [11, 0.220165, ",", false], [304, 0.093385, " in", false], [916, 0.030259, " over", false], [25, 0.029627, ":", false], [2337, 0.021025, " during", false], [320, 0.013752, " (", false], [504, 0.013353, " from", false], [26, 0.012638, ";", false], [1573, 0.011087, " before", false]]]}, "raw_delta": 0.15068352222442627, "tuned_delta": 0.15925531425500453}, {"byte_start": 1336, "byte_end": 1340, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 222, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "8.31% 8.31% 8.31% 8.31%", "qwen": "8.53% 8.53% 8.53% 8.53%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.15665288269519806]], "qwen": [[323, " and", "normal", 0.15088005363941193]]}, "loss": {"rwkv": 8.312403067621956, "qwen": 8.52664346813911}, "topk": {"rwkv": [21265, 2, 0.15665288269519806, [[21400, 0.328388, " but", false], [21265, 0.156653, " and", false], [59841, 0.04821, " including", false], [40186, 0.037553, " which", false], [4423, 0.02878, " as", false], [32139, 0.024238, " such", false], [4596, 0.020691, " in", false], [30917, 0.015871, " from", false], [57295, 0.014906, " starting", false], [37634, 0.013393, " after", false]]], "qwen": [323, 2, 0.15088005363941193, [[714, 0.256902, " but", false], [323, 0.15088, " and", false], [2670, 0.06764, " including", false], [1741, 0.031191, " such", false], [1429, 0.030556, " most", false], [892, 0.024749, " which", false], [3545, 0.023168, " often", false], [1045, 0.021803, " some", false], [438, 0.021583, " as", false], [504, 0.02001, " from", false]]]}, "raw_delta": -0.01188001036643982, "tuned_delta": -0.003308218335861571}, {"byte_start": 1340, "byte_end": 1343, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 223, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "16.16% 16.16% 16.16%", "qwen": "17.43% 17.43% 17.43%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.06742258369922638]], "qwen": [[432, " it", "normal", 0.05506710335612297]]}, "loss": {"rwkv": 16.15517884328787, "qwen": 17.427773067479766}, "topk": {"rwkv": [4601, 4, 0.06742258369922638, [[22590, 0.108091, " the", false], [31370, 0.090336, " many", false], [39934, 0.069697, " there", false], [4601, 0.067423, " it", false], [308, 0.046217, " I", false], [32074, 0.035824, " some", false], [4706, 0.035493, " of", false], [32232, 0.031075, " they", false], [332, 0.026151, " a", false], [32234, 0.023182, " this", false]]], "qwen": [432, 4, 0.05506710335612297, [[279, 0.090421, " the", false], [1657, 0.079639, " many", false], [1045, 0.060173, " some", false], [432, 0.055067, " it", false], [358, 0.049406, " I", false], [807, 0.046728, " they", false], [304, 0.043768, " in", false], [1052, 0.042553, " there", false], [419, 0.037198, " this", false], [264, 0.030768, " a", false]]]}, "raw_delta": -0.07056760787963867, "tuned_delta": -0.06199581584906042}, {"byte_start": 1343, "byte_end": 1346, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 224, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "8.97% 8.97% 8.97%", "qwen": "8.51% 8.51% 8.51%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.22523117065429688]], "qwen": [[374, " is", "normal", 0.24256405234336853]]}, "loss": {"rwkv": 8.969881276360416, "qwen": 8.514843129358189}, "topk": {"rwkv": [4600, 1, 0.22523117065429688, [[4600, 0.225231, " is", false], [22748, 0.150831, " was", false], [460, 0.121432, "'s", false], [32272, 0.080876, " took", false], [21800, 0.054031, " has", false], [40219, 0.0229, " would", false], [39620, 0.018985, " seems", false], [59393, 0.015811, " continues", false], [39820, 0.013745, " still", false], [52701, 0.011672, " remains", false]]], "qwen": [374, 1, 0.24256405234336853, [[374, 0.242564, " is", false], [572, 0.19145, " was", false], [594, 0.078296, "'s", false], [3867, 0.069163, " took", false], [702, 0.052033, " has", false], [1035, 0.019592, " would", false], [4977, 0.01895, " seems", false], [646, 0.014081, " can", false], [6069, 0.012516, " led", false], [1231, 0.012319, " may", false]]]}, "raw_delta": 0.025232672691345215, "tuned_delta": 0.033804464721923465}, {"byte_start": 1346, "byte_end": 1355, "display": {"text": " instruct", "kind": "normal"}, "is_word": true, "word_id": 225, "word_key": " instruct", "bytes_hex": "20 69 6e 73 74 72 75 63 74", "compression": {"rwkv": "8.14% 8.14% 8.14% 8.14% 8.14% 8.14% 8.14% 8.14% 8.14%", "qwen": "7.18% 7.18% 7.18% 7.18% 7.18% 7.18% 7.18% 7.18% 7.18%"}, "model_tokens": {"rwkv": [[56469, " instruct", "normal", 0.017296679317951202]], "qwen": [[21066, " instruct", "normal", 0.027793802320957184]]}, "loss": {"rwkv": 8.14020639390474, "qwen": 7.179295850141927}, "topk": {"rwkv": [56469, 10, 0.017296679317951202, [[22187, 0.117222, " not", false], [332, 0.0805, " a", false], [39820, 0.063108, " still", false], [22226, 0.062491, " one", false], [40218, 0.041248, " worth", false], [31581, 0.028223, " only", false], [22590, 0.020621, " the", false], [31048, 0.019876, " hard", false], [59829, 0.01731, " important", false], [56469, 0.017297, " instruct", false]]], "qwen": [21066, 6, 0.027793802320957184, [[537, 0.062966, " not", false], [264, 0.055177, " a", false], [5802, 0.052327, " worth", false], [2588, 0.032805, " hard", false], [2058, 0.031659, " still", false], [21066, 0.027794, " instruct", false], [279, 0.025145, " the", false], [2989, 0.024531, " important", false], [825, 0.022382, " one", false], [4135, 0.021515, " easy", false]]]}, "raw_delta": 0.05328419473436147, "tuned_delta": 0.06185598676493972}, {"byte_start": 1355, "byte_end": 1358, "display": {"text": "ive", "kind": "normal"}, "is_word": true, "word_id": 226, "word_key": "ive", "bytes_hex": "69 76 65", "compression": {"rwkv": "0.01% 0.01% 0.01%", "qwen": "0.01% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[7938, "ive", "normal", 0.9983742237091064]], "qwen": [[533, "ive", "normal", 0.9985384941101074]]}, "loss": {"rwkv": 0.009860338649467695, "qwen": 0.008791913226163243}, "topk": {"rwkv": [7938, 1, 0.9983742237091064, [[7938, 0.998374, "ive", false], [7856, 0.000744, "ing", false], [34918, 0.000723, "ively", false], [4811, 3.1e-05, " to", false], [24381, 1.5e-05, "able", false], [25656, 1.2e-05, "ible", false], [1958, 6e-06, "iv", false], [2255, 6e-06, "ve", false], [49338, 5e-06, "iveness", false], [33948, 5e-06, "ative", false]]], "qwen": [533, 1, 0.9985384941101074, [[533, 0.998538, "ive", false], [3132, 0.000996, "ively", false], [1262, 0.000238, "ful", false], [287, 9.4e-05, "ing", false], [1388, 4.7e-05, "ative", false], [1238, 1.1e-05, "ible", false], [480, 7e-06, "able", false], [311, 6e-06, " to", false], [344, 6e-06, "iv", false], [82, 4e-06, "s", false]]]}, "raw_delta": 5.924608558416372e-05, "tuned_delta": 0.008631038116162412}, {"byte_start": 1358, "byte_end": 1361, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 227, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.85% 0.85% 0.85%", "qwen": "0.73% 0.73% 0.73%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.8673887848854065]], "qwen": [[311, " to", "normal", 0.8852441310882568]]}, "loss": {"rwkv": 0.8511994666703275, "qwen": 0.7327195883865194}, "topk": {"rwkv": [4811, 1, 0.8673887848854065, [[4811, 0.867389, " to", false], [32227, 0.050323, " that", false], [21700, 0.016309, " for", false], [47, 0.015216, ".", false], [4596, 0.007946, " in", false], [21265, 0.007142, " and", false], [21835, 0.00447, " how", false], [45, 0.004036, ",", false], [4423, 0.003195, " as", false], [31077, 0.002264, " here", false]]], "qwen": [311, 1, 0.8852441310882568, [[311, 0.885244, " to", false], [429, 0.027062, " that", false], [369, 0.016089, " for", false], [13, 0.015356, ".", false], [304, 0.00887, " in", false], [11, 0.006595, ",", false], [323, 0.003971, " and", false], [1588, 0.003628, " here", false], [537, 0.002653, " not", false], [315, 0.002501, " of", false]]]}, "raw_delta": 0.006569919486840568, "tuned_delta": 0.015141711517418817}, {"byte_start": 1361, "byte_end": 1368, "display": {"text": " review", "kind": "normal"}, "is_word": true, "word_id": 228, "word_key": " review", "bytes_hex": "20 72 65 76 69 65 77", "compression": {"rwkv": "6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68%", "qwen": "8.00% 8.00% 8.00% 8.00% 8.00% 8.00% 8.00%"}, "model_tokens": {"rwkv": [[47108, " review", "normal", 0.07426609098911285]], "qwen": [[3395, " review", "normal", 0.04484003409743309]]}, "loss": {"rwkv": 6.6821254684031235, "qwen": 7.998336949748838}, "topk": {"rwkv": [47108, 4, 0.07426609098911285, [[31324, 0.203314, " look", false], [22449, 0.081474, " see", false], [55832, 0.076239, " consider", false], [47108, 0.074266, " review", false], [51667, 0.045202, " examine", false], [52751, 0.038728, " revisit", false], [31834, 0.024186, " read", false], [52672, 0.021541, " reflect", false], [39942, 0.019766, " think", false], [38877, 0.019247, " learn", false]]], "qwen": [3395, 5, 0.04484003409743309, [[1401, 0.232227, " look", false], [1490, 0.08595, " see", false], [2908, 0.08425, " consider", false], [20961, 0.046059, " examine", false], [3395, 0.04484, " review", false], [1140, 0.028893, " list", false], [1896, 0.020682, " take", false], [11167, 0.019772, " highlight", false], [1349, 0.019264, " read", false], [38296, 0.016471, " cite", false]]]}, "raw_delta": -0.07298626218523296, "tuned_delta": -0.06441447015465472}, {"byte_start": 1368, "byte_end": 1373, "display": {"text": " some", "kind": "normal"}, "is_word": true, "word_id": 229, "word_key": " some", "bytes_hex": "20 73 6f 6d 65", "compression": {"rwkv": "3.97% 3.97% 3.97% 3.97% 3.97%", "qwen": "3.33% 3.33% 3.33% 3.33% 3.33%"}, "model_tokens": {"rwkv": [[32074, " some", "normal", 0.3287736773490906]], "qwen": [[1045, " some", "normal", 0.39698800444602966]]}, "loss": {"rwkv": 3.9730468899481215, "qwen": 3.33208173875113}, "topk": {"rwkv": [32074, 1, 0.3287736773490906, [[32074, 0.328774, " some", false], [32229, 0.230669, " them", false], [332, 0.16902, " a", false], [22590, 0.085175, " the", false], [39936, 0.029564, " these", false], [39944, 0.022045, " those", false], [52869, 0.013726, " several", false], [32464, 0.011551, " what", false], [22226, 0.009252, " one", false], [31198, 0.009173, " just", false]]], "qwen": [1045, 1, 0.39698800444602966, [[1045, 0.396988, " some", false], [1105, 0.183857, " them", false], [264, 0.129938, " a", false], [279, 0.071827, " the", false], [1846, 0.032438, " those", false], [1493, 0.028706, " these", false], [862, 0.018064, " their", false], [3807, 0.015456, " several", false], [1246, 0.013721, " how", false], [1128, 0.013609, " what", false]]]}, "raw_delta": 0.03554265499114989, "tuned_delta": 0.04411444702172814}, {"byte_start": 1373, "byte_end": 1376, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 230, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "1.12% 1.12% 1.12%", "qwen": "1.10% 1.10% 1.10%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.8286420106887817]], "qwen": [[315, " of", "normal", 0.8333882093429565]]}, "loss": {"rwkv": 1.1153648183956015, "qwen": 1.0955809912170524}, "topk": {"rwkv": [4706, 1, 0.8286420106887817, [[4706, 0.828642, " of", false], [47, 0.06279, ".", false], [56162, 0.026725, " examples", false], [32227, 0.007027, " that", false], [59, 0.004101, ":", false], [45, 0.004093, ",", false], [47014, 0.00407, " recent", false], [37970, 0.003799, " cases", false], [30917, 0.002866, " from", false], [21952, 0.002137, " key", false]]], "qwen": [315, 1, 0.8333882093429565, [[315, 0.833388, " of", false], [13, 0.05021, ".", false], [429, 0.014256, " that", false], [10295, 0.013134, " examples", false], [624, 0.007572, ".\n", false], [11, 0.0059, ",", false], [5048, 0.005518, " cases", false], [304, 0.004061, " in", false], [3213, 0.003573, " recent", false], [1376, 0.002602, " key", false]]]}, "raw_delta": 0.0010970483223597255, "tuned_delta": 0.009668840352937974}, {"byte_start": 1376, "byte_end": 1380, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 231, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "7.40% 7.40% 7.40% 7.40%", "qwen": "8.53% 8.53% 8.53% 8.53%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.19532449543476105]], "qwen": [[279, " the", "normal", 0.15079525113105774]]}, "loss": {"rwkv": 7.396629848307673, "qwen": 8.5291780624562}, "topk": {"rwkv": [22590, 2, 0.19532449543476105, [[32229, 0.596575, " them", false], [22590, 0.195324, " the", false], [39936, 0.134746, " these", false], [39944, 0.054173, " those", false], [39931, 0.01107, " their", false], [32234, 0.001394, " this", false], [32464, 0.001147, " what", false], [32227, 0.000845, " that", false], [4677, 0.000721, " my", false], [22248, 0.000481, " our", false]]], "qwen": [279, 2, 0.15079525113105774, [[1105, 0.632266, " them", false], [279, 0.150795, " the", false], [1493, 0.111533, " these", false], [1846, 0.076856, " those", false], [862, 0.017848, " their", false], [1181, 0.004362, " its", false], [419, 0.001052, " this", false], [432, 0.000924, " it", false], [429, 0.000873, " that", false], [1128, 0.000716, " what", false]]]}, "raw_delta": -0.06280180811882019, "tuned_delta": -0.05423001608824194}, {"byte_start": 1380, "byte_end": 1385, "display": {"text": " most", "kind": "normal"}, "is_word": true, "word_id": 232, "word_key": " most", "bytes_hex": "20 6d 6f 73 74", "compression": {"rwkv": "6.42% 6.42% 6.42% 6.42% 6.42%", "qwen": "5.22% 5.22% 5.22% 5.22% 5.22%"}, "model_tokens": {"rwkv": [[31461, " most", "normal", 0.16908559203147888]], "qwen": [[1429, " most", "normal", 0.2352813184261322]]}, "loss": {"rwkv": 6.424501353958664, "qwen": 5.218853526398253}, "topk": {"rwkv": [31461, 1, 0.16908559203147888, [[31461, 0.169086, " most", false], [56162, 0.072147, " examples", false], [31458, 0.068466, " more", false], [37970, 0.045497, " cases", false], [32448, 0.040482, " ways", false], [21952, 0.02283, " key", false], [38328, 0.021576, " early", false], [30273, 0.020988, " best", false], [31580, 0.01857, " ones", false], [56652, 0.017062, " mistakes", false]]], "qwen": [1429, 1, 0.2352813184261322, [[1429, 0.235281, " most", false], [803, 0.115337, " more", false], [1376, 0.040874, " key", false], [10295, 0.033427, " examples", false], [3598, 0.029234, " major", false], [1850, 0.02745, " best", false], [5510, 0.024026, " ways", false], [5048, 0.020669, " cases", false], [6174, 0.016742, " ones", false], [18366, 0.01493, " lessons", false]]]}, "raw_delta": 0.06685531139373779, "tuned_delta": 0.07542710342431604}, {"byte_start": 1385, "byte_end": 1395, "display": {"text": " prominent", "kind": "normal"}, "is_word": true, "word_id": 233, "word_key": " prominent", "bytes_hex": "20 70 72 6f 6d 69 6e 65 6e 74", "compression": {"rwkv": "3.80% 3.80% 3.80% 3.80% 3.80% 3.80% 3.80% 3.80% 3.80% 3.80%", "qwen": "3.58% 3.58% 3.58% 3.58% 3.58% 3.58% 3.58% 3.58% 3.58% 3.58%"}, "model_tokens": {"rwkv": [[60273, " prominent", "normal", 0.12190701812505722]], "qwen": [[20469, " prominent", "normal", 0.13768811523914337]]}, "loss": {"rwkv": 3.803981064843946, "qwen": 3.5756549627536587}, "topk": {"rwkv": [60273, 1, 0.12190701812505722, [[60273, 0.121907, " prominent", false], [52321, 0.089666, " notable", false], [59829, 0.086941, " important", false], [45958, 0.071268, " famous", false], [57323, 0.057441, " striking", false], [52796, 0.042793, " salient", false], [56056, 0.035765, " dramatic", false], [63870, 0.03498, " significant", false], [52346, 0.0335, " obvious", false], [47014, 0.032097, " recent", false]]], "qwen": [20469, 2, 0.13768811523914337, [[27190, 0.155824, " notable", false], [20469, 0.137688, " prominent", false], [2989, 0.103076, " important", false], [11245, 0.07209, " famous", false], [89068, 0.059458, " egregious", false], [21771, 0.050865, " dramatic", false], [5089, 0.043584, " significant", false], [4274, 0.026176, " sal", false], [7040, 0.020387, " interesting", false], [4185, 0.018432, " common", false]]]}, "raw_delta": 0.01266108751296996, "tuned_delta": 0.02123287954354821}, {"byte_start": 1395, "byte_end": 1397, "display": {"text": ".\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e 0a", "compression": {"rwkv": "19.58% 23.67%", "qwen": "47.88% 47.88%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.33353230357170105], [261, "\n\n", "control", 0.0719975084066391]], "qwen": [[382, ".\n\n", "control", 0.0003474658587947488]]}, "loss": {"rwkv": 21.626336794575767, "qwen": 47.87850528129607}, "topk": {"rwkv": [47, 1, 0.33353230357170105, [[47, 0.333532, ".", false], [56162, 0.160815, " examples", false], [31580, 0.159719, " ones", false], [4706, 0.08361, " of", false], [37970, 0.06234, " cases", false], [21265, 0.029149, " and", false], [45, 0.023184, ",", false], [59, 0.020474, ":", false], [4596, 0.012404, " in", false], [56200, 0.008557, " failures", false]]], "qwen": [382, 68, 0.0003474658587947488, [[6174, 0.231678, " ones", false], [13, 0.230389, ".", false], [10295, 0.146838, " examples", false], [5048, 0.070555, " cases", false], [315, 0.062951, " of", false], [323, 0.03409, " and", false], [624, 0.033358, ".\n", false], [11, 0.029415, ",", false], [4221, 0.014615, " among", false], [27850, 0.010837, " failures", false]]]}, "raw_delta": -1.4557293256123862, "tuned_delta": -1.4471575335818079}, {"byte_start": 1397, "byte_end": 1398, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "23.67%", "qwen": "47.88%"}, "model_tokens": {"rwkv": [[261, "\n\n", "control", 0.0719975084066391]], "qwen": [[382, ".\n\n", "control", 0.0003474658587947488]]}, "loss": {"rwkv": 23.669215514584554, "qwen": 47.87850528129607}, "topk": {"rwkv": [261, 3, 0.0719975084066391, [[267, 0.229874, "  ", false], [11, 0.21496, "\n", false], [261, 0.071998, "\n\n", false], [20996, 0.069066, " The", false], [3913, 0.033704, " In", false], [20556, 0.017704, " One", false], [265, 0.015609, " \n", false], [308, 0.013084, " I", false], [19907, 0.011463, " For", false], [37453, 0.009139, " These", false]]], "qwen": [382, 68, 0.0003474658587947488, [[6174, 0.231678, " ones", false], [13, 0.230389, ".", false], [10295, 0.146838, " examples", false], [5048, 0.070555, " cases", false], [315, 0.062951, " of", false], [323, 0.03409, " and", false], [624, 0.033358, ".\n", false], [11, 0.029415, ",", false], [4221, 0.014615, " among", false], [27850, 0.010837, " failures", false]]]}, "raw_delta": -1.3424480756123862, "tuned_delta": -1.3338762835818079}, {"byte_start": 1398, "byte_end": 1400, "display": {"text": "In", "kind": "normal"}, "is_word": true, "word_id": 234, "word_key": "in", "bytes_hex": "49 6e", "compression": {"rwkv": "30.01% 30.01%", "qwen": "28.37% 28.37%"}, "model_tokens": {"rwkv": [[1136, "In", "normal", 0.036061257123947144]], "qwen": [[641, "In", "normal", 0.043021783232688904]]}, "loss": {"rwkv": 30.00918395599113, "qwen": 28.367428971722216}, "topk": {"rwkv": [1136, 3, 0.036061257123947144, [[53648, 0.37618, "Question", false], [6699, 0.074905, "The", false], [1136, 0.036061, "In", false], [66, 0.026082, "A", false], [6393, 0.018312, "One", false], [33161, 0.016189, "Human", false], [820, 0.014187, "AI", false], [50, 0.010306, "1", false], [33504, 0.006586, "There", false], [24242, 0.006425, "This", false]]], "qwen": [641, 2, 0.043021783232688904, [[785, 0.132259, "The", false], [641, 0.043022, "In", false], [16, 0.029539, "1", false], [33975, 0.027545, "Human", false], [32, 0.022505, "A", false], [3966, 0.01935, "One", false], [22029, 0.013633, "Figure", false], [5338, 0.012848, "First", false], [2132, 0.011323, "It", false], [17, 0.009716, "2", false]]]}, "raw_delta": 0.09103822708129883, "tuned_delta": 0.09961001911187707}, {"byte_start": 1400, "byte_end": 1409, "display": {"text": " computer", "kind": "normal"}, "is_word": true, "word_id": 235, "word_key": " computer", "bytes_hex": "20 63 6f 6d 70 75 74 65 72", "compression": {"rwkv": "11.02% 11.02% 11.02% 11.02% 11.02% 11.02% 11.02% 11.02% 11.02%", "qwen": "12.68% 12.68% 12.68% 12.68% 12.68% 12.68% 12.68% 12.68% 12.68%"}, "model_tokens": {"rwkv": [[55809, " computer", "normal", 0.003919978626072407]], "qwen": [[6366, " computer", "normal", 0.001782963052392006]]}, "loss": {"rwkv": 11.020587117901803, "qwen": 12.682649431400927}, "topk": {"rwkv": [55809, 21, 0.003919978626072407, [[22590, 0.392629, " the", false], [3492, 0.203776, " 19", false], [3493, 0.037114, " 20", false], [332, 0.029135, " a", false], [21823, 0.016887, " his", false], [38328, 0.01654, " early", false], [31370, 0.015106, " many", false], [32234, 0.014, " this", false], [62293, 0.012302, " particular", false], [4677, 0.009593, " my", false]]], "qwen": [6366, 32, 0.001782963052392006, [[279, 0.399548, " the", false], [220, 0.326221, " ", false], [264, 0.019494, " a", false], [825, 0.011365, " one", false], [419, 0.009697, " this", false], [847, 0.008932, " my", false], [1657, 0.007462, " many", false], [1045, 0.006665, " some", false], [71278, 0.006415, " reinforcement", false], [806, 0.00632, " his", false]]]}, "raw_delta": -0.09216430452134872, "tuned_delta": -0.08359251249077047}, {"byte_start": 1409, "byte_end": 1415, "display": {"text": " chess", "kind": "normal"}, "is_word": true, "word_id": 236, "word_key": " chess", "bytes_hex": "20 63 68 65 73 73", "compression": {"rwkv": "13.06% 13.06% 13.06% 13.06% 13.06% 13.06%", "qwen": "7.39% 7.39% 7.39% 7.39% 7.39% 7.39%"}, "model_tokens": {"rwkv": [[38013, " chess", "normal", 0.012850133702158928]], "qwen": [[32719, " chess", "normal", 0.08553595095872879]]}, "loss": {"rwkv": 13.055638716377988, "qwen": 7.39026075747072}, "topk": {"rwkv": [38013, 5, 0.012850133702158928, [[47732, 0.682616, " vision", false], [52814, 0.189248, " science", false], [56329, 0.042617, " graphics", false], [38576, 0.019965, " games", false], [38013, 0.01285, " chess", false], [46, 0.012509, "-", false], [63795, 0.004776, " programming", false], [46075, 0.002631, " gaming", false], [57181, 0.002139, " security", false], [64254, 0.001833, " architecture", false]]], "qwen": [32719, 3, 0.08553595095872879, [[11129, 0.712659, " vision", false], [8038, 0.097844, " science", false], [32719, 0.085536, " chess", false], [3868, 0.012228, " games", false], [5994, 0.011351, " Go", false], [1809, 0.008439, " game", false], [14181, 0.006157, " graphics", false], [12, 0.005733, "-", false], [1506, 0.004232, "ized", false], [15473, 0.003795, " programming", false]]]}, "raw_delta": 0.31415526072184247, "tuned_delta": 0.3227270527524207}, {"byte_start": 1415, "byte_end": 1416, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "3.59%", "qwen": "5.84%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8189488053321838]], "qwen": [[11, ",", "normal", 0.7231948971748352]]}, "loss": {"rwkv": 3.592648783463727, "qwen": 5.84429509357174}, "topk": {"rwkv": [45, 1, 0.8189488053321838, [[45, 0.818949, ",", false], [21265, 0.018424, " and", false], [22590, 0.016361, " the", false], [4596, 0.014915, " in", false], [275, 0.0128, " (", false], [39934, 0.010286, " there", false], [4858, 0.008815, " we", false], [3609, 0.004934, " AI", false], [4601, 0.004804, " it", false], [11, 0.004743, "\n", false]]], "qwen": [11, 1, 0.7231948971748352, [[11, 0.723195, ",", false], [320, 0.040994, " (", false], [7468, 0.030147, " programs", false], [304, 0.029816, " in", false], [3412, 0.019746, " research", false], [323, 0.01594, " and", false], [279, 0.013935, " the", false], [1052, 0.012069, " there", false], [369, 0.007485, " for", false], [432, 0.005921, " it", false]]]}, "raw_delta": -0.12485778331756592, "tuned_delta": -0.11628599128698767}, {"byte_start": 1416, "byte_end": 1420, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 237, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "5.39% 5.39% 5.39% 5.39%", "qwen": "6.35% 6.35% 6.35% 6.35%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.30426910519599915]], "qwen": [[279, " the", "normal", 0.24443350732326508]]}, "loss": {"rwkv": 5.3889731751955905, "qwen": 6.351518688749366}, "topk": {"rwkv": [22590, 1, 0.30426910519599915, [[22590, 0.304269, " the", false], [21700, 0.06704, " for", false], [332, 0.042806, " a", false], [4601, 0.04143, " it", false], [22226, 0.028704, " one", false], [39934, 0.024578, " there", false], [4596, 0.017291, " in", false], [63843, 0.013153, " researchers", false], [38328, 0.011117, " early", false], [31370, 0.009775, " many", false]]], "qwen": [279, 1, 0.24443350732326508, [[279, 0.244434, " the", false], [264, 0.051798, " a", false], [369, 0.051381, " for", false], [1052, 0.042275, " there", false], [432, 0.040178, " it", false], [11811, 0.018852, " researchers", false], [304, 0.017217, " in", false], [825, 0.016138, " one", false], [32719, 0.013971, " chess", false], [892, 0.011749, " which", false]]]}, "raw_delta": -0.05337485671043396, "tuned_delta": -0.04480306467985571}, {"byte_start": 1420, "byte_end": 1428, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 238, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "14.23% 14.23% 14.23% 14.23% 14.23% 14.23% 14.23% 14.23%", "qwen": "14.12% 14.12% 14.12% 14.12% 14.12% 14.12% 14.12% 14.12%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.0018233939772471786]], "qwen": [[5413, " methods", "normal", 0.0019067905377596617]]}, "loss": {"rwkv": 14.229706946268095, "qwen": 14.116621903976391}, "topk": {"rwkv": [52224, 90, 0.0018233939772471786, [[38499, 0.126427, " first", false], [31461, 0.041958, " most", false], [30273, 0.027797, " best", false], [38328, 0.023165, " early", false], [31581, 0.019253, " only", false], [38720, 0.018662, " human", false], [39802, 0.015406, " state", false], [31356, 0.014352, " main", false], [3492, 0.011422, " 19", false], [52013, 0.010364, " initial", false]]], "qwen": [5413, 86, 0.0019067905377596617, [[1156, 0.0676, " first", false], [1429, 0.042103, " most", false], [1850, 0.030411, " best", false], [4124, 0.021152, " early", false], [3738, 0.020591, " human", false], [220, 0.016693, " ", false], [17755, 0.015041, " lesson", false], [3491, 0.01422, " problem", false], [5486, 0.012232, " approach", false], [2856, 0.01215, " initial", false]]]}, "raw_delta": 0.006270766258239746, "tuned_delta": 0.014842558288817994}, {"byte_start": 1428, "byte_end": 1433, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 239, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "3.86% 3.86% 3.86% 3.86% 3.86%", "qwen": "4.31% 4.31% 4.31% 4.31% 4.31%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.34377023577690125]], "qwen": [[429, " that", "normal", 0.3024786710739136]]}, "loss": {"rwkv": 3.860336339878671, "qwen": 4.3127367029732895}, "topk": {"rwkv": [32227, 1, 0.34377023577690125, [[32227, 0.34377, " that", false], [4706, 0.242646, " of", false], [32354, 0.03598, " used", false], [37810, 0.034131, " based", false], [59506, 0.033568, " developed", false], [21700, 0.032062, " for", false], [31461, 0.025372, " most", false], [32462, 0.017815, " were", false], [59206, 0.00914, " available", false], [4811, 0.007823, " to", false]]], "qwen": [429, 1, 0.3024786710739136, [[429, 0.302479, " that", false], [315, 0.16364, " of", false], [369, 0.053253, " for", false], [1483, 0.048816, " used", false], [7881, 0.047778, " developed", false], [1033, 0.037098, " were", false], [525, 0.017987, " are", false], [3118, 0.016369, " based", false], [614, 0.01535, " have", false], [1429, 0.014283, " most", false]]]}, "raw_delta": -0.025086402893066406, "tuned_delta": -0.016514610862488156}, {"byte_start": 1433, "byte_end": 1442, "display": {"text": " defeated", "kind": "normal"}, "is_word": true, "word_id": 240, "word_key": " defeated", "bytes_hex": "20 64 65 66 65 61 74 65 64", "compression": {"rwkv": "14.53% 14.53% 14.53% 14.53% 14.53% 14.53% 14.53% 14.53% 14.53%", "qwen": "15.80% 15.80% 15.80% 15.80% 15.80% 15.80% 15.80% 15.80% 15.80%"}, "model_tokens": {"rwkv": [[55934, " defeated", "normal", 0.0007086691330187023]], "qwen": [[23283, " defeated", "normal", 0.00037607268313877285]]}, "loss": {"rwkv": 14.527137564506921, "qwen": 15.800972930162544}, "topk": {"rwkv": [55934, 130, 0.0007086691330187023, [[56540, 0.134546, " leverage", false], [32462, 0.100875, " were", false], [31059, 0.058523, " have", false], [47812, 0.040695, " worked", false], [22777, 0.040539, " won", false], [21286, 0.031806, " are", false], [31351, 0.030178, " made", false], [21795, 0.020883, " had", false], [32272, 0.016664, " took", false], [61959, 0.01644, " eventually", false]]], "qwen": [23283, 231, 0.00037607268313877285, [[1033, 0.102351, " were", false], [614, 0.076363, " have", false], [32064, 0.056497, " leverage", false], [525, 0.055837, " are", false], [27505, 0.033256, " lever", false], [6439, 0.030144, " worked", false], [29701, 0.024997, " dominated", false], [975, 0.01789, " work", false], [1865, 0.016655, " made", false], [18651, 0.013735, " proved", false]]]}, "raw_delta": -0.07063643137613929, "tuned_delta": -0.062064639345561036}, {"byte_start": 1442, "byte_end": 1446, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 241, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "3.89% 3.89% 3.89% 3.89%", "qwen": "5.75% 5.75% 5.75% 5.75%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.42165428400039673]], "qwen": [[279, " the", "normal", 0.27914050221443176]]}, "loss": {"rwkv": 3.892036182085704, "qwen": 5.7529271605177374}, "topk": {"rwkv": [22590, 1, 0.42165428400039673, [[22590, 0.421654, " the", false], [38720, 0.083178, " human", false], [20184, 0.075613, " Kas", false], [38013, 0.072637, " chess", false], [40213, 0.053899, " world", false], [19948, 0.035155, " Gar", false], [46227, 0.028764, " humans", false], [38621, 0.028033, " grand", false], [22615, 0.012024, " top", false], [332, 0.010923, " a", false]]], "qwen": [279, 1, 0.27914050221443176, [[279, 0.279141, " the", false], [1879, 0.105652, " world", false], [3738, 0.097588, " human", false], [12677, 0.088407, " humans", false], [6662, 0.064503, " grand", false], [1909, 0.062897, " top", false], [32719, 0.05791, " chess", false], [3746, 0.012339, " strong", false], [678, 0.010331, " all", false], [37542, 0.009515, " Kas", false]]]}, "raw_delta": -0.10318970680236816, "tuned_delta": -0.09461791477178992}, {"byte_start": 1446, "byte_end": 1452, "display": {"text": " world", "kind": "normal"}, "is_word": true, "word_id": 242, "word_key": " world", "bytes_hex": "20 77 6f 72 6c 64", "compression": {"rwkv": "2.32% 2.32% 2.32% 2.32% 2.32% 2.32%", "qwen": "4.30% 4.30% 4.30% 4.30% 4.30% 4.30%"}, "model_tokens": {"rwkv": [[40213, " world", "normal", 0.4585268199443817]], "qwen": [[1879, " world", "normal", 0.2394600361585617]]}, "loss": {"rwkv": 2.3246550951824116, "qwen": 4.29613163471361}, "topk": {"rwkv": [40213, 1, 0.4585268199443817, [[40213, 0.458527, " world", false], [30273, 0.141294, " best", false], [38720, 0.092137, " human", false], [60571, 0.043762, " strongest", false], [22615, 0.038353, " top", false], [38621, 0.032671, " grand", false], [39471, 0.009689, " reign", false], [52196, 0.0082, " masters", false], [31461, 0.007884, " most", false], [37576, 0.006943, " World", false]]], "qwen": [1879, 2, 0.2394600361585617, [[1850, 0.356442, " best", false], [1879, 0.23946, " world", false], [29905, 0.048002, " strongest", false], [6662, 0.046616, " grand", false], [3738, 0.045049, " human", false], [1909, 0.040378, " top", false], [89956, 0.026188, " reigning", false], [32719, 0.013202, " chess", false], [1602, 0.012916, " very", false], [12677, 0.011226, " humans", false]]]}, "raw_delta": -0.10932187239329018, "tuned_delta": -0.10075008036271194}, {"byte_start": 1452, "byte_end": 1461, "display": {"text": " champion", "kind": "normal"}, "is_word": true, "word_id": 243, "word_key": " champion", "bytes_hex": "20 63 68 61 6d 70 69 6f 6e", "compression": {"rwkv": "0.90% 0.90% 0.90% 0.90% 0.90% 0.90% 0.90% 0.90% 0.90%", "qwen": "3.55% 3.55% 3.55% 3.55% 3.55% 3.55% 3.55% 3.55% 3.55%"}, "model_tokens": {"rwkv": [[55716, " champion", "normal", 0.6399039030075073]], "qwen": [[18319, " champion", "normal", 0.17004424333572388]]}, "loss": {"rwkv": 0.900118976249082, "qwen": 3.550024794365723}, "topk": {"rwkv": [55716, 1, 0.6399039030075073, [[55716, 0.639904, " champion", false], [59283, 0.18726, " champions", false], [460, 0.057858, "'s", false], [38013, 0.043835, " chess", false], [46, 0.015617, "-", false], [38621, 0.009147, " grand", false], [37996, 0.007886, " champ", false], [64275, 0.007686, " championship", false], [52196, 0.006802, " masters", false], [46526, 0.003423, " master", false]]], "qwen": [18319, 2, 0.17004424333572388, [[33738, 0.404083, " champions", false], [18319, 0.170044, " champion", false], [594, 0.129451, "'s", false], [32719, 0.105916, " chess", false], [14800, 0.066794, "-class", false], [536, 0.024879, " class", false], [11582, 0.016839, "-ch", false], [21553, 0.013702, " championship", false], [1909, 0.005558, " top", false], [6662, 0.005017, " grand", false]]]}, "raw_delta": -0.1469419797261556, "tuned_delta": -0.13837018769557735}, {"byte_start": 1461, "byte_end": 1462, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "47.62%", "qwen": "45.26%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.07186435908079147]], "qwen": [[11, ",", "normal", 0.08129944652318954]]}, "loss": {"rwkv": 47.620207404342736, "qwen": 45.25763013464507}, "topk": {"rwkv": [45, 3, 0.07186435908079147, [[32462, 0.233318, " were", false], [4596, 0.187459, " in", false], [45, 0.071864, ",", false], [275, 0.042282, " (", false], [21286, 0.025967, " are", false], [28951, 0.020477, " Gary", false], [52628, 0.01916, " quickly", false], [36381, 0.017631, " Bobby", false], [21265, 0.017185, " and", false], [4450, 0.014326, " by", false]]], "qwen": [11, 3, 0.08129944652318954, [[1033, 0.322275, " were", false], [304, 0.116513, " in", false], [11, 0.081299, ",", false], [525, 0.051066, " are", false], [320, 0.028895, " (", false], [37542, 0.015117, " Kas", false], [323, 0.013393, " and", false], [518, 0.013335, " at", false], [479, 0.011227, " G", false], [553, 0.00992, " by", false]]]}, "raw_delta": 0.13100910186767578, "tuned_delta": 0.13958089389825404}, {"byte_start": 1462, "byte_end": 1466, "display": {"text": " Kas", "kind": "normal"}, "is_word": true, "word_id": 244, "word_key": " kas", "bytes_hex": "20 4b 61 73", "compression": {"rwkv": "9.37% 9.37% 9.37% 9.37%", "qwen": "14.67% 14.67% 14.67% 14.67%"}, "model_tokens": {"rwkv": [[20184, " Kas", "normal", 0.12688720226287842]], "qwen": [[37542, " Kas", "normal", 0.03861033543944359]]}, "loss": {"rwkv": 9.369064474523052, "qwen": 14.671465882840577}, "topk": {"rwkv": [20184, 1, 0.12688720226287842, [[20184, 0.126887, " Kas", false], [21265, 0.07066, " and", false], [28753, 0.069056, " Deep", false], [19948, 0.067941, " Gar", false], [37404, 0.058358, " Stock", false], [22590, 0.048731, " the", false], [32139, 0.037743, " such", false], [28951, 0.036827, " Gary", false], [50239, 0.020798, " Fischer", false], [31296, 0.017045, " like", false]]], "qwen": [37542, 3, 0.03861033543944359, [[18183, 0.49022, " Deep", false], [479, 0.073292, " G", false], [37542, 0.03861, " Kas", false], [27922, 0.027501, " IBM", false], [24708, 0.025863, " Alpha", false], [279, 0.020899, " the", false], [323, 0.018803, " and", false], [2670, 0.017984, " including", false], [1075, 0.016334, " like", false], [23826, 0.010039, " Gary", false]]]}, "raw_delta": -0.29402756690979004, "tuned_delta": -0.2854557748792118}, {"byte_start": 1466, "byte_end": 1469, "display": {"text": "par", "kind": "normal"}, "is_word": true, "word_id": 245, "word_key": "par", "bytes_hex": "70 61 72", "compression": {"rwkv": "0.06% 0.06% 0.06%", "qwen": "0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[8469, "par", "normal", 0.9898763298988342]], "qwen": [[1732, "par", "normal", 0.9997996687889099]]}, "loss": {"rwkv": 0.06127168574738995, "qwen": 0.0012044744350566269}, "topk": {"rwkv": [8469, 1, 0.9898763298988342, [[8469, 0.989876, "par", false], [113, 0.002037, "p", false], [8484, 0.001454, "per", false], [2111, 0.000612, "pa", false], [2184, 0.00045, "si", false], [2190, 0.000335, "so", false], [8496, 0.000315, "pie", false], [26645, 0.000304, "para", false], [46, 0.000293, "-", false], [2124, 0.00027, "po", false]]], "qwen": [1732, 1, 0.9997996687889099, [[1732, 0.9998, "par", false], [318, 5.5e-05, "im", false], [712, 2.2e-05, "per", false], [4270, 2.1e-05, " Par", false], [4272, 1.8e-05, "Par", false], [1346, 1e-05, " par", false], [12, 6e-06, "-", false], [2396, 4e-06, "ram", false], [370, 4e-06, "ab", false], [3380, 3e-06, "pare", false]]]}, "raw_delta": 0.003330833453219384, "tuned_delta": 0.011902625483797632}, {"byte_start": 1469, "byte_end": 1471, "display": {"text": "ov", "kind": "normal"}, "is_word": true, "word_id": 246, "word_key": "ov", "bytes_hex": "6f 76", "compression": {"rwkv": "0.01% 0.01%", "qwen": "0.02% 0.02%"}, "model_tokens": {"rwkv": [[2105, "ov", "normal", 0.9990142583847046]], "qwen": [[859, "ov", "normal", 0.99774569272995]]}, "loss": {"rwkv": 0.008805511724175801, "qwen": 0.020349439880208684}, "topk": {"rwkv": [2105, 1, 0.9990142583847046, [[2105, 0.999014, "ov", false], [2106, 0.000755, "ow", false], [28017, 6.2e-05, "ов", false], [8443, 3.9e-05, "ova", false], [8311, 2.3e-05, "off", false], [112, 2e-05, "o", false], [7745, 1.3e-05, "ian", false], [8262, 1.3e-05, "nov", false], [45, 9e-06, ",", false], [8445, 8e-06, "ovi", false]]], "qwen": [859, 1, 0.99774569272995, [[859, 0.997746, "ov", false], [994, 0.001156, "ove", false], [363, 0.000447, "ow", false], [45088, 0.000114, "ovi", false], [1103, 7e-05, "ian", false], [1055, 5.9e-05, "of", false], [12660, 4.8e-05, "ova", false], [50114, 3.2e-05, "ovich", false], [30835, 2.2e-05, "iov", false], [2308, 1.8e-05, " No", false]]]}, "raw_delta": -0.0006401313003152609, "tuned_delta": 0.007931660730262987}, {"byte_start": 1471, "byte_end": 1472, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "1.93%", "qwen": "2.13%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8988778591156006]], "qwen": [[11, ",", "normal", 0.8888115882873535]]}, "loss": {"rwkv": 1.9284070675945004, "qwen": 2.125631262784684}, "topk": {"rwkv": [45, 1, 0.8988778591156006, [[45, 0.898878, ",", false], [4596, 0.045213, " in", false], [275, 0.036681, " (", false], [21265, 0.005375, " and", false], [460, 0.001492, "'s", false], [4424, 0.001003, " at", false], [32462, 0.000857, " were", false], [326, 0.00081, " [", false], [47, 0.000595, ".", false], [4450, 0.000436, " by", false]]], "qwen": [11, 1, 0.8888115882873535, [[11, 0.888812, ",", false], [304, 0.052188, " in", false], [320, 0.023062, " (", false], [323, 0.009136, " and", false], [594, 0.004451, "'s", false], [1154, 0.002869, " ,", false], [508, 0.002651, " [", false], [518, 0.001571, " at", false], [220, 0.001497, " ", false], [1033, 0.000954, " were", false]]]}, "raw_delta": -0.010936431586742401, "tuned_delta": -0.002364639556164153}, {"byte_start": 1472, "byte_end": 1475, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 247, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "6.57% 6.57% 6.57%", "qwen": "8.98% 8.98% 8.98%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.3365491032600403]], "qwen": [[304, " in", "normal", 0.22436822950839996]]}, "loss": {"rwkv": 6.574782087384598, "qwen": 8.983582560879153}, "topk": {"rwkv": [4596, 1, 0.3365491032600403, [[4596, 0.336549, " in", false], [32462, 0.324224, " were", false], [21265, 0.041704, " and", false], [21286, 0.020685, " are", false], [47054, 0.014559, " relied", false], [4450, 0.012535, " by", false], [32354, 0.011725, " used", false], [4424, 0.010701, " at", false], [56427, 0.00861, " included", false], [21795, 0.008175, " had", false]]], "qwen": [304, 2, 0.22436822950839996, [[1033, 0.40179, " were", false], [304, 0.224368, " in", false], [39913, 0.022348, " relied", false], [1030, 0.02026, " had", false], [323, 0.019035, " and", false], [1483, 0.018675, " used", false], [525, 0.01754, " are", false], [6398, 0.015118, " involved", false], [1521, 0.012167, " did", false], [518, 0.011098, " at", false]]]}, "raw_delta": -0.133572260538737, "tuned_delta": -0.12500046850815874}, {"byte_start": 1475, "byte_end": 1478, "display": {"text": " 19", "kind": "normal"}, "is_word": true, "word_id": 248, "word_key": " 19", "bytes_hex": "20 31 39", "compression": {"rwkv": "4.25% 4.25% 4.25%", "qwen": "11.89% 1.11% 0.01%"}, "model_tokens": {"rwkv": [[3492, " 19", "normal", 0.4993974566459656]], "qwen": [[220, " ", "normal", 0.5171647071838379], [16, "1", "normal", 0.9404540061950684], [24, "9", "normal", 0.999442994594574]]}, "loss": {"rwkv": 4.250126992202187, "qwen": 4.336161768515685}, "topk": {"rwkv": [3492, 1, 0.4993974566459656, [[3492, 0.499397, " 19", false], [22590, 0.25355, " the", false], [3493, 0.133876, " 20", false], [332, 0.034427, " a", false], [31198, 0.004014, " just", false], [21823, 0.004008, " his", false], [31277, 0.003156, " less", false], [20394, 0.00275, " May", false], [37598, 0.00239, " about", false], [47014, 0.002232, " recent", false]]], "qwen": [220, 1, 0.5171647071838379, [[220, 0.517165, " ", false], [279, 0.350851, " the", false], [264, 0.03867, " a", false], [806, 0.00853, " his", false], [32719, 0.006975, " chess", false], [1378, 0.003782, " two", false], [862, 0.003536, " their", false], [458, 0.002794, " an", false], [2326, 0.002367, " three", false], [39061, 0.002184, " tournaments", false]]]}, "raw_delta": -0.00477078101054453, "tuned_delta": 0.0038010110200337186}, {"byte_start": 1478, "byte_end": 1480, "display": {"text": "97", "kind": "normal"}, "is_word": true, "word_id": 249, "word_key": "97", "bytes_hex": "39 37", "compression": {"rwkv": "2.89% 2.89%", "qwen": "0.83% 2.49%"}, "model_tokens": {"rwkv": [[717, "97", "normal", 0.7258799076080322]], "qwen": [[24, "9", "normal", 0.9547744393348694], [22, "7", "normal", 0.8708397746086121]]}, "loss": {"rwkv": 2.8882078455296627, "qwen": 1.6643060414114925}, "topk": {"rwkv": [717, 1, 0.7258799076080322, [[717, 0.72588, "97", false], [716, 0.215199, "96", false], [719, 0.020191, "99", false], [710, 0.011702, "90", false], [718, 0.008255, "98", false], [709, 0.004508, "89", false], [713, 0.003529, "93", false], [715, 0.002784, "95", false], [705, 0.001783, "85", false], [711, 0.001693, "91", false]]], "qwen": [24, 1, 0.9547744393348694, [[24, 0.954774, "9", false], [23, 0.043984, "8", false], [22, 0.001088, "7", false], [21, 7.7e-05, "6", false], [20, 1.7e-05, "5", false], [339, 1.6e-05, "th", false], [19, 7e-06, "4", false], [220, 4e-06, " ", false], [15, 4e-06, "0", false], [18, 4e-06, "3", false]]]}, "raw_delta": 0.06786752678453922, "tuned_delta": 0.07643931881511747}, {"byte_start": 1480, "byte_end": 1481, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "34.94%", "qwen": "42.10%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.14454956352710724]], "qwen": [[11, ",", "normal", 0.09688328206539154]]}, "loss": {"rwkv": 34.94027052152958, "qwen": 42.095105661422956}, "topk": {"rwkv": [45, 3, 0.14454956352710724, [[32462, 0.371787, " were", false], [21265, 0.213639, " and", false], [45, 0.14455, ",", false], [275, 0.052413, " (", false], [32354, 0.021215, " used", false], [21286, 0.014041, " are", false], [21795, 0.012023, " had", false], [47054, 0.00872, " relied", false], [56500, 0.008076, " involved", false], [21532, 0.007348, " did", false]]], "qwen": [11, 3, 0.09688328206539154, [[1033, 0.439887, " were", false], [323, 0.13122, " and", false], [11, 0.096883, ",", false], [320, 0.035252, " (", false], [12, 0.027816, "-", false], [6398, 0.019639, " involved", false], [5230, 0.019083, " included", false], [525, 0.017318, " are", false], [1030, 0.014978, " had", false], [1521, 0.012527, " did", false]]]}, "raw_delta": -0.39674830436706543, "tuned_delta": -0.3881765123364872}, {"byte_start": 1481, "byte_end": 1486, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 250, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"rwkv": "5.95% 5.95% 5.95% 5.95% 5.95%", "qwen": "2.68% 2.68% 2.68% 2.68% 2.68%"}, "model_tokens": {"rwkv": [[32462, " were", "normal", 0.1922028809785843]], "qwen": [[1033, " were", "normal", 0.47591105103492737]]}, "loss": {"rwkv": 5.945481516163501, "qwen": 2.678090406599476}, "topk": {"rwkv": [32462, 2, 0.1922028809785843, [[3493, 0.27099, " 20", false], [32462, 0.192203, " were", false], [21265, 0.154762, " and", false], [3492, 0.098703, " 19", false], [32354, 0.012385, " used", false], [21286, 0.012159, " are", false], [22590, 0.011727, " the", false], [4596, 0.009792, " in", false], [47054, 0.007366, " relied", false], [21795, 0.00723, " had", false]]], "qwen": [1033, 1, 0.47591105103492737, [[1033, 0.475911, " were", false], [220, 0.043079, " ", false], [39913, 0.037907, " relied", false], [323, 0.032855, " and", false], [1521, 0.031137, " did", false], [1483, 0.029892, " used", false], [5230, 0.016554, " included", false], [1030, 0.015625, " had", false], [6398, 0.014981, " involved", false], [525, 0.013672, " are", false]]]}, "raw_delta": 0.18118263483047486, "tuned_delta": 0.18975442686105312}, {"byte_start": 1486, "byte_end": 1492, "display": {"text": " based", "kind": "normal"}, "is_word": true, "word_id": 251, "word_key": " based", "bytes_hex": "20 62 61 73 65 64", "compression": {"rwkv": "7.23% 7.23% 7.23% 7.23% 7.23% 7.23%", "qwen": "6.65% 6.65% 6.65% 6.65% 6.65% 6.65%"}, "model_tokens": {"rwkv": [[37810, " based", "normal", 0.08956412225961685]], "qwen": [[3118, " based", "normal", 0.109536312520504]]}, "loss": {"rwkv": 7.232260296123059, "qwen": 6.646914477533975}, "topk": {"rwkv": [37810, 1, 0.08956412225961685, [[37810, 0.089564, " based", false], [22187, 0.053974, " not", false], [22590, 0.049683, " the", false], [332, 0.046704, " a", false], [63541, 0.038035, " essentially", false], [52094, 0.036795, " largely", false], [52224, 0.030486, " methods", false], [39944, 0.024219, " those", false], [21256, 0.016626, " all", false], [32386, 0.016187, " very", false]]], "qwen": [3118, 1, 0.109536312520504, [[3118, 0.109536, " based", false], [537, 0.085856, " not", false], [279, 0.033277, " the", false], [678, 0.031775, " all", false], [264, 0.024103, " a", false], [1602, 0.01956, " very", false], [4586, 0.017779, " general", false], [13771, 0.016204, " largely", false], [1846, 0.0123, " those", false], [11368, 0.011981, " entirely", false]]]}, "raw_delta": 0.03245846430460614, "tuned_delta": 0.04103025633518439}, {"byte_start": 1492, "byte_end": 1495, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 252, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"rwkv": "1.04% 1.04% 1.04%", "qwen": "0.91% 0.91% 0.91%"}, "model_tokens": {"rwkv": [[4712, " on", "normal", 0.8390783667564392]], "qwen": [[389, " on", "normal", 0.860114574432373]]}, "loss": {"rwkv": 1.0449207246021952, "qwen": 0.9058302035883852}, "topk": {"rwkv": [4712, 1, 0.8390783667564392, [[4712, 0.839078, " on", false], [56131, 0.016467, " entirely", false], [60247, 0.014913, " primarily", false], [4596, 0.014284, " in", false], [52094, 0.013891, " largely", false], [45145, 0.013001, " almost", false], [32350, 0.010964, " upon", false], [51919, 0.008763, " heavily", false], [22187, 0.007125, " not", false], [47330, 0.005489, " solely", false]]], "qwen": [389, 1, 0.860114574432373, [[389, 0.860115, " on", false], [304, 0.015985, " in", false], [4558, 0.01554, " almost", false], [11368, 0.014561, " entirely", false], [13771, 0.012379, " largely", false], [537, 0.011577, " not", false], [5193, 0.008528, " upon", false], [15503, 0.00716, " primarily", false], [2163, 0.005406, " around", false], [16916, 0.004664, " heavily", false]]]}, "raw_delta": 0.007712816198666893, "tuned_delta": 0.016284608229245143}, {"byte_start": 1495, "byte_end": 1503, "display": {"text": " massive", "kind": "normal"}, "is_word": true, "word_id": 253, "word_key": " massive", "bytes_hex": "20 6d 61 73 73 69 76 65", "compression": {"rwkv": "10.50% 10.50% 10.50% 10.50% 10.50% 10.50% 10.50% 10.50%", "qwen": "14.62% 14.62% 14.62% 14.62% 14.62% 14.62% 14.62% 14.62%"}, "model_tokens": {"rwkv": [[52195, " massive", "normal", 0.009590300731360912]], "qwen": [[10951, " massive", "normal", 0.0015222453512251377]]}, "loss": {"rwkv": 10.496169975217555, "qwen": 14.624349085853574}, "topk": {"rwkv": [52195, 14, 0.009590300731360912, [[332, 0.125288, " a", false], [22590, 0.108478, " the", false], [51832, 0.057074, " general", false], [52224, 0.027377, " methods", false], [52167, 0.022165, " machine", false], [46658, 0.021982, " neural", false], [56537, 0.020004, " learning", false], [30597, 0.016778, " deep", false], [55531, 0.012636, " applying", false], [47202, 0.011492, " search", false]]], "qwen": [10951, 84, 0.0015222453512251377, [[264, 0.132264, " a", false], [279, 0.095771, " the", false], [4586, 0.042222, " general", false], [5538, 0.023053, " deep", false], [6832, 0.022309, " learning", false], [64098, 0.022067, " brute", false], [3738, 0.02184, " human", false], [458, 0.01992, " an", false], [2711, 0.019204, " search", false], [5662, 0.018349, " machine", false]]]}, "raw_delta": -0.22891485691070557, "tuned_delta": -0.2203430648801273}, {"byte_start": 1503, "byte_end": 1504, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "79.46%", "qwen": "80.63%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.012095452286303043]], "qwen": [[11, ",", "normal", 0.011436567641794682]]}, "loss": {"rwkv": 79.46093779896243, "qwen": 80.62753051629504}, "topk": {"rwkv": [45, 14, 0.012095452286303043, [[64423, 0.114045, " improvements", false], [50897, 0.110007, " amounts", false], [63370, 0.097949, " computation", false], [22681, 0.045297, " use", false], [56812, 0.028972, " parallel", false], [38720, 0.026104, " human", false], [51832, 0.02105, " general", false], [64862, 0.019825, " computational", false], [47202, 0.018326, " search", false], [63621, 0.017981, " improvement", false]]], "qwen": [11, 13, 0.011436567641794682, [[14713, 0.15872, " amounts", false], [34447, 0.131126, " computation", false], [2711, 0.066927, " search", false], [82599, 0.051758, " computations", false], [54480, 0.044446, " computational", false], [31806, 0.039818, " databases", false], [821, 0.031169, " data", false], [990, 0.029515, " use", false], [24231, 0.02003, " computing", false], [64098, 0.015096, " brute", false]]]}, "raw_delta": -0.06468963623046875, "tuned_delta": -0.0561178441998905}, {"byte_start": 1504, "byte_end": 1509, "display": {"text": " deep", "kind": "normal"}, "is_word": true, "word_id": 254, "word_key": " deep", "bytes_hex": "20 64 65 65 70", "compression": {"rwkv": "16.79% 16.79% 16.79% 16.79% 16.79%", "qwen": "14.99% 14.99% 14.99% 14.99% 14.99%"}, "model_tokens": {"rwkv": [[30597, " deep", "normal", 0.009489580988883972]], "qwen": [[5538, " deep", "normal", 0.01565556600689888]]}, "loss": {"rwkv": 16.79387196034809, "qwen": 14.99295219218517}, "topk": {"rwkv": [30597, 15, 0.009489580988883972, [[31044, 0.100107, " hand", false], [38720, 0.062638, " human", false], [51832, 0.055898, " general", false], [59262, 0.040896, " carefully", false], [59988, 0.033768, " massively", false], [21400, 0.020121, " but", false], [56812, 0.016347, " parallel", false], [39802, 0.015758, " state", false], [22323, 0.014956, " pre", false], [37920, 0.013377, " brute", false]]], "qwen": [5538, 10, 0.01565556600689888, [[855, 0.049514, " pre", false], [4586, 0.047162, " general", false], [64098, 0.044898, " brute", false], [63707, 0.034973, " massively", false], [15279, 0.026881, " parallel", false], [10951, 0.023684, " massive", false], [1424, 0.020637, " hand", false], [1550, 0.019098, " high", false], [3738, 0.017058, " human", false], [5538, 0.015656, " deep", false]]]}, "raw_delta": 0.09986419677734382, "tuned_delta": 0.10843598880792206}, {"byte_start": 1509, "byte_end": 1516, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 255, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "9.22% 9.22% 9.22% 9.22% 9.22% 9.22% 9.22%", "qwen": "5.54% 5.54% 5.54% 5.54% 5.54% 5.54% 5.54%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.027812570333480835]], "qwen": [[2711, " search", "normal", 0.11630882322788239]]}, "loss": {"rwkv": 9.218112844965754, "qwen": 5.542799371917312}, "topk": {"rwkv": [47202, 5, 0.027812570333480835, [[56537, 0.250962, " learning", false], [45, 0.165588, ",", false], [46658, 0.154947, " neural", false], [46, 0.033813, "-", false], [47202, 0.027813, " search", false], [32298, 0.014586, " tree", false], [56705, 0.012814, " networks", false], [63384, 0.012554, " connections", false], [51832, 0.011478, " general", false], [21265, 0.010674, " and", false]]], "qwen": [2711, 4, 0.11630882322788239, [[29728, 0.228634, " neural", false], [6832, 0.141765, " learning", false], [11, 0.125937, ",", false], [2711, 0.116309, " search", false], [14155, 0.035094, " networks", false], [26475, 0.026614, " searches", false], [6540, 0.022596, " knowledge", false], [6358, 0.015513, " analysis", false], [34447, 0.014, " computation", false], [82599, 0.011676, " computations", false]]]}, "raw_delta": 0.20380265372140063, "tuned_delta": 0.2123744457519789}, {"byte_start": 1516, "byte_end": 1517, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "33.25%", "qwen": "39.40%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.15849344432353973]], "qwen": [[13, ".", "normal", 0.11249887943267822]]}, "loss": {"rwkv": 33.24961227048782, "qwen": 39.40021921416191}, "topk": {"rwkv": [47, 1, 0.15849344432353973, [[47, 0.158493, ".", false], [45, 0.150797, ",", false], [21265, 0.079702, " and", false], [40085, 0.069838, " using", false], [4706, 0.066579, " of", false], [55780, 0.050283, " combined", false], [32487, 0.045227, " with", false], [4596, 0.042338, " in", false], [31601, 0.035346, " over", false], [275, 0.033037, " (", false]]], "qwen": [13, 2, 0.11249887943267822, [[315, 0.154114, " of", false], [13, 0.112499, ".", false], [11, 0.110164, ",", false], [323, 0.099218, " and", false], [429, 0.052457, " that", false], [320, 0.047566, " (", false], [448, 0.046324, " with", false], [10856, 0.041333, " combined", false], [1667, 0.030094, " using", false], [304, 0.020681, " in", false]]]}, "raw_delta": -0.341062068939209, "tuned_delta": -0.33249027690863076}, {"byte_start": 1517, "byte_end": 1520, "display": {"text": " At", "kind": "normal"}, "is_word": true, "word_id": 256, "word_key": " at", "bytes_hex": "20 41 74", "compression": {"rwkv": "28.74% 28.74% 28.74%", "qwen": "25.76% 25.76% 25.76%"}, "model_tokens": {"rwkv": [[3642, " At", "normal", 0.008294779807329178]], "qwen": [[2411, " At", "normal", 0.013779883272945881]]}, "loss": {"rwkv": 28.741190267709815, "qwen": 25.755385134193023}, "topk": {"rwkv": [3642, 17, 0.008294779807329178, [[20996, 0.16726, " The", false], [3913, 0.099724, " In", false], [29894, 0.074496, " This", false], [19555, 0.034937, " But", false], [29893, 0.030826, " They", false], [28753, 0.030702, " Deep", false], [3918, 0.025467, " It", false], [20184, 0.025448, " Kas", false], [37453, 0.024568, " These", false], [267, 0.024184, "  ", false]]], "qwen": [2411, 12, 0.013779883272945881, [[576, 0.210873, " The", false], [1096, 0.054783, " This", false], [2379, 0.052526, " They", false], [220, 0.048822, " ", false], [4220, 0.045169, " These", false], [758, 0.041157, " In", false], [1988, 0.029914, " But", false], [1084, 0.025989, " It", false], [2619, 0.018194, " There", false], [18183, 0.015407, " Deep", false]]]}, "raw_delta": 0.165568192799886, "tuned_delta": 0.17413998483046425}, {"byte_start": 1520, "byte_end": 1524, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 257, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "2.03% 2.03% 2.03% 2.03%", "qwen": "2.66% 2.66% 2.66% 2.66%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.6423044800758362]], "qwen": [[279, " the", "normal", 0.5542927980422974]]}, "loss": {"rwkv": 2.025267696560434, "qwen": 2.6602496788230656}, "topk": {"rwkv": [22590, 1, 0.6423044800758362, [[22590, 0.642304, " the", false], [32227, 0.203458, " that", false], [38499, 0.018085, " first", false], [332, 0.017556, " a", false], [38879, 0.015072, " least", false], [37598, 0.012445, " about", false], [32234, 0.011288, " this", false], [22226, 0.00807, " one", false], [32074, 0.00772, " some", false], [21902, 0.004991, " its", false]]], "qwen": [279, 1, 0.5542927980422974, [[279, 0.554293, " the", false], [429, 0.188296, " that", false], [1156, 0.067455, " first", false], [825, 0.020725, " one", false], [264, 0.01993, " a", false], [3245, 0.018709, " least", false], [1817, 0.017859, " each", false], [419, 0.017575, " this", false], [1181, 0.008022, " its", false], [220, 0.007143, " ", false]]]}, "raw_delta": -0.035210877656936646, "tuned_delta": -0.026639085626358396}, {"byte_start": 1524, "byte_end": 1529, "display": {"text": " time", "kind": "normal"}, "is_word": true, "word_id": 258, "word_key": " time", "bytes_hex": "20 74 69 6d 65", "compression": {"rwkv": "0.61% 0.61% 0.61% 0.61% 0.61%", "qwen": "1.04% 1.04% 1.04% 1.04% 1.04%"}, "model_tokens": {"rwkv": [[32251, " time", "normal", 0.8444154262542725]], "qwen": [[882, " time", "normal", 0.748907744884491]]}, "loss": {"rwkv": 0.6128636160026357, "qwen": 1.0428501251452447}, "topk": {"rwkv": [32251, 1, 0.8444154262542725, [[32251, 0.844415, " time", false], [31937, 0.053033, " same", false], [21616, 0.030037, " end", false], [59220, 0.008447, " beginning", false], [38887, 0.007236, " level", false], [39801, 0.007233, " start", false], [38676, 0.002994, " heart", false], [22615, 0.002662, " top", false], [3492, 0.00228, " 19", false], [32321, 0.002239, " turn", false]]], "qwen": [882, 1, 0.748907744884491, [[882, 0.748908, " time", false], [1852, 0.050884, " same", false], [1191, 0.023412, " start", false], [3704, 0.02151, " root", false], [835, 0.019151, " end", false], [7167, 0.014188, " beginning", false], [1909, 0.010463, " top", false], [4746, 0.008314, " heart", false], [1602, 0.006322, " very", false], [16162, 0.005947, " peak", false]]]}, "raw_delta": -0.02384351491928101, "tuned_delta": -0.01527172288870276}, {"byte_start": 1529, "byte_end": 1530, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "5.74%", "qwen": "5.66%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.7221240401268005]], "qwen": [[11, ",", "normal", 0.7307966351509094]]}, "loss": {"rwkv": 5.741193644162623, "qwen": 5.655725790924782}, "topk": {"rwkv": [45, 1, 0.7221240401268005, [[45, 0.722124, ",", false], [4706, 0.075869, " of", false], [32234, 0.037753, " this", false], [22590, 0.032489, " the", false], [4601, 0.026915, " it", false], [32232, 0.017926, " they", false], [32227, 0.015678, " that", false], [39934, 0.009674, " there", false], [20184, 0.008429, " Kas", false], [275, 0.006458, " (", false]]], "qwen": [11, 1, 0.7307966351509094, [[11, 0.730797, ",", false], [315, 0.122308, " of", false], [279, 0.024006, " the", false], [432, 0.020119, " it", false], [419, 0.017418, " this", false], [807, 0.012417, " they", false], [1052, 0.010927, " there", false], [320, 0.009159, " (", false], [1493, 0.006985, " these", false], [429, 0.006148, " that", false]]]}, "raw_delta": 0.004739344120025635, "tuned_delta": 0.013311136150603883}, {"byte_start": 1530, "byte_end": 1535, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 259, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "7.33% 7.33% 7.33% 7.33% 7.33%", "qwen": "10.78% 10.78% 10.78% 10.78% 10.78%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.13208968937397003]], "qwen": [[419, " this", "normal", 0.05038928985595703]]}, "loss": {"rwkv": 7.326185754514267, "qwen": 10.776847381252168}, "topk": {"rwkv": [32234, 2, 0.13208968937397003, [[22590, 0.208129, " the", false], [32234, 0.13209, " this", false], [4601, 0.096917, " it", false], [32232, 0.045646, " they", false], [39936, 0.038543, " these", false], [39934, 0.036859, " there", false], [4692, 0.019692, " no", false], [32227, 0.018609, " that", false], [332, 0.018595, " a", false], [47202, 0.015894, " search", false]]], "qwen": [419, 5, 0.05038928985595703, [[279, 0.223538, " the", false], [432, 0.092244, " it", false], [1052, 0.054495, " there", false], [32719, 0.054022, " chess", false], [419, 0.050389, " this", false], [902, 0.04243, " no", false], [1493, 0.02881, " these", false], [807, 0.024149, " they", false], [264, 0.02267, " a", false], [1429, 0.020667, " most", false]]]}, "raw_delta": -0.19134531021118162, "tuned_delta": -0.18277351818060336}, {"byte_start": 1535, "byte_end": 1539, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 260, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "2.25% 2.25% 2.25% 2.25%", "qwen": "3.42% 3.42% 3.42% 3.42%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.6059576272964478]], "qwen": [[572, " was", "normal", 0.46857208013534546]]}, "loss": {"rwkv": 2.2454054896648294, "qwen": 3.417678471487961}, "topk": {"rwkv": [22748, 1, 0.6059576272964478, [[22748, 0.605958, " was", false], [47211, 0.052989, " seemed", false], [55532, 0.040104, " approach", false], [46561, 0.028907, " method", false], [63841, 0.017092, " represented", false], [57101, 0.014504, " required", false], [31351, 0.011846, " made", false], [47202, 0.011302, " search", false], [38990, 0.011119, " meant", false], [21795, 0.011076, " had", false]]], "qwen": [572, 1, 0.46857208013534546, [[572, 0.468572, " was", false], [9324, 0.09243, " seemed", false], [5486, 0.078204, " approach", false], [1714, 0.041065, " method", false], [2567, 0.038069, " required", false], [2711, 0.021175, " search", false], [8791, 0.019898, " meant", false], [1030, 0.016118, " had", false], [1035, 0.015172, " would", false], [6398, 0.013176, " involved", false]]]}, "raw_delta": -0.0650046169757843, "tuned_delta": -0.05643282494520605}, {"byte_start": 1539, "byte_end": 1546, "display": {"text": " looked", "kind": "normal"}, "is_word": true, "word_id": 261, "word_key": " looked", "bytes_hex": "20 6c 6f 6f 6b 65 64", "compression": {"rwkv": "22.86% 22.86% 22.86% 22.86% 22.86% 22.86% 22.86%", "qwen": "21.48% 21.48% 21.48% 21.48% 21.48% 21.48% 21.48%"}, "model_tokens": {"rwkv": [[46471, " looked", "normal", 0.00014063648995943367]], "qwen": [[6966, " looked", "normal", 0.00023941117979120463]]}, "loss": {"rwkv": 22.864140156945616, "qwen": 21.47896731794644}, "topk": {"rwkv": [46471, 291, 0.00014063648995943367, [[22590, 0.209277, " the", false], [332, 0.169261, " a", false], [61755, 0.094635, " considered", false], [31968, 0.039652, " seen", false], [4419, 0.03881, " an", false], [53137, 0.033443, " thought", false], [22187, 0.029644, " not", false], [57059, 0.019155, " regarded", false], [47724, 0.012689, " viewed", false], [22168, 0.011154, " new", false]]], "qwen": [6966, 208, 0.00023941117979120463, [[279, 0.19248, " the", false], [264, 0.174535, " a", false], [6509, 0.114077, " considered", false], [537, 0.080483, " not", false], [458, 0.058191, " an", false], [3884, 0.025644, " seen", false], [3381, 0.022485, " thought", false], [29969, 0.009631, " unprecedented", false], [13570, 0.009015, " widely", false], [825, 0.008999, " one", false]]]}, "raw_delta": 0.0768102918352398, "tuned_delta": 0.08538208386581804}, {"byte_start": 1546, "byte_end": 1551, "display": {"text": " upon", "kind": "normal"}, "is_word": true, "word_id": 262, "word_key": " upon", "bytes_hex": "20 75 70 6f 6e", "compression": {"rwkv": "3.24% 3.24% 3.24% 3.24% 3.24%", "qwen": "1.64% 1.64% 1.64% 1.64% 1.64%"}, "model_tokens": {"rwkv": [[32350, " upon", "normal", 0.4067184627056122]], "qwen": [[5193, " upon", "normal", 0.6352965831756592]]}, "loss": {"rwkv": 3.240428314496695, "qwen": 1.6362445526461131}, "topk": {"rwkv": [32350, 1, 0.4067184627056122, [[32350, 0.406718, " upon", false], [4424, 0.29206, " at", false], [4712, 0.264328, " on", false], [30678, 0.013842, " down", false], [4811, 0.006693, " to", false], [4423, 0.004043, " as", false], [4833, 0.001548, " up", false], [4450, 0.001287, " by", false], [30218, 0.001161, " back", false], [21295, 0.001024, " ask", false]]], "qwen": [5193, 1, 0.6352965831756592, [[5193, 0.635297, " upon", false], [518, 0.167502, " at", false], [389, 0.115316, " on", false], [1495, 0.05384, " down", false], [311, 0.015149, " to", false], [1182, 0.00164, " back", false], [369, 0.001565, " for", false], [1075, 0.001294, " like", false], [438, 0.001074, " as", false], [4637, 0.000624, " forward", false]]]}, "raw_delta": 0.08895483613014221, "tuned_delta": 0.09752662816072045}, {"byte_start": 1551, "byte_end": 1556, "display": {"text": " with", "kind": "normal"}, "is_word": true, "word_id": 263, "word_key": " with", "bytes_hex": "20 77 69 74 68", "compression": {"rwkv": "7.13% 7.13% 7.13% 7.13% 7.13%", "qwen": "12.53% 12.53% 12.53% 12.53% 12.53%"}, "model_tokens": {"rwkv": [[32487, " with", "normal", 0.13835200667381287]], "qwen": [[448, " with", "normal", 0.03100200742483139]]}, "loss": {"rwkv": 7.128942291892729, "qwen": 12.528736615480607}, "topk": {"rwkv": [32487, 2, 0.13835200667381287, [[4423, 0.711724, " as", false], [32487, 0.138352, " with", false], [4450, 0.068183, " by", false], [60512, 0.034853, " skeptical", false], [4596, 0.005076, " in", false], [38458, 0.003401, " favor", false], [57263, 0.002588, " somewhat", false], [45, 0.002395, ",", false], [62624, 0.002145, " suspicious", false], [21295, 0.001884, " ask", false]]], "qwen": [448, 3, 0.03100200742483139, [[438, 0.876166, " as", false], [553, 0.03154, " by", false], [448, 0.031002, " with", false], [36579, 0.009905, " skept", false], [11, 0.006082, ",", false], [311, 0.004734, " to", false], [304, 0.004288, " in", false], [320, 0.002634, " (", false], [4694, 0.00257, " favor", false], [537, 0.002294, " not", false]]]}, "raw_delta": -0.2994281768798828, "tuned_delta": -0.2908563848493046}, {"byte_start": 1556, "byte_end": 1563, "display": {"text": " dismay", "kind": "normal"}, "is_word": true, "word_id": 264, "word_key": " dismay", "bytes_hex": "20 64 69 73 6d 61 79", "compression": {"rwkv": "13.44% 13.44% 13.44% 13.44% 13.44% 13.44% 13.44%", "qwen": "11.90% 11.90% 11.90% 11.90% 11.90% 11.90% 11.90%"}, "model_tokens": {"rwkv": [[45756, " dismay", "normal", 0.005509744398295879]], "qwen": [[71982, " dismay", "normal", 0.00986457522958517]]}, "loss": {"rwkv": 13.444758472570138, "qwen": 11.899155303056101}, "topk": {"rwkv": [45756, 19, 0.005509744398295879, [[62561, 0.263272, " skepticism", false], [60609, 0.212474, " suspicion", false], [32074, 0.077677, " some", false], [21542, 0.051934, " dis", false], [332, 0.044298, " a", false], [46271, 0.026665, " incred", false], [38629, 0.024728, " great", false], [39608, 0.02181, " scorn", false], [39599, 0.017621, " scept", false], [21523, 0.016758, " der", false]]], "qwen": [71982, 18, 0.00986457522958517, [[66133, 0.185542, " skepticism", false], [2244, 0.114888, " great", false], [37041, 0.105034, " suspicion", false], [1045, 0.05703, " some", false], [264, 0.036511, " a", false], [23839, 0.035585, " considerable", false], [9653, 0.031005, " incred", false], [87006, 0.024041, " scorn", false], [50417, 0.020561, " awe", false], [78398, 0.019158, " disdain", false]]]}, "raw_delta": 0.0857064383370536, "tuned_delta": 0.09427823036763185}, {"byte_start": 1563, "byte_end": 1566, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 265, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "5.57% 5.57% 5.57%", "qwen": "8.77% 8.77% 8.77%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.3952583074569702]], "qwen": [[553, " by", "normal", 0.23240253329277039]]}, "loss": {"rwkv": 5.565083409679106, "qwen": 8.772092628735642}, "topk": {"rwkv": [4450, 1, 0.3952583074569702, [[4450, 0.395258, " by", false], [45, 0.190716, ",", false], [4423, 0.147753, " as", false], [47, 0.083341, ".", false], [51018, 0.051481, " because", false], [21265, 0.030159, " and", false], [4596, 0.017165, " in", false], [59, 0.016393, ":", false], [60, 0.01203, ";", false], [30917, 0.008852, " from", false]]], "qwen": [553, 2, 0.23240253329277039, [[11, 0.27647, ",", false], [553, 0.232403, " by", false], [13, 0.163083, ".", false], [1576, 0.070035, " because", false], [323, 0.067026, " and", false], [438, 0.052422, " as", false], [25, 0.034901, ":", false], [26, 0.016396, ";", false], [320, 0.012731, " (", false], [2474, 0.009707, " since", false]]]}, "raw_delta": -0.17783435185750326, "tuned_delta": -0.169262559826925}, {"byte_start": 1566, "byte_end": 1570, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 266, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "7.68% 7.68% 7.68% 7.68%", "qwen": "9.55% 9.55% 9.55% 9.55%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.18160317838191986]], "qwen": [[279, " the", "normal", 0.12037070840597153]]}, "loss": {"rwkv": 7.678406223481298, "qwen": 9.545136012910124}, "topk": {"rwkv": [22590, 2, 0.18160317838191986, [[31370, 0.205778, " many", false], [22590, 0.181603, " the", false], [39944, 0.082015, " those", false], [32074, 0.077888, " some", false], [38013, 0.076814, " chess", false], [38720, 0.068789, " human", false], [31461, 0.026712, " most", false], [20184, 0.021205, " Kas", false], [332, 0.015787, " a", false], [55809, 0.013672, " computer", false]]], "qwen": [279, 3, 0.12037070840597153, [[1657, 0.225981, " many", false], [32719, 0.209662, " chess", false], [279, 0.120371, " the", false], [1846, 0.0733, " those", false], [1045, 0.071325, " some", false], [3738, 0.027125, " human", false], [1429, 0.026412, " most", false], [264, 0.017876, " a", false], [11811, 0.017368, " researchers", false], [6366, 0.017071, " computer", false]]]}, "raw_delta": -0.10351347923278809, "tuned_delta": -0.09494168720220984}, {"byte_start": 1570, "byte_end": 1579, "display": {"text": " majority", "kind": "normal"}, "is_word": true, "word_id": 267, "word_key": " majority", "bytes_hex": "20 6d 61 6a 6f 72 69 74 79", "compression": {"rwkv": "10.39% 10.39% 10.39% 10.39% 10.39% 10.39% 10.39% 10.39% 10.39%", "qwen": "9.64% 9.64% 9.64% 9.64% 9.64% 9.64% 9.64% 9.64% 9.64%"}, "model_tokens": {"rwkv": [[56573, " majority", "normal", 0.005612103268504143]], "qwen": [[8686, " majority", "normal", 0.008159642107784748]]}, "loss": {"rwkv": 10.394417395293745, "qwen": 9.63510921443859}, "topk": {"rwkv": [56573, 21, 0.005612103268504143, [[38720, 0.170913, " human", false], [38013, 0.169576, " chess", false], [38621, 0.076005, " grand", false], [55809, 0.05481, " computer", false], [40213, 0.036494, " world", false], [51685, 0.02337, " experts", false], [3609, 0.019848, " AI", false], [22615, 0.019308, " top", false], [45929, 0.018355, " expert", false], [59324, 0.017437, " community", false]]], "qwen": [8686, 8, 0.008159642107784748, [[32719, 0.593104, " chess", false], [3738, 0.052657, " human", false], [15235, 0.021827, " AI", false], [6366, 0.015761, " computer", false], [6662, 0.015289, " grand", false], [1879, 0.012535, " world", false], [3942, 0.012518, " community", false], [8686, 0.00816, " majority", false], [1251, 0.008023, " people", false], [47387, 0.007971, " Chess", false]]]}, "raw_delta": 0.04210498597886825, "tuned_delta": 0.0506767780094465}, {"byte_start": 1579, "byte_end": 1582, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 268, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.12% 0.12% 0.12%", "qwen": "0.25% 0.25% 0.25%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9806281328201294]], "qwen": [[315, " of", "normal", 0.9587160348892212]]}, "loss": {"rwkv": 0.11740682298901069, "qwen": 0.25343560494597595}, "topk": {"rwkv": [4706, 1, 0.9806281328201294, [[4706, 0.980628, " of", false], [45, 0.004248, ",", false], [47, 0.002026, ".", false], [4596, 0.001685, " in", false], [22762, 0.001408, " who", false], [59324, 0.001187, " community", false], [38013, 0.001015, " chess", false], [3609, 0.000869, " AI", false], [52367, 0.000761, " opinion", false], [275, 0.000644, " (", false]]], "qwen": [315, 1, 0.9587160348892212, [[315, 0.958716, " of", false], [11, 0.014388, ",", false], [13, 0.005598, ".", false], [879, 0.003266, " who", false], [320, 0.002792, " (", false], [304, 0.001867, " in", false], [9459, 0.00135, " opinion", false], [1576, 0.001321, " because", false], [25, 0.000955, ":", false], [438, 0.000939, " as", false]]]}, "raw_delta": -0.007543037335077922, "tuned_delta": 0.0010287546955003264}, {"byte_start": 1582, "byte_end": 1591, "display": {"text": " computer", "kind": "normal"}, "is_word": true, "word_id": 269, "word_key": " computer", "bytes_hex": "20 63 6f 6d 70 75 74 65 72", "compression": {"rwkv": "4.73% 4.73% 4.73% 4.73% 4.73% 4.73% 4.73% 4.73% 4.73%", "qwen": "4.84% 4.84% 4.84% 4.84% 4.84% 4.84% 4.84% 4.84% 4.84%"}, "model_tokens": {"rwkv": [[55809, " computer", "normal", 0.09370432049036026]], "qwen": [[6366, " computer", "normal", 0.08924874663352966]]}, "loss": {"rwkv": 4.727581405690829, "qwen": 4.841700493670846}, "topk": {"rwkv": [55809, 4, 0.09370432049036026, [[3609, 0.243718, " AI", false], [38013, 0.221257, " chess", false], [22590, 0.216489, " the", false], [55809, 0.093704, " computer", false], [63843, 0.072572, " researchers", false], [46787, 0.022371, " people", false], [51685, 0.015295, " experts", false], [38720, 0.01309, " human", false], [52489, 0.010965, " players", false], [39944, 0.008059, " those", false]]], "qwen": [6366, 4, 0.08924874663352966, [[32719, 0.430236, " chess", false], [279, 0.177072, " the", false], [11811, 0.107766, " researchers", false], [6366, 0.089249, " computer", false], [15235, 0.059845, " AI", false], [1251, 0.017006, " people", false], [3738, 0.011981, " human", false], [11647, 0.009664, " experts", false], [1846, 0.007894, " those", false], [3412, 0.007429, " research", false]]]}, "raw_delta": -0.006328105926513672, "tuned_delta": 0.0022436861040645763}, {"byte_start": 1591, "byte_end": 1597, "display": {"text": "-chess", "kind": "normal"}, "is_word": true, "word_id": 270, "word_key": "-chess", "bytes_hex": "2d 63 68 65 73 73", "compression": {"rwkv": "55.79% 8.28% 8.28% 8.28% 8.28% 0.03%", "qwen": "22.36% 22.36% 22.36% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.04488632455468178], [24991, "ches", "normal", 0.15904244780540466], [116, "s", "normal", 0.9983900785446167]], "qwen": [[11582, "-ch", "normal", 0.02424108237028122], [433, "ess", "normal", 0.9995290040969849]]}, "loss": {"rwkv": 14.821625368497653, "qwen": 11.181420540360765}, "topk": {"rwkv": [46, 3, 0.04488632455468178, [[38013, 0.620857, " chess", false], [62532, 0.155146, " scientists", false], [46, 0.044886, "-", false], [51685, 0.036822, " experts", false], [52489, 0.027644, " players", false], [63794, 0.026189, " programmers", false], [52814, 0.023006, " science", false], [63843, 0.012672, " researchers", false], [3609, 0.006459, " AI", false], [30941, 0.003699, " game", false]]], "qwen": [11582, 4, 0.02424108237028122, [[13923, 0.414545, " scientists", false], [32719, 0.39622, " chess", false], [8038, 0.050103, " science", false], [11582, 0.024241, "-ch", false], [54846, 0.019488, " programmers", false], [4217, 0.016435, " players", false], [11811, 0.016364, " researchers", false], [27468, 0.007223, " scientist", false], [11129, 0.006301, " vision", false], [11647, 0.003527, " experts", false]]]}, "raw_delta": 0.20185581706270259, "tuned_delta": 0.21042760909328084}, {"byte_start": 1597, "byte_end": 1609, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 271, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"rwkv": "0.37% 0.37% 0.37% 0.37% 0.37% 0.37% 0.37% 0.37% 0.37% 0.37% 0.37% 0.37%", "qwen": "0.84% 0.84% 0.84% 0.84% 0.84% 0.84% 0.84% 0.84% 0.84% 0.84% 0.84% 0.84%"}, "model_tokens": {"rwkv": [[63843, " researchers", "normal", 0.7792559862136841]], "qwen": [[11811, " researchers", "normal", 0.5727719068527222]]}, "loss": {"rwkv": 0.37129907770274634, "qwen": 0.8374660249788509}, "topk": {"rwkv": [63843, 1, 0.7792559862136841, [[63843, 0.779256, " researchers", false], [51685, 0.079981, " experts", false], [52489, 0.038938, " players", false], [63533, 0.015383, " enthusiasts", false], [64985, 0.010136, " practitioners", false], [57103, 0.008909, " research", false], [46, 0.007441, "-", false], [46787, 0.007054, " people", false], [63874, 0.005711, " specialists", false], [30819, 0.003354, " fans", false]]], "qwen": [11811, 1, 0.5727719068527222, [[11811, 0.572772, " researchers", false], [4217, 0.101854, " players", false], [11647, 0.098618, " experts", false], [54846, 0.034473, " programmers", false], [42348, 0.030855, " enthusiasts", false], [72085, 0.026601, "-playing", false], [3412, 0.015379, " research", false], [82962, 0.012889, " theorists", false], [15387, 0.006701, " professionals", false], [42095, 0.006361, " practitioners", false]]]}, "raw_delta": -0.02584978441397349, "tuned_delta": -0.017277992383395245}, {"byte_start": 1609, "byte_end": 1613, "display": {"text": " who", "kind": "normal"}, "is_word": true, "word_id": 272, "word_key": " who", "bytes_hex": "20 77 68 6f", "compression": {"rwkv": "12.89% 12.89% 12.89% 12.89%", "qwen": "11.10% 11.10% 11.10% 11.10%"}, "model_tokens": {"rwkv": [[22762, " who", "normal", 0.05782460421323776]], "qwen": [[879, " who", "normal", 0.08526797592639923]]}, "loss": {"rwkv": 12.891269164193373, "qwen": 11.099538859022683}, "topk": {"rwkv": [22762, 3, 0.05782460421323776, [[45, 0.493104, ",", false], [47, 0.262916, ".", false], [22762, 0.057825, " who", false], [4423, 0.048434, " as", false], [51018, 0.044163, " because", false], [275, 0.017412, " (", false], [59, 0.014396, ":", false], [60, 0.013908, ";", false], [21265, 0.011592, " and", false], [4596, 0.007335, " in", false]]], "qwen": [879, 3, 0.08526797592639923, [[11, 0.460601, ",", false], [13, 0.243955, ".", false], [879, 0.085268, " who", false], [1576, 0.048636, " because", false], [320, 0.030388, " (", false], [323, 0.02917, " and", false], [25, 0.018105, ":", false], [438, 0.018057, " as", false], [26, 0.015047, ";", false], [2474, 0.005002, " since", false]]]}, "raw_delta": 0.09935462474822998, "tuned_delta": 0.10792641677880822}, {"byte_start": 1613, "byte_end": 1617, "display": {"text": " had", "kind": "normal"}, "is_word": true, "word_id": 273, "word_key": " had", "bytes_hex": "20 68 61 64", "compression": {"rwkv": "8.81% 8.81% 8.81% 8.81%", "qwen": "6.76% 6.76% 6.76% 6.76%"}, "model_tokens": {"rwkv": [[21795, " had", "normal", 0.14216969907283783]], "qwen": [[1030, " had", "normal", 0.2232958972454071]]}, "loss": {"rwkv": 8.805511724175801, "qwen": 6.759285254378814}, "topk": {"rwkv": [21795, 1, 0.14216969907283783, [[21795, 0.14217, " had", false], [55616, 0.139973, " believed", false], [32462, 0.124577, " were", false], [53137, 0.103935, " thought", false], [30840, 0.040844, " felt", false], [22439, 0.028225, " saw", false], [60227, 0.02457, " preferred", false], [45, 0.021214, ",", false], [56175, 0.017539, " expected", false], [39820, 0.015485, " still", false]]], "qwen": [1030, 1, 0.2232958972454071, [[1030, 0.223296, " had", false], [1033, 0.171908, " were", false], [11585, 0.130731, " believed", false], [3381, 0.049534, " thought", false], [14890, 0.037662, " preferred", false], [11, 0.028434, ",", false], [6476, 0.017256, " felt", false], [4829, 0.015278, " wanted", false], [45503, 0.012905, " favored", false], [4518, 0.011503, " instead", false]]]}, "raw_delta": 0.11346688866615295, "tuned_delta": 0.1220386806967312}, {"byte_start": 1617, "byte_end": 1625, "display": {"text": " pursued", "kind": "normal"}, "is_word": true, "word_id": 274, "word_key": " pursued", "bytes_hex": "20 70 75 72 73 75 65 64", "compression": {"rwkv": "13.10% 13.10% 13.10% 13.10% 13.10% 13.10% 13.10% 13.10%", "qwen": "11.11% 11.11% 11.11% 11.11% 11.11% 11.11% 11.11% 11.11%"}, "model_tokens": {"rwkv": [[52611, " pursued", "normal", 0.002957211807370186]], "qwen": [[45431, " pursued", "normal", 0.007243321277201176]]}, "loss": {"rwkv": 13.102601445573592, "qwen": 11.108019753493355}, "topk": {"rwkv": [52611, 46, 0.002957211807370186, [[30259, 0.249961, " been", false], [39762, 0.085795, " spent", false], [62367, 0.072542, " previously", false], [30482, 0.02922, " come", false], [55616, 0.024881, " believed", false], [47812, 0.024567, " worked", false], [56495, 0.023266, " invested", false], [53137, 0.020698, " thought", false], [22187, 0.017016, " not", false], [38709, 0.015475, " hoped", false]]], "qwen": [45431, 21, 0.007243321277201176, [[1012, 0.228198, " been", false], [7391, 0.173035, " spent", false], [27991, 0.042318, " invested", false], [10735, 0.036404, " focused", false], [8597, 0.023174, " previously", false], [7881, 0.022822, " developed", false], [6439, 0.019705, " worked", false], [11585, 0.019437, " believed", false], [6679, 0.016472, " tried", false], [28229, 0.013101, " devoted", false]]]}, "raw_delta": 0.11060309410095215, "tuned_delta": 0.11917488613153039}, {"byte_start": 1625, "byte_end": 1633, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 275, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "5.95% 5.95% 5.95% 5.95% 5.95% 5.95% 5.95% 5.95%", "qwen": "5.07% 5.07% 5.07% 5.07% 5.07% 5.07% 5.07% 5.07%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.07155764102935791]], "qwen": [[5413, " methods", "normal", 0.10562748461961746]]}, "loss": {"rwkv": 5.952525925542842, "qwen": 5.067097970081733}, "topk": {"rwkv": [52224, 4, 0.07155764102935791, [[22590, 0.188231, " the", false], [332, 0.132115, " a", false], [39193, 0.079462, " other", false], [52224, 0.071558, " methods", false], [31458, 0.042285, " more", false], [63277, 0.028887, " alternative", false], [4419, 0.024123, " an", false], [38720, 0.017514, " human", false], [47202, 0.014367, " search", false], [53265, 0.012634, " various", false]]], "qwen": [5413, 2, 0.10562748461961746, [[264, 0.154715, " a", false], [5413, 0.105627, " methods", false], [279, 0.101364, " the", false], [1008, 0.059124, " other", false], [458, 0.029129, " an", false], [803, 0.02519, " more", false], [2155, 0.020887, " different", false], [25600, 0.016323, " shallow", false], [10555, 0.016134, " alternative", false], [1128, 0.016059, " what", false]]]}, "raw_delta": 0.04909855127334595, "tuned_delta": 0.0576703433039242}, {"byte_start": 1633, "byte_end": 1638, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 276, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "4.93% 4.93% 4.93% 4.93% 4.93%", "qwen": "4.99% 4.99% 4.99% 4.99% 4.99%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.25757429003715515]], "qwen": [[429, " that", "normal", 0.25049540400505066]]}, "loss": {"rwkv": 4.931086565538449, "qwen": 4.992860153988606}, "topk": {"rwkv": [32227, 2, 0.25757429003715515, [[37810, 0.371391, " based", false], [32227, 0.257574, " that", false], [4706, 0.072435, " of", false], [59927, 0.030102, " involving", false], [21700, 0.021525, " for", false], [52700, 0.018955, " relying", false], [31296, 0.01863, " like", false], [38888, 0.018359, " lever", false], [4596, 0.017246, " in", false], [32139, 0.016944, " such", false]]], "qwen": [429, 2, 0.25049540400505066, [[3118, 0.496231, " based", false], [429, 0.250495, " that", false], [315, 0.041951, " of", false], [38561, 0.014541, " relying", false], [1667, 0.012073, " using", false], [14606, 0.011522, " inspired", false], [448, 0.009377, " with", false], [369, 0.008967, " for", false], [803, 0.008254, " more", false], [311, 0.007694, " to", false]]]}, "raw_delta": -0.003425455093383767, "tuned_delta": 0.005146336937194481}, {"byte_start": 1638, "byte_end": 1648, "display": {"text": " leveraged", "kind": "normal"}, "is_word": true, "word_id": 277, "word_key": " leveraged", "bytes_hex": "20 6c 65 76 65 72 61 67 65 64", "compression": {"rwkv": "4.23% 4.23% 4.23% 4.23% 4.23% 4.23% 4.23% 4.23% 4.23% 0.26%", "qwen": "8.38% 8.38% 8.38% 8.38% 8.38% 8.38% 0.00% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[56540, " leverage", "normal", 0.12110395729541779], [101, "d", "normal", 0.9858278036117554]], "qwen": [[27505, " lever", "normal", 0.06148497387766838], [3279, "aged", "normal", 0.9993828535079956]]}, "loss": {"rwkv": 3.8298472555337124, "qwen": 5.030640959058762}, "topk": {"rwkv": [56540, 2, 0.12110395729541779, [[32462, 0.139173, " were", false], [56540, 0.121104, " leverage", false], [47054, 0.084049, " relied", false], [32354, 0.059584, " used", false], [56500, 0.033754, " involved", false], [59685, 0.027754, " exploited", false], [21532, 0.027139, " did", false], [31351, 0.024597, " made", false], [40219, 0.021734, " would", false], [47340, 0.020651, " sought", false]]], "qwen": [27505, 3, 0.06148497387766838, [[39913, 0.185761, " relied", false], [1033, 0.15033, " were", false], [27505, 0.061485, " lever", false], [1483, 0.056543, " used", false], [50663, 0.024234, " exploited", false], [6398, 0.024042, " involved", false], [32064, 0.021802, " leverage", false], [1030, 0.017015, " had", false], [6966, 0.014276, " looked", false], [10735, 0.013199, " focused", false]]]}, "raw_delta": -0.06658614160260186, "tuned_delta": -0.05801434957202361}, {"byte_start": 1648, "byte_end": 1654, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 278, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "1.54% 1.54% 1.54% 1.54% 1.54% 1.54%", "qwen": "1.39% 1.39% 1.39% 1.39% 1.39% 1.39%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.5997323393821716]], "qwen": [[3738, " human", "normal", 0.6296586990356445]]}, "loss": {"rwkv": 1.53802938115604, "qwen": 1.3903292474063027}, "topk": {"rwkv": [38720, 1, 0.5997323393821716, [[38720, 0.599732, " human", false], [59943, 0.064163, " knowledge", false], [22590, 0.057836, " the", false], [39931, 0.05362, " their", false], [45775, 0.020474, " domain", false], [51832, 0.015236, " general", false], [332, 0.013627, " a", false], [38013, 0.009546, " chess", false], [55809, 0.009065, " computer", false], [59792, 0.007936, " heuristic", false]]], "qwen": [3738, 1, 0.6296586990356445, [[3738, 0.629659, " human", false], [6540, 0.071354, " knowledge", false], [279, 0.045133, " the", false], [862, 0.042105, " their", false], [264, 0.014281, " a", false], [32719, 0.011978, " chess", false], [7947, 0.010835, " domain", false], [803, 0.007386, " more", false], [1172, 0.005906, " only", false], [4586, 0.005699, " general", false]]]}, "raw_delta": 0.008190234502156571, "tuned_delta": 0.01676202653273482}, {"byte_start": 1654, "byte_end": 1668, "display": {"text": " understanding", "kind": "normal"}, "is_word": true, "word_id": 279, "word_key": " understanding", "bytes_hex": "20 75 6e 64 65 72 73 74 61 6e 64 69 6e 67", "compression": {"rwkv": "6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68%", "qwen": "7.90% 7.90% 7.90% 7.90% 7.90% 7.90% 7.90% 7.90% 7.90% 7.90% 7.90% 7.90% 7.90% 7.90%"}, "model_tokens": {"rwkv": [[65034, " understanding", "normal", 0.0055396584793925285]], "qwen": [[8660, " understanding", "normal", 0.0021649186965078115]]}, "loss": {"rwkv": 6.6821254684031235, "qwen": 7.903099714162297}, "topk": {"rwkv": [65034, 5, 0.0055396584793925285, [[59943, 0.883994, " knowledge", false], [59683, 0.025255, " expertise", false], [46, 0.022538, "-", false], [38013, 0.013486, " chess", false], [65034, 0.00554, " understanding", false], [59917, 0.003281, " intuition", false], [62418, 0.003033, " psychology", false], [52022, 0.002299, " insight", false], [45929, 0.00215, " expert", false], [45775, 0.00209, " domain", false]]], "qwen": [8660, 9, 0.0021649186965078115, [[6540, 0.831445, " knowledge", false], [12646, 0.055003, "-k", false], [18726, 0.026358, " expertise", false], [32719, 0.025361, " chess", false], [6203, 0.004151, " expert", false], [7947, 0.004118, " domain", false], [56251, 0.003225, " intuition", false], [3139, 0.002364, " experience", false], [8660, 0.002165, " understanding", false], [6358, 0.001524, " analysis", false]]]}, "raw_delta": -0.0677051884787423, "tuned_delta": -0.059133396448164045}, {"byte_start": 1668, "byte_end": 1671, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 280, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "3.71% 3.71% 3.71%", "qwen": "2.64% 2.64% 2.64%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.5453326106071472]], "qwen": [[315, " of", "normal", 0.6447494029998779]]}, "loss": {"rwkv": 3.7100556064527375, "qwen": 2.63829000238821}, "topk": {"rwkv": [4706, 1, 0.5453326106071472, [[4706, 0.545333, " of", false], [47, 0.215073, ".", false], [45, 0.072792, ",", false], [21265, 0.057871, " and", false], [275, 0.021519, " (", false], [4596, 0.017123, " in", false], [4811, 0.01344, " to", false], [4715, 0.00484, " or", false], [59, 0.004384, ":", false], [47001, 0.003393, " rather", false]]], "qwen": [315, 1, 0.6447494029998779, [[315, 0.644749, " of", false], [13, 0.137459, ".", false], [11, 0.060294, ",", false], [323, 0.028427, " and", false], [320, 0.027727, " (", false], [311, 0.01483, " to", false], [304, 0.013108, " in", false], [4751, 0.007219, " rather", false], [553, 0.005149, " by", false], [803, 0.005016, " more", false]]]}, "raw_delta": 0.05943130453427631, "tuned_delta": 0.06800309656485455}, {"byte_start": 1671, "byte_end": 1675, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 281, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "2.02% 2.02% 2.02% 2.02%", "qwen": "2.04% 2.04% 2.04% 2.04%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.6395004987716675]], "qwen": [[279, " the", "normal", 0.6357907056808472]]}, "loss": {"rwkv": 2.0164621848362585, "qwen": 2.041800469404744}, "topk": {"rwkv": [22590, 1, 0.6395004987716675, [[22590, 0.6395, " the", false], [38013, 0.250885, " chess", false], [30941, 0.013298, " game", false], [38576, 0.009768, " games", false], [21835, 0.008793, " how", false], [57317, 0.005117, " strategy", false], [31702, 0.00386, " play", false], [32464, 0.003629, " what", false], [39072, 0.003538, " moves", false], [60563, 0.003109, " strategic", false]]], "qwen": [279, 1, 0.6357907056808472, [[279, 0.635791, " the", false], [32719, 0.282524, " chess", false], [1246, 0.015043, " how", false], [1809, 0.006775, " game", false], [1128, 0.003794, " what", false], [3868, 0.003788, " games", false], [4479, 0.00322, " board", false], [264, 0.002583, " a", false], [9892, 0.002425, " positions", false], [2309, 0.002364, " position", false]]]}, "raw_delta": -0.0014050528407096863, "tuned_delta": 0.007166739189868562}, {"byte_start": 1675, "byte_end": 1683, "display": {"text": " special", "kind": "normal"}, "is_word": true, "word_id": 282, "word_key": " special", "bytes_hex": "20 73 70 65 63 69 61 6c", "compression": {"rwkv": "22.96% 22.96% 22.96% 22.96% 22.96% 22.96% 22.96% 22.96%", "qwen": "21.71% 21.71% 21.71% 21.71% 21.71% 21.71% 21.71% 21.71%"}, "model_tokens": {"rwkv": [[52964, " special", "normal", 3.7776739191031083e-05]], "qwen": [[3281, " special", "normal", 6.576983287231997e-05]]}, "loss": {"rwkv": 22.96477457665049, "qwen": 21.706583899468352}, "topk": {"rwkv": [52964, 207, 3.7776739191031083e-05, [[30941, 0.776871, " game", false], [45775, 0.113485, " domain", false], [38013, 0.020491, " chess", false], [39558, 0.008626, " rules", false], [56893, 0.007699, " position", false], [37876, 0.006084, " board", false], [52569, 0.005186, " problem", false], [60572, 0.003166, " structure", false], [46642, 0.003003, " nature", false], [60563, 0.002563, " strategic", false]]], "qwen": [3281, 153, 6.576983287231997e-05, [[1809, 0.705544, " game", false], [7947, 0.075646, " domain", false], [32719, 0.062908, " chess", false], [5601, 0.027749, " rules", false], [4479, 0.024367, " board", false], [3491, 0.019437, " problem", false], [3868, 0.008428, " games", false], [2309, 0.006874, " position", false], [9666, 0.005155, " pieces", false], [16170, 0.003218, " principles", false]]]}, "raw_delta": 0.06976890563964844, "tuned_delta": 0.07834069767022668}, {"byte_start": 1683, "byte_end": 1693, "display": {"text": " structure", "kind": "normal"}, "is_word": true, "word_id": 283, "word_key": " structure", "bytes_hex": "20 73 74 72 75 63 74 75 72 65", "compression": {"rwkv": "3.16% 3.16% 3.16% 3.16% 3.16% 3.16% 3.16% 3.16% 3.16% 3.16%", "qwen": "4.73% 4.73% 4.73% 4.73% 4.73% 4.73% 4.73% 4.73% 4.73% 4.73%"}, "model_tokens": {"rwkv": [[60572, " structure", "normal", 0.17478929460048676]], "qwen": [[5944, " structure", "normal", 0.07244773954153061]]}, "loss": {"rwkv": 3.1558954019446075, "qwen": 4.733644462955164}, "topk": {"rwkv": [60572, 2, 0.17478929460048676, [[56215, 0.198867, " features", false], [60572, 0.174789, " structure", false], [62404, 0.108107, " properties", false], [65258, 0.088162, " characteristics", false], [46642, 0.078605, " nature", false], [30405, 0.046773, " case", false], [50964, 0.030504, " aspects", false], [39558, 0.022449, " rules", false], [64847, 0.014595, " circumstances", false], [59943, 0.014528, " knowledge", false]]], "qwen": [5944, 3, 0.07244773954153061, [[4419, 0.226434, " features", false], [5888, 0.196031, " properties", false], [5944, 0.072448, " structure", false], [17452, 0.046335, " characteristics", false], [6540, 0.043927, " knowledge", false], [1361, 0.035753, "ities", false], [13566, 0.027856, " aspects", false], [5601, 0.0259, " rules", false], [32719, 0.025622, " chess", false], [6993, 0.019552, " nature", false]]]}, "raw_delta": -0.08748898506164555, "tuned_delta": -0.07891719303106731}, {"byte_start": 1693, "byte_end": 1696, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 284, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.54% 0.54% 0.54%", "qwen": "0.28% 0.28% 0.28%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9133241176605225]], "qwen": [[315, " of", "normal", 0.9550149440765381]]}, "loss": {"rwkv": 0.5430065563241744, "qwen": 0.2766864276960394}, "topk": {"rwkv": [4706, 1, 0.9133241176605225, [[4706, 0.913324, " of", false], [21265, 0.05389, " and", false], [32227, 0.007661, " that", false], [4596, 0.007532, " in", false], [45, 0.002641, ",", false], [275, 0.001931, " (", false], [52544, 0.001214, " present", false], [4715, 0.000954, " or", false], [56454, 0.000948, " inherent", false], [56500, 0.00066, " involved", false]]], "qwen": [315, 1, 0.9550149440765381, [[315, 0.955015, " of", false], [323, 0.013298, " and", false], [304, 0.010245, " in", false], [429, 0.003382, " that", false], [16533, 0.002991, " underlying", false], [36988, 0.001696, " inherent", false], [3042, 0.001604, " present", false], [320, 0.001567, " (", false], [11, 0.001048, ",", false], [807, 0.000631, " they", false]]]}, "raw_delta": 0.0147679237027963, "tuned_delta": 0.02333971573337455}, {"byte_start": 1696, "byte_end": 1702, "display": {"text": " chess", "kind": "normal"}, "is_word": true, "word_id": 285, "word_key": " chess", "bytes_hex": "20 63 68 65 73 73", "compression": {"rwkv": "2.62% 2.62% 2.62% 2.62% 2.62% 2.62%", "qwen": "1.21% 1.21% 1.21% 1.21% 1.21% 1.21%"}, "model_tokens": {"rwkv": [[38013, " chess", "normal", 0.4181702733039856]], "qwen": [[32719, " chess", "normal", 0.6691892147064209]]}, "loss": {"rwkv": 2.618172152654938, "qwen": 1.2073206275629442}, "topk": {"rwkv": [38013, 2, 0.4181702733039856, [[22590, 0.476079, " the", false], [38013, 0.41817, " chess", false], [332, 0.012555, " a", false], [37876, 0.011526, " board", false], [32234, 0.01071, " this", false], [38576, 0.009492, " games", false], [32227, 0.005553, " that", false], [55809, 0.003802, " computer", false], [60202, 0.002747, " positions", false], [30941, 0.002439, " game", false]]], "qwen": [32719, 1, 0.6691892147064209, [[32719, 0.669189, " chess", false], [279, 0.276381, " the", false], [3868, 0.006729, " games", false], [264, 0.006351, " a", false], [419, 0.005637, " this", false], [1779, 0.005631, " check", false], [6366, 0.003659, " computer", false], [5994, 0.001782, " Go", false], [4479, 0.001778, " board", false], [47387, 0.001769, " Chess", false]]]}, "raw_delta": 0.07823422054449715, "tuned_delta": 0.08680601257507539}, {"byte_start": 1702, "byte_end": 1703, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "15.92%", "qwen": "14.68%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.4152854382991791]], "qwen": [[13, ".", "normal", 0.44312065839767456]]}, "loss": {"rwkv": 15.920365197309849, "qwen": 14.677857188103266}, "topk": {"rwkv": [47, 1, 0.4152854382991791, [[47, 0.415285, ".", false], [45, 0.138868, ",", false], [275, 0.060483, " (", false], [60202, 0.059551, " positions", false], [21265, 0.052644, " and", false], [4423, 0.038024, " as", false], [38576, 0.034104, " games", false], [56939, 0.02069, " problems", false], [4811, 0.015186, " to", false], [52616, 0.013291, " puzzles", false]]], "qwen": [13, 1, 0.44312065839767456, [[13, 0.443121, ".", false], [11, 0.128804, ",", false], [320, 0.080235, " (", false], [311, 0.048823, " to", false], [9892, 0.044417, " positions", false], [323, 0.028027, " and", false], [4751, 0.018054, " rather", false], [304, 0.017365, " in", false], [5322, 0.014898, " problems", false], [382, 0.010414, ".\n\n", false]]]}, "raw_delta": 0.06889927387237549, "tuned_delta": 0.07747106590295373}, {"byte_start": 1703, "byte_end": 1708, "display": {"text": " When", "kind": "normal"}, "is_word": true, "word_id": 286, "word_key": " when", "bytes_hex": "20 57 68 65 6e", "compression": {"rwkv": "17.92% 17.92% 17.92% 17.92% 17.92%", "qwen": "17.97% 17.97% 17.97% 17.97% 17.97%"}, "model_tokens": {"rwkv": [[30032, " When", "normal", 0.007001301273703575]], "qwen": [[3197, " When", "normal", 0.00685387896373868]]}, "loss": {"rwkv": 17.92097746104259, "qwen": 17.972159497939362}, "topk": {"rwkv": [30032, 27, 0.007001301273703575, [[20996, 0.146973, " The", false], [19555, 0.095088, " But", false], [3913, 0.06269, " In", false], [29894, 0.038998, " This", false], [3918, 0.035124, " It", false], [267, 0.033548, "  ", false], [37453, 0.028921, " These", false], [29893, 0.026198, " They", false], [275, 0.022298, " (", false], [50318, 0.022143, " However", false]]], "qwen": [3197, 26, 0.00685387896373868, [[576, 0.144867, " The", false], [220, 0.068299, " ", false], [4220, 0.058249, " These", false], [2379, 0.047176, " They", false], [758, 0.044735, " In", false], [1096, 0.041127, " This", false], [1084, 0.033302, " It", false], [1988, 0.029506, " But", false], [47387, 0.023685, " Chess", false], [10964, 0.023642, " Their", false]]]}, "raw_delta": -0.002838134765625, "tuned_delta": 0.005733657264953248}, {"byte_start": 1708, "byte_end": 1710, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 287, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "30.57% 30.57%", "qwen": "28.05% 28.05%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.033543530851602554]], "qwen": [[264, " a", "normal", 0.04458407685160637]]}, "loss": {"rwkv": 30.572736706338382, "qwen": 28.04579776699427}, "topk": {"rwkv": [332, 5, 0.033543530851602554, [[22590, 0.200279, " the", false], [20184, 0.119217, " Kas", false], [28753, 0.053023, " Deep", false], [4601, 0.051405, " it", false], [332, 0.033544, " a", false], [39936, 0.026697, " these", false], [36274, 0.025618, " Alpha", false], [39944, 0.02499, " those", false], [32234, 0.021867, " this", false], [32227, 0.018636, " that", false]]], "qwen": [264, 4, 0.04458407685160637, [[279, 0.201523, " the", false], [18183, 0.087553, " Deep", false], [358, 0.055487, " I", false], [264, 0.044584, " a", false], [37542, 0.044462, " Kas", false], [807, 0.039931, " they", false], [1493, 0.030735, " these", false], [32719, 0.020001, " chess", false], [5538, 0.01991, " deep", false], [419, 0.019768, " this", false]]]}, "raw_delta": 0.14012324810028076, "tuned_delta": 0.14869504013085902}, {"byte_start": 1710, "byte_end": 1718, "display": {"text": " simpler", "kind": "normal"}, "is_word": true, "word_id": 288, "word_key": " simpler", "bytes_hex": "20 73 69 6d 70 6c 65 72", "compression": {"rwkv": "15.08% 15.08% 15.08% 15.08% 15.08% 15.08% 15.08% 15.08%", "qwen": "19.53% 19.53% 19.53% 19.53% 19.53% 19.53% 19.53% 19.53%"}, "model_tokens": {"rwkv": [[52907, " simpler", "normal", 0.0012639120686799288]], "qwen": [[34288, " simpler", "normal", 0.00017262586334254593]]}, "loss": {"rwkv": 15.075036071788972, "qwen": 19.531349481138687}, "topk": {"rwkv": [52907, 83, 0.0012639120686799288, [[55809, 0.076037, " computer", false], [46561, 0.075533, " method", false], [52167, 0.063921, " machine", false], [38013, 0.061223, " chess", false], [38720, 0.060972, " human", false], [30597, 0.060776, " deep", false], [52580, 0.052468, " program", false], [51832, 0.038626, " general", false], [22168, 0.034404, " new", false], [47202, 0.027246, " search", false]]], "qwen": [34288, 364, 0.00017262586334254593, [[6366, 0.117928, " computer", false], [1714, 0.09407, " method", false], [32719, 0.084993, " chess", false], [3738, 0.071491, " human", false], [501, 0.042914, " new", false], [5538, 0.034239, " deep", false], [2025, 0.027557, " program", false], [6662, 0.022282, " grand", false], [1879, 0.015855, " world", false], [1849, 0.014348, " system", false]]]}, "raw_delta": -0.2471104860305786, "tuned_delta": -0.23853869400000036}, {"byte_start": 1718, "byte_end": 1719, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "33.25%", "qwen": "39.88%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.15707261860370636]], "qwen": [[11, ",", "normal", 0.10952530801296234]]}, "loss": {"rwkv": 33.24961227048782, "qwen": 39.88329698260418}, "topk": {"rwkv": [45, 2, 0.15707261860370636, [[46561, 0.473748, " method", false], [45, 0.157073, ",", false], [55532, 0.071119, " approach", false], [47202, 0.038367, " search", false], [21265, 0.029981, " and", false], [51832, 0.021128, " general", false], [21400, 0.014595, " but", false], [53275, 0.01257, " version", false], [47487, 0.011231, " system", false], [30597, 0.009506, " deep", false]]], "qwen": [11, 3, 0.10952530801296234, [[1714, 0.446108, " method", false], [5486, 0.126378, " approach", false], [11, 0.109525, ",", false], [12111, 0.029682, " algorithm", false], [323, 0.02904, " and", false], [2711, 0.021826, " search", false], [714, 0.018789, " but", false], [1849, 0.016111, " system", false], [2025, 0.013475, " program", false], [2319, 0.012094, " version", false]]]}, "raw_delta": -0.36784958839416504, "tuned_delta": -0.3592777963635868}, {"byte_start": 1719, "byte_end": 1726, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 289, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "12.00% 12.00% 12.00% 12.00% 12.00% 12.00% 12.00%", "qwen": "12.96% 12.96% 12.96% 12.96% 12.96% 12.96% 12.96%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.009499076753854752]], "qwen": [[2711, " search", "normal", 0.0065371133387088776]]}, "loss": {"rwkv": 11.99562282882006, "qwen": 12.95916177251648}, "topk": {"rwkv": [47202, 16, 0.009499076753854752, [[31458, 0.185807, " more", false], [38720, 0.093854, " human", false], [51832, 0.084545, " general", false], [31277, 0.073223, " less", false], [21400, 0.064149, " but", false], [45961, 0.045475, " faster", false], [52873, 0.028926, " shallow", false], [45301, 0.019571, " better", false], [45683, 0.018277, " deeper", false], [37920, 0.01491, " brute", false]]], "qwen": [2711, 21, 0.0065371133387088776, [[2686, 0.149039, " less", false], [803, 0.129059, " more", false], [3738, 0.076043, " human", false], [714, 0.072923, " but", false], [10596, 0.04321, " faster", false], [25600, 0.020209, " shallow", false], [19117, 0.019998, " deeper", false], [4586, 0.017421, " general", false], [5538, 0.015501, " deep", false], [2477, 0.013525, " non", false]]]}, "raw_delta": -0.05342994417463032, "tuned_delta": -0.04485815214405207}, {"byte_start": 1726, "byte_end": 1732, "display": {"text": "-based", "kind": "normal"}, "is_word": true, "word_id": 290, "word_key": "-based", "bytes_hex": "2d 62 61 73 65 64", "compression": {"rwkv": "0.74% 0.96% 0.96% 0.96% 0.96% 0.96%", "qwen": "3.60% 3.60% 3.60% 3.60% 3.60% 3.60%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.9595441222190857], [34011, "based", "normal", 0.7661516070365906]], "qwen": [[5980, "-based", "normal", 0.3017718195915222]]}, "loss": {"rwkv": 0.9223773531074152, "qwen": 3.600979193114894}, "topk": {"rwkv": [46, 1, 0.9595441222190857, [[46, 0.959544, "-", false], [37810, 0.006754, " based", false], [46561, 0.006426, " method", false], [26127, 0.005095, "less", false], [35003, 0.002918, "light", false], [45862, 0.001671, " engine", false], [34011, 0.001429, "based", false], [31277, 0.00105, " less", false], [32298, 0.001029, " tree", false], [55532, 0.001023, " approach", false]]], "qwen": [5980, 1, 0.3017718195915222, [[5980, 0.301772, "-based", false], [1717, 0.245659, "less", false], [12577, 0.082205, "-free", false], [54909, 0.076161, "-less", false], [12, 0.033105, "-", false], [2852, 0.026122, "-l", false], [3419, 0.017647, "-in", false], [6810, 0.01748, "-de", false], [17709, 0.015087, "-light", false], [18376, 0.013742, "-exp", false]]]}, "raw_delta": -0.1485332250595093, "tuned_delta": -0.13996143302893105}, {"byte_start": 1732, "byte_end": 1741, "display": {"text": " approach", "kind": "normal"}, "is_word": true, "word_id": 291, "word_key": " approach", "bytes_hex": "20 61 70 70 72 6f 61 63 68", "compression": {"rwkv": "3.08% 3.08% 3.08% 3.08% 3.08% 3.08% 3.08% 3.08% 3.08%", "qwen": "2.77% 2.77% 2.77% 2.77% 2.77% 2.77% 2.77% 2.77% 2.77%"}, "model_tokens": {"rwkv": [[55532, " approach", "normal", 0.21413181722164154]], "qwen": [[5486, " approach", "normal", 0.2512800395488739]]}, "loss": {"rwkv": 3.0838858838446805, "qwen": 2.7675443399547306}, "topk": {"rwkv": [55532, 2, 0.21413181722164154, [[46561, 0.566179, " method", false], [55532, 0.214132, " approach", false], [47487, 0.037443, " system", false], [52580, 0.021893, " program", false], [45, 0.020486, ",", false], [57260, 0.017414, " solution", false], [3609, 0.01615, " AI", false], [38013, 0.01427, " chess", false], [55809, 0.011896, " computer", false], [59113, 0.00571, " algorithm", false]]], "qwen": [5486, 2, 0.2512800395488739, [[1714, 0.624797, " method", false], [5486, 0.25128, " approach", false], [1849, 0.044035, " system", false], [2025, 0.013728, " program", false], [11, 0.01117, ",", false], [14762, 0.006686, " technique", false], [12111, 0.005863, " algorithm", false], [6291, 0.003235, " solution", false], [8282, 0.003155, " strategy", false], [6366, 0.002419, " computer", false]]]}, "raw_delta": 0.017541699939303934, "tuned_delta": 0.026113491969882184}, {"byte_start": 1741, "byte_end": 1746, "display": {"text": " with", "kind": "normal"}, "is_word": true, "word_id": 292, "word_key": " with", "bytes_hex": "20 77 69 74 68", "compression": {"rwkv": "20.06% 20.06% 20.06% 20.06% 20.06%", "qwen": "19.36% 19.36% 19.36% 19.36% 19.36%"}, "model_tokens": {"rwkv": [[32487, " with", "normal", 0.0038757920265197754]], "qwen": [[448, " with", "normal", 0.004661415237933397]]}, "loss": {"rwkv": 20.062477912362148, "qwen": 19.36253948022767}, "topk": {"rwkv": [32487, 34, 0.0038757920265197754, [[22748, 0.135995, " was", false], [22777, 0.104854, " won", false], [30256, 0.064874, " beat", false], [55934, 0.064274, " defeated", false], [51744, 0.052972, " finally", false], [61959, 0.042262, " eventually", false], [4811, 0.036133, " to", false], [45, 0.032198, ",", false], [32227, 0.026997, " that", false], [30383, 0.019303, " came", false]]], "qwen": [448, 36, 0.004661415237933397, [[572, 0.184156, " was", false], [2765, 0.070575, " won", false], [23283, 0.055593, " defeated", false], [374, 0.041249, " is", false], [9583, 0.028863, " eventually", false], [429, 0.026253, " that", false], [6116, 0.026081, " became", false], [29701, 0.020218, " dominated", false], [11, 0.01994, ",", false], [14816, 0.019933, " wins", false]]]}, "raw_delta": 0.0388128280639648, "tuned_delta": 0.04738462009454305}, {"byte_start": 1746, "byte_end": 1754, "display": {"text": " special", "kind": "normal"}, "is_word": true, "word_id": 293, "word_key": " special", "bytes_hex": "20 73 70 65 63 69 61 6c", "compression": {"rwkv": "17.33% 17.33% 17.33% 17.33% 17.33% 17.33% 17.33% 17.33%", "qwen": "20.77% 20.77% 20.77% 20.77% 20.77% 20.77% 20.77% 20.77%"}, "model_tokens": {"rwkv": [[52964, " special", "normal", 0.0004496047622524202]], "qwen": [[3281, " special", "normal", 9.964989294530824e-05]]}, "loss": {"rwkv": 17.329247073177978, "qwen": 20.769957783736956}, "topk": {"rwkv": [52964, 194, 0.0004496047622524202, [[332, 0.191682, " a", false], [22590, 0.048645, " the", false], [38720, 0.038933, " human", false], [31277, 0.036428, " less", false], [30597, 0.034435, " deep", false], [31466, 0.025209, " much", false], [52906, 0.023126, " similar", false], [4692, 0.018722, " no", false], [52195, 0.017973, " massive", false], [4419, 0.017767, " an", false]]], "qwen": [3281, 456, 9.964989294530824e-05, [[264, 0.162726, " a", false], [2686, 0.070888, " less", false], [279, 0.054744, " the", false], [16745, 0.040869, " fewer", false], [902, 0.036982, " no", false], [2664, 0.029638, " better", false], [29039, 0.028325, " comparable", false], [1172, 0.027494, " only", false], [4428, 0.02705, " similar", false], [1753, 0.022012, " much", false]]]}, "raw_delta": -0.19079351425170898, "tuned_delta": -0.18222172222113073}, {"byte_start": 1754, "byte_end": 1763, "display": {"text": " hardware", "kind": "normal"}, "is_word": true, "word_id": 294, "word_key": " hardware", "bytes_hex": "20 68 61 72 64 77 61 72 65", "compression": {"rwkv": "7.86% 7.86% 7.86% 7.86% 7.86% 7.86% 7.86% 7.86% 7.86%", "qwen": "12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55%"}, "model_tokens": {"rwkv": [[56353, " hardware", "normal", 0.01969507336616516]], "qwen": [[11773, " hardware", "normal", 0.0019082442158833146]]}, "loss": {"rwkv": 7.858430018731115, "qwen": 12.546581535334132}, "topk": {"rwkv": [56353, 10, 0.01969507336616516, [[46, 0.136974, "-", false], [52224, 0.067794, " methods", false], [59943, 0.043138, " knowledge", false], [60572, 0.043045, " structure", false], [62586, 0.037339, " structures", false], [39558, 0.033567, " rules", false], [59792, 0.0335, " heuristic", false], [56215, 0.025575, " features", false], [62633, 0.024171, " techniques", false], [56353, 0.019695, " hardware", false]]], "qwen": [11773, 41, 0.0019082442158833146, [[58238, 0.186541, "-purpose", false], [6540, 0.087972, " knowledge", false], [32719, 0.080224, " chess", false], [7428, 0.069225, " purpose", false], [5944, 0.042278, " structure", false], [5601, 0.032705, " rules", false], [566, 0.03113, " he", false], [3738, 0.030087, " human", false], [38485, 0.026627, "-case", false], [5413, 0.023169, " methods", false]]]}, "raw_delta": -0.25996632046169704, "tuned_delta": -0.2513945284311188}, {"byte_start": 1763, "byte_end": 1767, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 295, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "15.50% 15.50% 15.50% 15.50%", "qwen": "16.46% 16.46% 16.46% 16.46%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.0321439653635025]], "qwen": [[323, " and", "normal", 0.025942524895071983]]}, "loss": {"rwkv": 15.49770063454941, "qwen": 16.464178638904322}, "topk": {"rwkv": [21265, 7, 0.0321439653635025, [[22777, 0.162071, " won", false], [22748, 0.136268, " was", false], [55934, 0.077032, " defeated", false], [275, 0.048254, " (", false], [45, 0.045464, ",", false], [51744, 0.042829, " finally", false], [21265, 0.032144, " and", false], [61959, 0.026994, " eventually", false], [30256, 0.026825, " beat", false], [38128, 0.019286, " could", false]]], "qwen": [323, 7, 0.025942524895071983, [[572, 0.161828, " was", false], [6116, 0.055485, " became", false], [320, 0.053677, " (", false], [311, 0.04978, " to", false], [369, 0.043006, " for", false], [11, 0.026602, ",", false], [323, 0.025943, " and", false], [374, 0.025237, " is", false], [6519, 0.022702, " turned", false], [9583, 0.019155, " eventually", false]]]}, "raw_delta": -0.05359292030334473, "tuned_delta": -0.04502112827276648}, {"byte_start": 1767, "byte_end": 1776, "display": {"text": " software", "kind": "normal"}, "is_word": true, "word_id": 296, "word_key": " software", "bytes_hex": "20 73 6f 66 74 77 61 72 65", "compression": {"rwkv": "4.23% 4.23% 4.23% 4.23% 4.23% 4.23% 4.23% 4.23% 4.23%", "qwen": "3.74% 3.74% 3.74% 3.74% 3.74% 3.74% 3.74% 3.74% 3.74%"}, "model_tokens": {"rwkv": [[57257, " software", "normal", 0.12066756188869476]], "qwen": [[3162, " software", "normal", 0.1549476981163025]]}, "loss": {"rwkv": 4.226645627604385, "qwen": 3.73631496859156}, "topk": {"rwkv": [57257, 1, 0.12066756188869476, [[57257, 0.120668, " software", false], [332, 0.091038, " a", false], [52195, 0.040955, " massive", false], [38720, 0.033452, " human", false], [59988, 0.025548, " massively", false], [52964, 0.019492, " special", false], [31044, 0.019435, " hand", false], [4419, 0.017655, " an", false], [45301, 0.015361, " better", false], [31458, 0.013354, " more", false]]], "qwen": [3162, 1, 0.1549476981163025, [[3162, 0.154948, " software", false], [264, 0.118348, " a", false], [25185, 0.044363, " algorithms", false], [12538, 0.024099, " techniques", false], [3281, 0.020289, " special", false], [2711, 0.019608, " search", false], [15473, 0.017461, " programming", false], [458, 0.016747, " an", false], [27699, 0.015374, " clever", false], [27076, 0.012723, " specialized", false]]]}, "raw_delta": 0.027189705106947154, "tuned_delta": 0.035761497137525404}, {"byte_start": 1776, "byte_end": 1783, "display": {"text": " proved", "kind": "normal"}, "is_word": true, "word_id": 297, "word_key": " proved", "bytes_hex": "20 70 72 6f 76 65 64", "compression": {"rwkv": "12.08% 12.08% 12.08% 12.08% 12.08% 12.08% 12.08%", "qwen": "11.02% 11.02% 11.02% 11.02% 11.02% 11.02% 11.02%"}, "model_tokens": {"rwkv": [[46936, " proved", "normal", 0.009227147325873375]], "qwen": [[18651, " proved", "normal", 0.01385732926428318]]}, "loss": {"rwkv": 12.076130364583953, "qwen": 11.023584256828508}, "topk": {"rwkv": [46936, 17, 0.009227147325873375, [[22748, 0.155735, " was", false], [22777, 0.145421, " won", false], [55934, 0.076917, " defeated", false], [45, 0.048027, ",", false], [275, 0.037139, " (", false], [30256, 0.03504, " beat", false], [51744, 0.032274, " finally", false], [32227, 0.028484, " that", false], [61959, 0.026472, " eventually", false], [38128, 0.021097, " could", false]]], "qwen": [18651, 13, 0.01385732926428318, [[572, 0.160549, " was", false], [311, 0.048153, " to", false], [6116, 0.041038, " became", false], [6519, 0.034666, " turned", false], [369, 0.02844, " for", false], [320, 0.025774, " (", false], [1824, 0.019725, " support", false], [374, 0.01963, " is", false], [3697, 0.019219, " came", false], [11, 0.019093, ",", false]]]}, "raw_delta": 0.05836554936000271, "tuned_delta": 0.06693734139058095}, {"byte_start": 1783, "byte_end": 1790, "display": {"text": " vastly", "kind": "normal"}, "is_word": true, "word_id": 298, "word_key": " vastly", "bytes_hex": "20 76 61 73 74 6c 79", "compression": {"rwkv": "11.27% 11.27% 11.27% 11.27% 11.27% 11.27% 11.27%", "qwen": "16.44% 16.44% 16.44% 16.44% 16.44% 16.44% 16.44%"}, "model_tokens": {"rwkv": [[47708, " vastly", "normal", 0.012812004424631596]], "qwen": [[52008, " vastly", "normal", 0.0016954494640231133]]}, "loss": {"rwkv": 11.271055006945026, "qwen": 16.43592250359131}, "topk": {"rwkv": [47708, 17, 0.012812004424631596, [[4811, 0.272015, " to", false], [57350, 0.142239, " superior", false], [31458, 0.050594, " more", false], [62603, 0.03392, " successful", false], [51127, 0.033284, " capable", false], [32227, 0.031712, " that", false], [32393, 0.025362, " vict", false], [59593, 0.02474, " effective", false], [22590, 0.022994, " the", false], [46342, 0.018988, " itself", false]]], "qwen": [52008, 58, 0.0016954494640231133, [[311, 0.251034, " to", false], [6849, 0.098068, " successful", false], [16353, 0.072676, " superior", false], [14680, 0.052867, " competitive", false], [803, 0.036943, " more", false], [14016, 0.031679, " sufficient", false], [73710, 0.03152, " victorious", false], [18308, 0.025031, " equally", false], [438, 0.024942, " as", false], [7373, 0.024878, " effective", false]]]}, "raw_delta": -0.2864010674612863, "tuned_delta": -0.27782927543070807}, {"byte_start": 1790, "byte_end": 1795, "display": {"text": " more", "kind": "normal"}, "is_word": true, "word_id": 299, "word_key": " more", "bytes_hex": "20 6d 6f 72 65", "compression": {"rwkv": "3.72% 3.72% 3.72% 3.72% 3.72%", "qwen": "6.16% 6.16% 6.16% 6.16% 6.16%"}, "model_tokens": {"rwkv": [[31458, " more", "normal", 0.3574398159980774]], "qwen": [[803, " more", "normal", 0.1812962144613266]]}, "loss": {"rwkv": 3.719448152291858, "qwen": 6.158948102240927}, "topk": {"rwkv": [31458, 2, 0.3574398159980774, [[57350, 0.515153, " superior", false], [31458, 0.35744, " more", false], [45301, 0.07177, " better", false], [45961, 0.014264, " faster", false], [57326, 0.013514, " stronger", false], [59593, 0.003661, " effective", false], [22249, 0.002475, " out", false], [62603, 0.001708, " successful", false], [39855, 0.001371, " super", false], [56445, 0.001241, " inferior", false]]], "qwen": [803, 2, 0.1812962144613266, [[16353, 0.660181, " superior", false], [803, 0.181296, " more", false], [37179, 0.058894, " inferior", false], [700, 0.024377, " out", false], [2664, 0.023047, " better", false], [6849, 0.009693, " successful", false], [2686, 0.005975, " less", false], [10596, 0.005228, " faster", false], [7373, 0.003773, " effective", false], [8661, 0.00299, " easier", false]]]}, "raw_delta": -0.13527460098266603, "tuned_delta": -0.12670280895208777}, {"byte_start": 1795, "byte_end": 1805, "display": {"text": " effective", "kind": "normal"}, "is_word": true, "word_id": 300, "word_key": " effective", "bytes_hex": "20 65 66 66 65 63 74 69 76 65", "compression": {"rwkv": "1.18% 1.18% 1.18% 1.18% 1.18% 1.18% 1.18% 1.18% 1.18% 1.18%", "qwen": "1.37% 1.37% 1.37% 1.37% 1.37% 1.37% 1.37% 1.37% 1.37% 1.37%"}, "model_tokens": {"rwkv": [[59593, " effective", "normal", 0.5193632245063782]], "qwen": [[7373, " effective", "normal", 0.46875810623168945]]}, "loss": {"rwkv": 1.183460775729228, "qwen": 1.3663556183001244}, "topk": {"rwkv": [59593, 1, 0.5193632245063782, [[59593, 0.519363, " effective", false], [56900, 0.248142, " powerful", false], [62603, 0.087465, " successful", false], [51127, 0.040674, " capable", false], [59594, 0.032189, " efficient", false], [63362, 0.009723, " competitive", false], [47129, 0.005053, " robust", false], [55435, 0.004777, " accurate", false], [46876, 0.004775, " potent", false], [59330, 0.003539, " competent", false]]], "qwen": [7373, 1, 0.46875810623168945, [[7373, 0.468758, " effective", false], [6849, 0.270519, " successful", false], [7988, 0.08256, " powerful", false], [11050, 0.06984, " efficient", false], [14976, 0.015863, " practical", false], [14680, 0.00762, " competitive", false], [5390, 0.006265, " useful", false], [5411, 0.005939, " popular", false], [12875, 0.005797, " capable", false], [5000, 0.004134, " difficult", false]]]}, "raw_delta": -0.010141843557357783, "tuned_delta": -0.0015700515267795343}, {"byte_start": 1805, "byte_end": 1806, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "11.83%", "qwen": "11.38%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.517075777053833]], "qwen": [[11, ",", "normal", 0.5320721864700317]]}, "loss": {"rwkv": 11.834607757292277, "qwen": 11.378826860216636}, "topk": {"rwkv": [45, 1, 0.517075777053833, [[45, 0.517076, ",", false], [32226, 0.318234, " than", false], [4596, 0.058019, " in", false], [4424, 0.033092, " at", false], [275, 0.013151, " (", false], [50870, 0.010288, " against", false], [21265, 0.006574, " and", false], [21700, 0.005527, " for", false], [4712, 0.005304, " on", false], [32227, 0.003332, " that", false]]], "qwen": [11, 1, 0.5320721864700317, [[11, 0.532072, ",", false], [1091, 0.212294, " than", false], [304, 0.092278, " in", false], [518, 0.045037, " at", false], [320, 0.022672, " (", false], [369, 0.015273, " for", false], [2348, 0.008727, " against", false], [323, 0.006842, " and", false], [1283, 0.005439, " after", false], [389, 0.004736, " on", false]]]}, "raw_delta": 0.02527385950088501, "tuned_delta": 0.03384565153146326}, {"byte_start": 1806, "byte_end": 1812, "display": {"text": " these", "kind": "normal"}, "is_word": true, "word_id": 301, "word_key": " these", "bytes_hex": "20 74 68 65 73 65", "compression": {"rwkv": "10.24% 10.24% 10.24% 10.24% 10.24% 10.24%", "qwen": "10.84% 10.84% 10.84% 10.84% 10.84% 10.84%"}, "model_tokens": {"rwkv": [[39936, " these", "normal", 0.03285355120897293]], "qwen": [[1493, " these", "normal", 0.02717256359755993]]}, "loss": {"rwkv": 10.237874964641732, "qwen": 10.836886238030623}, "topk": {"rwkv": [39936, 7, 0.03285355120897293, [[22590, 0.291234, " the", false], [4601, 0.146537, " it", false], [31370, 0.061791, " many", false], [39934, 0.045832, " there", false], [32234, 0.039601, " this", false], [32232, 0.037792, " they", false], [39936, 0.032854, " these", false], [39944, 0.03154, " those", false], [332, 0.024274, " a", false], [32074, 0.02115, " some", false]]], "qwen": [1493, 8, 0.02717256359755993, [[279, 0.257182, " the", false], [432, 0.19001, " it", false], [1657, 0.046408, " many", false], [807, 0.03432, " they", false], [264, 0.033781, " a", false], [419, 0.031577, " this", false], [1052, 0.028688, " there", false], [1493, 0.027173, " these", false], [1429, 0.02651, " most", false], [11811, 0.023335, " researchers", false]]]}, "raw_delta": -0.033216238021850586, "tuned_delta": -0.024644445991272336}, {"byte_start": 1812, "byte_end": 1818, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 302, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "10.47% 10.47% 10.47% 10.47% 10.47% 10.47%", "qwen": "15.86% 15.86% 15.86% 15.86% 15.86% 15.86%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.03081255406141281]], "qwen": [[3738, " human", "normal", 0.0051124123856425285]]}, "loss": {"rwkv": 10.472688610619752, "qwen": 15.857875301118847}, "topk": {"rwkv": [38720, 3, 0.03081255406141281, [[63843, 0.426013, " researchers", false], [52224, 0.145729, " methods", false], [38720, 0.030813, " human", false], [61590, 0.030591, " approaches", false], [31937, 0.027987, " same", false], [46787, 0.018104, " people", false], [55809, 0.012532, " computer", false], [32462, 0.011953, " were", false], [39193, 0.011745, " other", false], [31458, 0.010867, " more", false]]], "qwen": [3738, 6, 0.0051124123856425285, [[11811, 0.839768, " researchers", false], [1852, 0.028461, " same", false], [5413, 0.018997, " methods", false], [1251, 0.010135, " people", false], [6366, 0.009566, " computer", false], [3738, 0.005112, " human", false], [3412, 0.004544, " research", false], [11647, 0.003293, " experts", false], [1033, 0.00309, " were", false], [803, 0.002939, " more", false]]]}, "raw_delta": -0.2986181577046713, "tuned_delta": -0.2900463656740931}, {"byte_start": 1818, "byte_end": 1828, "display": {"text": "-knowledge", "kind": "normal"}, "is_word": true, "word_id": 303, "word_key": "-knowledge", "bytes_hex": "2d 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "2.48% 0.84% 0.84% 0.84% 0.84% 0.84% 0.84% 0.84% 0.84% 0.84%", "qwen": "9.30% 9.30% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.871780276298523], [58313, "knowledge", "normal", 0.6595557928085327]], "qwen": [[12646, "-k", "normal", 0.3563463091850281], [51186, "nowledge", "normal", 0.9994348883628845]]}, "loss": {"rwkv": 1.002067234211206, "qwen": 1.8618295005851109}, "topk": {"rwkv": [46, 1, 0.871780276298523, [[46, 0.87178, "-", false], [25971, 0.030047, "ists", false], [38013, 0.012634, " chess", false], [51685, 0.011814, " experts", false], [52224, 0.010909, " methods", false], [7919, 0.010518, "ist", false], [61590, 0.007997, " approaches", false], [47202, 0.00402, " search", false], [59943, 0.00399, " knowledge", false], [63843, 0.003556, " researchers", false]]], "qwen": [12646, 1, 0.3563463091850281, [[12646, 0.356346, "-k", false], [71107, 0.225456, "-under", false], [12, 0.107033, "-", false], [8660, 0.059608, " understanding", false], [5980, 0.023717, "-based", false], [6540, 0.023538, " knowledge", false], [35085, 0.017064, "-oriented", false], [18376, 0.013196, "-exp", false], [3419, 0.010298, "-in", false], [51273, 0.009458, "-focused", false]]]}, "raw_delta": -0.04767534327111208, "tuned_delta": -0.03910355124053383}, {"byte_start": 1828, "byte_end": 1834, "display": {"text": "-based", "kind": "normal"}, "is_word": true, "word_id": 304, "word_key": "-based", "bytes_hex": "2d 62 61 73 65 64", "compression": {"rwkv": "30.57% 1.56% 1.56% 1.56% 1.56% 1.56%", "qwen": "6.90% 6.90% 6.90% 6.90% 6.90% 6.90%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.18554151058197021], [34011, "based", "normal", 0.6482729315757751]], "qwen": [[5980, "-based", "normal", 0.10055873543024063]]}, "loss": {"rwkv": 6.3986718529010815, "qwen": 6.903936816493413}, "topk": {"rwkv": [46, 3, 0.18554151058197021, [[52224, 0.265552, " methods", false], [61590, 0.238326, " approaches", false], [46, 0.185542, "-", false], [63843, 0.142978, " researchers", false], [37810, 0.066875, " based", false], [56777, 0.00802, " oriented", false], [51685, 0.006366, " experts", false], [38013, 0.00614, " chess", false], [55532, 0.003715, " approach", false], [59099, 0.003218, " advocates", false]]], "qwen": [5980, 3, 0.10055873543024063, [[11811, 0.458921, " researchers", false], [5413, 0.179589, " methods", false], [5980, 0.100559, "-based", false], [19827, 0.086535, " approaches", false], [3118, 0.018875, " based", false], [35085, 0.01782, "-oriented", false], [34316, 0.010812, " specialists", false], [11647, 0.009548, " experts", false], [1251, 0.007044, " people", false], [3412, 0.005827, " research", false]]]}, "raw_delta": -0.028017838795979817, "tuned_delta": -0.01944604676540157}, {"byte_start": 1834, "byte_end": 1840, "display": {"text": " chess", "kind": "normal"}, "is_word": true, "word_id": 305, "word_key": " chess", "bytes_hex": "20 63 68 65 73 73", "compression": {"rwkv": "11.04% 11.04% 11.04% 11.04% 11.04% 11.04%", "qwen": "18.40% 18.40% 18.40% 18.40% 18.40% 18.40%"}, "model_tokens": {"rwkv": [[38013, " chess", "normal", 0.025300495326519012]], "qwen": [[32719, " chess", "normal", 0.0021924730390310287]]}, "loss": {"rwkv": 11.036241360967004, "qwen": 18.40255210111632}, "topk": {"rwkv": [38013, 4, 0.025300495326519012, [[52224, 0.373073, " methods", false], [63843, 0.289508, " researchers", false], [61590, 0.210366, " approaches", false], [38013, 0.0253, " chess", false], [47202, 0.007561, " search", false], [3609, 0.006943, " AI", false], [57103, 0.006204, " research", false], [55809, 0.006163, " computer", false], [51685, 0.005402, " experts", false], [45, 0.004026, ",", false]]], "qwen": [32719, 9, 0.0021924730390310287, [[11811, 0.666725, " researchers", false], [5413, 0.185187, " methods", false], [19827, 0.078376, " approaches", false], [3412, 0.008964, " research", false], [6366, 0.004887, " computer", false], [8869, 0.004315, " efforts", false], [11647, 0.003867, " experts", false], [1714, 0.002293, " method", false], [32719, 0.002192, " chess", false], [12538, 0.002084, " techniques", false]]]}, "raw_delta": -0.4084750016530356, "tuned_delta": -0.39990320962245735}, {"byte_start": 1840, "byte_end": 1852, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 306, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"rwkv": "0.56% 0.56% 0.56% 0.56% 0.56% 0.56% 0.56% 0.56% 0.56% 0.56% 0.56% 0.56%", "qwen": "0.99% 0.99% 0.99% 0.99% 0.99% 0.99% 0.99% 0.99% 0.99% 0.99% 0.99% 0.99%"}, "model_tokens": {"rwkv": [[63843, " researchers", "normal", 0.6872232556343079]], "qwen": [[11811, " researchers", "normal", 0.5165534615516663]]}, "loss": {"rwkv": 0.5606175797725259, "qwen": 0.9927191530532772}, "topk": {"rwkv": [63843, 1, 0.6872232556343079, [[63843, 0.687223, " researchers", false], [52224, 0.09212, " methods", false], [51685, 0.042066, " experts", false], [46, 0.034204, "-", false], [61590, 0.023681, " approaches", false], [3609, 0.022106, " AI", false], [52489, 0.013138, " players", false], [56949, 0.012948, " programs", false], [57103, 0.009412, " research", false], [63874, 0.004496, " specialists", false]]], "qwen": [11811, 1, 0.5165534615516663, [[11811, 0.516553, " researchers", false], [7468, 0.102095, " programs", false], [5413, 0.096953, " methods", false], [54846, 0.035029, " programmers", false], [4217, 0.031163, " players", false], [72085, 0.028395, "-playing", false], [11647, 0.023772, " experts", false], [3412, 0.019797, " research", false], [5942, 0.016329, " systems", false], [19827, 0.013321, " approaches", false]]]}, "raw_delta": -0.023960798978805545, "tuned_delta": -0.015389006948227297}, {"byte_start": 1852, "byte_end": 1857, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 307, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"rwkv": "4.90% 4.90% 4.90% 4.90% 4.90%", "qwen": "4.53% 4.53% 4.53% 4.53% 4.53%"}, "model_tokens": {"rwkv": [[32462, " were", "normal", 0.25559622049331665]], "qwen": [[1033, " were", "normal", 0.2846704423427582]]}, "loss": {"rwkv": 4.902908928021086, "qwen": 4.531588495805858}, "topk": {"rwkv": [32462, 1, 0.25559622049331665, [[32462, 0.255596, " were", false], [21795, 0.046323, " had", false], [21532, 0.023956, " did", false], [45, 0.022912, ",", false], [38547, 0.016735, " found", false], [30840, 0.016341, " felt", false], [31334, 0.012921, " lost", false], [60419, 0.012504, " retreated", false], [38435, 0.012385, " faced", false], [52628, 0.011966, " quickly", false]]], "qwen": [1033, 1, 0.2846704423427582, [[1033, 0.28467, " were", false], [1030, 0.053464, " had", false], [11, 0.023811, ",", false], [6476, 0.022545, " felt", false], [5558, 0.019401, " lost", false], [6966, 0.015394, " looked", false], [22978, 0.014257, " abandoned", false], [6116, 0.014051, " became", false], [6157, 0.013707, " quickly", false], [1730, 0.013475, " found", false]]]}, "raw_delta": 0.020590376853942827, "tuned_delta": 0.029162168884521077}, {"byte_start": 1857, "byte_end": 1861, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 308, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "13.95% 13.95% 13.95% 13.95%", "qwen": "15.12% 15.12% 15.12% 15.12%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.04509412869811058]], "qwen": [[537, " not", "normal", 0.03495302423834801]]}, "loss": {"rwkv": 13.947930571094469, "qwen": 15.120121323712658}, "topk": {"rwkv": [22187, 4, 0.04509412869811058, [[32053, 0.1306, " slow", false], [46021, 0.06047, " forced", false], [31269, 0.045305, " left", false], [22187, 0.045094, " not", false], [62683, 0.027402, " understand", false], [39418, 0.026169, " quick", false], [47650, 0.017289, " unable", false], [60601, 0.01446, " surprised", false], [39820, 0.013581, " still", false], [45, 0.013549, ",", false]]], "qwen": [537, 3, 0.03495302423834801, [[26620, 0.055359, " shocked", false], [71982, 0.038058, " dismay", false], [537, 0.034953, " not", false], [14453, 0.031572, " surprised", false], [2115, 0.028282, " left", false], [9575, 0.022694, " forced", false], [46926, 0.021046, " stunned", false], [86998, 0.019709, " understandably", false], [11889, 0.015698, " unable", false], [3974, 0.015696, " quick", false]]]}, "raw_delta": -0.06500005722045898, "tuned_delta": -0.056428265189880734}, {"byte_start": 1861, "byte_end": 1866, "display": {"text": " good", "kind": "normal"}, "is_word": true, "word_id": 309, "word_key": " good", "bytes_hex": "20 67 6f 6f 64", "compression": {"rwkv": "30.43% 30.43% 30.43% 30.43% 30.43%", "qwen": "29.23% 29.23% 29.23% 29.23% 29.23%"}, "model_tokens": {"rwkv": [[30992, " good", "normal", 0.00022168979921843857]], "qwen": [[1661, " good", "normal", 0.0003018275019712746]]}, "loss": {"rwkv": 30.43184851875157, "qwen": 29.234969656602026}, "topk": {"rwkv": [30992, 284, 0.00022168979921843857, [[39418, 0.095821, " quick", false], [30093, 0.073438, " able", false], [31581, 0.065513, " only", false], [53350, 0.047835, " willing", false], [56914, 0.043708, " prepared", false], [39449, 0.035332, " ready", false], [32053, 0.035318, " slow", false], [60601, 0.030924, " surprised", false], [4424, 0.021641, " at", false], [56426, 0.020471, " inclined", false]]], "qwen": [1661, 234, 0.0003018275019712746, [[14453, 0.06331, " surprised", false], [24404, 0.051046, " impressed", false], [7945, 0.044645, " particularly", false], [518, 0.037477, " at", false], [2952, 0.037358, " able", false], [6247, 0.036072, " happy", false], [22166, 0.030846, " convinced", false], [279, 0.02569, " the", false], [8014, 0.024005, " interested", false], [1172, 0.023934, " only", false]]]}, "raw_delta": 0.06636905670166016, "tuned_delta": 0.0749408487322384}, {"byte_start": 1866, "byte_end": 1873, "display": {"text": " losers", "kind": "normal"}, "is_word": true, "word_id": 310, "word_key": " losers", "bytes_hex": "20 6c 6f 73 65 72 73", "compression": {"rwkv": "21.42% 21.42% 21.42% 21.42% 21.42% 21.42% 0.01%", "qwen": "23.81% 23.81% 23.81% 23.81% 23.81% 23.81% 23.81%"}, "model_tokens": {"rwkv": [[38935, " loser", "normal", 0.0007969274884089828], [116, "s", "normal", 0.9997172951698303]], "qwen": [[67356, " losers", "normal", 9.699879592517391e-05]]}, "loss": {"rwkv": 18.356440481301235, "qwen": 23.806560859563593}, "topk": {"rwkv": [38935, 25, 0.0007969274884089828, [[4424, 0.626598, " at", false], [45865, 0.227566, " enough", false], [37598, 0.04074, " about", false], [46, 0.010277, "-", false], [32487, 0.009293, " with", false], [4811, 0.00882, " to", false], [61653, 0.007227, " candidates", false], [57330, 0.003439, " students", false], [46356, 0.003353, " judges", false], [4712, 0.002797, " on", false]]], "qwen": [67356, 199, 9.699879592517391e-05, [[518, 0.431798, " at", false], [3322, 0.350935, " enough", false], [4143, 0.015584, " students", false], [23562, 0.013815, " listeners", false], [4780, 0.010812, " friends", false], [11178, 0.01081, " candidates", false], [369, 0.010241, " for", false], [911, 0.008406, " about", false], [10030, 0.006562, " prepared", false], [448, 0.00574, " with", false]]]}, "raw_delta": -0.3022188459123884, "tuned_delta": -0.29364705388181017}, {"byte_start": 1873, "byte_end": 1874, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "6.23%", "qwen": "11.44%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.7060011625289917]], "qwen": [[13, ".", "normal", 0.5303573608398438]]}, "loss": {"rwkv": 6.234302300716467, "qwen": 11.43704191264213}, "topk": {"rwkv": [47, 1, 0.7060011625289917, [[47, 0.706001, ".", false], [45, 0.148981, ",", false], [21265, 0.032215, " and", false], [60, 0.025791, ";", false], [59, 0.016035, ":", false], [275, 0.009601, " (", false], [21400, 0.007759, " but", false], [4596, 0.007044, " in", false], [4424, 0.006522, " at", false], [280, 0.002929, " -", false]]], "qwen": [13, 1, 0.5303573608398438, [[13, 0.530357, ".", false], [11, 0.106582, ",", false], [382, 0.087159, ".\n\n", false], [624, 0.053129, ".\n", false], [304, 0.035469, " in", false], [26, 0.029752, ";", false], [323, 0.027361, " and", false], [714, 0.024008, " but", false], [320, 0.017181, " (", false], [25, 0.0155, ":", false]]]}, "raw_delta": -0.28850114345550537, "tuned_delta": -0.27992935142492714}, {"byte_start": 1874, "byte_end": 1879, "display": {"text": " They", "kind": "normal"}, "is_word": true, "word_id": 311, "word_key": " they", "bytes_hex": "20 54 68 65 79", "compression": {"rwkv": "6.73% 6.73% 6.73% 6.73% 6.73%", "qwen": "7.04% 7.04% 7.04% 7.04% 7.04%"}, "model_tokens": {"rwkv": [[29893, " They", "normal", 0.15564467012882233]], "qwen": [[2379, " They", "normal", 0.14182904362678528]]}, "loss": {"rwkv": 6.7344553666496525, "qwen": 7.044437756478033}, "topk": {"rwkv": [29893, 2, 0.15564467012882233, [[261, 0.194605, "\n\n", false], [29893, 0.155645, " They", false], [20996, 0.067001, " The", false], [267, 0.047631, "  ", false], [19555, 0.046406, " But", false], [3913, 0.039858, " In", false], [37449, 0.03316, " Their", false], [3918, 0.024008, " It", false], [300, 0.014307, " A", false], [37451, 0.012311, " There", false]]], "qwen": [2379, 1, 0.14182904362678528, [[2379, 0.141829, " They", false], [220, 0.131886, " ", false], [576, 0.082841, " The", false], [758, 0.04453, " In", false], [10964, 0.038897, " Their", false], [12090, 0.034402, " Instead", false], [1988, 0.029294, " But", false], [1084, 0.028173, " It", false], [320, 0.026805, " (", false], [1096, 0.018467, " This", false]]]}, "raw_delta": -0.017189073562622115, "tuned_delta": -0.008617281532043867}, {"byte_start": 1879, "byte_end": 1884, "display": {"text": " said", "kind": "normal"}, "is_word": true, "word_id": 312, "word_key": " said", "bytes_hex": "20 73 61 69 64", "compression": {"rwkv": "23.11% 23.11% 23.11% 23.11% 23.11%", "qwen": "24.38% 24.38% 24.38% 24.38% 24.38%"}, "model_tokens": {"rwkv": [[31929, " said", "normal", 0.001669788733124733]], "qwen": [[1053, " said", "normal", 0.0011602459708228707]]}, "loss": {"rwkv": 23.1056627642373, "qwen": 24.378384255590834}, "topk": {"rwkv": [31929, 94, 0.001669788733124733, [[32462, 0.119811, " were", false], [21795, 0.087098, " had", false], [21532, 0.05324, " did", false], [59392, 0.03691, " continued", false], [39762, 0.01865, " spent", false], [40013, 0.018119, " tried", false], [39820, 0.017358, " still", false], [38128, 0.015004, " could", false], [45196, 0.014658, " argued", false], [60158, 0.01246, " persisted", false]]], "qwen": [1053, 110, 0.0011602459708228707, [[1033, 0.182277, " were", false], [1030, 0.157047, " had", false], [1521, 0.037867, " did", false], [8570, 0.02375, " continued", false], [5558, 0.023589, " lost", false], [7391, 0.017444, " spent", false], [1410, 0.017068, " could", false], [1035, 0.013185, " would", false], [6476, 0.011364, " felt", false], [11585, 0.010578, " believed", false]]]}, "raw_delta": -0.07057466506957999, "tuned_delta": -0.06200287303900174}, {"byte_start": 1884, "byte_end": 1889, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 313, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "3.51% 3.51% 3.51% 3.51% 3.51%", "qwen": "4.76% 4.76% 4.76% 4.76% 4.76%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.3803556561470032]], "qwen": [[429, " that", "normal", 0.26710042357444763]]}, "loss": {"rwkv": 3.508115870911639, "qwen": 4.761364626621232}, "topk": {"rwkv": [32227, 1, 0.3803556561470032, [[32227, 0.380356, " that", false], [45, 0.099526, ",", false], [22590, 0.097763, " the", false], [32232, 0.08083, " they", false], [47539, 0.048248, " things", false], [4601, 0.042272, " it", false], [39931, 0.026849, " their", false], [269, 0.023397, " \"", false], [38013, 0.019255, " chess", false], [31370, 0.011386, " many", false]]], "qwen": [429, 1, 0.26710042357444763, [[429, 0.2671, " that", false], [11, 0.250771, ",", false], [330, 0.068366, " \"", false], [807, 0.055191, " they", false], [432, 0.050815, " it", false], [2513, 0.03838, " things", false], [4302, 0.036074, " nothing", false], [279, 0.033549, " the", false], [25, 0.031332, ":", false], [311, 0.012669, " to", false]]]}, "raw_delta": -0.06949486732482912, "tuned_delta": -0.060923075294250874}, {"byte_start": 1889, "byte_end": 1892, "display": {"text": " ``", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "20 60 60", "compression": {"rwkv": "63.12% 63.12% 63.12%", "qwen": "64.29% 64.29% 64.29%"}, "model_tokens": {"rwkv": [[4404, " ``", "normal", 2.7912303266930394e-05]], "qwen": [[9902, " ``", "normal", 2.2649990569334477e-05]]}, "loss": {"rwkv": 63.11790803889214, "qwen": 64.29221131173843}, "topk": {"rwkv": [4404, 575, 2.7912303266930394e-05, [[22590, 0.30634, " the", false], [39931, 0.110249, " their", false], [32232, 0.084758, " they", false], [47202, 0.083649, " search", false], [4601, 0.032346, " it", false], [32234, 0.032225, " this", false], [332, 0.025036, " a", false], [30597, 0.02062, " deep", false], [45, 0.017945, ",", false], [39934, 0.016947, " there", false]]], "qwen": [9902, 723, 2.2649990569334477e-05, [[279, 0.227069, " the", false], [807, 0.152814, " they", false], [862, 0.072788, " their", false], [432, 0.062657, " it", false], [32719, 0.034045, " chess", false], [2711, 0.031921, " search", false], [264, 0.027836, " a", false], [419, 0.02541, " this", false], [1052, 0.022813, " there", false], [11, 0.019629, ",", false]]]}, "raw_delta": -0.0651172002156577, "tuned_delta": -0.05654540818507945}, {"byte_start": 1892, "byte_end": 1897, "display": {"text": "brute", "kind": "normal"}, "is_word": true, "word_id": 314, "word_key": "brute", "bytes_hex": "62 72 75 74 65", "compression": {"rwkv": "45.46% 45.46% 45.46% 0.02% 0.02%", "qwen": "64.52% 64.52% 0.20% 0.20% 0.20%"}, "model_tokens": {"rwkv": [[7184, "bru", "normal", 0.0005290898261591792], [2206, "te", "normal", 0.9979749321937561]], "qwen": [[1323, "br", "normal", 0.0007809735834598541], [1070, "ute", "normal", 0.9664857387542725]]}, "loss": {"rwkv": 27.283272698427684, "qwen": 25.92904569975074}, "topk": {"rwkv": [7184, 173, 0.0005290898261591792, [[8801, 0.129063, "the", false], [25116, 0.067519, "deep", false], [42233, 0.054828, "search", false], [34580, 0.042701, "human", false], [53865, 0.026487, "computer", false], [2278, 0.0246, "we", false], [2073, 0.021748, "no", false], [35755, 0.020988, "there", false], [24991, 0.020163, "ches", false], [1956, 0.018559, "it", false]]], "qwen": [1323, 137, 0.0007809735834598541, [[1782, 0.152667, "the", false], [896, 0.046311, "we", false], [331, 0.044493, "ch", false], [25312, 0.034654, "human", false], [1836, 0.031319, "search", false], [18532, 0.030247, "there", false], [275, 0.030046, "it", false], [64, 0.024511, "a", false], [64947, 0.020238, "comput", false], [785, 0.015029, "The", false]]]}, "raw_delta": 0.0750942900776864, "tuned_delta": 0.08366608210826464}, {"byte_start": 1897, "byte_end": 1903, "display": {"text": " force", "kind": "normal"}, "is_word": true, "word_id": 315, "word_key": " force", "bytes_hex": "20 66 6f 72 63 65", "compression": {"rwkv": "1.18% 1.18% 1.18% 1.18% 1.18% 1.18%", "qwen": "0.64% 0.64% 0.64% 0.64% 0.64% 0.64%"}, "model_tokens": {"rwkv": [[38536, " force", "normal", 0.673162579536438]], "qwen": [[5344, " force", "normal", 0.8073176741600037]]}, "loss": {"rwkv": 1.1799385710395573, "qwen": 0.6433158405242455}, "topk": {"rwkv": [38536, 1, 0.673162579536438, [[38536, 0.673163, " force", false], [46, 0.282958, "-", false], [57319, 0.006794, " strength", false], [439, 0.005511, "''", false], [39339, 0.003964, " power", false], [59346, 0.002994, " computing", false], [47202, 0.002701, " search", false], [63370, 0.002166, " computation", false], [46022, 0.0018, " forces", false], [51779, 0.00164, " forcing", false]]], "qwen": [5344, 1, 0.8073176741600037, [[5344, 0.807318, " force", false], [80049, 0.155477, "-force", false], [2355, 0.013885, " power", false], [8170, 0.005856, " strength", false], [2711, 0.002685, " search", false], [24231, 0.001879, " computing", false], [24913, 0.001521, " forcing", false], [34447, 0.001121, " computation", false], [15039, 0.000489, " searching", false], [19428, 0.000473, "-search", false]]]}, "raw_delta": 0.029756682614485417, "tuned_delta": 0.038328474645063663}, {"byte_start": 1903, "byte_end": 1904, "display": {"text": "\"", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "22", "compression": {"rwkv": "59.74%", "qwen": "60.17%"}, "model_tokens": {"rwkv": [[35, "\"", "normal", 0.036194030195474625]], "qwen": [[1, "\"", "normal", 0.0355585552752018]]}, "loss": {"rwkv": 59.73659153680863, "qwen": 60.17074454064671}, "topk": {"rwkv": [35, 3, 0.036194030195474625, [[439, 0.636685, "''", false], [4600, 0.06822, " is", false], [35, 0.036194, "\"", false], [40, 0.020316, "'", false], [47202, 0.018037, " search", false], [22748, 0.016308, " was", false], [32475, 0.015448, " will", false], [37825, 0.010313, " beats", false], [32481, 0.010184, " wins", false], [5341, 0.00864, ",''", false]]], "qwen": [1, 5, 0.0355585552752018, [[4605, 0.666866, "''", false], [374, 0.046522, " is", false], [6, 0.040162, "'", false], [2711, 0.039583, " search", false], [1, 0.035559, "\"", false], [40510, 0.018344, ",''", false], [572, 0.010485, " was", false], [50817, 0.007851, "'',", false], [11, 0.007359, ",", false], [686, 0.006617, " will", false]]]}, "raw_delta": -0.024074554443359375, "tuned_delta": -0.015502762412781127}, {"byte_start": 1904, "byte_end": 1911, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 316, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "7.04% 7.04% 7.04% 7.04% 7.04% 7.04% 7.04%", "qwen": "5.22% 5.22% 5.22% 5.22% 5.22% 5.22% 5.22%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.06495513767004013]], "qwen": [[2711, " search", "normal", 0.13174693286418915]]}, "loss": {"rwkv": 7.044409379340641, "qwen": 5.22171206232272}, "topk": {"rwkv": [47202, 4, 0.06495513767004013, [[22748, 0.248066, " was", false], [52224, 0.163488, " methods", false], [40219, 0.089023, " would", false], [47202, 0.064955, " search", false], [21795, 0.053909, " had", false], [4600, 0.040446, " is", false], [38128, 0.027898, " could", false], [61590, 0.024319, " approaches", false], [275, 0.014012, " (", false], [21265, 0.011585, " and", false]]], "qwen": [2711, 2, 0.13174693286418915, [[572, 0.244206, " was", false], [2711, 0.131747, " search", false], [1035, 0.095376, " would", false], [5413, 0.057583, " methods", false], [374, 0.057558, " is", false], [320, 0.044885, " (", false], [1030, 0.040804, " had", false], [323, 0.020798, " and", false], [32719, 0.013899, " chess", false], [476, 0.01116, " or", false]]]}, "raw_delta": 0.10107180050441197, "tuned_delta": 0.10964359253499022}, {"byte_start": 1911, "byte_end": 1915, "display": {"text": " may", "kind": "normal"}, "is_word": true, "word_id": 317, "word_key": " may", "bytes_hex": "20 6d 61 79", "compression": {"rwkv": "37.19% 37.19% 37.19% 37.19%", "qwen": "34.56% 34.56% 34.56% 34.56%"}, "model_tokens": {"rwkv": [[22074, " may", "normal", 0.0002585754555184394]], "qwen": [[1231, " may", "normal", 0.00046904574264772236]]}, "loss": {"rwkv": 37.194481522918586, "qwen": 34.556198865622754}, "topk": {"rwkv": [22074, 128, 0.0002585754555184394, [[22748, 0.403255, " was", false], [40219, 0.084631, " would", false], [52224, 0.075907, " methods", false], [21795, 0.067733, " had", false], [4600, 0.053641, " is", false], [38128, 0.045601, " could", false], [21532, 0.016726, " did", false], [45, 0.016359, ",", false], [47285, 0.009384, " simply", false], [32445, 0.008629, " wasn", false]]], "qwen": [1231, 92, 0.00046904574264772236, [[572, 0.389624, " was", false], [1035, 0.13415, " would", false], [374, 0.099906, " is", false], [1030, 0.037142, " had", false], [11, 0.030969, ",", false], [1410, 0.024413, " could", false], [5413, 0.017751, " methods", false], [320, 0.016459, " (", false], [686, 0.015828, " will", false], [323, 0.012574, " and", false]]]}, "raw_delta": 0.14629745483398438, "tuned_delta": 0.15486924686456263}, {"byte_start": 1915, "byte_end": 1920, "display": {"text": " have", "kind": "normal"}, "is_word": true, "word_id": 318, "word_key": " have", "bytes_hex": "20 68 61 76 65", "compression": {"rwkv": "4.45% 4.45% 4.45% 4.45% 4.45%", "qwen": "7.79% 7.79% 7.79% 7.79% 7.79%"}, "model_tokens": {"rwkv": [[31059, " have", "normal", 0.2906019389629364]], "qwen": [[614, " have", "normal", 0.11545616388320923]]}, "loss": {"rwkv": 4.4520667277432855, "qwen": 7.786456903625622}, "topk": {"rwkv": [31059, 2, 0.2906019389629364, [[4435, 0.36095, " be", false], [31059, 0.290602, " have", false], [32499, 0.107708, " work", false], [22770, 0.028328, " win", false], [22187, 0.026155, " not", false], [32458, 0.023707, " well", false], [61959, 0.020059, " eventually", false], [30256, 0.015342, " beat", false], [46272, 0.006488, " indeed", false], [31358, 0.005452, " make", false]]], "qwen": [614, 3, 0.11545616388320923, [[387, 0.394511, " be", false], [537, 0.152496, " not", false], [614, 0.115456, " have", false], [975, 0.048592, " work", false], [1632, 0.045093, " well", false], [9583, 0.024234, " eventually", false], [3164, 0.020108, " win", false], [13653, 0.011506, " ultimately", false], [12824, 0.009843, " indeed", false], [12118, 0.008267, " prove", false]]]}, "raw_delta": -0.18489785194396974, "tuned_delta": -0.17632605991339148}, {"byte_start": 1920, "byte_end": 1924, "display": {"text": " won", "kind": "normal"}, "is_word": true, "word_id": 319, "word_key": " won", "bytes_hex": "20 77 6f 6e", "compression": {"rwkv": "7.64% 7.64% 7.64% 7.64%", "qwen": "8.65% 8.65% 8.65% 8.65%"}, "model_tokens": {"rwkv": [[22777, " won", "normal", 0.18192946910858154]], "qwen": [[2765, " won", "normal", 0.14682579040527344]]}, "loss": {"rwkv": 7.643184176584596, "qwen": 8.649445530204561}, "topk": {"rwkv": [22777, 2, 0.18192946910858154, [[30259, 0.284607, " been", false], [22777, 0.181929, " won", false], [47812, 0.179618, " worked", false], [55934, 0.056501, " defeated", false], [45281, 0.029122, " beaten", false], [61959, 0.022459, " eventually", false], [47333, 0.014326, " solved", false], [30256, 0.010943, " beat", false], [60586, 0.010462, " succeeded", false], [31351, 0.010056, " made", false]]], "qwen": [2765, 2, 0.14682579040527344, [[1012, 0.28794, " been", false], [2765, 0.146826, " won", false], [30294, 0.072956, " beaten", false], [23283, 0.069093, " defeated", false], [6439, 0.037148, " worked", false], [264, 0.025148, " a", false], [700, 0.013904, " out", false], [279, 0.013003, " the", false], [6069, 0.010961, " led", false], [1030, 0.010471, " had", false]]]}, "raw_delta": -0.0557989776134491, "tuned_delta": -0.04722718558287085}, {"byte_start": 1924, "byte_end": 1929, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 320, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "16.68% 16.68% 16.68% 16.68% 16.68%", "qwen": "17.28% 17.28% 17.28% 17.28% 17.28%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.009804054163396358]], "qwen": [[419, " this", "normal", 0.008304568938910961]]}, "loss": {"rwkv": 16.681161410278637, "qwen": 17.279697151637894}, "topk": {"rwkv": [32234, 11, 0.009804054163396358, [[22590, 0.574802, " the", false], [45, 0.125965, ",", false], [50870, 0.054928, " against", false], [4596, 0.039392, " in", false], [4712, 0.038121, " on", false], [32229, 0.022023, " them", false], [21400, 0.013831, " but", false], [332, 0.012925, " a", false], [4424, 0.012721, " at", false], [21700, 0.01186, " for", false]]], "qwen": [419, 9, 0.008304568938910961, [[279, 0.444667, " the", false], [11, 0.260208, ",", false], [32719, 0.059978, " chess", false], [304, 0.037963, " in", false], [37542, 0.02516, " Kas", false], [714, 0.015706, " but", false], [2348, 0.012235, " against", false], [13, 0.009391, ".", false], [419, 0.008305, " this", false], [264, 0.007524, " a", false]]]}, "raw_delta": -0.03318986892700193, "tuned_delta": -0.02461807689642368}, {"byte_start": 1929, "byte_end": 1934, "display": {"text": " time", "kind": "normal"}, "is_word": true, "word_id": 321, "word_key": " time", "bytes_hex": "20 74 69 6d 65", "compression": {"rwkv": "4.79% 4.79% 4.79% 4.79% 4.79%", "qwen": "13.29% 13.29% 13.29% 13.29% 13.29%"}, "model_tokens": {"rwkv": [[32251, " time", "normal", 0.26396211981773376]], "qwen": [[882, " time", "normal", 0.02511478215456009]]}, "loss": {"rwkv": 4.7901983779516355, "qwen": 13.288298852929454}, "topk": {"rwkv": [32251, 1, 0.26396211981773376, [[32251, 0.263962, " time", false], [62293, 0.2201, " particular", false], [30941, 0.093729, " game", false], [39551, 0.077617, " round", false], [38981, 0.06603, " match", false], [45278, 0.042764, " battle", false], [22226, 0.040377, " one", false], [38013, 0.032679, " chess", false], [57271, 0.026488, " specific", false], [62653, 0.01863, " tournament", false]]], "qwen": [882, 12, 0.02511478215456009, [[3953, 0.221175, " particular", false], [1809, 0.1886, " game", false], [2432, 0.102998, " match", false], [8049, 0.067648, " battle", false], [32719, 0.04686, " chess", false], [825, 0.041474, " one", false], [6957, 0.034948, " race", false], [4116, 0.029859, " war", false], [10707, 0.02819, " competition", false], [4778, 0.028065, " round", false]]]}, "raw_delta": -0.4712347507476807, "tuned_delta": -0.46266295871710245}, {"byte_start": 1934, "byte_end": 1935, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "2.25%", "qwen": "5.44%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8824990391731262]], "qwen": [[11, ",", "normal", 0.7395690679550171]]}, "loss": {"rwkv": 2.2454054896648294, "qwen": 5.440540023273668}, "topk": {"rwkv": [45, 1, 0.8824990391731262, [[45, 0.882499, ",", false], [21400, 0.054787, " but", false], [275, 0.015165, " (", false], [45202, 0.013356, " around", false], [51018, 0.005571, " because", false], [50870, 0.0037, " against", false], [21265, 0.00283, " and", false], [47, 0.002494, ".", false], [4450, 0.001975, " by", false], [4596, 0.001817, " in", false]]], "qwen": [11, 1, 0.7395690679550171, [[11, 0.739569, ",", false], [714, 0.134095, " but", false], [13, 0.026886, ".", false], [1576, 0.021813, " because", false], [320, 0.012209, " (", false], [323, 0.008291, " and", false], [26, 0.007506, ";", false], [2163, 0.006502, " around", false], [304, 0.005369, " in", false], [553, 0.002741, " by", false]]]}, "raw_delta": -0.1771758794784546, "tuned_delta": -0.16860408744787633}, {"byte_start": 1935, "byte_end": 1939, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 322, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"rwkv": "0.12% 0.12% 0.12% 0.12%", "qwen": "0.29% 0.29% 0.29% 0.29%"}, "model_tokens": {"rwkv": [[21400, " but", "normal", 0.9737100005149841]], "qwen": [[714, " but", "normal", 0.9371599555015564]]}, "loss": {"rwkv": 0.11997509724189528, "qwen": 0.2926023471418245}, "topk": {"rwkv": [21400, 1, 0.9737100005149841, [[21400, 0.97371, " but", false], [21265, 0.011471, " and", false], [51018, 0.002272, " because", false], [4596, 0.000807, " in", false], [32227, 0.000668, " that", false], [4423, 0.000658, " as", false], [4715, 0.000573, " or", false], [4601, 0.000563, " it", false], [21700, 0.00055, " for", false], [39690, 0.000361, " since", false]]], "qwen": [714, 1, 0.9371599555015564, [[714, 0.93716, " but", false], [323, 0.028797, " and", false], [9902, 0.002806, " ``", false], [1576, 0.002413, " because", false], [537, 0.00212, " not", false], [1393, 0.001582, " while", false], [773, 0.001197, " so", false], [304, 0.001113, " in", false], [429, 0.001088, " that", false], [892, 0.001065, " which", false]]]}, "raw_delta": -0.009572487324476242, "tuned_delta": -0.0010006952938979938}, {"byte_start": 1939, "byte_end": 1942, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 323, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "5.00% 5.00% 5.00%", "qwen": "10.12% 10.12% 10.12%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.4341208338737488]], "qwen": [[432, " it", "normal", 0.1857195794582367]]}, "loss": {"rwkv": 5.001530659331855, "qwen": 10.120008804656042}, "topk": {"rwkv": [4601, 1, 0.4341208338737488, [[4601, 0.434121, " it", false], [32227, 0.09888, " that", false], [32232, 0.051912, " they", false], [22590, 0.049127, " the", false], [4596, 0.040486, " in", false], [40219, 0.039958, " would", false], [39934, 0.019556, " there", false], [37920, 0.016224, " brute", false], [32234, 0.01315, " this", false], [32475, 0.012144, " will", false]]], "qwen": [432, 2, 0.1857195794582367, [[429, 0.205034, " that", false], [432, 0.18572, " it", false], [807, 0.076933, " they", false], [279, 0.07421, " the", false], [9902, 0.054034, " ``", false], [304, 0.031521, " in", false], [3738, 0.027188, " human", false], [862, 0.02355, " their", false], [11, 0.012975, ",", false], [1052, 0.012856, " there", false]]]}, "raw_delta": -0.2838286956151327, "tuned_delta": -0.27525690358455446}, {"byte_start": 1942, "byte_end": 1946, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 324, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "8.84% 8.84% 8.84% 8.84%", "qwen": "6.05% 6.05% 6.05% 6.05%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.14146897196769714]], "qwen": [[572, " was", "normal", 0.26141783595085144]]}, "loss": {"rwkv": 8.840733771072504, "qwen": 6.048657778025745}, "topk": {"rwkv": [22748, 3, 0.14146897196769714, [[40219, 0.328436, " would", false], [32475, 0.152008, " will", false], [22748, 0.141469, " was", false], [4600, 0.070187, " is", false], [22777, 0.057875, " won", false], [38128, 0.044718, " could", false], [47816, 0.038036, " wouldn", false], [45599, 0.017827, " couldn", false], [21795, 0.014394, " had", false], [45409, 0.013113, " cannot", false]]], "qwen": [572, 1, 0.26141783595085144, [[572, 0.261418, " was", false], [1035, 0.232932, " would", false], [1030, 0.083405, " had", false], [374, 0.064521, " is", false], [686, 0.062818, " will", false], [5710, 0.039827, " wasn", false], [1521, 0.028683, " did", false], [1410, 0.025184, " could", false], [8270, 0.020922, " wouldn", false], [2765, 0.013033, " won", false]]]}, "raw_delta": 0.15482556819915771, "tuned_delta": 0.16339736022973597}, {"byte_start": 1946, "byte_end": 1950, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 325, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "6.41% 6.41% 6.41% 6.41%", "qwen": "5.50% 5.50% 5.50% 5.50%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.24128875136375427]], "qwen": [[537, " not", "normal", 0.295030802488327]]}, "loss": {"rwkv": 6.410412535199983, "qwen": 5.503320140188}, "topk": {"rwkv": [22187, 1, 0.24128875136375427, [[22187, 0.241289, " not", false], [332, 0.159051, " a", false], [31581, 0.063467, " only", false], [22590, 0.045234, " the", false], [4692, 0.037471, " no", false], [4419, 0.034066, " an", false], [57492, 0.02133, " unlikely", false], [31198, 0.02111, " just", false], [45781, 0.017322, " doomed", false], [39115, 0.012332, " never", false]]], "qwen": [537, 1, 0.295030802488327, [[537, 0.295031, " not", false], [264, 0.097277, " a", false], [1172, 0.061949, " only", false], [279, 0.038257, " the", false], [9902, 0.028887, " ``", false], [2058, 0.022418, " still", false], [2581, 0.021681, " never", false], [902, 0.018413, " no", false], [458, 0.015422, " an", false], [4969, 0.014254, " wrong", false]]]}, "raw_delta": 0.050299882888793945, "tuned_delta": 0.058871674919372195}, {"byte_start": 1950, "byte_end": 1952, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 326, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "9.79% 9.79%", "qwen": "19.45% 19.45%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.33454951643943787]], "qwen": [[264, " a", "normal", 0.11562146991491318]]}, "loss": {"rwkv": 9.79172903728349, "qwen": 19.453241410466205}, "topk": {"rwkv": [332, 1, 0.33454951643943787, [[332, 0.33455, " a", false], [22590, 0.164044, " the", false], [38606, 0.109563, " going", false], [4419, 0.046664, " an", false], [46439, 0.032817, " likely", false], [51832, 0.021246, " general", false], [30992, 0.014992, " good", false], [47008, 0.014346, " really", false], [4596, 0.011074, " in", false], [32464, 0.00847, " what", false]]], "qwen": [264, 2, 0.11562146991491318, [[279, 0.455008, " the", false], [264, 0.115621, " a", false], [2087, 0.036553, " going", false], [862, 0.026023, " their", false], [1128, 0.024629, " what", false], [2167, 0.020695, " really", false], [4586, 0.015172, " general", false], [458, 0.013861, " an", false], [14312, 0.013161, " necessarily", false], [1576, 0.007926, " because", false]]]}, "raw_delta": -0.5357480049133301, "tuned_delta": -0.5271762128827518}, {"byte_start": 1952, "byte_end": 1960, "display": {"text": " general", "kind": "normal"}, "is_word": true, "word_id": 327, "word_key": " general", "bytes_hex": "20 67 65 6e 65 72 61 6c", "compression": {"rwkv": "4.12% 4.12% 4.12% 4.12% 4.12% 4.12% 4.12% 4.12%", "qwen": "5.09% 5.09% 5.09% 5.09% 5.09% 5.09% 5.09% 5.09%"}, "model_tokens": {"rwkv": [[51832, " general", "normal", 0.16105210781097412]], "qwen": [[4586, " general", "normal", 0.10466268658638]]}, "loss": {"rwkv": 4.120979486914275, "qwen": 5.087782645968473}, "topk": {"rwkv": [51832, 1, 0.16105210781097412, [[51832, 0.161052, " general", false], [30992, 0.098127, " good", false], [46561, 0.056488, " method", false], [30811, 0.04894, " fair", false], [53283, 0.034534, " victory", false], [31835, 0.031968, " real", false], [53354, 0.027957, " winning", false], [40091, 0.022314, " valid", false], [32313, 0.022279, " true", false], [63910, 0.020254, " sustainable", false]]], "qwen": [4586, 1, 0.10466268658638, [[4586, 0.104663, " general", false], [1661, 0.085055, " good", false], [1602, 0.039174, " very", false], [1714, 0.03682, " method", false], [830, 0.034978, " true", false], [10987, 0.030614, " winning", false], [6624, 0.029465, " fair", false], [6291, 0.025684, " solution", false], [12560, 0.022494, " victory", false], [7394, 0.017502, " princip", false]]]}, "raw_delta": -0.05361095070838928, "tuned_delta": -0.04503915867781103}, {"byte_start": 1960, "byte_end": 1969, "display": {"text": " strategy", "kind": "normal"}, "is_word": true, "word_id": 328, "word_key": " strategy", "bytes_hex": "20 73 74 72 61 74 65 67 79", "compression": {"rwkv": "6.20% 6.20% 6.20% 6.20% 6.20% 6.20% 6.20% 6.20% 6.20%", "qwen": "9.24% 9.24% 9.24% 9.24% 9.24% 9.24% 9.24% 9.24% 9.24%"}, "model_tokens": {"rwkv": [[57317, " strategy", "normal", 0.04533086344599724]], "qwen": [[8282, " strategy", "normal", 0.009917660616338253]]}, "loss": {"rwkv": 6.199080253819764, "qwen": 9.244144876068852}, "topk": {"rwkv": [57317, 4, 0.04533086344599724, [[46561, 0.493444, " method", false], [55532, 0.154119, " approach", false], [57260, 0.106063, " solution", false], [57317, 0.045331, " strategy", false], [41729, 0.043446, "izable", false], [60250, 0.032022, " principle", false], [22752, 0.022479, " way", false], [46, 0.01435, "-", false], [45, 0.006075, ",", false], [53354, 0.005696, " winning", false]]], "qwen": [8282, 11, 0.009917660616338253, [[1714, 0.38849, " method", false], [5486, 0.148424, " approach", false], [8335, 0.098412, "izable", false], [6291, 0.068549, " solution", false], [58238, 0.068317, "-purpose", false], [10987, 0.02087, " winning", false], [12111, 0.01473, " algorithm", false], [7428, 0.013208, " purpose", false], [14762, 0.012738, " technique", false], [11, 0.012299, ",", false]]]}, "raw_delta": -0.1688542366027832, "tuned_delta": -0.16028244457220495}, {"byte_start": 1969, "byte_end": 1970, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "35.08%", "qwen": "33.33%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.14232106506824493]], "qwen": [[11, ",", "normal", 0.15751907229423523]]}, "loss": {"rwkv": 35.081158709116394, "qwen": 33.33002060911559}, "topk": {"rwkv": [45, 3, 0.14232106506824493, [[47, 0.377648, ".", false], [21700, 0.194098, " for", false], [45, 0.142321, ",", false], [32227, 0.125138, " that", false], [21265, 0.057005, " and", false], [60, 0.019251, ";", false], [4811, 0.01429, " to", false], [275, 0.008036, " (", false], [59, 0.005971, ":", false], [61586, 0.004592, " applicable", false]]], "qwen": [11, 3, 0.15751907229423523, [[13, 0.267979, ".", false], [429, 0.184571, " that", false], [11, 0.157519, ",", false], [369, 0.122608, " for", false], [323, 0.089749, " and", false], [26, 0.032851, ";", false], [382, 0.022751, ".\n\n", false], [8415, 0.016348, " applicable", false], [311, 0.011225, " to", false], [320, 0.009869, " (", false]]]}, "raw_delta": 0.09710371494293213, "tuned_delta": 0.10567550697351037}, {"byte_start": 1970, "byte_end": 1974, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 329, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "0.99% 0.99% 0.99% 0.99%", "qwen": "1.64% 1.64% 1.64% 1.64%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.8024763464927673]], "qwen": [[323, " and", "normal", 0.6953110098838806]]}, "loss": {"rwkv": 0.9862173131076897, "qwen": 1.6383427409866393}, "topk": {"rwkv": [21265, 1, 0.8024763464927673, [[21265, 0.802476, " and", false], [4601, 0.031419, " it", false], [4788, 0.024592, " so", false], [22185, 0.016011, " nor", false], [32227, 0.008448, " that", false], [22187, 0.008329, " not", false], [51018, 0.008077, " because", false], [40186, 0.007414, " which", false], [4423, 0.006721, " as", false], [4715, 0.006302, " or", false]]], "qwen": [323, 1, 0.6953110098838806, [[323, 0.695311, " and", false], [432, 0.04768, " it", false], [773, 0.025122, " so", false], [6329, 0.021133, " nor", false], [1576, 0.018084, " because", false], [438, 0.017532, " as", false], [2474, 0.014623, " since", false], [892, 0.014369, " which", false], [1101, 0.012344, " just", false], [537, 0.007646, " not", false]]]}, "raw_delta": -0.03616151213645935, "tuned_delta": -0.0275897201058811}, {"byte_start": 1974, "byte_end": 1981, "display": {"text": " anyway", "kind": "normal"}, "is_word": true, "word_id": 330, "word_key": " anyway", "bytes_hex": "20 61 6e 79 77 61 79", "compression": {"rwkv": "18.84% 18.84% 18.84% 18.84% 18.84% 18.84% 18.84%", "qwen": "25.02% 25.02% 25.02% 25.02% 25.02% 25.02% 25.02%"}, "model_tokens": {"rwkv": [[45179, " anyway", "normal", 0.000668044900521636]], "qwen": [[13657, " anyway", "normal", 6.052275057299994e-05]]}, "loss": {"rwkv": 18.838763368750975, "qwen": 25.021719020604834}, "topk": {"rwkv": [45179, 105, 0.000668044900521636, [[4601, 0.168485, " it", false], [32232, 0.097553, " they", false], [40219, 0.080985, " would", false], [22590, 0.077007, " the", false], [32227, 0.075758, " that", false], [4596, 0.028886, " in", false], [39934, 0.022722, " there", false], [60645, 0.019418, " therefore", false], [32465, 0.018131, " when", false], [4788, 0.017, " so", false]]], "qwen": [13657, 396, 6.052275057299994e-05, [[432, 0.176351, " it", false], [429, 0.112898, " that", false], [807, 0.084212, " they", false], [279, 0.076921, " the", false], [1035, 0.040495, " would", false], [304, 0.031902, " in", false], [862, 0.025066, " their", false], [1052, 0.022272, " there", false], [11, 0.020961, ",", false], [773, 0.020704, " so", false]]]}, "raw_delta": -0.342855862208775, "tuned_delta": -0.3342840701781968}, {"byte_start": 1981, "byte_end": 1984, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 331, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "11.04% 11.04% 11.04%", "qwen": "10.77% 10.77% 10.77%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.16004523634910583]], "qwen": [[432, " it", "normal", 0.16680200397968292]]}, "loss": {"rwkv": 11.036241360967004, "qwen": 10.765798642485237}, "topk": {"rwkv": [4601, 2, 0.16004523634910583, [[45, 0.272488, ",", false], [4601, 0.160045, " it", false], [32232, 0.113072, " they", false], [22590, 0.098783, " the", false], [37920, 0.02628, " brute", false], [39934, 0.022621, " there", false], [20184, 0.017527, " Kas", false], [38013, 0.015741, " chess", false], [4858, 0.014868, " we", false], [39931, 0.014708, " their", false]]], "qwen": [432, 2, 0.16680200397968292, [[11, 0.396045, ",", false], [432, 0.166802, " it", false], [279, 0.084714, " the", false], [807, 0.055127, " they", false], [9902, 0.024949, " ``", false], [1052, 0.022042, " there", false], [37542, 0.019368, " Kas", false], [429, 0.012784, " that", false], [862, 0.012405, " their", false], [32719, 0.011599, " chess", false]]]}, "raw_delta": 0.014996528625488281, "tuned_delta": 0.02356832065606653}, {"byte_start": 1984, "byte_end": 1988, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 332, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "4.00% 4.00% 4.00% 4.00%", "qwen": "4.60% 4.60% 4.60% 4.60%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.41470974683761597]], "qwen": [[572, " was", "normal", 0.3602137267589569]]}, "loss": {"rwkv": 3.997702322775814, "qwen": 4.6033591132832}, "topk": {"rwkv": [22748, 1, 0.41470974683761597, [[22748, 0.41471, " was", false], [40219, 0.093539, " would", false], [21795, 0.083712, " had", false], [21532, 0.038062, " did", false], [57101, 0.032465, " required", false], [4600, 0.030558, " is", false], [38128, 0.027898, " could", false], [32272, 0.021889, " took", false], [30633, 0.017073, " didn", false], [32445, 0.015023, " wasn", false]]], "qwen": [572, 1, 0.3602137267589569, [[572, 0.360214, " was", false], [1035, 0.139555, " would", false], [1030, 0.070819, " had", false], [1521, 0.059803, " did", false], [374, 0.039697, " is", false], [1410, 0.034259, " could", false], [2567, 0.022039, " required", false], [3867, 0.017384, " took", false], [3207, 0.012466, " didn", false], [5710, 0.011562, " wasn", false]]]}, "raw_delta": -0.03358474373817444, "tuned_delta": -0.02501295170759619}, {"byte_start": 1988, "byte_end": 1992, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 333, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "6.76% 6.76% 6.76% 6.76%", "qwen": "7.19% 7.19% 7.19% 7.19%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.22291997075080872]], "qwen": [[537, " not", "normal", 0.2031400054693222]]}, "loss": {"rwkv": 6.762633004167015, "qwen": 7.185793091940252}, "topk": {"rwkv": [22187, 1, 0.22291997075080872, [[22187, 0.22292, " not", false], [22614, 0.064934, " too", false], [332, 0.059773, " a", false], [31581, 0.034407, " only", false], [31198, 0.024346, " just", false], [55725, 0.020326, " cheating", false], [4692, 0.016252, " no", false], [4788, 0.015378, " so", false], [4419, 0.013394, " an", false], [4404, 0.013135, " ``", false]]], "qwen": [537, 1, 0.2031400054693222, [[537, 0.20314, " not", false], [264, 0.068181, " a", false], [2238, 0.048861, " too", false], [1172, 0.045624, " only", false], [279, 0.023624, " the", false], [1101, 0.018506, " just", false], [3118, 0.017074, " based", false], [458, 0.014615, " an", false], [9902, 0.013939, " ``", false], [2588, 0.010936, " hard", false]]]}, "raw_delta": -0.023464977741241455, "tuned_delta": -0.014893185710663207}, {"byte_start": 1992, "byte_end": 1996, "display": {"text": " how", "kind": "normal"}, "is_word": true, "word_id": 334, "word_key": " how", "bytes_hex": "20 68 6f 77", "compression": {"rwkv": "19.58% 19.58% 19.58% 19.58%", "qwen": "22.53% 22.53% 22.53% 22.53%"}, "model_tokens": {"rwkv": [[21835, " how", "normal", 0.013002678751945496]], "qwen": [[1246, " how", "normal", 0.00675914017483592]]}, "loss": {"rwkv": 19.58345807456698, "qwen": 22.52795154215777}, "topk": {"rwkv": [21835, 14, 0.013002678751945496, [[332, 0.11312, " a", false], [22590, 0.05675, " the", false], [32386, 0.05119, " very", false], [47008, 0.043505, " really", false], [30992, 0.0394, " good", false], [30788, 0.035621, " even", false], [32464, 0.029665, " what", false], [4423, 0.027903, " as", false], [4404, 0.022892, " ``", false], [38606, 0.022005, " going", false]]], "qwen": [1246, 25, 0.00675914017483592, [[279, 0.142635, " the", false], [264, 0.096139, " a", false], [1128, 0.042469, " what", false], [862, 0.025291, " their", false], [1602, 0.023666, " very", false], [4586, 0.017903, " general", false], [438, 0.017367, " as", false], [3204, 0.016983, " possible", false], [2797, 0.01667, " clear", false], [2087, 0.016029, " going", false]]]}, "raw_delta": -0.16327738761901855, "tuned_delta": -0.1547055955884403}, {"byte_start": 1996, "byte_end": 2003, "display": {"text": " people", "kind": "normal"}, "is_word": true, "word_id": 335, "word_key": " people", "bytes_hex": "20 70 65 6f 70 6c 65", "compression": {"rwkv": "8.33% 8.33% 8.33% 8.33% 8.33% 8.33% 8.33%", "qwen": "12.17% 12.17% 12.17% 12.17% 12.17% 12.17% 12.17%"}, "model_tokens": {"rwkv": [[46787, " people", "normal", 0.03884807601571083]], "qwen": [[1251, " people", "normal", 0.00887445081025362]]}, "loss": {"rwkv": 8.33252995156293, "qwen": 12.171654442663186}, "topk": {"rwkv": [46787, 6, 0.03884807601571083, [[32232, 0.287569, " they", false], [46227, 0.184412, " humans", false], [38013, 0.072462, " chess", false], [38720, 0.060286, " human", false], [22590, 0.055845, " the", false], [46787, 0.038848, " people", false], [4858, 0.036273, " we", false], [59345, 0.035608, " computers", false], [332, 0.032924, " a", false], [22226, 0.026625, " one", false]]], "qwen": [1251, 12, 0.00887445081025362, [[807, 0.505775, " they", false], [32719, 0.172376, " chess", false], [279, 0.065239, " the", false], [12677, 0.054809, " humans", false], [18495, 0.032193, " computers", false], [37542, 0.024116, " Kas", false], [862, 0.017381, " their", false], [264, 0.014293, " a", false], [432, 0.012555, " it", false], [3738, 0.011437, " human", false]]]}, "raw_delta": -0.21288626534598218, "tuned_delta": -0.20431447331540392}, {"byte_start": 2003, "byte_end": 2010, "display": {"text": " played", "kind": "normal"}, "is_word": true, "word_id": 336, "word_key": " played", "bytes_hex": "20 70 6c 61 79 65 64", "compression": {"rwkv": "2.74% 2.74% 2.74% 2.74% 2.74% 2.74% 2.74%", "qwen": "2.96% 2.96% 2.96% 2.96% 2.96% 2.96% 2.96%"}, "model_tokens": {"rwkv": [[46840, " played", "normal", 0.3473087251186371]], "qwen": [[6342, " played", "normal", 0.31700965762138367]]}, "loss": {"rwkv": 2.737256215972363, "qwen": 2.9596451391318017}, "topk": {"rwkv": [46840, 1, 0.3473087251186371, [[46840, 0.347309, " played", false], [31702, 0.25139, " play", false], [55448, 0.045466, " actually", false], [39942, 0.044385, " think", false], [56714, 0.043096, " normally", false], [53137, 0.038729, " thought", false], [40219, 0.025537, " would", false], [47008, 0.016811, " really", false], [47333, 0.015898, " solved", false], [53248, 0.014591, " usually", false]]], "qwen": [6342, 1, 0.31700965762138367, [[6342, 0.31701, " played", false], [1486, 0.260489, " play", false], [1744, 0.073582, " think", false], [3381, 0.072214, " thought", false], [3520, 0.031797, " actually", false], [1030, 0.023478, " had", false], [14279, 0.016623, " normally", false], [11136, 0.015295, " typically", false], [9498, 0.011615, " learned", false], [5990, 0.011504, " usually", false]]]}, "raw_delta": -0.012331860406058187, "tuned_delta": -0.003760068375479939}, {"byte_start": 2010, "byte_end": 2016, "display": {"text": " chess", "kind": "normal"}, "is_word": true, "word_id": 337, "word_key": " chess", "bytes_hex": "20 63 68 65 73 73", "compression": {"rwkv": "1.20% 1.20% 1.20% 1.20% 1.20% 1.20%", "qwen": "0.36% 0.36% 0.36% 0.36% 0.36% 0.36%"}, "model_tokens": {"rwkv": [[38013, " chess", "normal", 0.6706175804138184]], "qwen": [[32719, " chess", "normal", 0.8862245678901672]]}, "loss": {"rwkv": 1.2034199356373594, "qwen": 0.36303296000348356}, "topk": {"rwkv": [38013, 1, 0.6706175804138184, [[38013, 0.670618, " chess", false], [47, 0.164079, ".", false], [22590, 0.09552, " the", false], [45, 0.022467, ",", false], [275, 0.007571, " (", false], [4715, 0.005695, " or", false], [21265, 0.005432, " and", false], [4596, 0.002739, " in", false], [38576, 0.002639, " games", false], [60, 0.002549, ";", false]]], "qwen": [32719, 1, 0.8862245678901672, [[32719, 0.886225, " chess", false], [279, 0.046825, " the", false], [13, 0.031141, ".", false], [11, 0.006314, ",", false], [3868, 0.003067, " games", false], [382, 0.002365, ".\n\n", false], [320, 0.002193, " (", false], [304, 0.001716, " in", false], [862, 0.001423, " their", false], [323, 0.001294, " and", false]]]}, "raw_delta": 0.04660094901919365, "tuned_delta": 0.0551727410497719}, {"byte_start": 2016, "byte_end": 2017, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "4.93%", "qwen": "7.36%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.7578884959220886]], "qwen": [[13, ".", "normal", 0.6647235751152039]]}, "loss": {"rwkv": 4.931086565538449, "qwen": 7.364670097319523}, "topk": {"rwkv": [47, 1, 0.7578884959220886, [[47, 0.757888, ".", false], [45, 0.108649, ",", false], [275, 0.028499, " (", false], [45179, 0.014494, " anyway", false], [34, 0.013592, "!", false], [4596, 0.010393, " in", false], [21265, 0.010356, " and", false], [60, 0.007991, ";", false], [4715, 0.005646, " or", false], [4788, 0.003098, " so", false]]], "qwen": [13, 1, 0.6647235751152039, [[13, 0.664724, ".", false], [11, 0.093925, ",", false], [382, 0.059952, ".\n\n", false], [320, 0.025962, " (", false], [304, 0.022525, " in", false], [13657, 0.021117, " anyway", false], [26, 0.015994, ";", false], [624, 0.009761, ".\n", false], [323, 0.009525, " and", false], [1573, 0.007049, " before", false]]]}, "raw_delta": -0.1349465250968933, "tuned_delta": -0.12637473306631505}, {"byte_start": 2017, "byte_end": 2023, "display": {"text": " These", "kind": "normal"}, "is_word": true, "word_id": 338, "word_key": " these", "bytes_hex": "20 54 68 65 73 65", "compression": {"rwkv": "13.43% 13.43% 13.43% 13.43% 13.43% 13.43%", "qwen": "13.75% 13.75% 13.75% 13.75% 13.75% 13.75%"}, "model_tokens": {"rwkv": [[37453, " These", "normal", 0.011329433880746365]], "qwen": [[4220, " These", "normal", 0.010298359207808971]]}, "loss": {"rwkv": 13.43134054994282, "qwen": 13.753004001417803}, "topk": {"rwkv": [37453, 15, 0.011329433880746365, [[261, 0.154872, "\n\n", false], [29893, 0.095155, " They", false], [267, 0.074251, "  ", false], [20996, 0.072246, " The", false], [19555, 0.042003, " But", false], [29894, 0.039349, " This", false], [3913, 0.037968, " In", false], [3918, 0.028282, " It", false], [275, 0.022757, " (", false], [19417, 0.017849, " And", false]]], "qwen": [4220, 16, 0.010298359207808971, [[2379, 0.138351, " They", false], [220, 0.111454, " ", false], [576, 0.09405, " The", false], [1096, 0.040878, " This", false], [1084, 0.038529, " It", false], [758, 0.035303, " In", false], [1597, 0.02738, " And", false], [10964, 0.026182, " Their", false], [1988, 0.024559, " But", false], [320, 0.024182, " (", false]]]}, "raw_delta": -0.017836809158325195, "tuned_delta": -0.009265017127746947}, {"byte_start": 2023, "byte_end": 2035, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 339, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"rwkv": "2.90% 2.90% 2.90% 2.90% 2.90% 2.90% 2.90% 2.90% 2.90% 2.90% 2.90% 2.90%", "qwen": "0.81% 0.81% 0.81% 0.81% 0.81% 0.81% 0.81% 0.81% 0.81% 0.81% 0.81% 0.81%"}, "model_tokens": {"rwkv": [[63843, " researchers", "normal", 0.14677117764949799]], "qwen": [[11811, " researchers", "normal", 0.5851952433586121]]}, "loss": {"rwkv": 2.899948527828564, "qwen": 0.8052188300705875}, "topk": {"rwkv": [63843, 1, 0.14677117764949799, [[63843, 0.146771, " researchers", false], [46787, 0.141002, " people", false], [32462, 0.086447, " were", false], [38720, 0.06432, " human", false], [38013, 0.025646, " chess", false], [31937, 0.024281, " same", false], [21286, 0.023734, " are", false], [59165, 0.023505, " arguments", false], [40119, 0.016835, " views", false], [61803, 0.015363, " criticisms", false]]], "qwen": [11811, 1, 0.5851952433586121, [[11811, 0.585195, " researchers", false], [3738, 0.069799, " human", false], [32719, 0.031066, " chess", false], [1033, 0.029196, " were", false], [1251, 0.026365, " people", false], [1852, 0.025132, " same", false], [525, 0.018851, " are", false], [5413, 0.014455, " methods", false], [6366, 0.013637, " computer", false], [9902, 0.008271, " ``", false]]]}, "raw_delta": 0.11615647872289016, "tuned_delta": 0.1247282707534684}, {"byte_start": 2035, "byte_end": 2042, "display": {"text": " wanted", "kind": "normal"}, "is_word": true, "word_id": 340, "word_key": " wanted", "bytes_hex": "20 77 61 6e 74 65 64", "compression": {"rwkv": "14.97% 14.97% 14.97% 14.97% 14.97% 14.97% 14.97%", "qwen": "13.46% 13.46% 13.46% 13.46% 13.46% 13.46% 13.46%"}, "model_tokens": {"rwkv": [[47763, " wanted", "normal", 0.002969448920339346]], "qwen": [[4829, " wanted", "normal", 0.005385169759392738]]}, "loss": {"rwkv": 14.974401652084108, "qwen": 13.458558851854368}, "topk": {"rwkv": [47763, 48, 0.002969448920339346, [[32462, 0.22819, " were", false], [21795, 0.087504, " had", false], [40, 0.058233, "'", false], [21532, 0.042336, " did", false], [45, 0.034351, ",", false], [31059, 0.020011, " have", false], [21286, 0.019543, " are", false], [40219, 0.017185, " would", false], [30135, 0.015096, " also", false], [38128, 0.012906, " could", false]]], "qwen": [4829, 30, 0.005385169759392738, [[1033, 0.212382, " were", false], [1030, 0.053234, " had", false], [1521, 0.046063, " did", false], [1083, 0.040398, " also", false], [11, 0.032438, ",", false], [6, 0.021224, "'", false], [11585, 0.020043, " believed", false], [1053, 0.017736, " said", false], [525, 0.016484, " are", false], [614, 0.014885, " have", false]]]}, "raw_delta": 0.08405617305210666, "tuned_delta": 0.09262796508268491}, {"byte_start": 2042, "byte_end": 2050, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 341, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "9.72% 9.72% 9.72% 9.72% 9.72% 9.72% 9.72% 9.72%", "qwen": "12.30% 12.30% 12.30% 12.30% 12.30% 12.30% 12.30% 12.30%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.013591461814939976]], "qwen": [[5413, " methods", "normal", 0.004273268394172192]]}, "loss": {"rwkv": 9.721284943490085, "qwen": 12.29756893004144}, "topk": {"rwkv": [52224, 6, 0.013591461814939976, [[4811, 0.664396, " to", false], [332, 0.068835, " a", false], [39931, 0.060808, " their", false], [22590, 0.029243, " the", false], [38013, 0.016546, " chess", false], [52224, 0.013591, " methods", false], [4419, 0.013344, " an", false], [31458, 0.009715, " more", false], [45, 0.007355, ",", false], [38720, 0.007183, " human", false]]], "qwen": [5413, 10, 0.004273268394172192, [[311, 0.74202, " to", false], [264, 0.061502, " a", false], [279, 0.032519, " the", false], [862, 0.027466, " their", false], [803, 0.01411, " more", false], [3738, 0.009216, " human", false], [458, 0.008059, " an", false], [32719, 0.006059, " chess", false], [2494, 0.005639, " something", false], [5413, 0.004273, " methods", false]]]}, "raw_delta": -0.14285951852798462, "tuned_delta": -0.13428772649740636}, {"byte_start": 2050, "byte_end": 2056, "display": {"text": " based", "kind": "normal"}, "is_word": true, "word_id": 342, "word_key": " based", "bytes_hex": "20 62 61 73 65 64", "compression": {"rwkv": "9.06% 9.06% 9.06% 9.06% 9.06% 9.06%", "qwen": "7.00% 7.00% 7.00% 7.00% 7.00% 7.00%"}, "model_tokens": {"rwkv": [[37810, " based", "normal", 0.0484761968255043]], "qwen": [[3118, " based", "normal", 0.09755192697048187]]}, "loss": {"rwkv": 9.063806734751624, "qwen": 6.995178628936783}, "topk": {"rwkv": [37810, 3, 0.0484761968255043, [[32227, 0.763646, " that", false], [4811, 0.075396, " to", false], [37810, 0.048476, " based", false], [21700, 0.030739, " for", false], [4706, 0.011632, " of", false], [32232, 0.009019, " they", false], [32487, 0.005753, " with", false], [4596, 0.004702, " in", false], [45, 0.003848, ",", false], [31458, 0.003551, " more", false]]], "qwen": [3118, 2, 0.09755192697048187, [[429, 0.764439, " that", false], [3118, 0.097552, " based", false], [311, 0.034021, " to", false], [1075, 0.013267, " like", false], [315, 0.012646, " of", false], [369, 0.011456, " for", false], [448, 0.006683, " with", false], [4428, 0.004272, " similar", false], [803, 0.003858, " more", false], [76482, 0.003539, " leveraging", false]]]}, "raw_delta": 0.11470909913380938, "tuned_delta": 0.12328089116438762}, {"byte_start": 2056, "byte_end": 2059, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 343, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"rwkv": "0.19% 0.19% 0.19%", "qwen": "0.25% 0.25% 0.25%"}, "model_tokens": {"rwkv": [[4712, " on", "normal", 0.9695175290107727]], "qwen": [[389, " on", "normal", 0.959489107131958]]}, "loss": {"rwkv": 0.18564953885137314, "qwen": 0.24859024008723393}, "topk": {"rwkv": [4712, 1, 0.9695175290107727, [[4712, 0.969518, " on", false], [32350, 0.006262, " upon", false], [31458, 0.005079, " more", false], [4596, 0.003877, " in", false], [22187, 0.003003, " not", false], [31581, 0.001197, " only", false], [56003, 0.001081, " directly", false], [46957, 0.000884, " purely", false], [52028, 0.00077, " instead", false], [4423, 0.000643, " as", false]]], "qwen": [389, 1, 0.959489107131958, [[389, 0.959489, " on", false], [803, 0.008495, " more", false], [304, 0.007239, " in", false], [5193, 0.006055, " upon", false], [537, 0.002056, " not", false], [21063, 0.001594, " solely", false], [2163, 0.001537, " around", false], [1172, 0.001132, " only", false], [31127, 0.001066, " purely", false], [11, 0.001, ",", false]]]}, "raw_delta": -0.0034901735683282222, "tuned_delta": 0.005081618462250026}, {"byte_start": 2059, "byte_end": 2065, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 344, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "3.15% 3.15% 3.15% 3.15% 3.15% 3.15%", "qwen": "2.34% 2.34% 2.34% 2.34% 2.34% 2.34%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.35164931416511536]], "qwen": [[3738, " human", "normal", 0.4591285288333893]]}, "loss": {"rwkv": 3.146502856105486, "qwen": 2.3396458912854303}, "topk": {"rwkv": [38720, 1, 0.35164931416511536, [[38720, 0.351649, " human", false], [39931, 0.106248, " their", false], [22590, 0.074814, " the", false], [65034, 0.047961, " understanding", false], [51832, 0.034556, " general", false], [30597, 0.030661, " deep", false], [332, 0.028802, " a", false], [38013, 0.024469, " chess", false], [59943, 0.020981, " knowledge", false], [32464, 0.013386, " what", false]]], "qwen": [3738, 1, 0.4591285288333893, [[3738, 0.459129, " human", false], [862, 0.141376, " their", false], [279, 0.061694, " the", false], [4586, 0.028779, " general", false], [264, 0.02666, " a", false], [8660, 0.018119, " understanding", false], [6540, 0.016029, " knowledge", false], [76482, 0.014361, " leveraging", false], [5538, 0.012181, " deep", false], [70601, 0.009768, " exploiting", false]]]}, "raw_delta": 0.044741650422414125, "tuned_delta": 0.053313442452992375}, {"byte_start": 2065, "byte_end": 2071, "display": {"text": " input", "kind": "normal"}, "is_word": true, "word_id": 345, "word_key": " input", "bytes_hex": "20 69 6e 70 75 74", "compression": {"rwkv": "25.55% 25.55% 25.55% 25.55% 25.55% 25.55%", "qwen": "24.75% 24.75% 24.75% 24.75% 24.75% 24.75%"}, "model_tokens": {"rwkv": [[38786, " input", "normal", 0.0002019024977926165]], "qwen": [[1946, " input", "normal", 0.00026557513047009706]]}, "loss": {"rwkv": 25.547724682408727, "qwen": 24.747068050449464}, "topk": {"rwkv": [38786, 72, 0.0002019024977926165, [[59943, 0.43564, " knowledge", false], [65034, 0.339619, " understanding", false], [59683, 0.040743, " expertise", false], [46, 0.034344, "-", false], [38013, 0.02655, " chess", false], [31702, 0.014614, " play", false], [59917, 0.010166, " intuition", false], [62418, 0.007823, " psychology", false], [60323, 0.00728, " reasoning", false], [52022, 0.00606, " insight", false]]], "qwen": [1946, 53, 0.00026557513047009706, [[6540, 0.446881, " knowledge", false], [8660, 0.339385, " understanding", false], [12646, 0.115004, "-k", false], [18726, 0.016356, " expertise", false], [56251, 0.010285, " intuition", false], [71107, 0.004593, "-under", false], [32719, 0.004265, " chess", false], [32711, 0.003989, " reasoning", false], [20017, 0.003962, " insight", false], [12681, 0.002659, "-like", false]]]}, "raw_delta": 0.044397830963134766, "tuned_delta": 0.052969622993713016}, {"byte_start": 2071, "byte_end": 2074, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 346, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "16.06% 16.06% 16.06%", "qwen": "12.74% 12.74% 12.74%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.0680377185344696]], "qwen": [[311, " to", "normal", 0.12003070116043091]]}, "loss": {"rwkv": 16.061253384896663, "qwen": 12.743852801817559}, "topk": {"rwkv": [4811, 5, 0.0680377185344696, [[45, 0.329605, ",", false], [21265, 0.164667, " and", false], [47, 0.136455, ".", false], [32227, 0.082538, " that", false], [4811, 0.068038, " to", false], [4706, 0.038071, " of", false], [31162, 0.033628, " into", false], [60, 0.01405, ";", false], [47001, 0.012615, " rather", false], [275, 0.01243, " (", false]]], "qwen": [311, 3, 0.12003070116043091, [[11, 0.312136, ",", false], [323, 0.121356, " and", false], [311, 0.120031, " to", false], [13, 0.104371, ".", false], [315, 0.044556, " of", false], [429, 0.036089, " that", false], [320, 0.025742, " (", false], [304, 0.018819, " in", false], [369, 0.017285, " for", false], [4751, 0.017163, " rather", false]]]}, "raw_delta": 0.1839557488759359, "tuned_delta": 0.19252754090651417}, {"byte_start": 2074, "byte_end": 2078, "display": {"text": " win", "kind": "normal"}, "is_word": true, "word_id": 347, "word_key": " win", "bytes_hex": "20 77 69 6e", "compression": {"rwkv": "12.05% 12.05% 12.05% 12.05%", "qwen": "17.09% 17.09% 17.09% 17.09%"}, "model_tokens": {"rwkv": [[22770, " win", "normal", 0.06979643553495407]], "qwen": [[3164, " win", "normal", 0.022558091208338737]]}, "loss": {"rwkv": 12.045940038672496, "qwen": 17.09441013788265}, "topk": {"rwkv": [22770, 3, 0.06979643553495407, [[4435, 0.203171, " be", false], [22590, 0.109735, " the", false], [22770, 0.069796, " win", false], [30256, 0.033785, " beat", false], [38013, 0.027678, " chess", false], [47059, 0.026664, " remain", false], [31702, 0.020708, " play", false], [51982, 0.020194, " improve", false], [55851, 0.018556, " continue", false], [32499, 0.015507, " work", false]]], "qwen": [3164, 6, 0.022558091208338737, [[387, 0.205114, " be", false], [279, 0.061523, " the", false], [1486, 0.047995, " play", false], [8474, 0.047719, " guide", false], [7269, 0.041327, " improve", false], [3164, 0.022558, " win", false], [11625, 0.022102, " solve", false], [1281, 0.021222, " make", false], [975, 0.018889, " work", false], [32719, 0.017693, " chess", false]]]}, "raw_delta": -0.27994662523269653, "tuned_delta": -0.2713748332021183}, {"byte_start": 2078, "byte_end": 2082, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 348, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "26.21% 26.21% 26.21% 26.21%", "qwen": "21.92% 21.92% 21.92% 21.92%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.0029539780225604773]], "qwen": [[323, " and", "normal", 0.007743414957076311]]}, "loss": {"rwkv": 26.205202891147184, "qwen": 21.915044070579164}, "topk": {"rwkv": [21265, 23, 0.0029539780225604773, [[22590, 0.176022, " the", false], [45, 0.160544, ",", false], [37635, 0.139895, " again", false], [4596, 0.122245, " in", false], [38013, 0.09006, " chess", false], [47, 0.071366, ".", false], [50870, 0.026514, " against", false], [46064, 0.024483, " future", false], [4424, 0.015812, " at", false], [4712, 0.01217, " on", false]]], "qwen": [323, 16, 0.007743414957076311, [[11, 0.236852, ",", false], [279, 0.183753, " the", false], [32719, 0.144311, " chess", false], [13, 0.087307, ".", false], [518, 0.040148, " at", false], [304, 0.030065, " in", false], [1182, 0.021278, " back", false], [1549, 0.018115, " again", false], [678, 0.017551, " all", false], [803, 0.014423, " more", false]]]}, "raw_delta": 0.23789691925048828, "tuned_delta": 0.24646871128106654}, {"byte_start": 2082, "byte_end": 2087, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 349, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"rwkv": "10.03% 10.03% 10.03% 10.03% 10.03%", "qwen": "6.67% 6.67% 6.67% 6.67% 6.67%"}, "model_tokens": {"rwkv": [[32462, " were", "normal", 0.06204770505428314]], "qwen": [[1033, " were", "normal", 0.1573631316423416]]}, "loss": {"rwkv": 10.031238956181074, "qwen": 6.669576201481539}, "topk": {"rwkv": [32462, 3, 0.06204770505428314, [[32232, 0.132566, " they", false], [45, 0.070691, ",", false], [32462, 0.062048, " were", false], [4811, 0.049485, " to", false], [22187, 0.030569, " not", false], [4788, 0.027509, " so", false], [21795, 0.026674, " had", false], [21532, 0.021734, " did", false], [22777, 0.021721, " won", false], [22590, 0.020569, " the", false]]], "qwen": [1033, 1, 0.1573631316423416, [[1033, 0.157363, " were", false], [11, 0.057803, ",", false], [537, 0.046059, " not", false], [807, 0.045585, " they", false], [311, 0.04225, " to", false], [773, 0.031472, " so", false], [11585, 0.03093, " believed", false], [1521, 0.029817, " did", false], [1035, 0.022363, " would", false], [1030, 0.015981, " had", false]]]}, "raw_delta": 0.18641016483306888, "tuned_delta": 0.19498195686364714}, {"byte_start": 2087, "byte_end": 2100, "display": {"text": " disappointed", "kind": "normal"}, "is_word": true, "word_id": 350, "word_key": " disappointed", "bytes_hex": "20 64 69 73 61 70 70 6f 69 6e 74 65 64", "compression": {"rwkv": "4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66%", "qwen": "4.56% 4.56% 4.56% 4.56% 4.56% 4.56% 4.56% 4.56% 4.56% 4.56% 4.56% 4.56% 4.56%"}, "model_tokens": {"rwkv": [[64362, " disappointed", "normal", 0.03446732833981514]], "qwen": [[24402, " disappointed", "normal", 0.03749189153313637]]}, "loss": {"rwkv": 4.660147743256117, "qwen": 4.555074611975615}, "topk": {"rwkv": [64362, 3, 0.03446732833981514, [[22187, 0.217453, " not", false], [60713, 0.048667, " unwilling", false], [64362, 0.034467, " disappointed", false], [32239, 0.029944, " thus", false], [53350, 0.022808, " willing", false], [62028, 0.019999, " frustrated", false], [45756, 0.014221, " dismay", false], [60374, 0.013732, " reluctant", false], [61853, 0.013632, " determined", false], [60645, 0.013492, " therefore", false]]], "qwen": [24402, 4, 0.03749189153313637, [[537, 0.212352, " not", false], [45143, 0.057787, " unwilling", false], [9831, 0.049617, " willing", false], [24402, 0.037492, " disappointed", false], [6247, 0.029933, " happy", false], [14453, 0.021838, " surprised", false], [1602, 0.015655, " very", false], [10030, 0.014863, " prepared", false], [8450, 0.012646, " thus", false], [42940, 0.011894, " reluctant", false]]]}, "raw_delta": 0.005826491575974702, "tuned_delta": 0.01439828360655295}, {"byte_start": 2100, "byte_end": 2105, "display": {"text": " when", "kind": "normal"}, "is_word": true, "word_id": 351, "word_key": " when", "bytes_hex": "20 77 68 65 6e", "compression": {"rwkv": "3.72% 3.72% 3.72% 3.72% 3.72%", "qwen": "3.83% 3.83% 3.83% 3.83% 3.83%"}, "model_tokens": {"rwkv": [[32465, " when", "normal", 0.35685861110687256]], "qwen": [[979, " when", "normal", 0.34567907452583313]]}, "loss": {"rwkv": 3.719448152291858, "qwen": 3.8312368753526838}, "topk": {"rwkv": [32465, 1, 0.35685861110687256, [[32465, 0.356859, " when", false], [32227, 0.257545, " that", false], [47, 0.097154, ".", false], [4811, 0.083437, " to", false], [4450, 0.061366, " by", false], [4596, 0.028412, " in", false], [45, 0.019553, ",", false], [4424, 0.019265, " at", false], [32487, 0.014428, " with", false], [21265, 0.012572, " and", false]]], "qwen": [979, 1, 0.34567907452583313, [[979, 0.345679, " when", false], [429, 0.229684, " that", false], [311, 0.205805, " to", false], [553, 0.114107, " by", false], [448, 0.034713, " with", false], [323, 0.011793, " and", false], [304, 0.011361, " in", false], [518, 0.009385, " at", false], [11, 0.007122, ",", false], [537, 0.00442, " not", false]]]}, "raw_delta": -0.006198883056640625, "tuned_delta": 0.0023729089739376232}, {"byte_start": 2105, "byte_end": 2110, "display": {"text": " they", "kind": "normal"}, "is_word": true, "word_id": 352, "word_key": " they", "bytes_hex": "20 74 68 65 79", "compression": {"rwkv": "4.14% 4.14% 4.14% 4.14% 4.14%", "qwen": "5.51% 5.51% 5.51% 5.51% 5.51%"}, "model_tokens": {"rwkv": [[32232, " they", "normal", 0.31571972370147705]], "qwen": [[807, " they", "normal", 0.21718207001686096]]}, "loss": {"rwkv": 4.1421127150522965, "qwen": 5.50755779270526}, "topk": {"rwkv": [32232, 1, 0.31571972370147705, [[32232, 0.31572, " they", false], [22590, 0.131504, " the", false], [37920, 0.105664, " brute", false], [4601, 0.061405, " it", false], [39931, 0.056841, " their", false], [332, 0.049243, " a", false], [47202, 0.029884, " search", false], [52224, 0.027449, " methods", false], [32234, 0.026024, " this", false], [32227, 0.021355, " that", false]]], "qwen": [807, 1, 0.21718207001686096, [[807, 0.217182, " they", false], [279, 0.146606, " the", false], [862, 0.087454, " their", false], [2711, 0.058103, " search", false], [432, 0.040035, " it", false], [1741, 0.038384, " such", false], [64098, 0.038306, " brute", false], [419, 0.037, " this", false], [264, 0.031455, " a", false], [429, 0.029938, " that", false]]]}, "raw_delta": -0.07571635246276859, "tuned_delta": -0.06714456043219034}, {"byte_start": 2110, "byte_end": 2114, "display": {"text": " did", "kind": "normal"}, "is_word": true, "word_id": 353, "word_key": " did", "bytes_hex": "20 64 69 64", "compression": {"rwkv": "5.04% 5.04% 5.04% 5.04%", "qwen": "8.23% 8.23% 8.23% 8.23%"}, "model_tokens": {"rwkv": [[21532, " did", "normal", 0.3273182213306427]], "qwen": [[1521, " did", "normal", 0.1610872596502304]]}, "loss": {"rwkv": 5.036752706228558, "qwen": 8.231518014583825}, "topk": {"rwkv": [21532, 1, 0.3273182213306427, [[21532, 0.327318, " did", false], [30633, 0.185, " didn", false], [31334, 0.114422, " lost", false], [45953, 0.111483, " failed", false], [32462, 0.064871, " were", false], [38128, 0.018362, " could", false], [38547, 0.016022, " found", false], [46936, 0.009529, " proved", false], [30383, 0.009396, " came", false], [45599, 0.008578, " couldn", false]]], "qwen": [1521, 1, 0.1610872596502304, [[1521, 0.161087, " did", false], [1033, 0.117427, " were", false], [1730, 0.114327, " found", false], [9498, 0.108848, " learned", false], [5485, 0.076586, " saw", false], [4641, 0.070985, " failed", false], [1410, 0.044698, " could", false], [11105, 0.033996, " discovered", false], [3207, 0.028945, " didn", false], [15043, 0.02417, " realized", false]]]}, "raw_delta": -0.17715540528297424, "tuned_delta": -0.168583613252396}, {"byte_start": 2114, "byte_end": 2118, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 354, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "0.07% 0.07% 0.07% 0.07%", "qwen": "0.03% 0.03% 0.03% 0.03%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.9849550724029541]], "qwen": [[537, " not", "normal", 0.9942071437835693]]}, "loss": {"rwkv": 0.06824271586236245, "qwen": 0.02619250425652555}, "topk": {"rwkv": [22187, 1, 0.9849550724029541, [[22187, 0.984955, " not", false], [47, 0.008415, ".", false], [4788, 0.001999, " so", false], [45, 0.00102, ",", false], [22770, 0.000965, " win", false], [45301, 0.000136, " better", false], [31332, 0.000135, " lose", false], [22590, 0.000112, " the", false], [4692, 0.000108, " no", false], [275, 0.000108, " (", false]]], "qwen": [537, 1, 0.9942071437835693, [[537, 0.994207, " not", false], [13, 0.001272, ".", false], [279, 0.000411, " the", false], [902, 0.00031, " no", false], [773, 0.000306, " so", false], [382, 0.000292, ".\n\n", false], [11, 0.000233, ",", false], [4302, 0.000182, " nothing", false], [2664, 0.000141, " better", false], [4518, 0.000124, " instead", false]]]}, "raw_delta": 0.002331758849322796, "tuned_delta": 0.010903550879901044}, {"byte_start": 2118, "byte_end": 2120, "display": {"text": ".\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e 0a", "compression": {"rwkv": "2.84% 8.45%", "qwen": "16.34% 16.34%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.8558160662651062], [261, "\n\n", "control", 0.3931463956832886]], "qwen": [[382, ".\n\n", "control", 0.06594829261302948]]}, "loss": {"rwkv": 5.644333015196689, "qwen": 16.343836645340584}, "topk": {"rwkv": [47, 1, 0.8558160662651062, [[47, 0.855816, ".", false], [45, 0.039462, ",", false], [22770, 0.031375, " win", false], [32499, 0.019109, " work", false], [4491, 0.004912, " do", false], [275, 0.0049, " (", false], [53051, 0.004546, " succeed", false], [60, 0.004252, ";", false], [4596, 0.002915, " in", false], [30482, 0.001322, " come", false]]], "qwen": [382, 5, 0.06594829261302948, [[13, 0.292512, ".", false], [3164, 0.140883, " win", false], [633, 0.097434, " get", false], [1477, 0.067145, " find", false], [382, 0.065948, ".\n\n", false], [11996, 0.057187, " succeed", false], [614, 0.046361, " have", false], [1490, 0.02706, " see", false], [11, 0.022252, ",", false], [975, 0.018473, " work", false]]]}, "raw_delta": -0.5933064619700114, "tuned_delta": -0.5847346699394331}, {"byte_start": 2120, "byte_end": 2121, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "8.45%", "qwen": "16.34%"}, "model_tokens": {"rwkv": [[261, "\n\n", "control", 0.3931463956832886]], "qwen": [[382, ".\n\n", "control", 0.06594829261302948]]}, "loss": {"rwkv": 8.45329125520877, "qwen": 16.343836645340584}, "topk": {"rwkv": [261, 1, 0.3931463956832886, [[261, 0.393146, "\n\n", false], [267, 0.07657, "  ", false], [29893, 0.060086, " They", false], [20996, 0.041803, " The", false], [19555, 0.035121, " But", false], [29894, 0.034772, " This", false], [3913, 0.030426, " In", false], [3918, 0.019266, " It", false], [3336, 0.014494, " \n\n", false], [37449, 0.012445, " Their", false]]], "qwen": [382, 5, 0.06594829261302948, [[13, 0.292512, ".", false], [3164, 0.140883, " win", false], [633, 0.097434, " get", false], [1477, 0.067145, " find", false], [382, 0.065948, ".\n\n", false], [11996, 0.057187, " succeed", false], [614, 0.046361, " have", false], [1490, 0.02706, " see", false], [11, 0.022252, ",", false], [975, 0.018473, " work", false]]]}, "raw_delta": -0.43754474322001136, "tuned_delta": -0.4289729511894331}, {"byte_start": 2121, "byte_end": 2122, "display": {"text": "A", "kind": "normal"}, "is_word": true, "word_id": 355, "word_key": "a", "bytes_hex": "41", "compression": {"rwkv": "51.57%", "qwen": "60.08%"}, "model_tokens": {"rwkv": [[66, "A", "normal", 0.0568917877972126]], "qwen": [[32, "A", "normal", 0.03574218973517418]]}, "loss": {"rwkv": 51.56507665677349, "qwen": 60.07785241134943}, "topk": {"rwkv": [66, 3, 0.0568917877972126, [[1136, 0.297876, "In", false], [6699, 0.154795, "The", false], [66, 0.056892, "A", false], [58094, 0.043348, "Similarly", false], [24242, 0.03946, "This", false], [33504, 0.021774, "There", false], [1141, 0.01801, "It", false], [24327, 0.016703, "When", false], [6393, 0.011491, "One", false], [5658, 0.010754, "But", false]]], "qwen": [32, 4, 0.03574218973517418, [[641, 0.353845, "In", false], [785, 0.115869, "The", false], [67691, 0.045728, "Similarly", false], [32, 0.035742, "A", false], [3862, 0.02463, "There", false], [14037, 0.023558, "Another", false], [4498, 0.021734, "When", false], [1986, 0.018385, "This", false], [3966, 0.011602, "One", false], [1655, 0.011292, "At", false]]]}, "raw_delta": -0.4720485210418701, "tuned_delta": -0.4634767290112919}, {"byte_start": 2122, "byte_end": 2130, "display": {"text": " similar", "kind": "normal"}, "is_word": true, "word_id": 356, "word_key": " similar", "bytes_hex": "20 73 69 6d 69 6c 61 72", "compression": {"rwkv": "1.47% 1.47% 1.47% 1.47% 1.47% 1.47% 1.47% 1.47%", "qwen": "1.47% 1.47% 1.47% 1.47% 1.47% 1.47% 1.47% 1.47%"}, "model_tokens": {"rwkv": [[52906, " similar", "normal", 0.5198955535888672]], "qwen": [[4428, " similar", "normal", 0.5214805603027344]]}, "loss": {"rwkv": 1.4705204579373587, "qwen": 1.4676789820776348}, "topk": {"rwkv": [52906, 1, 0.5198955535888672, [[52906, 0.519896, " similar", false], [31458, 0.041951, " more", false], [21674, 0.032268, " few", false], [52693, 0.030508, " related", false], [47205, 0.024086, " second", false], [32386, 0.017301, " very", false], [30992, 0.016075, " good", false], [59513, 0.01496, " different", false], [56812, 0.010946, " parallel", false], [21365, 0.010519, " bit", false]]], "qwen": [4428, 1, 0.5214805603027344, [[4428, 0.521481, " similar", false], [803, 0.048354, " more", false], [5435, 0.031472, " related", false], [2086, 0.028084, " second", false], [2421, 0.02363, " few", false], [2155, 0.022031, " different", false], [1602, 0.01837, " very", false], [14400, 0.010205, " somewhat", false], [13212, 0.009056, " decade", false], [11416, 0.008557, " classic", false]]]}, "raw_delta": 0.00015756487846374512, "tuned_delta": 0.008729356909041993}, {"byte_start": 2130, "byte_end": 2138, "display": {"text": " pattern", "kind": "normal"}, "is_word": true, "word_id": 357, "word_key": " pattern", "bytes_hex": "20 70 61 74 74 65 72 6e", "compression": {"rwkv": "7.15% 7.15% 7.15% 7.15% 7.15% 7.15% 7.15% 7.15%", "qwen": "6.29% 6.29% 6.29% 6.29% 6.29% 6.29% 6.29% 6.29%"}, "model_tokens": {"rwkv": [[52427, " pattern", "normal", 0.04210507869720459]], "qwen": [[5383, " pattern", "normal", 0.06150469928979874]]}, "loss": {"rwkv": 7.15007552003075, "qwen": 6.286187316698641}, "topk": {"rwkv": [52427, 5, 0.04210507869720459, [[39831, 0.281547, " story", false], [45315, 0.088449, " bitter", false], [60511, 0.079096, " situation", false], [65126, 0.055528, " disappointment", false], [52427, 0.042105, " pattern", false], [46430, 0.027427, " lesson", false], [30405, 0.021213, " case", false], [51668, 0.017758, " example", false], [45, 0.015309, ",", false], [57020, 0.01485, " reaction", false]]], "qwen": [5383, 4, 0.06150469928979874, [[6534, 0.161408, " situation", false], [3364, 0.133674, " story", false], [17755, 0.097952, " lesson", false], [5383, 0.061505, " pattern", false], [3110, 0.033002, " example", false], [3166, 0.029063, " thing", false], [12720, 0.022721, " reaction", false], [40598, 0.022441, " disappointment", false], [18915, 0.021367, " attitude", false], [24382, 0.020877, " fate", false]]]}, "raw_delta": 0.047904133796691895, "tuned_delta": 0.056475925827270144}, {"byte_start": 2138, "byte_end": 2141, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 358, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "17.09% 17.09% 17.09%", "qwen": "15.92% 15.92% 15.92%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.05823513865470886]], "qwen": [[315, " of", "normal", 0.07075536251068115]]}, "loss": {"rwkv": 17.094433427199956, "qwen": 15.920904076282552}, "topk": {"rwkv": [4706, 7, 0.05823513865470886, [[56745, 0.179856, " occurred", false], [22748, 0.134576, " was", false], [4600, 0.088215, " is", false], [21413, 0.073263, " can", false], [46840, 0.064228, " played", false], [51585, 0.058998, " emerged", false], [4706, 0.058235, " of", false], [21800, 0.032277, " has", false], [50935, 0.02939, " appears", false], [46697, 0.027455, " occurs", false]]], "qwen": [315, 5, 0.07075536251068115, [[572, 0.173193, " was", false], [21992, 0.146087, " emerged", false], [646, 0.09904, " can", false], [10017, 0.076013, " occurred", false], [315, 0.070755, " of", false], [374, 0.05973, " is", false], [702, 0.042734, " has", false], [6342, 0.0253, " played", false], [58596, 0.023844, " emerges", false], [312, 0.017661, " re", false]]]}, "raw_delta": 0.0650742848714192, "tuned_delta": 0.07364607690199744}, {"byte_start": 2141, "byte_end": 2150, "display": {"text": " research", "kind": "normal"}, "is_word": true, "word_id": 359, "word_key": " research", "bytes_hex": "20 72 65 73 65 61 72 63 68", "compression": {"rwkv": "11.71% 11.71% 11.71% 11.71% 11.71% 11.71% 11.71% 11.71% 11.71%", "qwen": "7.76% 7.76% 7.76% 7.76% 7.76% 7.76% 7.76% 7.76% 7.76%"}, "model_tokens": {"rwkv": [[57103, " research", "normal", 0.002921848325058818]], "qwen": [[3412, " research", "normal", 0.02082969807088375]]}, "loss": {"rwkv": 11.709373812770664, "qwen": 7.757242115177639}, "topk": {"rwkv": [57103, 25, 0.002921848325058818, [[45315, 0.352916, " bitter", false], [65126, 0.183364, " disappointment", false], [61640, 0.055511, " bitterness", false], [51708, 0.024754, " failure", false], [62500, 0.015933, " resistance", false], [38720, 0.01585, " human", false], [45685, 0.015144, " defeat", false], [45294, 0.010314, " belief", false], [55615, 0.010227, " behavior", false], [57419, 0.007118, " thinking", false]]], "qwen": [3412, 8, 0.02082969807088375, [[40598, 0.106948, " disappointment", false], [7709, 0.059513, " behavior", false], [3738, 0.049548, " human", false], [12720, 0.045738, " reaction", false], [1656, 0.034726, " bel", false], [7901, 0.033575, " failure", false], [13643, 0.023229, " resistance", false], [3412, 0.02083, " research", false], [7274, 0.019194, " thinking", false], [6832, 0.019006, " learning", false]]]}, "raw_delta": 0.21915271547105578, "tuned_delta": 0.22772450750163403}, {"byte_start": 2150, "byte_end": 2159, "display": {"text": " progress", "kind": "normal"}, "is_word": true, "word_id": 360, "word_key": " progress", "bytes_hex": "20 70 72 6f 67 72 65 73 73", "compression": {"rwkv": "12.27% 12.27% 12.27% 12.27% 12.27% 12.27% 12.27% 12.27% 12.27%", "qwen": "10.72% 10.72% 10.72% 10.72% 10.72% 10.72% 10.72% 10.72% 10.72%"}, "model_tokens": {"rwkv": [[56950, " progress", "normal", 0.0022138170897960663]], "qwen": [[5098, " progress", "normal", 0.00474706431850791]]}, "loss": {"rwkv": 12.272926563117915, "qwen": 10.720484080360402}, "topk": {"rwkv": [56950, 50, 0.0022138170897960663, [[51708, 0.153821, " failure", false], [65126, 0.131114, " disappointment", false], [22748, 0.063285, " was", false], [4600, 0.040835, " is", false], [21413, 0.035036, " can", false], [21265, 0.031881, " and", false], [46, 0.030735, "-", false], [4596, 0.024249, " in", false], [56745, 0.020649, " occurred", false], [21800, 0.020107, " has", false]]], "qwen": [5098, 36, 0.00474706431850791, [[572, 0.076821, " was", false], [323, 0.066671, " and", false], [374, 0.032934, " is", false], [7901, 0.028421, " failure", false], [10017, 0.023164, " occurred", false], [702, 0.020978, " has", false], [304, 0.020233, " in", false], [9162, 0.020032, " investment", false], [5041, 0.01999, " effort", false], [11, 0.017641, ",", false]]]}, "raw_delta": 0.08608569039238823, "tuned_delta": 0.09465748242296647}, {"byte_start": 2159, "byte_end": 2163, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 361, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "8.31% 8.31% 8.31% 8.31%", "qwen": "6.99% 6.99% 6.99% 6.99%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.15902355313301086]], "qwen": [[572, " was", "normal", 0.21211445331573486]]}, "loss": {"rwkv": 8.312403067621956, "qwen": 6.990891065621055}, "topk": {"rwkv": [22748, 1, 0.15902355313301086, [[22748, 0.159024, " was", false], [4596, 0.121666, " in", false], [21413, 0.115618, " can", false], [4600, 0.104086, " is", false], [56745, 0.097474, " occurred", false], [21800, 0.047412, " has", false], [21265, 0.047105, " and", false], [45, 0.020773, ",", false], [46840, 0.016361, " played", false], [51585, 0.015945, " emerged", false]]], "qwen": [572, 1, 0.21211445331573486, [[572, 0.212114, " was", false], [646, 0.094362, " can", false], [10017, 0.088096, " occurred", false], [374, 0.070937, " is", false], [304, 0.0703, " in", false], [323, 0.058003, " and", false], [8110, 0.03405, " followed", false], [702, 0.031553, " has", false], [21992, 0.026239, " emerged", false], [11, 0.018598, ",", false]]]}, "raw_delta": 0.07328018546104431, "tuned_delta": 0.08185197749162255}, {"byte_start": 2163, "byte_end": 2168, "display": {"text": " seen", "kind": "normal"}, "is_word": true, "word_id": 362, "word_key": " seen", "bytes_hex": "20 73 65 65 6e", "compression": {"rwkv": "3.30% 3.30% 3.30% 3.30% 3.30%", "qwen": "4.22% 4.22% 4.22% 4.22% 4.22%"}, "model_tokens": {"rwkv": [[31968, " seen", "normal", 0.4029674828052521]], "qwen": [[3884, " seen", "normal", 0.31041789054870605]]}, "loss": {"rwkv": 3.2967835895314197, "qwen": 4.2192912194968635}, "topk": {"rwkv": [31968, 1, 0.4029674828052521, [[31968, 0.402967, " seen", false], [51661, 0.141165, " evident", false], [56734, 0.110823, " observed", false], [57093, 0.04144, " repeated", false], [56255, 0.039543, " followed", false], [38547, 0.027996, " found", false], [55524, 0.02218, " apparent", false], [53296, 0.021982, " visible", false], [59676, 0.010409, " exhibited", false], [22590, 0.00836, " the", false]]], "qwen": [3884, 1, 0.31041789054870605, [[3884, 0.310418, " seen", false], [13166, 0.190853, " observed", false], [29476, 0.077438, " evident", false], [1730, 0.048113, " found", false], [11504, 0.029763, " repeated", false], [31026, 0.028457, " witnessed", false], [8110, 0.024862, " followed", false], [1083, 0.015594, " also", false], [304, 0.013705, " in", false], [10321, 0.010507, " experienced", false]]]}, "raw_delta": -0.05115468502044679, "tuned_delta": -0.04258289298986854}, {"byte_start": 2168, "byte_end": 2171, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 363, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "0.73% 0.73% 0.73%", "qwen": "0.94% 0.94% 0.94%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.8845621347427368]], "qwen": [[304, " in", "normal", 0.8556819558143616]]}, "loss": {"rwkv": 0.7337926436813167, "qwen": 0.9368891954426406}, "topk": {"rwkv": [4596, 1, 0.8845621347427368, [[4596, 0.884562, " in", false], [32487, 0.042789, " with", false], [32465, 0.010809, " when", false], [21700, 0.008234, " for", false], [4424, 0.004667, " at", false], [45, 0.004451, ",", false], [45805, 0.004283, " during", false], [45202, 0.002929, " around", false], [31601, 0.002847, " over", false], [4712, 0.002664, " on", false]]], "qwen": [304, 1, 0.8556819558143616, [[304, 0.855682, " in", false], [448, 0.046766, " with", false], [369, 0.018555, " for", false], [979, 0.011921, " when", false], [518, 0.011762, " at", false], [553, 0.010531, " by", false], [11, 0.005457, ",", false], [2337, 0.00533, " during", false], [916, 0.004182, " over", false], [4221, 0.003949, " among", false]]]}, "raw_delta": -0.01126206417878469, "tuned_delta": -0.0026902721482064424}, {"byte_start": 2171, "byte_end": 2180, "display": {"text": " computer", "kind": "normal"}, "is_word": true, "word_id": 364, "word_key": " computer", "bytes_hex": "20 63 6f 6d 70 75 74 65 72", "compression": {"rwkv": "3.87% 3.87% 3.87% 3.87% 3.87% 3.87% 3.87% 3.87% 3.87%", "qwen": "6.31% 6.31% 6.31% 6.31% 6.31% 6.31% 6.31% 6.31% 6.31%"}, "model_tokens": {"rwkv": [[55809, " computer", "normal", 0.14471325278282166]], "qwen": [[6366, " computer", "normal", 0.04282262921333313]]}, "loss": {"rwkv": 3.8665980371047524, "qwen": 6.313170678024638}, "topk": {"rwkv": [55809, 2, 0.14471325278282166, [[22590, 0.245204, " the", false], [55809, 0.144713, " computer", false], [52167, 0.044997, " machine", false], [3609, 0.037594, " AI", false], [38328, 0.035455, " early", false], [52299, 0.032372, " natural", false], [3851, 0.028316, " Go", false], [45929, 0.023532, " expert", false], [30941, 0.020615, " game", false], [61594, 0.018992, " artificial", false]]], "qwen": [6366, 3, 0.04282262921333313, [[279, 0.321339, " the", false], [1809, 0.056189, " game", false], [6366, 0.042823, " computer", false], [1008, 0.027065, " other", false], [6203, 0.022183, " expert", false], [5994, 0.020669, " Go", false], [5662, 0.018329, " machine", false], [20443, 0.016123, " artificial", false], [3868, 0.014979, " games", false], [5810, 0.013605, " natural", false]]]}, "raw_delta": -0.13566679424709746, "tuned_delta": -0.1270950022165192}, {"byte_start": 2180, "byte_end": 2183, "display": {"text": " Go", "kind": "normal"}, "is_word": true, "word_id": 365, "word_key": " go", "bytes_hex": "20 47 6f", "compression": {"rwkv": "4.27% 4.27% 4.27%", "qwen": "2.32% 2.32% 2.32%"}, "model_tokens": {"rwkv": [[3851, " Go", "normal", 0.4911113381385803]], "qwen": [[5994, " Go", "normal", 0.6799574494361877]]}, "loss": {"rwkv": 4.273608356799989, "qwen": 2.3186817435910383}, "topk": {"rwkv": [3851, 1, 0.4911113381385803, [[3851, 0.491111, " Go", false], [46, 0.096961, "-", false], [52814, 0.053694, " science", false], [39311, 0.042617, " poker", false], [4559, 0.026011, " go", false], [38576, 0.0252, " games", false], [47732, 0.022105, " vision", false], [47350, 0.017712, " speech", false], [52491, 0.01751, " playing", false], [31044, 0.01627, " hand", false]]], "qwen": [5994, 1, 0.6799574494361877, [[5994, 0.679957, " Go", false], [3868, 0.049785, " games", false], [20814, 0.030803, " poker", false], [728, 0.029928, " go", false], [1809, 0.02932, " game", false], [19926, 0.023104, "-go", false], [1182, 0.015382, " back", false], [1779, 0.009107, " check", false], [3701, 0.009033, " card", false], [12604, 0.007157, " GO", false]]]}, "raw_delta": 0.10840414961179096, "tuned_delta": 0.1169759416423692}, {"byte_start": 2183, "byte_end": 2184, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "22.54%", "qwen": "16.10%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.28818774223327637]], "qwen": [[11, ",", "normal", 0.40962767601013184]]}, "loss": {"rwkv": 22.542110013890053, "qwen": 16.09518771169503}, "topk": {"rwkv": [45, 2, 0.28818774223327637, [[47, 0.545737, ".", false], [45, 0.288188, ",", false], [4596, 0.049747, " in", false], [21265, 0.020126, " and", false], [275, 0.01743, " (", false], [59, 0.016158, ":", false], [31601, 0.006594, " over", false], [332, 0.003671, " a", false], [30917, 0.003334, " from", false], [60, 0.002923, ";", false]]], "qwen": [11, 2, 0.40962767601013184, [[13, 0.442132, ".", false], [11, 0.409628, ",", false], [304, 0.034679, " in", false], [320, 0.023862, " (", false], [323, 0.015349, " and", false], [3412, 0.006555, " research", false], [25, 0.006412, ":", false], [553, 0.005444, " by", false], [979, 0.005193, " when", false], [26, 0.002816, ";", false]]]}, "raw_delta": 0.3574932813644409, "tuned_delta": 0.36606507339501915}, {"byte_start": 2184, "byte_end": 2189, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 366, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"rwkv": "26.83% 26.83% 26.83% 26.83% 26.83%", "qwen": "31.91% 31.91% 31.91% 31.91% 31.91%"}, "model_tokens": {"rwkv": [[31581, " only", "normal", 0.0005948423640802503]], "qwen": [[1172, " only", "normal", 0.00014375371392816305]]}, "loss": {"rwkv": 26.825110916529162, "qwen": 31.910283618281632}, "topk": {"rwkv": [31581, 58, 0.0005948423640802503, [[40185, 0.426502, " where", false], [40186, 0.09853, " which", false], [21265, 0.05285, " and", false], [4596, 0.051349, " in", false], [22590, 0.048452, " the", false], [32487, 0.037382, " with", false], [332, 0.028634, " a", false], [50919, 0.015959, " another", false], [32465, 0.015691, " when", false], [57295, 0.015006, " starting", false]]], "qwen": [1172, 146, 0.00014375371392816305, [[1380, 0.360335, " where", false], [892, 0.147696, " which", false], [264, 0.065947, " a", false], [304, 0.062296, " in", false], [279, 0.05924, " the", false], [448, 0.042481, " with", false], [323, 0.029347, " and", false], [979, 0.018793, " when", false], [458, 0.015009, " an", false], [2441, 0.012311, " another", false]]]}, "raw_delta": -0.28198184967041007, "tuned_delta": -0.27341005763983184}, {"byte_start": 2189, "byte_end": 2197, "display": {"text": " delayed", "kind": "normal"}, "is_word": true, "word_id": 367, "word_key": " delayed", "bytes_hex": "20 64 65 6c 61 79 65 64", "compression": {"rwkv": "13.74% 13.74% 13.74% 13.74% 13.74% 13.74% 13.74% 13.74%", "qwen": "14.29% 14.29% 14.29% 14.29% 14.29% 14.29% 14.29% 14.29%"}, "model_tokens": {"rwkv": [[51419, " delayed", "normal", 0.0022904397919774055]], "qwen": [[22706, " delayed", "normal", 0.0017680253367871046]]}, "loss": {"rwkv": 13.73659828971425, "qwen": 14.28694599714994}, "topk": {"rwkv": [51419, 44, 0.0022904397919774055, [[332, 0.104567, " a", false], [31458, 0.082089, " more", false], [32487, 0.068922, " with", false], [31466, 0.060723, " much", false], [38869, 0.051716, " later", false], [32234, 0.051586, " this", false], [57245, 0.038719, " slightly", false], [4596, 0.038426, " in", false], [22590, 0.037312, " the", false], [37598, 0.03605, " about", false]]], "qwen": [22706, 45, 0.0017680253367871046, [[419, 0.243399, " this", false], [803, 0.134981, " more", false], [448, 0.060628, " with", false], [264, 0.05519, " a", false], [1753, 0.054965, " much", false], [304, 0.050239, " in", false], [311, 0.034538, " to", false], [432, 0.031966, " it", false], [279, 0.025637, " the", false], [429, 0.025317, " that", false]]]}, "raw_delta": -0.030517756938934326, "tuned_delta": -0.021945964908356076}, {"byte_start": 2197, "byte_end": 2200, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 368, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "3.19% 3.19% 3.19%", "qwen": "4.23% 4.23% 4.23%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.5878183245658875]], "qwen": [[553, " by", "normal", 0.49497660994529724]]}, "loss": {"rwkv": 3.193465585301091, "qwen": 4.227365804954872}, "topk": {"rwkv": [4450, 1, 0.5878183245658875, [[4450, 0.587818, " by", false], [332, 0.081254, " a", false], [57263, 0.06127, " somewhat", false], [21700, 0.041814, " for", false], [51018, 0.03781, " because", false], [57245, 0.031974, " slightly", false], [47, 0.0227, ".", false], [40076, 0.022327, " until", false], [4596, 0.012012, " in", false], [21265, 0.011976, " and", false]]], "qwen": [553, 1, 0.49497660994529724, [[553, 0.494977, " by", false], [3080, 0.072059, " until", false], [304, 0.060012, " in", false], [13, 0.051781, ".", false], [264, 0.044172, " a", false], [369, 0.040421, " for", false], [311, 0.02979, " to", false], [10078, 0.021066, " slightly", false], [1576, 0.020199, " because", false], [803, 0.016974, " more", false]]]}, "raw_delta": -0.05733160177866617, "tuned_delta": -0.04875980974808792}, {"byte_start": 2200, "byte_end": 2202, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 369, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "11.06% 11.06%", "qwen": "13.95% 13.95%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.29469388723373413]], "qwen": [[264, " a", "normal", 0.21295078098773956]]}, "loss": {"rwkv": 11.059722725564805, "qwen": 13.946301035477545}, "topk": {"rwkv": [332, 1, 0.29469388723373413, [[332, 0.294694, " a", false], [37598, 0.13754, " about", false], [22590, 0.122066, " the", false], [52869, 0.073772, " several", false], [22638, 0.033299, " two", false], [3483, 0.028246, " 10", false], [31370, 0.022508, " many", false], [31458, 0.018281, " more", false], [32074, 0.016117, " some", false], [30869, 0.015442, " five", false]]], "qwen": [264, 1, 0.21295078098773956, [[264, 0.212951, " a", false], [279, 0.190157, " the", false], [220, 0.099973, " ", false], [10793, 0.051928, " decades", false], [3807, 0.040558, " several", false], [803, 0.03866, " more", false], [1657, 0.034201, " many", false], [1378, 0.029853, " two", false], [911, 0.025934, " about", false], [2441, 0.018902, " another", false]]]}, "raw_delta": -0.1600658893585205, "tuned_delta": -0.15149409732794225}, {"byte_start": 2202, "byte_end": 2210, "display": {"text": " further", "kind": "normal"}, "is_word": true, "word_id": 370, "word_key": " further", "bytes_hex": "20 66 75 72 74 68 65 72", "compression": {"rwkv": "14.51% 14.51% 14.51% 14.51% 14.51% 14.51% 14.51% 14.51%", "qwen": "11.41% 11.41% 11.41% 11.41% 11.41% 11.41% 11.41% 11.41%"}, "model_tokens": {"rwkv": [[51816, " further", "normal", 0.0015914300456643105]], "qwen": [[4623, " further", "normal", 0.006346368696540594]]}, "loss": {"rwkv": 14.51148332144172, "qwen": 11.406020541992751}, "topk": {"rwkv": [51816, 14, 0.0015914300456643105, [[21674, 0.405744, " few", false], [45674, 0.309951, " decade", false], [45602, 0.109651, " couple", false], [32512, 0.038509, " year", false], [45950, 0.029282, " factor", false], [62035, 0.026727, " generation", false], [21365, 0.008774, " bit", false], [46454, 0.006501, " little", false], [46685, 0.005826, " number", false], [46530, 0.003238, " matter", false]]], "qwen": [4623, 17, 0.006346368696540594, [[13212, 0.361089, " decade", false], [2421, 0.127623, " few", false], [8168, 0.081854, " factor", false], [9471, 0.06511, " generation", false], [5021, 0.057878, " longer", false], [9294, 0.037375, " century", false], [5625, 0.029724, " couple", false], [1753, 0.023602, " much", false], [803, 0.017667, " more", false], [1042, 0.013761, " year", false]]]}, "raw_delta": 0.1722034215927124, "tuned_delta": 0.18077521362329066}, {"byte_start": 2210, "byte_end": 2213, "display": {"text": " 20", "kind": "normal"}, "is_word": true, "word_id": 371, "word_key": " 20", "bytes_hex": "20 32 30", "compression": {"rwkv": "21.32% 21.32% 21.32%", "qwen": "14.81% 15.29% 5.23%"}, "model_tokens": {"rwkv": [[3493, " 20", "normal", 0.028869060799479485]], "qwen": [[220, " ", "normal", 0.43981674313545227], [17, "2", "normal", 0.42840680480003357], [15, "0", "normal", 0.7482753396034241]]}, "loss": {"rwkv": 21.32107905480434, "qwen": 11.77637980616797}, "topk": {"rwkv": [3493, 11, 0.028869060799479485, [[45674, 0.256186, " decade", false], [3483, 0.092028, " 10", false], [30869, 0.068324, " five", false], [22638, 0.057827, " two", false], [22583, 0.050065, " ten", false], [3488, 0.045831, " 15", false], [39946, 0.033846, " three", false], [30905, 0.032757, " four", false], [21674, 0.032355, " few", false], [39644, 0.032022, " seven", false]]], "qwen": [220, 1, 0.43981674313545227, [[220, 0.439817, " ", false], [13212, 0.100761, " decade", false], [1378, 0.053785, " two", false], [5779, 0.039719, " ten", false], [4236, 0.037992, " five", false], [17073, 0.03225, " twenty", false], [9471, 0.030196, " generation", false], [2326, 0.028439, " three", false], [8168, 0.02575, " factor", false], [36655, 0.022671, " fifteen", false]]]}, "raw_delta": 0.5292705098787944, "tuned_delta": 0.5378423019093727}, {"byte_start": 2213, "byte_end": 2219, "display": {"text": " years", "kind": "normal"}, "is_word": true, "word_id": 372, "word_key": " years", "bytes_hex": "20 79 65 61 72 73", "compression": {"rwkv": "0.15% 0.15% 0.15% 0.15% 0.15% 0.15%", "qwen": "0.08% 0.08% 0.08% 0.08% 0.08% 0.08%"}, "model_tokens": {"rwkv": [[40237, " years", "normal", 0.9501520395278931]], "qwen": [[1635, " years", "normal", 0.9749020338058472]]}, "loss": {"rwkv": 0.1533626625293952, "qwen": 0.07639755989077397}, "topk": {"rwkv": [40237, 1, 0.9501520395278931, [[40237, 0.950152, " years", false], [4715, 0.01547, " or", false], [46, 0.013147, "-", false], [44, 0.005844, "+", false], [49, 0.002858, "0", false], [620, 0.001895, "00", false], [4811, 0.001188, " to", false], [32512, 0.001152, " year", false], [46596, 0.000922, " months", false], [38, 0.000819, "%", false]]], "qwen": [1635, 1, 0.9749020338058472, [[1635, 0.974902, " years", false], [476, 0.005643, " or", false], [12, 0.004019, "-", false], [311, 0.002986, " to", false], [4102, 0.00289, " ", false], [10, 0.002163, "+", false], [15, 0.001481, "0", false], [4142, 0.001073, "–", false], [56088, 0.00053, "-years", false], [22934, 0.000528, "-plus", false]]]}, "raw_delta": 0.00426785151163737, "tuned_delta": 0.012839643542215617}, {"byte_start": 2219, "byte_end": 2220, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "5.88%", "qwen": "6.47%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.719201385974884]], "qwen": [[13, ".", "normal", 0.6986647844314575]]}, "loss": {"rwkv": 5.882081831749435, "qwen": 6.466596042562159}, "topk": {"rwkv": [47, 1, 0.719201385974884, [[47, 0.719201, ".", false], [45, 0.076919, ",", false], [4715, 0.043867, " or", false], [51018, 0.027513, " because", false], [21572, 0.021136, " due", false], [21265, 0.018064, " and", false], [275, 0.017362, " (", false], [59, 0.013806, ":", false], [4706, 0.007526, " of", false], [37634, 0.006439, " after", false]]], "qwen": [13, 1, 0.6986647844314575, [[13, 0.698665, ".", false], [11, 0.08126, ",", false], [320, 0.02321, " (", false], [1576, 0.021752, " because", false], [315, 0.019394, " of", false], [323, 0.015811, " and", false], [476, 0.012819, " or", false], [1573, 0.011566, " before", false], [4152, 0.010564, " due", false], [504, 0.010561, " from", false]]]}, "raw_delta": -0.03241235017776489, "tuned_delta": -0.023840558147186643}, {"byte_start": 2220, "byte_end": 2223, "display": {"text": " En", "kind": "normal"}, "is_word": true, "word_id": 373, "word_key": " en", "bytes_hex": "20 45 6e", "compression": {"rwkv": "64.25% 64.25% 64.25%", "qwen": "67.94% 67.94% 67.94%"}, "model_tokens": {"rwkv": [[3785, " En", "normal", 2.30054010899039e-05]], "qwen": [[2925, " En", "normal", 1.2355040780676063e-05]]}, "loss": {"rwkv": 64.24501353958665, "qwen": 67.93558351169662}, "topk": {"rwkv": [3785, 910, 2.30054010899039e-05, [[20996, 0.178418, " The", false], [3913, 0.156782, " In", false], [37451, 0.027566, " There", false], [3851, 0.027197, " Go", false], [36251, 0.025745, " Again", false], [267, 0.025683, "  ", false], [300, 0.024986, " A", false], [30032, 0.023466, " When", false], [28753, 0.023235, " Deep", false], [29894, 0.022236, " This", false]]], "qwen": [2925, 1381, 1.2355040780676063e-05, [[576, 0.194352, " The", false], [758, 0.129986, " In", false], [3197, 0.042168, " When", false], [1084, 0.029462, " It", false], [1096, 0.028426, " This", false], [362, 0.026568, " A", false], [5994, 0.024987, " Go", false], [2411, 0.024318, " At", false], [18183, 0.022559, " Deep", false], [2619, 0.021317, " There", false]]]}, "raw_delta": -0.20464865366617824, "tuned_delta": -0.19607686163559998}, {"byte_start": 2223, "byte_end": 2226, "display": {"text": "orm", "kind": "normal"}, "is_word": true, "word_id": 374, "word_key": "orm", "bytes_hex": "6f 72 6d", "compression": {"rwkv": "10.71% 10.71% 10.71%", "qwen": "0.88% 0.88% 0.88%"}, "model_tokens": {"rwkv": [[8404, "orm", "normal", 0.16802969574928284]], "qwen": [[493, "orm", "normal", 0.8644454479217529]]}, "loss": {"rwkv": 10.707502256597774, "qwen": 0.8756382013579326}, "topk": {"rwkv": [8404, 2, 0.16802969574928284, [[26596, 0.450405, "ough", false], [8404, 0.16803, "orm", false], [35003, 0.112099, "light", false], [39552, 0.056283, " route", false], [34698, 0.039843, "igmat", false], [40885, 0.015508, "abling", false], [35590, 0.014525, "route", false], [54327, 0.013166, "rollment", false], [27567, 0.01029, "zyme", false], [2356, 0.010017, "zo", false]]], "qwen": [493, 1, 0.8644454479217529, [[493, 0.864445, "orm", false], [33132, 0.049235, "thus", false], [309, 0.017022, "am", false], [13013, 0.016572, "vision", false], [55247, 0.014893, "rico", false], [2152, 0.003988, "no", false], [18768, 0.002521, "abling", false], [12738, 0.002172, "zo", false], [1494, 0.001699, " pass", false], [98730, 0.001685, "igmatic", false]]]}, "raw_delta": 0.5451943079630533, "tuned_delta": 0.5537660999936316}, {"byte_start": 2226, "byte_end": 2229, "display": {"text": "ous", "kind": "normal"}, "is_word": true, "word_id": 375, "word_key": "ous", "bytes_hex": "6f 75 73", "compression": {"rwkv": "0.46% 0.46% 0.46%", "qwen": "0.45% 0.45% 0.45%"}, "model_tokens": {"rwkv": [[8439, "ous", "normal", 0.9265947937965393]], "qwen": [[782, "ous", "normal", 0.9285297393798828]]}, "loss": {"rwkv": 0.46082178023186693, "qwen": 0.4457498298154722}, "topk": {"rwkv": [8439, 1, 0.9265947937965393, [[8439, 0.926595, "ous", false], [35323, 0.072697, "ously", false], [2243, 0.000173, "us", false], [27340, 8.8e-05, "uous", false], [8435, 5.2e-05, "oul", false], [7933, 4.9e-05, "ity", false], [25902, 3.5e-05, "ious", false], [8440, 2.5e-05, "out", false], [2030, 2.2e-05, "ly", false], [7450, 2.2e-05, "ely", false]]], "qwen": [782, 1, 0.9285297393798828, [[782, 0.92853, "ous", false], [7017, 0.070054, "ously", false], [288, 0.000248, "es", false], [1530, 0.000137, "ouse", false], [283, 0.000123, "ou", false], [68, 0.000119, "e", false], [487, 0.000111, "ity", false], [78, 8.3e-05, "o", false], [33072, 7.9e-05, "eous", false], [480, 6.4e-05, "able", false]]]}, "raw_delta": 0.0008357663949330671, "tuned_delta": 0.009407558425511315}, {"byte_start": 2229, "byte_end": 2237, "display": {"text": " initial", "kind": "normal"}, "is_word": true, "word_id": 376, "word_key": " initial", "bytes_hex": "20 69 6e 69 74 69 61 6c", "compression": {"rwkv": "15.29% 15.29% 15.29% 15.29% 15.29% 15.29% 15.29% 15.29%", "qwen": "18.19% 18.19% 18.19% 18.19% 18.19% 18.19% 18.19% 18.19%"}, "model_tokens": {"rwkv": [[52013, " initial", "normal", 0.0011326418025419116]], "qwen": [[2856, " initial", "normal", 0.00031285788281820714]]}, "loss": {"rwkv": 15.286368353169191, "qwen": 18.19094464749472}, "topk": {"rwkv": [52013, 64, 0.0011326418025419116, [[56950, 0.28901, " progress", false], [64423, 0.146597, " improvements", false], [51566, 0.040142, " efforts", false], [55465, 0.037863, " advances", false], [50897, 0.032676, " amounts", false], [63621, 0.031678, " improvement", false], [45829, 0.030438, " effort", false], [57103, 0.021281, " research", false], [45, 0.018387, ",", false], [38720, 0.015586, " human", false]]], "qwen": [2856, 145, 0.00031285788281820714, [[2711, 0.142274, " search", false], [54480, 0.113539, " computational", false], [5098, 0.08119, " progress", false], [5041, 0.073557, " effort", false], [29903, 0.052898, " advances", false], [34447, 0.049092, " computation", false], [18142, 0.04861, " improvements", false], [14713, 0.038292, " amounts", false], [11, 0.025313, ",", false], [8869, 0.015892, " efforts", false]]]}, "raw_delta": -0.16106390953063965, "tuned_delta": -0.1524921175000614}, {"byte_start": 2237, "byte_end": 2245, "display": {"text": " efforts", "kind": "normal"}, "is_word": true, "word_id": 377, "word_key": " efforts", "bytes_hex": "20 65 66 66 6f 72 74 73", "compression": {"rwkv": "6.66% 6.66% 6.66% 6.66% 6.66% 6.66% 6.66% 6.66%", "qwen": "5.33% 5.33% 5.33% 5.33% 5.33% 5.33% 5.33% 5.33%"}, "model_tokens": {"rwkv": [[51566, " efforts", "normal", 0.05230437591671944]], "qwen": [[8869, " efforts", "normal", 0.09407690912485123]]}, "loss": {"rwkv": 6.656966863476906, "qwen": 5.328149360934822}, "topk": {"rwkv": [51566, 5, 0.05230437591671944, [[56950, 0.35329, " progress", false], [62157, 0.129804, " investment", false], [63678, 0.083329, " investments", false], [53052, 0.064681, " success", false], [51566, 0.052304, " efforts", false], [57103, 0.04055, " research", false], [45829, 0.038126, " effort", false], [60587, 0.028781, " successes", false], [55465, 0.023761, " advances", false], [38575, 0.020554, " gains", false]]], "qwen": [8869, 3, 0.09407690912485123, [[5041, 0.139331, " effort", false], [5098, 0.133733, " progress", false], [8869, 0.094077, " efforts", false], [9162, 0.085854, " investment", false], [29903, 0.07295, " advances", false], [54480, 0.068006, " computational", false], [2393, 0.050085, " success", false], [47088, 0.041195, " successes", false], [19619, 0.0384, " gains", false], [2711, 0.030214, " search", false]]]}, "raw_delta": 0.07368528842926025, "tuned_delta": 0.0822570804598385}, {"byte_start": 2245, "byte_end": 2250, "display": {"text": " went", "kind": "normal"}, "is_word": true, "word_id": 378, "word_key": " went", "bytes_hex": "20 77 65 6e 74", "compression": {"rwkv": "12.96% 12.96% 12.96% 12.96% 12.96%", "qwen": "14.21% 14.21% 14.21% 14.21% 14.21%"}, "model_tokens": {"rwkv": [[32460, " went", "normal", 0.027259374037384987]], "qwen": [[3937, " went", "normal", 0.01947474665939808]]}, "loss": {"rwkv": 12.96171325798678, "qwen": 14.205629375147302}, "topk": {"rwkv": [32460, 7, 0.027259374037384987, [[32462, 0.22322, " were", false], [4811, 0.216341, " to", false], [4596, 0.091994, " in", false], [4424, 0.056441, " at", false], [4450, 0.055174, " by", false], [51770, 0.046341, " focused", false], [32460, 0.027259, " went", false], [37810, 0.023881, " based", false], [45, 0.021706, ",", false], [4712, 0.016341, " on", false]]], "qwen": [3937, 9, 0.01947474665939808, [[1033, 0.326123, " were", false], [311, 0.202252, " to", false], [304, 0.091795, " in", false], [553, 0.044073, " by", false], [518, 0.034734, " at", false], [11, 0.032869, ",", false], [3118, 0.023143, " based", false], [1030, 0.020815, " had", false], [3937, 0.019475, " went", false], [389, 0.01851, " on", false]]]}, "raw_delta": -0.06897735595703125, "tuned_delta": -0.060405563926453}, {"byte_start": 2250, "byte_end": 2255, "display": {"text": " into", "kind": "normal"}, "is_word": true, "word_id": 379, "word_key": " into", "bytes_hex": "20 69 6e 74 6f", "compression": {"rwkv": "0.73% 0.73% 0.73% 0.73% 0.73%", "qwen": "0.39% 0.39% 0.39% 0.39% 0.39%"}, "model_tokens": {"rwkv": [[31162, " into", "normal", 0.8183413147926331]], "qwen": [[1119, " into", "normal", 0.8965668678283691]]}, "loss": {"rwkv": 0.725574166072086, "qwen": 0.39379216907816855}, "topk": {"rwkv": [31162, 1, 0.8183413147926331, [[31162, 0.818341, " into", false], [4811, 0.090753, " to", false], [47585, 0.044775, " toward", false], [53169, 0.01744, " towards", false], [4596, 0.015096, " in", false], [4712, 0.002648, " on", false], [56003, 0.00101, " directly", false], [52028, 0.000552, " instead", false], [45, 0.000477, ",", false], [38543, 0.000413, " forth", false]]], "qwen": [1119, 1, 0.8965668678283691, [[1119, 0.896567, " into", false], [8841, 0.040515, " toward", false], [6974, 0.020418, " towards", false], [311, 0.020106, " to", false], [304, 0.012883, " in", false], [389, 0.001529, " on", false], [1283, 0.001193, " after", false], [369, 0.000768, " for", false], [13771, 0.00056, " largely", false], [537, 0.000338, " not", false]]]}, "raw_delta": 0.018397900462150577, "tuned_delta": 0.026969692492728826}, {"byte_start": 2255, "byte_end": 2264, "display": {"text": " avoiding", "kind": "normal"}, "is_word": true, "word_id": 380, "word_key": " avoiding", "bytes_hex": "20 61 76 6f 69 64 69 6e 67", "compression": {"rwkv": "19.04% 19.04% 19.04% 19.04% 19.04% 19.04% 19.04% 19.04% 19.04%", "qwen": "18.25% 18.25% 18.25% 18.25% 18.25% 18.25% 18.25% 18.25% 18.25%"}, "model_tokens": {"rwkv": [[55586, " avoiding", "normal", 7.312235538847744e-05]], "qwen": [[30426, " avoiding", "normal", 0.0001108758442569524]]}, "loss": {"rwkv": 19.03555956728493, "qwen": 18.248287962858655}, "topk": {"rwkv": [55586, 585, 7.312235538847744e-05, [[52224, 0.124664, " methods", false], [61857, 0.076176, " developing", false], [38720, 0.066835, " human", false], [22590, 0.064859, " the", false], [47202, 0.035851, " search", false], [55882, 0.024303, " creating", false], [47629, 0.02362, " trying", false], [55666, 0.020139, " building", false], [59832, 0.019298, " improving", false], [55809, 0.017883, " computer", false]]], "qwen": [30426, 397, 0.0001108758442569524, [[11220, 0.192012, " developing", false], [5413, 0.153821, " methods", false], [3738, 0.062345, " human", false], [279, 0.032841, " the", false], [4460, 0.024713, " trying", false], [76482, 0.022661, " leveraging", false], [4752, 0.022024, " building", false], [6825, 0.019116, " creating", false], [9271, 0.019007, " finding", false], [8660, 0.016814, " understanding", false]]]}, "raw_delta": 0.04365560743543839, "tuned_delta": 0.05222739946601664}, {"byte_start": 2264, "byte_end": 2271, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 381, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "7.08% 7.08% 7.08% 7.08% 7.08% 7.08% 7.08%", "qwen": "6.52% 6.52% 6.52% 6.52% 6.52% 6.52% 6.52%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.06380629539489746]], "qwen": [[2711, " search", "normal", 0.07964933663606644]]}, "loss": {"rwkv": 7.084663147222587, "qwen": 6.518203890075754}, "topk": {"rwkv": [47202, 3, 0.06380629539489746, [[22590, 0.329888, " the", false], [37920, 0.219049, " brute", false], [47202, 0.063806, " search", false], [38720, 0.031973, " human", false], [30597, 0.031087, " deep", false], [332, 0.017288, " a", false], [4404, 0.015733, " ``", false], [63370, 0.008384, " computation", false], [52195, 0.00834, " massive", false], [32234, 0.00729, " this", false]]], "qwen": [2711, 3, 0.07964933663606644, [[279, 0.160157, " the", false], [9902, 0.08651, " ``", false], [2711, 0.079649, " search", false], [64098, 0.058393, " brute", false], [264, 0.039142, " a", false], [5538, 0.028358, " deep", false], [3738, 0.02146, " human", false], [5413, 0.01834, " methods", false], [6366, 0.017076, " computer", false], [4285, 0.015536, " simple", false]]]}, "raw_delta": 0.031411170959472656, "tuned_delta": 0.039982962990050906}, {"byte_start": 2271, "byte_end": 2274, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 382, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "13.81% 13.81% 13.81%", "qwen": "16.33% 16.33% 16.33%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.09918215870857239]], "qwen": [[553, " by", "normal", 0.06609392911195755]]}, "loss": {"rwkv": 13.807042383507657, "qwen": 16.33057678295906}, "topk": {"rwkv": [4450, 3, 0.09918215870857239, [[45, 0.234043, ",", false], [21265, 0.109957, " and", false], [4450, 0.099182, " by", false], [61566, 0.078327, " altogether", false], [47, 0.059861, ".", false], [46, 0.058658, "-", false], [52224, 0.04194, " methods", false], [56131, 0.040686, " entirely", false], [4424, 0.032649, " at", false], [4596, 0.029406, " in", false]]], "qwen": [553, 5, 0.06609392911195755, [[11, 0.249933, ",", false], [5980, 0.190714, "-based", false], [13, 0.076707, ".", false], [323, 0.074601, " and", false], [553, 0.066094, " by", false], [30055, 0.035941, " altogether", false], [5413, 0.028147, " methods", false], [304, 0.026033, " in", false], [320, 0.025177, " (", false], [518, 0.020442, " at", false]]]}, "raw_delta": -0.13993446032206214, "tuned_delta": -0.13136266829148388}, {"byte_start": 2274, "byte_end": 2281, "display": {"text": " taking", "kind": "normal"}, "is_word": true, "word_id": 383, "word_key": " taking", "bytes_hex": "20 74 61 6b 69 6e 67", "compression": {"rwkv": "15.22% 15.22% 15.22% 15.22% 15.22% 15.22% 15.22%", "qwen": "11.33% 11.33% 11.33% 11.33% 11.33% 11.33% 11.33%"}, "model_tokens": {"rwkv": [[47497, " taking", "normal", 0.002687763888388872]], "qwen": [[4633, " taking", "normal", 0.012311335653066635]]}, "loss": {"rwkv": 15.215924259375784, "qwen": 11.328337514157404}, "topk": {"rwkv": [47497, 58, 0.002687763888388872, [[40085, 0.080334, " using", false], [38720, 0.078829, " human", false], [31044, 0.077578, " hand", false], [38888, 0.037363, " lever", false], [47629, 0.025732, " trying", false], [46227, 0.022546, " humans", false], [61857, 0.021797, " developing", false], [38989, 0.021698, " means", false], [61984, 0.020016, " exploiting", false], [21273, 0.01784, " any", false]]], "qwen": [4633, 10, 0.012311335653066635, [[76482, 0.19438, " leveraging", false], [1667, 0.092285, " using", false], [70601, 0.072228, " exploiting", false], [38561, 0.036308, " relying", false], [11220, 0.028414, " developing", false], [3738, 0.022611, " human", false], [4460, 0.020352, " trying", false], [3259, 0.019752, " making", false], [9271, 0.012575, " finding", false], [4633, 0.012311, " taking", false]]]}, "raw_delta": 0.21557358333042687, "tuned_delta": 0.22414537536100512}, {"byte_start": 2281, "byte_end": 2291, "display": {"text": " advantage", "kind": "normal"}, "is_word": true, "word_id": 384, "word_key": " advantage", "bytes_hex": "20 61 64 76 61 6e 74 61 67 65", "compression": {"rwkv": "0.47% 0.47% 0.47% 0.47% 0.47% 0.47% 0.47% 0.47% 0.47% 0.47%", "qwen": "0.21% 0.21% 0.21% 0.21% 0.21% 0.21% 0.21% 0.21% 0.21% 0.21%"}, "model_tokens": {"rwkv": [[59093, " advantage", "normal", 0.7686576247215271]], "qwen": [[9423, " advantage", "normal", 0.8883240818977356]]}, "loss": {"rwkv": 0.471975428415823, "qwen": 0.21355244304141213}, "topk": {"rwkv": [59093, 1, 0.7686576247215271, [[59093, 0.768658, " advantage", false], [38720, 0.048083, " human", false], [332, 0.026224, " a", false], [22590, 0.017803, " the", false], [31044, 0.008921, " hand", false], [30923, 0.005653, " full", false], [4419, 0.004693, " an", false], [45929, 0.004575, " expert", false], [52964, 0.003557, " special", false], [39216, 0.003248, " pains", false]]], "qwen": [9423, 1, 0.8883240818977356, [[9423, 0.888324, " advantage", false], [3738, 0.020714, " human", false], [264, 0.013984, " a", false], [279, 0.010219, " the", false], [3281, 0.004454, " special", false], [458, 0.003345, " an", false], [1119, 0.003085, " into", false], [19760, 0.00281, " inspiration", false], [22146, 0.002526, " advantages", false], [2480, 0.001395, " full", false]]]}, "raw_delta": 0.014330013096332552, "tuned_delta": 0.0229018051269108}, {"byte_start": 2291, "byte_end": 2294, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 385, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.03% 0.03% 0.03%", "qwen": "0.02% 0.02% 0.02%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9949083924293518]], "qwen": [[315, " of", "normal", 0.997437596321106]]}, "loss": {"rwkv": 0.030819291034615302, "qwen": 0.015422807340620752}, "topk": {"rwkv": [4706, 1, 0.9949083924293518, [[4706, 0.994908, " of", false], [38720, 0.00164, " human", false], [45, 0.000835, ",", false], [52028, 0.000366, " instead", false], [22590, 0.000319, " the", false], [275, 0.000218, " (", false], [31581, 0.000146, " only", false], [4596, 0.000112, " in", false], [4423, 8.7e-05, " as", false], [21265, 8.1e-05, " and", false]]], "qwen": [315, 1, 0.997437596321106, [[315, 0.997438, " of", false], [3738, 0.000296, " human", false], [1172, 0.0002, " only", false], [11, 0.000194, ",", false], [4518, 0.000167, " instead", false], [320, 0.000163, " (", false], [916, 0.000138, " over", false], [279, 9.3e-05, " the", false], [198, 9e-05, "\n", false], [220, 7.1e-05, " ", false]]]}, "raw_delta": 0.0008537623410423597, "tuned_delta": 0.009425554371620608}, {"byte_start": 2294, "byte_end": 2300, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 386, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "2.75% 2.75% 2.75% 2.75% 2.75% 2.75%", "qwen": "6.58% 6.58% 6.58% 6.58% 6.58% 6.58%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.40167295932769775]], "qwen": [[3738, " human", "normal", 0.11216458678245544]]}, "loss": {"rwkv": 2.74731965794285, "qwen": 6.575647733393941}, "topk": {"rwkv": [38720, 1, 0.40167295932769775, [[38720, 0.401673, " human", false], [22590, 0.185124, " the", false], [52964, 0.042692, " special", false], [59943, 0.035366, " knowledge", false], [45775, 0.018048, " domain", false], [332, 0.015266, " a", false], [59792, 0.014431, " heuristic", false], [31044, 0.014003, " hand", false], [51832, 0.011934, " general", false], [46227, 0.009153, " humans", false]]], "qwen": [3738, 3, 0.11216458678245544, [[279, 0.509798, " the", false], [5994, 0.117232, " Go", false], [3738, 0.112165, " human", false], [3281, 0.049416, " special", false], [264, 0.015319, " a", false], [6540, 0.010242, " knowledge", false], [7947, 0.005956, " domain", false], [5888, 0.005153, " properties", false], [1045, 0.004887, " some", false], [1809, 0.003871, " game", false]]]}, "raw_delta": -0.2122875849405925, "tuned_delta": -0.20371579291001424}, {"byte_start": 2300, "byte_end": 2310, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 387, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "1.20% 1.20% 1.20% 1.20% 1.20% 1.20% 1.20% 1.20% 1.20% 1.20%", "qwen": "1.42% 1.42% 1.42% 1.42% 1.42% 1.42% 1.42% 1.42% 1.42% 1.42%"}, "model_tokens": {"rwkv": [[59943, " knowledge", "normal", 0.5131533145904541]], "qwen": [[6540, " knowledge", "normal", 0.45614248514175415]]}, "loss": {"rwkv": 1.1975495944879089, "qwen": 1.4155544802541344}, "topk": {"rwkv": [59943, 1, 0.5131533145904541, [[59943, 0.513153, " knowledge", false], [65034, 0.161099, " understanding", false], [46, 0.046622, "-", false], [59683, 0.035035, " expertise", false], [38786, 0.029546, " input", false], [59917, 0.028831, " intuition", false], [52022, 0.014413, " insight", false], [38013, 0.007878, " chess", false], [31702, 0.007873, " play", false], [62418, 0.005917, " psychology", false]]], "qwen": [6540, 1, 0.45614248514175415, [[6540, 0.456142, " knowledge", false], [8660, 0.220656, " understanding", false], [1946, 0.077828, " input", false], [18726, 0.045055, " expertise", false], [12646, 0.020202, "-k", false], [56251, 0.018437, " intuition", false], [71107, 0.007661, "-under", false], [20017, 0.00634, " insight", false], [5994, 0.004771, " Go", false], [6203, 0.004634, " expert", false]]]}, "raw_delta": -0.01208875775337219, "tuned_delta": -0.0035169657227939414}, {"byte_start": 2310, "byte_end": 2311, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "37.76%", "qwen": "45.93%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.12568451464176178]], "qwen": [[11, ",", "normal", 0.07831751555204391]]}, "loss": {"rwkv": 37.758034273265835, "qwen": 45.931514055087085}, "topk": {"rwkv": [45, 3, 0.12568451464176178, [[4706, 0.490393, " of", false], [47, 0.148935, ".", false], [45, 0.125685, ",", false], [37598, 0.08465, " about", false], [21265, 0.051184, " and", false], [4596, 0.02177, " in", false], [275, 0.019625, " (", false], [4811, 0.010303, " to", false], [60, 0.006758, ";", false], [32227, 0.003812, " that", false]]], "qwen": [11, 4, 0.07831751555204391, [[315, 0.576531, " of", false], [911, 0.126413, " about", false], [13, 0.089047, ".", false], [11, 0.078318, ",", false], [429, 0.028862, " that", false], [323, 0.024365, " and", false], [320, 0.016268, " (", false], [304, 0.009154, " in", false], [311, 0.009109, " to", false], [26, 0.005714, ";", false]]]}, "raw_delta": -0.4532339572906494, "tuned_delta": -0.4446621652600712}, {"byte_start": 2311, "byte_end": 2314, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 388, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"rwkv": "30.62% 30.62% 30.62%", "qwen": "34.32% 34.32% 34.32%"}, "model_tokens": {"rwkv": [[4715, " or", "normal", 0.006159464828670025]], "qwen": [[476, " or", "normal", 0.003315593581646681]]}, "loss": {"rwkv": 30.619699435533988, "qwen": 34.31882267814688}, "topk": {"rwkv": [4715, 19, 0.006159464828670025, [[21400, 0.394387, " but", false], [21265, 0.173016, " and", false], [32139, 0.038936, " such", false], [59841, 0.023127, " including", false], [40186, 0.018653, " which", false], [32487, 0.018028, " with", false], [4596, 0.017413, " in", false], [4423, 0.016758, " as", false], [21700, 0.011152, " for", false], [32230, 0.010708, " then", false]]], "qwen": [476, 25, 0.003315593581646681, [[714, 0.434782, " but", false], [323, 0.181965, " and", false], [448, 0.038411, " with", false], [1741, 0.030794, " such", false], [2670, 0.028073, " including", false], [1172, 0.024085, " only", false], [892, 0.023578, " which", false], [3080, 0.011885, " until", false], [304, 0.010632, " in", false], [438, 0.00972, " as", false]]]}, "raw_delta": -0.2051229476928711, "tuned_delta": -0.19655115566229284}, {"byte_start": 2314, "byte_end": 2317, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 389, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "15.87% 15.87% 15.87%", "qwen": "20.35% 20.35% 20.35%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.07145383208990097]], "qwen": [[315, " of", "normal", 0.03386511653661728]]}, "loss": {"rwkv": 15.873402468114245, "qwen": 20.350234124306272}, "topk": {"rwkv": [4706, 2, 0.07145383208990097, [[4450, 0.244458, " by", false], [4706, 0.071454, " of", false], [4424, 0.06519, " at", false], [30788, 0.037718, " even", false], [4404, 0.032433, " ``", false], [4596, 0.024966, " in", false], [40085, 0.023776, " using", false], [4788, 0.019072, " so", false], [45, 0.018771, ",", false], [47629, 0.018548, " trying", false]]], "qwen": [315, 7, 0.03386511653661728, [[9902, 0.18007, " ``", false], [11, 0.061641, ",", false], [518, 0.060405, " at", false], [553, 0.057777, " by", false], [304, 0.05474, " in", false], [1496, 0.033909, " even", false], [315, 0.033865, " of", false], [773, 0.029784, " so", false], [4751, 0.028175, " rather", false], [1119, 0.021958, " into", false]]]}, "raw_delta": -0.24824825922648108, "tuned_delta": -0.23967646719590283}, {"byte_start": 2317, "byte_end": 2321, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 390, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "10.57% 10.57% 10.57% 10.57%", "qwen": "6.59% 6.59% 6.59% 6.59%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.09579303115606308]], "qwen": [[279, " the", "normal", 0.23200125992298126]]}, "loss": {"rwkv": 10.566614069010962, "qwen": 6.586860823081602}, "topk": {"rwkv": [22590, 1, 0.09579303115606308, [[22590, 0.095793, " the", false], [38720, 0.064957, " human", false], [59792, 0.046383, " heuristic", false], [31044, 0.043984, " hand", false], [59943, 0.032278, " knowledge", false], [39193, 0.030453, " other", false], [332, 0.02655, " a", false], [4404, 0.023907, " ``", false], [32074, 0.018977, " some", false], [47202, 0.016324, " search", false]]], "qwen": [279, 1, 0.23200125992298126, [[279, 0.232001, " the", false], [3281, 0.062086, " special", false], [3738, 0.054244, " human", false], [5994, 0.043076, " Go", false], [1008, 0.037108, " other", false], [264, 0.033044, " a", false], [1045, 0.021499, " some", false], [9902, 0.019784, " ``", false], [1667, 0.007692, " using", false], [27076, 0.007412, " specialized", false]]]}, "raw_delta": 0.22068437933921814, "tuned_delta": 0.2292561713697964}, {"byte_start": 2321, "byte_end": 2329, "display": {"text": " special", "kind": "normal"}, "is_word": true, "word_id": 391, "word_key": " special", "bytes_hex": "20 73 70 65 63 69 61 6c", "compression": {"rwkv": "5.49% 5.49% 5.49% 5.49% 5.49% 5.49% 5.49% 5.49%", "qwen": "3.71% 3.71% 3.71% 3.71% 3.71% 3.71% 3.71% 3.71%"}, "model_tokens": {"rwkv": [[52964, " special", "normal", 0.08785334974527359]], "qwen": [[3281, " special", "normal", 0.1932644546031952]]}, "loss": {"rwkv": 5.4946393158857, "qwen": 3.7052372258510644}, "topk": {"rwkv": [52964, 2, 0.08785334974527359, [[60572, 0.132312, " structure", false], [52964, 0.087853, " special", false], [38720, 0.048425, " human", false], [30808, 0.037641, " fact", false], [62293, 0.025744, " particular", false], [30941, 0.017763, " game", false], [47484, 0.017089, " symmet", false], [57271, 0.015589, " specific", false], [4404, 0.014219, " ``", false], [39558, 0.013507, " rules", false]]], "qwen": [3281, 1, 0.1932644546031952, [[3281, 0.193264, " special", false], [5944, 0.122526, " structure", false], [2097, 0.03143, " fact", false], [5994, 0.02518, " Go", false], [1809, 0.020541, " game", false], [3738, 0.017236, " human", false], [7199, 0.01705, " limited", false], [9902, 0.012231, " ``", false], [1602, 0.011476, " very", false], [9981, 0.009489, " apparent", false]]]}, "raw_delta": 0.09922552108764648, "tuned_delta": 0.10779731311822473}, {"byte_start": 2329, "byte_end": 2338, "display": {"text": " features", "kind": "normal"}, "is_word": true, "word_id": 392, "word_key": " features", "bytes_hex": "20 66 65 61 74 75 72 65 73", "compression": {"rwkv": "8.83% 8.83% 8.83% 8.83% 8.83% 8.83% 8.83% 8.83% 8.83%", "qwen": "8.23% 8.23% 8.23% 8.23% 8.23% 8.23% 8.23% 8.23% 8.23%"}, "model_tokens": {"rwkv": [[56215, " features", "normal", 0.0121115418151021]], "qwen": [[4419, " features", "normal", 0.0164879709482193]]}, "loss": {"rwkv": 8.828993088773602, "qwen": 8.225613933782384}, "topk": {"rwkv": [56215, 6, 0.0121115418151021, [[60572, 0.63675, " structure", false], [62404, 0.034095, " properties", false], [46642, 0.021637, " nature", false], [62586, 0.02135, " structures", false], [47484, 0.012824, " symmet", false], [56215, 0.012112, " features", false], [56310, 0.012014, " geometry", false], [65258, 0.011735, " characteristics", false], [39558, 0.008685, " rules", false], [39654, 0.008449, " shape", false]]], "qwen": [4419, 4, 0.0164879709482193, [[5944, 0.698773, " structure", false], [5888, 0.067933, " properties", false], [6993, 0.024992, " nature", false], [4419, 0.016488, " features", false], [14389, 0.009091, " structures", false], [1809, 0.006874, " game", false], [17452, 0.00664, " characteristics", false], [6540, 0.00576, " knowledge", false], [5601, 0.005621, " rules", false], [45120, 0.004294, " symmetry", false]]]}, "raw_delta": 0.03345844480726451, "tuned_delta": 0.04203023683784276}, {"byte_start": 2338, "byte_end": 2341, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 393, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.20% 0.20% 0.20%", "qwen": "0.21% 0.21% 0.21%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9666310548782349]], "qwen": [[315, " of", "normal", 0.9655314683914185]]}, "loss": {"rwkv": 0.20399435494340606, "qwen": 0.21085330521885146}, "topk": {"rwkv": [4706, 1, 0.9666310548782349, [[4706, 0.966631, " of", false], [32227, 0.010082, " that", false], [21265, 0.00398, " and", false], [4596, 0.003571, " in", false], [275, 0.002553, " (", false], [45, 0.000726, ",", false], [47660, 0.000688, " unique", false], [57271, 0.000538, " specific", false], [56976, 0.000459, " provided", false], [32139, 0.000443, " such", false]]], "qwen": [315, 1, 0.9655314683914185, [[315, 0.965531, " of", false], [304, 0.006975, " in", false], [429, 0.006378, " that", false], [323, 0.004845, " and", false], [36988, 0.002197, " inherent", false], [320, 0.001166, " (", false], [11, 0.001155, ",", false], [3042, 0.000999, " present", false], [4911, 0.000969, " unique", false], [476, 0.000662, " or", false]]]}, "raw_delta": -0.00038034096360206604, "tuned_delta": 0.008191451066976182}, {"byte_start": 2341, "byte_end": 2345, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 394, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "3.84% 3.84% 3.84% 3.84%", "qwen": "5.12% 5.12% 5.12% 5.12%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.4348495900630951]], "qwen": [[279, " the", "normal", 0.3214719593524933]]}, "loss": {"rwkv": 3.839203111740649, "qwen": 5.116360250638249}, "topk": {"rwkv": [22590, 1, 0.4348495900630951, [[22590, 0.43485, " the", false], [3851, 0.269551, " Go", false], [37876, 0.047224, " board", false], [332, 0.023571, " a", false], [62293, 0.017269, " particular", false], [30941, 0.013335, " game", false], [52491, 0.0104, " playing", false], [38576, 0.009769, " games", false], [32234, 0.007583, " this", false], [51161, 0.006293, " certain", false]]], "qwen": [279, 2, 0.3214719593524933, [[5994, 0.547585, " Go", false], [279, 0.321472, " the", false], [419, 0.021368, " this", false], [264, 0.011347, " a", false], [4479, 0.008572, " board", false], [3738, 0.005747, " human", false], [32719, 0.00415, " chess", false], [6366, 0.003771, " computer", false], [728, 0.003709, " go", false], [9902, 0.003297, " ``", false]]]}, "raw_delta": -0.0708206295967102, "tuned_delta": -0.062248837566131955}, {"byte_start": 2345, "byte_end": 2350, "display": {"text": " game", "kind": "normal"}, "is_word": true, "word_id": 395, "word_key": " game", "bytes_hex": "20 67 61 6d 65", "compression": {"rwkv": "3.56% 3.56% 3.56% 3.56% 3.56%", "qwen": "4.66% 4.66% 4.66% 4.66% 4.66%"}, "model_tokens": {"rwkv": [[30941, " game", "normal", 0.3745507597923279]], "qwen": [[1809, " game", "normal", 0.275059312582016]]}, "loss": {"rwkv": 3.5644711459463645, "qwen": 4.655463299656067}, "topk": {"rwkv": [30941, 1, 0.3745507597923279, [[30941, 0.374551, " game", false], [37876, 0.254442, " board", false], [3851, 0.117418, " Go", false], [62293, 0.020858, " particular", false], [45775, 0.019811, " domain", false], [52569, 0.011625, " problem", false], [22638, 0.008441, " two", false], [38720, 0.008009, " human", false], [39558, 0.007313, " rules", false], [31012, 0.007254, " grid", false]]], "qwen": [1809, 2, 0.275059312582016, [[5994, 0.436529, " Go", false], [1809, 0.275059, " game", false], [4479, 0.128263, " board", false], [7947, 0.017312, " domain", false], [220, 0.008379, " ", false], [3738, 0.004586, " human", false], [3953, 0.004514, " particular", false], [2613, 0.004435, " small", false], [3491, 0.00443, " problem", false], [5944, 0.004076, " structure", false]]]}, "raw_delta": -0.06049745082855227, "tuned_delta": -0.05192565879797402}, {"byte_start": 2350, "byte_end": 2351, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "30.01%", "qwen": "29.58%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.1922062188386917]], "qwen": [[11, ",", "normal", 0.19395911693572998]]}, "loss": {"rwkv": 30.00918395599113, "qwen": 29.57719578377079}, "topk": {"rwkv": [45, 2, 0.1922062188386917, [[47, 0.363612, ".", false], [45, 0.192206, ",", false], [275, 0.071949, " (", false], [4706, 0.067428, " of", false], [32139, 0.044257, " such", false], [32227, 0.040145, " that", false], [460, 0.03844, "'s", false], [60572, 0.021663, " structure", false], [46342, 0.021244, " itself", false], [31296, 0.012087, " like", false]]], "qwen": [11, 2, 0.19395911693572998, [[13, 0.347763, ".", false], [11, 0.193959, ",", false], [315, 0.146011, " of", false], [4479, 0.062257, " board", false], [5086, 0.059378, " itself", false], [320, 0.048018, " (", false], [5994, 0.014755, " Go", false], [429, 0.014364, " that", false], [1741, 0.009644, " such", false], [323, 0.008801, " and", false]]]}, "raw_delta": 0.02395451068878174, "tuned_delta": 0.03252630271935999}, {"byte_start": 2351, "byte_end": 2355, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 396, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"rwkv": "5.57% 5.57% 5.57% 5.57%", "qwen": "5.01% 5.01% 5.01% 5.01%"}, "model_tokens": {"rwkv": [[21400, " but", "normal", 0.28987160325050354]], "qwen": [[714, " but", "normal", 0.3293311893939972]]}, "loss": {"rwkv": 5.565083409679106, "qwen": 5.007465673123974}, "topk": {"rwkv": [21400, 1, 0.28987160325050354, [[21400, 0.289872, " but", false], [32139, 0.233732, " such", false], [21265, 0.106829, " and", false], [4715, 0.104154, " or", false], [31296, 0.030195, " like", false], [4596, 0.02698, " in", false], [4811, 0.017742, " to", false], [59841, 0.012625, " including", false], [40186, 0.011637, " which", false], [4423, 0.010956, " as", false]]], "qwen": [714, 1, 0.3293311893939972, [[714, 0.329331, " but", false], [323, 0.146605, " and", false], [476, 0.131584, " or", false], [1741, 0.044465, " such", false], [3080, 0.036367, " until", false], [1172, 0.026147, " only", false], [892, 0.023762, " which", false], [448, 0.02018, " with", false], [2670, 0.018039, " including", false], [304, 0.016751, " in", false]]]}, "raw_delta": 0.03092089295387268, "tuned_delta": 0.03949268498445093}, {"byte_start": 2355, "byte_end": 2359, "display": {"text": " all", "kind": "normal"}, "is_word": true, "word_id": 397, "word_key": " all", "bytes_hex": "20 61 6c 6c", "compression": {"rwkv": "19.44% 19.44% 19.44% 19.44%", "qwen": "21.68% 21.68% 21.68% 21.68%"}, "model_tokens": {"rwkv": [[21256, " all", "normal", 0.013479495421051979]], "qwen": [[678, " all", "normal", 0.00816090777516365]]}, "loss": {"rwkv": 19.44256988698017, "qwen": 21.678297052967693}, "topk": {"rwkv": [21256, 15, 0.013479495421051979, [[39936, 0.150641, " these", false], [22590, 0.095963, " the", false], [32465, 0.091621, " when", false], [32234, 0.069119, " this", false], [4596, 0.065346, " in", false], [4601, 0.041442, " it", false], [4423, 0.035239, " as", false], [32232, 0.022459, " they", false], [32230, 0.02222, " then", false], [31578, 0.021448, " once", false]]], "qwen": [678, 25, 0.00816090777516365, [[1493, 0.137282, " these", false], [279, 0.095442, " the", false], [419, 0.089494, " this", false], [432, 0.06762, " it", false], [9583, 0.064241, " eventually", false], [304, 0.043861, " in", false], [979, 0.037487, " when", false], [1172, 0.029987, " only", false], [1221, 0.024956, " then", false], [11, 0.023043, ",", false]]]}, "raw_delta": -0.12397503852844238, "tuned_delta": -0.11540324649786414}, {"byte_start": 2359, "byte_end": 2365, "display": {"text": " those", "kind": "normal"}, "is_word": true, "word_id": 398, "word_key": " those", "bytes_hex": "20 74 68 6f 73 65", "compression": {"rwkv": "10.38% 10.38% 10.38% 10.38% 10.38% 10.38%", "qwen": "12.36% 12.36% 12.36% 12.36% 12.36% 12.36%"}, "model_tokens": {"rwkv": [[39944, " those", "normal", 0.03198657184839249]], "qwen": [[1846, " those", "normal", 0.01638016290962696]]}, "loss": {"rwkv": 10.378763152228546, "qwen": 12.358138711594995}, "topk": {"rwkv": [39944, 9, 0.03198657184839249, [[4706, 0.251499, " of", false], [39936, 0.157181, " these", false], [32139, 0.076099, " such", false], [32234, 0.065139, " this", false], [45953, 0.056934, " failed", false], [32462, 0.052521, " were", false], [32227, 0.049182, " that", false], [22590, 0.040221, " the", false], [39944, 0.031987, " those", false], [46936, 0.026999, " proved", false]]], "qwen": [1846, 11, 0.01638016290962696, [[315, 0.231068, " of", false], [1493, 0.211625, " these", false], [419, 0.083974, " this", false], [429, 0.068219, " that", false], [1741, 0.039104, " such", false], [1033, 0.033162, " were", false], [4641, 0.032745, " failed", false], [279, 0.027002, " the", false], [8869, 0.020748, " efforts", false], [304, 0.020119, " in", false]]]}, "raw_delta": -0.10975988705952955, "tuned_delta": -0.1011880950289513}, {"byte_start": 2365, "byte_end": 2373, "display": {"text": " efforts", "kind": "normal"}, "is_word": true, "word_id": 399, "word_key": " efforts", "bytes_hex": "20 65 66 66 6f 72 74 73", "compression": {"rwkv": "1.67% 1.67% 1.67% 1.67% 1.67% 1.67% 1.67% 1.67%", "qwen": "1.16% 1.16% 1.16% 1.16% 1.16% 1.16% 1.16% 1.16%"}, "model_tokens": {"rwkv": [[51566, " efforts", "normal", 0.4796241521835327]], "qwen": [[8869, " efforts", "normal", 0.5964605808258057]]}, "loss": {"rwkv": 1.6730472275934023, "qwen": 1.164845749811886}, "topk": {"rwkv": [51566, 1, 0.4796241521835327, [[51566, 0.479624, " efforts", false], [52224, 0.114917, " methods", false], [61590, 0.086399, " approaches", false], [38720, 0.024548, " human", false], [32462, 0.023234, " were", false], [55572, 0.019823, " attempts", false], [22762, 0.01328, " who", false], [45953, 0.010727, " failed", false], [32227, 0.009949, " that", false], [38328, 0.009683, " early", false]]], "qwen": [8869, 1, 0.5964605808258057, [[8869, 0.596461, " efforts", false], [5413, 0.095559, " methods", false], [19827, 0.069919, " approaches", false], [13553, 0.038784, " attempts", false], [4124, 0.02333, " early", false], [1635, 0.008638, " years", false], [2856, 0.007268, " initial", false], [12538, 0.005982, " techniques", false], [6708, 0.005706, " ideas", false], [3412, 0.005579, " research", false]]]}, "raw_delta": 0.028180673718452454, "tuned_delta": 0.036752465749030704}, {"byte_start": 2373, "byte_end": 2380, "display": {"text": " proved", "kind": "normal"}, "is_word": true, "word_id": 400, "word_key": " proved", "bytes_hex": "20 70 72 6f 76 65 64", "compression": {"rwkv": "6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68%", "qwen": "7.26% 7.26% 7.26% 7.26% 7.26% 7.26% 7.26%"}, "model_tokens": {"rwkv": [[46936, " proved", "normal", 0.07473129779100418]], "qwen": [[18651, " proved", "normal", 0.05967317521572113]]}, "loss": {"rwkv": 6.6821254684031235, "qwen": 7.262095805446487}, "topk": {"rwkv": [46936, 3, 0.07473129779100418, [[32462, 0.364346, " were", false], [45953, 0.129943, " failed", false], [46936, 0.074731, " proved", false], [62676, 0.041216, " ultimately", false], [61959, 0.028101, " eventually", false], [30383, 0.025273, " came", false], [21532, 0.020969, " did", false], [38367, 0.020479, " ended", false], [47638, 0.01424, " turned", false], [32460, 0.01336, " went", false]]], "qwen": [18651, 3, 0.05967317521572113, [[1033, 0.367029, " were", false], [4641, 0.179818, " failed", false], [18651, 0.059673, " proved", false], [13653, 0.048752, " ultimately", false], [9583, 0.031623, " eventually", false], [9482, 0.028981, " ended", false], [11, 0.015861, ",", false], [11052, 0.014836, " fell", false], [614, 0.014054, " have", false], [3697, 0.012633, " came", false]]]}, "raw_delta": -0.03216038431440077, "tuned_delta": -0.02358859228382252}, {"byte_start": 2380, "byte_end": 2391, "display": {"text": " irrelevant", "kind": "normal"}, "is_word": true, "word_id": 401, "word_key": " irrelevant", "bytes_hex": "20 69 72 72 65 6c 65 76 61 6e 74", "compression": {"rwkv": "8.91% 8.91% 8.91% 8.91% 8.91% 8.91% 8.91% 8.91% 8.91% 8.91% 8.91%", "qwen": "10.89% 10.89% 10.89% 10.89% 10.89% 10.89% 10.89% 10.89% 10.89% 10.89% 10.89%"}, "model_tokens": {"rwkv": [[62161, " irrelevant", "normal", 0.004359398037195206]], "qwen": [[39715, " irrelevant", "normal", 0.0013073112349957228]]}, "loss": {"rwkv": 8.914379869129245, "qwen": 10.885433943701791}, "topk": {"rwkv": [62161, 30, 0.004359398037195206, [[4811, 0.169799, " to", false], [62676, 0.108742, " ultimately", false], [62088, 0.062653, " inadequate", false], [63631, 0.060356, " ineffective", false], [21719, 0.059164, " fut", false], [31277, 0.044976, " less", false], [64450, 0.034119, " insufficient", false], [64616, 0.029121, " unsuccessful", false], [56445, 0.021643, " inferior", false], [38562, 0.019466, " fruit", false]]], "qwen": [39715, 63, 0.0013073112349957228, [[44925, 0.188567, " unsuccessful", false], [13779, 0.135968, " fruit", false], [311, 0.112288, " to", false], [84527, 0.065561, " futile", false], [38313, 0.053151, " insufficient", false], [54188, 0.041893, " ineffective", false], [13653, 0.034876, " ultimately", false], [45479, 0.024206, " inadequate", false], [38123, 0.017821, " disappointing", false], [2238, 0.01687, " too", false]]]}, "raw_delta": -0.10929844596169212, "tuned_delta": -0.10072665393111388}, {"byte_start": 2391, "byte_end": 2392, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "61.71%", "qwen": "49.52%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.03248727694153786]], "qwen": [[11, ",", "normal", 0.06418482959270477]]}, "loss": {"rwkv": 61.709026163024014, "qwen": 49.520297528472675}, "topk": {"rwkv": [45, 7, 0.03248727694153786, [[32465, 0.290877, " when", false], [4596, 0.165691, " in", false], [4811, 0.141382, " to", false], [47, 0.122309, ".", false], [4423, 0.084247, " as", false], [31578, 0.0398, " once", false], [45, 0.032487, ",", false], [21265, 0.013905, " and", false], [55794, 0.013724, " compared", false], [37634, 0.012328, " after", false]]], "qwen": [11, 6, 0.06418482959270477, [[13, 0.225093, ".", false], [979, 0.184171, " when", false], [304, 0.139454, " in", false], [311, 0.097434, " to", false], [438, 0.075705, " as", false], [11, 0.064185, ",", false], [3055, 0.046634, " once", false], [1283, 0.021483, " after", false], [369, 0.014886, " for", false], [323, 0.014392, " and", false]]]}, "raw_delta": 0.6758866310119629, "tuned_delta": 0.6844584230425411}, {"byte_start": 2392, "byte_end": 2395, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 402, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"rwkv": "20.19% 20.19% 20.19%", "qwen": "25.52% 25.52% 25.52%"}, "model_tokens": {"rwkv": [[4715, " or", "normal", 0.0346657894551754]], "qwen": [[476, " or", "normal", 0.01434085238724947]]}, "loss": {"rwkv": 20.19397355410984, "qwen": 25.515523797412175}, "topk": {"rwkv": [4715, 6, 0.0346657894551754, [[21265, 0.334903, " and", false], [4423, 0.1551, " as", false], [51018, 0.062139, " because", false], [4596, 0.052483, " in", false], [32465, 0.042149, " when", false], [4715, 0.034666, " or", false], [40187, 0.033495, " while", false], [31578, 0.02105, " once", false], [39690, 0.019456, " since", false], [32487, 0.015308, " with", false]]], "qwen": [476, 8, 0.01434085238724947, [[323, 0.510421, " and", false], [438, 0.138638, " as", false], [1576, 0.072281, " because", false], [2474, 0.031531, " since", false], [1496, 0.024779, " even", false], [304, 0.017724, " in", false], [448, 0.016665, " with", false], [476, 0.014341, " or", false], [369, 0.013842, " for", false], [518, 0.010165, " at", false]]]}, "raw_delta": -0.29508940378824855, "tuned_delta": -0.2865176117576703}, {"byte_start": 2395, "byte_end": 2401, "display": {"text": " worse", "kind": "normal"}, "is_word": true, "word_id": 403, "word_key": " worse", "bytes_hex": "20 77 6f 72 73 65", "compression": {"rwkv": "7.51% 7.51% 7.51% 7.51% 7.51% 7.51%", "qwen": "6.50% 6.50% 6.50% 6.50% 6.50% 6.50%"}, "model_tokens": {"rwkv": [[40216, " worse", "normal", 0.08160778880119324]], "qwen": [[10960, " worse", "normal", 0.1149168461561203]]}, "loss": {"rwkv": 7.514036671296684, "qwen": 6.502787283355913}, "topk": {"rwkv": [40216, 2, 0.08160778880119324, [[4424, 0.398658, " at", false], [40216, 0.081608, " worse", false], [30788, 0.054097, " even", false], [31581, 0.026726, " only", false], [31277, 0.015032, " less", false], [22187, 0.01217, " not", false], [62161, 0.011741, " irrelevant", false], [22614, 0.011484, " too", false], [51336, 0.010688, " counter", false], [63631, 0.010246, " ineffective", false]]], "qwen": [10960, 2, 0.1149168461561203, [[518, 0.291973, " at", false], [10960, 0.114917, " worse", false], [1496, 0.109925, " even", false], [1033, 0.072651, " were", false], [11, 0.019511, ",", false], [304, 0.019083, " in", false], [1172, 0.018328, " only", false], [4751, 0.0173, " rather", false], [1602, 0.008229, " very", false], [421, 0.007831, " if", false]]]}, "raw_delta": 0.0560755729675293, "tuned_delta": 0.06464736499810754}, {"byte_start": 2401, "byte_end": 2402, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "3.75%", "qwen": "5.24%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8126047253608704]], "qwen": [[11, ",", "normal", 0.7480016350746155]]}, "loss": {"rwkv": 3.7511479944988912, "qwen": 5.2360832858074735}, "topk": {"rwkv": [45, 1, 0.8126047253608704, [[45, 0.812605, ",", false], [47, 0.144453, ".", false], [59, 0.005925, ":", false], [32226, 0.005779, " than", false], [275, 0.00417, " (", false], [39820, 0.00309, " still", false], [22797, 0.002026, " yet", false], [4596, 0.001995, " in", false], [60, 0.001529, ";", false], [32465, 0.001258, " when", false]]], "qwen": [11, 1, 0.7480016350746155, [[11, 0.748002, ",", false], [13, 0.156205, ".", false], [1091, 0.024821, " than", false], [25, 0.013021, ":", false], [2058, 0.011146, " still", false], [382, 0.007431, ".\n\n", false], [320, 0.006354, " (", false], [3602, 0.006277, " yet", false], [304, 0.002296, " in", false], [1496, 0.001828, " even", false]]]}, "raw_delta": -0.08234229683876038, "tuned_delta": -0.07377050480818213}, {"byte_start": 2402, "byte_end": 2407, "display": {"text": " once", "kind": "normal"}, "is_word": true, "word_id": 404, "word_key": " once", "bytes_hex": "20 6f 6e 63 65", "compression": {"rwkv": "10.76% 10.76% 10.76% 10.76% 10.76%", "qwen": "17.17% 17.17% 17.17% 17.17% 17.17%"}, "model_tokens": {"rwkv": [[31578, " once", "normal", 0.05073611065745354]], "qwen": [[3055, " once", "normal", 0.008549327030777931]]}, "loss": {"rwkv": 10.7638575316325, "qwen": 17.174933919864813}, "topk": {"rwkv": [31578, 5, 0.05073611065745354, [[32465, 0.465948, " when", false], [4423, 0.139763, " as", false], [4596, 0.122279, " in", false], [4811, 0.071231, " to", false], [31578, 0.050736, " once", false], [51018, 0.014975, " because", false], [37634, 0.013941, " after", false], [22590, 0.009001, " the", false], [21265, 0.0075, " and", false], [55794, 0.005529, " compared", false]]], "qwen": [3055, 16, 0.008549327030777931, [[979, 0.130104, " when", false], [304, 0.094937, " in", false], [438, 0.081083, " as", false], [311, 0.047145, " to", false], [5546, 0.046519, " counter", false], [807, 0.035521, " they", false], [1033, 0.033083, " were", false], [1576, 0.0218, " because", false], [323, 0.018987, " and", false], [1283, 0.014799, " after", false]]]}, "raw_delta": -0.35550556182861326, "tuned_delta": -0.34693376979803503}, {"byte_start": 2407, "byte_end": 2414, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 405, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "7.00% 7.00% 7.00% 7.00% 7.00% 7.00% 7.00%", "qwen": "5.30% 5.30% 5.30% 5.30% 5.30% 5.30% 5.30%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.0654434785246849]], "qwen": [[2711, " search", "normal", 0.12801995873451233]]}, "loss": {"rwkv": 7.004155611458694, "qwen": 5.295641875914862}, "topk": {"rwkv": [47202, 4, 0.0654434785246849, [[22590, 0.252623, " the", false], [332, 0.098207, " a", false], [51832, 0.071414, " general", false], [47202, 0.065443, " search", false], [30597, 0.046835, " deep", false], [52224, 0.027957, " methods", false], [4601, 0.025044, " it", false], [52195, 0.02204, " massive", false], [59345, 0.016717, " computers", false], [63370, 0.013647, " computation", false]]], "qwen": [2711, 2, 0.12801995873451233, [[279, 0.272289, " the", false], [2711, 0.12802, " search", false], [264, 0.067083, " a", false], [5538, 0.042659, " deep", false], [64098, 0.025337, " brute", false], [5994, 0.021651, " Go", false], [6366, 0.020424, " computer", false], [432, 0.020042, " it", false], [10951, 0.016654, " massive", false], [803, 0.01515, " more", false]]]}, "raw_delta": 0.0947401182992118, "tuned_delta": 0.10331191032979005}, {"byte_start": 2414, "byte_end": 2418, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 406, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "9.02% 9.02% 9.02% 9.02%", "qwen": "9.35% 9.35% 9.35% 9.35%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.13477815687656403]], "qwen": [[572, " was", "normal", 0.12576831877231598]]}, "loss": {"rwkv": 9.01684400555602, "qwen": 9.347373162682981}, "topk": {"rwkv": [22748, 3, 0.13477815687656403, [[45283, 0.237867, " became", false], [46, 0.168972, "-", false], [22748, 0.134778, " was", false], [52224, 0.08936, " methods", false], [21795, 0.026584, " had", false], [32487, 0.017196, " with", false], [37810, 0.014106, " based", false], [21265, 0.012929, " and", false], [61559, 0.012752, " algorithms", false], [4450, 0.011651, " by", false]]], "qwen": [572, 3, 0.12576831877231598, [[5980, 0.388347, "-based", false], [6116, 0.183554, " became", false], [572, 0.125768, " was", false], [5413, 0.037246, " methods", false], [1030, 0.026783, " had", false], [18651, 0.025728, " proved", false], [3118, 0.018455, " based", false], [3697, 0.013409, " came", false], [1410, 0.012272, " could", false], [6009, 0.009349, " began", false]]]}, "raw_delta": -0.018328428268432617, "tuned_delta": -0.009756636237854369}, {"byte_start": 2418, "byte_end": 2426, "display": {"text": " applied", "kind": "normal"}, "is_word": true, "word_id": 407, "word_key": " applied", "bytes_hex": "20 61 70 70 6c 69 65 64", "compression": {"rwkv": "6.59% 6.59% 6.59% 6.59% 6.59% 6.59% 6.59% 6.59%", "qwen": "8.78% 8.78% 8.78% 8.78% 8.78% 8.78% 8.78% 8.78%"}, "model_tokens": {"rwkv": [[50937, " applied", "normal", 0.053955789655447006]], "qwen": [[9251, " applied", "normal", 0.0203444492071867]]}, "loss": {"rwkv": 6.5865227696835, "qwen": 8.780032494450476}, "topk": {"rwkv": [50937, 3, 0.053955789655447006, [[31351, 0.090637, " made", false], [59206, 0.089687, " available", false], [50937, 0.053956, " applied", false], [51744, 0.034488, " finally", false], [59506, 0.034336, " developed", false], [22590, 0.029703, " the", false], [51097, 0.027678, " brought", false], [64583, 0.025097, " sufficiently", false], [32354, 0.025039, " used", false], [63616, 0.020898, " implemented", false]]], "qwen": [9251, 12, 0.0203444492071867, [[1865, 0.053315, " made", false], [2500, 0.049449, " available", false], [5499, 0.049129, " finally", false], [11523, 0.040386, " introduced", false], [7117, 0.037536, " brought", false], [1483, 0.036969, " used", false], [11537, 0.035659, " implemented", false], [5420, 0.032594, " allowed", false], [279, 0.023325, " the", false], [3694, 0.021444, " added", false]]]}, "raw_delta": -0.12163400650024414, "tuned_delta": -0.1130622144696659}, {"byte_start": 2426, "byte_end": 2438, "display": {"text": " effectively", "kind": "normal"}, "is_word": true, "word_id": 408, "word_key": " effectively", "bytes_hex": "20 65 66 66 65 63 74 69 76 65 6c 79", "compression": {"rwkv": "7.98% 7.98% 7.98% 7.98% 7.98% 7.98% 7.98% 7.98% 7.98% 7.98% 7.98% 7.98%", "qwen": "6.01% 6.01% 6.01% 6.01% 6.01% 6.01% 6.01% 6.01% 6.01% 6.01% 6.01% 6.01%"}, "model_tokens": {"rwkv": [[63507, " effectively", "normal", 0.004854880273342133]], "qwen": [[13444, " effectively", "normal", 0.018304264172911644]]}, "loss": {"rwkv": 7.983663963252726, "qwen": 6.012163059512656}, "topk": {"rwkv": [63507, 22, 0.004854880273342133, [[47, 0.41929, ".", false], [4811, 0.169509, " to", false], [4596, 0.088032, " in", false], [21265, 0.044924, " and", false], [45, 0.027145, ",", false], [32487, 0.022463, " with", false], [4712, 0.020371, " on", false], [4424, 0.018365, " at", false], [4517, 0.01801, " en", false], [4423, 0.015975, " as", false]]], "qwen": [13444, 9, 0.018304264172911644, [[13, 0.52186, ".", false], [311, 0.097049, " to", false], [382, 0.055723, ".\n\n", false], [304, 0.043837, " in", false], [518, 0.029843, " at", false], [11, 0.029381, ",", false], [448, 0.027847, " with", false], [389, 0.02059, " on", false], [13444, 0.018304, " effectively", false], [323, 0.014927, " and", false]]]}, "raw_delta": 0.10932322343190505, "tuned_delta": 0.1178950154624833}, {"byte_start": 2438, "byte_end": 2441, "display": {"text": " at", "kind": "normal"}, "is_word": true, "word_id": 409, "word_key": " at", "bytes_hex": "20 61 74", "compression": {"rwkv": "31.37% 31.37% 31.37%", "qwen": "30.17% 30.17% 30.17%"}, "model_tokens": {"rwkv": [[4424, " at", "normal", 0.005401988048106432]], "qwen": [[518, " at", "normal", 0.006613673642277718]]}, "loss": {"rwkv": 31.371103102663653, "qwen": 30.16805292972565}, "topk": {"rwkv": [4424, 11, 0.005401988048106432, [[47, 0.573171, ".", false], [4811, 0.225641, " to", false], [21265, 0.052157, " and", false], [45, 0.032724, ",", false], [4596, 0.024689, " in", false], [275, 0.011357, " (", false], [32487, 0.011309, " with", false], [4450, 0.010695, " by", false], [4712, 0.008205, " on", false], [40085, 0.00728, " using", false]]], "qwen": [518, 12, 0.006613673642277718, [[13, 0.617983, ".", false], [382, 0.087803, ".\n\n", false], [311, 0.062098, " to", false], [11, 0.055043, ",", false], [3322, 0.032495, " enough", false], [323, 0.030829, " and", false], [304, 0.020317, " in", false], [553, 0.012897, " by", false], [320, 0.010857, " (", false], [448, 0.010341, " with", false]]]}, "raw_delta": 0.06671126683553052, "tuned_delta": 0.07528305886610877}, {"byte_start": 2441, "byte_end": 2447, "display": {"text": " scale", "kind": "normal"}, "is_word": true, "word_id": 410, "word_key": " scale", "bytes_hex": "20 73 63 61 6c 65", "compression": {"rwkv": "5.40% 5.40% 5.40% 5.40% 5.40% 5.40%", "qwen": "5.67% 5.67% 5.67% 5.67% 5.67% 5.67%"}, "model_tokens": {"rwkv": [[39590, " scale", "normal", 0.16841745376586914]], "qwen": [[5452, " scale", "normal", 0.151595801115036]]}, "loss": {"rwkv": 5.400713857494492, "qwen": 5.670204938641484}, "topk": {"rwkv": [39590, 3, 0.16841745376586914, [[332, 0.204759, " a", false], [22590, 0.170021, " the", false], [39590, 0.168417, " scale", false], [38864, 0.078099, " large", false], [52195, 0.053434, " massive", false], [4419, 0.029039, " an", false], [21256, 0.022619, " all", false], [31082, 0.016488, " high", false], [62606, 0.013832, " sufficient", false], [39855, 0.012291, " super", false]]], "qwen": [5452, 3, 0.151595801115036, [[279, 0.230702, " the", false], [264, 0.194575, " a", false], [5452, 0.151596, " scale", false], [678, 0.06696, " all", false], [458, 0.024789, " an", false], [3460, 0.013573, " large", false], [1602, 0.013524, " very", false], [1045, 0.01254, " some", false], [28405, 0.012332, " scales", false], [1550, 0.012189, " high", false]]]}, "raw_delta": -0.014943758646647098, "tuned_delta": -0.00637196661606885}, {"byte_start": 2447, "byte_end": 2448, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "2.99%", "qwen": "5.67%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.8458263278007507]], "qwen": [[13, ".", "normal", 0.7302824258804321]]}, "loss": {"rwkv": 2.9938739862197723, "qwen": 5.668420260341593}, "topk": {"rwkv": [47, 1, 0.8458263278007507, [[47, 0.845826, ".", false], [45, 0.033495, ",", false], [4811, 0.03331, " to", false], [21265, 0.0227, " and", false], [275, 0.013027, " (", false], [4450, 0.007837, " by", false], [4596, 0.007629, " in", false], [40085, 0.006791, " using", false], [32487, 0.006761, " with", false], [4712, 0.002454, " on", false]]], "qwen": [13, 1, 0.7302824258804321, [[13, 0.730282, ".", false], [382, 0.108808, ".\n\n", false], [11, 0.040343, ",", false], [311, 0.02045, " to", false], [323, 0.018308, " and", false], [320, 0.016744, " (", false], [304, 0.008748, " in", false], [448, 0.007164, " with", false], [624, 0.006981, ".\n", false], [553, 0.006571, " by", false]]]}, "raw_delta": -0.14830833673477173, "tuned_delta": -0.13973654470419347}, {"byte_start": 2448, "byte_end": 2453, "display": {"text": " Also", "kind": "normal"}, "is_word": true, "word_id": 411, "word_key": " also", "bytes_hex": "20 41 6c 73 6f", "compression": {"rwkv": "27.73% 27.73% 27.73% 27.73% 27.73%", "qwen": "28.49% 28.49% 28.49% 28.49% 28.49%"}, "model_tokens": {"rwkv": [[28402, " Also", "normal", 0.000463341100839898]], "qwen": [[7281, " Also", "normal", 0.0003707799769472331]]}, "loss": {"rwkv": 27.726795317084765, "qwen": 28.49287311726155}, "topk": {"rwkv": [28402, 125, 0.000463341100839898, [[261, 0.245212, "\n\n", false], [20996, 0.120486, " The", false], [3913, 0.042041, " In", false], [36251, 0.036602, " Again", false], [267, 0.035076, "  ", false], [29894, 0.032905, " This", false], [3918, 0.029586, " It", false], [300, 0.020538, " A", false], [37451, 0.017805, " There", false], [29511, 0.015977, " Once", false]]], "qwen": [7281, 176, 0.0003707799769472331, [[576, 0.178201, " The", false], [758, 0.057772, " In", false], [1096, 0.054582, " This", false], [220, 0.050601, " ", false], [1084, 0.038084, " It", false], [13759, 0.030587, " Again", false], [4220, 0.022767, " These", false], [362, 0.022738, " A", false], [320, 0.020443, " (", false], [2619, 0.020139, " There", false]]]}, "raw_delta": -0.04248037338256827, "tuned_delta": -0.03390858135199002}, {"byte_start": 2453, "byte_end": 2463, "display": {"text": " important", "kind": "normal"}, "is_word": true, "word_id": 412, "word_key": " important", "bytes_hex": "20 69 6d 70 6f 72 74 61 6e 74", "compression": {"rwkv": "15.22% 15.22% 15.22% 15.22% 15.22% 15.22% 15.22% 15.22% 15.22% 15.22%", "qwen": "11.92% 11.92% 11.92% 11.92% 11.92% 11.92% 11.92% 11.92% 11.92% 11.92%"}, "model_tokens": {"rwkv": [[59829, " important", "normal", 0.0002152388624381274]], "qwen": [[2989, " important", "normal", 0.0013470856938511133]]}, "loss": {"rwkv": 15.215924259375784, "qwen": 11.919928350385316}, "topk": {"rwkv": [59829, 111, 0.0002152388624381274, [[45, 0.390312, ",", false], [4596, 0.230308, " in", false], [31296, 0.080176, " like", false], [4423, 0.057574, " as", false], [4424, 0.031256, " at", false], [51419, 0.014735, " delayed", false], [32487, 0.011839, " with", false], [332, 0.010051, " a", false], [52906, 0.008664, " similar", false], [4712, 0.007033, " on", false]]], "qwen": [2989, 33, 0.0013470856938511133, [[11, 0.518282, ",", false], [304, 0.154027, " in", false], [4428, 0.038448, " similar", false], [1075, 0.03246, " like", false], [518, 0.026148, " at", false], [1490, 0.014715, " see", false], [79330, 0.012672, " delaying", false], [22706, 0.011817, " delayed", false], [438, 0.011266, " as", false], [279, 0.006489, " the", false]]]}, "raw_delta": 0.1827688217163086, "tuned_delta": 0.19134061374688685}, {"byte_start": 2463, "byte_end": 2467, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 413, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "7.22% 7.22% 7.22% 7.22%", "qwen": "5.04% 5.04% 5.04% 5.04%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.2006615549325943]], "qwen": [[572, " was", "normal", 0.32709893584251404]]}, "loss": {"rwkv": 7.220519613824157, "qwen": 5.038128029989677}, "topk": {"rwkv": [22748, 2, 0.2006615549325943, [[4596, 0.252713, " in", false], [22748, 0.200662, " was", false], [31077, 0.118265, " here", false], [45, 0.115576, ",", false], [32462, 0.089572, " were", false], [4811, 0.077186, " to", false], [4600, 0.05561, " is", false], [21700, 0.025312, " for", false], [21286, 0.014834, " are", false], [21400, 0.005999, " but", false]]], "qwen": [572, 1, 0.32709893584251404, [[572, 0.327099, " was", false], [304, 0.145178, " in", false], [374, 0.132326, " is", false], [1588, 0.093775, " here", false], [311, 0.089232, " to", false], [11, 0.0642, ",", false], [1033, 0.047665, " were", false], [369, 0.025981, " for", false], [25, 0.022407, ":", false], [525, 0.013844, " are", false]]]}, "raw_delta": 0.12101748585700989, "tuned_delta": 0.12958927788758814}, {"byte_start": 2467, "byte_end": 2471, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 414, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "1.36% 1.36% 1.36% 1.36%", "qwen": "2.14% 2.14% 2.14% 2.14%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.7405827045440674]], "qwen": [[279, " the", "normal", 0.622162401676178]]}, "loss": {"rwkv": 1.3648543172472491, "qwen": 2.1394903772153064}, "topk": {"rwkv": [22590, 1, 0.7405827045440674, [[22590, 0.740583, " the", false], [32227, 0.072345, " that", false], [332, 0.06375, " a", false], [4419, 0.013205, " an", false], [32499, 0.005354, " work", false], [56950, 0.004961, " progress", false], [57103, 0.004122, " research", false], [21835, 0.004078, " how", false], [38720, 0.003317, " human", false], [50919, 0.002861, " another", false]]], "qwen": [279, 1, 0.622162401676178, [[279, 0.622162, " the", false], [429, 0.178184, " that", false], [264, 0.082814, " a", false], [458, 0.020369, " an", false], [1246, 0.009444, " how", false], [3738, 0.003298, " human", false], [3412, 0.00252, " research", false], [5994, 0.00251, " Go", false], [537, 0.002483, " not", false], [5098, 0.002443, " progress", false]]]}, "raw_delta": -0.0429549440741539, "tuned_delta": -0.03438315204357565}, {"byte_start": 2471, "byte_end": 2475, "display": {"text": " use", "kind": "normal"}, "is_word": true, "word_id": 415, "word_key": " use", "bytes_hex": "20 75 73 65", "compression": {"rwkv": "18.32% 18.32% 18.32% 18.32%", "qwen": "21.57% 21.57% 21.57% 21.57%"}, "model_tokens": {"rwkv": [[22681, " use", "normal", 0.017374522984027863]], "qwen": [[990, " use", "normal", 0.008351313881576061]]}, "loss": {"rwkv": 18.315464386285665, "qwen": 21.57431634225604}, "topk": {"rwkv": [22681, 5, 0.017374522984027863, [[30808, 0.096526, " fact", false], [63469, 0.037724, " development", false], [59544, 0.033335, " discovery", false], [63820, 0.027142, " realization", false], [22681, 0.017375, " use", false], [63729, 0.01587, " observation", false], [31894, 0.014609, " role", false], [59612, 0.013572, " emergence", false], [63821, 0.01307, " recognition", false], [52013, 0.011464, " initial", false]]], "qwen": [990, 13, 0.008351313881576061, [[2097, 0.131559, " fact", false], [48703, 0.073433, " realization", false], [4401, 0.028247, " development", false], [18335, 0.026365, " discovery", false], [7901, 0.019405, " failure", false], [7626, 0.018758, " delay", false], [17843, 0.017594, " recognition", false], [6853, 0.017374, " lack", false], [48079, 0.0142, " emergence", false], [21930, 0.011831, " observation", false]]]}, "raw_delta": -0.1807091236114502, "tuned_delta": -0.17213733158087194}, {"byte_start": 2475, "byte_end": 2478, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 416, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.21% 0.21% 0.21%", "qwen": "0.25% 0.25% 0.25%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9654042720794678]], "qwen": [[315, " of", "normal", 0.9587425589561462]]}, "loss": {"rwkv": 0.21133228138021923, "qwen": 0.25326935505014186}, "topk": {"rwkv": [4706, 1, 0.9654042720794678, [[4706, 0.965404, " of", false], [45, 0.012247, ",", false], [4450, 0.008096, " by", false], [4596, 0.005176, " in", false], [275, 0.001271, " (", false], [4424, 0.000813, " at", false], [21265, 0.000751, " and", false], [31601, 0.000534, " over", false], [21700, 0.000303, " for", false], [32227, 0.000271, " that", false]]], "qwen": [315, 1, 0.9587425589561462, [[315, 0.958743, " of", false], [553, 0.015525, " by", false], [304, 0.007103, " in", false], [11, 0.006722, ",", false], [323, 0.001733, " and", false], [429, 0.001189, " that", false], [320, 0.001157, " (", false], [1865, 0.001034, " made", false], [311, 0.000661, " to", false], [518, 0.000401, " at", false]]]}, "raw_delta": -0.0023254851500193272, "tuned_delta": 0.006246306880558921}, {"byte_start": 2478, "byte_end": 2487, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 417, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "12.34% 12.34% 12.34% 12.34% 12.34% 12.34% 12.34% 12.34% 12.34%", "qwen": "12.02% 12.02% 12.02% 12.02% 12.02% 12.02% 12.02% 12.02% 12.02%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.002125680912286043]], "qwen": [[6832, " learning", "normal", 0.0024785639252513647]]}, "loss": {"rwkv": 12.335543535378722, "qwen": 12.022611547542127}, "topk": {"rwkv": [56537, 62, 0.002125680912286043, [[38720, 0.059488, " human", false], [332, 0.054038, " a", false], [22590, 0.043098, " the", false], [46658, 0.037007, " neural", false], [52195, 0.032594, " massive", false], [30597, 0.028056, " deep", false], [59988, 0.024844, " massively", false], [56812, 0.020321, " parallel", false], [52167, 0.018009, " machine", false], [63875, 0.017711, " specialized", false]]], "qwen": [6832, 63, 0.0024785639252513647, [[264, 0.079057, " a", false], [3738, 0.068136, " human", false], [279, 0.0513, " the", false], [5538, 0.047295, " deep", false], [29728, 0.02188, " neural", false], [11773, 0.018944, " hardware", false], [45767, 0.017372, " Monte", false], [9902, 0.01727, " ``", false], [71278, 0.014542, " reinforcement", false], [1602, 0.013646, " very", false]]]}, "raw_delta": 0.01735263400607645, "tuned_delta": 0.0259244260366547}, {"byte_start": 2487, "byte_end": 2490, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 418, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "21.13% 21.13% 21.13%", "qwen": "23.24% 23.24% 23.24%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.02975294552743435]], "qwen": [[553, " by", "normal", 0.02092740871012211]]}, "loss": {"rwkv": 21.133228138021924, "qwen": 23.243592850229273}, "topk": {"rwkv": [4450, 8, 0.02975294552743435, [[52224, 0.167015, " methods", false], [4811, 0.161166, " to", false], [61559, 0.123459, " algorithms", false], [45, 0.107821, ",", false], [30917, 0.101079, " from", false], [46, 0.034105, "-", false], [62633, 0.033417, " techniques", false], [4450, 0.029753, " by", false], [21265, 0.021394, " and", false], [275, 0.019614, " (", false]]], "qwen": [553, 11, 0.02092740871012211, [[311, 0.189302, " to", false], [5413, 0.157174, " methods", false], [11, 0.103816, ",", false], [5980, 0.077431, "-based", false], [25185, 0.067118, " algorithms", false], [12538, 0.049246, " techniques", false], [504, 0.0439, " from", false], [13, 0.031723, ".", false], [304, 0.028716, " in", false], [323, 0.027407, " and", false]]]}, "raw_delta": -0.11702346801757812, "tuned_delta": -0.10845167598699988}, {"byte_start": 2490, "byte_end": 2495, "display": {"text": " self", "kind": "normal"}, "is_word": true, "word_id": 419, "word_key": " self", "bytes_hex": "20 73 65 6c 66", "compression": {"rwkv": "16.57% 16.57% 16.57% 16.57% 16.57%", "qwen": "13.08% 13.08% 13.08% 13.08% 13.08%"}, "model_tokens": {"rwkv": [[31978, " self", "normal", 0.010073735378682613]], "qwen": [[656, " self", "normal", 0.026586027815937996]]}, "loss": {"rwkv": 16.568450860209186, "qwen": 13.082969625977602}, "topk": {"rwkv": [31978, 17, 0.010073735378682613, [[65003, 0.1349, " reinforcement", false], [59815, 0.102238, " imitation", false], [51668, 0.063129, " example", false], [30597, 0.061445, " deep", false], [46658, 0.042966, " neural", false], [38720, 0.032869, " human", false], [30218, 0.027649, " back", false], [22590, 0.02644, " the", false], [52491, 0.024558, " playing", false], [62557, 0.022996, " simulation", false]]], "qwen": [656, 7, 0.026586027815937996, [[5619, 0.168756, " playing", false], [3738, 0.110576, " human", false], [12677, 0.065122, " humans", false], [71278, 0.053049, " reinforcement", false], [3110, 0.036931, " example", false], [9091, 0.028179, " trial", false], [656, 0.026586, " self", false], [86840, 0.024489, " imitation", false], [1486, 0.023211, " play", false], [55103, 0.018182, " analogy", false]]]}, "raw_delta": 0.1932761192321777, "tuned_delta": 0.20184791126275595}, {"byte_start": 2495, "byte_end": 2500, "display": {"text": " play", "kind": "normal"}, "is_word": true, "word_id": 420, "word_key": " play", "bytes_hex": "20 70 6c 61 79", "compression": {"rwkv": "12.17% 12.17% 12.17% 12.17% 12.17%", "qwen": "15.15% 15.15% 15.15% 15.15% 15.15%"}, "model_tokens": {"rwkv": [[31702, " play", "normal", 0.03406842425465584]], "qwen": [[1486, " play", "normal", 0.014976556412875652]]}, "loss": {"rwkv": 12.172739407500629, "qwen": 15.15287541956948}, "topk": {"rwkv": [31702, 2, 0.03406842425465584, [[46, 0.945554, "-", false], [31702, 0.034068, " play", false], [26697, 0.008956, "play", false], [57453, 0.001425, " training", false], [63621, 0.000766, " improvement", false], [52491, 0.000756, " playing", false], [45, 0.000704, ",", false], [21265, 0.000694, " and", false], [4715, 0.000517, " or", false], [275, 0.000372, " (", false]]], "qwen": [1486, 3, 0.014976556412875652, [[26544, 0.943901, "-play", false], [1363, 0.017777, "play", false], [1486, 0.014977, " play", false], [12, 0.005114, "-", false], [72085, 0.003058, "-playing", false], [2371, 0.001586, "-g", false], [48793, 0.001382, "-te", false], [85370, 0.001343, "-training", false], [1331, 0.001274, "-s", false], [41912, 0.001197, "playing", false]]]}, "raw_delta": -0.16525382995605464, "tuned_delta": -0.1566820379254764}, {"byte_start": 2500, "byte_end": 2503, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 421, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "12.02% 12.02% 12.02%", "qwen": "12.75% 12.75% 12.75%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.13792358338832855]], "qwen": [[311, " to", "normal", 0.11986345052719116]]}, "loss": {"rwkv": 12.022458674074693, "qwen": 12.752235522858365}, "topk": {"rwkv": [4811, 2, 0.13792358338832855, [[45, 0.417633, ",", false], [4811, 0.137924, " to", false], [47, 0.114948, ".", false], [275, 0.042461, " (", false], [21265, 0.027035, " and", false], [4596, 0.026374, " in", false], [59, 0.02125, ":", false], [4706, 0.019343, " of", false], [32487, 0.01735, " with", false], [4712, 0.015412, " on", false]]], "qwen": [311, 3, 0.11986345052719116, [[11, 0.426174, ",", false], [13, 0.142018, ".", false], [311, 0.119863, " to", false], [304, 0.036712, " in", false], [320, 0.03566, " (", false], [382, 0.021482, ".\n\n", false], [323, 0.020301, " and", false], [4751, 0.017265, " rather", false], [25, 0.015469, ":", false], [429, 0.015155, " that", false]]]}, "raw_delta": -0.04046742121378588, "tuned_delta": -0.03189562918320763}, {"byte_start": 2503, "byte_end": 2509, "display": {"text": " learn", "kind": "normal"}, "is_word": true, "word_id": 422, "word_key": " learn", "bytes_hex": "20 6c 65 61 72 6e", "compression": {"rwkv": "11.04% 11.04% 11.04% 11.04% 11.04% 11.04%", "qwen": "11.45% 11.45% 11.45% 11.45% 11.45% 11.45%"}, "model_tokens": {"rwkv": [[38877, " learn", "normal", 0.025368090718984604]], "qwen": [[3960, " learn", "normal", 0.02213427983224392]]}, "loss": {"rwkv": 11.036241360967004, "qwen": 11.453278508072337}, "topk": {"rwkv": [38877, 4, 0.025368090718984604, [[51982, 0.162285, " improve", false], [30858, 0.030204, " find", false], [56010, 0.026963, " discover", false], [38877, 0.025368, " learn", false], [51456, 0.024142, " develop", false], [40000, 0.02404, " train", false], [37786, 0.019827, " avoid", false], [52640, 0.017333, " rapidly", false], [61516, 0.01656, " accelerate", false], [59771, 0.016493, " gradually", false]]], "qwen": [3960, 9, 0.02213427983224392, [[7269, 0.099804, " improve", false], [1477, 0.056095, " find", false], [6923, 0.047802, " generate", false], [6997, 0.040892, " discover", false], [5426, 0.039814, " train", false], [2225, 0.038448, " develop", false], [8193, 0.032726, " produce", false], [1855, 0.023893, " create", false], [3960, 0.022134, " learn", false], [13186, 0.020129, " explore", false]]]}, "raw_delta": -0.02312544981638598, "tuned_delta": -0.01455365778580773}, {"byte_start": 2509, "byte_end": 2511, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 423, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "22.26% 22.26%", "qwen": "24.36% 24.36%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.08501612395048141]], "qwen": [[264, " a", "normal", 0.06712794303894043]]}, "loss": {"rwkv": 22.260333638716425, "qwen": 24.355892794467625}, "topk": {"rwkv": [332, 4, 0.08501612395048141, [[22590, 0.130279, " the", false], [30917, 0.099003, " from", false], [4811, 0.095094, " to", false], [332, 0.085016, " a", false], [21835, 0.05709, " how", false], [37598, 0.026214, " about", false], [32464, 0.024185, " what", false], [47202, 0.023609, " search", false], [22168, 0.019606, " new", false], [4419, 0.016802, " an", false]]], "qwen": [264, 3, 0.06712794303894043, [[279, 0.236323, " the", false], [1246, 0.075652, " how", false], [264, 0.067128, " a", false], [504, 0.066064, " from", false], [311, 0.053305, " to", false], [3738, 0.026512, " human", false], [14830, 0.02373, " strategies", false], [1128, 0.020004, " what", false], [2664, 0.019458, " better", false], [1809, 0.017289, " game", false]]]}, "raw_delta": -0.1162024736404419, "tuned_delta": -0.10763068160986365}, {"byte_start": 2511, "byte_end": 2517, "display": {"text": " value", "kind": "normal"}, "is_word": true, "word_id": 424, "word_key": " value", "bytes_hex": "20 76 61 6c 75 65", "compression": {"rwkv": "17.09% 17.09% 17.09% 17.09% 17.09% 17.09%", "qwen": "17.96% 17.96% 17.96% 17.96% 17.96% 17.96%"}, "model_tokens": {"rwkv": [[40093, " value", "normal", 0.003398081986233592]], "qwen": [[897, " value", "normal", 0.0025432310067117214]]}, "loss": {"rwkv": 17.094433427199956, "qwen": 17.95650363059357}, "topk": {"rwkv": [40093, 40, 0.003398081986233592, [[51832, 0.077462, " general", false], [47202, 0.067976, " search", false], [30992, 0.062359, " good", false], [46857, 0.049598, " policy", false], [57317, 0.045921, " strategy", false], [39043, 0.037693, " model", false], [65161, 0.032359, " representation", false], [32386, 0.028991, " very", false], [45301, 0.028377, " better", false], [3851, 0.028315, " Go", false]]], "qwen": [897, 50, 0.0025432310067117214, [[8282, 0.080409, " strategy", false], [1661, 0.051989, " good", false], [1809, 0.05055, " game", false], [4842, 0.049585, " policy", false], [10987, 0.045937, " winning", false], [3738, 0.035362, " human", false], [1602, 0.032474, " very", false], [2664, 0.032441, " better", false], [9902, 0.030276, " ``", false], [501, 0.028941, " new", false]]]}, "raw_delta": -0.04780332247416186, "tuned_delta": -0.03923153044358361}, {"byte_start": 2517, "byte_end": 2526, "display": {"text": " function", "kind": "normal"}, "is_word": true, "word_id": 425, "word_key": " function", "bytes_hex": "20 66 75 6e 63 74 69 6f 6e", "compression": {"rwkv": "0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85%", "qwen": "0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65%"}, "model_tokens": {"rwkv": [[56292, " function", "normal", 0.6556443572044373]], "qwen": [[729, " function", "normal", 0.7247667908668518]]}, "loss": {"rwkv": 0.8453291255208769, "qwen": 0.6450156173193224}, "topk": {"rwkv": [56292, 1, 0.6556443572044373, [[56292, 0.655644, " function", false], [21700, 0.087647, " for", false], [56149, 0.061979, " estimate", false], [46, 0.036318, "-", false], [4706, 0.024888, " of", false], [39043, 0.01316, " model", false], [65161, 0.009733, " representation", false], [61955, 0.007907, " estimation", false], [59792, 0.00619, " heuristic", false], [47487, 0.00616, " system", false]]], "qwen": [729, 1, 0.7247667908668518, [[729, 0.724767, " function", false], [3922, 0.118357, " network", false], [5980, 0.032652, "-based", false], [33749, 0.022315, "-function", false], [16045, 0.013704, " estimate", false], [369, 0.00758, " for", false], [4179, 0.007473, " net", false], [315, 0.00721, " of", false], [16460, 0.006187, " evaluation", false], [13042, 0.004347, " representation", false]]]}, "raw_delta": 0.01110773947503832, "tuned_delta": 0.01967953150561657}, {"byte_start": 2526, "byte_end": 2528, "display": {"text": " (", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "20 28", "compression": {"rwkv": "34.94% 34.94%", "qwen": "27.56% 27.56%"}, "model_tokens": {"rwkv": [[275, " (", "normal", 0.02069687843322754]], "qwen": [[320, " (", "normal", 0.0470462329685688]]}, "loss": {"rwkv": 34.94027052152958, "qwen": 27.561105511417026}, "topk": {"rwkv": [275, 9, 0.02069687843322754, [[21700, 0.195586, " for", false], [32227, 0.177936, " that", false], [45, 0.157856, ",", false], [47, 0.07278, ".", false], [30917, 0.052868, " from", false], [4811, 0.046829, " to", false], [21265, 0.045101, " and", false], [4706, 0.042649, " of", false], [275, 0.020697, " (", false], [55536, 0.020321, " approxim", false]]], "qwen": [320, 6, 0.0470462329685688, [[11, 0.200767, ",", false], [429, 0.133146, " that", false], [369, 0.1235, " for", false], [13, 0.109011, ".", false], [323, 0.062236, " and", false], [320, 0.047046, " (", false], [311, 0.043689, " to", false], [504, 0.035917, " from", false], [3118, 0.021552, " based", false], [304, 0.018403, " in", false]]]}, "raw_delta": 0.40918779373168945, "tuned_delta": 0.4177595857622677}, {"byte_start": 2528, "byte_end": 2530, "display": {"text": "as", "kind": "normal"}, "is_word": true, "word_id": 426, "word_key": "as", "bytes_hex": "61 73", "compression": {"rwkv": "31.28% 31.28%", "qwen": "29.55% 29.55%"}, "model_tokens": {"rwkv": [[1751, "as", "normal", 0.03128112480044365]], "qwen": [[300, "as", "normal", 0.03771577402949333]]}, "loss": {"rwkv": 31.277177644272445, "qwen": 29.55430059337468}, "topk": {"rwkv": [1751, 7, 0.03128112480044365, [[2101, 0.080326, "or", false], [36003, 0.080096, "which", false], [98, 0.069288, "a", false], [8801, 0.05731, "the", false], [7005, 0.040737, "and", false], [7579, 0.03159, "for", false], [1751, 0.031281, "as", false], [2215, 0.023428, "to", false], [1746, 0.022925, "an", false], [1950, 0.021773, "in", false]]], "qwen": [300, 6, 0.03771577402949333, [[1782, 0.097205, "the", false], [8206, 0.075568, "which", false], [64, 0.075485, "a", false], [437, 0.049882, "and", false], [269, 0.042432, "or", false], [300, 0.037716, "as", false], [4060, 0.029328, "see", false], [258, 0.028759, "in", false], [276, 0.027044, "an", false], [9033, 0.024652, "that", false]]]}, "raw_delta": 0.09553658962249756, "tuned_delta": 0.1041083816530758}, {"byte_start": 2530, "byte_end": 2533, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 427, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "29.87% 29.87% 29.87%", "qwen": "35.37% 35.37% 35.37%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.006845293566584587]], "qwen": [[432, " it", "normal", 0.0027835743967443705]]}, "loss": {"rwkv": 29.868295768404316, "qwen": 35.37018988577891}, "topk": {"rwkv": [4601, 18, 0.006845293566584587, [[4596, 0.248739, " in", false], [52369, 0.244738, " opposed", false], [332, 0.049698, " a", false], [32458, 0.047174, " well", false], [22748, 0.033749, " was", false], [4419, 0.01949, " an", false], [32487, 0.019064, " with", false], [22590, 0.016928, " the", false], [4600, 0.016442, " is", false], [32354, 0.012238, " used", false]]], "qwen": [432, 23, 0.0027835743967443705, [[16087, 0.457368, " opposed", false], [304, 0.130405, " in", false], [1632, 0.102626, " well", false], [264, 0.022272, " a", false], [7481, 0.02131, " described", false], [14078, 0.018769, " discussed", false], [12460, 0.018734, " distinct", false], [572, 0.013752, " was", false], [279, 0.009101, " the", false], [1483, 0.00864, " used", false]]]}, "raw_delta": -0.30508979161580396, "tuned_delta": -0.29651799958522573}, {"byte_start": 2533, "byte_end": 2537, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 428, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "7.33% 7.33% 7.33% 7.33%", "qwen": "8.25% 8.25% 8.25% 8.25%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.198941171169281]], "qwen": [[572, " was", "normal", 0.16035059094429016]]}, "loss": {"rwkv": 7.326185754514267, "qwen": 8.252182267530776}, "topk": {"rwkv": [22748, 2, 0.198941171169281, [[47638, 0.242441, " turned", false], [22748, 0.198941, " was", false], [4600, 0.161035, " is", false], [32462, 0.105217, " were", false], [40040, 0.091945, " turns", false], [51896, 0.026667, " happens", false], [56348, 0.020272, " happened", false], [40219, 0.01411, " would", false], [21795, 0.011829, " had", false], [21800, 0.011143, " has", false]]], "qwen": [572, 2, 0.16035059094429016, [[374, 0.257658, " is", false], [572, 0.160351, " was", false], [10577, 0.100438, " turns", false], [6519, 0.080026, " turned", false], [1521, 0.034738, " did", false], [1035, 0.034517, " would", false], [1030, 0.034259, " had", false], [6116, 0.028161, " became", false], [1558, 0.026933, " does", false], [702, 0.023676, " has", false]]]}, "raw_delta": -0.05134814977645874, "tuned_delta": -0.04277635774588049}, {"byte_start": 2537, "byte_end": 2540, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 429, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "27.05% 27.05% 27.05%", "qwen": "21.74% 21.74% 21.74%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.01114705577492714]], "qwen": [[304, " in", "normal", 0.026875125244259834]]}, "loss": {"rwkv": 27.05053201666806, "qwen": 21.73993706822568}, "topk": {"rwkv": [4596, 13, 0.01114705577492714, [[45395, 0.333862, " called", false], [32230, 0.079106, " then", false], [38848, 0.051663, " known", false], [62275, 0.029972, " originally", false], [38869, 0.022371, " later", false], [59868, 0.019801, " initially", false], [22187, 0.018243, " not", false], [38499, 0.016669, " first", false], [62684, 0.01598, " understood", false], [45, 0.012787, ",", false]]], "qwen": [304, 6, 0.026875125244259834, [[2598, 0.379656, " called", false], [2814, 0.082709, " done", false], [1221, 0.063428, " then", false], [3881, 0.049845, " known", false], [2937, 0.031391, " later", false], [304, 0.026875, " in", false], [537, 0.017914, " not", false], [60837, 0.016524, " termed", false], [9251, 0.013353, " applied", false], [1083, 0.01199, " also", false]]]}, "raw_delta": 0.294481913248698, "tuned_delta": 0.3030537052792762}, {"byte_start": 2540, "byte_end": 2545, "display": {"text": " many", "kind": "normal"}, "is_word": true, "word_id": 430, "word_key": " many", "bytes_hex": "20 6d 61 6e 79", "compression": {"rwkv": "16.12% 16.12% 16.12% 16.12% 16.12%", "qwen": "16.15% 16.15% 16.15% 16.15% 16.15%"}, "model_tokens": {"rwkv": [[31370, " many", "normal", 0.011500372551381588]], "qwen": [[1657, " many", "normal", 0.011345302686095238]]}, "loss": {"rwkv": 16.11760865993139, "qwen": 16.154402628256975}, "topk": {"rwkv": [31370, 13, 0.011500372551381588, [[38013, 0.26649, " chess", false], [22590, 0.139523, " the", false], [3851, 0.113686, " Go", false], [30322, 0.042923, " both", false], [55809, 0.033523, " computer", false], [36274, 0.031875, " Alpha", false], [3492, 0.02359, " 19", false], [47202, 0.021193, " search", false], [38720, 0.01729, " human", false], [36466, 0.015516, " Chess", false]]], "qwen": [1657, 11, 0.011345302686095238, [[279, 0.303091, " the", false], [32719, 0.109606, " chess", false], [24708, 0.061578, " Alpha", false], [6366, 0.041331, " computer", false], [5994, 0.040199, " Go", false], [18183, 0.035052, " Deep", false], [264, 0.019417, " a", false], [1182, 0.017414, " back", false], [220, 0.01583, " ", false], [1008, 0.012868, " other", false]]]}, "raw_delta": -0.0020402908325194424, "tuned_delta": 0.006531501198058806}, {"byte_start": 2545, "byte_end": 2551, "display": {"text": " other", "kind": "normal"}, "is_word": true, "word_id": 431, "word_key": " other", "bytes_hex": "20 6f 74 68 65 72", "compression": {"rwkv": "2.91% 2.91% 2.91% 2.91% 2.91% 2.91%", "qwen": "4.74% 4.74% 4.74% 4.74% 4.74% 4.74%"}, "model_tokens": {"rwkv": [[39193, " other", "normal", 0.3769276738166809]], "qwen": [[1008, " other", "normal", 0.20644254982471466]]}, "loss": {"rwkv": 2.911689210127465, "qwen": 4.742057925894811}, "topk": {"rwkv": [39193, 1, 0.3769276738166809, [[39193, 0.376928, " other", false], [51551, 0.09823, " earlier", false], [4706, 0.06621, " of", false], [51515, 0.040781, " domains", false], [38576, 0.033758, " games", false], [38328, 0.032301, " early", false], [56926, 0.025966, " previous", false], [3609, 0.024194, " AI", false], [55809, 0.022975, " computer", false], [37970, 0.020843, " cases", false]]], "qwen": [1008, 1, 0.20644254982471466, [[1008, 0.206443, " other", false], [315, 0.192479, " of", false], [6366, 0.066459, " computer", false], [32719, 0.054559, " chess", false], [5048, 0.036724, " cases", false], [3868, 0.02637, " games", false], [4124, 0.02322, " early", false], [6788, 0.016202, " earlier", false], [5510, 0.014827, " ways", false], [3738, 0.011991, " human", false]]]}, "raw_delta": -0.10149719317754112, "tuned_delta": -0.09292540114696288}, {"byte_start": 2551, "byte_end": 2557, "display": {"text": " games", "kind": "normal"}, "is_word": true, "word_id": 432, "word_key": " games", "bytes_hex": "20 67 61 6d 65 73", "compression": {"rwkv": "6.53% 6.53% 6.53% 6.53% 6.53% 6.53%", "qwen": "5.62% 5.62% 5.62% 5.62% 5.62% 5.62%"}, "model_tokens": {"rwkv": [[38576, " games", "normal", 0.1139829158782959]], "qwen": [[3868, " games", "normal", 0.15397393703460693]]}, "loss": {"rwkv": 6.527819358188994, "qwen": 5.62342064144615}, "topk": {"rwkv": [38576, 2, 0.1139829158782959, [[51515, 0.433342, " domains", false], [38576, 0.113983, " games", false], [3609, 0.095083, " AI", false], [37738, 0.075944, " areas", false], [37970, 0.035832, " cases", false], [45976, 0.031162, " fields", false], [56939, 0.018183, " problems", false], [64251, 0.015185, " applications", false], [55809, 0.012712, " computer", false], [30941, 0.012314, " game", false]]], "qwen": [3868, 2, 0.15397393703460693, [[30476, 0.331291, " domains", false], [3868, 0.153974, " games", false], [5671, 0.08402, " areas", false], [8357, 0.054478, " applications", false], [15235, 0.034859, " AI", false], [5322, 0.029711, " problems", false], [37597, 0.027073, " contexts", false], [5048, 0.021655, " cases", false], [1809, 0.017305, " game", false], [5043, 0.016215, " fields", false]]]}, "raw_delta": 0.050150513648986816, "tuned_delta": 0.058722305679565066}, {"byte_start": 2557, "byte_end": 2561, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 433, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "20.57% 20.57% 20.57% 20.57%", "qwen": "16.39% 16.39% 16.39% 16.39%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.01029981765896082]], "qwen": [[323, " and", "normal", 0.02634415403008461]]}, "loss": {"rwkv": 20.56967538767467, "qwen": 16.394916925835595}, "topk": {"rwkv": [21265, 7, 0.01029981765896082, [[42, 0.300396, ")", false], [497, 0.201442, "),", false], [499, 0.168273, ").", false], [45, 0.125889, ",", false], [4423, 0.046018, " as", false], [4424, 0.019084, " at", false], [21265, 0.0103, " and", false], [45285, 0.009439, " before", false], [22614, 0.008871, " too", false], [32139, 0.008363, " such", false]]], "qwen": [323, 5, 0.02634415403008461, [[8, 0.282654, ")", false], [568, 0.194803, ").", false], [701, 0.179022, "),", false], [11, 0.100799, ",", false], [323, 0.026344, " and", false], [438, 0.024904, " as", false], [3593, 0.021138, ").\n\n", false], [518, 0.017665, " at", false], [1573, 0.015239, " before", false], [315, 0.011811, " of", false]]]}, "raw_delta": 0.23149776458740234, "tuned_delta": 0.2400695566179806}, {"byte_start": 2561, "byte_end": 2566, "display": {"text": " even", "kind": "normal"}, "is_word": true, "word_id": 434, "word_key": " even", "bytes_hex": "20 65 76 65 6e", "compression": {"rwkv": "18.71% 18.71% 18.71% 18.71% 18.71%", "qwen": "16.42% 16.42% 16.42% 16.42% 16.42%"}, "model_tokens": {"rwkv": [[30788, " even", "normal", 0.005658430512994528]], "qwen": [[1496, " even", "normal", 0.010534564033150673]]}, "loss": {"rwkv": 18.709951311528744, "qwen": 16.42181501243054}, "topk": {"rwkv": [30788, 23, 0.005658430512994528, [[51515, 0.383366, " domains", false], [4596, 0.12598, " in", false], [3609, 0.032943, " AI", false], [64251, 0.031425, " applications", false], [4423, 0.027926, " as", false], [39193, 0.026296, " other", false], [4811, 0.020793, " to", false], [56939, 0.017074, " problems", false], [31370, 0.012536, " many", false], [39898, 0.010971, " tasks", false]]], "qwen": [1496, 16, 0.010534564033150673, [[30476, 0.274515, " domains", false], [8357, 0.089942, " applications", false], [304, 0.088429, " in", false], [1008, 0.036862, " other", false], [5322, 0.032097, " problems", false], [374, 0.028859, " is", false], [9079, 0.026332, " tasks", false], [21737, 0.025758, " environments", false], [537, 0.017821, " not", false], [11, 0.014259, ",", false]]]}, "raw_delta": 0.12688121795654306, "tuned_delta": 0.13545300998712131}, {"byte_start": 2566, "byte_end": 2569, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 435, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "4.27% 4.27% 4.27%", "qwen": "4.87% 4.87% 4.87%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.48613446950912476]], "qwen": [[304, " in", "normal", 0.44450274109840393]]}, "loss": {"rwkv": 4.273608356799989, "qwen": 4.873898751154672}, "topk": {"rwkv": [4596, 1, 0.48613446950912476, [[4596, 0.486134, " in", false], [38013, 0.111113, " chess", false], [32074, 0.030967, " some", false], [31458, 0.024572, " more", false], [22184, 0.021033, " non", false], [4423, 0.013628, " as", false], [4811, 0.013192, " to", false], [31370, 0.013172, " many", false], [3851, 0.011135, " Go", false], [55809, 0.010021, " computer", false]]], "qwen": [304, 1, 0.44450274109840393, [[304, 0.444503, " in", false], [1045, 0.042425, " some", false], [32719, 0.033628, " chess", false], [1008, 0.0305, " other", false], [279, 0.02201, " the", false], [7797, 0.019831, " beyond", false], [2272, 0.019661, " life", false], [1657, 0.018959, " many", false], [803, 0.018664, " more", false], [11, 0.012248, ",", false]]]}, "raw_delta": -0.03328716754913333, "tuned_delta": -0.02471537551855508}, {"byte_start": 2569, "byte_end": 2575, "display": {"text": " chess", "kind": "normal"}, "is_word": true, "word_id": 436, "word_key": " chess", "bytes_hex": "20 63 68 65 73 73", "compression": {"rwkv": "3.78% 3.78% 3.78% 3.78% 3.78% 3.78%", "qwen": "4.06% 4.06% 4.06% 4.06% 4.06% 4.06%"}, "model_tokens": {"rwkv": [[38013, " chess", "normal", 0.2851180136203766]], "qwen": [[32719, " chess", "normal", 0.25881946086883545]]}, "loss": {"rwkv": 3.780499700246144, "qwen": 4.062462389958204}, "topk": {"rwkv": [38013, 1, 0.2851180136203766, [[38013, 0.285118, " chess", false], [22590, 0.076218, " the", false], [3851, 0.068435, " Go", false], [55809, 0.050382, " computer", false], [32074, 0.037516, " some", false], [31370, 0.030969, " many", false], [39311, 0.024418, " poker", false], [36274, 0.016639, " Alpha", false], [47202, 0.015812, " search", false], [38720, 0.015549, " human", false]]], "qwen": [32719, 1, 0.25881946086883545, [[32719, 0.258819, " chess", false], [279, 0.13382, " the", false], [1045, 0.055217, " some", false], [1008, 0.039027, " other", false], [1931, 0.031313, " real", false], [3738, 0.031129, " human", false], [6366, 0.029792, " computer", false], [1657, 0.025833, " many", false], [5810, 0.024103, " natural", false], [5994, 0.0238, " Go", false]]]}, "raw_delta": -0.015635331471761077, "tuned_delta": -0.007063539441182829}, {"byte_start": 2575, "byte_end": 2576, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "43.11%", "qwen": "48.06%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.0931757241487503]], "qwen": [[11, ",", "normal", 0.06960668414831161]]}, "loss": {"rwkv": 43.111785401564724, "qwen": 48.05787745339095}, "topk": {"rwkv": [45, 4, 0.0931757241487503, [[499, 0.282001, ").", false], [42, 0.259751, ")", false], [497, 0.189755, "),", false], [45, 0.093176, ",", false], [45285, 0.052042, " before", false], [4596, 0.012291, " in", false], [4424, 0.011912, " at", false], [39356, 0.009601, " prior", false], [502, 0.005652, ");", false], [37634, 0.004393, " after", false]]], "qwen": [11, 4, 0.06960668414831161, [[8, 0.311405, ")", false], [568, 0.216466, ").", false], [701, 0.159245, "),", false], [11, 0.069607, ",", false], [323, 0.032871, " and", false], [3593, 0.028469, ").\n\n", false], [304, 0.021751, " in", false], [518, 0.018202, " at", false], [1573, 0.014773, " before", false], [1215, 0.011096, ");", false]]]}, "raw_delta": -0.27426958084106445, "tuned_delta": -0.2656977888104862}, {"byte_start": 2576, "byte_end": 2585, "display": {"text": " although", "kind": "normal"}, "is_word": true, "word_id": 437, "word_key": " although", "bytes_hex": "20 61 6c 74 68 6f 75 67 68", "compression": {"rwkv": "7.04% 7.04% 7.04% 7.04% 7.04% 7.04% 7.04% 7.04% 7.04%", "qwen": "6.11% 6.11% 6.11% 6.11% 6.11% 6.11% 6.11% 6.11% 6.11%"}, "model_tokens": {"rwkv": [[55495, " although", "normal", 0.029813870787620544]], "qwen": [[7892, " although", "normal", 0.04747393727302551]]}, "loss": {"rwkv": 7.044409379340641, "qwen": 6.106556454033087}, "topk": {"rwkv": [55495, 6, 0.029813870787620544, [[21400, 0.200355, " but", false], [40185, 0.103638, " where", false], [47544, 0.065321, " though", false], [45285, 0.055038, " before", false], [4423, 0.036981, " as", false], [55495, 0.029814, " although", false], [21265, 0.029054, " and", false], [22590, 0.025076, " the", false], [21700, 0.024961, " for", false], [40186, 0.022637, " which", false]]], "qwen": [7892, 4, 0.04747393727302551, [[714, 0.253728, " but", false], [1380, 0.079006, " where", false], [3498, 0.063448, " though", false], [7892, 0.047474, " although", false], [1490, 0.044499, " see", false], [438, 0.039695, " as", false], [323, 0.024683, " and", false], [892, 0.022883, " which", false], [304, 0.021609, " in", false], [1573, 0.019246, " before", false]]]}, "raw_delta": 0.052005608876546205, "tuned_delta": 0.060577400907124455}, {"byte_start": 2585, "byte_end": 2594, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 438, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "10.46% 10.46% 10.46% 10.46% 10.46% 10.46% 10.46% 10.46% 10.46%", "qwen": "10.41% 10.41% 10.41% 10.41% 10.41% 10.41% 10.41% 10.41% 10.41%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.005482254084199667]], "qwen": [[6832, " learning", "normal", 0.005532432813197374]]}, "loss": {"rwkv": 10.457034367554552, "qwen": 10.413708115965523}, "topk": {"rwkv": [56537, 20, 0.005482254084199667, [[22590, 0.14525, " the", false], [4596, 0.112733, " in", false], [32227, 0.111733, " that", false], [4601, 0.072475, " it", false], [39934, 0.07201, " there", false], [22187, 0.052881, " not", false], [32234, 0.049834, " this", false], [38013, 0.041112, " chess", false], [47202, 0.016682, " search", false], [31277, 0.015004, " less", false]]], "qwen": [6832, 25, 0.005532432813197374, [[537, 0.222352, " not", false], [279, 0.082857, " the", false], [432, 0.069599, " it", false], [419, 0.059519, " this", false], [304, 0.058971, " in", false], [1052, 0.040108, " there", false], [429, 0.036923, " that", false], [5994, 0.033935, " Go", false], [1588, 0.025159, " here", false], [311, 0.020415, " to", false]]]}, "raw_delta": 0.0024025175306532365, "tuned_delta": 0.010974309561231485}, {"byte_start": 2594, "byte_end": 2598, "display": {"text": " did", "kind": "normal"}, "is_word": true, "word_id": 439, "word_key": " did", "bytes_hex": "20 64 69 64", "compression": {"rwkv": "27.05% 27.05% 27.05% 27.05%", "qwen": "20.85% 20.85% 20.85% 20.85%"}, "model_tokens": {"rwkv": [[21532, " did", "normal", 0.0025070246774703264]], "qwen": [[1521, " did", "normal", 0.009800087660551071]]}, "loss": {"rwkv": 27.05053201666806, "qwen": 20.8530920473809}, "topk": {"rwkv": [21532, 27, 0.0025070246774703264, [[4450, 0.402714, " by", false], [332, 0.136427, " a", false], [22590, 0.078279, " the", false], [22748, 0.053338, " was", false], [4706, 0.051219, " of", false], [4596, 0.03753, " in", false], [4811, 0.029705, " to", false], [30917, 0.019043, " from", false], [32227, 0.016914, " that", false], [4600, 0.013652, " is", false]]], "qwen": [1521, 14, 0.009800087660551071, [[553, 0.234046, " by", false], [572, 0.159847, " was", false], [304, 0.06377, " in", false], [264, 0.042462, " a", false], [374, 0.030726, " is", false], [897, 0.029572, " value", false], [279, 0.025313, " the", false], [311, 0.023479, " to", false], [504, 0.020341, " from", false], [5413, 0.018399, " methods", false]]]}, "raw_delta": 0.34365904331207275, "tuned_delta": 0.352230835342651}, {"byte_start": 2598, "byte_end": 2602, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 440, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "0.26% 0.26% 0.26% 0.26%", "qwen": "0.24% 0.24% 0.24% 0.24%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.9441571831703186]], "qwen": [[537, " not", "normal", 0.9479894638061523]]}, "loss": {"rwkv": 0.25866190689766416, "qwen": 0.2408033560754438}, "topk": {"rwkv": [22187, 1, 0.9441571831703186, [[22187, 0.944157, " not", false], [32187, 0.006166, " take", false], [39166, 0.004852, " occur", false], [31702, 0.004682, " play", false], [46159, 0.00249, " happen", false], [30482, 0.002195, " come", false], [61959, 0.001925, " eventually", false], [31967, 0.001481, " seem", false], [31466, 0.001419, " much", false], [37829, 0.001197, " begin", false]]], "qwen": [537, 1, 0.9479894638061523, [[537, 0.947989, " not", false], [1486, 0.011866, " play", false], [1896, 0.003933, " take", false], [12170, 0.002203, " occur", false], [614, 0.002135, " have", false], [12118, 0.002025, " prove", false], [1172, 0.001618, " only", false], [2803, 0.001143, " seem", false], [1492, 0.000945, " help", false], [2632, 0.000863, " little", false]]]}, "raw_delta": 0.000990288332104683, "tuned_delta": 0.009562080362682931}, {"byte_start": 2602, "byte_end": 2607, "display": {"text": " play", "kind": "normal"}, "is_word": true, "word_id": 441, "word_key": " play", "bytes_hex": "20 70 6c 61 79", "compression": {"rwkv": "9.19% 9.19% 9.19% 9.19% 9.19%", "qwen": "5.06% 5.06% 5.06% 5.06% 5.06%"}, "model_tokens": {"rwkv": [[31702, " play", "normal", 0.07770711183547974]], "qwen": [[1486, " play", "normal", 0.2457631230354309]]}, "loss": {"rwkv": 9.185909830660195, "qwen": 5.061649344724086}, "topk": {"rwkv": [31702, 1, 0.07770711183547974, [[31702, 0.077707, " play", false], [31967, 0.062265, " seem", false], [39801, 0.058786, " start", false], [39166, 0.04257, " occur", false], [56041, 0.036512, " dominate", false], [32499, 0.031206, " work", false], [46159, 0.030387, " happen", false], [45185, 0.027338, " appear", false], [22770, 0.02692, " win", false], [37829, 0.02434, " begin", false]]], "qwen": [1486, 1, 0.2457631230354309, [[1486, 0.245763, " play", false], [12118, 0.057356, " prove", false], [2803, 0.044004, " seem", false], [4994, 0.038472, " appear", false], [3635, 0.03657, " become", false], [975, 0.027108, " work", false], [1492, 0.026829, " help", false], [12170, 0.026608, " occur", false], [2525, 0.023338, " come", false], [3602, 0.022493, " yet", false]]]}, "raw_delta": 0.2286975622177124, "tuned_delta": 0.23726935424829065}, {"byte_start": 2607, "byte_end": 2609, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 442, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "7.89% 7.89%", "qwen": "4.35% 4.35%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.4145268499851227]], "qwen": [[264, " a", "normal", 0.6170863509178162]]}, "loss": {"rwkv": 7.889738504861517, "qwen": 4.3528478404219735}, "topk": {"rwkv": [332, 1, 0.4145268499851227, [[332, 0.414527, " a", false], [4423, 0.218792, " as", false], [32139, 0.092081, " such", false], [22590, 0.089039, " the", false], [4419, 0.038356, " an", false], [31466, 0.034285, " much", false], [32227, 0.033541, " that", false], [21273, 0.027088, " any", false], [4788, 0.011159, " so", false], [32234, 0.006514, " this", false]]], "qwen": [264, 1, 0.6170863509178162, [[264, 0.617086, " a", false], [438, 0.147431, " as", false], [1741, 0.048873, " such", false], [458, 0.047076, " an", false], [279, 0.029216, " the", false], [1753, 0.021222, " much", false], [894, 0.016069, " any", false], [7009, 0.013102, " nearly", false], [5008, 0.007137, " quite", false], [1052, 0.007039, " there", false]]]}, "raw_delta": 0.19612686336040497, "tuned_delta": 0.20469865539098323}, {"byte_start": 2609, "byte_end": 2613, "display": {"text": " big", "kind": "normal"}, "is_word": true, "word_id": 443, "word_key": " big", "bytes_hex": "20 62 69 67", "compression": {"rwkv": "17.47% 17.47% 17.47% 17.47%", "qwen": "13.34% 13.34% 13.34% 13.34%"}, "model_tokens": {"rwkv": [[21357, " big", "normal", 0.020496277138590813]], "qwen": [[2409, " big", "normal", 0.05184754729270935]]}, "loss": {"rwkv": 17.47013526076479, "qwen": 13.342438776442753}, "topk": {"rwkv": [21357, 10, 0.020496277138590813, [[31894, 0.35724, " role", false], [38961, 0.087679, " major", false], [51156, 0.079813, " central", false], [60273, 0.062897, " prominent", false], [38864, 0.053773, " large", false], [63870, 0.047491, " significant", false], [31633, 0.031742, " part", false], [56040, 0.031581, " dominant", false], [45752, 0.027115, " direct", false], [21357, 0.020496, " big", false]]], "qwen": [2409, 5, 0.05184754729270935, [[3476, 0.349896, " role", false], [3598, 0.160371, " major", false], [3460, 0.089409, " large", false], [5089, 0.068478, " significant", false], [2409, 0.051848, " big", false], [8622, 0.050104, " central", false], [20469, 0.038747, " prominent", false], [949, 0.029593, " part", false], [2118, 0.012775, " direct", false], [1376, 0.012518, " key", false]]]}, "raw_delta": 0.22888809442520142, "tuned_delta": 0.23745988645577967}, {"byte_start": 2613, "byte_end": 2618, "display": {"text": " role", "kind": "normal"}, "is_word": true, "word_id": 444, "word_key": " role", "bytes_hex": "20 72 6f 6c 65", "compression": {"rwkv": "0.50% 0.50% 0.50% 0.50% 0.50%", "qwen": "0.51% 0.51% 0.51% 0.51% 0.51%"}, "model_tokens": {"rwkv": [[31894, " role", "normal", 0.8702993392944336]], "qwen": [[3476, " role", "normal", 0.867730975151062]]}, "loss": {"rwkv": 0.5036752706228559, "qwen": 0.5117005723024768}, "topk": {"rwkv": [31894, 1, 0.8702993392944336, [[31894, 0.870299, " role", false], [31633, 0.099551, " part", false], [45865, 0.013572, " enough", false], [52013, 0.006282, " initial", false], [45752, 0.001327, " direct", false], [45, 0.001155, ",", false], [31895, 0.000607, " roll", false], [39568, 0.0006, " rôle", false], [4715, 0.000542, " or", false], [38328, 0.000513, " early", false]]], "qwen": [3476, 1, 0.867730975151062, [[3476, 0.867731, " role", false], [949, 0.121771, " part", false], [8168, 0.002727, " factor", false], [3322, 0.002314, " enough", false], [6502, 0.000408, " roll", false], [11, 0.000291, ",", false], [1809, 0.00026, " game", false], [2118, 0.00023, " direct", false], [14976, 0.000209, " practical", false], [2456, 0.000182, " effect", false]]]}, "raw_delta": -0.00044501721858978063, "tuned_delta": 0.008126774811988468}, {"byte_start": 2618, "byte_end": 2621, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 445, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "3.10% 3.10% 3.10%", "qwen": "2.27% 2.27% 2.27%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.5950484275817871]], "qwen": [[304, " in", "normal", 0.6852281093597412]]}, "loss": {"rwkv": 3.099540126909882, "qwen": 2.272265417609112}, "topk": {"rwkv": [4596, 1, 0.5950484275817871, [[4596, 0.595048, " in", false], [39934, 0.150896, " there", false], [499, 0.059296, ").", false], [40076, 0.034228, " until", false], [4424, 0.034011, " at", false], [59868, 0.017486, " initially", false], [42, 0.012552, ")", false], [32230, 0.011976, " then", false], [21700, 0.009663, " for", false], [31077, 0.009021, " here", false]]], "qwen": [304, 1, 0.6852281093597412, [[304, 0.685228, " in", false], [1052, 0.096012, " there", false], [3080, 0.035162, " until", false], [568, 0.034877, ").", false], [518, 0.027178, " at", false], [369, 0.01464, " for", false], [8, 0.013315, ")", false], [15102, 0.011603, " initially", false], [1221, 0.007446, " then", false], [1588, 0.007177, " here", false]]]}, "raw_delta": 0.04587385058403015, "tuned_delta": 0.0544456426146084}, {"byte_start": 2621, "byte_end": 2625, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 446, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "5.99% 5.99% 5.99% 5.99%", "qwen": "7.64% 7.64% 7.64% 7.64%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.26575765013694763]], "qwen": [[279, " the", "normal", 0.18346962332725525]]}, "loss": {"rwkv": 5.987747972439545, "qwen": 7.644958822563186}, "topk": {"rwkv": [22590, 2, 0.26575765013694763, [[38013, 0.269528, " chess", false], [22590, 0.265758, " the", false], [3851, 0.081561, " Go", false], [55809, 0.052864, " computer", false], [32227, 0.046727, " that", false], [39944, 0.027278, " those", false], [38328, 0.023411, " early", false], [53354, 0.013249, " winning", false], [47202, 0.010337, " search", false], [38720, 0.009971, " human", false]]], "qwen": [279, 2, 0.18346962332725525, [[32719, 0.341252, " chess", false], [279, 0.18347, " the", false], [5994, 0.154985, " Go", false], [6366, 0.07453, " computer", false], [1846, 0.02422, " those", false], [429, 0.018696, " that", false], [4124, 0.010531, " early", false], [1181, 0.010355, " its", false], [419, 0.010157, " this", false], [1493, 0.009928, " these", false]]]}, "raw_delta": -0.09189528226852417, "tuned_delta": -0.08332349023794593}, {"byte_start": 2625, "byte_end": 2628, "display": {"text": " 19", "kind": "normal"}, "is_word": true, "word_id": 447, "word_key": " 19", "bytes_hex": "20 31 39", "compression": {"rwkv": "23.48% 23.48% 23.48%", "qwen": "46.90% 1.40% 0.09%"}, "model_tokens": {"rwkv": [[3492, " 19", "normal", 0.02015720121562481]], "qwen": [[220, " ", "normal", 0.07424170523881912], [16, "1", "normal", 0.925460696220398], [24, "9", "normal", 0.9950696229934692]]}, "loss": {"rwkv": 23.481364597802134, "qwen": 16.127139440185175}, "topk": {"rwkv": [3492, 10, 0.02015720121562481, [[38328, 0.119445, " early", false], [38013, 0.104095, " chess", false], [47202, 0.086436, " search", false], [52013, 0.076176, " initial", false], [3851, 0.048838, " Go", false], [51551, 0.043884, " earlier", false], [38720, 0.036309, " human", false], [38499, 0.035452, " first", false], [38491, 0.026591, " final", false], [3492, 0.020157, " 19", false]]], "qwen": [220, 3, 0.07424170523881912, [[4124, 0.121692, " early", false], [32719, 0.103933, " chess", false], [220, 0.074242, " ", false], [6366, 0.056794, " computer", false], [2856, 0.037899, " initial", false], [2711, 0.036277, " search", false], [6788, 0.032006, " earlier", false], [3738, 0.031073, " human", false], [4401, 0.030849, " development", false], [5994, 0.026553, " Go", false]]]}, "raw_delta": 0.4078048346564173, "tuned_delta": 0.41637662668699554}, {"byte_start": 2628, "byte_end": 2630, "display": {"text": "97", "kind": "normal"}, "is_word": true, "word_id": 448, "word_key": "97", "bytes_hex": "39 37", "compression": {"rwkv": "2.85% 2.85%", "qwen": "0.56% 2.55%"}, "model_tokens": {"rwkv": [[717, "97", "normal", 0.7284044027328491]], "qwen": [[24, "9", "normal", 0.969538152217865], [22, "7", "normal", 0.8682795763015747]]}, "loss": {"rwkv": 2.8529857986329596, "qwen": 1.5524927134108706}, "topk": {"rwkv": [717, 1, 0.7284044027328491, [[717, 0.728404, "97", false], [710, 0.179865, "90", false], [716, 0.035469, "96", false], [700, 0.011845, "80", false], [690, 0.00909, "70", false], [709, 0.004971, "89", false], [719, 0.004885, "99", false], [670, 0.004309, "50", false], [715, 0.003452, "95", false], [711, 0.002343, "91", false]]], "qwen": [24, 1, 0.969538152217865, [[24, 0.969538, "9", false], [23, 0.017938, "8", false], [22, 0.009043, "7", false], [21, 0.001301, "6", false], [20, 0.00081, "5", false], [19, 0.00038, "4", false], [339, 0.000238, "th", false], [17, 0.000152, "2", false], [15, 0.000122, "0", false], [18, 8.3e-05, "3", false]]]}, "raw_delta": 0.07211464922875166, "tuned_delta": 0.0806864412593299}, {"byte_start": 2630, "byte_end": 2638, "display": {"text": " program", "kind": "normal"}, "is_word": true, "word_id": 449, "word_key": " program", "bytes_hex": "20 70 72 6f 67 72 61 6d", "compression": {"rwkv": "11.48% 11.48% 11.48% 11.48% 11.48% 11.48% 11.48% 11.48%", "qwen": "11.39% 11.39% 11.39% 11.39% 11.39% 11.39% 11.39% 11.39%"}, "model_tokens": {"rwkv": [[52580, " program", "normal", 0.006228081416338682]], "qwen": [[2025, " program", "normal", 0.00640413723886013]]}, "loss": {"rwkv": 11.482387288325246, "qwen": 11.385594377528088}, "topk": {"rwkv": [52580, 24, 0.006228081416338682, [[53283, 0.108538, " victory", false], [38013, 0.089222, " chess", false], [38981, 0.065294, " match", false], [46, 0.065221, "-", false], [30941, 0.063723, " game", false], [45685, 0.059596, " defeat", false], [20184, 0.044272, " Kas", false], [40213, 0.037546, " world", false], [21265, 0.035805, " and", false], [47202, 0.030445, " search", false]]], "qwen": [2025, 18, 0.00640413723886013, [[32719, 0.263852, " chess", false], [6366, 0.208496, " computer", false], [5994, 0.076176, " Go", false], [1879, 0.036089, " world", false], [12560, 0.034823, " victory", false], [37542, 0.027709, " Kas", false], [12, 0.023072, "-", false], [1142, 0.01972, " case", false], [1809, 0.017739, " game", false], [47387, 0.012744, " Chess", false]]]}, "raw_delta": 0.00536733865737915, "tuned_delta": 0.013939130687957399}, {"byte_start": 2638, "byte_end": 2643, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 450, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "14.37% 14.37% 14.37% 14.37% 14.37%", "qwen": "10.15% 10.15% 10.15% 10.15% 10.15%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.01888643205165863]], "qwen": [[429, " that", "normal", 0.06002192944288254]]}, "loss": {"rwkv": 14.370595133854907, "qwen": 10.145916127863138}, "topk": {"rwkv": [32227, 6, 0.01888643205165863, [[499, 0.68857, ").", false], [42, 0.068422, ")", false], [497, 0.06727, "),", false], [45, 0.03764, ",", false], [21700, 0.021178, " for", false], [32227, 0.018886, " that", false], [580, 0.016441, ".)", false], [21265, 0.010519, " and", false], [4706, 0.007717, " of", false], [47, 0.004464, ".", false]]], "qwen": [429, 5, 0.06002192944288254, [[568, 0.498181, ").", false], [8, 0.109327, ")", false], [3593, 0.094091, ").\n\n", false], [701, 0.070225, "),", false], [429, 0.060022, " that", false], [11, 0.027611, ",", false], [369, 0.026642, " for", false], [304, 0.00916, " in", false], [2348, 0.007056, " against", false], [594, 0.006991, "'s", false]]]}, "raw_delta": 0.23426594734191894, "tuned_delta": 0.2428377393724972}, {"byte_start": 2643, "byte_end": 2649, "display": {"text": " first", "kind": "normal"}, "is_word": true, "word_id": 451, "word_key": " first", "bytes_hex": "20 66 69 72 73 74", "compression": {"rwkv": "15.59% 15.59% 15.59% 15.59% 15.59% 15.59%", "qwen": "17.83% 17.83% 17.83% 17.83% 17.83% 17.83%"}, "model_tokens": {"rwkv": [[38499, " first", "normal", 0.005630576517432928]], "qwen": [[1156, " first", "normal", 0.002655275631695986]]}, "loss": {"rwkv": 15.591626092940619, "qwen": 17.82692186911223}, "topk": {"rwkv": [38499, 9, 0.005630576517432928, [[22777, 0.464782, " won", false], [55934, 0.223228, " defeated", false], [30256, 0.083291, " beat", false], [22748, 0.020675, " was", false], [51744, 0.017805, " finally", false], [61959, 0.009888, " eventually", false], [21532, 0.007498, " did", false], [62676, 0.007335, " ultimately", false], [38499, 0.005631, " first", false], [21994, 0.005627, " led", false]]], "qwen": [1156, 15, 0.002655275631695986, [[23283, 0.532717, " defeated", false], [9382, 0.188874, " beat", false], [2765, 0.122936, " won", false], [572, 0.010686, " was", false], [6342, 0.009291, " played", false], [3867, 0.008745, " took", false], [3937, 0.007337, " went", false], [29701, 0.006301, " dominated", false], [9583, 0.005843, " eventually", false], [18651, 0.003529, " proved", false]]]}, "raw_delta": -0.12395111719767249, "tuned_delta": -0.11537932516709425}, {"byte_start": 2649, "byte_end": 2654, "display": {"text": " beat", "kind": "normal"}, "is_word": true, "word_id": 452, "word_key": " beat", "bytes_hex": "20 62 65 61 74", "compression": {"rwkv": "5.55% 5.55% 5.55% 5.55% 5.55%", "qwen": "6.08% 6.08% 6.08% 6.08% 6.08%"}, "model_tokens": {"rwkv": [[30256, " beat", "normal", 0.21177823841571808]], "qwen": [[9382, " beat", "normal", 0.18517979979515076]]}, "loss": {"rwkv": 5.550994590920425, "qwen": 6.082503533758917}, "topk": {"rwkv": [30256, 3, 0.21177823841571808, [[22777, 0.286485, " won", false], [55934, 0.253486, " defeated", false], [30256, 0.211778, " beat", false], [31351, 0.012831, " made", false], [55437, 0.011345, " achieved", false], [32354, 0.006439, " used", false], [46936, 0.005962, " proved", false], [32272, 0.005958, " took", false], [47333, 0.005357, " solved", false], [51097, 0.004873, " brought", false]]], "qwen": [9382, 2, 0.18517979979515076, [[23283, 0.474552, " defeated", false], [9382, 0.18518, " beat", false], [2765, 0.039459, " won", false], [18651, 0.020258, " proved", false], [16994, 0.015913, " achieved", false], [3867, 0.015192, " took", false], [1483, 0.013701, " used", false], [3937, 0.013551, " went", false], [20459, 0.011575, " demonstrated", false], [6342, 0.010672, " played", false]]]}, "raw_delta": -0.029473114013671864, "tuned_delta": -0.020901321983093614}, {"byte_start": 2654, "byte_end": 2656, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 453, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "40.01% 40.01%", "qwen": "42.06% 42.06%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.011944356374442577]], "qwen": [[264, " a", "normal", 0.009427649900317192]]}, "loss": {"rwkv": 40.01224527465484, "qwen": 42.0555367530257}, "topk": {"rwkv": [332, 4, 0.011944356374442577, [[20184, 0.806659, " Kas", false], [22590, 0.126618, " the", false], [40213, 0.014172, " world", false], [332, 0.011944, " a", false], [38720, 0.010875, " human", false], [19948, 0.003774, " Gar", false], [38013, 0.003355, " chess", false], [46227, 0.001549, " humans", false], [38621, 0.001381, " grand", false], [22615, 0.001217, " top", false]]], "qwen": [264, 3, 0.009427649900317192, [[37542, 0.890068, " Kas", false], [279, 0.062893, " the", false], [264, 0.009428, " a", false], [730, 0.005613, " K", false], [3738, 0.005219, " human", false], [1879, 0.003376, " world", false], [32719, 0.002167, " chess", false], [220, 0.001656, " ", false], [5994, 0.000883, " Go", false], [12677, 0.000816, " humans", false]]]}, "raw_delta": -0.11330413818359375, "tuned_delta": -0.10473234615301551}, {"byte_start": 2656, "byte_end": 2662, "display": {"text": " world", "kind": "normal"}, "is_word": true, "word_id": 454, "word_key": " world", "bytes_hex": "20 77 6f 72 6c 64", "compression": {"rwkv": "2.61% 2.61% 2.61% 2.61% 2.61% 2.61%", "qwen": "3.36% 3.36% 3.36% 3.36% 3.36% 3.36%"}, "model_tokens": {"rwkv": [[40213, " world", "normal", 0.4182984530925751]], "qwen": [[1879, " world", "normal", 0.3270755708217621]]}, "loss": {"rwkv": 2.606431470356037, "qwen": 3.358966998306696}, "topk": {"rwkv": [40213, 1, 0.4182984530925751, [[40213, 0.418298, " world", false], [38720, 0.249122, " human", false], [38621, 0.153568, " grand", false], [22615, 0.061515, " top", false], [38013, 0.046831, " chess", false], [64532, 0.010259, " professional", false], [55716, 0.010002, " champion", false], [39471, 0.006408, " reign", false], [20184, 0.005079, " Kas", false], [47436, 0.003959, " strong", false]]], "qwen": [1879, 2, 0.3270755708217621, [[3738, 0.441339, " human", false], [1879, 0.327076, " world", false], [6662, 0.093183, " grand", false], [1909, 0.017116, " top", false], [6584, 0.016489, " professional", false], [32719, 0.01559, " chess", false], [89956, 0.012008, " reigning", false], [18319, 0.010819, " champion", false], [10304, 0.008297, " Grand", false], [2781, 0.005426, " player", false]]]}, "raw_delta": -0.041729430357615144, "tuned_delta": -0.033157638327036894}, {"byte_start": 2662, "byte_end": 2671, "display": {"text": " champion", "kind": "normal"}, "is_word": true, "word_id": 455, "word_key": " champion", "bytes_hex": "20 63 68 61 6d 70 69 6f 6e", "compression": {"rwkv": "0.54% 0.54% 0.54% 0.54% 0.54% 0.54% 0.54% 0.54% 0.54%", "qwen": "0.33% 0.33% 0.33% 0.33% 0.33% 0.33% 0.33% 0.33% 0.33%"}, "model_tokens": {"rwkv": [[55716, " champion", "normal", 0.7612940073013306]], "qwen": [[18319, " champion", "normal", 0.8487852215766907]]}, "loss": {"rwkv": 0.5439849465157495, "qwen": 0.32851188423501704}, "topk": {"rwkv": [55716, 1, 0.7612940073013306, [[55716, 0.761294, " champion", false], [38013, 0.123764, " chess", false], [46, 0.072842, "-", false], [38621, 0.011521, " grand", false], [37996, 0.007376, " champ", false], [64275, 0.007362, " championship", false], [38046, 0.002726, " class", false], [46526, 0.00215, " master", false], [38720, 0.001669, " human", false], [46841, 0.000877, " player", false]]], "qwen": [18319, 1, 0.8487852215766907, [[18319, 0.848785, " champion", false], [32719, 0.050926, " chess", false], [14800, 0.030213, "-class", false], [11582, 0.019481, "-ch", false], [6662, 0.008552, " grand", false], [34541, 0.0065, " champ", false], [21553, 0.006274, " championship", false], [536, 0.004128, " class", false], [2781, 0.003682, " player", false], [5994, 0.002991, " Go", false]]]}, "raw_delta": 0.011948363648520576, "tuned_delta": 0.020520155679098824}, {"byte_start": 2671, "byte_end": 2673, "display": {"text": ").", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29 2e", "compression": {"rwkv": "3.08% 3.08%", "qwen": "5.28% 5.28%"}, "model_tokens": {"rwkv": [[499, ").", "normal", 0.7121771574020386]], "qwen": [[568, ").", "normal", 0.5565124750137329]]}, "loss": {"rwkv": 3.0819291034615306, "qwen": 5.284463080386749}, "topk": {"rwkv": [499, 1, 0.7121771574020386, [[499, 0.712177, ").", false], [42, 0.054444, ")", false], [497, 0.049724, "),", false], [45, 0.049385, ",", false], [580, 0.032032, ".)", false], [47, 0.022036, ".", false], [4596, 0.019002, " in", false], [4424, 0.011766, " at", false], [21265, 0.006325, " and", false], [60, 0.004699, ";", false]]], "qwen": [568, 1, 0.5565124750137329, [[568, 0.556512, ").", false], [3593, 0.125492, ").\n\n", false], [8, 0.088581, ")", false], [304, 0.068221, " in", false], [701, 0.046289, "),", false], [11, 0.028162, ",", false], [6138, 0.011887, ".)", false], [518, 0.010606, " at", false], [553, 0.006713, " by", false], [448, 0.004133, " with", false]]]}, "raw_delta": -0.12213441729545593, "tuned_delta": -0.11356262526487769}, {"byte_start": 2673, "byte_end": 2682, "display": {"text": " Learning", "kind": "normal"}, "is_word": true, "word_id": 456, "word_key": " learning", "bytes_hex": "20 4c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "8.52% 8.52% 8.52% 8.52% 8.52% 8.52% 8.52% 8.52% 8.52%", "qwen": "7.34% 7.34% 7.34% 7.34% 7.34% 7.34% 7.34% 7.34% 7.34%"}, "model_tokens": {"rwkv": [[55122, " Learning", "normal", 0.014099424704909325]], "qwen": [[20909, " Learning", "normal", 0.025673646479845047]]}, "loss": {"rwkv": 8.515908227469575, "qwen": 7.338289033568737}, "topk": {"rwkv": [55122, 12, 0.014099424704909325, [[261, 0.277084, "\n\n", false], [20996, 0.098456, " The", false], [267, 0.055791, "  ", false], [29894, 0.053921, " This", false], [3913, 0.043547, " In", false], [19555, 0.033826, " But", false], [36251, 0.023086, " Again", false], [3918, 0.021389, " It", false], [37453, 0.017088, " These", false], [29511, 0.016195, " Once", false]]], "qwen": [20909, 6, 0.025673646479845047, [[1096, 0.131989, " This", false], [576, 0.113991, " The", false], [220, 0.064805, " ", false], [758, 0.056152, " In", false], [1084, 0.032568, " It", false], [20909, 0.025674, " Learning", false], [10115, 0.025323, " Self", false], [4220, 0.022711, " These", false], [362, 0.018038, " A", false], [3197, 0.017117, " When", false]]]}, "raw_delta": 0.06530107392205131, "tuned_delta": 0.07387286595262955}, {"byte_start": 2682, "byte_end": 2685, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 457, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "7.51% 7.51% 7.51%", "qwen": "7.34% 7.34% 7.34%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.2856481075286865]], "qwen": [[553, " by", "normal", 0.2946818768978119]]}, "loss": {"rwkv": 7.514036671296684, "qwen": 7.344873819313647}, "topk": {"rwkv": [4450, 1, 0.2856481075286865, [[4450, 0.285648, " by", false], [4600, 0.074767, " is", false], [22748, 0.067164, " was", false], [332, 0.056962, " a", false], [30917, 0.042613, " from", false], [4811, 0.037718, " to", false], [22590, 0.033044, " the", false], [4706, 0.032283, " of", false], [45, 0.022286, ",", false], [21800, 0.021196, " has", false]]], "qwen": [553, 1, 0.2946818768978119, [[553, 0.294682, " by", false], [572, 0.101215, " was", false], [374, 0.06683, " is", false], [702, 0.032769, " has", false], [11, 0.026648, ",", false], [304, 0.022976, " in", false], [1030, 0.01806, " had", false], [5980, 0.016686, "-based", false], [646, 0.016298, " can", false], [5413, 0.015814, " methods", false]]]}, "raw_delta": 0.009380380312601744, "tuned_delta": 0.017952172343179994}, {"byte_start": 2685, "byte_end": 2690, "display": {"text": " self", "kind": "normal"}, "is_word": true, "word_id": 458, "word_key": " self", "bytes_hex": "20 73 65 6c 66", "compression": {"rwkv": "0.74% 0.74% 0.74% 0.74% 0.74%", "qwen": "0.08% 0.08% 0.08% 0.08% 0.08%"}, "model_tokens": {"rwkv": [[31978, " self", "normal", 0.8137813806533813]], "qwen": [[656, " self", "normal", 0.9773311018943787]]}, "loss": {"rwkv": 0.7431851895204377, "qwen": 0.08270163994208604}, "topk": {"rwkv": [31978, 1, 0.8137813806533813, [[31978, 0.813781, " self", false], [47202, 0.029136, " search", false], [38720, 0.01375, " human", false], [46342, 0.012835, " itself", false], [52491, 0.008772, " playing", false], [65003, 0.007723, " reinforcement", false], [40093, 0.007475, " value", false], [59815, 0.005903, " imitation", false], [31702, 0.004359, " play", false], [62557, 0.004344, " simulation", false]]], "qwen": [656, 1, 0.9773311018943787, [[656, 0.977331, " self", false], [5086, 0.004029, " itself", false], [5619, 0.001925, " playing", false], [71278, 0.001007, " reinforcement", false], [3738, 0.000895, " human", false], [1486, 0.000809, " play", false], [11504, 0.000486, " repeated", false], [4862, 0.00044, " training", false], [10115, 0.000352, " Self", false], [2711, 0.000339, " search", false]]]}, "raw_delta": 0.03662498481571674, "tuned_delta": 0.04519677684629499}, {"byte_start": 2690, "byte_end": 2695, "display": {"text": " play", "kind": "normal"}, "is_word": true, "word_id": 459, "word_key": " play", "bytes_hex": "20 70 6c 61 79", "compression": {"rwkv": "1.13% 1.13% 1.13% 1.13% 1.13%", "qwen": "0.63% 0.63% 0.63% 0.63% 0.63%"}, "model_tokens": {"rwkv": [[31702, " play", "normal", 0.7305943965911865]], "qwen": [[1486, " play", "normal", 0.8401477932929993]]}, "loss": {"rwkv": 1.1271055006945025, "qwen": 0.6282122614234654}, "topk": {"rwkv": [31702, 1, 0.7305943965911865, [[31702, 0.730594, " play", false], [46, 0.264675, "-", false], [26697, 0.001694, "play", false], [39301, 0.000377, " plays", false], [52491, 0.000345, " playing", false], [4715, 0.000135, " or", false], [11, 7.4e-05, "\n", false], [45, 7.4e-05, ",", false], [32189, 6.3e-05, " talk", false], [47077, 6.2e-05, " replay", false]]], "qwen": [1486, 1, 0.8401477932929993, [[1486, 0.840148, " play", false], [26544, 0.153109, "-play", false], [1363, 0.002449, "play", false], [5619, 0.00096, " playing", false], [12, 0.000871, "-", false], [6342, 0.000397, " played", false], [11088, 0.00036, " plays", false], [72085, 0.000153, "-playing", false], [2268, 0.000136, "-p", false], [481, 0.000131, " -", false]]]}, "raw_delta": 0.027664515376091003, "tuned_delta": 0.03623630740666925}, {"byte_start": 2695, "byte_end": 2696, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "50.72%", "qwen": "51.11%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.06047001853585243]], "qwen": [[11, ",", "normal", 0.058770012110471725]]}, "loss": {"rwkv": 50.719747531252615, "qwen": 51.10970099381895}, "topk": {"rwkv": [45, 3, 0.06047001853585243, [[4600, 0.265067, " is", false], [22748, 0.154439, " was", false], [45, 0.06047, ",", false], [21800, 0.048743, " has", false], [46936, 0.023373, " proved", false], [30135, 0.018009, " also", false], [21795, 0.017133, " had", false], [21413, 0.016848, " can", false], [4596, 0.016831, " in", false], [21532, 0.012162, " did", false]]], "qwen": [11, 3, 0.058770012110471725, [[374, 0.186056, " is", false], [572, 0.16232, " was", false], [11, 0.05877, ",", false], [702, 0.054755, " has", false], [18651, 0.041368, " proved", false], [646, 0.024019, " can", false], [1558, 0.022965, " does", false], [1030, 0.018434, " had", false], [1521, 0.016502, " did", false], [1083, 0.015467, " also", false]]]}, "raw_delta": -0.021623611450195312, "tuned_delta": -0.013051819419617064}, {"byte_start": 2696, "byte_end": 2700, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 460, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "11.98% 11.98% 11.98% 11.98%", "qwen": "11.83% 11.83% 11.83% 11.83%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.0699387714266777]], "qwen": [[323, " and", "normal", 0.07252924889326096]]}, "loss": {"rwkv": 11.97549594487909, "qwen": 11.82904196875373}, "topk": {"rwkv": [21265, 4, 0.0699387714266777, [[4715, 0.106634, " or", false], [51948, 0.080174, " however", false], [4596, 0.073112, " in", false], [21265, 0.069939, " and", false], [40186, 0.05474, " which", false], [4423, 0.042955, " as", false], [4450, 0.028859, " by", false], [32487, 0.024602, " with", false], [47001, 0.019805, " rather", false], [32465, 0.019563, " when", false]]], "qwen": [323, 3, 0.07252924889326096, [[892, 0.120817, " which", false], [4764, 0.08481, " however", false], [323, 0.072529, " and", false], [304, 0.052395, " in", false], [476, 0.047287, " or", false], [438, 0.041698, " as", false], [1075, 0.030872, " like", false], [10856, 0.029464, " combined", false], [979, 0.023073, " when", false], [264, 0.018457, " a", false]]]}, "raw_delta": 0.008121132850646973, "tuned_delta": 0.016692924881225223}, {"byte_start": 2700, "byte_end": 2709, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 461, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "5.95% 5.95% 5.95% 5.95% 5.95% 5.95% 5.95% 5.95% 5.95%", "qwen": "5.58% 5.58% 5.58% 5.58% 5.58% 5.58% 5.58% 5.58% 5.58%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.051337603479623795]], "qwen": [[6832, " learning", "normal", 0.061622485518455505]]}, "loss": {"rwkv": 5.948612364776541, "qwen": 5.583887801632613}, "topk": {"rwkv": [56537, 3, 0.051337603479623795, [[22590, 0.14072, " the", false], [4450, 0.077418, " by", false], [56537, 0.051338, " learning", false], [47202, 0.05026, " search", false], [4596, 0.047363, " in", false], [32230, 0.039624, " then", false], [21902, 0.038404, " its", false], [39193, 0.02872, " other", false], [61953, 0.028545, " especially", false], [40085, 0.023326, " using", false]]], "qwen": [6832, 2, 0.061622485518455505, [[279, 0.169488, " the", false], [6832, 0.061622, " learning", false], [1181, 0.055484, " its", false], [304, 0.049826, " in", false], [5310, 0.043404, " especially", false], [1008, 0.036733, " other", false], [2937, 0.02753, " later", false], [1221, 0.024226, " then", false], [553, 0.023626, " by", false], [71278, 0.023571, " reinforcement", false]]]}, "raw_delta": 0.020224624209933817, "tuned_delta": 0.028796416240512067}, {"byte_start": 2709, "byte_end": 2712, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 462, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "20.85% 20.85% 20.85%", "qwen": "9.63% 9.63% 9.63%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.031202295795083046]], "qwen": [[304, " in", "normal", 0.20149588584899902]]}, "loss": {"rwkv": 20.851451762848296, "qwen": 9.62990697811478}, "topk": {"rwkv": [4596, 6, 0.031202295795083046, [[4450, 0.419549, " by", false], [30917, 0.107853, " from", false], [4811, 0.069568, " to", false], [332, 0.049121, " a", false], [22590, 0.037323, " the", false], [4596, 0.031202, " in", false], [4706, 0.030607, " of", false], [32487, 0.030387, " with", false], [22705, 0.013148, " via", false], [40093, 0.012071, " value", false]]], "qwen": [304, 2, 0.20149588584899902, [[553, 0.460229, " by", false], [304, 0.201496, " in", false], [504, 0.032372, " from", false], [803, 0.028194, " more", false], [311, 0.026235, " to", false], [8789, 0.022546, " generally", false], [315, 0.015536, " of", false], [448, 0.015369, " with", false], [5086, 0.011464, " itself", false], [518, 0.009877, " at", false]]]}, "raw_delta": 0.6222545703252157, "tuned_delta": 0.6308263623557939}, {"byte_start": 2712, "byte_end": 2720, "display": {"text": " general", "kind": "normal"}, "is_word": true, "word_id": 463, "word_key": " general", "bytes_hex": "20 67 65 6e 65 72 61 6c", "compression": {"rwkv": "1.47% 1.47% 1.47% 1.47% 1.47% 1.47% 1.47% 1.47%", "qwen": "0.29% 0.29% 0.29% 0.29% 0.29% 0.29% 0.29% 0.29%"}, "model_tokens": {"rwkv": [[51832, " general", "normal", 0.5234772562980652]], "qwen": [[4586, " general", "normal", 0.8802781701087952]]}, "loss": {"rwkv": 1.4705204579373587, "qwen": 0.2874509964834224}, "topk": {"rwkv": [51832, 1, 0.5234772562980652, [[51832, 0.523477, " general", false], [22590, 0.101166, " the", false], [332, 0.060567, " a", false], [39193, 0.024559, " other", false], [62293, 0.021128, " particular", false], [32234, 0.016136, " this", false], [47202, 0.013361, " search", false], [4419, 0.012075, " an", false], [56812, 0.01165, " parallel", false], [38576, 0.010957, " games", false]]], "qwen": [4586, 1, 0.8802781701087952, [[4586, 0.880278, " general", false], [1008, 0.024624, " other", false], [803, 0.015842, " more", false], [279, 0.009629, " the", false], [3953, 0.009389, " particular", false], [264, 0.006392, " a", false], [1657, 0.005726, " many", false], [3868, 0.004921, " games", false], [894, 0.003346, " any", false], [71278, 0.001897, " reinforcement", false]]]}, "raw_delta": 0.06560330092906952, "tuned_delta": 0.07417509295964776}, {"byte_start": 2720, "byte_end": 2721, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "1.28%", "qwen": "0.88%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.9317038059234619]], "qwen": [[11, ",", "normal", 0.9525086283683777]]}, "loss": {"rwkv": 1.276799200005491, "qwen": 0.8774496399791492}, "topk": {"rwkv": [45, 1, 0.9317038059234619, [[45, 0.931704, ",", false], [275, 0.008793, " (", false], [4450, 0.007177, " by", false], [30917, 0.005872, " from", false], [21286, 0.004578, " are", false], [4596, 0.004207, " in", false], [4600, 0.003044, " is", false], [4423, 0.002999, " as", false], [21700, 0.002112, " for", false], [32462, 0.00185, " were", false]]], "qwen": [11, 1, 0.9525086283683777, [[11, 0.952509, ",", false], [320, 0.011165, " (", false], [438, 0.003895, " as", false], [572, 0.002728, " was", false], [304, 0.002635, " in", false], [553, 0.002413, " by", false], [369, 0.001557, " for", false], [504, 0.001391, " from", false], [374, 0.001263, " is", false], [323, 0.001132, " and", false]]]}, "raw_delta": 0.02214464172720909, "tuned_delta": 0.03071643375778734}, {"byte_start": 2721, "byte_end": 2724, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 464, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "8.55% 8.55% 8.55%", "qwen": "9.93% 9.93% 9.93%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.239624485373497]], "qwen": [[374, " is", "normal", 0.19180235266685486]]}, "loss": {"rwkv": 8.547216713599978, "qwen": 9.926281813969146}, "topk": {"rwkv": [4600, 1, 0.239624485373497, [[4600, 0.239624, " is", false], [22748, 0.130871, " was", false], [21800, 0.096172, " has", false], [21286, 0.086335, " are", false], [32462, 0.04343, " were", false], [46936, 0.030249, " proved", false], [31059, 0.026591, " have", false], [21795, 0.025319, " had", false], [47638, 0.019544, " turned", false], [21413, 0.015931, " can", false]]], "qwen": [374, 2, 0.19180235266685486, [[572, 0.203406, " was", false], [374, 0.191802, " is", false], [702, 0.08035, " has", false], [525, 0.051294, " are", false], [1033, 0.048801, " were", false], [18651, 0.029424, " proved", false], [614, 0.022187, " have", false], [1030, 0.021144, " had", false], [6116, 0.019618, " became", false], [646, 0.014353, " can", false]]]}, "raw_delta": -0.07647160689036053, "tuned_delta": -0.06789981485978229}, {"byte_start": 2724, "byte_end": 2729, "display": {"text": " like", "kind": "normal"}, "is_word": true, "word_id": 465, "word_key": " like", "bytes_hex": "20 6c 69 6b 65", "compression": {"rwkv": "27.84% 27.84% 27.84% 27.84% 27.84%", "qwen": "27.71% 27.71% 27.71% 27.71% 27.71%"}, "model_tokens": {"rwkv": [[31296, " like", "normal", 0.0004481030919123441]], "qwen": [[1075, " like", "normal", 0.0004606365109793842]]}, "loss": {"rwkv": 27.839505867154212, "qwen": 27.710209310235552}, "topk": {"rwkv": [31296, 151, 0.0004481030919123441, [[332, 0.285115, " a", false], [22187, 0.072617, " not", false], [22590, 0.060805, " the", false], [4419, 0.059896, " an", false], [22226, 0.031702, " one", false], [31466, 0.027757, " much", false], [39171, 0.025885, " often", false], [50919, 0.022929, " another", false], [31458, 0.01857, " more", false], [32386, 0.01539, " very", false]]], "qwen": [1075, 154, 0.0004606365109793842, [[264, 0.256609, " a", false], [537, 0.086539, " not", false], [279, 0.061306, " the", false], [458, 0.054938, " an", false], [825, 0.03098, " one", false], [1431, 0.028723, " now", false], [2441, 0.01771, " another", false], [1602, 0.014805, " very", false], [3118, 0.01421, " based", false], [3545, 0.013818, " often", false]]]}, "raw_delta": 0.0071697235107421875, "tuned_delta": 0.015741515541320437}, {"byte_start": 2729, "byte_end": 2736, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 466, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "7.85% 7.85% 7.85% 7.85% 7.85% 7.85% 7.85%", "qwen": "8.18% 8.18% 8.18% 8.18% 8.18% 8.18% 8.18%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.04752352833747864]], "qwen": [[2711, " search", "normal", 0.04180444777011871]]}, "loss": {"rwkv": 7.849484736979571, "qwen": 8.178927946511084}, "topk": {"rwkv": [47202, 4, 0.04752352833747864, [[332, 0.146975, " a", false], [22590, 0.119602, " the", false], [38720, 0.067053, " human", false], [47202, 0.047524, " search", false], [37920, 0.03768, " brute", false], [38013, 0.021692, " chess", false], [60463, 0.021109, " searching", false], [21273, 0.021, " any", false], [56537, 0.020379, " learning", false], [30597, 0.019064, " deep", false]]], "qwen": [2711, 3, 0.04180444777011871, [[264, 0.205371, " a", false], [279, 0.14606, " the", false], [2711, 0.041804, " search", false], [3738, 0.039201, " human", false], [458, 0.029872, " an", false], [64098, 0.024256, " brute", false], [9902, 0.016597, " ``", false], [6832, 0.015212, " learning", false], [1667, 0.015136, " using", false], [15039, 0.014427, " searching", false]]]}, "raw_delta": -0.01826821054731098, "tuned_delta": -0.009696418516732733}, {"byte_start": 2736, "byte_end": 2739, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 467, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "5.64% 5.64% 5.64%", "qwen": "4.43% 4.43% 4.43%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.3910079598426819]], "qwen": [[304, " in", "normal", 0.478597491979599]]}, "loss": {"rwkv": 5.635527503472513, "qwen": 4.429646782739058}, "topk": {"rwkv": [4596, 1, 0.3910079598426819, [[4596, 0.391008, " in", false], [45, 0.202242, ",", false], [59, 0.099982, ":", false], [4450, 0.084479, " by", false], [47, 0.040716, ".", false], [21400, 0.03315, " but", false], [60, 0.02015, ";", false], [21265, 0.018215, " and", false], [32487, 0.008743, " with", false], [21700, 0.007815, " for", false]]], "qwen": [304, 1, 0.478597491979599, [[304, 0.478597, " in", false], [25, 0.13181, ":", false], [11, 0.102186, ",", false], [13, 0.028422, ".", false], [3118, 0.018091, " based", false], [26, 0.016742, ";", false], [369, 0.016629, " for", false], [714, 0.014212, " but", false], [5980, 0.01371, "-based", false], [448, 0.013334, " with", false]]]}, "raw_delta": 0.06686822573343912, "tuned_delta": 0.07544001776401736}, {"byte_start": 2739, "byte_end": 2744, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 468, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "1.62% 1.62% 1.62% 1.62% 1.62%", "qwen": "1.66% 1.66% 1.66% 1.66% 1.66%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.6378023028373718]], "qwen": [[429, " that", "normal", 0.6315386295318604]]}, "loss": {"rwkv": 1.6202141572483475, "qwen": 1.6576426340664636}, "topk": {"rwkv": [32227, 1, 0.6378023028373718, [[32227, 0.637802, " that", false], [22590, 0.088056, " the", false], [31370, 0.040742, " many", false], [21902, 0.030745, " its", false], [37832, 0.025968, " being", false], [32234, 0.023841, " this", false], [38013, 0.019362, " chess", false], [332, 0.018678, " a", false], [32074, 0.006937, " some", false], [39920, 0.006094, " terms", false]]], "qwen": [429, 1, 0.6315386295318604, [[429, 0.631539, " that", false], [279, 0.092578, " the", false], [419, 0.053061, " this", false], [264, 0.034964, " a", false], [32719, 0.02852, " chess", false], [1181, 0.0169, " its", false], [1657, 0.013024, " many", false], [825, 0.011143, " one", false], [2441, 0.009717, " another", false], [3793, 0.009374, " terms", false]]]}, "raw_delta": -0.0020754754543304416, "tuned_delta": 0.006496316576247807}, {"byte_start": 2744, "byte_end": 2747, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 469, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "2.21% 2.21% 2.21%", "qwen": "1.21% 1.21% 1.21%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.694502592086792]], "qwen": [[432, " it", "normal", 0.8172699809074402]]}, "loss": {"rwkv": 2.2072482721934006, "qwen": 1.2129804691136825}, "topk": {"rwkv": [4601, 1, 0.694502592086792, [[4601, 0.694503, " it", false], [22590, 0.090856, " the", false], [21902, 0.019429, " its", false], [45, 0.018944, ",", false], [332, 0.010958, " a", false], [39934, 0.010073, " there", false], [30322, 0.009476, " both", false], [56537, 0.007013, " learning", false], [22226, 0.006704, " one", false], [22799, 0.005822, " you", false]]], "qwen": [432, 1, 0.8172699809074402, [[432, 0.81727, " it", false], [279, 0.029159, " the", false], [11, 0.022253, ",", false], [1181, 0.019094, " its", false], [2176, 0.012306, " both", false], [807, 0.008344, " they", false], [1052, 0.006602, " there", false], [2711, 0.00489, " search", false], [264, 0.004275, " a", false], [304, 0.00391, " in", false]]]}, "raw_delta": 0.05513391395409902, "tuned_delta": 0.06370570598467727}, {"byte_start": 2747, "byte_end": 2755, "display": {"text": " enables", "kind": "normal"}, "is_word": true, "word_id": 470, "word_key": " enables", "bytes_hex": "20 65 6e 61 62 6c 65 73", "compression": {"rwkv": "11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83%", "qwen": "11.85% 11.85% 11.85% 11.85% 11.85% 11.85% 11.85% 11.85%"}, "model_tokens": {"rwkv": [[51597, " enables", "normal", 0.005270105786621571]], "qwen": [[20081, " enables", "normal", 0.005207602400332689]]}, "loss": {"rwkv": 11.834607757292277, "qwen": 11.85181999596894}, "topk": {"rwkv": [51597, 25, 0.005270105786621571, [[4600, 0.253682, " is", false], [21413, 0.087753, " can", false], [56540, 0.045638, " leverage", false], [47181, 0.045148, " scales", false], [30659, 0.044006, " does", false], [57102, 0.034876, " requires", false], [56501, 0.025579, " involves", false], [21800, 0.023224, " has", false], [39914, 0.01778, " tends", false], [32356, 0.016487, " uses", false]]], "qwen": [20081, 26, 0.005207602400332689, [[374, 0.315095, " is", false], [1558, 0.083303, " does", false], [646, 0.064419, " can", false], [7460, 0.038913, " requires", false], [27505, 0.021124, " lever", false], [702, 0.020943, " has", false], [3643, 0.019325, " makes", false], [17601, 0.017854, " involves", false], [5711, 0.017011, " uses", false], [4990, 0.011349, " takes", false]]]}, "raw_delta": -0.0009544491767883301, "tuned_delta": 0.007617342853789918}, {"byte_start": 2755, "byte_end": 2763, "display": {"text": " massive", "kind": "normal"}, "is_word": true, "word_id": 471, "word_key": " massive", "bytes_hex": "20 6d 61 73 73 69 76 65", "compression": {"rwkv": "7.26% 7.26% 7.26% 7.26% 7.26% 7.26% 7.26% 7.26%", "qwen": "12.42% 12.42% 12.42% 12.42% 12.42% 12.42% 12.42% 12.42%"}, "model_tokens": {"rwkv": [[52195, " massive", "normal", 0.0401168130338192]], "qwen": [[10951, " massive", "normal", 0.004051612690091133]]}, "loss": {"rwkv": 7.25574166072086, "qwen": 12.417637542849741}, "topk": {"rwkv": [52195, 3, 0.0401168130338192, [[22590, 0.173718, " the", false], [332, 0.10964, " a", false], [52195, 0.040117, " massive", false], [22226, 0.034335, " one", false], [4419, 0.0304, " an", false], [59988, 0.029927, " massively", false], [38888, 0.027781, " lever", false], [52224, 0.027375, " methods", false], [51832, 0.023804, " general", false], [63370, 0.023168, " computation", false]]], "qwen": [10951, 27, 0.004051612690091133, [[279, 0.188626, " the", false], [264, 0.10628, " a", false], [4586, 0.06056, " general", false], [5413, 0.052981, " methods", false], [458, 0.04216, " an", false], [39661, 0.036924, " exploitation", false], [13009, 0.036775, " agents", false], [76482, 0.023248, " leveraging", false], [26403, 0.022925, " exploration", false], [6832, 0.018577, " learning", false]]]}, "raw_delta": -0.2862362861633301, "tuned_delta": -0.27766449413275185}, {"byte_start": 2763, "byte_end": 2775, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 472, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "3.52% 3.52% 3.52% 3.52% 3.52% 3.52% 3.52% 3.52% 3.52% 3.52% 3.52% 3.52%", "qwen": "3.18% 3.18% 3.18% 3.18% 3.18% 3.18% 3.18% 3.18% 3.18% 3.18% 3.18% 3.18%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.09728000313043594]], "qwen": [[34447, " computation", "normal", 0.12069942057132721]]}, "loss": {"rwkv": 3.5222046896703203, "qwen": 3.17761380105219}, "topk": {"rwkv": [63370, 4, 0.09728000313043594, [[45, 0.126396, ",", false], [56812, 0.121244, " parallel", false], [63621, 0.119267, " improvement", false], [63370, 0.09728, " computation", false], [64423, 0.075713, " improvements", false], [56950, 0.063865, " progress", false], [63562, 0.031557, " exploration", false], [56540, 0.023432, " leverage", false], [38888, 0.022804, " lever", false], [52805, 0.01612, " scaling", false]]], "qwen": [34447, 1, 0.12069942057132721, [[34447, 0.120699, " computation", false], [26403, 0.09624, " exploration", false], [2711, 0.075672, " search", false], [14713, 0.075473, " amounts", false], [15673, 0.049149, " improvement", false], [18142, 0.038987, " improvements", false], [39661, 0.034509, " exploitation", false], [11, 0.031238, ",", false], [26943, 0.031151, " scaling", false], [5452, 0.030295, " scale", false]]]}, "raw_delta": 0.019108176231384277, "tuned_delta": 0.027679968261962527}, {"byte_start": 2775, "byte_end": 2778, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 473, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "4.27% 4.27% 4.27%", "qwen": "6.63% 6.63% 6.63%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.4887532591819763]], "qwen": [[311, " to", "normal", 0.3317577838897705]]}, "loss": {"rwkv": 4.273608356799989, "qwen": 6.632490865881613}, "topk": {"rwkv": [4811, 1, 0.4887532591819763, [[4811, 0.488753, " to", false], [45, 0.089803, ",", false], [47, 0.079899, ".", false], [21265, 0.036857, " and", false], [53356, 0.031182, " without", false], [4706, 0.028676, " of", false], [4424, 0.027044, " at", false], [4596, 0.026625, " in", false], [32487, 0.026466, " with", false], [4712, 0.020952, " on", false]]], "qwen": [311, 1, 0.3317577838897705, [[311, 0.331758, " to", false], [11, 0.125657, ",", false], [13, 0.109759, ".", false], [2041, 0.058306, " without", false], [323, 0.0552, " and", false], [518, 0.033041, " at", false], [429, 0.032326, " that", false], [448, 0.026722, " with", false], [382, 0.02651, ".\n\n", false], [714, 0.022131, " but", false]]]}, "raw_delta": -0.13080422083536783, "tuned_delta": -0.12223242880478959}, {"byte_start": 2778, "byte_end": 2781, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 474, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"rwkv": "1.55% 1.55% 1.55%", "qwen": "2.03% 2.03% 2.03%"}, "model_tokens": {"rwkv": [[4435, " be", "normal", 0.7740868926048279]], "qwen": [[387, " be", "normal", 0.7130709290504456]]}, "loss": {"rwkv": 1.549770063454941, "qwen": 2.032843532330941}, "topk": {"rwkv": [4435, 1, 0.7740868926048279, [[4435, 0.774087, " be", false], [56540, 0.038693, " leverage", false], [32187, 0.00792, " take", false], [31358, 0.006221, " make", false], [45284, 0.006172, " become", false], [30858, 0.005718, " find", false], [31702, 0.005342, " play", false], [4491, 0.00497, " do", false], [51982, 0.004533, " improve", false], [52570, 0.004326, " proceed", false]]], "qwen": [387, 1, 0.7130709290504456, [[387, 0.713071, " be", false], [1896, 0.027526, " take", false], [614, 0.013965, " have", false], [3635, 0.012586, " become", false], [32064, 0.010333, " leverage", false], [1281, 0.009125, " make", false], [7269, 0.008625, " improve", false], [11075, 0.008269, " achieve", false], [22279, 0.007899, " overcome", false], [1486, 0.006836, " play", false]]]}, "raw_delta": -0.026787281036376953, "tuned_delta": -0.018215489005798703}, {"byte_start": 2781, "byte_end": 2789, "display": {"text": " brought", "kind": "normal"}, "is_word": true, "word_id": 475, "word_key": " brought", "bytes_hex": "20 62 72 6f 75 67 68 74", "compression": {"rwkv": "10.21% 10.21% 10.21% 10.21% 10.21% 10.21% 10.21% 10.21%", "qwen": "11.49% 11.49% 11.49% 11.49% 11.49% 11.49% 11.49% 11.49%"}, "model_tokens": {"rwkv": [[51097, " brought", "normal", 0.010964682325720787]], "qwen": [[7117, " brought", "normal", 0.0061202989891171455]]}, "loss": {"rwkv": 10.214393600043929, "qwen": 11.487784318887634}, "topk": {"rwkv": [51097, 8, 0.010964682325720787, [[50937, 0.351463, " applied", false], [56540, 0.165552, " leverage", false], [32354, 0.085808, " used", false], [30666, 0.057943, " done", false], [60152, 0.05008, " performed", false], [51139, 0.012738, " carried", false], [55957, 0.011391, " deployed", false], [51097, 0.010965, " brought", false], [31351, 0.010142, " made", false], [59355, 0.009901, " conducted", false]]], "qwen": [7117, 19, 0.0061202989891171455, [[1483, 0.209172, " used", false], [27505, 0.177003, " lever", false], [9251, 0.148379, " applied", false], [2814, 0.096124, " done", false], [10660, 0.041811, " performed", false], [1865, 0.026493, " made", false], [50663, 0.019872, " exploited", false], [26075, 0.011203, " deployed", false], [19446, 0.009398, " employed", false], [2182, 0.008854, " put", false]]]}, "raw_delta": -0.07061177492141724, "tuned_delta": -0.062039982890838986}, {"byte_start": 2789, "byte_end": 2792, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 476, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.26% 0.26% 0.26%", "qwen": "0.21% 0.21% 0.21%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.9572607278823853]], "qwen": [[311, " to", "normal", 0.965833842754364]]}, "loss": {"rwkv": 0.2612301811505488, "qwen": 0.2089710581155999}, "topk": {"rwkv": [4811, 1, 0.9572607278823853, [[4811, 0.957261, " to", false], [31162, 0.01716, " into", false], [40062, 0.004825, " under", false], [4596, 0.002499, " in", false], [56003, 0.001631, " directly", false], [30678, 0.001246, " down", false], [63507, 0.001037, " effectively", false], [52628, 0.000781, " quickly", false], [51791, 0.000753, " forward", false], [57435, 0.000639, " together", false]]], "qwen": [311, 1, 0.965833842754364, [[311, 0.965834, " to", false], [1119, 0.023412, " into", false], [304, 0.002711, " in", false], [1212, 0.001242, " under", false], [911, 0.000974, " about", false], [2860, 0.000767, " online", false], [3786, 0.000469, " together", false], [11872, 0.000411, " cheap", false], [389, 0.000329, " on", false], [8630, 0.000317, " onto", false]]]}, "raw_delta": 0.002897861103216808, "tuned_delta": 0.011469653133795056}, {"byte_start": 2792, "byte_end": 2797, "display": {"text": " bear", "kind": "normal"}, "is_word": true, "word_id": 477, "word_key": " bear", "bytes_hex": "20 62 65 61 72", "compression": {"rwkv": "0.04% 0.04% 0.04% 0.04% 0.04%", "qwen": "0.03% 0.03% 0.03% 0.03% 0.03%"}, "model_tokens": {"rwkv": [[30255, " bear", "normal", 0.989607036113739]], "qwen": [[11722, " bear", "normal", 0.9928228855133057]]}, "loss": {"rwkv": 0.037863700413955946, "qwen": 0.025979210499576095}, "topk": {"rwkv": [30255, 1, 0.989607036113739, [[30255, 0.989607, " bear", false], [22590, 0.002974, " the", false], [332, 0.001924, " a", false], [4419, 0.000646, " an", false], [39590, 0.000471, " scale", false], [31702, 0.000347, " play", false], [30235, 0.000283, " bare", false], [32202, 0.000196, " task", false], [22681, 0.000153, " use", false], [39898, 0.000123, " tasks", false]]], "qwen": [11722, 1, 0.9928228855133057, [[11722, 0.992823, " bear", false], [279, 0.003907, " the", false], [264, 0.000731, " a", false], [1486, 0.000568, " play", false], [3383, 0.000198, " task", false], [5452, 0.000198, " scale", false], [458, 0.000177, " an", false], [894, 8.3e-05, " any", false], [21828, 6.7e-05, " solving", false], [3491, 5.7e-05, " problem", false]]]}, "raw_delta": 0.0006590160541236399, "tuned_delta": 0.009230808084701888}, {"byte_start": 2797, "byte_end": 2798, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "44.52%", "qwen": "37.38%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.0853908360004425]], "qwen": [[13, ".", "normal", 0.12581726908683777]]}, "loss": {"rwkv": 44.52066727743285, "qwen": 37.38247575857672}, "topk": {"rwkv": [47, 2, 0.0853908360004425, [[4712, 0.611888, " on", false], [47, 0.085391, ".", false], [45, 0.06785, ",", false], [4596, 0.062799, " in", false], [4811, 0.025209, " to", false], [53356, 0.02008, " without", false], [4424, 0.010781, " at", false], [21265, 0.010185, " and", false], [31601, 0.006874, " over", false], [50870, 0.00669, " against", false]]], "qwen": [13, 3, 0.12581726908683777, [[389, 0.432773, " on", false], [11, 0.149686, ",", false], [13, 0.125817, ".", false], [304, 0.049302, " in", false], [382, 0.038853, ".\n\n", false], [2041, 0.035623, " without", false], [323, 0.029677, " and", false], [311, 0.019642, " to", false], [26, 0.011298, ";", false], [714, 0.00808, " but", false]]]}, "raw_delta": 0.3958253860473633, "tuned_delta": 0.4043971780779415}, {"byte_start": 2798, "byte_end": 2805, "display": {"text": " Search", "kind": "normal"}, "is_word": true, "word_id": 478, "word_key": " search", "bytes_hex": "20 53 65 61 72 63 68", "compression": {"rwkv": "9.78% 9.78% 9.78% 9.78% 9.78% 9.78% 9.78%", "qwen": "10.67% 10.67% 10.67% 10.67% 10.67% 10.67% 10.67%"}, "model_tokens": {"rwkv": [[44844, " Search", "normal", 0.022513993084430695]], "qwen": [[7542, " Search", "normal", 0.015871211886405945]]}, "loss": {"rwkv": 9.781665595313005, "qwen": 10.674007406894734}, "topk": {"rwkv": [44844, 9, 0.022513993084430695, [[261, 0.16093, "\n\n", false], [19555, 0.10747, " But", false], [20996, 0.091038, " The", false], [3918, 0.079995, " It", false], [3913, 0.053094, " In", false], [19417, 0.030495, " And", false], [55122, 0.029356, " Learning", false], [267, 0.025966, "  ", false], [44844, 0.022514, " Search", false], [29894, 0.022505, " This", false]]], "qwen": [7542, 10, 0.015871211886405945, [[1084, 0.136113, " It", false], [576, 0.094023, " The", false], [220, 0.081177, " ", false], [758, 0.062874, " In", false], [1988, 0.036261, " But", false], [20909, 0.03, " Learning", false], [1597, 0.028712, " And", false], [1096, 0.025151, " This", false], [4354, 0.017457, " However", false], [7542, 0.015871, " Search", false]]]}, "raw_delta": -0.04948193686349045, "tuned_delta": -0.0409101448329122}, {"byte_start": 2805, "byte_end": 2809, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 479, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "9.65% 9.65% 9.65% 9.65%", "qwen": "10.57% 10.57% 10.57% 10.57%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.11752758175134659]], "qwen": [[323, " and", "normal", 0.09580511599779129]]}, "loss": {"rwkv": 9.650840849696678, "qwen": 10.57422967576948}, "topk": {"rwkv": [21265, 2, 0.11752758175134659, [[4600, 0.182704, " is", false], [21265, 0.117528, " and", false], [45, 0.065288, ",", false], [22748, 0.055948, " was", false], [4596, 0.050092, " in", false], [46, 0.037843, "-", false], [21800, 0.03667, " has", false], [21413, 0.036002, " can", false], [4450, 0.018851, " by", false], [30659, 0.018669, " does", false]]], "qwen": [323, 2, 0.09580511599779129, [[374, 0.206357, " is", false], [323, 0.095805, " and", false], [5980, 0.071295, "-based", false], [646, 0.046686, " can", false], [11, 0.045902, ",", false], [572, 0.042375, " was", false], [702, 0.0265, " has", false], [304, 0.024422, " in", false], [553, 0.023038, " by", false], [20081, 0.018307, " enables", false]]]}, "raw_delta": -0.05120354890823364, "tuned_delta": -0.04263175687765539}, {"byte_start": 2809, "byte_end": 2818, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 480, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50%", "qwen": "0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.7790603041648865]], "qwen": [[6832, " learning", "normal", 0.8839277029037476]]}, "loss": {"rwkv": 0.5009357780864456, "qwen": 0.2472218956567819}, "topk": {"rwkv": [56537, 1, 0.7790603041648865, [[56537, 0.77906, " learning", false], [31978, 0.19959, " self", false], [30597, 0.00259, " deep", false], [65003, 0.001368, " reinforcement", false], [22590, 0.001093, " the", false], [39193, 0.001069, " other", false], [51832, 0.000805, " general", false], [21902, 0.000578, " its", false], [40093, 0.000557, " value", false], [38720, 0.000556, " human", false]]], "qwen": [6832, 1, 0.8839277029037476, [[6832, 0.883928, " learning", false], [656, 0.037151, " self", false], [3738, 0.005913, " human", false], [279, 0.004736, " the", false], [4586, 0.003994, " general", false], [1008, 0.003665, " other", false], [3960, 0.003263, " learn", false], [71278, 0.003174, " reinforcement", false], [11, 0.002926, ",", false], [5662, 0.002919, " machine", false]]]}, "raw_delta": 0.014068884982003106, "tuned_delta": 0.022640677012581354}, {"byte_start": 2818, "byte_end": 2822, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 481, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"rwkv": "4.44% 4.44% 4.44% 4.44%", "qwen": "4.28% 4.28% 4.28% 4.28%"}, "model_tokens": {"rwkv": [[21286, " are", "normal", 0.37734663486480713]], "qwen": [[525, " are", "normal", 0.3873915672302246]]}, "loss": {"rwkv": 4.437977908984604, "qwen": 4.275423669509565}, "topk": {"rwkv": [21286, 1, 0.37734663486480713, [[21286, 0.377347, " are", false], [21413, 0.066319, " can", false], [4450, 0.063431, " by", false], [31059, 0.055624, " have", false], [30322, 0.043189, " both", false], [32462, 0.035023, " were", false], [45, 0.032518, ",", false], [4596, 0.029261, " in", false], [4491, 0.013718, " do", false], [22074, 0.009527, " may", false]]], "qwen": [525, 1, 0.3873915672302246, [[525, 0.387392, " are", false], [553, 0.133823, " by", false], [646, 0.054331, " can", false], [614, 0.044623, " have", false], [2176, 0.03334, " both", false], [11, 0.030488, ",", false], [1033, 0.025587, " were", false], [304, 0.018692, " in", false], [22766, 0.015927, " complement", false], [653, 0.012731, " do", false]]]}, "raw_delta": 0.009013921022415161, "tuned_delta": 0.01758571305299341}, {"byte_start": 2822, "byte_end": 2826, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 482, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "13.24% 13.24% 13.24% 13.24%", "qwen": "12.84% 12.84% 12.84% 12.84%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.05241644009947777]], "qwen": [[279, " the", "normal", 0.05798915773630142]]}, "loss": {"rwkv": 13.243489633160404, "qwen": 12.837728815196645}, "topk": {"rwkv": [22590, 4, 0.05241644009947777, [[64857, 0.157054, " complementary", false], [30322, 0.117149, " both", false], [22187, 0.083916, " not", false], [22590, 0.052416, " the", false], [22638, 0.049132, " two", false], [32239, 0.021946, " thus", false], [59513, 0.018533, " different", false], [30135, 0.0165, " also", false], [39171, 0.01559, " often", false], [45, 0.015421, ",", false]]], "qwen": [279, 5, 0.05798915773630142, [[2176, 0.143617, " both", false], [537, 0.10829, " not", false], [57435, 0.095817, " complementary", false], [1378, 0.078652, " two", false], [279, 0.057989, " the", false], [1602, 0.029411, " very", false], [2155, 0.021551, " different", false], [42493, 0.017764, " fundamentally", false], [1075, 0.015924, " like", false], [3545, 0.015657, " often", false]]]}, "raw_delta": 0.022500157356262207, "tuned_delta": 0.031071949386840457}, {"byte_start": 2826, "byte_end": 2830, "display": {"text": " two", "kind": "normal"}, "is_word": true, "word_id": 483, "word_key": " two", "bytes_hex": "20 74 77 6f", "compression": {"rwkv": "4.72% 4.72% 4.72% 4.72%", "qwen": "3.14% 3.14% 3.14% 3.14%"}, "model_tokens": {"rwkv": [[22638, " two", "normal", 0.3510001003742218]], "qwen": [[1378, " two", "normal", 0.49840816855430603]]}, "loss": {"rwkv": 4.719754284158229, "qwen": 3.139376414584656}, "topk": {"rwkv": [22638, 1, 0.3510001003742218, [[22638, 0.351, " two", false], [31937, 0.12424, " same", false], [31581, 0.063199, " only", false], [31461, 0.054213, " most", false], [51832, 0.021634, " general", false], [52224, 0.020149, " methods", false], [31356, 0.01754, " main", false], [57481, 0.011627, " ultimate", false], [21952, 0.009799, " key", false], [37812, 0.008782, " basic", false]]], "qwen": [1378, 1, 0.49840816855430603, [[1378, 0.498408, " two", false], [1429, 0.062366, " most", false], [1172, 0.056847, " only", false], [4586, 0.038485, " general", false], [1852, 0.034889, " same", false], [1850, 0.016256, " best", false], [5413, 0.014677, " methods", false], [3363, 0.011128, " means", false], [1887, 0.011071, " main", false], [27397, 0.007124, " twin", false]]]}, "raw_delta": 0.08763475716114044, "tuned_delta": 0.09620654919171868}, {"byte_start": 2830, "byte_end": 2835, "display": {"text": " most", "kind": "normal"}, "is_word": true, "word_id": 484, "word_key": " most", "bytes_hex": "20 6d 6f 73 74", "compression": {"rwkv": "5.78% 5.78% 5.78% 5.78% 5.78%", "qwen": "6.89% 6.89% 6.89% 6.89% 6.89%"}, "model_tokens": {"rwkv": [[31461, " most", "normal", 0.19866539537906647]], "qwen": [[1429, " most", "normal", 0.14800553023815155]]}, "loss": {"rwkv": 5.776415691059325, "qwen": 6.890692575869345}, "topk": {"rwkv": [31461, 1, 0.19866539537906647, [[31461, 0.198665, " most", false], [31356, 0.111706, " main", false], [51832, 0.066345, " general", false], [52224, 0.04932, " methods", false], [39682, 0.02909, " sides", false], [61590, 0.028021, " approaches", false], [21357, 0.027703, " big", false], [37812, 0.025698, " basic", false], [63591, 0.025067, " fundamental", false], [38961, 0.0248, " major", false]]], "qwen": [1429, 1, 0.14800553023815155, [[1429, 0.148006, " most", false], [4586, 0.087399, " general", false], [1887, 0.080456, " main", false], [5413, 0.06258, " methods", false], [3598, 0.042226, " major", false], [11067, 0.038367, " sides", false], [5510, 0.034518, " ways", false], [15811, 0.02932, " fundamental", false], [6028, 0.027451, " primary", false], [19827, 0.023461, " approaches", false]]]}, "raw_delta": -0.06178863048553468, "tuned_delta": -0.05321683845495643}, {"byte_start": 2835, "byte_end": 2845, "display": {"text": " important", "kind": "normal"}, "is_word": true, "word_id": 485, "word_key": " important", "bytes_hex": "20 69 6d 70 6f 72 74 61 6e 74", "compression": {"rwkv": "2.92% 2.92% 2.92% 2.92% 2.92% 2.92% 2.92% 2.92% 2.92% 2.92%", "qwen": "3.02% 3.02% 3.02% 3.02% 3.02% 3.02% 3.02% 3.02% 3.02% 3.02%"}, "model_tokens": {"rwkv": [[59829, " important", "normal", 0.1988791674375534]], "qwen": [[2989, " important", "normal", 0.18727020919322968]]}, "loss": {"rwkv": 2.9163854830470246, "qwen": 3.0210083339813387}, "topk": {"rwkv": [59829, 2, 0.1988791674375534, [[51832, 0.234228, " general", false], [59829, 0.198879, " important", false], [59593, 0.173565, " effective", false], [56900, 0.095803, " powerful", false], [63591, 0.039601, " fundamental", false], [45534, 0.032414, " common", false], [37812, 0.022478, " basic", false], [60274, 0.018906, " promising", false], [59594, 0.01451, " efficient", false], [62603, 0.011655, " successful", false]]], "qwen": [2989, 2, 0.18727020919322968, [[7373, 0.220257, " effective", false], [2989, 0.18727, " important", false], [7988, 0.147371, " powerful", false], [4586, 0.067652, " general", false], [4185, 0.057547, " common", false], [20469, 0.025604, " prominent", false], [15811, 0.019474, " fundamental", false], [6770, 0.019341, " basic", false], [8036, 0.018842, " obvious", false], [6849, 0.017663, " successful", false]]]}, "raw_delta": -0.005801522731781, "tuned_delta": 0.002770269298797248}, {"byte_start": 2845, "byte_end": 2853, "display": {"text": " classes", "kind": "normal"}, "is_word": true, "word_id": 486, "word_key": " classes", "bytes_hex": "20 63 6c 61 73 73 65 73", "compression": {"rwkv": "10.50% 10.50% 10.50% 10.50% 10.50% 10.50% 10.50% 10.50%", "qwen": "11.57% 11.57% 11.57% 11.57% 11.57% 11.57% 11.57% 11.57%"}, "model_tokens": {"rwkv": [[51200, " classes", "normal", 0.009409043937921524]], "qwen": [[6846, " classes", "normal", 0.005898187402635813]]}, "loss": {"rwkv": 10.496169975217555, "qwen": 11.571113137905368}, "topk": {"rwkv": [51200, 19, 0.009409043937921524, [[51832, 0.171532, " general", false], [52224, 0.157667, " methods", false], [32448, 0.04766, " ways", false], [61590, 0.033871, " approaches", false], [62633, 0.032932, " techniques", false], [21265, 0.027545, " and", false], [39979, 0.024062, " tools", false], [45, 0.021598, ",", false], [38888, 0.019368, " lever", false], [64862, 0.017444, " computational", false]]], "qwen": [6846, 20, 0.005898187402635813, [[4586, 0.143531, " general", false], [5413, 0.132431, " methods", false], [5510, 0.094557, " ways", false], [7375, 0.058382, " tools", false], [19827, 0.049997, " approaches", false], [12538, 0.038348, " techniques", false], [3363, 0.028763, " means", false], [6813, 0.025909, " components", false], [54480, 0.024748, " computational", false], [13966, 0.021211, " ingredients", false]]]}, "raw_delta": -0.059607505798339844, "tuned_delta": -0.051035713767761594}, {"byte_start": 2853, "byte_end": 2856, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 487, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.06% 0.06% 0.06%", "qwen": "0.03% 0.03% 0.03%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9908678531646729]], "qwen": [[315, " of", "normal", 0.9943274855613708]]}, "loss": {"rwkv": 0.055034448276098755, "qwen": 0.034195892144145486}, "topk": {"rwkv": [4706, 1, 0.9908678531646729, [[4706, 0.990868, " of", false], [4596, 0.003537, " in", false], [45, 0.00085, ",", false], [21700, 0.000842, " for", false], [32227, 0.00058, " that", false], [275, 0.000406, " (", false], [47, 0.00033, ".", false], [4715, 0.000312, " or", false], [4811, 0.000249, " to", false], [21265, 0.000169, " and", false]]], "qwen": [315, 1, 0.9943274855613708, [[315, 0.994327, " of", false], [304, 0.001101, " in", false], [429, 0.000963, " that", false], [369, 0.000572, " for", false], [320, 0.000504, " (", false], [11, 0.000416, ",", false], [476, 0.000242, " or", false], [311, 0.000238, " to", false], [323, 0.000137, " and", false], [4221, 8.4e-05, " among", false]]]}, "raw_delta": 0.0011555349143842857, "tuned_delta": 0.009727326944962533}, {"byte_start": 2856, "byte_end": 2867, "display": {"text": " techniques", "kind": "normal"}, "is_word": true, "word_id": 488, "word_key": " techniques", "bytes_hex": "20 74 65 63 68 6e 69 71 75 65 73", "compression": {"rwkv": "5.43% 5.43% 5.43% 5.43% 5.43% 5.43% 5.43% 5.43% 5.43% 5.43% 5.43%", "qwen": "5.74% 5.74% 5.74% 5.74% 5.74% 5.74% 5.74% 5.74% 5.74% 5.74% 5.74%"}, "model_tokens": {"rwkv": [[62633, " techniques", "normal", 0.036410946398973465]], "qwen": [[12538, " techniques", "normal", 0.030211452394723892]]}, "loss": {"rwkv": 5.430599230618968, "qwen": 5.737227880581591}, "topk": {"rwkv": [62633, 5, 0.036410946398973465, [[52224, 0.401138, " methods", false], [51832, 0.213233, " general", false], [61559, 0.05683, " algorithms", false], [3609, 0.051195, " AI", false], [62633, 0.036411, " techniques", false], [61590, 0.033764, " approaches", false], [63370, 0.022006, " computation", false], [59113, 0.015465, " algorithm", false], [46561, 0.01065, " method", false], [64862, 0.010585, " computational", false]]], "qwen": [12538, 7, 0.030211452394723892, [[5413, 0.40924, " methods", false], [4586, 0.115374, " general", false], [1714, 0.07087, " method", false], [34447, 0.068192, " computation", false], [54480, 0.041362, " computational", false], [25185, 0.032391, " algorithms", false], [12538, 0.030211, " techniques", false], [19827, 0.02384, " approaches", false], [12111, 0.023117, " algorithm", false], [15235, 0.02189, " AI", false]]]}, "raw_delta": -0.01700310273603961, "tuned_delta": -0.008431310705461362}, {"byte_start": 2867, "byte_end": 2871, "display": {"text": " for", "kind": "normal"}, "is_word": true, "word_id": 489, "word_key": " for", "bytes_hex": "20 66 6f 72", "compression": {"rwkv": "5.25% 5.25% 5.25% 5.25%", "qwen": "5.20% 5.20% 5.20% 5.20%"}, "model_tokens": {"rwkv": [[21700, " for", "normal", 0.31299299001693726]], "qwen": [[369, " for", "normal", 0.31576159596443176]]}, "loss": {"rwkv": 5.248084987608777, "qwen": 5.19716361191722}, "topk": {"rwkv": [21700, 1, 0.31299299001693726, [[21700, 0.312993, " for", false], [32227, 0.235007, " that", false], [4596, 0.190611, " in", false], [45, 0.059024, ",", false], [47, 0.030487, ".", false], [4811, 0.029508, " to", false], [32354, 0.019552, " used", false], [59206, 0.012683, " available", false], [4450, 0.007349, " by", false], [21265, 0.005422, " and", false]]], "qwen": [369, 1, 0.31576159596443176, [[369, 0.315762, " for", false], [429, 0.26786, " that", false], [304, 0.126991, " in", false], [311, 0.066363, " to", false], [11, 0.043717, ",", false], [1483, 0.023521, " used", false], [2500, 0.016698, " available", false], [13, 0.015239, ".", false], [582, 0.005726, " we", false], [553, 0.00528, " by", false]]]}, "raw_delta": 0.0028236806392669678, "tuned_delta": 0.011395472669845216}, {"byte_start": 2871, "byte_end": 2881, "display": {"text": " utilizing", "kind": "normal"}, "is_word": true, "word_id": 490, "word_key": " utilizing", "bytes_hex": "20 75 74 69 6c 69 7a 69 6e 67", "compression": {"rwkv": "12.74% 12.74% 12.74% 12.74% 12.74% 12.74% 12.74% 12.74% 12.74% 12.74%", "qwen": "9.54% 9.54% 9.54% 9.54% 9.54% 9.54% 9.54% 9.54% 9.54% 9.54%"}, "model_tokens": {"rwkv": [[60720, " utilizing", "normal", 0.0008674556156620383]], "qwen": [[34888, " utilizing", "normal", 0.0050475276075303555]]}, "loss": {"rwkv": 12.736292157847878, "qwen": 9.537758817101363}, "topk": {"rwkv": [60720, 129, 0.0008674556156620383, [[51832, 0.092093, " general", false], [3609, 0.085782, " AI", false], [38888, 0.048469, " lever", false], [59832, 0.041083, " improving", false], [52949, 0.039655, " solving", false], [46500, 0.032191, " making", false], [55531, 0.020808, " applying", false], [47497, 0.019485, " taking", false], [22590, 0.019327, " the", false], [51392, 0.01912, " dealing", false]]], "qwen": [34888, 35, 0.0050475276075303555, [[76482, 0.162236, " leveraging", false], [21828, 0.083615, " solving", false], [4586, 0.049685, " general", false], [15235, 0.040716, " AI", false], [18392, 0.030699, " improving", false], [27362, 0.030692, " enabling", false], [4633, 0.023317, " taking", false], [70601, 0.022516, " exploiting", false], [1667, 0.017289, " using", false], [279, 0.016945, " the", false]]]}, "raw_delta": 0.17736434936523438, "tuned_delta": 0.18593614139581263}, {"byte_start": 2881, "byte_end": 2889, "display": {"text": " massive", "kind": "normal"}, "is_word": true, "word_id": 491, "word_key": " massive", "bytes_hex": "20 6d 61 73 73 69 76 65", "compression": {"rwkv": "4.42% 4.42% 4.42% 4.42% 4.42% 4.42% 4.42% 4.42%", "qwen": "4.69% 4.69% 4.69% 4.69% 4.69% 4.69% 4.69% 4.69%"}, "model_tokens": {"rwkv": [[52195, " massive", "normal", 0.14183133840560913]], "qwen": [[10951, " massive", "normal", 0.12494955211877823]]}, "loss": {"rwkv": 4.420366885536252, "qwen": 4.688409908592699}, "topk": {"rwkv": [52195, 2, 0.14183133840560913, [[63370, 0.505701, " computation", false], [52195, 0.141831, " massive", false], [51832, 0.088197, " general", false], [22590, 0.046436, " the", false], [59988, 0.040588, " massively", false], [38864, 0.022429, " large", false], [64862, 0.018896, " computational", false], [59346, 0.00621, " computing", false], [332, 0.005905, " a", false], [38720, 0.005461, " human", false]]], "qwen": [10951, 2, 0.12494955211877823, [[34447, 0.473113, " computation", false], [10951, 0.12495, " massive", false], [279, 0.085623, " the", false], [63707, 0.04671, " massively", false], [54480, 0.033167, " computational", false], [4586, 0.028939, " general", false], [3460, 0.018179, " large", false], [6366, 0.014301, " computer", false], [419, 0.012215, " this", false], [74151, 0.007824, " exponentially", false]]]}, "raw_delta": -0.014863461256027222, "tuned_delta": -0.0062916692254489735}, {"byte_start": 2889, "byte_end": 2897, "display": {"text": " amounts", "kind": "normal"}, "is_word": true, "word_id": 492, "word_key": " amounts", "bytes_hex": "20 61 6d 6f 75 6e 74 73", "compression": {"rwkv": "9.65% 9.65% 9.65% 9.65% 9.65% 9.65% 9.65% 9.65%", "qwen": "8.24% 8.24% 8.24% 8.24% 8.24% 8.24% 8.24% 8.24%"}, "model_tokens": {"rwkv": [[50897, " amounts", "normal", 0.013889632187783718]], "qwen": [[14713, " amounts", "normal", 0.02579469420015812]]}, "loss": {"rwkv": 9.650840849696678, "qwen": 8.244971894893352}, "topk": {"rwkv": [50897, 4, 0.013889632187783718, [[63370, 0.872918, " computation", false], [64862, 0.028989, " computational", false], [45, 0.01809, ",", false], [50897, 0.01389, " amounts", false], [59346, 0.007893, " computing", false], [56812, 0.007679, " parallel", false], [64298, 0.006149, " computations", false], [51832, 0.004509, " general", false], [51266, 0.004495, " compute", false], [59206, 0.002221, " available", false]]], "qwen": [14713, 3, 0.02579469420015812, [[34447, 0.834982, " computation", false], [54480, 0.052718, " computational", false], [14713, 0.025795, " amounts", false], [24231, 0.018217, " computing", false], [6366, 0.008259, " computer", false], [11, 0.006246, ",", false], [82599, 0.005775, " computations", false], [821, 0.002735, " data", false], [12564, 0.002578, " compute", false], [2500, 0.002349, " available", false]]]}, "raw_delta": 0.07795792818069458, "tuned_delta": 0.08652972021127282}, {"byte_start": 2897, "byte_end": 2900, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 493, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.01% 0.01% 0.01%", "qwen": "0.01% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9988504648208618]], "qwen": [[315, " of", "normal", 0.9980055689811707]]}, "loss": {"rwkv": 0.006925168074742427, "qwen": 0.012001000602508067}, "topk": {"rwkv": [4706, 1, 0.9988504648208618, [[4706, 0.99885, " of", false], [63370, 0.000213, " computation", false], [21265, 0.00016, " and", false], [275, 0.000135, " (", false], [4715, 9.2e-05, " or", false], [45, 5.4e-05, ",", false], [11, 4.6e-05, "\n", false], [4588, 3.2e-05, " if", false], [261, 2.8e-05, "\n\n", false], [267, 2.8e-05, "  ", false]]], "qwen": [315, 1, 0.9980055689811707, [[315, 0.998006, " of", false], [34447, 0.000474, " computation", false], [323, 0.000282, " and", false], [320, 0.000122, " (", false], [11, 9.3e-05, ",", false], [476, 8.8e-05, " or", false], [13, 7.9e-05, ".", false], [2500, 6.7e-05, " available", false], [198, 6e-05, "\n", false], [54480, 4.8e-05, " computational", false]]]}, "raw_delta": -0.00028146392044921714, "tuned_delta": 0.00829032811012903}, {"byte_start": 2900, "byte_end": 2912, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 494, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17%", "qwen": "0.22% 0.22% 0.22% 0.22% 0.22% 0.22% 0.22% 0.22% 0.22% 0.22% 0.22% 0.22%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.8953267335891724]], "qwen": [[34447, " computation", "normal", 0.8663378953933716]]}, "loss": {"rwkv": 0.16730472275934022, "qwen": 0.21562315894494896}, "topk": {"rwkv": [63370, 1, 0.8953267335891724, [[63370, 0.895327, " computation", false], [64862, 0.028066, " computational", false], [59346, 0.015039, " computing", false], [51266, 0.011506, " compute", false], [59206, 0.004368, " available", false], [55809, 0.004326, " computer", false], [51832, 0.003667, " general", false], [56812, 0.003351, " parallel", false], [56353, 0.00212, " hardware", false], [52167, 0.001729, " machine", false]]], "qwen": [34447, 1, 0.8663378953933716, [[34447, 0.866338, " computation", false], [54480, 0.034819, " computational", false], [821, 0.017538, " data", false], [6366, 0.013891, " computer", false], [24231, 0.0123, " computing", false], [2500, 0.011808, " available", false], [1995, 0.005185, " information", false], [12564, 0.003155, " compute", false], [3738, 0.001975, " human", false], [4586, 0.001658, " general", false]]]}, "raw_delta": -0.002679343024889627, "tuned_delta": 0.005892449005688621}, {"byte_start": 2912, "byte_end": 2915, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 495, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "14.46% 14.46% 14.46%", "qwen": "14.28% 14.28% 14.28%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.08931517601013184]], "qwen": [[304, " in", "normal", 0.09289742261171341]]}, "loss": {"rwkv": 14.464520592246117, "qwen": 14.284239778479177}, "topk": {"rwkv": [4596, 4, 0.08931517601013184, [[47, 0.455824, ".", false], [45, 0.17863, ",", false], [4811, 0.108767, " to", false], [4596, 0.089315, " in", false], [21700, 0.025316, " for", false], [21265, 0.016218, " and", false], [60, 0.015935, ";", false], [32227, 0.015852, " that", false], [63507, 0.012333, " effectively", false], [4712, 0.008639, " on", false]]], "qwen": [304, 4, 0.09289742261171341, [[13, 0.313173, ".", false], [11, 0.211635, ",", false], [382, 0.14766, ".\n\n", false], [304, 0.092897, " in", false], [311, 0.06056, " to", false], [323, 0.020972, " and", false], [26, 0.019117, ";", false], [369, 0.017094, " for", false], [624, 0.012426, ".\n", false], [429, 0.01229, " that", false]]]}, "raw_delta": 0.009996891021728516, "tuned_delta": 0.018568683052306766}, {"byte_start": 2915, "byte_end": 2918, "display": {"text": " AI", "kind": "normal"}, "is_word": true, "word_id": 496, "word_key": " ai", "bytes_hex": "20 41 49", "compression": {"rwkv": "4.70% 4.70% 4.70%", "qwen": "9.37% 9.37% 9.37%"}, "model_tokens": {"rwkv": [[3609, " AI", "normal", 0.4577257037162781]], "qwen": [[15235, " AI", "normal", 0.210323303937912]]}, "loss": {"rwkv": 4.696272919560427, "qwen": 9.372163745210477}, "topk": {"rwkv": [3609, 1, 0.4577257037162781, [[3609, 0.457726, " AI", false], [332, 0.093265, " a", false], [22590, 0.063462, " the", false], [51832, 0.051233, " general", false], [4419, 0.029316, " an", false], [52949, 0.020207, " solving", false], [61594, 0.016048, " artificial", false], [32448, 0.015452, " ways", false], [52167, 0.014971, " machine", false], [46588, 0.013959, " modern", false]]], "qwen": [15235, 1, 0.210323303937912, [[15235, 0.210323, " AI", false], [264, 0.094458, " a", false], [279, 0.078566, " the", false], [4586, 0.072917, " general", false], [458, 0.063759, " an", false], [5662, 0.041125, " machine", false], [1973, 0.030933, " order", false], [20443, 0.024568, " artificial", false], [71278, 0.022122, " reinforcement", false], [2711, 0.017161, " search", false]]]}, "raw_delta": -0.25928644339243573, "tuned_delta": -0.2507146513618575}, {"byte_start": 2918, "byte_end": 2927, "display": {"text": " research", "kind": "normal"}, "is_word": true, "word_id": 497, "word_key": " research", "bytes_hex": "20 72 65 73 65 61 72 63 68", "compression": {"rwkv": "2.88% 2.88% 2.88% 2.88% 2.88% 2.88% 2.88% 2.88% 2.88%", "qwen": "4.03% 4.03% 4.03% 4.03% 4.03% 4.03% 4.03% 4.03% 4.03%"}, "model_tokens": {"rwkv": [[57103, " research", "normal", 0.23793143033981323]], "qwen": [[3412, " research", "normal", 0.1335524618625641]]}, "loss": {"rwkv": 2.880380723997062, "qwen": 4.034057544249869}, "topk": {"rwkv": [57103, 2, 0.23793143033981323, [[47, 0.473299, ".", false], [57103, 0.237931, " research", false], [45, 0.134669, ",", false], [53087, 0.028497, " systems", false], [52224, 0.019277, " methods", false], [56949, 0.013444, " programs", false], [21265, 0.011196, " and", false], [60, 0.010851, ";", false], [275, 0.007695, " (", false], [45124, 0.005847, " agents", false]]], "qwen": [3412, 4, 0.1335524618625641, [[13, 0.313332, ".", false], [382, 0.201284, ".\n\n", false], [11, 0.157925, ",", false], [3412, 0.133552, " research", false], [5942, 0.023116, " systems", false], [26, 0.020041, ";", false], [5322, 0.018045, " problems", false], [323, 0.016884, " and", false], [624, 0.013142, ".\n", false], [8357, 0.010693, " applications", false]]]}, "raw_delta": -0.06397342681884766, "tuned_delta": -0.055401634788269406}, {"byte_start": 2927, "byte_end": 2928, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "5.53%", "qwen": "15.99%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.7364534735679626]], "qwen": [[13, ".", "normal", 0.41206297278404236]]}, "loss": {"rwkv": 5.529861362782403, "qwen": 15.988290820159683}, "topk": {"rwkv": [47, 1, 0.7364534735679626, [[47, 0.736453, ".", false], [45, 0.175021, ",", false], [21265, 0.017487, " and", false], [60, 0.014362, ";", false], [275, 0.012494, " (", false], [39971, 0.006398, " today", false], [51018, 0.003501, " because", false], [56949, 0.003443, " programs", false], [59, 0.00287, ":", false], [4596, 0.002828, " in", false]]], "qwen": [13, 1, 0.41206297278404236, [[13, 0.412063, ".", false], [382, 0.242195, ".\n\n", false], [11, 0.20158, ",", false], [323, 0.02533, " and", false], [3351, 0.02175, " today", false], [26, 0.021355, ";", false], [624, 0.019663, ".\n", false], [320, 0.01351, " (", false], [4192, 0.003885, ".\n\n\n", false], [25, 0.003144, ":", false]]]}, "raw_delta": -0.5799384713172913, "tuned_delta": -0.571366679286713}, {"byte_start": 2928, "byte_end": 2931, "display": {"text": " In", "kind": "normal"}, "is_word": true, "word_id": 498, "word_key": " in", "bytes_hex": "20 49 6e", "compression": {"rwkv": "20.57% 20.57% 20.57%", "qwen": "18.27% 18.27% 18.27%"}, "model_tokens": {"rwkv": [[3913, " In", "normal", 0.03227507695555687]], "qwen": [[758, " In", "normal", 0.047852978110313416]]}, "loss": {"rwkv": 20.56967538767467, "qwen": 18.27186391791443}, "topk": {"rwkv": [3913, 5, 0.03227507695555687, [[261, 0.423476, "\n\n", false], [20996, 0.063265, " The", false], [29893, 0.040221, " They", false], [267, 0.033824, "  ", false], [3913, 0.032275, " In", false], [44844, 0.022807, " Search", false], [3918, 0.021278, " It", false], [19555, 0.018017, " But", false], [28530, 0.016632, " Both", false], [19417, 0.016513, " And", false]]], "qwen": [758, 3, 0.047852978110313416, [[220, 0.127926, " ", false], [576, 0.096576, " The", false], [758, 0.047853, " In", false], [2379, 0.047493, " They", false], [7542, 0.038321, " Search", false], [1084, 0.034894, " It", false], [320, 0.028448, " (", false], [2619, 0.024459, " There", false], [4220, 0.018994, " These", false], [11733, 0.018804, " Both", false]]]}, "raw_delta": 0.12741772333780932, "tuned_delta": 0.13598951536838758}, {"byte_start": 2931, "byte_end": 2940, "display": {"text": " computer", "kind": "normal"}, "is_word": true, "word_id": 499, "word_key": " computer", "bytes_hex": "20 63 6f 6d 70 75 74 65 72", "compression": {"rwkv": "6.07% 6.07% 6.07% 6.07% 6.07% 6.07% 6.07% 6.07% 6.07%", "qwen": "5.53% 5.53% 5.53% 5.53% 5.53% 5.53% 5.53% 5.53% 5.53%"}, "model_tokens": {"rwkv": [[55809, " computer", "normal", 0.04809846356511116]], "qwen": [[6366, " computer", "normal", 0.06315793842077255]]}, "loss": {"rwkv": 6.073846309298153, "qwen": 5.534572731956873}, "topk": {"rwkv": [55809, 5, 0.04809846356511116, [[22590, 0.158746, " the", false], [38013, 0.094629, " chess", false], [30322, 0.078071, " both", false], [30808, 0.062159, " fact", false], [55809, 0.048098, " computer", false], [56901, 0.046506, " practice", false], [31370, 0.039199, " many", false], [32234, 0.031957, " this", false], [51832, 0.028731, " general", false], [332, 0.022042, " a", false]]], "qwen": [6366, 4, 0.06315793842077255, [[279, 0.183702, " the", false], [5994, 0.095047, " Go", false], [2097, 0.085396, " fact", false], [6366, 0.063158, " computer", false], [32719, 0.061677, " chess", false], [1657, 0.046327, " many", false], [2176, 0.041075, " both", false], [419, 0.034534, " this", false], [1045, 0.029164, " some", false], [264, 0.025614, " a", false]]]}, "raw_delta": 0.02990367677476674, "tuned_delta": 0.03847546880534499}, {"byte_start": 2940, "byte_end": 2943, "display": {"text": " Go", "kind": "normal"}, "is_word": true, "word_id": 500, "word_key": " go", "bytes_hex": "20 47 6f", "compression": {"rwkv": "3.97% 3.97% 3.97%", "qwen": "0.47% 0.47% 0.47%"}, "model_tokens": {"rwkv": [[3851, " Go", "normal", 0.5136668682098389]], "qwen": [[5994, " Go", "normal", 0.924994945526123]]}, "loss": {"rwkv": 3.968350617028561, "qwen": 0.468677580468661}, "topk": {"rwkv": [3851, 1, 0.5136668682098389, [[3851, 0.513667, " Go", false], [38013, 0.325252, " chess", false], [38576, 0.04543, " games", false], [52814, 0.02737, " science", false], [46, 0.026703, "-", false], [36466, 0.012349, " Chess", false], [47732, 0.005854, " vision", false], [47202, 0.004233, " search", false], [39311, 0.003728, " poker", false], [52491, 0.002707, " playing", false]]], "qwen": [5994, 1, 0.924994945526123, [[5994, 0.924995, " Go", false], [32719, 0.050755, " chess", false], [3868, 0.005219, " games", false], [11129, 0.002533, " vision", false], [728, 0.001525, " go", false], [19926, 0.001371, "-go", false], [20814, 0.001265, " poker", false], [1809, 0.000784, " game", false], [8038, 0.000777, " science", false], [47387, 0.00046, " Chess", false]]]}, "raw_delta": 0.1940630798538526, "tuned_delta": 0.20263487188443086}, {"byte_start": 2943, "byte_end": 2944, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "3.65%", "qwen": "2.89%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8168437480926514]], "qwen": [[11, ",", "normal", 0.851840615272522]]}, "loss": {"rwkv": 3.6454818538087816, "qwen": 2.891806851221859}, "topk": {"rwkv": [45, 1, 0.8168437480926514, [[45, 0.816844, ",", false], [21265, 0.051853, " and", false], [22590, 0.029782, " the", false], [4423, 0.013966, " as", false], [39934, 0.011708, " there", false], [4601, 0.011033, " it", false], [32232, 0.007683, " they", false], [275, 0.005776, " (", false], [4596, 0.004322, " in", false], [4424, 0.003153, " at", false]]], "qwen": [11, 1, 0.851840615272522, [[11, 0.851841, ",", false], [323, 0.023537, " and", false], [279, 0.017421, " the", false], [304, 0.013813, " in", false], [320, 0.009807, " (", false], [1052, 0.006973, " there", false], [432, 0.005671, " it", false], [419, 0.004637, " this", false], [1493, 0.004015, " these", false], [807, 0.003892, " they", false]]]}, "raw_delta": 0.0417926162481308, "tuned_delta": 0.05036440827870905}, {"byte_start": 2944, "byte_end": 2947, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 501, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"rwkv": "15.50% 15.50% 15.50%", "qwen": "17.78% 17.78% 17.78%"}, "model_tokens": {"rwkv": [[4423, " as", "normal", 0.07514823973178864]], "qwen": [[438, " as", "normal", 0.05194857344031334]]}, "loss": {"rwkv": 15.49770063454941, "qwen": 17.778216382387882}, "topk": {"rwkv": [4423, 4, 0.07514823973178864, [[22590, 0.228135, " the", false], [47202, 0.087917, " search", false], [56537, 0.087015, " learning", false], [4423, 0.075148, " as", false], [4601, 0.05964, " it", false], [39936, 0.038903, " these", false], [32232, 0.031231, " they", false], [30322, 0.023966, " both", false], [51948, 0.023287, " however", false], [21265, 0.022746, " and", false]]], "qwen": [438, 5, 0.05194857344031334, [[279, 0.195139, " the", false], [2711, 0.096289, " search", false], [6832, 0.074085, " learning", false], [1493, 0.066387, " these", false], [438, 0.051949, " as", false], [264, 0.029, " a", false], [432, 0.028833, " it", false], [2176, 0.024597, " both", false], [807, 0.023639, " they", false], [3738, 0.018343, " human", false]]]}, "raw_delta": -0.12645864486694336, "tuned_delta": -0.11788685283636512}, {"byte_start": 2947, "byte_end": 2950, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 502, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "0.83% 0.83% 0.83%", "qwen": "1.53% 1.53% 1.53%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.871487557888031]], "qwen": [[304, " in", "normal", 0.7752819657325745]]}, "loss": {"rwkv": 0.8335884432219759, "qwen": 1.530029321513405}, "topk": {"rwkv": [4596, 1, 0.871487557888031, [[4596, 0.871488, " in", false], [32487, 0.03339, " with", false], [32458, 0.024945, " well", false], [4601, 0.012148, " it", false], [59608, 0.00553, " elsewhere", false], [22748, 0.003998, " was", false], [332, 0.003713, " a", false], [22590, 0.003417, " the", false], [4600, 0.002758, " is", false], [4858, 0.002301, " we", false]]], "qwen": [304, 1, 0.7752819657325745, [[304, 0.775282, " in", false], [1632, 0.065017, " well", false], [448, 0.045322, " with", false], [17920, 0.014089, " elsewhere", false], [432, 0.009485, " it", false], [264, 0.008159, " a", false], [374, 0.007507, " is", false], [369, 0.007215, " for", false], [279, 0.006596, " the", false], [807, 0.004535, " they", false]]]}, "raw_delta": -0.038618882497151695, "tuned_delta": -0.030047090466573445}, {"byte_start": 2950, "byte_end": 2959, "display": {"text": " computer", "kind": "normal"}, "is_word": true, "word_id": 503, "word_key": " computer", "bytes_hex": "20 63 6f 6d 70 75 74 65 72", "compression": {"rwkv": "2.57% 2.57% 2.57% 2.57% 2.57% 2.57% 2.57% 2.57% 2.57%", "qwen": "2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47%"}, "model_tokens": {"rwkv": [[55809, " computer", "normal", 0.27854442596435547]], "qwen": [[6366, " computer", "normal", 0.29155558347702026]]}, "loss": {"rwkv": 2.567295862693034, "qwen": 2.4696627449869744}, "topk": {"rwkv": [55809, 2, 0.27854442596435547, [[38013, 0.450208, " chess", false], [55809, 0.278544, " computer", false], [31370, 0.081316, " many", false], [39193, 0.037325, " other", false], [22590, 0.032114, " the", false], [31461, 0.01344, " most", false], [21256, 0.010313, " all", false], [3609, 0.010308, " AI", false], [3851, 0.004859, " Go", false], [4788, 0.004682, " so", false]]], "qwen": [6366, 2, 0.29155558347702026, [[32719, 0.383288, " chess", false], [6366, 0.291556, " computer", false], [1657, 0.098925, " many", false], [1008, 0.058122, " other", false], [678, 0.038657, " all", false], [279, 0.024456, " the", false], [1429, 0.023449, " most", false], [773, 0.022911, " so", false], [1753, 0.004562, " much", false], [5994, 0.004359, " Go", false]]]}, "raw_delta": 0.0054139296213785715, "tuned_delta": 0.01398572165195682}, {"byte_start": 2959, "byte_end": 2965, "display": {"text": " chess", "kind": "normal"}, "is_word": true, "word_id": 504, "word_key": " chess", "bytes_hex": "20 63 68 65 73 73", "compression": {"rwkv": "0.07% 0.07% 0.07% 0.07% 0.07% 0.07%", "qwen": "0.04% 0.04% 0.04% 0.04% 0.04% 0.04%"}, "model_tokens": {"rwkv": [[38013, " chess", "normal", 0.9758548140525818]], "qwen": [[32719, " chess", "normal", 0.9878679513931274]]}, "loss": {"rwkv": 0.073012368046291, "qwen": 0.03668731444912257}, "topk": {"rwkv": [38013, 1, 0.9758548140525818, [[38013, 0.975855, " chess", false], [36466, 0.018626, " Chess", false], [3851, 0.000883, " Go", false], [47202, 0.000854, " search", false], [46, 0.00065, "-", false], [39311, 0.000558, " poker", false], [38576, 0.000248, " games", false], [51180, 0.000204, " checker", false], [20660, 0.000123, " Pok", false], [52814, 8.4e-05, " science", false]]], "qwen": [32719, 1, 0.9878679513931274, [[32719, 0.987868, " chess", false], [47387, 0.003848, " Chess", false], [20814, 0.001194, " poker", false], [5994, 0.001027, " Go", false], [1779, 0.00058, " check", false], [1182, 0.000245, " back", false], [14164, 0.000241, " bridge", false], [3868, 0.000149, " games", false], [11129, 0.00014, " vision", false], [61447, 0.000136, " tic", false]]]}, "raw_delta": 0.0020142886787652965, "tuned_delta": 0.010586080709343545}, {"byte_start": 2965, "byte_end": 2966, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "0.81%", "qwen": "1.98%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.9563775062561035]], "qwen": [[11, ",", "normal", 0.8959089517593384]]}, "loss": {"rwkv": 0.8057043227620858, "qwen": 1.9821993443024535}, "topk": {"rwkv": [45, 1, 0.9563775062561035, [[45, 0.956378, ",", false], [21265, 0.0132, " and", false], [45285, 0.007554, " before", false], [275, 0.00596, " (", false], [4596, 0.003062, " in", false], [22590, 0.0012, " the", false], [332, 0.001195, " a", false], [4601, 0.00068, " it", false], [51551, 0.000651, " earlier", false], [4424, 0.000578, " at", false]]], "qwen": [11, 1, 0.8959089517593384, [[11, 0.895909, ",", false], [323, 0.048074, " and", false], [1573, 0.013162, " before", false], [304, 0.009898, " in", false], [320, 0.009069, " (", false], [518, 0.001852, " at", false], [369, 0.00163, " for", false], [220, 0.001625, " ", false], [264, 0.001368, " a", false], [4867, 0.00135, " prior", false]]]}, "raw_delta": -0.06523873656988144, "tuned_delta": -0.05666694453930319}, {"byte_start": 2966, "byte_end": 2978, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 505, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"rwkv": "6.57% 6.57% 6.57% 6.57% 6.57% 6.57% 6.57% 6.57% 6.57% 6.57% 6.57% 6.57%", "qwen": "7.09% 7.09% 7.09% 7.09% 7.09% 7.09% 7.09% 7.09% 7.09% 7.09% 7.09% 7.09%"}, "model_tokens": {"rwkv": [[63843, " researchers", "normal", 0.012594263069331646]], "qwen": [[11811, " researchers", "normal", 0.008952687494456768]]}, "loss": {"rwkv": 6.574782087384598, "qwen": 7.086940688899014}, "topk": {"rwkv": [63843, 10, 0.012594263069331646, [[22590, 0.348165, " the", false], [47202, 0.093982, " search", false], [56537, 0.06539, " learning", false], [4601, 0.061346, " it", false], [39936, 0.052645, " these", false], [38720, 0.036401, " human", false], [39934, 0.031691, " there", false], [32232, 0.018513, " they", false], [332, 0.015389, " a", false], [63843, 0.012594, " researchers", false]]], "qwen": [11811, 15, 0.008952687494456768, [[279, 0.266813, " the", false], [2711, 0.094763, " search", false], [6832, 0.081794, " learning", false], [1493, 0.067788, " these", false], [432, 0.04355, " it", false], [3738, 0.03791, " human", false], [1052, 0.033235, " there", false], [264, 0.026297, " a", false], [64098, 0.019366, " brute", false], [807, 0.017445, " they", false]]]}, "raw_delta": -0.02840010325113934, "tuned_delta": -0.01982831122056109}, {"byte_start": 2978, "byte_end": 2979, "display": {"text": "'", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "27", "compression": {"rwkv": "63.96%", "qwen": "79.26%"}, "model_tokens": {"rwkv": [[40, "'", "normal", 0.029054807499051094]], "qwen": [[6, "'", "normal", 0.012339101172983646]]}, "loss": {"rwkv": 63.96323716441302, "qwen": 79.25774029696802}, "topk": {"rwkv": [40, 4, 0.029054807499051094, [[22762, 0.261008, " who", false], [32462, 0.079869, " were", false], [21795, 0.046791, " had", false], [40, 0.029055, "'", false], [21532, 0.024395, " did", false], [32487, 0.023957, " with", false], [59868, 0.021031, " initially", false], [31059, 0.018028, " have", false], [52112, 0.01637, " learned", false], [32227, 0.014176, " that", false]]], "qwen": [6, 12, 0.012339101172983646, [[879, 0.154815, " who", false], [1033, 0.119077, " were", false], [1030, 0.043249, " had", false], [614, 0.031094, " have", false], [9498, 0.030262, " learned", false], [304, 0.020639, " in", false], [15102, 0.018902, " initially", false], [525, 0.017185, " are", false], [1521, 0.016844, " did", false], [9583, 0.01548, " eventually", false]]]}, "raw_delta": -0.8481073379516602, "tuned_delta": -0.8395355459210819}, {"byte_start": 2979, "byte_end": 2987, "display": {"text": " initial", "kind": "normal"}, "is_word": true, "word_id": 506, "word_key": " initial", "bytes_hex": "20 69 6e 69 74 69 61 6c", "compression": {"rwkv": "5.35% 5.35% 5.35% 5.35% 5.35% 5.35% 5.35% 5.35%", "qwen": "4.61% 4.61% 4.61% 4.61% 4.61% 4.61% 4.61% 4.61%"}, "model_tokens": {"rwkv": [[52013, " initial", "normal", 0.09287940710783005]], "qwen": [[2856, " initial", "normal", 0.12912534177303314]]}, "loss": {"rwkv": 5.353751128298887, "qwen": 4.614306346456402}, "topk": {"rwkv": [52013, 1, 0.09287940710783005, [[52013, 0.092879, " initial", false], [62157, 0.073147, " investment", false], [38720, 0.063106, " human", false], [51566, 0.044173, " efforts", false], [61701, 0.028034, " commitment", false], [63678, 0.024073, " investments", false], [45294, 0.022275, " belief", false], [51024, 0.020855, " beliefs", false], [64997, 0.018628, " psychological", false], [65034, 0.017758, " understanding", false]]], "qwen": [2856, 1, 0.12912534177303314, [[2856, 0.129125, " initial", false], [7901, 0.106858, " failure", false], [3738, 0.028307, " human", false], [8660, 0.017108, " understanding", false], [40598, 0.014864, " disappointment", false], [82950, 0.014519, " reluctance", false], [6853, 0.014486, " lack", false], [5244, 0.013037, " focus", false], [8869, 0.011784, " efforts", false], [27850, 0.01027, " failures", false]]]}, "raw_delta": 0.041003525257110596, "tuned_delta": 0.049575317287688846}, {"byte_start": 2987, "byte_end": 2994, "display": {"text": " effort", "kind": "normal"}, "is_word": true, "word_id": 507, "word_key": " effort", "bytes_hex": "20 65 66 66 6f 72 74", "compression": {"rwkv": "13.93% 13.93% 13.93% 13.93% 13.93% 13.93% 13.93%", "qwen": "11.72% 11.72% 11.72% 11.72% 11.72% 11.72% 11.72%"}, "model_tokens": {"rwkv": [[45829, " effort", "normal", 0.004506670869886875]], "qwen": [[5041, " effort", "normal", 0.010584041476249695]]}, "loss": {"rwkv": 13.927803687153498, "qwen": 11.717795912378751}, "topk": {"rwkv": [45829, 37, 0.004506670869886875, [[51566, 0.151177, " efforts", false], [62157, 0.10848, " investment", false], [63678, 0.05266, " investments", false], [38530, 0.046918, " focus", false], [62500, 0.034469, " resistance", false], [61701, 0.028744, " commitment", false], [55572, 0.021242, " attempts", false], [62561, 0.018954, " skepticism", false], [62476, 0.01889, " reluctance", false], [45294, 0.017965, " belief", false]]], "qwen": [5041, 17, 0.010584041476249695, [[8869, 0.090965, " efforts", false], [7901, 0.074317, " failure", false], [5244, 0.066832, " focus", false], [40598, 0.032757, " disappointment", false], [15155, 0.032682, " commitment", false], [9162, 0.03148, " investment", false], [16396, 0.029786, " belief", false], [82950, 0.02839, " reluctance", false], [13553, 0.028032, " attempts", false], [3738, 0.026329, " human", false]]]}, "raw_delta": 0.12254885264805393, "tuned_delta": 0.1311206446786322}, {"byte_start": 2994, "byte_end": 2998, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 508, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "4.97% 4.97% 4.97% 4.97%", "qwen": "4.65% 4.65% 4.65% 4.65%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.3331619203090668]], "qwen": [[572, " was", "normal", 0.3565994203090668]]}, "loss": {"rwkv": 4.966308612435152, "qwen": 4.648823801930352}, "topk": {"rwkv": [22748, 1, 0.3331619203090668, [[22748, 0.333162, " was", false], [4811, 0.141249, " to", false], [4424, 0.090194, " at", false], [32460, 0.06933, " went", false], [4596, 0.042545, " in", false], [51770, 0.034064, " focused", false], [31162, 0.019866, " into", false], [21795, 0.019657, " had", false], [4712, 0.016957, " on", false], [47518, 0.016818, " tended", false]]], "qwen": [572, 1, 0.3565994203090668, [[572, 0.356599, " was", false], [311, 0.163238, " to", false], [304, 0.111005, " in", false], [3937, 0.058702, " went", false], [10735, 0.040209, " focused", false], [518, 0.027906, " at", false], [1521, 0.01743, " did", false], [1033, 0.015174, " were", false], [1030, 0.009388, " had", false], [11, 0.009278, ",", false]]]}, "raw_delta": 0.017605096101760864, "tuned_delta": 0.026176888132339114}, {"byte_start": 2998, "byte_end": 3007, "display": {"text": " directed", "kind": "normal"}, "is_word": true, "word_id": 509, "word_key": " directed", "bytes_hex": "20 64 69 72 65 63 74 65 64", "compression": {"rwkv": "6.61% 6.61% 6.61% 6.61% 6.61% 6.61% 6.61% 6.61% 6.61%", "qwen": "7.23% 7.23% 7.23% 7.23% 7.23% 7.23% 7.23% 7.23% 7.23%"}, "model_tokens": {"rwkv": [[56002, " directed", "normal", 0.037287674844264984]], "qwen": [[15540, " directed", "normal", 0.02707730233669281]]}, "loss": {"rwkv": 6.606090573515001, "qwen": 7.231627782151552}, "topk": {"rwkv": [56002, 9, 0.037287674844264984, [[4811, 0.192953, " to", false], [39762, 0.072596, " spent", false], [4596, 0.063694, " in", false], [51770, 0.062405, " focused", false], [22187, 0.060269, " not", false], [37810, 0.05508, " based", false], [51459, 0.045389, " devoted", false], [4712, 0.044941, " on", false], [56002, 0.037288, " directed", false], [56495, 0.023658, " invested", false]]], "qwen": [15540, 6, 0.02707730233669281, [[311, 0.359191, " to", false], [3118, 0.063251, " based", false], [304, 0.062321, " in", false], [10735, 0.050541, " focused", false], [537, 0.040582, " not", false], [15540, 0.027077, " directed", false], [13771, 0.021218, " largely", false], [7391, 0.021157, " spent", false], [28229, 0.019022, " devoted", false], [38828, 0.016841, " wasted", false]]]}, "raw_delta": -0.03468714820014107, "tuned_delta": -0.02611535616956282}, {"byte_start": 3007, "byte_end": 3015, "display": {"text": " towards", "kind": "normal"}, "is_word": true, "word_id": 510, "word_key": " towards", "bytes_hex": "20 74 6f 77 61 72 64 73", "compression": {"rwkv": "4.44% 4.44% 4.44% 4.44% 4.44% 4.44% 4.44% 4.44%", "qwen": "5.04% 5.04% 5.04% 5.04% 5.04% 5.04% 5.04% 5.04%"}, "model_tokens": {"rwkv": [[53169, " towards", "normal", 0.1395360380411148]], "qwen": [[6974, " towards", "normal", 0.10707979649305344]]}, "loss": {"rwkv": 4.437977908984604, "qwen": 5.036315225360426}, "topk": {"rwkv": [53169, 3, 0.1395360380411148, [[4424, 0.363651, " at", false], [47585, 0.238883, " toward", false], [53169, 0.139536, " towards", false], [4811, 0.111944, " to", false], [30211, 0.040751, " away", false], [50870, 0.020957, " against", false], [60247, 0.009616, " primarily", false], [4596, 0.00879, " in", false], [4450, 0.006458, " by", false], [31162, 0.005836, " into", false]]], "qwen": [6974, 3, 0.10707979649305344, [[518, 0.484283, " at", false], [8841, 0.184966, " toward", false], [6974, 0.10708, " towards", false], [311, 0.043649, " to", false], [2348, 0.037031, " against", false], [3123, 0.022275, " away", false], [15503, 0.014535, " primarily", false], [304, 0.010548, " in", false], [537, 0.00793, " not", false], [803, 0.007657, " more", false]]]}, "raw_delta": -0.033178865909576416, "tuned_delta": -0.024607073878998166}, {"byte_start": 3015, "byte_end": 3025, "display": {"text": " utilizing", "kind": "normal"}, "is_word": true, "word_id": 511, "word_key": " utilizing", "bytes_hex": "20 75 74 69 6c 69 7a 69 6e 67", "compression": {"rwkv": "10.93% 10.93% 10.93% 10.93% 10.93% 10.93% 10.93% 10.93% 10.93% 10.93%", "qwen": "10.55% 10.55% 10.55% 10.55% 10.55% 10.55% 10.55% 10.55% 10.55% 10.55%"}, "model_tokens": {"rwkv": [[60720, " utilizing", "normal", 0.0023603595327585936]], "qwen": [[34888, " utilizing", "normal", 0.002871462842449546]]}, "loss": {"rwkv": 10.932923356736676, "qwen": 10.554998360771686}, "topk": {"rwkv": [60720, 38, 0.0023603595327585936, [[52224, 0.203569, " methods", false], [38720, 0.117299, " human", false], [47202, 0.101278, " search", false], [22590, 0.097177, " the", false], [55586, 0.048863, " avoiding", false], [38888, 0.04015, " lever", false], [332, 0.027977, " a", false], [61590, 0.021083, " approaches", false], [40085, 0.015468, " using", false], [60463, 0.012611, " searching", false]]], "qwen": [34888, 40, 0.002871462842449546, [[5413, 0.125822, " methods", false], [3738, 0.120421, " human", false], [76482, 0.10533, " leveraging", false], [2711, 0.053487, " search", false], [279, 0.053393, " the", false], [30426, 0.041448, " avoiding", false], [264, 0.034367, " a", false], [70601, 0.029746, " exploiting", false], [1667, 0.025237, " using", false], [6832, 0.024637, " learning", false]]]}, "raw_delta": 0.02095661163330076, "tuned_delta": 0.02952840366387901}, {"byte_start": 3025, "byte_end": 3031, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 512, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "0.96% 0.96% 0.96% 0.96% 0.96% 0.96%", "qwen": "1.52% 1.52% 1.52% 1.52% 1.52% 1.52%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.7257537841796875]], "qwen": [[3738, " human", "normal", 0.6021825075149536]]}, "loss": {"rwkv": 0.9568656073604371, "qwen": 1.5244318236736045}, "topk": {"rwkv": [38720, 1, 0.7257537841796875, [[38720, 0.725754, " human", false], [39931, 0.10154, " their", false], [22590, 0.041212, " the", false], [59943, 0.022745, " knowledge", false], [47202, 0.014268, " search", false], [52195, 0.005148, " massive", false], [52964, 0.003961, " special", false], [332, 0.003898, " a", false], [39936, 0.003832, " these", false], [46227, 0.003764, " humans", false]]], "qwen": [3738, 1, 0.6021825075149536, [[3738, 0.602183, " human", false], [279, 0.087118, " the", false], [862, 0.060083, " their", false], [3281, 0.042672, " special", false], [6540, 0.030904, " knowledge", false], [2711, 0.016004, " search", false], [264, 0.011134, " a", false], [34447, 0.00597, " computation", false], [10951, 0.005759, " massive", false], [27076, 0.004542, " specialized", false]]]}, "raw_delta": -0.03147255380948385, "tuned_delta": -0.0229007617789056}, {"byte_start": 3031, "byte_end": 3045, "display": {"text": " understanding", "kind": "normal"}, "is_word": true, "word_id": 513, "word_key": " understanding", "bytes_hex": "20 75 6e 64 65 72 73 74 61 6e 64 69 6e 67", "compression": {"rwkv": "4.39% 4.39% 4.39% 4.39% 4.39% 4.39% 4.39% 4.39% 4.39% 4.39% 4.39% 4.39% 4.39% 4.39%", "qwen": "3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28%"}, "model_tokens": {"rwkv": [[65034, " understanding", "normal", 0.03325283154845238]], "qwen": [[8660, " understanding", "normal", 0.07843122631311417]]}, "loss": {"rwkv": 4.387660699132171, "qwen": 3.2789536567374693}, "topk": {"rwkv": [65034, 2, 0.03325283154845238, [[59943, 0.889831, " knowledge", false], [65034, 0.033253, " understanding", false], [59683, 0.018382, " expertise", false], [38786, 0.016128, " input", false], [46, 0.010098, "-", false], [52022, 0.002473, " insight", false], [38013, 0.002287, " chess", false], [59917, 0.002057, " intuition", false], [31702, 0.001625, " play", false], [45775, 0.001433, " domain", false]]], "qwen": [8660, 3, 0.07843122631311417, [[6540, 0.738685, " knowledge", false], [12646, 0.111411, "-k", false], [8660, 0.078431, " understanding", false], [1946, 0.025349, " input", false], [18726, 0.008945, " expertise", false], [323, 0.001976, " and", false], [1995, 0.001632, " information", false], [11229, 0.001501, " intelligence", false], [476, 0.001448, " or", false], [56251, 0.001325, " intuition", false]]]}, "raw_delta": 0.061479772840227424, "tuned_delta": 0.07005156487080567}, {"byte_start": 3045, "byte_end": 3047, "display": {"text": " (", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "20 28", "compression": {"rwkv": "39.45% 39.45%", "qwen": "37.90% 37.90%"}, "model_tokens": {"rwkv": [[275, " (", "normal", 0.01249697059392929]], "qwen": [[320, " (", "normal", 0.01495111733675003]]}, "loss": {"rwkv": 39.44869252430759, "qwen": 37.897516502681846}, "topk": {"rwkv": [275, 8, 0.01249697059392929, [[4706, 0.405488, " of", false], [45, 0.228967, ",", false], [47, 0.082108, ".", false], [21265, 0.073364, " and", false], [47001, 0.044919, " rather", false], [4596, 0.041555, " in", false], [4811, 0.036254, " to", false], [275, 0.012497, " (", false], [4423, 0.011074, " as", false], [52028, 0.009213, " instead", false]]], "qwen": [320, 9, 0.01495111733675003, [[315, 0.460297, " of", false], [11, 0.168162, ",", false], [323, 0.082457, " and", false], [311, 0.07492, " to", false], [13, 0.05549, ".", false], [4751, 0.029435, " rather", false], [476, 0.024722, " or", false], [304, 0.020419, " in", false], [320, 0.014951, " (", false], [4518, 0.007982, " instead", false]]]}, "raw_delta": 0.08601546287536621, "tuned_delta": 0.09458725490594445}, {"byte_start": 3047, "byte_end": 3049, "display": {"text": "so", "kind": "normal"}, "is_word": true, "word_id": 514, "word_key": "so", "bytes_hex": "73 6f", "compression": {"rwkv": "49.59% 49.59%", "qwen": "60.55% 60.55%"}, "model_tokens": {"rwkv": [[2190, "so", "normal", 0.0040810187347233295]], "qwen": [[704, "so", "normal", 0.0012126192450523376]]}, "loss": {"rwkv": 49.59264203055811, "qwen": 60.54785949832613}, "topk": {"rwkv": [2190, 38, 0.0040810187347233295, [[2101, 0.094433, "or", false], [7005, 0.087191, "and", false], [1950, 0.082559, "in", false], [2090, 0.057561, "of", false], [36003, 0.050845, "which", false], [1751, 0.040668, "as", false], [8801, 0.030303, "the", false], [98, 0.024738, "a", false], [42135, 0.019727, "rather", false], [1782, 0.018952, "by", false]]], "qwen": [704, 78, 0.0012126192450523376, [[269, 0.204208, "or", false], [437, 0.11614, "and", false], [258, 0.054871, "in", false], [300, 0.039512, "as", false], [8206, 0.037719, "which", false], [1782, 0.025826, "the", false], [1055, 0.025452, "of", false], [36141, 0.020878, "although", false], [64, 0.013947, "a", false], [4197, 0.013222, "with", false]]]}, "raw_delta": -0.6074862480163574, "tuned_delta": -0.5989144559857792}, {"byte_start": 3049, "byte_end": 3054, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 515, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "6.09% 6.09% 6.09% 6.09% 6.09%", "qwen": "7.08% 7.08% 7.08% 7.08% 7.08%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.1862810105085373]], "qwen": [[429, " that", "normal", 0.14031538367271423]]}, "loss": {"rwkv": 6.086369703750314, "qwen": 7.083137292575182}, "topk": {"rwkv": [32227, 2, 0.1862810105085373, [[46, 0.230581, "-", false], [32227, 0.186281, " that", false], [4423, 0.125813, " as", false], [32232, 0.062569, " they", false], [45395, 0.049735, " called", false], [22590, 0.025463, " the", false], [31466, 0.022861, " much", false], [45, 0.022699, ",", false], [4811, 0.02096, " to", false], [4601, 0.019518, " it", false]]], "qwen": [429, 2, 0.14031538367271423, [[18900, 0.328651, "-called", false], [429, 0.140315, " that", false], [2598, 0.064618, " called", false], [311, 0.061745, " to", false], [438, 0.047244, " as", false], [807, 0.039029, " they", false], [279, 0.023667, " the", false], [1753, 0.02324, " much", false], [11, 0.019221, ",", false], [432, 0.01812, " it", false]]]}, "raw_delta": -0.05527253150939937, "tuned_delta": -0.04670073947882112}, {"byte_start": 3054, "byte_end": 3059, "display": {"text": " less", "kind": "normal"}, "is_word": true, "word_id": 516, "word_key": " less", "bytes_hex": "20 6c 65 73 73", "compression": {"rwkv": "26.83% 26.83% 26.83% 26.83% 26.83%", "qwen": "24.53% 24.53% 24.53% 24.53% 24.53%"}, "model_tokens": {"rwkv": [[31277, " less", "normal", 0.0005903737619519234]], "qwen": [[2686, " less", "normal", 0.001113724778406322]]}, "loss": {"rwkv": 26.825110916529162, "qwen": 24.525978046734792}, "topk": {"rwkv": [31277, 99, 0.0005903737619519234, [[22590, 0.192673, " the", false], [32232, 0.118792, " they", false], [47202, 0.102596, " search", false], [4601, 0.072384, " it", false], [332, 0.039451, " a", false], [56537, 0.031491, " learning", false], [38720, 0.028914, " human", false], [39931, 0.025104, " their", false], [45, 0.022468, ",", false], [46227, 0.015888, " humans", false]]], "qwen": [2686, 73, 0.001113724778406322, [[279, 0.20481, " the", false], [807, 0.145276, " they", false], [432, 0.082475, " it", false], [11, 0.045246, ",", false], [3738, 0.043629, " human", false], [264, 0.041135, " a", false], [862, 0.032532, " their", false], [5994, 0.024569, " Go", false], [2711, 0.021499, " search", false], [12677, 0.017729, " humans", false]]]}, "raw_delta": 0.12749099731445312, "tuned_delta": 0.13606278934503138}, {"byte_start": 3059, "byte_end": 3066, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 517, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "7.49% 7.49% 7.49% 7.49% 7.49% 7.49% 7.49%", "qwen": "7.46% 7.46% 7.46% 7.46% 7.46% 7.46% 7.46%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.05517926067113876]], "qwen": [[2711, " search", "normal", 0.05523906648159027]]}, "loss": {"rwkv": 7.487200826042054, "qwen": 7.461012782105671}, "topk": {"rwkv": [47202, 4, 0.05517926067113876, [[63370, 0.279616, " computation", false], [52195, 0.09342, " massive", false], [45829, 0.076264, " effort", false], [47202, 0.055179, " search", false], [32251, 0.043486, " time", false], [56537, 0.030917, " learning", false], [4706, 0.030595, " of", false], [38720, 0.026767, " human", false], [22748, 0.026319, " was", false], [59346, 0.023582, " computing", false]]], "qwen": [2711, 3, 0.05523906648159027, [[34447, 0.337095, " computation", false], [882, 0.062932, " time", false], [2711, 0.055239, " search", false], [3738, 0.054309, " human", false], [5041, 0.049145, " effort", false], [315, 0.041335, " of", false], [54480, 0.029346, " computational", false], [24231, 0.026667, " computing", false], [6366, 0.022173, " computer", false], [572, 0.017356, " was", false]]]}, "raw_delta": 0.0014521735055106344, "tuned_delta": 0.010023965536088883}, {"byte_start": 3066, "byte_end": 3070, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 518, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "3.66% 3.66% 3.66% 3.66%", "qwen": "3.46% 3.46% 3.46% 3.46%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.44635388255119324]], "qwen": [[572, " was", "normal", 0.46383416652679443]]}, "loss": {"rwkv": 3.6630928772571334, "qwen": 3.463496799460949}, "topk": {"rwkv": [22748, 1, 0.44635388255119324, [[22748, 0.446354, " was", false], [40219, 0.259778, " would", false], [21265, 0.060199, " and", false], [4715, 0.05388, " or", false], [38128, 0.037509, " could", false], [21795, 0.028175, " had", false], [4600, 0.017478, " is", false], [32251, 0.01452, " time", false], [45829, 0.013382, " effort", false], [46650, 0.010046, " needed", false]]], "qwen": [572, 1, 0.46383416652679443, [[572, 0.463834, " was", false], [1035, 0.302694, " would", false], [1410, 0.052677, " could", false], [374, 0.044084, " is", false], [2578, 0.036068, " might", false], [5041, 0.022308, " effort", false], [323, 0.013622, " and", false], [11, 0.0084, ",", false], [5980, 0.006814, "-based", false], [1231, 0.005859, " may", false]]]}, "raw_delta": 0.011067956686019897, "tuned_delta": 0.019639748716598147}, {"byte_start": 3070, "byte_end": 3077, "display": {"text": " needed", "kind": "normal"}, "is_word": true, "word_id": 519, "word_key": " needed", "bytes_hex": "20 6e 65 65 64 65 64", "compression": {"rwkv": "1.85% 1.85% 1.85% 1.85% 1.85% 1.85% 1.85%", "qwen": "1.83% 1.83% 1.83% 1.83% 1.83% 1.83% 1.83%"}, "model_tokens": {"rwkv": [[46650, " needed", "normal", 0.48742541670799255]], "qwen": [[4362, " needed", "normal", 0.4906936287879944]]}, "loss": {"rwkv": 1.8516733225695396, "qwen": 1.834116965035213}, "topk": {"rwkv": [46650, 1, 0.48742541670799255, [[46650, 0.487425, " needed", false], [57101, 0.339497, " required", false], [60050, 0.132029, " necessary", false], [30666, 0.006985, " done", false], [56500, 0.006829, " involved", false], [60152, 0.003734, " performed", false], [55448, 0.003093, " actually", false], [32354, 0.001828, " used", false], [56895, 0.001333, " possible", false], [4811, 0.000938, " to", false]]], "qwen": [4362, 1, 0.4906936287879944, [[4362, 0.490694, " needed", false], [2567, 0.33809, " required", false], [5871, 0.128202, " necessary", false], [2814, 0.008532, " done", false], [1483, 0.004738, " used", false], [6398, 0.002998, " involved", false], [10660, 0.002806, " performed", false], [3204, 0.00258, " possible", false], [3520, 0.002044, " actually", false], [9251, 0.001293, " applied", false]]]}, "raw_delta": 0.0009735311780657008, "tuned_delta": 0.009545323208643949}, {"byte_start": 3077, "byte_end": 3078, "display": {"text": ")", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29", "compression": {"rwkv": "18.17%", "qwen": "23.27%"}, "model_tokens": {"rwkv": [[42, ")", "normal", 0.3699245750904083]], "qwen": [[8, ")", "normal", 0.27510666847229004]]}, "loss": {"rwkv": 18.174576198698855, "qwen": 23.27421221143226}, "topk": {"rwkv": [42, 1, 0.3699245750904083, [[42, 0.369925, ")", false], [497, 0.332328, "),", false], [499, 0.121045, ").", false], [45, 0.050915, ",", false], [4811, 0.044693, " to", false], [21265, 0.018407, " and", false], [4715, 0.00916, " or", false], [21700, 0.00907, " for", false], [4596, 0.008958, " in", false], [502, 0.008178, ");", false]]], "qwen": [8, 2, 0.27510666847229004, [[701, 0.362747, "),", false], [8, 0.275107, ")", false], [568, 0.237883, ").", false], [11, 0.02339, ",", false], [1215, 0.020628, ");", false], [311, 0.02036, " to", false], [3593, 0.014575, ").\n\n", false], [323, 0.012792, " and", false], [304, 0.004909, " in", false], [369, 0.00392, " for", false]]]}, "raw_delta": -0.2827838659286499, "tuned_delta": -0.2742120738980717}, {"byte_start": 3078, "byte_end": 3082, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 520, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "4.75% 4.75% 4.75% 4.75%", "qwen": "6.03% 6.03% 6.03% 6.03%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.34676387906074524]], "qwen": [[323, " and", "normal", 0.2626458406448364]]}, "loss": {"rwkv": 4.754976331054933, "qwen": 6.02752863447568}, "topk": {"rwkv": [21265, 1, 0.34676387906074524, [[21265, 0.346764, " and", false], [47001, 0.239757, " rather", false], [21400, 0.19219, " but", false], [4715, 0.063797, " or", false], [40187, 0.028047, " while", false], [52028, 0.015544, " instead", false], [4596, 0.015222, " in", false], [4423, 0.011613, " as", false], [45285, 0.010545, " before", false], [4811, 0.007172, " to", false]]], "qwen": [323, 2, 0.2626458406448364, [[714, 0.439768, " but", false], [323, 0.262646, " and", false], [4751, 0.118464, " rather", false], [476, 0.043201, " or", false], [4518, 0.016896, " instead", false], [311, 0.012526, " to", false], [304, 0.011211, " in", false], [1177, 0.010443, " --", false], [438, 0.006834, " as", false], [1393, 0.006713, " while", false]]]}, "raw_delta": -0.07056528329849243, "tuned_delta": -0.06199349126791418}, {"byte_start": 3082, "byte_end": 3087, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 521, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"rwkv": "10.93% 10.93% 10.93% 10.93% 10.93%", "qwen": "14.81% 14.81% 14.81% 14.81% 14.81%"}, "model_tokens": {"rwkv": [[31581, " only", "normal", 0.04779050499200821]], "qwen": [[1172, " only", "normal", 0.01648406870663166]]}, "loss": {"rwkv": 10.932923356736675, "qwen": 14.806959834583077}, "topk": {"rwkv": [31581, 6, 0.04779050499200821, [[32230, 0.106557, " then", false], [32234, 0.071504, " this", false], [22590, 0.064578, " the", false], [56537, 0.060568, " learning", false], [45, 0.05272, ",", false], [31581, 0.047791, " only", false], [32232, 0.041411, " they", false], [32227, 0.031797, " that", false], [4601, 0.028144, " it", false], [22187, 0.02412, " not", false]]], "qwen": [1172, 13, 0.01648406870663166, [[419, 0.085718, " this", false], [11, 0.082977, ",", false], [1221, 0.072507, " then", false], [279, 0.062896, " the", false], [862, 0.042075, " their", false], [6974, 0.042065, " towards", false], [807, 0.04025, " they", false], [429, 0.037697, " that", false], [537, 0.030036, " not", false], [432, 0.027768, " it", false]]]}, "raw_delta": -0.2148221969604492, "tuned_delta": -0.20625040492987096}, {"byte_start": 3087, "byte_end": 3092, "display": {"text": " much", "kind": "normal"}, "is_word": true, "word_id": 522, "word_key": " much", "bytes_hex": "20 6d 75 63 68", "compression": {"rwkv": "11.72% 11.72% 11.72% 11.72% 11.72%", "qwen": "15.20% 15.20% 15.20% 15.20% 15.20%"}, "model_tokens": {"rwkv": [[31466, " much", "normal", 0.03886871039867401]], "qwen": [[1753, " much", "normal", 0.0147688128054142]]}, "loss": {"rwkv": 11.721897207222828, "qwen": 15.20325601731323}, "topk": {"rwkv": [31466, 5, 0.03886871039867401, [[38869, 0.458746, " later", false], [37634, 0.128596, " after", false], [32465, 0.045201, " when", false], [61552, 0.044255, " afterwards", false], [31466, 0.038869, " much", false], [32230, 0.029004, " then", false], [47205, 0.027375, " second", false], [4596, 0.018488, " in", false], [4424, 0.014949, " at", false], [59771, 0.011795, " gradually", false]]], "qwen": [1753, 8, 0.0147688128054142, [[2937, 0.466931, " later", false], [1283, 0.152772, " after", false], [979, 0.060403, " when", false], [304, 0.04391, " in", false], [1221, 0.033484, " then", false], [264, 0.021305, " a", false], [26024, 0.015625, " gradually", false], [1753, 0.014769, " much", false], [518, 0.01123, " at", false], [3055, 0.008694, " once", false]]]}, "raw_delta": -0.19304752349853516, "tuned_delta": -0.1844757314679569}, {"byte_start": 3092, "byte_end": 3098, "display": {"text": " later", "kind": "normal"}, "is_word": true, "word_id": 523, "word_key": " later", "bytes_hex": "20 6c 61 74 65 72", "compression": {"rwkv": "0.06% 0.06% 0.06% 0.06% 0.06% 0.06%", "qwen": "0.05% 0.05% 0.05% 0.05% 0.05% 0.05%"}, "model_tokens": {"rwkv": [[38869, " later", "normal", 0.97950279712677]], "qwen": [[2937, " later", "normal", 0.9822579026222229]]}, "loss": {"rwkv": 0.062372374712911925, "qwen": 0.053804716338493846}, "topk": {"rwkv": [38869, 1, 0.97950279712677, [[38869, 0.979503, " later", false], [31458, 0.009658, " more", false], [45, 0.002336, ",", false], [31466, 0.00095, " much", false], [46405, 0.000949, " latter", false], [61552, 0.00082, " afterwards", false], [37634, 0.000819, " after", false], [31255, 0.000636, " late", false], [51816, 0.000634, " further", false], [31277, 0.000567, " less", false]]], "qwen": [2937, 1, 0.9822579026222229, [[2937, 0.982258, " later", false], [803, 0.005995, " more", false], [11, 0.003197, ",", false], [5021, 0.002368, " longer", false], [4623, 0.002054, " further", false], [1283, 0.000772, " after", false], [15271, 0.00027, " latter", false], [28393, 0.000231, " slower", false], [2686, 0.000211, " less", false], [8131, 0.000192, " larger", false]]]}, "raw_delta": 0.0004750918596982956, "tuned_delta": 0.009046883890276544}, {"byte_start": 3098, "byte_end": 3102, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 524, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "9.72% 9.72% 9.72% 9.72%", "qwen": "11.38% 11.38% 11.38% 11.38%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.11592810600996017]], "qwen": [[572, " was", "normal", 0.08012823015451431]]}, "loss": {"rwkv": 9.721284943490085, "qwen": 11.37982973404948}, "topk": {"rwkv": [22748, 2, 0.11592810600996017, [[21532, 0.541503, " did", false], [22748, 0.115928, " was", false], [32462, 0.10857, " were", false], [45, 0.073, ",", false], [53169, 0.025974, " towards", false], [47585, 0.012947, " toward", false], [275, 0.00969, " (", false], [30383, 0.009638, " came", false], [4712, 0.006647, " on", false], [4596, 0.005592, " in", false]]], "qwen": [572, 3, 0.08012823015451431, [[1521, 0.530067, " did", false], [11, 0.086312, ",", false], [572, 0.080128, " was", false], [1033, 0.063535, " were", false], [6974, 0.045399, " towards", false], [807, 0.045398, " they", false], [320, 0.023243, " (", false], [311, 0.015634, " to", false], [304, 0.007121, " in", false], [6519, 0.006442, " turned", false]]]}, "raw_delta": -0.09196925163269043, "tuned_delta": -0.08339745960211219}, {"byte_start": 3102, "byte_end": 3107, "display": {"text": " much", "kind": "normal"}, "is_word": true, "word_id": 525, "word_key": " much", "bytes_hex": "20 6d 75 63 68", "compression": {"rwkv": "21.64% 21.64% 21.64% 21.64% 21.64%", "qwen": "22.89% 22.89% 22.89% 22.89% 22.89%"}, "model_tokens": {"rwkv": [[31466, " much", "normal", 0.002497876062989235]], "qwen": [[1753, " much", "normal", 0.0017537848325446248]]}, "loss": {"rwkv": 21.640425613334447, "qwen": 22.88828185302624}, "topk": {"rwkv": [31466, 23, 0.002497876062989235, [[22590, 0.226275, " the", false], [4601, 0.195146, " it", false], [56537, 0.135421, " learning", false], [47202, 0.092641, " search", false], [39934, 0.043747, " there", false], [32234, 0.043389, " this", false], [32227, 0.032814, " that", false], [39931, 0.027075, " their", false], [52195, 0.018011, " massive", false], [332, 0.016077, " a", false]]], "qwen": [1753, 29, 0.0017537848325446248, [[279, 0.308798, " the", false], [432, 0.210639, " it", false], [2711, 0.118688, " search", false], [1052, 0.045521, " there", false], [419, 0.039567, " this", false], [264, 0.033565, " a", false], [429, 0.027979, " that", false], [862, 0.023797, " their", false], [807, 0.012551, " they", false], [458, 0.012507, " an", false]]]}, "raw_delta": -0.06919584274292001, "tuned_delta": -0.06062405071234176}, {"byte_start": 3107, "byte_end": 3115, "display": {"text": " greater", "kind": "normal"}, "is_word": true, "word_id": 526, "word_key": " greater", "bytes_hex": "20 67 72 65 61 74 65 72", "compression": {"rwkv": "7.40% 7.40% 7.40% 7.40% 7.40% 7.40% 7.40% 7.40%", "qwen": "5.54% 5.54% 5.54% 5.54% 5.54% 5.54% 5.54% 5.54%"}, "model_tokens": {"rwkv": [[51867, " greater", "normal", 0.037600304931402206]], "qwen": [[7046, " greater", "normal", 0.08576159179210663]]}, "loss": {"rwkv": 7.396629848307673, "qwen": 5.536756792190434}, "topk": {"rwkv": [51867, 5, 0.037600304931402206, [[31458, 0.344054, " more", false], [4706, 0.204652, " of", false], [45829, 0.075449, " effort", false], [47202, 0.044362, " search", false], [51867, 0.0376, " greater", false], [31277, 0.034233, " less", false], [59193, 0.021018, " attention", false], [56537, 0.018753, " learning", false], [45683, 0.016974, " deeper", false], [45301, 0.015936, " better", false]]], "qwen": [7046, 3, 0.08576159179210663, [[803, 0.497301, " more", false], [315, 0.092637, " of", false], [7046, 0.085762, " greater", false], [2664, 0.043084, " better", false], [8131, 0.034521, " larger", false], [2686, 0.027994, " less", false], [5041, 0.015091, " effort", false], [11243, 0.013299, " bigger", false], [2711, 0.013052, " search", false], [6529, 0.012105, " attention", false]]]}, "raw_delta": 0.10313326120376587, "tuned_delta": 0.11170505323434411}, {"byte_start": 3115, "byte_end": 3123, "display": {"text": " success", "kind": "normal"}, "is_word": true, "word_id": 527, "word_key": " success", "bytes_hex": "20 73 75 63 63 65 73 73", "compression": {"rwkv": "5.42% 5.42% 5.42% 5.42% 5.42% 5.42% 5.42% 5.42%", "qwen": "12.94% 12.94% 12.94% 12.94% 12.94% 12.94% 12.94% 12.94%"}, "model_tokens": {"rwkv": [[53052, " success", "normal", 0.0909983441233635]], "qwen": [[2393, " success", "normal", 0.003210589289665222]]}, "loss": {"rwkv": 5.424195222092293, "qwen": 12.942102936222147}, "topk": {"rwkv": [53052, 2, 0.0909983441233635, [[45829, 0.182586, " effort", false], [53052, 0.090998, " success", false], [47202, 0.084582, " search", false], [56950, 0.071137, " progress", false], [63370, 0.052609, " computation", false], [64862, 0.042148, " computational", false], [22681, 0.040962, " use", false], [64902, 0.038508, " effectiveness", false], [56103, 0.032701, " emphasis", false], [57077, 0.024547, " reliance", false]]], "qwen": [2393, 21, 0.003210589289665222, [[5041, 0.395522, " effort", false], [24654, 0.16705, " emphasis", false], [2711, 0.120219, " search", false], [6529, 0.045958, " attention", false], [54480, 0.03399, " computational", false], [5244, 0.025252, " focus", false], [990, 0.023858, " use", false], [32064, 0.016879, " leverage", false], [34447, 0.012279, " computation", false], [2355, 0.008149, " power", false]]]}, "raw_delta": -0.4168813228607178, "tuned_delta": -0.40830953083013954}, {"byte_start": 3123, "byte_end": 3127, "display": {"text": " had", "kind": "normal"}, "is_word": true, "word_id": 528, "word_key": " had", "bytes_hex": "20 68 61 64", "compression": {"rwkv": "16.55% 16.55% 16.55% 16.55%", "qwen": "15.10% 15.10% 15.10% 15.10%"}, "model_tokens": {"rwkv": [[21795, " had", "normal", 0.0256732739508152]], "qwen": [[1030, " had", "normal", 0.03509770333766937]]}, "loss": {"rwkv": 16.554362041450506, "qwen": 15.101498827298919}, "topk": {"rwkv": [21795, 6, 0.0256732739508152, [[55437, 0.408485, " achieved", false], [38547, 0.115582, " found", false], [56741, 0.076742, " obtained", false], [31968, 0.065383, " seen", false], [57027, 0.059663, " realized", false], [21795, 0.025673, " had", false], [55571, 0.024821, " attained", false], [4596, 0.022397, " in", false], [51097, 0.01655, " brought", false], [21572, 0.013365, " due", false]]], "qwen": [1030, 6, 0.03509770333766937, [[16994, 0.519765, " achieved", false], [12180, 0.081078, " obtained", false], [15043, 0.071143, " realized", false], [1730, 0.054407, " found", false], [62160, 0.038328, " attained", false], [1030, 0.035098, " had", false], [18163, 0.021739, " gained", false], [3204, 0.017975, " possible", false], [3884, 0.014565, " seen", false], [1865, 0.014538, " made", false]]]}, "raw_delta": 0.08056384325027466, "tuned_delta": 0.0891356352808529}, {"byte_start": 3127, "byte_end": 3130, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 529, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "8.88% 8.88% 8.88%", "qwen": "16.99% 16.99% 16.99%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.22978253662586212]], "qwen": [[553, " by", "normal", 0.05922115221619606]]}, "loss": {"rwkv": 8.875955817969208, "qwen": 16.990598901741535}, "topk": {"rwkv": [4450, 2, 0.22978253662586212, [[32487, 0.305985, " with", false], [4450, 0.229783, " by", false], [4596, 0.116747, " in", false], [30259, 0.083631, " been", false], [32465, 0.0293, " when", false], [30917, 0.028723, " from", false], [4712, 0.024422, " on", false], [40085, 0.020209, " using", false], [4811, 0.017967, " to", false], [30482, 0.013175, " come", false]]], "qwen": [553, 4, 0.05922115221619606, [[16994, 0.270542, " achieved", false], [304, 0.08869, " in", false], [311, 0.084446, " to", false], [553, 0.059221, " by", false], [15043, 0.053533, " realized", false], [279, 0.039495, " the", false], [1730, 0.03894, " found", false], [448, 0.024488, " with", false], [13, 0.020905, ".", false], [62160, 0.017123, " attained", false]]]}, "raw_delta": -0.44997135798136395, "tuned_delta": -0.4413995659507857}, {"byte_start": 3130, "byte_end": 3140, "display": {"text": " embracing", "kind": "normal"}, "is_word": true, "word_id": 530, "word_key": " embracing", "bytes_hex": "20 65 6d 62 72 61 63 69 6e 67", "compression": {"rwkv": "7.78% 7.78% 7.78% 7.78% 7.78% 7.78% 7.78% 7.78% 7.78% 7.78%", "qwen": "10.73% 10.73% 10.73% 10.73% 10.73% 10.73% 10.73% 10.73% 10.73% 10.73%"}, "model_tokens": {"rwkv": [[59611, " embracing", "normal", 0.013404577039182186]], "qwen": [[55401, " embracing", "normal", 0.002601034939289093]]}, "loss": {"rwkv": 7.777027954792068, "qwen": 10.733373606767065}, "topk": {"rwkv": [59611, 14, 0.013404577039182186, [[40085, 0.093338, " using", false], [38888, 0.083852, " lever", false], [56537, 0.070385, " learning", false], [60720, 0.061764, " utilizing", false], [22590, 0.043762, " the", false], [47497, 0.036913, " taking", false], [55531, 0.034593, " applying", false], [332, 0.022074, " a", false], [47285, 0.020393, " simply", false], [52700, 0.019382, " relying", false]]], "qwen": [55401, 51, 0.002601034939289093, [[76482, 0.100302, " leveraging", false], [1667, 0.070835, " using", false], [18950, 0.06986, " applying", false], [279, 0.038026, " the", false], [2711, 0.034177, " search", false], [34888, 0.033063, " utilizing", false], [5413, 0.032772, " methods", false], [11811, 0.031422, " researchers", false], [15039, 0.030786, " searching", false], [4633, 0.028974, " taking", false]]]}, "raw_delta": -0.16393461227416992, "tuned_delta": -0.15536282024359166}, {"byte_start": 3140, "byte_end": 3147, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 531, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "2.04% 2.04% 2.04% 2.04% 2.04% 2.04% 2.04%", "qwen": "3.91% 3.91% 3.91% 3.91% 3.91% 3.91% 3.91%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.44809770584106445]], "qwen": [[2711, " search", "normal", 0.21910656988620758]]}, "loss": {"rwkv": 2.042878720008786, "qwen": 3.9112417303970552}, "topk": {"rwkv": [47202, 1, 0.44809770584106445, [[47202, 0.448098, " search", false], [22590, 0.209414, " the", false], [52195, 0.063619, " massive", false], [56537, 0.055673, " learning", false], [21265, 0.038601, " and", false], [332, 0.023735, " a", false], [51832, 0.020836, " general", false], [63370, 0.01426, " computation", false], [37920, 0.008584, " brute", false], [31458, 0.006744, " more", false]]], "qwen": [2711, 2, 0.21910656988620758, [[279, 0.224037, " the", false], [2711, 0.219107, " search", false], [34447, 0.139735, " computation", false], [10951, 0.126667, " massive", false], [4586, 0.039499, " general", false], [64098, 0.023071, " brute", false], [54480, 0.015243, " computational", false], [264, 0.015111, " a", false], [6832, 0.013645, " learning", false], [3460, 0.010581, " large", false]]]}, "raw_delta": -0.10360404423304968, "tuned_delta": -0.09503225220247144}, {"byte_start": 3147, "byte_end": 3151, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 532, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "8.17% 8.17% 8.17% 8.17%", "qwen": "7.99% 7.99% 7.99% 7.99%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.16404545307159424]], "qwen": [[323, " and", "normal", 0.17001445591449738]]}, "loss": {"rwkv": 8.171514880035144, "qwen": 7.988345832625277}, "topk": {"rwkv": [21265, 2, 0.16404545307159424, [[47, 0.382502, ".", false], [21265, 0.164045, " and", false], [4423, 0.118605, " as", false], [45, 0.054232, ",", false], [275, 0.048288, " (", false], [46, 0.01957, "-", false], [4596, 0.01727, " in", false], [32487, 0.01584, " with", false], [46342, 0.014273, " itself", false], [31458, 0.012311, " more", false]]], "qwen": [323, 3, 0.17001445591449738, [[13, 0.275088, ".", false], [382, 0.179275, ".\n\n", false], [323, 0.170014, " and", false], [11, 0.060514, ",", false], [320, 0.046399, " (", false], [438, 0.042173, " as", false], [518, 0.029792, " at", false], [304, 0.025262, " in", false], [5980, 0.019391, "-based", false], [311, 0.009923, " to", false]]]}, "raw_delta": 0.01015704870223999, "tuned_delta": 0.01872884073281824}, {"byte_start": 3151, "byte_end": 3160, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 533, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "0.71% 0.71% 0.71% 0.71% 0.71% 0.71% 0.71% 0.71% 0.71%", "qwen": "0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.7037807703018188]], "qwen": [[6832, " learning", "normal", 0.6542668342590332]]}, "loss": {"rwkv": 0.7083544987003645, "qwen": 0.8500679044303276}, "topk": {"rwkv": [56537, 1, 0.7037807703018188, [[56537, 0.703781, " learning", false], [31978, 0.047677, " self", false], [38888, 0.033895, " lever", false], [22590, 0.021175, " the", false], [21902, 0.020025, " its", false], [45, 0.008132, ",", false], [55586, 0.007394, " avoiding", false], [4450, 0.006453, " by", false], [40085, 0.005997, " using", false], [52129, 0.005276, " letting", false]]], "qwen": [6832, 1, 0.6542668342590332, [[6832, 0.654267, " learning", false], [656, 0.038117, " self", false], [76482, 0.036463, " leveraging", false], [11, 0.035101, ",", false], [553, 0.017691, " by", false], [1181, 0.015146, " its", false], [1221, 0.013366, " then", false], [279, 0.013133, " the", false], [34447, 0.009518, " computation", false], [1008, 0.007302, " other", false]]]}, "raw_delta": -0.00785825981034173, "tuned_delta": 0.0007135322202365176}, {"byte_start": 3160, "byte_end": 3162, "display": {"text": ".\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e 0a", "compression": {"rwkv": "8.14% 4.09%", "qwen": "7.92% 7.92%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.6419187188148499], [261, "\n\n", "control", 0.6377475261688232]], "qwen": [[382, ".\n\n", "control", 0.2678096890449524]]}, "loss": {"rwkv": 6.111025136578006, "qwen": 7.919666352489161}, "topk": {"rwkv": [47, 1, 0.6419187188148499, [[47, 0.641919, ".", false], [4423, 0.078597, " as", false], [45, 0.048777, ",", false], [4450, 0.033713, " by", false], [275, 0.024425, " (", false], [4596, 0.020929, " in", false], [21265, 0.012378, " and", false], [4811, 0.010892, " to", false], [31458, 0.009224, " more", false], [52028, 0.009113, " instead", false]]], "qwen": [382, 2, 0.2678096890449524, [[13, 0.349543, ".", false], [382, 0.26781, ".\n\n", false], [438, 0.062033, " as", false], [11, 0.042986, ",", false], [320, 0.03386, " (", false], [518, 0.031675, " at", false], [304, 0.026401, " in", false], [553, 0.026048, " by", false], [624, 0.014623, ".\n", false], [311, 0.014055, " to", false]]]}, "raw_delta": -0.1002923647562663, "tuned_delta": -0.09172057272568805}, {"byte_start": 3162, "byte_end": 3163, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "4.09%", "qwen": "7.92%"}, "model_tokens": {"rwkv": [[261, "\n\n", "control", 0.6377475261688232]], "qwen": [[382, ".\n\n", "control", 0.2678096890449524]]}, "loss": {"rwkv": 4.085757440017572, "qwen": 7.919666352489161}, "topk": {"rwkv": [261, 1, 0.6377475261688232, [[261, 0.637748, "\n\n", false], [20996, 0.040391, " The", false], [267, 0.033178, "  ", false], [3913, 0.021198, " In", false], [29894, 0.020926, " This", false], [3918, 0.015197, " It", false], [3336, 0.014963, " \n\n", false], [19417, 0.01011, " And", false], [19555, 0.009394, " But", false], [3328, 0.008935, "\n\n\n", false]]], "qwen": [382, 2, 0.2678096890449524, [[13, 0.349543, ".", false], [382, 0.26781, ".\n\n", false], [438, 0.062033, " as", false], [11, 0.042986, ",", false], [320, 0.03386, " (", false], [518, 0.031675, " at", false], [304, 0.026401, " in", false], [553, 0.026048, " by", false], [624, 0.014623, ".\n", false], [311, 0.014055, " to", false]]]}, "raw_delta": -0.2125970522562663, "tuned_delta": -0.20402526022568804}, {"byte_start": 3163, "byte_end": 3165, "display": {"text": "In", "kind": "normal"}, "is_word": true, "word_id": 534, "word_key": "in", "bytes_hex": "49 6e", "compression": {"rwkv": "16.27% 16.27%", "qwen": "14.30% 14.30%"}, "model_tokens": {"rwkv": [[1136, "In", "normal", 0.16476811468601227]], "qwen": [[641, "In", "normal", 0.20481045544147491]]}, "loss": {"rwkv": 16.272585666276882, "qwen": 14.297742208057853}, "topk": {"rwkv": [1136, 1, 0.16476811468601227, [[1136, 0.164768, "In", false], [6699, 0.148463, "The", false], [66, 0.083091, "A", false], [48358, 0.057915, "Another", false], [33504, 0.039198, "There", false], [1141, 0.025535, "It", false], [24242, 0.018545, "This", false], [58094, 0.016799, "Similarly", false], [6393, 0.015119, "One", false], [33505, 0.015112, "These", false]]], "qwen": [641, 1, 0.20481045544147491, [[641, 0.20481, "In", false], [785, 0.130888, "The", false], [32, 0.057549, "A", false], [14037, 0.046997, "Another", false], [3862, 0.033794, "There", false], [37332, 0.019945, "Computer", false], [1986, 0.018975, "This", false], [2132, 0.016819, "It", false], [9485, 0.014706, "These", false], [3966, 0.013877, "One", false]]]}, "raw_delta": 0.10950857400894165, "tuned_delta": 0.1180803660395199}, {"byte_start": 3165, "byte_end": 3172, "display": {"text": " speech", "kind": "normal"}, "is_word": true, "word_id": 535, "word_key": " speech", "bytes_hex": "20 73 70 65 65 63 68", "compression": {"rwkv": "13.69% 13.69% 13.69% 13.69% 13.69% 13.69% 13.69%", "qwen": "13.46% 13.46% 13.46% 13.46% 13.46% 13.46% 13.46%"}, "model_tokens": {"rwkv": [[47350, " speech", "normal", 0.0049649751745164394]], "qwen": [[8806, " speech", "normal", 0.0053747124038636684]]}, "loss": {"rwkv": 13.686281079861814, "qwen": 13.46356600388949}, "topk": {"rwkv": [47350, 24, 0.0049649751745164394, [[55809, 0.327519, " computer", false], [22590, 0.123117, " the", false], [3492, 0.039047, " 19", false], [52299, 0.034119, " natural", false], [52766, 0.03024, " robotic", false], [52167, 0.029188, " machine", false], [3609, 0.027223, " AI", false], [51832, 0.021017, " general", false], [3493, 0.020056, " 20", false], [31370, 0.016802, " many", false]]], "qwen": [8806, 20, 0.0053747124038636684, [[279, 0.194954, " the", false], [6366, 0.167436, " computer", false], [73606, 0.065926, " robotics", false], [71278, 0.027959, " reinforcement", false], [5662, 0.025601, " machine", false], [1657, 0.023437, " many", false], [220, 0.021513, " ", false], [264, 0.018057, " a", false], [678, 0.017338, " all", false], [2176, 0.016811, " both", false]]]}, "raw_delta": 0.012349946158272895, "tuned_delta": 0.020921738188851145}, {"byte_start": 3172, "byte_end": 3184, "display": {"text": " recognition", "kind": "normal"}, "is_word": true, "word_id": 536, "word_key": " recognition", "bytes_hex": "20 72 65 63 6f 67 6e 69 74 69 6f 6e", "compression": {"rwkv": "0.14% 0.14% 0.14% 0.14% 0.14% 0.14% 0.14% 0.14% 0.14% 0.14% 0.14% 0.14%", "qwen": "0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45%"}, "model_tokens": {"rwkv": [[63821, " recognition", "normal", 0.910800576210022]], "qwen": [[17843, " recognition", "normal", 0.7405100464820862]]}, "loss": {"rwkv": 0.13942060229945022, "qwen": 0.45146749157513333}, "topk": {"rwkv": [63821, 1, 0.910800576210022, [[63821, 0.910801, " recognition", false], [21265, 0.017009, " and", false], [46, 0.015004, "-", false], [45, 0.012315, ",", false], [62378, 0.011844, " processing", false], [60615, 0.010048, " synthesis", false], [65034, 0.007881, " understanding", false], [63944, 0.002946, " translation", false], [62035, 0.002079, " generation", false], [62634, 0.000906, " technology", false]]], "qwen": [17843, 1, 0.7405100464820862, [[17843, 0.74051, " recognition", false], [323, 0.073654, " and", false], [38875, 0.037246, " synthesis", false], [11, 0.032458, ",", false], [8692, 0.024103, " processing", false], [8660, 0.015766, " understanding", false], [5440, 0.013933, " technology", false], [3412, 0.010654, " research", false], [59172, 0.008406, "-rec", false], [4686, 0.002944, "-to", false]]]}, "raw_delta": -0.0173035537203153, "tuned_delta": -0.008731761689737052}, {"byte_start": 3184, "byte_end": 3185, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "2.75%", "qwen": "3.65%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8587448000907898]], "qwen": [[11, ",", "normal", 0.8166376948356628]]}, "loss": {"rwkv": 2.74731965794285, "qwen": 3.6528986056272403}, "topk": {"rwkv": [45, 1, 0.8587448000907898, [[45, 0.858745, ",", false], [21265, 0.067216, " and", false], [275, 0.009614, " (", false], [22590, 0.009349, " the", false], [57103, 0.008136, " research", false], [39934, 0.007132, " there", false], [53087, 0.004491, " systems", false], [4601, 0.004453, " it", false], [4596, 0.00248, " in", false], [332, 0.002215, " a", false]]], "qwen": [11, 1, 0.8166376948356628, [[11, 0.816638, ",", false], [323, 0.053789, " and", false], [3412, 0.044563, " research", false], [320, 0.024043, " (", false], [304, 0.010581, " in", false], [5942, 0.007971, " systems", false], [1052, 0.004169, " there", false], [279, 0.003158, " the", false], [518, 0.002123, " at", false], [369, 0.002005, " for", false]]]}, "raw_delta": -0.050215959548950195, "tuned_delta": -0.041644167518371945}, {"byte_start": 3185, "byte_end": 3191, "display": {"text": " there", "kind": "normal"}, "is_word": true, "word_id": 537, "word_key": " there", "bytes_hex": "20 74 68 65 72 65", "compression": {"rwkv": "9.58% 9.58% 9.58% 9.58% 9.58% 9.58%", "qwen": "9.39% 9.39% 9.39% 9.39% 9.39% 9.39%"}, "model_tokens": {"rwkv": [[39934, " there", "normal", 0.041605982929468155]], "qwen": [[1052, " there", "normal", 0.0440269410610199]]}, "loss": {"rwkv": 9.580396755903271, "qwen": 9.386394592974995}, "topk": {"rwkv": [39934, 4, 0.041605982929468155, [[22590, 0.365746, " the", false], [63843, 0.086614, " researchers", false], [332, 0.049329, " a", false], [39934, 0.041606, " there", false], [4601, 0.024879, " it", false], [40186, 0.014319, " which", false], [50919, 0.013814, " another", false], [38328, 0.012859, " early", false], [22226, 0.012047, " one", false], [4423, 0.011603, " as", false]]], "qwen": [1052, 5, 0.0440269410610199, [[279, 0.276267, " the", false], [264, 0.065506, " a", false], [4124, 0.049636, " early", false], [11811, 0.047668, " researchers", false], [1052, 0.044027, " there", false], [458, 0.01796, " an", false], [432, 0.01707, " it", false], [304, 0.016023, " in", false], [3412, 0.015395, " research", false], [3738, 0.015389, " human", false]]]}, "raw_delta": 0.010757764180501339, "tuned_delta": 0.01932955621107959}, {"byte_start": 3191, "byte_end": 3195, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 538, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "3.75% 3.75% 3.75% 3.75%", "qwen": "3.51% 3.51% 3.51% 3.51%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.4342584013938904]], "qwen": [[572, " was", "normal", 0.4586254358291626]]}, "loss": {"rwkv": 3.7511479944988912, "qwen": 3.5144114570802074}, "topk": {"rwkv": [22748, 1, 0.4342584013938904, [[22748, 0.434258, " was", false], [32462, 0.205648, " were", false], [21800, 0.11211, " has", false], [4600, 0.093833, " is", false], [31059, 0.062746, " have", false], [21286, 0.047831, " are", false], [21795, 0.016404, " had", false], [30135, 0.00243, " also", false], [39620, 0.002053, " seems", false], [22614, 0.001832, " too", false]]], "qwen": [572, 1, 0.4586254358291626, [[572, 0.458625, " was", false], [1033, 0.19218, " were", false], [702, 0.119229, " has", false], [374, 0.079648, " is", false], [614, 0.058493, " have", false], [525, 0.046995, " are", false], [1030, 0.015486, " had", false], [1083, 0.003227, " also", false], [1483, 0.002581, " used", false], [15102, 0.002502, " initially", false]]]}, "raw_delta": 0.013127461075782776, "tuned_delta": 0.021699253106361026}, {"byte_start": 3195, "byte_end": 3198, "display": {"text": " an", "kind": "normal"}, "is_word": true, "word_id": 539, "word_key": " an", "bytes_hex": "20 61 6e", "compression": {"rwkv": "13.43% 13.43% 13.43%", "qwen": "11.65% 11.65% 11.65%"}, "model_tokens": {"rwkv": [[4419, " an", "normal", 0.10843311995267868]], "qwen": [[458, " an", "normal", 0.14387594163417816]]}, "loss": {"rwkv": 13.43134054994282, "qwen": 11.654594949822933}, "topk": {"rwkv": [4419, 2, 0.10843311995267868, [[332, 0.505881, " a", false], [4419, 0.108433, " an", false], [30135, 0.051776, " also", false], [22590, 0.031101, " the", false], [59868, 0.02628, " initially", false], [50919, 0.02625, " another", false], [30788, 0.021297, " even", false], [52906, 0.020631, " similar", false], [31466, 0.017201, " much", false], [4692, 0.015729, " no", false]]], "qwen": [458, 2, 0.14387594163417816, [[264, 0.44822, " a", false], [458, 0.143876, " an", false], [1083, 0.063595, " also", false], [15102, 0.039345, " initially", false], [1753, 0.020871, " much", false], [2441, 0.018998, " another", false], [279, 0.015884, " the", false], [1045, 0.013977, " some", false], [2856, 0.013189, " initial", false], [902, 0.012129, " no", false]]]}, "raw_delta": 0.09852369626363111, "tuned_delta": 0.10709548829420935}, {"byte_start": 3198, "byte_end": 3204, "display": {"text": " early", "kind": "normal"}, "is_word": true, "word_id": 540, "word_key": " early", "bytes_hex": "20 65 61 72 6c 79", "compression": {"rwkv": "4.98% 4.98% 4.98% 4.98% 4.98% 4.98%", "qwen": "5.60% 5.60% 5.60% 5.60% 5.60% 5.60%"}, "model_tokens": {"rwkv": [[38328, " early", "normal", 0.19043795764446259]], "qwen": [[4124, " early", "normal", 0.15495134890079498]]}, "loss": {"rwkv": 4.9780492947340536, "qwen": 5.604401510043859}, "topk": {"rwkv": [38328, 2, 0.19043795764446259, [[52013, 0.233134, " initial", false], [38328, 0.190438, " early", false], [30788, 0.15006, " even", false], [51639, 0.042763, " equally", false], [59134, 0.035616, " analogous", false], [51551, 0.022189, " earlier", false], [59829, 0.018427, " important", false], [45829, 0.016659, " effort", false], [56125, 0.012986, " enormous", false], [52035, 0.010989, " intense", false]]], "qwen": [4124, 2, 0.15495134890079498, [[2856, 0.439237, " initial", false], [4124, 0.154951, " early", false], [6788, 0.037533, " earlier", false], [1496, 0.026808, " even", false], [2989, 0.023843, " important", false], [5041, 0.02224, " effort", false], [7040, 0.019334, " interesting", false], [18308, 0.018332, " equally", false], [4774, 0.01645, " attempt", false], [22399, 0.014664, " enormous", false]]]}, "raw_delta": -0.03473234176635742, "tuned_delta": -0.026160549735779172}, {"byte_start": 3204, "byte_end": 3216, "display": {"text": " competition", "kind": "normal"}, "is_word": true, "word_id": 541, "word_key": " competition", "bytes_hex": "20 63 6f 6d 70 65 74 69 74 69 6f 6e", "compression": {"rwkv": "9.02% 9.02% 9.02% 9.02% 9.02% 9.02% 9.02% 9.02% 9.02% 9.02% 9.02% 9.02%", "qwen": "12.69% 12.69% 12.69% 12.69% 12.69% 12.69% 12.69% 12.69% 12.69% 12.69% 12.69% 12.69%"}, "model_tokens": {"rwkv": [[63361, " competition", "normal", 0.0025059119798243046]], "qwen": [[10707, " competition", "normal", 0.00021447411563713104]]}, "loss": {"rwkv": 9.01684400555602, "qwen": 12.694697293823454}, "topk": {"rwkv": [63361, 58, 0.0025059119798243046, [[45829, 0.128628, " effort", false], [45, 0.047331, ",", false], [46790, 0.047023, " period", false], [21265, 0.046186, " and", false], [50976, 0.043196, " attempt", false], [55532, 0.037538, " approach", false], [56103, 0.031512, " emphasis", false], [31813, 0.020199, " race", false], [32447, 0.016303, " wave", false], [45294, 0.015906, " belief", false]]], "qwen": [10707, 293, 0.00021447411563713104, [[5041, 0.176581, " effort", false], [4168, 0.084525, " period", false], [4774, 0.084485, " attempt", false], [11, 0.035262, ",", false], [16396, 0.030165, " belief", false], [12060, 0.025291, " wave", false], [323, 0.02347, " and", false], [3738, 0.020796, " human", false], [7901, 0.020668, " failure", false], [30854, 0.020547, " tendency", false]]]}, "raw_delta": -0.20394349098205566, "tuned_delta": -0.1953716989514774}, {"byte_start": 3216, "byte_end": 3217, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "72.13%", "qwen": "64.79%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.018264463171362877]], "qwen": [[11, ",", "normal", 0.027518654242157936]]}, "loss": {"rwkv": 72.13475204444816, "qwen": 64.7930792522237}, "topk": {"rwkv": [45, 5, 0.018264463171362877, [[51035, 0.769351, " between", false], [4811, 0.039499, " to", false], [37694, 0.033841, " among", false], [4596, 0.030007, " in", false], [45, 0.018264, ",", false], [32487, 0.016816, " with", false], [21700, 0.016061, " for", false], [4706, 0.012016, " of", false], [32227, 0.010963, " that", false], [275, 0.005901, " (", false]]], "qwen": [11, 8, 0.027518654242157936, [[304, 0.250155, " in", false], [1948, 0.178994, " between", false], [429, 0.107616, " that", false], [311, 0.068565, " to", false], [369, 0.033285, " for", false], [448, 0.030391, " with", false], [2598, 0.029603, " called", false], [11, 0.027519, ",", false], [320, 0.026758, " (", false], [518, 0.023081, " at", false]]]}, "raw_delta": 0.40710878372192383, "tuned_delta": 0.41568057575250206}, {"byte_start": 3217, "byte_end": 3227, "display": {"text": " sponsored", "kind": "normal"}, "is_word": true, "word_id": 542, "word_key": " sponsored", "bytes_hex": "20 73 70 6f 6e 73 6f 72 65 64", "compression": {"rwkv": "11.33% 11.33% 11.33% 11.33% 11.33% 11.33% 11.33% 11.33% 11.33% 11.33%", "qwen": "6.79% 6.79% 6.79% 6.79% 6.79% 6.79% 6.79% 6.79% 6.79% 6.79%"}, "model_tokens": {"rwkv": [[60543, " sponsored", "normal", 0.0018463052110746503]], "qwen": [[29538, " sponsored", "normal", 0.02318495884537697]]}, "loss": {"rwkv": 11.32741028197975, "qwen": 6.7883340915119526}, "topk": {"rwkv": [60543, 68, 0.0018463052110746503, [[4596, 0.18676, " in", false], [51035, 0.080088, " between", false], [22590, 0.040197, " the", false], [32487, 0.037731, " with", false], [30917, 0.034535, " from", false], [40186, 0.030379, " which", false], [57295, 0.024309, " starting", false], [21265, 0.020234, " and", false], [3492, 0.019021, " 19", false], [45202, 0.01845, " around", false]]], "qwen": [29538, 7, 0.02318495884537697, [[304, 0.261176, " in", false], [279, 0.133815, " the", false], [2598, 0.048218, " called", false], [323, 0.034305, " and", false], [5644, 0.030072, " held", false], [892, 0.023604, " which", false], [29538, 0.023185, " sponsored", false], [3881, 0.020487, " known", false], [448, 0.019819, " with", false], [96127, 0.017136, " DAR", false]]]}, "raw_delta": 0.25169982910156247, "tuned_delta": 0.2602716211321407}, {"byte_start": 3227, "byte_end": 3230, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 543, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "0.40% 0.40% 0.40%", "qwen": "0.17% 0.17% 0.17%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.9355474710464478]], "qwen": [[553, " by", "normal", 0.972740650177002]]}, "loss": {"rwkv": 0.40211836873736156, "qwen": 0.16613700982584528}, "topk": {"rwkv": [4450, 1, 0.9355474710464478, [[4450, 0.935547, " by", false], [4596, 0.0308, " in", false], [52063, 0.006403, " jointly", false], [21265, 0.003917, " and", false], [4424, 0.002611, " at", false], [21700, 0.002492, " for", false], [4423, 0.002065, " as", false], [59868, 0.001265, " initially", false], [46768, 0.001179, " partly", false], [45, 0.001036, ",", false]]], "qwen": [553, 1, 0.972740650177002, [[553, 0.972741, " by", false], [304, 0.010446, " in", false], [52158, 0.003276, " jointly", false], [323, 0.003095, " and", false], [518, 0.001075, " at", false], [27037, 0.000755, " partly", false], [438, 0.000746, " as", false], [11, 0.00068, ",", false], [15102, 0.000552, " initially", false], [369, 0.00038, " for", false]]]}, "raw_delta": 0.013085585087537764, "tuned_delta": 0.021657377118116012}, {"byte_start": 3230, "byte_end": 3234, "display": {"text": " DAR", "kind": "normal"}, "is_word": true, "word_id": 544, "word_key": " dar", "bytes_hex": "20 44 41 52", "compression": {"rwkv": "6.06% 6.06% 6.06% 6.06%", "qwen": "12.82% 12.82% 12.82% 12.82%"}, "model_tokens": {"rwkv": [[19678, " DAR", "normal", 0.26150837540626526]], "qwen": [[96127, " DAR", "normal", 0.05827023833990097]]}, "loss": {"rwkv": 6.058192066232952, "qwen": 12.815927864416649}, "topk": {"rwkv": [19678, 1, 0.26150837540626526, [[19678, 0.261508, " DAR", false], [22590, 0.203837, " the", false], [20077, 0.179209, " IBM", false], [28484, 0.093815, " Bell", false], [3620, 0.074024, " AT", false], [54894, 0.023838, " Carnegie", false], [323, 0.017206, " X", false], [332, 0.015336, " a", false], [36292, 0.007002, " Apple", false], [62041, 0.006133, " government", false]]], "qwen": [96127, 4, 0.05827023833990097, [[27922, 0.30154, " IBM", false], [17884, 0.282074, " Bell", false], [279, 0.10406, " the", false], [96127, 0.05827, " DAR", false], [7369, 0.046139, " AT", false], [1599, 0.022942, " X", false], [264, 0.017722, " a", false], [5085, 0.01045, " Google", false], [5100, 0.009302, " Microsoft", false], [15611, 0.0087, " Intel", false]]]}, "raw_delta": -0.3747284412384033, "tuned_delta": -0.3661566492078251}, {"byte_start": 3234, "byte_end": 3236, "display": {"text": "PA", "kind": "normal"}, "is_word": true, "word_id": 545, "word_key": "pa", "bytes_hex": "50 41", "compression": {"rwkv": "0.00% 0.00%", "qwen": "0.00% 0.00%"}, "model_tokens": {"rwkv": [[1342, "PA", "normal", 0.9996206760406494]], "qwen": [[8041, "PA", "normal", 0.9999293088912964]]}, "loss": {"rwkv": 0.0034052564870836106, "qwen": 0.0006373881968423287}, "topk": {"rwkv": [1342, 1, 0.9996206760406494, [[1342, 0.999621, "PA", false], [6405, 8.3e-05, "PAN", false], [81, 7.4e-05, "P", false], [66, 3.9e-05, "A", false], [85, 2.3e-05, "T", false], [1356, 1.5e-05, "PP", false], [2111, 1.2e-05, "pa", false], [1470, 1.2e-05, "TA", false], [827, 9e-06, "AP", false], [6407, 9e-06, "PAS", false]]], "qwen": [8041, 1, 0.9999293088912964, [[8041, 0.999929, "PA", false], [20291, 2.7e-05, "Pa", false], [6595, 6e-06, "pa", false], [47, 6e-06, "P", false], [12878, 3e-06, " PA", false], [4872, 3e-06, "PC", false], [23304, 3e-06, "WIN", false], [54, 2e-06, "W", false], [4406, 2e-06, "PP", false], [81450, 2e-06, "PCA", false]]]}, "raw_delta": 0.0001534832081233617, "tuned_delta": 0.00872527523870161}, {"byte_start": 3236, "byte_end": 3237, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "4.31%", "qwen": "2.21%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.7888008952140808]], "qwen": [[11, ",", "normal", 0.8846657872200012]]}, "loss": {"rwkv": 4.314700744846142, "qwen": 2.209944548117162}, "topk": {"rwkv": [45, 1, 0.7888008952140808, [[45, 0.788801, ",", false], [4596, 0.100737, " in", false], [21265, 0.054736, " and", false], [275, 0.023392, " (", false], [51035, 0.003307, " between", false], [21700, 0.0031, " for", false], [4811, 0.002906, " to", false], [4423, 0.002458, " as", false], [460, 0.001865, "'s", false], [45805, 0.001627, " during", false]]], "qwen": [11, 1, 0.8846657872200012, [[11, 0.884666, ",", false], [304, 0.040663, " in", false], [323, 0.027295, " and", false], [320, 0.020129, " (", false], [13, 0.005623, ".", false], [429, 0.002827, " that", false], [311, 0.001975, " to", false], [594, 0.001838, "'s", false], [518, 0.001258, " at", false], [369, 0.001099, " for", false]]]}, "raw_delta": 0.11671246588230133, "tuned_delta": 0.1252842579128796}, {"byte_start": 3237, "byte_end": 3240, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 546, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "15.22% 15.22% 15.22%", "qwen": "8.62% 8.62% 8.62%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.08052660524845123]], "qwen": [[304, " in", "normal", 0.23855070769786835]]}, "loss": {"rwkv": 15.215924259375784, "qwen": 8.615134095614458}, "topk": {"rwkv": [4596, 3, 0.08052660524845123, [[51035, 0.588954, " between", false], [4811, 0.137252, " to", false], [4596, 0.080527, " in", false], [32227, 0.055003, " that", false], [21700, 0.031132, " for", false], [32487, 0.014863, " with", false], [40186, 0.014385, " which", false], [37694, 0.009269, " among", false], [40185, 0.007082, " where", false], [4706, 0.00515, " of", false]]], "qwen": [304, 2, 0.23855070769786835, [[311, 0.238995, " to", false], [304, 0.238551, " in", false], [429, 0.175627, " that", false], [369, 0.05571, " for", false], [1948, 0.040542, " between", false], [892, 0.031381, " which", false], [1380, 0.031349, " where", false], [448, 0.028236, " with", false], [2598, 0.025995, " called", false], [323, 0.01324, " and", false]]]}, "raw_delta": 0.36602552731831867, "tuned_delta": 0.3745973193488969}, {"byte_start": 3240, "byte_end": 3244, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 547, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "11.98% 11.98% 11.98% 11.98%", "qwen": "8.54% 8.54% 8.54% 8.54%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.06948770582675934]], "qwen": [[279, " the", "normal", 0.1504439413547516]]}, "loss": {"rwkv": 11.97549594487909, "qwen": 8.539694264110675}, "topk": {"rwkv": [22590, 3, 0.06948770582675934, [[40186, 0.696188, " which", false], [3492, 0.089394, " 19", false], [22590, 0.069488, " the", false], [53342, 0.007611, " whether", false], [52224, 0.005943, " methods", false], [40085, 0.005289, " using", false], [22638, 0.005097, " two", false], [332, 0.004836, " a", false], [61857, 0.004387, " developing", false], [47350, 0.003569, " speech", false]]], "qwen": [279, 3, 0.1504439413547516, [[892, 0.647437, " which", false], [220, 0.170432, " ", false], [279, 0.150444, " the", false], [9902, 0.001091, " ``", false], [48083, 0.001075, " recognizing", false], [8806, 0.001071, " speech", false], [1246, 0.001006, " how", false], [264, 0.000975, " a", false], [1667, 0.000938, " using", false], [3309, 0.000766, " late", false]]]}, "raw_delta": 0.19052129983901978, "tuned_delta": 0.19909309186959803}, {"byte_start": 3244, "byte_end": 3247, "display": {"text": " 19", "kind": "normal"}, "is_word": true, "word_id": 548, "word_key": " 19", "bytes_hex": "20 31 39", "compression": {"rwkv": "6.01% 6.01% 6.01%", "qwen": "12.98% 0.19% 0.00%"}, "model_tokens": {"rwkv": [[3492, " 19", "normal", 0.3674902021884918]], "qwen": [[220, " ", "normal", 0.4868954122066498], [16, "1", "normal", 0.9896891117095947], [24, "9", "normal", 0.9997244477272034]]}, "loss": {"rwkv": 6.011229337037347, "qwen": 4.390276775293654}, "topk": {"rwkv": [3492, 1, 0.3674902021884918, [[3492, 0.36749, " 19", false], [31255, 0.149987, " late", false], [38328, 0.090776, " early", false], [22089, 0.055917, " mid", false], [22681, 0.03991, " use", false], [63469, 0.016627, " development", false], [30899, 0.011415, " form", false], [38478, 0.007578, " field", false], [4273, 0.007523, " US", false], [45010, 0.00728, " United", false]]], "qwen": [220, 1, 0.4868954122066498, [[220, 0.486895, " ", false], [3309, 0.207656, " late", false], [4124, 0.125531, " early", false], [5099, 0.097892, " mid", false], [990, 0.004568, " use", false], [3639, 0.004485, " United", false], [9902, 0.003857, " ``", false], [2274, 0.003569, " US", false], [4401, 0.003243, " development", false], [1042, 0.002953, " year", false]]]}, "raw_delta": 0.08988469583952487, "tuned_delta": 0.09845648787010311}, {"byte_start": 3247, "byte_end": 3249, "display": {"text": "70", "kind": "normal"}, "is_word": true, "word_id": 549, "word_key": "70", "bytes_hex": "37 30", "compression": {"rwkv": "8.00% 8.00%", "qwen": "25.38% 0.02%"}, "model_tokens": {"rwkv": [[690, "70", "normal", 0.41248324513435364]], "qwen": [[22, "7", "normal", 0.24479924142360687], [15, "0", "normal", 0.9991158843040466]]}, "loss": {"rwkv": 7.995404645551628, "qwen": 12.697532554416602}, "topk": {"rwkv": [690, 1, 0.41248324513435364, [[690, 0.412483, "70", false], [680, 0.283178, "60", false], [700, 0.129796, "80", false], [710, 0.115721, "90", false], [670, 0.025593, "50", false], [686, 0.003766, "66", false], [689, 0.00332, "69", false], [711, 0.002239, "91", false], [691, 0.002143, "71", false], [687, 0.001669, "67", false]]], "qwen": [22, 3, 0.24479924142360687, [[24, 0.345654, "9", false], [23, 0.263998, "8", false], [22, 0.244799, "7", false], [21, 0.126102, "6", false], [20, 0.016886, "5", false], [19, 0.001879, "4", false], [18, 0.000354, "3", false], [15, 0.000186, "0", false], [17, 6.5e-05, "2", false], [16, 1.6e-05, "1", false]]]}, "raw_delta": -0.26074133621295914, "tuned_delta": -0.2521695441823809}, {"byte_start": 3249, "byte_end": 3250, "display": {"text": "s", "kind": "normal"}, "is_word": true, "word_id": 550, "word_key": "s", "bytes_hex": "73", "compression": {"rwkv": "2.20%", "qwen": "1.25%"}, "model_tokens": {"rwkv": [[116, "s", "normal", 0.885227620601654]], "qwen": [[82, "s", "normal", 0.9332221746444702]]}, "loss": {"rwkv": 2.2013779310439503, "qwen": 1.2463441628509455}, "topk": {"rwkv": [116, 1, 0.885227620601654, [[116, 0.885228, "s", false], [460, 0.111462, "'s", false], [21265, 0.000614, " and", false], [46, 0.000477, "-", false], [28309, 0.000448, "’s", false], [97, 0.000223, "`", false], [350, 0.000156, " s", false], [40, 0.000148, "'", false], [9835, 0.000127, "′", false], [45, 8.5e-05, ",", false]]], "qwen": [82, 1, 0.9332221746444702, [[82, 0.933222, "s", false], [594, 0.0611, "'s", false], [748, 0.001087, "’s", false], [274, 0.001046, " s", false], [38515, 0.00053, "′", false], [12, 0.000401, "-", false], [550, 0.000263, "ies", false], [11, 0.000204, ",", false], [323, 0.000146, " and", false], [429, 0.000109, " that", false]]]}, "raw_delta": 0.05295831710100174, "tuned_delta": 0.06153010913157999}, {"byte_start": 3250, "byte_end": 3251, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "69.04%", "qwen": "44.10%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.021778911352157593]], "qwen": [[13, ".", "normal", 0.08669820427894592]]}, "loss": {"rwkv": 69.03521191753828, "qwen": 44.09817469732327}, "topk": {"rwkv": [47, 6, 0.021778911352157593, [[51035, 0.381235, " between", false], [45, 0.207386, ",", false], [21265, 0.173183, " and", false], [4811, 0.095693, " to", false], [32227, 0.040025, " that", false], [47, 0.021779, ".", false], [21700, 0.014593, " for", false], [4596, 0.009535, " in", false], [32487, 0.005555, " with", false], [37694, 0.005413, " among", false]]], "qwen": [13, 4, 0.08669820427894592, [[11, 0.429518, ",", false], [429, 0.095464, " that", false], [311, 0.095161, " to", false], [13, 0.086698, ".", false], [323, 0.082738, " and", false], [304, 0.04481, " in", false], [1948, 0.027085, " between", false], [2598, 0.020796, " called", false], [369, 0.017049, " for", false], [320, 0.014453, " (", false]]]}, "raw_delta": 1.382802963256836, "tuned_delta": 1.3913747552874143}, {"byte_start": 3251, "byte_end": 3260, "display": {"text": " Entrants", "kind": "normal"}, "is_word": true, "word_id": 551, "word_key": " entrants", "bytes_hex": "20 45 6e 74 72 61 6e 74 73", "compression": {"rwkv": "34.80% 34.80% 34.80% 34.80% 3.59% 3.59% 3.59% 3.59% 0.22%", "qwen": "40.55% 40.55% 40.55% 40.55% 40.55% 0.06% 0.06% 0.06% 0.06%"}, "model_tokens": {"rwkv": [[19830, " Ent", "normal", 0.0004425676597747952], [26809, "rant", "normal", 0.4516456723213196], [116, "s", "normal", 0.9878607392311096]], "qwen": [[47141, " Entr", "normal", 1.311307914875215e-05], [1783, "ants", "normal", 0.9865424633026123]]}, "loss": {"rwkv": 17.08758469585893, "qwen": 22.55302913193068}, "topk": {"rwkv": [19830, 108, 0.0004425676597747952, [[20996, 0.315605, " The", false], [20556, 0.145259, " One", false], [3918, 0.059293, " It", false], [3913, 0.043634, " In", false], [29894, 0.043511, " This", false], [37451, 0.028093, " There", false], [63222, 0.024791, " Researchers", false], [300, 0.022096, " A", false], [19678, 0.015182, " DAR", false], [29804, 0.015114, " Some", false]]], "qwen": [47141, 1259, 1.311307914875215e-05, [[576, 0.293552, " The", false], [1084, 0.109592, " It", false], [1096, 0.083515, " This", false], [758, 0.048719, " In", false], [362, 0.029816, " A", false], [2619, 0.027854, " There", false], [11445, 0.01968, " Its", false], [3776, 0.019046, " One", false], [2411, 0.01553, " At", false], [58150, 0.015228, " Researchers", false]]]}, "raw_delta": -0.3030685921096139, "tuned_delta": -0.29449680007903567}, {"byte_start": 3260, "byte_end": 3269, "display": {"text": " included", "kind": "normal"}, "is_word": true, "word_id": 552, "word_key": " included", "bytes_hex": "20 69 6e 63 6c 75 64 65 64", "compression": {"rwkv": "5.60% 5.60% 5.60% 5.60% 5.60% 5.60% 5.60% 5.60% 5.60%", "qwen": "8.71% 8.71% 8.71% 8.71% 8.71% 8.71% 8.71% 8.71% 8.71%"}, "model_tokens": {"rwkv": [[56427, " included", "normal", 0.06150316074490547]], "qwen": [[5230, " included", "normal", 0.012943398207426071]]}, "loss": {"rwkv": 5.60421901734211, "qwen": 8.710610741970532}, "topk": {"rwkv": [56427, 2, 0.06150316074490547, [[32462, 0.414593, " were", false], [56427, 0.061503, " included", false], [32354, 0.053603, " used", false], [21795, 0.042334, " had", false], [4811, 0.04173, " to", false], [55796, 0.022861, " competed", false], [38128, 0.022067, " could", false], [4596, 0.02121, " in", false], [22762, 0.01614, " who", false], [59506, 0.01222, " developed", false]]], "qwen": [5230, 13, 0.012943398207426071, [[1033, 0.298909, " were", false], [1483, 0.085028, " used", false], [304, 0.082163, " in", false], [1030, 0.052615, " had", false], [311, 0.051618, " to", false], [14634, 0.024043, " submitted", false], [2765, 0.022824, " won", false], [6, 0.015722, "'", false], [429, 0.014798, " that", false], [6679, 0.01377, " tried", false]]]}, "raw_delta": -0.17225493325127494, "tuned_delta": -0.1636831412206967}, {"byte_start": 3269, "byte_end": 3271, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 553, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "22.82% 22.82%", "qwen": "21.65% 21.65%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.07904893159866333]], "qwen": [[264, " a", "normal", 0.09066668152809143]]}, "loss": {"rwkv": 22.823886389063677, "qwen": 21.645521459279514}, "topk": {"rwkv": [332, 3, 0.07904893159866333, [[63843, 0.108868, " researchers", false], [22590, 0.097801, " the", false], [332, 0.079049, " a", false], [30322, 0.052179, " both", false], [22638, 0.027818, " two", false], [32074, 0.023717, " some", false], [31370, 0.023121, " many", false], [46787, 0.0176, " people", false], [46131, 0.015359, " groups", false], [52869, 0.015197, " several", false]]], "qwen": [264, 2, 0.09066668152809143, [[27922, 0.149647, " IBM", false], [264, 0.090667, " a", false], [11811, 0.083081, " researchers", false], [279, 0.074898, " the", false], [17884, 0.065079, " Bell", false], [14865, 0.02785, " MIT", false], [1657, 0.025836, " many", false], [1378, 0.018612, " two", false], [1045, 0.017207, " some", false], [3807, 0.016664, " several", false]]]}, "raw_delta": 0.06534242630004883, "tuned_delta": 0.07391421833062707}, {"byte_start": 3271, "byte_end": 3276, "display": {"text": " host", "kind": "normal"}, "is_word": true, "word_id": 554, "word_key": " host", "bytes_hex": "20 68 6f 73 74", "compression": {"rwkv": "27.28% 27.28% 27.28% 27.28% 27.28%", "qwen": "29.84% 29.84% 29.84% 29.84% 29.84%"}, "model_tokens": {"rwkv": [[31112, " host", "normal", 0.0005192694952711463]], "qwen": [[3468, " host", "normal", 0.00025549010024406016]]}, "loss": {"rwkv": 27.27595311680696, "qwen": 29.83611437477487}, "topk": {"rwkv": [31112, 126, 0.0005192694952711463, [[32207, 0.218117, " team", false], [38640, 0.105203, " group", false], [46685, 0.078566, " number", false], [38720, 0.036927, " human", false], [53264, 0.032496, " variety", false], [21674, 0.029699, " few", false], [47350, 0.029298, " speech", false], [47202, 0.024372, " search", false], [38864, 0.022772, " large", false], [57103, 0.020937, " research", false]]], "qwen": [3468, 250, 0.00025549010024406016, [[1372, 0.132876, " number", false], [1874, 0.058637, " group", false], [2421, 0.054193, " few", false], [2083, 0.043321, " team", false], [8806, 0.039168, " speech", false], [1714, 0.039105, " method", false], [2813, 0.03677, " company", false], [3738, 0.035784, " human", false], [8045, 0.028896, " variety", false], [3460, 0.026857, " large", false]]]}, "raw_delta": -0.1419654846191407, "tuned_delta": -0.13339369258856246}, {"byte_start": 3276, "byte_end": 3279, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 555, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.04% 0.04% 0.04%", "qwen": "0.01% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9926510453224182]], "qwen": [[315, " of", "normal", 0.9980087876319885]]}, "loss": {"rwkv": 0.044394454942719666, "qwen": 0.011981691743041081}, "topk": {"rwkv": [4706, 1, 0.9926510453224182, [[4706, 0.992651, " of", false], [22762, 0.00065, " who", false], [45, 0.000576, ",", false], [37747, 0.000511, " array", false], [32227, 0.000392, " that", false], [1851, 0.000307, "el", false], [46, 0.000304, "-", false], [275, 0.000231, " (", false], [32207, 0.000214, " team", false], [21265, 0.0002, " and", false]]], "qwen": [315, 1, 0.9980087876319885, [[315, 0.998009, " of", false], [433, 0.000175, "ess", false], [11, 0.000174, ",", false], [320, 0.000116, " (", false], [879, 8.6e-05, " who", false], [198, 8.4e-05, "\n", false], [1372, 7.1e-05, " number", false], [476, 6.8e-05, " or", false], [429, 5.9e-05, " that", false], [264, 5.5e-05, " a", false]]]}, "raw_delta": 0.001797345234081149, "tuned_delta": 0.010369137264659397}, {"byte_start": 3279, "byte_end": 3287, "display": {"text": " special", "kind": "normal"}, "is_word": true, "word_id": 556, "word_key": " special", "bytes_hex": "20 73 70 65 63 69 61 6c", "compression": {"rwkv": "14.30% 14.30% 14.30% 14.30% 14.30% 14.30% 14.30% 14.30%", "qwen": "14.77% 14.77% 14.77% 14.77% 14.77% 14.77% 14.77% 14.77%"}, "model_tokens": {"rwkv": [[52964, " special", "normal", 0.0017601862782612443]], "qwen": [[3281, " special", "normal", 0.0014242958277463913]]}, "loss": {"rwkv": 14.3001510400615, "qwen": 14.77427388685166}, "topk": {"rwkv": [52964, 73, 0.0017601862782612443, [[63843, 0.188318, " researchers", false], [38720, 0.075254, " human", false], [57103, 0.050293, " research", false], [46787, 0.025338, " people", false], [52224, 0.022181, " methods", false], [3609, 0.020609, " AI", false], [39904, 0.020084, " teams", false], [59513, 0.019582, " different", false], [55809, 0.018218, " computer", false], [46131, 0.017402, " groups", false]]], "qwen": [3281, 82, 0.0014242958277463913, [[11811, 0.180827, " researchers", false], [3738, 0.056594, " human", false], [5413, 0.053861, " methods", false], [5110, 0.031301, " companies", false], [2155, 0.028066, " different", false], [3412, 0.027185, " research", false], [8806, 0.024624, " speech", false], [5942, 0.018314, " systems", false], [19827, 0.01823, " approaches", false], [1602, 0.017551, " very", false]]]}, "raw_delta": -0.026290953159332275, "tuned_delta": -0.017719161128754025}, {"byte_start": 3287, "byte_end": 3295, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 557, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "6.80% 6.80% 6.80% 6.80% 6.80% 6.80% 6.80% 6.80%", "qwen": "8.12% 8.12% 8.12% 8.12% 8.12% 8.12% 8.12% 8.12%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.04879653826355934]], "qwen": [[5413, " methods", "normal", 0.027293074876070023]]}, "loss": {"rwkv": 6.797855051063719, "qwen": 8.117689684772923}, "topk": {"rwkv": [52224, 3, 0.04879653826355934, [[46, 0.652387, "-", false], [52610, 0.07975, " purpose", false], [52224, 0.048797, " methods", false], [62633, 0.021554, " techniques", false], [61590, 0.016459, " approaches", false], [53087, 0.008744, " systems", false], [25971, 0.007197, "ists", false], [38720, 0.006938, " human", false], [27161, 0.006379, "ties", false], [25940, 0.006283, "ised", false]]], "qwen": [5413, 3, 0.027293074876070023, [[58238, 0.773182, "-purpose", false], [7428, 0.037158, " purpose", false], [5413, 0.027293, " methods", false], [12538, 0.0171, " techniques", false], [25185, 0.007393, " algorithms", false], [38485, 0.006867, "-case", false], [19827, 0.005876, " approaches", false], [11, 0.005599, ",", false], [12, 0.005488, "-", false], [11647, 0.004813, " experts", false]]]}, "raw_delta": -0.07318717241287231, "tuned_delta": -0.06461538038229407}, {"byte_start": 3295, "byte_end": 3300, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 558, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "7.13% 7.13% 7.13% 7.13% 7.13%", "qwen": "4.54% 4.54% 4.54% 4.54% 4.54%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.13948602974414825]], "qwen": [[429, " that", "normal", 0.28388261795043945]]}, "loss": {"rwkv": 7.128942291892729, "qwen": 4.541584127474004}, "topk": {"rwkv": [32227, 2, 0.13948602974414825, [[45, 0.234957, ",", false], [32227, 0.139486, " that", false], [37810, 0.132836, " based", false], [21700, 0.111832, " for", false], [55966, 0.03012, " designed", false], [21265, 0.029156, " and", false], [38888, 0.025359, " lever", false], [47, 0.02045, ".", false], [4811, 0.017289, " to", false], [32139, 0.017098, " such", false]]], "qwen": [429, 1, 0.28388261795043945, [[429, 0.283883, " that", false], [3118, 0.205155, " based", false], [11, 0.141055, ",", false], [369, 0.076992, " for", false], [6188, 0.028651, " designed", false], [320, 0.023569, " (", false], [70601, 0.020602, " exploiting", false], [323, 0.016581, " and", false], [311, 0.012588, " to", false], [40791, 0.011173, " tailored", false]]]}, "raw_delta": 0.1434736013412476, "tuned_delta": 0.15204539337182585}, {"byte_start": 3300, "byte_end": 3305, "display": {"text": " took", "kind": "normal"}, "is_word": true, "word_id": 559, "word_key": " took", "bytes_hex": "20 74 6f 6f 6b", "compression": {"rwkv": "8.12% 8.12% 8.12% 8.12% 8.12%", "qwen": "6.42% 6.42% 6.42% 6.42% 6.42%"}, "model_tokens": {"rwkv": [[32272, " took", "normal", 0.1053810864686966]], "qwen": [[3867, " took", "normal", 0.16853733360767365]]}, "loss": {"rwkv": 8.115159605000418, "qwen": 6.422149921164743}, "topk": {"rwkv": [32272, 3, 0.1053810864686966, [[32462, 0.119223, " were", false], [56540, 0.116081, " leverage", false], [32272, 0.105381, " took", false], [59685, 0.070902, " exploited", false], [31351, 0.050261, " made", false], [32354, 0.046111, " used", false], [40013, 0.040103, " tried", false], [57510, 0.031828, " utilized", false], [21795, 0.026877, " had", false], [47054, 0.021588, " relied", false]]], "qwen": [3867, 1, 0.16853733360767365, [[3867, 0.168537, " took", false], [1033, 0.148943, " were", false], [27505, 0.138017, " lever", false], [50663, 0.068061, " exploited", false], [1865, 0.036492, " made", false], [39913, 0.027299, " relied", false], [1030, 0.02667, " had", false], [1483, 0.023096, " used", false], [1521, 0.016878, " did", false], [33616, 0.016635, " utilized", false]]]}, "raw_delta": 0.09388039112091068, "tuned_delta": 0.10245218315148892}, {"byte_start": 3305, "byte_end": 3315, "display": {"text": " advantage", "kind": "normal"}, "is_word": true, "word_id": 560, "word_key": " advantage", "bytes_hex": "20 61 64 76 61 6e 74 61 67 65", "compression": {"rwkv": "0.15% 0.15% 0.15% 0.15% 0.15% 0.15% 0.15% 0.15% 0.15% 0.15%", "qwen": "0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17%"}, "model_tokens": {"rwkv": [[59093, " advantage", "normal", 0.9194269776344299]], "qwen": [[9423, " advantage", "normal", 0.91209876537323]]}, "loss": {"rwkv": 0.15145480165582373, "qwen": 0.1659225331283318}, "topk": {"rwkv": [59093, 1, 0.9194269776344299, [[59093, 0.919427, " advantage", false], [38720, 0.022346, " human", false], [30923, 0.00885, " full", false], [31162, 0.005785, " into", false], [61544, 0.004482, " advantages", false], [332, 0.002767, " a", false], [22590, 0.002495, " the", false], [38629, 0.002271, " great", false], [56540, 0.001736, " leverage", false], [50845, 0.001522, " account", false]]], "qwen": [9423, 1, 0.91209876537323, [[9423, 0.912099, " advantage", false], [3738, 0.019265, " human", false], [2480, 0.009981, " full", false], [2244, 0.006812, " great", false], [22146, 0.004719, " advantages", false], [264, 0.003321, " a", false], [279, 0.002832, " the", false], [3281, 0.002583, " special", false], [1119, 0.001649, " into", false], [5257, 0.001598, " various", false]]]}, "raw_delta": -0.0008022613823413845, "tuned_delta": 0.007769530648236864}, {"byte_start": 3315, "byte_end": 3318, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 561, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.03% 0.03% 0.03%", "qwen": "0.02% 0.02% 0.02%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.995306670665741]], "qwen": [[315, " of", "normal", 0.9974083304405212]]}, "loss": {"rwkv": 0.028434464942651023, "qwen": 0.01559934988305673}, "topk": {"rwkv": [4706, 1, 0.995306670665741, [[4706, 0.995307, " of", false], [45, 0.000963, ",", false], [4596, 0.000722, " in", false], [38720, 0.000713, " human", false], [45833, 0.000277, " either", false], [275, 0.000191, " (", false], [22590, 0.00014, " the", false], [22187, 0.000134, " not", false], [4715, 0.000111, " or", false], [53265, 9.7e-05, " various", false]]], "qwen": [315, 1, 0.9974083304405212, [[315, 0.997408, " of", false], [11, 0.000401, ",", false], [2987, 0.000314, " either", false], [537, 0.000232, " not", false], [3738, 0.000214, " human", false], [320, 0.000182, " (", false], [2176, 0.000108, " both", false], [304, 7.5e-05, " in", false], [311, 6.1e-05, " to", false], [279, 5.1e-05, " the", false]]]}, "raw_delta": 0.0007117299052576224, "tuned_delta": 0.00928352193583587}, {"byte_start": 3318, "byte_end": 3324, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 562, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "3.83% 3.83% 3.83% 3.83% 3.83% 3.83%", "qwen": "2.80% 2.80% 2.80% 2.80% 2.80% 2.80%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.2783218324184418]], "qwen": [[3738, " human", "normal", 0.3939196765422821]]}, "loss": {"rwkv": 3.8274624294417485, "qwen": 2.800055271452416}, "topk": {"rwkv": [38720, 1, 0.2783218324184418, [[38720, 0.278322, " human", false], [22590, 0.270218, " the", false], [59943, 0.056224, " knowledge", false], [62182, 0.035436, " linguistic", false], [45775, 0.015658, " domain", false], [332, 0.014945, " a", false], [52964, 0.013684, " special", false], [56215, 0.013602, " features", false], [62293, 0.010376, " particular", false], [53265, 0.009834, " various", false]]], "qwen": [3738, 1, 0.3939196765422821, [[3738, 0.39392, " human", false], [279, 0.212672, " the", false], [3281, 0.052552, " special", false], [6540, 0.026586, " knowledge", false], [264, 0.012291, " a", false], [7947, 0.01182, " domain", false], [8806, 0.010677, " speech", false], [5257, 0.010535, " various", false], [862, 0.010528, " their", false], [3953, 0.009571, " particular", false]]]}, "raw_delta": 0.05697154998779297, "tuned_delta": 0.06554334201837121}, {"byte_start": 3324, "byte_end": 3334, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 563, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "0.82% 0.82% 0.82% 0.82% 0.82% 0.82% 0.82% 0.82% 0.82% 0.82%", "qwen": "0.94% 0.94% 0.94% 0.94% 0.94% 0.94% 0.94% 0.94% 0.94% 0.94%"}, "model_tokens": {"rwkv": [[59943, " knowledge", "normal", 0.6355510950088501]], "qwen": [[6540, " knowledge", "normal", 0.592913031578064]]}, "loss": {"rwkv": 0.824195897382855, "qwen": 0.9426344371284479}, "topk": {"rwkv": [59943, 1, 0.6355510950088501, [[59943, 0.635551, " knowledge", false], [65034, 0.179749, " understanding", false], [62182, 0.046399, " linguistic", false], [46, 0.022666, "-", false], [38786, 0.016538, " input", false], [59683, 0.016386, " expertise", false], [56529, 0.011517, " language", false], [47350, 0.01107, " speech", false], [59917, 0.003494, " intuition", false], [63637, 0.002681, " information", false]]], "qwen": [6540, 1, 0.592913031578064, [[6540, 0.592913, " knowledge", false], [8660, 0.140599, " understanding", false], [18726, 0.080196, " expertise", false], [64667, 0.02676, " linguistic", false], [1946, 0.02544, " input", false], [12646, 0.021762, "-k", false], [4128, 0.007777, " language", false], [71107, 0.006643, "-under", false], [8806, 0.005197, " speech", false], [7947, 0.003196, " domain", false]]]}, "raw_delta": -0.006567627191543579, "tuned_delta": 0.002004164839034669}, {"byte_start": 3334, "byte_end": 3337, "display": {"text": "---", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d 2d 2d", "compression": {"rwkv": "48.84% 48.84% 48.84%", "qwen": "44.71% 44.71% 44.71%"}, "model_tokens": {"rwkv": [[5346, "---", "normal", 0.00029503233963623643]], "qwen": [[4421, "---", "normal", 0.0005885124555788934]]}, "loss": {"rwkv": 48.841238363428445, "qwen": 44.71099761076521}, "topk": {"rwkv": [5346, 42, 0.00029503233963623643, [[4706, 0.257508, " of", false], [45, 0.25072, ",", false], [47, 0.111356, ".", false], [37598, 0.100703, " about", false], [21265, 0.08588, " and", false], [275, 0.05165, " (", false], [4596, 0.037083, " in", false], [59, 0.019559, ":", false], [4811, 0.014264, " to", false], [32139, 0.008908, " such", false]]], "qwen": [4421, 31, 0.0005885124555788934, [[315, 0.28056, " of", false], [11, 0.207789, ",", false], [13, 0.10953, ".", false], [911, 0.10866, " about", false], [323, 0.065017, " and", false], [320, 0.057745, " (", false], [311, 0.040508, " to", false], [304, 0.033645, " in", false], [476, 0.015063, " or", false], [25, 0.011465, ":", false]]]}, "raw_delta": 0.22902917861938477, "tuned_delta": 0.23760097064996302}, {"byte_start": 3337, "byte_end": 3346, "display": {"text": "knowledge", "kind": "normal"}, "is_word": true, "word_id": 564, "word_key": "knowledge", "bytes_hex": "6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "6.79% 6.79% 6.79% 6.79% 6.79% 6.79% 6.79% 6.79% 6.79%", "qwen": "10.00% 10.00% 10.00% 10.00% 10.00% 10.00% 10.00% 10.00% 10.00%"}, "model_tokens": {"rwkv": [[58313, "knowledge", "normal", 0.0337136946618557]], "qwen": [[89053, "knowledge", "normal", 0.006804365664720535]]}, "loss": {"rwkv": 6.793941490297418, "qwen": 9.999060811112807}, "topk": {"rwkv": [58313, 5, 0.0337136946618557, [[35381, 0.06631, "phone", false], [7579, 0.05077, "for", false], [27095, 0.046591, "such", false], [58282, 0.035448, "including", false], [58313, 0.033714, "knowledge", false], [8801, 0.026144, "the", false], [1950, 0.025295, "in", false], [2090, 0.021315, "of", false], [6907, 0.015876, "aco", false], [98, 0.015545, "a", false]]], "qwen": [89053, 19, 0.006804365664720535, [[1958, 0.113174, "for", false], [1782, 0.039278, "the", false], [20805, 0.035593, "such", false], [51701, 0.034481, "phon", false], [258, 0.027204, "in", false], [16169, 0.025303, "including", false], [64, 0.023208, "a", false], [68, 0.022413, "e", false], [35742, 0.017526, "methods", false], [437, 0.014828, "and", false]]]}, "raw_delta": -0.17772955364651152, "tuned_delta": -0.16915776161593327}, {"byte_start": 3346, "byte_end": 3349, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 565, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "1.50% 1.50% 1.50%", "qwen": "4.17% 4.17% 4.17%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.7771164774894714]], "qwen": [[315, " of", "normal", 0.5000578165054321]]}, "loss": {"rwkv": 1.5028073342593367, "qwen": 4.165971939865932}, "topk": {"rwkv": [4706, 1, 0.7771164774894714, [[4706, 0.777116, " of", false], [37598, 0.087997, " about", false], [32227, 0.053327, " that", false], [46, 0.007534, "-", false], [32139, 0.005432, " such", false], [37810, 0.005192, " based", false], [4596, 0.003923, " in", false], [22187, 0.003118, " not", false], [55442, 0.002865, " acquired", false], [30917, 0.002861, " from", false]]], "qwen": [315, 1, 0.5000578165054321, [[315, 0.500058, " of", false], [911, 0.244429, " about", false], [429, 0.108862, " that", false], [1741, 0.013823, " such", false], [11, 0.012711, ",", false], [504, 0.008878, " from", false], [304, 0.004599, " in", false], [5980, 0.003731, "-based", false], [3118, 0.003642, " based", false], [18163, 0.003563, " gained", false]]]}, "raw_delta": -0.14767720301946002, "tuned_delta": -0.13910541098888177}, {"byte_start": 3349, "byte_end": 3355, "display": {"text": " words", "kind": "normal"}, "is_word": true, "word_id": 566, "word_key": " words", "bytes_hex": "20 77 6f 72 64 73", "compression": {"rwkv": "11.74% 11.74% 11.74% 11.74% 11.74% 11.74%", "qwen": "15.78% 15.78% 15.78% 15.78% 15.78% 15.78%"}, "model_tokens": {"rwkv": [[40210, " words", "normal", 0.020194733515381813]], "qwen": [[4244, " words", "normal", 0.005253321025520563]]}, "loss": {"rwkv": 11.740682298901067, "qwen": 15.77615487818387}, "topk": {"rwkv": [40210, 10, 0.020194733515381813, [[22590, 0.253503, " the", false], [39273, 0.138416, " phone", false], [56529, 0.059451, " language", false], [47350, 0.056894, " speech", false], [55440, 0.043914, " acoustic", false], [21835, 0.037936, " how", false], [62182, 0.035757, " linguistic", false], [51860, 0.034834, " grammar", false], [59946, 0.026252, " languages", false], [40210, 0.020195, " words", false]]], "qwen": [4244, 17, 0.005253321025520563, [[279, 0.353914, " the", false], [50823, 0.253003, " phon", false], [1246, 0.058093, " how", false], [4128, 0.035753, " language", false], [8806, 0.03563, " speech", false], [31428, 0.015489, " grammar", false], [1128, 0.013788, " what", false], [3281, 0.013287, " special", false], [6364, 0.010292, " English", false], [70622, 0.010262, " pronunciation", false]]]}, "raw_delta": -0.2237741152445476, "tuned_delta": -0.21520232321396934}, {"byte_start": 3355, "byte_end": 3356, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "6.06%", "qwen": "7.27%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.715740442276001]], "qwen": [[11, ",", "normal", 0.6681299209594727]]}, "loss": {"rwkv": 6.058192066232952, "qwen": 7.272493308360682}, "topk": {"rwkv": [45, 1, 0.715740442276001, [[45, 0.71574, ",", false], [21265, 0.188574, " and", false], [4596, 0.02537, " in", false], [275, 0.016159, " (", false], [32227, 0.009013, " that", false], [4715, 0.008957, " or", false], [5346, 0.004707, "---", false], [4423, 0.003686, " as", false], [40, 0.002234, "'", false], [30917, 0.001721, " from", false]]], "qwen": [11, 1, 0.6681299209594727, [[11, 0.66813, ",", false], [323, 0.21026, " and", false], [304, 0.026596, " in", false], [320, 0.019248, " (", false], [476, 0.016288, " or", false], [429, 0.011097, " that", false], [438, 0.007941, " as", false], [1660, 0.003235, " being", false], [1075, 0.002041, " like", false], [1741, 0.001965, " such", false]]]}, "raw_delta": -0.06733515858650208, "tuned_delta": -0.058763366555923825}, {"byte_start": 3356, "byte_end": 3359, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 567, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "10.38% 10.38% 10.38%", "qwen": "10.98% 10.98% 10.98%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.17572148144245148]], "qwen": [[315, " of", "normal", 0.16089268028736115]]}, "loss": {"rwkv": 10.378763152228546, "qwen": 10.982622186588632}, "topk": {"rwkv": [4706, 2, 0.17572148144245148, [[59943, 0.400852, " knowledge", false], [4706, 0.175721, " of", false], [51860, 0.054776, " grammar", false], [39273, 0.037322, " phone", false], [21265, 0.017596, " and", false], [64996, 0.014313, " pronunciation", false], [56529, 0.013782, " language", false], [47486, 0.013023, " syntax", false], [32497, 0.012532, " word", false], [47341, 0.012097, " sounds", false]]], "qwen": [315, 1, 0.16089268028736115, [[315, 0.160893, " of", false], [50823, 0.158093, " phon", false], [6540, 0.15273, " knowledge", false], [31428, 0.073357, " grammar", false], [323, 0.032645, " and", false], [862, 0.026638, " their", false], [70622, 0.02638, " pronunciation", false], [279, 0.025346, " the", false], [476, 0.017606, " or", false], [4128, 0.014281, " language", false]]]}, "raw_delta": -0.0334850549697876, "tuned_delta": -0.024913262939209348}, {"byte_start": 3359, "byte_end": 3368, "display": {"text": " phonemes", "kind": "normal"}, "is_word": true, "word_id": 568, "word_key": " phonemes", "bytes_hex": "20 70 68 6f 6e 65 6d 65 73", "compression": {"rwkv": "7.28% 7.28% 7.28% 7.28% 7.28% 7.28% 2.64% 2.64% 2.64%", "qwen": "5.17% 5.17% 5.17% 5.17% 5.17% 4.32% 4.32% 4.32% 4.32%"}, "model_tokens": {"rwkv": [[39273, " phone", "normal", 0.08897095918655396], [8164, "mes", "normal", 0.6444879770278931]], "qwen": [[50823, " phon", "normal", 0.23876725137233734], [15660, "emes", "normal", 0.383487343788147]]}, "loss": {"rwkv": 5.733366522630021, "qwen": 4.79037800427587}, "topk": {"rwkv": [39273, 2, 0.08897095918655396, [[51860, 0.168416, " grammar", false], [39273, 0.088971, " phone", false], [22590, 0.080181, " the", false], [56529, 0.053506, " language", false], [47350, 0.039147, " speech", false], [47486, 0.032729, " syntax", false], [64996, 0.025667, " pronunciation", false], [55440, 0.025221, " acoustic", false], [60476, 0.02402, " sentences", false], [51310, 0.023265, " context", false]]], "qwen": [50823, 1, 0.23876725137233734, [[50823, 0.238767, " phon", false], [279, 0.117382, " the", false], [70622, 0.049761, " pronunciation", false], [8806, 0.049463, " speech", false], [4128, 0.040122, " language", false], [31428, 0.030796, " grammar", false], [1246, 0.026751, " how", false], [3409, 0.026679, " word", false], [862, 0.02647, " their", false], [15459, 0.019261, " languages", false]]]}, "raw_delta": 0.0522903866238064, "tuned_delta": 0.06086217865438465}, {"byte_start": 3368, "byte_end": 3369, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "2.48%", "qwen": "2.14%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8706715703010559]], "qwen": [[11, ",", "normal", 0.8879333138465881]]}, "loss": {"rwkv": 2.483154306217576, "qwen": 2.1434594143297496}, "topk": {"rwkv": [45, 1, 0.8706715703010559, [[45, 0.870672, ",", false], [21265, 0.052177, " and", false], [275, 0.033585, " (", false], [4596, 0.012094, " in", false], [4715, 0.007122, " or", false], [5346, 0.005051, "---", false], [47, 0.003442, ".", false], [4706, 0.00294, " of", false], [4423, 0.001587, " as", false], [47806, 0.001463, " within", false]]], "qwen": [11, 1, 0.8879333138465881, [[11, 0.887933, ",", false], [323, 0.048608, " and", false], [320, 0.039137, " (", false], [476, 0.005605, " or", false], [304, 0.004284, " in", false], [429, 0.001585, " that", false], [13, 0.001211, ".", false], [438, 0.001177, " as", false], [4421, 0.001061, "---", false], [3489, 0.000585, " (\"", false]]]}, "raw_delta": 0.01883668452501297, "tuned_delta": 0.02740847655559122}, {"byte_start": 3369, "byte_end": 3372, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 569, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "1.53% 1.53% 1.53%", "qwen": "2.01% 2.01% 2.01%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.7766412496566772]], "qwen": [[315, " of", "normal", 0.7161024808883667]]}, "loss": {"rwkv": 1.526288698857139, "qwen": 2.0073415507340955}, "topk": {"rwkv": [4706, 1, 0.7766412496566772, [[4706, 0.776641, " of", false], [21265, 0.138856, " and", false], [21643, 0.022741, " etc", false], [4715, 0.010595, " or", false], [59943, 0.005057, " knowledge", false], [30788, 0.00494, " even", false], [22590, 0.002472, " the", false], [39273, 0.002387, " phone", false], [55440, 0.001789, " acoustic", false], [51860, 0.001327, " grammar", false]]], "qwen": [315, 1, 0.7161024808883667, [[315, 0.716102, " of", false], [323, 0.192834, " and", false], [476, 0.024667, " or", false], [4992, 0.023788, " etc", false], [6540, 0.009226, " knowledge", false], [1496, 0.00469, " even", false], [50823, 0.004016, " phon", false], [279, 0.001684, " the", false], [5601, 0.000789, " rules", false], [31428, 0.000649, " grammar", false]]]}, "raw_delta": -0.026675234238306672, "tuned_delta": -0.018103442207728422}, {"byte_start": 3372, "byte_end": 3376, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 570, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "10.64% 10.64% 10.64% 10.64%", "qwen": "8.30% 8.30% 8.30% 8.30%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.09426004439592361]], "qwen": [[279, " the", "normal", 0.1585163027048111]]}, "loss": {"rwkv": 10.637058162804367, "qwen": 8.304052772476783}, "topk": {"rwkv": [22590, 2, 0.09426004439592361, [[51860, 0.129075, " grammar", false], [22590, 0.09426, " the", false], [55440, 0.064723, " acoustic", false], [56529, 0.041231, " language", false], [51310, 0.039466, " context", false], [62182, 0.038495, " linguistic", false], [39273, 0.035438, " phone", false], [47350, 0.027224, " speech", false], [64996, 0.026239, " pronunciation", false], [47486, 0.020857, " syntax", false]]], "qwen": [279, 1, 0.1585163027048111, [[279, 0.158516, " the", false], [4128, 0.06611, " language", false], [50823, 0.065517, " phon", false], [8806, 0.064626, " speech", false], [31428, 0.045814, " grammar", false], [8709, 0.02981, " pros", false], [1246, 0.027838, " how", false], [3409, 0.027465, " word", false], [70622, 0.024873, " pronunciation", false], [15459, 0.024133, " languages", false]]]}, "raw_delta": 0.12936928868293762, "tuned_delta": 0.13794108071351588}, {"byte_start": 3376, "byte_end": 3382, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 571, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "15.50% 15.50% 15.50% 15.50% 15.50% 15.50%", "qwen": "16.97% 16.97% 16.97% 16.97% 16.97% 16.97%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.005730811506509781]], "qwen": [[3738, " human", "normal", 0.0035279719159007072]]}, "loss": {"rwkv": 15.49770063454941, "qwen": 16.97280156375475}, "topk": {"rwkv": [38720, 31, 0.005730811506509781, [[60572, 0.113852, " structure", false], [55440, 0.079798, " acoustic", false], [51860, 0.059951, " grammar", false], [39273, 0.027495, " phone", false], [22752, 0.026084, " way", false], [39747, 0.023744, " sound", false], [56529, 0.022356, " language", false], [47341, 0.021375, " sounds", false], [51310, 0.020774, " context", false], [47350, 0.01737, " speech", false]]], "qwen": [3738, 35, 0.0035279719159007072, [[5944, 0.196786, " structure", false], [3281, 0.084411, " special", false], [50823, 0.04054, " phon", false], [44066, 0.039506, " acoustic", false], [1616, 0.033336, " way", false], [8806, 0.03235, " speech", false], [4128, 0.024568, " language", false], [5112, 0.020068, " sound", false], [31428, 0.014308, " grammar", false], [2266, 0.013803, " context", false]]]}, "raw_delta": -0.0817969640096029, "tuned_delta": -0.07322517197902466}, {"byte_start": 3382, "byte_end": 3388, "display": {"text": " vocal", "kind": "normal"}, "is_word": true, "word_id": 572, "word_key": " vocal", "bytes_hex": "20 76 6f 63 61 6c", "compression": {"rwkv": "7.75% 7.75% 7.75% 7.75% 7.75% 7.75%", "qwen": "5.47% 5.47% 5.47% 5.47% 5.47% 5.47%"}, "model_tokens": {"rwkv": [[40136, " vocal", "normal", 0.07571001350879669]], "qwen": [[25407, " vocal", "normal", 0.1618843823671341]]}, "loss": {"rwkv": 7.748850317274705, "qwen": 5.472842306374786}, "topk": {"rwkv": [40136, 2, 0.07571001350879669, [[40139, 0.438532, " voice", false], [40136, 0.07571, " vocal", false], [47350, 0.064505, " speech", false], [56529, 0.045972, " language", false], [21590, 0.035777, " ear", false], [52963, 0.032602, " speaker", false], [55579, 0.029032, " auditory", false], [50905, 0.023315, " anatomy", false], [39070, 0.019673, " mouth", false], [37898, 0.016469, " brain", false]]], "qwen": [25407, 1, 0.1618843823671341, [[25407, 0.161884, " vocal", false], [7743, 0.124555, " voice", false], [8806, 0.082691, " speech", false], [4128, 0.069859, " language", false], [82529, 0.066939, " auditory", false], [2430, 0.040684, " ear", false], [8109, 0.039357, " brain", false], [50823, 0.034274, " phon", false], [10778, 0.031447, " hearing", false], [27564, 0.023384, " artic", false]]]}, "raw_delta": 0.12620868285497025, "tuned_delta": 0.1347804748855485}, {"byte_start": 3388, "byte_end": 3394, "display": {"text": " tract", "kind": "normal"}, "is_word": true, "word_id": 573, "word_key": " tract", "bytes_hex": "20 74 72 61 63 74", "compression": {"rwkv": "0.93% 0.93% 0.93% 0.93% 0.93% 0.93%", "qwen": "0.08% 0.08% 0.08% 0.08% 0.08% 0.08%"}, "model_tokens": {"rwkv": [[39996, " tract", "normal", 0.7332308888435364]], "qwen": [[41829, " tract", "normal", 0.9751889109611511]]}, "loss": {"rwkv": 0.9275139016131844, "qwen": 0.07551333841152351}, "topk": {"rwkv": [39996, 1, 0.7332308888435364, [[39996, 0.733231, " tract", false], [59153, 0.116333, " apparatus", false], [47487, 0.052536, " system", false], [50905, 0.030457, " anatomy", false], [38115, 0.009745, " cords", false], [38024, 0.00734, " chord", false], [59994, 0.005682, " mechanism", false], [46719, 0.005405, " organs", false], [46, 0.003949, "-", false], [62382, 0.003221, " production", false]]], "qwen": [41829, 1, 0.9751889109611511, [[41829, 0.975189, " tract", false], [40605, 0.007592, " apparatus", false], [1849, 0.002449, " system", false], [16953, 0.002247, " mechanism", false], [2872, 0.00137, " organ", false], [79617, 0.001342, " cords", false], [35753, 0.001225, " organs", false], [489, 0.001167, " tr", false], [61590, 0.00104, " anatomy", false], [3754, 0.000617, " track", false]]]}, "raw_delta": 0.04724494305749733, "tuned_delta": 0.05581673508807558}, {"byte_start": 3394, "byte_end": 3395, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "10.00%", "qwen": "3.67%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.5722053050994873]], "qwen": [[11, ",", "normal", 0.8159487247467041]]}, "loss": {"rwkv": 10.00306131866371, "qwen": 3.6681201451201666}, "topk": {"rwkv": [45, 1, 0.5722053050994873, [[45, 0.572205, ",", false], [47, 0.161537, ".", false], [5346, 0.128898, "---", false], [21265, 0.084454, " and", false], [275, 0.007558, " (", false], [568, 0.005787, "--", false], [60, 0.003431, ";", false], [21643, 0.002768, " etc", false], [50905, 0.002691, " anatomy", false], [116, 0.002302, "s", false]]], "qwen": [11, 1, 0.8159487247467041, [[11, 0.815949, ",", false], [13, 0.073331, ".", false], [323, 0.039013, " and", false], [4421, 0.033701, "---", false], [320, 0.010362, " (", false], [4992, 0.002894, " etc", false], [26, 0.002181, ";", false], [5944, 0.002157, " structure", false], [476, 0.002121, " or", false], [438, 0.001473, " as", false]]]}, "raw_delta": 0.3512837290763855, "tuned_delta": 0.3598555211069637}, {"byte_start": 3395, "byte_end": 3399, "display": {"text": " etc", "kind": "normal"}, "is_word": true, "word_id": 574, "word_key": " etc", "bytes_hex": "20 65 74 63", "compression": {"rwkv": "10.36% 10.36% 10.36% 10.36%", "qwen": "8.02% 8.02% 8.02% 8.02%"}, "model_tokens": {"rwkv": [[21643, " etc", "normal", 0.1010892316699028]], "qwen": [[4992, " etc", "normal", 0.16893409192562103]]}, "loss": {"rwkv": 10.355281787630743, "qwen": 8.017086283367588}, "topk": {"rwkv": [21643, 3, 0.1010892316699028, [[4706, 0.496547, " of", false], [21265, 0.323512, " and", false], [21643, 0.101089, " etc", false], [59943, 0.014964, " knowledge", false], [4715, 0.008195, " or", false], [22590, 0.006899, " the", false], [30788, 0.005034, " even", false], [55440, 0.002536, " acoustic", false], [4522, 0.001973, " et", false], [21256, 0.001644, " all", false]]], "qwen": [4992, 3, 0.16893409192562103, [[315, 0.404679, " of", false], [323, 0.344859, " and", false], [4992, 0.168934, " etc", false], [6540, 0.021371, " knowledge", false], [476, 0.011289, " or", false], [279, 0.005028, " the", false], [1496, 0.004895, " even", false], [678, 0.003127, " all", false], [50823, 0.002071, " phon", false], [1842, 0.002019, " et", false]]]}, "raw_delta": 0.1296570897102356, "tuned_delta": 0.13822888174081385}, {"byte_start": 3399, "byte_end": 3400, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "4.47%", "qwen": "1.88%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.7803417444229126]], "qwen": [[13, ".", "normal", 0.9009494781494141]]}, "loss": {"rwkv": 4.473199955881307, "qwen": 1.8810239662215529}, "topk": {"rwkv": [47, 1, 0.7803417444229126, [[47, 0.780342, ".", false], [5361, 0.09236, ".--", false], [583, 0.048006, ".,", false], [5346, 0.047938, "---", false], [45, 0.005661, ",", false], [584, 0.005269, ".-", false], [568, 0.00297, "--", false], [23326, 0.002968, ".—", false], [25358, 0.002714, "eter", false], [585, 0.002696, "..", false]]], "qwen": [13, 1, 0.9009494781494141, [[13, 0.900949, ".", false], [4421, 0.032714, "---", false], [2572, 0.032237, ".,", false], [11, 0.006014, ",", false], [1404, 0.005206, "eter", false], [32401, 0.005182, ".--", false], [382, 0.004326, ".\n\n", false], [7110, 0.00181, ".\\", false], [496, 0.001474, "..", false], [15642, 0.00098, ".;", false]]]}, "raw_delta": 0.14374075829982758, "tuned_delta": 0.15231255033040583}, {"byte_start": 3400, "byte_end": 3403, "display": {"text": " On", "kind": "normal"}, "is_word": true, "word_id": 575, "word_key": " on", "bytes_hex": "20 4f 6e", "compression": {"rwkv": "40.58% 40.58% 40.58%", "qwen": "40.04% 40.04% 40.04%"}, "model_tokens": {"rwkv": [[4095, " On", "normal", 0.00117211090400815]], "qwen": [[1913, " On", "normal", 0.0012803024146705866]]}, "loss": {"rwkv": 40.57579802500209, "qwen": 40.0387478011528}, "topk": {"rwkv": [4095, 80, 0.00117211090400815, [[20996, 0.155459, " The", false], [37453, 0.116238, " These", false], [19555, 0.06252, " But", false], [3913, 0.039468, " In", false], [29894, 0.031814, " This", false], [29804, 0.030002, " Some", false], [19407, 0.029717, " All", false], [37451, 0.026174, " There", false], [20556, 0.024466, " One", false], [29344, 0.021451, " Many", false]]], "qwen": [1913, 69, 0.0012803024146705866, [[4220, 0.13774, " These", false], [576, 0.116353, " The", false], [1988, 0.048123, " But", false], [1096, 0.045986, " This", false], [4421, 0.042403, "---", false], [2009, 0.032058, " All", false], [758, 0.031777, " In", false], [2619, 0.024885, " There", false], [1084, 0.022443, " It", false], [2240, 0.019998, " None", false]]]}, "raw_delta": 0.02978038787841797, "tuned_delta": 0.03835217990899622}, {"byte_start": 3403, "byte_end": 3407, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 576, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "2.87% 2.87% 2.87% 2.87%", "qwen": "3.02% 3.02% 3.02% 3.02%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.5254470109939575]], "qwen": [[279, " the", "normal", 0.5120087265968323]]}, "loss": {"rwkv": 2.8705968220813114, "qwen": 3.0179988525695527}, "topk": {"rwkv": [22590, 1, 0.5254470109939575, [[22590, 0.525447, " the", false], [332, 0.072098, " a", false], [32234, 0.050453, " this", false], [50987, 0.044821, " average", false], [22615, 0.042635, " top", false], [22226, 0.03378, " one", false], [30719, 0.014834, " each", false], [39931, 0.012789, " their", false], [32227, 0.012635, " that", false], [34514, 0.012627, "going", false]]], "qwen": [279, 1, 0.5120087265968323, [[279, 0.512009, " the", false], [825, 0.077259, " one", false], [264, 0.065043, " a", false], [419, 0.062111, " this", false], [5567, 0.028102, " paper", false], [5461, 0.020084, " average", false], [1493, 0.013356, " these", false], [10778, 0.012195, " hearing", false], [429, 0.010967, " that", false], [1181, 0.010632, " its", false]]]}, "raw_delta": -0.008173704147338867, "tuned_delta": 0.00039808788323938103}, {"byte_start": 3407, "byte_end": 3413, "display": {"text": " other", "kind": "normal"}, "is_word": true, "word_id": 577, "word_key": " other", "bytes_hex": "20 6f 74 68 65 72", "compression": {"rwkv": "2.29% 2.29% 2.29% 2.29% 2.29% 2.29%", "qwen": "3.91% 3.91% 3.91% 3.91% 3.91% 3.91%"}, "model_tokens": {"rwkv": [[39193, " other", "normal", 0.470399409532547]], "qwen": [[1008, " other", "normal", 0.2723727226257324]]}, "loss": {"rwkv": 2.289433048285708, "qwen": 3.909053865388579}, "topk": {"rwkv": [39193, 1, 0.470399409532547, [[39193, 0.470399, " other", false], [40190, 0.138401, " whole", false], [37815, 0.064786, " basis", false], [22226, 0.032974, " one", false], [30807, 0.018048, " face", false], [53064, 0.016245, " surface", false], [38499, 0.011105, " first", false], [19678, 0.007489, " DAR", false], [21509, 0.005219, " day", false], [30218, 0.005181, " back", false]]], "qwen": [1008, 1, 0.2723727226257324, [[1008, 0.272373, " other", false], [825, 0.128202, " one", false], [8037, 0.101598, " basis", false], [4361, 0.084979, " whole", false], [7329, 0.062224, " surface", false], [1156, 0.035604, " first", false], [1899, 0.020541, " day", false], [3579, 0.019704, " face", false], [8170, 0.016435, " strength", false], [24335, 0.007199, " assumption", false]]]}, "raw_delta": -0.08981084823608398, "tuned_delta": -0.08123905620550574}, {"byte_start": 3413, "byte_end": 3418, "display": {"text": " side", "kind": "normal"}, "is_word": true, "word_id": 578, "word_key": " side", "bytes_hex": "20 73 69 64 65", "compression": {"rwkv": "2.78% 2.78% 2.78% 2.78% 2.78%", "qwen": "13.41% 13.41% 13.41% 13.41% 13.41%"}, "model_tokens": {"rwkv": [[32011, " side", "normal", 0.4629760682582855]], "qwen": [[3108, " side", "normal", 0.024280866608023643]]}, "loss": {"rwkv": 2.7754972954602124, "qwen": 13.410090946877716}, "topk": {"rwkv": [32011, 2, 0.4629760682582855, [[31044, 0.514676, " hand", false], [32011, 0.462976, " side", false], [21616, 0.014103, " end", false], [45, 0.001928, ",", false], [32207, 0.000888, " team", false], [51699, 0.000887, " extreme", false], [32462, 0.000323, " were", false], [38559, 0.000305, " front", false], [22748, 0.000162, " was", false], [25548, 0.000155, "hand", false]]], "qwen": [3108, 2, 0.024280866608023643, [[1424, 0.966155, " hand", false], [3108, 0.024281, " side", false], [835, 0.005734, " end", false], [14226, 0.000471, " extreme", false], [6078, 0.000411, " hands", false], [1616, 0.000195, " way", false], [11, 0.000186, ",", false], [3579, 0.000149, " face", false], [24413, 8.5e-05, "-hand", false], [1030, 7.4e-05, " had", false]]]}, "raw_delta": -0.5897070884704589, "tuned_delta": -0.5811352964398807}, {"byte_start": 3418, "byte_end": 3423, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 579, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"rwkv": "4.03% 4.03% 4.03% 4.03% 4.03%", "qwen": "5.26% 5.26% 5.26% 5.26% 5.26%"}, "model_tokens": {"rwkv": [[32462, " were", "normal", 0.31780949234962463]], "qwen": [[1033, " were", "normal", 0.23232492804527283]]}, "loss": {"rwkv": 4.029402164982847, "qwen": 5.26446031571068}, "topk": {"rwkv": [32462, 1, 0.31780949234962463, [[32462, 0.317809, " were", false], [45, 0.316057, ",", false], [22748, 0.181299, " was", false], [4706, 0.149667, " of", false], [39934, 0.017661, " there", false], [39826, 0.005139, " stood", false], [22590, 0.001342, " the", false], [275, 0.001303, " (", false], [4858, 0.001141, " we", false], [5346, 0.000915, "---", false]]], "qwen": [1033, 2, 0.23232492804527283, [[315, 0.490659, " of", false], [1033, 0.232325, " were", false], [11, 0.166032, ",", false], [572, 0.082803, " was", false], [1052, 0.011907, " there", false], [14638, 0.003368, " stood", false], [320, 0.001514, " (", false], [7578, 0.001177, " sat", false], [582, 0.001015, " we", false], [279, 0.000952, " the", false]]]}, "raw_delta": -0.06848616600036622, "tuned_delta": -0.05991437396978797}, {"byte_start": 3423, "byte_end": 3429, "display": {"text": " newer", "kind": "normal"}, "is_word": true, "word_id": 580, "word_key": " newer", "bytes_hex": "20 6e 65 77 65 72", "compression": {"rwkv": "26.30% 26.30% 26.30% 26.30% 26.30% 26.30%", "qwen": "26.07% 26.07% 26.07% 26.07% 26.07% 26.07%"}, "model_tokens": {"rwkv": [[39116, " newer", "normal", 0.00016174896154552698]], "qwen": [[25546, " newer", "normal", 0.00017089667380787432]]}, "loss": {"rwkv": 26.299128349538393, "qwen": 26.072059655604225}, "topk": {"rwkv": [39116, 270, 0.00016174896154552698, [[52224, 0.239662, " methods", false], [22590, 0.121987, " the", false], [63843, 0.11326, " researchers", false], [332, 0.042692, " a", false], [61590, 0.022408, " approaches", false], [39944, 0.019127, " those", false], [39904, 0.018869, " teams", false], [51566, 0.01637, " efforts", false], [62633, 0.016064, " techniques", false], [53087, 0.014074, " systems", false]]], "qwen": [25546, 334, 0.00017089667380787432, [[5413, 0.14978, " methods", false], [279, 0.096848, " the", false], [264, 0.049531, " a", false], [29728, 0.035675, " neural", false], [1378, 0.033291, " two", false], [11811, 0.032846, " researchers", false], [5942, 0.031073, " systems", false], [4586, 0.021922, " general", false], [7468, 0.021892, " programs", false], [1657, 0.021721, " many", false]]]}, "raw_delta": 0.012591361999511719, "tuned_delta": 0.02116315403008997}, {"byte_start": 3429, "byte_end": 3437, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 581, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "1.51% 1.51% 1.51% 1.51% 1.51% 1.51% 1.51% 1.51%", "qwen": "1.34% 1.34% 1.34% 1.34% 1.34% 1.34% 1.34% 1.34%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.5125495791435242]], "qwen": [[5413, " methods", "normal", 0.5520504713058472]]}, "loss": {"rwkv": 1.514548016558238, "qwen": 1.3392624926301873}, "topk": {"rwkv": [52224, 1, 0.5125495791435242, [[52224, 0.51255, " methods", false], [45, 0.124348, ",", false], [61590, 0.109964, " approaches", false], [62633, 0.056274, " techniques", false], [38378, 0.041541, " entra", false], [21265, 0.024336, " and", false], [63843, 0.012209, " researchers", false], [57103, 0.009618, " research", false], [4404, 0.00684, " ``", false], [51566, 0.005897, " efforts", false]]], "qwen": [5413, 1, 0.5520504713058472, [[5413, 0.55205, " methods", false], [11, 0.132193, ",", false], [19827, 0.082683, " approaches", false], [12538, 0.043585, " techniques", false], [5942, 0.030773, " systems", false], [323, 0.017067, " and", false], [4586, 0.011913, " general", false], [7468, 0.010526, " programs", false], [9902, 0.006363, " ``", false], [11811, 0.005818, " researchers", false]]]}, "raw_delta": 0.009719893336296082, "tuned_delta": 0.01829168536687433}, {"byte_start": 3437, "byte_end": 3442, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 582, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "2.93% 2.93% 2.93% 2.93% 2.93%", "qwen": "2.18% 2.18% 2.18% 2.18% 2.18%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.4417383074760437]], "qwen": [[429, " that", "normal", 0.5460522174835205]]}, "loss": {"rwkv": 2.930474301805707, "qwen": 2.182222718369164}, "topk": {"rwkv": [32227, 1, 0.4417383074760437, [[32227, 0.441738, " that", false], [37810, 0.227342, " based", false], [45, 0.107697, ",", false], [4706, 0.039301, " of", false], [5346, 0.019834, "---", false], [40085, 0.017174, " using", false], [32139, 0.011853, " such", false], [21700, 0.011562, " for", false], [275, 0.009923, " (", false], [31296, 0.006963, " like", false]]], "qwen": [429, 1, 0.5460522174835205, [[429, 0.546052, " that", false], [3118, 0.155059, " based", false], [11, 0.141318, ",", false], [4421, 0.023036, "---", false], [320, 0.012567, " (", false], [315, 0.011942, " of", false], [1667, 0.009367, " using", false], [1741, 0.009027, " such", false], [1075, 0.008867, " like", false], [892, 0.007434, " which", false]]]}, "raw_delta": 0.04149187803268434, "tuned_delta": 0.05006367006326259}, {"byte_start": 3442, "byte_end": 3447, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 583, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"rwkv": "8.28% 8.28% 8.28% 8.28% 8.28%", "qwen": "7.93% 7.93% 7.93% 7.93% 7.93%"}, "model_tokens": {"rwkv": [[32462, " were", "normal", 0.10054638981819153]], "qwen": [[1033, " were", "normal", 0.1108400747179985]]}, "loss": {"rwkv": 8.284225430104593, "qwen": 7.933621598055672}, "topk": {"rwkv": [32462, 3, 0.10054638981819153, [[32354, 0.152801, " used", false], [32272, 0.116563, " took", false], [32462, 0.100546, " were", false], [21532, 0.055004, " did", false], [56540, 0.046257, " leverage", false], [31351, 0.038582, " made", false], [57510, 0.036171, " utilized", false], [47054, 0.034577, " relied", false], [21795, 0.019937, " had", false], [50937, 0.01773, " applied", false]]], "qwen": [1033, 2, 0.1108400747179985, [[1483, 0.118791, " used", false], [1033, 0.11084, " were", false], [3867, 0.110069, " took", false], [1521, 0.06304, " did", false], [27505, 0.052365, " lever", false], [39913, 0.052317, " relied", false], [1865, 0.034872, " made", false], [33616, 0.033021, " utilized", false], [9251, 0.020661, " applied", false], [50663, 0.019668, " exploited", false]]]}, "raw_delta": 0.019441604614257812, "tuned_delta": 0.028013396644836062}, {"byte_start": 3447, "byte_end": 3452, "display": {"text": " more", "kind": "normal"}, "is_word": true, "word_id": 584, "word_key": " more", "bytes_hex": "20 6d 6f 72 65", "compression": {"rwkv": "10.43% 10.43% 10.43% 10.43% 10.43%", "qwen": "10.64% 10.64% 10.64% 10.64% 10.64%"}, "model_tokens": {"rwkv": [[31458, " more", "normal", 0.05520031973719597]], "qwen": [[803, " more", "normal", 0.052396297454833984]]}, "loss": {"rwkv": 10.425725881424148, "qwen": 10.635978111756948}, "topk": {"rwkv": [31458, 2, 0.05520031973719597, [[37810, 0.26754, " based", false], [31458, 0.0552, " more", false], [22187, 0.055078, " not", false], [31466, 0.020558, " much", false], [63541, 0.020256, " essentially", false], [46957, 0.017689, " purely", false], [47202, 0.013153, " search", false], [31277, 0.011647, " less", false], [47285, 0.010488, " simply", false], [31198, 0.009328, " just", false]]], "qwen": [803, 3, 0.052396297454833984, [[3118, 0.30488, " based", false], [537, 0.055778, " not", false], [803, 0.052396, " more", false], [2686, 0.026301, " less", false], [1753, 0.025835, " much", false], [15791, 0.021092, " essentially", false], [4586, 0.016136, " general", false], [2711, 0.015008, " search", false], [13771, 0.01305, " largely", false], [1602, 0.011742, " very", false]]]}, "raw_delta": -0.011658859252929643, "tuned_delta": -0.003087067222351395}, {"byte_start": 3452, "byte_end": 3464, "display": {"text": " statistical", "kind": "normal"}, "is_word": true, "word_id": 585, "word_key": " statistical", "bytes_hex": "20 73 74 61 74 69 73 74 69 63 61 6c", "compression": {"rwkv": "8.17% 8.17% 8.17% 8.17% 8.17% 8.17% 8.17% 8.17% 8.17% 8.17% 8.17% 8.17%", "qwen": "9.61% 9.61% 9.61% 9.61% 9.61% 9.61% 9.61% 9.61% 9.61% 9.61% 9.61% 9.61%"}, "model_tokens": {"rwkv": [[63885, " statistical", "normal", 0.004327341448515654]], "qwen": [[28464, " statistical", "normal", 0.0016723305452615023]]}, "loss": {"rwkv": 8.171514880035144, "qwen": 9.608254362371156}, "topk": {"rwkv": [63885, 34, 0.004327341448515654, [[51832, 0.309702, " general", false], [31296, 0.098105, " like", false], [30579, 0.026066, " data", false], [59758, 0.025707, " generally", false], [59593, 0.024248, " effective", false], [4715, 0.020687, " or", false], [64862, 0.018046, " computational", false], [4596, 0.015982, " in", false], [52906, 0.014617, " similar", false], [37810, 0.014523, " based", false]]], "qwen": [28464, 55, 0.0016723305452615023, [[4586, 0.515447, " general", false], [1075, 0.03594, " like", false], [2711, 0.024862, " search", false], [3716, 0.018841, " comput", false], [476, 0.016976, " or", false], [7373, 0.016174, " effective", false], [54480, 0.015547, " computational", false], [13954, 0.014393, " generic", false], [3118, 0.013251, " based", false], [31499, 0.012603, " suited", false]]]}, "raw_delta": -0.07966975371042884, "tuned_delta": -0.0710979616798506}, {"byte_start": 3464, "byte_end": 3467, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 586, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "7.51% 7.51% 7.51%", "qwen": "7.96% 7.96% 7.96%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.28507310152053833]], "qwen": [[304, " in", "normal", 0.26591023802757263]]}, "loss": {"rwkv": 7.514036671296684, "qwen": 7.962453486240692}, "topk": {"rwkv": [4596, 2, 0.28507310152053833, [[45, 0.334784, ",", false], [4596, 0.285073, " in", false], [21265, 0.188728, " and", false], [47, 0.067821, ".", false], [5346, 0.03041, "---", false], [275, 0.024674, " (", false], [4715, 0.013308, " or", false], [32226, 0.008372, " than", false], [21400, 0.006468, " but", false], [59, 0.00586, ":", false]]], "qwen": [304, 1, 0.26591023802757263, [[304, 0.26591, " in", false], [11, 0.261915, ",", false], [323, 0.217155, " and", false], [4421, 0.069411, "---", false], [13, 0.061853, ".", false], [320, 0.038152, " (", false], [714, 0.021823, " but", false], [476, 0.011689, " or", false], [25, 0.009083, ":", false], [26, 0.005756, ";", false]]]}, "raw_delta": -0.02486550807952881, "tuned_delta": -0.01629371604895056}, {"byte_start": 3467, "byte_end": 3474, "display": {"text": " nature", "kind": "normal"}, "is_word": true, "word_id": 587, "word_key": " nature", "bytes_hex": "20 6e 61 74 75 72 65", "compression": {"rwkv": "0.78% 0.78% 0.78% 0.78% 0.78% 0.78% 0.78%", "qwen": "0.58% 0.58% 0.58% 0.58% 0.58% 0.58% 0.58%"}, "model_tokens": {"rwkv": [[46642, " nature", "normal", 0.7380651235580444]], "qwen": [[6993, " nature", "normal", 0.7982470989227295]]}, "loss": {"rwkv": 0.7799167527127138, "qwen": 0.5805226393643393}, "topk": {"rwkv": [46642, 1, 0.7380651235580444, [[46642, 0.738065, " nature", false], [55532, 0.066161, " approach", false], [59284, 0.065103, " character", false], [39931, 0.040284, " their", false], [46004, 0.027238, " flavor", false], [47362, 0.013647, " spirit", false], [22590, 0.012682, " the", false], [63735, 0.005605, " orientation", false], [32227, 0.0027, " that", false], [30899, 0.002066, " form", false]]], "qwen": [6993, 1, 0.7982470989227295, [[6993, 0.798247, " nature", false], [3668, 0.055633, " character", false], [17172, 0.04214, " flavor", false], [5486, 0.025221, " approach", false], [862, 0.024129, " their", false], [8913, 0.007035, " spirit", false], [279, 0.005846, " the", false], [16725, 0.004318, " orientation", false], [1352, 0.003448, " form", false], [5244, 0.003247, " focus", false]]]}, "raw_delta": 0.011056757399014064, "tuned_delta": 0.01962854942959231}, {"byte_start": 3474, "byte_end": 3478, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 588, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "6.97% 6.97% 6.97% 6.97%", "qwen": "7.11% 7.11% 7.11% 7.11%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.21052032709121704]], "qwen": [[323, " and", "normal", 0.20663084089756012]]}, "loss": {"rwkv": 6.9739652855472345, "qwen": 7.108976503486595}, "topk": {"rwkv": [21265, 2, 0.21052032709121704, [[45, 0.456307, ",", false], [21265, 0.21052, " and", false], [47, 0.20057, ".", false], [5346, 0.048755, "---", false], [275, 0.039368, " (", false], [21400, 0.013839, " but", false], [59, 0.010156, ":", false], [60, 0.006548, ";", false], [4715, 0.001868, " or", false], [32227, 0.001345, " that", false]]], "qwen": [323, 3, 0.20663084089756012, [[11, 0.348995, ",", false], [13, 0.261467, ".", false], [323, 0.206631, " and", false], [4421, 0.067034, "---", false], [320, 0.041091, " (", false], [714, 0.02972, " but", false], [25, 0.015691, ":", false], [26, 0.008932, ";", false], [429, 0.004058, " that", false], [313, 0.001818, "--", false]]]}, "raw_delta": -0.007486611604690552, "tuned_delta": 0.0010851804258876965}, {"byte_start": 3478, "byte_end": 3482, "display": {"text": " did", "kind": "normal"}, "is_word": true, "word_id": 589, "word_key": " did", "bytes_hex": "20 64 69 64", "compression": {"rwkv": "11.91% 11.91% 11.91% 11.91%", "qwen": "12.47% 12.47% 12.47% 12.47%"}, "model_tokens": {"rwkv": [[21532, " did", "normal", 0.07148892432451248]], "qwen": [[1521, " did", "normal", 0.06296456605195999]]}, "loss": {"rwkv": 11.905051851085684, "qwen": 12.466612827357629}, "topk": {"rwkv": [21532, 2, 0.07148892432451248, [[32227, 0.161816, " that", false], [21532, 0.071489, " did", false], [32354, 0.067243, " used", false], [37810, 0.054365, " based", false], [32462, 0.050358, " were", false], [31458, 0.047804, " more", false], [31277, 0.02681, " less", false], [21795, 0.024628, " had", false], [31351, 0.023634, " made", false], [47054, 0.022225, " relied", false]]], "qwen": [1521, 2, 0.06296456605195999, [[429, 0.120831, " that", false], [1521, 0.062965, " did", false], [1033, 0.058103, " were", false], [3867, 0.057854, " took", false], [11, 0.035677, ",", false], [1483, 0.033562, " used", false], [1865, 0.031942, " made", false], [39913, 0.028828, " relied", false], [892, 0.023499, " which", false], [1030, 0.023368, " had", false]]]}, "raw_delta": -0.0311395525932312, "tuned_delta": -0.02256776056265295}, {"byte_start": 3482, "byte_end": 3487, "display": {"text": " much", "kind": "normal"}, "is_word": true, "word_id": 590, "word_key": " much", "bytes_hex": "20 6d 75 63 68", "compression": {"rwkv": "22.32% 22.32% 22.32% 22.32% 22.32%", "qwen": "20.84% 20.84% 20.84% 20.84% 20.84%"}, "model_tokens": {"rwkv": [[31466, " much", "normal", 0.002074274467304349]], "qwen": [[1753, " much", "normal", 0.0030921902507543564]]}, "loss": {"rwkv": 22.31668891375115, "qwen": 20.84288874666184}, "topk": {"rwkv": [31466, 4, 0.002074274467304349, [[22187, 0.971966, " not", false], [30211, 0.004615, " away", false], [4692, 0.00315, " no", false], [31466, 0.002074, " much", false], [31277, 0.001834, " less", false], [46454, 0.001438, " little", false], [31458, 0.0013, " more", false], [332, 0.001027, " a", false], [45301, 0.000947, " better", false], [31856, 0.000638, " rely", false]]], "qwen": [1753, 4, 0.0030921902507543564, [[537, 0.949856, " not", false], [264, 0.004543, " a", false], [2664, 0.00393, " better", false], [1753, 0.003092, " much", false], [2686, 0.00274, " less", false], [1632, 0.002697, " well", false], [1373, 0.002249, " require", false], [2632, 0.001887, " little", false], [803, 0.001702, " more", false], [1602, 0.001505, " very", false]]]}, "raw_delta": 0.08172483444213863, "tuned_delta": 0.09029662647271687}, {"byte_start": 3487, "byte_end": 3492, "display": {"text": " more", "kind": "normal"}, "is_word": true, "word_id": 591, "word_key": " more", "bytes_hex": "20 6d 6f 72 65", "compression": {"rwkv": "9.19% 9.19% 9.19% 9.19% 9.19%", "qwen": "5.78% 5.78% 5.78% 5.78% 5.78%"}, "model_tokens": {"rwkv": [[31458, " more", "normal", 0.07819143682718277]], "qwen": [[803, " more", "normal", 0.20147407054901123]]}, "loss": {"rwkv": 9.185909830660195, "qwen": 5.778335017442954}, "topk": {"rwkv": [31458, 3, 0.07819143682718277, [[45301, 0.566712, " better", false], [31277, 0.246108, " less", false], [31458, 0.078191, " more", false], [4706, 0.027247, " of", false], [32487, 0.017617, " with", false], [22590, 0.015422, " the", false], [4811, 0.010659, " to", false], [45, 0.004582, ",", false], [4715, 0.003168, " or", false], [38475, 0.002385, " fewer", false]]], "qwen": [803, 3, 0.20147407054901123, [[2686, 0.413826, " less", false], [2664, 0.293949, " better", false], [803, 0.201474, " more", false], [315, 0.03732, " of", false], [10960, 0.006383, " worse", false], [448, 0.00482, " with", false], [311, 0.004143, " to", false], [11, 0.003658, ",", false], [6832, 0.003465, " learning", false], [279, 0.003133, " the", false]]]}, "raw_delta": 0.1889560699462891, "tuned_delta": 0.19752786197686736}, {"byte_start": 3492, "byte_end": 3504, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 592, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "3.50% 3.50% 3.50% 3.50% 3.50% 3.50% 3.50% 3.50% 3.50% 3.50% 3.50% 3.50%", "qwen": "1.86% 1.86% 1.86% 1.86% 1.86% 1.86% 1.86% 1.86% 1.86% 1.86% 1.86% 1.86%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.0981467068195343]], "qwen": [[34447, " computation", "normal", 0.2901773154735565]]}, "loss": {"rwkv": 3.4987233250725183, "qwen": 1.8593682153775188}, "topk": {"rwkv": [63370, 2, 0.0981467068195343, [[32487, 0.277294, " with", false], [63370, 0.098147, " computation", false], [4811, 0.049486, " to", false], [51832, 0.041776, " general", false], [4706, 0.032036, " of", false], [32499, 0.024771, " work", false], [56537, 0.024551, " learning", false], [52195, 0.01695, " massive", false], [47202, 0.015255, " search", false], [63507, 0.01412, " effectively", false]]], "qwen": [34447, 1, 0.2901773154735565, [[34447, 0.290177, " computation", false], [15039, 0.145217, " searching", false], [2711, 0.081705, " search", false], [315, 0.0751, " of", false], [448, 0.05351, " with", false], [24231, 0.031271, " computing", false], [6832, 0.022954, " learning", false], [4586, 0.018643, " general", false], [975, 0.017757, " work", false], [311, 0.01145, " to", false]]]}, "raw_delta": 0.09090514977773033, "tuned_delta": 0.09947694180830857}, {"byte_start": 3504, "byte_end": 3505, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "32.97%", "qwen": "45.12%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.1606893539428711]], "qwen": [[11, ",", "normal", 0.08190564066171646]]}, "loss": {"rwkv": 32.9678358953142, "qwen": 45.12366854832176}, "topk": {"rwkv": [45, 2, 0.1606893539428711, [[47, 0.49463, ".", false], [45, 0.160689, ",", false], [5346, 0.049153, "---", false], [275, 0.044913, " (", false], [4596, 0.033058, " in", false], [4811, 0.028661, " to", false], [4712, 0.021897, " on", false], [22278, 0.020443, " per", false], [21265, 0.017576, " and", false], [32226, 0.017341, " than", false]]], "qwen": [11, 2, 0.08190564066171646, [[13, 0.583414, ".", false], [11, 0.081906, ",", false], [1091, 0.070011, " than", false], [4421, 0.039688, "---", false], [320, 0.033191, " (", false], [304, 0.031476, " in", false], [817, 0.024267, " per", false], [389, 0.023708, " on", false], [311, 0.02129, " to", false], [323, 0.013687, " and", false]]]}, "raw_delta": -0.6740624904632568, "tuned_delta": -0.6654906984326786}, {"byte_start": 3505, "byte_end": 3511, "display": {"text": " based", "kind": "normal"}, "is_word": true, "word_id": 593, "word_key": " based", "bytes_hex": "20 62 61 73 65 64", "compression": {"rwkv": "12.96% 12.96% 12.96% 12.96% 12.96% 12.96%", "qwen": "13.62% 13.62% 13.62% 13.62% 13.62% 13.62%"}, "model_tokens": {"rwkv": [[37810, " based", "normal", 0.013464839197695255]], "qwen": [[3118, " based", "normal", 0.01076422818005085]]}, "loss": {"rwkv": 12.96171325798678, "qwen": 13.620024149393167}, "topk": {"rwkv": [37810, 13, 0.013464839197695255, [[21400, 0.256003, " but", false], [21265, 0.090732, " and", false], [59841, 0.056641, " including", false], [40085, 0.034153, " using", false], [4596, 0.02781, " in", false], [40186, 0.022788, " which", false], [32487, 0.018737, " with", false], [61953, 0.01661, " especially", false], [30322, 0.016132, " both", false], [55495, 0.01419, " although", false]]], "qwen": [3118, 12, 0.01076422818005085, [[714, 0.261164, " but", false], [323, 0.184254, " and", false], [2670, 0.10632, " including", false], [1741, 0.029872, " such", false], [5310, 0.020441, " especially", false], [448, 0.019934, " with", false], [892, 0.018584, " which", false], [304, 0.01769, " in", false], [7892, 0.014641, " although", false], [1667, 0.014108, " using", false]]]}, "raw_delta": -0.036504507064819336, "tuned_delta": -0.027932715034241086}, {"byte_start": 3511, "byte_end": 3514, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 594, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"rwkv": "0.57% 0.57% 0.57%", "qwen": "0.84% 0.84% 0.84%"}, "model_tokens": {"rwkv": [[4712, " on", "normal", 0.9089198112487793]], "qwen": [[389, " on", "normal", 0.8698983192443848]]}, "loss": {"rwkv": 0.572358262071427, "qwen": 0.8378387436300176}, "topk": {"rwkv": [4712, 1, 0.9089198112487793, [[4712, 0.90892, " on", false], [4596, 0.01225, " in", false], [32350, 0.011141, " upon", false], [52094, 0.008452, " largely", false], [46495, 0.007784, " mainly", false], [60247, 0.005817, " primarily", false], [45, 0.005664, ",", false], [46602, 0.005173, " mostly", false], [31581, 0.003709, " only", false], [31458, 0.003253, " more", false]]], "qwen": [389, 1, 0.8698983192443848, [[389, 0.869898, " on", false], [304, 0.021619, " in", false], [11, 0.011789, ",", false], [13771, 0.010429, " largely", false], [438, 0.008155, " as", false], [10008, 0.005441, " mostly", false], [537, 0.005329, " not", false], [2987, 0.005026, " either", false], [15503, 0.004967, " primarily", false], [5193, 0.004075, " upon", false]]]}, "raw_delta": -0.01472136378288269, "tuned_delta": -0.006149571752304442}, {"byte_start": 3514, "byte_end": 3521, "display": {"text": " hidden", "kind": "normal"}, "is_word": true, "word_id": 595, "word_key": " hidden", "bytes_hex": "20 68 69 64 64 65 6e", "compression": {"rwkv": "9.62% 9.62% 9.62% 9.62% 9.62% 9.62% 9.62%", "qwen": "10.98% 10.98% 10.98% 10.98% 10.98% 10.98% 10.98%"}, "model_tokens": {"rwkv": [[46196, " hidden", "normal", 0.023908214643597603]], "qwen": [[8177, " hidden", "normal", 0.014072589576244354]]}, "loss": {"rwkv": 9.62065052378522, "qwen": 10.983872234296777}, "topk": {"rwkv": [46196, 6, 0.023908214643597603, [[22590, 0.178736, " the", false], [56537, 0.070708, " learning", false], [332, 0.058205, " a", false], [52195, 0.051162, " massive", false], [38864, 0.043341, " large", false], [46196, 0.023908, " hidden", false], [63885, 0.023092, " statistical", false], [62633, 0.017139, " techniques", false], [52224, 0.01643, " methods", false], [57453, 0.013904, " training", false]]], "qwen": [8177, 7, 0.014072589576244354, [[279, 0.121637, " the", false], [264, 0.052986, " a", false], [6832, 0.03322, " learning", false], [3460, 0.029745, " large", false], [4862, 0.026799, " training", false], [29728, 0.015595, " neural", false], [8177, 0.014073, " hidden", false], [12538, 0.012574, " techniques", false], [5662, 0.012055, " machine", false], [5413, 0.010144, " methods", false]]]}, "raw_delta": -0.07559306280953537, "tuned_delta": -0.06702127077895713}, {"byte_start": 3521, "byte_end": 3528, "display": {"text": " Markov", "kind": "normal"}, "is_word": true, "word_id": 596, "word_key": " markov", "bytes_hex": "20 4d 61 72 6b 6f 76", "compression": {"rwkv": "0.11% 0.11% 0.11% 0.11% 0.11% 0.11% 0.11%", "qwen": "0.37% 0.37% 0.37% 0.37% 0.37% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[44557, " Markov", "normal", 0.959473192691803]], "qwen": [[4389, " Mark", "normal", 0.9030137658119202], [859, "ov", "normal", 0.9992189407348633]]}, "loss": {"rwkv": 0.10692407093642042, "qwen": 0.2648345104151857}, "topk": {"rwkv": [44557, 1, 0.959473192691803, [[44557, 0.959473, " Markov", false], [46, 0.018457, "-", false], [31376, 0.008027, " mark", false], [60725, 0.002314, " variables", false], [40069, 0.001311, " units", false], [47398, 0.000993, " states", false], [57518, 0.000764, " variable", false], [39802, 0.000665, " state", false], [46587, 0.000534, " models", false], [275, 0.000464, " (", false]]], "qwen": [4389, 1, 0.9030137658119202, [[4389, 0.903014, " Mark", false], [1868, 0.035682, " mark", false], [5251, 0.009038, "-M", false], [28904, 0.007059, "-mark", false], [12, 0.006278, "-", false], [1448, 0.004914, "-m", false], [20733, 0.004111, "-state", false], [1584, 0.002487, " state", false], [8949, 0.001597, "Mark", false], [64096, 0.001461, "-memory", false]]]}, "raw_delta": -0.008756414072455043, "tuned_delta": -0.0001846220418767943}, {"byte_start": 3528, "byte_end": 3535, "display": {"text": " models", "kind": "normal"}, "is_word": true, "word_id": 597, "word_key": " models", "bytes_hex": "20 6d 6f 64 65 6c 73", "compression": {"rwkv": "0.15% 0.15% 0.15% 0.15% 0.15% 0.15% 0.15%", "qwen": "0.08% 0.08% 0.08% 0.08% 0.08% 0.08% 0.08%"}, "model_tokens": {"rwkv": [[46587, " models", "normal", 0.9444479942321777]], "qwen": [[4119, " models", "normal", 0.9691730737686157]]}, "loss": {"rwkv": 0.147177838818367, "qwen": 0.08066737789838634}, "topk": {"rwkv": [46587, 1, 0.9444479942321777, [[46587, 0.944448, " models", false], [39043, 0.015857, " model", false], [56658, 0.00883, " modeling", false], [46, 0.007083, "-", false], [45447, 0.003356, " chains", false], [21265, 0.003224, " and", false], [4715, 0.002533, " or", false], [44592, 0.00183, " Models", false], [60261, 0.001642, " processes", false], [275, 0.00117, " (", false]]], "qwen": [4119, 1, 0.9691730737686157, [[4119, 0.969173, " models", false], [1614, 0.012049, " model", false], [26874, 0.00448, " Models", false], [33479, 0.003152, " modeling", false], [476, 0.002071, " or", false], [26179, 0.001405, " chains", false], [28244, 0.001231, "-model", false], [323, 0.00104, " and", false], [11364, 0.000769, " processes", false], [4194, 0.000413, " random", false]]]}, "raw_delta": 0.00368812307715416, "tuned_delta": 0.012259915107732408}, {"byte_start": 3535, "byte_end": 3537, "display": {"text": " (", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "20 28", "compression": {"rwkv": "17.19% 17.19%", "qwen": "16.60% 16.60%"}, "model_tokens": {"rwkv": [[275, " (", "normal", 0.1487080305814743]], "qwen": [[320, " (", "normal", 0.15871939063072205]]}, "loss": {"rwkv": 17.188358885591164, "qwen": 16.59656013462283}, "topk": {"rwkv": [275, 4, 0.1487080305814743, [[47, 0.283415, ".", false], [21265, 0.247813, " and", false], [45, 0.190994, ",", false], [275, 0.148708, " (", false], [4715, 0.039965, " or", false], [4706, 0.01696, " of", false], [32227, 0.013779, " that", false], [5346, 0.012509, "---", false], [32487, 0.007722, " with", false], [21700, 0.006554, " for", false]]], "qwen": [320, 4, 0.15871939063072205, [[323, 0.328073, " and", false], [11, 0.233007, ",", false], [13, 0.175975, ".", false], [320, 0.158719, " (", false], [476, 0.035767, " or", false], [448, 0.013998, " with", false], [429, 0.010125, " that", false], [4421, 0.006499, "---", false], [315, 0.006206, " of", false], [369, 0.003851, " for", false]]]}, "raw_delta": 0.032816290855407715, "tuned_delta": 0.041388082885985965}, {"byte_start": 3537, "byte_end": 3541, "display": {"text": "HMMs", "kind": "normal"}, "is_word": true, "word_id": 598, "word_key": "hmms", "bytes_hex": "48 4d 4d 73", "compression": {"rwkv": "2.69% 2.69% 0.94% 0.94%", "qwen": "6.68% 0.03% 0.03% 2.60%"}, "model_tokens": {"rwkv": [[1082, "HM", "normal", 0.743228554725647], [1261, "Ms", "normal", 0.9010351896286011]], "qwen": [[39, "H", "normal", 0.6906211972236633], [8035, "MM", "normal", 0.9962831139564514], [82, "s", "normal", 0.8658856153488159]]}, "loss": {"rwkv": 1.818338171042303, "qwen": 2.334867245282211}, "topk": {"rwkv": [1082, 1, 0.743228554725647, [[1082, 0.743229, "HM", false], [36003, 0.023631, "which", false], [98, 0.02212, "a", false], [7005, 0.018637, "and", false], [1926, 0.014106, "hm", false], [2101, 0.01403, "or", false], [8695, 0.011904, "see", false], [8801, 0.009683, "the", false], [27142, 0.006171, "that", false], [58443, 0.005013, "statistic", false]]], "qwen": [39, 1, 0.6906211972236633, [[39, 0.690621, "H", false], [8206, 0.047421, "which", false], [437, 0.039519, "and", false], [64, 0.024801, "a", false], [269, 0.016491, "or", false], [1782, 0.01081, "the", false], [258, 0.009388, "in", false], [71, 0.008746, "h", false], [300, 0.006994, "as", false], [4197, 0.006513, "with", false]]]}, "raw_delta": -0.028642453718930483, "tuned_delta": -0.020070661688352233}, {"byte_start": 3541, "byte_end": 3543, "display": {"text": ").", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29 2e", "compression": {"rwkv": "7.22% 7.22%", "qwen": "9.13% 9.13%"}, "model_tokens": {"rwkv": [[499, ").", "normal", 0.44534578919410706]], "qwen": [[568, ").", "normal", 0.3631744682788849]]}, "loss": {"rwkv": 7.220519613824157, "qwen": 9.132908647273922}, "topk": {"rwkv": [499, 1, 0.44534578919410706, [[499, 0.445346, ").", false], [42, 0.328558, ")", false], [497, 0.201617, "),", false], [5308, 0.008746, ")--", false], [45, 0.005604, ",", false], [502, 0.002893, ");", false], [60, 0.001664, ";", false], [5346, 0.0007, "---", false], [21700, 0.000687, " for", false], [501, 0.000635, "):", false]]], "qwen": [568, 2, 0.3631744682788849, [[8, 0.385691, ")", false], [568, 0.363174, ").", false], [701, 0.229154, "),", false], [11, 0.006967, ",", false], [3593, 0.002974, ").\n\n", false], [1215, 0.002065, ");", false], [29621, 0.001574, ")--", false], [26, 0.001246, ";", false], [323, 0.001242, " and", false], [4421, 0.000941, "---", false]]]}, "raw_delta": -0.10604536533355713, "tuned_delta": -0.09747357330297889}, {"byte_start": 3543, "byte_end": 3549, "display": {"text": " Again", "kind": "normal"}, "is_word": true, "word_id": 599, "word_key": " again", "bytes_hex": "20 41 67 61 69 6e", "compression": {"rwkv": "16.81% 16.81% 16.81% 16.81% 16.81% 16.81%", "qwen": "15.64% 15.64% 15.64% 15.64% 15.64% 15.64%"}, "model_tokens": {"rwkv": [[36251, " Again", "normal", 0.003723106812685728]], "qwen": [[13759, " Again", "normal", 0.005494527984410524]]}, "loss": {"rwkv": 16.812657052026328, "qwen": 15.641225889449453}, "topk": {"rwkv": [36251, 32, 0.003723106812685728, [[20996, 0.324433, " The", false], [37453, 0.087602, " These", false], [3866, 0.072985, " HM", false], [3913, 0.057136, " In", false], [3918, 0.026648, " It", false], [29894, 0.022694, " This", false], [3642, 0.019202, " At", false], [267, 0.018116, "  ", false], [37451, 0.016326, " There", false], [54829, 0.014108, " Although", false]]], "qwen": [13759, 31, 0.005494527984410524, [[576, 0.262557, " The", false], [4220, 0.073662, " These", false], [472, 0.071914, " H", false], [758, 0.057428, " In", false], [1096, 0.038843, " This", false], [1084, 0.028376, " It", false], [2411, 0.020486, " At", false], [2619, 0.016192, " There", false], [3197, 0.015853, " When", false], [3216, 0.014445, " By", false]]]}, "raw_delta": 0.06495793660481763, "tuned_delta": 0.07352972863539588}, {"byte_start": 3549, "byte_end": 3550, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "2.61%", "qwen": "3.05%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.865909218788147]], "qwen": [[11, ",", "normal", 0.8445719480514526]]}, "loss": {"rwkv": 2.606431470356037, "qwen": 3.0463466991666914}, "topk": {"rwkv": [45, 1, 0.865909218788147, [[45, 0.865909, ",", false], [22590, 0.047503, " the", false], [39934, 0.014524, " there", false], [21265, 0.009154, " and", false], [3866, 0.008656, " HM", false], [4601, 0.007596, " it", false], [4596, 0.005665, " in", false], [39936, 0.005091, " these", false], [32234, 0.003568, " this", false], [47202, 0.002804, " search", false]]], "qwen": [11, 1, 0.8445719480514526, [[11, 0.844572, ",", false], [279, 0.053969, " the", false], [1052, 0.015605, " there", false], [432, 0.015465, " it", false], [304, 0.009116, " in", false], [419, 0.005411, " this", false], [1493, 0.005168, " these", false], [323, 0.0044, " and", false], [264, 0.003203, " a", false], [11811, 0.002799, " researchers", false]]]}, "raw_delta": -0.02439408004283905, "tuned_delta": -0.0158222880122608}, {"byte_start": 3550, "byte_end": 3554, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 600, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "3.24% 3.24% 3.24% 3.24%", "qwen": "4.65% 4.65% 4.65% 4.65%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.49406540393829346]], "qwen": [[279, " the", "normal", 0.356892853975296]]}, "loss": {"rwkv": 3.240428314496695, "qwen": 4.645115963466906}, "topk": {"rwkv": [22590, 1, 0.49406540393829346, [[22590, 0.494065, " the", false], [3866, 0.06066, " HM", false], [39934, 0.046454, " there", false], [39936, 0.038909, " these", false], [38720, 0.034166, " human", false], [4601, 0.031346, " it", false], [4596, 0.021296, " in", false], [32234, 0.020433, " this", false], [63843, 0.015117, " researchers", false], [332, 0.012578, " a", false]]], "qwen": [279, 1, 0.356892853975296, [[279, 0.356893, " the", false], [432, 0.05677, " it", false], [3738, 0.041688, " human", false], [1052, 0.038032, " there", false], [304, 0.035916, " in", false], [472, 0.034717, " H", false], [1493, 0.033768, " these", false], [419, 0.021128, " this", false], [4124, 0.020707, " early", false], [438, 0.017895, " as", false]]]}, "raw_delta": -0.07789242267608643, "tuned_delta": -0.06932063064550818}, {"byte_start": 3554, "byte_end": 3566, "display": {"text": " statistical", "kind": "normal"}, "is_word": true, "word_id": 601, "word_key": " statistical", "bytes_hex": "20 73 74 61 74 69 73 74 69 63 61 6c", "compression": {"rwkv": "4.98% 4.98% 4.98% 4.98% 4.98% 4.98% 4.98% 4.98% 4.98% 4.98% 4.98% 4.98%", "qwen": "4.40% 4.40% 4.40% 4.40% 4.40% 4.40% 4.40% 4.40% 4.40% 4.40% 4.40% 4.40%"}, "model_tokens": {"rwkv": [[63885, " statistical", "normal", 0.03652314469218254]], "qwen": [[28464, " statistical", "normal", 0.05349557474255562]]}, "loss": {"rwkv": 4.978049294734053, "qwen": 4.400454877538232}, "topk": {"rwkv": [63885, 4, 0.03652314469218254, [[3866, 0.201409, " HM", false], [38720, 0.184401, " human", false], [38328, 0.046366, " early", false], [63885, 0.036523, " statistical", false], [52224, 0.034727, " methods", false], [47202, 0.030684, " search", false], [52013, 0.026483, " initial", false], [47798, 0.02279, " winner", false], [52964, 0.017055, " special", false], [63843, 0.01606, " researchers", false]]], "qwen": [28464, 4, 0.05349557474255562, [[3738, 0.136382, " human", false], [472, 0.068326, " H", false], [4124, 0.056395, " early", false], [28464, 0.053496, " statistical", false], [2856, 0.047444, " initial", false], [5413, 0.042712, " methods", false], [25546, 0.032433, " newer", false], [15271, 0.031915, " latter", false], [13632, 0.028531, " winner", false], [3281, 0.025215, " special", false]]]}, "raw_delta": 0.03202863534291587, "tuned_delta": 0.04060042737349412}, {"byte_start": 3566, "byte_end": 3574, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 602, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "0.63% 0.63% 0.63% 0.63% 0.63% 0.63% 0.63% 0.63%", "qwen": "0.92% 0.92% 0.92% 0.92% 0.92% 0.92% 0.92% 0.92%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.7541329860687256]], "qwen": [[5413, " methods", "normal", 0.664587140083313]]}, "loss": {"rwkv": 0.6295940882785698, "qwen": 0.9210465029849182}, "topk": {"rwkv": [52224, 1, 0.7541329860687256, [[52224, 0.754133, " methods", false], [55532, 0.056963, " approach", false], [61590, 0.045995, " approaches", false], [46561, 0.032751, " method", false], [45, 0.015164, ",", false], [46587, 0.014644, " models", false], [46, 0.01364, "-", false], [3866, 0.01118, " HM", false], [62633, 0.008179, " techniques", false], [32011, 0.005531, " side", false]]], "qwen": [5413, 1, 0.664587140083313, [[5413, 0.664587, " methods", false], [5486, 0.064661, " approach", false], [19827, 0.043287, " approaches", false], [1714, 0.034178, " method", false], [11, 0.026638, ",", false], [323, 0.014655, " and", false], [472, 0.014598, " H", false], [320, 0.013281, " (", false], [5980, 0.012254, "-based", false], [4119, 0.010203, " models", false]]]}, "raw_delta": -0.01616155356168747, "tuned_delta": -0.007589761531109221}, {"byte_start": 3574, "byte_end": 3578, "display": {"text": " won", "kind": "normal"}, "is_word": true, "word_id": 603, "word_key": " won", "bytes_hex": "20 77 6f 6e", "compression": {"rwkv": "3.84% 3.84% 3.84% 3.84%", "qwen": "8.76% 8.76% 8.76% 8.76%"}, "model_tokens": {"rwkv": [[22777, " won", "normal", 0.424134761095047]], "qwen": [[2765, " won", "normal", 0.1433647722005844]]}, "loss": {"rwkv": 3.839203111740649, "qwen": 8.7569921936927}, "topk": {"rwkv": [22777, 1, 0.424134761095047, [[22777, 0.424135, " won", false], [32462, 0.173788, " were", false], [46936, 0.039287, " proved", false], [45, 0.037533, ",", false], [61959, 0.026863, " eventually", false], [21795, 0.023217, " had", false], [60244, 0.01898, " prevailed", false], [21532, 0.01613, " did", false], [30256, 0.012252, " beat", false], [47211, 0.011561, " seemed", false]]], "qwen": [2765, 1, 0.1433647722005844, [[2765, 0.143365, " won", false], [1033, 0.120753, " were", false], [18651, 0.109853, " proved", false], [11, 0.049774, ",", false], [29701, 0.047198, " dominated", false], [9583, 0.046813, " eventually", false], [13653, 0.027808, " ultimately", false], [9382, 0.026061, " beat", false], [3118, 0.025765, " based", false], [1521, 0.018119, " did", false]]]}, "raw_delta": -0.27270013093948364, "tuned_delta": -0.2641283389089054}, {"byte_start": 3578, "byte_end": 3582, "display": {"text": " out", "kind": "normal"}, "is_word": true, "word_id": 604, "word_key": " out", "bytes_hex": "20 6f 75 74", "compression": {"rwkv": "10.43% 10.43% 10.43% 10.43%", "qwen": "13.68% 13.68% 13.68% 13.68%"}, "model_tokens": {"rwkv": [[22249, " out", "normal", 0.0996764749288559]], "qwen": [[700, " out", "normal", 0.048153363168239594]]}, "loss": {"rwkv": 10.425725881424148, "qwen": 13.675686334344915}, "topk": {"rwkv": [22249, 4, 0.0996764749288559, [[45, 0.271348, ",", false], [47, 0.190689, ".", false], [22590, 0.123692, " the", false], [22249, 0.099676, " out", false], [4450, 0.059841, " by", false], [4596, 0.040531, " in", false], [21265, 0.028968, " and", false], [5346, 0.026318, "---", false], [32234, 0.011701, " this", false], [21357, 0.010701, " big", false]]], "qwen": [700, 4, 0.048153363168239594, [[11, 0.257229, ",", false], [13, 0.197844, ".", false], [279, 0.160048, " the", false], [700, 0.048153, " out", false], [323, 0.043212, " and", false], [304, 0.038485, " in", false], [553, 0.02944, " by", false], [382, 0.023635, ".\n\n", false], [4421, 0.02173, "---", false], [419, 0.013421, " this", false]]]}, "raw_delta": -0.18021607398986816, "tuned_delta": -0.1716442819592899}, {"byte_start": 3582, "byte_end": 3587, "display": {"text": " over", "kind": "normal"}, "is_word": true, "word_id": 605, "word_key": " over", "bytes_hex": "20 6f 76 65 72", "compression": {"rwkv": "12.57% 12.57% 12.57% 12.57% 12.57%", "qwen": "13.65% 13.65% 13.65% 13.65% 13.65%"}, "model_tokens": {"rwkv": [[31601, " over", "normal", 0.030751002952456474]], "qwen": [[916, " over", "normal", 0.022708440199494362]]}, "loss": {"rwkv": 12.567226332743704, "qwen": 13.651568347301168}, "topk": {"rwkv": [31601, 6, 0.030751002952456474, [[45, 0.315893, ",", false], [47, 0.222139, ".", false], [4596, 0.14563, " in", false], [21265, 0.053644, " and", false], [4450, 0.03463, " by", false], [31601, 0.030751, " over", false], [61959, 0.029524, " eventually", false], [5346, 0.017705, "---", false], [51018, 0.011196, " because", false], [55925, 0.008306, " decisive", false]]], "qwen": [916, 6, 0.022708440199494362, [[11, 0.350947, ",", false], [13, 0.276182, ".", false], [304, 0.087414, " in", false], [323, 0.057563, " and", false], [382, 0.034446, ".\n\n", false], [916, 0.022708, " over", false], [4421, 0.021969, "---", false], [33022, 0.014341, " decis", false], [553, 0.013826, " by", false], [320, 0.01148, " (", false]]]}, "raw_delta": -0.06012868881225586, "tuned_delta": -0.05155689678167761}, {"byte_start": 3587, "byte_end": 3591, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 606, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "2.57% 2.57% 2.57% 2.57%", "qwen": "1.04% 1.04% 1.04% 1.04%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.569801390171051]], "qwen": [[279, " the", "normal", 0.7941256165504456]]}, "loss": {"rwkv": 2.571209423459334, "qwen": 1.0392525974289544}, "topk": {"rwkv": [22590, 1, 0.569801390171051, [[22590, 0.569801, " the", false], [32251, 0.230766, " time", false], [332, 0.040427, " a", false], [38720, 0.02062, " human", false], [52224, 0.018804, " methods", false], [39944, 0.015984, " those", false], [31370, 0.013614, " many", false], [31323, 0.008454, " long", false], [52869, 0.004427, " several", false], [3866, 0.004113, " HM", false]]], "qwen": [279, 1, 0.7941256165504456, [[279, 0.794126, " the", false], [678, 0.024315, " all", false], [882, 0.023916, " time", false], [264, 0.023365, " a", false], [3738, 0.019839, " human", false], [3281, 0.012307, " special", false], [1657, 0.00971, " many", false], [1846, 0.008672, " those", false], [5413, 0.006965, " methods", false], [803, 0.005373, " more", false]]]}, "raw_delta": 0.08494972437620163, "tuned_delta": 0.09352151640677987}, {"byte_start": 3591, "byte_end": 3597, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 607, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "2.79% 2.79% 2.79% 2.79% 2.79% 2.79%", "qwen": "4.50% 4.50% 4.50% 4.50% 4.50% 4.50%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.39809736609458923]], "qwen": [[3738, " human", "normal", 0.22361716628074646]]}, "loss": {"rwkv": 2.794282387138454, "qwen": 4.501869105482948}, "topk": {"rwkv": [38720, 1, 0.39809736609458923, [[38720, 0.398097, " human", false], [52224, 0.093048, " methods", false], [31458, 0.066597, " more", false], [52964, 0.041854, " special", false], [63875, 0.028607, " specialized", false], [31580, 0.019392, " ones", false], [39174, 0.019105, " older", false], [47202, 0.017081, " search", false], [59943, 0.015856, " knowledge", false], [3866, 0.014252, " HM", false]]], "qwen": [3738, 2, 0.22361716628074646, [[3281, 0.358286, " special", false], [3738, 0.223617, " human", false], [5413, 0.075183, " methods", false], [6540, 0.072806, " knowledge", false], [803, 0.040975, " more", false], [3800, 0.022162, " others", false], [27076, 0.0214, " specialized", false], [6788, 0.014749, " earlier", false], [1008, 0.01418, " other", false], [4124, 0.010068, " early", false]]]}, "raw_delta": -0.09468871355056763, "tuned_delta": -0.08611692151998938}, {"byte_start": 3597, "byte_end": 3607, "display": {"text": "-knowledge", "kind": "normal"}, "is_word": true, "word_id": 608, "word_key": "-knowledge", "bytes_hex": "2d 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "4.68% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13%", "qwen": "2.63% 2.63% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.7723766565322876], [58313, "knowledge", "normal", 0.9389006495475769]], "qwen": [[12646, "-k", "normal", 0.7466897964477539], [51186, "nowledge", "normal", 0.998958945274353]]}, "loss": {"rwkv": 0.5829248761404382, "qwen": 0.5286522461362759}, "topk": {"rwkv": [46, 1, 0.7723766565322876, [[46, 0.772377, "-", false], [59943, 0.128563, " knowledge", false], [52224, 0.05253, " methods", false], [61590, 0.00985, " approaches", false], [34864, 0.006816, "istic", false], [7919, 0.004152, "ist", false], [65034, 0.001804, " understanding", false], [46561, 0.001197, " method", false], [46587, 0.001169, " models", false], [55532, 0.001133, " approach", false]]], "qwen": [12646, 1, 0.7466897964477539, [[12646, 0.74669, "-k", false], [6540, 0.156835, " knowledge", false], [12, 0.014235, "-", false], [5980, 0.012712, "-based", false], [8660, 0.010945, " understanding", false], [71107, 0.010203, "-under", false], [5413, 0.004288, " methods", false], [35085, 0.002812, "-oriented", false], [50297, 0.002317, "-method", false], [3419, 0.00195, "-in", false]]]}, "raw_delta": 0.003009513637516648, "tuned_delta": 0.011581305668094895}, {"byte_start": 3607, "byte_end": 3613, "display": {"text": "-based", "kind": "normal"}, "is_word": true, "word_id": 609, "word_key": "-based", "bytes_hex": "2d 62 61 73 65 64", "compression": {"rwkv": "30.71% 0.46% 0.46% 0.46% 0.46% 0.46%", "qwen": "3.14% 3.14% 3.14% 3.14% 3.14% 3.14%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.1845637559890747], [34011, "based", "normal", 0.880551278591156]], "qwen": [[5980, "-based", "normal", 0.35163143277168274]]}, "loss": {"rwkv": 5.50050965703515, "qwen": 3.141383505864803}, "topk": {"rwkv": [46, 2, 0.1845637559890747, [[52224, 0.670292, " methods", false], [46, 0.184564, "-", false], [61590, 0.080086, " approaches", false], [37810, 0.017626, " based", false], [55532, 0.009256, " approach", false], [31580, 0.008055, " ones", false], [46561, 0.002841, " method", false], [45, 0.002271, ",", false], [51566, 0.001977, " efforts", false], [46587, 0.001846, " models", false]]], "qwen": [5980, 2, 0.35163143277168274, [[5413, 0.454863, " methods", false], [5980, 0.351631, "-based", false], [19827, 0.061546, " approaches", false], [3118, 0.04312, " based", false], [6174, 0.026549, " ones", false], [5486, 0.006416, " approach", false], [31405, 0.005861, "-driven", false], [12538, 0.002516, " techniques", false], [2331, 0.002066, " base", false], [35085, 0.002062, "-oriented", false]]]}, "raw_delta": 0.13081773122151694, "tuned_delta": 0.1393895232520952}, {"byte_start": 3613, "byte_end": 3621, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 610, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "0.66% 0.66% 0.66% 0.66% 0.66% 0.66% 0.66% 0.66%", "qwen": "0.44% 0.44% 0.44% 0.44% 0.44% 0.44% 0.44% 0.44%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.7432807087898254]], "qwen": [[5413, " methods", "normal", 0.8244560956954956]]}, "loss": {"rwkv": 0.6648161351752729, "qwen": 0.4351335400805226}, "topk": {"rwkv": [52224, 1, 0.7432807087898254, [[52224, 0.743281, " methods", false], [61590, 0.109698, " approaches", false], [31580, 0.089866, " ones", false], [55532, 0.009513, " approach", false], [51566, 0.00478, " efforts", false], [45, 0.004181, ",", false], [46561, 0.002382, " method", false], [47, 0.002334, ".", false], [63363, 0.002329, " competitors", false], [62633, 0.002109, " techniques", false]]], "qwen": [5413, 1, 0.8244560956954956, [[5413, 0.824456, " methods", false], [19827, 0.067382, " approaches", false], [6174, 0.052365, " ones", false], [5942, 0.006073, " systems", false], [5486, 0.005619, " approach", false], [8869, 0.00496, " efforts", false], [12538, 0.003728, " techniques", false], [3281, 0.003131, " special", false], [1714, 0.002541, " method", false], [11, 0.002202, ",", false]]]}, "raw_delta": 0.012736307457089424, "tuned_delta": 0.021308099487667674}, {"byte_start": 3621, "byte_end": 3622, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "14.37%", "qwen": "17.17%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.45558494329452515]], "qwen": [[13, ".", "normal", 0.38593173027038574]]}, "loss": {"rwkv": 14.370595133854907, "qwen": 17.169780459731708}, "topk": {"rwkv": [47, 1, 0.45558494329452515, [[47, 0.455585, ".", false], [45, 0.309949, ",", false], [4596, 0.058838, " in", false], [21265, 0.033201, " and", false], [4450, 0.031756, " by", false], [5346, 0.012278, "---", false], [275, 0.011693, " (", false], [51018, 0.010177, " because", false], [32227, 0.006678, " that", false], [37634, 0.004424, " after", false]]], "qwen": [13, 1, 0.38593173027038574, [[13, 0.385932, ".", false], [11, 0.298631, ",", false], [382, 0.07573, ".\n\n", false], [304, 0.050795, " in", false], [323, 0.034481, " and", false], [553, 0.020631, " by", false], [4421, 0.019415, "---", false], [320, 0.015519, " (", false], [26, 0.007749, ";", false], [518, 0.005623, " at", false]]]}, "raw_delta": -0.15521979331970215, "tuned_delta": -0.1466480012891239}, {"byte_start": 3622, "byte_end": 3627, "display": {"text": " This", "kind": "normal"}, "is_word": true, "word_id": 611, "word_key": " this", "bytes_hex": "20 54 68 69 73", "compression": {"rwkv": "10.03% 10.03% 10.03% 10.03% 10.03%", "qwen": "8.12% 8.12% 8.12% 8.12% 8.12%"}, "model_tokens": {"rwkv": [[29894, " This", "normal", 0.06170455738902092]], "qwen": [[1096, " This", "normal", 0.10536638647317886]]}, "loss": {"rwkv": 10.031238956181074, "qwen": 8.116282651710552}, "topk": {"rwkv": [29894, 4, 0.06170455738902092, [[261, 0.184556, "\n\n", false], [20996, 0.13913, " The", false], [3913, 0.075887, " In", false], [29894, 0.061705, " This", false], [19555, 0.033519, " But", false], [3918, 0.02886, " It", false], [267, 0.021632, "  ", false], [19417, 0.019461, " And", false], [300, 0.018988, " A", false], [37451, 0.018419, " There", false]]], "qwen": [1096, 2, 0.10536638647317886, [[576, 0.147242, " The", false], [1096, 0.105366, " This", false], [758, 0.077956, " In", false], [1084, 0.038441, " It", false], [2619, 0.034625, " There", false], [362, 0.023556, " A", false], [220, 0.023178, " ", false], [65694, 0.022903, " Statistical", false], [472, 0.021494, " H", false], [4220, 0.019384, " These", false]]]}, "raw_delta": 0.1061877250671387, "tuned_delta": 0.11475951709771694}, {"byte_start": 3627, "byte_end": 3631, "display": {"text": " led", "kind": "normal"}, "is_word": true, "word_id": 612, "word_key": " led", "bytes_hex": "20 6c 65 64", "compression": {"rwkv": "21.84% 21.84% 21.84% 21.84%", "qwen": "20.00% 20.00% 20.00% 20.00%"}, "model_tokens": {"rwkv": [[21994, " led", "normal", 0.0078525235876441]], "qwen": [[6069, " led", "normal", 0.01184548158198595]]}, "loss": {"rwkv": 21.837669075955986, "qwen": 19.99849735654479}, "topk": {"rwkv": [21994, 11, 0.0078525235876441, [[22748, 0.335846, " was", false], [32251, 0.127685, " time", false], [4600, 0.092788, " is", false], [63361, 0.060595, " competition", false], [52427, 0.04616, " pattern", false], [56348, 0.010858, " happened", false], [38328, 0.010419, " early", false], [53283, 0.010181, " victory", false], [22074, 0.009366, " may", false], [47092, 0.009033, " result", false]]], "qwen": [6069, 8, 0.01184548158198595, [[572, 0.290054, " was", false], [374, 0.138482, " is", false], [5383, 0.073053, " pattern", false], [882, 0.046901, " time", false], [9149, 0.018298, " trend", false], [10707, 0.012723, " competition", false], [6932, 0.011943, " happened", false], [6069, 0.011845, " led", false], [12560, 0.010531, " victory", false], [4124, 0.010371, " early", false]]]}, "raw_delta": 0.10198533535003662, "tuned_delta": 0.11055712738061486}, {"byte_start": 3631, "byte_end": 3634, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 613, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "1.91% 1.91% 1.91%", "qwen": "1.64% 1.64% 1.64%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.7254297137260437]], "qwen": [[311, " to", "normal", 0.7614275813102722]]}, "loss": {"rwkv": 1.9137312147208743, "qwen": 1.638421924665474}, "topk": {"rwkv": [4811, 1, 0.7254297137260437, [[4811, 0.72543, " to", false], [32074, 0.053977, " some", false], [31370, 0.044685, " many", false], [22590, 0.035891, " the", false], [332, 0.018427, " a", false], [63843, 0.017706, " researchers", false], [46787, 0.011179, " people", false], [22226, 0.009128, " one", false], [45, 0.007413, ",", false], [19678, 0.004704, " DAR", false]]], "qwen": [311, 1, 0.7614275813102722, [[311, 0.761428, " to", false], [1045, 0.048317, " some", false], [1657, 0.041988, " many", false], [279, 0.02385, " the", false], [264, 0.018831, " a", false], [11811, 0.016607, " researchers", false], [11, 0.008645, ",", false], [825, 0.007132, " one", false], [304, 0.005231, " in", false], [1251, 0.003191, " people", false]]]}, "raw_delta": 0.015266388654708862, "tuned_delta": 0.023838180685287112}, {"byte_start": 3634, "byte_end": 3636, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 614, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "10.07% 10.07%", "qwen": "8.44% 8.44%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.32784348726272583]], "qwen": [[264, " a", "normal", 0.3922613263130188]]}, "loss": {"rwkv": 10.073505412457116, "qwen": 8.438206226944965}, "topk": {"rwkv": [332, 1, 0.32784348726272583, [[332, 0.327843, " a", false], [22590, 0.231271, " the", false], [4419, 0.048289, " an", false], [31466, 0.028891, " much", false], [32074, 0.024626, " some", false], [31370, 0.020084, " many", false], [51816, 0.014236, " further", false], [50919, 0.012117, " another", false], [65126, 0.011758, " disappointment", false], [31458, 0.008876, " more", false]]], "qwen": [264, 1, 0.3922613263130188, [[264, 0.392261, " a", false], [279, 0.185976, " the", false], [458, 0.075346, " an", false], [1657, 0.02746, " many", false], [1045, 0.025467, " some", false], [1753, 0.018786, " much", false], [2441, 0.014868, " another", false], [4623, 0.009604, " further", false], [1128, 0.007172, " what", false], [803, 0.005978, " more", false]]]}, "raw_delta": 0.09068024158477783, "tuned_delta": 0.09925203361535608}, {"byte_start": 3636, "byte_end": 3642, "display": {"text": " major", "kind": "normal"}, "is_word": true, "word_id": 615, "word_key": " major", "bytes_hex": "20 6d 61 6a 6f 72", "compression": {"rwkv": "11.98% 11.98% 11.98% 11.98% 11.98% 11.98%", "qwen": "12.44% 12.44% 12.44% 12.44% 12.44% 12.44%"}, "model_tokens": {"rwkv": [[38961, " major", "normal", 0.018703404814004898]], "qwen": [[3598, " major", "normal", 0.015963859856128693]]}, "loss": {"rwkv": 11.97549594487909, "qwen": 12.43551513940693}, "topk": {"rwkv": [38961, 8, 0.018703404814004898, [[31323, 0.072443, " long", false], [46790, 0.056268, " period", false], [45315, 0.030924, " bitter", false], [55591, 0.023598, " backlash", false], [38629, 0.022737, " great", false], [22031, 0.022407, " lot", false], [51816, 0.022389, " further", false], [38961, 0.018703, " major", false], [45674, 0.018517, " decade", false], [39664, 0.018253, " shift", false]]], "qwen": [3598, 10, 0.015963859856128693, [[1293, 0.075389, " long", false], [25180, 0.037527, " bitter", false], [4168, 0.029762, " period", false], [4586, 0.023005, " general", false], [2696, 0.019431, " lot", false], [501, 0.019248, " new", false], [2244, 0.017001, " great", false], [3460, 0.016283, " large", false], [1372, 0.016052, " number", false], [3598, 0.015964, " major", false]]]}, "raw_delta": -0.025508880615234375, "tuned_delta": -0.016937088584656125}, {"byte_start": 3642, "byte_end": 3649, "display": {"text": " change", "kind": "normal"}, "is_word": true, "word_id": 616, "word_key": " change", "bytes_hex": "20 63 68 61 6e 67 65", "compression": {"rwkv": "4.81% 4.81% 4.81% 4.81% 4.81% 4.81% 4.81%", "qwen": "6.66% 6.66% 6.66% 6.66% 6.66% 6.66% 6.66%"}, "model_tokens": {"rwkv": [[45450, " change", "normal", 0.15361158549785614]], "qwen": [[2297, " change", "normal", 0.07551056891679764]]}, "loss": {"rwkv": 4.81032526189261, "qwen": 6.6556739224766694}, "topk": {"rwkv": [45450, 2, 0.15361158549785614, [[39664, 0.203584, " shift", false], [45450, 0.153612, " change", false], [56810, 0.036295, " paradigm", false], [57103, 0.030638, " research", false], [45829, 0.030009, " effort", false], [4757, 0.029589, " re", false], [22378, 0.019607, " ret", false], [63415, 0.015852, " controversy", false], [55591, 0.015402, " backlash", false], [57138, 0.014776, " revision", false]]], "qwen": [2297, 2, 0.07551056891679764, [[6407, 0.115522, " shift", false], [2297, 0.075511, " change", false], [48240, 0.05293, " paradigm", false], [312, 0.050844, " re", false], [11004, 0.035189, " debate", false], [3412, 0.020011, " research", false], [47056, 0.018988, " backlash", false], [40598, 0.018954, " disappointment", false], [25573, 0.018221, " controversy", false], [5041, 0.011259, " effort", false]]]}, "raw_delta": -0.102327857698713, "tuned_delta": -0.09375606566813476}, {"byte_start": 3649, "byte_end": 3652, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 617, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "0.55% 0.55% 0.55%", "qwen": "0.75% 0.75% 0.75%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.9128422141075134]], "qwen": [[304, " in", "normal", 0.882537305355072]]}, "loss": {"rwkv": 0.5459417268988996, "qwen": 0.7511284501011392}, "topk": {"rwkv": [4596, 1, 0.9128422141075134, [[4596, 0.912842, " in", false], [4706, 0.03714, " of", false], [45, 0.015217, ",", false], [59, 0.006536, ":", false], [47, 0.003765, ".", false], [4811, 0.001911, " to", false], [32227, 0.001871, " that", false], [4424, 0.001563, " at", false], [31601, 0.001483, " over", false], [30917, 0.001482, " from", false]]], "qwen": [304, 1, 0.882537305355072, [[304, 0.882537, " in", false], [315, 0.081219, " of", false], [11, 0.007828, ",", false], [504, 0.00465, " from", false], [25, 0.002838, ":", false], [4421, 0.002085, "---", false], [311, 0.001744, " to", false], [916, 0.001621, " over", false], [429, 0.001302, " that", false], [369, 0.001157, " for", false]]]}, "raw_delta": -0.011377967894077301, "tuned_delta": -0.002806175863499053}, {"byte_start": 3652, "byte_end": 3656, "display": {"text": " all", "kind": "normal"}, "is_word": true, "word_id": 618, "word_key": " all", "bytes_hex": "20 61 6c 6c", "compression": {"rwkv": "35.08% 35.08% 35.08% 35.08%", "qwen": "32.00% 32.00% 32.00% 32.00%"}, "model_tokens": {"rwkv": [[21256, " all", "normal", 0.00040676642674952745]], "qwen": [[678, " all", "normal", 0.0008276173612102866]]}, "loss": {"rwkv": 35.081158709116394, "qwen": 31.99608877249348}, "topk": {"rwkv": [21256, 86, 0.00040676642674952745, [[22590, 0.462505, " the", false], [47350, 0.114987, " speech", false], [3609, 0.079406, " AI", false], [57103, 0.057021, " research", false], [59526, 0.039207, " direction", false], [56103, 0.028247, " emphasis", false], [38530, 0.017078, " focus", false], [21835, 0.01464, " how", false], [57419, 0.010613, " thinking", false], [55574, 0.009997, " attitude", false]]], "qwen": [678, 54, 0.0008276173612102866, [[279, 0.515891, " the", false], [3412, 0.07072, " research", false], [8806, 0.070528, " speech", false], [1246, 0.067919, " how", false], [15235, 0.028624, " AI", false], [7274, 0.019499, " thinking", false], [5244, 0.016435, " focus", false], [24654, 0.012447, " emphasis", false], [5106, 0.011719, " direction", false], [6366, 0.011553, " computer", false]]]}, "raw_delta": 0.1710726022720337, "tuned_delta": 0.17964439430261195}, {"byte_start": 3656, "byte_end": 3659, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 619, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "13.24% 13.24% 13.24%", "qwen": "13.25% 13.25% 13.25%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.109671451151371]], "qwen": [[315, " of", "normal", 0.11038658767938614]]}, "loss": {"rwkv": 13.243489633160404, "qwen": 13.247346344106003}, "topk": {"rwkv": [4706, 2, 0.109671451151371, [[47350, 0.439427, " speech", false], [4706, 0.109671, " of", false], [3609, 0.067718, " AI", false], [22590, 0.067576, " the", false], [62597, 0.067054, " subsequent", false], [57103, 0.042091, " research", false], [46064, 0.020986, " future", false], [37738, 0.018781, " areas", false], [50964, 0.01707, " aspects", false], [38720, 0.009232, " human", false]]], "qwen": [315, 3, 0.11038658767938614, [[8806, 0.358103, " speech", false], [17420, 0.151202, " subsequent", false], [315, 0.110387, " of", false], [279, 0.08224, " the", false], [3412, 0.050408, " research", false], [15235, 0.029133, " AI", false], [5671, 0.024269, " areas", false], [3853, 0.014411, " future", false], [19827, 0.012652, " approaches", false], [13566, 0.011898, " aspects", false]]]}, "raw_delta": -0.00021386146545410156, "tuned_delta": 0.008357930565124147}, {"byte_start": 3659, "byte_end": 3667, "display": {"text": " natural", "kind": "normal"}, "is_word": true, "word_id": 620, "word_key": " natural", "bytes_hex": "20 6e 61 74 75 72 61 6c", "compression": {"rwkv": "13.53% 13.53% 13.53% 13.53% 13.53% 13.53% 13.53% 13.53%", "qwen": "10.22% 10.22% 10.22% 10.22% 10.22% 10.22% 10.22% 10.22%"}, "model_tokens": {"rwkv": [[52299, " natural", "normal", 0.002481764182448387]], "qwen": [[5810, " natural", "normal", 0.010747061111032963]]}, "loss": {"rwkv": 13.52526600833403, "qwen": 10.218615774122611}, "topk": {"rwkv": [52299, 9, 0.002481764182448387, [[47350, 0.755028, " speech", false], [3609, 0.07456, " AI", false], [22590, 0.06515, " the", false], [55809, 0.029765, " computer", false], [57103, 0.009415, " research", false], [19678, 0.007169, " DAR", false], [64862, 0.006673, " computational", false], [52167, 0.003082, " machine", false], [52299, 0.002482, " natural", false], [38720, 0.002255, " human", false]]], "qwen": [5810, 6, 0.010747061111032963, [[8806, 0.68847, " speech", false], [279, 0.089251, " the", false], [15235, 0.083967, " AI", false], [6366, 0.029443, " computer", false], [451, 0.013061, " N", false], [5810, 0.010747, " natural", false], [5662, 0.006164, " machine", false], [3412, 0.006111, " research", false], [3738, 0.005999, " human", false], [4128, 0.004576, " language", false]]]}, "raw_delta": 0.18335962295532227, "tuned_delta": 0.19193141498590052}, {"byte_start": 3667, "byte_end": 3676, "display": {"text": " language", "kind": "normal"}, "is_word": true, "word_id": 621, "word_key": " language", "bytes_hex": "20 6c 61 6e 67 75 61 67 65", "compression": {"rwkv": "0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43%", "qwen": "0.89% 0.89% 0.89% 0.89% 0.89% 0.89% 0.89% 0.89% 0.89%"}, "model_tokens": {"rwkv": [[56529, " language", "normal", 0.8071631789207458]], "qwen": [[4128, " language", "normal", 0.6401944160461426]]}, "loss": {"rwkv": 0.43049168429303913, "qwen": 0.8936361857707253}, "topk": {"rwkv": [56529, 1, 0.8071631789207458, [[56529, 0.807163, " language", false], [46, 0.18598, "-", false], [59946, 0.002354, " languages", false], [47350, 0.002111, " speech", false], [21265, 0.000347, " and", false], [275, 0.000189, " (", false], [34864, 0.000178, "istic", false], [62378, 0.00015, " processing", false], [48, 0.000104, "/", false], [52814, 9e-05, " science", false]]], "qwen": [4128, 1, 0.6401944160461426, [[4128, 0.640194, " language", false], [43558, 0.341647, "-language", false], [8806, 0.003305, " speech", false], [1331, 0.002551, "-s", false], [11476, 0.001883, "-com", false], [323, 0.001119, " and", false], [15459, 0.001004, " languages", false], [12, 0.000899, "-", false], [8038, 0.000572, " science", false], [24231, 0.000527, " computing", false]]]}, "raw_delta": -0.025682184431287978, "tuned_delta": -0.01711039240070973}, {"byte_start": 3676, "byte_end": 3687, "display": {"text": " processing", "kind": "normal"}, "is_word": true, "word_id": 622, "word_key": " processing", "bytes_hex": "20 70 72 6f 63 65 73 73 69 6e 67", "compression": {"rwkv": "0.15% 0.15% 0.15% 0.15% 0.15% 0.15% 0.15% 0.15% 0.15% 0.15% 0.15%", "qwen": "0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16%"}, "model_tokens": {"rwkv": [[62378, " processing", "normal", 0.9100680947303772]], "qwen": [[8692, " processing", "normal", 0.9070752859115601]]}, "loss": {"rwkv": 0.15449670570599364, "qwen": 0.15989290567035236}, "topk": {"rwkv": [62378, 1, 0.9100680947303772, [[62378, 0.910068, " processing", false], [57103, 0.046873, " research", false], [65034, 0.020287, " understanding", false], [45, 0.003555, ",", false], [21265, 0.00215, " and", false], [275, 0.00147, " (", false], [63821, 0.001433, " recognition", false], [62634, 0.001212, " technology", false], [47, 0.00121, ".", false], [46, 0.000894, "-", false]]], "qwen": [8692, 1, 0.9070752859115601, [[8692, 0.907075, " processing", false], [3412, 0.032684, " research", false], [8660, 0.014011, " understanding", false], [69193, 0.007294, "-processing", false], [323, 0.005977, " and", false], [8806, 0.003086, " speech", false], [320, 0.002747, " (", false], [15235, 0.002486, " AI", false], [11, 0.002392, ",", false], [24231, 0.001239, " computing", false]]]}, "raw_delta": -0.0002992288632826367, "tuned_delta": 0.008272563167295612}, {"byte_start": 3687, "byte_end": 3688, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "21.70%", "qwen": "22.27%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.3021651804447174]], "qwen": [[11, ",", "normal", 0.29089972376823425]]}, "loss": {"rwkv": 21.696780888369172, "qwen": 22.26757840788402}, "topk": {"rwkv": [45, 1, 0.3021651804447174, [[45, 0.302165, ",", false], [275, 0.219077, " (", false], [47, 0.153554, ".", false], [57103, 0.093974, " research", false], [59, 0.052152, ":", false], [5346, 0.0422, "---", false], [21265, 0.035003, " and", false], [4596, 0.01944, " in", false], [32227, 0.012163, " that", false], [31601, 0.00587, " over", false]]], "qwen": [11, 1, 0.29089972376823425, [[11, 0.2909, ",", false], [320, 0.28355, " (", false], [13, 0.098036, ".", false], [3412, 0.078873, " research", false], [323, 0.062554, " and", false], [4421, 0.032666, "---", false], [25, 0.021578, ":", false], [304, 0.018883, " in", false], [382, 0.015774, ".\n\n", false], [369, 0.014402, " for", false]]]}, "raw_delta": -0.03165173530578613, "tuned_delta": -0.023079943275207883}, {"byte_start": 3688, "byte_end": 3698, "display": {"text": " gradually", "kind": "normal"}, "is_word": true, "word_id": 623, "word_key": " gradually", "bytes_hex": "20 67 72 61 64 75 61 6c 6c 79", "compression": {"rwkv": "14.88% 14.88% 14.88% 14.88% 14.88% 14.88% 14.88% 14.88% 14.88% 14.88%", "qwen": "17.05% 17.05% 17.05% 17.05% 17.05% 17.05% 17.05% 17.05% 17.05% 17.05%"}, "model_tokens": {"rwkv": [[59771, " gradually", "normal", 0.00026331678964197636]], "qwen": [[26024, " gradually", "normal", 7.828678644727916e-05]]}, "loss": {"rwkv": 14.877792609167432, "qwen": 17.051089212978507}, "topk": {"rwkv": [59771, 128, 0.00026331678964197636, [[40186, 0.18027, " which", false], [21265, 0.113458, " and", false], [30917, 0.091548, " from", false], [40185, 0.073692, " where", false], [32487, 0.071375, " with", false], [4423, 0.052657, " as", false], [4811, 0.044154, " to", false], [4596, 0.040929, " in", false], [30211, 0.023158, " away", false], [59841, 0.020795, " including", false]]], "qwen": [26024, 308, 7.828678644727916e-05, [[323, 0.155709, " and", false], [892, 0.104721, " which", false], [438, 0.092851, " as", false], [448, 0.086681, " with", false], [2670, 0.081711, " including", false], [1380, 0.071378, " where", false], [304, 0.038294, " in", false], [504, 0.033125, " from", false], [264, 0.019029, " a", false], [1576, 0.013909, " because", false]]]}, "raw_delta": -0.12051315307617197, "tuned_delta": -0.11194136104559373}, {"byte_start": 3698, "byte_end": 3703, "display": {"text": " over", "kind": "normal"}, "is_word": true, "word_id": 624, "word_key": " over", "bytes_hex": "20 6f 76 65 72", "compression": {"rwkv": "16.68% 16.68% 16.68% 16.68% 16.68%", "qwen": "12.23% 12.23% 12.23% 12.23% 12.23%"}, "model_tokens": {"rwkv": [[31601, " over", "normal", 0.009676050394773483]], "qwen": [[916, " over", "normal", 0.0336746983230114]]}, "loss": {"rwkv": 16.681161410278637, "qwen": 12.230478282961545}, "topk": {"rwkv": [31601, 19, 0.009676050394773483, [[46612, 0.15327, " moving", false], [60385, 0.134453, " replacing", false], [57209, 0.126251, " shifting", false], [52107, 0.029412, " leading", false], [45, 0.022168, ",", false], [39856, 0.02079, " suppl", false], [46500, 0.020352, " making", false], [30917, 0.020219, " from", false], [50834, 0.019002, " abandon", false], [55660, 0.018108, " bringing", false]]], "qwen": [916, 7, 0.0336746983230114, [[24891, 0.07919, " replacing", false], [7218, 0.063611, " moving", false], [11, 0.043552, ",", false], [714, 0.037893, " but", false], [6388, 0.037171, " leading", false], [31831, 0.036395, " shifting", false], [916, 0.033675, " over", false], [10018, 0.027561, " changing", false], [3259, 0.023925, " making", false], [2714, 0.02245, " er", false]]]}, "raw_delta": 0.24679827690124512, "tuned_delta": 0.25537006893182335}, {"byte_start": 3703, "byte_end": 3711, "display": {"text": " decades", "kind": "normal"}, "is_word": true, "word_id": 625, "word_key": " decades", "bytes_hex": "20 64 65 63 61 64 65 73", "compression": {"rwkv": "8.52% 8.52% 8.52% 8.52% 8.52% 8.52% 8.52% 8.52%", "qwen": "10.19% 10.19% 10.19% 10.19% 10.19% 10.19% 10.19% 10.19%"}, "model_tokens": {"rwkv": [[51396, " decades", "normal", 0.022979633882641792]], "qwen": [[10793, " decades", "normal", 0.010877071879804134]]}, "loss": {"rwkv": 8.523735349002175, "qwen": 10.191509158563496}, "topk": {"rwkv": [51396, 6, 0.022979633882641792, [[22590, 0.511333, " the", false], [332, 0.151255, " a", false], [32251, 0.107072, " time", false], [31370, 0.062735, " many", false], [52869, 0.042528, " several", false], [51396, 0.02298, " decades", false], [37598, 0.017119, " about", false], [3493, 0.014353, " 20", false], [22638, 0.008469, " two", false], [31458, 0.005752, " more", false]]], "qwen": [10793, 9, 0.010877071879804134, [[279, 0.336972, " the", false], [264, 0.297456, " a", false], [1657, 0.081974, " many", false], [220, 0.055959, " ", false], [882, 0.054568, " time", false], [3807, 0.053385, " several", false], [458, 0.01625, " an", false], [803, 0.011744, " more", false], [10793, 0.010877, " decades", false], [7009, 0.00856, " nearly", false]]]}, "raw_delta": -0.09248101711273193, "tuned_delta": -0.08390922508215369}, {"byte_start": 3711, "byte_end": 3712, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "12.26%", "qwen": "11.64%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.5042016506195068]], "qwen": [[11, ",", "normal", 0.5245233774185181]]}, "loss": {"rwkv": 12.257272320052715, "qwen": 11.636512765570654}, "topk": {"rwkv": [45, 1, 0.5042016506195068, [[45, 0.504202, ",", false], [47, 0.347258, ".", false], [21265, 0.017231, " and", false], [4706, 0.016622, " of", false], [59, 0.015157, ":", false], [4423, 0.011844, " as", false], [30917, 0.008682, " from", false], [4811, 0.008501, " to", false], [275, 0.007981, " (", false], [21400, 0.007161, " but", false]]], "qwen": [11, 1, 0.5245233774185181, [[11, 0.524523, ",", false], [13, 0.264647, ".", false], [382, 0.065992, ".\n\n", false], [315, 0.032031, " of", false], [323, 0.017668, " and", false], [320, 0.01125, " (", false], [25, 0.009036, ":", false], [4421, 0.008871, "---", false], [438, 0.007894, " as", false], [311, 0.005143, " to", false]]]}, "raw_delta": 0.034422218799591064, "tuned_delta": 0.042994010830169314}, {"byte_start": 3712, "byte_end": 3718, "display": {"text": " where", "kind": "normal"}, "is_word": true, "word_id": 626, "word_key": " where", "bytes_hex": "20 77 68 65 72 65", "compression": {"rwkv": "10.90% 10.90% 10.90% 10.90% 10.90% 10.90%", "qwen": "13.11% 13.11% 13.11% 13.11% 13.11% 13.11%"}, "model_tokens": {"rwkv": [[40185, " where", "normal", 0.02696811780333519]], "qwen": [[1380, " where", "normal", 0.012734335847198963]]}, "loss": {"rwkv": 10.89535317338019, "qwen": 13.114859509013838}, "topk": {"rwkv": [40185, 12, 0.02696811780333519, [[30917, 0.187083, " from", false], [4423, 0.116297, " as", false], [32487, 0.089598, " with", false], [4811, 0.087584, " to", false], [30211, 0.065642, " away", false], [21265, 0.062838, " and", false], [53169, 0.047793, " towards", false], [4596, 0.045397, " in", false], [21400, 0.030748, " but", false], [40186, 0.029044, " which", false]]], "qwen": [1380, 16, 0.012734335847198963, [[438, 0.176274, " as", false], [323, 0.137214, " and", false], [504, 0.105461, " from", false], [311, 0.068331, " to", false], [448, 0.06198, " with", false], [304, 0.041964, " in", false], [3123, 0.027893, " away", false], [714, 0.027693, " but", false], [773, 0.025551, " so", false], [2670, 0.023168, " including", false]]]}, "raw_delta": -0.12307556470235193, "tuned_delta": -0.11450377267177368}, {"byte_start": 3718, "byte_end": 3729, "display": {"text": " statistics", "kind": "normal"}, "is_word": true, "word_id": 627, "word_key": " statistics", "bytes_hex": "20 73 74 61 74 69 73 74 69 63 73", "compression": {"rwkv": "10.20% 10.20% 10.20% 10.20% 10.20% 10.20% 10.20% 10.20% 10.20% 10.20% 10.20%", "qwen": "10.25% 10.25% 10.25% 10.25% 10.25% 10.25% 10.25% 10.25% 10.25% 10.25% 10.25%"}, "model_tokens": {"rwkv": [[62577, " statistics", "normal", 0.0020087799057364464]], "qwen": [[13142, " statistics", "normal", 0.0019320999272167683]]}, "loss": {"rwkv": 10.19518157446391, "qwen": 10.245016674508697}, "topk": {"rwkv": [62577, 42, 0.0020087799057364464, [[22590, 0.218629, " the", false], [63885, 0.190964, " statistical", false], [3866, 0.06995, " HM", false], [52224, 0.048869, " methods", false], [38720, 0.043119, " human", false], [4601, 0.021841, " it", false], [31458, 0.021768, " more", false], [21256, 0.015081, " all", false], [31461, 0.013634, " most", false], [332, 0.013095, " a", false]]], "qwen": [13142, 61, 0.0019320999272167683, [[279, 0.191419, " the", false], [28464, 0.104236, " statistical", false], [3738, 0.073572, " human", false], [472, 0.053897, " H", false], [5413, 0.042883, " methods", false], [264, 0.030919, " a", false], [803, 0.021692, " more", false], [6788, 0.020739, " earlier", false], [11811, 0.020264, " researchers", false], [678, 0.020051, " all", false]]]}, "raw_delta": -0.0027634447271174256, "tuned_delta": 0.005808347303460823}, {"byte_start": 3729, "byte_end": 3733, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 628, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "11.06% 11.06% 11.06% 11.06%", "qwen": "9.20% 9.20% 9.20% 9.20%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.08643412590026855]], "qwen": [[323, " and", "normal", 0.129806786775589]]}, "loss": {"rwkv": 11.059722725564805, "qwen": 9.20488231176844}, "topk": {"rwkv": [21265, 2, 0.08643412590026855, [[45283, 0.091928, " became", false], [21265, 0.086434, " and", false], [30383, 0.067295, " came", false], [32272, 0.060775, " took", false], [57094, 0.059678, " replaced", false], [46, 0.059529, "-", false], [31059, 0.050042, " have", false], [22777, 0.035994, " won", false], [32462, 0.035378, " were", false], [37828, 0.034083, " began", false]]], "qwen": [323, 1, 0.129806786775589, [[323, 0.129807, " and", false], [6116, 0.110121, " became", false], [702, 0.052799, " has", false], [5980, 0.051573, "-based", false], [4421, 0.050791, "---", false], [11, 0.048703, ",", false], [572, 0.041111, " was", false], [3867, 0.034376, " took", false], [320, 0.031195, " (", false], [12575, 0.023812, " replaced", false]]]}, "raw_delta": 0.10285419225692749, "tuned_delta": 0.11142598428750573}, {"byte_start": 3733, "byte_end": 3745, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 629, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "3.01% 3.01% 3.01% 3.01% 3.01% 3.01% 3.01% 3.01% 3.01% 3.01% 3.01% 3.01%", "qwen": "1.57% 1.57% 1.57% 1.57% 1.57% 1.57% 1.57% 1.57% 1.57% 1.57% 1.57% 1.57%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.13499867916107178]], "qwen": [[34447, " computation", "normal", 0.3509063720703125]]}, "loss": {"rwkv": 3.0056146685186733, "qwen": 1.5737937108487454}, "topk": {"rwkv": [63370, 3, 0.13499867916107178, [[3866, 0.163178, " HM", false], [56537, 0.151697, " learning", false], [63370, 0.134999, " computation", false], [47202, 0.090606, " search", false], [52167, 0.062742, " machine", false], [63885, 0.059155, " statistical", false], [52195, 0.033744, " massive", false], [56935, 0.019006, " probabil", false], [31458, 0.013914, " more", false], [63787, 0.013857, " probability", false]]], "qwen": [34447, 1, 0.3509063720703125, [[34447, 0.350906, " computation", false], [5662, 0.09078, " machine", false], [6832, 0.047997, " learning", false], [472, 0.044146, " H", false], [2711, 0.035162, " search", false], [28464, 0.026352, " statistical", false], [54480, 0.021034, " computational", false], [10951, 0.019022, " massive", false], [24231, 0.016781, " computing", false], [279, 0.016624, " the", false]]]}, "raw_delta": 0.07939701279004416, "tuned_delta": 0.0879688048206224}, {"byte_start": 3745, "byte_end": 3750, "display": {"text": " came", "kind": "normal"}, "is_word": true, "word_id": 630, "word_key": " came", "bytes_hex": "20 63 61 6d 65", "compression": {"rwkv": "8.06% 8.06% 8.06% 8.06% 8.06%", "qwen": "11.08% 11.08% 11.08% 11.08% 11.08%"}, "model_tokens": {"rwkv": [[30383, " came", "normal", 0.10698934644460678]], "qwen": [[3697, " came", "normal", 0.04633750766515732]]}, "loss": {"rwkv": 8.058804329965694, "qwen": 11.079189441815968}, "topk": {"rwkv": [30383, 2, 0.10698934644460678, [[31059, 0.108267, " have", false], [30383, 0.106989, " came", false], [45283, 0.103023, " became", false], [32272, 0.089009, " took", false], [57094, 0.058479, " replaced", false], [32462, 0.052215, " were", false], [22777, 0.040453, " won", false], [22190, 0.028635, " now", false], [61959, 0.028579, " eventually", false], [59771, 0.028253, " gradually", false]]], "qwen": [3697, 6, 0.04633750766515732, [[6116, 0.155787, " became", false], [614, 0.143535, " have", false], [1033, 0.084004, " were", false], [3867, 0.052117, " took", false], [29701, 0.04924, " dominated", false], [3697, 0.046338, " came", false], [11, 0.026066, ",", false], [525, 0.022455, " are", false], [1431, 0.021502, " now", false], [916, 0.018227, " over", false]]]}, "raw_delta": -0.16748571395874023, "tuned_delta": -0.15891392192816198}, {"byte_start": 3750, "byte_end": 3753, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 631, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.25% 0.25% 0.25%", "qwen": "0.19% 0.19% 0.19%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.9597342610359192]], "qwen": [[311, " to", "normal", 0.9691116213798523]]}, "loss": {"rwkv": 0.24655432827692242, "qwen": 0.18860515475946268}, "topk": {"rwkv": [4811, 1, 0.9597342610359192, [[4811, 0.959734, " to", false], [38499, 0.011867, " first", false], [31162, 0.006523, " into", false], [4596, 0.005717, " in", false], [22249, 0.00207, " out", false], [64430, 0.001754, " increasingly", false], [57435, 0.001214, " together", false], [45285, 0.000735, " before", false], [30218, 0.00061, " back", false], [4712, 0.000538, " on", false]]], "qwen": [311, 1, 0.9691116213798523, [[311, 0.969112, " to", false], [1119, 0.006749, " into", false], [14756, 0.005994, " increasingly", false], [304, 0.002393, " in", false], [700, 0.002006, " out", false], [518, 0.00129, " at", false], [1156, 0.000882, " first", false], [315, 0.000805, " of", false], [803, 0.000767, " more", false], [1182, 0.000627, " back", false]]]}, "raw_delta": 0.003213384499152502, "tuned_delta": 0.01178517652973075}, {"byte_start": 3753, "byte_end": 3762, "display": {"text": " dominate", "kind": "normal"}, "is_word": true, "word_id": 632, "word_key": " dominate", "bytes_hex": "20 64 6f 6d 69 6e 61 74 65", "compression": {"rwkv": "1.89% 1.89% 1.89% 1.89% 1.89% 1.89% 1.89% 1.89% 1.89%", "qwen": "0.88% 0.88% 0.88% 0.88% 0.88% 0.88% 0.88% 0.88% 0.88%"}, "model_tokens": {"rwkv": [[56041, " dominate", "normal", 0.3885592222213745]], "qwen": [[40736, " dominate", "normal", 0.6446137428283691]]}, "loss": {"rwkv": 1.8863362893567714, "qwen": 0.8798515971554768}, "topk": {"rwkv": [56041, 1, 0.3885592222213745, [[56041, 0.388559, " dominate", false], [4435, 0.274421, " be", false], [31702, 0.051946, " play", false], [52716, 0.045106, " replace", false], [31907, 0.043391, " rule", false], [32187, 0.029668, " take", false], [56906, 0.026743, " predomin", false], [22590, 0.020774, " the", false], [52550, 0.008612, " prevail", false], [31059, 0.005651, " have", false]]], "qwen": [40736, 1, 0.6446137428283691, [[40736, 0.644614, " dominate", false], [1486, 0.059636, " play", false], [279, 0.044036, " the", false], [387, 0.039062, " be", false], [1896, 0.037964, " take", false], [4162, 0.030339, " pred", false], [8290, 0.025675, " replace", false], [1026, 0.009732, " sup", false], [65728, 0.008506, " prevail", false], [5912, 0.008304, " rule", false]]]}, "raw_delta": 0.05581136213408576, "tuned_delta": 0.064383154164664}, {"byte_start": 3762, "byte_end": 3766, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 633, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "12.33% 12.33% 12.33% 12.33%", "qwen": "9.96% 9.96% 9.96% 9.96%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.06447254866361618]], "qwen": [[279, " the", "normal", 0.10979695618152618]]}, "loss": {"rwkv": 12.327716413846122, "qwen": 9.959656122260641}, "topk": {"rwkv": [22590, 3, 0.06447254866361618, [[47, 0.53756, ".", false], [45, 0.14881, ",", false], [22590, 0.064473, " the", false], [31601, 0.054655, " over", false], [21265, 0.054523, " and", false], [275, 0.013618, " (", false], [57103, 0.010165, " research", false], [4596, 0.009688, " in", false], [52224, 0.007401, " methods", false], [40187, 0.007125, " while", false]]], "qwen": [279, 3, 0.10979695618152618, [[13, 0.282776, ".", false], [382, 0.179756, ".\n\n", false], [279, 0.109797, " the", false], [916, 0.090845, " over", false], [11, 0.083813, ",", false], [323, 0.025576, " and", false], [3738, 0.023952, " human", false], [678, 0.019848, " all", false], [320, 0.015324, " (", false], [5413, 0.012913, " methods", false]]]}, "raw_delta": 0.13131314516067505, "tuned_delta": 0.1398849371912533}, {"byte_start": 3766, "byte_end": 3772, "display": {"text": " field", "kind": "normal"}, "is_word": true, "word_id": 634, "word_key": " field", "bytes_hex": "20 66 69 65 6c 64", "compression": {"rwkv": "3.55% 3.55% 3.55% 3.55% 3.55% 3.55%", "qwen": "0.73% 0.73% 0.73% 0.73% 0.73% 0.73%"}, "model_tokens": {"rwkv": [[38478, " field", "normal", 0.3058306574821472]], "qwen": [[2070, " field", "normal", 0.7843818068504333]]}, "loss": {"rwkv": 3.5456860542681228, "qwen": 0.7299417550650444}, "topk": {"rwkv": [38478, 1, 0.3058306574821472, [[38478, 0.305831, " field", false], [57103, 0.227717, " research", false], [52224, 0.069457, " methods", false], [39597, 0.028572, " scene", false], [39802, 0.028022, " state", false], [55532, 0.023143, " approach", false], [61590, 0.017995, " approaches", false], [45829, 0.01575, " effort", false], [59945, 0.012382, " landscape", false], [3609, 0.011517, " AI", false]]], "qwen": [2070, 1, 0.7843818068504333, [[2070, 0.784382, " field", false], [5413, 0.030536, " methods", false], [3412, 0.025925, " research", false], [3082, 0.015, " area", false], [5486, 0.009158, " approach", false], [25364, 0.007416, " discipline", false], [7947, 0.007026, " domain", false], [3738, 0.006482, " human", false], [1616, 0.005541, " way", false], [990, 0.004777, " use", false]]]}, "raw_delta": 0.15613801777362823, "tuned_delta": 0.1647098098042065}, {"byte_start": 3772, "byte_end": 3773, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "7.29%", "qwen": "13.96%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.6675684452056885]], "qwen": [[13, ".", "normal", 0.46101492643356323]]}, "loss": {"rwkv": 7.290963707617563, "qwen": 13.963933556757253}, "topk": {"rwkv": [47, 1, 0.6675684452056885, [[47, 0.667568, ".", false], [45, 0.162354, ",", false], [21265, 0.051791, " and", false], [275, 0.015237, " (", false], [31601, 0.014673, " over", false], [4706, 0.013431, " of", false], [40187, 0.00995, " while", false], [4596, 0.006824, " in", false], [5346, 0.006287, "---", false], [4423, 0.005711, " as", false]]], "qwen": [13, 1, 0.46101492643356323, [[13, 0.461015, ".", false], [382, 0.256917, ".\n\n", false], [11, 0.13449, ",", false], [323, 0.027926, " and", false], [320, 0.020551, " (", false], [4421, 0.01885, "---", false], [304, 0.007144, " in", false], [916, 0.007141, " over", false], [624, 0.005872, ".\n", false], [315, 0.00569, " of", false]]]}, "raw_delta": -0.370028018951416, "tuned_delta": -0.3614562269208378}, {"byte_start": 3773, "byte_end": 3777, "display": {"text": " The", "kind": "normal"}, "is_word": true, "word_id": 635, "word_key": " the", "bytes_hex": "20 54 68 65", "compression": {"rwkv": "10.92% 10.92% 10.92% 10.92%", "qwen": "9.02% 9.02% 9.02% 9.02%"}, "model_tokens": {"rwkv": [[20996, " The", "normal", 0.08902532607316971]], "qwen": [[576, " The", "normal", 0.13527105748653412]]}, "loss": {"rwkv": 10.918834537977993, "qwen": 9.018984114667694}, "topk": {"rwkv": [20996, 2, 0.08902532607316971, [[261, 0.374472, "\n\n", false], [20996, 0.089025, " The", false], [29894, 0.041615, " This", false], [3913, 0.035407, " In", false], [3918, 0.029797, " It", false], [267, 0.022017, "  ", false], [37451, 0.019905, " There", false], [275, 0.01648, " (", false], [36251, 0.015892, " Again", false], [19555, 0.014609, " But", false]]], "qwen": [576, 1, 0.13527105748653412, [[576, 0.135271, " The", false], [1096, 0.087521, " This", false], [758, 0.070972, " In", false], [1084, 0.059122, " It", false], [220, 0.042533, " ", false], [2619, 0.033782, " There", false], [320, 0.031058, " (", false], [362, 0.024504, " A", false], [65694, 0.018292, " Statistical", false], [3776, 0.01478, " One", false]]]}, "raw_delta": 0.1053500771522522, "tuned_delta": 0.11392186918283044}, {"byte_start": 3777, "byte_end": 3784, "display": {"text": " recent", "kind": "normal"}, "is_word": true, "word_id": 636, "word_key": " recent", "bytes_hex": "20 72 65 63 65 6e 74", "compression": {"rwkv": "15.62% 15.62% 15.62% 15.62% 15.62% 15.62% 15.62%", "qwen": "16.84% 16.84% 16.84% 16.84% 16.84% 16.84% 16.84%"}, "model_tokens": {"rwkv": [[47014, " recent", "normal", 0.002348215552046895]], "qwen": [[3213, " recent", "normal", 0.001448009512387216]]}, "loss": {"rwkv": 15.618461938195253, "qwen": 16.842344533425265}, "topk": {"rwkv": [47014, 69, 0.002348215552046895, [[38720, 0.086211, " human", false], [63885, 0.079259, " statistical", false], [38328, 0.032405, " early", false], [19678, 0.028031, " DAR", false], [46430, 0.019183, " lesson", false], [52224, 0.018234, " methods", false], [52013, 0.017128, " initial", false], [62577, 0.014863, " statistics", false], [31937, 0.014523, " same", false], [47798, 0.014323, " winner", false]]], "qwen": [3213, 106, 0.001448009512387216, [[3738, 0.08607, " human", false], [17755, 0.057509, " lesson", false], [1852, 0.039748, " same", false], [2297, 0.033862, " change", false], [2874, 0.025564, " reason", false], [4124, 0.023552, " early", false], [28464, 0.022176, " statistical", false], [2070, 0.021218, " field", false], [18366, 0.013596, " lessons", false], [2856, 0.012939, " initial", false]]]}, "raw_delta": -0.06786646161760601, "tuned_delta": -0.05929466958702776}, {"byte_start": 3784, "byte_end": 3789, "display": {"text": " rise", "kind": "normal"}, "is_word": true, "word_id": 637, "word_key": " rise", "bytes_hex": "20 72 69 73 65", "compression": {"rwkv": "12.68% 12.68% 12.68% 12.68% 12.68%", "qwen": "11.77% 11.77% 11.77% 11.77% 11.77%"}, "model_tokens": {"rwkv": [[31886, " rise", "normal", 0.029765283688902855]], "qwen": [[10000, " rise", "normal", 0.03823969513177872]]}, "loss": {"rwkv": 12.679936882813154, "qwen": 11.7719630767155}, "topk": {"rwkv": [31886, 5, 0.029765283688902855, [[53052, 0.158568, " success", false], [59687, 0.068896, " explosion", false], [60587, 0.045996, " successes", false], [22377, 0.032422, " res", false], [31886, 0.029765, " rise", false], [56950, 0.02179, " progress", false], [63469, 0.020988, " development", false], [32499, 0.020036, " work", false], [55465, 0.017368, " advances", false], [64266, 0.016526, " breakthrough", false]]], "qwen": [10000, 4, 0.03823969513177872, [[2393, 0.155085, " success", false], [90490, 0.075235, " resurgence", false], [9902, 0.065232, " ``", false], [10000, 0.03824, " rise", false], [48079, 0.031369, " emergence", false], [4401, 0.023977, " development", false], [975, 0.023407, " work", false], [47088, 0.022941, " successes", false], [24199, 0.016634, " explosion", false], [12560, 0.010869, " victory", false]]]}, "raw_delta": 0.050348758697509766, "tuned_delta": 0.058920550728088016}, {"byte_start": 3789, "byte_end": 3792, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 638, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.83% 0.83% 0.83%", "qwen": "0.88% 0.88% 0.88%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.871516227722168]], "qwen": [[315, " of", "normal", 0.8635035753250122]]}, "loss": {"rwkv": 0.8277181020725253, "qwen": 0.8821916360987787}, "topk": {"rwkv": [4706, 1, 0.871516227722168, [[4706, 0.871516, " of", false], [4596, 0.097808, " in", false], [4811, 0.015521, " to", false], [21265, 0.009588, " and", false], [45, 0.002323, ",", false], [275, 0.001096, " (", false], [37635, 0.00029, " again", false], [30917, 0.000124, " from", false], [4600, 0.000124, " is", false], [30218, 0.000119, " back", false]]], "qwen": [315, 1, 0.8635035753250122, [[315, 0.863504, " of", false], [304, 0.106901, " in", false], [311, 0.014329, " to", false], [323, 0.010539, " and", false], [11, 0.001082, ",", false], [320, 0.000833, " (", false], [1549, 0.000326, " again", false], [702, 0.000226, " has", false], [504, 0.000149, " from", false], [8841, 0.000125, " toward", false]]]}, "raw_delta": -0.0030206541220347063, "tuned_delta": 0.005551137908543542}, {"byte_start": 3792, "byte_end": 3797, "display": {"text": " deep", "kind": "normal"}, "is_word": true, "word_id": 639, "word_key": " deep", "bytes_hex": "20 64 65 65 70", "compression": {"rwkv": "2.14% 2.14% 2.14% 2.14% 2.14%", "qwen": "2.71% 2.71% 2.71% 2.71% 2.71%"}, "model_tokens": {"rwkv": [[30597, " deep", "normal", 0.547441840171814]], "qwen": [[5538, " deep", "normal", 0.47233864665031433]]}, "loss": {"rwkv": 2.141500451319555, "qwen": 2.7052662451755625}, "topk": {"rwkv": [30597, 1, 0.547441840171814, [[30597, 0.547442, " deep", false], [46658, 0.132981, " neural", false], [60342, 0.02775, " recurrent", false], [52167, 0.023649, " machine", false], [22590, 0.022831, " the", false], [59193, 0.020559, " attention", false], [4404, 0.020213, " ``", false], [64597, 0.009582, " transformers", false], [32497, 0.008067, " word", false], [63939, 0.007948, " transformer", false]]], "qwen": [5538, 1, 0.47233864665031433, [[5538, 0.472339, " deep", false], [29728, 0.166442, " neural", false], [5662, 0.030954, " machine", false], [279, 0.029208, " the", false], [3460, 0.017315, " large", false], [9902, 0.017042, " ``", false], [6529, 0.013668, " attention", false], [1766, 0.011558, " gener", false], [15235, 0.010287, " AI", false], [28464, 0.010208, " statistical", false]]]}, "raw_delta": -0.031261813640594494, "tuned_delta": -0.022690021610016244}, {"byte_start": 3797, "byte_end": 3806, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 640, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "0.38% 0.38% 0.38% 0.38% 0.38% 0.38% 0.38% 0.38% 0.38%", "qwen": "0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.8255179524421692]], "qwen": [[6832, " learning", "normal", 0.7984076142311096]]}, "loss": {"rwkv": 0.38352895509743484, "qwen": 0.4511146733470222}, "topk": {"rwkv": [56537, 1, 0.8255179524421692, [[56537, 0.825518, " learning", false], [46658, 0.135234, " neural", false], [46, 0.01012, "-", false], [56705, 0.006017, " networks", false], [31510, 0.002088, " nets", false], [47350, 0.001926, " speech", false], [56529, 0.001691, " language", false], [46086, 0.001264, " genera", false], [45, 0.001217, ",", false], [46587, 0.000945, " models", false]]], "qwen": [6832, 1, 0.7984076142311096, [[6832, 0.798408, " learning", false], [29728, 0.147366, " neural", false], [70756, 0.025295, "-learning", false], [14155, 0.00426, " networks", false], [71278, 0.00325, " reinforcement", false], [52457, 0.002188, " nets", false], [55712, 0.00194, " convolution", false], [11, 0.001538, ",", false], [1766, 0.001425, " gener", false], [320, 0.001152, " (", false]]]}, "raw_delta": -0.003747748004065618, "tuned_delta": 0.00482404402651263}, {"byte_start": 3806, "byte_end": 3809, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 641, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "10.19% 10.19% 10.19%", "qwen": "10.72% 10.72% 10.72%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.18572263419628143]], "qwen": [[304, " in", "normal", 0.16819624602794647]]}, "loss": {"rwkv": 10.190912235446126, "qwen": 10.715761006811082}, "topk": {"rwkv": [4596, 1, 0.18572263419628143, [[4596, 0.185723, " in", false], [45, 0.147007, ",", false], [21800, 0.124324, " has", false], [4600, 0.097739, " is", false], [52224, 0.050718, " methods", false], [21265, 0.038394, " and", false], [275, 0.032991, " (", false], [22748, 0.027951, " was", false], [21413, 0.024213, " can", false], [21700, 0.021879, " for", false]]], "qwen": [304, 2, 0.16819624602794647, [[702, 0.183061, " has", false], [304, 0.168196, " in", false], [374, 0.121965, " is", false], [11, 0.09634, ",", false], [572, 0.051172, " was", false], [323, 0.048385, " and", false], [5413, 0.047639, " methods", false], [320, 0.035923, " (", false], [1083, 0.016303, " also", false], [646, 0.015431, " can", false]]]}, "raw_delta": -0.02910379568735766, "tuned_delta": -0.02053200365677941}, {"byte_start": 3809, "byte_end": 3816, "display": {"text": " speech", "kind": "normal"}, "is_word": true, "word_id": 642, "word_key": " speech", "bytes_hex": "20 73 70 65 65 63 68", "compression": {"rwkv": "3.34% 3.34% 3.34% 3.34% 3.34% 3.34% 3.34%", "qwen": "3.08% 3.08% 3.08% 3.08% 3.08% 3.08% 3.08%"}, "model_tokens": {"rwkv": [[47350, " speech", "normal", 0.27548930048942566]], "qwen": [[8806, " speech", "normal", 0.30251842737197876]]}, "loss": {"rwkv": 3.3410627342015617, "qwen": 3.0801874720096674}, "topk": {"rwkv": [47350, 1, 0.27548930048942566, [[47350, 0.275489, " speech", false], [4047, 0.223361, " NL", false], [52299, 0.202829, " natural", false], [55809, 0.074227, " computer", false], [22590, 0.034189, " the", false], [32234, 0.033955, " this", false], [3609, 0.013477, " AI", false], [62293, 0.011698, " particular", false], [56529, 0.010611, " language", false], [52167, 0.010464, " machine", false]]], "qwen": [8806, 1, 0.30251842737197876, [[8806, 0.302518, " speech", false], [5810, 0.227938, " natural", false], [451, 0.12571, " N", false], [6366, 0.050058, " computer", false], [279, 0.045199, " the", false], [419, 0.039475, " this", false], [5662, 0.023615, " machine", false], [4128, 0.021623, " language", false], [678, 0.016251, " all", false], [29728, 0.015388, " neural", false]]]}, "raw_delta": 0.014465996197291803, "tuned_delta": 0.023037788227870053}, {"byte_start": 3816, "byte_end": 3828, "display": {"text": " recognition", "kind": "normal"}, "is_word": true, "word_id": 643, "word_key": " recognition", "bytes_hex": "20 72 65 63 6f 67 6e 69 74 69 6f 6e", "compression": {"rwkv": "0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48%", "qwen": "0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25%"}, "model_tokens": {"rwkv": [[63821, " recognition", "normal", 0.7280098795890808]], "qwen": [[17843, " recognition", "normal", 0.845000684261322]]}, "loss": {"rwkv": 0.47549763310549326, "qwen": 0.25309961175671214}, "topk": {"rwkv": [63821, 1, 0.7280098795890808, [[63821, 0.72801, " recognition", false], [21265, 0.124131, " and", false], [62378, 0.04523, " processing", false], [21800, 0.017489, " has", false], [45, 0.016553, ",", false], [4600, 0.012477, " is", false], [275, 0.004673, " (", false], [46, 0.004609, "-", false], [22748, 0.004023, " was", false], [62634, 0.003172, " technology", false]]], "qwen": [17843, 1, 0.845000684261322, [[17843, 0.845001, " recognition", false], [323, 0.051257, " and", false], [8692, 0.02725, " processing", false], [702, 0.014117, " has", false], [59172, 0.012267, "-rec", false], [11, 0.009875, ",", false], [374, 0.007562, " is", false], [572, 0.002541, " was", false], [3412, 0.00192, " research", false], [320, 0.00178, " (", false]]]}, "raw_delta": 0.012332364916801453, "tuned_delta": 0.020904156947379703}, {"byte_start": 3828, "byte_end": 3831, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 644, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "8.08% 8.08% 8.08%", "qwen": "7.52% 7.52% 7.52%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.2587813138961792]], "qwen": [[374, " is", "normal", 0.2861829102039337]]}, "loss": {"rwkv": 8.077589421643935, "qwen": 7.520794156286835}, "topk": {"rwkv": [4600, 1, 0.2587813138961792, [[4600, 0.258781, " is", false], [21800, 0.16979, " has", false], [21265, 0.153793, " and", false], [45, 0.102155, ",", false], [22748, 0.078371, " was", false], [21413, 0.023739, " can", false], [275, 0.020406, " (", false], [39680, 0.007059, " shows", false], [22074, 0.006559, " may", false], [30135, 0.006528, " also", false]]], "qwen": [374, 1, 0.2861829102039337, [[374, 0.286183, " is", false], [702, 0.119782, " has", false], [11, 0.093267, ",", false], [572, 0.083613, " was", false], [323, 0.074318, " and", false], [646, 0.039305, " can", false], [320, 0.032056, " (", false], [1083, 0.024595, " also", false], [4933, 0.013609, " shows", false], [1231, 0.009235, " may", false]]]}, "raw_delta": 0.03087528546651208, "tuned_delta": 0.03944707749709033}, {"byte_start": 3831, "byte_end": 3835, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 645, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "10.78% 10.78% 10.78% 10.78%", "qwen": "11.99% 11.99% 11.99% 11.99%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.09131397306919098]], "qwen": [[279, " the", "normal", 0.0699431374669075]]}, "loss": {"rwkv": 10.777946350391181, "qwen": 11.992730756278679}, "topk": {"rwkv": [22590, 2, 0.09131397306919098, [[332, 0.252089, " a", false], [22590, 0.091314, " the", false], [4419, 0.089771, " an", false], [50919, 0.049306, " another", false], [31198, 0.035743, " just", false], [22797, 0.031289, " yet", false], [4596, 0.023604, " in", false], [47285, 0.021613, " simply", false], [21572, 0.020608, " due", false], [52906, 0.018816, " similar", false]]], "qwen": [279, 4, 0.0699431374669075, [[264, 0.234943, " a", false], [2441, 0.142371, " another", false], [458, 0.090994, " an", false], [279, 0.069943, " the", false], [3602, 0.038998, " yet", false], [1101, 0.03188, " just", false], [1083, 0.027514, " also", false], [304, 0.021343, " in", false], [537, 0.01635, " not", false], [8365, 0.014277, " perhaps", false]]]}, "raw_delta": -0.06736195087432861, "tuned_delta": -0.05879015884375036}, {"byte_start": 3835, "byte_end": 3840, "display": {"text": " most", "kind": "normal"}, "is_word": true, "word_id": 646, "word_key": " most", "bytes_hex": "20 6d 6f 73 74", "compression": {"rwkv": "8.06% 8.06% 8.06% 8.06% 8.06%", "qwen": "5.85% 5.85% 5.85% 5.85% 5.85%"}, "model_tokens": {"rwkv": [[31461, " most", "normal", 0.10850495100021362]], "qwen": [[1429, " most", "normal", 0.1974916160106659]]}, "loss": {"rwkv": 8.058804329965694, "qwen": 5.850342003576077}, "topk": {"rwkv": [31461, 2, 0.10850495100021362, [[46404, 0.375387, " latest", false], [31461, 0.108505, " most", false], [45635, 0.106246, " culmin", false], [52299, 0.05548, " natural", false], [64328, 0.047418, " continuation", false], [52154, 0.035014, " logical", false], [47092, 0.029192, " result", false], [31515, 0.028893, " next", false], [31937, 0.018856, " same", false], [38491, 0.015832, " final", false]]], "qwen": [1429, 2, 0.1974916160106659, [[5535, 0.307636, " latest", false], [1429, 0.197492, " most", false], [92201, 0.057313, " culmination", false], [1102, 0.04321, " result", false], [16724, 0.030106, " ultimate", false], [1590, 0.026096, " final", false], [5810, 0.019535, " natural", false], [1790, 0.018574, " next", false], [6481, 0.016573, " modern", false], [1850, 0.013925, " best", false]]]}, "raw_delta": 0.12246315479278569, "tuned_delta": 0.13103494682336395}, {"byte_start": 3840, "byte_end": 3847, "display": {"text": " recent", "kind": "normal"}, "is_word": true, "word_id": 647, "word_key": " recent", "bytes_hex": "20 72 65 63 65 6e 74", "compression": {"rwkv": "1.53% 1.53% 1.53% 1.53% 1.53% 1.53% 1.53%", "qwen": "1.77% 1.77% 1.77% 1.77% 1.77% 1.77% 1.77%"}, "model_tokens": {"rwkv": [[47014, " recent", "normal", 0.5541421175003052]], "qwen": [[3213, " recent", "normal", 0.5033757090568542]]}, "loss": {"rwkv": 1.529643179513968, "qwen": 1.7683793607497929}, "topk": {"rwkv": [47014, 1, 0.5541421175003052, [[47014, 0.554142, " recent", false], [56056, 0.097038, " dramatic", false], [52346, 0.083036, " obvious", false], [63878, 0.028788, " spectacular", false], [51699, 0.023407, " extreme", false], [60273, 0.023087, " prominent", false], [53296, 0.020328, " visible", false], [57323, 0.020291, " striking", false], [59829, 0.014216, " important", false], [45752, 0.011239, " direct", false]]], "qwen": [3213, 1, 0.5033757090568542, [[3213, 0.503376, " recent", false], [21771, 0.087077, " dramatic", false], [20469, 0.041847, " prominent", false], [8036, 0.041745, " obvious", false], [14226, 0.036954, " extreme", false], [27709, 0.034373, " spectacular", false], [9434, 0.032216, " visible", false], [2989, 0.022292, " important", false], [5089, 0.018553, " significant", false], [27190, 0.017109, " notable", false]]]}, "raw_delta": -0.01323834487370082, "tuned_delta": -0.004666552843122571}, {"byte_start": 3847, "byte_end": 3852, "display": {"text": " step", "kind": "normal"}, "is_word": true, "word_id": 648, "word_key": " step", "bytes_hex": "20 73 74 65 70", "compression": {"rwkv": "17.47% 17.47% 17.47% 17.47% 17.47%", "qwen": "19.09% 19.09% 19.09% 19.09% 19.09%"}, "model_tokens": {"rwkv": [[32115, " step", "normal", 0.007795756217092276]], "qwen": [[3019, " step", "normal", 0.005021218676120043]]}, "loss": {"rwkv": 17.47013526076479, "qwen": 19.094366932737294}, "topk": {"rwkv": [32115, 18, 0.007795756217092276, [[51668, 0.367121, " example", false], [64955, 0.082502, " manifestation", false], [21265, 0.05559, " and", false], [45, 0.030289, ",", false], [56467, 0.028381, " instance", false], [53275, 0.023527, " version", false], [59695, 0.021506, " extension", false], [63469, 0.018923, " development", false], [59932, 0.016977, " iteration", false], [4706, 0.016629, " of", false]]], "qwen": [3019, 20, 0.005021218676120043, [[3110, 0.454865, " example", false], [62950, 0.143977, " manifestation", false], [323, 0.034289, " and", false], [2867, 0.031439, " instance", false], [315, 0.018749, " of", false], [7493, 0.01635, " expression", false], [3598, 0.014601, " major", false], [39034, 0.014404, " illustration", false], [11, 0.013451, ",", false], [2319, 0.011413, " version", false]]]}, "raw_delta": -0.09006652832031259, "tuned_delta": -0.08149473628973435}, {"byte_start": 3852, "byte_end": 3855, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 649, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "1.51% 1.51% 1.51%", "qwen": "1.46% 1.46% 1.46%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.7774576544761658]], "qwen": [[304, " in", "normal", 0.7840771675109863]]}, "loss": {"rwkv": 1.514548016558238, "qwen": 1.4622185329127406}, "topk": {"rwkv": [4596, 1, 0.7774576544761658, [[4596, 0.777458, " in", false], [37678, 0.097522, " along", false], [4706, 0.049117, " of", false], [45, 0.009862, ",", false], [4712, 0.009206, " on", false], [47, 0.007668, ".", false], [53169, 0.006621, " towards", false], [30678, 0.005657, " down", false], [47585, 0.00557, " toward", false], [30211, 0.005053, " away", false]]], "qwen": [304, 1, 0.7840771675109863, [[304, 0.784077, " in", false], [6974, 0.047984, " towards", false], [3156, 0.033861, " along", false], [315, 0.021732, " of", false], [11, 0.021365, ",", false], [389, 0.013445, " on", false], [4637, 0.011178, " forward", false], [8841, 0.00769, " toward", false], [311, 0.007191, " to", false], [13, 0.006736, ".", false]]]}, "raw_delta": 0.0029017627239227295, "tuned_delta": 0.011473554754500978}, {"byte_start": 3855, "byte_end": 3860, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 650, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "1.73% 1.73% 1.73% 1.73% 1.73%", "qwen": "1.39% 1.39% 1.39% 1.39% 1.39%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.6161835193634033]], "qwen": [[419, " this", "normal", 0.6810057759284973]]}, "loss": {"rwkv": 1.725880297938457, "qwen": 1.3856527166618726}, "topk": {"rwkv": [32234, 1, 0.6161835193634033, [[32234, 0.616184, " this", false], [32227, 0.182241, " that", false], [22590, 0.116104, " the", false], [332, 0.058396, " a", false], [4419, 0.006048, " an", false], [32464, 0.002821, " what", false], [39936, 0.002457, " these", false], [61774, 0.001212, " continuing", false], [59725, 0.00076, " following", false], [55531, 0.000565, " applying", false]]], "qwen": [419, 1, 0.6810057759284973, [[419, 0.681006, " this", false], [429, 0.131548, " that", false], [279, 0.095718, " the", false], [264, 0.054598, " a", false], [458, 0.004845, " an", false], [1128, 0.003424, " what", false], [1493, 0.001981, " these", false], [1741, 0.001159, " such", false], [14354, 0.001105, " continuing", false], [5810, 0.000941, " natural", false]]]}, "raw_delta": 0.01886622309684753, "tuned_delta": 0.02743801512742578}, {"byte_start": 3860, "byte_end": 3871, "display": {"text": " consistent", "kind": "normal"}, "is_word": true, "word_id": 651, "word_key": " consistent", "bytes_hex": "20 63 6f 6e 73 69 73 74 65 6e 74", "compression": {"rwkv": "17.83% 17.83% 17.83% 17.83% 17.83% 17.83% 17.83% 17.83% 17.83% 17.83% 17.83%", "qwen": "15.36% 15.36% 15.36% 15.36% 15.36% 15.36% 15.36% 15.36% 15.36% 15.36% 15.36%"}, "model_tokens": {"rwkv": [[61756, " consistent", "normal", 1.863027318904642e-05]], "qwen": [[12966, " consistent", "normal", 8.523379074176773e-05]]}, "loss": {"rwkv": 17.82875973825849, "qwen": 15.361607635964383}, "topk": {"rwkv": [61756, 861, 1.863027318904642e-05, [[52571, 0.155838, " process", false], [31323, 0.116301, " long", false], [59657, 0.081685, " evolution", false], [40009, 0.073981, " trend", false], [59526, 0.063072, " direction", false], [31937, 0.042181, " same", false], [51832, 0.031156, " general", false], [45450, 0.030962, " change", false], [63797, 0.029158, " progression", false], [52427, 0.023598, " pattern", false]]], "qwen": [12966, 291, 8.523379074176773e-05, [[1882, 0.186448, " process", false], [9149, 0.135534, " trend", false], [1293, 0.100552, " long", false], [15379, 0.066108, " evolution", false], [5106, 0.0499, " direction", false], [2297, 0.042591, " change", false], [4586, 0.030231, " general", false], [9142, 0.027419, " transition", false], [32724, 0.022523, " progression", false], [5383, 0.02007, " pattern", false]]]}, "raw_delta": 0.1368079618974165, "tuned_delta": 0.14537975392799476}, {"byte_start": 3871, "byte_end": 3881, "display": {"text": " direction", "kind": "normal"}, "is_word": true, "word_id": 652, "word_key": " direction", "bytes_hex": "20 64 69 72 65 63 74 69 6f 6e", "compression": {"rwkv": "7.83% 7.83% 7.83% 7.83% 7.83% 7.83% 7.83% 7.83% 7.83% 7.83%", "qwen": "6.56% 6.56% 6.56% 6.56% 6.56% 6.56% 6.56% 6.56% 6.56% 6.56%"}, "model_tokens": {"rwkv": [[59526, " direction", "normal", 0.012842195108532906]], "qwen": [[5106, " direction", "normal", 0.02627510018646717]]}, "loss": {"rwkv": 7.833383229826794, "qwen": 6.5626997328859815}, "topk": {"rwkv": [59526, 12, 0.012842195108532906, [[52427, 0.258604, " pattern", false], [40009, 0.198655, " trend", false], [45, 0.0538, ",", false], [63797, 0.03342, " progression", false], [59657, 0.032109, " evolution", false], [56950, 0.031539, " progress", false], [21265, 0.027424, " and", false], [45450, 0.026849, " change", false], [39664, 0.023627, " shift", false], [52571, 0.019469, " process", false]]], "qwen": [5106, 9, 0.02627510018646717, [[9149, 0.299869, " trend", false], [5383, 0.093218, " pattern", false], [2297, 0.054152, " change", false], [6407, 0.051961, " shift", false], [15379, 0.044662, " evolution", false], [1882, 0.03035, " process", false], [11, 0.029086, ",", false], [323, 0.026876, " and", false], [5106, 0.026275, " direction", false], [3271, 0.022239, " move", false]]]}, "raw_delta": 0.07046165466308596, "tuned_delta": 0.0790334466936642}, {"byte_start": 3881, "byte_end": 3882, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "5.78%", "qwen": "22.29%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.7278621196746826]], "qwen": [[13, ".", "normal", 0.29059064388275146]]}, "loss": {"rwkv": 5.776415691059325, "qwen": 22.286748024105815}, "topk": {"rwkv": [47, 1, 0.7278621196746826, [[47, 0.727862, ".", false], [45, 0.125623, ",", false], [4706, 0.062274, " of", false], [5346, 0.010447, "---", false], [21265, 0.009084, " and", false], [4596, 0.006474, " in", false], [30917, 0.006027, " from", false], [53169, 0.006012, " towards", false], [275, 0.005598, " (", false], [32227, 0.005451, " that", false]]], "qwen": [13, 2, 0.29059064388275146, [[382, 0.405737, ".\n\n", false], [13, 0.290591, ".", false], [11, 0.135025, ",", false], [315, 0.061821, " of", false], [4421, 0.019762, "---", false], [320, 0.011173, " (", false], [624, 0.010594, ".\n", false], [323, 0.009096, " and", false], [26, 0.006324, ";", false], [304, 0.005766, " in", false]]]}, "raw_delta": -0.9155272245407104, "tuned_delta": -0.9069554325101322}, {"byte_start": 3882, "byte_end": 3887, "display": {"text": " Deep", "kind": "normal"}, "is_word": true, "word_id": 653, "word_key": " deep", "bytes_hex": "20 44 65 65 70", "compression": {"rwkv": "13.98% 13.98% 13.98% 13.98% 13.98%", "qwen": "11.75% 11.75% 11.75% 11.75% 11.75%"}, "model_tokens": {"rwkv": [[28753, " Deep", "normal", 0.02122342400252819]], "qwen": [[18183, " Deep", "normal", 0.03847718983888626]]}, "loss": {"rwkv": 13.976108208611832, "qwen": 11.749631989414219}, "topk": {"rwkv": [28753, 4, 0.02122342400252819, [[261, 0.624039, "\n\n", false], [20996, 0.042449, " The", false], [3918, 0.033713, " It", false], [28753, 0.021223, " Deep", false], [3913, 0.020742, " In", false], [267, 0.018436, "  ", false], [44900, 0.011442, " Speech", false], [37451, 0.011002, " There", false], [29894, 0.009622, " This", false], [3336, 0.008285, " \n\n", false]]], "qwen": [18183, 6, 0.03847718983888626, [[576, 0.116875, " The", false], [220, 0.098938, " ", false], [758, 0.08166, " In", false], [1084, 0.064057, " It", false], [1096, 0.03989, " This", false], [18183, 0.038477, " Deep", false], [2619, 0.035076, " There", false], [320, 0.027231, " (", false], [362, 0.017175, " A", false], [1634, 0.014003, " As", false]]]}, "raw_delta": 0.12346205711364744, "tuned_delta": 0.1320338491442257}, {"byte_start": 3887, "byte_end": 3896, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 654, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "0.12% 0.12% 0.12% 0.12% 0.12% 0.12% 0.12% 0.12% 0.12%", "qwen": "0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.9430890083312988]], "qwen": [[6832, " learning", "normal", 0.9382525086402893]]}, "loss": {"rwkv": 0.11789601808479822, "qwen": 0.12771088284932422}, "topk": {"rwkv": [56537, 1, 0.9430890083312988, [[56537, 0.943089, " learning", false], [46658, 0.019796, " neural", false], [46, 0.011293, "-", false], [56705, 0.003299, " networks", false], [47350, 0.001933, " speech", false], [31510, 0.00187, " nets", false], [55122, 0.001551, " Learning", false], [46587, 0.001416, " models", false], [45, 0.001409, ",", false], [52224, 0.001401, " methods", false]]], "qwen": [6832, 1, 0.9382525086402893, [[6832, 0.938253, " learning", false], [29728, 0.024987, " neural", false], [70756, 0.01787, "-learning", false], [14155, 0.00314, " networks", false], [52457, 0.00118, " nets", false], [4119, 0.000807, " models", false], [20909, 0.000775, " Learning", false], [5413, 0.000722, " methods", false], [11, 0.000584, ",", false], [71278, 0.000508, " reinforcement", false]]]}, "raw_delta": -0.0005442516671286691, "tuned_delta": 0.00802754036344958}, {"byte_start": 3896, "byte_end": 3904, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 655, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "4.68% 4.68% 4.68% 4.68% 4.68% 4.68% 4.68% 4.68%", "qwen": "6.29% 6.29% 6.29% 6.29% 6.29% 6.29% 6.29% 6.29%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.1253858208656311]], "qwen": [[5413, " methods", "normal", 0.061479464173316956]]}, "loss": {"rwkv": 4.684532237261526, "qwen": 6.287111723447028}, "topk": {"rwkv": [52224, 2, 0.1253858208656311, [[4600, 0.220187, " is", false], [52224, 0.125386, " methods", false], [45, 0.089534, ",", false], [21800, 0.074177, " has", false], [21413, 0.028607, " can", false], [32356, 0.025294, " uses", false], [30659, 0.0252, " does", false], [22748, 0.017888, " was", false], [4596, 0.016556, " in", false], [62633, 0.015841, " techniques", false]]], "qwen": [5413, 4, 0.061479464173316956, [[374, 0.355186, " is", false], [702, 0.088279, " has", false], [11, 0.080589, ",", false], [5413, 0.061479, " methods", false], [304, 0.034315, " in", false], [572, 0.032036, " was", false], [323, 0.024567, " and", false], [646, 0.016037, " can", false], [1558, 0.012097, " does", false], [320, 0.010785, " (", false]]]}, "raw_delta": -0.08886587619781494, "tuned_delta": -0.0802940841672367}, {"byte_start": 3904, "byte_end": 3909, "display": {"text": " rely", "kind": "normal"}, "is_word": true, "word_id": 656, "word_key": " rely", "bytes_hex": "20 72 65 6c 79", "compression": {"rwkv": "17.13% 17.13% 17.13% 17.13% 17.13%", "qwen": "19.16% 19.16% 19.16% 19.16% 19.16%"}, "model_tokens": {"rwkv": [[31856, " rely", "normal", 0.008645105175673962]], "qwen": [[17188, " rely", "normal", 0.0049310470931231976]]}, "loss": {"rwkv": 17.13200361055644, "qwen": 19.159725499544685}, "topk": {"rwkv": [31856, 16, 0.008645105175673962, [[21286, 0.264944, " are", false], [45, 0.115213, ",", false], [31059, 0.094583, " have", false], [4491, 0.04506, " do", false], [21413, 0.033538, " can", false], [22681, 0.022545, " use", false], [56540, 0.019318, " leverage", false], [32187, 0.017729, " take", false], [32462, 0.015626, " were", false], [4596, 0.012693, " in", false]]], "qwen": [17188, 23, 0.0049310470931231976, [[525, 0.272963, " are", false], [614, 0.124843, " have", false], [11, 0.080843, ",", false], [1033, 0.030006, " were", false], [646, 0.027957, " can", false], [429, 0.027579, " that", false], [653, 0.021692, " do", false], [369, 0.017541, " for", false], [304, 0.015921, " in", false], [320, 0.012085, " (", false]]]}, "raw_delta": -0.11244077682495113, "tuned_delta": -0.10386898479437288}, {"byte_start": 3909, "byte_end": 3914, "display": {"text": " even", "kind": "normal"}, "is_word": true, "word_id": 657, "word_key": " even", "bytes_hex": "20 65 76 65 6e", "compression": {"rwkv": "21.19% 21.19% 21.19% 21.19% 21.19%", "qwen": "14.45% 14.45% 14.45% 14.45% 14.45%"}, "model_tokens": {"rwkv": [[30788, " even", "normal", 0.0027790244203060865]], "qwen": [[1496, " even", "normal", 0.01821867562830448]]}, "loss": {"rwkv": 21.18958341305665, "qwen": 14.44609551758368}, "topk": {"rwkv": [30788, 25, 0.0027790244203060865, [[4712, 0.70067, " on", false], [51919, 0.120362, " heavily", false], [31458, 0.014284, " more", false], [32350, 0.014111, " upon", false], [4596, 0.010824, " in", false], [45, 0.009702, ",", false], [31466, 0.009266, " much", false], [32386, 0.008866, " very", false], [45145, 0.007483, " almost", false], [60247, 0.005988, " primarily", false]]], "qwen": [1496, 5, 0.01821867562830448, [[389, 0.546781, " on", false], [16916, 0.192428, " heavily", false], [803, 0.041072, " more", false], [1753, 0.027618, " much", false], [1496, 0.018219, " even", false], [2686, 0.014777, " less", false], [4558, 0.014529, " almost", false], [5193, 0.008048, " upon", false], [1602, 0.006943, " very", false], [15503, 0.006629, " primarily", false]]]}, "raw_delta": 0.3739383697509766, "tuned_delta": 0.38251016178155484}, {"byte_start": 3914, "byte_end": 3919, "display": {"text": " less", "kind": "normal"}, "is_word": true, "word_id": 658, "word_key": " less", "bytes_hex": "20 6c 65 73 73", "compression": {"rwkv": "10.99% 10.99% 10.99% 10.99% 10.99%", "qwen": "11.69% 11.69% 11.69% 11.69% 11.69%"}, "model_tokens": {"rwkv": [[31277, " less", "normal", 0.04748174548149109]], "qwen": [[2686, " less", "normal", 0.039091095328330994]]}, "loss": {"rwkv": 10.9892786317714, "qwen": 11.692540628633799}, "topk": {"rwkv": [31277, 2, 0.04748174548149109, [[31458, 0.944053, " more", false], [31277, 0.047482, " less", false], [51816, 0.004451, " further", false], [4712, 0.001177, " on", false], [45501, 0.000384, " closer", false], [51918, 0.000374, " heavier", false], [31466, 0.000311, " much", false], [57326, 0.000217, " stronger", false], [4596, 0.000203, " in", false], [51919, 0.000181, " heavily", false]]], "qwen": [2686, 2, 0.039091095328330994, [[803, 0.941949, " more", false], [2686, 0.039091, " less", false], [4623, 0.007461, " further", false], [1753, 0.002388, " much", false], [15750, 0.001907, " harder", false], [16245, 0.001344, " stronger", false], [16916, 0.000838, " heavily", false], [7046, 0.000763, " greater", false], [43822, 0.00046, " heavier", false], [389, 0.000449, " on", false]]]}, "raw_delta": -0.03899712562561031, "tuned_delta": -0.030425333595032057}, {"byte_start": 3919, "byte_end": 3922, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 659, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"rwkv": "0.55% 0.55% 0.55%", "qwen": "0.46% 0.46% 0.46%"}, "model_tokens": {"rwkv": [[4712, " on", "normal", 0.9120094180107117]], "qwen": [[389, " on", "normal", 0.9263618588447571]]}, "loss": {"rwkv": 0.5547472386230755, "qwen": 0.45980081239096365}, "topk": {"rwkv": [4712, 1, 0.9120094180107117, [[4712, 0.912009, " on", false], [32226, 0.044922, " than", false], [32350, 0.022266, " upon", false], [56003, 0.007307, " directly", false], [45, 0.002262, ",", false], [51919, 0.00214, " heavily", false], [275, 0.002018, " (", false], [61983, 0.001878, " explicitly", false], [4706, 0.000545, " of", false], [4596, 0.00038, " in", false]]], "qwen": [389, 1, 0.9263618588447571, [[389, 0.926362, " on", false], [1091, 0.018097, " than", false], [16916, 0.015518, " heavily", false], [5193, 0.011774, " upon", false], [5961, 0.005576, " directly", false], [11, 0.004045, ",", false], [320, 0.002729, " (", false], [20975, 0.002665, " explicitly", false], [16510, 0.001793, " strongly", false], [3738, 0.001346, " human", false]]]}, "raw_delta": 0.005264947811762493, "tuned_delta": 0.013836739842340741}, {"byte_start": 3922, "byte_end": 3928, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 660, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "1.01% 1.01% 1.01% 1.01% 1.01% 1.01%", "qwen": "0.68% 0.68% 0.68% 0.68% 0.68% 0.68%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.7140908241271973]], "qwen": [[3738, " human", "normal", 0.7977262735366821]]}, "loss": {"rwkv": 1.009698677705492, "qwen": 0.6792380897031334}, "topk": {"rwkv": [38720, 1, 0.7140908241271973, [[38720, 0.714091, " human", false], [22590, 0.044683, " the", false], [59943, 0.034845, " knowledge", false], [45775, 0.01886, " domain", false], [52964, 0.017018, " special", false], [56179, 0.0119, " explicit", false], [21273, 0.011628, " any", false], [39356, 0.011557, " prior", false], [63875, 0.010436, " specialized", false], [65034, 0.009299, " understanding", false]]], "qwen": [3738, 1, 0.7977262735366821, [[3738, 0.797726, " human", false], [279, 0.021198, " the", false], [3281, 0.020519, " special", false], [11464, 0.01508, " explicit", false], [894, 0.014222, " any", false], [6540, 0.0102, " knowledge", false], [28464, 0.009826, " statistical", false], [4867, 0.007139, " prior", false], [27076, 0.004095, " specialized", false], [70601, 0.003108, " exploiting", false]]]}, "raw_delta": 0.018324625988801326, "tuned_delta": 0.026896418019379573}, {"byte_start": 3928, "byte_end": 3938, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 661, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50%", "qwen": "0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48%"}, "model_tokens": {"rwkv": [[59943, " knowledge", "normal", 0.7569496035575867]], "qwen": [[6540, " knowledge", "normal", 0.7678873538970947]]}, "loss": {"rwkv": 0.5001530659331854, "qwen": 0.4762917629958522}, "topk": {"rwkv": [59943, 1, 0.7569496035575867, [[59943, 0.75695, " knowledge", false], [46, 0.081589, "-", false], [65034, 0.081567, " understanding", false], [38786, 0.044524, " input", false], [59683, 0.006586, " expertise", false], [45775, 0.002684, " domain", false], [62182, 0.001964, " linguistic", false], [46297, 0.00156, " inputs", false], [52022, 0.001245, " insight", false], [39356, 0.001195, " prior", false]]], "qwen": [6540, 1, 0.7678873538970947, [[6540, 0.767887, " knowledge", false], [12646, 0.131365, "-k", false], [8660, 0.05767, " understanding", false], [1946, 0.018732, " input", false], [18726, 0.002581, " expertise", false], [71107, 0.001571, "-under", false], [1995, 0.000701, " information", false], [7947, 0.000522, " domain", false], [56251, 0.000467, " intuition", false], [12, 0.000397, "-", false]]]}, "raw_delta": 0.0013231515884399407, "tuned_delta": 0.009894943619018189}, {"byte_start": 3938, "byte_end": 3939, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "36.35%", "qwen": "43.23%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.1320059448480606]], "qwen": [[11, ",", "normal", 0.09096557646989822]]}, "loss": {"rwkv": 36.34915239739771, "qwen": 43.23169600531254}, "topk": {"rwkv": [45, 3, 0.1320059448480606, [[32226, 0.434867, " than", false], [21265, 0.176853, " and", false], [45, 0.132006, ",", false], [47, 0.057793, ".", false], [4706, 0.049093, " of", false], [5346, 0.038115, "---", false], [275, 0.023135, " (", false], [37598, 0.016251, " about", false], [4596, 0.013484, " in", false], [60, 0.008025, ";", false]]], "qwen": [11, 3, 0.09096557646989822, [[1091, 0.532951, " than", false], [323, 0.195286, " and", false], [11, 0.090966, ",", false], [315, 0.045367, " of", false], [13, 0.018696, ".", false], [382, 0.016803, ".\n\n", false], [320, 0.015955, " (", false], [911, 0.011983, " about", false], [4421, 0.009853, "---", false], [311, 0.009667, " to", false]]]}, "raw_delta": -0.3816492557525635, "tuned_delta": -0.37307746372198525}, {"byte_start": 3939, "byte_end": 3943, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 662, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "4.07% 4.07% 4.07% 4.07%", "qwen": "3.32% 3.32% 3.32% 3.32%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.40637195110321045]], "qwen": [[323, " and", "normal", 0.4790298044681549]]}, "loss": {"rwkv": 4.0681464165692205, "qwen": 3.3181647414095763}, "topk": {"rwkv": [21265, 1, 0.40637195110321045, [[21265, 0.406372, " and", false], [21400, 0.121094, " but", false], [55495, 0.042003, " although", false], [39690, 0.036786, " since", false], [4423, 0.025259, " as", false], [52700, 0.021972, " relying", false], [40186, 0.021811, " which", false], [4788, 0.016831, " so", false], [30788, 0.015641, " even", false], [4596, 0.015513, " in", false]]], "qwen": [323, 1, 0.4790298044681549, [[323, 0.47903, " and", false], [714, 0.071377, " but", false], [476, 0.027249, " or", false], [892, 0.022689, " which", false], [304, 0.019728, " in", false], [1496, 0.017436, " even", false], [438, 0.01599, " as", false], [38561, 0.014133, " relying", false], [7892, 0.013545, " although", false], [525, 0.013027, " are", false]]]}, "raw_delta": 0.041587814688682556, "tuned_delta": 0.050159606719260806}, {"byte_start": 3943, "byte_end": 3947, "display": {"text": " use", "kind": "normal"}, "is_word": true, "word_id": 663, "word_key": " use", "bytes_hex": "20 75 73 65", "compression": {"rwkv": "20.15% 20.15% 20.15% 20.15%", "qwen": "18.30% 18.30% 18.30% 18.30%"}, "model_tokens": {"rwkv": [[22681, " use", "normal", 0.011399897746741772]], "qwen": [[990, " use", "normal", 0.017263662070035934]]}, "loss": {"rwkv": 20.147010824914233, "qwen": 18.300368609106183}, "topk": {"rwkv": [22681, 17, 0.011399897746741772, [[31458, 0.165242, " more", false], [21286, 0.117427, " are", false], [32232, 0.065597, " they", false], [30788, 0.052148, " even", false], [31059, 0.035736, " have", false], [52028, 0.033725, " instead", false], [22590, 0.02727, " the", false], [4596, 0.022122, " in", false], [31856, 0.019772, " rely", false], [31466, 0.016966, " much", false]]], "qwen": [990, 13, 0.017263662070035934, [[803, 0.107137, " more", false], [525, 0.079429, " are", false], [1496, 0.055057, " even", false], [1373, 0.044111, " require", false], [807, 0.043144, " they", false], [4518, 0.037029, " instead", false], [1753, 0.035006, " much", false], [304, 0.031479, " in", false], [614, 0.031112, " have", false], [279, 0.024103, " the", false]]]}, "raw_delta": 0.10239958763122559, "tuned_delta": 0.11097137966180383}, {"byte_start": 3947, "byte_end": 3952, "display": {"text": " even", "kind": "normal"}, "is_word": true, "word_id": 664, "word_key": " even", "bytes_hex": "20 65 76 65 6e", "compression": {"rwkv": "9.24% 9.24% 9.24% 9.24% 9.24%", "qwen": "5.53% 5.53% 5.53% 5.53% 5.53%"}, "model_tokens": {"rwkv": [[30788, " even", "normal", 0.07655905187129974]], "qwen": [[1496, " even", "normal", 0.2160256952047348]]}, "loss": {"rwkv": 9.24226510569492, "qwen": 5.52681297029586}, "topk": {"rwkv": [30788, 2, 0.07655905187129974, [[52195, 0.315936, " massive", false], [30788, 0.076559, " even", false], [31458, 0.062224, " more", false], [31466, 0.056573, " much", false], [63370, 0.054929, " computation", false], [21660, 0.038872, " far", false], [22590, 0.031434, " the", false], [332, 0.027923, " a", false], [31581, 0.024429, " only", false], [59988, 0.017011, " massively", false]]], "qwen": [1496, 1, 0.2160256952047348, [[1496, 0.216026, " even", false], [803, 0.132534, " more", false], [3041, 0.118427, " far", false], [1753, 0.10704, " much", false], [34447, 0.06405, " computation", false], [10951, 0.027769, " massive", false], [264, 0.02091, " a", false], [279, 0.015844, " the", false], [2058, 0.013601, " still", false], [1657, 0.013031, " many", false]]]}, "raw_delta": 0.20602841377258296, "tuned_delta": 0.21460020580316122}, {"byte_start": 3952, "byte_end": 3957, "display": {"text": " more", "kind": "normal"}, "is_word": true, "word_id": 665, "word_key": " more", "bytes_hex": "20 6d 6f 72 65", "compression": {"rwkv": "1.01% 1.01% 1.01% 1.01% 1.01%", "qwen": "0.44% 0.44% 0.44% 0.44% 0.44%"}, "model_tokens": {"rwkv": [[31458, " more", "normal", 0.7560068368911743]], "qwen": [[803, " more", "normal", 0.8862769603729248]]}, "loss": {"rwkv": 1.0143949506250522, "qwen": 0.4354261591556644}, "topk": {"rwkv": [31458, 1, 0.7560068368911743, [[31458, 0.756007, " more", false], [31277, 0.148203, " less", false], [46397, 0.019507, " larger", false], [51867, 0.018695, " greater", false], [38475, 0.016358, " fewer", false], [52195, 0.00631, " massive", false], [45305, 0.004635, " bigger", false], [51918, 0.003655, " heavier", false], [31466, 0.002748, " much", false], [52932, 0.002498, " smaller", false]]], "qwen": [803, 1, 0.8862769603729248, [[803, 0.886277, " more", false], [7046, 0.069768, " greater", false], [8131, 0.011515, " larger", false], [1753, 0.009957, " much", false], [2686, 0.005961, " less", false], [5080, 0.002148, " higher", false], [11243, 0.002051, " bigger", false], [19117, 0.001932, " deeper", false], [16745, 0.000835, " fewer", false], [3041, 0.000817, " far", false]]]}, "raw_delta": 0.03210484683513641, "tuned_delta": 0.04067663886571466}, {"byte_start": 3957, "byte_end": 3969, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 666, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28%", "qwen": "0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.8277170062065125]], "qwen": [[34447, " computation", "normal", 0.8317679166793823]]}, "loss": {"rwkv": 0.2832439604609883, "qwen": 0.2768198933990527}, "topk": {"rwkv": [63370, 1, 0.8277170062065125, [[63370, 0.827717, " computation", false], [52195, 0.091086, " massive", false], [4706, 0.011687, " of", false], [47202, 0.007348, " search", false], [64862, 0.006919, " computational", false], [59346, 0.005382, " computing", false], [63885, 0.003743, " statistical", false], [62577, 0.003425, " statistics", false], [51266, 0.003089, " compute", false], [64298, 0.003076, " computations", false]]], "qwen": [34447, 1, 0.8317679166793823, [[34447, 0.831768, " computation", false], [10951, 0.075317, " massive", false], [54480, 0.013324, " computational", false], [315, 0.012591, " of", false], [24231, 0.011308, " computing", false], [7988, 0.004662, " powerful", false], [6366, 0.003931, " computer", false], [63707, 0.00252, " massively", false], [82599, 0.002164, " computations", false], [320, 0.001896, " (", false]]]}, "raw_delta": 0.00035622591773668867, "tuned_delta": 0.008928017948314937}, {"byte_start": 3969, "byte_end": 3970, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "16.62%", "qwen": "14.02%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.38943740725517273]], "qwen": [[11, ",", "normal", 0.4596511125564575]]}, "loss": {"rwkv": 16.62480613524391, "qwen": 14.017361042139353}, "topk": {"rwkv": [45, 1, 0.38943740725517273, [[45, 0.389437, ",", false], [47, 0.335641, ".", false], [32226, 0.171496, " than", false], [275, 0.024748, " (", false], [4811, 0.019178, " to", false], [5346, 0.013557, "---", false], [21265, 0.007835, " and", false], [4596, 0.006923, " in", false], [22278, 0.004351, " per", false], [21700, 0.003568, " for", false]]], "qwen": [11, 1, 0.4596511125564575, [[11, 0.459651, ",", false], [13, 0.147939, ".", false], [382, 0.145457, ".\n\n", false], [1091, 0.121472, " than", false], [311, 0.033275, " to", false], [320, 0.017124, " (", false], [4421, 0.013298, "---", false], [323, 0.01034, " and", false], [817, 0.00947, " per", false], [304, 0.007553, " in", false]]]}, "raw_delta": 0.1445874571800232, "tuned_delta": 0.15315924921060145}, {"byte_start": 3970, "byte_end": 3979, "display": {"text": " together", "kind": "normal"}, "is_word": true, "word_id": 667, "word_key": " together", "bytes_hex": "20 74 6f 67 65 74 68 65 72", "compression": {"rwkv": "22.67% 22.67% 22.67% 22.67% 22.67% 22.67% 22.67% 22.67% 22.67%", "qwen": "21.58% 21.58% 21.58% 21.58% 21.58% 21.58% 21.58% 21.58% 21.58%"}, "model_tokens": {"rwkv": [[57435, " together", "normal", 1.166057882073801e-05]], "qwen": [[3786, " together", "normal", 2.100588972098194e-05]]}, "loss": {"rwkv": 22.667343958411664, "qwen": 21.581732138615322}, "topk": {"rwkv": [57435, 399, 1.166057882073801e-05, [[32226, 0.419946, " than", false], [21265, 0.179234, " and", false], [21400, 0.127153, " but", false], [4788, 0.052421, " so", false], [4811, 0.041217, " to", false], [40186, 0.028096, " which", false], [4596, 0.015641, " in", false], [4423, 0.010753, " as", false], [46500, 0.009051, " making", false], [55495, 0.00834, " although", false]]], "qwen": [3786, 322, 2.100588972098194e-05, [[1091, 0.619293, " than", false], [323, 0.154646, " and", false], [311, 0.065051, " to", false], [714, 0.024441, " but", false], [304, 0.014371, " in", false], [773, 0.010733, " so", false], [7707, 0.007883, " compared", false], [892, 0.007188, " which", false], [438, 0.007071, " as", false], [369, 0.004787, " for", false]]]}, "raw_delta": 0.06019910176595045, "tuned_delta": 0.06877089379652869}, {"byte_start": 3979, "byte_end": 3984, "display": {"text": " with", "kind": "normal"}, "is_word": true, "word_id": 668, "word_key": " with", "bytes_hex": "20 77 69 74 68", "compression": {"rwkv": "0.66% 0.66% 0.66% 0.66% 0.66%", "qwen": "0.70% 0.70% 0.70% 0.70% 0.70%"}, "model_tokens": {"rwkv": [[32487, " with", "normal", 0.8343991041183472]], "qwen": [[448, " with", "normal", 0.8225528001785278]]}, "loss": {"rwkv": 0.6551300722786797, "qwen": 0.7045495557269997}, "topk": {"rwkv": [32487, 1, 0.8343991041183472, [[32487, 0.834399, " with", false], [47, 0.039435, ".", false], [4811, 0.014426, " to", false], [4596, 0.012325, " in", false], [45, 0.011111, ",", false], [57581, 0.006438, " yielding", false], [46500, 0.005494, " making", false], [56109, 0.004559, " enabling", false], [52107, 0.004248, " leading", false], [60264, 0.004239, " producing", false]]], "qwen": [448, 1, 0.8225528001785278, [[448, 0.822553, " with", false], [311, 0.044499, " to", false], [11, 0.017739, ",", false], [13, 0.012832, ".", false], [382, 0.012299, ".\n\n", false], [27362, 0.008633, " enabling", false], [304, 0.007544, " in", false], [3259, 0.00511, " making", false], [1091, 0.004741, " than", false], [6388, 0.00336, " leading", false]]]}, "raw_delta": -0.0027403980493545532, "tuned_delta": 0.005831393981223695}, {"byte_start": 3984, "byte_end": 3993, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 669, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "7.98% 7.98% 7.98% 7.98% 7.98% 7.98% 7.98% 7.98% 7.98%", "qwen": "7.55% 7.55% 7.55% 7.55% 7.55% 7.55% 7.55% 7.55% 7.55%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.01860511116683483]], "qwen": [[6832, " learning", "normal", 0.02309095859527588]]}, "loss": {"rwkv": 7.983663963252727, "qwen": 7.550733469424535}, "topk": {"rwkv": [56537, 6, 0.01860511116683483, [[52195, 0.365601, " massive", false], [22590, 0.073595, " the", false], [332, 0.051126, " a", false], [38864, 0.029114, " large", false], [31458, 0.019268, " more", false], [56537, 0.018605, " learning", false], [31466, 0.01559, " much", false], [45301, 0.014824, " better", false], [30789, 0.014687, " ever", false], [39193, 0.014503, " other", false]]], "qwen": [6832, 7, 0.02309095859527588, [[264, 0.073963, " a", false], [803, 0.049149, " more", false], [279, 0.046292, " the", false], [1753, 0.030189, " much", false], [28464, 0.029183, " statistical", false], [1008, 0.024636, " other", false], [6832, 0.023091, " learning", false], [7988, 0.022235, " powerful", false], [5413, 0.020202, " methods", false], [1602, 0.01773, " very", false]]]}, "raw_delta": 0.024006764094034794, "tuned_delta": 0.032578556124613044}, {"byte_start": 3993, "byte_end": 3996, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 670, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"rwkv": "31.93% 31.93% 31.93%", "qwen": "37.45% 37.45% 37.45%"}, "model_tokens": {"rwkv": [[4712, " on", "normal", 0.004880957771092653]], "qwen": [[389, " on", "normal", 0.001969738397747278]]}, "loss": {"rwkv": 31.934655853010906, "qwen": 37.44908463925589}, "topk": {"rwkv": [4712, 18, 0.004880957771092653, [[47, 0.30545, ".", false], [4450, 0.176563, " by", false], [45, 0.122019, ",", false], [30917, 0.088815, " from", false], [4811, 0.039794, " to", false], [4596, 0.033555, " in", false], [61559, 0.031364, " algorithms", false], [21265, 0.019146, " and", false], [275, 0.017849, " (", false], [52224, 0.017621, " methods", false]]], "qwen": [389, 23, 0.001969738397747278, [[553, 0.332966, " by", false], [11, 0.146714, ",", false], [13, 0.082028, ".", false], [382, 0.066914, ".\n\n", false], [311, 0.0633, " to", false], [504, 0.056364, " from", false], [323, 0.042003, " and", false], [5413, 0.028665, " methods", false], [12538, 0.026802, " techniques", false], [304, 0.026564, " in", false]]]}, "raw_delta": -0.30578486124674487, "tuned_delta": -0.29721306921616664}, {"byte_start": 3996, "byte_end": 4001, "display": {"text": " huge", "kind": "normal"}, "is_word": true, "word_id": 671, "word_key": " huge", "bytes_hex": "20 68 75 67 65", "compression": {"rwkv": "12.74% 12.74% 12.74% 12.74% 12.74%", "qwen": "13.87% 13.87% 13.87% 13.87% 13.87%"}, "model_tokens": {"rwkv": [[31118, " huge", "normal", 0.02925737574696541]], "qwen": [[6765, " huge", "normal", 0.021390043199062347]]}, "loss": {"rwkv": 12.73629215784788, "qwen": 13.867291345757915}, "topk": {"rwkv": [31118, 5, 0.02925737574696541, [[52195, 0.548794, " massive", false], [22590, 0.085755, " the", false], [38864, 0.072956, " large", false], [332, 0.054133, " a", false], [31118, 0.029257, " huge", false], [30579, 0.023986, " data", false], [31466, 0.023553, " much", false], [32386, 0.016041, " very", false], [32373, 0.014164, " vast", false], [38720, 0.010161, " human", false]]], "qwen": [6765, 7, 0.021390043199062347, [[264, 0.206652, " a", false], [656, 0.19224, " self", false], [3460, 0.116152, " large", false], [10951, 0.100546, " massive", false], [279, 0.081583, " the", false], [821, 0.028143, " data", false], [6765, 0.02139, " huge", false], [1753, 0.014829, " much", false], [458, 0.013544, " an", false], [1602, 0.013479, " very", false]]]}, "raw_delta": -0.06271591186523429, "tuned_delta": -0.054144119834656036}, {"byte_start": 4001, "byte_end": 4010, "display": {"text": " training", "kind": "normal"}, "is_word": true, "word_id": 672, "word_key": " training", "bytes_hex": "20 74 72 61 69 6e 69 6e 67", "compression": {"rwkv": "9.08% 9.08% 9.08% 9.08% 9.08% 9.08% 9.08% 9.08% 9.08%", "qwen": "7.17% 7.17% 7.17% 7.17% 7.17% 7.17% 7.17% 7.17% 7.17%"}, "model_tokens": {"rwkv": [[57453, " training", "normal", 0.010948601178824902]], "qwen": [[4862, " training", "normal", 0.027948863804340363]]}, "loss": {"rwkv": 9.079460977816826, "qwen": 7.1681480302589184}, "topk": {"rwkv": [57453, 9, 0.010948601178824902, [[50897, 0.658448, " amounts", false], [55913, 0.081205, " datasets", false], [30579, 0.070438, " data", false], [45588, 0.030048, " corpor", false], [59442, 0.023973, " databases", false], [62426, 0.020156, " quantities", false], [45, 0.013483, ",", false], [63344, 0.013247, " collections", false], [57453, 0.010949, " training", false], [53304, 0.010588, " volumes", false]]], "qwen": [4862, 5, 0.027948863804340363, [[14713, 0.489025, " amounts", false], [29425, 0.179325, " datasets", false], [821, 0.127879, " data", false], [32676, 0.028737, " quantities", false], [4862, 0.027949, " training", false], [8368, 0.022283, " corpor", false], [31806, 0.017646, " databases", false], [11, 0.011832, ",", false], [26282, 0.008516, " volumes", false], [7289, 0.007055, " sets", false]]]}, "raw_delta": 0.10598569446139863, "tuned_delta": 0.11455748649197688}, {"byte_start": 4010, "byte_end": 4015, "display": {"text": " sets", "kind": "normal"}, "is_word": true, "word_id": 673, "word_key": " sets", "bytes_hex": "20 73 65 74 73", "compression": {"rwkv": "1.69% 1.69% 1.69% 1.69% 1.69%", "qwen": "1.70% 1.70% 1.70% 1.70% 1.70%"}, "model_tokens": {"rwkv": [[31989, " sets", "normal", 0.6259512305259705]], "qwen": [[7289, " sets", "normal", 0.6247401833534241]]}, "loss": {"rwkv": 1.6906582510417538, "qwen": 1.6966794711376174}, "topk": {"rwkv": [31989, 1, 0.6259512305259705, [[31989, 0.625951, " sets", false], [30579, 0.173782, " data", false], [55913, 0.104321, " datasets", false], [45588, 0.068904, " corpor", false], [59442, 0.011071, " databases", false], [63344, 0.004355, " collections", false], [52800, 0.001882, " samples", false], [21265, 0.001335, " and", false], [45590, 0.000819, " corpus", false], [56162, 0.000751, " examples", false]]], "qwen": [7289, 1, 0.6247401833534241, [[7289, 0.62474, " sets", false], [821, 0.205242, " data", false], [29425, 0.120632, " datasets", false], [8368, 0.01474, " corpor", false], [31806, 0.006376, " databases", false], [10469, 0.004582, " samples", false], [10295, 0.003663, " examples", false], [323, 0.003389, " and", false], [738, 0.002761, " set", false], [15302, 0.001929, " collections", false]]]}, "raw_delta": -0.0003338873386383029, "tuned_delta": 0.008237904691939945}, {"byte_start": 4015, "byte_end": 4016, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "40.01%", "qwen": "25.69%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.10759126394987106]], "qwen": [[11, ",", "normal", 0.24055695533752441]]}, "loss": {"rwkv": 40.01224527465484, "qwen": 25.694371422421927}, "topk": {"rwkv": [45, 3, 0.10759126394987106, [[47, 0.626975, ".", false], [4706, 0.129354, " of", false], [45, 0.107591, ",", false], [32227, 0.027114, " that", false], [275, 0.018844, " (", false], [21265, 0.010868, " and", false], [5346, 0.010591, "---", false], [4811, 0.009913, " to", false], [30917, 0.007722, " from", false], [4596, 0.003982, " in", false]]], "qwen": [11, 2, 0.24055695533752441, [[13, 0.279001, ".", false], [11, 0.240557, ",", false], [382, 0.232527, ".\n\n", false], [311, 0.071379, " to", false], [315, 0.041802, " of", false], [320, 0.027236, " (", false], [323, 0.025563, " and", false], [429, 0.01288, " that", false], [304, 0.007643, " in", false], [4421, 0.006589, "---", false]]]}, "raw_delta": 0.7939515113830566, "tuned_delta": 0.8025233034136349}, {"byte_start": 4016, "byte_end": 4019, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 674, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "5.82% 5.82% 5.82%", "qwen": "5.31% 5.31% 5.31%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.3826839327812195]], "qwen": [[311, " to", "normal", 0.4131651222705841]]}, "loss": {"rwkv": 5.82337842025493, "qwen": 5.313373543145382}, "topk": {"rwkv": [4811, 1, 0.3826839327812195, [[4811, 0.382684, " to", false], [21265, 0.166266, " and", false], [32226, 0.067666, " than", false], [40186, 0.055081, " which", false], [4788, 0.050425, " so", false], [21400, 0.038161, " but", false], [4596, 0.026396, " in", false], [4423, 0.018309, " as", false], [21700, 0.012002, " for", false], [30322, 0.008568, " both", false]]], "qwen": [311, 1, 0.4131651222705841, [[311, 0.413165, " to", false], [1091, 0.289355, " than", false], [323, 0.077884, " and", false], [304, 0.044376, " in", false], [892, 0.016596, " which", false], [773, 0.008746, " so", false], [429, 0.00852, " that", false], [438, 0.008271, " as", false], [369, 0.007668, " for", false], [714, 0.007464, " but", false]]]}, "raw_delta": 0.028280675411224365, "tuned_delta": 0.036852467441802615}, {"byte_start": 4019, "byte_end": 4027, "display": {"text": " produce", "kind": "normal"}, "is_word": true, "word_id": 675, "word_key": " produce", "bytes_hex": "20 70 72 6f 64 75 63 65", "compression": {"rwkv": "7.50% 7.50% 7.50% 7.50% 7.50% 7.50% 7.50% 7.50%", "qwen": "6.17% 6.17% 6.17% 6.17% 6.17% 6.17% 6.17% 6.17%"}, "model_tokens": {"rwkv": [[52573, " produce", "normal", 0.03572550788521767]], "qwen": [[8193, " produce", "normal", 0.06479889154434204]]}, "loss": {"rwkv": 7.5022959889977825, "qwen": 6.168573756231406}, "topk": {"rwkv": [52573, 3, 0.03572550788521767, [[50848, 0.177285, " achieve", false], [31358, 0.063811, " make", false], [52573, 0.035726, " produce", false], [51982, 0.032574, " improve", false], [22249, 0.030236, " out", false], [45851, 0.026567, " enable", false], [4491, 0.024796, " do", false], [39740, 0.022546, " solve", false], [38877, 0.019398, " learn", false], [30256, 0.017436, " beat", false]]], "qwen": [8193, 2, 0.06479889154434204, [[11075, 0.208723, " achieve", false], [8193, 0.064799, " produce", false], [1281, 0.043523, " make", false], [700, 0.042999, " out", false], [9382, 0.038458, " beat", false], [7269, 0.036169, " improve", false], [653, 0.031651, " do", false], [2736, 0.031527, " perform", false], [11625, 0.023982, " solve", false], [3960, 0.021608, " learn", false]]]}, "raw_delta": 0.07395726442337036, "tuned_delta": 0.0825290564539486}, {"byte_start": 4027, "byte_end": 4040, "display": {"text": " dramatically", "kind": "normal"}, "is_word": true, "word_id": 676, "word_key": " dramatically", "bytes_hex": "20 64 72 61 6d 61 74 69 63 61 6c 6c 79", "compression": {"rwkv": "7.41% 7.41% 7.41% 7.41% 7.41% 7.41% 7.41% 7.41% 7.41% 7.41% 7.41% 7.41% 7.41%", "qwen": "6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95%"}, "model_tokens": {"rwkv": [[64374, " dramatically", "normal", 0.004814160987734795]], "qwen": [[27957, " dramatically", "normal", 0.006656334735453129]]}, "loss": {"rwkv": 7.412886177644616, "qwen": 6.952938422064054}, "topk": {"rwkv": [64374, 41, 0.004814160987734795, [[62084, 0.072649, " impressive", false], [22590, 0.070349, " the", false], [39802, 0.057424, " state", false], [45301, 0.054554, " better", false], [32386, 0.052813, " very", false], [52738, 0.043075, " results", false], [30992, 0.033619, " good", false], [62477, 0.026332, " remarkable", false], [53087, 0.025269, " systems", false], [31466, 0.025226, " much", false]]], "qwen": [27957, 33, 0.006656334735453129, [[1584, 0.126618, " state", false], [2664, 0.055133, " better", false], [15978, 0.047918, " impressive", false], [3059, 0.047126, " results", false], [279, 0.040378, " the", false], [1602, 0.028198, " very", false], [9073, 0.027886, " excellent", false], [22804, 0.027785, " remarkable", false], [264, 0.025321, " a", false], [5942, 0.022768, " systems", false]]]}, "raw_delta": 0.025504919198843123, "tuned_delta": 0.03407671122942137}, {"byte_start": 4040, "byte_end": 4047, "display": {"text": " better", "kind": "normal"}, "is_word": true, "word_id": 677, "word_key": " better", "bytes_hex": "20 62 65 74 74 65 72", "compression": {"rwkv": "1.45% 1.45% 1.45% 1.45% 1.45% 1.45% 1.45%", "qwen": "1.41% 1.41% 1.41% 1.41% 1.41% 1.41% 1.41%"}, "model_tokens": {"rwkv": [[45301, " better", "normal", 0.5686437487602234]], "qwen": [[2664, " better", "normal", 0.5791397094726562]]}, "loss": {"rwkv": 1.4491356437500749, "qwen": 1.4071724911633026}, "topk": {"rwkv": [45301, 1, 0.5686437487602234, [[45301, 0.568644, " better", false], [56418, 0.206021, " improved", false], [31458, 0.111422, " more", false], [57350, 0.037369, " superior", false], [46198, 0.018186, " higher", false], [51867, 0.00769, " greater", false], [59593, 0.005926, " effective", false], [62603, 0.005844, " successful", false], [57326, 0.004773, " stronger", false], [46397, 0.003331, " larger", false]]], "qwen": [2664, 1, 0.5791397094726562, [[2664, 0.57914, " better", false], [12944, 0.182639, " improved", false], [803, 0.081216, " more", false], [16353, 0.067956, " superior", false], [5080, 0.019567, " higher", false], [7046, 0.011218, " greater", false], [7172, 0.005289, " increased", false], [700, 0.005247, " out", false], [4722, 0.005004, " lower", false], [6849, 0.004503, " successful", false]]]}, "raw_delta": 0.0023269312722342395, "tuned_delta": 0.010898723302812488}, {"byte_start": 4047, "byte_end": 4054, "display": {"text": " speech", "kind": "normal"}, "is_word": true, "word_id": 678, "word_key": " speech", "bytes_hex": "20 73 70 65 65 63 68", "compression": {"rwkv": "6.84% 6.84% 6.84% 6.84% 6.84% 6.84% 6.84%", "qwen": "6.50% 6.50% 6.50% 6.50% 6.50% 6.50% 6.50%"}, "model_tokens": {"rwkv": [[47350, " speech", "normal", 0.06968890875577927]], "qwen": [[8806, " speech", "normal", 0.08017592877149582]]}, "loss": {"rwkv": 6.843140539930907, "qwen": 6.501226745540583}, "topk": {"rwkv": [47350, 3, 0.06968890875577927, [[52738, 0.428004, " results", false], [63750, 0.334254, " performance", false], [47350, 0.069689, " speech", false], [53087, 0.060757, " systems", false], [63821, 0.015339, " recognition", false], [52224, 0.011108, " methods", false], [46587, 0.010234, " models", false], [32497, 0.005204, " word", false], [55434, 0.004574, " accuracy", false], [56529, 0.004012, " language", false]]], "qwen": [8806, 3, 0.08017592877149582, [[3059, 0.494967, " results", false], [5068, 0.302497, " performance", false], [8806, 0.080176, " speech", false], [17843, 0.031126, " recognition", false], [5942, 0.018468, " systems", false], [4119, 0.010573, " models", false], [23675, 0.008674, " performances", false], [13403, 0.006383, " accuracy", false], [8084, 0.002414, " overall", false], [12205, 0.002009, " scores", false]]]}, "raw_delta": 0.018959726606096516, "tuned_delta": 0.027531518636674766}, {"byte_start": 4054, "byte_end": 4066, "display": {"text": " recognition", "kind": "normal"}, "is_word": true, "word_id": 679, "word_key": " recognition", "bytes_hex": "20 72 65 63 6f 67 6e 69 74 69 6f 6e", "compression": {"rwkv": "0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28%", "qwen": "0.31% 0.31% 0.31% 0.31% 0.31% 0.31% 0.31% 0.31% 0.31% 0.31% 0.31% 0.31%"}, "model_tokens": {"rwkv": [[63821, " recognition", "normal", 0.827271044254303]], "qwen": [[17843, " recognition", "normal", 0.8116647601127625]]}, "loss": {"rwkv": 0.28471154574835084, "qwen": 0.3135876343703854}, "topk": {"rwkv": [63821, 1, 0.827271044254303, [[63821, 0.827271, " recognition", false], [46, 0.077582, "-", false], [60335, 0.045979, " recognize", false], [53087, 0.012585, " systems", false], [65034, 0.009922, " understanding", false], [21265, 0.007315, " and", false], [62378, 0.003192, " processing", false], [46587, 0.001954, " models", false], [64591, 0.001364, " technologies", false], [62380, 0.001078, " processors", false]]], "qwen": [17843, 1, 0.8116647601127625, [[17843, 0.811665, " recognition", false], [59172, 0.117195, "-rec", false], [5829, 0.02908, " recogn", false], [12, 0.015159, "-", false], [323, 0.003871, " and", false], [4686, 0.00245, "-to", false], [5504, 0.001691, "-re", false], [45840, 0.001459, " transcription", false], [8660, 0.001436, " understanding", false], [93159, 0.001286, " recognizer", false]]]}, "raw_delta": -0.0016012303531169891, "tuned_delta": 0.006970561677461259}, {"byte_start": 4066, "byte_end": 4074, "display": {"text": " systems", "kind": "normal"}, "is_word": true, "word_id": 680, "word_key": " systems", "bytes_hex": "20 73 79 73 74 65 6d 73", "compression": {"rwkv": "2.31% 2.31% 2.31% 2.31% 2.31% 2.31% 2.31% 2.31%", "qwen": "2.70% 2.70% 2.70% 2.70% 2.70% 2.70% 2.70% 2.70%"}, "model_tokens": {"rwkv": [[53087, " systems", "normal", 0.36058366298675537]], "qwen": [[5942, " systems", "normal", 0.3021843433380127]]}, "loss": {"rwkv": 2.30704407173406, "qwen": 2.6976548304941583}, "topk": {"rwkv": [53087, 1, 0.36058366298675537, [[53087, 0.360584, " systems", false], [47, 0.255342, ".", false], [63750, 0.091043, " performance", false], [32226, 0.072549, " than", false], [52738, 0.059611, " results", false], [21265, 0.02609, " and", false], [45, 0.021148, ",", false], [51616, 0.0197, " engines", false], [46587, 0.008751, " models", false], [55434, 0.008507, " accuracy", false]]], "qwen": [5942, 1, 0.3021843433380127, [[5942, 0.302184, " systems", false], [1091, 0.180007, " than", false], [5068, 0.14868, " performance", false], [3059, 0.097481, " results", false], [13, 0.070357, ".", false], [382, 0.070091, ".\n\n", false], [13403, 0.015708, " accuracy", false], [11, 0.015176, ",", false], [323, 0.009859, " and", false], [12205, 0.008681, " scores", false]]]}, "raw_delta": -0.021660059690475464, "tuned_delta": -0.013088267659897216}, {"byte_start": 4074, "byte_end": 4075, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "5.32%", "qwen": "24.80%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.7467849850654602]], "qwen": [[13, ".", "normal", 0.25276753306388855]]}, "loss": {"rwkv": 5.3185290814021835, "qwen": 24.80146114675672}, "topk": {"rwkv": [47, 1, 0.7467849850654602, [[47, 0.746785, ".", false], [32226, 0.159068, " than", false], [45, 0.028283, ",", false], [275, 0.008789, " (", false], [5346, 0.008286, "---", false], [32227, 0.007375, " that", false], [21265, 0.006074, " and", false], [4596, 0.00593, " in", false], [21700, 0.004052, " for", false], [39971, 0.003315, " today", false]]], "qwen": [13, 3, 0.25276753306388855, [[1091, 0.349262, " than", false], [382, 0.288776, ".\n\n", false], [13, 0.252768, ".", false], [11, 0.031671, ",", false], [320, 0.011297, " (", false], [304, 0.010227, " in", false], [624, 0.006941, ".\n", false], [429, 0.005702, " that", false], [4421, 0.005591, "---", false], [3351, 0.003167, " today", false]]]}, "raw_delta": -1.080363154411316, "tuned_delta": -1.0717913623807376}, {"byte_start": 4075, "byte_end": 4078, "display": {"text": " As", "kind": "normal"}, "is_word": true, "word_id": 681, "word_key": " as", "bytes_hex": "20 41 73", "compression": {"rwkv": "31.56% 31.56% 31.56%", "qwen": "25.03% 25.03% 25.03%"}, "model_tokens": {"rwkv": [[3641, " As", "normal", 0.005242753308266401]], "qwen": [[1634, " As", "normal", 0.015550422482192516]]}, "loss": {"rwkv": 31.55895401944607, "qwen": 25.028761300675168}, "topk": {"rwkv": [3641, 16, 0.005242753308266401, [[261, 0.680003, "\n\n", false], [20996, 0.037509, " The", false], [267, 0.022622, "  ", false], [3913, 0.016002, " In", false], [29894, 0.015575, " This", false], [3918, 0.012984, " It", false], [3336, 0.012386, " \n\n", false], [275, 0.011553, " (", false], [37453, 0.00886, " These", false], [28753, 0.008466, " Deep", false]]], "qwen": [1634, 11, 0.015550422482192516, [[576, 0.121241, " The", false], [220, 0.096089, " ", false], [1096, 0.088579, " This", false], [758, 0.065973, " In", false], [1084, 0.043178, " It", false], [18183, 0.032035, " Deep", false], [4220, 0.031349, " These", false], [2619, 0.029938, " There", false], [320, 0.023987, " (", false], [362, 0.016137, " A", false]]]}, "raw_delta": 0.3621107737223308, "tuned_delta": 0.37068256575290903}, {"byte_start": 4078, "byte_end": 4081, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 682, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "9.20% 9.20% 9.20%", "qwen": "7.85% 7.85% 7.85%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.21443837881088257]], "qwen": [[304, " in", "normal", 0.27106383442878723]]}, "loss": {"rwkv": 9.204694922338437, "qwen": 7.847064593021805}, "topk": {"rwkv": [4596, 2, 0.21443837881088257, [[32487, 0.270293, " with", false], [4596, 0.214438, " in", false], [332, 0.063033, " a", false], [22590, 0.045334, " the", false], [45150, 0.02772, " always", false], [47350, 0.018437, " speech", false], [4858, 0.016752, " we", false], [21700, 0.016353, " for", false], [31458, 0.015313, " more", false], [45285, 0.014527, " before", false]]], "qwen": [304, 1, 0.27106383442878723, [[304, 0.271064, " in", false], [448, 0.141271, " with", false], [264, 0.106352, " a", false], [279, 0.039938, " the", false], [582, 0.020754, " we", false], [315, 0.019944, " of", false], [374, 0.018514, " is", false], [369, 0.016189, " for", false], [419, 0.014837, " this", false], [458, 0.012199, " an", false]]]}, "raw_delta": 0.0752830108006795, "tuned_delta": 0.08385480283125775}, {"byte_start": 4081, "byte_end": 4085, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 683, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "7.71% 7.71% 7.71% 7.71%", "qwen": "8.97% 8.97% 8.97% 8.97%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.17889811098575592]], "qwen": [[279, " the", "normal", 0.13674281537532806]]}, "loss": {"rwkv": 7.713628270378002, "qwen": 8.970197473629971}, "topk": {"rwkv": [22590, 3, 0.17889811098575592, [[55809, 0.350947, " computer", false], [38013, 0.180859, " chess", false], [22590, 0.178898, " the", false], [3851, 0.066754, " Go", false], [39193, 0.048008, " other", false], [31370, 0.025676, " many", false], [21256, 0.020174, " all", false], [47350, 0.017067, " speech", false], [47202, 0.012969, " search", false], [51551, 0.010352, " earlier", false]]], "qwen": [279, 3, 0.13674281537532806, [[6366, 0.37974, " computer", false], [5994, 0.182268, " Go", false], [279, 0.136743, " the", false], [32719, 0.101986, " chess", false], [1008, 0.060014, " other", false], [678, 0.031429, " all", false], [1657, 0.026397, " many", false], [8806, 0.014696, " speech", false], [5810, 0.004728, " natural", false], [773, 0.004164, " so", false]]]}, "raw_delta": -0.06967899203300476, "tuned_delta": -0.06110720000242651}, {"byte_start": 4085, "byte_end": 4091, "display": {"text": " games", "kind": "normal"}, "is_word": true, "word_id": 684, "word_key": " games", "bytes_hex": "20 67 61 6d 65 73", "compression": {"rwkv": "16.25% 16.25% 16.25% 16.25% 16.25% 16.25%", "qwen": "18.95% 18.95% 18.95% 18.95% 18.95% 18.95%"}, "model_tokens": {"rwkv": [[38576, " games", "normal", 0.004468951374292374]], "qwen": [[3868, " games", "normal", 0.0018289807485416532]]}, "loss": {"rwkv": 16.24910430167908, "qwen": 18.947384539917156}, "topk": {"rwkv": [38576, 21, 0.004468951374292374, [[39193, 0.298413, " other", false], [30405, 0.132221, " case", false], [51551, 0.084788, " earlier", false], [38013, 0.072867, " chess", false], [56926, 0.064135, " previous", false], [37970, 0.039929, " cases", false], [55809, 0.039734, " computer", false], [22638, 0.035154, " two", false], [31636, 0.022564, " past", false], [3851, 0.016283, " Go", false]]], "qwen": [3868, 27, 0.0018289807485416532, [[1142, 0.338963, " case", false], [1008, 0.280844, " other", false], [6788, 0.07526, " earlier", false], [5994, 0.053692, " Go", false], [5048, 0.035354, " cases", false], [3681, 0.027521, " previous", false], [6366, 0.026768, " computer", false], [32719, 0.01479, " chess", false], [2070, 0.011252, " field", false], [4124, 0.01084, " early", false]]]}, "raw_delta": -0.14962442715962732, "tuned_delta": -0.14105263512904906}, {"byte_start": 4091, "byte_end": 4092, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "11.20%", "qwen": "13.51%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.5409867167472839]], "qwen": [[11, ",", "normal", 0.472660630941391]]}, "loss": {"rwkv": 11.20061091315162, "qwen": 13.514041990582097}, "topk": {"rwkv": [45, 1, 0.5409867167472839, [[45, 0.540987, ",", false], [4706, 0.1395, " of", false], [21265, 0.069385, " and", false], [37599, 0.059481, " above", false], [60003, 0.044097, " mentioned", false], [59546, 0.016139, " discussed", false], [56162, 0.015386, " examples", false], [37970, 0.009827, " cases", false], [45285, 0.009579, " before", false], [32227, 0.006431, " that", false]]], "qwen": [11, 1, 0.472660630941391, [[11, 0.472661, ",", false], [323, 0.207851, " and", false], [315, 0.160039, " of", false], [9733, 0.033301, " mentioned", false], [3403, 0.018764, " above", false], [14078, 0.015981, " discussed", false], [7947, 0.012767, " domain", false], [2070, 0.006106, " field", false], [7481, 0.005491, " described", false], [3110, 0.005347, " example", false]]]}, "raw_delta": -0.12828385829925537, "tuned_delta": -0.11971206626867713}, {"byte_start": 4092, "byte_end": 4104, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 685, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"rwkv": "5.78% 5.78% 5.78% 5.78% 5.78% 5.78% 5.78% 5.78% 5.78% 5.78% 5.78% 5.78%", "qwen": "6.37% 6.37% 6.37% 6.37% 6.37% 6.37% 6.37% 6.37% 6.37% 6.37% 6.37% 6.37%"}, "model_tokens": {"rwkv": [[63843, " researchers", "normal", 0.021582767367362976]], "qwen": [[11811, " researchers", "normal", 0.014395827427506447]]}, "loss": {"rwkv": 5.776415691059325, "qwen": 6.3731309960591975}, "topk": {"rwkv": [63843, 9, 0.021582767367362976, [[22590, 0.309165, " the", false], [39934, 0.066722, " there", false], [4601, 0.061405, " it", false], [32234, 0.054552, " this", false], [39936, 0.047268, " these", false], [38720, 0.039012, " human", false], [56537, 0.033539, " learning", false], [30597, 0.031057, " deep", false], [63843, 0.021583, " researchers", false], [31578, 0.018969, " once", false]]], "qwen": [11811, 14, 0.014395827427506447, [[279, 0.297215, " the", false], [1052, 0.067666, " there", false], [419, 0.066505, " this", false], [432, 0.041822, " it", false], [304, 0.040851, " in", false], [3738, 0.033822, " human", false], [323, 0.022787, " and", false], [2711, 0.02126, " search", false], [264, 0.019594, " a", false], [6832, 0.018681, " learning", false]]]}, "raw_delta": -0.03308892250061035, "tuned_delta": -0.0245171304700321}, {"byte_start": 4104, "byte_end": 4111, "display": {"text": " always", "kind": "normal"}, "is_word": true, "word_id": 686, "word_key": " always", "bytes_hex": "20 61 6c 77 61 79 73", "compression": {"rwkv": "22.70% 22.70% 22.70% 22.70% 22.70% 22.70% 22.70%", "qwen": "22.92% 22.92% 22.92% 22.92% 22.92% 22.92% 22.92%"}, "model_tokens": {"rwkv": [[45150, " always", "normal", 0.00015241364599205554]], "qwen": [[2677, " always", "normal", 0.0001365811040159315]]}, "loss": {"rwkv": 22.703125085417838, "qwen": 22.924918825760535}, "topk": {"rwkv": [45150, 241, 0.00015241364599205554, [[40, 0.249077, "'", false], [22762, 0.242983, " who", false], [32462, 0.036638, " were", false], [4596, 0.031876, " in", false], [21286, 0.029154, " are", false], [32487, 0.028677, " with", false], [59868, 0.027397, " initially", false], [31059, 0.027013, " have", false], [4424, 0.015884, " at", false], [21795, 0.014565, " had", false]]], "qwen": [2677, 263, 0.0001365811040159315, [[6, 0.21676, "'", false], [879, 0.110363, " who", false], [15102, 0.091388, " initially", false], [304, 0.081451, " in", false], [1033, 0.065001, " were", false], [1030, 0.022644, " had", false], [614, 0.022178, " have", false], [525, 0.016846, " are", false], [9498, 0.013413, " learned", false], [6009, 0.011756, " began", false]]]}, "raw_delta": -0.012298856462751084, "tuned_delta": -0.003727064432172836}, {"byte_start": 4111, "byte_end": 4117, "display": {"text": " tried", "kind": "normal"}, "is_word": true, "word_id": 687, "word_key": " tried", "bytes_hex": "20 74 72 69 65 64", "compression": {"rwkv": "14.18% 14.18% 14.18% 14.18% 14.18% 14.18%", "qwen": "9.37% 9.37% 9.37% 9.37% 9.37% 9.37%"}, "model_tokens": {"rwkv": [[40013, " tried", "normal", 0.008999734185636044]], "qwen": [[6679, " tried", "normal", 0.04428163915872574]]}, "loss": {"rwkv": 14.182744217072491, "qwen": 9.369057308579267}, "topk": {"rwkv": [40013, 23, 0.008999734185636044, [[21795, 0.048539, " had", false], [31059, 0.048114, " have", false], [47763, 0.042829, " wanted", false], [32435, 0.038282, " want", false], [31967, 0.026346, " seem", false], [55800, 0.022902, " complain", false], [32216, 0.02241, " tend", false], [22441, 0.018634, " say", false], [47211, 0.017705, " seemed", false], [38709, 0.017428, " hoped", false]]], "qwen": [6679, 4, 0.04428163915872574, [[4829, 0.168017, " wanted", false], [1030, 0.070548, " had", false], [3381, 0.049538, " thought", false], [6679, 0.044282, " tried", false], [6966, 0.036923, " looked", false], [9324, 0.036395, " seemed", false], [11585, 0.032255, " believed", false], [2803, 0.022574, " seem", false], [14890, 0.019978, " preferred", false], [3855, 0.018211, " started", false]]]}, "raw_delta": 0.26692748069763184, "tuned_delta": 0.27549927272821007}, {"byte_start": 4117, "byte_end": 4120, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 688, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "1.51% 1.51% 1.51%", "qwen": "1.01% 1.01% 1.01%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.779309093952179]], "qwen": [[311, " to", "normal", 0.8456106185913086]]}, "loss": {"rwkv": 1.514548016558238, "qwen": 1.0080607221046183}, "topk": {"rwkv": [4811, 1, 0.779309093952179, [[4811, 0.779309, " to", false], [22590, 0.026492, " the", false], [52224, 0.024956, " methods", false], [38720, 0.019605, " human", false], [39931, 0.013916, " their", false], [22249, 0.010137, " out", false], [46162, 0.009724, " harder", false], [45, 0.008365, ",", false], [31048, 0.008113, " hard", false], [21700, 0.007562, " for", false]]], "qwen": [311, 1, 0.8456106185913086, [[311, 0.845611, " to", false], [1156, 0.02425, " first", false], [3738, 0.017506, " human", false], [369, 0.011429, " for", false], [5413, 0.009274, " methods", false], [2588, 0.007665, " hard", false], [279, 0.006218, " the", false], [862, 0.005177, " their", false], [11, 0.004996, ",", false], [15750, 0.004074, " harder", false]]]}, "raw_delta": 0.0280856192111969, "tuned_delta": 0.03665741124177515}, {"byte_start": 4120, "byte_end": 4125, "display": {"text": " make", "kind": "normal"}, "is_word": true, "word_id": 689, "word_key": " make", "bytes_hex": "20 6d 61 6b 65", "compression": {"rwkv": "13.19% 13.19% 13.19% 13.19% 13.19%", "qwen": "12.03% 12.03% 12.03% 12.03% 12.03%"}, "model_tokens": {"rwkv": [[31358, " make", "normal", 0.025832204148173332]], "qwen": [[1281, " make", "normal", 0.035619549453258514]]}, "loss": {"rwkv": 13.187134358125679, "qwen": 12.027967851657332}, "topk": {"rwkv": [31358, 8, 0.025832204148173332, [[30858, 0.068083, " find", false], [22681, 0.062439, " use", false], [37786, 0.034549, " avoid", false], [21751, 0.034263, " get", false], [56540, 0.032047, " leverage", false], [51982, 0.031184, " improve", false], [32187, 0.027907, " take", false], [31358, 0.025832, " make", false], [37730, 0.023612, " apply", false], [37911, 0.022465, " bring", false]]], "qwen": [1281, 5, 0.035619549453258514, [[5648, 0.15674, " avoid", false], [32064, 0.111753, " leverage", false], [990, 0.087157, " use", false], [1896, 0.074023, " take", false], [1281, 0.03562, " make", false], [653, 0.034822, " do", false], [1477, 0.031611, " find", false], [32194, 0.024721, " exploit", false], [3164, 0.023025, " win", false], [633, 0.018305, " get", false]]]}, "raw_delta": 0.06427783966064449, "tuned_delta": 0.07284963169122273}, {"byte_start": 4125, "byte_end": 4133, "display": {"text": " systems", "kind": "normal"}, "is_word": true, "word_id": 690, "word_key": " systems", "bytes_hex": "20 73 79 73 74 65 6d 73", "compression": {"rwkv": "11.98% 11.98% 11.98% 11.98% 11.98% 11.98% 11.98% 11.98%", "qwen": "12.37% 12.37% 12.37% 12.37% 12.37% 12.37% 12.37% 12.37%"}, "model_tokens": {"rwkv": [[53087, " systems", "normal", 0.00490612955763936]], "qwen": [[5942, " systems", "normal", 0.00414033979177475]]}, "loss": {"rwkv": 11.97549594487909, "qwen": 12.368805218920382}, "topk": {"rwkv": [53087, 21, 0.00490612955763936, [[39931, 0.314755, " their", false], [22590, 0.159961, " the", false], [22681, 0.074439, " use", false], [332, 0.057305, " a", false], [38720, 0.051242, " human", false], [32157, 0.031961, " sure", false], [39631, 0.0204, " sense", false], [52224, 0.020064, " methods", false], [4601, 0.019969, " it", false], [56950, 0.017963, " progress", false]]], "qwen": [5942, 23, 0.00414033979177475, [[279, 0.224454, " the", false], [862, 0.147851, " their", false], [990, 0.093358, " use", false], [8806, 0.070922, " speech", false], [264, 0.043604, " a", false], [5098, 0.03824, " progress", false], [2664, 0.030784, " better", false], [5413, 0.026733, " methods", false], [653, 0.021345, " do", false], [3738, 0.020873, " human", false]]]}, "raw_delta": -0.021809697151184082, "tuned_delta": -0.013237905120605834}, {"byte_start": 4133, "byte_end": 4138, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 691, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "1.82% 1.82% 1.82% 1.82% 1.82%", "qwen": "2.36% 2.36% 2.36% 2.36% 2.36%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.603221595287323]], "qwen": [[429, " that", "normal", 0.5194821357727051]]}, "loss": {"rwkv": 1.8174576198698855, "qwen": 2.3621350593066297}, "topk": {"rwkv": [32227, 1, 0.603221595287323, [[32227, 0.603222, " that", false], [37810, 0.081903, " based", false], [32499, 0.039989, " work", false], [32487, 0.030928, " with", false], [45301, 0.022007, " better", false], [31458, 0.019397, " more", false], [40085, 0.016495, " using", false], [21700, 0.014673, " for", false], [22681, 0.008881, " use", false], [4491, 0.008791, " do", false]]], "qwen": [429, 1, 0.5194821357727051, [[429, 0.519482, " that", false], [3118, 0.150236, " based", false], [2664, 0.058277, " better", false], [803, 0.051618, " more", false], [448, 0.026351, " with", false], [975, 0.020437, " work", false], [9902, 0.015163, " ``", false], [1667, 0.007924, " using", false], [438, 0.006488, " as", false], [369, 0.006078, " for", false]]]}, "raw_delta": -0.030203330516815185, "tuned_delta": -0.02163153848623694}, {"byte_start": 4138, "byte_end": 4145, "display": {"text": " worked", "kind": "normal"}, "is_word": true, "word_id": 692, "word_key": " worked", "bytes_hex": "20 77 6f 72 6b 65 64", "compression": {"rwkv": "6.96% 6.96% 6.96% 6.96% 6.96% 6.96% 6.96%", "qwen": "8.39% 8.39% 8.39% 8.39% 8.39% 8.39% 8.39%"}, "model_tokens": {"rwkv": [[47812, " worked", "normal", 0.06686489284038544]], "qwen": [[6439, " worked", "normal", 0.03847305104136467]]}, "loss": {"rwkv": 6.963901843576749, "qwen": 8.392871293065653}, "topk": {"rwkv": [47812, 5, 0.06686489284038544, [[32462, 0.11901, " were", false], [40219, 0.11162, " would", false], [32354, 0.090664, " used", false], [38128, 0.084713, " could", false], [47812, 0.066865, " worked", false], [21532, 0.063689, " did", false], [47054, 0.037808, " relied", false], [56540, 0.0283, " leverage", false], [32272, 0.025586, " took", false], [31351, 0.019677, " made", false]]], "qwen": [6439, 8, 0.03847305104136467, [[1033, 0.177715, " were", false], [1035, 0.086483, " would", false], [3867, 0.082084, " took", false], [1483, 0.047169, " used", false], [39913, 0.046838, " relied", false], [1410, 0.041457, " could", false], [27505, 0.03997, " lever", false], [6439, 0.038473, " worked", false], [1521, 0.032498, " did", false], [50663, 0.028108, " exploited", false]]]}, "raw_delta": -0.0792388916015625, "tuned_delta": -0.07066709957098426}, {"byte_start": 4145, "byte_end": 4149, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 693, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "21.70% 21.70% 21.70% 21.70%", "qwen": "25.85% 25.85% 25.85% 25.85%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.008162806741893291]], "qwen": [[279, " the", "normal", 0.0032348092645406723]]}, "loss": {"rwkv": 21.696780888369172, "qwen": 25.850323140441187}, "topk": {"rwkv": [22590, 15, 0.008162806741893291, [[32458, 0.341334, " well", false], [32487, 0.112616, " with", false], [4596, 0.100526, " in", false], [4712, 0.071727, " on", false], [4450, 0.061649, " by", false], [53356, 0.037994, " without", false], [21700, 0.037633, " for", false], [45301, 0.037044, " better", false], [4423, 0.019666, " as", false], [37810, 0.019405, " based", false]]], "qwen": [279, 28, 0.0032348092645406723, [[1632, 0.210527, " well", false], [553, 0.183147, " by", false], [2664, 0.122462, " better", false], [448, 0.090211, " with", false], [389, 0.036326, " on", false], [1850, 0.034978, " best", false], [2041, 0.032927, " without", false], [304, 0.030127, " in", false], [3118, 0.029257, " based", false], [1667, 0.022388, " using", false]]]}, "raw_delta": -0.23032128810882568, "tuned_delta": -0.22174949607824743}, {"byte_start": 4149, "byte_end": 4153, "display": {"text": " way", "kind": "normal"}, "is_word": true, "word_id": 694, "word_key": " way", "bytes_hex": "20 77 61 79", "compression": {"rwkv": "1.51% 1.51% 1.51% 1.51%", "qwen": "1.80% 1.80% 1.80% 1.80%"}, "model_tokens": {"rwkv": [[22752, " way", "normal", 0.7143092751502991]], "qwen": [[1616, " way", "normal", 0.6703117489814758]]}, "loss": {"rwkv": 1.514548016558238, "qwen": 1.8034244536221318}, "topk": {"rwkv": [22752, 1, 0.7143092751502991, [[22752, 0.714309, " way", false], [30273, 0.117729, " best", false], [31937, 0.062102, " same", false], [39523, 0.019476, " right", false], [38499, 0.01691, " first", false], [31461, 0.013271, " most", false], [38720, 0.011546, " human", false], [4404, 0.010584, " ``", false], [51718, 0.003699, " fastest", false], [51555, 0.003047, " easiest", false]]], "qwen": [1616, 1, 0.6703117489814758, [[1616, 0.670312, " way", false], [1850, 0.105118, " best", false], [1852, 0.093585, " same", false], [3738, 0.023929, " human", false], [2310, 0.02321, " old", false], [9902, 0.017485, " ``", false], [1156, 0.013976, " first", false], [2588, 0.005618, " hard", false], [8606, 0.004595, " traditional", false], [1008, 0.002564, " other", false]]]}, "raw_delta": -0.016018711030483246, "tuned_delta": -0.007446918999904998}, {"byte_start": 4153, "byte_end": 4157, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 695, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "15.92% 15.92% 15.92% 15.92%", "qwen": "16.31% 16.31% 16.31% 16.31%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.029294833540916443]], "qwen": [[279, " the", "normal", 0.026834776625037193]]}, "loss": {"rwkv": 15.920365197309849, "qwen": 16.311725692938552}, "topk": {"rwkv": [22590, 6, 0.029294833540916443, [[32232, 0.33019, " they", false], [46227, 0.2556, " humans", false], [46787, 0.156969, " people", false], [38720, 0.070664, " human", false], [32227, 0.062082, " that", false], [22590, 0.029295, " the", false], [51685, 0.019072, " experts", false], [332, 0.015409, " a", false], [39931, 0.011945, " their", false], [4601, 0.004655, " it", false]]], "qwen": [279, 6, 0.026834776625037193, [[1251, 0.338643, " people", false], [12677, 0.333696, " humans", false], [807, 0.124633, " they", false], [429, 0.074541, " that", false], [3738, 0.036561, " human", false], [279, 0.026835, " the", false], [264, 0.011034, " a", false], [862, 0.008604, " their", false], [582, 0.008014, " we", false], [1429, 0.00515, " most", false]]]}, "raw_delta": -0.0217016339302063, "tuned_delta": -0.01312984189962805}, {"byte_start": 4157, "byte_end": 4169, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 696, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"rwkv": "8.08% 8.08% 8.08% 8.08% 8.08% 8.08% 8.08% 8.08% 8.08% 8.08% 8.08% 8.08%", "qwen": "9.76% 9.76% 9.76% 9.76% 9.76% 9.76% 9.76% 9.76% 9.76% 9.76% 9.76% 9.76%"}, "model_tokens": {"rwkv": [[63843, " researchers", "normal", 0.0046857683919370174]], "qwen": [[11811, " researchers", "normal", 0.0015071507077664137]]}, "loss": {"rwkv": 8.077589421643935, "qwen": 9.764542163153973}, "topk": {"rwkv": [63843, 13, 0.0046857683919370174, [[38720, 0.550796, " human", false], [51685, 0.110782, " experts", false], [46227, 0.071634, " humans", false], [40213, 0.048832, " world", false], [45775, 0.014298, " domain", false], [53087, 0.011699, " systems", false], [30273, 0.009457, " best", false], [47487, 0.009286, " system", false], [45929, 0.009068, " expert", false], [4404, 0.007293, " ``", false]]], "qwen": [11811, 28, 0.0015071507077664137, [[3738, 0.503164, " human", false], [12677, 0.108089, " humans", false], [1879, 0.094028, " world", false], [11647, 0.063805, " experts", false], [1850, 0.047976, " best", false], [1251, 0.022485, " people", false], [6203, 0.01531, " expert", false], [5461, 0.011294, " average", false], [8686, 0.006228, " majority", false], [33738, 0.00596, " champions", false]]]}, "raw_delta": -0.09354452292124434, "tuned_delta": -0.08497273089066609}, {"byte_start": 4169, "byte_end": 4177, "display": {"text": " thought", "kind": "normal"}, "is_word": true, "word_id": 697, "word_key": " thought", "bytes_hex": "20 74 68 6f 75 67 68 74", "compression": {"rwkv": "3.01% 3.01% 3.01% 3.01% 3.01% 3.01% 3.01% 3.01%", "qwen": "3.65% 3.65% 3.65% 3.65% 3.65% 3.65% 3.65% 3.65%"}, "model_tokens": {"rwkv": [[53137, " thought", "normal", 0.2654259204864502]], "qwen": [[3381, " thought", "normal", 0.19764433801174164]]}, "loss": {"rwkv": 3.011485009668124, "qwen": 3.654721084280602}, "topk": {"rwkv": [53137, 1, 0.2654259204864502, [[53137, 0.265426, " thought", false], [47763, 0.245852, " wanted", false], [31220, 0.126704, " knew", false], [62684, 0.075654, " understood", false], [62643, 0.044594, " themselves", false], [55616, 0.044529, " believed", false], [21532, 0.021053, " did", false], [56175, 0.019688, " expected", false], [40219, 0.015921, " would", false], [40, 0.013553, "'", false]]], "qwen": [3381, 2, 0.19764433801174164, [[4829, 0.216252, " wanted", false], [3381, 0.197644, " thought", false], [5577, 0.095206, " themselves", false], [6876, 0.091078, " knew", false], [6342, 0.039408, " played", false], [3601, 0.039298, " expected", false], [1521, 0.038354, " did", false], [15985, 0.033178, " understood", false], [1035, 0.025781, " would", false], [11585, 0.016411, " believed", false]]]}, "raw_delta": -0.03566858172416687, "tuned_delta": -0.02709678969358862}, {"byte_start": 4177, "byte_end": 4183, "display": {"text": " their", "kind": "normal"}, "is_word": true, "word_id": 698, "word_key": " their", "bytes_hex": "20 74 68 65 69 72", "compression": {"rwkv": "14.28% 14.28% 14.28% 14.28% 14.28% 14.28%", "qwen": "15.82% 15.82% 15.82% 15.82% 15.82% 15.82%"}, "model_tokens": {"rwkv": [[39931, " their", "normal", 0.008585930801928043]], "qwen": [[862, " their", "normal", 0.005176984239369631]]}, "loss": {"rwkv": 14.276669675463697, "qwen": 15.82015090665209}, "topk": {"rwkv": [39931, 20, 0.008585930801928043, [[22590, 0.207213, " the", false], [46227, 0.132329, " humans", false], [32232, 0.094845, " they", false], [47350, 0.088168, " speech", false], [46787, 0.083652, " people", false], [38720, 0.068032, " human", false], [45, 0.036853, ",", false], [22748, 0.035229, " was", false], [30273, 0.020521, " best", false], [332, 0.019366, " a", false]]], "qwen": [862, 20, 0.005176984239369631, [[1251, 0.166699, " people", false], [807, 0.156441, " they", false], [279, 0.124674, " the", false], [12677, 0.096171, " humans", false], [572, 0.055338, " was", false], [11, 0.052921, ",", false], [1035, 0.051776, " would", false], [3738, 0.037222, " human", false], [429, 0.036515, " that", false], [264, 0.028396, " a", false]]]}, "raw_delta": -0.08558877309163415, "tuned_delta": -0.07701698106105591}, {"byte_start": 4183, "byte_end": 4187, "display": {"text": " own", "kind": "normal"}, "is_word": true, "word_id": 699, "word_key": " own", "bytes_hex": "20 6f 77 6e", "compression": {"rwkv": "19.16% 19.16% 19.16% 19.16%", "qwen": "9.08% 9.08% 9.08% 9.08%"}, "model_tokens": {"rwkv": [[22251, " own", "normal", 0.014240657910704613]], "qwen": [[1828, " own", "normal", 0.1334380805492401]]}, "loss": {"rwkv": 19.160793511806542, "qwen": 9.08049263485721}, "topk": {"rwkv": [22251, 7, 0.014240657910704613, [[53087, 0.29197, " systems", false], [38720, 0.176664, " human", false], [59943, 0.066479, " knowledge", false], [47487, 0.064513, " system", false], [45775, 0.061871, " domain", false], [52224, 0.049945, " methods", false], [22251, 0.014241, " own", false], [65034, 0.013689, " understanding", false], [47350, 0.011999, " speech", false], [38478, 0.010275, " field", false]]], "qwen": [1828, 3, 0.1334380805492401, [[3738, 0.201269, " human", false], [5942, 0.165008, " systems", false], [1828, 0.133438, " own", false], [61440, 0.070908, " predecessors", false], [7947, 0.044888, " domain", false], [1849, 0.024061, " system", false], [3281, 0.019679, " special", false], [5413, 0.016345, " methods", false], [6540, 0.016087, " knowledge", false], [34102, 0.012111, " brains", false]]]}, "raw_delta": 0.55897057056427, "tuned_delta": 0.5675423625948482}, {"byte_start": 4187, "byte_end": 4193, "display": {"text": " minds", "kind": "normal"}, "is_word": true, "word_id": 700, "word_key": " minds", "bytes_hex": "20 6d 69 6e 64 73", "compression": {"rwkv": "12.21% 12.21% 12.21% 12.21% 12.21% 12.21%", "qwen": "9.01% 9.01% 9.01% 9.01% 9.01% 9.01%"}, "model_tokens": {"rwkv": [[39026, " minds", "normal", 0.017391813918948174]], "qwen": [[20062, " minds", "normal", 0.0499066598713398]]}, "loss": {"rwkv": 12.210309590857111, "qwen": 9.009633632918597}, "topk": {"rwkv": [39026, 10, 0.017391813918948174, [[38720, 0.231769, " human", false], [59943, 0.149483, " knowledge", false], [53087, 0.099329, " systems", false], [52224, 0.066865, " methods", false], [47487, 0.040331, " system", false], [65034, 0.029332, " understanding", false], [47350, 0.025544, " speech", false], [59683, 0.022126, " expertise", false], [45775, 0.017956, " domain", false], [39026, 0.017392, " minds", false]]], "qwen": [20062, 5, 0.0499066598713398, [[3738, 0.156074, " human", false], [5942, 0.091684, " systems", false], [7947, 0.073352, " domain", false], [34102, 0.062548, " brains", false], [20062, 0.049907, " minds", false], [6540, 0.04608, " knowledge", false], [5413, 0.044033, " methods", false], [12677, 0.035771, " humans", false], [1616, 0.034793, " way", false], [3281, 0.025066, " special", false]]]}, "raw_delta": 0.1774831612904867, "tuned_delta": 0.18605495332106495}, {"byte_start": 4193, "byte_end": 4200, "display": {"text": " worked", "kind": "normal"}, "is_word": true, "word_id": 701, "word_key": " worked", "bytes_hex": "20 77 6f 72 6b 65 64", "compression": {"rwkv": "1.08% 1.08% 1.08% 1.08% 1.08% 1.08% 1.08%", "qwen": "0.70% 0.70% 0.70% 0.70% 0.70% 0.70% 0.70%"}, "model_tokens": {"rwkv": [[47812, " worked", "normal", 0.6561989784240723]], "qwen": [[6439, " worked", "normal", 0.7613739371299744]]}, "loss": {"rwkv": 1.081820011827313, "qwen": 0.7023623279756674}, "topk": {"rwkv": [47812, 1, 0.6561989784240723, [[47812, 0.656199, " worked", false], [21532, 0.13238, " did", false], [40219, 0.087434, " would", false], [47266, 0.035626, " should", false], [53137, 0.016959, " thought", false], [32499, 0.012029, " work", false], [32462, 0.009216, " were", false], [39021, 0.008043, " might", false], [56760, 0.005808, " operated", false], [39196, 0.0058, " ought", false]]], "qwen": [6439, 1, 0.7613739371299744, [[6439, 0.761374, " worked", false], [1035, 0.091885, " would", false], [1521, 0.045518, " did", false], [1265, 0.037856, " should", false], [975, 0.008386, " work", false], [1030, 0.007429, " had", false], [21776, 0.005342, " ought", false], [1969, 0.004679, " must", false], [323, 0.004666, " and", false], [1033, 0.004177, " were", false]]]}, "raw_delta": 0.02104160189628601, "tuned_delta": 0.02961339392686426}, {"byte_start": 4200, "byte_end": 4203, "display": {"text": "---", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d 2d 2d", "compression": {"rwkv": "16.62% 16.62% 16.62%", "qwen": "14.36% 14.36% 14.36%"}, "model_tokens": {"rwkv": [[5346, "---", "normal", 0.06219616159796715]], "qwen": [[4421, "---", "normal", 0.0916820615530014]]}, "loss": {"rwkv": 16.62480613524391, "qwen": 14.363403392671328}, "topk": {"rwkv": [5346, 3, 0.06219616159796715, [[45, 0.542713, ",", false], [47, 0.252916, ".", false], [5346, 0.062196, "---", false], [275, 0.027437, " (", false], [30273, 0.022266, " best", false], [60, 0.021071, ";", false], [21265, 0.017501, " and", false], [32465, 0.007372, " when", false], [4596, 0.006008, " in", false], [21400, 0.004508, " but", false]]], "qwen": [4421, 3, 0.0916820615530014, [[11, 0.463088, ",", false], [13, 0.217557, ".", false], [4421, 0.091682, "---", false], [320, 0.047334, " (", false], [323, 0.041853, " and", false], [382, 0.035104, ".\n\n", false], [26, 0.016768, ";", false], [304, 0.009855, " in", false], [979, 0.007711, " when", false], [714, 0.007509, " but", false]]]}, "raw_delta": 0.12539879480997718, "tuned_delta": 0.13397058684055543}, {"byte_start": 4203, "byte_end": 4207, "display": {"text": "they", "kind": "normal"}, "is_word": true, "word_id": 702, "word_key": "they", "bytes_hex": "74 68 65 79", "compression": {"rwkv": "17.54% 17.54% 17.54% 17.54%", "qwen": "16.97% 16.97% 16.97% 16.97%"}, "model_tokens": {"rwkv": [[27148, "they", "normal", 0.02055172808468342]], "qwen": [[20069, "they", "normal", 0.023210639134049416]]}, "loss": {"rwkv": 17.540579354558197, "qwen": 16.96584343233859}, "topk": {"rwkv": [27148, 14, 0.02055172808468342, [[27142, 0.101266, "that", false], [1950, 0.074633, "in", false], [7005, 0.057043, "and", false], [7195, 0.048548, "but", false], [1782, 0.043067, "by", false], [27493, 0.037862, "with", false], [8801, 0.034769, "the", false], [36003, 0.032613, "which", false], [98, 0.029583, "a", false], [49750, 0.025774, "systems", false]]], "qwen": [20069, 12, 0.023210639134049416, [[9033, 0.113276, "that", false], [29939, 0.078263, "based", false], [437, 0.058803, "and", false], [970, 0.053, "using", false], [4197, 0.042315, "with", false], [1782, 0.039568, "the", false], [1694, 0.037741, "by", false], [258, 0.035452, "in", false], [64, 0.030492, "a", false], [8088, 0.027657, "but", false]]]}, "raw_delta": 0.031870126724243164, "tuned_delta": 0.040441918754821414}, {"byte_start": 4207, "byte_end": 4213, "display": {"text": " tried", "kind": "normal"}, "is_word": true, "word_id": 703, "word_key": " tried", "bytes_hex": "20 74 72 69 65 64", "compression": {"rwkv": "7.00% 7.00% 7.00% 7.00% 7.00% 7.00%", "qwen": "7.13% 7.13% 7.13% 7.13% 7.13% 7.13%"}, "model_tokens": {"rwkv": [[40013, " tried", "normal", 0.09664983302354813]], "qwen": [[6679, " tried", "normal", 0.09341413527727127]]}, "loss": {"rwkv": 6.9974466501450365, "qwen": 7.125449037615954}, "topk": {"rwkv": [40013, 2, 0.09664983302354813, [[47763, 0.106261, " wanted", false], [40013, 0.09665, " tried", false], [32462, 0.093518, " were", false], [21532, 0.062411, " did", false], [53137, 0.056074, " thought", false], [32354, 0.048292, " used", false], [45150, 0.035507, " always", false], [21795, 0.03244, " had", false], [47812, 0.028795, " worked", false], [40219, 0.024284, " would", false]]], "qwen": [6679, 3, 0.09341413527727127, [[4829, 0.184392, " wanted", false], [1521, 0.118051, " did", false], [6679, 0.093414, " tried", false], [1033, 0.086483, " were", false], [3381, 0.045878, " thought", false], [1483, 0.0269, " used", false], [11585, 0.02205, " believed", false], [1030, 0.020286, " had", false], [2581, 0.018875, " never", false], [3867, 0.015135, " took", false]]]}, "raw_delta": -0.007097959518432617, "tuned_delta": 0.001473832512145631}, {"byte_start": 4213, "byte_end": 4216, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 704, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.76% 0.76% 0.76%", "qwen": "0.75% 0.75% 0.75%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.8819284439086914]], "qwen": [[311, " to", "normal", 0.8823504447937012]]}, "loss": {"rwkv": 0.757274008279119, "qwen": 0.7524013456532673}, "topk": {"rwkv": [4811, 1, 0.8819284439086914, [[4811, 0.881928, " to", false], [52224, 0.012025, " methods", false], [38499, 0.008718, " first", false], [38720, 0.007755, " human", false], [31048, 0.007378, " hard", false], [22249, 0.005742, " out", false], [21700, 0.005071, " for", false], [22590, 0.00433, " the", false], [45, 0.00394, ",", false], [22187, 0.002952, " not", false]]], "qwen": [311, 1, 0.8823504447937012, [[311, 0.88235, " to", false], [3738, 0.023664, " human", false], [5413, 0.015564, " methods", false], [3281, 0.005675, " special", false], [2588, 0.004839, " hard", false], [537, 0.004669, " not", false], [369, 0.004409, " for", false], [1667, 0.004191, " using", false], [279, 0.003089, " the", false], [11, 0.003054, ",", false]]]}, "raw_delta": 0.00027019778887430596, "tuned_delta": 0.008841989819452554}, {"byte_start": 4216, "byte_end": 4220, "display": {"text": " put", "kind": "normal"}, "is_word": true, "word_id": 705, "word_key": " put", "bytes_hex": "20 70 75 74", "compression": {"rwkv": "19.44% 19.44% 19.44% 19.44%", "qwen": "23.32% 23.32% 23.32% 23.32%"}, "model_tokens": {"rwkv": [[22339, " put", "normal", 0.013433695770800114]], "qwen": [[2182, " put", "normal", 0.005670353304594755]]}, "loss": {"rwkv": 19.44256988698017, "qwen": 23.31983060957362}, "topk": {"rwkv": [22339, 17, 0.013433695770800114, [[31358, 0.0724, " make", false], [22681, 0.068449, " use", false], [37923, 0.061063, " build", false], [39025, 0.049412, " mimic", false], [39043, 0.031307, " model", false], [4516, 0.025971, " em", false], [32187, 0.024617, " take", false], [45854, 0.019379, " encode", false], [4491, 0.017422, " do", false], [45616, 0.016928, " create", false]]], "qwen": [2182, 32, 0.005670353304594755, [[1281, 0.136003, " make", false], [990, 0.085992, " use", false], [32064, 0.0754, " leverage", false], [1896, 0.066793, " take", false], [1936, 0.041364, " build", false], [32194, 0.029387, " exploit", false], [5648, 0.025347, " avoid", false], [653, 0.020886, " do", false], [9902, 0.019416, " ``", false], [65485, 0.019378, " emulate", false]]]}, "raw_delta": -0.21500098705291748, "tuned_delta": -0.20642919502233922}, {"byte_start": 4220, "byte_end": 4225, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 706, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "26.49% 26.49% 26.49% 26.49% 26.49%", "qwen": "23.14% 23.14% 23.14% 23.14% 23.14%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.0006495369016192853]], "qwen": [[429, " that", "normal", 0.001635799533687532]]}, "loss": {"rwkv": 26.48697926632081, "qwen": 23.139471113743912}, "topk": {"rwkv": [32227, 82, 0.0006495369016192853, [[4596, 0.182866, " in", false], [39931, 0.178564, " their", false], [22590, 0.107867, " the", false], [38720, 0.078455, " human", false], [57435, 0.054727, " together", false], [21256, 0.029646, " all", false], [40210, 0.029152, " words", false], [332, 0.02602, " a", false], [59943, 0.022969, " knowledge", false], [4404, 0.021274, " ``", false]]], "qwen": [429, 38, 0.001635799533687532, [[862, 0.155009, " their", false], [304, 0.148532, " in", false], [3738, 0.101256, " human", false], [279, 0.100274, " the", false], [5577, 0.09738, " themselves", false], [264, 0.042682, " a", false], [3786, 0.026835, " together", false], [6540, 0.024458, " knowledge", false], [12677, 0.021355, " humans", false], [1119, 0.015779, " into", false]]]}, "raw_delta": 0.18562526702880855, "tuned_delta": 0.1941970590593868}, {"byte_start": 4225, "byte_end": 4235, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 707, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "2.59% 2.59% 2.59% 2.59% 2.59% 2.59% 2.59% 2.59% 2.59% 2.59%", "qwen": "3.29% 3.29% 3.29% 3.29% 3.29% 3.29% 3.29% 3.29% 3.29% 3.29%"}, "model_tokens": {"rwkv": [[59943, " knowledge", "normal", 0.23726817965507507]], "qwen": [[6540, " knowledge", "normal", 0.16167356073856354]]}, "loss": {"rwkv": 2.592342651597356, "qwen": 3.286055311770598}, "topk": {"rwkv": [59943, 1, 0.23726817965507507, [[59943, 0.237268, " knowledge", false], [38720, 0.216031, " human", false], [31162, 0.045316, " into", false], [52964, 0.030301, " special", false], [4596, 0.02453, " in", false], [65034, 0.023088, " understanding", false], [4404, 0.022945, " ``", false], [47487, 0.020702, " system", false], [38434, 0.015141, " extra", false], [31427, 0.014325, " mind", false]]], "qwen": [6540, 2, 0.16167356073856354, [[3738, 0.232212, " human", false], [6540, 0.161674, " knowledge", false], [1119, 0.066522, " into", false], [8660, 0.053874, " understanding", false], [304, 0.053395, " in", false], [3093, 0.047307, " kind", false], [3281, 0.028993, " special", false], [1616, 0.027035, " way", false], [3381, 0.025701, " thought", false], [9902, 0.025343, " ``", false]]]}, "raw_delta": -0.03846759796142579, "tuned_delta": -0.029895805930847542}, {"byte_start": 4235, "byte_end": 4238, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 708, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "9.16% 9.16% 9.16%", "qwen": "17.62% 17.62% 17.62%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.21844901144504547]], "qwen": [[304, " in", "normal", 0.053343866020441055]]}, "loss": {"rwkv": 9.157732193142833, "qwen": 17.618891654628577}, "topk": {"rwkv": [4596, 2, 0.21844901144504547, [[31162, 0.553753, " into", false], [4596, 0.218449, " in", false], [4706, 0.039429, " of", false], [4811, 0.038389, " to", false], [32232, 0.034851, " they", false], [56003, 0.015738, " directly", false], [45, 0.015472, ",", false], [32227, 0.009432, " that", false], [21265, 0.008139, " and", false], [46301, 0.007721, " inside", false]]], "qwen": [304, 3, 0.053343866020441055, [[1119, 0.64124, " into", false], [311, 0.188813, " to", false], [304, 0.053344, " in", false], [5961, 0.017141, " directly", false], [315, 0.013351, " of", false], [518, 0.012458, " at", false], [11, 0.010536, ",", false], [389, 0.009964, " on", false], [4766, 0.00838, " inside", false], [323, 0.008258, " and", false]]]}, "raw_delta": -0.46918630599975586, "tuned_delta": -0.46061451396917763}, {"byte_start": 4238, "byte_end": 4244, "display": {"text": " their", "kind": "normal"}, "is_word": true, "word_id": 709, "word_key": " their", "bytes_hex": "20 74 68 65 69 72", "compression": {"rwkv": "6.53% 6.53% 6.53% 6.53% 6.53% 6.53%", "qwen": "5.88% 5.88% 5.88% 5.88% 5.88% 5.88%"}, "model_tokens": {"rwkv": [[39931, " their", "normal", 0.11392802745103836]], "qwen": [[862, " their", "normal", 0.14135323464870453]]}, "loss": {"rwkv": 6.527819358188994, "qwen": 5.8804651948313245}, "topk": {"rwkv": [39931, 2, 0.11392802745103836, [[22590, 0.584285, " the", false], [39931, 0.113928, " their", false], [45, 0.050233, ",", false], [332, 0.041784, " a", false], [47, 0.038236, ".", false], [21265, 0.0143, " and", false], [4423, 0.013226, " as", false], [38559, 0.008859, " front", false], [39934, 0.008139, " there", false], [4811, 0.007723, " to", false]]], "qwen": [862, 2, 0.14135323464870453, [[279, 0.568154, " the", false], [862, 0.141353, " their", false], [264, 0.072226, " a", false], [311, 0.030093, " to", false], [5942, 0.012445, " systems", false], [12645, 0.011967, " machines", false], [1992, 0.011912, " place", false], [11, 0.011863, ",", false], [6366, 0.010402, " computer", false], [13, 0.008414, ".", false]]]}, "raw_delta": 0.03589693705240887, "tuned_delta": 0.04446872908298712}, {"byte_start": 4244, "byte_end": 4252, "display": {"text": " systems", "kind": "normal"}, "is_word": true, "word_id": 710, "word_key": " systems", "bytes_hex": "20 73 79 73 74 65 6d 73", "compression": {"rwkv": "1.90% 1.90% 1.90% 1.90% 1.90% 1.90% 1.90% 1.90%", "qwen": "1.52% 1.52% 1.52% 1.52% 1.52% 1.52% 1.52% 1.52%"}, "model_tokens": {"rwkv": [[53087, " systems", "normal", 0.4285065233707428]], "qwen": [[5942, " systems", "normal", 0.5105169415473938]]}, "loss": {"rwkv": 1.901990532421973, "qwen": 1.5155768221501569}, "topk": {"rwkv": [53087, 1, 0.4285065233707428, [[53087, 0.428507, " systems", false], [46587, 0.110786, " models", false], [52224, 0.098029, " methods", false], [47487, 0.076208, " system", false], [61559, 0.048317, " algorithms", false], [56949, 0.037343, " programs", false], [47350, 0.01668, " speech", false], [30469, 0.016335, " code", false], [56567, 0.016307, " machines", false], [22251, 0.015295, " own", false]]], "qwen": [5942, 1, 0.5105169415473938, [[5942, 0.510517, " systems", false], [7468, 0.084851, " programs", false], [12645, 0.07608, " machines", false], [4119, 0.03891, " models", false], [8806, 0.036206, " speech", false], [1849, 0.034784, " system", false], [18495, 0.024004, " computers", false], [5413, 0.020255, " methods", false], [25185, 0.019073, " algorithms", false], [6366, 0.018461, " computer", false]]]}, "raw_delta": 0.021427325904369354, "tuned_delta": 0.029999117934947604}, {"byte_start": 4252, "byte_end": 4255, "display": {"text": "---", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d 2d 2d", "compression": {"rwkv": "9.25% 9.25% 9.25%", "qwen": "8.18% 8.18% 8.18%"}, "model_tokens": {"rwkv": [[5346, "---", "normal", 0.2115027755498886]], "qwen": [[4421, "---", "normal", 0.2565803825855255]]}, "loss": {"rwkv": 9.251657651534043, "qwen": 8.177155194389064}, "topk": {"rwkv": [5346, 3, 0.2115027755498886, [[47, 0.358047, ".", false], [45, 0.223329, ",", false], [5346, 0.211503, "---", false], [21265, 0.050371, " and", false], [4596, 0.01938, " in", false], [4423, 0.014669, " as", false], [47001, 0.011381, " rather", false], [4450, 0.011237, " by", false], [4811, 0.009672, " to", false], [4788, 0.008337, " so", false]]], "qwen": [4421, 2, 0.2565803825855255, [[13, 0.326225, ".", false], [4421, 0.25658, "---", false], [11, 0.202918, ",", false], [323, 0.047183, " and", false], [382, 0.031108, ".\n\n", false], [4518, 0.01422, " instead", false], [311, 0.013798, " to", false], [304, 0.01277, " in", false], [320, 0.010513, " (", false], [773, 0.010385, " so", false]]]}, "raw_delta": 0.05958306789398199, "tuned_delta": 0.06815485992456023}, {"byte_start": 4255, "byte_end": 4258, "display": {"text": "but", "kind": "normal"}, "is_word": true, "word_id": 711, "word_key": "but", "bytes_hex": "62 75 74", "compression": {"rwkv": "2.45% 2.45% 2.45%", "qwen": "4.04% 4.04% 4.04%"}, "model_tokens": {"rwkv": [[7195, "but", "normal", 0.6669910550117493]], "qwen": [[8088, "but", "normal", 0.5108304619789124]]}, "loss": {"rwkv": 2.4538026004703233, "qwen": 4.037848089647843}, "topk": {"rwkv": [7195, 1, 0.6669910550117493, [[7195, 0.666991, "but", false], [7005, 0.214964, "and", false], [35898, 0.014185, "until", false], [36003, 0.008452, "which", false], [26476, 0.008341, "only", false], [2190, 0.008284, "so", false], [36004, 0.006571, "while", false], [42135, 0.00612, "rather", false], [36002, 0.006116, "where", false], [9122, 0.003406, "yet", false]]], "qwen": [8088, 1, 0.5108304619789124, [[8088, 0.51083, "but", false], [437, 0.291467, "and", false], [3243, 0.029564, "only", false], [38730, 0.02406, "until", false], [73203, 0.021517, "rather", false], [64837, 0.0121, "instead", false], [28996, 0.006618, "without", false], [14801, 0.006535, "before", false], [704, 0.006166, "so", false], [3472, 0.005263, "while", false]]]}, "raw_delta": -0.08783813317616779, "tuned_delta": -0.07926634114558954}, {"byte_start": 4258, "byte_end": 4261, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 712, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "17.19% 17.19% 17.19%", "qwen": "16.16% 16.16% 16.16%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.057567186653614044]], "qwen": [[432, " it", "normal", 0.06796281039714813]]}, "loss": {"rwkv": 17.188358885591164, "qwen": 16.162961058239414}, "topk": {"rwkv": [4601, 5, 0.057567186653614044, [[22590, 0.160855, " the", false], [32232, 0.108364, " they", false], [4596, 0.076378, " in", false], [32234, 0.060832, " this", false], [4601, 0.057567, " it", false], [32227, 0.045204, " that", false], [45, 0.039228, ",", false], [30597, 0.037068, " deep", false], [61959, 0.031903, " eventually", false], [4423, 0.023895, " as", false]]], "qwen": [432, 4, 0.06796281039714813, [[279, 0.138948, " the", false], [807, 0.087394, " they", false], [304, 0.079733, " in", false], [432, 0.067963, " it", false], [419, 0.061158, " this", false], [11, 0.044456, ",", false], [429, 0.039143, " that", false], [1172, 0.028256, " only", false], [979, 0.026061, " when", false], [438, 0.025101, " as", false]]]}, "raw_delta": 0.0568601290384928, "tuned_delta": 0.06543192106907104}, {"byte_start": 4261, "byte_end": 4268, "display": {"text": " proved", "kind": "normal"}, "is_word": true, "word_id": 713, "word_key": " proved", "bytes_hex": "20 70 72 6f 76 65 64", "compression": {"rwkv": "8.86% 8.86% 8.86% 8.86% 8.86% 8.86% 8.86%", "qwen": "8.43% 8.43% 8.43% 8.43% 8.43% 8.43% 8.43%"}, "model_tokens": {"rwkv": [[46936, " proved", "normal", 0.03177895024418831]], "qwen": [[18651, " proved", "normal", 0.037908583879470825]]}, "loss": {"rwkv": 8.855828934028233, "qwen": 8.430949480414185}, "topk": {"rwkv": [46936, 6, 0.03177895024418831, [[22748, 0.346219, " was", false], [47638, 0.1177, " turned", false], [4600, 0.101375, " is", false], [21532, 0.053398, " did", false], [40040, 0.052259, " turns", false], [46936, 0.031779, " proved", false], [39115, 0.024252, " never", false], [30633, 0.021177, " didn", false], [21800, 0.017562, " has", false], [45150, 0.014967, " always", false]]], "qwen": [18651, 5, 0.037908583879470825, [[572, 0.403749, " was", false], [6519, 0.079842, " turned", false], [1521, 0.075345, " did", false], [374, 0.066288, " is", false], [18651, 0.037909, " proved", false], [3867, 0.037231, " took", false], [2581, 0.036642, " never", false], [10577, 0.016711, " turns", false], [3207, 0.015634, " didn", false], [6116, 0.015539, " became", false]]]}, "raw_delta": 0.023560319628034287, "tuned_delta": 0.03213211165861254}, {"byte_start": 4268, "byte_end": 4279, "display": {"text": " ultimately", "kind": "normal"}, "is_word": true, "word_id": 714, "word_key": " ultimately", "bytes_hex": "20 75 6c 74 69 6d 61 74 65 6c 79", "compression": {"rwkv": "6.43% 6.43% 6.43% 6.43% 6.43% 6.43% 6.43% 6.43% 6.43% 6.43% 6.43%", "qwen": "7.08% 7.08% 7.08% 7.08% 7.08% 7.08% 7.08% 7.08% 7.08% 7.08% 7.08%"}, "model_tokens": {"rwkv": [[62676, " ultimately", "normal", 0.01972923055291176]], "qwen": [[13653, " ultimately", "normal", 0.013284618966281414]]}, "loss": {"rwkv": 6.429624560780002, "qwen": 7.08420381953233}, "topk": {"rwkv": [62676, 12, 0.01972923055291176, [[4811, 0.185411, " to", false], [62082, 0.059732, " impossible", false], [22187, 0.057852, " not", false], [332, 0.056209, " a", false], [21719, 0.05288, " fut", false], [31466, 0.049094, " much", false], [32227, 0.037396, " that", false], [62161, 0.035025, " irrelevant", false], [31458, 0.034246, " more", false], [31277, 0.02764, " less", false]]], "qwen": [13653, 17, 0.013284618966281414, [[311, 0.178685, " to", false], [11997, 0.07576, " impossible", false], [39715, 0.058243, " irrelevant", false], [537, 0.045833, " not", false], [264, 0.045779, " a", false], [54188, 0.043133, " ineffective", false], [429, 0.038112, " that", false], [84527, 0.025843, " futile", false], [1753, 0.025481, " much", false], [5000, 0.020392, " difficult", false]]]}, "raw_delta": -0.0362975814125755, "tuned_delta": -0.027725789381997247}, {"byte_start": 4279, "byte_end": 4287, "display": {"text": " counter", "kind": "normal"}, "is_word": true, "word_id": 715, "word_key": " counter", "bytes_hex": "20 63 6f 75 6e 74 65 72", "compression": {"rwkv": "10.64% 10.64% 10.64% 10.64% 10.64% 10.64% 10.64% 10.64%", "qwen": "8.72% 8.72% 8.72% 8.72% 8.72% 8.72% 8.72% 8.72%"}, "model_tokens": {"rwkv": [[51336, " counter", "normal", 0.008901496417820454]], "qwen": [[5546, " counter", "normal", 0.020920855924487114]]}, "loss": {"rwkv": 10.637058162804367, "qwen": 8.717053522596084}, "topk": {"rwkv": [51336, 17, 0.008901496417820454, [[4811, 0.184686, " to", false], [21719, 0.145053, " fut", false], [62161, 0.087515, " irrelevant", false], [22187, 0.083214, " not", false], [31458, 0.064921, " more", false], [62082, 0.037568, " impossible", false], [31277, 0.032762, " less", false], [332, 0.031811, " a", false], [31466, 0.028849, " much", false], [32227, 0.026914, " that", false]]], "qwen": [5546, 12, 0.020920855924487114, [[39715, 0.214401, " irrelevant", false], [311, 0.13551, " to", false], [11997, 0.082176, " impossible", false], [54188, 0.055731, " ineffective", false], [84527, 0.043993, " futile", false], [650, 0.040503, " un", false], [264, 0.037476, " a", false], [537, 0.035118, " not", false], [28848, 0.030893, " useless", false], [2686, 0.029788, " less", false]]]}, "raw_delta": 0.10646766424179077, "tuned_delta": 0.11503945627236901}, {"byte_start": 4287, "byte_end": 4297, "display": {"text": "productive", "kind": "normal"}, "is_word": true, "word_id": 716, "word_key": "productive", "bytes_hex": "70 72 6f 64 75 63 74 69 76 65", "compression": {"rwkv": "0.26% 0.26% 0.26% 0.26% 0.26% 0.26% 0.26% 0.26% 0.26% 0.26%", "qwen": "0.29% 0.29% 0.29% 0.29% 0.29% 0.29% 0.29% 0.29% 0.29% 0.29%"}, "model_tokens": {"rwkv": [[61076, "productive", "normal", 0.8636018633842468]], "qwen": [[33270, "productive", "normal", 0.8513615727424622]]}, "loss": {"rwkv": 0.26416535172527406, "qwen": 0.29019508716709524}, "topk": {"rwkv": [61076, 1, 0.8636018633842468, [[61076, 0.863602, "productive", false], [46, 0.113879, "-", false], [62383, 0.01852, " productive", false], [4811, 0.001983, " to", false], [49587, 0.000345, "product", false], [59918, 0.000264, " intuitive", false], [47687, 0.000215, " useful", false], [59593, 0.000179, " effective", false], [7865, 0.000142, "int", false], [52574, 9.4e-05, " product", false]]], "qwen": [33270, 1, 0.8513615727424622, [[33270, 0.851362, "productive", false], [28645, 0.090052, "-product", false], [26236, 0.045962, " productive", false], [311, 0.007526, " to", false], [69, 0.001049, "f", false], [3031, 0.000766, "product", false], [52321, 0.00068, "-effective", false], [396, 0.000502, "int", false], [20052, 0.000213, "-int", false], [1985, 0.000205, " product", false]]]}, "raw_delta": -0.001443395018577577, "tuned_delta": 0.007128397012000671}, {"byte_start": 4297, "byte_end": 4298, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "47.06%", "qwen": "32.14%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.07382529228925705]], "qwen": [[11, ",", "normal", 0.16827599704265594]]}, "loss": {"rwkv": 47.05665465399548, "qwen": 32.13873548268536}, "topk": {"rwkv": [45, 3, 0.07382529228925705, [[47, 0.73699, ".", false], [4811, 0.090839, " to", false], [45, 0.073825, ",", false], [21265, 0.025615, " and", false], [4596, 0.016618, " in", false], [21700, 0.009107, " for", false], [4423, 0.007689, " as", false], [51018, 0.00695, " because", false], [275, 0.004281, " (", false], [32465, 0.00344, " when", false]]], "qwen": [11, 3, 0.16827599704265594, [[13, 0.353762, ".", false], [382, 0.180349, ".\n\n", false], [11, 0.168276, ",", false], [311, 0.077022, " to", false], [304, 0.039872, " in", false], [323, 0.038458, " and", false], [1576, 0.023677, " because", false], [979, 0.021899, " when", false], [438, 0.017857, " as", false], [25, 0.017265, ":", false]]]}, "raw_delta": 0.8272250890731812, "tuned_delta": 0.8357968811037594}, {"byte_start": 4298, "byte_end": 4302, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 717, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "4.90% 4.90% 4.90% 4.90%", "qwen": "5.12% 5.12% 5.12% 5.12%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.3399445116519928]], "qwen": [[323, " and", "normal", 0.3214159905910492]]}, "loss": {"rwkv": 4.895864518641745, "qwen": 5.117144921482811}, "topk": {"rwkv": [21265, 1, 0.3399445116519928, [[21265, 0.339945, " and", false], [4423, 0.127708, " as", false], [51018, 0.062052, " because", false], [39690, 0.030129, " since", false], [4596, 0.028861, " in", false], [30788, 0.024208, " even", false], [61953, 0.019965, " especially", false], [4424, 0.019914, " at", false], [22187, 0.019226, " not", false], [31198, 0.017515, " just", false]]], "qwen": [323, 1, 0.3214159905910492, [[323, 0.321416, " and", false], [438, 0.148337, " as", false], [1576, 0.10391, " because", false], [304, 0.049118, " in", false], [2474, 0.042246, " since", false], [6388, 0.035436, " leading", false], [448, 0.014209, " with", false], [2176, 0.013179, " both", false], [5310, 0.012899, " especially", false], [537, 0.011847, " not", false]]]}, "raw_delta": -0.01227039098739624, "tuned_delta": -0.003698598956817992}, {"byte_start": 4302, "byte_end": 4304, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 718, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "33.39% 33.39%", "qwen": "41.39% 41.39%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.02479836903512478]], "qwen": [[264, " a", "normal", 0.010144878178834915]]}, "loss": {"rwkv": 33.39050045807464, "qwen": 41.39440534614516}, "topk": {"rwkv": [332, 6, 0.02479836903512478, [[22590, 0.140634, " the", false], [32232, 0.114203, " they", false], [4601, 0.03931, " it", false], [4596, 0.032636, " in", false], [22748, 0.026399, " was", false], [332, 0.024798, " a", false], [22190, 0.021132, " now", false], [61959, 0.020945, " eventually", false], [31581, 0.01996, " only", false], [39931, 0.018339, " their", false]]], "qwen": [264, 15, 0.010144878178834915, [[279, 0.161362, " the", false], [807, 0.086711, " they", false], [304, 0.066773, " in", false], [432, 0.041896, " it", false], [1172, 0.023338, " only", false], [862, 0.021538, " their", false], [5538, 0.020492, " deep", false], [6069, 0.020044, " led", false], [2711, 0.016448, " search", false], [572, 0.01333, " was", false]]]}, "raw_delta": -0.4438307285308838, "tuned_delta": -0.43525893650030556}, {"byte_start": 4304, "byte_end": 4313, "display": {"text": " colossal", "kind": "normal"}, "is_word": true, "word_id": 719, "word_key": " colossal", "bytes_hex": "20 63 6f 6c 6f 73 73 61 6c", "compression": {"rwkv": "39.73% 39.73% 39.73% 39.73% 0.02% 0.02% 0.02% 0.02% 0.91%", "qwen": "18.90% 18.90% 18.90% 18.90% 18.90% 18.90% 18.90% 18.90% 18.90%"}, "model_tokens": {"rwkv": [[21454, " col", "normal", 0.00015093869296833873], [26568, "ossa", "normal", 0.9960336089134216], [109, "l", "normal", 0.9505134224891663]], "qwen": [[96837, " colossal", "normal", 8.025064744288102e-05]]}, "loss": {"rwkv": 17.767198982681776, "qwen": 18.896010933456505}, "topk": {"rwkv": [21454, 589, 0.00015093869296833873, [[38961, 0.064862, " major", false], [40166, 0.037564, " waste", false], [45301, 0.031831, " better", false], [22168, 0.028106, " new", false], [31466, 0.024427, " much", false], [52245, 0.019058, " mistake", false], [30585, 0.018882, " dead", false], [47342, 0.018667, " source", false], [59513, 0.017021, " different", false], [31458, 0.016709, " more", false]]], "qwen": [96837, 808, 8.025064744288102e-05, [[3598, 0.053847, " major", false], [2711, 0.046389, " search", false], [501, 0.041305, " new", false], [803, 0.038808, " more", false], [1753, 0.032122, " much", false], [2155, 0.027745, " different", false], [17755, 0.02686, " lesson", false], [2244, 0.026337, " great", false], [4586, 0.024132, " general", false], [5538, 0.017797, " deep", false]]]}, "raw_delta": -0.06259462568494999, "tuned_delta": -0.05402283365437174}, {"byte_start": 4313, "byte_end": 4319, "display": {"text": " waste", "kind": "normal"}, "is_word": true, "word_id": 720, "word_key": " waste", "bytes_hex": "20 77 61 73 74 65", "compression": {"rwkv": "0.67% 0.67% 0.67% 0.67% 0.67% 0.67%", "qwen": "2.68% 2.68% 2.68% 2.68% 2.68% 2.68%"}, "model_tokens": {"rwkv": [[40166, " waste", "normal", 0.8000627756118774]], "qwen": [[12291, " waste", "normal", 0.4097566604614258]]}, "loss": {"rwkv": 0.6721540616120861, "qwen": 2.6815848432569753}, "topk": {"rwkv": [40166, 1, 0.8000627756118774, [[40166, 0.800063, " waste", false], [52245, 0.084998, " mistake", false], [38392, 0.012419, " error", false], [31333, 0.011166, " loss", false], [51708, 0.008317, " failure", false], [32251, 0.007249, " time", false], [45157, 0.00592, " amount", false], [45829, 0.003701, " effort", false], [63494, 0.002904, " distraction", false], [22097, 0.002578, " mis", false]]], "qwen": [12291, 1, 0.4097566604614258, [[12291, 0.409757, " waste", false], [16523, 0.093011, " mistake", false], [7901, 0.071587, " failure", false], [2393, 0.051838, " success", false], [54480, 0.019745, " computational", false], [4709, 0.019731, " loss", false], [1465, 0.015853, " error", false], [9162, 0.015468, " investment", false], [5041, 0.014599, " effort", false], [3311, 0.013996, " amount", false]]]}, "raw_delta": -0.11142650246620178, "tuned_delta": -0.10285471043562354}, {"byte_start": 4319, "byte_end": 4322, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 721, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.12% 0.12% 0.12%", "qwen": "0.21% 0.21% 0.21%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9799205660820007]], "qwen": [[315, " of", "normal", 0.9657832384109497]]}, "loss": {"rwkv": 0.1225433714947799, "qwen": 0.20928595655784377}, "topk": {"rwkv": [4706, 1, 0.9799205660820007, [[4706, 0.979921, " of", false], [47, 0.007993, ".", false], [45, 0.003699, ",", false], [4596, 0.002837, " in", false], [4811, 0.001225, " to", false], [21700, 0.000496, " for", false], [32465, 0.000248, " when", false], [4588, 0.000233, " if", false], [115, 0.000213, "r", false], [30322, 0.000212, " both", false]]], "qwen": [315, 1, 0.9657832384109497, [[315, 0.965783, " of", false], [13, 0.009533, ".", false], [382, 0.00845, ".\n\n", false], [11, 0.006116, ",", false], [304, 0.002787, " in", false], [311, 0.000845, " to", false], [979, 0.000714, " when", false], [369, 0.00057, " for", false], [421, 0.000532, " if", false], [429, 0.000438, " that", false]]]}, "raw_delta": -0.004810030261675517, "tuned_delta": 0.003761761768902731}, {"byte_start": 4322, "byte_end": 4333, "display": {"text": " researcher", "kind": "normal"}, "is_word": true, "word_id": 722, "word_key": " researcher", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72", "compression": {"rwkv": "11.17% 11.17% 11.17% 11.17% 11.17% 11.17% 11.17% 11.17% 11.17% 11.17% 11.17%", "qwen": "8.72% 8.72% 8.72% 8.72% 8.72% 8.72% 8.72% 8.72% 8.72% 8.72% 8.72%"}, "model_tokens": {"rwkv": [[62496, " researcher", "normal", 0.0010917175095528364]], "qwen": [[31085, " researcher", "normal", 0.004892498254776001]]}, "loss": {"rwkv": 11.168590870518251, "qwen": 8.721832783659178}, "topk": {"rwkv": [62496, 29, 0.0010917175095528364, [[32251, 0.440795, " time", false], [45829, 0.220168, " effort", false], [57103, 0.078411, " research", false], [60406, 0.075986, " resources", false], [38720, 0.043124, " human", false], [59346, 0.021317, " computing", false], [64862, 0.011585, " computational", false], [22590, 0.011012, " the", false], [63370, 0.008455, " computation", false], [39052, 0.008243, " money", false]]], "qwen": [31085, 16, 0.004892498254776001, [[882, 0.407485, " time", false], [5041, 0.179142, " effort", false], [3412, 0.074444, " research", false], [4963, 0.057635, " resources", false], [3738, 0.038905, " human", false], [54480, 0.034954, " computational", false], [24231, 0.02493, " computing", false], [34447, 0.024742, " computation", false], [279, 0.013204, " the", false], [862, 0.012156, " their", false]]]}, "raw_delta": 0.13567707755348898, "tuned_delta": 0.14424886958406724}, {"byte_start": 4333, "byte_end": 4335, "display": {"text": "'s", "kind": "normal"}, "is_word": true, "word_id": 723, "word_key": "'s", "bytes_hex": "27 73", "compression": {"rwkv": "24.09% 24.09%", "qwen": "24.62% 24.62%"}, "model_tokens": {"rwkv": [[460, "'s", "normal", 0.06930006295442581]], "qwen": [[594, "'s", "normal", 0.06518886238336563]]}, "loss": {"rwkv": 24.091880077344992, "qwen": 24.62019143274732}, "topk": {"rwkv": [460, 3, 0.06930006295442581, [[32251, 0.671968, " time", false], [45829, 0.15504, " effort", false], [460, 0.0693, "'s", false], [21265, 0.041618, " and", false], [45860, 0.011513, " energy", false], [46, 0.008188, "-", false], [60406, 0.005903, " resources", false], [51566, 0.003552, " efforts", false], [38853, 0.00325, " labor", false], [59193, 0.002949, " attention", false]]], "qwen": [594, 3, 0.06518886238336563, [[882, 0.681477, " time", false], [5041, 0.188081, " effort", false], [594, 0.065189, "'s", false], [4963, 0.014736, " resources", false], [4802, 0.01146, " energy", false], [323, 0.006305, " and", false], [8869, 0.004525, " efforts", false], [6529, 0.004199, " attention", false], [10772, 0.002837, " talent", false], [9327, 0.001501, " labor", false]]]}, "raw_delta": -0.029295802116394043, "tuned_delta": -0.020724010085815793}, {"byte_start": 4335, "byte_end": 4340, "display": {"text": " time", "kind": "normal"}, "is_word": true, "word_id": 724, "word_key": " time", "bytes_hex": "20 74 69 6d 65", "compression": {"rwkv": "0.51% 0.51% 0.51% 0.51% 0.51%", "qwen": "1.10% 1.10% 1.10% 1.10% 1.10%"}, "model_tokens": {"rwkv": [[32251, " time", "normal", 0.866916298866272]], "qwen": [[882, " time", "normal", 0.7375895977020264]]}, "loss": {"rwkv": 0.5142418846918668, "qwen": 1.0977745045247913}, "topk": {"rwkv": [32251, 1, 0.866916298866272, [[32251, 0.866916, " time", false], [45829, 0.042071, " effort", false], [21265, 0.021866, " and", false], [51566, 0.018416, " efforts", false], [45860, 0.005459, " energy", false], [56903, 0.003187, " precious", false], [38720, 0.002723, " human", false], [57516, 0.002453, " valuable", false], [59193, 0.002409, " attention", false], [60406, 0.001895, " resources", false]]], "qwen": [882, 1, 0.7375895977020264, [[882, 0.73759, " time", false], [5041, 0.128003, " effort", false], [8869, 0.025919, " efforts", false], [4802, 0.008823, " energy", false], [4963, 0.006566, " resources", false], [26400, 0.00652, " precious", false], [3738, 0.006044, " human", false], [6529, 0.005272, " attention", false], [323, 0.004589, " and", false], [15172, 0.004549, " valuable", false]]]}, "raw_delta": -0.03235791921615601, "tuned_delta": -0.02378612718557776}, {"byte_start": 4340, "byte_end": 4341, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "35.93%", "qwen": "40.43%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.13542591035366058]], "qwen": [[11, ",", "normal", 0.10624746233224869]]}, "loss": {"rwkv": 35.92648783463727, "qwen": 40.4312466069519}, "topk": {"rwkv": [45, 3, 0.13542591035366058, [[47, 0.598064, ".", false], [21265, 0.166502, " and", false], [45, 0.135426, ",", false], [4811, 0.028994, " to", false], [4596, 0.011701, " in", false], [275, 0.008524, " (", false], [32227, 0.005544, " that", false], [5346, 0.004165, "---", false], [4423, 0.003963, " as", false], [32465, 0.003101, " when", false]]], "qwen": [11, 4, 0.10624746233224869, [[323, 0.304828, " and", false], [13, 0.26084, ".", false], [382, 0.254418, ".\n\n", false], [11, 0.106247, ",", false], [304, 0.010195, " in", false], [311, 0.009514, " to", false], [320, 0.00708, " (", false], [624, 0.005238, ".\n", false], [4421, 0.004562, "---", false], [979, 0.004306, " when", false]]]}, "raw_delta": -0.24979686737060547, "tuned_delta": -0.2412250753400272}, {"byte_start": 4341, "byte_end": 4346, "display": {"text": " when", "kind": "normal"}, "is_word": true, "word_id": 725, "word_key": " when", "bytes_hex": "20 77 68 65 6e", "compression": {"rwkv": "13.30% 13.30% 13.30% 13.30% 13.30%", "qwen": "12.28% 12.28% 12.28% 12.28% 12.28%"}, "model_tokens": {"rwkv": [[32465, " when", "normal", 0.025247817859053612]], "qwen": [[979, " when", "normal", 0.03321311995387077]]}, "loss": {"rwkv": 13.299844908195132, "qwen": 12.280257801340529}, "topk": {"rwkv": [32465, 7, 0.025247817859053612, [[4811, 0.548573, " to", false], [51018, 0.050523, " because", false], [4423, 0.044626, " as", false], [4596, 0.030249, " in", false], [21700, 0.028655, " for", false], [21265, 0.027587, " and", false], [32465, 0.025248, " when", false], [22187, 0.023942, " not", false], [39690, 0.020568, " since", false], [45860, 0.019586, " energy", false]]], "qwen": [979, 9, 0.03321311995387077, [[5041, 0.246581, " effort", false], [4802, 0.103955, " energy", false], [1576, 0.079911, " because", false], [438, 0.069456, " as", false], [323, 0.051911, " and", false], [3220, 0.050327, " money", false], [304, 0.041387, " in", false], [311, 0.035333, " to", false], [979, 0.033213, " when", false], [4963, 0.023515, " resources", false]]]}, "raw_delta": 0.05653791427612309, "tuned_delta": 0.06510970630670133}, {"byte_start": 4346, "byte_end": 4347, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "98.06%", "qwen": "80.84%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.004391924012452364]], "qwen": [[11, ",", "normal", 0.01130516454577446]]}, "loss": {"rwkv": 98.05817856042172, "qwen": 80.8359218943455}, "topk": {"rwkv": [45, 32, 0.004391924012452364, [[22590, 0.253762, " the", false], [32232, 0.102642, " they", false], [4601, 0.098824, " it", false], [30597, 0.034525, " deep", false], [32227, 0.030201, " that", false], [4596, 0.026019, " in", false], [332, 0.025607, " a", false], [39931, 0.018047, " their", false], [45301, 0.017256, " better", false], [32464, 0.016987, " what", false]]], "qwen": [11, 14, 0.01130516454577446, [[279, 0.162434, " the", false], [7707, 0.108965, " compared", false], [432, 0.107384, " it", false], [807, 0.078017, " they", false], [2711, 0.070108, " search", false], [264, 0.035017, " a", false], [10951, 0.027206, " massive", false], [803, 0.022081, " more", false], [304, 0.018598, " in", false], [5538, 0.014809, " deep", false]]]}, "raw_delta": 0.9550046920776367, "tuned_delta": 0.963576484108215}, {"byte_start": 4347, "byte_end": 4355, "display": {"text": " through", "kind": "normal"}, "is_word": true, "word_id": 726, "word_key": " through", "bytes_hex": "20 74 68 72 6f 75 67 68", "compression": {"rwkv": "14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09%", "qwen": "15.75% 15.75% 15.75% 15.75% 15.75% 15.75% 15.75% 15.75%"}, "model_tokens": {"rwkv": [[53140, " through", "normal", 0.0019288297044113278]], "qwen": [[1526, " through", "normal", 0.0009252128074876964]]}, "loss": {"rwkv": 14.088818758681281, "qwen": 15.746761609962658}, "topk": {"rwkv": [53140, 38, 0.0019288297044113278, [[4596, 0.254129, " in", false], [52028, 0.21454, " instead", false], [4423, 0.069479, " as", false], [31578, 0.039127, " once", false], [4450, 0.033198, " by", false], [32487, 0.032611, " with", false], [61959, 0.02865, " eventually", false], [31601, 0.021773, " over", false], [37634, 0.021175, " after", false], [51744, 0.018751, " finally", false]]], "qwen": [1526, 62, 0.0009252128074876964, [[304, 0.329289, " in", false], [438, 0.123083, " as", false], [4518, 0.066681, " instead", false], [518, 0.054587, " at", false], [448, 0.034583, " with", false], [916, 0.0274, " over", false], [1283, 0.022602, " after", false], [553, 0.021075, " by", false], [389, 0.020413, " on", false], [3055, 0.018127, " once", false]]]}, "raw_delta": -0.09193587303161621, "tuned_delta": -0.08336408100103797}, {"byte_start": 4355, "byte_end": 4361, "display": {"text": " Moore", "kind": "normal"}, "is_word": true, "word_id": 727, "word_key": " moore", "bytes_hex": "20 4d 6f 6f 72 65", "compression": {"rwkv": "14.75% 14.75% 14.75% 14.75% 14.75% 14.75%", "qwen": "16.54% 16.54% 16.54% 16.54% 16.54% 16.54%"}, "model_tokens": {"rwkv": [[37045, " Moore", "normal", 0.007424832321703434]], "qwen": [[20219, " Moore", "normal", 0.0040683140978217125]]}, "loss": {"rwkv": 14.746296967419742, "qwen": 16.54448593772471}, "topk": {"rwkv": [37045, 19, 0.007424832321703434, [[52195, 0.171718, " massive", false], [22590, 0.171164, " the", false], [56537, 0.057447, " learning", false], [63370, 0.047718, " computation", false], [30597, 0.036371, " deep", false], [39660, 0.023785, " sheer", false], [63885, 0.02346, " statistical", false], [332, 0.020174, " a", false], [47202, 0.019178, " search", false], [57103, 0.017832, " research", false]]], "qwen": [20219, 27, 0.0040683140978217125, [[279, 0.237795, " the", false], [10951, 0.09182, " massive", false], [6832, 0.059796, " learning", false], [32538, 0.048165, " sheer", false], [2711, 0.044429, " search", false], [34447, 0.035206, " computation", false], [5538, 0.024726, " deep", false], [264, 0.02464, " a", false], [1753, 0.015854, " much", false], [990, 0.013902, " use", false]]]}, "raw_delta": -0.09971276919047034, "tuned_delta": -0.0911409771598921}, {"byte_start": 4361, "byte_end": 4363, "display": {"text": "'s", "kind": "normal"}, "is_word": true, "word_id": 728, "word_key": "'s", "bytes_hex": "27 73", "compression": {"rwkv": "0.04% 0.04%", "qwen": "0.03% 0.03%"}, "model_tokens": {"rwkv": [[460, "'s", "normal", 0.9960860013961792]], "qwen": [[594, "'s", "normal", 0.9965344667434692]]}, "loss": {"rwkv": 0.0354972191380837, "qwen": 0.03130233932751536}, "topk": {"rwkv": [460, 1, 0.9960860013961792, [[460, 0.996086, "'s", false], [116, 0.001754, "s", false], [28309, 0.000765, "’s", false], [40, 0.000344, "'", false], [21265, 0.00018, " and", false], [45, 0.000148, ",", false], [46, 0.000134, "-", false], [439, 4.1e-05, "''", false], [4522, 3.6e-05, " et", false], [97, 2.3e-05, "`", false]]], "qwen": [594, 1, 0.9965344667434692, [[594, 0.996534, "'s", false], [748, 0.000975, "’s", false], [11, 0.000548, ",", false], [2329, 0.000432, " law", false], [6, 0.000262, "'", false], [12681, 0.000169, "-like", false], [323, 0.000102, " and", false], [4605, 9.1e-05, "''", false], [11297, 6.5e-05, "-style", false], [364, 4.8e-05, " '", false]]]}, "raw_delta": 0.0002326135290786624, "tuned_delta": 0.00880440555965691}, {"byte_start": 4363, "byte_end": 4367, "display": {"text": " law", "kind": "normal"}, "is_word": true, "word_id": 729, "word_key": " law", "bytes_hex": "20 6c 61 77", "compression": {"rwkv": "0.43% 0.43% 0.43% 0.43%", "qwen": "0.30% 0.30% 0.30% 0.30%"}, "model_tokens": {"rwkv": [[21988, " law", "normal", 0.909474790096283]], "qwen": [[2329, " law", "normal", 0.9363114237785339]]}, "loss": {"rwkv": 0.4292686965535703, "qwen": 0.29668629688294773}, "topk": {"rwkv": [21988, 1, 0.909474790096283, [[21988, 0.909475, " law", false], [20267, 0.088024, " Law", false], [31259, 0.000338, " laws", false], [21265, 0.000272, " and", false], [45828, 0.000207, " effect", false], [45, 0.00013, ",", false], [53127, 8.8e-05, " theorem", false], [4715, 7.9e-05, " or", false], [275, 6.8e-05, " (", false], [46, 6.6e-05, "-", false]]], "qwen": [2329, 1, 0.9363114237785339, [[2329, 0.936311, " law", false], [7506, 0.050916, " Law", false], [6872, 0.003729, " laws", false], [220, 0.000412, " ", false], [5912, 0.000322, " rule", false], [323, 0.000269, " and", false], [5098, 0.000241, " progress", false], [320, 0.000219, " (", false], [30312, 0.000192, "-law", false], [10963, 0.000187, " magic", false]]]}, "raw_delta": 0.007351929321885109, "tuned_delta": 0.01592372135246336}, {"byte_start": 4367, "byte_end": 4368, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "2.36%", "qwen": "2.48%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8766926527023315]], "qwen": [[11, ",", "normal", 0.8713169097900391]]}, "loss": {"rwkv": 2.3598771420791147, "qwen": 2.4841316513756824}, "topk": {"rwkv": [45, 1, 0.8766926527023315, [[45, 0.876693, ",", false], [21265, 0.085212, " and", false], [4706, 0.01144, " of", false], [4715, 0.008383, " or", false], [275, 0.003987, " (", false], [46, 0.003422, "-", false], [460, 0.000729, "'s", false], [4596, 0.000654, " in", false], [45796, 0.000635, " driven", false], [22590, 0.000513, " the", false]]], "qwen": [11, 1, 0.8713169097900391, [[11, 0.871317, ",", false], [323, 0.097784, " and", false], [320, 0.006191, " (", false], [476, 0.002729, " or", false], [31405, 0.002712, "-driven", false], [315, 0.001506, " of", false], [594, 0.001459, "'s", false], [304, 0.001161, " in", false], [10856, 0.00105, " combined", false], [12681, 0.001013, "-like", false]]]}, "raw_delta": -0.006890133023262024, "tuned_delta": 0.0016816590073162243}, {"byte_start": 4368, "byte_end": 4376, "display": {"text": " massive", "kind": "normal"}, "is_word": true, "word_id": 730, "word_key": " massive", "bytes_hex": "20 6d 61 73 73 69 76 65", "compression": {"rwkv": "7.40% 7.40% 7.40% 7.40% 7.40% 7.40% 7.40% 7.40%", "qwen": "6.46% 6.46% 6.46% 6.46% 6.46% 6.46% 6.46% 6.46%"}, "model_tokens": {"rwkv": [[52195, " massive", "normal", 0.03779609128832817]], "qwen": [[10951, " massive", "normal", 0.057061079889535904]]}, "loss": {"rwkv": 7.396629848307673, "qwen": 6.455233363797967}, "topk": {"rwkv": [52195, 6, 0.03779609128832817, [[22590, 0.273887, " the", false], [63370, 0.084655, " computation", false], [32232, 0.075957, " they", false], [4601, 0.043927, " it", false], [31458, 0.041796, " more", false], [52195, 0.037796, " massive", false], [30597, 0.027417, " deep", false], [332, 0.026901, " a", false], [45301, 0.026221, " better", false], [32227, 0.021507, " that", false]]], "qwen": [10951, 5, 0.057061079889535904, [[279, 0.17426, " the", false], [807, 0.081228, " they", false], [803, 0.074922, " more", false], [34447, 0.072744, " computation", false], [10951, 0.057061, " massive", false], [1753, 0.047729, " much", false], [432, 0.04672, " it", false], [264, 0.032111, " a", false], [862, 0.018677, " their", false], [1052, 0.016162, " there", false]]]}, "raw_delta": 0.05220210552215576, "tuned_delta": 0.06077389755273401}, {"byte_start": 4376, "byte_end": 4388, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 731, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "2.32% 2.32% 2.32% 2.32% 2.32% 2.32% 2.32% 2.32% 2.32% 2.32% 2.32% 2.32%", "qwen": "1.84% 1.84% 1.84% 1.84% 1.84% 1.84% 1.84% 1.84% 1.84% 1.84% 1.84% 1.84%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.21400213241577148]], "qwen": [[34447, " computation", "normal", 0.2932566702365875]]}, "loss": {"rwkv": 2.3246550951824116, "qwen": 1.8435042490241822}, "topk": {"rwkv": [63370, 2, 0.21400213241577148, [[50897, 0.395801, " amounts", false], [63370, 0.214002, " computation", false], [64423, 0.042162, " improvements", false], [22168, 0.035789, " new", false], [45, 0.028302, ",", false], [64862, 0.026595, " computational", false], [59847, 0.017846, " increases", false], [31458, 0.017664, " more", false], [51832, 0.014237, " general", false], [63621, 0.013986, " improvement", false]]], "qwen": [34447, 2, 0.2932566702365875, [[14713, 0.427977, " amounts", false], [34447, 0.293257, " computation", false], [54480, 0.049017, " computational", false], [24231, 0.022304, " computing", false], [11, 0.02115, ",", false], [5107, 0.014191, " additional", false], [32676, 0.012414, " quantities", false], [12703, 0.01168, " increases", false], [803, 0.011543, " more", false], [501, 0.009909, " new", false]]]}, "raw_delta": 0.02668066819508869, "tuned_delta": 0.035252460225666936}, {"byte_start": 4388, "byte_end": 4395, "display": {"text": " became", "kind": "normal"}, "is_word": true, "word_id": 732, "word_key": " became", "bytes_hex": "20 62 65 63 61 6d 65", "compression": {"rwkv": "2.62% 2.62% 2.62% 2.62% 2.62% 2.62% 2.62%", "qwen": "2.41% 2.41% 2.41% 2.41% 2.41% 2.41% 2.41%"}, "model_tokens": {"rwkv": [[45283, " became", "normal", 0.3594065308570862]], "qwen": [[6116, " became", "normal", 0.39302074909210205]]}, "loss": {"rwkv": 2.616494912326524, "qwen": 2.405933328200484}, "topk": {"rwkv": [45283, 1, 0.3594065308570862, [[45283, 0.359407, " became", false], [22748, 0.1922, " was", false], [30383, 0.059947, " came", false], [21265, 0.051972, " and", false], [38128, 0.042128, " could", false], [51744, 0.039702, " finally", false], [31351, 0.015692, " made", false], [61959, 0.013754, " eventually", false], [45, 0.011628, ",", false], [57094, 0.009835, " replaced", false]]], "qwen": [6116, 1, 0.39302074909210205, [[6116, 0.393021, " became", false], [572, 0.194667, " was", false], [1410, 0.040672, " could", false], [3697, 0.03836, " came", false], [9583, 0.036963, " eventually", false], [323, 0.022499, " and", false], [9044, 0.021965, " becomes", false], [374, 0.019237, " is", false], [1035, 0.015391, " would", false], [5499, 0.014598, " finally", false]]]}, "raw_delta": 0.011676013469696045, "tuned_delta": 0.020247805500274295}, {"byte_start": 4395, "byte_end": 4405, "display": {"text": " available", "kind": "normal"}, "is_word": true, "word_id": 733, "word_key": " available", "bytes_hex": "20 61 76 61 69 6c 61 62 6c 65", "compression": {"rwkv": "0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85%", "qwen": "0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83%"}, "model_tokens": {"rwkv": [[59206, " available", "normal", 0.6220821738243103]], "qwen": [[2500, " available", "normal", 0.6327334046363831]]}, "loss": {"rwkv": 0.8523735349002174, "qwen": 0.8254128896160231}, "topk": {"rwkv": [59206, 1, 0.6220821738243103, [[59206, 0.622082, " available", false], [22590, 0.114845, " the", false], [31458, 0.033297, " more", false], [332, 0.028031, " a", false], [56895, 0.012456, " possible", false], [52648, 0.011136, " readily", false], [64430, 0.011072, " increasingly", false], [4788, 0.010731, " so", false], [31466, 0.010326, " much", false], [51178, 0.008644, " cheaper", false]]], "qwen": [2500, 1, 0.6327334046363831, [[2500, 0.632733, " available", false], [30268, 0.039508, " readily", false], [279, 0.037552, " the", false], [803, 0.032959, " more", false], [3204, 0.02564, " possible", false], [1753, 0.019598, " much", false], [773, 0.017614, " so", false], [13570, 0.013775, " widely", false], [14756, 0.01292, " increasingly", false], [264, 0.01292, " a", false]]]}, "raw_delta": 0.0014950156211853, "tuned_delta": 0.010066807651763548}, {"byte_start": 4405, "byte_end": 4409, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 734, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "12.54% 12.54% 12.54% 12.54%", "qwen": "11.87% 11.87% 11.87% 11.87%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.06176622211933136]], "qwen": [[323, " and", "normal", 0.07190161198377609]]}, "loss": {"rwkv": 12.539048695226342, "qwen": 11.868226065969685}, "topk": {"rwkv": [21265, 4, 0.06176622211933136, [[47, 0.325989, ".", false], [4811, 0.230561, " to", false], [4424, 0.07997, " at", false], [21265, 0.061766, " and", false], [45, 0.052388, ",", false], [52028, 0.050491, " instead", false], [21700, 0.037084, " for", false], [4596, 0.036406, " in", false], [32227, 0.033453, " that", false], [4423, 0.009834, " as", false]]], "qwen": [323, 5, 0.07190161198377609, [[382, 0.23149, ".\n\n", false], [13, 0.215409, ".", false], [311, 0.10388, " to", false], [429, 0.0986, " that", false], [323, 0.071902, " and", false], [11, 0.058201, ",", false], [304, 0.038352, " in", false], [518, 0.032441, " at", false], [369, 0.027997, " for", false], [4518, 0.015276, " instead", false]]]}, "raw_delta": 0.03719830513000488, "tuned_delta": 0.04577009716058313}, {"byte_start": 4409, "byte_end": 4411, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 735, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "43.96% 43.96%", "qwen": "37.09% 37.09%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.007724887225776911]], "qwen": [[264, " a", "normal", 0.01634964533150196]]}, "loss": {"rwkv": 43.9571145270856, "qwen": 37.0912317384731}, "topk": {"rwkv": [332, 22, 0.007724887225776911, [[22590, 0.157717, " the", false], [22748, 0.066187, " was", false], [38128, 0.065747, " could", false], [4601, 0.041408, " it", false], [31351, 0.039964, " made", false], [51596, 0.028288, " enabled", false], [50887, 0.026077, " allowed", false], [45, 0.015678, ",", false], [46936, 0.01519, " proved", false], [63843, 0.014301, " researchers", false]]], "qwen": [264, 10, 0.01634964533150196, [[279, 0.120917, " the", false], [1410, 0.117716, " could", false], [572, 0.067555, " was", false], [432, 0.034898, " it", false], [4362, 0.022412, " needed", false], [2711, 0.020414, " search", false], [429, 0.019385, " that", false], [803, 0.017654, " more", false], [5538, 0.017278, " deep", false], [264, 0.01635, " a", false]]]}, "raw_delta": 0.3807253837585449, "tuned_delta": 0.38929717578912315}, {"byte_start": 4411, "byte_end": 4417, "display": {"text": " means", "kind": "normal"}, "is_word": true, "word_id": 736, "word_key": " means", "bytes_hex": "20 6d 65 61 6e 73", "compression": {"rwkv": "28.55% 28.55% 28.55% 28.55% 28.55% 28.55%", "qwen": "27.04% 27.04% 27.04% 27.04% 27.04% 27.04%"}, "model_tokens": {"rwkv": [[38989, " means", "normal", 7.455547893187031e-05]], "qwen": [[3363, " means", "normal", 0.0001237821561517194]]}, "loss": {"rwkv": 28.553339350927395, "qwen": 27.041477130100134}, "topk": {"rwkv": [38989, 463, 7.455547893187031e-05, [[59513, 0.145706, " different", false], [45301, 0.142446, " better", false], [22168, 0.091024, " new", false], [31466, 0.065912, " much", false], [31458, 0.064476, " more", false], [63885, 0.048841, " statistical", false], [52907, 0.025329, " simpler", false], [47202, 0.017838, " search", false], [60315, 0.016518, " radically", false], [51832, 0.016076, " general", false]]], "qwen": [3363, 346, 0.0001237821561517194, [[2711, 0.096738, " search", false], [2155, 0.089491, " different", false], [501, 0.086501, " new", false], [1753, 0.050604, " much", false], [2664, 0.050082, " better", false], [803, 0.047499, " more", false], [4285, 0.04206, " simple", false], [4586, 0.039017, " general", false], [28464, 0.035356, " statistical", false], [1714, 0.027322, " method", false]]]}, "raw_delta": 0.08383544286092115, "tuned_delta": 0.09240723489149939}, {"byte_start": 4417, "byte_end": 4421, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 737, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "10.57% 10.57% 10.57% 10.57%", "qwen": "10.58% 10.58% 10.58% 10.58%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.0957559198141098]], "qwen": [[572, " was", "normal", 0.09576229751110077]]}, "loss": {"rwkv": 10.566614069010962, "qwen": 10.576245097459278}, "topk": {"rwkv": [22748, 3, 0.0957559198141098, [[4706, 0.502468, " of", false], [4811, 0.246519, " to", false], [22748, 0.095756, " was", false], [21700, 0.074487, " for", false], [4450, 0.01781, " by", false], [38128, 0.014682, " could", false], [32227, 0.005941, " that", false], [51680, 0.005413, " existed", false], [21795, 0.003417, " had", false], [38547, 0.003039, " found", false]]], "qwen": [572, 4, 0.09576229751110077, [[315, 0.379491, " of", false], [311, 0.286611, " to", false], [369, 0.135096, " for", false], [572, 0.095762, " was", false], [1410, 0.023275, " could", false], [429, 0.01598, " that", false], [1030, 0.009299, " had", false], [553, 0.00645, " by", false], [803, 0.003219, " more", false], [2664, 0.002605, " better", false]]]}, "raw_delta": -0.0005340576171875, "tuned_delta": 0.008037734413390748}, {"byte_start": 4421, "byte_end": 4427, "display": {"text": " found", "kind": "normal"}, "is_word": true, "word_id": 738, "word_key": " found", "bytes_hex": "20 66 6f 75 6e 64", "compression": {"rwkv": "0.53% 0.53% 0.53% 0.53% 0.53% 0.53%", "qwen": "1.24% 1.24% 1.24% 1.24% 1.24% 1.24%"}, "model_tokens": {"rwkv": [[38547, " found", "normal", 0.8374359011650085]], "qwen": [[1730, " found", "normal", 0.6622791886329651]]}, "loss": {"rwkv": 0.5253955328758227, "qwen": 1.2385177429836738}, "topk": {"rwkv": [38547, 1, 0.8374359011650085, [[38547, 0.837436, " found", false], [61885, 0.047187, " discovered", false], [51744, 0.019061, " finally", false], [56976, 0.016228, " provided", false], [59506, 0.01444, " developed", false], [51458, 0.007916, " devised", false], [47340, 0.005037, " sought", false], [56492, 0.004759, " invented", false], [46650, 0.004718, " needed", false], [59206, 0.004589, " available", false]]], "qwen": [1730, 1, 0.6622791886329651, [[1730, 0.662279, " found", false], [11105, 0.070285, " discovered", false], [3897, 0.054142, " provided", false], [4362, 0.043026, " needed", false], [5499, 0.015155, " finally", false], [3465, 0.011804, " created", false], [2500, 0.00995, " available", false], [518, 0.009313, " at", false], [9555, 0.008666, " established", false], [7881, 0.008553, " developed", false]]]}, "raw_delta": -0.03954389194647472, "tuned_delta": -0.030972099915896473}, {"byte_start": 4427, "byte_end": 4430, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 739, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "1.31% 1.31% 1.31%", "qwen": "0.98% 0.98% 0.98%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.8043674230575562]], "qwen": [[311, " to", "normal", 0.8500741124153137]]}, "loss": {"rwkv": 1.3149564174769197, "qwen": 0.976414391582807}, "topk": {"rwkv": [4811, 1, 0.8043674230575562, [[4811, 0.804367, " to", false], [4706, 0.097612, " of", false], [21700, 0.04111, " for", false], [275, 0.012771, " (", false], [32227, 0.011524, " that", false], [45, 0.011088, ",", false], [4450, 0.006413, " by", false], [5346, 0.002836, "---", false], [22187, 0.001534, " not", false], [4596, 0.001271, " in", false]]], "qwen": [311, 1, 0.8500741124153137, [[311, 0.850074, " to", false], [369, 0.070927, " for", false], [315, 0.019311, " of", false], [429, 0.013787, " that", false], [11, 0.006648, ",", false], [553, 0.005246, " by", false], [304, 0.004791, " in", false], [320, 0.002589, " (", false], [537, 0.002422, " not", false], [1526, 0.002282, " through", false]]]}, "raw_delta": 0.0187727560599645, "tuned_delta": 0.02734454809054275}, {"byte_start": 4430, "byte_end": 4434, "display": {"text": " put", "kind": "normal"}, "is_word": true, "word_id": 740, "word_key": " put", "bytes_hex": "20 70 75 74", "compression": {"rwkv": "13.24% 13.24% 13.24% 13.24%", "qwen": "10.10% 10.10% 10.10% 10.10%"}, "model_tokens": {"rwkv": [[22339, " put", "normal", 0.05298086255788803]], "qwen": [[2182, " put", "normal", 0.10636377334594727]]}, "loss": {"rwkv": 13.243489633160404, "qwen": 10.102878974332917}, "topk": {"rwkv": [22339, 6, 0.05298086255788803, [[22681, 0.133746, " use", false], [31358, 0.094149, " make", false], [56540, 0.090845, " leverage", false], [32187, 0.08296, " take", false], [53251, 0.056313, " utilize", false], [22339, 0.052981, " put", false], [37730, 0.036128, " apply", false], [37911, 0.036024, " bring", false], [51690, 0.031508, " exploit", false], [21751, 0.020391, " get", false]]], "qwen": [2182, 1, 0.10636377334594727, [[2182, 0.106364, " put", false], [32064, 0.095979, " leverage", false], [1896, 0.090858, " take", false], [1281, 0.090596, " make", false], [990, 0.085173, " use", false], [32408, 0.044063, " harness", false], [32194, 0.036651, " exploit", false], [4446, 0.033395, " bring", false], [3796, 0.030367, " apply", false], [28066, 0.025767, " utilize", false]]]}, "raw_delta": 0.1741524338722229, "tuned_delta": 0.18272422590280116}, {"byte_start": 4434, "byte_end": 4437, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 741, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "5.80% 5.80% 5.80%", "qwen": "3.44% 3.44% 3.44%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.38305723667144775]], "qwen": [[432, " it", "normal", 0.5642081499099731]]}, "loss": {"rwkv": 5.799897055657127, "qwen": 3.44041941494408}, "topk": {"rwkv": [4601, 2, 0.38305723667144775, [[32227, 0.414391, " that", false], [4601, 0.383057, " it", false], [22590, 0.058964, " the", false], [52195, 0.020023, " massive", false], [21256, 0.015544, " all", false], [32234, 0.012122, " this", false], [63370, 0.008196, " computation", false], [332, 0.008017, " a", false], [31466, 0.00777, " much", false], [31458, 0.00695, " more", false]]], "qwen": [432, 1, 0.5642081499099731, [[432, 0.564208, " it", false], [429, 0.290662, " that", false], [419, 0.021829, " this", false], [279, 0.014798, " the", false], [678, 0.013609, " all", false], [803, 0.010546, " more", false], [10951, 0.010346, " massive", false], [34447, 0.009711, " computation", false], [1496, 0.005578, " even", false], [264, 0.005563, " a", false]]]}, "raw_delta": 0.13083722194035846, "tuned_delta": 0.13940901397093672}, {"byte_start": 4437, "byte_end": 4440, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 742, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "1.48% 1.48% 1.48%", "qwen": "0.97% 0.97% 0.97%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.7803198099136353]], "qwen": [[311, " to", "normal", 0.8510703444480896]]}, "loss": {"rwkv": 1.4793259696615346, "qwen": 0.9693738518131108}, "topk": {"rwkv": [4811, 1, 0.7803198099136353, [[4811, 0.78032, " to", false], [4596, 0.086069, " in", false], [31162, 0.041428, " into", false], [21256, 0.030616, " all", false], [39934, 0.015893, " there", false], [4424, 0.013482, " at", false], [40185, 0.004383, " where", false], [63507, 0.003866, " effectively", false], [46301, 0.003237, " inside", false], [56003, 0.001885, " directly", false]]], "qwen": [311, 1, 0.8510703444480896, [[311, 0.85107, " to", false], [304, 0.050348, " in", false], [1119, 0.038508, " into", false], [13444, 0.021227, " effectively", false], [5961, 0.009136, " directly", false], [990, 0.002848, " use", false], [518, 0.002263, " at", false], [29720, 0.002102, " efficiently", false], [678, 0.001641, " all", false], [7225, 0.001396, " fully", false]]]}, "raw_delta": 0.02827774981657664, "tuned_delta": 0.03684954184715489}, {"byte_start": 4440, "byte_end": 4445, "display": {"text": " good", "kind": "normal"}, "is_word": true, "word_id": 743, "word_key": " good", "bytes_hex": "20 67 6f 6f 64", "compression": {"rwkv": "8.40% 8.40% 8.40% 8.40% 8.40%", "qwen": "8.16% 8.16% 8.16% 8.16% 8.16%"}, "model_tokens": {"rwkv": [[30992, " good", "normal", 0.09741509705781937]], "qwen": [[1661, " good", "normal", 0.10399079322814941]]}, "loss": {"rwkv": 8.396935980174044, "qwen": 8.163681070288343}, "topk": {"rwkv": [30992, 3, 0.09741509705781937, [[22681, 0.350954, " use", false], [32499, 0.243058, " work", false], [30992, 0.097415, " good", false], [59593, 0.083261, " effective", false], [45301, 0.056173, " better", false], [22590, 0.019862, " the", false], [31466, 0.017513, " much", false], [62383, 0.016633, " productive", false], [30273, 0.010195, " best", false], [31458, 0.007053, " more", false]]], "qwen": [1661, 3, 0.10399079322814941, [[990, 0.247732, " use", false], [975, 0.241505, " work", false], [1661, 0.103991, " good", false], [2664, 0.088417, " better", false], [7373, 0.053809, " effective", false], [279, 0.039391, " the", false], [1850, 0.03241, " best", false], [1753, 0.018473, " much", false], [803, 0.014827, " more", false], [26236, 0.01261, " productive", false]]]}, "raw_delta": 0.012934398651123058, "tuned_delta": 0.021506190681701308}, {"byte_start": 4445, "byte_end": 4449, "display": {"text": " use", "kind": "normal"}, "is_word": true, "word_id": 744, "word_key": " use", "bytes_hex": "20 75 73 65", "compression": {"rwkv": "0.16% 0.16% 0.16% 0.16%", "qwen": "0.16% 0.16% 0.16% 0.16%"}, "model_tokens": {"rwkv": [[22681, " use", "normal", 0.964491605758667]], "qwen": [[990, " use", "normal", 0.9658353328704834]]}, "loss": {"rwkv": 0.1629019668972523, "qwen": 0.15672154192403911}, "topk": {"rwkv": [22681, 1, 0.964491605758667, [[22681, 0.964492, " use", false], [45828, 0.00888, " effect", false], [45, 0.004338, ",", false], [59093, 0.004256, " advantage", false], [51832, 0.001895, " general", false], [32499, 0.001795, " work", false], [21265, 0.001371, " and", false], [60212, 0.000986, " practical", false], [32356, 0.000764, " uses", false], [275, 0.000744, " (", false]]], "qwen": [990, 1, 0.9658353328704834, [[990, 0.965835, " use", false], [2456, 0.0087, " effect", false], [975, 0.007098, " work", false], [2692, 0.002582, " account", false], [9423, 0.001591, " advantage", false], [323, 0.001557, " and", false], [11, 0.001498, ",", false], [5711, 0.00129, " uses", false], [7428, 0.001177, " purpose", false], [320, 0.001028, " (", false]]]}, "raw_delta": 0.0003427155315876007, "tuned_delta": 0.008914507562165849}, {"byte_start": 4449, "byte_end": 4451, "display": {"text": ".\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e 0a", "compression": {"rwkv": "3.31% 2.05%", "qwen": "4.00% 4.00%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.8317354321479797], [261, "\n\n", "control", 0.7984659075737]], "qwen": [[382, ".\n\n", "control", 0.5144608616828918]]}, "loss": {"rwkv": 2.6812783200115313, "qwen": 3.9952780839930266}, "topk": {"rwkv": [47, 1, 0.8317354321479797, [[47, 0.831735, ".", false], [4596, 0.047742, " in", false], [45, 0.025462, ",", false], [5346, 0.019369, "---", false], [53356, 0.011946, " without", false], [52028, 0.011257, " instead", false], [275, 0.005403, " (", false], [4450, 0.005214, " by", false], [21700, 0.003337, " for", false], [4712, 0.002923, " on", false]]], "qwen": [382, 1, 0.5144608616828918, [[382, 0.514461, ".\n\n", false], [13, 0.244287, ".", false], [304, 0.056674, " in", false], [11, 0.029495, ",", false], [624, 0.01973, ".\n", false], [553, 0.017578, " by", false], [2041, 0.017143, " without", false], [4192, 0.014547, ".\n\n\n", false], [4421, 0.014191, "---", false], [1526, 0.009009, " through", false]]]}, "raw_delta": -0.07286361853281656, "tuned_delta": -0.06429182650223832}, {"byte_start": 4451, "byte_end": 4452, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "2.05%", "qwen": "4.00%"}, "model_tokens": {"rwkv": [[261, "\n\n", "control", 0.7984659075737]], "qwen": [[382, ".\n\n", "control", 0.5144608616828918]]}, "loss": {"rwkv": 2.0516842317329615, "qwen": 3.9952780839930266}, "topk": {"rwkv": [261, 1, 0.7984659075737, [[261, 0.798466, "\n\n", false], [20996, 0.02136, " The", false], [267, 0.017026, "  ", false], [3913, 0.01181, " In", false], [3336, 0.009919, " \n\n", false], [3918, 0.009581, " It", false], [3328, 0.009526, "\n\n\n", false], [0, 0.007907, "[0]", false], [29894, 0.006895, " This", false], [11, 0.005135, "\n", false]]], "qwen": [382, 1, 0.5144608616828918, [[382, 0.514461, ".\n\n", false], [13, 0.244287, ".", false], [304, 0.056674, " in", false], [11, 0.029495, ",", false], [624, 0.01973, ".\n", false], [553, 0.017578, " by", false], [2041, 0.017143, " without", false], [4192, 0.014547, ".\n\n\n", false], [4421, 0.014191, "---", false], [1526, 0.009009, " through", false]]]}, "raw_delta": -0.10777572790781656, "tuned_delta": -0.09920393587723832}, {"byte_start": 4452, "byte_end": 4454, "display": {"text": "In", "kind": "normal"}, "is_word": true, "word_id": 745, "word_key": "in", "bytes_hex": "49 6e", "compression": {"rwkv": "11.48% 11.48%", "qwen": "11.56% 11.56%"}, "model_tokens": {"rwkv": [[1136, "In", "normal", 0.28333574533462524]], "qwen": [[641, "In", "normal", 0.2775447964668274]]}, "loss": {"rwkv": 11.482387288325246, "qwen": 11.557545856535429}, "topk": {"rwkv": [1136, 1, 0.28333574533462524, [[1136, 0.283336, "In", false], [6699, 0.119155, "The", false], [66, 0.060258, "A", false], [33504, 0.055928, "There", false], [48358, 0.034444, "Another", false], [33505, 0.029975, "These", false], [1141, 0.026713, "It", false], [24242, 0.01586, "This", false], [58094, 0.013487, "Similarly", false], [6393, 0.013408, "One", false]]], "qwen": [641, 1, 0.2775447964668274, [[641, 0.277545, "In", false], [785, 0.116033, "The", false], [32, 0.040546, "A", false], [3862, 0.038229, "There", false], [9485, 0.028259, "These", false], [14037, 0.017428, "Another", false], [67691, 0.016609, "Similarly", false], [1986, 0.015898, "This", false], [2132, 0.014444, "It", false], [33464, 0.012972, "Deep", false]]]}, "raw_delta": -0.004167675971984863, "tuned_delta": 0.004404116058593385}, {"byte_start": 4454, "byte_end": 4463, "display": {"text": " computer", "kind": "normal"}, "is_word": true, "word_id": 746, "word_key": " computer", "bytes_hex": "20 63 6f 6d 70 75 74 65 72", "compression": {"rwkv": "3.05% 3.05% 3.05% 3.05% 3.05% 3.05% 3.05% 3.05% 3.05%", "qwen": "3.91% 3.91% 3.91% 3.91% 3.91% 3.91% 3.91% 3.91% 3.91%"}, "model_tokens": {"rwkv": [[55809, " computer", "normal", 0.21826326847076416]], "qwen": [[6366, " computer", "normal", 0.1419302076101303]]}, "loss": {"rwkv": 3.0525773977142774, "qwen": 3.9121478810505597}, "topk": {"rwkv": [55809, 1, 0.21826326847076416, [[55809, 0.218263, " computer", false], [52766, 0.136421, " robotic", false], [22590, 0.083853, " the", false], [52299, 0.037856, " natural", false], [21256, 0.027232, " all", false], [52167, 0.026895, " machine", false], [65003, 0.019705, " reinforcement", false], [52209, 0.019266, " medical", false], [38744, 0.01909, " image", false], [51832, 0.017083, " general", false]]], "qwen": [6366, 1, 0.1419302076101303, [[6366, 0.14193, " computer", false], [279, 0.130395, " the", false], [73606, 0.125936, " robotics", false], [5662, 0.046521, " machine", false], [678, 0.036918, " all", false], [71278, 0.034866, " reinforcement", false], [11129, 0.030967, " vision", false], [12305, 0.027495, " robot", false], [5810, 0.025839, " natural", false], [2168, 0.024849, " image", false]]]}, "raw_delta": -0.04766470856136745, "tuned_delta": -0.0390929165307892}, {"byte_start": 4463, "byte_end": 4470, "display": {"text": " vision", "kind": "normal"}, "is_word": true, "word_id": 747, "word_key": " vision", "bytes_hex": "20 76 69 73 69 6f 6e", "compression": {"rwkv": "0.19% 0.19% 0.19% 0.19% 0.19% 0.19% 0.19%", "qwen": "0.56% 0.56% 0.56% 0.56% 0.56% 0.56% 0.56%"}, "model_tokens": {"rwkv": [[47732, " vision", "normal", 0.9274498820304871]], "qwen": [[11129, " vision", "normal", 0.8056734204292297]]}, "loss": {"rwkv": 0.19497918817817844, "qwen": 0.5566659584607483}, "topk": {"rwkv": [47732, 1, 0.9274498820304871, [[47732, 0.92745, " vision", false], [63944, 0.012066, " translation", false], [52814, 0.008668, " science", false], [46, 0.006332, "-", false], [52766, 0.004298, " robotic", false], [56329, 0.004237, " graphics", false], [56529, 0.003973, " language", false], [31044, 0.002612, " hand", false], [38744, 0.001578, " image", false], [45032, 0.001509, " Vision", false]]], "qwen": [11129, 1, 0.8056734204292297, [[11129, 0.805673, " vision", false], [5994, 0.035949, " Go", false], [3868, 0.02343, " games", false], [1809, 0.018173, " game", false], [8038, 0.007636, " science", false], [73606, 0.006905, " robotics", false], [8273, 0.006662, "-v", false], [14181, 0.006551, " graphics", false], [20814, 0.005766, " poker", false], [2766, 0.005482, " video", false]]]}, "raw_delta": -0.02005617320537567, "tuned_delta": -0.011484381174797423}, {"byte_start": 4470, "byte_end": 4471, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "1.47%", "qwen": "1.78%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.9220231175422668]], "qwen": [[11, ",", "normal", 0.9061692357063293]]}, "loss": {"rwkv": 1.4705204579373587, "qwen": 1.7768446692927307}, "topk": {"rwkv": [45, 1, 0.9220231175422668, [[45, 0.922023, ",", false], [21265, 0.036312, " and", false], [275, 0.008781, " (", false], [39934, 0.005697, " there", false], [5346, 0.003784, "---", false], [57103, 0.003593, " research", false], [22590, 0.00272, " the", false], [22614, 0.001771, " too", false], [53087, 0.001476, " systems", false], [4423, 0.001091, " as", false]]], "qwen": [11, 1, 0.9061692357063293, [[11, 0.906169, ",", false], [323, 0.034152, " and", false], [1052, 0.011199, " there", false], [320, 0.011075, " (", false], [3412, 0.004476, " research", false], [279, 0.00315, " the", false], [4421, 0.002759, "---", false], [438, 0.002543, " as", false], [304, 0.002428, " in", false], [11811, 0.002211, " researchers", false]]]}, "raw_delta": -0.016986221075057983, "tuned_delta": -0.008414429044479735}, {"byte_start": 4471, "byte_end": 4477, "display": {"text": " there", "kind": "normal"}, "is_word": true, "word_id": 748, "word_key": " there", "bytes_hex": "20 74 68 65 72 65", "compression": {"rwkv": "6.62% 6.62% 6.62% 6.62% 6.62% 6.62%", "qwen": "5.20% 5.20% 5.20% 5.20% 5.20% 5.20%"}, "model_tokens": {"rwkv": [[39934, " there", "normal", 0.11340678483247757]], "qwen": [[1052, " there", "normal", 0.1774648129940033]]}, "loss": {"rwkv": 6.621744816580202, "qwen": 5.19665644224577}, "topk": {"rwkv": [39934, 2, 0.11340678483247757, [[22590, 0.336809, " the", false], [39934, 0.113407, " there", false], [332, 0.059531, " a", false], [63843, 0.043764, " researchers", false], [4601, 0.026649, " it", false], [50919, 0.020071, " another", false], [37635, 0.017193, " again", false], [52224, 0.016136, " methods", false], [4596, 0.014111, " in", false], [22226, 0.01232, " one", false]]], "qwen": [1052, 2, 0.1774648129940033, [[279, 0.208848, " the", false], [1052, 0.177465, " there", false], [11811, 0.082833, " researchers", false], [264, 0.054324, " a", false], [4124, 0.053299, " early", false], [304, 0.021776, " in", false], [5413, 0.016807, " methods", false], [3738, 0.015499, " human", false], [432, 0.01524, " it", false], [458, 0.013534, " an", false]]]}, "raw_delta": 0.07902367909749347, "tuned_delta": 0.08759547112807171}, {"byte_start": 4477, "byte_end": 4481, "display": {"text": " has", "kind": "normal"}, "is_word": true, "word_id": 749, "word_key": " has", "bytes_hex": "20 68 61 73", "compression": {"rwkv": "9.44% 9.44% 9.44% 9.44%", "qwen": "10.06% 10.06% 10.06% 10.06%"}, "model_tokens": {"rwkv": [[21800, " has", "normal", 0.12311496585607529]], "qwen": [[702, " has", "normal", 0.10737162828445435]]}, "loss": {"rwkv": 9.439508568316459, "qwen": 10.06035948858179}, "topk": {"rwkv": [21800, 3, 0.12311496585607529, [[22748, 0.419516, " was", false], [32462, 0.222666, " were", false], [21800, 0.123115, " has", false], [31059, 0.101793, " have", false], [4600, 0.069628, " is", false], [21286, 0.03921, " are", false], [21795, 0.003589, " had", false], [22614, 0.002321, " too", false], [30135, 0.002106, " also", false], [37635, 0.002008, " again", false]]], "qwen": [702, 3, 0.10737162828445435, [[572, 0.514358, " was", false], [1033, 0.172868, " were", false], [702, 0.107372, " has", false], [374, 0.077177, " is", false], [614, 0.052585, " have", false], [525, 0.039749, " are", false], [1030, 0.007536, " had", false], [1083, 0.006672, " also", false], [1549, 0.003572, " again", false], [2238, 0.002997, " too", false]]]}, "raw_delta": -0.03442728519439697, "tuned_delta": -0.025855493163818723}, {"byte_start": 4481, "byte_end": 4486, "display": {"text": " been", "kind": "normal"}, "is_word": true, "word_id": 750, "word_key": " been", "bytes_hex": "20 62 65 65 6e", "compression": {"rwkv": "1.05% 1.05% 1.05% 1.05% 1.05%", "qwen": "0.81% 0.81% 0.81% 0.81% 0.81%"}, "model_tokens": {"rwkv": [[30259, " been", "normal", 0.747715413570404]], "qwen": [[1012, " been", "normal", 0.7988281846046448]]}, "loss": {"rwkv": 1.0496169975217555, "qwen": 0.8101072398579089}, "topk": {"rwkv": [30259, 1, 0.747715413570404, [[30259, 0.747715, " been", false], [30135, 0.153006, " also", false], [45150, 0.021881, " always", false], [31323, 0.012638, " long", false], [22187, 0.01022, " not", false], [56548, 0.007506, " likewise", false], [57036, 0.00583, " recently", false], [37635, 0.005008, " again", false], [60505, 0.004354, " similarly", false], [45, 0.004121, ",", false]]], "qwen": [1012, 1, 0.7988281846046448, [[1012, 0.798828, " been", false], [1083, 0.083231, " also", false], [2677, 0.046376, " always", false], [1293, 0.017368, " long", false], [2581, 0.007312, " never", false], [537, 0.00695, " not", false], [34801, 0.003097, " historically", false], [1549, 0.00252, " again", false], [35242, 0.002296, " traditionally", false], [5926, 0.001962, " recently", false]]]}, "raw_delta": 0.013281241059303284, "tuned_delta": 0.021853033089881534}, {"byte_start": 4486, "byte_end": 4488, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 751, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "3.86% 3.86%", "qwen": "4.90% 4.90%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.6513375639915466]], "qwen": [[264, " a", "normal", 0.5807908177375793]]}, "loss": {"rwkv": 3.856814135189001, "qwen": 4.899434233538717}, "topk": {"rwkv": [332, 1, 0.6513375639915466, [[332, 0.651338, " a", false], [4419, 0.134001, " an", false], [52906, 0.020983, " similar", false], [50919, 0.016473, " another", false], [22590, 0.015272, " the", false], [31466, 0.01459, " much", false], [30788, 0.012737, " even", false], [45, 0.011664, ",", false], [4692, 0.007404, " no", false], [31458, 0.005878, " more", false]]], "qwen": [264, 1, 0.5807908177375793, [[264, 0.580791, " a", false], [458, 0.147467, " an", false], [1753, 0.035839, " much", false], [4428, 0.027938, " similar", false], [1045, 0.012506, " some", false], [29193, 0.009416, " similarly", false], [902, 0.008481, " no", false], [279, 0.007541, " the", false], [23839, 0.00746, " considerable", false], [803, 0.007214, " more", false]]]}, "raw_delta": -0.05781513452529907, "tuned_delta": -0.04924334249472082}, {"byte_start": 4488, "byte_end": 4496, "display": {"text": " similar", "kind": "normal"}, "is_word": true, "word_id": 752, "word_key": " similar", "bytes_hex": "20 73 69 6d 69 6c 61 72", "compression": {"rwkv": "1.76% 1.76% 1.76% 1.76% 1.76% 1.76% 1.76% 1.76%", "qwen": "2.80% 2.80% 2.80% 2.80% 2.80% 2.80% 2.80% 2.80%"}, "model_tokens": {"rwkv": [[52906, " similar", "normal", 0.45986196398735046]], "qwen": [[4428, " similar", "normal", 0.28896403312683105]]}, "loss": {"rwkv": 1.7611023448351601, "qwen": 2.7984971265504583}, "topk": {"rwkv": [52906, 1, 0.45986196398735046, [[52906, 0.459862, " similar", false], [31323, 0.106699, " long", false], [32386, 0.024848, " very", false], [47405, 0.01726, " steady", false], [60505, 0.014995, " similarly", false], [52427, 0.014722, " pattern", false], [38961, 0.013573, " major", false], [61774, 0.011334, " continuing", false], [51859, 0.010981, " gradual", false], [61756, 0.009168, " consistent", false]]], "qwen": [4428, 1, 0.28896403312683105, [[4428, 0.288964, " similar", false], [1293, 0.235387, " long", false], [29193, 0.019415, " similarly", false], [3598, 0.018889, " major", false], [2244, 0.017125, " great", false], [1602, 0.016404, " very", false], [12966, 0.013811, " consistent", false], [2696, 0.012967, " lot", false], [5383, 0.012706, " pattern", false], [24020, 0.011707, " steady", false]]]}, "raw_delta": -0.057525381445884705, "tuned_delta": -0.048953589415306455}, {"byte_start": 4496, "byte_end": 4504, "display": {"text": " pattern", "kind": "normal"}, "is_word": true, "word_id": 753, "word_key": " pattern", "bytes_hex": "20 70 61 74 74 65 72 6e", "compression": {"rwkv": "1.95% 1.95% 1.95% 1.95% 1.95% 1.95% 1.95% 1.95%", "qwen": "2.23% 2.23% 2.23% 2.23% 2.23% 2.23% 2.23% 2.23%"}, "model_tokens": {"rwkv": [[52427, " pattern", "normal", 0.4187702536582947]], "qwen": [[5383, " pattern", "normal", 0.3711734712123871]]}, "loss": {"rwkv": 1.946018091042852, "qwen": 2.234116440973038}, "topk": {"rwkv": [52427, 1, 0.4187702536582947, [[52427, 0.41877, " pattern", false], [39831, 0.118149, " story", false], [51929, 0.059372, " history", false], [45, 0.035831, ",", false], [39664, 0.021719, " shift", false], [59657, 0.020292, " evolution", false], [63797, 0.019084, " progression", false], [62660, 0.017703, " transition", false], [45450, 0.014281, " change", false], [45315, 0.011194, " bitter", false]]], "qwen": [5383, 1, 0.3711734712123871, [[5383, 0.371173, " pattern", false], [9149, 0.085054, " trend", false], [3364, 0.058034, " story", false], [6407, 0.041732, " shift", false], [32724, 0.033134, " progression", false], [2297, 0.022624, " change", false], [1293, 0.02091, " long", false], [9142, 0.01898, " transition", false], [3840, 0.017896, " history", false], [11, 0.013164, ",", false]]]}, "raw_delta": -0.01597556471824646, "tuned_delta": -0.007403772687668212}, {"byte_start": 4504, "byte_end": 4505, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "15.08%", "qwen": "22.93%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.4318086802959442]], "qwen": [[13, ".", "normal", 0.2804797291755676]]}, "loss": {"rwkv": 15.075036071788972, "qwen": 22.925394849169177}, "topk": {"rwkv": [47, 1, 0.4318086802959442, [[47, 0.431809, ".", false], [4706, 0.29945, " of", false], [45, 0.145887, ",", false], [31601, 0.020864, " over", false], [4596, 0.017669, " in", false], [59, 0.016538, ":", false], [5346, 0.008867, "---", false], [39690, 0.006442, " since", false], [21700, 0.005976, " for", false], [32487, 0.00581, " with", false]]], "qwen": [13, 2, 0.2804797291755676, [[315, 0.466759, " of", false], [13, 0.28048, ".", false], [11, 0.082198, ",", false], [311, 0.037578, " to", false], [304, 0.027072, " in", false], [916, 0.01584, " over", false], [25, 0.013909, ":", false], [4421, 0.010026, "---", false], [504, 0.00752, " from", false], [369, 0.007465, " for", false]]]}, "raw_delta": -0.4353163242340088, "tuned_delta": -0.42674453220343056}, {"byte_start": 4505, "byte_end": 4511, "display": {"text": " Early", "kind": "normal"}, "is_word": true, "word_id": 754, "word_key": " early", "bytes_hex": "20 45 61 72 6c 79", "compression": {"rwkv": "5.96% 5.96% 5.96% 5.96% 5.96% 5.96%", "qwen": "5.03% 5.03% 5.03% 5.03% 5.03% 5.03%"}, "model_tokens": {"rwkv": [[36607, " Early", "normal", 0.13682277500629425]], "qwen": [[22752, " Early", "normal", 0.18737633526325226]]}, "loss": {"rwkv": 5.964266607841743, "qwen": 5.033310903428166}, "topk": {"rwkv": [36607, 2, 0.13682277500629425, [[20996, 0.154913, " The", false], [36607, 0.136823, " Early", false], [3913, 0.09772, " In", false], [37451, 0.040401, " There", false], [19907, 0.038629, " For", false], [63222, 0.035554, " Researchers", false], [50438, 0.024645, " Methods", false], [3642, 0.01935, " At", false], [58864, 0.018602, " Initially", false], [36809, 0.018484, " Human", false]]], "qwen": [22752, 1, 0.18737633526325226, [[22752, 0.187376, " Early", false], [758, 0.112628, " In", false], [576, 0.098623, " The", false], [2619, 0.094991, " There", false], [58150, 0.057391, " Researchers", false], [58556, 0.028442, " Initially", false], [1752, 0.025186, " For", false], [362, 0.024925, " A", false], [2411, 0.017526, " At", false], [11097, 0.01484, " Human", false]]]}, "raw_delta": 0.051623145739237486, "tuned_delta": 0.060194937769815736}, {"byte_start": 4511, "byte_end": 4519, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 755, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "3.03% 3.03% 3.03% 3.03% 3.03% 3.03% 3.03% 3.03%", "qwen": "4.38% 4.38% 4.38% 4.38% 4.38% 4.38% 4.38% 4.38%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.260214626789093]], "qwen": [[5413, " methods", "normal", 0.1432800143957138]]}, "loss": {"rwkv": 3.029096033116476, "qwen": 4.379829231113428}, "topk": {"rwkv": [52224, 1, 0.260214626789093, [[52224, 0.260215, " methods", false], [55809, 0.103162, " computer", false], [57103, 0.098552, " research", false], [51566, 0.098348, " efforts", false], [32499, 0.053475, " work", false], [61590, 0.05319, " approaches", false], [63843, 0.046697, " researchers", false], [4712, 0.034582, " on", false], [47732, 0.029301, " vision", false], [55572, 0.025312, " attempts", false]]], "qwen": [5413, 1, 0.1432800143957138, [[5413, 0.14328, " methods", false], [304, 0.120413, " in", false], [975, 0.118516, " work", false], [8869, 0.092872, " efforts", false], [6366, 0.087719, " computer", false], [11811, 0.059996, " researchers", false], [3412, 0.051687, " research", false], [11129, 0.049252, " vision", false], [19827, 0.043755, " approaches", false], [389, 0.037572, " on", false]]]}, "raw_delta": -0.0749005526304245, "tuned_delta": -0.06632876059984626}, {"byte_start": 4519, "byte_end": 4529, "display": {"text": " conceived", "kind": "normal"}, "is_word": true, "word_id": 756, "word_key": " conceived", "bytes_hex": "20 63 6f 6e 63 65 69 76 65 64", "compression": {"rwkv": "19.27% 19.27% 19.27% 19.27% 19.27% 19.27% 19.27% 19.27% 19.27% 19.27%", "qwen": "18.27% 18.27% 18.27% 18.27% 18.27% 18.27% 18.27% 18.27% 18.27% 18.27%"}, "model_tokens": {"rwkv": [[59348, " conceived", "normal", 2.25853655138053e-05]], "qwen": [[49078, " conceived", "normal", 3.9800819649826735e-05]]}, "loss": {"rwkv": 19.27350406187599, "qwen": 18.27105330635336}, "topk": {"rwkv": [59348, 527, 2.25853655138053e-05, [[32462, 0.174569, " were", false], [47054, 0.143228, " relied", false], [45, 0.091219, ",", false], [32354, 0.067284, " used", false], [4596, 0.066749, " in", false], [21700, 0.04945, " for", false], [32227, 0.035534, " that", false], [40013, 0.033949, " tried", false], [4706, 0.023363, " of", false], [56427, 0.022307, " included", false]]], "qwen": [49078, 410, 3.9800819649826735e-05, [[1033, 0.22463, " were", false], [39913, 0.084109, " relied", false], [304, 0.066021, " in", false], [369, 0.064234, " for", false], [3867, 0.063007, " took", false], [11, 0.057171, ",", false], [429, 0.040702, " that", false], [3118, 0.038395, " based", false], [10735, 0.038008, " focused", false], [315, 0.026742, " of", false]]]}, "raw_delta": 0.05558767318725599, "tuned_delta": 0.06415946521783424}, {"byte_start": 4529, "byte_end": 4532, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 757, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "5.38% 5.38% 5.38%", "qwen": "9.18% 9.18% 9.18%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.40571919083595276]], "qwen": [[315, " of", "normal", 0.21719248592853546]]}, "loss": {"rwkv": 5.377232492896689, "qwen": 9.178974916901904}, "topk": {"rwkv": [4706, 1, 0.40571919083595276, [[4706, 0.405719, " of", false], [4450, 0.163427, " by", false], [4596, 0.088176, " in", false], [4811, 0.047341, " to", false], [4423, 0.034336, " as", false], [21265, 0.031606, " and", false], [22590, 0.016049, " the", false], [332, 0.015414, " a", false], [4712, 0.012725, " on", false], [32487, 0.012659, " with", false]]], "qwen": [315, 1, 0.21719248592853546, [[315, 0.217192, " of", false], [304, 0.155638, " in", false], [438, 0.152512, " as", false], [323, 0.076464, " and", false], [553, 0.074736, " by", false], [311, 0.05731, " to", false], [389, 0.032373, " on", false], [448, 0.032037, " with", false], [279, 0.015105, " the", false], [3118, 0.014067, " based", false]]]}, "raw_delta": -0.2108133633931478, "tuned_delta": -0.20224157136256954}, {"byte_start": 4532, "byte_end": 4539, "display": {"text": " vision", "kind": "normal"}, "is_word": true, "word_id": 758, "word_key": " vision", "bytes_hex": "20 76 69 73 69 6f 6e", "compression": {"rwkv": "8.21% 8.21% 8.21% 8.21% 8.21% 8.21% 8.21%", "qwen": "6.55% 6.55% 6.55% 6.55% 6.55% 6.55% 6.55%"}, "model_tokens": {"rwkv": [[47732, " vision", "normal", 0.04103774577379227]], "qwen": [[11129, " vision", "normal", 0.07862947881221771]]}, "loss": {"rwkv": 8.21176864791709, "qwen": 6.551403298153559}, "topk": {"rwkv": [47732, 7, 0.04103774577379227, [[4423, 0.258047, " as", false], [22590, 0.097834, " the", false], [332, 0.06878, " a", false], [4450, 0.062958, " by", false], [55809, 0.047489, " computer", false], [4596, 0.044303, " in", false], [47732, 0.041038, " vision", false], [46249, 0.025295, " images", false], [52342, 0.020283, " objects", false], [38744, 0.018771, " image", false]]], "qwen": [11129, 3, 0.07862947881221771, [[438, 0.122214, " as", false], [279, 0.107035, " the", false], [11129, 0.078629, " vision", false], [264, 0.064636, " a", false], [6366, 0.062212, " computer", false], [1667, 0.031913, " using", false], [4633, 0.028064, " taking", false], [304, 0.024232, " in", false], [3738, 0.023334, " human", false], [9902, 0.018649, " ``", false]]]}, "raw_delta": 0.09207020487104145, "tuned_delta": 0.10064199690161969}, {"byte_start": 4539, "byte_end": 4542, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 759, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"rwkv": "2.61% 2.61% 2.61%", "qwen": "1.65% 1.65% 1.65%"}, "model_tokens": {"rwkv": [[4423, " as", "normal", 0.6463713645935059]], "qwen": [[438, " as", "normal", 0.7599860429763794]]}, "loss": {"rwkv": 2.606431470356037, "qwen": 1.64981326720481}, "topk": {"rwkv": [4423, 1, 0.6463713645935059, [[4423, 0.646371, " as", false], [4596, 0.137363, " in", false], [56939, 0.039319, " problems", false], [53087, 0.037758, " systems", false], [39898, 0.034812, " tasks", false], [30917, 0.008588, " from", false], [4450, 0.007895, " by", false], [21265, 0.006168, " and", false], [62378, 0.005735, " processing", false], [45, 0.005301, ",", false]]], "qwen": [438, 1, 0.7599860429763794, [[438, 0.759986, " as", false], [304, 0.108452, " in", false], [5942, 0.014882, " systems", false], [5322, 0.009305, " problems", false], [11, 0.006321, ",", false], [25185, 0.005025, " algorithms", false], [553, 0.005003, " by", false], [9079, 0.004906, " tasks", false], [3118, 0.003904, " based", false], [323, 0.003779, " and", false]]]}, "raw_delta": 0.05304617683092753, "tuned_delta": 0.06161796886150578}, {"byte_start": 4542, "byte_end": 4552, "display": {"text": " searching", "kind": "normal"}, "is_word": true, "word_id": 760, "word_key": " searching", "bytes_hex": "20 73 65 61 72 63 68 69 6e 67", "compression": {"rwkv": "14.20% 14.20% 14.20% 14.20% 14.20% 14.20% 14.20% 14.20% 14.20% 14.20%", "qwen": "12.93% 12.93% 12.93% 12.93% 12.93% 12.93% 12.93% 12.93% 12.93% 12.93%"}, "model_tokens": {"rwkv": [[60463, " searching", "normal", 0.00038259965367615223]], "qwen": [[15039, " searching", "normal", 0.0007701599388383329]]}, "loss": {"rwkv": 14.201529308750729, "qwen": 12.928192979420364}, "topk": {"rwkv": [60463, 118, 0.00038259965367615223, [[332, 0.498589, " a", false], [37832, 0.07855, " being", false], [4419, 0.070187, " an", false], [22590, 0.04413, " the", false], [60522, 0.024242, " something", false], [63541, 0.017786, " essentially", false], [52906, 0.013338, " similar", false], [59927, 0.012703, " involving", false], [59134, 0.009976, " analogous", false], [46170, 0.007928, " having", false]]], "qwen": [15039, 85, 0.0007701599388383329, [[264, 0.487278, " a", false], [458, 0.071254, " an", false], [279, 0.06089, " the", false], [1660, 0.035027, " being", false], [2494, 0.020415, " something", false], [15860, 0.01772, " involving", false], [9902, 0.01342, " ``", false], [3432, 0.012937, " having", false], [4633, 0.01076, " taking", false], [15791, 0.007221, " essentially", false]]]}, "raw_delta": 0.07060875892639162, "tuned_delta": 0.07918055095696987}, {"byte_start": 4552, "byte_end": 4556, "display": {"text": " for", "kind": "normal"}, "is_word": true, "word_id": 761, "word_key": " for", "bytes_hex": "20 66 6f 72", "compression": {"rwkv": "3.86% 3.86% 3.86% 3.86%", "qwen": "3.44% 3.44% 3.44% 3.44%"}, "model_tokens": {"rwkv": [[21700, " for", "normal", 0.4267788529396057]], "qwen": [[369, " for", "normal", 0.46674421429634094]]}, "loss": {"rwkv": 3.856814135189001, "qwen": 3.4352999751290993}, "topk": {"rwkv": [21700, 1, 0.4267788529396057, [[21700, 0.426779, " for", false], [53140, 0.155739, " through", false], [332, 0.086099, " a", false], [31601, 0.063356, " over", false], [22590, 0.04669, " the", false], [4596, 0.044139, " in", false], [45, 0.022467, ",", false], [4419, 0.014625, " an", false], [21265, 0.009688, " and", false], [5346, 0.009635, "---", false]]], "qwen": [369, 1, 0.46674421429634094, [[369, 0.466744, " for", false], [1526, 0.183925, " through", false], [11, 0.047437, ",", false], [304, 0.046804, " in", false], [264, 0.044039, " a", false], [323, 0.028121, " and", false], [279, 0.024204, " the", false], [916, 0.021524, " over", false], [553, 0.009388, " by", false], [13, 0.008407, ".", false]]]}, "raw_delta": 0.023373708128929138, "tuned_delta": 0.03194550015950739}, {"byte_start": 4556, "byte_end": 4562, "display": {"text": " edges", "kind": "normal"}, "is_word": true, "word_id": 762, "word_key": " edges", "bytes_hex": "20 65 64 67 65 73", "compression": {"rwkv": "9.86% 9.86% 9.86% 9.86% 9.86% 9.86%", "qwen": "16.52% 16.52% 16.52% 16.52% 16.52% 16.52%"}, "model_tokens": {"rwkv": [[38332, " edges", "normal", 0.037653230130672455]], "qwen": [[12822, " edges", "normal", 0.004106951877474785]]}, "loss": {"rwkv": 9.862173131076897, "qwen": 16.516075836990932}, "topk": {"rwkv": [38332, 5, 0.037653230130672455, [[52342, 0.21613, " objects", false], [56832, 0.066548, " patterns", false], [56215, 0.053318, " features", false], [332, 0.041254, " a", false], [38332, 0.037653, " edges", false], [47734, 0.033464, " visual", false], [57271, 0.026871, " specific", false], [22590, 0.026812, " the", false], [4404, 0.023431, " ``", false], [46691, 0.022311, " object", false]]], "qwen": [12822, 35, 0.004106951877474785, [[12624, 0.108482, " patterns", false], [4419, 0.107189, " features", false], [6171, 0.101189, " objects", false], [264, 0.056917, " a", false], [279, 0.037417, " the", false], [3151, 0.02735, " specific", false], [4274, 0.01985, " sal", false], [3281, 0.017533, " special", false], [9124, 0.016381, " visual", false], [3738, 0.01627, " human", false]]]}, "raw_delta": -0.3689707120259604, "tuned_delta": -0.36039891999538215}, {"byte_start": 4562, "byte_end": 4563, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "22.12%", "qwen": "14.23%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.2914634644985199]], "qwen": [[11, ",", "normal", 0.45429813861846924]]}, "loss": {"rwkv": 22.11944545112961, "qwen": 14.228608407085709}, "topk": {"rwkv": [45, 2, 0.2914634644985199, [[21265, 0.336078, " and", false], [45, 0.291463, ",", false], [4596, 0.133942, " in", false], [4715, 0.097066, " or", false], [47, 0.030694, ".", false], [5346, 0.024753, "---", false], [275, 0.021554, " (", false], [4706, 0.011554, " of", false], [32227, 0.006539, " that", false], [4811, 0.006144, " to", false]]], "qwen": [11, 1, 0.45429813861846924, [[11, 0.454298, ",", false], [323, 0.403713, " and", false], [476, 0.040795, " or", false], [304, 0.040111, " in", false], [320, 0.015853, " (", false], [13, 0.01289, ".", false], [4421, 0.003669, "---", false], [26, 0.002524, ";", false], [389, 0.002163, " on", false], [315, 0.002136, " of", false]]]}, "raw_delta": 0.43756091594696045, "tuned_delta": 0.4461327079775387}, {"byte_start": 4563, "byte_end": 4566, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 763, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"rwkv": "9.02% 9.02% 9.02%", "qwen": "12.30% 12.30% 12.30%"}, "model_tokens": {"rwkv": [[4715, " or", "normal", 0.22449207305908203]], "qwen": [[476, " or", "normal", 0.12923438847064972]]}, "loss": {"rwkv": 9.01684400555602, "qwen": 12.299742002494527}, "topk": {"rwkv": [4715, 1, 0.22449207305908203, [[4715, 0.224492, " or", false], [21265, 0.20366, " and", false], [51327, 0.091674, " corners", false], [32230, 0.055477, " then", false], [38905, 0.035899, " lines", false], [40186, 0.027468, " which", false], [47253, 0.022247, " shapes", false], [21700, 0.020649, " for", false], [40085, 0.014609, " using", false], [21643, 0.014268, " etc", false]]], "qwen": [476, 2, 0.12923438847064972, [[323, 0.188974, " and", false], [476, 0.129234, " or", false], [23462, 0.072278, " corners", false], [1221, 0.052065, " then", false], [20816, 0.035317, " shapes", false], [49031, 0.032121, " contours", false], [5128, 0.031306, " lines", false], [76899, 0.028993, " blobs", false], [369, 0.026087, " for", false], [4419, 0.025871, " features", false]]]}, "raw_delta": -0.1820425192515055, "tuned_delta": -0.17347072722092724}, {"byte_start": 4566, "byte_end": 4578, "display": {"text": " generalized", "kind": "normal"}, "is_word": true, "word_id": 764, "word_key": " generalized", "bytes_hex": "20 67 65 6e 65 72 61 6c 69 7a 65 64", "compression": {"rwkv": "14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09%", "qwen": "14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 14.96%"}, "model_tokens": {"rwkv": [[63594, " generalized", "normal", 8.530707418685779e-05]], "qwen": [[66117, " generalized", "normal", 4.747543061967008e-05]]}, "loss": {"rwkv": 14.088818758681281, "qwen": 14.960895485977597}, "topk": {"rwkv": [63594, 518, 8.530707418685779e-05, [[21700, 0.223051, " for", false], [39193, 0.072967, " other", false], [38905, 0.047639, " lines", false], [47253, 0.040854, " shapes", false], [51327, 0.038605, " corners", false], [31458, 0.026516, " more", false], [55852, 0.024301, " contours", false], [57413, 0.020505, " textures", false], [37865, 0.019896, " blobs", false], [4423, 0.019723, " as", false]]], "qwen": [66117, 800, 4.747543061967008e-05, [[315, 0.154972, " of", false], [438, 0.084378, " as", false], [76899, 0.062551, " blobs", false], [369, 0.050894, " for", false], [23462, 0.042371, " corners", false], [20816, 0.039494, " shapes", false], [1008, 0.028485, " other", false], [4419, 0.025384, " features", false], [49031, 0.022003, " contours", false], [29853, 0.020409, " textures", false]]]}, "raw_delta": -0.04835820198059082, "tuned_delta": -0.03978640995001257}, {"byte_start": 4578, "byte_end": 4588, "display": {"text": " cylinders", "kind": "normal"}, "is_word": true, "word_id": 765, "word_key": " cylinders", "bytes_hex": "20 63 79 6c 69 6e 64 65 72 73", "compression": {"rwkv": "18.94% 18.94% 18.94% 18.94% 18.94% 18.94% 18.94% 18.94% 18.94% 18.94%", "qwen": "14.63% 14.63% 14.63% 14.63% 14.63% 14.63% 14.63% 14.63% 14.63% 14.63%"}, "model_tokens": {"rwkv": [[59439, " cylinders", "normal", 2.7507401682669297e-05]], "qwen": [[74321, " cylinders", "normal", 0.00029981572879478335]]}, "loss": {"rwkv": 18.935372411667647, "qwen": 14.629545971606023}, "topk": {"rwkv": [59439, 812, 2.7507401682669297e-05, [[38332, 0.323782, " edges", false], [47253, 0.084554, " shapes", false], [30729, 0.052577, " edge", false], [57527, 0.036641, " versions", false], [4811, 0.036129, " to", false], [56215, 0.028999, " features", false], [56832, 0.026346, " patterns", false], [38541, 0.020935, " forms", false], [38905, 0.017084, " lines", false], [32229, 0.014818, " them", false]]], "qwen": [74321, 155, 0.00029981572879478335, [[12822, 0.516086, " edges", false], [4419, 0.114138, " features", false], [20816, 0.039735, " shapes", false], [10795, 0.018152, " versions", false], [311, 0.013885, " to", false], [12624, 0.011384, " patterns", false], [7586, 0.010593, " forms", false], [5335, 0.008431, " images", false], [76899, 0.00804, " blobs", false], [49031, 0.007564, " contours", false]]]}, "raw_delta": 0.23876571655273438, "tuned_delta": 0.24733750858331263}, {"byte_start": 4588, "byte_end": 4589, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "11.98%", "qwen": "8.56%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.5074355602264404]], "qwen": [[11, ",", "normal", 0.6220842599868774]]}, "loss": {"rwkv": 11.97549594487909, "qwen": 8.560225767948992}, "topk": {"rwkv": [45, 1, 0.5074355602264404, [[45, 0.507436, ",", false], [47, 0.07487, ".", false], [275, 0.068072, " (", false], [4715, 0.061727, " or", false], [21265, 0.057446, " and", false], [4596, 0.04451, " in", false], [4706, 0.040184, " of", false], [5346, 0.024133, "---", false], [32227, 0.022551, " that", false], [45395, 0.010373, " called", false]]], "qwen": [11, 1, 0.6220842599868774, [[11, 0.622084, ",", false], [476, 0.072416, " or", false], [13, 0.071301, ".", false], [320, 0.061127, " (", false], [323, 0.044242, " and", false], [304, 0.04152, " in", false], [315, 0.022199, " of", false], [429, 0.008502, " that", false], [4421, 0.007446, "---", false], [26, 0.005209, ";", false]]]}, "raw_delta": 0.18938279151916504, "tuned_delta": 0.1979545835497433}, {"byte_start": 4589, "byte_end": 4592, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 766, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"rwkv": "4.77% 4.77% 4.77%", "qwen": "2.07% 2.07% 2.07%"}, "model_tokens": {"rwkv": [[4715, " or", "normal", 0.45057412981987]], "qwen": [[476, " or", "normal", 0.7081467509269714]]}, "loss": {"rwkv": 4.766717013353834, "qwen": 2.0744988052614812}, "topk": {"rwkv": [4715, 1, 0.45057412981987, [[4715, 0.450574, " or", false], [21265, 0.14221, " and", false], [4596, 0.121982, " in", false], [21643, 0.053046, " etc", false], [40186, 0.021115, " which", false], [32227, 0.018409, " that", false], [4811, 0.014874, " to", false], [32487, 0.008585, " with", false], [4423, 0.007932, " as", false], [40085, 0.007516, " using", false]]], "qwen": [476, 1, 0.7081467509269714, [[476, 0.708147, " or", false], [323, 0.091256, " and", false], [304, 0.034837, " in", false], [4992, 0.033548, " etc", false], [892, 0.009402, " which", false], [429, 0.006675, " that", false], [3118, 0.005765, " based", false], [448, 0.005734, " with", false], [1667, 0.005297, " using", false], [438, 0.004923, " as", false]]]}, "raw_delta": 0.14928827683130902, "tuned_delta": 0.15786006886188728}, {"byte_start": 4592, "byte_end": 4595, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 767, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "32.87% 32.87% 32.87%", "qwen": "29.69% 29.69% 29.69%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.004255402367562056]], "qwen": [[304, " in", "normal", 0.007163698319345713]]}, "loss": {"rwkv": 32.87391043692299, "qwen": 29.687831506476456}, "topk": {"rwkv": [4596, 36, 0.004255402367562056, [[39193, 0.137982, " other", false], [63594, 0.124483, " generalized", false], [32074, 0.062221, " some", false], [38905, 0.025453, " lines", false], [31458, 0.020996, " more", false], [22590, 0.019826, " the", false], [30788, 0.019388, " even", false], [37865, 0.018238, " blobs", false], [57564, 0.014912, " whatever", false], [332, 0.011824, " a", false]]], "qwen": [304, 23, 0.007163698319345713, [[1008, 0.095454, " other", false], [76899, 0.049573, " blobs", false], [315, 0.041197, " of", false], [1045, 0.028895, " some", false], [2494, 0.028273, " something", false], [66117, 0.027925, " generalized", false], [20816, 0.020533, " shapes", false], [8820, 0.020296, " whatever", false], [438, 0.018271, " as", false], [12300, 0.016067, " faces", false]]]}, "raw_delta": 0.176673730214437, "tuned_delta": 0.18524552224501525}, {"byte_start": 4595, "byte_end": 4601, "display": {"text": " terms", "kind": "normal"}, "is_word": true, "word_id": 768, "word_key": " terms", "bytes_hex": "20 74 65 72 6d 73", "compression": {"rwkv": "10.19% 10.19% 10.19% 10.19% 10.19% 10.19%", "qwen": "10.86% 10.86% 10.86% 10.86% 10.86% 10.86%"}, "model_tokens": {"rwkv": [[39920, " terms", "normal", 0.03363630920648575]], "qwen": [[3793, " terms", "normal", 0.02695387974381447]]}, "loss": {"rwkv": 10.190912235446126, "qwen": 10.861173054709965}, "topk": {"rwkv": [39920, 7, 0.03363630920648575, [[32074, 0.252682, " some", false], [39193, 0.181931, " other", false], [22590, 0.094999, " the", false], [51832, 0.072975, " general", false], [332, 0.055862, " a", false], [31458, 0.03984, " more", false], [39920, 0.033636, " terms", false], [22226, 0.023774, " one", false], [53265, 0.016313, " various", false], [31370, 0.015086, " many", false]]], "qwen": [3793, 7, 0.02695387974381447, [[1045, 0.208606, " some", false], [279, 0.132075, " the", false], [1008, 0.123278, " other", false], [264, 0.050137, " a", false], [4586, 0.029927, " general", false], [220, 0.028146, " ", false], [3793, 0.026954, " terms", false], [54611, 0.019275, "variants", false], [947, 0.018864, "var", false], [803, 0.013371, " more", false]]]}, "raw_delta": -0.037167151769002316, "tuned_delta": -0.028595359738424066}, {"byte_start": 4601, "byte_end": 4604, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 769, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.15% 0.15% 0.15%", "qwen": "0.05% 0.05% 0.05%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9748835563659668]], "qwen": [[315, " of", "normal", 0.9919356107711792]]}, "loss": {"rwkv": 0.15262886988571386, "qwen": 0.04867343032269244}, "topk": {"rwkv": [4706, 1, 0.9748835563659668, [[4706, 0.974884, " of", false], [32227, 0.006181, " that", false], [31458, 0.00471, " more", false], [52906, 0.001592, " similar", false], [39193, 0.001341, " other", false], [31296, 0.000741, " like", false], [52693, 0.000488, " related", false], [56205, 0.000383, " familiar", false], [56466, 0.000291, " inspired", false], [22590, 0.000259, " the", false]]], "qwen": [315, 1, 0.9919356107711792, [[315, 0.991936, " of", false], [429, 0.002911, " that", false], [3118, 0.000341, " based", false], [4428, 0.000316, " similar", false], [803, 0.000269, " more", false], [5435, 0.000265, " related", false], [1075, 0.000195, " like", false], [15860, 0.000164, " involving", false], [1008, 0.000144, " other", false], [1602, 8.6e-05, " very", false]]]}, "raw_delta": 0.005764513586958248, "tuned_delta": 0.014336305617536496}, {"byte_start": 4604, "byte_end": 4609, "display": {"text": " SIFT", "kind": "normal"}, "is_word": true, "word_id": 770, "word_key": " sift", "bytes_hex": "20 53 49 46 54", "compression": {"rwkv": "45.65% 45.65% 45.65% 0.00% 0.00%", "qwen": "73.93% 73.93% 0.86% 0.86% 0.86%"}, "model_tokens": {"rwkv": [[4191, " SI", "normal", 0.0005048418533988297], [1023, "FT", "normal", 0.9994822144508362]], "qwen": [[328, " S", "normal", 0.00027484563179314137], [14292, "IFT", "normal", 0.8664654493331909]]}, "loss": {"rwkv": 27.39050732089366, "qwen": 30.089691130898576}, "topk": {"rwkv": [4191, 259, 0.0005048418533988297, [[332, 0.099233, " a", false], [22590, 0.072216, " the", false], [39193, 0.029142, " other", false], [31044, 0.027975, " hand", false], [38720, 0.027118, " human", false], [32074, 0.020387, " some", false], [63885, 0.013919, " statistical", false], [51725, 0.013622, " feature", false], [59767, 0.012094, " geometric", false], [56215, 0.01152, " features", false]]], "qwen": [328, 446, 0.00027484563179314137, [[279, 0.059039, " the", false], [3738, 0.05651, " human", false], [264, 0.042507, " a", false], [4419, 0.025916, " features", false], [4565, 0.022914, " feature", false], [2205, 0.020055, " local", false], [1045, 0.016433, " some", false], [1008, 0.014731, " other", false], [1894, 0.014299, " color", false], [4285, 0.014204, " simple", false]]]}, "raw_delta": -0.14967453181743626, "tuned_delta": -0.141102739786858}, {"byte_start": 4609, "byte_end": 4618, "display": {"text": " features", "kind": "normal"}, "is_word": true, "word_id": 771, "word_key": " features", "bytes_hex": "20 66 65 61 74 75 72 65 73", "compression": {"rwkv": "3.54% 3.54% 3.54% 3.54% 3.54% 3.54% 3.54% 3.54% 3.54%", "qwen": "1.16% 1.16% 1.16% 1.16% 1.16% 1.16% 1.16% 1.16% 1.16%"}, "model_tokens": {"rwkv": [[56215, " features", "normal", 0.17301976680755615]], "qwen": [[4419, " features", "normal", 0.5602641105651855]]}, "loss": {"rwkv": 3.5378589327355217, "qwen": 1.1608624703841681}, "topk": {"rwkv": [56215, 2, 0.17301976680755615, [[45, 0.186963, ",", false], [56215, 0.17302, " features", false], [275, 0.143896, " (", false], [4715, 0.07172, " or", false], [63458, 0.064991, " descriptors", false], [21265, 0.063587, " and", false], [47, 0.047308, ".", false], [5346, 0.034819, "---", false], [46, 0.026713, "-", false], [59940, 0.0221, " keypoints", false]]], "qwen": [4419, 1, 0.5602641105651855, [[4419, 0.560264, " features", false], [47517, 0.058171, " descriptors", false], [320, 0.049761, " (", false], [82, 0.040318, "s", false], [11, 0.039659, ",", false], [476, 0.036471, " or", false], [12681, 0.031961, "-like", false], [323, 0.01962, " and", false], [13, 0.019555, ".", false], [3501, 0.009528, " points", false]]]}, "raw_delta": 0.1318086716863844, "tuned_delta": 0.14038046371696267}, {"byte_start": 4618, "byte_end": 4619, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "20.57%", "qwen": "17.12%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.32082709670066833]], "qwen": [[13, ".", "normal", 0.3871019184589386]]}, "loss": {"rwkv": 20.56967538767467, "qwen": 17.115182417432173}, "topk": {"rwkv": [47, 2, 0.32082709670066833, [[45, 0.36196, ",", false], [47, 0.320827, ".", false], [275, 0.078872, " (", false], [5346, 0.051381, "---", false], [21265, 0.047438, " and", false], [4715, 0.037554, " or", false], [32227, 0.027323, " that", false], [4596, 0.008005, " in", false], [60, 0.007978, ";", false], [4706, 0.005888, " of", false]]], "qwen": [13, 1, 0.3871019184589386, [[13, 0.387102, ".", false], [11, 0.377043, ",", false], [320, 0.066533, " (", false], [323, 0.048637, " and", false], [476, 0.046631, " or", false], [4421, 0.016091, "---", false], [429, 0.010928, " that", false], [26, 0.009214, ";", false], [304, 0.005007, " in", false], [508, 0.002577, " [", false]]]}, "raw_delta": 0.19155776500701904, "tuned_delta": 0.2001295570375973}, {"byte_start": 4619, "byte_end": 4623, "display": {"text": " But", "kind": "normal"}, "is_word": true, "word_id": 772, "word_key": " but", "bytes_hex": "20 42 75 74", "compression": {"rwkv": "15.29% 15.29% 15.29% 15.29%", "qwen": "17.70% 17.70% 17.70% 17.70%"}, "model_tokens": {"rwkv": [[19555, " But", "normal", 0.03335017338395119]], "qwen": [[1988, " But", "normal", 0.019717730581760406]]}, "loss": {"rwkv": 15.286368353169191, "qwen": 17.701133758271173}, "topk": {"rwkv": [19555, 5, 0.03335017338395119, [[37453, 0.272282, " These", false], [20996, 0.05809, " The", false], [36918, 0.0496, " Later", false], [29894, 0.039383, " This", false], [19555, 0.03335, " But", false], [3913, 0.032863, " In", false], [29890, 0.032073, " Then", false], [19407, 0.026237, " All", false], [29421, 0.022944, " More", false], [37451, 0.022828, " There", false]]], "qwen": [1988, 10, 0.019717730581760406, [[4220, 0.179589, " These", false], [24885, 0.126057, " Later", false], [576, 0.057926, " The", false], [2619, 0.040932, " There", false], [2009, 0.036093, " All", false], [758, 0.033983, " In", false], [4398, 0.030353, " More", false], [5005, 0.028521, " Then", false], [1096, 0.026708, " This", false], [1988, 0.019718, " But", false]]]}, "raw_delta": -0.13390302658081055, "tuned_delta": -0.1253312345502323}, {"byte_start": 4623, "byte_end": 4629, "display": {"text": " today", "kind": "normal"}, "is_word": true, "word_id": 773, "word_key": " today", "bytes_hex": "20 74 6f 64 61 79", "compression": {"rwkv": "22.82% 22.82% 22.82% 22.82% 22.82% 22.82%", "qwen": "19.59% 19.59% 19.59% 19.59% 19.59% 19.59%"}, "model_tokens": {"rwkv": [[39971, " today", "normal", 0.0005062879645265639]], "qwen": [[3351, " today", "normal", 0.0014754984294995666]]}, "loss": {"rwkv": 22.823886389063677, "qwen": 19.592878424267994}, "topk": {"rwkv": [39971, 107, 0.0005062879645265639, [[22590, 0.115556, " the", false], [39936, 0.114644, " these", false], [45, 0.089872, ",", false], [4423, 0.055648, " as", false], [4596, 0.053503, " in", false], [32487, 0.031316, " with", false], [4601, 0.027264, " it", false], [39944, 0.024523, " those", false], [32465, 0.023059, " when", false], [32230, 0.020954, " then", false]]], "qwen": [3351, 61, 0.0014754984294995666, [[1493, 0.162007, " these", false], [279, 0.083008, " the", false], [11, 0.069522, ",", false], [678, 0.054504, " all", false], [1846, 0.04808, " those", false], [432, 0.040395, " it", false], [438, 0.032433, " as", false], [419, 0.031545, " this", false], [2711, 0.028393, " search", false], [304, 0.027728, " in", false]]]}, "raw_delta": 0.17916512489318848, "tuned_delta": 0.18773691692376673}, {"byte_start": 4629, "byte_end": 4633, "display": {"text": " all", "kind": "normal"}, "is_word": true, "word_id": 774, "word_key": " all", "bytes_hex": "20 61 6c 6c", "compression": {"rwkv": "23.67% 23.67% 23.67% 23.67%", "qwen": "24.88% 24.88% 24.88% 24.88%"}, "model_tokens": {"rwkv": [[21256, " all", "normal", 0.005297759082168341]], "qwen": [[678, " all", "normal", 0.004013643134385347]]}, "loss": {"rwkv": 23.669215514584554, "qwen": 24.877724703498696}, "topk": {"rwkv": [21256, 13, 0.005297759082168341, [[45, 0.489995, ",", false], [460, 0.2643, "'s", false], [22590, 0.055336, " the", false], [39934, 0.021747, " there", false], [4601, 0.021558, " it", false], [4858, 0.019624, " we", false], [30597, 0.01306, " deep", false], [39936, 0.0102, " these", false], [31461, 0.009053, " most", false], [47732, 0.007525, " vision", false]]], "qwen": [678, 13, 0.004013643134385347, [[11, 0.467636, ",", false], [594, 0.310312, "'s", false], [279, 0.045603, " the", false], [582, 0.021165, " we", false], [432, 0.014184, " it", false], [1052, 0.013138, " there", false], [5538, 0.010651, " deep", false], [1429, 0.01032, " most", false], [6366, 0.009914, " computer", false], [11129, 0.007534, " vision", false]]]}, "raw_delta": -0.06701397895812988, "tuned_delta": -0.05844218692755163}, {"byte_start": 4633, "byte_end": 4638, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 775, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "15.44% 15.44% 15.44% 15.44% 15.44%", "qwen": "12.47% 12.47% 12.47% 12.47% 12.47%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.013896853663027287]], "qwen": [[419, " this", "normal", 0.031515933573246]]}, "loss": {"rwkv": 15.441345359514685, "qwen": 12.469436997463111}, "topk": {"rwkv": [32234, 14, 0.013896853663027287, [[22590, 0.211601, " the", false], [4706, 0.135503, " of", false], [52224, 0.088675, " methods", false], [39936, 0.073791, " these", false], [55809, 0.047185, " computer", false], [62603, 0.039381, " successful", false], [32227, 0.034496, " that", false], [47732, 0.03381, " vision", false], [38961, 0.030639, " major", false], [39944, 0.024235, " those", false]]], "qwen": [419, 9, 0.031515933573246, [[315, 0.226157, " of", false], [279, 0.127321, " the", false], [6366, 0.115761, " computer", false], [429, 0.090816, " that", false], [1846, 0.039523, " those", false], [5413, 0.036473, " methods", false], [3598, 0.035435, " major", false], [1493, 0.033718, " these", false], [419, 0.031516, " this", false], [11129, 0.028523, " vision", false]]]}, "raw_delta": 0.16479759216308587, "tuned_delta": 0.17336938419366413}, {"byte_start": 4638, "byte_end": 4641, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 776, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "4.93% 4.93% 4.93%", "qwen": "7.06% 7.06% 7.06%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.4382253587245941]], "qwen": [[374, " is", "normal", 0.3087458312511444]]}, "loss": {"rwkv": 4.931086565538449, "qwen": 7.064618774005778}, "topk": {"rwkv": [4600, 1, 0.4382253587245941, [[4600, 0.438225, " is", false], [21800, 0.212744, " has", false], [32499, 0.052106, " work", false], [39620, 0.047211, " seems", false], [57103, 0.026847, " research", false], [38720, 0.020936, " human", false], [31615, 0.01203, " pale", false], [45829, 0.010238, " effort", false], [38932, 0.008502, " looks", false], [22748, 0.007898, " was", false]]], "qwen": [374, 1, 0.3087458312511444, [[374, 0.308746, " is", false], [702, 0.20507, " has", false], [6540, 0.059443, " knowledge", false], [3738, 0.055794, " human", false], [975, 0.049138, " work", false], [3412, 0.038615, " research", false], [5041, 0.020935, " effort", false], [2711, 0.015505, " search", false], [11129, 0.013739, " vision", false], [15039, 0.007819, " searching", false]]]}, "raw_delta": -0.11830814679463703, "tuned_delta": -0.10973635476405878}, {"byte_start": 4641, "byte_end": 4651, "display": {"text": " discarded", "kind": "normal"}, "is_word": true, "word_id": 777, "word_key": " discarded", "bytes_hex": "20 64 69 73 63 61 72 64 65 64", "compression": {"rwkv": "11.38% 11.38% 11.38% 11.38% 11.38% 11.38% 11.38% 11.38% 11.38% 11.38%", "qwen": "11.54% 11.54% 11.54% 11.54% 11.54% 11.54% 11.54% 11.54% 11.54% 11.54%"}, "model_tokens": {"rwkv": [[59536, " discarded", "normal", 0.001785344211384654]], "qwen": [[43210, " discarded", "normal", 0.0016657938249409199]]}, "loss": {"rwkv": 11.383765557014474, "qwen": 11.536967702403063}, "topk": {"rwkv": [59536, 92, 0.001785344211384654, [[332, 0.061481, " a", false], [30666, 0.042728, " done", false], [45290, 0.038686, " behind", false], [38319, 0.03661, " dwarf", false], [62161, 0.033108, " irrelevant", false], [31968, 0.025987, " seen", false], [52094, 0.023844, " largely", false], [56738, 0.023731, " obsolete", false], [31323, 0.02197, " long", false], [4596, 0.021353, " in", false]]], "qwen": [43210, 93, 0.0016657938249409199, [[2814, 0.106711, " done", false], [46066, 0.081737, " obsolete", false], [264, 0.044212, " a", false], [39715, 0.026981, " irrelevant", false], [13771, 0.026165, " largely", false], [3884, 0.024434, " seen", false], [1660, 0.023346, " being", false], [12575, 0.021129, " replaced", false], [1632, 0.015291, " well", false], [6509, 0.014365, " considered", false]]]}, "raw_delta": -0.008495330810546875, "tuned_delta": 7.646122003137322e-05}, {"byte_start": 4651, "byte_end": 4652, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "39.45%", "qwen": "45.59%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.11266692727804184]], "qwen": [[13, ".", "normal", 0.07983085513114929]]}, "loss": {"rwkv": 39.44869252430759, "qwen": 45.58637497176933}, "topk": {"rwkv": [47, 3, 0.11266692727804184, [[4596, 0.366475, " in", false], [45, 0.223278, ",", false], [47, 0.112667, ".", false], [21265, 0.099154, " and", false], [4423, 0.083951, " as", false], [21700, 0.02073, " for", false], [60, 0.018032, ";", false], [5346, 0.015629, "---", false], [51018, 0.011631, " because", false], [4450, 0.007607, " by", false]]], "qwen": [13, 4, 0.07983085513114929, [[304, 0.359606, " in", false], [11, 0.254916, ",", false], [323, 0.151327, " and", false], [13, 0.079831, ".", false], [438, 0.028933, " as", false], [4421, 0.024645, "---", false], [369, 0.020899, " for", false], [26, 0.015377, ";", false], [553, 0.012128, " by", false], [25, 0.007039, ":", false]]]}, "raw_delta": -0.3403453826904297, "tuned_delta": -0.33177359065985146}, {"byte_start": 4652, "byte_end": 4659, "display": {"text": " Modern", "kind": "normal"}, "is_word": true, "word_id": 778, "word_key": " modern", "bytes_hex": "20 4d 6f 64 65 72 6e", "compression": {"rwkv": "10.71% 10.71% 10.71% 10.71% 10.71% 10.71% 10.71%", "qwen": "10.06% 10.06% 10.06% 10.06% 10.06% 10.06% 10.06%"}, "model_tokens": {"rwkv": [[44593, " Modern", "normal", 0.01586654782295227]], "qwen": [[18265, " Modern", "normal", 0.020121648907661438]]}, "loss": {"rwkv": 10.707502256597774, "qwen": 10.062692617507867}, "topk": {"rwkv": [44593, 13, 0.01586654782295227, [[50342, 0.261398, " Instead", false], [20996, 0.157116, " The", false], [45032, 0.039057, " Vision", false], [28753, 0.030913, " Deep", false], [3913, 0.030549, " In", false], [3918, 0.027309, " It", false], [36607, 0.026227, " Early", false], [37451, 0.020768, " There", false], [54932, 0.017308, " Computer", false], [50438, 0.017166, " Methods", false]]], "qwen": [18265, 8, 0.020121648907661438, [[12090, 0.211263, " Instead", false], [576, 0.121408, " The", false], [30441, 0.099468, " Vision", false], [2619, 0.037192, " There", false], [758, 0.035085, " In", false], [18183, 0.031522, " Deep", false], [1084, 0.020505, " It", false], [18265, 0.020122, " Modern", false], [17407, 0.018563, " Computer", false], [18801, 0.015824, " Methods", false]]]}, "raw_delta": 0.03575583866664345, "tuned_delta": 0.0443276306972217}, {"byte_start": 4659, "byte_end": 4664, "display": {"text": " deep", "kind": "normal"}, "is_word": true, "word_id": 779, "word_key": " deep", "bytes_hex": "20 64 65 65 70", "compression": {"rwkv": "14.77% 14.77% 14.77% 14.77% 14.77%", "qwen": "11.38% 11.38% 11.38% 11.38% 11.38%"}, "model_tokens": {"rwkv": [[30597, " deep", "normal", 0.01665862463414669]], "qwen": [[5538, " deep", "normal", 0.042633719742298126]]}, "loss": {"rwkv": 14.765082059097983, "qwen": 11.379653451832345}, "topk": {"rwkv": [30597, 7, 0.01665862463414669, [[52224, 0.420391, " methods", false], [55809, 0.195413, " computer", false], [47732, 0.122881, " vision", false], [53087, 0.054055, " systems", false], [61590, 0.051621, " approaches", false], [57103, 0.025345, " research", false], [30597, 0.016659, " deep", false], [38744, 0.009217, " image", false], [45, 0.008537, ",", false], [62633, 0.00787, " techniques", false]]], "qwen": [5538, 6, 0.042633719742298126, [[5413, 0.268403, " methods", false], [6366, 0.264064, " computer", false], [11129, 0.13221, " vision", false], [5942, 0.080928, " systems", false], [19827, 0.067449, " approaches", false], [5538, 0.042634, " deep", false], [12538, 0.016512, " techniques", false], [975, 0.010687, " work", false], [3412, 0.010184, " research", false], [25185, 0.006606, " algorithms", false]]]}, "raw_delta": 0.1877280235290527, "tuned_delta": 0.19629981555963097}, {"byte_start": 4664, "byte_end": 4673, "display": {"text": "-learning", "kind": "normal"}, "is_word": true, "word_id": 780, "word_key": "-learning", "bytes_hex": "2d 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "45.93% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10%", "qwen": "3.60% 3.60% 3.60% 3.60% 3.60% 3.60% 3.60% 3.60% 3.60%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.0782984271645546], [54126, "learning", "normal", 0.9556092023849487]], "qwen": [[70756, "-learning", "normal", 0.16620495915412903]]}, "loss": {"rwkv": 5.194273527072148, "qwen": 3.5957841227348726}, "topk": {"rwkv": [46, 2, 0.0782984271645546, [[56537, 0.619999, " learning", false], [46, 0.078298, "-", false], [63421, 0.061007, " convolution", false], [46658, 0.059126, " neural", false], [47732, 0.048795, " vision", false], [56705, 0.03477, " networks", false], [52224, 0.018726, " methods", false], [19593, 0.016758, " CNN", false], [47734, 0.009307, " visual", false], [52307, 0.008272, " network", false]]], "qwen": [70756, 2, 0.16620495915412903, [[6832, 0.627562, " learning", false], [70756, 0.166205, "-learning", false], [29728, 0.074835, " neural", false], [14155, 0.035269, " networks", false], [55712, 0.022559, " convolution", false], [11129, 0.014643, " vision", false], [5413, 0.007685, " methods", false], [12, 0.005075, "-", false], [3922, 0.004662, " network", false], [52457, 0.004097, " nets", false]]]}, "raw_delta": 0.08863907390170632, "tuned_delta": 0.09721086593228456}, {"byte_start": 4673, "byte_end": 4680, "display": {"text": " neural", "kind": "normal"}, "is_word": true, "word_id": 781, "word_key": " neural", "bytes_hex": "20 6e 65 75 72 61 6c", "compression": {"rwkv": "16.58% 16.58% 16.58% 16.58% 16.58% 16.58% 16.58%", "qwen": "16.49% 16.49% 16.49% 16.49% 16.49% 16.49% 16.49%"}, "model_tokens": {"rwkv": [[46658, " neural", "normal", 0.0016307620098814368]], "qwen": [[29728, " neural", "normal", 0.0016614794731140137]]}, "loss": {"rwkv": 16.58455236736196, "qwen": 16.488063957990402}, "topk": {"rwkv": [46658, 21, 0.0016307620098814368, [[52224, 0.451256, " methods", false], [46, 0.134434, "-", false], [61590, 0.09121, " approaches", false], [47732, 0.086641, " vision", false], [53087, 0.081947, " systems", false], [55809, 0.04924, " computer", false], [62633, 0.015111, " techniques", false], [46587, 0.010419, " models", false], [57103, 0.008534, " research", false], [37810, 0.008078, " based", false]]], "qwen": [29728, 21, 0.0016614794731140137, [[5413, 0.297083, " methods", false], [5980, 0.277579, "-based", false], [5942, 0.09559, " systems", false], [19827, 0.068918, " approaches", false], [11129, 0.056684, " vision", false], [6366, 0.050089, " computer", false], [12538, 0.027737, " techniques", false], [3118, 0.026534, " based", false], [4119, 0.01504, " models", false], [77235, 0.009815, " architectures", false]]]}, "raw_delta": 0.005350453513009112, "tuned_delta": 0.01392224554358736}, {"byte_start": 4680, "byte_end": 4689, "display": {"text": " networks", "kind": "normal"}, "is_word": true, "word_id": 782, "word_key": " networks", "bytes_hex": "20 6e 65 74 77 6f 72 6b 73", "compression": {"rwkv": "0.97% 0.97% 0.97% 0.97% 0.97% 0.97% 0.97% 0.97% 0.97%", "qwen": "1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12%"}, "model_tokens": {"rwkv": [[56705, " networks", "normal", 0.6159466505050659]], "qwen": [[14155, " networks", "normal", 0.5725714564323425]]}, "loss": {"rwkv": 0.9666495092761881, "qwen": 1.1173226736703195}, "topk": {"rwkv": [56705, 1, 0.6159466505050659, [[56705, 0.615947, " networks", false], [46, 0.126019, "-", false], [52307, 0.115085, " network", false], [31510, 0.090473, " nets", false], [22166, 0.016425, " net", false], [53087, 0.00905, " systems", false], [47732, 0.007823, " vision", false], [61590, 0.004813, " approaches", false], [52224, 0.004112, " methods", false], [64833, 0.002053, " architectures", false]]], "qwen": [14155, 1, 0.5725714564323425, [[14155, 0.572571, " networks", false], [3922, 0.180329, " network", false], [56732, 0.095167, "-network", false], [52457, 0.089963, " nets", false], [4179, 0.025765, " net", false], [66496, 0.019738, "-net", false], [77235, 0.002377, " architectures", false], [5413, 0.001393, " methods", false], [4119, 0.001261, " models", false], [11129, 0.000954, " vision", false]]]}, "raw_delta": -0.008355094326867, "tuned_delta": 0.00021669770371124907}, {"byte_start": 4689, "byte_end": 4693, "display": {"text": " use", "kind": "normal"}, "is_word": true, "word_id": 783, "word_key": " use", "bytes_hex": "20 75 73 65", "compression": {"rwkv": "16.70% 16.70% 16.70% 16.70%", "qwen": "20.07% 20.07% 20.07% 20.07%"}, "model_tokens": {"rwkv": [[22681, " use", "normal", 0.024639911949634552]], "qwen": [[990, " use", "normal", 0.011658454313874245]]}, "loss": {"rwkv": 16.69525022903732, "qwen": 20.070248518484753}, "topk": {"rwkv": [22681, 9, 0.024639911949634552, [[45, 0.127213, ",", false], [21286, 0.116796, " are", false], [31059, 0.107893, " have", false], [38877, 0.066003, " learn", false], [21413, 0.041754, " can", false], [4491, 0.038278, " do", false], [32227, 0.031818, " that", false], [32499, 0.024642, " work", false], [22681, 0.02464, " use", false], [32187, 0.019137, " take", false]]], "qwen": [990, 16, 0.011658454313874245, [[525, 0.195085, " are", false], [614, 0.08028, " have", false], [11, 0.079562, ",", false], [369, 0.045916, " for", false], [653, 0.037626, " do", false], [429, 0.036058, " that", false], [646, 0.035558, " can", false], [3960, 0.028118, " learn", false], [8193, 0.024127, " produce", false], [975, 0.020111, " work", false]]]}, "raw_delta": -0.18714964389801025, "tuned_delta": -0.178577851867432}, {"byte_start": 4693, "byte_end": 4698, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 784, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"rwkv": "15.33% 15.33% 15.33% 15.33% 15.33%", "qwen": "14.56% 14.56% 14.56% 14.56% 14.56%"}, "model_tokens": {"rwkv": [[31581, " only", "normal", 0.014325984753668308]], "qwen": [[1172, " only", "normal", 0.01767251081764698]]}, "loss": {"rwkv": 15.328634809445234, "qwen": 14.555872043629412}, "topk": {"rwkv": [31581, 8, 0.014325984753668308, [[52195, 0.390215, " massive", false], [332, 0.05208, " a", false], [63421, 0.047013, " convolution", false], [59988, 0.031819, " massively", false], [56640, 0.026825, " millions", false], [22590, 0.02301, " the", false], [31118, 0.019377, " huge", false], [31581, 0.014326, " only", false], [56125, 0.013456, " enormous", false], [32386, 0.013305, " very", false]]], "qwen": [1172, 14, 0.01767251081764698, [[10951, 0.12976, " massive", false], [264, 0.099447, " a", false], [34447, 0.044404, " computation", false], [1657, 0.032764, " many", false], [1753, 0.030882, " much", false], [1602, 0.027839, " very", false], [6765, 0.023795, " huge", false], [3460, 0.022523, " large", false], [902, 0.02079, " no", false], [279, 0.020385, " the", false]]]}, "raw_delta": 0.04285106658935545, "tuned_delta": 0.051422858619933697}, {"byte_start": 4698, "byte_end": 4702, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 785, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "10.64% 10.64% 10.64% 10.64%", "qwen": "13.86% 13.86% 13.86% 13.86%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.09487435966730118]], "qwen": [[279, " the", "normal", 0.04623117297887802]]}, "loss": {"rwkv": 10.637058162804367, "qwen": 13.859344457418173}, "topk": {"rwkv": [22590, 2, 0.09487435966730118, [[332, 0.18061, " a", false], [22590, 0.094874, " the", false], [52195, 0.076957, " massive", false], [63421, 0.053056, " convolution", false], [32386, 0.039989, " very", false], [63885, 0.02103, " statistical", false], [47284, 0.018884, " simple", false], [62577, 0.018354, " statistics", false], [22363, 0.017736, " raw", false], [22226, 0.016553, " one", false]]], "qwen": [279, 4, 0.04623117297887802, [[34447, 0.191654, " computation", false], [264, 0.084767, " a", false], [10951, 0.058609, " massive", false], [279, 0.046231, " the", false], [825, 0.040496, " one", false], [2205, 0.032466, " local", false], [15751, 0.027486, " pixels", false], [1602, 0.020954, " very", false], [4285, 0.019496, " simple", false], [1378, 0.018379, " two", false]]]}, "raw_delta": -0.17868149280548096, "tuned_delta": -0.1701097007749027}, {"byte_start": 4702, "byte_end": 4710, "display": {"text": " notions", "kind": "normal"}, "is_word": true, "word_id": 786, "word_key": " notions", "bytes_hex": "20 6e 6f 74 69 6f 6e 73", "compression": {"rwkv": "18.74% 18.74% 18.74% 18.74% 18.74% 18.74% 18.74% 18.74%", "qwen": "21.11% 21.11% 21.11% 21.11% 21.11% 21.11% 21.11% 21.11%"}, "model_tokens": {"rwkv": [[52326, " notions", "normal", 0.00024144651251845062]], "qwen": [[58582, " notions", "normal", 8.57186532812193e-05]]}, "loss": {"rwkv": 18.738128949046104, "qwen": 21.109423589359373}, "topk": {"rwkv": [52326, 396, 0.00024144651251845062, [[22363, 0.082594, " raw", false], [63370, 0.056164, " computation", false], [52195, 0.048287, " massive", false], [63885, 0.035906, " statistical", false], [31461, 0.034227, " most", false], [37812, 0.027825, " basic", false], [30579, 0.026856, " data", false], [62577, 0.022559, " statistics", false], [32386, 0.021313, " very", false], [31937, 0.013605, " same", false]]], "qwen": [58582, 710, 8.57186532812193e-05, [[7112, 0.240242, " raw", false], [1946, 0.050263, " input", false], [1429, 0.04968, " most", false], [34447, 0.040505, " computation", false], [821, 0.030689, " data", false], [15751, 0.021541, " pixels", false], [44548, 0.013875, " simplest", false], [54480, 0.01277, " computational", false], [2550, 0.012747, " output", false], [1995, 0.011851, " information", false]]]}, "raw_delta": -0.1314924955368042, "tuned_delta": -0.12292070350622596}, {"byte_start": 4710, "byte_end": 4713, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 787, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "1.01% 1.01% 1.01%", "qwen": "0.50% 0.50% 0.50%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.8455100655555725]], "qwen": [[315, " of", "normal", 0.9205737113952637]]}, "loss": {"rwkv": 1.009698677705492, "qwen": 0.4974787177974093}, "topk": {"rwkv": [4706, 1, 0.8455100655555725, [[4706, 0.84551, " of", false], [32227, 0.097821, " that", false], [4404, 0.004486, " ``", false], [21265, 0.003961, " and", false], [30917, 0.003564, " from", false], [56412, 0.002612, " implicit", false], [38547, 0.002136, " found", false], [52112, 0.002092, " learned", false], [45, 0.002004, ",", false], [46650, 0.001869, " needed", false]]], "qwen": [315, 1, 0.9205737113952637, [[315, 0.920574, " of", false], [429, 0.042324, " that", false], [9902, 0.005987, " ``", false], [323, 0.004754, " and", false], [11, 0.001434, ",", false], [504, 0.001303, " from", false], [304, 0.001071, " in", false], [2500, 0.000902, " available", false], [1730, 0.000823, " found", false], [3897, 0.000765, " provided", false]]]}, "raw_delta": 0.028403505682945255, "tuned_delta": 0.0369752977135235}, {"byte_start": 4713, "byte_end": 4725, "display": {"text": " convolution", "kind": "normal"}, "is_word": true, "word_id": 788, "word_key": " convolution", "bytes_hex": "20 63 6f 6e 76 6f 6c 75 74 69 6f 6e", "compression": {"rwkv": "2.86% 2.86% 2.86% 2.86% 2.86% 2.86% 2.86% 2.86% 2.86% 2.86% 2.86% 2.86%", "qwen": "7.81% 7.81% 7.81% 7.81% 7.81% 7.81% 7.81% 7.81% 7.81% 7.81% 7.81% 7.81%"}, "model_tokens": {"rwkv": [[63421, " convolution", "normal", 0.14818428456783295]], "qwen": [[55712, " convolution", "normal", 0.005531262140721083]]}, "loss": {"rwkv": 2.864726480931861, "qwen": 7.810599254878239}, "topk": {"rwkv": [63421, 1, 0.14818428456783295, [[63421, 0.148184, " convolution", false], [4404, 0.105011, " ``", false], [46826, 0.047699, " pixels", false], [38332, 0.043432, " edges", false], [332, 0.040121, " a", false], [56324, 0.03039, " gradient", false], [59770, 0.018632, " gradients", false], [62554, 0.017616, " similarity", false], [39289, 0.015778, " pixel", false], [22590, 0.015391, " the", false]]], "qwen": [55712, 21, 0.005531262140721083, [[15751, 0.210336, " pixels", false], [9902, 0.163015, " ``", false], [1946, 0.080249, " input", false], [12955, 0.049233, " pixel", false], [11127, 0.038684, " inputs", false], [821, 0.02286, " data", false], [264, 0.022442, " a", false], [2168, 0.017997, " image", false], [5335, 0.01565, " images", false], [13617, 0.014336, " layers", false]]]}, "raw_delta": -0.2742574214935303, "tuned_delta": -0.26568562946295204}, {"byte_start": 4725, "byte_end": 4729, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 789, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "3.22% 3.22% 3.22% 3.22%", "qwen": "2.59% 2.59% 2.59% 2.59%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.4923631250858307]], "qwen": [[323, " and", "normal", 0.563117504119873]]}, "loss": {"rwkv": 3.2228172910483432, "qwen": 2.5890375750044}, "topk": {"rwkv": [21265, 1, 0.4923631250858307, [[21265, 0.492363, " and", false], [116, 0.196919, "s", false], [45, 0.143742, ",", false], [1744, 0.079053, "al", false], [275, 0.020357, " (", false], [32487, 0.007552, " with", false], [5346, 0.006894, "---", false], [4706, 0.006807, " of", false], [4596, 0.004937, " in", false], [4715, 0.003917, " or", false]]], "qwen": [323, 1, 0.563117504119873, [[323, 0.563118, " and", false], [11, 0.249865, ",", false], [278, 0.088523, "al", false], [320, 0.033634, " (", false], [448, 0.007711, " with", false], [304, 0.007127, " in", false], [315, 0.006006, " of", false], [4421, 0.005023, "---", false], [311, 0.003296, " to", false], [476, 0.002801, " or", false]]]}, "raw_delta": 0.03514420986175537, "tuned_delta": 0.04371600189233362}, {"byte_start": 4729, "byte_end": 4737, "display": {"text": " certain", "kind": "normal"}, "is_word": true, "word_id": 790, "word_key": " certain", "bytes_hex": "20 63 65 72 74 61 69 6e", "compression": {"rwkv": "20.01% 20.01% 20.01% 20.01% 20.01% 20.01% 20.01% 20.01%", "qwen": "22.03% 22.03% 22.03% 22.03% 22.03% 22.03% 22.03% 22.03%"}, "model_tokens": {"rwkv": [[51161, " certain", "normal", 0.00014390598516911268]], "qwen": [[3654, " certain", "normal", 5.696467269444838e-05]]}, "loss": {"rwkv": 20.00612263732742, "qwen": 22.0305820154288}, "topk": {"rwkv": [51161, 315, 0.00014390598516911268, [[52513, 0.516895, " pooling", false], [56324, 0.021, " gradient", false], [30218, 0.01963, " back", false], [46528, 0.018212, " matrix", false], [22590, 0.017681, " the", false], [61531, 0.01542, " activation", false], [4706, 0.012175, " of", false], [22073, 0.01208, " max", false], [46442, 0.012005, " linear", false], [332, 0.011744, " a", false]]], "qwen": [3654, 512, 5.696467269444838e-05, [[74410, 0.323474, " pooling", false], [1182, 0.152139, " back", false], [15099, 0.053239, " activation", false], [1932, 0.031181, " max", false], [7608, 0.024382, " rect", false], [315, 0.020933, " of", false], [20169, 0.020894, " gradient", false], [279, 0.015892, " the", false], [2205, 0.01021, " local", false], [2477, 0.009828, " non", false]]]}, "raw_delta": -0.1122598648071289, "tuned_delta": -0.10368807277655066}, {"byte_start": 4737, "byte_end": 4743, "display": {"text": " kinds", "kind": "normal"}, "is_word": true, "word_id": 791, "word_key": " kinds", "bytes_hex": "20 6b 69 6e 64 73", "compression": {"rwkv": "7.19% 7.19% 7.19% 7.19% 7.19% 7.19%", "qwen": "7.10% 7.10% 7.10% 7.10% 7.10% 7.10%"}, "model_tokens": {"rwkv": [[38841, " kinds", "normal", 0.09110265225172043]], "qwen": [[12829, " kinds", "normal", 0.09435734152793884]]}, "loss": {"rwkv": 7.185297566927454, "qwen": 7.095252467096338}, "topk": {"rwkv": [38841, 2, 0.09110265225172043, [[39193, 0.10053, " other", false], [38841, 0.091103, " kinds", false], [40050, 0.085254, " types", false], [38541, 0.050381, " forms", false], [47284, 0.044576, " simple", false], [57520, 0.03626, " variants", false], [37812, 0.029429, " basic", false], [64481, 0.01774, " mathematical", false], [65135, 0.01715, " generalization", false], [46442, 0.015364, " linear", false]]], "qwen": [12829, 2, 0.09435734152793884, [[1008, 0.125553, " other", false], [12829, 0.094357, " kinds", false], [4494, 0.07733, " types", false], [15099, 0.043503, " activation", false], [4285, 0.025572, " simple", false], [13482, 0.019895, " linear", false], [7525, 0.018981, " operations", false], [13617, 0.018745, " layers", false], [2477, 0.016965, " non", false], [6770, 0.016653, " basic", false]]]}, "raw_delta": 0.004993160565694155, "tuned_delta": 0.013564952596272403}, {"byte_start": 4743, "byte_end": 4746, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 792, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.01% 0.01% 0.01%", "qwen": "0.01% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9987161159515381]], "qwen": [[315, " of", "normal", 0.99803227186203]]}, "loss": {"rwkv": 0.0077506847988839086, "qwen": 0.011840085975758403}, "topk": {"rwkv": [4706, 1, 0.9987161159515381, [[4706, 0.998716, " of", false], [21265, 0.000264, " and", false], [275, 0.000172, " (", false], [45, 4.1e-05, ",", false], [4715, 3.8e-05, " or", false], [46442, 2.2e-05, " linear", false], [63421, 1.9e-05, " convolution", false], [4588, 1.9e-05, " if", false], [267, 1.8e-05, "  ", false], [59751, 1.4e-05, " functions", false]]], "qwen": [315, 1, 0.99803227186203, [[315, 0.998032, " of", false], [323, 0.000492, " and", false], [320, 0.000466, " (", false], [476, 0.000258, " or", false], [11, 0.000107, ",", false], [198, 5.8e-05, "\n", false], [220, 2.7e-05, " ", false], [4421, 1.4e-05, "---", false], [369, 1.3e-05, " for", false], [389, 1.2e-05, " on", false]]]}, "raw_delta": -0.00022676455167432627, "tuned_delta": 0.008345027478903921}, {"byte_start": 4746, "byte_end": 4758, "display": {"text": " invariances", "kind": "normal"}, "is_word": true, "word_id": 793, "word_key": " invariances", "bytes_hex": "20 69 6e 76 61 72 69 61 6e 63 65 73", "compression": {"rwkv": "15.22% 15.22% 15.22% 15.22% 15.22% 15.22% 15.22% 8.68% 8.68% 8.68% 8.68% 8.68%", "qwen": "45.30% 45.30% 45.30% 0.94% 0.94% 0.94% 5.83% 5.83% 5.83% 5.83% 5.83% 5.83%"}, "model_tokens": {"rwkv": [[46326, " invari", "normal", 0.002731385873630643], [33764, "ances", "normal", 0.09060946851968765]], "qwen": [[304, " in", "normal", 0.0005338663468137383], [947, "var", "normal", 0.855250895023346], [21813, "iances", "normal", 0.14363746345043182]]}, "loss": {"rwkv": 12.492085966030738, "qwen": 14.475323252503442}, "topk": {"rwkv": [46326, 55, 0.002731385873630643, [[52513, 0.215602, " pooling", false], [61531, 0.075048, " activation", false], [51743, 0.038729, " filters", false], [31333, 0.029012, " loss", false], [60060, 0.028117, " nonlinear", false], [22184, 0.024564, " non", false], [46442, 0.016425, " linear", false], [51725, 0.015429, " feature", false], [60342, 0.013442, " recurrent", false], [46528, 0.013061, " matrix", false]]], "qwen": [304, 149, 0.0005338663468137383, [[74410, 0.326134, " pooling", false], [15099, 0.094545, " activation", false], [2477, 0.030159, " non", false], [13617, 0.025877, " layers", false], [73998, 0.020388, " nonlinear", false], [1182, 0.019519, " back", false], [2205, 0.01408, " local", false], [6193, 0.014002, " layer", false], [13482, 0.013913, " linear", false], [20169, 0.012127, " gradient", false]]]}, "raw_delta": -0.10997402667999263, "tuned_delta": -0.10140223464941439}, {"byte_start": 4758, "byte_end": 4759, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "21.98%", "qwen": "22.09%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.2971969246864319]], "qwen": [[11, ",", "normal", 0.29383400082588196]]}, "loss": {"rwkv": 21.9785572635428, "qwen": 22.086583866116}, "topk": {"rwkv": [45, 1, 0.2971969246864319, [[45, 0.297197, ",", false], [47, 0.152599, ".", false], [4811, 0.123485, " to", false], [32227, 0.102124, " that", false], [275, 0.093389, " (", false], [5346, 0.036716, "---", false], [21265, 0.035848, " and", false], [4596, 0.017245, " in", false], [4706, 0.014828, " of", false], [60, 0.01097, ";", false]]], "qwen": [11, 1, 0.29383400082588196, [[11, 0.293834, ",", false], [311, 0.188356, " to", false], [13, 0.157803, ".", false], [320, 0.106901, " (", false], [4421, 0.052737, "---", false], [323, 0.043261, " and", false], [304, 0.021859, " in", false], [315, 0.020711, " of", false], [429, 0.014442, " that", false], [369, 0.013225, " for", false]]]}, "raw_delta": -0.005990266799926758, "tuned_delta": 0.0025815252306514904}, {"byte_start": 4759, "byte_end": 4763, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 794, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "4.39% 4.39% 4.39% 4.39%", "qwen": "3.81% 3.81% 3.81% 3.81%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.3746629059314728]], "qwen": [[323, " and", "normal", 0.4295869469642639]]}, "loss": {"rwkv": 4.385144838639549, "qwen": 3.8093060776712857}, "topk": {"rwkv": [21265, 1, 0.3746629059314728, [[21265, 0.374663, " and", false], [21400, 0.168011, " but", false], [40186, 0.054604, " which", false], [32139, 0.051539, " such", false], [32487, 0.02725, " with", false], [53356, 0.025751, " without", false], [22187, 0.020457, " not", false], [4423, 0.014145, " as", false], [31296, 0.013973, " like", false], [22797, 0.012327, " yet", false]]], "qwen": [323, 1, 0.4295869469642639, [[323, 0.429587, " and", false], [892, 0.107556, " which", false], [2041, 0.049767, " without", false], [448, 0.047513, " with", false], [1741, 0.036292, " such", false], [714, 0.035953, " but", false], [438, 0.015502, " as", false], [3156, 0.012447, " along", false], [304, 0.011674, " in", false], [311, 0.011388, " to", false]]]}, "raw_delta": 0.031931281089782715, "tuned_delta": 0.040503073120360965}, {"byte_start": 4763, "byte_end": 4771, "display": {"text": " perform", "kind": "normal"}, "is_word": true, "word_id": 795, "word_key": " perform", "bytes_hex": "20 70 65 72 66 6f 72 6d", "compression": {"rwkv": "12.19% 12.19% 12.19% 12.19% 12.19% 12.19% 12.19% 12.19%", "qwen": "10.87% 10.87% 10.87% 10.87% 10.87% 10.87% 10.87% 10.87%"}, "model_tokens": {"rwkv": [[52446, " perform", "normal", 0.004482059273868799]], "qwen": [[2736, " perform", "normal", 0.008039688691496849]]}, "loss": {"rwkv": 12.186828226259308, "qwen": 10.872882923450586}, "topk": {"rwkv": [52446, 38, 0.004482059273868799, [[32232, 0.14487, " they", false], [39936, 0.089294, " these", false], [22590, 0.065345, " the", false], [4491, 0.037091, " do", false], [21286, 0.032853, " are", false], [22797, 0.0274, " yet", false], [31059, 0.025442, " have", false], [38877, 0.025026, " learn", false], [39944, 0.020124, " those", false], [4596, 0.019057, " in", false]]], "qwen": [2736, 27, 0.008039688691496849, [[807, 0.101894, " they", false], [1493, 0.078591, " these", false], [525, 0.053959, " are", false], [279, 0.049706, " the", false], [653, 0.038032, " do", false], [614, 0.034809, " have", false], [3960, 0.026716, " learn", false], [678, 0.021493, " all", false], [990, 0.018424, " use", false], [304, 0.014912, " in", false]]]}, "raw_delta": 0.07286059856414795, "tuned_delta": 0.08143239059472619}, {"byte_start": 4771, "byte_end": 4776, "display": {"text": " much", "kind": "normal"}, "is_word": true, "word_id": 796, "word_key": " much", "bytes_hex": "20 6d 75 63 68", "compression": {"rwkv": "13.41% 13.41% 13.41% 13.41% 13.41%", "qwen": "12.78% 12.78% 12.78% 12.78% 12.78%"}, "model_tokens": {"rwkv": [[31466, " much", "normal", 0.024248937144875526]], "qwen": [[1753, " much", "normal", 0.02893921546638012]]}, "loss": {"rwkv": 13.412555458264581, "qwen": 12.777076123673485}, "topk": {"rwkv": [31466, 9, 0.024248937144875526, [[22590, 0.094189, " the", false], [39931, 0.087639, " their", false], [32386, 0.046725, " very", false], [32458, 0.044061, " well", false], [50892, 0.04163, " amazing", false], [332, 0.038638, " a", false], [52195, 0.03686, " massive", false], [62478, 0.029377, " remarkably", false], [31466, 0.024249, " much", false], [21256, 0.021847, " all", false]]], "qwen": [1753, 6, 0.02893921546638012, [[10951, 0.108828, " massive", false], [264, 0.058312, " a", false], [34447, 0.051205, " computation", false], [279, 0.036593, " the", false], [82599, 0.032326, " computations", false], [1753, 0.028939, " much", false], [678, 0.028153, " all", false], [1172, 0.024633, " only", false], [63707, 0.023228, " massively", false], [3041, 0.022704, " far", false]]]}, "raw_delta": 0.035238456726074285, "tuned_delta": 0.043810248756652535}, {"byte_start": 4776, "byte_end": 4783, "display": {"text": " better", "kind": "normal"}, "is_word": true, "word_id": 797, "word_key": " better", "bytes_hex": "20 62 65 74 74 65 72", "compression": {"rwkv": "0.73% 0.73% 0.73% 0.73% 0.73% 0.73% 0.73%", "qwen": "13.20% 13.20% 13.20% 13.20% 13.20% 13.20% 13.20%"}, "model_tokens": {"rwkv": [[45301, " better", "normal", 0.7511299252510071]], "qwen": [[2664, " better", "normal", 0.005944317672401667]]}, "loss": {"rwkv": 0.7295995428602808, "qwen": 13.204058925107585}, "topk": {"rwkv": [45301, 1, 0.7511299252510071, [[45301, 0.75113, " better", false], [31458, 0.154028, " more", false], [45, 0.019599, ",", false], [4706, 0.016179, " of", false], [22590, 0.012248, " the", false], [31466, 0.008137, " much", false], [31277, 0.004959, " less", false], [45961, 0.004018, " faster", false], [46198, 0.003279, " higher", false], [4715, 0.003223, " or", false]]], "qwen": [2664, 10, 0.005944317672401667, [[803, 0.738744, " more", false], [11, 0.077369, ",", false], [7046, 0.036871, " greater", false], [34447, 0.032189, " computation", false], [8131, 0.022939, " larger", false], [1753, 0.014226, " much", false], [315, 0.012348, " of", false], [2686, 0.009427, " less", false], [19117, 0.007091, " deeper", false], [2664, 0.005944, " better", false]]]}, "raw_delta": -0.6917309079851421, "tuned_delta": -0.6831591159545639}, {"byte_start": 4783, "byte_end": 4785, "display": {"text": ".\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e 0a", "compression": {"rwkv": "16.27% 23.81%", "qwen": "23.55% 23.55%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.4038146436214447], [261, "\n\n", "control", 0.07171101123094559]], "qwen": [[382, ".\n\n", "control", 0.019882136955857277]]}, "loss": {"rwkv": 20.041344684224125, "qwen": 23.551598012848235}, "topk": {"rwkv": [47, 1, 0.4038146436214447, [[47, 0.403815, ".", false], [32226, 0.226057, " than", false], [45, 0.066152, ",", false], [4712, 0.066079, " on", false], [4596, 0.038707, " in", false], [4424, 0.032568, " at", false], [5346, 0.027397, "---", false], [32487, 0.021845, " with", false], [21265, 0.010803, " and", false], [4450, 0.01077, " by", false]]], "qwen": [382, 8, 0.019882136955857277, [[1091, 0.471128, " than", false], [13, 0.246018, ".", false], [11, 0.053335, ",", false], [304, 0.03831, " in", false], [389, 0.03272, " on", false], [518, 0.025199, " at", false], [323, 0.020144, " and", false], [382, 0.019882, ".\n\n", false], [320, 0.01196, " (", false], [4421, 0.011649, "---", false]]]}, "raw_delta": -0.19464977582295728, "tuned_delta": -0.18607798379237903}, {"byte_start": 4785, "byte_end": 4786, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "23.81%", "qwen": "23.55%"}, "model_tokens": {"rwkv": [[261, "\n\n", "control", 0.07171101123094559]], "qwen": [[382, ".\n\n", "control", 0.019882136955857277]]}, "loss": {"rwkv": 23.810103702171368, "qwen": 23.551598012848235}, "topk": {"rwkv": [261, 3, 0.07171101123094559, [[20996, 0.140689, " The", false], [29894, 0.09324, " This", false], [261, 0.071711, "\n\n", false], [36251, 0.06361, " Again", false], [3913, 0.044152, " In", false], [3918, 0.03636, " It", false], [37451, 0.033717, " There", false], [29893, 0.02838, " They", false], [37453, 0.021943, " These", false], [3641, 0.021111, " As", false]]], "qwen": [382, 8, 0.019882136955857277, [[1091, 0.471128, " than", false], [13, 0.246018, ".", false], [11, 0.053335, ",", false], [304, 0.03831, " in", false], [389, 0.03272, " on", false], [518, 0.025199, " at", false], [323, 0.020144, " and", false], [382, 0.019882, ".\n\n", false], [320, 0.01196, " (", false], [4421, 0.011649, "---", false]]]}, "raw_delta": 0.014334599177042717, "tuned_delta": 0.022906391207620967}, {"byte_start": 4786, "byte_end": 4790, "display": {"text": "This", "kind": "normal"}, "is_word": true, "word_id": 798, "word_key": "this", "bytes_hex": "54 68 69 73", "compression": {"rwkv": "17.40% 17.40% 17.40% 17.40%", "qwen": "18.53% 18.53% 18.53% 18.53%"}, "model_tokens": {"rwkv": [[24242, "This", "normal", 0.02099331095814705]], "qwen": [[1986, "This", "normal", 0.016417063772678375]]}, "loss": {"rwkv": 17.399691166971383, "qwen": 18.527063240774723}, "topk": {"rwkv": [24242, 8, 0.02099331095814705, [[1136, 0.236235, "In", false], [6699, 0.114129, "The", false], [33504, 0.068052, "There", false], [33505, 0.045878, "These", false], [1141, 0.035715, "It", false], [66, 0.034916, "A", false], [5559, 0.028935, "All", false], [24242, 0.020993, "This", false], [1461, 0.013711, "So", false], [58094, 0.013548, "Similarly", false]]], "qwen": [1986, 8, 0.016417063772678375, [[641, 0.367578, "In", false], [785, 0.092108, "The", false], [3862, 0.037181, "There", false], [9485, 0.026937, "These", false], [32, 0.026351, "A", false], [2403, 0.01976, "All", false], [2132, 0.018167, "It", false], [1986, 0.016417, "This", false], [67691, 0.016169, "Similarly", false], [23949, 0.012105, "Finally", false]]]}, "raw_delta": -0.0625147819519043, "tuned_delta": -0.05394298992132605}, {"byte_start": 4790, "byte_end": 4793, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 799, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "8.55% 8.55% 8.55%", "qwen": "11.80% 11.80% 11.80%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.24036209285259247]], "qwen": [[374, " is", "normal", 0.14036953449249268]]}, "loss": {"rwkv": 8.547216713599978, "qwen": 11.802909204955125}, "topk": {"rwkv": [4600, 1, 0.24036209285259247, [[4600, 0.240362, " is", false], [52427, 0.215301, " pattern", false], [46430, 0.023896, " lesson", false], [31937, 0.021227, " same", false], [21800, 0.019253, " has", false], [45315, 0.016246, " bitter", false], [51832, 0.015342, " general", false], [21365, 0.013791, " bit", false], [30659, 0.013637, " does", false], [31254, 0.012731, " last", false]]], "qwen": [374, 2, 0.14036953449249268, [[5383, 0.312502, " pattern", false], [374, 0.14037, " is", false], [25180, 0.084028, " bitter", false], [9149, 0.038647, " trend", false], [1852, 0.025313, " same", false], [17755, 0.017518, " lesson", false], [572, 0.015478, " was", false], [702, 0.013894, " has", false], [4586, 0.013448, " general", false], [78996, 0.009663, " bitterness", false]]]}, "raw_delta": -0.1805339256922404, "tuned_delta": -0.17196213366166213}, {"byte_start": 4793, "byte_end": 4795, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 800, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "18.60% 18.60%", "qwen": "16.10% 16.10%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.12615233659744263]], "qwen": [[264, " a", "normal", 0.16762448847293854]]}, "loss": {"rwkv": 18.597240761459293, "qwen": 16.104344712961908}, "topk": {"rwkv": [332, 2, 0.12615233659744263, [[22187, 0.401821, " not", false], [332, 0.126152, " a", false], [22590, 0.077981, " the", false], [21256, 0.03986, " all", false], [31198, 0.037754, " just", false], [4419, 0.028315, " an", false], [32313, 0.019864, " true", false], [22226, 0.015876, " one", false], [31581, 0.015499, " only", false], [4450, 0.013564, " by", false]]], "qwen": [264, 2, 0.16762448847293854, [[537, 0.305703, " not", false], [264, 0.167624, " a", false], [279, 0.080188, " the", false], [830, 0.049772, " true", false], [458, 0.044748, " an", false], [1101, 0.033786, " just", false], [1083, 0.030415, " also", false], [678, 0.026734, " all", false], [1172, 0.017125, " only", false], [825, 0.015389, " one", false]]]}, "raw_delta": 0.13823550939559937, "tuned_delta": 0.14680730142617762}, {"byte_start": 4795, "byte_end": 4799, "display": {"text": " big", "kind": "normal"}, "is_word": true, "word_id": 801, "word_key": " big", "bytes_hex": "20 62 69 67", "compression": {"rwkv": "23.11% 23.11% 23.11% 23.11%", "qwen": "18.40% 18.40% 18.40% 18.40%"}, "model_tokens": {"rwkv": [[21357, " big", "normal", 0.005916913505643606]], "qwen": [[2409, " big", "normal", 0.016895288601517677]]}, "loss": {"rwkv": 23.1056627642373, "qwen": 18.397609749687152}, "topk": {"rwkv": [21357, 23, 0.005916913505643606, [[52427, 0.151616, " pattern", false], [51832, 0.138843, " general", false], [32386, 0.077253, " very", false], [46430, 0.050761, " lesson", false], [45534, 0.025772, " common", false], [30992, 0.019185, " good", false], [31323, 0.018731, " long", false], [21365, 0.016426, " bit", false], [53216, 0.013408, " typical", false], [39831, 0.011666, " story", false]]], "qwen": [2409, 6, 0.016895288601517677, [[5383, 0.145758, " pattern", false], [25180, 0.106271, " bitter", false], [4586, 0.053672, " general", false], [1602, 0.04959, " very", false], [1293, 0.028695, " long", false], [2409, 0.016895, " big", false], [1661, 0.01616, " good", false], [45250, 0.014066, " recurring", false], [4185, 0.013676, " common", false], [12126, 0.013605, " summary", false]]]}, "raw_delta": 0.2610698938369751, "tuned_delta": 0.2696416858675533}, {"byte_start": 4799, "byte_end": 4806, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 802, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"rwkv": "2.36% 2.36% 2.36% 2.36% 2.36% 2.36% 2.36%", "qwen": "2.75% 2.75% 2.75% 2.75% 2.75% 2.75% 2.75%"}, "model_tokens": {"rwkv": [[46430, " lesson", "normal", 0.39640820026397705]], "qwen": [[17755, " lesson", "normal", 0.34429696202278137]]}, "loss": {"rwkv": 2.3649088630643575, "qwen": 2.746919184055841}, "topk": {"rwkv": [46430, 1, 0.39640820026397705, [[46430, 0.396408, " lesson", false], [45450, 0.077684, " change", false], [30587, 0.046992, " deal", false], [39932, 0.036886, " theme", false], [45, 0.034727, ",", false], [39831, 0.03342, " story", false], [52427, 0.027727, " pattern", false], [31633, 0.022082, " part", false], [39981, 0.019946, " topic", false], [21265, 0.018497, " and", false]]], "qwen": [17755, 1, 0.34429696202278137, [[17755, 0.344297, " lesson", false], [5383, 0.15431, " pattern", false], [6802, 0.054268, " picture", false], [2297, 0.05139, " change", false], [6912, 0.033931, " theme", false], [3364, 0.032475, " story", false], [4586, 0.019287, " general", false], [11, 0.018384, ",", false], [323, 0.018098, " and", false], [3491, 0.016748, " problem", false]]]}, "raw_delta": -0.021183150155203695, "tuned_delta": -0.012611358124625447}, {"byte_start": 4806, "byte_end": 4807, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "29.87%", "qwen": "24.30%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.1890116184949875]], "qwen": [[13, ".", "normal", 0.25993290543556213]]}, "loss": {"rwkv": 29.868295768404316, "qwen": 24.297360649029603}, "topk": {"rwkv": [47, 1, 0.1890116184949875, [[47, 0.189012, ".", false], [21700, 0.179171, " for", false], [45, 0.177697, ",", false], [32227, 0.080117, " that", false], [4811, 0.075661, " to", false], [59, 0.068448, ":", false], [4596, 0.064481, " in", false], [37598, 0.036516, " about", false], [4706, 0.02082, " of", false], [30917, 0.019844, " from", false]]], "qwen": [13, 1, 0.25993290543556213, [[13, 0.259933, ".", false], [369, 0.230987, " for", false], [11, 0.149982, ",", false], [25, 0.080439, ":", false], [311, 0.076702, " to", false], [429, 0.042925, " that", false], [304, 0.033457, " in", false], [911, 0.020299, " about", false], [315, 0.013647, " of", false], [4421, 0.013556, "---", false]]]}, "raw_delta": 0.3089182376861572, "tuned_delta": 0.31749002971673546}, {"byte_start": 4807, "byte_end": 4810, "display": {"text": " As", "kind": "normal"}, "is_word": true, "word_id": 803, "word_key": " as", "bytes_hex": "20 41 73", "compression": {"rwkv": "25.92% 25.92% 25.92%", "qwen": "25.48% 25.48% 25.48%"}, "model_tokens": {"rwkv": [[3641, " As", "normal", 0.013599949888885021]], "qwen": [[1634, " As", "normal", 0.014417086727917194]]}, "loss": {"rwkv": 25.92342651597356, "qwen": 25.483652545829788}, "topk": {"rwkv": [3641, 10, 0.013599949888885021, [[3918, 0.215962, " It", false], [20996, 0.140166, " The", false], [3913, 0.047111, " In", false], [3908, 0.041719, " If", false], [37451, 0.028886, " There", false], [30032, 0.027224, " When", false], [4331, 0.021836, " We", false], [300, 0.014039, " A", false], [19907, 0.013748, " For", false], [3641, 0.0136, " As", false]]], "qwen": [1634, 10, 0.014417086727917194, [[1084, 0.165845, " It", false], [576, 0.106745, " The", false], [758, 0.058878, " In", false], [1416, 0.035811, " If", false], [2619, 0.029166, " There", false], [1205, 0.024241, " We", false], [3197, 0.022053, " When", false], [58150, 0.018399, " Researchers", false], [11097, 0.01658, " Human", false], [1634, 0.014417, " As", false]]]}, "raw_delta": 0.024386246999104744, "tuned_delta": 0.032958039029682994}, {"byte_start": 4810, "byte_end": 4812, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 804, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "20.57% 20.57%", "qwen": "25.17% 25.17%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.10101870447397232]], "qwen": [[264, " a", "normal", 0.06133865565061569]]}, "loss": {"rwkv": 20.56967538767467, "qwen": 25.169123507988093}, "topk": {"rwkv": [332, 1, 0.10101870447397232, [[332, 0.101019, " a", false], [22590, 0.071726, " the", false], [3609, 0.069767, " AI", false], [31323, 0.066281, " long", false], [4858, 0.05641, " we", false], [308, 0.036531, " I", false], [4596, 0.028283, " in", false], [21660, 0.025114, " far", false], [63843, 0.022032, " researchers", false], [32079, 0.021067, " soon", false]]], "qwen": [264, 3, 0.06133865565061569, [[20219, 0.109935, " Moore", false], [304, 0.062056, " in", false], [264, 0.061339, " a", false], [279, 0.060003, " the", false], [582, 0.052603, " we", false], [1293, 0.04475, " long", false], [358, 0.031471, " I", false], [448, 0.024315, " with", false], [15235, 0.023857, " AI", false], [11811, 0.020073, " researchers", false]]]}, "raw_delta": -0.2550475597381592, "tuned_delta": -0.24647576770758092}, {"byte_start": 4812, "byte_end": 4818, "display": {"text": " field", "kind": "normal"}, "is_word": true, "word_id": 805, "word_key": " field", "bytes_hex": "20 66 69 65 6c 64", "compression": {"rwkv": "12.68% 12.68% 12.68% 12.68% 12.68% 12.68%", "qwen": "9.42% 9.42% 9.42% 9.42% 9.42% 9.42%"}, "model_tokens": {"rwkv": [[38478, " field", "normal", 0.014523682184517384]], "qwen": [[2070, " field", "normal", 0.043501608073711395]]}, "loss": {"rwkv": 12.679936882813154, "qwen": 9.422473686748498}, "topk": {"rwkv": [38478, 10, 0.014523682184517384, [[51832, 0.243275, " general", false], [62496, 0.057557, " researcher", false], [47092, 0.05675, " result", false], [31907, 0.044584, " rule", false], [46530, 0.026454, " matter", false], [60212, 0.025288, " practical", false], [57103, 0.016576, " research", false], [52942, 0.016178, " society", false], [21458, 0.01524, " cor", false], [38478, 0.014524, " field", false]]], "qwen": [2070, 5, 0.043501608073711395, [[1102, 0.13028, " result", false], [4586, 0.081515, " general", false], [5912, 0.055403, " rule", false], [28674, 0.047317, " consequence", false], [2070, 0.043502, " field", false], [31085, 0.04242, " researcher", false], [1829, 0.032466, " cor", false], [6366, 0.02916, " computer", false], [3108, 0.020903, " side", false], [14976, 0.020808, " practical", false]]]}, "raw_delta": 0.1806321144104004, "tuned_delta": 0.18920390644097865}, {"byte_start": 4818, "byte_end": 4819, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "8.84%", "qwen": "4.97%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.6092252731323242]], "qwen": [[11, ",", "normal", 0.7591410279273987]]}, "loss": {"rwkv": 8.840733771072504, "qwen": 4.969501577837577}, "topk": {"rwkv": [45, 1, 0.6092252731323242, [[45, 0.609225, ",", false], [4706, 0.171511, " of", false], [4858, 0.034033, " we", false], [32227, 0.02243, " that", false], [38642, 0.02184, " grows", false], [46531, 0.019879, " mature", false], [39072, 0.009967, " moves", false], [55981, 0.008931, " develops", false], [62394, 0.007743, " progresses", false], [4596, 0.005394, " in", false]]], "qwen": [11, 1, 0.7591410279273987, [[11, 0.759141, ",", false], [315, 0.071774, " of", false], [88626, 0.035103, " matures", false], [429, 0.014541, " that", false], [582, 0.013315, " we", false], [27715, 0.009727, " grows", false], [702, 0.005493, " has", false], [91954, 0.005326, " evolves", false], [432, 0.004382, " it", false], [9044, 0.003944, " becomes", false]]]}, "raw_delta": 0.2146666944026947, "tuned_delta": 0.22323848643327296}, {"byte_start": 4819, "byte_end": 4822, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 806, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"rwkv": "9.44% 9.44% 9.44%", "qwen": "11.50% 11.50% 11.50%"}, "model_tokens": {"rwkv": [[4858, " we", "normal", 0.20773224532604218]], "qwen": [[582, " we", "normal", 0.14750812947750092]]}, "loss": {"rwkv": 9.439508568316459, "qwen": 11.504723535106052}, "topk": {"rwkv": [4858, 2, 0.20773224532604218, [[3609, 0.41938, " AI", false], [4858, 0.207732, " we", false], [55809, 0.154025, " computer", false], [4601, 0.037014, " it", false], [61594, 0.028619, " artificial", false], [52167, 0.022356, " machine", false], [22590, 0.017376, " the", false], [22248, 0.007635, " our", false], [21265, 0.006665, " and", false], [39934, 0.004918, " there", false]]], "qwen": [582, 2, 0.14750812947750092, [[15235, 0.45968, " AI", false], [582, 0.147508, " we", false], [6366, 0.123506, " computer", false], [279, 0.039406, " the", false], [5662, 0.032863, " machine", false], [432, 0.026634, " it", false], [20443, 0.018288, " artificial", false], [11129, 0.007375, " vision", false], [5538, 0.006872, " deep", false], [323, 0.006621, " and", false]]]}, "raw_delta": -0.11451983451843262, "tuned_delta": -0.10594804248785437}, {"byte_start": 4822, "byte_end": 4828, "display": {"text": " still", "kind": "normal"}, "is_word": true, "word_id": 807, "word_key": " still", "bytes_hex": "20 73 74 69 6c 6c", "compression": {"rwkv": "16.91% 16.91% 16.91% 16.91% 16.91% 16.91%", "qwen": "16.40% 16.40% 16.40% 16.40% 16.40% 16.40%"}, "model_tokens": {"rwkv": [[39820, " still", "normal", 0.0035765713546425104]], "qwen": [[2058, " still", "normal", 0.00426615821197629]]}, "loss": {"rwkv": 16.90658251041754, "qwen": 16.40176470171745}, "topk": {"rwkv": [39820, 29, 0.0035765713546425104, [[31059, 0.240231, " have", false], [31506, 0.153746, " need", false], [47266, 0.14672, " should", false], [21286, 0.097353, " are", false], [31475, 0.035653, " must", false], [21413, 0.029261, " can", false], [32216, 0.019803, " tend", false], [4491, 0.012959, " do", false], [5231, 0.01285, "'ve", false], [22190, 0.010097, " now", false]]], "qwen": [2058, 25, 0.00426615821197629, [[614, 0.341647, " have", false], [1184, 0.100251, " need", false], [525, 0.09699, " are", false], [1265, 0.090401, " should", false], [1969, 0.046019, " must", false], [646, 0.017051, " can", false], [3003, 0.014424, "'ve", false], [1033, 0.014299, " were", false], [8376, 0.013918, " tend", false], [1431, 0.012259, " now", false]]]}, "raw_delta": 0.027993043263753292, "tuned_delta": 0.03656483529433154}, {"byte_start": 4828, "byte_end": 4833, "display": {"text": " have", "kind": "normal"}, "is_word": true, "word_id": 808, "word_key": " have", "bytes_hex": "20 68 61 76 65", "compression": {"rwkv": "4.85% 4.85% 4.85% 4.85% 4.85%", "qwen": "3.75% 3.75% 3.75% 3.75% 3.75%"}, "model_tokens": {"rwkv": [[31059, " have", "normal", 0.2598569095134735]], "qwen": [[614, " have", "normal", 0.35401177406311035]]}, "loss": {"rwkv": 4.846553652986361, "qwen": 3.745326811723812}, "topk": {"rwkv": [31059, 1, 0.2598569095134735, [[31059, 0.259857, " have", false], [32216, 0.091551, " tend", false], [31506, 0.051154, " need", false], [4491, 0.040088, " do", false], [39942, 0.037661, " think", false], [31967, 0.021362, " seem", false], [57328, 0.017307, " struggle", false], [39761, 0.016216, " spend", false], [39171, 0.015666, " often", false], [21556, 0.013541, " don", false]]], "qwen": [614, 1, 0.35401177406311035, [[614, 0.354012, " have", false], [1184, 0.089251, " need", false], [653, 0.062919, " do", false], [8376, 0.039788, " tend", false], [1744, 0.02565, " think", false], [4411, 0.025608, " believe", false], [2803, 0.02214, " seem", false], [1513, 0.015161, " don", false], [8990, 0.014136, " haven", false], [1430, 0.012707, " try", false]]]}, "raw_delta": 0.06106498241424561, "tuned_delta": 0.06963677444482386}, {"byte_start": 4833, "byte_end": 4837, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 809, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "8.95% 8.95% 8.95% 8.95%", "qwen": "11.42% 11.42% 11.42% 11.42%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.13639238476753235]], "qwen": [[537, " not", "normal", 0.07942873239517212]]}, "loss": {"rwkv": 8.946399911762613, "qwen": 11.419359946350298}, "topk": {"rwkv": [22187, 2, 0.13639238476753235, [[332, 0.311102, " a", false], [22187, 0.136392, " not", false], [4811, 0.079346, " to", false], [31466, 0.069057, " much", false], [31370, 0.05811, " many", false], [32074, 0.036899, " some", false], [22590, 0.031385, " the", false], [4419, 0.018718, " an", false], [31335, 0.014693, " lots", false], [22614, 0.013194, " too", false]]], "qwen": [537, 3, 0.07942873239517212, [[264, 0.426092, " a", false], [1753, 0.093368, " much", false], [537, 0.079429, " not", false], [311, 0.049156, " to", false], [1657, 0.03934, " many", false], [1045, 0.03253, " some", false], [458, 0.023293, " an", false], [279, 0.021844, " the", false], [2238, 0.01847, " too", false], [975, 0.009718, " work", false]]]}, "raw_delta": -0.1371300220489502, "tuned_delta": -0.12855823001837194}, {"byte_start": 4837, "byte_end": 4848, "display": {"text": " thoroughly", "kind": "normal"}, "is_word": true, "word_id": 810, "word_key": " thoroughly", "bytes_hex": "20 74 68 6f 72 6f 75 67 68 6c 79", "compression": {"rwkv": "11.73% 11.73% 11.73% 11.73% 11.73% 11.73% 11.73% 11.73% 11.73% 11.73% 11.73%", "qwen": "11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96%"}, "model_tokens": {"rwkv": [[62646, " thoroughly", "normal", 0.0007897895411588252]], "qwen": [[26364, " thoroughly", "normal", 0.0006773083587177098]]}, "loss": {"rwkv": 11.732143620865504, "qwen": 11.963522043682426}, "topk": {"rwkv": [62646, 94, 0.0007897895411588252, [[52112, 0.217577, " learned", false], [38566, 0.205699, " fully", false], [22797, 0.046931, " yet", false], [39423, 0.026941, " quite", false], [46112, 0.023693, " gotten", false], [56098, 0.023239, " embraced", false], [30482, 0.023224, " come", false], [56480, 0.021566, " internal", false], [61717, 0.019571, " completely", false], [31351, 0.019036, " made", false]]], "qwen": [26364, 96, 0.0006773083587177098, [[9498, 0.296307, " learned", false], [7225, 0.056839, " fully", false], [3602, 0.054157, " yet", false], [17019, 0.035025, " gotten", false], [2167, 0.029621, " really", false], [24692, 0.027863, " figured", false], [2525, 0.026812, " come", false], [5008, 0.024497, " quite", false], [70225, 0.022509, " mastered", false], [42503, 0.020379, " embraced", false]]]}, "raw_delta": -0.012830344113436642, "tuned_delta": -0.004258552082858394}, {"byte_start": 4848, "byte_end": 4856, "display": {"text": " learned", "kind": "normal"}, "is_word": true, "word_id": 811, "word_key": " learned", "bytes_hex": "20 6c 65 61 72 6e 65 64", "compression": {"rwkv": "4.47% 4.47% 4.47% 4.47% 4.47% 4.47% 4.47% 4.47%", "qwen": "3.39% 3.39% 3.39% 3.39% 3.39% 3.39% 3.39% 3.39%"}, "model_tokens": {"rwkv": [[52112, " learned", "normal", 0.13818806409835815]], "qwen": [[9498, " learned", "normal", 0.22197359800338745]]}, "loss": {"rwkv": 4.473199955881307, "qwen": 3.393031207836185}, "topk": {"rwkv": [52112, 2, 0.13818806409835815, [[56480, 0.196796, " internal", false], [52112, 0.138188, " learned", false], [56098, 0.117499, " embraced", false], [62684, 0.083172, " understood", false], [55423, 0.064751, " absorbed", false], [38625, 0.036738, " grasp", false], [45746, 0.028517, " digest", false], [37761, 0.024372, " assim", false], [62141, 0.023075, " integrated", false], [63289, 0.020703, " appreciated", false]]], "qwen": [9498, 1, 0.22197359800338745, [[9498, 0.221974, " learned", false], [42503, 0.174885, " embraced", false], [5306, 0.10591, " internal", false], [15985, 0.089439, " understood", false], [70225, 0.066635, " mastered", false], [41001, 0.047362, " absorbed", false], [48987, 0.040584, " gras", false], [35031, 0.013365, " explored", false], [24692, 0.012867, " figured", false], [11666, 0.010591, " accepted", false]]]}, "raw_delta": 0.059897273778915405, "tuned_delta": 0.06846906580949365}, {"byte_start": 4856, "byte_end": 4859, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 812, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "2.24% 2.24% 2.24%", "qwen": "5.48% 5.48% 5.48%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.6888904571533203]], "qwen": [[432, " it", "normal", 0.4015727937221527]]}, "loss": {"rwkv": 2.242470319090104, "qwen": 5.484444327661428}, "topk": {"rwkv": [4601, 1, 0.6888904571533203, [[4601, 0.68889, " it", false], [32234, 0.105858, " this", false], [22590, 0.045903, " the", false], [32227, 0.035526, " that", false], [30917, 0.025735, " from", false], [4811, 0.025269, " to", false], [21835, 0.023128, " how", false], [32464, 0.009804, " what", false], [21265, 0.006502, " and", false], [22248, 0.003925, " our", false]]], "qwen": [432, 1, 0.4015727937221527, [[432, 0.401573, " it", false], [1246, 0.116987, " how", false], [279, 0.11032, " the", false], [419, 0.089393, " this", false], [504, 0.053228, " from", false], [429, 0.047667, " that", false], [311, 0.042615, " to", false], [1128, 0.022051, " what", false], [911, 0.019256, " about", false], [1039, 0.015275, " our", false]]]}, "raw_delta": -0.179773211479187, "tuned_delta": -0.17120141944860875}, {"byte_start": 4859, "byte_end": 4860, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "25.64%", "qwen": "22.17%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.24268387258052826]], "qwen": [[11, ",", "normal", 0.2925507724285126]]}, "loss": {"rwkv": 25.641650140799932, "qwen": 22.16551530372949}, "topk": {"rwkv": [45, 2, 0.24268387258052826, [[47, 0.653606, ".", false], [45, 0.242684, ",", false], [5346, 0.018404, "---", false], [21265, 0.017578, " and", false], [22797, 0.01482, " yet", false], [60, 0.007195, ";", false], [59, 0.006336, ":", false], [4715, 0.005869, " or", false], [275, 0.005326, " (", false], [4596, 0.004724, " in", false]]], "qwen": [11, 2, 0.2925507724285126, [[13, 0.547799, ".", false], [11, 0.292551, ",", false], [382, 0.042821, ".\n\n", false], [323, 0.01752, " and", false], [3602, 0.014398, " yet", false], [624, 0.0134, ".\n", false], [4421, 0.011376, "---", false], [25, 0.011239, ":", false], [26, 0.00771, ";", false], [320, 0.005204, " (", false]]]}, "raw_delta": 0.19275784492492676, "tuned_delta": 0.20132963695550501}, {"byte_start": 4860, "byte_end": 4863, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 813, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"rwkv": "24.80% 24.80% 24.80%", "qwen": "26.90% 26.90% 26.90%"}, "model_tokens": {"rwkv": [[4423, " as", "normal", 0.016042407602071762]], "qwen": [[438, " as", "normal", 0.011395213194191456]]}, "loss": {"rwkv": 24.796321015279055, "qwen": 26.89761650903091}, "topk": {"rwkv": [4423, 7, 0.016042407602071762, [[21265, 0.345716, " and", false], [21400, 0.33421, " but", false], [55495, 0.042687, " although", false], [4715, 0.038293, " or", false], [30788, 0.025219, " even", false], [51018, 0.023825, " because", false], [4423, 0.016042, " as", false], [22185, 0.014719, " nor", false], [4788, 0.014672, " so", false], [47544, 0.013463, " though", false]]], "qwen": [438, 11, 0.011395213194191456, [[323, 0.414459, " and", false], [714, 0.295449, " but", false], [7892, 0.052773, " although", false], [476, 0.032967, " or", false], [6329, 0.023723, " nor", false], [1496, 0.020777, " even", false], [3498, 0.014762, " though", false], [8818, 0.01382, " despite", false], [1576, 0.012854, " because", false], [773, 0.012796, " so", false]]]}, "raw_delta": -0.1165205637613933, "tuned_delta": -0.10794877173081506}, {"byte_start": 4863, "byte_end": 4866, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 814, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"rwkv": "11.74% 11.74% 11.74%", "qwen": "8.57% 8.57% 8.57%"}, "model_tokens": {"rwkv": [[4858, " we", "normal", 0.14369505643844604]], "qwen": [[582, " we", "normal", 0.24048909544944763]]}, "loss": {"rwkv": 11.740682298901067, "qwen": 8.566485936440397}, "topk": {"rwkv": [4858, 2, 0.14369505643844604, [[4601, 0.162894, " it", false], [4858, 0.143695, " we", false], [59655, 0.108984, " evidenced", false], [39934, 0.053337, " there", false], [332, 0.045773, " a", false], [22590, 0.035668, " the", false], [31370, 0.030317, " many", false], [4600, 0.026523, " is", false], [308, 0.020256, " I", false], [31466, 0.017239, " much", false]]], "qwen": [582, 1, 0.24048909544944763, [[582, 0.240489, " we", false], [68357, 0.109104, " evidenced", false], [1052, 0.062233, " there", false], [279, 0.055876, " the", false], [432, 0.052813, " it", false], [264, 0.03345, " a", false], [1657, 0.022085, " many", false], [3602, 0.020279, " yet", false], [374, 0.018945, " is", false], [1039, 0.01833, " our", false]]]}, "raw_delta": 0.1760148207346598, "tuned_delta": 0.18458661276523805}, {"byte_start": 4866, "byte_end": 4870, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 815, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"rwkv": "10.99% 10.99% 10.99% 10.99%", "qwen": "12.75% 12.75% 12.75% 12.75%"}, "model_tokens": {"rwkv": [[21286, " are", "normal", 0.08767735213041306]], "qwen": [[525, " are", "normal", 0.05910564213991165]]}, "loss": {"rwkv": 10.9892786317714, "qwen": 12.751750388464055}, "topk": {"rwkv": [21286, 3, 0.08767735213041306, [[31059, 0.244129, " have", false], [39820, 0.097822, " still", false], [21286, 0.087677, " are", false], [47266, 0.058725, " should", false], [55851, 0.035146, " continue", false], [22449, 0.023081, " see", false], [21413, 0.022533, " can", false], [21532, 0.018698, " did", false], [32475, 0.018211, " will", false], [31967, 0.017509, " seem", false]]], "qwen": [525, 3, 0.05910564213991165, [[614, 0.339705, " have", false], [2058, 0.161847, " still", false], [525, 0.059106, " are", false], [3060, 0.03749, " continue", false], [1521, 0.033827, " did", false], [1265, 0.032813, " should", false], [686, 0.015527, " will", false], [653, 0.014244, " do", false], [1033, 0.010461, " were", false], [1030, 0.009776, " had", false]]]}, "raw_delta": -0.09773218631744385, "tuned_delta": -0.0891603942868656}, {"byte_start": 4870, "byte_end": 4881, "display": {"text": " continuing", "kind": "normal"}, "is_word": true, "word_id": 816, "word_key": " continuing", "bytes_hex": "20 63 6f 6e 74 69 6e 75 69 6e 67", "compression": {"rwkv": "9.43% 9.43% 9.43% 9.43% 9.43% 9.43% 9.43% 9.43% 9.43% 9.43% 9.43%", "qwen": "8.10% 8.10% 8.10% 8.10% 8.10% 8.10% 8.10% 8.10% 8.10% 8.10% 8.10%"}, "model_tokens": {"rwkv": [[61774, " continuing", "normal", 0.0032059645745903254]], "qwen": [[14354, " continuing", "normal", 0.007154079619795084]]}, "loss": {"rwkv": 9.42670055126311, "qwen": 8.098884261357814}, "topk": {"rwkv": [61774, 22, 0.0032059645745903254, [[39820, 0.631963, " still", false], [21256, 0.022194, " all", false], [22187, 0.021499, " not", false], [4596, 0.015967, " in", false], [4788, 0.014402, " so", false], [22190, 0.012031, " now", false], [22614, 0.01169, " too", false], [39364, 0.011389, " prone", false], [61760, 0.007598, " constantly", false], [39171, 0.00746, " often", false]]], "qwen": [14354, 20, 0.007154079619795084, [[2058, 0.387489, " still", false], [537, 0.032653, " not", false], [304, 0.030534, " in", false], [1431, 0.029945, " now", false], [1172, 0.025649, " only", false], [3545, 0.024299, " often", false], [1101, 0.019831, " just", false], [2238, 0.019285, " too", false], [6301, 0.01608, " slow", false], [3602, 0.013849, " yet", false]]]}, "raw_delta": 0.07362976941195398, "tuned_delta": 0.08220156144253223}, {"byte_start": 4881, "byte_end": 4884, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 817, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.42% 0.42% 0.42%", "qwen": "0.67% 0.67% 0.67%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.932659924030304]], "qwen": [[311, " to", "normal", 0.8951485753059387]]}, "loss": {"rwkv": 0.41972939218571315, "qwen": 0.6658374165262169}, "topk": {"rwkv": [4811, 1, 0.932659924030304, [[4811, 0.93266, " to", false], [22590, 0.011447, " the", false], [45, 0.00952, ",", false], [22248, 0.006447, " our", false], [4596, 0.00543, " in", false], [32487, 0.004372, " with", false], [332, 0.003248, " a", false], [4712, 0.002375, " on", false], [51566, 0.001911, " efforts", false], [57103, 0.001478, " research", false]]], "qwen": [311, 1, 0.8951485753059387, [[311, 0.895149, " to", false], [448, 0.020321, " with", false], [1039, 0.013346, " our", false], [1495, 0.010645, " down", false], [304, 0.009115, " in", false], [389, 0.006475, " on", false], [279, 0.005177, " the", false], [11, 0.003922, ",", false], [3412, 0.003907, " research", false], [264, 0.002929, " a", false]]]}, "raw_delta": -0.013647126654783884, "tuned_delta": -0.005075334624205636}, {"byte_start": 4884, "byte_end": 4889, "display": {"text": " make", "kind": "normal"}, "is_word": true, "word_id": 818, "word_key": " make", "bytes_hex": "20 6d 61 6b 65", "compression": {"rwkv": "12.57% 12.57% 12.57% 12.57% 12.57%", "qwen": "9.57% 9.57% 9.57% 9.57% 9.57%"}, "model_tokens": {"rwkv": [[31358, " make", "normal", 0.030505675822496414]], "qwen": [[1281, " make", "normal", 0.07037892192602158]]}, "loss": {"rwkv": 12.567226332743704, "qwen": 9.5717812850083}, "topk": {"rwkv": [31358, 5, 0.030505675822496414, [[46330, 0.081087, " invest", false], [22626, 0.051773, " try", false], [46960, 0.033906, " pursue", false], [22339, 0.033775, " put", false], [31358, 0.030506, " make", false], [31856, 0.027364, " rely", false], [39761, 0.024688, " spend", false], [4435, 0.023275, " be", false], [38530, 0.021599, " focus", false], [40166, 0.02144, " waste", false]]], "qwen": [1281, 3, 0.07037892192602158, [[22729, 0.090621, " pursue", false], [1430, 0.080991, " try", false], [1281, 0.070379, " make", false], [2725, 0.056145, " invest", false], [8329, 0.031418, " spend", false], [387, 0.031217, " be", false], [12291, 0.02088, " waste", false], [2225, 0.020268, " develop", false], [990, 0.020147, " use", false], [653, 0.019984, " do", false]]]}, "raw_delta": 0.1661027431488037, "tuned_delta": 0.17467453517938195}, {"byte_start": 4889, "byte_end": 4893, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 819, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "11.98% 11.98% 11.98% 11.98%", "qwen": "11.47% 11.47% 11.47% 11.47%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.0704706534743309]], "qwen": [[279, " the", "normal", 0.07849346101284027]]}, "loss": {"rwkv": 11.97549594487909, "qwen": 11.472761634334766}, "topk": {"rwkv": [22590, 2, 0.0704706534743309, [[51566, 0.085147, " efforts", false], [22590, 0.070471, " the", false], [56950, 0.069084, " progress", false], [52224, 0.054982, " methods", false], [22681, 0.033814, " use", false], [56652, 0.033148, " mistakes", false], [57103, 0.028527, " research", false], [332, 0.021892, " a", false], [38961, 0.020088, " major", false], [22248, 0.019366, " our", false]]], "qwen": [279, 3, 0.07849346101284027, [[5098, 0.106727, " progress", false], [20643, 0.085339, " mistakes", false], [279, 0.078493, " the", false], [2244, 0.032022, " great", false], [8869, 0.02644, " efforts", false], [5413, 0.024356, " methods", false], [264, 0.020544, " a", false], [5089, 0.018895, " significant", false], [1657, 0.018697, " many", false], [2989, 0.015426, " important", false]]]}, "raw_delta": 0.027877509593963623, "tuned_delta": 0.03644930162454187}, {"byte_start": 4893, "byte_end": 4898, "display": {"text": " same", "kind": "normal"}, "is_word": true, "word_id": 820, "word_key": " same", "bytes_hex": "20 73 61 6d 65", "compression": {"rwkv": "3.92% 3.92% 3.92% 3.92% 3.92%", "qwen": "3.22% 3.22% 3.22% 3.22% 3.22%"}, "model_tokens": {"rwkv": [[31937, " same", "normal", 0.3347090482711792]], "qwen": [[1852, " same", "normal", 0.40971702337265015]]}, "loss": {"rwkv": 3.9166916149133963, "qwen": 3.218250506732995}, "topk": {"rwkv": [31937, 1, 0.3347090482711792, [[31937, 0.334709, " same", false], [52245, 0.240849, " mistake", false], [56652, 0.058142, " mistakes", false], [38720, 0.027209, " human", false], [62660, 0.017263, " transition", false], [45829, 0.016415, " effort", false], [38392, 0.0125, " error", false], [22221, 0.011733, " old", false], [45315, 0.009555, " bitter", false], [38841, 0.007034, " kinds", false]]], "qwen": [1852, 1, 0.40971702337265015, [[1852, 0.409717, " same", false], [16523, 0.186574, " mistake", false], [20643, 0.049671, " mistakes", false], [3738, 0.044813, " human", false], [4969, 0.020748, " wrong", false], [1465, 0.012287, " error", false], [2310, 0.011683, " old", false], [1429, 0.011365, " most", false], [9142, 0.009277, " transition", false], [1850, 0.008689, " best", false]]]}, "raw_delta": 0.038729798793792736, "tuned_delta": 0.047301590824370986}, {"byte_start": 4898, "byte_end": 4903, "display": {"text": " kind", "kind": "normal"}, "is_word": true, "word_id": 821, "word_key": " kind", "bytes_hex": "20 6b 69 6e 64", "compression": {"rwkv": "18.15% 18.15% 18.15% 18.15% 18.15%", "qwen": "18.33% 18.33% 18.33% 18.33% 18.33%"}, "model_tokens": {"rwkv": [[31214, " kind", "normal", 0.006520731840282679]], "qwen": [[3093, " kind", "normal", 0.006207973230630159]]}, "loss": {"rwkv": 18.146398561181492, "qwen": 18.329154205294348}, "topk": {"rwkv": [31214, 7, 0.006520731840282679, [[56652, 0.735291, " mistakes", false], [52245, 0.111483, " mistake", false], [38841, 0.024679, " kinds", false], [45888, 0.015524, " errors", false], [22221, 0.006977, " old", false], [39745, 0.00681, " sorts", false], [31214, 0.006521, " kind", false], [38392, 0.005356, " error", false], [37812, 0.004696, " basic", false], [21325, 0.004467, " bad", false]]], "qwen": [3093, 10, 0.006207973230630159, [[20643, 0.750139, " mistakes", false], [5975, 0.035275, " errors", false], [12829, 0.023533, " kinds", false], [16523, 0.016307, " mistake", false], [2310, 0.010712, " old", false], [20853, 0.010077, " sorts", false], [4124, 0.008521, " early", false], [3738, 0.008324, " human", false], [2856, 0.008138, " initial", false], [3093, 0.006208, " kind", false]]]}, "raw_delta": -0.010134124755859286, "tuned_delta": -0.001562332725281038}, {"byte_start": 4903, "byte_end": 4906, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 822, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.03% 0.03% 0.03%", "qwen": "0.01% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9945980310440063]], "qwen": [[315, " of", "normal", 0.9986101388931274]]}, "loss": {"rwkv": 0.0326537726438186, "qwen": 0.008360422639164542}, "topk": {"rwkv": [4706, 1, 0.9945980310440063, [[4706, 0.994598, " of", false], [56652, 0.00315, " mistakes", false], [45888, 0.000598, " errors", false], [45, 0.00014, ",", false], [46, 0.000104, "-", false], [275, 9.5e-05, " (", false], [51566, 8.9e-05, " efforts", false], [21265, 7.7e-05, " and", false], [52245, 6.1e-05, " mistake", false], [4715, 5.9e-05, " or", false]]], "qwen": [315, 1, 0.9986101388931274, [[315, 0.99861, " of", false], [323, 0.000309, " and", false], [20643, 0.000172, " mistakes", false], [476, 0.000135, " or", false], [320, 0.000128, " (", false], [11, 0.000117, ",", false], [5975, 7.1e-05, " errors", false], [8869, 3.4e-05, " efforts", false], [220, 2.5e-05, " ", false], [198, 2.4e-05, "\n", false]]]}, "raw_delta": 0.0013471093649665515, "tuned_delta": 0.009918901395544799}, {"byte_start": 4906, "byte_end": 4915, "display": {"text": " mistakes", "kind": "normal"}, "is_word": true, "word_id": 823, "word_key": " mistakes", "bytes_hex": "20 6d 69 73 74 61 6b 65 73", "compression": {"rwkv": "1.01% 1.01% 1.01% 1.01% 1.01% 1.01% 1.01% 1.01% 1.01%", "qwen": "1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49%"}, "model_tokens": {"rwkv": [[56652, " mistakes", "normal", 0.6053490042686462]], "qwen": [[20643, " mistakes", "normal", 0.4746242165565491]]}, "loss": {"rwkv": 1.009698677705492, "qwen": 1.4932533397067185}, "topk": {"rwkv": [56652, 1, 0.6053490042686462, [[56652, 0.605349, " mistakes", false], [52245, 0.041975, " mistake", false], [51566, 0.025594, " efforts", false], [45888, 0.024898, " errors", false], [57103, 0.021704, " research", false], [45829, 0.018067, " effort", false], [63678, 0.015487, " investments", false], [52224, 0.015085, " methods", false], [38392, 0.011439, " error", false], [38720, 0.011376, " human", false]]], "qwen": [20643, 1, 0.4746242165565491, [[20643, 0.474624, " mistakes", false], [16523, 0.065973, " mistake", false], [5975, 0.056037, " errors", false], [3738, 0.039857, " human", false], [4124, 0.029794, " early", false], [1465, 0.026912, " error", false], [9162, 0.021732, " investment", false], [21786, 0.017071, " investments", false], [5098, 0.014993, " progress", false], [2856, 0.01144, " initial", false]]]}, "raw_delta": -0.026813964049021397, "tuned_delta": -0.01824217201844315}, {"byte_start": 4915, "byte_end": 4916, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "29.45%", "qwen": "28.04%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.19574415683746338]], "qwen": [[13, ".", "normal", 0.21126553416252136]]}, "loss": {"rwkv": 29.445631205643878, "qwen": 28.03588296717203}, "topk": {"rwkv": [47, 1, 0.19574415683746338, [[47, 0.195744, ".", false], [4596, 0.162787, " in", false], [31601, 0.138742, " over", false], [32227, 0.107937, " that", false], [45, 0.106589, ",", false], [4423, 0.057475, " as", false], [4858, 0.039757, " we", false], [37635, 0.023249, " again", false], [32487, 0.022469, " with", false], [4712, 0.011689, " on", false]]], "qwen": [13, 1, 0.21126553416252136, [[13, 0.211266, ".", false], [916, 0.195751, " over", false], [11, 0.095069, ",", false], [429, 0.074492, " that", false], [304, 0.072692, " in", false], [438, 0.048917, " as", false], [4421, 0.042336, "---", false], [582, 0.035252, " we", false], [1549, 0.028672, " again", false], [323, 0.021516, " and", false]]]}, "raw_delta": 0.07817304134368896, "tuned_delta": 0.08674483337426721}, {"byte_start": 4916, "byte_end": 4919, "display": {"text": " To", "kind": "normal"}, "is_word": true, "word_id": 824, "word_key": " to", "bytes_hex": "20 54 6f", "compression": {"rwkv": "31.18% 31.18% 31.18%", "qwen": "28.46% 28.46% 28.46%"}, "model_tokens": {"rwkv": [[4255, " To", "normal", 0.005641411058604717]], "qwen": [[2014, " To", "normal", 0.008780253119766712]]}, "loss": {"rwkv": 31.183252185881237, "qwen": 28.464673695275074}, "topk": {"rwkv": [4255, 27, 0.005641411058604717, [[4331, 0.134701, " We", false], [20996, 0.081061, " The", false], [261, 0.066953, "\n\n", false], [3913, 0.061582, " In", false], [19555, 0.053585, " But", false], [3918, 0.046274, " It", false], [37451, 0.045053, " There", false], [19907, 0.026815, " For", false], [29894, 0.023136, " This", false], [308, 0.020625, " I", false]]], "qwen": [2014, 18, 0.008780253119766712, [[1205, 0.111953, " We", false], [1988, 0.093285, " But", false], [576, 0.089017, " The", false], [1084, 0.063892, " It", false], [758, 0.048323, " In", false], [2619, 0.039947, " There", false], [1096, 0.032974, " This", false], [1597, 0.031907, " And", false], [358, 0.026578, " I", false], [1752, 0.022181, " For", false]]]}, "raw_delta": 0.1507500012715659, "tuned_delta": 0.15932179330214416}, {"byte_start": 4919, "byte_end": 4923, "display": {"text": " see", "kind": "normal"}, "is_word": true, "word_id": 825, "word_key": " see", "bytes_hex": "20 73 65 65", "compression": {"rwkv": "16.77% 16.77% 16.77% 16.77%", "qwen": "19.52% 19.52% 19.52% 19.52%"}, "model_tokens": {"rwkv": [[22449, " see", "normal", 0.024376166984438896]], "qwen": [[1490, " see", "normal", 0.013163922354578972]]}, "loss": {"rwkv": 16.765694322830726, "qwen": 19.522709502715966}, "topk": {"rwkv": [22449, 10, 0.024376166984438896, [[4435, 0.099156, " be", false], [31358, 0.060039, " make", false], [32187, 0.040712, " take", false], [22590, 0.034171, " the", false], [21751, 0.032115, " get", false], [37786, 0.028702, " avoid", false], [62683, 0.027854, " understand", false], [4491, 0.026741, " do", false], [32074, 0.024892, " some", false], [22449, 0.024376, " see", false]]], "qwen": [1490, 17, 0.013163922354578972, [[387, 0.110351, " be", false], [3960, 0.067301, " learn", false], [5648, 0.063263, " avoid", false], [1281, 0.062849, " make", false], [3535, 0.030926, " understand", false], [653, 0.02404, " do", false], [279, 0.02172, " the", false], [633, 0.021199, " get", false], [1896, 0.020937, " take", false], [13153, 0.020529, " repeat", false]]]}, "raw_delta": -0.15288138389587402, "tuned_delta": -0.14430959186529577}, {"byte_start": 4923, "byte_end": 4928, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 826, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "8.17% 8.17% 8.17% 8.17% 8.17%", "qwen": "6.74% 6.74% 6.74% 6.74% 6.74%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.10356917977333069]], "qwen": [[419, " this", "normal", 0.15444213151931763]]}, "loss": {"rwkv": 8.171514880035144, "qwen": 6.737154634354944}, "topk": {"rwkv": [32234, 4, 0.10356917977333069, [[22590, 0.18071, " the", false], [22763, 0.165182, " why", false], [21835, 0.145519, " how", false], [32234, 0.103569, " this", false], [32464, 0.063456, " what", false], [4601, 0.061808, " it", false], [32227, 0.048837, " that", false], [332, 0.033685, " a", false], [4419, 0.01726, " an", false], [40185, 0.012608, " where", false]]], "qwen": [419, 1, 0.15444213151931763, [[419, 0.154442, " this", false], [3170, 0.139609, " why", false], [279, 0.133873, " the", false], [1246, 0.12847, " how", false], [1128, 0.07713, " what", false], [429, 0.055649, " that", false], [264, 0.035625, " a", false], [1045, 0.034062, " some", false], [432, 0.033593, " it", false], [1380, 0.028605, " where", false]]]}, "raw_delta": 0.07953782081604005, "tuned_delta": 0.0881096128466183}, {"byte_start": 4928, "byte_end": 4929, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "13.38%", "qwen": "8.79%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.4706677496433258]], "qwen": [[11, ",", "normal", 0.6143350005149841]]}, "loss": {"rwkv": 13.384377820747218, "qwen": 8.786281376580419}, "topk": {"rwkv": [45, 1, 0.4706677496433258, [[45, 0.470668, ",", false], [46430, 0.121789, " lesson", false], [52427, 0.058859, " pattern", false], [4596, 0.052895, " in", false], [31458, 0.052536, " more", false], [51208, 0.042406, " clearly", false], [4423, 0.019694, " as", false], [4600, 0.010563, " is", false], [52245, 0.009951, " mistake", false], [31461, 0.008372, " most", false]]], "qwen": [11, 1, 0.6143350005149841, [[11, 0.614335, ",", false], [304, 0.049511, " in", false], [9355, 0.0491, " clearly", false], [17755, 0.031125, " lesson", false], [5383, 0.025883, " pattern", false], [803, 0.020151, " more", false], [374, 0.012446, " is", false], [2664, 0.011206, " better", false], [1459, 0.007334, " point", false], [369, 0.007332, " for", false]]]}, "raw_delta": 0.2549726068973541, "tuned_delta": 0.26354439892793236}, {"byte_start": 4929, "byte_end": 4933, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 827, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "23.81% 23.81% 23.81% 23.81%", "qwen": "25.09% 25.09% 25.09% 25.09%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.005093383602797985]], "qwen": [[323, " and", "normal", 0.0038293139077723026]]}, "loss": {"rwkv": 23.810103702171368, "qwen": 25.089682571771426}, "topk": {"rwkv": [21265, 21, 0.005093383602797985, [[4601, 0.200636, " it", false], [4858, 0.164141, " we", false], [55832, 0.134672, " consider", false], [22001, 0.075261, " let", false], [22226, 0.072453, " one", false], [31324, 0.061285, " look", false], [31198, 0.038013, " just", false], [51250, 0.030382, " compare", false], [32187, 0.022115, " take", false], [308, 0.014481, " I", false]]], "qwen": [323, 26, 0.0038293139077723026, [[2908, 0.195418, " consider", false], [1401, 0.155159, " look", false], [432, 0.101601, " it", false], [582, 0.080695, " we", false], [825, 0.057995, " one", false], [1077, 0.041057, " let", false], [5185, 0.036375, " note", false], [1101, 0.03611, " just", false], [1896, 0.025511, " take", false], [9429, 0.025018, " compare", false]]]}, "raw_delta": -0.07095491886138916, "tuned_delta": -0.06238312683081091}, {"byte_start": 4933, "byte_end": 4936, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 828, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "3.36% 3.36% 3.36%", "qwen": "3.45% 3.45% 3.45%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.5713860392570496]], "qwen": [[311, " to", "normal", 0.5629984140396118]]}, "loss": {"rwkv": 3.357835137485705, "qwen": 3.4533216967306837}, "topk": {"rwkv": [4811, 1, 0.5713860392570496, [[4811, 0.571386, " to", false], [22590, 0.063481, " the", false], [21835, 0.021663, " how", false], [38877, 0.020491, " learn", false], [22763, 0.018488, " why", false], [21902, 0.015733, " its", false], [30135, 0.014389, " also", false], [39193, 0.013611, " other", false], [22449, 0.012867, " see", false], [32464, 0.012248, " what", false]]], "qwen": [311, 1, 0.5629984140396118, [[311, 0.562998, " to", false], [279, 0.091902, " the", false], [1246, 0.030864, " how", false], [1083, 0.022423, " also", false], [1008, 0.021903, " other", false], [3170, 0.021149, " why", false], [264, 0.017367, " a", false], [1128, 0.014932, " what", false], [369, 0.01095, " for", false], [1045, 0.010928, " some", false]]]}, "raw_delta": -0.005294899145762144, "tuned_delta": 0.003276892884816104}, {"byte_start": 4936, "byte_end": 4948, "display": {"text": " effectively", "kind": "normal"}, "is_word": true, "word_id": 829, "word_key": " effectively", "bytes_hex": "20 65 66 66 65 63 74 69 76 65 6c 79", "compression": {"rwkv": "13.34% 13.34% 13.34% 13.34% 13.34% 13.34% 13.34% 13.34% 13.34% 13.34% 13.34% 13.34%", "qwen": "13.85% 13.85% 13.85% 13.85% 13.85% 13.85% 13.85% 13.85% 13.85% 13.85% 13.85% 13.85%"}, "model_tokens": {"rwkv": [[63507, " effectively", "normal", 0.00013784487964585423]], "qwen": [[13444, " effectively", "normal", 9.947544458555058e-05]]}, "loss": {"rwkv": 13.337415091551614, "qwen": 13.849271290238262}, "topk": {"rwkv": [63507, 303, 0.00013784487964585423, [[22449, 0.225273, " see", false], [62683, 0.158171, " understand", false], [38877, 0.087, " learn", false], [37786, 0.046839, " avoid", false], [61588, 0.041666, " appreciate", false], [21751, 0.03552, " get", false], [4435, 0.029543, " be", false], [31358, 0.026092, " make", false], [52653, 0.012859, " realize", false], [22626, 0.012111, " try", false]]], "qwen": [13444, 431, 9.947544458555058e-05, [[3535, 0.19748, " understand", false], [1490, 0.11596, " see", false], [3960, 0.075994, " learn", false], [387, 0.03856, " be", false], [5648, 0.03285, " avoid", false], [15401, 0.029415, " appreciate", false], [1281, 0.024992, " make", false], [633, 0.023834, " get", false], [614, 0.021632, " have", false], [15282, 0.016598, " recognize", false]]]}, "raw_delta": -0.02838333447774244, "tuned_delta": -0.01981154244716419}, {"byte_start": 4948, "byte_end": 4955, "display": {"text": " resist", "kind": "normal"}, "is_word": true, "word_id": 830, "word_key": " resist", "bytes_hex": "20 72 65 73 69 73 74", "compression": {"rwkv": "15.14% 15.14% 15.14% 15.14% 15.14% 15.14% 15.14%", "qwen": "19.98% 19.98% 19.98% 19.98% 19.98% 19.98% 19.98%"}, "model_tokens": {"rwkv": [[47087, " resist", "normal", 0.0028409697115421295]], "qwen": [[22106, " resist", "normal", 0.00042875210056081414]]}, "loss": {"rwkv": 15.135416723611891, "qwen": 19.97780200852034}, "topk": {"rwkv": [47087, 42, 0.0028409697115421295, [[38877, 0.119497, " learn", false], [37730, 0.104816, " apply", false], [37786, 0.085516, " avoid", false], [22681, 0.059306, " use", false], [51336, 0.03759, " counter", false], [50855, 0.031638, " address", false], [56540, 0.030998, " leverage", false], [32187, 0.024057, " take", false], [31358, 0.020605, " make", false], [45522, 0.019548, " combat", false]]], "qwen": [22106, 164, 0.00042875210056081414, [[3960, 0.262567, " learn", false], [5648, 0.123221, " avoid", false], [3796, 0.078308, " apply", false], [32064, 0.030248, " leverage", false], [3271, 0.028553, " move", false], [990, 0.022574, " use", false], [1896, 0.020608, " take", false], [1281, 0.020517, " make", false], [4538, 0.017982, " teach", false], [4211, 0.017053, " implement", false]]]}, "raw_delta": -0.26851885659354074, "tuned_delta": -0.2599470645629625}, {"byte_start": 4955, "byte_end": 4958, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 831, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "13.24% 13.24% 13.24%", "qwen": "12.15% 12.15% 12.15%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.10896933078765869]], "qwen": [[432, " it", "normal", 0.1325092613697052]]}, "loss": {"rwkv": 13.243489633160404, "qwen": 12.1493130773511}, "topk": {"rwkv": [4601, 2, 0.10896933078765869, [[22590, 0.456799, " the", false], [4601, 0.108969, " it", false], [32234, 0.092467, " this", false], [46500, 0.056916, " making", false], [39936, 0.042893, " these", false], [39944, 0.017961, " those", false], [60384, 0.017759, " repeating", false], [32227, 0.017459, " that", false], [332, 0.011967, " a", false], [51709, 0.011382, " falling", false]]], "qwen": [432, 2, 0.1325092613697052, [[279, 0.322693, " the", false], [432, 0.132509, " it", false], [1493, 0.083273, " these", false], [419, 0.069625, " this", false], [1105, 0.037731, " them", false], [1741, 0.032003, " such", false], [1181, 0.025679, " its", false], [15679, 0.018607, " falling", false], [3259, 0.018244, " making", false], [1846, 0.017832, " those", false]]]}, "raw_delta": 0.06067403157552087, "tuned_delta": 0.06924582360609911}, {"byte_start": 4958, "byte_end": 4959, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "0.99%", "qwen": "1.24%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.9466332197189331]], "qwen": [[11, ",", "normal", 0.9333043098449707]]}, "loss": {"rwkv": 0.9862173131076897, "qwen": 1.2447570854509522}, "topk": {"rwkv": [45, 1, 0.9466332197189331, [[45, 0.946633, ",", false], [4596, 0.017383, " in", false], [275, 0.004334, " (", false], [4423, 0.003516, " as", false], [32465, 0.003453, " when", false], [37635, 0.001884, " again", false], [4600, 0.001832, " is", false], [5346, 0.001451, "---", false], [21265, 0.001444, " and", false], [38606, 0.001085, " going", false]]], "qwen": [11, 1, 0.9333043098449707, [[11, 0.933304, ",", false], [304, 0.029313, " in", false], [979, 0.003033, " when", false], [320, 0.002939, " (", false], [323, 0.002854, " and", false], [504, 0.002625, " from", false], [2087, 0.002564, " going", false], [369, 0.002483, " for", false], [438, 0.00187, " as", false], [518, 0.001153, " at", false]]]}, "raw_delta": -0.014336489140987396, "tuned_delta": -0.005764697110409148}, {"byte_start": 4959, "byte_end": 4962, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 832, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"rwkv": "5.24% 5.24% 5.24%", "qwen": "6.28% 6.28% 6.28%"}, "model_tokens": {"rwkv": [[4858, " we", "normal", 0.4178939163684845]], "qwen": [[582, " we", "normal", 0.35177427530288696]]}, "loss": {"rwkv": 5.236344305309876, "qwen": 6.280325574681734}, "topk": {"rwkv": [4858, 1, 0.4178939163684845, [[4858, 0.417894, " we", false], [4601, 0.204802, " it", false], [22226, 0.090999, " one", false], [4600, 0.042974, " is", false], [57102, 0.038263, " requires", false], [22590, 0.028853, " the", false], [22799, 0.022359, " you", false], [308, 0.020666, " I", false], [332, 0.015554, " a", false], [22001, 0.011749, " let", false]]], "qwen": [582, 1, 0.35177427530288696, [[582, 0.351774, " we", false], [432, 0.128463, " it", false], [825, 0.091517, " one", false], [7460, 0.063632, " requires", false], [498, 0.041468, " you", false], [279, 0.033669, " the", false], [374, 0.031293, " is", false], [11811, 0.021768, " researchers", false], [264, 0.020178, " a", false], [2908, 0.017095, " consider", false]]]}, "raw_delta": -0.05789061387379968, "tuned_delta": -0.04931882184322143}, {"byte_start": 4962, "byte_end": 4967, "display": {"text": " have", "kind": "normal"}, "is_word": true, "word_id": 833, "word_key": " have", "bytes_hex": "20 68 61 76 65", "compression": {"rwkv": "10.09% 10.09% 10.09% 10.09% 10.09%", "qwen": "11.52% 11.52% 11.52% 11.52% 11.52%"}, "model_tokens": {"rwkv": [[31059, " have", "normal", 0.06028171628713608]], "qwen": [[614, " have", "normal", 0.04098060354590416]]}, "loss": {"rwkv": 10.087594231215798, "qwen": 11.522287263325417}, "topk": {"rwkv": [31059, 4, 0.06028171628713608, [[31506, 0.592673, " need", false], [31475, 0.151163, " must", false], [47266, 0.062411, " should", false], [31059, 0.060282, " have", false], [21413, 0.039595, " can", false], [32475, 0.0155, " will", false], [38499, 0.011462, " first", false], [40219, 0.006171, " would", false], [39021, 0.005365, " might", false], [22074, 0.005097, " may", false]]], "qwen": [614, 3, 0.04098060354590416, [[1184, 0.608809, " need", false], [1969, 0.254305, " must", false], [614, 0.040981, " have", false], [686, 0.027231, " will", false], [1265, 0.024201, " should", false], [646, 0.009551, " can", false], [1035, 0.003053, " would", false], [1156, 0.003053, " first", false], [525, 0.002076, " are", false], [1083, 0.001956, " also", false]]]}, "raw_delta": -0.07955627441406254, "tuned_delta": -0.0709844823834843}, {"byte_start": 4967, "byte_end": 4970, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 834, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.45% 0.45% 0.45%", "qwen": "0.25% 0.25% 0.25%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.928294837474823]], "qwen": [[311, " to", "normal", 0.9586803913116455]]}, "loss": {"rwkv": 0.44614592735824055, "qwen": 0.25365889127563124}, "topk": {"rwkv": [4811, 1, 0.928294837474823, [[4811, 0.928295, " to", false], [31581, 0.01285, " only", false], [332, 0.010268, " a", false], [22638, 0.004383, " two", false], [32074, 0.001995, " some", false], [22590, 0.0017, " the", false], [4419, 0.001557, " an", false], [39946, 0.00145, " three", false], [30259, 0.001226, " been", false], [38499, 0.001074, " first", false]]], "qwen": [311, 1, 0.9586803913116455, [[311, 0.95868, " to", false], [264, 0.005949, " a", false], [1378, 0.005568, " two", false], [1172, 0.002125, " only", false], [3807, 0.00138, " several", false], [2326, 0.001378, " three", false], [279, 0.001253, " the", false], [518, 0.00111, " at", false], [537, 0.001098, " not", false], [1045, 0.001079, " some", false]]]}, "raw_delta": 0.010673747708400091, "tuned_delta": 0.01924553973897834}, {"byte_start": 4970, "byte_end": 4981, "display": {"text": " understand", "kind": "normal"}, "is_word": true, "word_id": 835, "word_key": " understand", "bytes_hex": "20 75 6e 64 65 72 73 74 61 6e 64", "compression": {"rwkv": "3.23% 3.23% 3.23% 3.23% 3.23% 3.23% 3.23% 3.23% 3.23% 3.23% 3.23%", "qwen": "3.93% 3.93% 3.93% 3.93% 3.93% 3.93% 3.93% 3.93% 3.93% 3.93% 3.93%"}, "model_tokens": {"rwkv": [[62683, " understand", "normal", 0.1398772895336151]], "qwen": [[3535, " understand", "normal", 0.09098818153142929]]}, "loss": {"rwkv": 3.2276202974433486, "qwen": 3.9297465052446636}, "topk": {"rwkv": [62683, 1, 0.1398772895336151, [[62683, 0.139877, " understand", false], [4435, 0.068481, " be", false], [31324, 0.067404, " look", false], [38877, 0.032759, " learn", false], [60335, 0.030881, " recognize", false], [21295, 0.02982, " ask", false], [31059, 0.029113, " have", false], [39942, 0.026514, " think", false], [22449, 0.026296, " see", false], [31205, 0.026092, " keep", false]]], "qwen": [3535, 2, 0.09098818153142929, [[387, 0.107454, " be", false], [3535, 0.090988, " understand", false], [1401, 0.068165, " look", false], [15282, 0.044598, " recognize", false], [3960, 0.037387, " learn", false], [1744, 0.029901, " think", false], [614, 0.027115, " have", false], [1490, 0.025923, " see", false], [1281, 0.021878, " make", false], [728, 0.021751, " go", false]]]}, "raw_delta": -0.03893414410677822, "tuned_delta": -0.030362352076199972}, {"byte_start": 4981, "byte_end": 4985, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 836, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "5.39% 5.39% 5.39% 5.39%", "qwen": "6.04% 6.04% 6.04% 6.04%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.30333784222602844]], "qwen": [[279, " the", "normal", 0.26193827390670776]]}, "loss": {"rwkv": 5.3889731751955905, "qwen": 6.039691032566385}, "topk": {"rwkv": [22590, 1, 0.30333784222602844, [[22590, 0.303338, " the", false], [32464, 0.13074, " what", false], [22763, 0.109415, " why", false], [4601, 0.106478, " it", false], [21835, 0.086119, " how", false], [32227, 0.026279, " that", false], [21902, 0.019398, " its", false], [332, 0.01811, " a", false], [21265, 0.016685, " and", false], [51665, 0.014394, " exactly", false]]], "qwen": [279, 1, 0.26193827390670776, [[279, 0.261938, " the", false], [1128, 0.127375, " what", false], [3170, 0.11478, " why", false], [432, 0.090524, " it", false], [1246, 0.058081, " how", false], [429, 0.055388, " that", false], [1181, 0.033889, " its", false], [1378, 0.019473, " two", false], [419, 0.016042, " this", false], [1045, 0.014734, " some", false]]]}, "raw_delta": -0.03608345985412598, "tuned_delta": -0.027511667823547727}, {"byte_start": 4985, "byte_end": 4992, "display": {"text": " appeal", "kind": "normal"}, "is_word": true, "word_id": 837, "word_key": " appeal", "bytes_hex": "20 61 70 70 65 61 6c", "compression": {"rwkv": "20.77% 20.77% 20.77% 20.77% 20.77% 20.77% 20.77%", "qwen": "25.58% 25.58% 25.58% 25.58% 25.58% 25.58% 25.58%"}, "model_tokens": {"rwkv": [[45184, " appeal", "normal", 0.0003196117759216577]], "qwen": [[14303, " appeal", "normal", 4.866080416832119e-05]]}, "loss": {"rwkv": 20.770944227084403, "qwen": 25.583714099514278}, "topk": {"rwkv": [45184, 292, 0.0003196117759216577, [[46642, 0.095806, " nature", false], [46430, 0.050476, " lesson", false], [52127, 0.03419, " lessons", false], [51929, 0.030761, " history", false], [52654, 0.028853, " reasons", false], [51832, 0.024896, " general", false], [37812, 0.024573, " basic", false], [62680, 0.02384, " underlying", false], [62418, 0.023291, " psychology", false], [52427, 0.018902, " pattern", false]]], "qwen": [14303, 1067, 4.866080416832119e-05, [[7966, 0.083915, " reasons", false], [6993, 0.045704, " nature", false], [6672, 0.027063, " difference", false], [3840, 0.025021, " history", false], [25180, 0.023007, " bitter", false], [16533, 0.021936, " underlying", false], [15811, 0.020883, " fundamental", false], [1378, 0.020182, " two", false], [29918, 0.013321, " psychology", false], [3491, 0.011962, " problem", false]]]}, "raw_delta": -0.26687662942068924, "tuned_delta": -0.258304837390111}, {"byte_start": 4992, "byte_end": 4995, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 838, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.87% 0.87% 0.87%", "qwen": "0.62% 0.62% 0.62%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.8628022074699402]], "qwen": [[315, " of", "normal", 0.9012525081634521]]}, "loss": {"rwkv": 0.8746808312681296, "qwen": 0.624986207275609}, "topk": {"rwkv": [4706, 1, 0.8628022074699402, [[4706, 0.862802, " of", false], [4811, 0.039641, " to", false], [21265, 0.036568, " and", false], [32227, 0.016825, " that", false], [45, 0.013967, ",", false], [21700, 0.004149, " for", false], [47, 0.004116, ".", false], [5346, 0.003409, "---", false], [4601, 0.00203, " it", false], [4858, 0.001565, " we", false]]], "qwen": [315, 1, 0.9012525081634521, [[315, 0.901253, " of", false], [323, 0.02613, " and", false], [429, 0.023416, " that", false], [311, 0.021789, " to", false], [11, 0.010386, ",", false], [369, 0.002979, " for", false], [304, 0.00221, " in", false], [320, 0.001709, " (", false], [4421, 0.001039, "---", false], [13, 0.000806, ".", false]]]}, "raw_delta": 0.013846009969711304, "tuned_delta": 0.022417802000289554}, {"byte_start": 4995, "byte_end": 5001, "display": {"text": " these", "kind": "normal"}, "is_word": true, "word_id": 839, "word_key": " these", "bytes_hex": "20 74 68 65 73 65", "compression": {"rwkv": "9.39% 9.39% 9.39% 9.39% 9.39% 9.39%", "qwen": "11.26% 11.26% 11.26% 11.26% 11.26% 11.26%"}, "model_tokens": {"rwkv": [[39936, " these", "normal", 0.04402855783700943]], "qwen": [[1493, " these", "normal", 0.023618167266249657]]}, "loss": {"rwkv": 9.392545839120855, "qwen": 11.258248032210776}, "topk": {"rwkv": [39936, 4, 0.04402855783700943, [[22590, 0.314405, " the", false], [38720, 0.228851, " human", false], [52224, 0.077048, " methods", false], [39936, 0.044029, " these", false], [22248, 0.018348, " our", false], [32234, 0.013944, " this", false], [332, 0.012823, " a", false], [47629, 0.012164, " trying", false], [61590, 0.010988, " approaches", false], [57103, 0.010512, " research", false]]], "qwen": [1493, 5, 0.023618167266249657, [[279, 0.309243, " the", false], [3738, 0.306688, " human", false], [3281, 0.033718, " special", false], [5413, 0.030899, " methods", false], [1493, 0.023618, " these", false], [1039, 0.012996, " our", false], [1045, 0.012859, " some", false], [264, 0.009896, " a", false], [1817, 0.009332, " each", false], [3654, 0.00927, " certain", false]]]}, "raw_delta": -0.10345649719238281, "tuned_delta": -0.09488470516180457}, {"byte_start": 5001, "byte_end": 5010, "display": {"text": " mistakes", "kind": "normal"}, "is_word": true, "word_id": 840, "word_key": " mistakes", "bytes_hex": "20 6d 69 73 74 61 6b 65 73", "compression": {"rwkv": "12.90% 12.90% 12.90% 12.90% 12.90% 12.90% 12.90% 12.90% 12.90%", "qwen": "10.98% 10.98% 10.98% 10.98% 10.98% 10.98% 10.98% 10.98% 10.98%"}, "model_tokens": {"rwkv": [[56652, " mistakes", "normal", 0.0015993948327377439]], "qwen": [[20643, " mistakes", "normal", 0.004172160755842924]]}, "loss": {"rwkv": 12.899096285725975, "qwen": 10.979152675472264}, "topk": {"rwkv": [56652, 46, 0.0015993948327377439, [[38720, 0.193543, " human", false], [39193, 0.121086, " other", false], [52224, 0.072802, " methods", false], [22221, 0.069215, " old", false], [39174, 0.066841, " older", false], [51551, 0.065484, " earlier", false], [63277, 0.037843, " alternative", false], [61590, 0.034219, " approaches", false], [38841, 0.024445, " kinds", false], [52964, 0.019217, " special", false]]], "qwen": [20643, 20, 0.004172160755842924, [[3738, 0.209033, " human", false], [3281, 0.137328, " special", false], [4124, 0.075919, " early", false], [6788, 0.071177, " earlier", false], [5413, 0.063224, " methods", false], [1008, 0.050898, " other", false], [19827, 0.048362, " approaches", false], [2310, 0.043633, " old", false], [9014, 0.036111, " older", false], [10555, 0.017361, " alternative", false]]]}, "raw_delta": 0.10646428002251518, "tuned_delta": 0.11503607205309342}, {"byte_start": 5010, "byte_end": 5011, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "12.89%", "qwen": "18.89%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.4857923090457916]], "qwen": [[13, ".", "normal", 0.3507641553878784]]}, "loss": {"rwkv": 12.891269164193373, "qwen": 18.892835942629745}, "topk": {"rwkv": [47, 1, 0.4857923090457916, [[47, 0.485792, ".", false], [45, 0.262081, ",", false], [21265, 0.14136, " and", false], [4811, 0.021574, " to", false], [5346, 0.019084, "---", false], [4596, 0.017449, " in", false], [21700, 0.006586, " for", false], [59, 0.005962, ":", false], [4423, 0.005793, " as", false], [60, 0.004013, ";", false]]], "qwen": [13, 1, 0.3507641553878784, [[13, 0.350764, ".", false], [11, 0.283279, ",", false], [323, 0.138152, " and", false], [382, 0.08834, ".\n\n", false], [304, 0.02879, " in", false], [4421, 0.028449, "---", false], [438, 0.00939, " as", false], [624, 0.007296, ".\n", false], [25, 0.005875, ":", false], [311, 0.005231, " to", false]]]}, "raw_delta": -0.3327975273132324, "tuned_delta": -0.3242257352826542}, {"byte_start": 5011, "byte_end": 5014, "display": {"text": " We", "kind": "normal"}, "is_word": true, "word_id": 841, "word_key": " we", "bytes_hex": "20 57 65", "compression": {"rwkv": "17.47% 17.47% 17.47%", "qwen": "14.90% 14.90% 14.90%"}, "model_tokens": {"rwkv": [[4331, " We", "normal", 0.054759811609983444]], "qwen": [[1205, " We", "normal", 0.08380118012428284]]}, "loss": {"rwkv": 17.47013526076479, "qwen": 14.903689756734355}, "topk": {"rwkv": [4331, 3, 0.054759811609983444, [[261, 0.395245, "\n\n", false], [20996, 0.077614, " The", false], [4331, 0.05476, " We", false], [3913, 0.027977, " In", false], [29893, 0.024518, " They", false], [3918, 0.024238, " It", false], [37451, 0.022188, " There", false], [21152, 0.021068, " Why", false], [4255, 0.01825, " To", false], [19417, 0.018046, " And", false]]], "qwen": [1205, 2, 0.08380118012428284, [[576, 0.111714, " The", false], [1205, 0.083801, " We", false], [8429, 0.070663, " Why", false], [1084, 0.06605, " It", false], [220, 0.059405, " ", false], [758, 0.046129, " In", false], [2619, 0.037961, " There", false], [3776, 0.036161, " One", false], [2379, 0.033422, " They", false], [1096, 0.033081, " This", false]]]}, "raw_delta": 0.14231395721435547, "tuned_delta": 0.15088574924493373}, {"byte_start": 5014, "byte_end": 5019, "display": {"text": " have", "kind": "normal"}, "is_word": true, "word_id": 842, "word_key": " have", "bytes_hex": "20 68 61 76 65", "compression": {"rwkv": "4.17% 4.17% 4.17% 4.17% 4.17%", "qwen": "3.33% 3.33% 3.33% 3.33% 3.33%"}, "model_tokens": {"rwkv": [[31059, " have", "normal", 0.3120371997356415]], "qwen": [[614, " have", "normal", 0.397343248128891]]}, "loss": {"rwkv": 4.170290352569659, "qwen": 3.328855774177571}, "topk": {"rwkv": [31059, 1, 0.3120371997356415, [[31059, 0.312037, " have", false], [31506, 0.105877, " need", false], [21413, 0.104254, " can", false], [32475, 0.072976, " will", false], [31475, 0.061082, " must", false], [21286, 0.043713, " are", false], [47266, 0.030198, " should", false], [30135, 0.02125, " also", false], [4491, 0.015971, " do", false], [31223, 0.011014, " know", false]]], "qwen": [614, 1, 0.397343248128891, [[614, 0.397343, " have", false], [1184, 0.100606, " need", false], [1969, 0.078978, " must", false], [686, 0.051475, " will", false], [646, 0.046523, " can", false], [1083, 0.042537, " also", false], [1265, 0.024587, " should", false], [525, 0.022719, " are", false], [678, 0.017195, " all", false], [653, 0.017034, " do", false]]]}, "raw_delta": 0.04665904045104982, "tuned_delta": 0.05523083248162807}, {"byte_start": 5019, "byte_end": 5022, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 843, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.97% 0.97% 0.97%", "qwen": "1.06% 1.06% 1.06%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.8508479595184326]], "qwen": [[311, " to", "normal", 0.8381847143173218]]}, "loss": {"rwkv": 0.9686062896593381, "qwen": 1.0610827942170276}, "topk": {"rwkv": [4811, 1, 0.8508479595184326, [[4811, 0.850848, " to", false], [332, 0.01689, " a", false], [31968, 0.012974, " seen", false], [50888, 0.009887, " already", false], [30259, 0.006838, " been", false], [30135, 0.006364, " also", false], [22590, 0.004833, " the", false], [21256, 0.004547, " all", false], [22638, 0.003885, " two", false], [4419, 0.003203, " an", false]]], "qwen": [311, 1, 0.8381847143173218, [[311, 0.838185, " to", false], [264, 0.017542, " a", false], [3884, 0.015281, " seen", false], [1012, 0.010706, " been", false], [1083, 0.007613, " also", false], [537, 0.006748, " not", false], [2669, 0.005927, " already", false], [11, 0.005638, ",", false], [458, 0.004663, " an", false], [678, 0.003852, " all", false]]]}, "raw_delta": -0.005127986272176109, "tuned_delta": 0.003443805758402139}, {"byte_start": 5022, "byte_end": 5028, "display": {"text": " learn", "kind": "normal"}, "is_word": true, "word_id": 844, "word_key": " learn", "bytes_hex": "20 6c 65 61 72 6e", "compression": {"rwkv": "12.77% 12.77% 12.77% 12.77% 12.77% 12.77%", "qwen": "13.20% 13.20% 13.20% 13.20% 13.20% 13.20%"}, "model_tokens": {"rwkv": [[38877, " learn", "normal", 0.014352542348206043]], "qwen": [[3960, " learn", "normal", 0.012385758571326733]]}, "loss": {"rwkv": 12.773862341204364, "qwen": 13.198279693814845}, "topk": {"rwkv": [38877, 6, 0.014352542348206043, [[62683, 0.66888, " understand", false], [22449, 0.067032, " see", false], [21295, 0.023327, " ask", false], [4435, 0.022155, " be", false], [31223, 0.01982, " know", false], [38877, 0.014353, " learn", false], [60335, 0.014054, " recognize", false], [31324, 0.009366, " look", false], [52653, 0.008152, " realize", false], [61588, 0.008049, " appreciate", false]]], "qwen": [3960, 8, 0.012385758571326733, [[3535, 0.416839, " understand", false], [1490, 0.093795, " see", false], [387, 0.080511, " be", false], [15282, 0.071187, " recognize", false], [1414, 0.048619, " know", false], [13083, 0.024323, " realize", false], [15401, 0.014749, " appreciate", false], [3960, 0.012386, " learn", false], [614, 0.011074, " have", false], [22106, 0.009968, " resist", false]]]}, "raw_delta": -0.0235346953074137, "tuned_delta": -0.014962903276835452}, {"byte_start": 5028, "byte_end": 5032, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 845, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "9.72% 9.72% 9.72% 9.72%", "qwen": "9.99% 9.99% 9.99% 9.99%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.11565075069665909]], "qwen": [[279, " the", "normal", 0.10899939388036728]]}, "loss": {"rwkv": 9.721284943490085, "qwen": 9.992525231515227}, "topk": {"rwkv": [22590, 3, 0.11565075069665909, [[4811, 0.235363, " to", false], [22763, 0.144022, " why", false], [22590, 0.115651, " the", false], [21835, 0.103323, " how", false], [32464, 0.080975, " what", false], [30917, 0.060809, " from", false], [37598, 0.044134, " about", false], [32227, 0.039768, " that", false], [22187, 0.019824, " not", false], [45, 0.014333, ",", false]]], "qwen": [279, 2, 0.10899939388036728, [[311, 0.280491, " to", false], [279, 0.108999, " the", false], [3170, 0.097243, " why", false], [504, 0.096747, " from", false], [1246, 0.095497, " how", false], [1128, 0.084064, " what", false], [429, 0.062275, " that", false], [911, 0.026732, " about", false], [537, 0.024654, " not", false], [862, 0.012204, " their", false]]]}, "raw_delta": -0.015040755271911621, "tuned_delta": -0.006468963241333373}, {"byte_start": 5032, "byte_end": 5039, "display": {"text": " bitter", "kind": "normal"}, "is_word": true, "word_id": 846, "word_key": " bitter", "bytes_hex": "20 62 69 74 74 65 72", "compression": {"rwkv": "5.84% 5.84% 5.84% 5.84% 5.84% 5.84% 5.84%", "qwen": "6.93% 6.93% 6.93% 6.93% 6.93% 6.93% 6.93%"}, "model_tokens": {"rwkv": [[45315, " bitter", "normal", 0.10421230643987656]], "qwen": [[25180, " bitter", "normal", 0.06782101839780807]]}, "loss": {"rwkv": 5.836796342882247, "qwen": 6.932363910751027}, "topk": {"rwkv": [45315, 3, 0.10421230643987656, [[46430, 0.132265, " lesson", false], [52127, 0.115146, " lessons", false], [45315, 0.104212, " bitter", false], [52654, 0.052029, " reasons", false], [62418, 0.025685, " psychology", false], [51929, 0.021571, " history", false], [46642, 0.013865, " nature", false], [64997, 0.013822, " psychological", false], [39831, 0.012239, " story", false], [51832, 0.012164, " general", false]]], "qwen": [25180, 2, 0.06782101839780807, [[18366, 0.074521, " lessons", false], [25180, 0.067821, " bitter", false], [29918, 0.056861, " psychology", false], [7966, 0.049741, " reasons", false], [17755, 0.045587, " lesson", false], [3840, 0.026809, " history", false], [23187, 0.019314, " psychological", false], [6672, 0.015804, " difference", false], [5510, 0.014425, " ways", false], [3738, 0.012123, " human", false]]]}, "raw_delta": -0.060751165662493, "tuned_delta": -0.05217937363191475}, {"byte_start": 5039, "byte_end": 5046, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 847, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"rwkv": "1.09% 1.09% 1.09% 1.09% 1.09% 1.09% 1.09%", "qwen": "0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83%"}, "model_tokens": {"rwkv": [[46430, " lesson", "normal", 0.657513439655304]], "qwen": [[17755, " lesson", "normal", 0.7237542867660522]]}, "loss": {"rwkv": 1.086851732812556, "qwen": 0.8329073714504341}, "topk": {"rwkv": [46430, 1, 0.657513439655304, [[46430, 0.657513, " lesson", false], [52127, 0.284651, " lessons", false], [45, 0.010466, ",", false], [7513, 0.006494, "est", false], [40029, 0.004498, " truth", false], [39899, 0.004173, " taste", false], [21265, 0.003299, " and", false], [46, 0.002331, "-", false], [39831, 0.001557, " story", false], [47009, 0.000994, " reason", false]]], "qwen": [17755, 1, 0.7237542867660522, [[17755, 0.723754, " lesson", false], [18366, 0.11963, " lessons", false], [8046, 0.027578, " truth", false], [11, 0.016569, ",", false], [12656, 0.015943, " taste", false], [3139, 0.009252, " experience", false], [3840, 0.007859, " history", false], [323, 0.005836, " and", false], [8729, 0.002913, " reality", false], [512, 0.002361, " le", false]]]}, "raw_delta": 0.01408166544778006, "tuned_delta": 0.022653457478358306}, {"byte_start": 5046, "byte_end": 5051, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 848, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "9.07% 9.07% 9.07% 9.07% 9.07%", "qwen": "7.36% 7.36% 7.36% 7.36% 7.36%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.07928112149238586]], "qwen": [[429, " that", "normal", 0.1298098862171173]]}, "loss": {"rwkv": 9.073199280590746, "qwen": 7.363818998176066}, "topk": {"rwkv": [32227, 5, 0.07928112149238586, [[47, 0.258066, ".", false], [4706, 0.171253, " of", false], [45, 0.126456, ",", false], [21265, 0.081146, " and", false], [32227, 0.079281, " that", false], [59, 0.034091, ":", false], [4596, 0.02317, " in", false], [32458, 0.021089, " well", false], [5346, 0.019392, "---", false], [30917, 0.0171, " from", false]]], "qwen": [429, 2, 0.1298098862171173, [[382, 0.154984, ".\n\n", false], [429, 0.12981, " that", false], [13, 0.129599, ".", false], [315, 0.094392, " of", false], [11, 0.087151, ",", false], [323, 0.042616, " and", false], [1632, 0.037236, " well", false], [624, 0.026237, ".\n", false], [504, 0.025933, " from", false], [304, 0.024922, " in", false]]]}, "raw_delta": 0.09478816986083988, "tuned_delta": 0.10335996189141812}, {"byte_start": 5051, "byte_end": 5060, "display": {"text": " building", "kind": "normal"}, "is_word": true, "word_id": 849, "word_key": " building", "bytes_hex": "20 62 75 69 6c 64 69 6e 67", "compression": {"rwkv": "20.16% 20.16% 20.16% 20.16% 20.16% 20.16% 20.16% 20.16% 20.16%", "qwen": "14.69% 14.69% 14.69% 14.69% 14.69% 14.69% 14.69% 14.69% 14.69%"}, "model_tokens": {"rwkv": [[55666, " building", "normal", 4.278751293895766e-05]], "qwen": [[4752, " building", "normal", 0.0006548331002704799]]}, "loss": {"rwkv": 20.162665067979436, "qwen": 14.68970129885748}, "topk": {"rwkv": [55666, 749, 4.278751293895766e-05, [[22590, 0.094302, " the", false], [4858, 0.088073, " we", false], [63370, 0.064448, " computation", false], [51832, 0.053794, " general", false], [52195, 0.052991, " massive", false], [47202, 0.049379, " search", false], [45, 0.046746, ",", false], [4601, 0.035439, " it", false], [37045, 0.026211, " Moore", false], [39936, 0.020011, " these", false]]], "qwen": [4752, 142, 0.0006548331002704799, [[279, 0.103325, " the", false], [4586, 0.063643, " general", false], [432, 0.060562, " it", false], [582, 0.052497, " we", false], [11, 0.051867, ",", false], [3738, 0.037563, " human", false], [1052, 0.022888, " there", false], [374, 0.02135, " is", false], [1493, 0.018889, " these", false], [304, 0.016522, " in", false]]]}, "raw_delta": 0.3034855524698894, "tuned_delta": 0.3120573445004676}, {"byte_start": 5060, "byte_end": 5063, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 850, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "28.74% 28.74% 28.74%", "qwen": "33.67% 33.67% 33.67%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.008279256522655487]], "qwen": [[304, " in", "normal", 0.0036908648908138275]]}, "loss": {"rwkv": 28.741190267709815, "qwen": 33.674271831998276}, "topk": {"rwkv": [4596, 16, 0.008279256522655487, [[52224, 0.157471, " methods", false], [53087, 0.139396, " systems", false], [332, 0.113857, " a", false], [4712, 0.054041, " on", false], [38720, 0.04874, " human", false], [22248, 0.045829, " our", false], [3609, 0.031711, " AI", false], [51832, 0.031, " general", false], [22590, 0.020907, " the", false], [47202, 0.017241, " search", false]]], "qwen": [304, 37, 0.0036908648908138275, [[5942, 0.208604, " systems", false], [264, 0.125894, " a", false], [5413, 0.058349, " methods", false], [15235, 0.057395, " AI", false], [458, 0.03022, " an", false], [4119, 0.025556, " models", false], [24514, 0.022974, " intelligent", false], [389, 0.022105, " on", false], [4586, 0.02147, " general", false], [2664, 0.017385, " better", false]]]}, "raw_delta": -0.2735481262207031, "tuned_delta": -0.2649763341901249}, {"byte_start": 5063, "byte_end": 5067, "display": {"text": " how", "kind": "normal"}, "is_word": true, "word_id": 851, "word_key": " how", "bytes_hex": "20 68 6f 77", "compression": {"rwkv": "41.14% 41.14% 41.14% 41.14%", "qwen": "38.38% 38.38% 38.38% 38.38%"}, "model_tokens": {"rwkv": [[21835, " how", "normal", 0.00010841196490218863]], "qwen": [[1246, " how", "normal", 0.00020085007417947054]]}, "loss": {"rwkv": 41.13935077534934, "qwen": 38.379979433147284}, "topk": {"rwkv": [21835, 259, 0.00010841196490218863, [[38720, 0.438515, " human", false], [22248, 0.067943, " our", false], [22590, 0.053666, " the", false], [52195, 0.038905, " massive", false], [332, 0.032204, " a", false], [59943, 0.028475, " knowledge", false], [51832, 0.027865, " general", false], [47202, 0.016437, " search", false], [31458, 0.013131, " more", false], [21256, 0.011241, " all", false]]], "qwen": [1246, 180, 0.00020085007417947054, [[3738, 0.52517, " human", false], [279, 0.077771, " the", false], [1039, 0.054292, " our", false], [6540, 0.04219, " knowledge", false], [264, 0.02268, " a", false], [7947, 0.015423, " domain", false], [25312, 0.015209, "human", false], [3281, 0.012182, " special", false], [4867, 0.008671, " prior", false], [323, 0.007345, " and", false]]]}, "raw_delta": 0.15301203727722168, "tuned_delta": 0.16158382930779994}, {"byte_start": 5067, "byte_end": 5070, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 852, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"rwkv": "7.61% 7.61% 7.61%", "qwen": "9.51% 9.51% 9.51%"}, "model_tokens": {"rwkv": [[4858, " we", "normal", 0.28450843691825867]], "qwen": [[582, " we", "normal", 0.2055639922618866]]}, "loss": {"rwkv": 7.607962129687892, "qwen": 9.50975201568386}, "topk": {"rwkv": [4858, 1, 0.28450843691825867, [[4858, 0.284508, " we", false], [46227, 0.172225, " humans", false], [46787, 0.076883, " people", false], [22590, 0.06279, " the", false], [4811, 0.061105, " to", false], [22248, 0.060481, " our", false], [38720, 0.056891, " human", false], [332, 0.045204, " a", false], [22226, 0.030347, " one", false], [22799, 0.024038, " you", false]]], "qwen": [582, 2, 0.2055639922618866, [[279, 0.246858, " the", false], [582, 0.205564, " we", false], [12677, 0.134287, " humans", false], [1039, 0.085343, " our", false], [1251, 0.076924, " people", false], [264, 0.066651, " a", false], [311, 0.043537, " to", false], [3738, 0.032875, " human", false], [825, 0.014076, " one", false], [2513, 0.009328, " things", false]]]}, "raw_delta": -0.10545762379964196, "tuned_delta": -0.09688583176906372}, {"byte_start": 5070, "byte_end": 5076, "display": {"text": " think", "kind": "normal"}, "is_word": true, "word_id": 853, "word_key": " think", "bytes_hex": "20 74 68 69 6e 6b", "compression": {"rwkv": "2.14% 2.14% 2.14% 2.14% 2.14% 2.14%", "qwen": "1.44% 1.44% 1.44% 1.44% 1.44% 1.44%"}, "model_tokens": {"rwkv": [[39942, " think", "normal", 0.4875118136405945]], "qwen": [[1744, " think", "normal", 0.6184293031692505]]}, "loss": {"rwkv": 2.1368041783999945, "qwen": 1.444415283022331}, "topk": {"rwkv": [39942, 1, 0.4875118136405945, [[39942, 0.487512, " think", false], [62683, 0.0669, " understand", false], [31223, 0.06606, " know", false], [32435, 0.048042, " want", false], [45, 0.026571, ",", false], [60112, 0.025746, " ourselves", false], [46227, 0.023297, " humans", false], [22449, 0.017294, " see", false], [4423, 0.015454, " as", false], [51968, 0.014877, " imagine", false]]], "qwen": [1744, 1, 0.6184293031692505, [[1744, 0.618429, " think", false], [3535, 0.038989, " understand", false], [4411, 0.034441, " believe", false], [1720, 0.032975, " expect", false], [975, 0.025085, " work", false], [12677, 0.01914, " humans", false], [1366, 0.017792, " want", false], [1414, 0.01713, " know", false], [653, 0.014336, " do", false], [525, 0.009446, " are", false]]]}, "raw_delta": 0.038394192854563386, "tuned_delta": 0.046965984885141636}, {"byte_start": 5076, "byte_end": 5079, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 854, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"rwkv": "9.11% 9.11% 9.11%", "qwen": "17.15% 17.15% 17.15%"}, "model_tokens": {"rwkv": [[4858, " we", "normal", 0.2213239073753357]], "qwen": [[582, " we", "normal", 0.057669106870889664]]}, "loss": {"rwkv": 9.11076946394723, "qwen": 17.150238931027424}, "topk": {"rwkv": [4858, 1, 0.2213239073753357, [[4858, 0.221324, " we", false], [37598, 0.146123, " about", false], [4600, 0.145352, " is", false], [22248, 0.106594, " our", false], [45, 0.070646, ",", false], [22590, 0.044996, " the", false], [21265, 0.027026, " and", false], [5346, 0.018853, "---", false], [47001, 0.014404, " rather", false], [4706, 0.01332, " of", false]]], "qwen": [582, 5, 0.057669106870889664, [[374, 0.197221, " is", false], [1039, 0.178334, " our", false], [911, 0.084625, " about", false], [11, 0.061796, ",", false], [582, 0.057669, " we", false], [279, 0.050208, " the", false], [323, 0.028571, " and", false], [12677, 0.026298, " humans", false], [686, 0.023324, " will", false], [4421, 0.019348, "---", false]]]}, "raw_delta": -0.44580284754435223, "tuned_delta": -0.437231055513774}, {"byte_start": 5079, "byte_end": 5085, "display": {"text": " think", "kind": "normal"}, "is_word": true, "word_id": 855, "word_key": " think", "bytes_hex": "20 74 68 69 6e 6b", "compression": {"rwkv": "3.19% 3.19% 3.19% 3.19% 3.19% 3.19%", "qwen": "1.35% 1.35% 1.35% 1.35% 1.35% 1.35%"}, "model_tokens": {"rwkv": [[39942, " think", "normal", 0.3434136211872101]], "qwen": [[1744, " think", "normal", 0.6386187672615051]]}, "loss": {"rwkv": 3.193465585301091, "qwen": 1.3478607294303546}, "topk": {"rwkv": [39942, 1, 0.3434136211872101, [[39942, 0.343414, " think", false], [21286, 0.160343, " are", false], [47266, 0.076611, " should", false], [31223, 0.051239, " know", false], [32475, 0.046138, " will", false], [62683, 0.035482, " understand", false], [32499, 0.026556, " work", false], [21413, 0.024884, " can", false], [32435, 0.02415, " want", false], [5230, 0.022209, "'re", false]]], "qwen": [1744, 1, 0.6386187672615051, [[1744, 0.638619, " think", false], [1414, 0.071785, " know", false], [3535, 0.049039, " understand", false], [975, 0.045229, " work", false], [1265, 0.035646, " should", false], [653, 0.0287, " do", false], [525, 0.015335, " are", false], [12677, 0.012244, " humans", false], [646, 0.010578, " can", false], [21776, 0.007312, " ought", false]]]}, "raw_delta": 0.10234206418196361, "tuned_delta": 0.11091385621254185}, {"byte_start": 5085, "byte_end": 5090, "display": {"text": " does", "kind": "normal"}, "is_word": true, "word_id": 856, "word_key": " does", "bytes_hex": "20 64 6f 65 73", "compression": {"rwkv": "17.36% 17.36% 17.36% 17.36% 17.36%", "qwen": "17.11% 17.11% 17.11% 17.11% 17.11%"}, "model_tokens": {"rwkv": [[30659, " does", "normal", 0.008141069673001766]], "qwen": [[1558, " does", "normal", 0.008711479604244232]]}, "loss": {"rwkv": 17.35742471069534, "qwen": 17.10716587611883}, "topk": {"rwkv": [30659, 15, 0.008141069673001766, [[4600, 0.35955, " is", false], [45, 0.160617, ",", false], [5346, 0.054572, "---", false], [32475, 0.034889, " will", false], [38964, 0.02888, " makes", false], [37598, 0.028654, " about", false], [38686, 0.028542, " helps", false], [21265, 0.024325, " and", false], [40212, 0.01893, " works", false], [275, 0.0153, " (", false]]], "qwen": [1558, 16, 0.008711479604244232, [[374, 0.427321, " is", false], [11, 0.107602, ",", false], [4421, 0.075485, "---", false], [686, 0.042633, " will", false], [320, 0.034348, " (", false], [323, 0.020956, " and", false], [11508, 0.017248, " leads", false], [646, 0.016237, " can", false], [1119, 0.015159, " into", false], [911, 0.014814, " about", false]]]}, "raw_delta": 0.013877296447753928, "tuned_delta": 0.02244908847833218}, {"byte_start": 5090, "byte_end": 5094, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 857, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "0.43% 0.43% 0.43% 0.43%", "qwen": "0.58% 0.58% 0.58% 0.58%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.9085621237754822]], "qwen": [[537, " not", "normal", 0.8796513676643372]]}, "loss": {"rwkv": 0.4314700744846143, "qwen": 0.5781132315259238}, "topk": {"rwkv": [22187, 1, 0.9085621237754822, [[22187, 0.908562, " not", false], [31458, 0.014172, " more", false], [4835, 0.013025, " us", false], [31466, 0.007076, " much", false], [4692, 0.004324, " no", false], [332, 0.004023, " a", false], [21660, 0.003528, " far", false], [31049, 0.002812, " harm", false], [45, 0.002667, ",", false], [4788, 0.002106, " so", false]]], "qwen": [537, 1, 0.8796513676643372, [[537, 0.879651, " not", false], [601, 0.026351, " us", false], [803, 0.015866, " more", false], [902, 0.011103, " no", false], [2632, 0.010846, " little", false], [4302, 0.009943, " nothing", false], [279, 0.004964, " the", false], [2686, 0.003646, " less", false], [264, 0.002525, " a", false], [1602, 0.002124, " very", false]]]}, "raw_delta": -0.008131623268127441, "tuned_delta": 0.0004401687624508068}, {"byte_start": 5094, "byte_end": 5099, "display": {"text": " work", "kind": "normal"}, "is_word": true, "word_id": 858, "word_key": " work", "bytes_hex": "20 77 6f 72 6b", "compression": {"rwkv": "4.28% 4.28% 4.28% 4.28% 4.28%", "qwen": "4.62% 4.62% 4.62% 4.62% 4.62%"}, "model_tokens": {"rwkv": [[32499, " work", "normal", 0.30648013949394226]], "qwen": [[975, " work", "normal", 0.27795347571372986]]}, "loss": {"rwkv": 4.28300090263911, "qwen": 4.6177118179217995}, "topk": {"rwkv": [32499, 1, 0.30648013949394226, [[32499, 0.30648, " work", false], [31073, 0.153813, " help", false], [31358, 0.117898, " make", false], [31262, 0.044946, " lead", false], [22269, 0.030662, " pay", false], [51982, 0.022369, " improve", false], [40239, 0.021061, " yield", false], [63717, 0.017719, " necessarily", false], [45150, 0.014854, " always", false], [45851, 0.013678, " enable", false]]], "qwen": [975, 1, 0.27795347571372986, [[975, 0.277953, " work", false], [1492, 0.141885, " help", false], [1281, 0.130175, " make", false], [14312, 0.047249, " necessarily", false], [2677, 0.039702, " always", false], [2990, 0.034625, " lead", false], [2291, 0.028309, " pay", false], [7269, 0.019406, " improve", false], [5452, 0.01876, " scale", false], [8193, 0.016406, " produce", false]]]}, "raw_delta": -0.01856031417846682, "tuned_delta": -0.00998852214788857}, {"byte_start": 5099, "byte_end": 5102, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 859, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "22.17% 22.17% 22.17%", "qwen": "14.61% 14.61% 14.61%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.025334522128105164]], "qwen": [[304, " in", "normal", 0.08799804002046585]]}, "loss": {"rwkv": 22.166408180325217, "qwen": 14.609937656305648}, "topk": {"rwkv": [4596, 5, 0.025334522128105164, [[47, 0.557546, ".", false], [45, 0.203756, ",", false], [21265, 0.032659, " and", false], [4423, 0.030164, " as", false], [4596, 0.025335, " in", false], [32458, 0.024674, " well", false], [5346, 0.018759, "---", false], [21700, 0.01802, " for", false], [32386, 0.013154, " very", false], [60, 0.012424, ";", false]]], "qwen": [304, 4, 0.08799804002046585, [[11, 0.228025, ",", false], [13, 0.186119, ".", false], [1632, 0.11878, " well", false], [304, 0.087998, " in", false], [382, 0.056287, ".\n\n", false], [979, 0.046167, " when", false], [369, 0.033962, " for", false], [4421, 0.032596, "---", false], [323, 0.027918, " and", false], [1602, 0.02747, " very", false]]]}, "raw_delta": 0.41901969909667985, "tuned_delta": 0.4275914911272581}, {"byte_start": 5102, "byte_end": 5106, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 860, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "8.03% 8.03% 8.03% 8.03%", "qwen": "5.12% 5.12% 5.12% 5.12%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.16564661264419556]], "qwen": [[279, " the", "normal", 0.3210839331150055]]}, "loss": {"rwkv": 8.030626692448331, "qwen": 5.121805113875409}, "topk": {"rwkv": [22590, 3, 0.16564661264419556, [[3609, 0.307636, " AI", false], [51832, 0.246449, " general", false], [22590, 0.165647, " the", false], [332, 0.034936, " a", false], [56901, 0.033283, " practice", false], [32234, 0.027718, " this", false], [52167, 0.018159, " machine", false], [31461, 0.016012, " most", false], [55809, 0.013437, " computer", false], [61594, 0.008507, " artificial", false]]], "qwen": [279, 1, 0.3210839331150055, [[279, 0.321084, " the", false], [15235, 0.237011, " AI", false], [4586, 0.070292, " general", false], [264, 0.049939, " a", false], [419, 0.04585, " this", false], [6588, 0.034317, " practice", false], [458, 0.020227, " an", false], [6366, 0.019437, " computer", false], [1657, 0.015189, " many", false], [1429, 0.014388, " most", false]]]}, "raw_delta": 0.16129931807518005, "tuned_delta": 0.1698711101057583}, {"byte_start": 5106, "byte_end": 5111, "display": {"text": " long", "kind": "normal"}, "is_word": true, "word_id": 861, "word_key": " long", "bytes_hex": "20 6c 6f 6e 67", "compression": {"rwkv": "1.67% 1.67% 1.67% 1.67% 1.67%", "qwen": "2.14% 2.14% 2.14% 2.14% 2.14%"}, "model_tokens": {"rwkv": [[31323, " long", "normal", 0.6261128783226013]], "qwen": [[1293, " long", "normal", 0.5521554946899414]]}, "loss": {"rwkv": 1.669525022903732, "qwen": 2.1421337774313574}, "topk": {"rwkv": [31323, 1, 0.6261128783226013, [[31323, 0.626113, " long", false], [51832, 0.051677, " general", false], [30807, 0.041278, " face", false], [31835, 0.024926, " real", false], [21616, 0.023988, " end", false], [46470, 0.020722, " longer", false], [3609, 0.013909, " AI", false], [51310, 0.012343, " context", false], [31937, 0.011603, " same", false], [56916, 0.011568, " presence", false]]], "qwen": [1293, 1, 0.5521554946899414, [[1293, 0.552155, " long", false], [3579, 0.056277, " face", false], [1852, 0.040254, " same", false], [1616, 0.039427, " way", false], [2266, 0.035569, " context", false], [835, 0.029098, " end", false], [1879, 0.022416, " world", false], [4586, 0.020575, " general", false], [4231, 0.017114, " age", false], [1931, 0.016012, " real", false]]]}, "raw_delta": -0.026206994056701672, "tuned_delta": -0.017635202026123425}, {"byte_start": 5111, "byte_end": 5115, "display": {"text": " run", "kind": "normal"}, "is_word": true, "word_id": 862, "word_key": " run", "bytes_hex": "20 72 75 6e", "compression": {"rwkv": "0.52% 0.52% 0.52% 0.52%", "qwen": "0.81% 0.81% 0.81% 0.81%"}, "model_tokens": {"rwkv": [[22418, " run", "normal", 0.892048180103302]], "qwen": [[1598, " run", "normal", 0.8350721001625061]]}, "loss": {"rwkv": 0.5151224358642844, "qwen": 0.812585509856842}, "topk": {"rwkv": [22418, 1, 0.892048180103302, [[22418, 0.892048, " run", false], [32219, 0.094978, " term", false], [46, 0.008566, "-", false], [31057, 0.001793, " haul", false], [45, 0.000386, ",", false], [4715, 0.00027, " or", false], [21265, 0.000258, " and", false], [39438, 0.000208, " range", false], [8661, 0.000132, "run", false], [32251, 7.4e-05, " time", false]]], "qwen": [1598, 1, 0.8350721001625061, [[1598, 0.835072, " run", false], [4647, 0.149661, " term", false], [22973, 0.006208, "-run", false], [9663, 0.00508, "-term", false], [1809, 0.000577, " game", false], [37868, 0.000539, " haul", false], [11, 0.00049, ",", false], [1651, 0.000252, " view", false], [835, 0.000126, " end", false], [1424, 0.000122, " hand", false]]]}, "raw_delta": -0.016494855284690857, "tuned_delta": -0.007923063254112609}, {"byte_start": 5115, "byte_end": 5116, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "6.83%", "qwen": "17.50%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.6870548129081726]], "qwen": [[13, ".", "normal", 0.3790284991264343]]}, "loss": {"rwkv": 6.833077097960421, "qwen": 17.495271600079956}, "topk": {"rwkv": [47, 1, 0.6870548129081726, [[47, 0.687055, ".", false], [45, 0.201355, ",", false], [21265, 0.039974, " and", false], [5346, 0.014201, "---", false], [60, 0.012268, ";", false], [4423, 0.004079, " as", false], [4596, 0.004047, " in", false], [4588, 0.003963, " if", false], [275, 0.003757, " (", false], [51018, 0.003714, " because", false]]], "qwen": [13, 1, 0.3790284991264343, [[13, 0.379028, ".", false], [11, 0.312495, ",", false], [382, 0.143711, ".\n\n", false], [323, 0.029924, " and", false], [4421, 0.02744, "---", false], [26, 0.020779, ";", false], [979, 0.016691, " when", false], [624, 0.013268, ".\n", false], [320, 0.006766, " (", false], [369, 0.006157, " for", false]]]}, "raw_delta": -0.5912376046180725, "tuned_delta": -0.5826658125874943}, {"byte_start": 5116, "byte_end": 5120, "display": {"text": " The", "kind": "normal"}, "is_word": true, "word_id": 863, "word_key": " the", "bytes_hex": "20 54 68 65", "compression": {"rwkv": "12.54% 12.54% 12.54% 12.54%", "qwen": "11.54% 11.54% 11.54% 11.54%"}, "model_tokens": {"rwkv": [[20996, " The", "normal", 0.0623793862760067]], "qwen": [[576, " The", "normal", 0.07735802233219147]]}, "loss": {"rwkv": 12.539048695226342, "qwen": 11.53845363250652}, "topk": {"rwkv": [20996, 3, 0.0623793862760067, [[261, 0.353309, "\n\n", false], [4331, 0.110811, " We", false], [20996, 0.062379, " The", false], [3918, 0.047851, " It", false], [29894, 0.028177, " This", false], [19417, 0.027652, " And", false], [3913, 0.022502, " In", false], [4255, 0.019988, " To", false], [267, 0.018998, "  ", false], [37451, 0.0166, " There", false]]], "qwen": [576, 3, 0.07735802233219147, [[1205, 0.201504, " We", false], [1084, 0.085766, " It", false], [576, 0.077358, " The", false], [220, 0.049018, " ", false], [1597, 0.043184, " And", false], [758, 0.04095, " In", false], [12090, 0.036267, " Instead", false], [1096, 0.031497, " This", false], [2014, 0.020006, " To", false], [1416, 0.018401, " If", false]]]}, "raw_delta": 0.055484771728515625, "tuned_delta": 0.06405656375909387}, {"byte_start": 5120, "byte_end": 5127, "display": {"text": " bitter", "kind": "normal"}, "is_word": true, "word_id": 864, "word_key": " bitter", "bytes_hex": "20 62 69 74 74 65 72", "compression": {"rwkv": "8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09%", "qwen": "11.57% 11.57% 11.57% 11.57% 11.57% 11.57% 11.57%"}, "model_tokens": {"rwkv": [[45315, " bitter", "normal", 0.04283943399786949]], "qwen": [[25180, " bitter", "normal", 0.011190979741513729]]}, "loss": {"rwkv": 8.091007344271251, "qwen": 11.574142489455566}, "topk": {"rwkv": [45315, 3, 0.04283943399786949, [[46430, 0.077597, " lesson", false], [45184, 0.045862, " appeal", false], [45315, 0.042839, " bitter", false], [47009, 0.029321, " reason", false], [31581, 0.023927, " only", false], [31461, 0.023058, " most", false], [38720, 0.021002, " human", false], [30273, 0.015989, " best", false], [52127, 0.013819, " lessons", false], [21357, 0.013423, " big", false]]], "qwen": [25180, 12, 0.011190979741513729, [[1172, 0.059374, " only", false], [3738, 0.059229, " human", false], [17755, 0.042784, " lesson", false], [1850, 0.034479, " best", false], [1429, 0.026778, " most", false], [2070, 0.024099, " field", false], [2874, 0.019449, " reason", false], [1616, 0.018545, " way", false], [803, 0.015485, " more", false], [1376, 0.012972, " key", false]]]}, "raw_delta": -0.19314602443150108, "tuned_delta": -0.18457423240092283}, {"byte_start": 5127, "byte_end": 5134, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 865, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"rwkv": "0.31% 0.31% 0.31% 0.31% 0.31% 0.31% 0.31%", "qwen": "0.27% 0.27% 0.27% 0.27% 0.27% 0.27% 0.27%"}, "model_tokens": {"rwkv": [[46430, " lesson", "normal", 0.8862361311912537]], "qwen": [[17755, " lesson", "normal", 0.9021850824356079]]}, "loss": {"rwkv": 0.3119667010850856, "qwen": 0.2651869017991099}, "topk": {"rwkv": [46430, 1, 0.8862361311912537, [[46430, 0.886236, " lesson", false], [52127, 0.043298, " lessons", false], [7513, 0.027198, "est", false], [31633, 0.006349, " part", false], [39899, 0.004205, " taste", false], [46, 0.003502, "-", false], [40029, 0.002673, " truth", false], [47009, 0.001869, " reason", false], [45, 0.001406, ",", false], [21265, 0.000988, " and", false]]], "qwen": [17755, 1, 0.9021850824356079, [[17755, 0.902185, " lesson", false], [18366, 0.020929, " lessons", false], [8046, 0.011496, " truth", false], [11, 0.004877, ",", false], [477, 0.004274, "est", false], [12656, 0.003808, " taste", false], [3139, 0.003217, " experience", false], [949, 0.00215, " part", false], [374, 0.001937, " is", false], [323, 0.001742, " and", false]]]}, "raw_delta": 0.002594022878578732, "tuned_delta": 0.01116581490915698}, {"byte_start": 5134, "byte_end": 5137, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 866, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "2.97% 2.97% 2.97%", "qwen": "4.62% 4.62% 4.62%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.6106763482093811]], "qwen": [[374, " is", "normal", 0.4638510048389435]]}, "loss": {"rwkv": 2.9703926216219703, "qwen": 4.617777529626316}, "topk": {"rwkv": [4600, 1, 0.6106763482093811, [[4600, 0.610676, " is", false], [4706, 0.043832, " of", false], [32227, 0.043181, " that", false], [45, 0.030191, ",", false], [21800, 0.025671, " has", false], [30135, 0.023286, " also", false], [21413, 0.01885, " can", false], [50938, 0.010327, " applies", false], [30659, 0.009446, " does", false], [4596, 0.009378, " in", false]]], "qwen": [374, 1, 0.4638510048389435, [[374, 0.463851, " is", false], [429, 0.060347, " that", false], [315, 0.045223, " of", false], [702, 0.037756, " has", false], [11, 0.030756, ",", false], [1231, 0.021503, " may", false], [646, 0.019577, " can", false], [1083, 0.01896, " also", false], [686, 0.015643, " will", false], [572, 0.013588, " was", false]]]}, "raw_delta": -0.0913504163424174, "tuned_delta": -0.08277862431183916}, {"byte_start": 5137, "byte_end": 5143, "display": {"text": " based", "kind": "normal"}, "is_word": true, "word_id": 867, "word_key": " based", "bytes_hex": "20 62 61 73 65 64", "compression": {"rwkv": "19.44% 19.44% 19.44% 19.44% 19.44% 19.44%", "qwen": "21.48% 21.48% 21.48% 21.48% 21.48% 21.48%"}, "model_tokens": {"rwkv": [[37810, " based", "normal", 0.0015793975908309221]], "qwen": [[3118, " based", "normal", 0.0007878189207985997]]}, "loss": {"rwkv": 19.44256988698017, "qwen": 21.47885020595085}, "topk": {"rwkv": [37810, 43, 0.0015793975908309221, [[32227, 0.501362, " that", false], [22187, 0.062458, " not", false], [22590, 0.047505, " the", false], [30135, 0.030121, " also", false], [32234, 0.028763, " this", false], [332, 0.024128, " a", false], [4811, 0.019839, " to", false], [59, 0.018992, ":", false], [45, 0.015691, ",", false], [37598, 0.014904, " about", false]]], "qwen": [3118, 87, 0.0007878189207985997, [[429, 0.420396, " that", false], [537, 0.060272, " not", false], [264, 0.042158, " a", false], [1083, 0.040813, " also", false], [279, 0.035126, " the", false], [25180, 0.026915, " bitter", false], [419, 0.024569, " this", false], [825, 0.021177, " one", false], [11, 0.015526, ",", false], [25, 0.013466, ":", false]]]}, "raw_delta": -0.11291535695393873, "tuned_delta": -0.10434356492336049}, {"byte_start": 5143, "byte_end": 5146, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 868, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"rwkv": "0.58% 0.58% 0.58%", "qwen": "0.63% 0.63% 0.63%"}, "model_tokens": {"rwkv": [[4712, " on", "normal", 0.9080391526222229]], "qwen": [[389, " on", "normal", 0.9003555178642273]]}, "loss": {"rwkv": 0.584098944370328, "qwen": 0.6309720544814594}, "topk": {"rwkv": [4712, 1, 0.9080391526222229, [[4712, 0.908039, " on", false], [4596, 0.039021, " in", false], [22187, 0.012283, " not", false], [32350, 0.010816, " upon", false], [45, 0.007775, ",", false], [46768, 0.001574, " partly", false], [31458, 0.001391, " more", false], [45202, 0.001182, " around", false], [60247, 0.001127, " primarily", false], [30322, 0.001012, " both", false]]], "qwen": [389, 1, 0.9003555178642273, [[389, 0.900356, " on", false], [304, 0.02386, " in", false], [537, 0.01802, " not", false], [11, 0.010356, ",", false], [5193, 0.009928, " upon", false], [1172, 0.00229, " only", false], [11368, 0.002201, " entirely", false], [803, 0.002024, " more", false], [13771, 0.001939, " largely", false], [2163, 0.001594, " around", false]]]}, "raw_delta": -0.002599197129408523, "tuned_delta": 0.005972594901169725}, {"byte_start": 5146, "byte_end": 5150, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 869, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "4.31% 4.31% 4.31% 4.31%", "qwen": "5.10% 5.10% 5.10% 5.10%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.3865814208984375]], "qwen": [[279, " the", "normal", 0.32240262627601624]]}, "loss": {"rwkv": 4.314700744846142, "qwen": 5.103327190377551}, "topk": {"rwkv": [22590, 1, 0.3865814208984375, [[22590, 0.386581, " the", false], [332, 0.141616, " a", false], [37045, 0.07456, " Moore", false], [22638, 0.044492, " two", false], [4419, 0.029966, " an", false], [32464, 0.023575, " what", false], [32234, 0.016644, " this", false], [21835, 0.016211, " how", false], [39946, 0.013038, " three", false], [65034, 0.010476, " understanding", false]]], "qwen": [279, 1, 0.32240262627601624, [[279, 0.322403, " the", false], [264, 0.118365, " a", false], [1378, 0.048474, " two", false], [20219, 0.045589, " Moore", false], [458, 0.021637, " an", false], [1128, 0.020198, " what", false], [3139, 0.017951, " experience", false], [2326, 0.017125, " three", false], [1039, 0.012978, " our", false], [3738, 0.00938, " human", false]]]}, "raw_delta": -0.043730735778808594, "tuned_delta": -0.035158943748230344}, {"byte_start": 5150, "byte_end": 5161, "display": {"text": " historical", "kind": "normal"}, "is_word": true, "word_id": 870, "word_key": " historical", "bytes_hex": "20 68 69 73 74 6f 72 69 63 61 6c", "compression": {"rwkv": "10.96% 10.96% 10.96% 10.96% 10.96% 10.96% 10.96% 10.96% 10.96% 10.96% 10.96%", "qwen": "9.95% 9.95% 9.95% 9.95% 9.95% 9.95% 9.95% 9.95% 9.95% 9.95% 9.95%"}, "model_tokens": {"rwkv": [[62061, " historical", "normal", 0.001241572666913271]], "qwen": [[13656, " historical", "normal", 0.002314023906365037]]}, "loss": {"rwkv": 10.963662597664705, "qwen": 9.949296415046708}, "topk": {"rwkv": [62061, 110, 0.001241572666913271, [[30808, 0.136299, " fact", false], [63729, 0.073991, " observation", false], [59725, 0.059779, " following", false], [51832, 0.027097, " general", false], [31135, 0.023824, " idea", false], [46681, 0.015575, " notion", false], [47284, 0.013786, " simple", false], [60250, 0.01375, " principle", false], [52022, 0.011658, " insight", false], [63820, 0.011656, " realization", false]]], "qwen": [13656, 51, 0.002314023906365037, [[2097, 0.133914, " fact", false], [21930, 0.114291, " observation", false], [2701, 0.046345, " following", false], [4285, 0.033885, " simple", false], [4522, 0.023517, " idea", false], [24335, 0.022318, " assumption", false], [17508, 0.021572, " principle", false], [15811, 0.016477, " fundamental", false], [48703, 0.015829, " realization", false], [17843, 0.012666, " recognition", false]]]}, "raw_delta": 0.05624840476296156, "tuned_delta": 0.0648201967935398}, {"byte_start": 5161, "byte_end": 5174, "display": {"text": " observations", "kind": "normal"}, "is_word": true, "word_id": 871, "word_key": " observations", "bytes_hex": "20 6f 62 73 65 72 76 61 74 69 6f 6e 73", "compression": {"rwkv": "6.76% 6.76% 6.76% 6.76% 6.76% 6.76% 6.76% 6.76% 6.76% 6.76% 6.76% 6.76% 6.76%", "qwen": "8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09%"}, "model_tokens": {"rwkv": [[64495, " observations", "normal", 0.007574328221380711]], "qwen": [[23722, " observations", "normal", 0.002941312501206994]]}, "loss": {"rwkv": 6.762633004167015, "qwen": 8.085888687000958}, "topk": {"rwkv": [64495, 16, 0.007574328221380711, [[52427, 0.168155, " pattern", false], [30808, 0.118657, " fact", false], [47024, 0.104024, " record", false], [56157, 0.058514, " evidence", false], [56162, 0.051737, " examples", false], [61979, 0.050051, " experience", false], [51668, 0.034355, " example", false], [38440, 0.024553, " facts", false], [63729, 0.022453, " observation", false], [30579, 0.018244, " data", false]]], "qwen": [23722, 34, 0.002941312501206994, [[2097, 0.276674, " fact", false], [3255, 0.119615, " record", false], [3139, 0.067845, " experience", false], [5904, 0.037318, " evidence", false], [5383, 0.035484, " pattern", false], [8729, 0.034271, " reality", false], [21930, 0.024844, " observation", false], [2393, 0.017481, " success", false], [4401, 0.016759, " development", false], [323, 0.014835, " and", false]]]}, "raw_delta": -0.07337687565730167, "tuned_delta": -0.06480508362672342}, {"byte_start": 5174, "byte_end": 5179, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 872, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "3.56% 3.56% 3.56% 3.56% 3.56%", "qwen": "3.07% 3.07% 3.07% 3.07% 3.07%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.3737061023712158]], "qwen": [[429, " that", "normal", 0.42726224660873413]]}, "loss": {"rwkv": 3.5644711459463645, "qwen": 3.067015627891962}, "topk": {"rwkv": [32227, 1, 0.3737061023712158, [[32227, 0.373706, " that", false], [4706, 0.160495, " of", false], [45, 0.045392, ",", false], [37599, 0.043534, " above", false], [47, 0.033779, ".", false], [59488, 0.032704, " described", false], [4596, 0.030989, " in", false], [37598, 0.023491, " about", false], [31198, 0.022236, " just", false], [21265, 0.021996, " and", false]]], "qwen": [429, 1, 0.42726224660873413, [[429, 0.427262, " that", false], [315, 0.291769, " of", false], [323, 0.027302, " and", false], [1865, 0.027231, " made", false], [11, 0.024236, ",", false], [3403, 0.020542, " above", false], [304, 0.019367, " in", false], [911, 0.018508, " about", false], [7481, 0.010782, " described", false], [68629, 0.008892, " summarized", false]]]}, "raw_delta": 0.02758479118347168, "tuned_delta": 0.03615658321404993}, {"byte_start": 5179, "byte_end": 5181, "display": {"text": " 1", "kind": "normal"}, "is_word": true, "word_id": 873, "word_key": " 1", "bytes_hex": "20 31", "compression": {"rwkv": "46.77% 46.77%", "qwen": "89.94% 5.89%"}, "model_tokens": {"rwkv": [[284, " 1", "normal", 0.005633039399981499]], "qwen": [[220, " ", "normal", 0.006822048686444759], [16, "1", "normal", 0.7212427258491516]]}, "loss": {"rwkv": 46.77487827882186, "qwen": 47.918891555156414}, "topk": {"rwkv": [284, 32, 0.005633039399981499, [[22590, 0.096831, " the", false], [4858, 0.070248, " we", false], [45, 0.060374, ",", false], [59, 0.051346, ":", false], [47202, 0.042919, " search", false], [38720, 0.027865, " human", false], [52224, 0.02731, " methods", false], [63370, 0.02686, " computation", false], [4596, 0.024258, " in", false], [52195, 0.02262, " massive", false]]], "qwen": [220, 31, 0.006822048686444759, [[279, 0.114873, " the", false], [11, 0.074743, ",", false], [582, 0.039058, " we", false], [3738, 0.037648, " human", false], [1052, 0.032026, " there", false], [11811, 0.025722, " researchers", false], [304, 0.022724, " in", false], [614, 0.018306, " have", false], [1429, 0.018006, " most", false], [1447, 0.01739, ":\n\n", false]]]}, "raw_delta": -0.0634375661611557, "tuned_delta": -0.05486577413057745}, {"byte_start": 5181, "byte_end": 5182, "display": {"text": ")", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29", "compression": {"rwkv": "1.57%", "qwen": "2.71%"}, "model_tokens": {"rwkv": [[42, ")", "normal", 0.916594922542572]], "qwen": [[8, ")", "normal", 0.8606036901473999]]}, "loss": {"rwkv": 1.5673810869032927, "qwen": 2.7072382949905966}, "topk": {"rwkv": [42, 1, 0.916594922542572, [[42, 0.916595, ")", false], [47, 0.053489, ".", false], [580, 0.00931, ".)", false], [48, 0.007099, "/", false], [45, 0.003575, ",", false], [46, 0.001759, "-", false], [59, 0.001194, ":", false], [499, 0.000951, ").", false], [276, 0.000381, " )", false], [98, 0.000339, "a", false]]], "qwen": [8, 1, 0.8606036901473999, [[8, 0.860604, ")", false], [13, 0.071884, ".", false], [24, 0.027879, "9", false], [15, 0.009732, "0", false], [6138, 0.005238, ".)", false], [11, 0.001529, ",", false], [25, 0.001528, ":", false], [279, 0.001499, " the", false], [14, 0.001431, "/", false], [12, 0.001183, "-", false]]]}, "raw_delta": -0.06320710480213165, "tuned_delta": -0.0546353127715534}, {"byte_start": 5182, "byte_end": 5185, "display": {"text": " AI", "kind": "normal"}, "is_word": true, "word_id": 874, "word_key": " ai", "bytes_hex": "20 41 49", "compression": {"rwkv": "28.93% 28.93% 28.93%", "qwen": "35.42% 35.42% 35.42%"}, "model_tokens": {"rwkv": [[3609, " AI", "normal", 0.008249612525105476]], "qwen": [[15235, " AI", "normal", 0.002759526250883937]]}, "loss": {"rwkv": 28.929041184492235, "qwen": 35.42234935740809}, "topk": {"rwkv": [3609, 22, 0.008249612525105476, [[22590, 0.111227, " the", false], [52195, 0.106297, " massive", false], [47202, 0.079443, " search", false], [63370, 0.044649, " computation", false], [52224, 0.037926, " methods", false], [38720, 0.037749, " human", false], [4596, 0.023473, " in", false], [39934, 0.02338, " there", false], [4858, 0.022097, " we", false], [37045, 0.021416, " Moore", false]]], "qwen": [15235, 51, 0.002759526250883937, [[279, 0.12742, " the", false], [3738, 0.091542, " human", false], [1052, 0.030641, " there", false], [1429, 0.029236, " most", false], [304, 0.026788, " in", false], [582, 0.026313, " we", false], [4586, 0.024561, " general", false], [5413, 0.022817, " methods", false], [432, 0.017832, " it", false], [979, 0.016287, " when", false]]]}, "raw_delta": -0.3600654602050781, "tuned_delta": -0.3514936681744999}, {"byte_start": 5185, "byte_end": 5197, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 875, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"rwkv": "2.36% 2.36% 2.36% 2.36% 2.36% 2.36% 2.36% 2.36% 2.36% 2.36% 2.36% 2.36%", "qwen": "1.30% 1.30% 1.30% 1.30% 1.30% 1.30% 1.30% 1.30% 1.30% 1.30% 1.30% 1.30%"}, "model_tokens": {"rwkv": [[63843, " researchers", "normal", 0.20665737986564636]], "qwen": [[11811, " researchers", "normal", 0.4211137890815735]]}, "loss": {"rwkv": 2.3598771420791147, "qwen": 1.2997062142088494}, "topk": {"rwkv": [63843, 2, 0.20665737986564636, [[57103, 0.355594, " research", false], [63843, 0.206657, " researchers", false], [52224, 0.08492, " methods", false], [53087, 0.043916, " systems", false], [4600, 0.032844, " is", false], [21800, 0.028624, " has", false], [56950, 0.017856, " progress", false], [56949, 0.012839, " programs", false], [62633, 0.010243, " techniques", false], [22748, 0.008962, " was", false]]], "qwen": [11811, 1, 0.4211137890815735, [[11811, 0.421114, " researchers", false], [3412, 0.241596, " research", false], [702, 0.051568, " has", false], [374, 0.045421, " is", false], [5413, 0.030513, " methods", false], [572, 0.024486, " was", false], [5942, 0.016856, " systems", false], [594, 0.005651, "'s", false], [646, 0.004245, " can", false], [304, 0.004208, " in", false]]]}, "raw_delta": 0.05878835916519165, "tuned_delta": 0.0673601511957699}, {"byte_start": 5197, "byte_end": 5202, "display": {"text": " have", "kind": "normal"}, "is_word": true, "word_id": 876, "word_key": " have", "bytes_hex": "20 68 61 76 65", "compression": {"rwkv": "6.09% 6.09% 6.09% 6.09% 6.09%", "qwen": "6.84% 6.84% 6.84% 6.84% 6.84%"}, "model_tokens": {"rwkv": [[31059, " have", "normal", 0.18479271233081818]], "qwen": [[614, " have", "normal", 0.15027377009391785]]}, "loss": {"rwkv": 6.086369703750314, "qwen": 6.835836989550142}, "topk": {"rwkv": [31059, 1, 0.18479271233081818, [[31059, 0.184793, " have", false], [40, 0.125531, "'", false], [21286, 0.08591, " are", false], [32216, 0.043883, " tend", false], [22762, 0.039098, " who", false], [45, 0.029817, ",", false], [4491, 0.018315, " do", false], [39171, 0.017601, " often", false], [32462, 0.016839, " were", false], [45150, 0.01482, " always", false]]], "qwen": [614, 1, 0.15027377009391785, [[614, 0.150274, " have", false], [525, 0.076383, " are", false], [6, 0.065294, "'", false], [8376, 0.048428, " tend", false], [879, 0.039182, " who", false], [1033, 0.037454, " were", false], [2677, 0.02672, " always", false], [653, 0.024378, " do", false], [11, 0.023063, ",", false], [3545, 0.021426, " often", false]]]}, "raw_delta": -0.04155929088592525, "tuned_delta": -0.032987498855347}, {"byte_start": 5202, "byte_end": 5208, "display": {"text": " often", "kind": "normal"}, "is_word": true, "word_id": 877, "word_key": " often", "bytes_hex": "20 6f 66 74 65 6e", "compression": {"rwkv": "11.55% 11.55% 11.55% 11.55% 11.55% 11.55%", "qwen": "10.20% 10.20% 10.20% 10.20% 10.20% 10.20%"}, "model_tokens": {"rwkv": [[39171, " often", "normal", 0.02140750177204609]], "qwen": [[3545, " often", "normal", 0.033567722886800766]]}, "loss": {"rwkv": 11.55283138211865, "qwen": 10.201628187783637}, "topk": {"rwkv": [39171, 7, 0.02140750177204609, [[30259, 0.153282, " been", false], [22187, 0.071969, " not", false], [45150, 0.064603, " always", false], [332, 0.051983, " a", false], [47518, 0.030179, " tended", false], [21795, 0.028723, " had", false], [39171, 0.021408, " often", false], [31351, 0.020213, " made", false], [39762, 0.019188, " spent", false], [56495, 0.018302, " invested", false]]], "qwen": [3545, 6, 0.033567722886800766, [[1012, 0.116053, " been", false], [2677, 0.102586, " always", false], [537, 0.060681, " not", false], [48790, 0.050558, " tended", false], [264, 0.035441, " a", false], [3545, 0.033568, " often", false], [1865, 0.03193, " made", false], [8789, 0.03124, " generally", false], [6679, 0.025189, " tried", false], [7391, 0.021125, " spent", false]]]}, "raw_delta": 0.07492661476135254, "tuned_delta": 0.08349840679193078}, {"byte_start": 5208, "byte_end": 5214, "display": {"text": " tried", "kind": "normal"}, "is_word": true, "word_id": 878, "word_key": " tried", "bytes_hex": "20 74 72 69 65 64", "compression": {"rwkv": "9.02% 9.02% 9.02% 9.02% 9.02% 9.02%", "qwen": "7.22% 7.22% 7.22% 7.22% 7.22% 7.22%"}, "model_tokens": {"rwkv": [[40013, " tried", "normal", 0.049675680696964264]], "qwen": [[6679, " tried", "normal", 0.09043993800878525]]}, "loss": {"rwkv": 9.01684400555602, "qwen": 7.2227009271126}, "topk": {"rwkv": [40013, 3, 0.049675680696964264, [[30259, 0.175788, " been", false], [31351, 0.056235, " made", false], [40013, 0.049676, " tried", false], [21795, 0.033501, " had", false], [53137, 0.027602, " thought", false], [45953, 0.026995, " failed", false], [22187, 0.026353, " not", false], [56495, 0.02413, " invested", false], [37924, 0.023808, " built", false], [56651, 0.02061, " mistaken", false]]], "qwen": [6679, 2, 0.09043993800878525, [[1012, 0.204918, " been", false], [6679, 0.09044, " tried", false], [1865, 0.062135, " made", false], [7391, 0.025583, " spent", false], [11585, 0.020182, " believed", false], [1030, 0.019235, " had", false], [3381, 0.019098, " thought", false], [4641, 0.018346, " failed", false], [45431, 0.016739, " pursued", false], [10735, 0.016659, " focused", false]]]}, "raw_delta": 0.09948841730753583, "tuned_delta": 0.10806020933811407}, {"byte_start": 5214, "byte_end": 5217, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 879, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "1.89% 1.89% 1.89%", "qwen": "0.87% 0.87% 0.87%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.7269521951675415]], "qwen": [[311, " to", "normal", 0.8649898171424866]]}, "loss": {"rwkv": 1.890249850123072, "qwen": 0.8718540455931668}, "topk": {"rwkv": [4811, 1, 0.7269521951675415, [[4811, 0.726952, " to", false], [52224, 0.101673, " methods", false], [22590, 0.010989, " the", false], [39931, 0.010568, " their", false], [45, 0.010553, ",", false], [61590, 0.008753, " approaches", false], [38720, 0.00633, " human", false], [32448, 0.005422, " ways", false], [55666, 0.005143, " building", false], [22249, 0.005037, " out", false]]], "qwen": [311, 1, 0.8649898171424866, [[311, 0.86499, " to", false], [5413, 0.01351, " methods", false], [11, 0.010121, ",", false], [3738, 0.007356, " human", false], [323, 0.006901, " and", false], [304, 0.004482, " in", false], [2588, 0.004469, " hard", false], [279, 0.004439, " the", false], [2238, 0.004154, " too", false], [1602, 0.004112, " very", false]]]}, "raw_delta": 0.056471854448318475, "tuned_delta": 0.06504364647889672}, {"byte_start": 5217, "byte_end": 5223, "display": {"text": " build", "kind": "normal"}, "is_word": true, "word_id": 880, "word_key": " build", "bytes_hex": "20 62 75 69 6c 64", "compression": {"rwkv": "5.89% 5.89% 5.89% 5.89% 5.89% 5.89%", "qwen": "4.01% 4.01% 4.01% 4.01% 4.01% 4.01%"}, "model_tokens": {"rwkv": [[37923, " build", "normal", 0.1399841010570526]], "qwen": [[1936, " build", "normal", 0.2630777955055237]]}, "loss": {"rwkv": 5.8938225140483365, "qwen": 4.013413654526509}, "topk": {"rwkv": [37923, 1, 0.1399841010570526, [[37923, 0.139984, " build", false], [31358, 0.06772, " make", false], [22339, 0.065152, " put", false], [22681, 0.050738, " use", false], [56540, 0.044043, " leverage", false], [32187, 0.04041, " take", false], [51982, 0.034896, " improve", false], [37730, 0.029011, " apply", false], [4491, 0.023135, " do", false], [39740, 0.022475, " solve", false]]], "qwen": [1936, 1, 0.2630777955055237, [[1936, 0.263078, " build", false], [1281, 0.147193, " make", false], [32064, 0.035578, " leverage", false], [2182, 0.035405, " put", false], [990, 0.032568, " use", false], [65485, 0.025452, " emulate", false], [11625, 0.02464, " solve", false], [653, 0.023266, " do", false], [55359, 0.016776, " mimic", false], [3796, 0.016032, " apply", false]]]}, "raw_delta": 0.10427200794219972, "tuned_delta": 0.11284379997277796}, {"byte_start": 5223, "byte_end": 5233, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 881, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "9.30% 9.30% 9.30% 9.30% 9.30% 9.30% 9.30% 9.30% 9.30% 9.30%", "qwen": "11.44% 11.44% 11.44% 11.44% 11.44% 11.44% 11.44% 11.44% 11.44% 11.44%"}, "model_tokens": {"rwkv": [[59943, " knowledge", "normal", 0.005743762012571096]], "qwen": [[6540, " knowledge", "normal", 0.001757561694830656]]}, "loss": {"rwkv": 9.298620380729647, "qwen": 11.440260997909652}, "topk": {"rwkv": [59943, 17, 0.005743762012571096, [[4596, 0.161759, " in", false], [3609, 0.158346, " AI", false], [53087, 0.150292, " systems", false], [52224, 0.127166, " methods", false], [39931, 0.11992, " their", false], [332, 0.023776, " a", false], [63659, 0.017988, " intelligent", false], [64452, 0.01705, " intelligence", false], [22590, 0.015152, " the", false], [51832, 0.011605, " general", false]]], "qwen": [6540, 38, 0.001757561694830656, [[5942, 0.383208, " systems", false], [304, 0.147803, " in", false], [5413, 0.048333, " methods", false], [15235, 0.036416, " AI", false], [264, 0.036301, " a", false], [12645, 0.028511, " machines", false], [4119, 0.023244, " models", false], [862, 0.022203, " their", false], [24514, 0.020137, " intelligent", false], [279, 0.015744, " the", false]]]}, "raw_delta": -0.11875777244567876, "tuned_delta": -0.11018598041510051}, {"byte_start": 5233, "byte_end": 5238, "display": {"text": " into", "kind": "normal"}, "is_word": true, "word_id": 882, "word_key": " into", "bytes_hex": "20 69 6e 74 6f", "compression": {"rwkv": "3.97% 3.97% 3.97% 3.97% 3.97%", "qwen": "2.58% 2.58% 2.58% 2.58% 2.58%"}, "model_tokens": {"rwkv": [[31162, " into", "normal", 0.3309861421585083]], "qwen": [[1119, " into", "normal", 0.4887540638446808]]}, "loss": {"rwkv": 3.9730468899481215, "qwen": 2.5820486300299623}, "topk": {"rwkv": [31162, 2, 0.3309861421585083, [[46, 0.366979, "-", false], [31162, 0.330986, " into", false], [4706, 0.061737, " of", false], [21265, 0.034483, " and", false], [53087, 0.027927, " systems", false], [4596, 0.027338, " in", false], [37598, 0.023705, " about", false], [56003, 0.015832, " directly", false], [4715, 0.012908, " or", false], [45, 0.011031, ",", false]]], "qwen": [1119, 1, 0.4887540638446808, [[1119, 0.488754, " into", false], [5980, 0.177835, "-based", false], [5961, 0.056711, " directly", false], [304, 0.044363, " in", false], [23092, 0.020867, " bases", false], [12, 0.017732, "-", false], [11, 0.013609, ",", false], [13042, 0.011556, " representation", false], [43613, 0.011007, " representations", false], [323, 0.010619, " and", false]]]}, "raw_delta": 0.07713332176208496, "tuned_delta": 0.0857051137926632}, {"byte_start": 5238, "byte_end": 5244, "display": {"text": " their", "kind": "normal"}, "is_word": true, "word_id": 883, "word_key": " their", "bytes_hex": "20 74 68 65 69 72", "compression": {"rwkv": "1.57% 1.57% 1.57% 1.57% 1.57% 1.57%", "qwen": "2.35% 2.35% 2.35% 2.35% 2.35% 2.35%"}, "model_tokens": {"rwkv": [[39931, " their", "normal", 0.5923572778701782]], "qwen": [[862, " their", "normal", 0.45808759331703186]]}, "loss": {"rwkv": 1.573251428052743, "qwen": 2.3464680489182497}, "topk": {"rwkv": [39931, 1, 0.5923572778701782, [[39931, 0.592357, " their", false], [3609, 0.124498, " AI", false], [52224, 0.06675, " methods", false], [53087, 0.061587, " systems", false], [22590, 0.058529, " the", false], [56949, 0.011045, " programs", false], [332, 0.008555, " a", false], [61559, 0.005536, " algorithms", false], [56567, 0.004553, " machines", false], [4419, 0.003581, " an", false]]], "qwen": [862, 1, 0.45808759331703186, [[862, 0.458088, " their", false], [5942, 0.145753, " systems", false], [15235, 0.106452, " AI", false], [279, 0.098164, " the", false], [5413, 0.032825, " methods", false], [264, 0.022574, " a", false], [12645, 0.013158, " machines", false], [25185, 0.011579, " algorithms", false], [458, 0.009804, " an", false], [13009, 0.009332, " agents", false]]]}, "raw_delta": -0.04287623365720112, "tuned_delta": -0.03430444162662287}, {"byte_start": 5244, "byte_end": 5251, "display": {"text": " agents", "kind": "normal"}, "is_word": true, "word_id": 884, "word_key": " agents", "bytes_hex": "20 61 67 65 6e 74 73", "compression": {"rwkv": "13.28% 13.28% 13.28% 13.28% 13.28% 13.28% 13.28%", "qwen": "9.16% 9.16% 9.16% 9.16% 9.16% 9.16% 9.16%"}, "model_tokens": {"rwkv": [[45124, " agents", "normal", 0.00581713393330574]], "qwen": [[13009, " agents", "normal", 0.02860068529844284]]}, "loss": {"rwkv": 13.283743401042354, "qwen": 9.156797344590643}, "topk": {"rwkv": [45124, 11, 0.00581713393330574, [[53087, 0.363531, " systems", false], [52224, 0.312871, " methods", false], [3609, 0.080099, " AI", false], [56949, 0.060257, " programs", false], [61590, 0.020752, " approaches", false], [57103, 0.019518, " research", false], [61559, 0.019268, " algorithms", false], [46587, 0.017875, " models", false], [32499, 0.012338, " work", false], [56567, 0.006306, " machines", false]]], "qwen": [13009, 5, 0.02860068529844284, [[5942, 0.584944, " systems", false], [5413, 0.162817, " methods", false], [15235, 0.040642, " AI", false], [25185, 0.035244, " algorithms", false], [13009, 0.028601, " agents", false], [7468, 0.026119, " programs", false], [4119, 0.013486, " models", false], [12645, 0.012212, " machines", false], [19827, 0.011931, " approaches", false], [1849, 0.00816, " system", false]]]}, "raw_delta": 0.228846481868199, "tuned_delta": 0.23741827389877726}, {"byte_start": 5251, "byte_end": 5252, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "15.15%", "qwen": "16.14%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.434590220451355]], "qwen": [[11, ",", "normal", 0.4085323214530945]]}, "loss": {"rwkv": 15.145480165582377, "qwen": 16.1434739907079}, "topk": {"rwkv": [45, 1, 0.434590220451355, [[45, 0.43459, ",", false], [21265, 0.131458, " and", false], [4596, 0.063392, " in", false], [4811, 0.052394, " to", false], [275, 0.039203, " (", false], [60, 0.034373, ";", false], [45285, 0.022127, " before", false], [32227, 0.019831, " that", false], [21400, 0.018695, " but", false], [5346, 0.015708, "---", false]]], "qwen": [11, 1, 0.4085323214530945, [[11, 0.408532, ",", false], [323, 0.095241, " and", false], [304, 0.061851, " in", false], [26, 0.057017, ";", false], [320, 0.038999, " (", false], [438, 0.028618, " as", false], [429, 0.028383, " that", false], [2041, 0.024179, " without", false], [553, 0.023365, " by", false], [4421, 0.022919, "---", false]]]}, "raw_delta": -0.05534052848815918, "tuned_delta": -0.04676873645758093}, {"byte_start": 5252, "byte_end": 5254, "display": {"text": " 2", "kind": "normal"}, "is_word": true, "word_id": 885, "word_key": " 2", "bytes_hex": "20 32", "compression": {"rwkv": "20.01% 20.01%", "qwen": "37.18% 0.11%"}, "model_tokens": {"rwkv": [[285, " 2", "normal", 0.10914670675992966]], "qwen": [[220, " ", "normal", 0.1272447109222412], [17, "2", "normal", 0.994102418422699]]}, "loss": {"rwkv": 20.00612263732742, "qwen": 18.642849443588588}, "topk": {"rwkv": [285, 2, 0.10914670675992966, [[21265, 0.421511, " and", false], [285, 0.109147, " 2", false], [21400, 0.065315, " but", false], [4596, 0.03874, " in", false], [4423, 0.02439, " as", false], [30788, 0.021679, " even", false], [4715, 0.021674, " or", false], [4811, 0.01869, " to", false], [32487, 0.017204, " with", false], [40186, 0.015772, " which", false]]], "qwen": [220, 2, 0.1272447109222412, [[323, 0.393957, " and", false], [220, 0.127245, " ", false], [714, 0.073304, " but", false], [4751, 0.029262, " rather", false], [304, 0.024752, " in", false], [438, 0.022122, " as", false], [448, 0.020125, " with", false], [2987, 0.01689, " either", false], [1496, 0.014024, " even", false], [892, 0.012988, " which", false]]]}, "raw_delta": 0.07559591764584184, "tuned_delta": 0.08416770967642008}, {"byte_start": 5254, "byte_end": 5255, "display": {"text": ")", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29", "compression": {"rwkv": "0.02%", "qwen": "0.02%"}, "model_tokens": {"rwkv": [[42, ")", "normal", 0.998727023601532]], "qwen": [[8, ")", "normal", 0.9990455508232117]]}, "loss": {"rwkv": 0.022839296034580986, "qwen": 0.017220137660109158}, "topk": {"rwkv": [42, 1, 0.998727023601532, [[42, 0.998727, ")", false], [497, 0.000637, "),", false], [276, 9.6e-05, " )", false], [48, 8.6e-05, "/", false], [98, 7.4e-05, "a", false], [499, 4.8e-05, ").", false], [47, 4.8e-05, ".", false], [580, 3.9e-05, ".)", false], [45, 2.7e-05, ",", false], [46, 1.9e-05, "-", false]]], "qwen": [8, 1, 0.9990455508232117, [[8, 0.999046, ")", false], [701, 0.00022, "),", false], [64, 0.000148, "a", false], [873, 0.000108, " )", false], [13, 4.8e-05, ".", false], [6138, 3.7e-05, ".)", false], [11, 3.5e-05, ",", false], [15, 3.4e-05, "0", false], [323, 2.6e-05, " and", false], [429, 1.9e-05, " that", false]]]}, "raw_delta": 0.0003115923027507961, "tuned_delta": 0.008883384333329044}, {"byte_start": 5255, "byte_end": 5260, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 886, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "7.89% 7.89% 7.89% 7.89% 7.89%", "qwen": "9.24% 9.24% 9.24% 9.24% 9.24%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.11136122792959213]], "qwen": [[419, " this", "normal", 0.07725539803504944]]}, "loss": {"rwkv": 7.889738504861517, "qwen": 9.235550903005239}, "topk": {"rwkv": [32234, 2, 0.11136122792959213, [[32227, 0.199419, " that", false], [32234, 0.111361, " this", false], [22590, 0.085605, " the", false], [39936, 0.050789, " these", false], [32232, 0.045699, " they", false], [32465, 0.041929, " when", false], [4596, 0.026535, " in", false], [32139, 0.025946, " such", false], [59943, 0.02394, " knowledge", false], [39944, 0.022067, " those", false]]], "qwen": [419, 3, 0.07725539803504944, [[279, 0.106956, " the", false], [807, 0.088234, " they", false], [419, 0.077255, " this", false], [429, 0.070534, " that", false], [6540, 0.044582, " knowledge", false], [1493, 0.042293, " these", false], [1846, 0.035526, " those", false], [304, 0.034022, " in", false], [862, 0.026684, " their", false], [15235, 0.026366, " AI", false]]]}, "raw_delta": -0.07462768554687504, "tuned_delta": -0.0660558935162968}, {"byte_start": 5260, "byte_end": 5267, "display": {"text": " always", "kind": "normal"}, "is_word": true, "word_id": 887, "word_key": " always", "bytes_hex": "20 61 6c 77 61 79 73", "compression": {"rwkv": "11.59% 11.59% 11.59% 11.59% 11.59% 11.59% 11.59%", "qwen": "16.09% 16.09% 16.09% 16.09% 16.09% 16.09% 16.09%"}, "model_tokens": {"rwkv": [[45150, " always", "normal", 0.011080559343099594]], "qwen": [[2677, " always", "normal", 0.0019399260636419058]]}, "loss": {"rwkv": 11.593085150000599, "qwen": 16.088897139127845}, "topk": {"rwkv": [45150, 11, 0.011080559343099594, [[59943, 0.251005, " knowledge", false], [21800, 0.201708, " has", false], [4600, 0.065389, " is", false], [39171, 0.044568, " often", false], [55532, 0.03673, " approach", false], [45829, 0.034193, " effort", false], [22748, 0.025524, " was", false], [30659, 0.021778, " does", false], [38964, 0.017035, " makes", false], [38720, 0.012337, " human", false]]], "qwen": [2677, 40, 0.0019399260636419058, [[702, 0.303916, " has", false], [6540, 0.21361, " knowledge", false], [374, 0.076746, " is", false], [5486, 0.04863, " approach", false], [3545, 0.043218, " often", false], [572, 0.026249, " was", false], [5041, 0.01478, " effort", false], [3093, 0.013744, " kind", false], [1558, 0.012532, " does", false], [27236, 0.009465, " tends", false]]]}, "raw_delta": -0.2493007523672921, "tuned_delta": -0.24072896033671384}, {"byte_start": 5267, "byte_end": 5273, "display": {"text": " helps", "kind": "normal"}, "is_word": true, "word_id": 888, "word_key": " helps", "bytes_hex": "20 68 65 6c 70 73", "compression": {"rwkv": "21.32% 21.32% 21.32% 21.32% 21.32% 21.32%", "qwen": "17.04% 17.04% 17.04% 17.04% 17.04% 17.04%"}, "model_tokens": {"rwkv": [[38686, " helps", "normal", 0.0008338545449078083]], "qwen": [[8609, " helps", "normal", 0.0034472723491489887]]}, "loss": {"rwkv": 21.32107905480434, "qwen": 17.04235134776367}, "topk": {"rwkv": [38686, 105, 0.0008338545449078083, [[38964, 0.06304, " makes", false], [21800, 0.059982, " has", false], [40040, 0.056542, " turns", false], [38875, 0.053095, " leads", false], [38442, 0.047763, " fails", false], [39620, 0.042737, " seems", false], [46936, 0.042604, " proved", false], [31351, 0.03373, " made", false], [47638, 0.033328, " turned", false], [45953, 0.029506, " failed", false]]], "qwen": [8609, 48, 0.0034472723491489887, [[11508, 0.082167, " leads", false], [702, 0.055408, " has", false], [4977, 0.051891, " seems", false], [14525, 0.044846, " fails", false], [4041, 0.041755, " comes", false], [6069, 0.035197, " led", false], [18651, 0.033772, " proved", false], [3643, 0.030163, " makes", false], [4641, 0.028432, " failed", false], [10335, 0.025981, " ends", false]]]}, "raw_delta": 0.237263043721517, "tuned_delta": 0.24583483575209525}, {"byte_start": 5273, "byte_end": 5276, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 889, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "8.03% 8.03% 8.03%", "qwen": "6.63% 6.63% 6.63%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.2614516019821167]], "qwen": [[304, " in", "normal", 0.3321073055267334]]}, "loss": {"rwkv": 8.030626692448331, "qwen": 6.626161187735484}, "topk": {"rwkv": [4596, 1, 0.2614516019821167, [[4596, 0.261452, " in", false], [31581, 0.076774, " only", false], [45, 0.072435, ",", false], [32229, 0.070311, " them", false], [332, 0.051969, " a", false], [4424, 0.043171, " at", false], [21700, 0.040395, " for", false], [4811, 0.039668, " to", false], [22590, 0.035948, " the", false], [32465, 0.021311, " when", false]]], "qwen": [304, 1, 0.3321073055267334, [[304, 0.332107, " in", false], [279, 0.083113, " the", false], [1105, 0.073144, " them", false], [264, 0.042835, " a", false], [11, 0.033876, ",", false], [311, 0.032151, " to", false], [979, 0.02858, " when", false], [369, 0.026255, " for", false], [15102, 0.02395, " initially", false], [4124, 0.019933, " early", false]]]}, "raw_delta": 0.07788010438283283, "tuned_delta": 0.08645189641341107}, {"byte_start": 5276, "byte_end": 5280, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 890, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "1.21% 1.21% 1.21% 1.21%", "qwen": "0.72% 0.72% 0.72% 0.72%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.7659869194030762]], "qwen": [[279, " the", "normal", 0.8523589968681335]]}, "loss": {"rwkv": 1.2063551062120847, "qwen": 0.7202089926085409}, "topk": {"rwkv": [22590, 1, 0.7659869194030762, [[22590, 0.765987, " the", false], [32074, 0.070148, " some", false], [39675, 0.019721, " short", false], [332, 0.012314, " a", false], [38576, 0.005521, " games", false], [46639, 0.00543, " narrow", false], [39720, 0.003654, " small", false], [51515, 0.003286, " domains", false], [38328, 0.003227, " early", false], [47535, 0.002907, " theory", false]]], "qwen": [279, 1, 0.8523589968681335, [[279, 0.852359, " the", false], [2805, 0.01926, " short", false], [1045, 0.019121, " some", false], [264, 0.010473, " a", false], [6588, 0.00565, " practice", false], [4862, 0.004612, " training", false], [2613, 0.004378, " small", false], [3793, 0.004265, " terms", false], [3259, 0.003964, " making", false], [862, 0.002562, " their", false]]]}, "raw_delta": 0.026957664638757706, "tuned_delta": 0.035529456669335956}, {"byte_start": 5280, "byte_end": 5286, "display": {"text": " short", "kind": "normal"}, "is_word": true, "word_id": 891, "word_key": " short", "bytes_hex": "20 73 68 6f 72 74", "compression": {"rwkv": "0.29% 0.29% 0.29% 0.29% 0.29% 0.29%", "qwen": "0.38% 0.38% 0.38% 0.38% 0.38% 0.38%"}, "model_tokens": {"rwkv": [[39675, " short", "normal", 0.9099187254905701]], "qwen": [[2805, " short", "normal", 0.8821887969970703]]}, "loss": {"rwkv": 0.2861791310357135, "qwen": 0.37675137560658395}, "topk": {"rwkv": [39675, 1, 0.9099187254905701, [[39675, 0.909919, " short", false], [59220, 0.012985, " beginning", false], [31323, 0.009941, " long", false], [38328, 0.008594, " early", false], [52888, 0.008279, " shorter", false], [38499, 0.006497, " first", false], [31503, 0.004843, " near", false], [52013, 0.004601, " initial", false], [59816, 0.003968, " immediate", false], [32386, 0.003736, " very", false]]], "qwen": [2805, 1, 0.8821887969970703, [[2805, 0.882189, " short", false], [4124, 0.03014, " early", false], [23327, 0.010896, " shorter", false], [13922, 0.009542, " immediate", false], [1602, 0.009541, " very", false], [2856, 0.007255, " initial", false], [7167, 0.005843, " beginning", false], [3143, 0.005533, " near", false], [1293, 0.003011, " long", false], [11051, 0.002668, " medium", false]]]}, "raw_delta": -0.005022391676902771, "tuned_delta": 0.0035494003536754772}, {"byte_start": 5286, "byte_end": 5291, "display": {"text": " term", "kind": "normal"}, "is_word": true, "word_id": 892, "word_key": " term", "bytes_hex": "20 74 65 72 6d", "compression": {"rwkv": "3.75% 3.75% 3.75% 3.75% 3.75%", "qwen": "2.27% 2.27% 2.27% 2.27% 2.27%"}, "model_tokens": {"rwkv": [[32219, " term", "normal", 0.35302820801734924]], "qwen": [[4647, " term", "normal", 0.5326520204544067]]}, "loss": {"rwkv": 3.7476257898092213, "qwen": 2.2718368583409934}, "topk": {"rwkv": [32219, 2, 0.35302820801734924, [[22418, 0.618986, " run", false], [32219, 0.353028, " term", false], [46, 0.0225, "-", false], [4811, 0.000834, " to", false], [4715, 0.000747, " or", false], [21265, 0.000664, " and", false], [8661, 0.000368, "run", false], [32251, 0.00029, " time", false], [45, 0.000235, ",", false], [39438, 0.00019, " range", false]]], "qwen": [4647, 1, 0.5326520204544067, [[4647, 0.532652, " term", false], [1598, 0.433524, " run", false], [9663, 0.017027, "-term", false], [22973, 0.007456, "-run", false], [311, 0.001493, " to", false], [882, 0.001204, " time", false], [323, 0.001141, " and", false], [11, 0.000983, ",", false], [12, 0.000648, "-", false], [4686, 0.000535, "-to", false]]]}, "raw_delta": 0.08183511495590212, "tuned_delta": 0.09040690698648036}, {"byte_start": 5291, "byte_end": 5292, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "4.61%", "qwen": "7.41%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.775114893913269]], "qwen": [[11, ",", "normal", 0.6631759405136108]]}, "loss": {"rwkv": 4.61408814346812, "qwen": 7.406705344419314}, "topk": {"rwkv": [45, 1, 0.775114893913269, [[45, 0.775115, ",", false], [21400, 0.097752, " but", false], [275, 0.036147, " (", false], [21265, 0.029023, " and", false], [32465, 0.008431, " when", false], [5346, 0.005627, "---", false], [4450, 0.004008, " by", false], [4596, 0.003845, " in", false], [51018, 0.002883, " because", false], [4424, 0.002792, " at", false]]], "qwen": [11, 1, 0.6631759405136108, [[11, 0.663176, ",", false], [714, 0.176976, " but", false], [320, 0.032339, " (", false], [323, 0.030976, " and", false], [220, 0.013957, " ", false], [979, 0.011009, " when", false], [553, 0.010002, " by", false], [4421, 0.009404, "---", false], [1576, 0.007255, " because", false], [304, 0.005778, " in", false]]]}, "raw_delta": -0.15485557913780212, "tuned_delta": -0.14628378710722387}, {"byte_start": 5292, "byte_end": 5296, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 893, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "6.38% 6.38% 6.38% 6.38%", "qwen": "6.55% 6.55% 6.55% 6.55%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.2431361973285675]], "qwen": [[323, " and", "normal", 0.23368458449840546]]}, "loss": {"rwkv": 6.37519048830328, "qwen": 6.55426742351418}, "topk": {"rwkv": [21265, 3, 0.2431361973285675, [[21400, 0.359584, " but", false], [286, 0.278356, " 3", false], [21265, 0.243136, " and", false], [32465, 0.008133, " when", false], [30788, 0.007754, " even", false], [40076, 0.007155, " until", false], [4423, 0.006963, " as", false], [51018, 0.006009, " because", false], [4596, 0.004779, " in", false], [39171, 0.004488, " often", false]]], "qwen": [323, 3, 0.23368458449840546, [[714, 0.386545, " but", false], [220, 0.264845, " ", false], [323, 0.233685, " and", false], [1496, 0.014745, " even", false], [979, 0.008836, " when", false], [1576, 0.006399, " because", false], [438, 0.006186, " as", false], [518, 0.004264, " at", false], [3602, 0.00402, " yet", false], [5310, 0.003229, " especially", false]]]}, "raw_delta": -0.009930133819580078, "tuned_delta": -0.00135834178900183}, {"byte_start": 5296, "byte_end": 5299, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 894, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "35.32% 35.32% 35.32%", "qwen": "36.50% 36.50% 36.50%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.0027636028826236725]], "qwen": [[374, " is", "normal", 0.0023053758777678013]]}, "loss": {"rwkv": 35.31597235509441, "qwen": 36.50326031808084}, "topk": {"rwkv": [4600, 9, 0.0027636028826236725, [[286, 0.91861, " 3", false], [39171, 0.007677, " often", false], [45, 0.006756, ",", false], [60523, 0.005081, " sometimes", false], [32230, 0.004573, " then", false], [31581, 0.004088, " only", false], [32227, 0.003895, " that", false], [4596, 0.003376, " in", false], [4600, 0.002764, " is", false], [61959, 0.001976, " eventually", false]]], "qwen": [374, 10, 0.0023053758777678013, [[220, 0.928814, " ", false], [1172, 0.006544, " only", false], [1221, 0.005395, " then", false], [304, 0.005333, " in", false], [11, 0.003971, ",", false], [7025, 0.002931, " sometimes", false], [429, 0.002917, " that", false], [279, 0.002799, " the", false], [3545, 0.002413, " often", false], [374, 0.002305, " is", false]]]}, "raw_delta": -0.0658372243245442, "tuned_delta": -0.05726543229396595}, {"byte_start": 5299, "byte_end": 5310, "display": {"text": " personally", "kind": "normal"}, "is_word": true, "word_id": 895, "word_key": " personally", "bytes_hex": "20 70 65 72 73 6f 6e 61 6c 6c 79", "compression": {"rwkv": "13.22% 13.22% 13.22% 13.22% 13.22% 13.22% 13.22% 13.22% 13.22% 13.22% 13.22%", "qwen": "17.72% 17.72% 17.72% 17.72% 17.72% 17.72% 17.72% 17.72% 17.72% 17.72% 17.72%"}, "model_tokens": {"rwkv": [[62309, " personally", "normal", 0.000304235378280282]], "qwen": [[15726, " personally", "normal", 2.0252231479389593e-05]]}, "loss": {"rwkv": 13.217873599053709, "qwen": 17.717680834502143}, "topk": {"rwkv": [62309, 245, 0.000304235378280282, [[39171, 0.140777, " often", false], [332, 0.053596, " a", false], [60645, 0.042091, " therefore", false], [22187, 0.032508, " not", false], [60523, 0.03211, " sometimes", false], [45150, 0.029338, " always", false], [32386, 0.026068, " very", false], [30724, 0.025437, " easy", false], [32239, 0.022997, " thus", false], [57403, 0.020189, " tempting", false]]], "qwen": [15726, 1258, 2.0252231479389593e-05, [[3545, 0.115149, " often", false], [264, 0.065454, " a", false], [279, 0.055977, " the", false], [6966, 0.035276, " looked", false], [2677, 0.031695, " always", false], [7025, 0.025693, " sometimes", false], [8916, 0.023796, " therefore", false], [537, 0.022601, " not", false], [3884, 0.020386, " seen", false], [5310, 0.019291, " especially", false]]]}, "raw_delta": -0.24952229586514554, "tuned_delta": -0.2409505038345673}, {"byte_start": 5310, "byte_end": 5321, "display": {"text": " satisfying", "kind": "normal"}, "is_word": true, "word_id": 896, "word_key": " satisfying", "bytes_hex": "20 73 61 74 69 73 66 79 69 6e 67", "compression": {"rwkv": "1.35% 1.35% 1.35% 1.35% 1.35% 1.35% 1.35% 1.35% 1.35% 1.35% 1.35%", "qwen": "0.86% 0.86% 0.86% 0.86% 0.86% 0.86% 0.86% 0.86% 0.86% 0.86% 0.86%"}, "model_tokens": {"rwkv": [[62527, " satisfying", "normal", 0.4378766119480133]], "qwen": [[36054, " satisfying", "normal", 0.5923541188240051]]}, "loss": {"rwkv": 1.3512457991280684, "qwen": 0.858486580051204}, "topk": {"rwkv": [62527, 1, 0.4378766119480133, [[62527, 0.437877, " satisfying", false], [31004, 0.107398, " grat", false], [59154, 0.107104, " appealing", false], [60428, 0.096222, " rewarding", false], [61694, 0.034863, " comforting", false], [32386, 0.025518, " very", false], [21265, 0.021764, " and", false], [56874, 0.021491, " pleasing", false], [61617, 0.018987, " attractive", false], [62029, 0.007011, " fulfilling", false]]], "qwen": [36054, 1, 0.5923541188240051, [[36054, 0.592354, " satisfying", false], [40993, 0.13555, " rewarding", false], [8728, 0.07889, " grat", false], [49598, 0.032174, " fulfilling", false], [1602, 0.013924, " very", false], [32252, 0.01271, " appealing", false], [68030, 0.008722, " comforting", false], [88589, 0.008718, " motivating", false], [18879, 0.007923, " attractive", false], [5390, 0.007654, " useful", false]]]}, "raw_delta": 0.027324373071843933, "tuned_delta": 0.03589616510242218}, {"byte_start": 5321, "byte_end": 5324, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 897, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "8.88% 8.88% 8.88%", "qwen": "10.03% 10.03% 10.03%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.2312353104352951]], "qwen": [[311, " to", "normal", 0.18857607245445251]]}, "loss": {"rwkv": 8.875955817969208, "qwen": 10.02825677701511}, "topk": {"rwkv": [4811, 2, 0.2312353104352951, [[45, 0.579151, ",", false], [4811, 0.231235, " to", false], [21700, 0.060822, " for", false], [21265, 0.035763, " and", false], [4596, 0.024416, " in", false], [275, 0.010831, " (", false], [4423, 0.009268, " as", false], [51018, 0.007781, " because", false], [47, 0.005236, ".", false], [21400, 0.004564, " but", false]]], "qwen": [311, 2, 0.18857607245445251, [[11, 0.56908, ",", false], [311, 0.188576, " to", false], [369, 0.075684, " for", false], [304, 0.048536, " in", false], [323, 0.025997, " and", false], [320, 0.018352, " (", false], [1576, 0.011494, " because", false], [979, 0.007177, " when", false], [714, 0.006805, " but", false], [518, 0.006291, " at", false]]]}, "raw_delta": -0.06389713287353516, "tuned_delta": -0.055325340842956906}, {"byte_start": 5324, "byte_end": 5328, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 898, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "2.68% 2.68% 2.68% 2.68%", "qwen": "2.68% 2.68% 2.68% 2.68%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.559503436088562]], "qwen": [[279, " the", "normal", 0.5514378547668457]]}, "loss": {"rwkv": 2.6768755641494435, "qwen": 2.6835307552920504}, "topk": {"rwkv": [22590, 1, 0.559503436088562, [[22590, 0.559503, " the", false], [63843, 0.091696, " researchers", false], [4491, 0.072447, " do", false], [39944, 0.046482, " those", false], [32229, 0.034027, " them", false], [31059, 0.016784, " have", false], [31370, 0.013396, " many", false], [32499, 0.011874, " work", false], [332, 0.010146, " a", false], [3609, 0.008619, " AI", false]]], "qwen": [279, 1, 0.5514378547668457, [[279, 0.551438, " the", false], [11811, 0.121601, " researchers", false], [653, 0.081151, " do", false], [1846, 0.069355, " those", false], [1936, 0.029654, " build", false], [1105, 0.010795, " them", false], [1430, 0.008679, " try", false], [1657, 0.007836, " many", false], [15235, 0.004722, " AI", false], [1490, 0.004643, " see", false]]]}, "raw_delta": -0.00036904215812683105, "tuned_delta": 0.008202749872451417}, {"byte_start": 5328, "byte_end": 5339, "display": {"text": " researcher", "kind": "normal"}, "is_word": true, "word_id": 899, "word_key": " researcher", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72", "compression": {"rwkv": "1.47% 1.47% 1.47% 1.47% 1.47% 1.47% 1.47% 1.47% 1.47% 1.47% 1.47%", "qwen": "2.10% 2.10% 2.10% 2.10% 2.10% 2.10% 2.10% 2.10% 2.10% 2.10% 2.10%"}, "model_tokens": {"rwkv": [[62496, " researcher", "normal", 0.4059281349182129]], "qwen": [[31085, " researcher", "normal", 0.2772934138774872]]}, "loss": {"rwkv": 1.4729219611348614, "qwen": 2.1028576694971903}, "topk": {"rwkv": [62496, 1, 0.4059281349182129, [[62496, 0.405928, " researcher", false], [63843, 0.350129, " researchers", false], [37636, 0.06722, " agent", false], [3609, 0.037711, " AI", false], [38720, 0.021742, " human", false], [45124, 0.018909, " agents", false], [62105, 0.009099, " individual", false], [46787, 0.007936, " people", false], [57103, 0.004754, " research", false], [64951, 0.004345, " investigators", false]]], "qwen": [31085, 2, 0.2772934138774872, [[11811, 0.537529, " researchers", false], [31085, 0.277293, " researcher", false], [3738, 0.018354, " human", false], [13402, 0.012415, " developers", false], [8315, 0.01054, " agent", false], [1251, 0.010197, " people", false], [15235, 0.007937, " AI", false], [3412, 0.007739, " research", false], [3842, 0.007146, " individual", false], [12014, 0.007041, " authors", false]]]}, "raw_delta": -0.034931052814830436, "tuned_delta": -0.026359260784252186}, {"byte_start": 5339, "byte_end": 5340, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "2.82%", "qwen": "4.25%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8550218939781189]], "qwen": [[11, ",", "normal", 0.7900545597076416]]}, "loss": {"rwkv": 2.8177637517362566, "qwen": 4.249697752169408}, "topk": {"rwkv": [45, 1, 0.8550218939781189, [[45, 0.855022, ",", false], [22762, 0.026986, " who", false], [21265, 0.019284, " and", false], [275, 0.015934, " (", false], [47, 0.009862, ".", false], [4596, 0.007708, " in", false], [286, 0.00665, " 3", false], [51018, 0.006173, " because", false], [4811, 0.004574, " to", false], [60, 0.003876, ";", false]]], "qwen": [11, 1, 0.7900545597076416, [[11, 0.790055, ",", false], [879, 0.068329, " who", false], [320, 0.024808, " (", false], [4421, 0.010228, "---", false], [323, 0.00911, " and", false], [4460, 0.008482, " trying", false], [311, 0.007447, " to", false], [13, 0.006437, ".", false], [3730, 0.00533, " doing", false], [1576, 0.004422, " because", false]]]}, "raw_delta": -0.07940328121185303, "tuned_delta": -0.07083148918127478}, {"byte_start": 5340, "byte_end": 5344, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 900, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"rwkv": "6.06% 6.06% 6.06% 6.06%", "qwen": "4.45% 4.45% 4.45% 4.45%"}, "model_tokens": {"rwkv": [[21400, " but", "normal", 0.26175305247306824]], "qwen": [[714, " but", "normal", 0.37229880690574646]]}, "loss": {"rwkv": 6.058192066232952, "qwen": 4.45458444626276}, "topk": {"rwkv": [21400, 3, 0.26175305247306824, [[286, 0.423515, " 3", false], [21265, 0.266668, " and", false], [21400, 0.261753, " but", false], [22762, 0.008996, " who", false], [30788, 0.003798, " even", false], [51018, 0.003428, " because", false], [4423, 0.002328, " as", false], [40187, 0.002235, " while", false], [4788, 0.002218, " so", false], [22797, 0.001451, " yet", false]]], "qwen": [714, 1, 0.37229880690574646, [[714, 0.372299, " but", false], [323, 0.322522, " and", false], [220, 0.249809, " ", false], [1496, 0.006742, " even", false], [1576, 0.006304, " because", false], [3602, 0.003455, " yet", false], [438, 0.003381, " as", false], [1393, 0.002528, " while", false], [773, 0.002484, " so", false], [5310, 0.001837, " especially", false]]]}, "raw_delta": 0.0889228880405426, "tuned_delta": 0.09749468007112085}, {"byte_start": 5344, "byte_end": 5346, "display": {"text": " 3", "kind": "normal"}, "is_word": true, "word_id": 901, "word_key": " 3", "bytes_hex": "20 33", "compression": {"rwkv": "2.91% 2.91%", "qwen": "4.66% 0.05%"}, "model_tokens": {"rwkv": [[286, " 3", "normal", 0.7265291213989258]], "qwen": [[220, " ", "normal", 0.7723115682601929], [18, "3", "normal", 0.9974400997161865]]}, "loss": {"rwkv": 2.9058188689780144, "qwen": 2.35276879806534}, "topk": {"rwkv": [286, 1, 0.7265291213989258, [[286, 0.726529, " 3", false], [45, 0.033719, ",", false], [4600, 0.025319, " is", false], [4596, 0.019004, " in", false], [4601, 0.018985, " it", false], [32227, 0.013282, " that", false], [31601, 0.012459, " over", false], [61959, 0.011353, " eventually", false], [62676, 0.010438, " ultimately", false], [30659, 0.00992, " does", false]]], "qwen": [220, 1, 0.7723115682601929, [[220, 0.772312, " ", false], [374, 0.023632, " is", false], [1558, 0.023287, " does", false], [304, 0.022494, " in", false], [432, 0.015446, " it", false], [537, 0.010833, " not", false], [2581, 0.007654, " never", false], [1172, 0.007199, " only", false], [13653, 0.006963, " ultimately", false], [279, 0.00546, " the", false]]]}, "raw_delta": 0.030667607788927853, "tuned_delta": 0.0392393998195061}, {"byte_start": 5346, "byte_end": 5347, "display": {"text": ")", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29", "compression": {"rwkv": "0.01%", "qwen": "0.01%"}, "model_tokens": {"rwkv": [[42, ")", "normal", 0.9992398023605347]], "qwen": [[8, ")", "normal", 0.9994556307792664]]}, "loss": {"rwkv": 0.013827405129369813, "qwen": 0.009819685564566784}, "topk": {"rwkv": [42, 1, 0.9992398023605347, [[42, 0.99924, ")", false], [497, 0.000284, "),", false], [499, 4.7e-05, ").", false], [47, 4.6e-05, ".", false], [276, 4.5e-05, " )", false], [45, 3.8e-05, ",", false], [98, 2.8e-05, "a", false], [4600, 2.5e-05, " is", false], [30659, 1.8e-05, " does", false], [4596, 1.2e-05, " in", false]]], "qwen": [8, 1, 0.9994556307792664, [[8, 0.999456, ")", false], [64, 0.000158, "a", false], [701, 4.8e-05, "),", false], [873, 3e-05, " )", false], [11, 2.3e-05, ",", false], [65, 1.3e-05, "b", false], [13, 1.3e-05, ".", false], [340, 1.2e-05, ")\n", false], [692, 1.1e-05, ")\n\n", false], [568, 1e-05, ").", false]]]}, "raw_delta": 0.00022223516134545207, "tuned_delta": 0.0087940271919237}, {"byte_start": 5347, "byte_end": 5350, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 902, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "13.24% 13.24% 13.24%", "qwen": "12.09% 12.09% 12.09%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.11017217487096786]], "qwen": [[304, " in", "normal", 0.1338699460029602]]}, "loss": {"rwkv": 13.243489633160404, "qwen": 12.087900939105507}, "topk": {"rwkv": [4596, 2, 0.11017217487096786, [[4601, 0.222461, " it", false], [4596, 0.110172, " in", false], [22590, 0.107652, " the", false], [32234, 0.077103, " this", false], [31601, 0.042091, " over", false], [32227, 0.032452, " that", false], [32465, 0.02627, " when", false], [61959, 0.02495, " eventually", false], [4423, 0.018162, " as", false], [31578, 0.014734, " once", false]]], "qwen": [304, 2, 0.1338699460029602, [[432, 0.22157, " it", false], [304, 0.13387, " in", false], [279, 0.106598, " the", false], [419, 0.075664, " this", false], [9583, 0.036889, " eventually", false], [916, 0.021513, " over", false], [979, 0.021205, " when", false], [438, 0.015544, " as", false], [13653, 0.013909, " ultimately", false], [1493, 0.012713, " these", false]]]}, "raw_delta": 0.06407944361368811, "tuned_delta": 0.07265123564426636}, {"byte_start": 5350, "byte_end": 5354, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 903, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "0.63% 0.63% 0.63% 0.63%", "qwen": "0.35% 0.35% 0.35% 0.35%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.8694505095481873]], "qwen": [[279, " the", "normal", 0.9242848753929138]]}, "loss": {"rwkv": 0.6295940882785698, "qwen": 0.35497037750131616}, "topk": {"rwkv": [22590, 1, 0.8694505095481873, [[22590, 0.869451, " the", false], [51832, 0.030552, " general", false], [56901, 0.02449, " practice", false], [332, 0.012814, " a", false], [31461, 0.007921, " most", false], [45145, 0.004309, " almost", false], [30808, 0.003205, " fact", false], [31323, 0.00295, " long", false], [21256, 0.002759, " all", false], [31370, 0.002502, " many", false]]], "qwen": [279, 1, 0.9242848753929138, [[279, 0.924285, " the", false], [6588, 0.021992, " practice", false], [4586, 0.005897, " general", false], [2097, 0.004719, " fact", false], [76553, 0.003382, " retrospect", false], [8729, 0.003154, " reality", false], [1429, 0.003066, " most", false], [264, 0.002704, " a", false], [1657, 0.002187, " many", false], [3793, 0.002115, " terms", false]]]}, "raw_delta": 0.015228372067213058, "tuned_delta": 0.02380016409779131}, {"byte_start": 5354, "byte_end": 5359, "display": {"text": " long", "kind": "normal"}, "is_word": true, "word_id": 904, "word_key": " long", "bytes_hex": "20 6c 6f 6e 67", "compression": {"rwkv": "0.46% 0.46% 0.46% 0.46% 0.46%", "qwen": "0.23% 0.23% 0.23% 0.23% 0.23%"}, "model_tokens": {"rwkv": [[31323, " long", "normal", 0.8808698058128357]], "qwen": [[1293, " long", "normal", 0.9382081031799316]]}, "loss": {"rwkv": 0.4578866096571417, "qwen": 0.23005022816518658}, "topk": {"rwkv": [31323, 1, 0.8808698058128357, [[31323, 0.88087, " long", false], [46470, 0.079796, " longer", false], [21616, 0.012357, " end", false], [32386, 0.004316, " very", false], [50837, 0.002124, " absence", false], [46536, 0.002025, " medium", false], [31466, 0.001539, " much", false], [39675, 0.000905, " short", false], [30405, 0.000877, " case", false], [46397, 0.000751, " larger", false]]], "qwen": [1293, 1, 0.9382081031799316, [[1293, 0.938208, " long", false], [5021, 0.030905, " longer", false], [835, 0.014702, " end", false], [11051, 0.003611, " medium", false], [1602, 0.001793, " very", false], [2805, 0.001152, " short", false], [3930, 0.000565, " limit", false], [3853, 0.000481, " future", false], [1931, 0.000452, " real", false], [19265, 0.000355, " absence", false]]]}, "raw_delta": 0.012633931636810303, "tuned_delta": 0.02120572366738855}, {"byte_start": 5359, "byte_end": 5363, "display": {"text": " run", "kind": "normal"}, "is_word": true, "word_id": 905, "word_key": " run", "bytes_hex": "20 72 75 6e", "compression": {"rwkv": "1.63% 1.63% 1.63% 1.63%", "qwen": "1.93% 1.93% 1.93% 1.93%"}, "model_tokens": {"rwkv": [[22418, " run", "normal", 0.696638822555542]], "qwen": [[1598, " run", "normal", 0.6518276333808899]]}, "loss": {"rwkv": 1.6290196689725231, "qwen": 1.929492304993734}, "topk": {"rwkv": [22418, 1, 0.696638822555542, [[22418, 0.696639, " run", false], [32219, 0.29224, " term", false], [46, 0.007287, "-", false], [31057, 0.000752, " haul", false], [32251, 0.000254, " time", false], [45, 0.000249, ",", false], [27132, 0.000197, "term", false], [39438, 0.000183, " range", false], [39920, 0.000141, " terms", false], [32186, 0.000122, " tail", false]]], "qwen": [1598, 1, 0.6518276333808899, [[1598, 0.651828, " run", false], [4647, 0.340334, " term", false], [9663, 0.004076, "-term", false], [22973, 0.00116, "-run", false], [11, 0.000488, ",", false], [37868, 0.000388, " haul", false], [882, 0.000245, " time", false], [3793, 0.000145, " terms", false], [320, 9.5e-05, " (", false], [835, 7.2e-05, " end", false]]]}, "raw_delta": -0.016661740839481354, "tuned_delta": -0.008089948808903106}, {"byte_start": 5363, "byte_end": 5366, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 906, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "10.05% 10.05% 10.05%", "qwen": "9.72% 9.72% 9.72%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.1925484836101532]], "qwen": [[432, " it", "normal", 0.19834871590137482]]}, "loss": {"rwkv": 10.050024047859313, "qwen": 9.724538281968906}, "topk": {"rwkv": [4601, 2, 0.1925484836101532, [[45, 0.570428, ",", false], [4601, 0.192548, " it", false], [32234, 0.07024, " this", false], [22590, 0.046824, " the", false], [39936, 0.011848, " these", false], [32139, 0.011633, " such", false], [275, 0.005885, " (", false], [32227, 0.005665, " that", false], [4600, 0.003679, " is", false], [39934, 0.00306, " there", false]]], "qwen": [432, 2, 0.19834871590137482, [[11, 0.483205, ",", false], [432, 0.198349, " it", false], [279, 0.080016, " the", false], [419, 0.063814, " this", false], [34447, 0.010684, " computation", false], [1052, 0.00918, " there", false], [1493, 0.007101, " these", false], [678, 0.006852, " all", false], [6540, 0.006494, " knowledge", false], [320, 0.006237, " (", false]]]}, "raw_delta": 0.018048763275146484, "tuned_delta": 0.026620555305724734}, {"byte_start": 5366, "byte_end": 5375, "display": {"text": " plateaus", "kind": "normal"}, "is_word": true, "word_id": 907, "word_key": " plateaus", "bytes_hex": "20 70 6c 61 74 65 61 75 73", "compression": {"rwkv": "30.01% 30.01% 30.01% 30.01% 30.01% 30.01% 30.01% 30.01% 0.13%", "qwen": "45.10% 45.10% 45.10% 45.10% 45.10% 45.10% 0.02% 0.02% 0.02%"}, "model_tokens": {"rwkv": [[52488, " plateau", "normal", 1.6992586324704462e-06], [116, "s", "normal", 0.9926484227180481]], "qwen": [[11968, " plate", "normal", 3.0405055895244004e-07], [11855, "aus", "normal", 0.9973642230033875]]}, "loss": {"rwkv": 26.689628334750797, "qwen": 30.073601910940067}, "topk": {"rwkv": [52488, 1640, 1.6992586324704462e-06, [[4600, 0.294624, " is", false], [30659, 0.109196, " does", false], [45150, 0.05864, " always", false], [39115, 0.052263, " never", false], [21800, 0.03202, " has", false], [45145, 0.023423, " almost", false], [39914, 0.020226, " tends", false], [38964, 0.018081, " makes", false], [39171, 0.016802, " often", false], [38724, 0.016613, " hurts", false]]], "qwen": [11968, 3160, 3.0405055895244004e-07, [[374, 0.266822, " is", false], [1558, 0.1476, " does", false], [2677, 0.056765, " always", false], [43064, 0.033064, " hurts", false], [9044, 0.026317, " becomes", false], [702, 0.025968, " has", false], [305, 0.023234, " h", false], [1172, 0.021983, " only", false], [2581, 0.021418, " never", false], [83396, 0.020202, " harms", false]]]}, "raw_delta": -0.18764733947399576, "tuned_delta": -0.1790755474434175}, {"byte_start": 5375, "byte_end": 5379, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 908, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "6.73% 6.73% 6.73% 6.73%", "qwen": "6.21% 6.21% 6.21% 6.21%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.22643521428108215]], "qwen": [[323, " and", "normal", 0.25207898020744324]]}, "loss": {"rwkv": 6.727410957270312, "qwen": 6.212663121117438}, "topk": {"rwkv": [21265, 3, 0.22643521428108215, [[45, 0.35756, ",", false], [4715, 0.231589, " or", false], [21265, 0.226435, " and", false], [4596, 0.037887, " in", false], [22249, 0.032709, " out", false], [275, 0.013597, " (", false], [4424, 0.01314, " at", false], [47, 0.01166, ".", false], [4423, 0.008217, " as", false], [40187, 0.005346, " while", false]]], "qwen": [323, 2, 0.25207898020744324, [[11, 0.284829, ",", false], [323, 0.252079, " and", false], [476, 0.094555, " or", false], [4421, 0.054411, "---", false], [5068, 0.052599, " performance", false], [518, 0.037941, " at", false], [279, 0.025653, " the", false], [304, 0.02063, " in", false], [320, 0.018466, " (", false], [13, 0.016911, ".", false]]]}, "raw_delta": 0.028543680906295776, "tuned_delta": 0.037115472936874026}, {"byte_start": 5379, "byte_end": 5384, "display": {"text": " even", "kind": "normal"}, "is_word": true, "word_id": 909, "word_key": " even", "bytes_hex": "20 65 76 65 6e", "compression": {"rwkv": "13.58% 13.58% 13.58% 13.58% 13.58%", "qwen": "10.78% 10.78% 10.78% 10.78% 10.78%"}, "model_tokens": {"rwkv": [[30788, " even", "normal", 0.022958513349294662]], "qwen": [[1496, " even", "normal", 0.05034052953124046]]}, "loss": {"rwkv": 13.581621283368756, "qwen": 10.780339488977937}, "topk": {"rwkv": [30788, 7, 0.022958513349294662, [[32230, 0.113568, " then", false], [4600, 0.086859, " is", false], [30659, 0.068003, " does", false], [51019, 0.050926, " becomes", false], [22590, 0.045561, " the", false], [61959, 0.045538, " eventually", false], [30788, 0.022959, " even", false], [39115, 0.021391, " never", false], [39171, 0.021272, " often", false], [38442, 0.018677, " fails", false]]], "qwen": [1496, 5, 0.05034052953124046, [[1221, 0.112166, " then", false], [9044, 0.086393, " becomes", false], [374, 0.068139, " is", false], [1558, 0.066127, " does", false], [1496, 0.050341, " even", false], [14525, 0.038145, " fails", false], [9583, 0.037363, " eventually", false], [3545, 0.026048, " often", false], [279, 0.025496, " the", false], [17066, 0.022589, " falls", false]]]}, "raw_delta": 0.1553360462188721, "tuned_delta": 0.16390783824945035}, {"byte_start": 5384, "byte_end": 5393, "display": {"text": " inhibits", "kind": "normal"}, "is_word": true, "word_id": 910, "word_key": " inhibits", "bytes_hex": "20 69 6e 68 69 62 69 74 73", "compression": {"rwkv": "10.21% 10.21% 10.21% 10.21% 10.21% 10.21% 10.21% 10.21% 0.01%", "qwen": "20.57% 20.57% 20.57% 20.57% 20.57% 20.57% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[52011, " inhibit", "normal", 0.010673652403056622], [116, "s", "normal", 0.9995808005332947]], "qwen": [[20142, " inhib", "normal", 0.0010657573584467173], [1199, "its", "normal", 0.9995834231376648]]}, "loss": {"rwkv": 9.08030178188771, "qwen": 13.714591980118762}, "topk": {"rwkv": [52011, 26, 0.010673652403056622, [[38724, 0.084977, " hurts", false], [55929, 0.064589, " declines", false], [52688, 0.057091, " regress", false], [46201, 0.05617, " hinder", false], [51417, 0.048086, " degrade", false], [31049, 0.03523, " harm", false], [51019, 0.029307, " becomes", false], [59456, 0.029264, " decreases", false], [30218, 0.02554, " back", false], [30965, 0.024325, " gets", false]]], "qwen": [20142, 91, 0.0010657573584467173, [[56954, 0.174928, " declines", false], [46193, 0.106602, " wors", false], [17066, 0.083355, " falls", false], [38336, 0.071724, " deterior", false], [9044, 0.038606, " becomes", false], [42054, 0.033706, " decreases", false], [5221, 0.029796, " gets", false], [5780, 0.026763, " goes", false], [14525, 0.019451, " fails", false], [69170, 0.017272, " slows", false]]]}, "raw_delta": -0.2569796147840355, "tuned_delta": -0.24840782275345727}, {"byte_start": 5393, "byte_end": 5401, "display": {"text": " further", "kind": "normal"}, "is_word": true, "word_id": 911, "word_key": " further", "bytes_hex": "20 66 75 72 74 68 65 72", "compression": {"rwkv": "6.13% 6.13% 6.13% 6.13% 6.13% 6.13% 6.13% 6.13%", "qwen": "5.51% 5.51% 5.51% 5.51% 5.51% 5.51% 5.51% 5.51%"}, "model_tokens": {"rwkv": [[51816, " further", "normal", 0.06583872437477112]], "qwen": [[4623, " further", "normal", 0.0866326093673706]]}, "loss": {"rwkv": 6.128636160026358, "qwen": 5.513978227529439}, "topk": {"rwkv": [51816, 3, 0.06583872437477112, [[56950, 0.604828, " progress", false], [22590, 0.073033, " the", false], [51816, 0.065839, " further", false], [63750, 0.054296, " performance", false], [56537, 0.025818, " learning", false], [63621, 0.023078, " improvement", false], [57103, 0.022705, " research", false], [45, 0.020699, ",", false], [46064, 0.00738, " future", false], [63469, 0.007257, " development", false]]], "qwen": [4623, 3, 0.0866326093673706, [[5098, 0.393611, " progress", false], [5068, 0.238207, " performance", false], [4623, 0.086633, " further", false], [279, 0.064738, " the", false], [15673, 0.021279, " improvement", false], [3853, 0.013209, " future", false], [3412, 0.01273, " research", false], [2393, 0.009553, " success", false], [1293, 0.009438, " long", false], [11, 0.009293, ",", false]]]}, "raw_delta": 0.03408387303352356, "tuned_delta": 0.04265566506410181}, {"byte_start": 5401, "byte_end": 5410, "display": {"text": " progress", "kind": "normal"}, "is_word": true, "word_id": 912, "word_key": " progress", "bytes_hex": "20 70 72 6f 67 72 65 73 73", "compression": {"rwkv": "0.53% 0.53% 0.53% 0.53% 0.53% 0.53% 0.53% 0.53% 0.53%", "qwen": "0.73% 0.73% 0.73% 0.73% 0.73% 0.73% 0.73% 0.73% 0.73%"}, "model_tokens": {"rwkv": [[56950, " progress", "normal", 0.7676780223846436]], "qwen": [[5098, " progress", "normal", 0.6947980523109436]]}, "loss": {"rwkv": 0.5283307034505481, "qwen": 0.7296311412600225}, "topk": {"rwkv": [56950, 1, 0.7676780223846436, [[56950, 0.767678, " progress", false], [63621, 0.064471, " improvement", false], [57103, 0.03445, " research", false], [63469, 0.026276, " development", false], [63750, 0.017198, " performance", false], [56537, 0.0125, " learning", false], [64423, 0.009459, " improvements", false], [46132, 0.007171, " growth", false], [55465, 0.005687, " advances", false], [53052, 0.00488, " success", false]]], "qwen": [5098, 1, 0.6947980523109436, [[5098, 0.694798, " progress", false], [15673, 0.081768, " improvement", false], [5068, 0.06162, " performance", false], [19619, 0.038062, " gains", false], [18142, 0.027084, " improvements", false], [29903, 0.015329, " advances", false], [4401, 0.011739, " development", false], [2393, 0.011474, " success", false], [3412, 0.004793, " research", false], [11912, 0.004657, " advance", false]]]}, "raw_delta": -0.011162466473049588, "tuned_delta": -0.0025906744424713402}, {"byte_start": 5410, "byte_end": 5411, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "16.84%", "qwen": "24.12%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.39145898818969727]], "qwen": [[11, ",", "normal", 0.2625139057636261]]}, "loss": {"rwkv": 16.83613841662413, "qwen": 24.11917802360319}, "topk": {"rwkv": [45, 2, 0.39145898818969727, [[47, 0.44562, ".", false], [45, 0.391459, ",", false], [21265, 0.018936, " and", false], [4450, 0.015545, " by", false], [4596, 0.015309, " in", false], [5346, 0.015023, "---", false], [51018, 0.014348, " because", false], [4423, 0.014031, " as", false], [275, 0.01284, " (", false], [60, 0.007438, ";", false]]], "qwen": [11, 2, 0.2625139057636261, [[13, 0.474898, ".", false], [11, 0.262514, ",", false], [382, 0.117923, ".\n\n", false], [304, 0.022742, " in", false], [1576, 0.016775, " because", false], [320, 0.014746, " (", false], [323, 0.010745, " and", false], [553, 0.010258, " by", false], [4421, 0.008457, "---", false], [624, 0.007372, ".\n", false]]]}, "raw_delta": -0.4038574695587158, "tuned_delta": -0.3952856775281376}, {"byte_start": 5411, "byte_end": 5415, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 913, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "2.89% 2.89% 2.89% 2.89%", "qwen": "2.82% 2.82% 2.82% 2.82%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.5252609848976135]], "qwen": [[323, " and", "normal", 0.535361111164093]]}, "loss": {"rwkv": 2.8882078455296627, "qwen": 2.8169242614217325}, "topk": {"rwkv": [21265, 1, 0.5252609848976135, [[21265, 0.525261, " and", false], [287, 0.108301, " 4", false], [51018, 0.057239, " because", false], [40187, 0.045891, " while", false], [4423, 0.03307, " as", false], [53339, 0.019971, " whereas", false], [4715, 0.009878, " or", false], [32465, 0.0089, " when", false], [61953, 0.008477, " especially", false], [40186, 0.008407, " which", false]]], "qwen": [323, 1, 0.535361111164093, [[323, 0.535361, " and", false], [220, 0.107731, " ", false], [1576, 0.095174, " because", false], [438, 0.060538, " as", false], [1393, 0.013686, " while", false], [1496, 0.010414, " even", false], [4152, 0.009644, " due", false], [2474, 0.009604, " since", false], [304, 0.008119, " in", false], [773, 0.007076, " so", false]]]}, "raw_delta": 0.00395280122756958, "tuned_delta": 0.012524593258147828}, {"byte_start": 5415, "byte_end": 5417, "display": {"text": " 4", "kind": "normal"}, "is_word": true, "word_id": 914, "word_key": " 4", "bytes_hex": "20 34", "compression": {"rwkv": "1.51% 1.51%", "qwen": "2.80% 0.02%"}, "model_tokens": {"rwkv": [[287, " 4", "normal", 0.8443912863731384]], "qwen": [[220, " ", "normal", 0.8563111424446106], [19, "4", "normal", 0.9990171194076538]]}, "loss": {"rwkv": 1.514548016558238, "qwen": 1.407572999090544}, "topk": {"rwkv": [287, 1, 0.8443912863731384, [[287, 0.844391, " 4", false], [4600, 0.015825, " is", false], [32227, 0.010586, " that", false], [22590, 0.008069, " the", false], [51744, 0.007588, " finally", false], [61959, 0.006686, " eventually", false], [4601, 0.00656, " it", false], [45, 0.005482, ",", false], [30788, 0.004141, " even", false], [32234, 0.003679, " this", false]]], "qwen": [220, 1, 0.8563111424446106, [[220, 0.856311, " ", false], [429, 0.02449, " that", false], [374, 0.014326, " is", false], [304, 0.01074, " in", false], [279, 0.009291, " the", false], [5499, 0.005781, " finally", false], [11, 0.005532, ",", false], [432, 0.003642, " it", false], [3545, 0.002983, " often", false], [9583, 0.002595, " eventually", false]]]}, "raw_delta": 0.005931954539846629, "tuned_delta": 0.014503746570424877}, {"byte_start": 5417, "byte_end": 5418, "display": {"text": ")", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29", "compression": {"rwkv": "0.02%", "qwen": "0.01%"}, "model_tokens": {"rwkv": [[42, ")", "normal", 0.9990647435188293]], "qwen": [[8, ")", "normal", 0.9994415640830994]]}, "loss": {"rwkv": 0.016716713663865, "qwen": 0.010073219314950659}, "topk": {"rwkv": [42, 1, 0.9990647435188293, [[42, 0.999065, ")", false], [47, 0.000141, ".", false], [497, 0.000141, "),", false], [499, 0.00012, ").", false], [276, 0.00012, " )", false], [98, 6.4e-05, "a", false], [45, 4.3e-05, ",", false], [580, 3.9e-05, ".)", false], [22590, 3e-05, " the", false], [32227, 1.7e-05, " that", false]]], "qwen": [8, 1, 0.9994415640830994, [[8, 0.999442, ")", false], [701, 0.000149, "),", false], [11, 4.9e-05, ",", false], [64, 4.9e-05, "a", false], [873, 4.5e-05, " )", false], [568, 1.8e-05, ").", false], [13, 1.6e-05, ".", false], [6138, 1.3e-05, ".)", false], [323, 1.3e-05, " and", false], [692, 1.2e-05, ")\n\n", false]]]}, "raw_delta": 0.0003683935501612723, "tuned_delta": 0.00894018558073952}, {"byte_start": 5418, "byte_end": 5431, "display": {"text": " breakthrough", "kind": "normal"}, "is_word": true, "word_id": 915, "word_key": " breakthrough", "bytes_hex": "20 62 72 65 61 6b 74 68 72 6f 75 67 68", "compression": {"rwkv": "13.01% 13.01% 13.01% 13.01% 13.01% 13.01% 13.01% 13.01% 13.01% 13.01% 13.01% 13.01% 13.01%", "qwen": "12.14% 12.14% 12.14% 12.14% 12.14% 12.14% 12.14% 12.14% 12.14% 12.14% 12.14% 12.14% 12.14%"}, "model_tokens": {"rwkv": [[64266, " breakthrough", "normal", 8.692935080034658e-05]], "qwen": [[41345, " breakthrough", "normal", 0.00015804381109774113]]}, "loss": {"rwkv": 13.005063469551951, "qwen": 12.14171849988146}, "topk": {"rwkv": [64266, 358, 8.692935080034658e-05, [[22590, 0.210888, " the", false], [4601, 0.071538, " it", false], [4596, 0.059609, " in", false], [52028, 0.043644, " instead", false], [39934, 0.032084, " there", false], [52224, 0.030895, " methods", false], [32234, 0.029483, " this", false], [32465, 0.027287, " when", false], [332, 0.02339, " a", false], [32227, 0.02271, " that", false]]], "qwen": [41345, 300, 0.00015804381109774113, [[279, 0.178854, " the", false], [304, 0.09324, " in", false], [432, 0.061079, " it", false], [419, 0.046795, " this", false], [1052, 0.037482, " there", false], [979, 0.030111, " when", false], [438, 0.018218, " as", false], [582, 0.016687, " we", false], [429, 0.016293, " that", false], [20219, 0.015668, " Moore", false]]]}, "raw_delta": 0.04787401052621698, "tuned_delta": 0.05644580255679523}, {"byte_start": 5431, "byte_end": 5440, "display": {"text": " progress", "kind": "normal"}, "is_word": true, "word_id": 916, "word_key": " progress", "bytes_hex": "20 70 72 6f 67 72 65 73 73", "compression": {"rwkv": "5.01% 5.01% 5.01% 5.01% 5.01% 5.01% 5.01% 5.01% 5.01%", "qwen": "6.42% 6.42% 6.42% 6.42% 6.42% 6.42% 6.42% 6.42% 6.42%"}, "model_tokens": {"rwkv": [[56950, " progress", "normal", 0.08195258677005768]], "qwen": [[5098, " progress", "normal", 0.040597595274448395]]}, "loss": {"rwkv": 5.009357780864455, "qwen": 6.420086081581431}, "topk": {"rwkv": [56950, 2, 0.08195258677005768, [[116, 0.784498, "s", false], [56950, 0.081953, " progress", false], [52224, 0.054013, " methods", false], [63750, 0.008182, " performance", false], [64423, 0.008025, " improvements", false], [62633, 0.007093, " techniques", false], [57103, 0.006015, " research", false], [55465, 0.005452, " advances", false], [52738, 0.005396, " results", false], [61590, 0.004307, " approaches", false]]], "qwen": [5098, 2, 0.040597595274448395, [[82, 0.860475, "s", false], [5098, 0.040598, " progress", false], [5413, 0.019827, " methods", false], [3059, 0.011784, " results", false], [29903, 0.004517, " advances", false], [3412, 0.004024, " research", false], [18142, 0.003056, " improvements", false], [15235, 0.003025, " AI", false], [4041, 0.002972, " comes", false], [5068, 0.002947, " performance", false]]]}, "raw_delta": -0.07822738753424752, "tuned_delta": -0.06965559550366927}, {"byte_start": 5440, "byte_end": 5451, "display": {"text": " eventually", "kind": "normal"}, "is_word": true, "word_id": 917, "word_key": " eventually", "bytes_hex": "20 65 76 65 6e 74 75 61 6c 6c 79", "compression": {"rwkv": "11.12% 11.12% 11.12% 11.12% 11.12% 11.12% 11.12% 11.12% 11.12% 11.12% 11.12%", "qwen": "7.91% 7.91% 7.91% 7.91% 7.91% 7.91% 7.91% 7.91% 7.91% 7.91% 7.91%"}, "model_tokens": {"rwkv": [[61959, " eventually", "normal", 0.0011185797629877925]], "qwen": [[9583, " eventually", "normal", 0.008022933267056942]]}, "loss": {"rwkv": 11.117358802304864, "qwen": 7.910971326589175}, "topk": {"rwkv": [61959, 47, 0.0011185797629877925, [[4600, 0.260561, " is", false], [38087, 0.154675, " comes", false], [21800, 0.089359, " has", false], [4596, 0.076166, " in", false], [45150, 0.053771, " always", false], [21413, 0.050387, " can", false], [46697, 0.026159, " occurs", false], [45, 0.02253, ",", false], [51896, 0.020185, " happens", false], [45145, 0.019772, " almost", false]]], "qwen": [9583, 19, 0.008022933267056942, [[374, 0.216913, " is", false], [4041, 0.17991, " comes", false], [304, 0.122485, " in", false], [702, 0.053817, " has", false], [13666, 0.036241, " occurs", false], [2677, 0.034178, " always", false], [7460, 0.031665, " requires", false], [8573, 0.028992, " happens", false], [646, 0.028319, " can", false], [3545, 0.019932, " often", false]]]}, "raw_delta": 0.17779987508600412, "tuned_delta": 0.18637166711658237}, {"byte_start": 5451, "byte_end": 5459, "display": {"text": " arrives", "kind": "normal"}, "is_word": true, "word_id": 918, "word_key": " arrives", "bytes_hex": "20 61 72 72 69 76 65 73", "compression": {"rwkv": "9.09% 9.09% 9.09% 9.09% 9.09% 9.09% 9.09% 9.09%", "qwen": "8.48% 8.48% 8.48% 8.48% 8.48% 8.48% 8.48% 8.48%"}, "model_tokens": {"rwkv": [[50956, " arrives", "normal", 0.017871713265776634]], "qwen": [[29682, " arrives", "normal", 0.02329213172197342]]}, "loss": {"rwkv": 9.087288099349427, "qwen": 8.475021263145285}, "topk": {"rwkv": [50956, 7, 0.017871713265776634, [[38087, 0.660999, " comes", false], [46697, 0.061924, " occurs", false], [51896, 0.038454, " happens", false], [57102, 0.028955, " requires", false], [30659, 0.025431, " does", false], [4600, 0.018528, " is", false], [50956, 0.017872, " arrives", false], [45199, 0.009327, " arises", false], [51586, 0.008961, " emerges", false], [52738, 0.007925, " results", false]]], "qwen": [29682, 7, 0.02329213172197342, [[4041, 0.635852, " comes", false], [8573, 0.055551, " happens", false], [13666, 0.050596, " occurs", false], [7460, 0.040678, " requires", false], [3697, 0.023872, " came", false], [3059, 0.023389, " results", false], [29682, 0.023292, " arrives", false], [13798, 0.013052, " depends", false], [33644, 0.009571, " relies", false], [702, 0.009373, " has", false]]]}, "raw_delta": 0.0339512825012207, "tuned_delta": 0.04252307453179895}, {"byte_start": 5459, "byte_end": 5462, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 919, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "14.18% 14.18% 14.18%", "qwen": "13.84% 13.84% 13.84%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.09448861330747604]], "qwen": [[553, " by", "normal", 0.0999731495976448]]}, "loss": {"rwkv": 14.182744217072491, "qwen": 13.842981024782954}, "topk": {"rwkv": [4450, 3, 0.09448861330747604, [[32465, 0.256046, " when", false], [30917, 0.128342, " from", false], [4450, 0.094489, " by", false], [31581, 0.090725, " only", false], [53140, 0.079759, " through", false], [22705, 0.040717, " via", false], [32487, 0.039308, " with", false], [45, 0.035888, ",", false], [4596, 0.028899, " in", false], [32227, 0.028239, " that", false]]], "qwen": [553, 3, 0.0999731495976448, [[979, 0.241971, " when", false], [504, 0.153203, " from", false], [553, 0.099973, " by", false], [1526, 0.089356, " through", false], [11, 0.072803, ",", false], [304, 0.045917, " in", false], [1172, 0.044993, " only", false], [448, 0.036462, " with", false], [518, 0.023641, " at", false], [429, 0.023147, " that", false]]]}, "raw_delta": 0.018840471903483147, "tuned_delta": 0.027412263934061397}, {"byte_start": 5462, "byte_end": 5465, "display": {"text": " an", "kind": "normal"}, "is_word": true, "word_id": 920, "word_key": " an", "bytes_hex": "20 61 6e", "compression": {"rwkv": "33.81% 33.81% 33.81%", "qwen": "35.53% 35.53% 35.53%"}, "model_tokens": {"rwkv": [[4419, " an", "normal", 0.003557920688763261]], "qwen": [[458, " an", "normal", 0.0027115787379443645]]}, "loss": {"rwkv": 33.81316502083508, "qwen": 35.52771166208167}, "topk": {"rwkv": [4419, 44, 0.003557920688763261, [[38888, 0.094816, " lever", false], [40085, 0.070304, " using", false], [47497, 0.067727, " taking", false], [59611, 0.067172, " embracing", false], [38989, 0.049284, " means", false], [55666, 0.038724, " building", false], [332, 0.035454, " a", false], [46500, 0.0348, " making", false], [39193, 0.034005, " other", false], [55586, 0.02101, " avoiding", false]]], "qwen": [458, 61, 0.0027115787379443645, [[76482, 0.117065, " leveraging", false], [1667, 0.062866, " using", false], [55401, 0.034076, " embracing", false], [4752, 0.031185, " building", false], [18950, 0.026335, " applying", false], [264, 0.025556, " a", false], [4633, 0.025075, " taking", false], [77239, 0.025066, " abandoning", false], [7218, 0.022691, " moving", false], [4936, 0.022481, " simply", false]]]}, "raw_delta": -0.09507465362548828, "tuned_delta": -0.08650286159491004}, {"byte_start": 5465, "byte_end": 5474, "display": {"text": " opposing", "kind": "normal"}, "is_word": true, "word_id": 921, "word_key": " opposing", "bytes_hex": "20 6f 70 70 6f 73 69 6e 67", "compression": {"rwkv": "13.90% 13.90% 13.90% 13.90% 13.90% 13.90% 13.90% 13.90% 13.90%", "qwen": "17.69% 17.69% 17.69% 17.69% 17.69% 17.69% 17.69% 17.69% 17.69%"}, "model_tokens": {"rwkv": [[56766, " opposing", "normal", 0.0009504445479251444]], "qwen": [[30222, " opposing", "normal", 0.00014682918845210224]]}, "loss": {"rwkv": 13.900967841898863, "qwen": 17.685518689032}, "topk": {"rwkv": [56766, 55, 0.0009504445479251444, [[63277, 0.399267, " alternative", false], [56131, 0.25246, " entirely", false], [55532, 0.084354, " approach", false], [59121, 0.017096, " alternate", false], [56767, 0.014497, " opposite", false], [63627, 0.01305, " independent", false], [39193, 0.011962, " other", false], [62688, 0.008506, " unexpected", false], [37636, 0.006338, " agent", false], [63621, 0.00584, " improvement", false]]], "qwen": [30222, 267, 0.00014682918845210224, [[11368, 0.350579, " entirely", false], [5486, 0.224518, " approach", false], [10555, 0.062742, " alternative", false], [7373, 0.0206, " effective", false], [9489, 0.020104, " independent", false], [650, 0.017477, " un", false], [16500, 0.016767, " unexpected", false], [3766, 0.016207, " application", false], [30055, 0.015551, " altogether", false], [4558, 0.010551, " almost", false]]]}, "raw_delta": -0.20986005995008666, "tuned_delta": -0.2012882679195084}, {"byte_start": 5474, "byte_end": 5483, "display": {"text": " approach", "kind": "normal"}, "is_word": true, "word_id": 922, "word_key": " approach", "bytes_hex": "20 61 70 70 72 6f 61 63 68", "compression": {"rwkv": "4.20% 4.20% 4.20% 4.20% 4.20% 4.20% 4.20% 4.20% 4.20%", "qwen": "3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28%"}, "model_tokens": {"rwkv": [[55532, " approach", "normal", 0.1232675313949585]], "qwen": [[5486, " approach", "normal", 0.19462503492832184]]}, "loss": {"rwkv": 4.195337141473982, "qwen": 3.279487246561189}, "topk": {"rwkv": [55532, 2, 0.1232675313949585, [[39552, 0.302602, " route", false], [55532, 0.123268, " approach", false], [46561, 0.1229, " method", false], [31637, 0.07388, " path", false], [45, 0.073874, ",", false], [57317, 0.051959, " strategy", false], [38536, 0.035433, " force", false], [38989, 0.025893, " means", false], [59526, 0.019725, " direction", false], [51832, 0.016345, " general", false]]], "qwen": [5486, 2, 0.19462503492832184, [[6021, 0.198698, " route", false], [5486, 0.194625, " approach", false], [1714, 0.128327, " method", false], [3363, 0.111152, " means", false], [1815, 0.099305, " path", false], [11, 0.036819, ",", false], [5344, 0.02711, " force", false], [8282, 0.026197, " strategy", false], [16953, 0.015982, " mechanism", false], [1882, 0.014992, " process", false]]]}, "raw_delta": 0.050785501797994, "tuned_delta": 0.05935729382857225}, {"byte_start": 5483, "byte_end": 5489, "display": {"text": " based", "kind": "normal"}, "is_word": true, "word_id": 923, "word_key": " based", "bytes_hex": "20 62 61 73 65 64", "compression": {"rwkv": "10.61% 10.61% 10.61% 10.61% 10.61% 10.61%", "qwen": "11.40% 11.40% 11.40% 11.40% 11.40% 11.40%"}, "model_tokens": {"rwkv": [[37810, " based", "normal", 0.029513614252209663]], "qwen": [[3118, " based", "normal", 0.022526785731315613]]}, "loss": {"rwkv": 10.613576798206566, "qwen": 11.400447587510417}, "topk": {"rwkv": [37810, 5, 0.029513614252209663, [[32227, 0.381868, " that", false], [45, 0.224016, ",", false], [47, 0.123714, ".", false], [5346, 0.114852, "---", false], [37810, 0.029514, " based", false], [4706, 0.020603, " of", false], [59, 0.019219, ":", false], [4811, 0.013707, " to", false], [275, 0.01159, " (", false], [21265, 0.00929, " and", false]]], "qwen": [3118, 8, 0.022526785731315613, [[429, 0.246227, " that", false], [11, 0.240545, ",", false], [4421, 0.184119, "---", false], [13, 0.09639, ".", false], [25, 0.051621, ":", false], [315, 0.030846, " of", false], [382, 0.028947, ".\n\n", false], [3118, 0.022527, " based", false], [320, 0.021723, " (", false], [311, 0.01038, " to", false]]]}, "raw_delta": -0.04363338152567553, "tuned_delta": -0.03506158949509728}, {"byte_start": 5489, "byte_end": 5492, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 924, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"rwkv": "0.50% 0.50% 0.50%", "qwen": "0.40% 0.40% 0.40%"}, "model_tokens": {"rwkv": [[4712, " on", "normal", 0.9195689558982849]], "qwen": [[389, " on", "normal", 0.9363231658935547]]}, "loss": {"rwkv": 0.504849338852746, "qwen": 0.39550657634180847}, "topk": {"rwkv": [4712, 1, 0.9195689558982849, [[4712, 0.919569, " on", false], [31581, 0.01471, " only", false], [47330, 0.011791, " solely", false], [31458, 0.00854, " more", false], [46957, 0.007562, " purely", false], [22187, 0.00604, " not", false], [4596, 0.003631, " in", false], [52028, 0.003594, " instead", false], [56131, 0.003026, " entirely", false], [47285, 0.001941, " simply", false]]], "qwen": [389, 1, 0.9363231658935547, [[389, 0.936323, " on", false], [21063, 0.011515, " solely", false], [31127, 0.005355, " purely", false], [1172, 0.004652, " only", false], [537, 0.004412, " not", false], [803, 0.004253, " more", false], [304, 0.003795, " in", false], [11368, 0.003471, " entirely", false], [13771, 0.002031, " largely", false], [4558, 0.001982, " almost", false]]]}, "raw_delta": 0.00606325020392736, "tuned_delta": 0.014635042234505609}, {"byte_start": 5492, "byte_end": 5500, "display": {"text": " scaling", "kind": "normal"}, "is_word": true, "word_id": 925, "word_key": " scaling", "bytes_hex": "20 73 63 61 6c 69 6e 67", "compression": {"rwkv": "15.78% 15.78% 15.78% 15.78% 15.78% 15.78% 15.78% 15.78%", "qwen": "12.54% 12.54% 12.54% 12.54% 12.54% 12.54% 12.54% 12.54%"}, "model_tokens": {"rwkv": [[52805, " scaling", "normal", 0.0008995500393211842]], "qwen": [[26943, " scaling", "normal", 0.003844857681542635]]}, "loss": {"rwkv": 15.779477009723035, "qwen": 12.535710082016466}, "topk": {"rwkv": [52805, 51, 0.0008995500393211842, [[52195, 0.47432, " massive", false], [63370, 0.151678, " computation", false], [59988, 0.039656, " massively", false], [38888, 0.027267, " lever", false], [22590, 0.026972, " the", false], [47202, 0.024024, " search", false], [51832, 0.022338, " general", false], [31458, 0.013133, " more", false], [332, 0.012098, " a", false], [31466, 0.011167, " much", false]]], "qwen": [26943, 27, 0.003844857681542635, [[76482, 0.224468, " leveraging", false], [34447, 0.194775, " computation", false], [10951, 0.113851, " massive", false], [279, 0.040022, " the", false], [63707, 0.024968, " massively", false], [2711, 0.022049, " search", false], [32064, 0.02161, " leverage", false], [4586, 0.019638, " general", false], [6832, 0.014682, " learning", false], [54480, 0.013875, " computational", false]]]}, "raw_delta": 0.17987263202667236, "tuned_delta": 0.18844442405725062}, {"byte_start": 5500, "byte_end": 5512, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 926, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "1.51% 1.51% 1.51% 1.51% 1.51% 1.51% 1.51% 1.51% 1.51% 1.51% 1.51% 1.51%", "qwen": "2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.3625050485134125]], "qwen": [[34447, " computation", "normal", 0.1930505931377411]]}, "loss": {"rwkv": 1.514548016558238, "qwen": 2.471822082714474}, "topk": {"rwkv": [63370, 2, 0.3625050485134125, [[4833, 0.368705, " up", false], [63370, 0.362505, " computation", false], [21265, 0.043918, " and", false], [45, 0.027719, ",", false], [52195, 0.02201, " massive", false], [47, 0.017585, ".", false], [4706, 0.012807, " of", false], [64862, 0.011428, " computational", false], [22590, 0.010869, " the", false], [46, 0.008844, "-", false]]], "qwen": [34447, 2, 0.1930505931377411, [[705, 0.524018, " up", false], [34447, 0.193051, " computation", false], [5239, 0.053742, "-up", false], [279, 0.033484, " the", false], [63707, 0.019079, " massively", false], [323, 0.01254, " and", false], [700, 0.010937, " out", false], [990, 0.010724, " use", false], [315, 0.010249, " of", false], [10951, 0.009639, " massive", false]]]}, "raw_delta": -0.05308254559834801, "tuned_delta": -0.04451075356776976}, {"byte_start": 5512, "byte_end": 5515, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 927, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "26.30% 26.30% 26.30%", "qwen": "23.53% 23.53% 23.53%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.012551532126963139]], "qwen": [[553, " by", "normal", 0.019953183829784393]]}, "loss": {"rwkv": 26.299128349538393, "qwen": 23.530156075851913}, "topk": {"rwkv": [4450, 10, 0.012551532126963139, [[21265, 0.341814, " and", false], [47, 0.206012, ".", false], [45, 0.134494, ",", false], [4811, 0.054574, " to", false], [4833, 0.028509, " up", false], [275, 0.020292, " (", false], [4596, 0.020291, " in", false], [47001, 0.020043, " rather", false], [5346, 0.017119, "---", false], [4450, 0.012552, " by", false]]], "qwen": [553, 8, 0.019953183829784393, [[13, 0.347101, ".", false], [382, 0.137095, ".\n\n", false], [11, 0.105796, ",", false], [311, 0.075456, " to", false], [323, 0.055648, " and", false], [705, 0.049668, " up", false], [4421, 0.022753, "---", false], [553, 0.019953, " by", false], [320, 0.015454, " (", false], [4751, 0.014441, " rather", false]]]}, "raw_delta": 0.15354442596435547, "tuned_delta": 0.16211621799493373}, {"byte_start": 5515, "byte_end": 5522, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 928, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "11.67% 11.67% 11.67% 11.67% 11.67% 11.67% 11.67%", "qwen": "17.54% 17.54% 17.54% 17.54% 17.54% 17.54% 17.54%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.010901223868131638]], "qwen": [[2711, " search", "normal", 0.001106332871131599]]}, "loss": {"rwkv": 11.673592685764493, "qwen": 17.53571224553878}, "topk": {"rwkv": [47202, 12, 0.010901223868131638, [[37045, 0.371462, " Moore", false], [52195, 0.17144, " massive", false], [332, 0.047983, " a", false], [59988, 0.040987, " massively", false], [38888, 0.038125, " lever", false], [40085, 0.022373, " using", false], [46718, 0.016342, " orders", false], [22590, 0.014957, " the", false], [51832, 0.013006, " general", false], [38989, 0.012471, " means", false]]], "qwen": [2711, 77, 0.001106332871131599, [[20219, 0.245247, " Moore", false], [264, 0.113989, " a", false], [76482, 0.085343, " leveraging", false], [279, 0.025898, " the", false], [63707, 0.024991, " massively", false], [10951, 0.02362, " massive", false], [1667, 0.023573, " using", false], [803, 0.022908, " more", false], [10163, 0.020346, " orders", false], [458, 0.019338, " an", false]]]}, "raw_delta": -0.3250649315970285, "tuned_delta": -0.31649313956645025}, {"byte_start": 5522, "byte_end": 5526, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 929, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "3.73% 3.73% 3.73% 3.73%", "qwen": "1.60% 1.60% 1.60% 1.60%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.4349638819694519]], "qwen": [[323, " and", "normal", 0.7012136578559875]]}, "loss": {"rwkv": 3.7335369710505395, "qwen": 1.600231116832549}, "topk": {"rwkv": [21265, 1, 0.4349638819694519, [[21265, 0.434964, " and", false], [4715, 0.385931, " or", false], [45, 0.078134, ",", false], [47, 0.034275, ".", false], [275, 0.02465, " (", false], [48, 0.009226, "/", false], [5346, 0.004794, "---", false], [4596, 0.004341, " in", false], [52224, 0.002546, " methods", false], [4811, 0.001489, " to", false]]], "qwen": [323, 1, 0.7012136578559875, [[323, 0.701214, " and", false], [476, 0.160536, " or", false], [11, 0.06367, ",", false], [13, 0.02418, ".", false], [320, 0.011431, " (", false], [382, 0.009288, ".\n\n", false], [9777, 0.003663, "-and", false], [5413, 0.003568, " methods", false], [5980, 0.002035, "-based", false], [4421, 0.001439, "---", false]]]}, "raw_delta": 0.1182955950498581, "tuned_delta": 0.12686738708043635}, {"byte_start": 5526, "byte_end": 5535, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 930, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "0.90% 0.90% 0.90% 0.90% 0.90% 0.90% 0.90% 0.90% 0.90%", "qwen": "0.42% 0.42% 0.42% 0.42% 0.42% 0.42% 0.42% 0.42% 0.42%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.6373797059059143]], "qwen": [[6832, " learning", "normal", 0.8108955025672913]]}, "loss": {"rwkv": 0.9040325370153822, "qwen": 0.4200167166734307}, "topk": {"rwkv": [56537, 1, 0.6373797059059143, [[56537, 0.63738, " learning", false], [48, 0.146796, "/", false], [4450, 0.081643, " by", false], [31978, 0.01792, " self", false], [38888, 0.013293, " lever", false], [62577, 0.009892, " statistics", false], [63885, 0.008487, " statistical", false], [45, 0.005723, ",", false], [32230, 0.004032, " then", false], [22590, 0.003748, " the", false]]], "qwen": [6832, 1, 0.8108955025672913, [[6832, 0.810896, " learning", false], [5144, 0.053234, "/or", false], [553, 0.026637, " by", false], [76482, 0.009203, " leveraging", false], [389, 0.00778, " on", false], [5538, 0.007117, " deep", false], [5662, 0.006245, " machine", false], [1008, 0.004239, " other", false], [656, 0.004126, " self", false], [1221, 0.004103, " then", false]]]}, "raw_delta": 0.026839536097314626, "tuned_delta": 0.035411328127892876}, {"byte_start": 5535, "byte_end": 5536, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "10.57%", "qwen": "10.93%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.5536013841629028]], "qwen": [[13, ".", "normal", 0.5454769134521484]]}, "loss": {"rwkv": 10.566614069010962, "qwen": 10.930124124115569}, "topk": {"rwkv": [47, 1, 0.5536013841629028, [[47, 0.553601, ".", false], [45, 0.187041, ",", false], [5346, 0.050885, "---", false], [4450, 0.040365, " by", false], [21265, 0.031979, " and", false], [275, 0.019057, " (", false], [4596, 0.01244, " in", false], [4712, 0.008232, " on", false], [4811, 0.007784, " to", false], [47001, 0.007466, " rather", false]]], "qwen": [13, 1, 0.5454769134521484, [[13, 0.545477, ".", false], [382, 0.178999, ".\n\n", false], [11, 0.11097, ",", false], [320, 0.025356, " (", false], [624, 0.016818, ".\n", false], [5413, 0.016496, " methods", false], [4421, 0.014729, "---", false], [323, 0.010313, " and", false], [12538, 0.008433, " techniques", false], [4751, 0.006221, " rather", false]]]}, "raw_delta": -0.020157277584075928, "tuned_delta": -0.01158548555349768}, {"byte_start": 5536, "byte_end": 5540, "display": {"text": " The", "kind": "normal"}, "is_word": true, "word_id": 931, "word_key": " the", "bytes_hex": "20 54 68 65", "compression": {"rwkv": "11.69% 11.69% 11.69% 11.69%", "qwen": "8.76% 8.76% 8.76% 8.76%"}, "model_tokens": {"rwkv": [[20996, " The", "normal", 0.07541705667972565]], "qwen": [[576, " The", "normal", 0.14312496781349182]]}, "loss": {"rwkv": 11.693719569705465, "qwen": 8.76454008228244}, "topk": {"rwkv": [20996, 2, 0.07541705667972565, [[261, 0.52264, "\n\n", false], [20996, 0.075417, " The", false], [29894, 0.042126, " This", false], [4331, 0.03552, " We", false], [267, 0.034, "  ", false], [3913, 0.02105, " In", false], [3918, 0.017224, " It", false], [3336, 0.013511, " \n\n", false], [37453, 0.013192, " These", false], [4255, 0.012783, " To", false]]], "qwen": [576, 2, 0.14312496781349182, [[220, 0.151022, " ", false], [576, 0.143125, " The", false], [1096, 0.06928, " This", false], [1205, 0.054866, " We", false], [1084, 0.044859, " It", false], [4220, 0.043008, " These", false], [758, 0.041557, " In", false], [2014, 0.022343, " To", false], [2619, 0.02132, " There", false], [1634, 0.01157, " As", false]]]}, "raw_delta": 0.16242820024490356, "tuned_delta": 0.17099999227548182}, {"byte_start": 5540, "byte_end": 5549, "display": {"text": " eventual", "kind": "normal"}, "is_word": true, "word_id": 932, "word_key": " eventual", "bytes_hex": "20 65 76 65 6e 74 75 61 6c", "compression": {"rwkv": "16.28% 16.28% 16.28% 16.28% 16.28% 16.28% 16.28% 16.28% 16.28%", "qwen": "14.95% 14.95% 14.95% 14.95% 14.95% 14.95% 14.95% 14.95% 14.95%"}, "model_tokens": {"rwkv": [[56154, " eventual", "normal", 0.00029455721960403025]], "qwen": [[41735, " eventual", "normal", 0.0005762152140960097]]}, "loss": {"rwkv": 16.28041278780948, "qwen": 14.945978379663178}, "topk": {"rwkv": [56154, 332, 0.00029455721960403025, [[45315, 0.201228, " bitter", false], [46430, 0.107066, " lesson", false], [47009, 0.022126, " reason", false], [45184, 0.021001, " appeal", false], [21952, 0.020405, " key", false], [52127, 0.015971, " lessons", false], [38499, 0.013635, " first", false], [31461, 0.012251, " most", false], [21365, 0.011016, " bit", false], [62061, 0.009609, " historical", false]]], "qwen": [41735, 191, 0.0005762152140960097, [[25180, 0.315766, " bitter", false], [17755, 0.034954, " lesson", false], [78996, 0.024005, " bitterness", false], [1376, 0.015684, " key", false], [1429, 0.014092, " most", false], [1156, 0.013176, " first", false], [1172, 0.011851, " only", false], [2874, 0.009096, " reason", false], [1293, 0.00799, " long", false], [1537, 0.007683, " last", false]]]}, "raw_delta": 0.07399675581190324, "tuned_delta": 0.08256854784248148}, {"byte_start": 5549, "byte_end": 5557, "display": {"text": " success", "kind": "normal"}, "is_word": true, "word_id": 933, "word_key": " success", "bytes_hex": "20 73 75 63 63 65 73 73", "compression": {"rwkv": "4.61% 4.61% 4.61% 4.61% 4.61% 4.61% 4.61% 4.61%", "qwen": "7.22% 7.22% 7.22% 7.22% 7.22% 7.22% 7.22% 7.22%"}, "model_tokens": {"rwkv": [[53052, " success", "normal", 0.1292545348405838]], "qwen": [[2393, " success", "normal", 0.04058763012290001]]}, "loss": {"rwkv": 4.61408814346812, "qwen": 7.22314987349079}, "topk": {"rwkv": [53052, 1, 0.1292545348405838, [[53052, 0.129255, " success", false], [64266, 0.089544, " breakthrough", false], [57260, 0.039538, " solution", false], [47798, 0.032321, " winner", false], [53198, 0.026578, " triumph", false], [7933, 0.026454, "ity", false], [56950, 0.022981, " progress", false], [46430, 0.018824, " lesson", false], [53283, 0.017154, " victory", false], [52382, 0.015983, " outcome", false]]], "qwen": [2393, 4, 0.04058763012290001, [[41345, 0.226281, " breakthrough", false], [5486, 0.093374, " approach", false], [37486, 0.045089, " triumph", false], [2393, 0.040588, " success", false], [5098, 0.026488, " progress", false], [18647, 0.015863, " arrival", false], [13632, 0.015807, " winner", false], [15274, 0.014492, " outcome", false], [48079, 0.012363, " emergence", false], [12560, 0.011613, " victory", false]]]}, "raw_delta": -0.14467710256576538, "tuned_delta": -0.13610531053518712}, {"byte_start": 5557, "byte_end": 5560, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 934, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "17.09% 17.09% 17.09%", "qwen": "18.80% 18.80% 18.80%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.05810806155204773]], "qwen": [[374, " is", "normal", 0.04383223131299019]]}, "loss": {"rwkv": 17.094433427199956, "qwen": 18.799433598134907}, "topk": {"rwkv": [4600, 2, 0.05810806155204773, [[4706, 0.784938, " of", false], [4600, 0.058108, " is", false], [4596, 0.0279, " in", false], [38087, 0.012747, " comes", false], [45, 0.007718, ",", false], [51434, 0.007197, " depends", false], [32475, 0.0068, " will", false], [4450, 0.006312, " by", false], [21800, 0.00585, " has", false], [22748, 0.004845, " was", false]]], "qwen": [374, 3, 0.04383223131299019, [[315, 0.707315, " of", false], [304, 0.068246, " in", false], [374, 0.043832, " is", false], [702, 0.016581, " has", false], [553, 0.014604, " by", false], [572, 0.013944, " was", false], [429, 0.013445, " that", false], [448, 0.01158, " with", false], [11, 0.009154, ",", false], [4041, 0.008134, " comes", false]]]}, "raw_delta": -0.09454528490702307, "tuned_delta": -0.08597349287644483}, {"byte_start": 5560, "byte_end": 5565, "display": {"text": " ting", "kind": "normal"}, "is_word": true, "word_id": 935, "word_key": " ting", "bytes_hex": "20 74 69 6e 67", "compression": {"rwkv": "49.59% 49.59% 49.59% 49.59% 49.59%", "qwen": "39.10% 39.10% 39.10% 39.10% 39.10%"}, "model_tokens": {"rwkv": [[32252, " ting", "normal", 1.0751234640338225e-06]], "qwen": [[42227, " ting", "normal", 1.9561890439945273e-05]]}, "loss": {"rwkv": 49.59264203055811, "qwen": 39.103987697183264}, "topk": {"rwkv": [32252, 4981, 1.0751234640338225e-06, [[37810, 0.134978, " based", false], [22187, 0.130543, " not", false], [21572, 0.056394, " due", false], [45150, 0.056135, " always", false], [332, 0.044849, " a", false], [22590, 0.039081, " the", false], [4596, 0.016419, " in", false], [4450, 0.014284, " by", false], [62109, 0.01383, " inevitable", false], [39171, 0.012576, " often", false]]], "qwen": [42227, 1268, 1.9561890439945273e-05, [[3118, 0.144691, " based", false], [537, 0.08893, " not", false], [4152, 0.060983, " due", false], [2677, 0.049161, " always", false], [264, 0.041665, " a", false], [3545, 0.040587, " often", false], [16994, 0.029664, " achieved", false], [553, 0.027469, " by", false], [279, 0.026745, " the", false], [304, 0.019998, " in", false]]]}, "raw_delta": 0.5816144943237305, "tuned_delta": 0.5901862863543087}, {"byte_start": 5565, "byte_end": 5567, "display": {"text": "ed", "kind": "normal"}, "is_word": true, "word_id": 936, "word_key": "ed", "bytes_hex": "65 64", "compression": {"rwkv": "0.01% 0.01%", "qwen": "0.01% 0.01%"}, "model_tokens": {"rwkv": [[1843, "ed", "normal", 0.9993645548820496]], "qwen": [[291, "ed", "normal", 0.9991808533668518]]}, "loss": {"rwkv": 0.005744220538817808, "qwen": 0.007389000931368411}, "topk": {"rwkv": [1843, 1, 0.9993645548820496, [[1843, 0.999365, "ed", false], [1858, 0.000125, "es", false], [25206, 0.000118, "eing", false], [102, 0.000106, "e", false], [8067, 7.6e-05, "led", false], [7856, 4.4e-05, "ing", false], [2030, 2.7e-05, "ly", false], [101, 1.7e-05, "d", false], [26151, 1.4e-05, "ling", false], [116, 1.2e-05, "s", false]]], "qwen": [291, 1, 0.9991808533668518, [[291, 0.999181, "ed", false], [2718, 0.000341, "ling", false], [832, 0.000193, "led", false], [3556, 4.4e-05, "ged", false], [75, 2.1e-05, "l", false], [1151, 1.4e-05, "red", false], [12336, 1.2e-05, "ered", false], [3018, 1.2e-05, "ored", false], [3260, 9e-06, "ued", false], [2181, 8e-06, "iled", false]]]}, "raw_delta": -9.120599133893847e-05, "tuned_delta": 0.00848058603923931}, {"byte_start": 5567, "byte_end": 5572, "display": {"text": " with", "kind": "normal"}, "is_word": true, "word_id": 937, "word_key": " with", "bytes_hex": "20 77 69 74 68", "compression": {"rwkv": "0.46% 0.46% 0.46% 0.46% 0.46%", "qwen": "0.47% 0.47% 0.47% 0.47% 0.47%"}, "model_tokens": {"rwkv": [[32487, " with", "normal", 0.8810338377952576]], "qwen": [[448, " with", "normal", 0.8772037029266357]]}, "loss": {"rwkv": 0.4578866096571417, "qwen": 0.47254039142390725}, "topk": {"rwkv": [32487, 1, 0.8810338377952576, [[32487, 0.881034, " with", false], [4450, 0.08964, " by", false], [45, 0.007895, ",", false], [4596, 0.005228, " in", false], [332, 0.00273, " a", false], [57263, 0.002144, " somewhat", false], [57245, 0.001472, " slightly", false], [4706, 0.000865, " of", false], [22187, 0.000576, " not", false], [30322, 0.000513, " both", false]]], "qwen": [448, 1, 0.8772037029266357, [[448, 0.877204, " with", false], [553, 0.096491, " by", false], [11, 0.009353, ",", false], [304, 0.002796, " in", false], [264, 0.001064, " a", false], [537, 0.001013, " not", false], [14400, 0.000839, " somewhat", false], [315, 0.000753, " of", false], [311, 0.000588, " to", false], [320, 0.000395, " (", false]]]}, "raw_delta": -0.0008125782012939446, "tuned_delta": 0.007759213829284304}, {"byte_start": 5572, "byte_end": 5583, "display": {"text": " bitterness", "kind": "normal"}, "is_word": true, "word_id": 938, "word_key": " bitterness", "bytes_hex": "20 62 69 74 74 65 72 6e 65 73 73", "compression": {"rwkv": "3.16% 3.16% 3.16% 3.16% 3.16% 3.16% 3.16% 3.16% 3.16% 3.16% 3.16%", "qwen": "1.50% 1.50% 1.50% 1.50% 1.50% 1.50% 1.50% 1.50% 1.50% 1.50% 1.50%"}, "model_tokens": {"rwkv": [[61640, " bitterness", "normal", 0.14697323739528656]], "qwen": [[78996, " bitterness", "normal", 0.40061235427856445]]}, "loss": {"rwkv": 3.1635802121766146, "qwen": 1.4996831456310211}, "topk": {"rwkv": [61640, 2, 0.14697323739528656, [[332, 0.148044, " a", false], [61640, 0.146973, " bitterness", false], [22590, 0.103511, " the", false], [45315, 0.088484, " bitter", false], [52793, 0.071181, " sadness", false], [47048, 0.04781, " regret", false], [38805, 0.041348, " irony", false], [65126, 0.040868, " disappointment", false], [53178, 0.034561, " tragedy", false], [63588, 0.019909, " frustration", false]]], "qwen": [78996, 1, 0.40061235427856445, [[78996, 0.400612, " bitterness", false], [50878, 0.184147, " sadness", false], [22231, 0.077142, " regret", false], [264, 0.058002, " a", false], [25180, 0.050059, " bitter", false], [279, 0.027139, " the", false], [50605, 0.026256, " irony", false], [40598, 0.02382, " disappointment", false], [57496, 0.012962, " sorrow", false], [86063, 0.007106, " melanch", false]]]}, "raw_delta": 0.09226604483344338, "tuned_delta": 0.10083783686402162}, {"byte_start": 5583, "byte_end": 5584, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "17.33%", "qwen": "22.51%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.38802972435951233]], "qwen": [[11, ",", "normal", 0.28709185123443604]]}, "loss": {"rwkv": 17.329247073177978, "qwen": 22.50519823744862}, "topk": {"rwkv": [45, 1, 0.38802972435951233, [[45, 0.38803, ",", false], [51018, 0.203718, " because", false], [21700, 0.081682, " for", false], [47, 0.058162, ".", false], [4423, 0.036781, " as", false], [5346, 0.032045, "---", false], [32227, 0.026848, " that", false], [21265, 0.025683, " and", false], [4596, 0.022714, " in", false], [59, 0.020702, ":", false]]], "qwen": [11, 2, 0.28709185123443604, [[1576, 0.375146, " because", false], [11, 0.287092, ",", false], [553, 0.066923, " by", false], [13, 0.044343, ".", false], [369, 0.032616, " for", false], [323, 0.026326, " and", false], [438, 0.023125, " as", false], [382, 0.015253, ".\n\n", false], [518, 0.013712, " at", false], [304, 0.013023, " in", false]]]}, "raw_delta": -0.2870156764984131, "tuned_delta": -0.27844388446783486}, {"byte_start": 5584, "byte_end": 5588, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 939, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "12.61% 12.61% 12.61% 12.61%", "qwen": "9.34% 9.34% 9.34% 9.34%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.061159905046224594]], "qwen": [[323, " and", "normal", 0.1260937601327896]]}, "loss": {"rwkv": 12.609492789019747, "qwen": 9.335722412978594}, "topk": {"rwkv": [21265, 4, 0.061159905046224594, [[51018, 0.275527, " because", false], [21400, 0.27325, " but", false], [4423, 0.179361, " as", false], [21265, 0.06116, " and", false], [21700, 0.025996, " for", false], [4596, 0.025641, " in", false], [39690, 0.025492, " since", false], [22187, 0.016954, " not", false], [40186, 0.0074, " which", false], [4706, 0.006747, " of", false]]], "qwen": [323, 3, 0.1260937601327896, [[1576, 0.302206, " because", false], [438, 0.175248, " as", false], [323, 0.126094, " and", false], [714, 0.084405, " but", false], [369, 0.046944, " for", false], [537, 0.036781, " not", false], [2474, 0.03465, " since", false], [892, 0.015301, " which", false], [304, 0.013924, " in", false], [773, 0.010399, " so", false]]]}, "raw_delta": 0.18153637647628784, "tuned_delta": 0.1901081685068661}, {"byte_start": 5588, "byte_end": 5594, "display": {"text": " often", "kind": "normal"}, "is_word": true, "word_id": 940, "word_key": " often", "bytes_hex": "20 6f 66 74 65 6e", "compression": {"rwkv": "15.31% 15.31% 15.31% 15.31% 15.31% 15.31%", "qwen": "11.66% 11.66% 11.66% 11.66% 11.66% 11.66%"}, "model_tokens": {"rwkv": [[39171, " often", "normal", 0.0061404891312122345]], "qwen": [[3545, " often", "normal", 0.020638203248381615]]}, "loss": {"rwkv": 15.309849717766994, "qwen": 11.663622605804472}, "topk": {"rwkv": [39171, 27, 0.0061404891312122345, [[22590, 0.157922, " the", false], [4601, 0.092219, " it", false], [4858, 0.064718, " we", false], [4600, 0.05719, " is", false], [32234, 0.048891, " this", false], [32227, 0.028623, " that", false], [63843, 0.028011, " researchers", false], [4788, 0.023514, " so", false], [39934, 0.0213, " there", false], [4596, 0.017706, " in", false]]], "qwen": [3545, 9, 0.020638203248381615, [[279, 0.181648, " the", false], [419, 0.066944, " this", false], [432, 0.062067, " it", false], [374, 0.05647, " is", false], [582, 0.040288, " we", false], [429, 0.040272, " that", false], [773, 0.023409, " so", false], [264, 0.021673, " a", false], [3545, 0.020638, " often", false], [304, 0.019978, " in", false]]]}, "raw_delta": 0.20218976338704434, "tuned_delta": 0.2107615554176226}, {"byte_start": 5594, "byte_end": 5607, "display": {"text": " incompletely", "kind": "normal"}, "is_word": true, "word_id": 941, "word_key": " incompletely", "bytes_hex": "20 69 6e 63 6f 6d 70 6c 65 74 65 6c 79", "compression": {"rwkv": "13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 12.33% 12.33%", "qwen": "25.61% 25.61% 25.61% 25.61% 25.61% 25.61% 10.83% 10.83% 10.83% 10.83% 10.83% 10.83% 10.83%"}, "model_tokens": {"rwkv": [[62091, " incomplete", "normal", 0.0003408551274333149], [2030, "ly", "normal", 0.25676867365837097]], "qwen": [[52890, " incom", "normal", 0.00019925166270695627], [49168, "pletely", "normal", 0.014954663813114166]]}, "loss": {"rwkv": 12.994225916660662, "qwen": 17.650366464151663}, "topk": {"rwkv": [62091, 280, 0.0003408551274333149, [[32487, 0.058794, " with", false], [22590, 0.058553, " the", false], [56501, 0.050013, " involves", false], [4600, 0.035464, " is", false], [4601, 0.030968, " it", false], [332, 0.026724, " a", false], [38087, 0.02284, " comes", false], [38875, 0.02024, " leads", false], [63843, 0.018899, " researchers", false], [39934, 0.018716, " there", false]]], "qwen": [52890, 448, 0.00019925166270695627, [[448, 0.113979, " with", false], [279, 0.073731, " the", false], [374, 0.044957, " is", false], [23943, 0.031305, " accompanied", false], [4041, 0.030687, " comes", false], [432, 0.024818, " it", false], [11811, 0.020573, " researchers", false], [264, 0.018769, " a", false], [11508, 0.015304, " leads", false], [17601, 0.013093, " involves", false]]]}, "raw_delta": -0.2581912554227388, "tuned_delta": -0.24961946339216054}, {"byte_start": 5607, "byte_end": 5616, "display": {"text": " digested", "kind": "normal"}, "is_word": true, "word_id": 942, "word_key": " digested", "bytes_hex": "20 64 69 67 65 73 74 65 64", "compression": {"rwkv": "15.94% 15.94% 15.94% 15.94% 15.94% 15.94% 15.94% 0.06% 0.06%", "qwen": "40.72% 40.72% 40.72% 40.72% 0.00% 0.00% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[45746, " digest", "normal", 0.0020771108102053404], [1843, "ed", "normal", 0.9938040971755981]], "qwen": [[4078, " dig", "normal", 0.00011939474643440917], [9980, "ested", "normal", 0.9998053908348083]]}, "loss": {"rwkv": 12.410757281356057, "qwen": 18.100352509323848}, "topk": {"rwkv": [45746, 26, 0.0020771108102053404, [[62684, 0.53488, " understood", false], [63289, 0.202622, " appreciated", false], [62438, 0.040571, " recognized", false], [64238, 0.017612, " acknowledged", false], [57027, 0.015666, " realized", false], [55428, 0.01557, " accepted", false], [52112, 0.011024, " learned", false], [38625, 0.010959, " grasp", false], [4788, 0.007556, " so", false], [45, 0.006183, ",", false]]], "qwen": [4078, 214, 0.00011939474643440917, [[15985, 0.482853, " understood", false], [25498, 0.044029, " acknowledged", false], [9498, 0.037975, " learned", false], [14975, 0.036413, " recognized", false], [25808, 0.033701, " appreciated", false], [11247, 0.031423, " explained", false], [773, 0.02678, " so", false], [15043, 0.024798, " realized", false], [34416, 0.021106, " justified", false], [26471, 0.019687, " remembered", false]]]}, "raw_delta": -0.31549815126345493, "tuned_delta": -0.3069263592328767}, {"byte_start": 5616, "byte_end": 5617, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "17.47%", "qwen": "27.08%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.3821512460708618]], "qwen": [[11, ",", "normal", 0.22278772294521332]]}, "loss": {"rwkv": 17.47013526076479, "qwen": 27.07822767280638}, "topk": {"rwkv": [45, 1, 0.3821512460708618, [[45, 0.382151, ",", false], [4450, 0.263127, " by", false], [47, 0.176273, ".", false], [4596, 0.023382, " in", false], [5346, 0.018755, "---", false], [21265, 0.012854, " and", false], [32465, 0.012324, " when", false], [40076, 0.010249, " until", false], [4423, 0.009236, " as", false], [4424, 0.008984, " at", false]]], "qwen": [11, 2, 0.22278772294521332, [[553, 0.285165, " by", false], [11, 0.222788, ",", false], [13, 0.206131, ".", false], [382, 0.079159, ".\n\n", false], [304, 0.021819, " in", false], [518, 0.019729, " at", false], [323, 0.017123, " and", false], [369, 0.011375, " for", false], [438, 0.010354, " as", false], [476, 0.010326, " or", false]]]}, "raw_delta": -0.5327857732772827, "tuned_delta": -0.5242139812467045}, {"byte_start": 5617, "byte_end": 5625, "display": {"text": " because", "kind": "normal"}, "is_word": true, "word_id": 943, "word_key": " because", "bytes_hex": "20 62 65 63 61 75 73 65", "compression": {"rwkv": "3.66% 3.66% 3.66% 3.66% 3.66% 3.66% 3.66% 3.66%", "qwen": "3.01% 3.01% 3.01% 3.01% 3.01% 3.01% 3.01% 3.01%"}, "model_tokens": {"rwkv": [[51018, " because", "normal", 0.19768062233924866]], "qwen": [[1576, " because", "normal", 0.26296961307525635]]}, "loss": {"rwkv": 3.6630928772571334, "qwen": 3.0109873348721896}, "topk": {"rwkv": [51018, 2, 0.19768062233924866, [[21400, 0.39533, " but", false], [51018, 0.197681, " because", false], [4423, 0.095918, " as", false], [21265, 0.050934, " and", false], [4450, 0.050033, " by", false], [21700, 0.022768, " for", false], [4788, 0.01819, " so", false], [4596, 0.017289, " in", false], [32465, 0.014035, " when", false], [30788, 0.012179, " even", false]]], "qwen": [1576, 1, 0.26296961307525635, [[1576, 0.26297, " because", false], [714, 0.15885, " but", false], [438, 0.139906, " as", false], [323, 0.089964, " and", false], [553, 0.056858, " by", false], [369, 0.040796, " for", false], [773, 0.025334, " so", false], [2474, 0.021178, " since", false], [304, 0.01481, " in", false], [1496, 0.012878, " even", false]]]}, "raw_delta": 0.036160409450531006, "tuned_delta": 0.044732201481109256}, {"byte_start": 5625, "byte_end": 5628, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 944, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "9.77% 9.77% 9.77%", "qwen": "9.17% 9.17% 9.17%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.19962885975837708]], "qwen": [[432, " it", "normal", 0.2176695615053177]]}, "loss": {"rwkv": 9.768247672685687, "qwen": 9.165785280769484}, "topk": {"rwkv": [4601, 2, 0.19962885975837708, [[22590, 0.319802, " the", false], [4601, 0.199629, " it", false], [4706, 0.09383, " of", false], [4858, 0.073552, " we", false], [63843, 0.061128, " researchers", false], [284, 0.019924, " 1", false], [39934, 0.014404, " there", false], [46787, 0.00946, " people", false], [332, 0.009233, " a", false], [3609, 0.009022, " AI", false]]], "qwen": [432, 2, 0.2176695615053177, [[279, 0.285832, " the", false], [432, 0.21767, " it", false], [315, 0.098557, " of", false], [11811, 0.038652, " researchers", false], [582, 0.033831, " we", false], [220, 0.029431, " ", false], [1052, 0.021834, " there", false], [304, 0.018553, " in", false], [11, 0.010721, ",", false], [1429, 0.00928, " most", false]]]}, "raw_delta": 0.0334076086680094, "tuned_delta": 0.04197940069858765}, {"byte_start": 5628, "byte_end": 5631, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 945, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "7.51% 7.51% 7.51%", "qwen": "7.18% 7.18% 7.18%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.2882640063762665]], "qwen": [[374, " is", "normal", 0.3027406334877014]]}, "loss": {"rwkv": 7.514036671296684, "qwen": 7.182690596578126}, "topk": {"rwkv": [4600, 1, 0.2882640063762665, [[4600, 0.288264, " is", false], [30659, 0.062116, " does", false], [22748, 0.06041, " was", false], [21800, 0.039604, " has", false], [56501, 0.034766, " involves", false], [39888, 0.033837, " takes", false], [38087, 0.029904, " comes", false], [39620, 0.024831, " seems", false], [57102, 0.022864, " requires", false], [31908, 0.015377, " runs", false]]], "qwen": [374, 1, 0.3027406334877014, [[374, 0.302741, " is", false], [4041, 0.105995, " comes", false], [29682, 0.065926, " arrives", false], [1558, 0.04941, " does", false], [572, 0.02891, " was", false], [7460, 0.028253, " requires", false], [4990, 0.026667, " takes", false], [702, 0.020119, " has", false], [8573, 0.015152, " happens", false], [3697, 0.012295, " came", false]]]}, "raw_delta": 0.018373727798461914, "tuned_delta": 0.026945519829040164}, {"byte_start": 5631, "byte_end": 5639, "display": {"text": " success", "kind": "normal"}, "is_word": true, "word_id": 946, "word_key": " success", "bytes_hex": "20 73 75 63 63 65 73 73", "compression": {"rwkv": "22.82% 22.82% 22.82% 22.82% 22.82% 22.82% 22.82% 22.82%", "qwen": "22.30% 22.30% 22.30% 22.30% 22.30% 22.30% 22.30% 22.30%"}, "model_tokens": {"rwkv": [[53052, " success", "normal", 4.079076097696088e-05]], "qwen": [[2393, " success", "normal", 5.052114283898845e-05]]}, "loss": {"rwkv": 22.823886389063677, "qwen": 22.301177368513205}, "topk": {"rwkv": [53052, 865, 4.079076097696088e-05, [[22187, 0.132184, " not", false], [4788, 0.095865, " so", false], [332, 0.071927, " a", false], [31048, 0.07044, " hard", false], [45315, 0.059021, " bitter", false], [22590, 0.038532, " the", false], [37810, 0.036888, " based", false], [51336, 0.034481, " counter", false], [59516, 0.029296, " difficult", false], [31968, 0.0164, " seen", false]]], "qwen": [2393, 891, 5.052114283898845e-05, [[537, 0.12214, " not", false], [264, 0.085189, " a", false], [3118, 0.077157, " based", false], [773, 0.071189, " so", false], [279, 0.042447, " the", false], [3545, 0.025751, " often", false], [5546, 0.024856, " counter", false], [2238, 0.022544, " too", false], [2588, 0.021346, " hard", false], [16500, 0.017735, " unexpected", false]]]}, "raw_delta": 0.028985142707824707, "tuned_delta": 0.03755693473840296}, {"byte_start": 5639, "byte_end": 5644, "display": {"text": " over", "kind": "normal"}, "is_word": true, "word_id": 947, "word_key": " over", "bytes_hex": "20 6f 76 65 72", "compression": {"rwkv": "22.09% 22.09% 22.09% 22.09% 22.09%", "qwen": "14.60% 14.60% 14.60% 14.60% 14.60%"}, "model_tokens": {"rwkv": [[31601, " over", "normal", 0.002152421046048403]], "qwen": [[916, " over", "normal", 0.01744821108877659]]}, "loss": {"rwkv": 22.09126781361225, "qwen": 14.601942756142542}, "topk": {"rwkv": [31601, 41, 0.002152421046048403, [[32227, 0.142402, " that", false], [37810, 0.117379, " based", false], [4596, 0.089234, " in", false], [37634, 0.072337, " after", false], [4450, 0.053094, " by", false], [4424, 0.04055, " at", false], [50870, 0.038967, " against", false], [31581, 0.036845, " only", false], [55437, 0.031206, " achieved", false], [37924, 0.029755, " built", false]]], "qwen": [916, 14, 0.01744821108877659, [[304, 0.155545, " in", false], [429, 0.120506, " that", false], [518, 0.07092, " at", false], [2348, 0.067026, " against", false], [553, 0.062182, " by", false], [16994, 0.051364, " achieved", false], [3118, 0.048459, " based", false], [315, 0.036886, " of", false], [1283, 0.032752, " after", false], [369, 0.032327, " for", false]]]}, "raw_delta": 0.4152963638305664, "tuned_delta": 0.4238681558611446}, {"byte_start": 5644, "byte_end": 5646, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 948, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "10.99% 10.99%", "qwen": "10.54% 10.54%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.2956809997558594]], "qwen": [[264, " a", "normal", 0.3108728528022766]]}, "loss": {"rwkv": 10.9892786317714, "qwen": 10.535021930939031}, "topk": {"rwkv": [332, 1, 0.2956809997558594, [[332, 0.295681, " a", false], [22590, 0.156365, " the", false], [38720, 0.056497, " human", false], [4419, 0.04167, " an", false], [51396, 0.025634, " decades", false], [32464, 0.022762, " what", false], [32251, 0.022253, " time", false], [32139, 0.019951, " such", false], [31370, 0.016971, " many", false], [60522, 0.016744, " something", false]]], "qwen": [264, 1, 0.3108728528022766, [[264, 0.310873, " a", false], [279, 0.133102, " the", false], [458, 0.105017, " an", false], [10793, 0.034139, " decades", false], [1128, 0.025159, " what", false], [882, 0.023667, " time", false], [1657, 0.022911, " many", false], [2494, 0.017569, " something", false], [892, 0.015761, " which", false], [3738, 0.012052, " human", false]]]}, "raw_delta": 0.025189340114593506, "tuned_delta": 0.033761132145171756}, {"byte_start": 5646, "byte_end": 5654, "display": {"text": " favored", "kind": "normal"}, "is_word": true, "word_id": 949, "word_key": " favored", "bytes_hex": "20 66 61 76 6f 72 65 64", "compression": {"rwkv": "23.95% 23.95% 23.95% 23.95% 23.95% 23.95% 23.95% 23.95%", "qwen": "23.85% 23.85% 23.85% 23.85% 23.85% 23.85% 23.85% 23.85%"}, "model_tokens": {"rwkv": [[51722, " favored", "normal", 2.4290700821438804e-05]], "qwen": [[45503, " favored", "normal", 2.53817252087174e-05]]}, "loss": {"rwkv": 23.95099188975818, "qwen": 23.852890835922896}, "topk": {"rwkv": [51722, 888, 2.4290700821438804e-05, [[31323, 0.379958, " long", false], [32386, 0.105367, " very", false], [46470, 0.065834, " longer", false], [31466, 0.057021, " much", false], [46790, 0.019398, " period", false], [31118, 0.015977, " huge", false], [62471, 0.015084, " relatively", false], [39675, 0.014525, " short", false], [38864, 0.014124, " large", false], [32251, 0.013945, " time", false]]], "qwen": [45503, 1111, 2.53817252087174e-05, [[1293, 0.219826, " long", false], [1602, 0.085832, " very", false], [1753, 0.078482, " much", false], [4168, 0.072124, " period", false], [882, 0.056071, " time", false], [5021, 0.048234, " longer", false], [2155, 0.021774, " different", false], [12767, 0.011735, " vast", false], [1714, 0.010897, " method", false], [3460, 0.010863, " large", false]]]}, "raw_delta": 0.005439877510070801, "tuned_delta": 0.014011669540649049}, {"byte_start": 5654, "byte_end": 5655, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "68.47%", "qwen": "59.41%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.022521788254380226]], "qwen": [[11, ",", "normal", 0.03708159551024437]]}, "loss": {"rwkv": 68.47165916719104, "qwen": 59.41441213738106}, "topk": {"rwkv": [45, 6, 0.022521788254380226, [[55532, 0.449047, " approach", false], [46561, 0.125214, " method", false], [22752, 0.052567, " way", false], [38720, 0.037699, " human", false], [21400, 0.036149, " but", false], [45, 0.022522, ",", false], [21265, 0.015819, " and", false], [63277, 0.0157, " alternative", false], [57317, 0.01437, " strategy", false], [31135, 0.013747, " idea", false]]], "qwen": [11, 3, 0.03708159551024437, [[5486, 0.512128, " approach", false], [1815, 0.046588, " path", false], [11, 0.037082, ",", false], [1714, 0.029168, " method", false], [323, 0.024596, " and", false], [1616, 0.019403, " way", false], [714, 0.014412, " but", false], [10555, 0.013887, " alternative", false], [2856, 0.013755, " initial", false], [2309, 0.013726, " position", false]]]}, "raw_delta": 0.5022404193878174, "tuned_delta": 0.5108122114183956}, {"byte_start": 5655, "byte_end": 5661, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 950, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "6.06% 6.06% 6.06% 6.06% 6.06% 6.06%", "qwen": "7.77% 7.77% 7.77% 7.77% 7.77% 7.77%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.13161326944828033]], "qwen": [[3738, " human", "normal", 0.07525920867919922]]}, "loss": {"rwkv": 6.058192066232952, "qwen": 7.774975198535144}, "topk": {"rwkv": [38720, 2, 0.13161326944828033, [[21400, 0.261989, " but", false], [38720, 0.131613, " human", false], [21265, 0.067886, " and", false], [56847, 0.044525, " personal", false], [39675, 0.027583, " short", false], [31323, 0.023109, " long", false], [62309, 0.018654, " personally", false], [47544, 0.016238, " though", false], [30437, 0.014396, " cher", false], [56205, 0.014345, " familiar", false]]], "qwen": [3738, 2, 0.07525920867919922, [[714, 0.151215, " but", false], [3738, 0.075259, " human", false], [323, 0.063641, " and", false], [1293, 0.049341, " long", false], [3281, 0.018588, " special", false], [81044, 0.017409, " entrenched", false], [2805, 0.013023, " short", false], [4345, 0.011846, " personal", false], [15102, 0.011559, " initially", false], [4124, 0.011314, " early", false]]]}, "raw_delta": -0.09519867102305096, "tuned_delta": -0.08662687899247272}, {"byte_start": 5661, "byte_end": 5669, "display": {"text": "-centric", "kind": "normal"}, "is_word": true, "word_id": 951, "word_key": "-centric", "bytes_hex": "2d 63 65 6e 74 72 69 63", "compression": {"rwkv": "5.32% 6.72% 6.72% 6.72% 6.72% 6.72% 6.72% 6.72%", "qwen": "7.71% 7.71% 7.71% 7.71% 7.71% 7.71% 7.71% 7.71%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.7443927526473999], [48948, "centric", "normal", 0.07364126294851303]], "qwen": [[64424, "-centric", "normal", 0.032710764557123184]]}, "loss": {"rwkv": 6.54689796692471, "qwen": 7.709516810130813}, "topk": {"rwkv": [46, 1, 0.7443927526473999, [[46, 0.744393, "-", false], [22752, 0.057986, " way", false], [55532, 0.045527, " approach", false], [45, 0.028108, ",", false], [2030, 0.022282, "ly", false], [34864, 0.015767, "istic", false], [46561, 0.007028, " method", false], [7919, 0.00693, "ist", false], [65034, 0.005707, " understanding", false], [59943, 0.004915, " knowledge", false]]], "qwen": [64424, 4, 0.032710764557123184, [[12646, 0.578206, "-k", false], [49382, 0.05646, "-centered", false], [71107, 0.045622, "-under", false], [64424, 0.032711, "-centric", false], [12681, 0.023995, "-like", false], [35085, 0.021641, "-oriented", false], [6540, 0.017246, " knowledge", false], [5980, 0.016713, "-based", false], [12, 0.014339, "-", false], [3419, 0.010668, "-in", false]]]}, "raw_delta": -0.06446927785873413, "tuned_delta": -0.05589748582815588}, {"byte_start": 5669, "byte_end": 5678, "display": {"text": " approach", "kind": "normal"}, "is_word": true, "word_id": 952, "word_key": " approach", "bytes_hex": "20 61 70 70 72 6f 61 63 68", "compression": {"rwkv": "1.37% 1.37% 1.37% 1.37% 1.37% 1.37% 1.37% 1.37% 1.37%", "qwen": "1.34% 1.34% 1.34% 1.34% 1.34% 1.34% 1.34% 1.34% 1.34%"}, "model_tokens": {"rwkv": [[55532, " approach", "normal", 0.5075794458389282]], "qwen": [[5486, " approach", "normal", 0.5117776393890381]]}, "loss": {"rwkv": 1.3697462682051245, "qwen": 1.342237523767222}, "topk": {"rwkv": [55532, 1, 0.5075794458389282, [[55532, 0.507579, " approach", false], [45, 0.133189, ",", false], [46561, 0.05707, " method", false], [22752, 0.054261, " way", false], [32398, 0.042187, " view", false], [46681, 0.016602, " notion", false], [57317, 0.013877, " strategy", false], [56810, 0.010144, " paradigm", false], [63708, 0.008959, " methodology", false], [31135, 0.008109, " idea", false]]], "qwen": [5486, 1, 0.5117776393890381, [[5486, 0.511778, " approach", false], [11, 0.194958, ",", false], [1651, 0.037037, " view", false], [1616, 0.025717, " way", false], [13057, 0.025309, " perspective", false], [11129, 0.017677, " vision", false], [1714, 0.013919, " method", false], [48240, 0.010254, " paradigm", false], [1614, 0.008498, " model", false], [42556, 0.006575, " conception", false]]]}, "raw_delta": 0.001525408691830099, "tuned_delta": 0.010097200722408347}, {"byte_start": 5678, "byte_end": 5680, "display": {"text": ".\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e 0a", "compression": {"rwkv": "11.55% 9.65%", "qwen": "13.81% 13.81%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.5315477252006531], [261, "\n\n", "control", 0.34259605407714844]], "qwen": [[382, ".\n\n", "control", 0.10044247657060623]]}, "loss": {"rwkv": 10.601836115907664, "qwen": 13.814827464836712}, "topk": {"rwkv": [47, 1, 0.5315477252006531, [[47, 0.531548, ".", false], [32227, 0.152361, " that", false], [45, 0.149682, ",", false], [4811, 0.070093, " to", false], [21265, 0.015953, " and", false], [5346, 0.013315, "---", false], [60, 0.006668, ";", false], [4596, 0.005774, " in", false], [47001, 0.005749, " rather", false], [275, 0.005231, " (", false]]], "qwen": [382, 4, 0.10044247657060623, [[13, 0.279323, ".", false], [11, 0.207899, ",", false], [429, 0.159146, " that", false], [382, 0.100442, ".\n\n", false], [311, 0.059556, " to", false], [4421, 0.037203, "---", false], [323, 0.026511, " and", false], [4751, 0.016863, " rather", false], [3118, 0.014959, " based", false], [320, 0.011289, " (", false]]]}, "raw_delta": -0.1781660715738932, "tuned_delta": -0.16959427954331494}, {"byte_start": 5680, "byte_end": 5681, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "9.65%", "qwen": "13.81%"}, "model_tokens": {"rwkv": [[261, "\n\n", "control", 0.34259605407714844]], "qwen": [[382, ".\n\n", "control", 0.10044247657060623]]}, "loss": {"rwkv": 9.650840849696678, "qwen": 13.814827464836712}, "topk": {"rwkv": [261, 1, 0.34259605407714844, [[261, 0.342596, "\n\n", false], [19555, 0.139247, " But", false], [20996, 0.086645, " The", false], [3918, 0.042543, " It", false], [29894, 0.041358, " This", false], [4331, 0.037635, " We", false], [267, 0.021008, "  ", false], [3913, 0.018412, " In", false], [19417, 0.011484, " And", false], [37451, 0.00935, " There", false]]], "qwen": [382, 4, 0.10044247657060623, [[13, 0.279323, ".", false], [11, 0.207899, ",", false], [429, 0.159146, " that", false], [382, 0.100442, ".\n\n", false], [311, 0.059556, " to", false], [4421, 0.037203, "---", false], [323, 0.026511, " and", false], [4751, 0.016863, " rather", false], [3118, 0.014959, " based", false], [320, 0.011289, " (", false]]]}, "raw_delta": -0.2309004465738932, "tuned_delta": -0.22232865454331494}, {"byte_start": 5681, "byte_end": 5684, "display": {"text": "One", "kind": "normal"}, "is_word": true, "word_id": 953, "word_key": "one", "bytes_hex": "4f 6e 65", "compression": {"rwkv": "24.04% 24.04% 24.04%", "qwen": "25.47% 25.47% 25.47%"}, "model_tokens": {"rwkv": [[6393, "One", "normal", 0.018186720088124275]], "qwen": [[3966, "One", "normal", 0.014451012015342712]]}, "loss": {"rwkv": 24.044917348149387, "qwen": 25.46952417106141}, "topk": {"rwkv": [6393, 12, 0.018186720088124275, [[6699, 0.173339, "The", false], [1136, 0.074415, "In", false], [24242, 0.05702, "This", false], [1589, 0.045547, "We", false], [1500, 0.041338, "To", false], [33504, 0.039424, "There", false], [66, 0.031859, "A", false], [1141, 0.030634, "It", false], [74, 0.030074, "I", false], [24326, 0.022752, "What", false]]], "qwen": [3966, 12, 0.014451012015342712, [[785, 0.170455, "The", false], [1986, 0.064505, "This", false], [641, 0.054122, "In", false], [3862, 0.035957, "There", false], [2132, 0.034442, "It", false], [1654, 0.034082, "We", false], [32, 0.026993, "A", false], [1249, 0.026394, "To", false], [40, 0.018889, "I", false], [3983, 0.016479, "But", false]]]}, "raw_delta": -0.07899697621663426, "tuned_delta": -0.07042518418605602}, {"byte_start": 5684, "byte_end": 5690, "display": {"text": " thing", "kind": "normal"}, "is_word": true, "word_id": 954, "word_key": " thing", "bytes_hex": "20 74 68 69 6e 67", "compression": {"rwkv": "11.55% 11.55% 11.55% 11.55% 11.55% 11.55%", "qwen": "11.64% 11.64% 11.64% 11.64% 11.64% 11.64%"}, "model_tokens": {"rwkv": [[39941, " thing", "normal", 0.021191934123635292]], "qwen": [[3166, " thing", "normal", 0.020781708881258965]]}, "loss": {"rwkv": 11.55283138211865, "qwen": 11.642795506784987}, "topk": {"rwkv": [39941, 7, 0.021191934123635292, [[4706, 0.154792, " of", false], [22752, 0.140198, " way", false], [47009, 0.063192, " reason", false], [21413, 0.045563, " can", false], [39021, 0.041041, " might", false], [51668, 0.022052, " example", false], [39941, 0.021192, " thing", false], [46430, 0.017946, " lesson", false], [56895, 0.016454, " possible", false], [59829, 0.015548, " important", false]]], "qwen": [3166, 5, 0.020781708881258965, [[315, 0.175248, " of", false], [2874, 0.116729, " reason", false], [1616, 0.105777, " way", false], [646, 0.042688, " can", false], [3166, 0.020782, " thing", false], [2578, 0.019364, " might", false], [2989, 0.016264, " important", false], [5486, 0.014129, " approach", false], [1590, 0.01315, " final", false], [803, 0.013112, " more", false]]]}, "raw_delta": -0.004988670349121094, "tuned_delta": 0.0035831216814571545}, {"byte_start": 5690, "byte_end": 5695, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 955, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "2.49% 2.49% 2.49% 2.49% 2.49%", "qwen": "2.65% 2.65% 2.65% 2.65% 2.65%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.49741557240486145]], "qwen": [[429, " that", "normal", 0.47998541593551636]]}, "loss": {"rwkv": 2.4937209202865867, "qwen": 2.6473437782348497}, "topk": {"rwkv": [32227, 1, 0.49741557240486145, [[32227, 0.497416, " that", false], [4858, 0.150318, " we", false], [4811, 0.113244, " to", false], [4600, 0.033267, " is", false], [32234, 0.03034, " this", false], [308, 0.026921, " I", false], [22590, 0.02312, " the", false], [37598, 0.010763, " about", false], [3609, 0.006933, " AI", false], [39936, 0.004753, " these", false]]], "qwen": [429, 1, 0.47998541593551636, [[429, 0.479985, " that", false], [311, 0.16196, " to", false], [582, 0.093175, " we", false], [374, 0.059273, " is", false], [358, 0.025259, " I", false], [911, 0.022871, " about", false], [279, 0.016734, " the", false], [419, 0.014615, " this", false], [5802, 0.008468, " worth", false], [15235, 0.00763, " AI", false]]]}, "raw_delta": -0.008518660068511957, "tuned_delta": 5.313196206629088e-05}, {"byte_start": 5695, "byte_end": 5702, "display": {"text": " should", "kind": "normal"}, "is_word": true, "word_id": 956, "word_key": " should", "bytes_hex": "20 73 68 6f 75 6c 64", "compression": {"rwkv": "11.11% 11.11% 11.11% 11.11% 11.11% 11.11% 11.11%", "qwen": "11.03% 11.03% 11.03% 11.03% 11.03% 11.03% 11.03%"}, "model_tokens": {"rwkv": [[47266, " should", "normal", 0.013386623933911324]], "qwen": [[1265, " should", "normal", 0.013812181539833546]]}, "loss": {"rwkv": 11.110039935417243, "qwen": 11.031991751560685}, "topk": {"rwkv": [47266, 16, 0.013386623933911324, [[4600, 0.196296, " is", false], [21800, 0.078812, " has", false], [4858, 0.062292, " we", false], [38964, 0.04568, " makes", false], [21413, 0.045268, " can", false], [22590, 0.029351, " the", false], [39021, 0.021661, " might", false], [38686, 0.021108, " helps", false], [308, 0.019905, " I", false], [32234, 0.019869, " this", false]]], "qwen": [1265, 15, 0.013812181539833546, [[374, 0.176985, " is", false], [646, 0.06568, " can", false], [582, 0.061963, " we", false], [702, 0.052179, " has", false], [3643, 0.036484, " makes", false], [279, 0.036215, " the", false], [8609, 0.036166, " helps", false], [1558, 0.028032, " does", false], [11811, 0.024418, " researchers", false], [358, 0.023333, " I", false]]]}, "raw_delta": 0.004327910287039605, "tuned_delta": 0.012899702317617853}, {"byte_start": 5702, "byte_end": 5705, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 957, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"rwkv": "2.14% 2.14% 2.14%", "qwen": "3.09% 3.09% 3.09%"}, "model_tokens": {"rwkv": [[4435, " be", "normal", 0.7007312774658203]], "qwen": [[387, " be", "normal", 0.5976617932319641]]}, "loss": {"rwkv": 2.1368041783999945, "qwen": 3.094161369504148}, "topk": {"rwkv": [4435, 1, 0.7007312774658203, [[4435, 0.700731, " be", false], [31073, 0.056464, " help", false], [22187, 0.049648, " not", false], [31059, 0.023253, " have", false], [31358, 0.013951, " make", false], [30135, 0.010645, " also", false], [30482, 0.010423, " come", false], [45284, 0.008644, " become", false], [45150, 0.006725, " always", false], [47428, 0.00665, " strike", false]]], "qwen": [387, 1, 0.5976617932319641, [[387, 0.597662, " be", false], [537, 0.079499, " not", false], [1492, 0.06085, " help", false], [1281, 0.035471, " make", false], [614, 0.023218, " have", false], [1083, 0.012459, " also", false], [2525, 0.011101, " come", false], [2968, 0.008135, " give", false], [3635, 0.007961, " become", false], [32944, 0.006529, " emerge", false]]]}, "raw_delta": -0.05308715502421061, "tuned_delta": -0.04451536299363236}, {"byte_start": 5705, "byte_end": 5713, "display": {"text": " learned", "kind": "normal"}, "is_word": true, "word_id": 958, "word_key": " learned", "bytes_hex": "20 6c 65 61 72 6e 65 64", "compression": {"rwkv": "5.57% 5.57% 5.57% 5.57% 5.57% 5.57% 5.57% 5.57%", "qwen": "7.63% 7.63% 7.63% 7.63% 7.63% 7.63% 7.63% 7.63%"}, "model_tokens": {"rwkv": [[52112, " learned", "normal", 0.08431340008974075]], "qwen": [[9498, " learned", "normal", 0.033842235803604126]]}, "loss": {"rwkv": 5.565083409679106, "qwen": 7.632860917966555}, "topk": {"rwkv": [52112, 2, 0.08431340008974075, [[38049, 0.299266, " clear", false], [52112, 0.084313, " learned", false], [39140, 0.082093, " noted", false], [52346, 0.057422, " obvious", false], [62684, 0.037237, " understood", false], [61934, 0.02881, " emphasized", false], [31207, 0.024649, " kept", false], [55524, 0.021464, " apparent", false], [31351, 0.018904, " made", false], [63289, 0.017947, " appreciated", false]]], "qwen": [9498, 7, 0.033842235803604126, [[2797, 0.275875, " clear", false], [10342, 0.093688, " noted", false], [8036, 0.061994, " obvious", false], [3694, 0.059659, " added", false], [1053, 0.05515, " said", false], [45628, 0.043568, " emphasized", false], [9498, 0.033842, " learned", false], [31547, 0.029003, " stressed", false], [29476, 0.021034, " evident", false], [9733, 0.019105, " mentioned", false]]]}, "raw_delta": -0.11466193199157715, "tuned_delta": -0.1060901399609989}, {"byte_start": 5713, "byte_end": 5718, "display": {"text": " from", "kind": "normal"}, "is_word": true, "word_id": 959, "word_key": " from", "bytes_hex": "20 66 72 6f 6d", "compression": {"rwkv": "2.13% 2.13% 2.13% 2.13% 2.13%", "qwen": "2.05% 2.05% 2.05% 2.05% 2.05%"}, "model_tokens": {"rwkv": [[30917, " from", "normal", 0.5561042428016663]], "qwen": [[504, " from", "normal", 0.5667757391929626]]}, "loss": {"rwkv": 2.1274116325608734, "qwen": 2.0478752459729774}, "topk": {"rwkv": [30917, 1, 0.5561042428016663, [[30917, 0.556104, " from", false], [4600, 0.269363, " is", false], [45, 0.045566, ",", false], [31077, 0.017917, " here", false], [4450, 0.014278, " by", false], [37598, 0.013777, " about", false], [4596, 0.012411, " in", false], [21265, 0.00878, " and", false], [31458, 0.00544, " more", false], [32458, 0.004925, " well", false]]], "qwen": [504, 1, 0.5667757391929626, [[504, 0.566776, " from", false], [374, 0.260513, " is", false], [11, 0.046342, ",", false], [304, 0.019425, " in", false], [1588, 0.018739, " here", false], [553, 0.014429, " by", false], [911, 0.012014, " about", false], [323, 0.004805, " and", false], [438, 0.004626, " as", false], [518, 0.004103, " at", false]]]}, "raw_delta": 0.004410433769226077, "tuned_delta": 0.012982225799804325}, {"byte_start": 5718, "byte_end": 5722, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 960, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "5.99% 5.99% 5.99% 5.99%", "qwen": "7.25% 7.25% 7.25% 7.25%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.26441845297813416]], "qwen": [[279, " the", "normal", 0.20029723644256592]]}, "loss": {"rwkv": 5.987747972439545, "qwen": 7.249329932518381}, "topk": {"rwkv": [22590, 2, 0.26441845297813416, [[32234, 0.383667, " this", false], [22590, 0.264418, " the", false], [39936, 0.180487, " these", false], [21256, 0.056352, " all", false], [3609, 0.018239, " AI", false], [45315, 0.013758, " bitter", false], [51929, 0.008418, " history", false], [55809, 0.003554, " computer", false], [31636, 0.003259, " past", false], [22248, 0.00314, " our", false]]], "qwen": [279, 2, 0.20029723644256592, [[419, 0.461009, " this", false], [279, 0.200297, " the", false], [1493, 0.151398, " these", false], [678, 0.087104, " all", false], [6366, 0.00636, " computer", false], [15235, 0.004603, " AI", false], [3840, 0.003931, " history", false], [20219, 0.003923, " Moore", false], [1817, 0.003834, " each", false], [264, 0.003543, " a", false]]]}, "raw_delta": -0.0699569582939148, "tuned_delta": -0.061385166263336545}, {"byte_start": 5722, "byte_end": 5729, "display": {"text": " bitter", "kind": "normal"}, "is_word": true, "word_id": 961, "word_key": " bitter", "bytes_hex": "20 62 69 74 74 65 72", "compression": {"rwkv": "0.76% 0.76% 0.76% 0.76% 0.76% 0.76% 0.76%", "qwen": "0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45%"}, "model_tokens": {"rwkv": [[45315, " bitter", "normal", 0.7465822100639343]], "qwen": [[25180, " bitter", "normal", 0.8381265997886658]]}, "loss": {"rwkv": 0.7597898687717407, "qwen": 0.45492843128433225}, "topk": {"rwkv": [45315, 1, 0.7465822100639343, [[45315, 0.746582, " bitter", false], [51929, 0.04974, " history", false], [31636, 0.011954, " past", false], [37599, 0.011739, " above", false], [60587, 0.009584, " successes", false], [61640, 0.008671, " bitterness", false], [62061, 0.007071, " historical", false], [3609, 0.00692, " AI", false], [56162, 0.006886, " examples", false], [52427, 0.005523, " pattern", false]]], "qwen": [25180, 1, 0.8381265997886658, [[25180, 0.838127, " bitter", false], [3840, 0.020017, " history", false], [3403, 0.01126, " above", false], [78996, 0.010213, " bitterness", false], [6366, 0.008315, " computer", false], [18366, 0.00567, " lessons", false], [3139, 0.005327, " experience", false], [13656, 0.004365, " historical", false], [3267, 0.004178, " past", false], [4124, 0.003944, " early", false]]]}, "raw_delta": 0.016905107668467933, "tuned_delta": 0.02547689969904618}, {"byte_start": 5729, "byte_end": 5736, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 962, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"rwkv": "1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49%", "qwen": "0.52% 0.52% 0.52% 0.52% 0.52% 0.52% 0.52%"}, "model_tokens": {"rwkv": [[46430, " lesson", "normal", 0.5590899586677551]], "qwen": [[17755, " lesson", "normal", 0.8182079195976257]]}, "loss": {"rwkv": 1.4893894116320212, "qwen": 0.5168938955571559}, "topk": {"rwkv": [46430, 1, 0.5590899586677551, [[46430, 0.55909, " lesson", false], [52127, 0.399026, " lessons", false], [61979, 0.008515, " experience", false], [46, 0.007213, "-", false], [31636, 0.002694, " past", false], [63558, 0.002306, " experiences", false], [51929, 0.002008, " history", false], [39899, 0.001541, " taste", false], [45, 0.001254, ",", false], [39831, 0.000541, " story", false]]], "qwen": [17755, 1, 0.8182079195976257, [[17755, 0.818208, " lesson", false], [18366, 0.105563, " lessons", false], [3139, 0.03114, " experience", false], [3840, 0.013571, " history", false], [11449, 0.004299, " experiences", false], [15235, 0.003162, " AI", false], [11, 0.001942, ",", false], [13656, 0.00183, " historical", false], [3267, 0.001488, " past", false], [323, 0.000688, " and", false]]]}, "raw_delta": 0.05392660200595856, "tuned_delta": 0.06249839403653681}, {"byte_start": 5736, "byte_end": 5739, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 963, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "1.06% 1.06% 1.06%", "qwen": "1.21% 1.21% 1.21%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.8394970297813416]], "qwen": [[374, " is", "normal", 0.817969799041748]]}, "loss": {"rwkv": 1.0566614069010962, "qwen": 1.2078356797725596}, "topk": {"rwkv": [4600, 1, 0.8394970297813416, [[4600, 0.839497, " is", false], [4706, 0.056035, " of", false], [45, 0.04297, ",", false], [4596, 0.011184, " in", false], [32227, 0.009509, " that", false], [37598, 0.00805, " about", false], [59, 0.004939, ":", false], [21265, 0.004035, " and", false], [5346, 0.002418, "---", false], [4712, 0.001878, " on", false]]], "qwen": [374, 1, 0.817969799041748, [[374, 0.81797, " is", false], [315, 0.068726, " of", false], [11, 0.038809, ",", false], [304, 0.012614, " in", false], [911, 0.007968, " about", false], [429, 0.006566, " that", false], [25, 0.006301, ":", false], [4421, 0.005378, "---", false], [323, 0.004139, " and", false], [389, 0.002969, " on", false]]]}, "raw_delta": -0.008382881681124374, "tuned_delta": 0.0001889103494538743}, {"byte_start": 5739, "byte_end": 5743, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 964, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "11.27% 11.27% 11.27% 11.27%", "qwen": "10.35% 10.35% 10.35% 10.35%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.08066534996032715]], "qwen": [[279, " the", "normal", 0.10073703527450562]]}, "loss": {"rwkv": 11.271055006945026, "qwen": 10.347918780390678}, "topk": {"rwkv": [22590, 3, 0.08066534996032715, [[32227, 0.687518, " that", false], [4811, 0.096033, " to", false], [22590, 0.080665, " the", false], [22187, 0.028248, " not", false], [21835, 0.022794, " how", false], [32234, 0.014226, " this", false], [332, 0.013353, " a", false], [45, 0.005186, ",", false], [59, 0.005085, ":", false], [32464, 0.004776, " what", false]]], "qwen": [279, 2, 0.10073703527450562, [[429, 0.677339, " that", false], [279, 0.100737, " the", false], [311, 0.073085, " to", false], [1246, 0.036996, " how", false], [537, 0.025421, " not", false], [264, 0.013102, " a", false], [419, 0.009452, " this", false], [1128, 0.009201, " what", false], [911, 0.00403, " about", false], [1101, 0.003283, " just", false]]]}, "raw_delta": 0.051189541816711426, "tuned_delta": 0.059761333847289676}, {"byte_start": 5743, "byte_end": 5749, "display": {"text": " great", "kind": "normal"}, "is_word": true, "word_id": 965, "word_key": " great", "bytes_hex": "20 67 72 65 61 74", "compression": {"rwkv": "16.72% 16.72% 16.72% 16.72% 16.72% 16.72%", "qwen": "13.41% 13.41% 13.41% 13.41% 13.41% 13.41%"}, "model_tokens": {"rwkv": [[38629, " great", "normal", 0.0038409861735999584]], "qwen": [[2244, " great", "normal", 0.011553216725587845]]}, "loss": {"rwkv": 16.718731593635123, "qwen": 13.40742062958532}, "topk": {"rwkv": [38629, 27, 0.0038409861735999584, [[62079, 0.236673, " importance", false], [31506, 0.113577, " need", false], [40093, 0.043038, " value", false], [59725, 0.018497, " following", false], [30808, 0.015713, " fact", false], [45661, 0.013849, " danger", false], [21719, 0.012937, " fut", false], [31135, 0.008465, " idea", false], [60051, 0.008357, " necessity", false], [63820, 0.008164, " realization", false]]], "qwen": [2244, 10, 0.011553216725587845, [[12650, 0.178247, " importance", false], [1184, 0.076754, " need", false], [897, 0.037843, " value", false], [2355, 0.019332, " power", false], [2097, 0.017897, " fact", false], [3476, 0.012779, " role", false], [6672, 0.012589, " difference", false], [23389, 0.012551, " wisdom", false], [17755, 0.012181, " lesson", false], [2244, 0.011553, " great", false]]]}, "raw_delta": 0.18361806869506836, "tuned_delta": 0.19218986072564662}, {"byte_start": 5749, "byte_end": 5755, "display": {"text": " power", "kind": "normal"}, "is_word": true, "word_id": 966, "word_key": " power", "bytes_hex": "20 70 6f 77 65 72", "compression": {"rwkv": "7.84% 7.84% 7.84% 7.84% 7.84% 7.84%", "qwen": "6.64% 6.64% 6.64% 6.64% 6.64% 6.64%"}, "model_tokens": {"rwkv": [[39339, " power", "normal", 0.07397116720676422]], "qwen": [[2355, " power", "normal", 0.10960918664932251]]}, "loss": {"rwkv": 7.842775775665913, "qwen": 6.644915179217694}, "topk": {"rwkv": [39339, 3, 0.07397116720676422, [[62079, 0.249328, " importance", false], [40093, 0.20345, " value", false], [39339, 0.073971, " power", false], [60211, 0.029027, " potential", false], [59093, 0.028662, " advantage", false], [51030, 0.02592, " benefit", false], [45661, 0.018144, " danger", false], [61865, 0.018045, " difficulty", false], [31506, 0.01731, " need", false], [30510, 0.013183, " cost", false]]], "qwen": [2355, 3, 0.10960918664932251, [[12650, 0.233723, " importance", false], [897, 0.15247, " value", false], [2355, 0.109609, " power", false], [4650, 0.025403, " potential", false], [16829, 0.025179, " difficulty", false], [6672, 0.019781, " difference", false], [1184, 0.019257, " need", false], [9423, 0.014658, " advantage", false], [7978, 0.011806, " danger", false], [8760, 0.011559, " benefit", false]]]}, "raw_delta": 0.066423495610555, "tuned_delta": 0.07499528764113324}, {"byte_start": 5755, "byte_end": 5758, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 967, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "1.32% 1.32% 1.32%", "qwen": "0.86% 0.86% 0.86%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.8027152419090271]], "qwen": [[315, " of", "normal", 0.8665686249732971]]}, "loss": {"rwkv": 1.3208267586263702, "qwen": 0.8608919430866092}, "topk": {"rwkv": [4706, 1, 0.8027152419090271, [[4706, 0.802715, " of", false], [32227, 0.08327, " that", false], [21265, 0.047147, " and", false], [4596, 0.011247, " in", false], [45, 0.009468, ",", false], [4811, 0.008144, " to", false], [4858, 0.003839, " we", false], [59206, 0.003084, " available", false], [56454, 0.001722, " inherent", false], [275, 0.001532, " (", false]]], "qwen": [315, 1, 0.8665686249732971, [[315, 0.866569, " of", false], [429, 0.055394, " that", false], [323, 0.03366, " and", false], [304, 0.016253, " in", false], [11, 0.004085, ",", false], [2500, 0.002322, " available", false], [582, 0.001572, " we", false], [36988, 0.001447, " inherent", false], [320, 0.001337, " (", false], [311, 0.001265, " to", false]]]}, "raw_delta": 0.025504201650619507, "tuned_delta": 0.03407599368119776}, {"byte_start": 5758, "byte_end": 5766, "display": {"text": " general", "kind": "normal"}, "is_word": true, "word_id": 968, "word_key": " general", "bytes_hex": "20 67 65 6e 65 72 61 6c", "compression": {"rwkv": "7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29%", "qwen": "8.35% 8.35% 8.35% 8.35% 8.35% 8.35% 8.35% 8.35%"}, "model_tokens": {"rwkv": [[51832, " general", "normal", 0.039375290274620056]], "qwen": [[4586, " general", "normal", 0.02458660677075386]]}, "loss": {"rwkv": 7.290963707617563, "qwen": 8.353099537273936}, "topk": {"rwkv": [51832, 7, 0.039375290274620056, [[63370, 0.118311, " computation", false], [22590, 0.097759, " the", false], [47202, 0.095433, " search", false], [52195, 0.082458, " massive", false], [37045, 0.044575, " Moore", false], [56537, 0.043099, " learning", false], [51832, 0.039375, " general", false], [30597, 0.034995, " deep", false], [38720, 0.030198, " human", false], [52805, 0.030027, " scaling", false]]], "qwen": [4586, 8, 0.02458660677075386, [[2711, 0.130795, " search", false], [34447, 0.084417, " computation", false], [6832, 0.075878, " learning", false], [26943, 0.074503, " scaling", false], [279, 0.052316, " the", false], [76482, 0.037135, " leveraging", false], [3738, 0.027417, " human", false], [4586, 0.024587, " general", false], [5538, 0.022336, " deep", false], [20219, 0.017969, " Moore", false]]]}, "raw_delta": -0.058897316455841064, "tuned_delta": -0.050325524425262814}, {"byte_start": 5766, "byte_end": 5774, "display": {"text": " purpose", "kind": "normal"}, "is_word": true, "word_id": 969, "word_key": " purpose", "bytes_hex": "20 70 75 72 70 6f 73 65", "compression": {"rwkv": "15.00% 15.00% 15.00% 15.00% 15.00% 15.00% 15.00% 15.00%", "qwen": "13.16% 13.16% 13.16% 13.16% 13.16% 13.16% 13.16% 13.16%"}, "model_tokens": {"rwkv": [[52610, " purpose", "normal", 0.0012786333682015538]], "qwen": [[7428, " purpose", "normal", 0.0029112529009580612]]}, "loss": {"rwkv": 15.004591977995565, "qwen": 13.162725505423662}, "topk": {"rwkv": [52610, 24, 0.0012786333682015538, [[52224, 0.728638, " methods", false], [7933, 0.05501, "ity", false], [45, 0.035518, ",", false], [63370, 0.027367, " computation", false], [61590, 0.025408, " approaches", false], [47202, 0.021693, " search", false], [46, 0.015861, "-", false], [62633, 0.00846, " techniques", false], [64862, 0.006902, " computational", false], [61559, 0.006029, " algorithms", false]]], "qwen": [7428, 16, 0.0029112529009580612, [[5413, 0.702868, " methods", false], [58238, 0.059669, "-purpose", false], [2022, 0.028043, "ization", false], [11, 0.025752, ",", false], [12538, 0.025624, " techniques", false], [19827, 0.023412, " approaches", false], [34447, 0.018258, " computation", false], [4849, 0.013943, "izing", false], [2711, 0.010966, " search", false], [16170, 0.00461, " principles", false]]]}, "raw_delta": 0.10213476419448853, "tuned_delta": 0.11070655622506677}, {"byte_start": 5774, "byte_end": 5782, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 970, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "3.49% 3.49% 3.49% 3.49% 3.49% 3.49% 3.49% 3.49%", "qwen": "1.14% 1.14% 1.14% 1.14% 1.14% 1.14% 1.14% 1.14%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.21236179769039154]], "qwen": [[5413, " methods", "normal", 0.6017976403236389]]}, "loss": {"rwkv": 3.4869826427736172, "qwen": 1.1447650286248554}, "topk": {"rwkv": [52224, 2, 0.21236179769039154, [[63370, 0.399466, " computation", false], [52224, 0.212362, " methods", false], [45, 0.075849, ",", false], [47202, 0.046389, " search", false], [59346, 0.036532, " computing", false], [61590, 0.018706, " approaches", false], [52167, 0.017686, " machine", false], [64862, 0.016841, " computational", false], [56537, 0.015442, " learning", false], [61559, 0.013269, " algorithms", false]]], "qwen": [5413, 1, 0.6017976403236389, [[5413, 0.601798, " methods", false], [34447, 0.076976, " computation", false], [11, 0.038898, ",", false], [12538, 0.035484, " techniques", false], [6832, 0.021442, " learning", false], [19827, 0.019211, " approaches", false], [2711, 0.018296, " search", false], [24231, 0.017946, " computing", false], [25185, 0.015499, " algorithms", false], [7375, 0.010698, " tools", false]]]}, "raw_delta": 0.1298801228404045, "tuned_delta": 0.13845191487098277}, {"byte_start": 5782, "byte_end": 5783, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "35.36%", "qwen": "36.43%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.14271970093250275]], "qwen": [[11, ",", "normal", 0.1326359212398529]]}, "loss": {"rwkv": 35.362935084290015, "qwen": 36.430706570436854}, "topk": {"rwkv": [45, 3, 0.14271970093250275, [[47, 0.2773, ".", false], [32227, 0.192116, " that", false], [45, 0.14272, ",", false], [37810, 0.105475, " based", false], [21700, 0.036589, " for", false], [4811, 0.028232, " to", false], [38888, 0.027374, " lever", false], [4596, 0.022836, " in", false], [5346, 0.021902, "---", false], [21265, 0.020357, " and", false]]], "qwen": [11, 3, 0.1326359212398529, [[429, 0.30262, " that", false], [13, 0.202239, ".", false], [11, 0.132636, ",", false], [3118, 0.076307, " based", false], [369, 0.057671, " for", false], [76482, 0.053195, " leveraging", false], [4421, 0.025408, "---", false], [323, 0.017669, " and", false], [320, 0.012069, " (", false], [315, 0.009734, " of", false]]]}, "raw_delta": -0.05920982360839844, "tuned_delta": -0.05063803157782019}, {"byte_start": 5783, "byte_end": 5786, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 971, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "25.17% 25.17% 25.17%", "qwen": "27.84% 27.84% 27.84%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.015138182789087296]], "qwen": [[315, " of", "normal", 0.009746178984642029]]}, "loss": {"rwkv": 25.172022848843888, "qwen": 27.83728098492755}, "topk": {"rwkv": [4706, 13, 0.015138182789087296, [[21265, 0.219321, " and", false], [40186, 0.088054, " which", false], [37810, 0.070383, " based", false], [32139, 0.05106, " such", false], [61953, 0.048148, " especially", false], [31296, 0.045576, " like", false], [4423, 0.035435, " as", false], [4596, 0.028835, " in", false], [32227, 0.023601, " that", false], [30788, 0.018099, " even", false]]], "qwen": [315, 21, 0.009746178984642029, [[323, 0.2285, " and", false], [892, 0.108199, " which", false], [1741, 0.049188, " such", false], [5310, 0.043817, " especially", false], [5413, 0.043779, " methods", false], [429, 0.04067, " that", false], [3118, 0.03595, " based", false], [304, 0.033636, " in", false], [438, 0.024886, " as", false], [1075, 0.021069, " like", false]]]}, "raw_delta": -0.14779329299926758, "tuned_delta": -0.13922150096868932}, {"byte_start": 5786, "byte_end": 5794, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 972, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "2.50% 2.50% 2.50% 2.50% 2.50% 2.50% 2.50% 2.50%", "qwen": "1.69% 1.69% 1.69% 1.69% 1.69% 1.69% 1.69% 1.69%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.3314961791038513]], "qwen": [[5413, " methods", "normal", 0.4725334644317627]]}, "loss": {"rwkv": 2.5007653296659274, "qwen": 1.6898617563899454}, "topk": {"rwkv": [52224, 1, 0.3314961791038513, [[52224, 0.331496, " methods", false], [63370, 0.076128, " computation", false], [51832, 0.061012, " general", false], [22590, 0.052537, " the", false], [47202, 0.045617, " search", false], [38888, 0.031043, " lever", false], [52195, 0.021047, " massive", false], [56537, 0.017199, " learning", false], [52805, 0.016802, " scaling", false], [39944, 0.015506, " those", false]]], "qwen": [5413, 1, 0.4725334644317627, [[5413, 0.472533, " methods", false], [76482, 0.103653, " leveraging", false], [2711, 0.027005, " search", false], [892, 0.024523, " which", false], [12538, 0.022774, " techniques", false], [279, 0.018274, " the", false], [4586, 0.016407, " general", false], [1667, 0.015324, " using", false], [26943, 0.014974, " scaling", false], [34447, 0.013791, " computation", false]]]}, "raw_delta": 0.044966042041778564, "tuned_delta": 0.053537834072356814}, {"byte_start": 5794, "byte_end": 5799, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 973, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "0.99% 0.99% 0.99% 0.99% 0.99%", "qwen": "0.76% 0.76% 0.76% 0.76% 0.76%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.7592579126358032]], "qwen": [[429, " that", "normal", 0.8100671768188477]]}, "loss": {"rwkv": 0.9932617224870304, "qwen": 0.7597162156659493}, "topk": {"rwkv": [32227, 1, 0.7592579126358032, [[32227, 0.759258, " that", false], [37810, 0.087618, " based", false], [22187, 0.0145, " not", false], [31296, 0.012691, " like", false], [37924, 0.008564, " built", false], [40191, 0.007539, " whose", false], [38888, 0.007425, " lever", false], [21700, 0.007131, " for", false], [4596, 0.006644, " in", false], [55966, 0.006543, " designed", false]]], "qwen": [429, 1, 0.8100671768188477, [[429, 0.810067, " that", false], [3118, 0.062734, " based", false], [76482, 0.010371, " leveraging", false], [537, 0.009305, " not", false], [892, 0.007798, " which", false], [369, 0.006217, " for", false], [304, 0.004875, " in", false], [6693, 0.004694, " whose", false], [315, 0.004501, " of", false], [448, 0.004247, " with", false]]]}, "raw_delta": 0.012950512766838068, "tuned_delta": 0.021522304797416316}, {"byte_start": 5799, "byte_end": 5808, "display": {"text": " continue", "kind": "normal"}, "is_word": true, "word_id": 974, "word_key": " continue", "bytes_hex": "20 63 6f 6e 74 69 6e 75 65", "compression": {"rwkv": "20.04% 20.04% 20.04% 20.04% 20.04% 20.04% 20.04% 20.04% 20.04%", "qwen": "17.37% 17.37% 17.37% 17.37% 17.37% 17.37% 17.37% 17.37% 17.37%"}, "model_tokens": {"rwkv": [[55851, " continue", "normal", 4.608542803907767e-05]], "qwen": [[3060, " continue", "normal", 0.00017152675718534738]]}, "loss": {"rwkv": 20.03743112345782, "qwen": 17.373998869850823}, "topk": {"rwkv": [55851, 480, 4.608542803907767e-05, [[21286, 0.197445, " are", false], [21413, 0.136272, " can", false], [4491, 0.12731, " do", false], [56540, 0.060552, " leverage", false], [32499, 0.054995, " work", false], [31358, 0.031331, " make", false], [39590, 0.030566, " scale", false], [22681, 0.029318, " use", false], [32187, 0.028249, " take", false], [37730, 0.015528, " apply", false]]], "qwen": [3060, 229, 0.00017152675718534738, [[32064, 0.184149, " leverage", false], [646, 0.143933, " can", false], [653, 0.121026, " do", false], [525, 0.112008, " are", false], [1896, 0.035563, " take", false], [5452, 0.028873, " scale", false], [975, 0.026423, " work", false], [1281, 0.025458, " make", false], [990, 0.024203, " use", false], [32194, 0.013727, " exploit", false]]]}, "raw_delta": 0.14769204457600915, "tuned_delta": 0.1562638366065874}, {"byte_start": 5808, "byte_end": 5811, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 975, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.42% 0.42% 0.42%", "qwen": "0.29% 0.29% 0.29%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.9320844411849976]], "qwen": [[311, " to", "normal", 0.9529430270195007]]}, "loss": {"rwkv": 0.42266456276043846, "qwen": 0.28974210546681106}, "topk": {"rwkv": [4811, 1, 0.9320844411849976, [[4811, 0.932084, " to", false], [38888, 0.003386, " lever", false], [22590, 0.003359, " the", false], [45, 0.003307, ",", false], [4596, 0.002794, " in", false], [52805, 0.002777, " scaling", false], [53362, 0.002759, " working", false], [39931, 0.002388, " their", false], [4712, 0.002205, " on", false], [59832, 0.001889, " improving", false]]], "qwen": [311, 1, 0.9529430270195007, [[311, 0.952943, " to", false], [26943, 0.00323, " scaling", false], [6832, 0.002523, " learning", false], [3238, 0.002497, " working", false], [40928, 0.002333, " evolving", false], [18392, 0.001735, " improving", false], [15039, 0.001664, " searching", false], [279, 0.001274, " the", false], [862, 0.001127, " their", false], [304, 0.001102, " in", false]]]}, "raw_delta": 0.007370786120494206, "tuned_delta": 0.015942578151072452}, {"byte_start": 5811, "byte_end": 5817, "display": {"text": " scale", "kind": "normal"}, "is_word": true, "word_id": 976, "word_key": " scale", "bytes_hex": "20 73 63 61 6c 65", "compression": {"rwkv": "5.92% 5.92% 5.92% 5.92% 5.92% 5.92%", "qwen": "8.58% 8.58% 8.58% 8.58% 8.58% 8.58%"}, "model_tokens": {"rwkv": [[39590, " scale", "normal", 0.1392880231142044]], "qwen": [[5452, " scale", "normal", 0.05761812999844551]]}, "loss": {"rwkv": 5.9173038786461385, "qwen": 8.577778030658298}, "topk": {"rwkv": [39590, 2, 0.1392880231142044, [[32499, 0.140866, " work", false], [39590, 0.139288, " scale", false], [51982, 0.134192, " improve", false], [4435, 0.07867, " be", false], [56540, 0.040068, " leverage", false], [31358, 0.025031, " make", false], [52573, 0.024293, " produce", false], [38877, 0.020745, " learn", false], [21751, 0.019687, " get", false], [31017, 0.019045, " grow", false]]], "qwen": [5452, 4, 0.05761812999844551, [[387, 0.151001, " be", false], [975, 0.120046, " work", false], [7269, 0.116449, " improve", false], [5452, 0.057618, " scale", false], [37580, 0.044474, " evolve", false], [1281, 0.040973, " make", false], [3063, 0.036439, " grow", false], [32064, 0.021143, " leverage", false], [8760, 0.01922, " benefit", false], [3960, 0.013668, " learn", false]]]}, "raw_delta": -0.1475280125935872, "tuned_delta": -0.13895622056300894}, {"byte_start": 5817, "byte_end": 5822, "display": {"text": " with", "kind": "normal"}, "is_word": true, "word_id": 977, "word_key": " with", "bytes_hex": "20 77 69 74 68", "compression": {"rwkv": "6.82% 6.82% 6.82% 6.82% 6.82%", "qwen": "4.33% 4.33% 4.33% 4.33% 4.33%"}, "model_tokens": {"rwkv": [[32487, " with", "normal", 0.14969824254512787]], "qwen": [[448, " with", "normal", 0.3008979856967926]]}, "loss": {"rwkv": 6.81898827920174, "qwen": 4.331634156650095}, "topk": {"rwkv": [32487, 1, 0.14969824254512787, [[32487, 0.149698, " with", false], [4596, 0.095813, " in", false], [4423, 0.094629, " as", false], [21265, 0.084582, " and", false], [45, 0.080031, ",", false], [63370, 0.05234, " computation", false], [47, 0.046884, ".", false], [64911, 0.036911, " exponentially", false], [4833, 0.028026, " up", false], [39931, 0.021112, " their", false]]], "qwen": [448, 1, 0.3008979856967926, [[448, 0.300898, " with", false], [438, 0.116872, " as", false], [705, 0.065229, " up", false], [323, 0.064483, " and", false], [11, 0.062953, ",", false], [13, 0.04911, ".", false], [34447, 0.038239, " computation", false], [304, 0.036669, " in", false], [1632, 0.029503, " well", false], [553, 0.024149, " by", false]]]}, "raw_delta": 0.1379281997680664, "tuned_delta": 0.14649999179864465}, {"byte_start": 5822, "byte_end": 5832, "display": {"text": " increased", "kind": "normal"}, "is_word": true, "word_id": 978, "word_key": " increased", "bytes_hex": "20 69 6e 63 72 65 61 73 65 64", "compression": {"rwkv": "6.09% 6.09% 6.09% 6.09% 6.09% 6.09% 6.09% 6.09% 6.09% 6.09%", "qwen": "7.67% 7.67% 7.67% 7.67% 7.67% 7.67% 7.67% 7.67% 7.67% 7.67%"}, "model_tokens": {"rwkv": [[59846, " increased", "normal", 0.03413951396942139]], "qwen": [[7172, " increased", "normal", 0.014236995950341225]]}, "loss": {"rwkv": 6.0863697037503135, "qwen": 7.667763937045909}, "topk": {"rwkv": [59846, 6, 0.03413951396942139, [[22590, 0.22892, " the", false], [63370, 0.133219, " computation", false], [31458, 0.076002, " more", false], [30789, 0.057314, " ever", false], [62092, 0.051011, " increasing", false], [59846, 0.03414, " increased", false], [37045, 0.03338, " Moore", false], [61535, 0.02794, " additional", false], [51816, 0.027925, " further", false], [52195, 0.024579, " massive", false]]], "qwen": [7172, 8, 0.014236995950341225, [[20219, 0.292234, " Moore", false], [279, 0.172921, " the", false], [34447, 0.141059, " computation", false], [7703, 0.047749, " increasing", false], [2500, 0.027034, " available", false], [54480, 0.016824, " computational", false], [803, 0.015453, " more", false], [7172, 0.014237, " increased", false], [10951, 0.012732, " massive", false], [501, 0.01187, " new", false]]]}, "raw_delta": -0.08769111633300782, "tuned_delta": -0.07911932430242957}, {"byte_start": 5832, "byte_end": 5844, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 979, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "1.16% 1.16% 1.16% 1.16% 1.16% 1.16% 1.16% 1.16% 1.16% 1.16% 1.16% 1.16%", "qwen": "0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.45999717712402344]], "qwen": [[34447, " computation", "normal", 0.6468513011932373]]}, "loss": {"rwkv": 1.1623275475912058, "qwen": 0.6546811617302088}, "topk": {"rwkv": [63370, 1, 0.45999717712402344, [[63370, 0.459997, " computation", false], [64862, 0.124821, " computational", false], [59346, 0.078693, " computing", false], [60406, 0.063126, " resources", false], [50897, 0.021716, " amounts", false], [51266, 0.021144, " compute", false], [39339, 0.015046, " power", false], [59206, 0.014973, " available", false], [56353, 0.012508, " hardware", false], [30579, 0.010723, " data", false]]], "qwen": [34447, 1, 0.6468513011932373, [[34447, 0.646851, " computation", false], [54480, 0.09894, " computational", false], [14713, 0.078807, " amounts", false], [24231, 0.046903, " computing", false], [2500, 0.015446, " available", false], [18048, 0.013459, " availability", false], [6366, 0.010488, " computer", false], [2783, 0.006107, " cost", false], [4963, 0.005944, " resources", false], [11773, 0.005312, " hardware", false]]]}, "raw_delta": 0.028149892886479694, "tuned_delta": 0.03672168491705794}, {"byte_start": 5844, "byte_end": 5849, "display": {"text": " even", "kind": "normal"}, "is_word": true, "word_id": 980, "word_key": " even", "bytes_hex": "20 65 76 65 6e", "compression": {"rwkv": "17.47% 17.47% 17.47% 17.47% 17.47%", "qwen": "19.09% 19.09% 19.09% 19.09% 19.09%"}, "model_tokens": {"rwkv": [[30788, " even", "normal", 0.007824920117855072]], "qwen": [[1496, " even", "normal", 0.005025168415158987]]}, "loss": {"rwkv": 17.47013526076479, "qwen": 19.091530938824565}, "topk": {"rwkv": [30788, 8, 0.007824920117855072, [[47, 0.437822, ".", false], [45, 0.262274, ",", false], [21265, 0.148169, " and", false], [5346, 0.016194, "---", false], [31601, 0.01369, " over", false], [4423, 0.009461, " as", false], [275, 0.008932, " (", false], [30788, 0.007825, " even", false], [4596, 0.007705, " in", false], [59206, 0.00638, " available", false]]], "qwen": [1496, 15, 0.005025168415158987, [[13, 0.533932, ".", false], [11, 0.231739, ",", false], [323, 0.065042, " and", false], [2355, 0.018454, " power", false], [2500, 0.016098, " available", false], [320, 0.012527, " (", false], [304, 0.01184, " in", false], [438, 0.010132, " as", false], [4421, 0.00899, "---", false], [382, 0.007814, ".\n\n", false]]]}, "raw_delta": -0.08990926742553706, "tuned_delta": -0.08133747539495882}, {"byte_start": 5849, "byte_end": 5852, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 981, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"rwkv": "6.39% 6.39% 6.39%", "qwen": "6.94% 6.94% 6.94%"}, "model_tokens": {"rwkv": [[4423, " as", "normal", 0.34426066279411316]], "qwen": [[438, " as", "normal", 0.3154607117176056]]}, "loss": {"rwkv": 6.386931170602182, "qwen": 6.935282804396296}, "topk": {"rwkv": [4423, 1, 0.34426066279411316, [[4423, 0.344261, " as", false], [32465, 0.230062, " when", false], [4596, 0.099522, " in", false], [4588, 0.095085, " if", false], [47544, 0.068938, " though", false], [37634, 0.057283, " after", false], [40187, 0.019861, " while", false], [53356, 0.007973, " without", false], [31601, 0.007471, " over", false], [21700, 0.006294, " for", false]]], "qwen": [438, 1, 0.3154607117176056, [[438, 0.315461, " as", false], [979, 0.261261, " when", false], [421, 0.124773, " if", false], [1283, 0.103627, " after", false], [304, 0.055037, " in", false], [3498, 0.036656, " though", false], [1393, 0.022834, " while", false], [7797, 0.017056, " beyond", false], [2041, 0.010729, " without", false], [518, 0.007943, " at", false]]]}, "raw_delta": -0.030407071113586426, "tuned_delta": -0.021835279083008176}, {"byte_start": 5852, "byte_end": 5856, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 982, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "5.92% 5.92% 5.92% 5.92%", "qwen": "5.45% 5.45% 5.45% 5.45%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.2669343650341034]], "qwen": [[279, " the", "normal", 0.2983497083187103]]}, "loss": {"rwkv": 5.9173038786461385, "qwen": 5.452886765268265}, "topk": {"rwkv": [22590, 1, 0.2669343650341034, [[22590, 0.266934, " the", false], [32232, 0.183427, " they", false], [4858, 0.110678, " we", false], [38720, 0.074014, " human", false], [39931, 0.037862, " their", false], [31458, 0.024239, " more", false], [39193, 0.018828, " other", false], [22248, 0.018089, " our", false], [63370, 0.014987, " computation", false], [46227, 0.011221, " humans", false]]], "qwen": [279, 1, 0.2983497083187103, [[279, 0.29835, " the", false], [807, 0.211722, " they", false], [3738, 0.084128, " human", false], [862, 0.071106, " their", false], [34447, 0.025875, " computation", false], [803, 0.025603, " more", false], [582, 0.01675, " we", false], [501, 0.016648, " new", false], [3151, 0.015792, " specific", false], [11811, 0.012698, " researchers", false]]]}, "raw_delta": 0.025752753019332886, "tuned_delta": 0.034324545049911136}, {"byte_start": 5856, "byte_end": 5866, "display": {"text": " available", "kind": "normal"}, "is_word": true, "word_id": 983, "word_key": " available", "bytes_hex": "20 61 76 61 69 6c 61 62 6c 65", "compression": {"rwkv": "8.57% 8.57% 8.57% 8.57% 8.57% 8.57% 8.57% 8.57% 8.57% 8.57%", "qwen": "8.28% 8.28% 8.28% 8.28% 8.28% 8.28% 8.28% 8.28% 8.28% 8.28%"}, "model_tokens": {"rwkv": [[59206, " available", "normal", 0.008583514019846916]], "qwen": [[2500, " available", "normal", 0.010146329179406166]]}, "loss": {"rwkv": 8.56600180527822, "qwen": 8.278623095252737}, "topk": {"rwkv": [59206, 23, 0.008583514019846916, [[45775, 0.115198, " domain", false], [52569, 0.100676, " problem", false], [38720, 0.061424, " human", false], [62680, 0.036014, " underlying", false], [52224, 0.029215, " methods", false], [45157, 0.026914, " amount", false], [56939, 0.021285, " problems", false], [37636, 0.019084, " agent", false], [57103, 0.018668, " research", false], [59943, 0.018022, " knowledge", false]]], "qwen": [2500, 19, 0.010146329179406166, [[34447, 0.102133, " computation", false], [3738, 0.094568, " human", false], [3311, 0.074239, " amount", false], [7947, 0.047311, " domain", false], [3151, 0.036203, " specific", false], [5413, 0.034137, " methods", false], [3491, 0.030156, " problem", false], [6540, 0.021283, " knowledge", false], [54480, 0.019491, " computational", false], [6993, 0.016969, " nature", false]]]}, "raw_delta": 0.015935659408569336, "tuned_delta": 0.024507451439147586}, {"byte_start": 5866, "byte_end": 5878, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 984, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "3.62% 3.62% 3.62% 3.62% 3.62% 3.62% 3.62% 3.62% 3.62% 3.62% 3.62% 3.62%", "qwen": "1.13% 1.13% 1.13% 1.13% 1.13% 1.13% 1.13% 1.13% 1.13% 1.13% 1.13% 1.13%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.09044206142425537]], "qwen": [[34447, " computation", "normal", 0.47061216831207275]]}, "loss": {"rwkv": 3.6161301480615293, "qwen": 1.132697444927869}, "topk": {"rwkv": [63370, 3, 0.09044206142425537, [[38720, 0.459459, " human", false], [59943, 0.184088, " knowledge", false], [63370, 0.090442, " computation", false], [30579, 0.044916, " data", false], [45775, 0.032191, " domain", false], [63637, 0.028861, " information", false], [45157, 0.010843, " amount", false], [60406, 0.010127, " resources", false], [64862, 0.008399, " computational", false], [22363, 0.007413, " raw", false]]], "qwen": [34447, 1, 0.47061216831207275, [[34447, 0.470612, " computation", false], [6540, 0.165297, " knowledge", false], [3738, 0.115396, " human", false], [3311, 0.043473, " amount", false], [54480, 0.022194, " computational", false], [5413, 0.011345, " methods", false], [11773, 0.007348, " hardware", false], [7947, 0.0073, " domain", false], [821, 0.00552, " data", false], [1995, 0.005116, " information", false]]]}, "raw_delta": 0.13771075010299683, "tuned_delta": 0.14628254213357508}, {"byte_start": 5878, "byte_end": 5886, "display": {"text": " becomes", "kind": "normal"}, "is_word": true, "word_id": 985, "word_key": " becomes", "bytes_hex": "20 62 65 63 6f 6d 65 73", "compression": {"rwkv": "8.07% 8.07% 8.07% 8.07% 8.07% 8.07% 8.07% 8.07%", "qwen": "6.26% 6.26% 6.26% 6.26% 6.26% 6.26% 6.26% 6.26%"}, "model_tokens": {"rwkv": [[51019, " becomes", "normal", 0.027750374749302864]], "qwen": [[9044, " becomes", "normal", 0.06228700652718544]]}, "loss": {"rwkv": 8.065848739345034, "qwen": 6.257695165908513}, "topk": {"rwkv": [51019, 6, 0.027750374749302864, [[59847, 0.466229, " increases", false], [38642, 0.213637, " grows", false], [4600, 0.039365, " is", false], [59393, 0.036534, " continues", false], [47181, 0.030308, " scales", false], [51019, 0.02775, " becomes", false], [46342, 0.025315, " itself", false], [30659, 0.019472, " does", false], [51682, 0.007159, " expands", false], [51165, 0.007093, " changes", false]]], "qwen": [9044, 4, 0.06228700652718544, [[12703, 0.253245, " increases", false], [5086, 0.142313, " itself", false], [27715, 0.085325, " grows", false], [9044, 0.062287, " becomes", false], [374, 0.053701, " is", false], [9539, 0.046072, " continues", false], [28405, 0.03588, " scales", false], [39296, 0.033377, " doubles", false], [37168, 0.017151, " rises", false], [5221, 0.016072, " gets", false]]]}, "raw_delta": 0.10026532411575317, "tuned_delta": 0.10883711614633142}, {"byte_start": 5886, "byte_end": 5891, "display": {"text": " very", "kind": "normal"}, "is_word": true, "word_id": 986, "word_key": " very", "bytes_hex": "20 76 65 72 79", "compression": {"rwkv": "14.77% 14.77% 14.77% 14.77% 14.77%", "qwen": "15.78% 15.78% 15.78% 15.78% 15.78%"}, "model_tokens": {"rwkv": [[32386, " very", "normal", 0.016866842284798622]], "qwen": [[1602, " very", "normal", 0.012585463002324104]]}, "loss": {"rwkv": 14.765082059097983, "qwen": 15.780244052345884}, "topk": {"rwkv": [32386, 15, 0.016866842284798622, [[31458, 0.198606, " more", false], [64430, 0.078598, " increasingly", false], [30789, 0.071104, " ever", false], [51867, 0.060054, " greater", false], [47708, 0.049904, " vastly", false], [46397, 0.046751, " larger", false], [32373, 0.040181, " vast", false], [59988, 0.036478, " massively", false], [31466, 0.030799, " much", false], [31277, 0.03058, " less", false]]], "qwen": [1602, 14, 0.012585463002324104, [[803, 0.190779, " more", false], [23048, 0.136486, " cheaper", false], [74151, 0.043393, " exponentially", false], [2686, 0.043111, " less", false], [3512, 0.039846, " ever", false], [14756, 0.035201, " increasingly", false], [1753, 0.026386, " much", false], [52008, 0.024412, " vastly", false], [9155, 0.018486, " smaller", false], [8131, 0.017435, " larger", false]]]}, "raw_delta": -0.05629253387451172, "tuned_delta": -0.04772074184393347}, {"byte_start": 5891, "byte_end": 5897, "display": {"text": " great", "kind": "normal"}, "is_word": true, "word_id": 987, "word_key": " great", "bytes_hex": "20 67 72 65 61 74", "compression": {"rwkv": "14.09% 14.09% 14.09% 14.09% 14.09% 14.09%", "qwen": "14.65% 14.65% 14.65% 14.65% 14.65% 14.65%"}, "model_tokens": {"rwkv": [[38629, " great", "normal", 0.009130761958658695]], "qwen": [[2244, " great", "normal", 0.00763477198779583]]}, "loss": {"rwkv": 14.088818758681281, "qwen": 14.652497629639166}, "topk": {"rwkv": [38629, 11, 0.009130761958658695, [[38864, 0.648381, " large", false], [45, 0.039464, ",", false], [31466, 0.039348, " much", false], [52195, 0.03162, " massive", false], [59682, 0.029665, " expensive", false], [52140, 0.024815, " limited", false], [38006, 0.021361, " cheap", false], [55425, 0.016649, " abundant", false], [32386, 0.013949, " very", false], [31082, 0.012535, " high", false]]], "qwen": [2244, 12, 0.00763477198779583, [[3460, 0.591815, " large", false], [11392, 0.079838, " expensive", false], [11872, 0.058693, " cheap", false], [33248, 0.030851, " costly", false], [10951, 0.025125, " massive", false], [1753, 0.021907, " much", false], [1550, 0.015571, " high", false], [2155, 0.015023, " different", false], [11, 0.01191, ",", false], [2613, 0.010517, " small", false]]]}, "raw_delta": -0.03125699361165368, "tuned_delta": -0.022685201581075433}, {"byte_start": 5897, "byte_end": 5898, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "3.12%", "qwen": "4.96%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.8422117233276367]], "qwen": [[13, ".", "normal", 0.7596530914306641]]}, "loss": {"rwkv": 3.1171511503582336, "qwen": 4.957342404421576}, "topk": {"rwkv": [47, 1, 0.8422117233276367, [[47, 0.842212, ".", false], [45, 0.091486, ",", false], [21265, 0.017741, " and", false], [5346, 0.015824, "---", false], [275, 0.009558, " (", false], [46272, 0.004551, " indeed", false], [4596, 0.002794, " in", false], [59, 0.002333, ":", false], [31601, 0.001695, " over", false], [60, 0.001498, ";", false]]], "qwen": [13, 1, 0.7596530914306641, [[13, 0.759653, ".", false], [11, 0.090143, ",", false], [12824, 0.03693, " indeed", false], [323, 0.028389, " and", false], [382, 0.018928, ".\n\n", false], [320, 0.013618, " (", false], [304, 0.013529, " in", false], [4421, 0.007694, "---", false], [7707, 0.004819, " compared", false], [624, 0.002992, ".\n", false]]]}, "raw_delta": -0.10204187035560608, "tuned_delta": -0.09347007832502784}, {"byte_start": 5898, "byte_end": 5902, "display": {"text": " The", "kind": "normal"}, "is_word": true, "word_id": 988, "word_key": " the", "bytes_hex": "20 54 68 65", "compression": {"rwkv": "9.51% 9.51% 9.51% 9.51%", "qwen": "9.63% 9.63% 9.63% 9.63%"}, "model_tokens": {"rwkv": [[20996, " The", "normal", 0.12276290357112885]], "qwen": [[576, " The", "normal", 0.11811265349388123]]}, "loss": {"rwkv": 9.509952662109866, "qwen": 9.63051465014783}, "topk": {"rwkv": [20996, 1, 0.12276290357112885, [[20996, 0.122763, " The", false], [29894, 0.100596, " This", false], [37453, 0.074076, " These", false], [49964, 0.050826, " Another", false], [3913, 0.046974, " In", false], [3918, 0.040912, " It", false], [4331, 0.037225, " We", false], [19555, 0.025029, " But", false], [37451, 0.023522, " There", false], [300, 0.022858, " A", false]]], "qwen": [576, 1, 0.11811265349388123, [[576, 0.118113, " The", false], [4220, 0.089386, " These", false], [1096, 0.089242, " This", false], [758, 0.044741, " In", false], [1084, 0.040934, " It", false], [18801, 0.036011, " Methods", false], [3251, 0.02725, " General", false], [15132, 0.026036, " Such", false], [1205, 0.022733, " We", false], [362, 0.021711, " A", false]]]}, "raw_delta": -0.006685376167297363, "tuned_delta": 0.001886415863280885}, {"byte_start": 5902, "byte_end": 5906, "display": {"text": " two", "kind": "normal"}, "is_word": true, "word_id": 989, "word_key": " two", "bytes_hex": "20 74 77 6f", "compression": {"rwkv": "25.22% 25.22% 25.22% 25.22%", "qwen": "22.49% 22.49% 22.49% 22.49%"}, "model_tokens": {"rwkv": [[22638, " two", "normal", 0.0037508720997720957]], "qwen": [[1378, " two", "normal", 0.006819556001573801]]}, "loss": {"rwkv": 25.218985578039494, "qwen": 22.487832289277748}, "topk": {"rwkv": [22638, 44, 0.0037508720997720957, [[52224, 0.048183, " methods", false], [45315, 0.046474, " bitter", false], [39193, 0.042814, " other", false], [51832, 0.032339, " general", false], [31461, 0.029584, " most", false], [39339, 0.023737, " power", false], [46430, 0.02333, " lesson", false], [38720, 0.022358, " human", false], [38629, 0.0196, " great", false], [31458, 0.013139, " more", false]]], "qwen": [1378, 22, 0.006819556001573801, [[25180, 0.054846, " bitter", false], [2244, 0.045813, " great", false], [2355, 0.035684, " power", false], [1429, 0.035433, " most", false], [1008, 0.02844, " other", false], [803, 0.023813, " more", false], [1850, 0.019804, " best", false], [17755, 0.019538, " lesson", false], [4586, 0.018616, " general", false], [16724, 0.018521, " ultimate", false]]]}, "raw_delta": 0.15144729614257812, "tuned_delta": 0.16001908817315638}, {"byte_start": 5906, "byte_end": 5914, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 990, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "6.83% 6.83% 6.83% 6.83% 6.83% 6.83% 6.83% 6.83%", "qwen": "7.09% 7.09% 7.09% 7.09% 7.09% 7.09% 7.09% 7.09%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.04795757681131363]], "qwen": [[5413, " methods", "normal", 0.04310791566967964]]}, "loss": {"rwkv": 6.833077097960421, "qwen": 7.0873491476948125}, "topk": {"rwkv": [52224, 3, 0.04795757681131363, [[31461, 0.227209, " most", false], [56162, 0.089797, " examples", false], [52224, 0.047958, " methods", false], [31356, 0.043051, " main", false], [61590, 0.040895, " approaches", false], [51832, 0.034791, " general", false], [39193, 0.028591, " other", false], [21357, 0.027638, " big", false], [38629, 0.026169, " great", false], [38841, 0.021979, " kinds", false]]], "qwen": [5413, 3, 0.04310791566967964, [[1429, 0.319986, " most", false], [2244, 0.061233, " great", false], [5413, 0.043108, " methods", false], [1850, 0.038617, " best", false], [1887, 0.037959, " main", false], [19827, 0.027477, " approaches", false], [6846, 0.022287, " classes", false], [10295, 0.02201, " examples", false], [3598, 0.021598, " major", false], [4586, 0.016298, " general", false]]]}, "raw_delta": -0.014099836349487305, "tuned_delta": -0.0055280443189090565}, {"byte_start": 5914, "byte_end": 5919, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 991, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "1.85% 1.85% 1.85% 1.85% 1.85%", "qwen": "1.54% 1.54% 1.54% 1.54% 1.54%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.600534975528717]], "qwen": [[429, " that", "normal", 0.651837944984436]]}, "loss": {"rwkv": 1.8456352573872479, "qwen": 1.5435369822310456}, "topk": {"rwkv": [32227, 1, 0.600534975528717, [[32227, 0.600535, " that", false], [31461, 0.0362, " most", false], [60003, 0.033344, " mentioned", false], [4596, 0.032641, " in", false], [45, 0.031235, ",", false], [4706, 0.024974, " of", false], [21286, 0.022882, " are", false], [4858, 0.018746, " we", false], [59546, 0.018099, " discussed", false], [5346, 0.010903, "---", false]]], "qwen": [429, 1, 0.651837944984436, [[429, 0.651838, " that", false], [315, 0.050855, " of", false], [1429, 0.033235, " most", false], [11, 0.026012, ",", false], [448, 0.022792, " with", false], [369, 0.017932, " for", false], [304, 0.012973, " in", false], [582, 0.011556, " we", false], [4421, 0.010776, "---", false], [525, 0.009607, " are", false]]]}, "raw_delta": 0.016751885414123535, "tuned_delta": 0.025323677444701785}, {"byte_start": 5919, "byte_end": 5924, "display": {"text": " seem", "kind": "normal"}, "is_word": true, "word_id": 992, "word_key": " seem", "bytes_hex": "20 73 65 65 6d", "compression": {"rwkv": "17.02% 17.02% 17.02% 17.02% 17.02%", "qwen": "14.39% 14.39% 14.39% 14.39% 14.39%"}, "model_tokens": {"rwkv": [[31967, " seem", "normal", 0.008849682286381721]], "qwen": [[2803, " seem", "normal", 0.01850428618490696]]}, "loss": {"rwkv": 17.019293060486987, "qwen": 14.389991337219216}, "topk": {"rwkv": [31967, 16, 0.008849682286381721, [[31059, 0.280323, " have", false], [21286, 0.099518, " are", false], [56041, 0.072332, " dominate", false], [22777, 0.031133, " won", false], [39590, 0.029646, " scale", false], [56540, 0.02449, " leverage", false], [4491, 0.02119, " do", false], [22770, 0.0181, " win", false], [31461, 0.014474, " most", false], [52597, 0.013958, " provide", false]]], "qwen": [2803, 5, 0.01850428618490696, [[614, 0.365672, " have", false], [525, 0.109491, " are", false], [40736, 0.044416, " dominate", false], [582, 0.019356, " we", false], [2803, 0.018504, " seem", false], [653, 0.01835, " do", false], [358, 0.015936, " I", false], [1033, 0.015454, " were", false], [975, 0.013802, " work", false], [29701, 0.01267, " dominated", false]]]}, "raw_delta": 0.14579944610595696, "tuned_delta": 0.15437123813653522}, {"byte_start": 5924, "byte_end": 5927, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 993, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "2.90% 2.90% 2.90%", "qwen": "2.36% 2.36% 2.36%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.6157535910606384]], "qwen": [[311, " to", "normal", 0.6752561926841736]]}, "loss": {"rwkv": 2.8999485278285637, "qwen": 2.360387894722458}, "topk": {"rwkv": [4811, 1, 0.6157535910606384, [[4811, 0.615754, " to", false], [31461, 0.208454, " most", false], [30273, 0.025807, " best", false], [46439, 0.015218, " likely", false], [22590, 0.013669, " the", false], [31296, 0.008436, " like", false], [61953, 0.006983, " especially", false], [45, 0.006332, ",", false], [55971, 0.005988, " destined", false], [64507, 0.004612, " particularly", false]]], "qwen": [311, 1, 0.6752561926841736, [[311, 0.675256, " to", false], [1429, 0.155037, " most", false], [1850, 0.035498, " best", false], [4363, 0.016922, " likely", false], [279, 0.012212, " the", false], [7945, 0.004961, " particularly", false], [5310, 0.003635, " especially", false], [3245, 0.0036, " least", false], [2677, 0.0034, " always", false], [1075, 0.002733, " like", false]]]}, "raw_delta": 0.029919594526290894, "tuned_delta": 0.038491386556869144}, {"byte_start": 5927, "byte_end": 5933, "display": {"text": " scale", "kind": "normal"}, "is_word": true, "word_id": 994, "word_key": " scale", "bytes_hex": "20 73 63 61 6c 65", "compression": {"rwkv": "11.55% 11.55% 11.55% 11.55% 11.55% 11.55%", "qwen": "11.71% 11.71% 11.71% 11.71% 11.71% 11.71%"}, "model_tokens": {"rwkv": [[39590, " scale", "normal", 0.021370796486735344]], "qwen": [[5452, " scale", "normal", 0.02033877931535244]]}, "loss": {"rwkv": 11.55283138211865, "qwen": 11.707547691429212}, "topk": {"rwkv": [39590, 7, 0.021370796486735344, [[4435, 0.256499, " be", false], [31059, 0.189022, " have", false], [56041, 0.07728, " dominate", false], [4491, 0.042717, " do", false], [32499, 0.026914, " work", false], [22770, 0.021801, " win", false], [39590, 0.021371, " scale", false], [52597, 0.020961, " provide", false], [39169, 0.015354, " offer", false], [4660, 0.012185, " me", false]]], "qwen": [5452, 6, 0.02033877931535244, [[614, 0.291799, " have", false], [387, 0.190763, " be", false], [975, 0.063204, " work", false], [40736, 0.052469, " dominate", false], [653, 0.026229, " do", false], [5452, 0.020339, " scale", false], [3010, 0.016682, " offer", false], [6359, 0.01375, " deliver", false], [1850, 0.013632, " best", false], [3410, 0.01356, " provide", false]]]}, "raw_delta": -0.008579293886820438, "tuned_delta": -7.501856242190033e-06}, {"byte_start": 5933, "byte_end": 5945, "display": {"text": " arbitrarily", "kind": "normal"}, "is_word": true, "word_id": 995, "word_key": " arbitrarily", "bytes_hex": "20 61 72 62 69 74 72 61 72 69 6c 79", "compression": {"rwkv": "15.50% 15.50% 15.50% 15.50% 15.50% 15.50% 15.50% 15.50% 15.50% 15.50% 15.50% 15.50%", "qwen": "15.63% 15.63% 15.63% 15.63% 15.63% 15.63% 15.63% 15.63% 15.63% 15.63% 15.63% 15.63%"}, "model_tokens": {"rwkv": [[63293, " arbitrarily", "normal", 3.4344517189310864e-05]], "qwen": [[85657, " arbitrarily", "normal", 3.0418892492889427e-05]]}, "loss": {"rwkv": 15.49770063454941, "qwen": 15.62986786854872}, "topk": {"rwkv": [63293, 355, 3.4344517189310864e-05, [[30273, 0.288058, " best", false], [31461, 0.157965, " most", false], [32487, 0.118358, " with", false], [22590, 0.108727, " the", false], [4596, 0.055994, " in", false], [21286, 0.028604, " are", false], [32234, 0.019026, " this", false], [4811, 0.012696, " to", false], [32458, 0.012521, " well", false], [4424, 0.010743, " at", false]]], "qwen": [85657, 371, 3.0418892492889427e-05, [[279, 0.217243, " the", false], [1850, 0.180104, " best", false], [1429, 0.147235, " most", false], [1632, 0.076015, " well", false], [773, 0.056074, " so", false], [448, 0.047299, " with", false], [304, 0.03944, " in", false], [525, 0.015779, " are", false], [1602, 0.011276, " very", false], [311, 0.010897, " to", false]]]}, "raw_delta": -0.007328907648722294, "tuned_delta": 0.0012428843818559545}, {"byte_start": 5945, "byte_end": 5948, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 996, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "25.92% 25.92% 25.92%", "qwen": "19.13% 19.13% 19.13%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.013327537104487419]], "qwen": [[304, " in", "normal", 0.04151996970176697]]}, "loss": {"rwkv": 25.92342651597356, "qwen": 19.125211734531785}, "topk": {"rwkv": [4596, 7, 0.013327537104487419, [[32458, 0.580077, " well", false], [21286, 0.163976, " are", false], [45, 0.059394, ",", false], [32487, 0.055862, " with", false], [5346, 0.020386, "---", false], [30826, 0.01591, " fast", false], [4596, 0.013328, " in", false], [275, 0.010466, " (", false], [21265, 0.007186, " and", false], [21660, 0.005985, " far", false]]], "qwen": [304, 5, 0.04151996970176697, [[1632, 0.421549, " well", false], [448, 0.154494, " with", false], [525, 0.142794, " are", false], [11, 0.07809, ",", false], [304, 0.04152, " in", false], [323, 0.027385, " and", false], [320, 0.014245, " (", false], [4421, 0.01004, "---", false], [438, 0.008332, " as", false], [311, 0.007703, " to", false]]]}, "raw_delta": 0.3769730726877849, "tuned_delta": 0.38554486471836313}, {"byte_start": 5948, "byte_end": 5953, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 997, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "2.27% 2.27% 2.27% 2.27% 2.27%", "qwen": "3.12% 3.12% 3.12% 3.12% 3.12%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.5358603000640869]], "qwen": [[419, " this", "normal", 0.42092493176460266]]}, "loss": {"rwkv": 2.2682998201476865, "qwen": 3.1209128408892304}, "topk": {"rwkv": [32234, 1, 0.5358603000640869, [[32234, 0.53586, " this", false], [22590, 0.103242, " the", false], [39339, 0.034922, " power", false], [332, 0.029159, " a", false], [32227, 0.024856, " that", false], [39931, 0.024263, " their", false], [3609, 0.01975, " AI", false], [21256, 0.018288, " all", false], [63370, 0.016905, " computation", false], [39920, 0.014474, " terms", false]]], "qwen": [419, 1, 0.42092493176460266, [[419, 0.420925, " this", false], [279, 0.199113, " the", false], [264, 0.028031, " a", false], [3793, 0.022434, " terms", false], [429, 0.019819, " that", false], [15235, 0.015791, " AI", false], [6588, 0.015505, " practice", false], [862, 0.015268, " their", false], [678, 0.014585, " all", false], [34447, 0.011417, " computation", false]]]}, "raw_delta": -0.04727890491485595, "tuned_delta": -0.0387071128842777}, {"byte_start": 5953, "byte_end": 5957, "display": {"text": " way", "kind": "normal"}, "is_word": true, "word_id": 998, "word_key": " way", "bytes_hex": "20 77 61 79", "compression": {"rwkv": "1.24% 1.24% 1.24% 1.24%", "qwen": "1.40% 1.40% 1.40% 1.40%"}, "model_tokens": {"rwkv": [[22752, " way", "normal", 0.7598547339439392]], "qwen": [[1616, " way", "normal", 0.7331099510192871]]}, "loss": {"rwkv": 1.241577153108788, "qwen": 1.3996826851072117}, "topk": {"rwkv": [22752, 1, 0.7598547339439392, [[22752, 0.759855, " way", false], [51717, 0.051551, " fashion", false], [46505, 0.041358, " manner", false], [39631, 0.038833, " sense", false], [47043, 0.037563, " regard", false], [52731, 0.021625, " respect", false], [59526, 0.009479, " direction", false], [51310, 0.007768, " context", false], [30405, 0.004511, " case", false], [32375, 0.003053, " vein", false]]], "qwen": [1616, 1, 0.7331099510192871, [[1616, 0.73311, " way", false], [5530, 0.073809, " sense", false], [11566, 0.067566, " manner", false], [5091, 0.025314, " respect", false], [5250, 0.023959, " regard", false], [11153, 0.023104, " fashion", false], [4586, 0.003667, " general", false], [5106, 0.003347, " direction", false], [2266, 0.003034, " context", false], [8913, 0.002671, " spirit", false]]]}, "raw_delta": -0.008767232298851013, "tuned_delta": -0.00019544026827276496}, {"byte_start": 5957, "byte_end": 5961, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 999, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"rwkv": "0.63% 0.63% 0.63% 0.63%", "qwen": "1.42% 1.42% 1.42% 1.42%"}, "model_tokens": {"rwkv": [[21286, " are", "normal", 0.8693117499351501]], "qwen": [[525, " are", "normal", 0.7301681637763977]]}, "loss": {"rwkv": 0.6295940882785698, "qwen": 1.4178103283153818}, "topk": {"rwkv": [21286, 1, 0.8693117499351501, [[21286, 0.869312, " are", false], [45, 0.06059, ",", false], [5346, 0.015101, "---", false], [4596, 0.010288, " in", false], [275, 0.007978, " (", false], [21265, 0.006446, " and", false], [31059, 0.002976, " have", false], [21700, 0.001804, " for", false], [32462, 0.001268, " were", false], [32227, 0.001243, " that", false]]], "qwen": [525, 1, 0.7301681637763977, [[525, 0.730168, " are", false], [11, 0.117868, ",", false], [4421, 0.057707, "---", false], [320, 0.011839, " (", false], [323, 0.009408, " and", false], [614, 0.008631, " have", false], [304, 0.008361, " in", false], [313, 0.004455, "--", false], [1033, 0.003958, " were", false], [448, 0.002738, " with", false]]]}, "raw_delta": -0.043707989156246185, "tuned_delta": -0.035136197125667935}, {"byte_start": 5961, "byte_end": 5968, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 1000, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "2.07% 2.07% 2.07% 2.07% 2.07% 2.07% 2.07%", "qwen": "1.19% 1.19% 1.19% 1.19% 1.19% 1.19% 1.19%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.45155325531959534]], "qwen": [[2711, " search", "normal", 0.6300439238548279]]}, "loss": {"rwkv": 2.073069045920245, "qwen": 1.190135069230555}, "topk": {"rwkv": [47202, 1, 0.45155325531959534, [[47202, 0.451553, " search", false], [56537, 0.216898, " learning", false], [30597, 0.063031, " deep", false], [22590, 0.024574, " the", false], [52224, 0.015205, " methods", false], [275, 0.014344, " (", false], [51832, 0.014287, " general", false], [59, 0.014113, ":", false], [31978, 0.013708, " self", false], [284, 0.012589, " 1", false]]], "qwen": [2711, 1, 0.6300439238548279, [[2711, 0.630044, " search", false], [5538, 0.037948, " deep", false], [220, 0.03342, " ", false], [71278, 0.0333, " reinforcement", false], [6832, 0.030104, " learning", false], [279, 0.020244, " the", false], [320, 0.019229, " (", false], [29728, 0.015948, " neural", false], [5413, 0.006827, " methods", false], [4586, 0.006082, " general", false]]]}, "raw_delta": 0.04896025572504315, "tuned_delta": 0.0575320477556214}, {"byte_start": 5968, "byte_end": 5972, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 1001, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "0.75% 0.75% 0.75% 0.75%", "qwen": "0.94% 0.94% 0.94% 0.94%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.8481370210647583]], "qwen": [[323, " and", "normal", 0.8115851879119873]]}, "loss": {"rwkv": 0.752871252417031, "qwen": 0.9412047507262832}, "topk": {"rwkv": [21265, 1, 0.8481370210647583, [[21265, 0.848137, " and", false], [275, 0.037155, " (", false], [45, 0.035785, ",", false], [4450, 0.014302, " by", false], [46, 0.009083, "-", false], [21700, 0.007965, " for", false], [4596, 0.007037, " in", false], [48, 0.006575, "/", false], [52224, 0.006182, " methods", false], [5346, 0.005235, "---", false]]], "qwen": [323, 1, 0.8115851879119873, [[323, 0.811585, " and", false], [11, 0.049152, ",", false], [5980, 0.035495, "-based", false], [320, 0.035066, " (", false], [5413, 0.017255, " methods", false], [3118, 0.00808, " based", false], [448, 0.006759, " with", false], [304, 0.004219, " in", false], [553, 0.004205, " by", false], [4421, 0.003902, "---", false]]]}, "raw_delta": -0.010443426668643951, "tuned_delta": -0.0018716346380657032}, {"byte_start": 5972, "byte_end": 5981, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 1002, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "0.09% 0.09% 0.09% 0.09% 0.09% 0.09% 0.09% 0.09% 0.09%", "qwen": "0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.955946683883667]], "qwen": [[6832, " learning", "normal", 0.7982138395309448]]}, "loss": {"rwkv": 0.09001189762490819, "qwen": 0.4516011214976917}, "topk": {"rwkv": [56537, 1, 0.955946683883667, [[56537, 0.955947, " learning", false], [31978, 0.007853, " self", false], [30597, 0.007209, " deep", false], [63885, 0.002888, " statistical", false], [63370, 0.002856, " computation", false], [62577, 0.002222, " statistics", false], [52167, 0.002175, " machine", false], [22590, 0.001699, " the", false], [45, 0.001113, ",", false], [38877, 0.000974, " learn", false]]], "qwen": [6832, 1, 0.7982138395309448, [[6832, 0.798214, " learning", false], [5538, 0.078967, " deep", false], [5662, 0.018328, " machine", false], [71278, 0.009165, " reinforcement", false], [29728, 0.007465, " neural", false], [4586, 0.007452, " general", false], [279, 0.006766, " the", false], [656, 0.006574, " self", false], [28464, 0.004518, " statistical", false], [11, 0.004284, ",", false]]]}, "raw_delta": -0.020050764083862305, "tuned_delta": -0.011478972053284056}, {"byte_start": 5981, "byte_end": 5983, "display": {"text": ".\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e 0a", "compression": {"rwkv": "6.62% 30.29%", "qwen": "20.61% 20.61%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.6958373785018921], [261, "\n\n", "control", 0.03502431884407997]], "qwen": [[382, ".\n\n", "control", 0.03244423121213913]]}, "loss": {"rwkv": 18.45635257387248, "qwen": 20.607891365885145}, "topk": {"rwkv": [47, 1, 0.6958373785018921, [[47, 0.695837, ".", false], [45, 0.143549, ",", false], [4450, 0.058391, " by", false], [5346, 0.044315, "---", false], [275, 0.020473, " (", false], [60, 0.008673, ";", false], [37810, 0.003398, " based", false], [59, 0.002846, ":", false], [4596, 0.002768, " in", false], [22705, 0.002312, " via", false]]], "qwen": [382, 4, 0.03244423121213913, [[13, 0.64142, ".", false], [11, 0.169912, ",", false], [553, 0.05934, " by", false], [382, 0.032444, ".\n\n", false], [320, 0.022388, " (", false], [4421, 0.014733, "---", false], [26, 0.010116, ";", false], [25, 0.006254, ":", false], [624, 0.004282, ".\n", false], [389, 0.003554, " on", false]]]}, "raw_delta": -0.11930664380391431, "tuned_delta": -0.11073485177333607}, {"byte_start": 5983, "byte_end": 5984, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "30.29%", "qwen": "20.61%"}, "model_tokens": {"rwkv": [[261, "\n\n", "control", 0.03502431884407997]], "qwen": [[382, ".\n\n", "control", 0.03244423121213913]]}, "loss": {"rwkv": 30.290960331164754, "qwen": 20.607891365885145}, "topk": {"rwkv": [261, 7, 0.03502431884407997, [[20996, 0.118947, " The", false], [44844, 0.08454, " Search", false], [37453, 0.06573, " These", false], [29893, 0.049894, " They", false], [3913, 0.043841, " In", false], [28530, 0.038686, " Both", false], [261, 0.035024, "\n\n", false], [29894, 0.030989, " This", false], [37451, 0.02994, " There", false], [3918, 0.029626, " It", false]]], "qwen": [382, 4, 0.03244423121213913, [[13, 0.64142, ".", false], [11, 0.169912, ",", false], [553, 0.05934, " by", false], [382, 0.032444, ".\n\n", false], [320, 0.022388, " (", false], [4421, 0.014733, "---", false], [26, 0.010116, ";", false], [25, 0.006254, ":", false], [624, 0.004282, ".\n", false], [389, 0.003554, " on", false]]]}, "raw_delta": 0.5369433561960857, "tuned_delta": 0.5455151482266639}, {"byte_start": 5984, "byte_end": 5987, "display": {"text": "The", "kind": "normal"}, "is_word": true, "word_id": 1003, "word_key": "the", "bytes_hex": "54 68 65", "compression": {"rwkv": "10.75% 10.75% 10.75%", "qwen": "11.43% 11.43% 11.43%"}, "model_tokens": {"rwkv": [[6699, "The", "normal", 0.167260080575943]], "qwen": [[785, "The", "normal", 0.14927057921886444]]}, "loss": {"rwkv": 10.754464985793378, "qwen": 11.433325654194736}, "topk": {"rwkv": [6699, 1, 0.167260080575943, [[6699, 0.16726, "The", false], [1136, 0.07729, "In", false], [40754, 0.060815, "Search", false], [48358, 0.059455, "Another", false], [66, 0.048495, "A", false], [33504, 0.04158, "There", false], [24242, 0.032702, "This", false], [1141, 0.027615, "It", false], [1589, 0.026254, "We", false], [6393, 0.021957, "One", false]]], "qwen": [785, 1, 0.14927057921886444, [[785, 0.149271, "The", false], [5890, 0.131513, "Search", false], [641, 0.051216, "In", false], [14037, 0.033545, "Another", false], [32, 0.029603, "A", false], [3862, 0.029517, "There", false], [2132, 0.018916, "It", false], [1986, 0.01801, "This", false], [3966, 0.017081, "One", false], [1654, 0.015245, "We", false]]]}, "raw_delta": -0.037644028663635254, "tuned_delta": -0.029072236633057004}, {"byte_start": 5987, "byte_end": 5994, "display": {"text": " second", "kind": "normal"}, "is_word": true, "word_id": 1004, "word_key": " second", "bytes_hex": "20 73 65 63 6f 6e 64", "compression": {"rwkv": "7.53% 7.53% 7.53% 7.53% 7.53% 7.53% 7.53%", "qwen": "7.41% 7.41% 7.41% 7.41% 7.41% 7.41% 7.41%"}, "model_tokens": {"rwkv": [[47205, " second", "normal", 0.05338800325989723]], "qwen": [[2086, " second", "normal", 0.05633553862571716]]}, "loss": {"rwkv": 7.527454593924, "qwen": 7.410376790125389}, "topk": {"rwkv": [47205, 2, 0.05338800325989723, [[39193, 0.078959, " other", false], [47205, 0.053388, " second", false], [45315, 0.042152, " bitter", false], [38499, 0.040274, " first", false], [47202, 0.0356, " search", false], [46430, 0.021967, " lesson", false], [31515, 0.020945, " next", false], [31461, 0.020122, " most", false], [45184, 0.018424, " appeal", false], [19523, 0.017487, " Bit", false]]], "qwen": [2086, 3, 0.05633553862571716, [[25180, 0.123237, " bitter", false], [1008, 0.085452, " other", false], [2086, 0.056336, " second", false], [17755, 0.025586, " lesson", false], [1156, 0.024374, " first", false], [425, 0.024121, " B", false], [1378, 0.023931, " two", false], [2711, 0.02016, " search", false], [1790, 0.019953, " next", false], [1429, 0.018854, " most", false]]]}, "raw_delta": 0.006492171968732585, "tuned_delta": 0.015063963999310833}, {"byte_start": 5994, "byte_end": 6002, "display": {"text": " general", "kind": "normal"}, "is_word": true, "word_id": 1005, "word_key": " general", "bytes_hex": "20 67 65 6e 65 72 61 6c", "compression": {"rwkv": "10.92% 10.92% 10.92% 10.92% 10.92% 10.92% 10.92% 10.92%", "qwen": "13.77% 13.77% 13.77% 13.77% 13.77% 13.77% 13.77% 13.77%"}, "model_tokens": {"rwkv": [[51832, " general", "normal", 0.007929818704724312]], "qwen": [[4586, " general", "normal", 0.0022193738259375095]]}, "loss": {"rwkv": 10.918834537977993, "qwen": 13.774423723988388}, "topk": {"rwkv": [51832, 13, 0.007929818704724312, [[46430, 0.444956, " lesson", false], [39941, 0.236752, " thing", false], [21357, 0.0326, " big", false], [45, 0.02639, ",", false], [59829, 0.022833, " important", false], [4600, 0.018489, " is", false], [38629, 0.016371, " great", false], [45315, 0.013829, " bitter", false], [38961, 0.01184, " major", false], [21365, 0.011642, " bit", false]]], "qwen": [4586, 32, 0.0022193738259375095, [[17755, 0.239377, " lesson", false], [3166, 0.11453, " thing", false], [25180, 0.067352, " bitter", false], [2409, 0.06589, " big", false], [1429, 0.053341, " most", false], [2989, 0.039198, " important", false], [2244, 0.033994, " great", false], [949, 0.02987, " part", false], [374, 0.025651, " is", false], [1459, 0.022695, " point", false]]]}, "raw_delta": -0.158347487449646, "tuned_delta": -0.14977569541906774}, {"byte_start": 6002, "byte_end": 6008, "display": {"text": " point", "kind": "normal"}, "is_word": true, "word_id": 1006, "word_key": " point", "bytes_hex": "20 70 6f 69 6e 74", "compression": {"rwkv": "11.93% 11.93% 11.93% 11.93% 11.93% 11.93%", "qwen": "13.17% 13.17% 13.17% 13.17% 13.17% 13.17%"}, "model_tokens": {"rwkv": [[39310, " point", "normal", 0.01900864765048027]], "qwen": [[1459, " point", "normal", 0.012501237913966179]]}, "loss": {"rwkv": 11.928533215683485, "qwen": 13.170385541033655}, "topk": {"rwkv": [39310, 6, 0.01900864765048027, [[46430, 0.635106, " lesson", false], [46561, 0.116598, " method", false], [60250, 0.032214, " principle", false], [63729, 0.022525, " observation", false], [52610, 0.020929, " purpose", false], [39310, 0.019009, " point", false], [38046, 0.014627, " class", false], [55532, 0.012005, " approach", false], [52022, 0.011643, " insight", false], [46, 0.009202, "-", false]]], "qwen": [1459, 8, 0.012501237913966179, [[17755, 0.291199, " lesson", false], [1714, 0.180131, " method", false], [58238, 0.152266, "-purpose", false], [2022, 0.074681, "ization", false], [7428, 0.073605, " purpose", false], [17508, 0.0455, " principle", false], [5486, 0.015525, " approach", false], [1459, 0.012501, " point", false], [5912, 0.009425, " rule", false], [8335, 0.008556, "izable", false]]]}, "raw_delta": -0.0688629150390625, "tuned_delta": -0.06029112300848425}, {"byte_start": 6008, "byte_end": 6011, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 1007, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "13.90% 13.90% 13.90%", "qwen": "10.77% 10.77% 10.77%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.09831735491752625]], "qwen": [[311, " to", "normal", 0.16670064628124237]]}, "loss": {"rwkv": 13.900967841898865, "qwen": 10.769451840627315}, "topk": {"rwkv": [4811, 3, 0.09831735491752625, [[4600, 0.585693, " is", false], [32227, 0.135859, " that", false], [4811, 0.098317, " to", false], [45, 0.039834, ",", false], [4706, 0.025722, " of", false], [4858, 0.01797, " we", false], [30917, 0.014022, " from", false], [37598, 0.009947, " about", false], [47266, 0.00759, " should", false], [55817, 0.005214, " concerns", false]]], "qwen": [311, 3, 0.16670064628124237, [[374, 0.369789, " is", false], [429, 0.215947, " that", false], [311, 0.166701, " to", false], [911, 0.052649, " about", false], [315, 0.040486, " of", false], [504, 0.027561, " from", false], [11, 0.024677, ",", false], [582, 0.01348, " we", false], [304, 0.010125, " in", false], [358, 0.009444, " I", false]]]}, "raw_delta": 0.17364811897277832, "tuned_delta": 0.18221991100335658}, {"byte_start": 6011, "byte_end": 6014, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 1008, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"rwkv": "6.11% 6.11% 6.11%", "qwen": "4.18% 4.18% 4.18%"}, "model_tokens": {"rwkv": [[4435, " be", "normal", 0.3609258234500885]], "qwen": [[387, " be", "normal", 0.4988078474998474]]}, "loss": {"rwkv": 6.105154795428556, "qwen": 4.1810164805473455}, "topk": {"rwkv": [4435, 1, 0.3609258234500885, [[4435, 0.360926, " be", false], [38877, 0.262821, " learn", false], [32187, 0.127006, " take", false], [31539, 0.038513, " note", false], [31358, 0.035555, " make", false], [62683, 0.03092, " understand", false], [30681, 0.01531, " draw", false], [38625, 0.012491, " grasp", false], [31205, 0.008879, " keep", false], [45846, 0.007584, " emerge", false]]], "qwen": [387, 1, 0.4988078474998474, [[387, 0.498808, " be", false], [3960, 0.15009, " learn", false], [1281, 0.088365, " make", false], [1896, 0.042628, " take", false], [5185, 0.040671, " note", false], [3535, 0.036939, " understand", false], [32944, 0.021993, " emerge", false], [4038, 0.017, " draw", false], [2908, 0.011306, " consider", false], [2525, 0.009433, " come", false]]]}, "raw_delta": 0.10669688383738202, "tuned_delta": 0.11526867586796026}, {"byte_start": 6014, "byte_end": 6022, "display": {"text": " learned", "kind": "normal"}, "is_word": true, "word_id": 1009, "word_key": " learned", "bytes_hex": "20 6c 65 61 72 6e 65 64", "compression": {"rwkv": "0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45%", "qwen": "0.95% 0.95% 0.95% 0.95% 0.95% 0.95% 0.95% 0.95%"}, "model_tokens": {"rwkv": [[52112, " learned", "normal", 0.8210574984550476]], "qwen": [[9498, " learned", "normal", 0.6572651267051697]]}, "loss": {"rwkv": 0.4468797200019219, "qwen": 0.9460197275046579}, "topk": {"rwkv": [52112, 1, 0.8210574984550476, [[52112, 0.821057, " learned", false], [31351, 0.078871, " made", false], [38297, 0.025474, " drawn", false], [39887, 0.010846, " taken", false], [51438, 0.009887, " derived", false], [62684, 0.009239, " understood", false], [39140, 0.005854, " noted", false], [59697, 0.004733, " extracted", false], [46071, 0.002809, " gained", false], [21762, 0.002261, " gle", false]]], "qwen": [9498, 1, 0.6572651267051697, [[9498, 0.657265, " learned", false], [1865, 0.20109, " made", false], [14764, 0.041951, " drawn", false], [15985, 0.020831, " understood", false], [4429, 0.011879, " taken", false], [94016, 0.009719, " glean", false], [14257, 0.008286, " derived", false], [49250, 0.004656, " learnt", false], [10342, 0.004631, " noted", false], [27432, 0.004047, " extracted", false]]]}, "raw_delta": -0.027678199112415314, "tuned_delta": -0.019106407081837064}, {"byte_start": 6022, "byte_end": 6027, "display": {"text": " from", "kind": "normal"}, "is_word": true, "word_id": 1010, "word_key": " from", "bytes_hex": "20 66 72 6f 6d", "compression": {"rwkv": "3.86% 3.86% 3.86% 3.86% 3.86%", "qwen": "2.35% 2.35% 2.35% 2.35% 2.35%"}, "model_tokens": {"rwkv": [[30917, " from", "normal", 0.3454531133174896]], "qwen": [[504, " from", "normal", 0.5210452675819397]]}, "loss": {"rwkv": 3.860336339878671, "qwen": 2.3512986474540782}, "topk": {"rwkv": [30917, 2, 0.3454531133174896, [[4600, 0.592108, " is", false], [30917, 0.345453, " from", false], [45, 0.019722, ",", false], [4450, 0.00699, " by", false], [31077, 0.004617, " here", false], [37598, 0.003657, " about", false], [4596, 0.003493, " in", false], [21800, 0.002493, " has", false], [47266, 0.002059, " should", false], [52694, 0.001808, " relates", false]]], "qwen": [504, 1, 0.5210452675819397, [[504, 0.521045, " from", false], [374, 0.421965, " is", false], [11, 0.026251, ",", false], [911, 0.004493, " about", false], [1588, 0.004179, " here", false], [304, 0.004135, " in", false], [320, 0.002605, " (", false], [553, 0.001493, " by", false], [429, 0.000956, " that", false], [702, 0.000948, " has", false]]]}, "raw_delta": 0.08367881774902342, "tuned_delta": 0.09225060977960166}, {"byte_start": 6027, "byte_end": 6031, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1011, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "0.91% 0.91% 0.91% 0.91%", "qwen": "1.49% 1.49% 1.49% 1.49%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.8171052932739258]], "qwen": [[279, " the", "normal", 0.7185409665107727]]}, "loss": {"rwkv": 0.9069677075901075, "qwen": 1.4901802247141136}, "topk": {"rwkv": [22590, 1, 0.8171052932739258, [[22590, 0.817105, " the", false], [32234, 0.11575, " this", false], [45315, 0.014828, " bitter", false], [39936, 0.010304, " these", false], [51929, 0.00431, " history", false], [3609, 0.003942, " AI", false], [31636, 0.00205, " past", false], [21256, 0.001959, " all", false], [22248, 0.001788, " our", false], [332, 0.001571, " a", false]]], "qwen": [279, 1, 0.7185409665107727, [[279, 0.718541, " the", false], [419, 0.167578, " this", false], [1493, 0.048285, " these", false], [678, 0.017376, " all", false], [25180, 0.007513, " bitter", false], [20219, 0.003286, " Moore", false], [220, 0.00309, " ", false], [264, 0.002845, " a", false], [15235, 0.002356, " AI", false], [1039, 0.002221, " our", false]]]}, "raw_delta": -0.032340168952941895, "tuned_delta": -0.023768376922363645}, {"byte_start": 6031, "byte_end": 6038, "display": {"text": " bitter", "kind": "normal"}, "is_word": true, "word_id": 1012, "word_key": " bitter", "bytes_hex": "20 62 69 74 74 65 72", "compression": {"rwkv": "0.11% 0.11% 0.11% 0.11% 0.11% 0.11% 0.11%", "qwen": "0.06% 0.06% 0.06% 0.06% 0.06% 0.06% 0.06%"}, "model_tokens": {"rwkv": [[45315, " bitter", "normal", 0.9597883820533752]], "qwen": [[25180, " bitter", "normal", 0.9765259623527527]]}, "loss": {"rwkv": 0.10566614069010961, "qwen": 0.061195885097820216}, "topk": {"rwkv": [45315, 1, 0.9597883820533752, [[45315, 0.959788, " bitter", false], [61640, 0.012349, " bitterness", false], [51929, 0.003987, " history", false], [21365, 0.00252, " bit", false], [31636, 0.001694, " past", false], [19523, 0.001433, " Bit", false], [62061, 0.001389, " historical", false], [46430, 0.001035, " lesson", false], [52127, 0.000987, " lessons", false], [31323, 0.000483, " long", false]]], "qwen": [25180, 1, 0.9765259623527527, [[25180, 0.976526, " bitter", false], [78996, 0.005516, " bitterness", false], [17755, 0.001699, " lesson", false], [3840, 0.001541, " history", false], [425, 0.001217, " B", false], [3403, 0.00092, " above", false], [18366, 0.000657, " lessons", false], [13656, 0.000452, " historical", false], [3412, 0.000375, " research", false], [3139, 0.000287, " experience", false]]]}, "raw_delta": 0.002465954582606043, "tuned_delta": 0.01103774661318429}, {"byte_start": 6038, "byte_end": 6045, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 1013, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"rwkv": "0.11% 0.11% 0.11% 0.11% 0.11% 0.11% 0.11%", "qwen": "0.08% 0.08% 0.08% 0.08% 0.08% 0.08% 0.08%"}, "model_tokens": {"rwkv": [[46430, " lesson", "normal", 0.9592282176017761]], "qwen": [[17755, " lesson", "normal", 0.970899760723114]]}, "loss": {"rwkv": 0.10692407093642042, "qwen": 0.07608165533722623}, "topk": {"rwkv": [46430, 1, 0.9592282176017761, [[46430, 0.959228, " lesson", false], [52127, 0.034556, " lessons", false], [61979, 0.002478, " experience", false], [46, 0.000568, "-", false], [31636, 0.000347, " past", false], [26127, 0.000233, "less", false], [39899, 0.000181, " taste", false], [4600, 0.000177, " is", false], [51929, 0.000101, " history", false], [45, 9.6e-05, ",", false]]], "qwen": [17755, 1, 0.970899760723114, [[17755, 0.9709, " lesson", false], [18366, 0.014189, " lessons", false], [3139, 0.006979, " experience", false], [3840, 0.001089, " history", false], [11, 0.000636, ",", false], [15235, 0.000578, " AI", false], [323, 0.000363, " and", false], [320, 0.000222, " (", false], [12, 0.000184, "-", false], [512, 0.000149, " le", false]]]}, "raw_delta": 0.001710266673139164, "tuned_delta": 0.010282058703717413}, {"byte_start": 6045, "byte_end": 6048, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 1014, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "0.28% 0.28% 0.28%", "qwen": "0.40% 0.40% 0.40%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.9542855620384216]], "qwen": [[374, " is", "normal", 0.9348880052566528]]}, "loss": {"rwkv": 0.28324396046098826, "qwen": 0.4047272649340828}, "topk": {"rwkv": [4600, 1, 0.9542855620384216, [[4600, 0.954286, " is", false], [45, 0.014459, ",", false], [21800, 0.004434, " has", false], [55817, 0.004251, " concerns", false], [4706, 0.003805, " of", false], [4596, 0.002038, " in", false], [47266, 0.001625, " should", false], [52694, 0.001195, " relates", false], [275, 0.001172, " (", false], [37598, 0.001067, " about", false]]], "qwen": [374, 1, 0.9348880052566528, [[374, 0.934888, " is", false], [11, 0.019629, ",", false], [315, 0.014443, " of", false], [10520, 0.003587, " concerns", false], [320, 0.002818, " (", false], [429, 0.002524, " that", false], [304, 0.00217, " in", false], [702, 0.002084, " has", false], [911, 0.002025, " about", false], [4421, 0.001162, "---", false]]]}, "raw_delta": -0.00673646479845047, "tuned_delta": 0.0018353272321277782}, {"byte_start": 6048, "byte_end": 6053, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 1015, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "0.97% 0.97% 0.97% 0.97% 0.97%", "qwen": "1.29% 1.29% 1.29% 1.29% 1.29%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.7683013677597046]], "qwen": [[429, " that", "normal", 0.6995595693588257]]}, "loss": {"rwkv": 0.9650840849696678, "qwen": 1.2887028716958038}, "topk": {"rwkv": [32227, 1, 0.7683013677597046, [[32227, 0.768301, " that", false], [22590, 0.12915, " the", false], [21835, 0.018802, " how", false], [4811, 0.015453, " to", false], [32234, 0.009228, " this", false], [332, 0.009012, " a", false], [37598, 0.005823, " about", false], [32464, 0.005314, " what", false], [45, 0.005166, ",", false], [22763, 0.002526, " why", false]]], "qwen": [429, 1, 0.6995595693588257, [[429, 0.69956, " that", false], [279, 0.185011, " the", false], [911, 0.015583, " about", false], [311, 0.014676, " to", false], [419, 0.011509, " this", false], [264, 0.008822, " a", false], [1246, 0.00828, " how", false], [537, 0.005344, " not", false], [1128, 0.005076, " what", false], [825, 0.00361, " one", false]]]}, "raw_delta": -0.017945235967636114, "tuned_delta": -0.009373443937057866}, {"byte_start": 6053, "byte_end": 6057, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1016, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "7.89% 7.89% 7.89% 7.89%", "qwen": "8.51% 8.51% 8.51% 8.51%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.17340393364429474]], "qwen": [[279, " the", "normal", 0.1515452116727829]]}, "loss": {"rwkv": 7.889738504861517, "qwen": 8.506812256157275}, "topk": {"rwkv": [22590, 1, 0.17340393364429474, [[22590, 0.173404, " the", false], [45, 0.061805, ",", false], [4601, 0.060114, " it", false], [38720, 0.053581, " human", false], [39934, 0.048522, " there", false], [4858, 0.031781, " we", false], [47202, 0.026266, " search", false], [4596, 0.02513, " in", false], [56537, 0.020867, " learning", false], [52224, 0.018407, " methods", false]]], "qwen": [279, 1, 0.1515452116727829, [[279, 0.151545, " the", false], [1052, 0.060307, " there", false], [3738, 0.059422, " human", false], [432, 0.053269, " it", false], [11, 0.04297, ",", false], [582, 0.033542, " we", false], [304, 0.030668, " in", false], [4586, 0.024622, " general", false], [5413, 0.017795, " methods", false], [264, 0.017794, " a", false]]]}, "raw_delta": -0.03421783447265625, "tuned_delta": -0.025646042442078}, {"byte_start": 6057, "byte_end": 6064, "display": {"text": " actual", "kind": "normal"}, "is_word": true, "word_id": 1017, "word_key": " actual", "bytes_hex": "20 61 63 74 75 61 6c", "compression": {"rwkv": "18.36% 18.36% 18.36% 18.36% 18.36% 18.36% 18.36%", "qwen": "18.34% 18.34% 18.34% 18.34% 18.34% 18.34% 18.34%"}, "model_tokens": {"rwkv": [[45098, " actual", "normal", 0.0008110906346701086]], "qwen": [[5042, " actual", "normal", 0.0008084636065177619]]}, "loss": {"rwkv": 18.355718154167608, "qwen": 18.343802213357833}, "topk": {"rwkv": [45098, 177, 0.0008110906346701086, [[38720, 0.093456, " human", false], [52224, 0.041066, " methods", false], [22638, 0.032892, " two", false], [31461, 0.029555, " most", false], [47202, 0.023482, " search", false], [45184, 0.020337, " appeal", false], [30273, 0.018515, " best", false], [22752, 0.015234, " way", false], [31581, 0.014188, " only", false], [22681, 0.011798, " use", false]]], "qwen": [5042, 193, 0.0008084636065177619, [[3738, 0.05743, " human", false], [1429, 0.036709, " most", false], [1850, 0.02961, " best", false], [1378, 0.027693, " two", false], [2070, 0.019168, " field", false], [25180, 0.013765, " bitter", false], [803, 0.013295, " more", false], [5413, 0.013289, " methods", false], [2711, 0.013264, " search", false], [1172, 0.013, " only", false]]]}, "raw_delta": 0.000660760062081378, "tuned_delta": 0.009232552092659626}, {"byte_start": 6064, "byte_end": 6073, "display": {"text": " contents", "kind": "normal"}, "is_word": true, "word_id": 1018, "word_key": " contents", "bytes_hex": "20 63 6f 6e 74 65 6e 74 73", "compression": {"rwkv": "14.21% 14.21% 14.21% 14.21% 14.21% 14.21% 14.21% 14.21% 14.21%", "qwen": "15.03% 15.03% 15.03% 15.03% 15.03% 15.03% 15.03% 15.03% 15.03%"}, "model_tokens": {"rwkv": [[55847, " contents", "normal", 0.000837124593090266]], "qwen": [[8794, " contents", "normal", 0.0005515777156688273]]}, "loss": {"rwkv": 14.214052703202896, "qwen": 15.03353856905412}, "topk": {"rwkv": [55847, 198, 0.000837124593090266, [[52224, 0.063427, " methods", false], [56950, 0.028036, " progress", false], [53052, 0.021613, " success", false], [38720, 0.020718, " human", false], [63370, 0.020555, " computation", false], [57103, 0.019124, " research", false], [22752, 0.015117, " way", false], [62633, 0.014898, " techniques", false], [52571, 0.013858, " process", false], [51308, 0.013646, " content", false]]], "qwen": [8794, 287, 0.0005515777156688273, [[3738, 0.026625, " human", false], [3311, 0.024815, " amount", false], [5413, 0.023012, " methods", false], [5068, 0.02043, " performance", false], [2393, 0.017845, " success", false], [8129, 0.016658, " implementation", false], [897, 0.01486, " value", false], [11, 0.013857, ",", false], [6832, 0.013082, " learning", false], [990, 0.013004, " use", false]]]}, "raw_delta": -0.045441945393880245, "tuned_delta": -0.036870153363301995}, {"byte_start": 6073, "byte_end": 6076, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 1019, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.24% 0.24% 0.24%", "qwen": "0.24% 0.24% 0.24%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9604994058609009]], "qwen": [[315, " of", "normal", 0.9605894684791565]]}, "loss": {"rwkv": 0.24361915770219716, "qwen": 0.24170031949848864}, "topk": {"rwkv": [4706, 1, 0.9604994058609009, [[4706, 0.960499, " of", false], [21265, 0.014781, " and", false], [45, 0.00482, ",", false], [32227, 0.004616, " that", false], [4715, 0.004418, " or", false], [275, 0.001733, " (", false], [21286, 0.001075, " are", false], [4596, 0.001068, " in", false], [46530, 0.000867, " matter", false], [5346, 0.000758, "---", false]]], "qwen": [315, 1, 0.9605894684791565, [[315, 0.960589, " of", false], [323, 0.017903, " and", false], [11, 0.005787, ",", false], [429, 0.002832, " that", false], [320, 0.002554, " (", false], [476, 0.002003, " or", false], [525, 0.001233, " are", false], [4925, 0.000675, " matter", false], [4421, 0.00062, "---", false], [304, 0.000604, " in", false]]]}, "raw_delta": 0.00010640298326810259, "tuned_delta": 0.00867819501384635}, {"byte_start": 6076, "byte_end": 6082, "display": {"text": " minds", "kind": "normal"}, "is_word": true, "word_id": 1020, "word_key": " minds", "bytes_hex": "20 6d 69 6e 64 73", "compression": {"rwkv": "24.04% 24.04% 24.04% 24.04% 24.04% 24.04%", "qwen": "22.99% 22.99% 22.99% 22.99% 22.99% 22.99%"}, "model_tokens": {"rwkv": [[39026, " minds", "normal", 0.0003299340314697474]], "qwen": [[20062, " minds", "normal", 0.0004761377349495888]]}, "loss": {"rwkv": 24.044917348149387, "qwen": 22.992360593848883}, "topk": {"rwkv": [39026, 91, 0.0003299340314697474, [[22590, 0.358819, " the", false], [332, 0.089015, " a", false], [59943, 0.077085, " knowledge", false], [38720, 0.056439, " human", false], [3609, 0.052565, " AI", false], [39936, 0.036217, " these", false], [22248, 0.029482, " our", false], [32464, 0.027882, " what", false], [52224, 0.025358, " methods", false], [4419, 0.022947, " an", false]]], "qwen": [20062, 80, 0.0004761377349495888, [[279, 0.313124, " the", false], [3738, 0.179506, " human", false], [6540, 0.121824, " knowledge", false], [264, 0.092694, " a", false], [1039, 0.031638, " our", false], [458, 0.027065, " an", false], [1128, 0.023767, " what", false], [894, 0.013029, " any", false], [825, 0.012983, " one", false], [15235, 0.012561, " AI", false]]]}, "raw_delta": 0.058366139729817634, "tuned_delta": 0.06693793176039588}, {"byte_start": 6082, "byte_end": 6086, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 1021, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"rwkv": "5.67% 5.67% 5.67% 5.67%", "qwen": "4.95% 4.95% 4.95% 4.95%"}, "model_tokens": {"rwkv": [[21286, " are", "normal", 0.2817038893699646]], "qwen": [[525, " are", "normal", 0.3335510194301605]]}, "loss": {"rwkv": 5.670749550369216, "qwen": 4.950064313615376}, "topk": {"rwkv": [21286, 1, 0.2817038893699646, [[21286, 0.281704, " are", false], [45, 0.179858, ",", false], [21265, 0.077366, " and", false], [4600, 0.053538, " is", false], [5346, 0.048175, "---", false], [4491, 0.045656, " do", false], [4715, 0.031378, " or", false], [275, 0.027799, " (", false], [4706, 0.024976, " of", false], [32227, 0.022278, " that", false]]], "qwen": [525, 1, 0.3335510194301605, [[525, 0.333551, " are", false], [11, 0.114802, ",", false], [4421, 0.079364, "---", false], [323, 0.063299, " and", false], [4925, 0.05121, " matter", false], [653, 0.043679, " do", false], [320, 0.036484, " (", false], [646, 0.036335, " can", false], [1745, 0.021339, " differ", false], [429, 0.018434, " that", false]]]}, "raw_delta": 0.03996327519416809, "tuned_delta": 0.04853506722474634}, {"byte_start": 6086, "byte_end": 6099, "display": {"text": " tremendously", "kind": "normal"}, "is_word": true, "word_id": 1022, "word_key": " tremendously", "bytes_hex": "20 74 72 65 6d 65 6e 64 6f 75 73 6c 79", "compression": {"rwkv": "14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 0.06% 0.06%", "qwen": "12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55%"}, "model_tokens": {"rwkv": [[62670, " tremendous", "normal", 0.00010990122973453254], [2030, "ly", "normal", 0.9931179285049438]], "qwen": [[71323, " tremendously", "normal", 0.00011814780737040564]]}, "loss": {"rwkv": 12.667829304192416, "qwen": 12.545307540774282}, "topk": {"rwkv": [62670, 312, 0.00010990122973453254, [[22187, 0.270501, " not", false], [62161, 0.149868, " irrelevant", false], [31277, 0.042152, " less", false], [39171, 0.030398, " often", false], [31466, 0.028387, " much", false], [32386, 0.027819, " very", false], [4706, 0.02619, " of", false], [332, 0.018336, " a", false], [45, 0.015417, ",", false], [52094, 0.015258, " largely", false]]], "qwen": [71323, 309, 0.00011814780737040564, [[537, 0.245593, " not", false], [39715, 0.157858, " irrelevant", false], [2686, 0.040909, " less", false], [3545, 0.037021, " often", false], [315, 0.036599, " of", false], [4893, 0.025389, " imm", false], [13771, 0.022763, " largely", false], [650, 0.02013, " un", false], [264, 0.015697, " a", false], [11, 0.014247, ",", false]]]}, "raw_delta": 0.006794049189640943, "tuned_delta": 0.015365841220219192}, {"byte_start": 6099, "byte_end": 6100, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "96.37%", "qwen": "102.99%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.004739854019135237]], "qwen": [[11, ",", "normal", 0.003309671999886632]]}, "loss": {"rwkv": 96.36752030937997, "qwen": 102.98869758321233}, "topk": {"rwkv": [45, 17, 0.004739854019135237, [[51258, 0.180527, " complex", false], [63366, 0.161625, " complicated", false], [59516, 0.145637, " difficult", false], [31048, 0.101267, " hard", false], [31458, 0.064857, " more", false], [59829, 0.042214, " important", false], [31277, 0.034056, " less", false], [51507, 0.024857, " diverse", false], [57518, 0.017939, " variable", false], [46162, 0.016899, " harder", false]]], "qwen": [11, 36, 0.003309671999886632, [[2989, 0.192251, " important", false], [2686, 0.099634, " less", false], [6351, 0.078771, " complex", false], [39715, 0.076917, " irrelevant", false], [2155, 0.043931, " different", false], [16965, 0.038716, " complicated", false], [803, 0.037987, " more", false], [5000, 0.034358, " difficult", false], [2588, 0.022752, " hard", false], [650, 0.022206, " un", false]]]}, "raw_delta": -0.3671560287475586, "tuned_delta": -0.35858423671698036}, {"byte_start": 6100, "byte_end": 6105, "display": {"text": " irre", "kind": "normal"}, "is_word": true, "word_id": 1023, "word_key": " irre", "bytes_hex": "20 69 72 72 65", "compression": {"rwkv": "18.82% 18.82% 18.82% 18.82% 18.82%", "qwen": "16.00% 16.00% 16.00% 16.00% 16.00%"}, "model_tokens": {"rwkv": [[31170, " irre", "normal", 0.005436149891465902]], "qwen": [[24870, " irre", "normal", 0.011836192570626736]]}, "loss": {"rwkv": 18.822661861598192, "qwen": 16.001626999842525}, "topk": {"rwkv": [31170, 36, 0.005436149891465902, [[21265, 0.095776, " and", false], [52448, 0.0491, " perhaps", false], [46269, 0.048716, " incomp", false], [30788, 0.037951, " even", false], [64911, 0.03376, " exponentially", false], [59988, 0.029059, " massively", false], [47708, 0.02749, " vastly", false], [21400, 0.025175, " but", false], [45145, 0.019054, " almost", false], [31427, 0.017959, " mind", false]]], "qwen": [24870, 15, 0.011836192570626736, [[323, 0.207878, " and", false], [714, 0.051271, " but", false], [1496, 0.050814, " even", false], [421, 0.023342, " if", false], [52890, 0.022976, " incom", false], [8365, 0.02207, " perhaps", false], [3498, 0.020079, " though", false], [83544, 0.018703, " unknow", false], [4558, 0.015977, " almost", false], [71323, 0.015372, " tremendously", false]]]}, "raw_delta": 0.15643138885498042, "tuned_delta": 0.16500318088555868}, {"byte_start": 6105, "byte_end": 6113, "display": {"text": "deemably", "kind": "normal"}, "is_word": true, "word_id": 1024, "word_key": "deemably", "bytes_hex": "64 65 65 6d 61 62 6c 79", "compression": {"rwkv": "20.57% 20.57% 20.57% 0.03% 0.03% 0.01% 0.01% 0.01%", "qwen": "26.66% 26.66% 0.01% 0.01% 0.01% 0.01% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[7333, "dee", "normal", 0.03222240135073662], [2034, "ma", "normal", 0.9963411688804626], [7166, "bly", "normal", 0.9980254173278809]], "qwen": [[450, "de", "normal", 0.051972292363643646], [336, "em", "normal", 0.9987937211990356], [2845, "ably", "normal", 0.9985482096672058]]}, "loss": {"rwkv": 7.726286193481504, "qwen": 6.671797688020069}, "topk": {"rwkv": [7333, 5, 0.03222240135073662, [[7387, 0.633821, "duc", false], [27190, 0.09252, "trie", false], [27418, 0.069613, "vers", false], [35986, 0.054719, "vocab", false], [7333, 0.032222, "dee", false], [34176, 0.020238, "cover", false], [35389, 0.016771, "place", false], [26645, 0.010755, "para", false], [25053, 0.009233, "conc", false], [7595, 0.009066, "fut", false]]], "qwen": [450, 5, 0.051972292363643646, [[7545, 0.391993, "duc", false], [8927, 0.16819, "trie", false], [3004, 0.134581, "vers", false], [78285, 0.059703, "ducible", false], [450, 0.051972, "de", false], [40446, 0.049267, "conc", false], [1732, 0.029554, "par", false], [3449, 0.025845, "lev", false], [273, 0.024408, "le", false], [32094, 0.020225, "levance", false]]]}, "raw_delta": 0.05847325875947718, "tuned_delta": 0.06704505079005543}, {"byte_start": 6113, "byte_end": 6121, "display": {"text": " complex", "kind": "normal"}, "is_word": true, "word_id": 1025, "word_key": " complex", "bytes_hex": "20 63 6f 6d 70 6c 65 78", "compression": {"rwkv": "4.83% 4.83% 4.83% 4.83% 4.83% 4.83% 4.83% 4.83%", "qwen": "5.27% 5.27% 5.27% 5.27% 5.27% 5.27% 5.27% 5.27%"}, "model_tokens": {"rwkv": [[51258, " complex", "normal", 0.11706952005624771]], "qwen": [[6351, " complex", "normal", 0.09666675329208374]]}, "loss": {"rwkv": 4.825420424848339, "qwen": 5.2669321363602055}, "topk": {"rwkv": [51258, 2, 0.11706952005624771, [[59516, 0.150604, " difficult", false], [51258, 0.11707, " complex", false], [31048, 0.110542, " hard", false], [63366, 0.104429, " complicated", false], [45, 0.103886, ",", false], [39011, 0.080194, " messy", false], [59829, 0.038833, " important", false], [62161, 0.021655, " irrelevant", false], [46706, 0.016982, " opaque", false], [62590, 0.010168, " subjective", false]]], "qwen": [6351, 2, 0.09666675329208374, [[11, 0.242719, ",", false], [6351, 0.096667, " complex", false], [2155, 0.091925, " different", false], [16965, 0.03225, " complicated", false], [2989, 0.031886, " important", false], [39715, 0.025306, " irrelevant", false], [650, 0.024848, " un", false], [5000, 0.020229, " difficult", false], [869, 0.017272, " private", false], [46484, 0.014961, " opaque", false]]]}, "raw_delta": -0.0244826078414917, "tuned_delta": -0.01591081581091345}, {"byte_start": 6121, "byte_end": 6122, "display": {"text": ";", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "3b", "compression": {"rwkv": "83.97%", "qwen": "82.18%"}, "model_tokens": {"rwkv": [[60, ";", "normal", 0.009439690038561821]], "qwen": [[26, ";", "normal", 0.010491050779819489]]}, "loss": {"rwkv": 83.96935980174044, "qwen": 82.18371553262716}, "topk": {"rwkv": [60, 6, 0.009439690038561821, [[47, 0.448298, ".", false], [45, 0.296146, ",", false], [5346, 0.111241, "---", false], [21265, 0.068237, " and", false], [4596, 0.010706, " in", false], [60, 0.00944, ";", false], [275, 0.008439, " (", false], [4811, 0.006937, " to", false], [21700, 0.006069, " for", false], [59, 0.004702, ":", false]]], "qwen": [26, 5, 0.010491050779819489, [[13, 0.562278, ".", false], [11, 0.241227, ",", false], [323, 0.091116, " and", false], [4421, 0.037604, "---", false], [26, 0.010491, ";", false], [320, 0.00747, " (", false], [311, 0.00652, " to", false], [382, 0.005579, ".\n\n", false], [25, 0.004955, ":", false], [2513, 0.004913, " things", false]]]}, "raw_delta": 0.09901714324951172, "tuned_delta": 0.10758893528008996}, {"byte_start": 6122, "byte_end": 6125, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 1026, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"rwkv": "17.94% 17.94% 17.94%", "qwen": "14.50% 14.50% 14.50%"}, "model_tokens": {"rwkv": [[4858, " we", "normal", 0.050800591707229614]], "qwen": [[582, " we", "normal", 0.08956600725650787]]}, "loss": {"rwkv": 17.939762552720833, "qwen": 14.503769899550523}, "topk": {"rwkv": [4858, 6, 0.050800591707229614, [[32232, 0.087932, " they", false], [22590, 0.087926, " the", false], [21265, 0.084758, " and", false], [39934, 0.063725, " there", false], [32227, 0.058954, " that", false], [4858, 0.050801, " we", false], [4601, 0.042259, " it", false], [32234, 0.036455, " this", false], [21400, 0.033681, " but", false], [4596, 0.028743, " in", false]]], "qwen": [582, 2, 0.08956600725650787, [[323, 0.130866, " and", false], [582, 0.089566, " we", false], [279, 0.07098, " the", false], [432, 0.067737, " it", false], [807, 0.059452, " they", false], [429, 0.053745, " that", false], [1052, 0.030598, " there", false], [419, 0.028595, " this", false], [304, 0.025112, " in", false], [773, 0.018137, " so", false]]]}, "raw_delta": 0.19053188959757483, "tuned_delta": 0.1991036816281531}, {"byte_start": 6125, "byte_end": 6132, "display": {"text": " should", "kind": "normal"}, "is_word": true, "word_id": 1027, "word_key": " should", "bytes_hex": "20 73 68 6f 75 6c 64", "compression": {"rwkv": "8.45% 8.45% 8.45% 8.45% 8.45% 8.45% 8.45%", "qwen": "6.97% 6.97% 6.97% 6.97% 6.97% 6.97% 6.97%"}, "model_tokens": {"rwkv": [[47266, " should", "normal", 0.03814317286014557]], "qwen": [[1265, " should", "normal", 0.06674191355705261]]}, "loss": {"rwkv": 8.45329125520877, "qwen": 6.973683971068322}, "topk": {"rwkv": [47266, 7, 0.03814317286014557, [[31059, 0.14752, " have", false], [4491, 0.145967, " do", false], [21286, 0.117571, " are", false], [45409, 0.09505, " cannot", false], [21413, 0.086851, " can", false], [32475, 0.040993, " will", false], [47266, 0.038143, " should", false], [31223, 0.036915, " know", false], [46227, 0.026478, " humans", false], [21556, 0.022666, " don", false]]], "qwen": [1265, 6, 0.06674191355705261, [[653, 0.17182, " do", false], [614, 0.130978, " have", false], [4157, 0.13019, " cannot", false], [646, 0.105554, " can", false], [525, 0.073844, " are", false], [1265, 0.066742, " should", false], [1414, 0.033922, " know", false], [1513, 0.027113, " don", false], [686, 0.020999, " will", false], [4936, 0.019961, " simply", false]]]}, "raw_delta": 0.08204684938703266, "tuned_delta": 0.0906186414176109}, {"byte_start": 6132, "byte_end": 6137, "display": {"text": " stop", "kind": "normal"}, "is_word": true, "word_id": 1028, "word_key": " stop", "bytes_hex": "20 73 74 6f 70", "compression": {"rwkv": "15.33% 15.33% 15.33% 15.33% 15.33%", "qwen": "17.86% 17.86% 17.86% 17.86% 17.86%"}, "model_tokens": {"rwkv": [[32122, " stop", "normal", 0.014346488751471043]], "qwen": [[2936, " stop", "normal", 0.00706950668245554]]}, "loss": {"rwkv": 15.328634809445234, "qwen": 17.860436128285865}, "topk": {"rwkv": [32122, 9, 0.014346488751471043, [[22187, 0.429127, " not", false], [39115, 0.097004, " never", false], [45926, 0.063851, " expect", false], [4435, 0.056317, " be", false], [60645, 0.028603, " therefore", false], [31059, 0.020275, " have", false], [45084, 0.017353, " accept", false], [45150, 0.015625, " always", false], [32122, 0.014346, " stop", false], [38877, 0.010446, " learn", false]]], "qwen": [2936, 13, 0.00706950668245554, [[537, 0.530159, " not", false], [387, 0.074207, " be", false], [2581, 0.044176, " never", false], [8916, 0.022915, " therefore", false], [5648, 0.019162, " avoid", false], [1430, 0.013761, " try", false], [1720, 0.010714, " expect", false], [614, 0.008325, " have", false], [2677, 0.007854, " always", false], [5274, 0.007544, " leave", false]]]}, "raw_delta": -0.1403928756713867, "tuned_delta": -0.13182108364080844}, {"byte_start": 6137, "byte_end": 6144, "display": {"text": " trying", "kind": "normal"}, "is_word": true, "word_id": 1029, "word_key": " trying", "bytes_hex": "20 74 72 79 69 6e 67", "compression": {"rwkv": "1.38% 1.38% 1.38% 1.38% 1.38% 1.38% 1.38%", "qwen": "1.79% 1.79% 1.79% 1.79% 1.79% 1.79% 1.79%"}, "model_tokens": {"rwkv": [[47629, " trying", "normal", 0.5826796889305115]], "qwen": [[4460, " trying", "normal", 0.4985191822052002]]}, "loss": {"rwkv": 1.3786915499566683, "qwen": 1.7933555412213442}, "topk": {"rwkv": [47629, 1, 0.5826796889305115, [[47629, 0.58268, " trying", false], [57419, 0.094989, " thinking", false], [62360, 0.044284, " pretending", false], [59681, 0.017607, " expecting", false], [53320, 0.016909, " wasting", false], [52157, 0.015668, " looking", false], [46500, 0.01265, " making", false], [46217, 0.010758, " hoping", false], [59224, 0.010693, " believing", false], [59813, 0.008519, " imagining", false]]], "qwen": [4460, 1, 0.4985191822052002, [[4460, 0.498519, " trying", false], [7274, 0.087178, " thinking", false], [47797, 0.028093, " wasting", false], [39776, 0.019131, " worrying", false], [3259, 0.018178, " making", false], [54806, 0.017214, " pretending", false], [3330, 0.016465, " looking", false], [26625, 0.016464, " treating", false], [10161, 0.015371, " asking", false], [25538, 0.014384, " assuming", false]]]}, "raw_delta": -0.022993854113987505, "tuned_delta": -0.014422062083409256}, {"byte_start": 6144, "byte_end": 6147, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 1030, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.21% 0.21% 0.21%", "qwen": "0.14% 0.14% 0.14%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.9659410715103149]], "qwen": [[311, " to", "normal", 0.9774839878082275]]}, "loss": {"rwkv": 0.20839711080549397, "qwen": 0.13689611868117005}, "topk": {"rwkv": [4811, 1, 0.9659410715103149, [[4811, 0.965941, " to", false], [47, 0.00777, ".", false], [45, 0.005024, ",", false], [4788, 0.004535, " so", false], [21265, 0.002311, " and", false], [4596, 0.002285, " in", false], [21700, 0.001095, " for", false], [275, 0.000932, " (", false], [63461, 0.000789, " desperately", false], [22614, 0.000692, " too", false]]], "qwen": [311, 1, 0.9774839878082275, [[311, 0.977484, " to", false], [11, 0.003888, ",", false], [773, 0.002972, " so", false], [37543, 0.001506, " desperately", false], [304, 0.00114, " in", false], [323, 0.001132, " and", false], [369, 0.001086, " for", false], [320, 0.000969, " (", false], [13, 0.000955, ".", false], [2238, 0.000853, " too", false]]]}, "raw_delta": 0.0039648568878571195, "tuned_delta": 0.012536648918435367}, {"byte_start": 6147, "byte_end": 6152, "display": {"text": " find", "kind": "normal"}, "is_word": true, "word_id": 1031, "word_key": " find", "bytes_hex": "20 66 69 6e 64", "compression": {"rwkv": "17.58% 17.58% 17.58% 17.58% 17.58%", "qwen": "17.29% 17.29% 17.29% 17.29% 17.29%"}, "model_tokens": {"rwkv": [[30858, " find", "normal", 0.007629687432199717]], "qwen": [[1477, " find", "normal", 0.008287807926535606]]}, "loss": {"rwkv": 17.58284581083424, "qwen": 17.28698405655495}, "topk": {"rwkv": [30858, 25, 0.007629687432199717, [[39043, 0.101693, " model", false], [62683, 0.084843, " understand", false], [37923, 0.08271, " build", false], [22339, 0.0639, " put", false], [31358, 0.046281, " make", false], [47030, 0.026574, " reduce", false], [51133, 0.019362, " capture", false], [39025, 0.019198, " mimic", false], [60386, 0.01884, " replicate", false], [63292, 0.0171, " approximate", false]]], "qwen": [1477, 12, 0.008287807926535606, [[3535, 0.28374, " understand", false], [1614, 0.094508, " model", false], [1936, 0.090455, " build", false], [1281, 0.026458, " make", false], [2182, 0.02417, " put", false], [4009, 0.016793, " represent", false], [12322, 0.016563, " capture", false], [633, 0.015462, " get", false], [7949, 0.014764, " reduce", false], [7512, 0.013279, " describe", false]]]}, "raw_delta": 0.01640605926513672, "tuned_delta": 0.02497785129571497}, {"byte_start": 6152, "byte_end": 6159, "display": {"text": " simple", "kind": "normal"}, "is_word": true, "word_id": 1032, "word_key": " simple", "bytes_hex": "20 73 69 6d 70 6c 65", "compression": {"rwkv": "5.92% 5.92% 5.92% 5.92% 5.92% 5.92% 5.92%", "qwen": "5.90% 5.90% 5.90% 5.90% 5.90% 5.90% 5.90%"}, "model_tokens": {"rwkv": [[47284, " simple", "normal", 0.1009325236082077]], "qwen": [[4285, " simple", "normal", 0.10120167583227158]]}, "loss": {"rwkv": 5.9173038786461385, "qwen": 5.901241313279305}, "topk": {"rwkv": [47284, 2, 0.1009325236082077, [[332, 0.133364, " a", false], [47284, 0.100933, " simple", false], [32448, 0.100101, " ways", false], [22590, 0.068825, " the", false], [22249, 0.047653, " out", false], [51832, 0.037114, " general", false], [32229, 0.029899, " them", false], [4419, 0.026561, " an", false], [30724, 0.01999, " easy", false], [38720, 0.017781, " human", false]]], "qwen": [4285, 3, 0.10120167583227158, [[700, 0.118878, " out", false], [264, 0.101372, " a", false], [4285, 0.101202, " simple", false], [5510, 0.095032, " ways", false], [1105, 0.049416, " them", false], [279, 0.049007, " the", false], [458, 0.016485, " an", false], [1661, 0.01402, " good", false], [894, 0.01358, " any", false], [11464, 0.013484, " explicit", false]]]}, "raw_delta": 0.0008906977517263992, "tuned_delta": 0.009462489782304647}, {"byte_start": 6159, "byte_end": 6164, "display": {"text": " ways", "kind": "normal"}, "is_word": true, "word_id": 1033, "word_key": " ways", "bytes_hex": "20 77 61 79 73", "compression": {"rwkv": "7.78% 7.78% 7.78% 7.78% 7.78%", "qwen": "10.46% 10.46% 10.46% 10.46% 10.46%"}, "model_tokens": {"rwkv": [[32448, " ways", "normal", 0.11449906975030899]], "qwen": [[5510, " ways", "normal", 0.05498006194829941]]}, "loss": {"rwkv": 7.777027954792068, "qwen": 10.462368505016979}, "topk": {"rwkv": [32448, 2, 0.11449906975030899, [[45, 0.191352, ",", false], [32448, 0.114499, " ways", false], [46587, 0.089249, " models", false], [64392, 0.067039, " explanations", false], [65275, 0.04155, " representations", false], [64351, 0.041112, " descriptions", false], [39558, 0.03746, " rules", false], [60521, 0.022346, " solutions", false], [38720, 0.021478, " human", false], [51832, 0.018319, " general", false]]], "qwen": [5510, 5, 0.05498006194829941, [[11, 0.200505, ",", false], [4119, 0.119313, " models", false], [43613, 0.083355, " representations", false], [40841, 0.072082, " explanations", false], [5510, 0.05498, " ways", false], [323, 0.034541, " and", false], [10502, 0.028146, " mental", false], [27787, 0.025921, " descriptions", false], [5601, 0.019599, " rules", false], [23400, 0.014106, " analog", false]]]}, "raw_delta": -0.1489068984985351, "tuned_delta": -0.14033510646795685}, {"byte_start": 6164, "byte_end": 6167, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 1034, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "1.48% 1.48% 1.48%", "qwen": "1.91% 1.91% 1.91%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.7835110425949097]], "qwen": [[311, " to", "normal", 0.7277523875236511]]}, "loss": {"rwkv": 1.4793259696615346, "qwen": 1.9103352739607122}, "topk": {"rwkv": [4811, 1, 0.7835110425949097, [[4811, 0.783511, " to", false], [4706, 0.169309, " of", false], [21700, 0.014905, " for", false], [4596, 0.011627, " in", false], [32227, 0.004023, " that", false], [45202, 0.002926, " around", false], [45, 0.002862, ",", false], [275, 0.001867, " (", false], [31162, 0.001472, " into", false], [22249, 0.001421, " out", false]]], "qwen": [311, 1, 0.7277523875236511, [[311, 0.727752, " to", false], [315, 0.238862, " of", false], [304, 0.005255, " in", false], [429, 0.00495, " that", false], [369, 0.004693, " for", false], [1119, 0.00412, " into", false], [11, 0.003879, ",", false], [700, 0.002278, " out", false], [320, 0.001997, " (", false], [2163, 0.001271, " around", false]]]}, "raw_delta": -0.023900230725606278, "tuned_delta": -0.01532843869502803}, {"byte_start": 6167, "byte_end": 6173, "display": {"text": " think", "kind": "normal"}, "is_word": true, "word_id": 1035, "word_key": " think", "bytes_hex": "20 74 68 69 6e 6b", "compression": {"rwkv": "15.50% 15.50% 15.50% 15.50% 15.50% 15.50%", "qwen": "13.14% 13.14% 13.14% 13.14% 13.14% 13.14%"}, "model_tokens": {"rwkv": [[39942, " think", "normal", 0.005826219916343689]], "qwen": [[1744, " think", "normal", 0.012629715725779533]]}, "loss": {"rwkv": 15.49770063454941, "qwen": 13.139653674513227}, "topk": {"rwkv": [39942, 23, 0.005826219916343689, [[60389, 0.137841, " represent", false], [55961, 0.131746, " describe", false], [39043, 0.102576, " model", false], [22339, 0.062984, " put", false], [51133, 0.049694, " capture", false], [62683, 0.039643, " understand", false], [51688, 0.036405, " explain", false], [37923, 0.034396, " build", false], [45854, 0.031101, " encode", false], [31358, 0.024102, " make", false]]], "qwen": [1744, 10, 0.012629715725779533, [[4009, 0.175052, " represent", false], [3535, 0.125118, " understand", false], [1614, 0.116433, " model", false], [7512, 0.06857, " describe", false], [12322, 0.057066, " capture", false], [1936, 0.050149, " build", false], [16164, 0.022086, " encode", false], [10339, 0.019037, " explain", false], [633, 0.013144, " get", false], [1744, 0.01263, " think", false]]]}, "raw_delta": 0.13075788815816247, "tuned_delta": 0.13932968018874073}, {"byte_start": 6173, "byte_end": 6179, "display": {"text": " about", "kind": "normal"}, "is_word": true, "word_id": 1036, "word_key": " about", "bytes_hex": "20 61 62 6f 75 74", "compression": {"rwkv": "2.23% 2.23% 2.23% 2.23% 2.23% 2.23%", "qwen": "3.15% 3.15% 3.15% 3.15% 3.15% 3.15%"}, "model_tokens": {"rwkv": [[37598, " about", "normal", 0.4756644070148468]], "qwen": [[911, " about", "normal", 0.35096195340156555]]}, "loss": {"rwkv": 2.230729636791203, "qwen": 3.1471112447329133}, "topk": {"rwkv": [37598, 1, 0.4756644070148468, [[37598, 0.475664, " about", false], [31296, 0.232608, " like", false], [47, 0.046353, ".", false], [4706, 0.038336, " of", false], [21265, 0.033355, " and", false], [45, 0.02902, ",", false], [32227, 0.024073, " that", false], [4596, 0.022565, " in", false], [4715, 0.009774, " or", false], [4423, 0.008723, " as", false]]], "qwen": [911, 1, 0.35096195340156555, [[911, 0.350962, " about", false], [13, 0.1403, ".", false], [11, 0.080916, ",", false], [429, 0.079425, " that", false], [323, 0.075951, " and", false], [315, 0.051051, " of", false], [1075, 0.042088, " like", false], [476, 0.022743, " or", false], [304, 0.022563, " in", false], [382, 0.012704, ".\n\n", false]]]}, "raw_delta": -0.050814986228942864, "tuned_delta": -0.042243194198364614}, {"byte_start": 6179, "byte_end": 6183, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1037, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "9.65% 9.65% 9.65% 9.65%", "qwen": "12.21% 12.21% 12.21% 12.21%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.11691730469465256]], "qwen": [[279, " the", "normal", 0.06668713688850403]]}, "loss": {"rwkv": 9.650840849696678, "qwen": 12.207648875929388}, "topk": {"rwkv": [22590, 3, 0.11691730469465256, [[32229, 0.388506, " them", false], [39026, 0.163565, " minds", false], [22590, 0.116917, " the", false], [21835, 0.04894, " how", false], [4601, 0.024438, " it", false], [32464, 0.024369, " what", false], [51258, 0.022859, " complex", false], [22248, 0.017387, " our", false], [38720, 0.016553, " human", false], [21265, 0.016518, " and", false]]], "qwen": [279, 3, 0.06668713688850403, [[1105, 0.503293, " them", false], [20062, 0.069343, " minds", false], [279, 0.066687, " the", false], [1128, 0.034867, " what", false], [1246, 0.030605, " how", false], [15235, 0.024006, " AI", false], [6351, 0.020271, " complex", false], [419, 0.017523, " this", false], [323, 0.017303, " and", false], [476, 0.016512, " or", false]]]}, "raw_delta": -0.14177954196929932, "tuned_delta": -0.13320774993872106}, {"byte_start": 6183, "byte_end": 6192, "display": {"text": " contents", "kind": "normal"}, "is_word": true, "word_id": 1038, "word_key": " contents", "bytes_hex": "20 63 6f 6e 74 65 6e 74 73", "compression": {"rwkv": "4.04% 4.04% 4.04% 4.04% 4.04% 4.04% 4.04% 4.04% 4.04%", "qwen": "3.10% 3.10% 3.10% 3.10% 3.10% 3.10% 3.10% 3.10% 3.10%"}, "model_tokens": {"rwkv": [[55847, " contents", "normal", 0.13328483700752258]], "qwen": [[8794, " contents", "normal", 0.2131236046552658]]}, "loss": {"rwkv": 4.038794710821968, "qwen": 3.0975522941036595}, "topk": {"rwkv": [55847, 3, 0.13328483700752258, [[40213, 0.245528, " world", false], [31427, 0.235026, " mind", false], [55847, 0.133285, " contents", false], [39026, 0.099565, " minds", false], [51258, 0.037006, " complex", false], [38720, 0.03131, " human", false], [61720, 0.025837, " complexity", false], [37898, 0.010584, " brain", false], [22752, 0.010093, " way", false], [52569, 0.007788, " problem", false]]], "qwen": [8794, 1, 0.2131236046552658, [[8794, 0.213124, " contents", false], [3971, 0.117353, " mind", false], [1879, 0.113957, " world", false], [20062, 0.074614, " minds", false], [23094, 0.047547, " complexity", false], [6351, 0.021124, " complex", false], [2213, 0.020462, " content", false], [3491, 0.019065, " problem", false], [3738, 0.018264, " human", false], [5322, 0.015819, " problems", false]]]}, "raw_delta": 0.052193562189737974, "tuned_delta": 0.060765354220316224}, {"byte_start": 6192, "byte_end": 6195, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 1039, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.49% 0.49% 0.49%", "qwen": "0.67% 0.67% 0.67%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9207640290260315]], "qwen": [[315, " of", "normal", 0.8948466181755066]]}, "loss": {"rwkv": 0.49310865655384484, "qwen": 0.6678653786176408}, "topk": {"rwkv": [4706, 1, 0.9207640290260315, [[4706, 0.920764, " of", false], [47, 0.030662, ".", false], [45, 0.017317, ",", false], [21265, 0.012963, " and", false], [4596, 0.003097, " in", false], [32227, 0.002232, " that", false], [60, 0.001965, ";", false], [275, 0.001528, " (", false], [4715, 0.001405, " or", false], [5346, 0.001029, "---", false]]], "qwen": [315, 1, 0.8948466181755066, [[315, 0.894847, " of", false], [13, 0.047853, ".", false], [11, 0.01782, ",", false], [323, 0.01475, " and", false], [382, 0.004503, ".\n\n", false], [4421, 0.00264, "---", false], [429, 0.002627, " that", false], [320, 0.001751, " (", false], [304, 0.001715, " in", false], [476, 0.00163, " or", false]]]}, "raw_delta": -0.009690570334593453, "tuned_delta": -0.0011187783040152045}, {"byte_start": 6195, "byte_end": 6201, "display": {"text": " minds", "kind": "normal"}, "is_word": true, "word_id": 1040, "word_key": " minds", "bytes_hex": "20 6d 69 6e 64 73", "compression": {"rwkv": "0.36% 0.36% 0.36% 0.36% 0.36% 0.36%", "qwen": "0.79% 0.79% 0.79% 0.79% 0.79% 0.79%"}, "model_tokens": {"rwkv": [[39026, " minds", "normal", 0.888293981552124]], "qwen": [[20062, " minds", "normal", 0.7699849605560303]]}, "loss": {"rwkv": 0.3580908101164826, "qwen": 0.7856205112617974}, "topk": {"rwkv": [39026, 1, 0.888293981552124, [[39026, 0.888294, " minds", false], [22248, 0.031547, " our", false], [22590, 0.020458, " the", false], [38720, 0.011497, " human", false], [332, 0.010313, " a", false], [39193, 0.004367, " other", false], [31427, 0.002685, " mind", false], [39944, 0.002133, " those", false], [39931, 0.001903, " their", false], [45124, 0.001894, " agents", false]]], "qwen": [20062, 1, 0.7699849605560303, [[20062, 0.769985, " minds", false], [1039, 0.059714, " our", false], [279, 0.039389, " the", false], [3738, 0.021807, " human", false], [264, 0.0203, " a", false], [1846, 0.007593, " those", false], [3971, 0.007428, " mind", false], [1493, 0.006947, " these", false], [1008, 0.006242, " other", false], [1251, 0.004898, " people", false]]]}, "raw_delta": -0.02370728055636088, "tuned_delta": -0.015135488525782633}, {"byte_start": 6201, "byte_end": 6202, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "25.36%", "qwen": "27.39%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.24629829823970795]], "qwen": [[11, ",", "normal", 0.21901921927928925]]}, "loss": {"rwkv": 25.359873765626308, "qwen": 27.385883137368587}, "topk": {"rwkv": [45, 2, 0.24629829823970795, [[47, 0.460899, ".", false], [45, 0.246298, ",", false], [21265, 0.113674, " and", false], [32227, 0.028732, " that", false], [60, 0.024096, ";", false], [4596, 0.021667, " in", false], [275, 0.01893, " (", false], [5346, 0.013782, "---", false], [4423, 0.011644, " as", false], [4450, 0.006186, " by", false]]], "qwen": [11, 2, 0.21901921927928925, [[13, 0.494029, ".", false], [11, 0.219019, ",", false], [323, 0.098597, " and", false], [382, 0.051394, ".\n\n", false], [4421, 0.019468, "---", false], [429, 0.017928, " that", false], [320, 0.014993, " (", false], [26, 0.014264, ";", false], [304, 0.013559, " in", false], [476, 0.010207, " or", false]]]}, "raw_delta": -0.11234581470489502, "tuned_delta": -0.10377402267431678}, {"byte_start": 6202, "byte_end": 6207, "display": {"text": " such", "kind": "normal"}, "is_word": true, "word_id": 1041, "word_key": " such", "bytes_hex": "20 73 75 63 68", "compression": {"rwkv": "16.46% 16.46% 16.46% 16.46% 16.46%", "qwen": "14.75% 14.75% 14.75% 14.75% 14.75%"}, "model_tokens": {"rwkv": [[32139, " such", "normal", 0.010573497042059898]], "qwen": [[1741, " such", "normal", 0.016764383763074875]]}, "loss": {"rwkv": 16.45574031013974, "qwen": 14.746141609758464}, "topk": {"rwkv": [32139, 11, 0.010573497042059898, [[21265, 0.57877, " and", false], [51018, 0.057204, " because", false], [4715, 0.055497, " or", false], [4423, 0.024738, " as", false], [21400, 0.022354, " but", false], [40186, 0.015172, " which", false], [4596, 0.015118, " in", false], [4811, 0.015016, " to", false], [4858, 0.014407, " we", false], [30788, 0.011805, " even", false]]], "qwen": [1741, 8, 0.016764383763074875, [[323, 0.5002, " and", false], [476, 0.087305, " or", false], [1576, 0.081886, " because", false], [438, 0.050973, " as", false], [892, 0.023271, " which", false], [2474, 0.018089, " since", false], [714, 0.017288, " but", false], [1741, 0.016764, " such", false], [1496, 0.015244, " even", false], [311, 0.015047, " to", false]]]}, "raw_delta": 0.09480028152465814, "tuned_delta": 0.10337207355523638}, {"byte_start": 6207, "byte_end": 6210, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 1042, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"rwkv": "0.15% 0.15% 0.15%", "qwen": "0.03% 0.03% 0.03%"}, "model_tokens": {"rwkv": [[4423, " as", "normal", 0.9750046133995056]], "qwen": [[438, " as", "normal", 0.9950841069221497]]}, "loss": {"rwkv": 0.15189507724203258, "qwen": 0.02962327542236265}, "topk": {"rwkv": [4423, 1, 0.9750046133995056, [[4423, 0.975005, " as", false], [32227, 0.018112, " that", false], [4450, 0.001033, " by", false], [332, 0.000722, " a", false], [32448, 0.000585, " ways", false], [52224, 0.000458, " methods", false], [47284, 0.000318, " simple", false], [4419, 0.00031, " an", false], [4600, 0.000204, " is", false], [57419, 0.000197, " thinking", false]]], "qwen": [438, 1, 0.9950841069221497, [[438, 0.995084, " as", false], [429, 0.00189, " that", false], [264, 0.000488, " a", false], [5510, 0.000193, " ways", false], [7274, 0.000175, " thinking", false], [5413, 0.000133, " methods", false], [374, 9.6e-05, " is", false], [553, 8.8e-05, " by", false], [4285, 8.8e-05, " simple", false], [4460, 8.3e-05, " trying", false]]]}, "raw_delta": 0.006780188375463088, "tuned_delta": 0.015351980406041337}, {"byte_start": 6210, "byte_end": 6217, "display": {"text": " simple", "kind": "normal"}, "is_word": true, "word_id": 1043, "word_key": " simple", "bytes_hex": "20 73 69 6d 70 6c 65", "compression": {"rwkv": "8.65% 8.65% 8.65% 8.65% 8.65% 8.65% 8.65%", "qwen": "14.47% 14.47% 14.47% 14.47% 14.47% 14.47% 14.47%"}, "model_tokens": {"rwkv": [[47284, " simple", "normal", 0.035057224333286285]], "qwen": [[4285, " simple", "normal", 0.003632637206465006]]}, "loss": {"rwkv": 8.654560094618503, "qwen": 14.472798281025144}, "topk": {"rwkv": [47284, 4, 0.035057224333286285, [[4450, 0.208841, " by", false], [4596, 0.087361, " in", false], [22590, 0.072713, " the", false], [47284, 0.035057, " simple", false], [53140, 0.033118, " through", false], [4404, 0.030458, " ``", false], [55666, 0.023463, " building", false], [40085, 0.020275, " using", false], [47629, 0.019979, " trying", false], [38720, 0.0189, " human", false]]], "qwen": [4285, 37, 0.003632637206465006, [[279, 0.133687, " the", false], [4460, 0.052323, " trying", false], [553, 0.03949, " by", false], [304, 0.03373, " in", false], [7274, 0.031925, " thinking", false], [9902, 0.026922, " ``", false], [6540, 0.024552, " knowledge", false], [15039, 0.02171, " searching", false], [4752, 0.017244, " building", false], [3738, 0.016192, " human", false]]]}, "raw_delta": -0.32263163157871794, "tuned_delta": -0.3140598395481397}, {"byte_start": 6217, "byte_end": 6222, "display": {"text": " ways", "kind": "normal"}, "is_word": true, "word_id": 1044, "word_key": " ways", "bytes_hex": "20 77 61 79 73", "compression": {"rwkv": "14.31% 14.31% 14.31% 14.31% 14.31%", "qwen": "19.04% 19.04% 19.04% 19.04% 19.04%"}, "model_tokens": {"rwkv": [[32448, " ways", "normal", 0.018915539607405663]], "qwen": [[5510, " ways", "normal", 0.005097561050206423]]}, "loss": {"rwkv": 14.314239858820182, "qwen": 19.039943022871757}, "topk": {"rwkv": [32448, 9, 0.018915539607405663, [[65275, 0.091285, " representations", false], [46587, 0.084383, " models", false], [39558, 0.03865, " rules", false], [57375, 0.034939, " symbolic", false], [59943, 0.031659, " knowledge", false], [46658, 0.030362, " neural", false], [45, 0.026188, ",", false], [38720, 0.020902, " human", false], [32448, 0.018916, " ways", false], [45432, 0.016186, " causal", false]]], "qwen": [5510, 30, 0.005097561050206423, [[43613, 0.065501, " representations", false], [6540, 0.05868, " knowledge", false], [5601, 0.054789, " rules", false], [4119, 0.040498, " models", false], [35296, 0.029279, " symbolic", false], [11, 0.024659, ",", false], [24970, 0.017899, " theories", false], [4419, 0.016319, " features", false], [10502, 0.014763, " mental", false], [29728, 0.01381, " neural", false]]]}, "raw_delta": -0.26204862594604506, "tuned_delta": -0.2534768339154668}, {"byte_start": 6222, "byte_end": 6225, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 1045, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.97% 0.97% 0.97%", "qwen": "1.92% 1.92% 1.92%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.8508548140525818]], "qwen": [[311, " to", "normal", 0.7263924479484558]]}, "loss": {"rwkv": 0.9686062896593381, "qwen": 1.921578818909463}, "topk": {"rwkv": [4811, 1, 0.8508548140525818, [[4811, 0.850855, " to", false], [4706, 0.124952, " of", false], [21700, 0.012865, " for", false], [32227, 0.004086, " that", false], [4596, 0.002308, " in", false], [37810, 0.000481, " based", false], [275, 0.000468, " (", false], [45, 0.000425, ",", false], [31296, 0.000404, " like", false], [4858, 0.000321, " we", false]]], "qwen": [311, 1, 0.7263924479484558, [[311, 0.726392, " to", false], [315, 0.224225, " of", false], [429, 0.014931, " that", false], [304, 0.011929, " in", false], [369, 0.005449, " for", false], [3118, 0.004559, " based", false], [1119, 0.001091, " into", false], [11, 0.000979, ",", false], [1075, 0.000975, " like", false], [320, 0.00066, " (", false]]]}, "raw_delta": -0.05284401774406433, "tuned_delta": -0.04427222571348608}, {"byte_start": 6225, "byte_end": 6231, "display": {"text": " think", "kind": "normal"}, "is_word": true, "word_id": 1046, "word_key": " think", "bytes_hex": "20 74 68 69 6e 6b", "compression": {"rwkv": "6.06% 6.06% 6.06% 6.06% 6.06% 6.06%", "qwen": "4.14% 4.14% 4.14% 4.14% 4.14% 4.14%"}, "model_tokens": {"rwkv": [[39942, " think", "normal", 0.13201920688152313]], "qwen": [[1744, " think", "normal", 0.2525695562362671]]}, "loss": {"rwkv": 6.058192066232952, "qwen": 4.135931945218039}, "topk": {"rwkv": [39942, 1, 0.13201920688152313, [[39942, 0.132019, " think", false], [60389, 0.107778, " represent", false], [37923, 0.069077, " build", false], [55961, 0.051718, " describe", false], [39043, 0.043258, " model", false], [22339, 0.038955, " put", false], [45688, 0.029868, " define", false], [62683, 0.022644, " understand", false], [45854, 0.020946, " encode", false], [30858, 0.01596, " find", false]]], "qwen": [1744, 1, 0.2525695562362671, [[1744, 0.25257, " think", false], [4009, 0.241383, " represent", false], [16164, 0.048848, " encode", false], [7512, 0.036788, " describe", false], [1614, 0.031156, " model", false], [1936, 0.020897, " build", false], [3535, 0.020736, " understand", false], [12322, 0.013109, " capture", false], [3158, 0.012055, " express", false], [2415, 0.010918, " map", false]]]}, "raw_delta": 0.10659273465474449, "tuned_delta": 0.11516452668532273}, {"byte_start": 6231, "byte_end": 6237, "display": {"text": " about", "kind": "normal"}, "is_word": true, "word_id": 1047, "word_key": " about", "bytes_hex": "20 61 62 6f 75 74", "compression": {"rwkv": "0.23% 0.23% 0.23% 0.23% 0.23% 0.23%", "qwen": "0.26% 0.26% 0.26% 0.26% 0.26% 0.26%"}, "model_tokens": {"rwkv": [[37598, " about", "normal", 0.9247358441352844]], "qwen": [[911, " about", "normal", 0.9184801578521729]]}, "loss": {"rwkv": 0.23334606069065872, "qwen": 0.25558232016207766}, "topk": {"rwkv": [37598, 1, 0.9247358441352844, [[37598, 0.924736, " about", false], [4706, 0.036857, " of", false], [4596, 0.010728, " in", false], [32227, 0.010199, " that", false], [31296, 0.002625, " like", false], [32464, 0.000647, " what", false], [21835, 0.000568, " how", false], [4423, 0.000511, " as", false], [21265, 0.000486, " and", false], [4450, 0.000474, " by", false]]], "qwen": [911, 1, 0.9184801578521729, [[911, 0.91848, " about", false], [315, 0.066512, " of", false], [304, 0.004573, " in", false], [429, 0.001382, " that", false], [1075, 0.000739, " like", false], [476, 0.000675, " or", false], [11, 0.00053, ",", false], [1246, 0.000372, " how", false], [279, 0.000333, " the", false], [323, 0.000302, " and", false]]]}, "raw_delta": -0.0012330400447050725, "tuned_delta": 0.007338751985873176}, {"byte_start": 6237, "byte_end": 6243, "display": {"text": " space", "kind": "normal"}, "is_word": true, "word_id": 1048, "word_key": " space", "bytes_hex": "20 73 70 61 63 65", "compression": {"rwkv": "22.17% 22.17% 22.17% 22.17% 22.17% 22.17%", "qwen": "23.57% 23.57% 23.57% 23.57% 23.57% 23.57%"}, "model_tokens": {"rwkv": [[39750, " space", "normal", 0.0006307411240413785]], "qwen": [[3550, " space", "normal", 0.00039288686821237206]]}, "loss": {"rwkv": 22.166408180325217, "qwen": 23.569997290113044}, "topk": {"rwkv": [39750, 139, 0.0006307411240413785, [[22590, 0.225832, " the", false], [21835, 0.108221, " how", false], [32464, 0.067001, " what", false], [38720, 0.056188, " human", false], [59943, 0.037485, " knowledge", false], [4404, 0.021567, " ``", false], [47732, 0.019219, " vision", false], [332, 0.013843, " a", false], [56529, 0.012784, " language", false], [47284, 0.009938, " simple", false]]], "qwen": [3550, 166, 0.00039288686821237206, [[279, 0.177559, " the", false], [1246, 0.083276, " how", false], [3738, 0.082368, " human", false], [6540, 0.076958, " knowledge", false], [11129, 0.057263, " vision", false], [1128, 0.055498, " what", false], [4244, 0.027448, " words", false], [4128, 0.024734, " language", false], [8806, 0.019701, " speech", false], [862, 0.016263, " their", false]]]}, "raw_delta": -0.07783150672912598, "tuned_delta": -0.06925971469854773}, {"byte_start": 6243, "byte_end": 6244, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "19.44%", "qwen": "16.97%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.34336769580841064]], "qwen": [[11, ",", "normal", 0.39013928174972534]]}, "loss": {"rwkv": 19.44256988698017, "qwen": 16.97423511080913}, "topk": {"rwkv": [45, 1, 0.34336769580841064, [[45, 0.343368, ",", false], [21265, 0.199534, " and", false], [4715, 0.192438, " or", false], [47, 0.139316, ".", false], [275, 0.023966, " (", false], [4423, 0.017262, " as", false], [4596, 0.015951, " in", false], [46, 0.008148, "-", false], [5346, 0.007209, "---", false], [27165, 0.006575, "time", false]]], "qwen": [11, 1, 0.39013928174972534, [[11, 0.390139, ",", false], [323, 0.262821, " and", false], [476, 0.154869, " or", false], [13, 0.087858, ".", false], [320, 0.025548, " (", false], [7246, 0.02115, "-time", false], [304, 0.019751, " in", false], [382, 0.007857, ".\n\n", false], [315, 0.003637, " of", false], [26, 0.003188, ";", false]]]}, "raw_delta": 0.1368735432624817, "tuned_delta": 0.14544533529305995}, {"byte_start": 6244, "byte_end": 6252, "display": {"text": " objects", "kind": "normal"}, "is_word": true, "word_id": 1049, "word_key": " objects", "bytes_hex": "20 6f 62 6a 65 63 74 73", "compression": {"rwkv": "10.00% 10.00% 10.00% 10.00% 10.00% 10.00% 10.00% 10.00%", "qwen": "11.01% 11.01% 11.01% 11.01% 11.01% 11.01% 11.01% 11.01%"}, "model_tokens": {"rwkv": [[52342, " objects", "normal", 0.011667819693684578]], "qwen": [[6171, " objects", "normal", 0.007564160972833633]]}, "loss": {"rwkv": 10.00306131866371, "qwen": 11.010318559321329}, "topk": {"rwkv": [52342, 9, 0.011667819693684578, [[4715, 0.350322, " or", false], [47284, 0.133252, " simple", false], [21265, 0.098674, " and", false], [32251, 0.069816, " time", false], [37598, 0.050554, " about", false], [32139, 0.026637, " such", false], [4811, 0.016945, " to", false], [4423, 0.015397, " as", false], [52342, 0.011668, " objects", false], [31296, 0.010183, " like", false]]], "qwen": [6171, 12, 0.007564160972833633, [[476, 0.347496, " or", false], [882, 0.303176, " time", false], [323, 0.0296, " and", false], [911, 0.027436, " about", false], [4128, 0.022497, " language", false], [438, 0.018997, " as", false], [1894, 0.018668, " color", false], [1741, 0.016463, " such", false], [311, 0.013976, " to", false], [4285, 0.012753, " simple", false]]]}, "raw_delta": -0.055854201316833496, "tuned_delta": -0.047282409286255246}, {"byte_start": 6252, "byte_end": 6253, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "1.02%", "qwen": "0.86%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.9446302056312561]], "qwen": [[11, ",", "normal", 0.9531685709953308]]}, "loss": {"rwkv": 1.021439360004393, "qwen": 0.8649585266108387}, "topk": {"rwkv": [45, 1, 0.9446302056312561, [[45, 0.94463, ",", false], [21265, 0.029621, " and", false], [4596, 0.009174, " in", false], [4715, 0.008865, " or", false], [275, 0.002056, " (", false], [4706, 0.000879, " of", false], [4423, 0.000522, " as", false], [32227, 0.000505, " that", false], [32487, 0.000495, " with", false], [21643, 0.000247, " etc", false]]], "qwen": [11, 1, 0.9531685709953308, [[11, 0.953169, ",", false], [323, 0.025544, " and", false], [476, 0.008522, " or", false], [304, 0.007181, " in", false], [320, 0.001544, " (", false], [315, 0.000549, " of", false], [429, 0.000304, " that", false], [4992, 0.000284, " etc", false], [438, 0.000209, " as", false], [13, 0.000204, ".", false]]]}, "raw_delta": 0.00867713987827301, "tuned_delta": 0.01724893190885126}, {"byte_start": 6253, "byte_end": 6262, "display": {"text": " multiple", "kind": "normal"}, "is_word": true, "word_id": 1050, "word_key": " multiple", "bytes_hex": "20 6d 75 6c 74 69 70 6c 65", "compression": {"rwkv": "21.29% 21.29% 21.29% 21.29% 21.29% 21.29% 21.29% 21.29% 21.29%", "qwen": "21.59% 21.59% 21.59% 21.59% 21.59% 21.59% 21.59% 21.59% 21.59%"}, "model_tokens": {"rwkv": [[56679, " multiple", "normal", 2.4625243895570748e-05]], "qwen": [[5248, " multiple", "normal", 2.091510032187216e-05]]}, "loss": {"rwkv": 21.289770568673937, "qwen": 21.590409618810526}, "topk": {"rwkv": [56679, 800, 2.4625243895570748e-05, [[21265, 0.170301, " and", false], [4715, 0.131235, " or", false], [50851, 0.091448, " actions", false], [45909, 0.031345, " events", false], [38604, 0.030503, " goals", false], [46606, 0.025559, " motion", false], [55816, 0.023921, " concepts", false], [47184, 0.02296, " scenes", false], [21643, 0.022612, " etc", false], [61661, 0.022446, " categories", false]]], "qwen": [5248, 1010, 2.091510032187216e-05, [[476, 0.146282, " or", false], [323, 0.125577, " and", false], [882, 0.073682, " time", false], [4992, 0.044693, " etc", false], [4244, 0.041437, " words", false], [4357, 0.028706, " events", false], [4128, 0.028093, " language", false], [6168, 0.020604, " actions", false], [11379, 0.01876, " motion", false], [279, 0.016326, " the", false]]]}, "raw_delta": -0.016670968797471764, "tuned_delta": -0.008099176766893515}, {"byte_start": 6262, "byte_end": 6269, "display": {"text": " agents", "kind": "normal"}, "is_word": true, "word_id": 1051, "word_key": " agents", "bytes_hex": "20 61 67 65 6e 74 73", "compression": {"rwkv": "10.47% 10.47% 10.47% 10.47% 10.47% 10.47% 10.47%", "qwen": "3.37% 3.37% 3.37% 3.37% 3.37% 3.37% 3.37%"}, "model_tokens": {"rwkv": [[45124, " agents", "normal", 0.017348535358905792]], "qwen": [[13009, " agents", "normal", 0.27024340629577637]]}, "loss": {"rwkv": 10.465979649306096, "qwen": 3.3708369235203084}, "topk": {"rwkv": [45124, 3, 0.017348535358905792, [[52342, 0.716978, " objects", false], [46691, 0.041405, " object", false], [45124, 0.017349, " agents", false], [47539, 0.016985, " things", false], [46, 0.011421, "-", false], [55816, 0.009144, " concepts", false], [38604, 0.009136, " goals", false], [9098, 0.005825, "xin", false], [56215, 0.005649, " features", false], [65275, 0.005428, " representations", false]]], "qwen": [13009, 1, 0.27024340629577637, [[13009, 0.270243, " agents", false], [6171, 0.051458, " objects", false], [43613, 0.049531, " representations", false], [15336, 0.044358, " dimensions", false], [38455, 0.029288, " perspectives", false], [20062, 0.022272, " minds", false], [1251, 0.020611, " people", false], [2513, 0.018062, " things", false], [37107, 0.016936, " senses", false], [6194, 0.015997, " views", false]]]}, "raw_delta": 0.39343825408390604, "tuned_delta": 0.40201004611448427}, {"byte_start": 6269, "byte_end": 6270, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "2.89%", "qwen": "2.10%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8509618043899536]], "qwen": [[11, ",", "normal", 0.8899271488189697]]}, "loss": {"rwkv": 2.8882078455296627, "qwen": 2.103010975907061}, "topk": {"rwkv": [45, 1, 0.8509618043899536, [[45, 0.850962, ",", false], [21265, 0.02726, " and", false], [63662, 0.024319, " interacting", false], [4596, 0.018076, " in", false], [45094, 0.01261, " acting", false], [47, 0.01086, ".", false], [4715, 0.007671, " or", false], [45580, 0.005719, " cooper", false], [53362, 0.00465, " working", false], [275, 0.004206, " (", false]]], "qwen": [11, 1, 0.8899271488189697, [[11, 0.889927, ",", false], [323, 0.024245, " and", false], [13, 0.015877, ".", false], [44730, 0.011038, " interacting", false], [304, 0.00927, " in", false], [476, 0.009064, " or", false], [6, 0.005501, "'", false], [448, 0.005398, " with", false], [4992, 0.005097, " etc", false], [320, 0.003637, " (", false]]]}, "raw_delta": 0.04354055970907211, "tuned_delta": 0.05211235173965036}, {"byte_start": 6270, "byte_end": 6273, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 1052, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"rwkv": "12.96% 12.96% 12.96%", "qwen": "16.14% 16.14% 16.14%"}, "model_tokens": {"rwkv": [[4715, " or", "normal", 0.11574005335569382]], "qwen": [[476, " or", "normal", 0.06827627867460251]]}, "loss": {"rwkv": 12.96171325798678, "qwen": 16.135299082036887}, "topk": {"rwkv": [4715, 3, 0.11574005335569382, [[21643, 0.148393, " etc", false], [21265, 0.147212, " and", false], [4715, 0.11574, " or", false], [38604, 0.038784, " goals", false], [50851, 0.031208, " actions", false], [45432, 0.023302, " causal", false], [32251, 0.017653, " time", false], [56529, 0.016348, " language", false], [22590, 0.012422, " the", false], [62143, 0.009965, " intentions", false]]], "qwen": [476, 3, 0.06827627867460251, [[4992, 0.362629, " etc", false], [323, 0.112262, " and", false], [476, 0.068276, " or", false], [882, 0.028907, " time", false], [5248, 0.022951, " multiple", false], [4128, 0.018681, " language", false], [279, 0.014417, " the", false], [6540, 0.013399, " knowledge", false], [8845, 0.012834, " goals", false], [3738, 0.009357, " human", false]]]}, "raw_delta": -0.17598096529642737, "tuned_delta": -0.16740917326584911}, {"byte_start": 6273, "byte_end": 6280, "display": {"text": " symmet", "kind": "normal"}, "is_word": true, "word_id": 1053, "word_key": " symmet", "bytes_hex": "20 73 79 6d 6d 65 74", "compression": {"rwkv": "24.31% 24.31% 24.31% 24.31% 24.31% 24.31% 24.31%", "qwen": "39.61% 39.61% 39.61% 39.61% 0.16% 0.16% 0.16%"}, "model_tokens": {"rwkv": [[47484, " symmet", "normal", 7.686301978537813e-05]], "qwen": [[7886, " sym", "normal", 0.00015302766405511647], [4059, "met", "normal", 0.9731724262237549]]}, "loss": {"rwkv": 24.313275800695703, "qwen": 22.702058773788}, "topk": {"rwkv": [47484, 763, 7.686301978537813e-05, [[30788, 0.082493, " even", false], [22590, 0.076892, " the", false], [45432, 0.03283, " causal", false], [38604, 0.027743, " goals", false], [47284, 0.024737, " simple", false], [39193, 0.023756, " other", false], [50851, 0.023154, " actions", false], [56529, 0.020575, " language", false], [38720, 0.017794, " human", false], [55816, 0.016268, " concepts", false]]], "qwen": [7886, 472, 0.00015302766405511647, [[279, 0.078277, " the", false], [1496, 0.069353, " even", false], [3738, 0.034636, " human", false], [1008, 0.032857, " other", false], [4128, 0.032166, " language", false], [5248, 0.025747, " multiple", false], [882, 0.020751, " time", false], [6540, 0.018177, " knowledge", false], [894, 0.017684, " any", false], [4113, 0.015942, " anything", false]]]}, "raw_delta": 0.08934484315770026, "tuned_delta": 0.0979166351882785}, {"byte_start": 6280, "byte_end": 6284, "display": {"text": "ries", "kind": "normal"}, "is_word": true, "word_id": 1054, "word_key": "ries", "bytes_hex": "72 69 65 73", "compression": {"rwkv": "0.00% 0.00% 0.00% 0.00%", "qwen": "0.00% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[26892, "ries", "normal", 0.9992349147796631]], "qwen": [[4019, "ries", "normal", 0.9997239708900452]]}, "loss": {"rwkv": 0.003456851282342453, "qwen": 0.0012445526786539558}, "topk": {"rwkv": [26892, 1, 0.9992349147796631, [[26892, 0.999235, "ries", false], [8623, 0.000359, "riz", false], [7789, 0.000162, "ies", false], [122, 3.4e-05, "y", false], [1939, 2.9e-05, "ic", false], [8608, 2.6e-05, "rie", false], [8619, 2e-05, "ris", false], [26910, 1.2e-05, "rise", false], [2159, 1e-05, "ri", false], [42193, 7e-06, "rising", false]]], "qwen": [4019, 1, 0.9997239708900452, [[4019, 0.999724, "ries", false], [81, 8.5e-05, "r", false], [7231, 2.8e-05, "rie", false], [4543, 2.7e-05, "tries", false], [550, 1.7e-05, "ies", false], [5963, 1.5e-05, "ris", false], [461, 1.3e-05, "ri", false], [1539, 7e-06, "try", false], [376, 6e-06, "tr", false], [25610, 5e-06, "rons", false]]]}, "raw_delta": 0.00012267588317627087, "tuned_delta": 0.008694467913754519}, {"byte_start": 6284, "byte_end": 6285, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "8.91%", "qwen": "12.28%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.6068022847175598]], "qwen": [[13, ".", "normal", 0.5062693953514099]]}, "loss": {"rwkv": 8.91117786486591, "qwen": 12.275286427839026}, "topk": {"rwkv": [47, 1, 0.6068022847175598, [[47, 0.606802, ".", false], [45, 0.272887, ",", false], [4706, 0.022284, " of", false], [4596, 0.019909, " in", false], [60, 0.0176, ";", false], [275, 0.013365, " (", false], [21265, 0.012714, " and", false], [4715, 0.011999, " or", false], [5346, 0.004998, "---", false], [32227, 0.002968, " that", false]]], "qwen": [13, 1, 0.5062693953514099, [[13, 0.506269, ".", false], [11, 0.235655, ",", false], [382, 0.050041, ".\n\n", false], [323, 0.049627, " and", false], [476, 0.036576, " or", false], [304, 0.02841, " in", false], [315, 0.025678, " of", false], [4421, 0.014913, "---", false], [26, 0.014688, ";", false], [320, 0.012269, " (", false]]]}, "raw_delta": -0.18654578924179077, "tuned_delta": -0.17797399721121251}, {"byte_start": 6285, "byte_end": 6289, "display": {"text": " All", "kind": "normal"}, "is_word": true, "word_id": 1055, "word_key": " all", "bytes_hex": "20 41 6c 6c", "compression": {"rwkv": "20.99% 20.99% 20.99% 20.99%", "qwen": "19.97% 19.97% 19.97% 19.97%"}, "model_tokens": {"rwkv": [[19407, " All", "normal", 0.009374026209115982]], "qwen": [[2009, " All", "normal", 0.011931069195270538]]}, "loss": {"rwkv": 20.99233995043511, "qwen": 19.966039930760708}, "topk": {"rwkv": [19407, 16, 0.009374026209115982, [[20996, 0.144864, " The", false], [4331, 0.105113, " We", false], [50342, 0.064783, " Instead", false], [29894, 0.05346, " This", false], [37453, 0.052519, " These", false], [261, 0.047597, "\n\n", false], [3913, 0.030471, " In", false], [37451, 0.029898, " There", false], [3918, 0.029551, " It", false], [29834, 0.018962, " Such", false]]], "qwen": [2009, 15, 0.011931069195270538, [[576, 0.137482, " The", false], [1205, 0.108703, " We", false], [12090, 0.078001, " Instead", false], [1096, 0.065582, " This", false], [4220, 0.051513, " These", false], [1084, 0.039099, " It", false], [758, 0.025056, " In", false], [2619, 0.024796, " There", false], [15132, 0.024106, " Such", false], [1416, 0.021449, " If", false]]]}, "raw_delta": 0.056910157203674316, "tuned_delta": 0.06548194923425256}, {"byte_start": 6289, "byte_end": 6295, "display": {"text": " these", "kind": "normal"}, "is_word": true, "word_id": 1056, "word_key": " these", "bytes_hex": "20 74 68 65 73 65", "compression": {"rwkv": "4.25% 4.25% 4.25% 4.25% 4.25% 4.25%", "qwen": "4.02% 4.02% 4.02% 4.02% 4.02% 4.02%"}, "model_tokens": {"rwkv": [[39936, " these", "normal", 0.24104814231395721]], "qwen": [[1493, " these", "normal", 0.26273828744888306]]}, "loss": {"rwkv": 4.250126992202187, "qwen": 4.0172950879781695}, "topk": {"rwkv": [39936, 2, 0.24104814231395721, [[4706, 0.345517, " of", false], [39936, 0.241048, " these", false], [32139, 0.116757, " such", false], [22590, 0.064086, " the", false], [32234, 0.035297, " this", false], [39944, 0.032699, " those", false], [32227, 0.021556, " that", false], [22248, 0.015256, " our", false], [4858, 0.014967, " we", false], [55572, 0.007599, " attempts", false]]], "qwen": [1493, 2, 0.26273828744888306, [[315, 0.365524, " of", false], [1493, 0.262738, " these", false], [1741, 0.059072, " such", false], [279, 0.050706, " the", false], [419, 0.038164, " this", false], [429, 0.035941, " that", false], [582, 0.032031, " we", false], [1846, 0.029898, " those", false], [1039, 0.023221, " our", false], [13553, 0.009483, " attempts", false]]]}, "raw_delta": 0.012910942236582457, "tuned_delta": 0.021482734267160707}, {"byte_start": 6295, "byte_end": 6299, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 1057, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"rwkv": "7.96% 7.96% 7.96% 7.96%", "qwen": "7.74% 7.74% 7.74% 7.74%"}, "model_tokens": {"rwkv": [[21286, " are", "normal", 0.17364351451396942]], "qwen": [[525, " are", "normal", 0.17949646711349487]]}, "loss": {"rwkv": 7.960182598654924, "qwen": 7.743664502905407}, "topk": {"rwkv": [21286, 1, 0.17364351451396942, [[21286, 0.173644, " are", false], [47539, 0.109253, " things", false], [47284, 0.097019, " simple", false], [32448, 0.038409, " ways", false], [61590, 0.034588, " approaches", false], [51566, 0.033651, " efforts", false], [55572, 0.031193, " attempts", false], [38735, 0.030757, " ideas", false], [55816, 0.027786, " concepts", false], [52326, 0.027406, " notions", false]]], "qwen": [525, 1, 0.17949646711349487, [[525, 0.179496, " are", false], [2513, 0.14278, " things", false], [4285, 0.083813, " simple", false], [614, 0.033614, " have", false], [18940, 0.026301, " concepts", false], [6708, 0.024537, " ideas", false], [58582, 0.022189, " notions", false], [5510, 0.021111, " ways", false], [2803, 0.020764, " seem", false], [13553, 0.019804, " attempts", false]]]}, "raw_delta": 0.012006312608718872, "tuned_delta": 0.020578104639297122}, {"byte_start": 6299, "byte_end": 6304, "display": {"text": " part", "kind": "normal"}, "is_word": true, "word_id": 1058, "word_key": " part", "bytes_hex": "20 70 61 72 74", "compression": {"rwkv": "20.18% 20.18% 20.18% 20.18% 20.18%", "qwen": "17.79% 17.79% 17.79% 17.79% 17.79%"}, "model_tokens": {"rwkv": [[31633, " part", "normal", 0.0036934264935553074]], "qwen": [[949, " part", "normal", 0.00720400782302022]]}, "loss": {"rwkv": 20.175188462431596, "qwen": 17.79246170535885}, "topk": {"rwkv": [31633, 47, 0.0036934264935553074, [[32386, 0.047963, " very", false], [22614, 0.043635, " too", false], [47284, 0.039228, " simple", false], [51258, 0.038984, " complex", false], [59829, 0.028351, " important", false], [32448, 0.026706, " ways", false], [59699, 0.016265, " extremely", false], [47539, 0.014897, " things", false], [63366, 0.014604, " complicated", false], [56162, 0.014202, " examples", false]]], "qwen": [949, 26, 0.00720400782302022, [[5390, 0.053922, " useful", false], [4285, 0.028505, " simple", false], [6351, 0.027971, " complex", false], [1602, 0.026334, " very", false], [2238, 0.025342, " too", false], [2989, 0.023064, " important", false], [1101, 0.019092, " just", false], [2244, 0.016302, " great", false], [9016, 0.016134, " extremely", false], [1661, 0.015528, " good", false]]]}, "raw_delta": 0.1321264266967772, "tuned_delta": 0.14069821872735547}, {"byte_start": 6304, "byte_end": 6307, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 1059, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.06% 0.06% 0.06%", "qwen": "0.11% 0.11% 0.11%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9901755452156067]], "qwen": [[315, " of", "normal", 0.9824559688568115]]}, "loss": {"rwkv": 0.05980410046002732, "qwen": 0.10639722371129687}, "topk": {"rwkv": [4706, 1, 0.9901755452156067, [[4706, 0.990176, " of", false], [21265, 0.007056, " and", false], [46, 0.000809, "-", false], [45, 0.000642, ",", false], [22590, 0.000218, " the", false], [275, 8.5e-05, " (", false], [4596, 7.1e-05, " in", false], [4715, 6.4e-05, " or", false], [38720, 3.4e-05, " human", false], [568, 3.3e-05, "--", false]]], "qwen": [315, 1, 0.9824559688568115, [[315, 0.982456, " of", false], [323, 0.012155, " and", false], [11, 0.002275, ",", false], [9777, 0.000429, "-and", false], [4421, 0.000221, "---", false], [6351, 0.000212, " complex", false], [320, 0.000203, " (", false], [714, 0.000132, " but", false], [279, 0.000132, " the", false], [476, 0.000102, " or", false]]]}, "raw_delta": -0.0025836713612079616, "tuned_delta": 0.005988120669370286}, {"byte_start": 6307, "byte_end": 6311, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1060, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "2.48% 2.48% 2.48% 2.48%", "qwen": "2.77% 2.77% 2.77% 2.77%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.5780766606330872]], "qwen": [[279, " the", "normal", 0.5408031344413757]]}, "loss": {"rwkv": 2.483154306217576, "qwen": 2.7713270923888382}, "topk": {"rwkv": [22590, 1, 0.5780766606330872, [[22590, 0.578077, " the", false], [32464, 0.069887, " what", false], [22248, 0.044835, " our", false], [38720, 0.038102, " human", false], [332, 0.037381, " a", false], [39026, 0.037153, " minds", false], [21835, 0.025059, " how", false], [52652, 0.020581, " reality", false], [51258, 0.012993, " complex", false], [57419, 0.012202, " thinking", false]]], "qwen": [279, 1, 0.5408031344413757, [[279, 0.540803, " the", false], [1039, 0.075508, " our", false], [1128, 0.062604, " what", false], [3738, 0.043597, " human", false], [20062, 0.042312, " minds", false], [264, 0.041211, " a", false], [3971, 0.020199, " mind", false], [6351, 0.016703, " complex", false], [1246, 0.009529, " how", false], [4586, 0.008416, " general", false]]]}, "raw_delta": -0.015979692339897156, "tuned_delta": -0.0074079003093189075}, {"byte_start": 6311, "byte_end": 6321, "display": {"text": " arbitrary", "kind": "normal"}, "is_word": true, "word_id": 1061, "word_key": " arbitrary", "bytes_hex": "20 61 72 62 69 74 72 61 72 79", "compression": {"rwkv": "18.15% 18.15% 18.15% 18.15% 18.15% 18.15% 18.15% 18.15% 18.15% 18.15%", "qwen": "18.48% 18.48% 18.48% 18.48% 18.48% 18.48% 18.48% 18.48% 18.48% 18.48%"}, "model_tokens": {"rwkv": [[59163, " arbitrary", "normal", 4.2606767237884924e-05]], "qwen": [[24168, " arbitrary", "normal", 3.55418051185552e-05]]}, "loss": {"rwkv": 18.14639856118149, "qwen": 18.475153717264796}, "topk": {"rwkv": [59163, 890, 4.2606767237884924e-05, [[61720, 0.181785, " complexity", false], [55847, 0.125567, " contents", false], [31427, 0.062453, " mind", false], [38720, 0.041804, " human", false], [51258, 0.037608, " complex", false], [51308, 0.031101, " content", false], [52569, 0.030807, " problem", false], [31835, 0.030627, " real", false], [45098, 0.02853, " actual", false], [22752, 0.020391, " way", false]]], "qwen": [24168, 1218, 3.55418051185552e-05, [[23094, 0.230235, " complexity", false], [3971, 0.082195, " mind", false], [6351, 0.044407, " complex", false], [3738, 0.025924, " human", false], [8794, 0.024136, " contents", false], [5042, 0.021258, " actual", false], [3491, 0.020376, " problem", false], [20062, 0.020193, " minds", false], [88930, 0.0185, " richness", false], [2213, 0.016962, " content", false]]]}, "raw_delta": -0.01823005676269518, "tuned_delta": -0.009658264732116931}, {"byte_start": 6321, "byte_end": 6322, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "41.98%", "qwen": "36.15%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.09706572443246841]], "qwen": [[11, ",", "normal", 0.13471338152885437]]}, "loss": {"rwkv": 41.98467990087022, "qwen": 36.15043504345827}, "topk": {"rwkv": [45, 2, 0.09706572443246841, [[61720, 0.483272, " complexity", false], [45, 0.097066, ",", false], [60572, 0.036714, " structure", false], [21265, 0.025786, " and", false], [55847, 0.017039, " contents", false], [64294, 0.016393, " complexities", false], [22752, 0.014772, " way", false], [51308, 0.013878, " content", false], [38720, 0.011606, " human", false], [46642, 0.01099, " nature", false]]], "qwen": [11, 2, 0.13471338152885437, [[23094, 0.148095, " complexity", false], [11, 0.134713, ",", false], [323, 0.055262, " and", false], [5944, 0.043879, " structure", false], [3738, 0.041658, " human", false], [15491, 0.030826, " simpl", false], [3565, 0.021551, " details", false], [10502, 0.014835, " mental", false], [2213, 0.014607, " content", false], [6993, 0.014223, " nature", false]]]}, "raw_delta": 0.323519229888916, "tuned_delta": 0.33209102191949424}, {"byte_start": 6322, "byte_end": 6336, "display": {"text": " intrinsically", "kind": "normal"}, "is_word": true, "word_id": 1062, "word_key": " intrinsically", "bytes_hex": "20 69 6e 74 72 69 6e 73 69 63 61 6c 6c 79", "compression": {"rwkv": "11.05% 11.05% 11.05% 11.05% 11.05% 11.05% 11.05% 11.05% 11.05% 11.05% 5.21% 5.21% 5.21% 5.21%", "qwen": "30.80% 30.80% 30.80% 30.80% 30.80% 0.10% 0.10% 0.10% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[59914, " intrinsic", "normal", 0.0021597729064524174], [24525, "ally", "normal", 0.31128764152526855]], "qwen": [[10582, " intr", "normal", 0.00019538900232873857], [1330, "ins", "normal", 0.9828972220420837], [2673, "ically", "normal", 0.9994437098503113]]}, "loss": {"rwkv": 9.37912791649354, "qwen": 11.024154460112934}, "topk": {"rwkv": [59914, 48, 0.0021597729064524174, [[51258, 0.14994, " complex", false], [38720, 0.13498, " human", false], [63366, 0.035795, " complicated", false], [39011, 0.035125, " messy", false], [21265, 0.025959, " and", false], [62590, 0.017408, " subjective", false], [47284, 0.015247, " simple", false], [21861, 0.010734, " idi", false], [21400, 0.010487, " but", false], [22184, 0.009928, " non", false]]], "qwen": [10582, 561, 0.00019538900232873857, [[24870, 0.118122, " irre", false], [6351, 0.08494, " complex", false], [3738, 0.072046, " human", false], [323, 0.033334, " and", false], [714, 0.015954, " but", false], [650, 0.015624, " un", false], [16965, 0.01198, " complicated", false], [877, 0.011912, " id", false], [45846, 0.010069, " messy", false], [24168, 0.009484, " arbitrary", false]]]}, "raw_delta": -0.09121964085248425, "tuned_delta": -0.08264784882190601}, {"byte_start": 6336, "byte_end": 6344, "display": {"text": "-complex", "kind": "normal"}, "is_word": true, "word_id": 1063, "word_key": "-complex", "bytes_hex": "2d 63 6f 6d 70 6c 65 78", "compression": {"rwkv": "75.52% 1.55% 1.55% 1.55% 1.55% 1.55% 1.55% 1.55%", "qwen": "21.28% 21.28% 21.28% 21.28% 0.08% 0.08% 0.08% 0.08%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.015309866517782211], [48997, "complex", "normal", 0.5483301281929016]], "qwen": [[11476, "-com", "normal", 0.008921952918171883], [9111, "plex", "normal", 0.9829851984977722]]}, "loss": {"rwkv": 10.795557373839532, "qwen": 10.676848137768228}, "topk": {"rwkv": [46, 8, 0.015309866517782211, [[51258, 0.472701, " complex", false], [63366, 0.071237, " complicated", false], [39011, 0.056884, " messy", false], [59516, 0.031709, " difficult", false], [31048, 0.025811, " hard", false], [38797, 0.016166, " intra", false], [38720, 0.015675, " human", false], [46, 0.01531, "-", false], [47284, 0.015209, " simple", false], [63682, 0.0082, " irreducible", false]]], "qwen": [11476, 9, 0.008921952918171883, [[6351, 0.474555, " complex", false], [16965, 0.050957, " complicated", false], [5000, 0.04705, " difficult", false], [83544, 0.027861, " unknow", false], [650, 0.021079, " un", false], [2588, 0.018002, " hard", false], [24870, 0.01069, " irre", false], [3738, 0.009019, " human", false], [11476, 0.008922, "-com", false], [55926, 0.007587, " meaningless", false]]]}, "raw_delta": 0.006582637783139944, "tuned_delta": 0.015154429813718192}, {"byte_start": 6344, "byte_end": 6345, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "44.80%", "qwen": "37.66%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.08270533382892609]], "qwen": [[11, ",", "normal", 0.12389146536588669]]}, "loss": {"rwkv": 44.80244365260648, "qwen": 37.66064049808222}, "topk": {"rwkv": [45, 4, 0.08270533382892609, [[55847, 0.305905, " contents", false], [46642, 0.132776, " nature", false], [60572, 0.132112, " structure", false], [45, 0.082705, ",", false], [51308, 0.0699, " content", false], [46, 0.012652, "-", false], [56480, 0.012218, " internal", false], [38720, 0.012206, " human", false], [61720, 0.011211, " complexity", false], [22752, 0.009044, " way", false]]], "qwen": [11, 1, 0.12389146536588669, [[11, 0.123891, ",", false], [8794, 0.092671, " contents", false], [6993, 0.071234, " nature", false], [5944, 0.060559, " structure", false], [1879, 0.058331, " world", false], [2213, 0.033085, " content", false], [3971, 0.03014, " mind", false], [10502, 0.023869, " mental", false], [323, 0.022605, " and", false], [20062, 0.01616, " minds", false]]]}, "raw_delta": 0.3960256576538086, "tuned_delta": 0.4045974496843868}, {"byte_start": 6345, "byte_end": 6353, "display": {"text": " outside", "kind": "normal"}, "is_word": true, "word_id": 1064, "word_key": " outside", "bytes_hex": "20 6f 75 74 73 69 64 65", "compression": {"rwkv": "23.95% 23.95% 23.95% 23.95% 23.95% 23.95% 23.95% 23.95%", "qwen": "21.42% 21.42% 21.42% 21.42% 21.42% 21.42% 21.42% 21.42%"}, "model_tokens": {"rwkv": [[52391, " outside", "normal", 2.3365817469311878e-05]], "qwen": [[4889, " outside", "normal", 7.482973160222173e-05]]}, "loss": {"rwkv": 23.95099188975818, "qwen": 21.41567094596764}, "topk": {"rwkv": [52391, 1867, 2.3365817469311878e-05, [[55847, 0.087454, " contents", false], [21265, 0.054203, " and", false], [60572, 0.047959, " structure", false], [38720, 0.045599, " human", false], [51308, 0.027095, " content", false], [46642, 0.026357, " nature", false], [39011, 0.023997, " messy", false], [56480, 0.021559, " internal", false], [31835, 0.020745, " real", false], [63682, 0.016748, " irreducible", false]]], "qwen": [4889, 960, 7.482973160222173e-05, [[24870, 0.181912, " irre", false], [323, 0.08592, " and", false], [3971, 0.045985, " mind", false], [3738, 0.029883, " human", false], [20062, 0.022767, " minds", false], [8794, 0.020036, " contents", false], [1931, 0.011558, " real", false], [2213, 0.010374, " content", false], [10502, 0.008828, " mental", false], [7548, 0.008385, " highly", false]]]}, "raw_delta": 0.14058804512023926, "tuned_delta": 0.14915983715081751}, {"byte_start": 6353, "byte_end": 6359, "display": {"text": " world", "kind": "normal"}, "is_word": true, "word_id": 1065, "word_key": " world", "bytes_hex": "20 77 6f 72 6c 64", "compression": {"rwkv": "6.72% 6.72% 6.72% 6.72% 6.72% 6.72%", "qwen": "3.07% 3.07% 3.07% 3.07% 3.07% 3.07%"}, "model_tokens": {"rwkv": [[40213, " world", "normal", 0.10787786543369293]], "qwen": [[1879, " world", "normal", 0.3606451451778412]]}, "loss": {"rwkv": 6.71567027497141, "qwen": 3.065308771741586}, "topk": {"rwkv": [40213, 2, 0.10787786543369293, [[46, 0.657547, "-", false], [40213, 0.107878, " world", false], [22590, 0.025483, " the", false], [4706, 0.024886, " of", false], [46642, 0.017877, " nature", false], [52652, 0.014205, " reality", false], [32398, 0.009414, " view", false], [60572, 0.007526, " structure", false], [63536, 0.006055, " environment", false], [63637, 0.00572, " information", false]]], "qwen": [1879, 1, 0.3606451451778412, [[1879, 0.360645, " world", false], [10603, 0.193052, "-the", false], [315, 0.051654, " of", false], [30084, 0.041532, "-world", false], [279, 0.03997, " the", false], [8729, 0.039052, " reality", false], [11, 0.023874, ",", false], [8668, 0.017669, "-of", false], [7947, 0.014426, " domain", false], [12, 0.006347, "-", false]]]}, "raw_delta": 0.20241902271906534, "tuned_delta": 0.2109908147496436}, {"byte_start": 6359, "byte_end": 6360, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "19.30%", "qwen": "32.75%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.3428715169429779]], "qwen": [[13, ".", "normal", 0.16265623271465302]]}, "loss": {"rwkv": 19.301681699393356, "qwen": 32.751273191564614}, "topk": {"rwkv": [47, 1, 0.3428715169429779, [[47, 0.342872, ".", false], [45, 0.246875, ",", false], [32227, 0.111944, " that", false], [4706, 0.060651, " of", false], [4858, 0.051275, " we", false], [60, 0.036922, ";", false], [5346, 0.034979, "---", false], [21265, 0.023958, " and", false], [4596, 0.020023, " in", false], [4811, 0.008261, " to", false]]], "qwen": [13, 3, 0.16265623271465302, [[11, 0.304169, ",", false], [429, 0.212047, " that", false], [13, 0.162656, ".", false], [315, 0.073421, " of", false], [582, 0.04008, " we", false], [323, 0.037262, " and", false], [304, 0.03095, " in", false], [26, 0.019891, ";", false], [382, 0.013724, ".\n\n", false], [4421, 0.011087, "---", false]]]}, "raw_delta": -0.745803713798523, "tuned_delta": -0.7372319217679447}, {"byte_start": 6360, "byte_end": 6365, "display": {"text": " They", "kind": "normal"}, "is_word": true, "word_id": 1066, "word_key": " they", "bytes_hex": "20 54 68 65 79", "compression": {"rwkv": "11.21% 11.21% 11.21% 11.21% 11.21%", "qwen": "11.05% 11.05% 11.05% 11.05% 11.05%"}, "model_tokens": {"rwkv": [[29893, " They", "normal", 0.04504038393497467]], "qwen": [[2379, " They", "normal", 0.046690043061971664]]}, "loss": {"rwkv": 11.214699731910299, "qwen": 11.051852799461324}, "topk": {"rwkv": [29893, 4, 0.04504038393497467, [[20996, 0.153233, " The", false], [4331, 0.128593, " We", false], [50342, 0.049215, " Instead", false], [29893, 0.04504, " They", false], [261, 0.042059, "\n\n", false], [30031, 0.036273, " What", false], [3918, 0.031607, " It", false], [19555, 0.030127, " But", false], [37451, 0.027606, " There", false], [20571, 0.027526, " Our", false]]], "qwen": [2379, 3, 0.046690043061971664, [[576, 0.16355, " The", false], [1205, 0.103303, " We", false], [2379, 0.04669, " They", false], [1084, 0.039729, " It", false], [12090, 0.027401, " Instead", false], [2619, 0.024403, " There", false], [2014, 0.023697, " To", false], [758, 0.022879, " In", false], [1416, 0.022751, " If", false], [1597, 0.022629, " And", false]]]}, "raw_delta": 0.009030151367187433, "tuned_delta": 0.017601943397765683}, {"byte_start": 6365, "byte_end": 6369, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 1067, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"rwkv": "3.29% 3.29% 3.29% 3.29%", "qwen": "2.57% 2.57% 2.57% 2.57%"}, "model_tokens": {"rwkv": [[21286, " are", "normal", 0.4786088466644287]], "qwen": [[525, " are", "normal", 0.5650731921195984]]}, "loss": {"rwkv": 3.29326138484175, "qwen": 2.5734070392698905}, "topk": {"rwkv": [21286, 1, 0.4786088466644287, [[21286, 0.478609, " are", false], [4491, 0.081424, " do", false], [47266, 0.067275, " should", false], [31059, 0.052875, " have", false], [45409, 0.041094, " cannot", false], [21413, 0.041028, " can", false], [22074, 0.019537, " may", false], [32475, 0.017421, " will", false], [31506, 0.015219, " need", false], [21256, 0.013112, " all", false]]], "qwen": [525, 1, 0.5650731921195984, [[525, 0.565073, " are", false], [653, 0.050742, " do", false], [614, 0.046284, " have", false], [646, 0.043862, " can", false], [1265, 0.041158, " should", false], [1231, 0.027971, " may", false], [4157, 0.024155, " cannot", false], [3000, 0.012619, " exist", false], [1969, 0.011286, " must", false], [1184, 0.011214, " need", false]]]}, "raw_delta": 0.039917200803756714, "tuned_delta": 0.048488992834334964}, {"byte_start": 6369, "byte_end": 6373, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 1068, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "5.11% 5.11% 5.11% 5.11%", "qwen": "5.43% 5.43% 5.43% 5.43%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.32195380330085754]], "qwen": [[537, " not", "normal", 0.29971134662628174]]}, "loss": {"rwkv": 5.107196800021964, "qwen": 5.4323574112130855}, "topk": {"rwkv": [22187, 1, 0.32195380330085754, [[22187, 0.321954, " not", false], [31633, 0.051663, " part", false], [22590, 0.04268, " the", false], [21256, 0.039106, " all", false], [332, 0.013656, " a", false], [31296, 0.012447, " like", false], [31198, 0.011998, " just", false], [45, 0.011522, ",", false], [32464, 0.011268, " what", false], [39934, 0.01115, " there", false]]], "qwen": [537, 1, 0.29971134662628174, [[537, 0.299711, " not", false], [949, 0.055794, " part", false], [279, 0.04706, " the", false], [678, 0.025093, " all", false], [1101, 0.018226, " just", false], [1128, 0.015271, " what", false], [1172, 0.014496, " only", false], [5390, 0.012231, " useful", false], [11, 0.010814, ",", false], [2513, 0.010723, " things", false]]]}, "raw_delta": -0.01803073287010193, "tuned_delta": -0.00945894083952368}, {"byte_start": 6373, "byte_end": 6378, "display": {"text": " what", "kind": "normal"}, "is_word": true, "word_id": 1069, "word_key": " what", "bytes_hex": "20 77 68 61 74", "compression": {"rwkv": "17.36% 17.36% 17.36% 17.36% 17.36%", "qwen": "13.71% 13.71% 13.71% 13.71% 13.71%"}, "model_tokens": {"rwkv": [[32464, " what", "normal", 0.00808615144342184]], "qwen": [[1128, " what", "normal", 0.022369293496012688]]}, "loss": {"rwkv": 17.35742471069534, "qwen": 13.705840912433946}, "topk": {"rwkv": [32464, 19, 0.00808615144342184, [[31633, 0.116338, " part", false], [59914, 0.103823, " intrinsic", false], [22590, 0.088474, " the", false], [47284, 0.050883, " simple", false], [45, 0.024164, ",", false], [4596, 0.022836, " in", false], [47539, 0.021188, " things", false], [63591, 0.016011, " fundamental", false], [4811, 0.01387, " to", false], [332, 0.012946, " a", false]]], "qwen": [1128, 5, 0.022369293496012688, [[949, 0.257528, " part", false], [279, 0.149537, " the", false], [304, 0.03459, " in", false], [4766, 0.029046, " inside", false], [1128, 0.022369, " what", false], [46601, 0.018088, " intrinsic", false], [11, 0.013909, ",", false], [4285, 0.012322, " simple", false], [264, 0.011966, " a", false], [9902, 0.011239, " ``", false]]]}, "raw_delta": 0.20248680114746098, "tuned_delta": 0.21105859317803924}, {"byte_start": 6378, "byte_end": 6385, "display": {"text": " should", "kind": "normal"}, "is_word": true, "word_id": 1070, "word_key": " should", "bytes_hex": "20 73 68 6f 75 6c 64", "compression": {"rwkv": "10.30% 10.30% 10.30% 10.30% 10.30% 10.30% 10.30%", "qwen": "16.70% 16.70% 16.70% 16.70% 16.70% 16.70% 16.70%"}, "model_tokens": {"rwkv": [[47266, " should", "normal", 0.018452977761626244]], "qwen": [[1265, " should", "normal", 0.0015293064061552286]]}, "loss": {"rwkv": 10.304964577778307, "qwen": 16.701618500909266}, "topk": {"rwkv": [47266, 7, 0.018452977761626244, [[4858, 0.266663, " we", false], [39026, 0.116671, " minds", false], [4600, 0.110939, " is", false], [22590, 0.081737, " the", false], [3609, 0.038492, " AI", false], [38964, 0.02024, " makes", false], [47266, 0.018453, " should", false], [21286, 0.018429, " are", false], [52201, 0.016266, " matters", false], [332, 0.01494, " a", false]]], "qwen": [1265, 39, 0.0015293064061552286, [[279, 0.238696, " the", false], [582, 0.149782, " we", false], [374, 0.120309, " is", false], [20062, 0.100219, " minds", false], [1039, 0.050444, " our", false], [3643, 0.0339, " makes", false], [432, 0.024385, " it", false], [5780, 0.018558, " goes", false], [12677, 0.015993, " humans", false], [264, 0.011859, " a", false]]]}, "raw_delta": -0.354705810546875, "tuned_delta": -0.34613401851629677}, {"byte_start": 6385, "byte_end": 6388, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 1071, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"rwkv": "0.68% 0.68% 0.68%", "qwen": "1.14% 1.14% 1.14%"}, "model_tokens": {"rwkv": [[4435, " be", "normal", 0.8929682374000549]], "qwen": [[387, " be", "normal", 0.8268448710441589]]}, "loss": {"rwkv": 0.6838947439109873, "qwen": 1.1429644508871892}, "topk": {"rwkv": [4435, 1, 0.8929682374000549, [[4435, 0.892968, " be", false], [46530, 0.010812, " matter", false], [38649, 0.010182, " guide", false], [38306, 0.009278, " drive", false], [51273, 0.005512, " concern", false], [38377, 0.004994, " enter", false], [4715, 0.004612, " or", false], [4559, 0.002851, " go", false], [31059, 0.002417, " have", false], [47008, 0.002415, " really", false]]], "qwen": [387, 1, 0.8268448710441589, [[387, 0.826845, " be", false], [8474, 0.029989, " guide", false], [6541, 0.017479, " drive", false], [6051, 0.009878, " inform", false], [728, 0.00861, " go", false], [4925, 0.007859, " matter", false], [8253, 0.007208, " determine", false], [61325, 0.005009, " motivate", false], [6979, 0.004122, " define", false], [1281, 0.003884, " make", false]]]}, "raw_delta": -0.02545622984568278, "tuned_delta": -0.016884437815104535}, {"byte_start": 6388, "byte_end": 6394, "display": {"text": " built", "kind": "normal"}, "is_word": true, "word_id": 1072, "word_key": " built", "bytes_hex": "20 62 75 69 6c 74", "compression": {"rwkv": "11.32% 11.32% 11.32% 11.32% 11.32% 11.32%", "qwen": "11.21% 11.21% 11.21% 11.21% 11.21% 11.21%"}, "model_tokens": {"rwkv": [[37924, " built", "normal", 0.02331293746829033]], "qwen": [[5798, " built", "normal", 0.023984147235751152]]}, "loss": {"rwkv": 11.318017736140629, "qwen": 11.212031277763288}, "topk": {"rwkv": [37924, 10, 0.02331293746829033, [[22339, 0.094739, " put", false], [22590, 0.071422, " the", false], [53137, 0.060476, " thought", false], [52249, 0.054899, " modeled", false], [53035, 0.049894, " studied", false], [4596, 0.044018, " in", false], [52112, 0.035605, " learned", false], [39887, 0.026018, " taken", false], [61755, 0.025804, " considered", false], [37924, 0.023313, " built", false]]], "qwen": [5798, 9, 0.023984147235751152, [[3381, 0.102225, " thought", false], [279, 0.082371, " the", false], [61553, 0.073139, " modeled", false], [304, 0.057516, " in", false], [4766, 0.056733, " inside", false], [15251, 0.036094, " represented", false], [9498, 0.034182, " learned", false], [518, 0.025864, " at", false], [5798, 0.023984, " built", false], [19476, 0.023806, " studied", false]]]}, "raw_delta": 0.005877137184143066, "tuned_delta": 0.014448929214721315}, {"byte_start": 6394, "byte_end": 6397, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 1073, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "14.46% 14.46% 14.46%", "qwen": "10.69% 10.69% 10.69%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.09114251285791397]], "qwen": [[304, " in", "normal", 0.16885791718959808]]}, "loss": {"rwkv": 14.464520592246117, "qwen": 10.692159254357676}, "topk": {"rwkv": [4596, 2, 0.09114251285791397, [[31162, 0.839627, " into", false], [4596, 0.091143, " in", false], [46, 0.010649, "-", false], [46301, 0.008812, " inside", false], [47, 0.006814, ".", false], [4450, 0.005827, " by", false], [45, 0.004704, ",", false], [21265, 0.002709, " and", false], [4423, 0.002373, " as", false], [4715, 0.002369, " or", false]]], "qwen": [304, 2, 0.16885791718959808, [[1119, 0.712143, " into", false], [304, 0.168858, " in", false], [4766, 0.053773, " inside", false], [11, 0.00777, ",", false], [2878, 0.006168, " within", false], [311, 0.005287, " to", false], [323, 0.004373, " and", false], [13, 0.004349, ".", false], [553, 0.004262, " by", false], [369, 0.003311, " for", false]]]}, "raw_delta": 0.2091841300328573, "tuned_delta": 0.21775592206343555}, {"byte_start": 6397, "byte_end": 6398, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "40.86%", "qwen": "48.25%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.10549722611904144]], "qwen": [[11, ",", "normal", 0.0688665434718132]]}, "loss": {"rwkv": 40.857574400175714, "qwen": 48.25066140587562}, "topk": {"rwkv": [45, 3, 0.10549722611904144, [[4811, 0.373112, " to", false], [47, 0.221567, ".", false], [45, 0.105497, ",", false], [4423, 0.03443, " as", false], [22590, 0.026247, " the", false], [22248, 0.023031, " our", false], [3609, 0.021817, " AI", false], [4450, 0.019882, " by", false], [60, 0.016826, ";", false], [21265, 0.01213, " and", false]]], "qwen": [11, 3, 0.0688665434718132, [[311, 0.609426, " to", false], [13, 0.07712, ".", false], [11, 0.068867, ",", false], [279, 0.042724, " the", false], [1039, 0.025157, " our", false], [264, 0.023088, " a", false], [382, 0.016726, ".\n\n", false], [476, 0.014431, " or", false], [458, 0.013104, " an", false], [20062, 0.009841, " minds", false]]]}, "raw_delta": -0.4099597930908203, "tuned_delta": -0.4013880010602421}, {"byte_start": 6398, "byte_end": 6401, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 1074, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"rwkv": "15.97% 15.97% 15.97%", "qwen": "20.21% 20.21% 20.21%"}, "model_tokens": {"rwkv": [[4423, " as", "normal", 0.07138797640800476]], "qwen": [[438, " as", "normal", 0.03467898070812225]]}, "loss": {"rwkv": 15.967327926505453, "qwen": 20.20747849176884}, "topk": {"rwkv": [4423, 4, 0.07138797640800476, [[21265, 0.209805, " and", false], [21400, 0.142508, " but", false], [4715, 0.100561, " or", false], [4423, 0.071388, " as", false], [32232, 0.054404, " they", false], [51018, 0.043878, " because", false], [4596, 0.038, " in", false], [22185, 0.03465, " nor", false], [4811, 0.014699, " to", false], [30788, 0.013509, " even", false]]], "qwen": [438, 7, 0.03467898070812225, [[323, 0.207156, " and", false], [476, 0.162336, " or", false], [6329, 0.139448, " nor", false], [714, 0.08335, " but", false], [1576, 0.046677, " because", false], [807, 0.039988, " they", false], [438, 0.034679, " as", false], [1496, 0.025316, " even", false], [311, 0.022693, " to", false], [304, 0.021659, " in", false]]]}, "raw_delta": -0.23512387275695812, "tuned_delta": -0.22655208072637986}, {"byte_start": 6401, "byte_end": 6407, "display": {"text": " their", "kind": "normal"}, "is_word": true, "word_id": 1075, "word_key": " their", "bytes_hex": "20 74 68 65 69 72", "compression": {"rwkv": "16.25% 16.25% 16.25% 16.25% 16.25% 16.25%", "qwen": "15.12% 15.12% 15.12% 15.12% 15.12% 15.12%"}, "model_tokens": {"rwkv": [[39931, " their", "normal", 0.004446817561984062]], "qwen": [[862, " their", "normal", 0.006524569820612669]]}, "loss": {"rwkv": 16.24910430167908, "qwen": 15.124794952249854}, "topk": {"rwkv": [39931, 34, 0.004446817561984062, [[32232, 0.149974, " they", false], [22590, 0.073455, " the", false], [31633, 0.059053, " part", false], [332, 0.055842, " a", false], [4858, 0.039236, " we", false], [55666, 0.032336, " building", false], [4601, 0.030379, " it", false], [4588, 0.020821, " if", false], [4596, 0.01615, " in", false], [47284, 0.014415, " simple", false]]], "qwen": [862, 25, 0.006524569820612669, [[807, 0.175156, " they", false], [279, 0.082138, " the", false], [264, 0.064957, " a", false], [582, 0.056716, " we", false], [421, 0.045218, " if", false], [419, 0.044418, " this", false], [429, 0.036722, " that", false], [949, 0.031809, " part", false], [432, 0.02626, " it", false], [1493, 0.02526, " these", false]]]}, "raw_delta": 0.06234494845072425, "tuned_delta": 0.07091674048130249}, {"byte_start": 6407, "byte_end": 6418, "display": {"text": " complexity", "kind": "normal"}, "is_word": true, "word_id": 1076, "word_key": " complexity", "bytes_hex": "20 63 6f 6d 70 6c 65 78 69 74 79", "compression": {"rwkv": "3.43% 3.43% 3.43% 3.43% 3.43% 3.43% 3.43% 3.43% 3.43% 3.43% 3.43%", "qwen": "4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88%"}, "model_tokens": {"rwkv": [[61720, " complexity", "normal", 0.12213197350502014]], "qwen": [[23094, " complexity", "normal", 0.050824154168367386]]}, "loss": {"rwkv": 3.432548570296895, "qwen": 4.884479658024287}, "topk": {"rwkv": [61720, 1, 0.12213197350502014, [[61720, 0.122132, " complexity", false], [55847, 0.066168, " contents", false], [56916, 0.057216, " presence", false], [32386, 0.027796, " very", false], [22681, 0.027666, " use", false], [59677, 0.024985, " existence", false], [59914, 0.024313, " intrinsic", false], [51308, 0.017714, " content", false], [45098, 0.013721, " actual", false], [40093, 0.013424, " value", false]]], "qwen": [23094, 2, 0.050824154168367386, [[8794, 0.118183, " contents", false], [23094, 0.050824, " complexity", false], [13885, 0.036968, " existence", false], [9362, 0.031106, " presence", false], [2213, 0.029506, " content", false], [4752, 0.025276, " building", false], [13042, 0.022211, " representation", false], [6993, 0.015222, " nature", false], [990, 0.011962, " use", false], [54480, 0.011863, " computational", false]]]}, "raw_delta": -0.08051215518604625, "tuned_delta": -0.071940363155468}, {"byte_start": 6418, "byte_end": 6421, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 1077, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "7.51% 7.51% 7.51%", "qwen": "8.06% 8.06% 8.06%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.2833641767501831]], "qwen": [[374, " is", "normal", 0.2616298794746399]]}, "loss": {"rwkv": 7.514036671296684, "qwen": 8.060003478998834}, "topk": {"rwkv": [4600, 1, 0.2833641767501831, [[4600, 0.283364, " is", false], [38964, 0.068425, " makes", false], [40219, 0.049537, " would", false], [32475, 0.048743, " will", false], [21265, 0.043867, " and", false], [45409, 0.03087, " cannot", false], [21413, 0.028453, " can", false], [30659, 0.026134, " does", false], [47266, 0.023127, " should", false], [21800, 0.017332, " has", false]]], "qwen": [374, 1, 0.2616298794746399, [[374, 0.26163, " is", false], [3643, 0.093887, " makes", false], [323, 0.05325, " and", false], [686, 0.04864, " will", false], [1035, 0.031732, " would", false], [4157, 0.02455, " cannot", false], [646, 0.0233, " can", false], [3363, 0.018559, " means", false], [27715, 0.017811, " grows", false], [27934, 0.016117, " prevents", false]]]}, "raw_delta": -0.03027482827504474, "tuned_delta": -0.02170303624446649}, {"byte_start": 6421, "byte_end": 6429, "display": {"text": " endless", "kind": "normal"}, "is_word": true, "word_id": 1078, "word_key": " endless", "bytes_hex": "20 65 6e 64 6c 65 73 73", "compression": {"rwkv": "18.32% 18.32% 18.32% 18.32% 18.32% 18.32% 18.32% 18.32%", "qwen": "18.18% 18.18% 18.18% 18.18% 18.18% 18.18% 18.18% 18.18%"}, "model_tokens": {"rwkv": [[51607, " endless", "normal", 0.000289862509816885]], "qwen": [[25678, " endless", "normal", 0.00031490589026361704]]}, "loss": {"rwkv": 18.315464386285665, "qwen": 18.17623583127968}, "topk": {"rwkv": [51607, 273, 0.000289862509816885, [[22187, 0.170304, " not", false], [332, 0.078675, " a", false], [4419, 0.050049, " an", false], [22614, 0.042854, " too", false], [31633, 0.025791, " part", false], [45302, 0.024152, " beyond", false], [22590, 0.021548, " the", false], [31581, 0.020269, " only", false], [52391, 0.017648, " outside", false], [62161, 0.01734, " irrelevant", false]]], "qwen": [25678, 295, 0.00031490589026361704, [[537, 0.092246, " not", false], [264, 0.06122, " a", false], [7797, 0.059096, " beyond", false], [773, 0.041949, " so", false], [2238, 0.037008, " too", false], [24870, 0.025747, " irre", false], [458, 0.02232, " an", false], [279, 0.021553, " the", false], [39715, 0.019333, " irrelevant", false], [3041, 0.018743, " far", false]]]}, "raw_delta": 0.007720470428466797, "tuned_delta": 0.016292262459045047}, {"byte_start": 6429, "byte_end": 6430, "display": {"text": ";", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "3b", "compression": {"rwkv": "80.02%", "qwen": "71.32%"}, "model_tokens": {"rwkv": [[60, ";", "normal", 0.011825809255242348]], "qwen": [[26, ";", "normal", 0.0191591028124094]]}, "loss": {"rwkv": 80.02449054930968, "qwen": 71.32282624929111}, "topk": {"rwkv": [60, 5, 0.011825809255242348, [[2030, 0.495472, "ly", false], [47, 0.196249, ".", false], [21265, 0.134506, " and", false], [45, 0.127318, ",", false], [60, 0.011826, ";", false], [4596, 0.006734, " in", false], [5346, 0.004611, "---", false], [275, 0.003209, " (", false], [4811, 0.0014, " to", false], [21400, 0.00136, " but", false]]], "qwen": [26, 5, 0.0191591028124094, [[13, 0.294122, ".", false], [11, 0.279669, ",", false], [323, 0.27395, " and", false], [382, 0.055618, ".\n\n", false], [26, 0.019159, ";", false], [304, 0.016172, " in", false], [320, 0.012282, " (", false], [4421, 0.005053, "---", false], [311, 0.003033, " to", false], [1576, 0.002492, " because", false]]]}, "raw_delta": 0.48252272605895996, "tuned_delta": 0.4910945180895382}, {"byte_start": 6430, "byte_end": 6438, "display": {"text": " instead", "kind": "normal"}, "is_word": true, "word_id": 1079, "word_key": " instead", "bytes_hex": "20 69 6e 73 74 65 61 64", "compression": {"rwkv": "5.95% 5.95% 5.95% 5.95% 5.95% 5.95% 5.95% 5.95%", "qwen": "6.45% 6.45% 6.45% 6.45% 6.45% 6.45% 6.45% 6.45%"}, "model_tokens": {"rwkv": [[52028, " instead", "normal", 0.07251709699630737]], "qwen": [[4518, " instead", "normal", 0.05730580538511276]]}, "loss": {"rwkv": 5.952525925542842, "qwen": 6.445586211976131}, "topk": {"rwkv": [52028, 4, 0.07251709699630737, [[32232, 0.255238, " they", false], [4858, 0.121006, " we", false], [22590, 0.081521, " the", false], [52028, 0.072517, " instead", false], [4601, 0.057043, " it", false], [32464, 0.048157, " what", false], [21265, 0.034372, " and", false], [47001, 0.029379, " rather", false], [39934, 0.022412, " there", false], [21256, 0.019508, " all", false]]], "qwen": [4518, 4, 0.05730580538511276, [[807, 0.1876, " they", false], [432, 0.067963, " it", false], [582, 0.060777, " we", false], [4518, 0.057306, " instead", false], [323, 0.056879, " and", false], [279, 0.05503, " the", false], [4751, 0.035705, " rather", false], [1052, 0.030189, " there", false], [862, 0.030058, " their", false], [304, 0.020754, " in", false]]]}, "raw_delta": -0.027341067790985107, "tuned_delta": -0.018769275760406857}, {"byte_start": 6438, "byte_end": 6441, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 1080, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"rwkv": "9.25% 9.25% 9.25%", "qwen": "14.87% 14.87% 14.87%"}, "model_tokens": {"rwkv": [[4858, " we", "normal", 0.21421262621879578]], "qwen": [[582, " we", "normal", 0.0842391699552536]]}, "loss": {"rwkv": 9.251657651534043, "qwen": 14.872354517747151}, "topk": {"rwkv": [4858, 2, 0.21421262621879578, [[45, 0.604138, ",", false], [4858, 0.214213, " we", false], [32232, 0.065456, " they", false], [22590, 0.028203, " the", false], [32464, 0.019365, " what", false], [4706, 0.01548, " of", false], [4601, 0.00581, " it", false], [22226, 0.005753, " one", false], [21256, 0.003854, " all", false], [22248, 0.003193, " our", false]]], "qwen": [582, 3, 0.0842391699552536, [[11, 0.677031, ",", false], [807, 0.117721, " they", false], [582, 0.084239, " we", false], [279, 0.028229, " the", false], [1128, 0.014383, " what", false], [432, 0.01135, " it", false], [315, 0.010613, " of", false], [825, 0.005054, " one", false], [862, 0.004203, " their", false], [1052, 0.003506, " there", false]]]}, "raw_delta": -0.311677614847819, "tuned_delta": -0.30310582281724074}, {"byte_start": 6441, "byte_end": 6448, "display": {"text": " should", "kind": "normal"}, "is_word": true, "word_id": 1081, "word_key": " should", "bytes_hex": "20 73 68 6f 75 6c 64", "compression": {"rwkv": "0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25%", "qwen": "0.41% 0.41% 0.41% 0.41% 0.41% 0.41% 0.41%"}, "model_tokens": {"rwkv": [[47266, " should", "normal", 0.906289279460907]], "qwen": [[1265, " should", "normal", 0.8530765771865845]]}, "loss": {"rwkv": 0.2541019097547874, "qwen": 0.4093801314287926}, "topk": {"rwkv": [47266, 1, 0.906289279460907, [[47266, 0.906289, " should", false], [31475, 0.028844, " must", false], [31506, 0.016706, " need", false], [31059, 0.011331, " have", false], [21286, 0.006538, " are", false], [21413, 0.004479, " can", false], [39196, 0.004147, " ought", false], [37923, 0.002255, " build", false], [38530, 0.001249, " focus", false], [32435, 0.001146, " want", false]]], "qwen": [1265, 1, 0.8530765771865845, [[1265, 0.853077, " should", false], [1184, 0.034088, " need", false], [646, 0.024345, " can", false], [1969, 0.016667, " must", false], [614, 0.015318, " have", false], [1936, 0.009191, " build", false], [21776, 0.008415, " ought", false], [525, 0.006014, " are", false], [5931, 0.002937, " seek", false], [1366, 0.002463, " want", false]]]}, "raw_delta": -0.008610452924455914, "tuned_delta": -3.866089387766572e-05}, {"byte_start": 6448, "byte_end": 6454, "display": {"text": " build", "kind": "normal"}, "is_word": true, "word_id": 1082, "word_key": " build", "bytes_hex": "20 62 75 69 6c 64", "compression": {"rwkv": "5.24% 5.24% 5.24% 5.24% 5.24% 5.24%", "qwen": "4.60% 4.60% 4.60% 4.60% 4.60% 4.60%"}, "model_tokens": {"rwkv": [[37923, " build", "normal", 0.1764019876718521]], "qwen": [[1936, " build", "normal", 0.21648700535297394]]}, "loss": {"rwkv": 5.236344305309876, "qwen": 4.59926610534126}, "topk": {"rwkv": [37923, 1, 0.1764019876718521, [[37923, 0.176402, " build", false], [38530, 0.130243, " focus", false], [4435, 0.106596, " be", false], [22626, 0.042721, " try", false], [38877, 0.039922, " learn", false], [31966, 0.029626, " seek", false], [63373, 0.025807, " concentrate", false], [22681, 0.019599, " use", false], [32122, 0.01863, " stop", false], [32499, 0.017251, " work", false]]], "qwen": [1936, 1, 0.21648700535297394, [[1936, 0.216487, " build", false], [5244, 0.116851, " focus", false], [1430, 0.068962, " try", false], [5931, 0.06029, " seek", false], [387, 0.056968, " be", false], [1401, 0.031789, " look", false], [1744, 0.031542, " think", false], [36355, 0.024805, " concentrate", false], [990, 0.017762, " use", false], [1477, 0.016482, " find", false]]]}, "raw_delta": 0.03532711664835608, "tuned_delta": 0.04389890867893433}, {"byte_start": 6454, "byte_end": 6457, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 1083, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "8.59% 8.59% 8.59%", "qwen": "4.42% 4.42% 4.42%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.23957906663417816]], "qwen": [[304, " in", "normal", 0.479447603225708]]}, "loss": {"rwkv": 8.594179442795582, "qwen": 4.418978842224913}, "topk": {"rwkv": [4596, 1, 0.23957906663417816, [[4596, 0.239579, " in", false], [52224, 0.107285, " methods", false], [53087, 0.0647, " systems", false], [22590, 0.039648, " the", false], [45124, 0.035094, " agents", false], [56567, 0.026681, " machines", false], [22248, 0.026088, " our", false], [332, 0.02571, " a", false], [51258, 0.018846, " complex", false], [51832, 0.017426, " general", false]]], "qwen": [304, 1, 0.479447603225708, [[304, 0.479448, " in", false], [5413, 0.091186, " methods", false], [279, 0.037211, " the", false], [4586, 0.029043, " general", false], [34447, 0.024152, " computation", false], [389, 0.019459, " on", false], [1039, 0.019375, " our", false], [5942, 0.016499, " systems", false], [2513, 0.014034, " things", false], [25185, 0.011642, " algorithms", false]]]}, "raw_delta": 0.23152228196461996, "tuned_delta": 0.24009407399519822}, {"byte_start": 6457, "byte_end": 6462, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 1084, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"rwkv": "14.77% 14.77% 14.77% 14.77% 14.77%", "qwen": "12.35% 12.35% 12.35% 12.35% 12.35%"}, "model_tokens": {"rwkv": [[31581, " only", "normal", 0.016717543825507164]], "qwen": [[1172, " only", "normal", 0.03259682282805443]]}, "loss": {"rwkv": 14.765082059097983, "qwen": 12.347811726686185}, "topk": {"rwkv": [31581, 13, 0.016717543825507164, [[22590, 0.186146, " the", false], [52224, 0.08146, " methods", false], [63370, 0.050588, " computation", false], [332, 0.040078, " a", false], [51832, 0.035239, " general", false], [32464, 0.034387, " what", false], [64862, 0.024996, " computational", false], [61720, 0.021238, " complexity", false], [32448, 0.020215, " ways", false], [63293, 0.019996, " arbitrarily", false]]], "qwen": [1172, 8, 0.03259682282805443, [[279, 0.193697, " the", false], [5413, 0.111508, " methods", false], [4586, 0.074875, " general", false], [34447, 0.058896, " computation", false], [1246, 0.040794, " how", false], [1128, 0.035663, " what", false], [5510, 0.033375, " ways", false], [1172, 0.032597, " only", false], [264, 0.025612, " a", false], [4285, 0.015885, " simple", false]]]}, "raw_delta": 0.13404192924499514, "tuned_delta": 0.1426137212755734}, {"byte_start": 6462, "byte_end": 6466, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1085, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "4.28% 4.28% 4.28% 4.28%", "qwen": "4.33% 4.33% 4.33% 4.33%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.39054688811302185]], "qwen": [[279, " the", "normal", 0.3827328383922577]]}, "loss": {"rwkv": 4.27947869794944, "qwen": 4.32997011701384}, "topk": {"rwkv": [22590, 1, 0.39054688811302185, [[22590, 0.390547, " the", false], [32464, 0.233915, " what", false], [332, 0.038416, " a", false], [47284, 0.035673, " simple", false], [39944, 0.034469, " those", false], [32227, 0.025262, " that", false], [4423, 0.020501, " as", false], [39931, 0.012705, " their", false], [21835, 0.010207, " how", false], [32386, 0.008919, " very", false]]], "qwen": [279, 1, 0.3827328383922577, [[279, 0.382733, " the", false], [1128, 0.12453, " what", false], [4586, 0.05139, " general", false], [1846, 0.03903, " those", false], [264, 0.038345, " a", false], [5413, 0.026603, " methods", false], [34447, 0.024977, " computation", false], [4285, 0.024853, " simple", false], [1602, 0.019209, " very", false], [2513, 0.015342, " things", false]]]}, "raw_delta": -0.0027998387813568115, "tuned_delta": 0.005771953249221437}, {"byte_start": 6466, "byte_end": 6471, "display": {"text": " meta", "kind": "normal"}, "is_word": true, "word_id": 1086, "word_key": " meta", "bytes_hex": "20 6d 65 74 61", "compression": {"rwkv": "36.07% 36.07% 36.07% 36.07% 36.07%", "qwen": "31.24% 31.24% 31.24% 31.24% 31.24%"}, "model_tokens": {"rwkv": [[31416, " meta", "normal", 4.4256728870095685e-05]], "qwen": [[8823, " meta", "normal", 0.00017295297584496439]]}, "loss": {"rwkv": 36.06737602222408, "qwen": 31.243331458582645}, "topk": {"rwkv": [31416, 991, 4.4256728870095685e-05, [[47284, 0.065649, " simple", false], [57234, 0.046452, " simplest", false], [47539, 0.043642, " things", false], [52236, 0.040481, " minimal", false], [32386, 0.032835, " very", false], [61720, 0.030334, " complexity", false], [64862, 0.028558, " computational", false], [59644, 0.026121, " essential", false], [39239, 0.025282, " parts", false], [60050, 0.021958, " necessary", false]]], "qwen": [8823, 457, 0.00017295297584496439, [[4586, 0.075737, " general", false], [1429, 0.057345, " most", false], [4285, 0.04441, " simple", false], [44548, 0.040875, " simplest", false], [5413, 0.030342, " methods", false], [1602, 0.022685, " very", false], [54480, 0.020146, " computational", false], [6770, 0.018722, " basic", false], [12829, 0.018643, " kinds", false], [5871, 0.017594, " necessary", false]]]}, "raw_delta": 0.2675018310546875, "tuned_delta": 0.27607362308526573}, {"byte_start": 6471, "byte_end": 6479, "display": {"text": "-methods", "kind": "normal"}, "is_word": true, "word_id": 1087, "word_key": "-methods", "bytes_hex": "2d 6d 65 74 68 6f 64 73", "compression": {"rwkv": "4.14% 14.33% 14.33% 14.33% 14.33% 14.33% 14.33% 14.33%", "qwen": "12.34% 12.34% 12.34% 12.34% 12.34% 12.34% 12.34% 1.24%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.7969080805778503], [49411, "methods", "normal", 0.003857108997181058]], "qwen": [[50297, "-method", "normal", 0.008322557434439659], [82, "s", "normal", 0.9337674379348755]]}, "loss": {"rwkv": 13.056372509021667, "qwen": 10.949410231711036}, "topk": {"rwkv": [46, 1, 0.7969080805778503, [[46, 0.796908, "-", false], [58313, 0.018115, "knowledge", false], [1798, 0.017464, "co", false], [63039, 0.01384, "computation", false], [38887, 0.010467, " level", false], [59943, 0.009418, " knowledge", false], [65275, 0.006507, " representations", false], [58449, 0.006226, "structure", false], [45, 0.005619, ",", false], [65062, 0.005469, "representation", false]]], "qwen": [50297, 18, 0.008322557434439659, [[11591, 0.193179, "-level", false], [12, 0.164031, "-", false], [12646, 0.135322, "-k", false], [46094, 0.033313, "structures", false], [80739, 0.026792, "-information", false], [7837, 0.024583, "structure", false], [1448, 0.024123, "-m", false], [6540, 0.019148, " knowledge", false], [14389, 0.014137, " structures", false], [5504, 0.011423, "-re", false]]]}, "raw_delta": 0.11683479696512215, "tuned_delta": 0.1254065889957004}, {"byte_start": 6479, "byte_end": 6484, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 1088, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "2.59% 2.59% 2.59% 2.59% 2.59%", "qwen": "3.78% 3.78% 3.78% 3.78% 3.78%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.4841887652873993]], "qwen": [[429, " that", "normal", 0.3503324091434479]]}, "loss": {"rwkv": 2.5923426515973556, "qwen": 3.7830090704411083}, "topk": {"rwkv": [32227, 1, 0.4841887652873993, [[32227, 0.484189, " that", false], [45, 0.140237, ",", false], [21700, 0.078195, " for", false], [4706, 0.052582, " of", false], [4811, 0.045515, " to", false], [46650, 0.034676, " needed", false], [21265, 0.030126, " and", false], [5346, 0.023119, "---", false], [4858, 0.018807, " we", false], [47, 0.011374, ".", false]]], "qwen": [429, 1, 0.3503324091434479, [[429, 0.350332, " that", false], [11, 0.172676, ",", false], [315, 0.140634, " of", false], [369, 0.101778, " for", false], [323, 0.035062, " and", false], [4421, 0.030228, "---", false], [311, 0.02602, " to", false], [320, 0.01569, " (", false], [13, 0.015441, ".", false], [25, 0.014572, ":", false]]]}, "raw_delta": -0.06602456569671633, "tuned_delta": -0.05745277366613808}, {"byte_start": 6484, "byte_end": 6488, "display": {"text": " can", "kind": "normal"}, "is_word": true, "word_id": 1089, "word_key": " can", "bytes_hex": "20 63 61 6e", "compression": {"rwkv": "10.85% 10.85% 10.85% 10.85%", "qwen": "8.84% 8.84% 8.84% 8.84%"}, "model_tokens": {"rwkv": [[21413, " can", "normal", 0.09099408984184265]], "qwen": [[646, " can", "normal", 0.14080820977687836]]}, "loss": {"rwkv": 10.848390444184586, "qwen": 8.83811426032155}, "topk": {"rwkv": [21413, 3, 0.09099408984184265, [[21286, 0.136156, " are", false], [45851, 0.123109, " enable", false], [21413, 0.090994, " can", false], [37675, 0.072854, " allow", false], [39590, 0.067388, " scale", false], [31358, 0.042277, " make", false], [4858, 0.038587, " we", false], [56540, 0.027955, " leverage", false], [32475, 0.023036, " will", false], [22001, 0.016404, " let", false]]], "qwen": [646, 1, 0.14080820977687836, [[646, 0.140808, " can", false], [525, 0.112271, " are", false], [7283, 0.094056, " enable", false], [2138, 0.087731, " allow", false], [5452, 0.065495, " scale", false], [1281, 0.041473, " make", false], [686, 0.038862, " will", false], [582, 0.032966, " we", false], [32064, 0.025115, " leverage", false], [1077, 0.013032, " let", false]]]}, "raw_delta": 0.11147338151931763, "tuned_delta": 0.12004517354989587}, {"byte_start": 6488, "byte_end": 6493, "display": {"text": " find", "kind": "normal"}, "is_word": true, "word_id": 1090, "word_key": " find", "bytes_hex": "20 66 69 6e 64", "compression": {"rwkv": "17.47% 17.47% 17.47% 17.47% 17.47%", "qwen": "18.87% 18.87% 18.87% 18.87% 18.87%"}, "model_tokens": {"rwkv": [[30858, " find", "normal", 0.007948637008666992]], "qwen": [[1477, " find", "normal", 0.0053453813306987286]]}, "loss": {"rwkv": 17.47013526076479, "qwen": 18.868729134458306}, "topk": {"rwkv": [30858, 21, 0.007948637008666992, [[39590, 0.169593, " scale", false], [4435, 0.10789, " be", false], [56540, 0.056821, " leverage", false], [32187, 0.045987, " take", false], [38877, 0.039794, " learn", false], [46158, 0.038689, " handle", false], [30587, 0.033412, " deal", false], [31358, 0.031685, " make", false], [22681, 0.029003, " use", false], [30498, 0.014938, " cope", false]]], "qwen": [1477, 23, 0.0053453813306987286, [[387, 0.225458, " be", false], [5452, 0.197008, " scale", false], [32064, 0.081598, " leverage", false], [1896, 0.052988, " take", false], [3705, 0.027218, " handle", false], [32194, 0.023882, " exploit", false], [1281, 0.020005, " make", false], [1492, 0.016496, " help", false], [3060, 0.0129, " continue", false], [13444, 0.012311, " effectively", false]]]}, "raw_delta": -0.07755451202392583, "tuned_delta": -0.06898271999334758}, {"byte_start": 6493, "byte_end": 6497, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 1091, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "10.71% 10.71% 10.71% 10.71%", "qwen": "11.80% 11.80% 11.80% 11.80%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.09242917597293854]], "qwen": [[323, " and", "normal", 0.0730060413479805]]}, "loss": {"rwkv": 10.707502256597774, "qwen": 11.799500723793338}, "topk": {"rwkv": [21265, 2, 0.09242917597293854, [[22590, 0.143574, " the", false], [21265, 0.092429, " and", false], [32448, 0.066946, " ways", false], [47284, 0.051276, " simple", false], [332, 0.046749, " a", false], [60521, 0.039924, " solutions", false], [51832, 0.039444, " general", false], [45, 0.02658, ",", false], [39931, 0.021251, " their", false], [30992, 0.020643, " good", false]]], "qwen": [323, 2, 0.0730060413479805, [[279, 0.141221, " the", false], [323, 0.073006, " and", false], [1661, 0.060295, " good", false], [264, 0.054906, " a", false], [5510, 0.054743, " ways", false], [9904, 0.046261, " solutions", false], [1493, 0.041047, " these", false], [4285, 0.038317, " simple", false], [862, 0.029244, " their", false], [1105, 0.02607, " them", false]]]}, "raw_delta": -0.06055325269699097, "tuned_delta": -0.05198146066641272}, {"byte_start": 6497, "byte_end": 6505, "display": {"text": " capture", "kind": "normal"}, "is_word": true, "word_id": 1092, "word_key": " capture", "bytes_hex": "20 63 61 70 74 75 72 65", "compression": {"rwkv": "15.43% 15.43% 15.43% 15.43% 15.43% 15.43% 15.43% 15.43%", "qwen": "16.17% 16.17% 16.17% 16.17% 16.17% 16.17% 16.17% 16.17%"}, "model_tokens": {"rwkv": [[51133, " capture", "normal", 0.0010759427677839994]], "qwen": [[12322, " capture", "normal", 0.0007653105421923101]]}, "loss": {"rwkv": 15.427256540756003, "qwen": 16.17448031287533}, "topk": {"rwkv": [51133, 73, 0.0010759427677839994, [[22681, 0.197043, " use", false], [51690, 0.185724, " exploit", false], [38877, 0.064263, " learn", false], [53251, 0.042735, " utilize", false], [39590, 0.035183, " scale", false], [56540, 0.033831, " leverage", false], [31358, 0.023954, " make", false], [37923, 0.021228, " build", false], [32187, 0.019547, " take", false], [46158, 0.0159, " handle", false]]], "qwen": [12322, 91, 0.0007653105421923101, [[990, 0.19459, " use", false], [32194, 0.186764, " exploit", false], [32064, 0.077788, " leverage", false], [28066, 0.064644, " utilize", false], [3796, 0.036191, " apply", false], [1896, 0.028938, " take", false], [5452, 0.027852, " scale", false], [1281, 0.018812, " make", false], [3960, 0.017616, " learn", false], [10515, 0.012242, " adapt", false]]]}, "raw_delta": -0.0414348840713501, "tuned_delta": -0.03286309204077185}, {"byte_start": 6505, "byte_end": 6510, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 1093, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "15.44% 15.44% 15.44% 15.44% 15.44%", "qwen": "14.58% 14.58% 14.58% 14.58% 14.58%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.013306764885783195]], "qwen": [[419, " this", "normal", 0.0175336766988039]]}, "loss": {"rwkv": 15.441345359514685, "qwen": 14.584319693908627}, "topk": {"rwkv": [32234, 14, 0.013306764885783195, [[22590, 0.359031, " the", false], [39936, 0.073763, " these", false], [51832, 0.064023, " general", false], [39931, 0.036997, " their", false], [32139, 0.024921, " such", false], [32229, 0.021877, " them", false], [56832, 0.020125, " patterns", false], [61720, 0.019906, " complexity", false], [21256, 0.019791, " all", false], [39944, 0.017567, " those", false]]], "qwen": [419, 8, 0.0175336766988039, [[279, 0.280644, " the", false], [1493, 0.057801, " these", false], [4586, 0.045954, " general", false], [1128, 0.045642, " what", false], [5390, 0.039438, " useful", false], [12624, 0.029172, " patterns", false], [1846, 0.024341, " those", false], [419, 0.017534, " this", false], [6540, 0.017077, " knowledge", false], [5944, 0.015977, " structure", false]]]}, "raw_delta": 0.04752359390258787, "tuned_delta": 0.05609538593316612}, {"byte_start": 6510, "byte_end": 6520, "display": {"text": " arbitrary", "kind": "normal"}, "is_word": true, "word_id": 1094, "word_key": " arbitrary", "bytes_hex": "20 61 72 62 69 74 72 61 72 79", "compression": {"rwkv": "7.61% 7.61% 7.61% 7.61% 7.61% 7.61% 7.61% 7.61% 7.61% 7.61%", "qwen": "7.74% 7.74% 7.74% 7.74% 7.74% 7.74% 7.74% 7.74% 7.74% 7.74%"}, "model_tokens": {"rwkv": [[59163, " arbitrary", "normal", 0.014749602414667606]], "qwen": [[24168, " arbitrary", "normal", 0.013689912855625153]]}, "loss": {"rwkv": 7.607962129687892, "qwen": 7.738428168632419}, "topk": {"rwkv": [59163, 5, 0.014749602414667606, [[61720, 0.625683, " complexity", false], [51607, 0.073259, " endless", false], [59914, 0.039681, " intrinsic", false], [51258, 0.032856, " complex", false], [59163, 0.01475, " arbitrary", false], [56454, 0.012652, " inherent", false], [51832, 0.008986, " general", false], [62680, 0.008116, " underlying", false], [51970, 0.007768, " immense", false], [56125, 0.00605, " enormous", false]]], "qwen": [24168, 6, 0.013689912855625153, [[23094, 0.542489, " complexity", false], [6351, 0.061806, " complex", false], [1995, 0.052409, " information", false], [4889, 0.019668, " outside", false], [6540, 0.019221, " knowledge", false], [24168, 0.01369, " arbitrary", false], [5944, 0.013563, " structure", false], [2213, 0.012819, " content", false], [1879, 0.010544, " world", false], [3093, 0.009757, " kind", false]]]}, "raw_delta": -0.0072345733642578125, "tuned_delta": 0.0013372186663204357}, {"byte_start": 6520, "byte_end": 6531, "display": {"text": " complexity", "kind": "normal"}, "is_word": true, "word_id": 1095, "word_key": " complexity", "bytes_hex": "20 63 6f 6d 70 6c 65 78 69 74 79", "compression": {"rwkv": "0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50%", "qwen": "0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83%"}, "model_tokens": {"rwkv": [[61720, " complexity", "normal", 0.7334807515144348]], "qwen": [[23094, " complexity", "normal", 0.6040256023406982]]}, "loss": {"rwkv": 0.4995126650805183, "qwen": 0.8264981978603826}, "topk": {"rwkv": [61720, 1, 0.7334807515144348, [[61720, 0.733481, " complexity", false], [45, 0.195163, ",", false], [21265, 0.010069, " and", false], [59914, 0.006533, " intrinsic", false], [51258, 0.0063, " complex", false], [51308, 0.003801, " content", false], [52391, 0.003504, " outside", false], [60572, 0.00273, " structure", false], [57141, 0.002073, " richness", false], [46, 0.001871, "-", false]]], "qwen": [23094, 1, 0.6040256023406982, [[23094, 0.604026, " complexity", false], [11, 0.203697, ",", false], [1879, 0.040507, " world", false], [4889, 0.020384, " outside", false], [323, 0.017252, " and", false], [6351, 0.016169, " complex", false], [5944, 0.016046, " structure", false], [1995, 0.009967, " information", false], [2213, 0.006884, " content", false], [714, 0.004294, " but", false]]]}, "raw_delta": -0.01813192801042037, "tuned_delta": -0.009560135979842123}, {"byte_start": 6531, "byte_end": 6532, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "15.43%", "qwen": "26.58%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.4203220009803772]], "qwen": [[13, ".", "normal", 0.22900354862213135]]}, "loss": {"rwkv": 15.427256540756003, "qwen": 26.581978183091152}, "topk": {"rwkv": [47, 1, 0.4203220009803772, [[47, 0.420322, ".", false], [45, 0.279181, ",", false], [4596, 0.054462, " in", false], [21265, 0.044779, " and", false], [5346, 0.037457, "---", false], [4423, 0.016962, " as", false], [4706, 0.010517, " of", false], [275, 0.009552, " (", false], [53356, 0.008911, " without", false], [4450, 0.008732, " by", false]]], "qwen": [13, 2, 0.22900354862213135, [[11, 0.242662, ",", false], [13, 0.229004, ".", false], [304, 0.118386, " in", false], [382, 0.102984, ".\n\n", false], [323, 0.03766, " and", false], [4421, 0.033871, "---", false], [438, 0.019708, " as", false], [448, 0.014766, " with", false], [320, 0.011584, " (", false], [389, 0.011583, " on", false]]]}, "raw_delta": -0.618549108505249, "tuned_delta": -0.6099773164746708}, {"byte_start": 6532, "byte_end": 6542, "display": {"text": " Essential", "kind": "normal"}, "is_word": true, "word_id": 1096, "word_key": " essential", "bytes_hex": "20 45 73 73 65 6e 74 69 61 6c", "compression": {"rwkv": "53.54% 53.54% 53.54% 53.54% 0.12% 0.12% 0.12% 0.12% 0.12% 0.12%", "qwen": "20.26% 20.26% 20.26% 20.26% 20.26% 20.26% 20.26% 20.26% 20.26% 20.26%"}, "model_tokens": {"rwkv": [[19840, " Ess", "normal", 6.738956926710671e-06], [41342, "ential", "normal", 0.9601582884788513]], "qwen": [[47733, " Essential", "normal", 1.3228118405095302e-05]]}, "loss": {"rwkv": 21.4880902605062, "qwen": 20.25754063497075}, "topk": {"rwkv": [19840, 1310, 6.738956926710671e-06, [[261, 0.271875, "\n\n", false], [20996, 0.103626, " The", false], [29894, 0.061958, " This", false], [37453, 0.0587, " These", false], [3913, 0.046762, " In", false], [4331, 0.04389, " We", false], [19417, 0.019997, " And", false], [29889, 0.018439, " That", false], [44844, 0.018096, " Search", false], [3918, 0.015744, " It", false]]], "qwen": [47733, 1181, 1.3228118405095302e-05, [[576, 0.129797, " The", false], [1096, 0.08778, " This", false], [1205, 0.079979, " We", false], [4220, 0.061063, " These", false], [758, 0.048117, " In", false], [1752, 0.039487, " For", false], [1597, 0.029719, " And", false], [2938, 0.027698, " That", false], [1084, 0.023024, " It", false], [220, 0.01766, " ", false]]]}, "raw_delta": 0.06823616027832036, "tuned_delta": 0.0768079523088986}, {"byte_start": 6542, "byte_end": 6545, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 1097, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "5.52% 5.52% 5.52%", "qwen": "6.58% 6.58% 6.58%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.39990708231925964]], "qwen": [[311, " to", "normal", 0.33457592129707336]]}, "loss": {"rwkv": 5.518120680483502, "qwen": 6.581643478559646}, "topk": {"rwkv": [4811, 1, 0.39990708231925964, [[4811, 0.399907, " to", false], [37694, 0.15518, " among", false], [39239, 0.050831, " parts", false], [31416, 0.036344, " meta", false], [52224, 0.029773, " methods", false], [56089, 0.027284, " elements", false], [31077, 0.025508, " here", false], [4596, 0.022025, " in", false], [4600, 0.016106, " is", false], [61723, 0.015299, " components", false]]], "qwen": [311, 1, 0.33457592129707336, [[311, 0.334576, " to", false], [8823, 0.173613, " meta", false], [369, 0.105095, " for", false], [374, 0.036002, " is", false], [5413, 0.0318, " methods", false], [304, 0.027267, " in", false], [4221, 0.02533, " among", false], [11, 0.014456, ",", false], [1588, 0.012913, " here", false], [5479, 0.012706, " parts", false]]]}, "raw_delta": -0.05897422631581628, "tuned_delta": -0.05040243428523803}, {"byte_start": 6545, "byte_end": 6551, "display": {"text": " these", "kind": "normal"}, "is_word": true, "word_id": 1098, "word_key": " these", "bytes_hex": "20 74 68 65 73 65", "compression": {"rwkv": "8.08% 8.08% 8.08% 8.08% 8.08% 8.08%", "qwen": "6.54% 6.54% 6.54% 6.54% 6.54% 6.54%"}, "model_tokens": {"rwkv": [[39936, " these", "normal", 0.06746024638414383]], "qwen": [[1493, " these", "normal", 0.1133388951420784]]}, "loss": {"rwkv": 8.077589421643935, "qwen": 6.544344024559395}, "topk": {"rwkv": [39936, 3, 0.06746024638414383, [[32234, 0.572183, " this", false], [22590, 0.095323, " the", false], [39936, 0.06746, " these", false], [32227, 0.044333, " that", false], [55666, 0.027429, " building", false], [32139, 0.023214, " such", false], [38279, 0.017045, " doing", false], [21256, 0.013936, " all", false], [59258, 0.008388, " capturing", false], [22248, 0.008175, " our", false]]], "qwen": [1493, 2, 0.1133388951420784, [[419, 0.486482, " this", false], [1493, 0.113339, " these", false], [279, 0.090156, " the", false], [678, 0.039767, " all", false], [429, 0.034608, " that", false], [4752, 0.018017, " building", false], [1741, 0.016435, " such", false], [3730, 0.015154, " doing", false], [6832, 0.013901, " learning", false], [894, 0.009253, " any", false]]]}, "raw_delta": 0.08502117792765301, "tuned_delta": 0.09359296995823126}, {"byte_start": 6551, "byte_end": 6559, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 1099, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "2.76% 2.76% 2.76% 2.76% 2.76% 2.76% 2.76% 2.76%", "qwen": "4.78% 4.78% 4.78% 4.78% 4.78% 4.78% 4.78% 4.78%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.2920089364051819]], "qwen": [[5413, " methods", "normal", 0.11975329369306564]]}, "loss": {"rwkv": 2.7649306813912014, "qwen": 4.784160712014783}, "topk": {"rwkv": [52224, 2, 0.2920089364051819, [[31416, 0.408875, " meta", false], [52224, 0.292009, " methods", false], [21286, 0.170203, " are", false], [51832, 0.040912, " general", false], [4600, 0.013271, " is", false], [22638, 0.009858, " two", false], [51258, 0.004377, " complex", false], [45, 0.002604, ",", false], [61590, 0.002591, " approaches", false], [38841, 0.0024, " kinds", false]]], "qwen": [5413, 2, 0.11975329369306564, [[8823, 0.671973, " meta", false], [5413, 0.119753, " methods", false], [374, 0.077473, " is", false], [525, 0.054646, " are", false], [4586, 0.01824, " general", false], [19827, 0.003394, " approaches", false], [1378, 0.00277, " two", false], [11, 0.002668, ",", false], [12538, 0.002589, " techniques", false], [1714, 0.001728, " method", false]]]}, "raw_delta": -0.11196988821029663, "tuned_delta": -0.10339809617971839}, {"byte_start": 6559, "byte_end": 6562, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 1100, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "5.52% 5.52% 5.52%", "qwen": "2.68% 2.68% 2.68%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.399360716342926]], "qwen": [[374, " is", "normal", 0.6401692628860474]]}, "loss": {"rwkv": 5.518120680483502, "qwen": 2.6811448543085183}, "topk": {"rwkv": [4600, 2, 0.399360716342926, [[21286, 0.506034, " are", false], [4600, 0.399361, " is", false], [45, 0.030381, ",", false], [32475, 0.019346, " will", false], [4706, 0.008176, " of", false], [40219, 0.00761, " would", false], [21700, 0.00412, " for", false], [47266, 0.004055, " should", false], [4596, 0.002645, " in", false], [275, 0.00246, " (", false]]], "qwen": [374, 1, 0.6401692628860474, [[374, 0.640169, " is", false], [525, 0.278169, " are", false], [11, 0.031505, ",", false], [686, 0.009927, " will", false], [1265, 0.007983, " should", false], [369, 0.004219, " for", false], [1969, 0.003339, " must", false], [304, 0.003269, " in", false], [315, 0.003194, " of", false], [320, 0.003101, " (", false]]]}, "raw_delta": 0.15731534361839292, "tuned_delta": 0.16588713564897117}, {"byte_start": 6562, "byte_end": 6567, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 1101, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "10.14% 10.14% 10.14% 10.14% 10.14%", "qwen": "12.61% 12.61% 12.61% 12.61% 12.61%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.06073502078652382]], "qwen": [[429, " that", "normal", 0.03027326427400112]]}, "loss": {"rwkv": 10.143949506250523, "qwen": 12.61453016086352}, "topk": {"rwkv": [32227, 3, 0.06073502078652382, [[22590, 0.308303, " the", false], [56537, 0.130619, " learning", false], [32227, 0.060735, " that", false], [332, 0.056023, " a", false], [52195, 0.03967, " massive", false], [63370, 0.020971, " computation", false], [4811, 0.019743, " to", false], [47202, 0.018603, " search", false], [4419, 0.014295, " an", false], [51832, 0.012133, " general", false]]], "qwen": [429, 6, 0.03027326427400112, [[279, 0.385126, " the", false], [26943, 0.090273, " scaling", false], [264, 0.049859, " a", false], [34447, 0.0463, " computation", false], [6832, 0.037336, " learning", false], [429, 0.030273, " that", false], [2711, 0.029554, " search", false], [311, 0.018949, " to", false], [458, 0.013936, " an", false], [5452, 0.011061, " scale", false]]]}, "raw_delta": -0.1369980812072754, "tuned_delta": -0.12842628917669716}, {"byte_start": 6567, "byte_end": 6572, "display": {"text": " they", "kind": "normal"}, "is_word": true, "word_id": 1102, "word_key": " they", "bytes_hex": "20 74 68 65 79", "compression": {"rwkv": "0.92% 0.92% 0.92% 0.92% 0.92%", "qwen": "1.10% 1.10% 1.10% 1.10% 1.10%"}, "model_tokens": {"rwkv": [[32232, " they", "normal", 0.7772095799446106]], "qwen": [[807, " they", "normal", 0.7365784645080566]]}, "loss": {"rwkv": 0.9157732193142833, "qwen": 1.1027221229226438}, "topk": {"rwkv": [32232, 1, 0.7772095799446106, [[32232, 0.77721, " they", false], [4858, 0.062873, " we", false], [22590, 0.038953, " the", false], [39931, 0.016339, " their", false], [45, 0.014259, ",", false], [39934, 0.013089, " there", false], [4706, 0.00529, " of", false], [63370, 0.003693, " computation", false], [21256, 0.003647, " all", false], [22226, 0.002853, " one", false]]], "qwen": [807, 1, 0.7365784645080566, [[807, 0.736578, " they", false], [582, 0.065723, " we", false], [279, 0.056088, " the", false], [11, 0.016532, ",", false], [34447, 0.012233, " computation", false], [1052, 0.010324, " there", false], [862, 0.010036, " their", false], [315, 0.005888, " of", false], [432, 0.004903, " it", false], [264, 0.004412, " a", false]]]}, "raw_delta": -0.010366648435592651, "tuned_delta": -0.0017948564050144031}, {"byte_start": 6572, "byte_end": 6576, "display": {"text": " can", "kind": "normal"}, "is_word": true, "word_id": 1103, "word_key": " can", "bytes_hex": "20 63 61 6e", "compression": {"rwkv": "10.92% 10.92% 10.92% 10.92%", "qwen": "11.62% 11.62% 11.62% 11.62%"}, "model_tokens": {"rwkv": [[21413, " can", "normal", 0.08924920856952667]], "qwen": [[646, " can", "normal", 0.07595773786306381]]}, "loss": {"rwkv": 10.918834537977993, "qwen": 11.62081074954688}, "topk": {"rwkv": [21413, 4, 0.08924920856952667, [[39590, 0.152068, " scale", false], [21286, 0.13008, " are", false], [4435, 0.102596, " be", false], [21413, 0.089249, " can", false], [47266, 0.029672, " should", false], [22681, 0.026512, " use", false], [31059, 0.026283, " have", false], [4491, 0.025239, " do", false], [31475, 0.022251, " must", false], [38877, 0.018636, " learn", false]]], "qwen": [646, 4, 0.07595773786306381, [[387, 0.126536, " be", false], [525, 0.094305, " are", false], [5452, 0.082216, " scale", false], [646, 0.075958, " can", false], [1265, 0.054224, " should", false], [1969, 0.0487, " must", false], [32064, 0.036971, " leverage", false], [614, 0.023595, " have", false], [1896, 0.021734, " take", false], [990, 0.019605, " use", false]]]}, "raw_delta": -0.03892582654953003, "tuned_delta": -0.03035403451895178}, {"byte_start": 6576, "byte_end": 6581, "display": {"text": " find", "kind": "normal"}, "is_word": true, "word_id": 1104, "word_key": " find", "bytes_hex": "20 66 69 6e 64", "compression": {"rwkv": "11.95% 11.95% 11.95% 11.95% 11.95%", "qwen": "10.19% 10.19% 10.19% 10.19% 10.19%"}, "model_tokens": {"rwkv": [[30858, " find", "normal", 0.03652869537472725]], "qwen": [[1477, " find", "normal", 0.059287264943122864]]}, "loss": {"rwkv": 11.947318307361726, "qwen": 10.190334947014732}, "topk": {"rwkv": [30858, 5, 0.03652869537472725, [[39590, 0.266831, " scale", false], [4435, 0.13724, " be", false], [38877, 0.076261, " learn", false], [56540, 0.03888, " leverage", false], [30858, 0.036529, " find", false], [22681, 0.022034, " use", false], [32187, 0.021203, " take", false], [51133, 0.020645, " capture", false], [31358, 0.015494, " make", false], [46158, 0.01403, " handle", false]]], "qwen": [1477, 4, 0.059287264943122864, [[5452, 0.217553, " scale", false], [387, 0.111124, " be", false], [32064, 0.070474, " leverage", false], [1477, 0.059287, " find", false], [1896, 0.033056, " take", false], [3960, 0.031697, " learn", false], [32194, 0.022243, " exploit", false], [12322, 0.019151, " capture", false], [3705, 0.016545, " handle", false], [990, 0.016301, " use", false]]]}, "raw_delta": 0.0974278450012207, "tuned_delta": 0.10599963703179895}, {"byte_start": 6581, "byte_end": 6586, "display": {"text": " good", "kind": "normal"}, "is_word": true, "word_id": 1105, "word_key": " good", "bytes_hex": "20 67 6f 6f 64", "compression": {"rwkv": "21.87% 21.87% 21.87% 21.87% 21.87%", "qwen": "20.73% 20.73% 20.73% 20.73% 20.73%"}, "model_tokens": {"rwkv": [[30992, " good", "normal", 0.002304589608684182]], "qwen": [[1661, " good", "normal", 0.003192703705281019]]}, "loss": {"rwkv": 21.86584671347335, "qwen": 20.727514185330524}, "topk": {"rwkv": [30992, 41, 0.002304589608684182, [[21265, 0.329588, " and", false], [59163, 0.074517, " arbitrary", false], [22590, 0.0678, " the", false], [63293, 0.052614, " arbitrarily", false], [45, 0.03914, ",", false], [32448, 0.020771, " ways", false], [332, 0.019164, " a", false], [60572, 0.014226, " structure", false], [22168, 0.012742, " new", false], [56832, 0.012013, " patterns", false]]], "qwen": [1661, 35, 0.003192703705281019, [[323, 0.373493, " and", false], [279, 0.122858, " the", false], [11, 0.049253, ",", false], [264, 0.021193, " a", false], [419, 0.019855, " this", false], [1128, 0.018387, " what", false], [12624, 0.01774, " patterns", false], [24168, 0.017142, " arbitrary", false], [23094, 0.014599, " complexity", false], [862, 0.014111, " their", false]]]}, "raw_delta": 0.06312255859374982, "tuned_delta": 0.07169435062432807}, {"byte_start": 6586, "byte_end": 6601, "display": {"text": " approximations", "kind": "normal"}, "is_word": true, "word_id": 1106, "word_key": " approximations", "bytes_hex": "20 61 70 70 72 6f 78 69 6d 61 74 69 6f 6e 73", "compression": {"rwkv": "2.70% 2.70% 2.70% 2.70% 2.70% 2.70% 2.70% 2.70% 2.70% 2.70% 2.70% 2.70% 2.70% 2.70% 0.16%", "qwen": "6.57% 6.57% 6.57% 6.57% 6.57% 6.57% 6.57% 0.01% 0.01% 0.01% 0.01% 0.01% 0.01% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[64831, " approximation", "normal", 0.12326377630233765], [116, "s", "normal", 0.9911762475967407]], "qwen": [[9848, " approx", "normal", 0.07817225903272629], [96376, "imations", "normal", 0.9960803389549255]]}, "loss": {"rwkv": 2.527915657482136, "qwen": 3.06905465744766}, "topk": {"rwkv": [64831, 1, 0.12326377630233765, [[64831, 0.123264, " approximation", false], [32448, 0.108896, " ways", false], [65275, 0.081583, " representations", false], [60521, 0.070758, " solutions", false], [45, 0.067439, ",", false], [63245, 0.06578, " abstraction", false], [65135, 0.033084, " generalization", false], [45865, 0.014931, " enough", false], [63292, 0.014699, " approximate", false], [51832, 0.013353, " general", false]]], "qwen": [9848, 2, 0.07817225903272629, [[43613, 0.137482, " representations", false], [9848, 0.078172, " approx", false], [9904, 0.074397, " solutions", false], [5510, 0.067546, " ways", false], [11, 0.048612, ",", false], [44868, 0.030861, " approximate", false], [4586, 0.027049, " general", false], [2750, 0.026102, " values", false], [3322, 0.019664, " enough", false], [4119, 0.017806, " models", false]]]}, "raw_delta": -0.03000711776937049, "tuned_delta": -0.02143532573879224}, {"byte_start": 6601, "byte_end": 6602, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "41.42%", "qwen": "43.14%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.10104823857545853]], "qwen": [[11, ",", "normal", 0.09145106375217438]]}, "loss": {"rwkv": 41.42112715052297, "qwen": 43.13570388873347}, "topk": {"rwkv": [45, 2, 0.10104823857545853, [[4811, 0.558979, " to", false], [45, 0.101048, ",", false], [4706, 0.070776, " of", false], [4596, 0.035331, " in", false], [32227, 0.032384, " that", false], [21265, 0.02019, " and", false], [21700, 0.019779, " for", false], [47, 0.018619, ".", false], [5346, 0.011841, "---", false], [52628, 0.011646, " quickly", false]]], "qwen": [11, 3, 0.09145106375217438, [[311, 0.526465, " to", false], [315, 0.162268, " of", false], [11, 0.091451, ",", false], [369, 0.029232, " for", false], [304, 0.021169, " in", false], [13, 0.020419, ".", false], [429, 0.019746, " that", false], [323, 0.018833, " and", false], [4421, 0.011141, "---", false], [448, 0.008905, " with", false]]]}, "raw_delta": -0.09507632255554199, "tuned_delta": -0.08650453052496375}, {"byte_start": 6602, "byte_end": 6606, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 1107, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"rwkv": "19.87% 19.87% 19.87% 19.87%", "qwen": "18.68% 18.68% 18.68% 18.68%"}, "model_tokens": {"rwkv": [[21400, " but", "normal", 0.012224591337144375]], "qwen": [[714, " but", "normal", 0.01588658057153225]]}, "loss": {"rwkv": 19.86523444974061, "qwen": 18.675148902300144}, "topk": {"rwkv": [21400, 15, 0.012224591337144375, [[21265, 0.19839, " and", false], [4715, 0.069173, " or", false], [4596, 0.059257, " in", false], [30788, 0.057941, " even", false], [22187, 0.051335, " not", false], [32227, 0.044996, " that", false], [4788, 0.028376, " so", false], [32487, 0.025229, " with", false], [47001, 0.021421, " rather", false], [4423, 0.018659, " as", false]]], "qwen": [714, 10, 0.01588658057153225, [[323, 0.225587, " and", false], [1496, 0.073592, " even", false], [476, 0.052948, " or", false], [892, 0.049974, " which", false], [304, 0.047493, " in", false], [537, 0.041677, " not", false], [448, 0.031349, " with", false], [438, 0.027299, " as", false], [429, 0.023634, " that", false], [714, 0.015887, " but", false]]]}, "raw_delta": 0.06599235534667969, "tuned_delta": 0.07456414737725793}, {"byte_start": 6606, "byte_end": 6610, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1108, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "16.98% 16.98% 16.98% 16.98%", "qwen": "14.26% 14.26% 14.26% 14.26%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.02291511557996273]], "qwen": [[279, " the", "normal", 0.042297009378671646]]}, "loss": {"rwkv": 16.977026604210945, "qwen": 14.260313408772268}, "topk": {"rwkv": [22590, 10, 0.02291511557996273, [[22187, 0.216743, " not", false], [32232, 0.156106, " they", false], [32227, 0.085494, " that", false], [4692, 0.044768, " no", false], [39115, 0.041982, " never", false], [45409, 0.033733, " cannot", false], [30135, 0.033562, " also", false], [21413, 0.030949, " can", false], [4491, 0.02292, " do", false], [22590, 0.022915, " the", false]]], "qwen": [279, 5, 0.042297009378671646, [[537, 0.165363, " not", false], [807, 0.163116, " they", false], [429, 0.05804, " that", false], [2581, 0.044574, " never", false], [279, 0.042297, " the", false], [653, 0.026959, " do", false], [419, 0.025683, " this", false], [1172, 0.023613, " only", false], [646, 0.023518, " can", false], [304, 0.021847, " in", false]]]}, "raw_delta": 0.15064656734466553, "tuned_delta": 0.15921835937524378}, {"byte_start": 6610, "byte_end": 6617, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 1109, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "12.00% 12.00% 12.00% 12.00% 12.00% 12.00% 12.00%", "qwen": "10.83% 10.83% 10.83% 10.83% 10.83% 10.83% 10.83%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.009381993673741817]], "qwen": [[2711, " search", "normal", 0.014953196048736572]]}, "loss": {"rwkv": 11.99562282882006, "qwen": 10.827504379684806}, "topk": {"rwkv": [47202, 10, 0.009381993673741817, [[64831, 0.394329, " approximation", false], [30992, 0.052952, " good", false], [52224, 0.051282, " methods", false], [30273, 0.027662, " best", false], [31458, 0.017874, " more", false], [21952, 0.016672, " key", false], [52621, 0.011775, " quality", false], [61720, 0.011335, " complexity", false], [31581, 0.011079, " only", false], [47202, 0.009382, " search", false]]], "qwen": [2711, 11, 0.014953196048736572, [[9848, 0.096294, " approx", false], [23094, 0.055132, " complexity", false], [3565, 0.054822, " details", false], [5042, 0.035948, " actual", false], [56204, 0.035316, " approximation", false], [5413, 0.02631, " methods", false], [1850, 0.022449, " best", false], [4271, 0.016598, " quality", false], [44868, 0.015384, " approximate", false], [4734, 0.014968, " exact", false]]]}, "raw_delta": 0.06477424076625271, "tuned_delta": 0.07334603279683095}, {"byte_start": 6617, "byte_end": 6621, "display": {"text": " for", "kind": "normal"}, "is_word": true, "word_id": 1110, "word_key": " for", "bytes_hex": "20 66 6f 72", "compression": {"rwkv": "7.54% 7.54% 7.54% 7.54%", "qwen": "7.36% 7.36% 7.36% 7.36%"}, "model_tokens": {"rwkv": [[21700, " for", "normal", 0.18933232128620148]], "qwen": [[369, " for", "normal", 0.19535474479198456]]}, "loss": {"rwkv": 7.537518035894486, "qwen": 7.361974269267249}, "topk": {"rwkv": [21700, 1, 0.18933232128620148, [[21700, 0.189332, " for", false], [21265, 0.129636, " and", false], [39750, 0.097165, " space", false], [4600, 0.083052, " is", false], [31475, 0.05847, " must", false], [4715, 0.041544, " or", false], [52224, 0.033567, " methods", false], [47266, 0.02919, " should", false], [46, 0.02581, "-", false], [21413, 0.023306, " can", false]]], "qwen": [369, 2, 0.19535474479198456, [[323, 0.248778, " and", false], [369, 0.195355, " for", false], [3550, 0.060089, " space", false], [374, 0.051573, " is", false], [476, 0.047005, " or", false], [5413, 0.034343, " methods", false], [646, 0.031523, " can", false], [1969, 0.021933, " must", false], [1184, 0.019861, " need", false], [9777, 0.016862, "-and", false]]]}, "raw_delta": 0.00973421335220337, "tuned_delta": 0.01830600538278162}, {"byte_start": 6621, "byte_end": 6626, "display": {"text": " them", "kind": "normal"}, "is_word": true, "word_id": 1111, "word_key": " them", "bytes_hex": "20 74 68 65 6d", "compression": {"rwkv": "12.62% 12.62% 12.62% 12.62% 12.62%", "qwen": "22.09% 22.09% 22.09% 22.09% 22.09%"}, "model_tokens": {"rwkv": [[32229, " them", "normal", 0.030142957344651222]], "qwen": [[1105, " them", "normal", 0.002185772405937314]]}, "loss": {"rwkv": 12.623581607778428, "qwen": 22.094102087698467}, "topk": {"rwkv": [32229, 8, 0.030142957344651222, [[30992, 0.348829, " good", false], [39936, 0.10654, " these", false], [64831, 0.106388, " approximation", false], [32139, 0.081604, " such", false], [22590, 0.078889, " the", false], [45301, 0.035198, " better", false], [332, 0.034523, " a", false], [32229, 0.030143, " them", false], [39944, 0.026664, " those", false], [4419, 0.014202, " an", false]]], "qwen": [1105, 47, 0.002185772405937314, [[1661, 0.158216, " good", false], [279, 0.120957, " the", false], [264, 0.08415, " a", false], [4734, 0.061812, " exact", false], [1493, 0.041712, " these", false], [458, 0.038725, " an", false], [9848, 0.032758, " approx", false], [1741, 0.028929, " such", false], [4285, 0.027181, " simple", false], [4727, 0.019721, " perfect", false]]]}, "raw_delta": -0.5251571655273437, "tuned_delta": -0.5165853734967655}, {"byte_start": 6626, "byte_end": 6633, "display": {"text": " should", "kind": "normal"}, "is_word": true, "word_id": 1112, "word_key": " should", "bytes_hex": "20 73 68 6f 75 6c 64", "compression": {"rwkv": "5.80% 5.80% 5.80% 5.80% 5.80% 5.80% 5.80%", "qwen": "5.68% 5.68% 5.68% 5.68% 5.68% 5.68% 5.68%"}, "model_tokens": {"rwkv": [[47266, " should", "normal", 0.10533887892961502]], "qwen": [[1265, " should", "normal", 0.11030002683401108]]}, "loss": {"rwkv": 5.7965425750002995, "qwen": 5.679455557845392}, "topk": {"rwkv": [47266, 3, 0.10533887892961502, [[4600, 0.299148, " is", false], [31475, 0.192366, " must", false], [47266, 0.105339, " should", false], [21800, 0.055008, " has", false], [21413, 0.050542, " can", false], [32475, 0.035463, " will", false], [45409, 0.03245, " cannot", false], [39105, 0.022745, " needs", false], [45, 0.021985, ",", false], [22074, 0.020177, " may", false]]], "qwen": [1265, 2, 0.11030002683401108, [[374, 0.354648, " is", false], [1265, 0.1103, " should", false], [1969, 0.082882, " must", false], [646, 0.063995, " can", false], [1558, 0.034168, " does", false], [4157, 0.033618, " cannot", false], [702, 0.031089, " has", false], [686, 0.029944, " will", false], [11, 0.025467, ",", false], [1231, 0.025081, " may", false]]]}, "raw_delta": 0.006492682865687827, "tuned_delta": 0.015064474896266075}, {"byte_start": 6633, "byte_end": 6636, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 1113, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"rwkv": "6.11% 6.11% 6.11%", "qwen": "5.80% 5.80% 5.80%"}, "model_tokens": {"rwkv": [[4435, " be", "normal", 0.3649194836616516]], "qwen": [[387, " be", "normal", 0.38093888759613037]]}, "loss": {"rwkv": 6.105154795428556, "qwen": 5.801535190406596}, "topk": {"rwkv": [4435, 1, 0.3649194836616516, [[4435, 0.364919, " be", false], [22187, 0.33217, " not", false], [39115, 0.05579, " never", false], [45150, 0.028503, " always", false], [55851, 0.022339, " continue", false], [52570, 0.013133, " proceed", false], [32122, 0.01283, " stop", false], [31581, 0.012715, " only", false], [52051, 0.009601, " involve", false], [31059, 0.008831, " have", false]]], "qwen": [387, 2, 0.38093888759613037, [[537, 0.406596, " not", false], [387, 0.380939, " be", false], [2581, 0.03639, " never", false], [2936, 0.018259, " stop", false], [2677, 0.017082, " always", false], [7146, 0.012229, " remain", false], [3060, 0.009484, " continue", false], [10354, 0.009378, " proceed", false], [1172, 0.006784, " only", false], [835, 0.00434, " end", false]]]}, "raw_delta": 0.016836245854695675, "tuned_delta": 0.025408037885273925}, {"byte_start": 6636, "byte_end": 6639, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 1114, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "29.49% 29.49% 29.49%", "qwen": "32.12% 32.12% 32.12%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.007502478547394276]], "qwen": [[553, " by", "normal", 0.004782747942954302]]}, "loss": {"rwkv": 29.492593934839483, "qwen": 32.11643578221786}, "topk": {"rwkv": [4450, 21, 0.007502478547394276, [[37810, 0.06737, " based", false], [46141, 0.062068, " guided", false], [30666, 0.044607, " done", false], [37862, 0.038172, " blind", false], [332, 0.025393, " a", false], [45796, 0.022783, " driven", false], [64862, 0.015573, " computational", false], [31269, 0.014314, " left", false], [4423, 0.013196, " as", false], [4596, 0.012941, " in", false]]], "qwen": [553, 33, 0.004782747942954302, [[2814, 0.098134, " done", false], [2115, 0.091625, " left", false], [3118, 0.038297, " based", false], [32587, 0.033109, " guided", false], [264, 0.02995, " a", false], [27498, 0.019021, " automated", false], [7199, 0.018033, " limited", false], [22978, 0.012739, " abandoned", false], [16227, 0.011882, " driven", false], [13075, 0.010533, " conducted", false]]]}, "raw_delta": -0.14549668629964185, "tuned_delta": -0.1369248942690636}, {"byte_start": 6639, "byte_end": 6643, "display": {"text": " our", "kind": "normal"}, "is_word": true, "word_id": 1115, "word_key": " our", "bytes_hex": "20 6f 75 72", "compression": {"rwkv": "40.01% 40.01% 40.01% 40.01%", "qwen": "34.49% 34.49% 34.49% 34.49%"}, "model_tokens": {"rwkv": [[22248, " our", "normal", 0.0001352092222077772]], "qwen": [[1039, " our", "normal", 0.0004757429996971041]]}, "loss": {"rwkv": 40.01224527465484, "qwen": 34.49228151342959}, "topk": {"rwkv": [22248, 451, 0.0001352092222077772, [[37920, 0.195743, " brute", false], [38989, 0.049722, " means", false], [332, 0.043044, " a", false], [52195, 0.039637, " massive", false], [52224, 0.034644, " methods", false], [56537, 0.030646, " learning", false], [47202, 0.028058, " search", false], [22590, 0.027791, " the", false], [31978, 0.022344, " self", false], [63370, 0.018677, " computation", false]]], "qwen": [1039, 235, 0.0004757429996971041, [[264, 0.064584, " a", false], [26943, 0.05475, " scaling", false], [4586, 0.048367, " general", false], [5413, 0.040268, " methods", false], [279, 0.036895, " the", false], [34447, 0.029067, " computation", false], [458, 0.028545, " an", false], [64098, 0.026486, " brute", false], [2711, 0.018504, " search", false], [8823, 0.01828, " meta", false]]]}, "raw_delta": 0.3060917854309082, "tuned_delta": 0.31466357746148643}, {"byte_start": 6643, "byte_end": 6651, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 1116, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "8.21% 8.21% 8.21% 8.21% 8.21% 8.21% 8.21% 8.21%", "qwen": "7.91% 7.91% 7.91% 7.91% 7.91% 7.91% 7.91% 7.91%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.02609674073755741]], "qwen": [[5413, " methods", "normal", 0.029909150674939156]]}, "loss": {"rwkv": 8.206736926931846, "qwen": 7.9113583364123246}, "topk": {"rwkv": [52224, 6, 0.02609674073755741, [[22251, 0.204277, " own", false], [30273, 0.091332, " best", false], [39026, 0.059926, " minds", false], [31461, 0.036086, " most", false], [45124, 0.027058, " agents", false], [52224, 0.026097, " methods", false], [56567, 0.017254, " machines", false], [51832, 0.012683, " general", false], [37636, 0.009412, " agent", false], [59345, 0.008894, " computers", false]]], "qwen": [5413, 6, 0.029909150674939156, [[1828, 0.28534, " own", false], [54480, 0.03619, " computational", false], [3738, 0.03306, " human", false], [4586, 0.032884, " general", false], [20062, 0.03041, " minds", false], [5413, 0.029909, " methods", false], [8823, 0.01548, " meta", false], [1850, 0.013422, " best", false], [13009, 0.012272, " agents", false], [34447, 0.011803, " computation", false]]]}, "raw_delta": 0.01637926697731018, "tuned_delta": 0.02495105900788843}, {"byte_start": 6651, "byte_end": 6652, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "16.41%", "qwen": "10.56%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.405602365732193]], "qwen": [[11, ",", "normal", 0.5567399263381958]]}, "loss": {"rwkv": 16.413473853863692, "qwen": 10.561556704184026}, "topk": {"rwkv": [45, 1, 0.405602365732193, [[45, 0.405602, ",", false], [4706, 0.148247, " of", false], [21265, 0.041474, " and", false], [47, 0.041302, ".", false], [40, 0.040812, "'", false], [32227, 0.031499, " that", false], [22187, 0.028501, " not", false], [5346, 0.026753, "---", false], [47001, 0.02564, " rather", false], [21700, 0.024731, " for", false]]], "qwen": [11, 1, 0.5567399263381958, [[11, 0.55674, ",", false], [323, 0.076192, " and", false], [315, 0.048468, " of", false], [4751, 0.040143, " rather", false], [13, 0.03996, ".", false], [4421, 0.037418, "---", false], [429, 0.032771, " that", false], [369, 0.02546, " for", false], [320, 0.018558, " (", false], [382, 0.016291, ".\n\n", false]]]}, "raw_delta": 0.3244991898536682, "tuned_delta": 0.33307098188424644}, {"byte_start": 6652, "byte_end": 6656, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 1117, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "2.02% 2.02% 2.02% 2.02%", "qwen": "2.91% 2.91% 2.91% 2.91%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.6416407227516174]], "qwen": [[537, " not", "normal", 0.5248613357543945]]}, "loss": {"rwkv": 2.0164621848362585, "qwen": 2.906224371822002}, "topk": {"rwkv": [22187, 1, 0.6416407227516174, [[22187, 0.641641, " not", false], [21265, 0.117235, " and", false], [47001, 0.027668, " rather", false], [40186, 0.022936, " which", false], [4450, 0.020288, " by", false], [4423, 0.011753, " as", false], [4596, 0.008012, " in", false], [53356, 0.00778, " without", false], [40085, 0.007262, " using", false], [32487, 0.007185, " with", false]]], "qwen": [537, 1, 0.5248613357543945, [[537, 0.524861, " not", false], [323, 0.174363, " and", false], [892, 0.037924, " which", false], [4751, 0.031897, " rather", false], [553, 0.022549, " by", false], [438, 0.017158, " as", false], [773, 0.01376, " so", false], [1667, 0.012388, " using", false], [429, 0.010594, " that", false], [448, 0.009621, " with", false]]]}, "raw_delta": -0.049338892102241516, "tuned_delta": -0.040767100071663266}, {"byte_start": 6656, "byte_end": 6659, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 1118, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "1.90% 1.90% 1.90%", "qwen": "1.98% 1.98% 1.98%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.7286056876182556]], "qwen": [[553, " by", "normal", 0.7199219465255737]]}, "loss": {"rwkv": 1.901990532421973, "qwen": 1.9753651389266438}, "topk": {"rwkv": [4450, 1, 0.7286056876182556, [[4450, 0.728606, " by", false], [22590, 0.084609, " the", false], [22248, 0.033014, " our", false], [31597, 0.014343, " ours", false], [4596, 0.009855, " in", false], [39944, 0.007908, " those", false], [38720, 0.007643, " human", false], [53140, 0.007051, " through", false], [332, 0.004437, " a", false], [21700, 0.004273, " for", false]]], "qwen": [553, 1, 0.7199219465255737, [[553, 0.719922, " by", false], [1039, 0.078851, " our", false], [279, 0.035263, " the", false], [11350, 0.023112, " ours", false], [304, 0.01811, " in", false], [3738, 0.007074, " human", false], [504, 0.00552, " from", false], [1128, 0.005099, " what", false], [1846, 0.00484, " those", false], [264, 0.004775, " a", false]]]}, "raw_delta": -0.004068752129872635, "tuned_delta": 0.004503039900705613}, {"byte_start": 6659, "byte_end": 6662, "display": {"text": " us", "kind": "normal"}, "is_word": true, "word_id": 1119, "word_key": " us", "bytes_hex": "20 75 73", "compression": {"rwkv": "34.19% 34.19% 34.19%", "qwen": "28.03% 28.03% 28.03%"}, "model_tokens": {"rwkv": [[4835, " us", "normal", 0.0033956430852413177]], "qwen": [[601, " us", "normal", 0.009435177780687809]]}, "loss": {"rwkv": 34.18886685439991, "qwen": 28.032226186058057}, "topk": {"rwkv": [4835, 30, 0.0033956430852413177, [[22590, 0.292774, " the", false], [38720, 0.098065, " human", false], [22248, 0.091586, " our", false], [31044, 0.032349, " hand", false], [52224, 0.028213, " methods", false], [21273, 0.026857, " any", false], [31597, 0.025495, " ours", false], [39944, 0.023, " those", false], [32074, 0.019273, " some", false], [332, 0.016666, " a", false]]], "qwen": [601, 16, 0.009435177780687809, [[1039, 0.258688, " our", false], [279, 0.135349, " the", false], [3738, 0.051711, " human", false], [1128, 0.040592, " what", false], [1246, 0.030586, " how", false], [894, 0.029897, " any", false], [11350, 0.029029, " ours", false], [1045, 0.022115, " some", false], [4460, 0.01838, " trying", false], [264, 0.016735, " a", false]]]}, "raw_delta": 0.3413966496785481, "tuned_delta": 0.34996844170912633}, {"byte_start": 6662, "byte_end": 6663, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "16.70%", "qwen": "17.46%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.39389297366142273]], "qwen": [[13, ".", "normal", 0.3797611594200134]]}, "loss": {"rwkv": 16.69525022903732, "qwen": 17.460447263063372}, "topk": {"rwkv": [47, 1, 0.39389297366142273, [[47, 0.393893, ".", false], [45, 0.128652, ",", false], [47629, 0.049454, " trying", false], [57419, 0.036062, " thinking", false], [55666, 0.018745, " building", false], [52157, 0.017178, " looking", false], [60, 0.012904, ";", false], [52614, 0.011, " putting", false], [52087, 0.010164, " knowing", false], [46227, 0.010145, " humans", false]]], "qwen": [13, 1, 0.3797611594200134, [[13, 0.379761, ".", false], [382, 0.197382, ".\n\n", false], [11, 0.133295, ",", false], [4460, 0.027582, " trying", false], [4421, 0.02084, "---", false], [13217, 0.019914, " ourselves", false], [26, 0.01801, ";", false], [4752, 0.015604, " building", false], [304, 0.013535, " in", false], [624, 0.012272, ".\n", false]]]}, "raw_delta": -0.042431533336639404, "tuned_delta": -0.033859741306061154}, {"byte_start": 6663, "byte_end": 6666, "display": {"text": " We", "kind": "normal"}, "is_word": true, "word_id": 1120, "word_key": " we", "bytes_hex": "20 57 65", "compression": {"rwkv": "15.59% 15.59% 15.59%", "qwen": "12.74% 12.74% 12.74%"}, "model_tokens": {"rwkv": [[4331, " We", "normal", 0.07419870793819427]], "qwen": [[1205, " We", "normal", 0.12015379965305328]]}, "loss": {"rwkv": 15.591626092940619, "qwen": 12.7376915233504}, "topk": {"rwkv": [4331, 3, 0.07419870793819427, [[261, 0.339053, "\n\n", false], [20996, 0.092401, " The", false], [4331, 0.074199, " We", false], [29894, 0.062721, " This", false], [3913, 0.032627, " In", false], [20571, 0.022018, " Our", false], [37453, 0.020734, " These", false], [3918, 0.01711, " It", false], [19417, 0.014782, " And", false], [44844, 0.013491, " Search", false]]], "qwen": [1205, 2, 0.12015379965305328, [[576, 0.124349, " The", false], [1205, 0.120154, " We", false], [1096, 0.100161, " This", false], [758, 0.045278, " In", false], [1084, 0.03561, " It", false], [4220, 0.029118, " These", false], [1597, 0.026011, " And", false], [2938, 0.025488, " That", false], [2379, 0.023709, " They", false], [1416, 0.022571, " If", false]]]}, "raw_delta": 0.15825573603312182, "tuned_delta": 0.16682752806370008}, {"byte_start": 6666, "byte_end": 6671, "display": {"text": " want", "kind": "normal"}, "is_word": true, "word_id": 1121, "word_key": " want", "bytes_hex": "20 77 61 6e 74", "compression": {"rwkv": "17.02% 17.02% 17.02% 17.02% 17.02%", "qwen": "16.53% 16.53% 16.53% 16.53% 16.53%"}, "model_tokens": {"rwkv": [[32435, " want", "normal", 0.008886758238077164]], "qwen": [[1366, " want", "normal", 0.01023530401289463]]}, "loss": {"rwkv": 17.019293060486987, "qwen": 16.525756167132496}, "topk": {"rwkv": [32435, 10, 0.008886758238077164, [[47266, 0.570663, " should", false], [21286, 0.064686, " are", false], [21413, 0.054047, " can", false], [31059, 0.046024, " have", false], [4491, 0.032473, " do", false], [31475, 0.03148, " must", false], [31506, 0.028998, " need", false], [45409, 0.025182, " cannot", false], [32475, 0.018433, " will", false], [32435, 0.008887, " want", false]]], "qwen": [1366, 11, 0.01023530401289463, [[1265, 0.475429, " should", false], [646, 0.080123, " can", false], [525, 0.070954, " are", false], [653, 0.048946, " do", false], [614, 0.043774, " have", false], [1184, 0.03069, " need", false], [4157, 0.023288, " cannot", false], [1969, 0.021519, " must", false], [686, 0.020723, " will", false], [1936, 0.014334, " build", false]]]}, "raw_delta": 0.027367496490478538, "tuned_delta": 0.03593928852105679}, {"byte_start": 6671, "byte_end": 6674, "display": {"text": " AI", "kind": "normal"}, "is_word": true, "word_id": 1122, "word_key": " ai", "bytes_hex": "20 41 49", "compression": {"rwkv": "34.19% 34.19% 34.19%", "qwen": "33.82% 33.82% 33.82%"}, "model_tokens": {"rwkv": [[3609, " AI", "normal", 0.003392708720639348]], "qwen": [[15235, " AI", "normal", 0.003602352924644947]]}, "loss": {"rwkv": 34.18886685439991, "qwen": 33.82018764574531}, "topk": {"rwkv": [3609, 20, 0.003392708720639348, [[4811, 0.401271, " to", false], [22248, 0.151508, " our", false], [52224, 0.088485, " methods", false], [22590, 0.065865, " the", false], [332, 0.043564, " a", false], [30992, 0.025533, " good", false], [39936, 0.018421, " these", false], [32229, 0.014171, " them", false], [4419, 0.009503, " an", false], [47202, 0.009064, " search", false]]], "qwen": [15235, 19, 0.003602352924644947, [[311, 0.431843, " to", false], [1039, 0.151343, " our", false], [279, 0.06933, " the", false], [5413, 0.062271, " methods", false], [1105, 0.055695, " them", false], [264, 0.020451, " a", false], [1493, 0.020378, " these", false], [13009, 0.007229, " agents", false], [458, 0.006334, " an", false], [18495, 0.00584, " computers", false]]]}, "raw_delta": 0.02044391632080078, "tuned_delta": 0.02901570835137903}, {"byte_start": 6674, "byte_end": 6681, "display": {"text": " agents", "kind": "normal"}, "is_word": true, "word_id": 1123, "word_key": " agents", "bytes_hex": "20 61 67 65 6e 74 73", "compression": {"rwkv": "4.49% 4.49% 4.49% 4.49% 4.49% 4.49% 4.49%", "qwen": "4.27% 4.27% 4.27% 4.27% 4.27% 4.27% 4.27%"}, "model_tokens": {"rwkv": [[45124, " agents", "normal", 0.17387990653514862]], "qwen": [[13009, " agents", "normal", 0.19034291803836823]]}, "loss": {"rwkv": 4.488295118837037, "qwen": 4.273798663792818}, "topk": {"rwkv": [45124, 3, 0.17387990653514862, [[53087, 0.249089, " systems", false], [4811, 0.187299, " to", false], [45124, 0.17388, " agents", false], [52224, 0.147139, " methods", false], [63843, 0.054576, " researchers", false], [57103, 0.040544, " research", false], [32227, 0.031342, " that", false], [116, 0.0199, "s", false], [56949, 0.015795, " programs", false], [45, 0.011397, ",", false]]], "qwen": [13009, 3, 0.19034291803836823, [[5942, 0.341456, " systems", false], [311, 0.200749, " to", false], [13009, 0.190343, " agents", false], [5413, 0.066325, " methods", false], [429, 0.04606, " that", false], [11811, 0.04474, " researchers", false], [3412, 0.025602, " research", false], [7468, 0.008014, " programs", false], [11, 0.006924, ",", false], [537, 0.003817, " not", false]]]}, "raw_delta": 0.011894209044320259, "tuned_delta": 0.02046600107489851}, {"byte_start": 6681, "byte_end": 6686, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 1124, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "3.32% 3.32% 3.32% 3.32% 3.32%", "qwen": "3.77% 3.77% 3.77% 3.77% 3.77%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.40044909715652466]], "qwen": [[429, " that", "normal", 0.35199281573295593]]}, "loss": {"rwkv": 3.324961227048783, "qwen": 3.7659552707815522}, "topk": {"rwkv": [32227, 2, 0.40044909715652466, [[4811, 0.464835, " to", false], [32227, 0.400449, " that", false], [45, 0.031049, ",", false], [22762, 0.028127, " who", false], [32487, 0.013456, " with", false], [40191, 0.010205, " whose", false], [21265, 0.004849, " and", false], [275, 0.004232, " (", false], [4596, 0.004068, " in", false], [51127, 0.003754, " capable", false]]], "qwen": [429, 2, 0.35199281573295593, [[311, 0.565987, " to", false], [429, 0.351993, " that", false], [448, 0.011837, " with", false], [11, 0.010759, ",", false], [6693, 0.005431, " whose", false], [879, 0.005186, " who", false], [2952, 0.004026, " able", false], [537, 0.003776, " not", false], [12875, 0.003059, " capable", false], [5798, 0.002581, " built", false]]]}, "raw_delta": -0.024453902244567866, "tuned_delta": -0.015882110213989616}, {"byte_start": 6686, "byte_end": 6690, "display": {"text": " can", "kind": "normal"}, "is_word": true, "word_id": 1125, "word_key": " can", "bytes_hex": "20 63 61 6e", "compression": {"rwkv": "4.54% 4.54% 4.54% 4.54%", "qwen": "4.18% 4.18% 4.18% 4.18%"}, "model_tokens": {"rwkv": [[21413, " can", "normal", 0.36886271834373474]], "qwen": [[646, " can", "normal", 0.3953403830528259]]}, "loss": {"rwkv": 4.543644049674714, "qwen": 4.18385258194923}, "topk": {"rwkv": [21413, 1, 0.36886271834373474, [[21413, 0.368863, " can", false], [21286, 0.16787, " are", false], [30858, 0.046551, " find", false], [31059, 0.036646, " have", false], [4491, 0.033468, " do", false], [38877, 0.027849, " learn", false], [32475, 0.021242, " will", false], [47202, 0.018657, " search", false], [39942, 0.018343, " think", false], [4858, 0.015148, " we", false]]], "qwen": [646, 1, 0.3953403830528259, [[646, 0.39534, " can", false], [525, 0.170227, " are", false], [3960, 0.036257, " learn", false], [614, 0.029221, " have", false], [653, 0.026931, " do", false], [686, 0.022574, " will", false], [1477, 0.018476, " find", false], [975, 0.015161, " work", false], [1744, 0.014971, " think", false], [11, 0.010416, ",", false]]]}, "raw_delta": 0.019951075315475464, "tuned_delta": 0.028522867346053714}, {"byte_start": 6690, "byte_end": 6699, "display": {"text": " discover", "kind": "normal"}, "is_word": true, "word_id": 1126, "word_key": " discover", "bytes_hex": "20 64 69 73 63 6f 76 65 72", "compression": {"rwkv": "7.83% 7.83% 7.83% 7.83% 7.83% 7.83% 7.83% 7.83% 7.83%", "qwen": "8.66% 8.66% 8.66% 8.66% 8.66% 8.66% 8.66% 8.66% 8.66%"}, "model_tokens": {"rwkv": [[56010, " discover", "normal", 0.020210230723023415]], "qwen": [[6997, " discover", "normal", 0.013267488218843937]]}, "loss": {"rwkv": 7.827121532600711, "qwen": 8.661056807501929}, "topk": {"rwkv": [56010, 8, 0.020210230723023415, [[30858, 0.271751, " find", false], [38877, 0.074894, " learn", false], [47202, 0.05126, " search", false], [4491, 0.046526, " do", false], [39942, 0.033556, " think", false], [4435, 0.030315, " be", false], [37923, 0.023489, " build", false], [56010, 0.02021, " discover", false], [63292, 0.018048, " approximate", false], [22681, 0.015947, " use", false]]], "qwen": [6997, 13, 0.013267488218843937, [[1477, 0.163343, " find", false], [3960, 0.0668, " learn", false], [653, 0.063917, " do", false], [1744, 0.040563, " think", false], [11625, 0.026984, " solve", false], [2711, 0.02423, " search", false], [387, 0.022677, " be", false], [1936, 0.019734, " build", false], [1281, 0.018899, " make", false], [2874, 0.017637, " reason", false]]]}, "raw_delta": -0.04624319076538086, "tuned_delta": -0.03767139873480261}, {"byte_start": 6699, "byte_end": 6704, "display": {"text": " like", "kind": "normal"}, "is_word": true, "word_id": 1127, "word_key": " like", "bytes_hex": "20 6c 69 6b 65", "compression": {"rwkv": "36.29% 36.29% 36.29% 36.29% 36.29%", "qwen": "32.17% 32.17% 32.17% 32.17% 32.17%"}, "model_tokens": {"rwkv": [[31296, " like", "normal", 4.271131911082193e-05]], "qwen": [[1075, " like", "normal", 0.00013390577805694193]]}, "loss": {"rwkv": 36.292797122362984, "qwen": 32.1662350786017}, "topk": {"rwkv": [31296, 531, 4.271131911082193e-05, [[22590, 0.153616, " the", false], [21265, 0.079406, " and", false], [30992, 0.072583, " good", false], [45, 0.061582, ",", false], [39936, 0.05371, " these", false], [39931, 0.053492, " their", false], [22168, 0.034159, " new", false], [52224, 0.032527, " methods", false], [32464, 0.032322, " what", false], [21835, 0.031038, " how", false]]], "qwen": [1075, 249, 0.00013390577805694193, [[279, 0.162703, " the", false], [323, 0.109268, " and", false], [369, 0.064706, " for", false], [862, 0.062624, " their", false], [1128, 0.058175, " what", false], [1661, 0.057383, " good", false], [11, 0.041455, ",", false], [1493, 0.039444, " these", false], [1246, 0.029323, " how", false], [2513, 0.02278, " things", false]]]}, "raw_delta": 0.22882518768310556, "tuned_delta": 0.23739697971368381}, {"byte_start": 6704, "byte_end": 6707, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 1128, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"rwkv": "15.31% 15.31% 15.31%", "qwen": "11.68% 11.68% 11.68%"}, "model_tokens": {"rwkv": [[4858, " we", "normal", 0.07806975394487381]], "qwen": [[582, " we", "normal", 0.14333263039588928]]}, "loss": {"rwkv": 15.309849717766994, "qwen": 11.677338222210782}, "topk": {"rwkv": [4858, 3, 0.07806975394487381, [[4835, 0.405959, " us", false], [32234, 0.104065, " this", false], [4858, 0.07807, " we", false], [46227, 0.065164, " humans", false], [46, 0.050487, "-", false], [26307, 0.028313, "ness", false], [22590, 0.02622, " the", false], [52224, 0.024994, " methods", false], [38720, 0.024662, " human", false], [22248, 0.015617, " our", false]]], "qwen": [582, 3, 0.14333263039588928, [[601, 0.288519, " us", false], [33323, 0.180082, "-minded", false], [582, 0.143333, " we", false], [12677, 0.092214, " humans", false], [13217, 0.027994, " ourselves", false], [3738, 0.027534, " human", false], [264, 0.024417, " a", false], [5577, 0.018602, " themselves", false], [279, 0.018061, " the", false], [20062, 0.014807, " minds", false]]]}, "raw_delta": 0.20142920811971032, "tuned_delta": 0.21000100015028858}, {"byte_start": 6707, "byte_end": 6711, "display": {"text": " can", "kind": "normal"}, "is_word": true, "word_id": 1129, "word_key": " can", "bytes_hex": "20 63 61 6e", "compression": {"rwkv": "14.02% 14.02% 14.02% 14.02%", "qwen": "8.59% 8.59% 8.59% 8.59%"}, "model_tokens": {"rwkv": [[21413, " can", "normal", 0.04430075362324715]], "qwen": [[646, " can", "normal", 0.14863568544387817]]}, "loss": {"rwkv": 14.018374664887876, "qwen": 8.594211152096834}, "topk": {"rwkv": [21413, 3, 0.04430075362324715, [[4491, 0.835724, " do", false], [56010, 0.045945, " discover", false], [21413, 0.044301, " can", false], [31059, 0.014708, " have", false], [21532, 0.010558, " did", false], [46227, 0.009851, " humans", false], [40219, 0.005348, " would", false], [60112, 0.002919, " ourselves", false], [39021, 0.002612, " might", false], [61885, 0.002538, " discovered", false]]], "qwen": [646, 3, 0.14863568544387817, [[653, 0.568086, " do", false], [6997, 0.174734, " discover", false], [646, 0.148636, " can", false], [1521, 0.021359, " did", false], [11105, 0.010338, " discovered", false], [1410, 0.007818, " could", false], [1035, 0.007264, " would", false], [1477, 0.007214, " find", false], [11, 0.006526, ",", false], [1744, 0.006406, " think", false]]]}, "raw_delta": 0.3007794916629791, "tuned_delta": 0.30935128369355736}, {"byte_start": 6711, "byte_end": 6712, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "11.27%", "qwen": "13.22%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.5405202507972717]], "qwen": [[11, ",", "normal", 0.48036783933639526]]}, "loss": {"rwkv": 11.271055006945026, "qwen": 13.222356190044069}, "topk": {"rwkv": [45, 1, 0.5405202507972717, [[45, 0.54052, ",", false], [47, 0.162355, ".", false], [56010, 0.068789, " discover", false], [5346, 0.058311, "---", false], [60, 0.035383, ";", false], [21265, 0.019231, " and", false], [59, 0.016769, ":", false], [4596, 0.013378, " in", false], [275, 0.007809, " (", false], [22590, 0.005136, " the", false]]], "qwen": [11, 1, 0.48036783933639526, [[11, 0.480368, ",", false], [6997, 0.207943, " discover", false], [13, 0.099656, ".", false], [4421, 0.064796, "---", false], [382, 0.043028, ".\n\n", false], [26, 0.024823, ";", false], [320, 0.007874, " (", false], [323, 0.007799, " and", false], [25, 0.007231, ":", false], [1477, 0.004184, " find", false]]]}, "raw_delta": -0.10820311307907104, "tuned_delta": -0.0996313210484928}, {"byte_start": 6712, "byte_end": 6716, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 1130, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "7.82% 7.82% 7.82% 7.82%", "qwen": "7.45% 7.45% 7.45% 7.45%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.17512939870357513]], "qwen": [[537, " not", "normal", 0.19144868850708008]]}, "loss": {"rwkv": 7.819294411068111, "qwen": 7.453032633549699}, "topk": {"rwkv": [22187, 2, 0.17512939870357513, [[21265, 0.190424, " and", false], [22187, 0.175129, " not", false], [21400, 0.152519, " but", false], [47001, 0.042702, " rather", false], [32227, 0.042439, " that", false], [4450, 0.039707, " by", false], [4596, 0.027738, " in", false], [4788, 0.02235, " so", false], [4715, 0.021353, " or", false], [53356, 0.020909, " without", false]]], "qwen": [537, 2, 0.19144868850708008, [[323, 0.224467, " and", false], [537, 0.191449, " not", false], [714, 0.158138, " but", false], [553, 0.039503, " by", false], [429, 0.02697, " that", false], [2041, 0.026324, " without", false], [476, 0.023965, " or", false], [4751, 0.023311, " rather", false], [448, 0.023124, " with", false], [773, 0.020411, " so", false]]]}, "raw_delta": 0.020309865474700928, "tuned_delta": 0.028881657505279178}, {"byte_start": 6716, "byte_end": 6722, "display": {"text": " which", "kind": "normal"}, "is_word": true, "word_id": 1131, "word_key": " which", "bytes_hex": "20 77 68 69 63 68", "compression": {"rwkv": "21.23% 21.23% 21.23% 21.23% 21.23% 21.23%", "qwen": "26.25% 26.25% 26.25% 26.25% 26.25% 26.25%"}, "model_tokens": {"rwkv": [[40186, " which", "normal", 0.0008482365519739687]], "qwen": [[892, " which", "normal", 0.0001608761231182143]]}, "loss": {"rwkv": 21.22715359641313, "qwen": 26.25367046853784}, "topk": {"rwkv": [40186, 52, 0.0008482365519739687, [[31296, 0.336947, " like", false], [32227, 0.20722, " that", false], [31198, 0.044844, " just", false], [3609, 0.043916, " AI", false], [56010, 0.042039, " discover", false], [45124, 0.040443, " agents", false], [31580, 0.035014, " ones", false], [4450, 0.019381, " by", false], [22590, 0.014692, " the", false], [4835, 0.014163, " us", false]]], "qwen": [892, 153, 0.0001608761231182143, [[1075, 0.258698, " like", false], [429, 0.23203, " that", false], [6997, 0.062718, " discover", false], [1101, 0.053694, " just", false], [6174, 0.038152, " ones", false], [279, 0.03279, " the", false], [825, 0.025358, " one", false], [13009, 0.025107, " agents", false], [15235, 0.02273, " AI", false], [553, 0.022475, " by", false]]]}, "raw_delta": -0.27872927983601903, "tuned_delta": -0.2701574878054408}, {"byte_start": 6722, "byte_end": 6730, "display": {"text": " contain", "kind": "normal"}, "is_word": true, "word_id": 1132, "word_key": " contain", "bytes_hex": "20 63 6f 6e 74 61 69 6e", "compression": {"rwkv": "19.58% 19.58% 19.58% 19.58% 19.58% 19.58% 19.58% 19.58%", "qwen": "19.92% 19.92% 19.92% 19.92% 19.92% 19.92% 19.92% 19.92%"}, "model_tokens": {"rwkv": [[51306, " contain", "normal", 0.00016801267338450998]], "qwen": [[6644, " contain", "normal", 0.00014512930647470057]]}, "loss": {"rwkv": 19.58345807456698, "qwen": 19.922457377248936}, "topk": {"rwkv": [51306, 162, 0.00016801267338450998, [[4858, 0.439659, " we", false], [21413, 0.177438, " can", false], [4706, 0.039156, " of", false], [22752, 0.037556, " way", false], [31580, 0.020576, " ones", false], [31296, 0.018933, " like", false], [39239, 0.016602, " parts", false], [21286, 0.016067, " are", false], [32448, 0.01186, " ways", false], [47539, 0.008937, " things", false]]], "qwen": [6644, 286, 0.00014512930647470057, [[582, 0.509987, " we", false], [315, 0.054849, " of", false], [646, 0.046551, " can", false], [374, 0.044929, " is", false], [525, 0.02955, " are", false], [1075, 0.015272, " like", false], [1616, 0.011093, " way", false], [5510, 0.009118, " ways", false], [5413, 0.008642, " methods", false], [11, 0.008383, ",", false]]]}, "raw_delta": -0.018798112869262695, "tuned_delta": -0.010226320838684447}, {"byte_start": 6730, "byte_end": 6735, "display": {"text": " what", "kind": "normal"}, "is_word": true, "word_id": 1133, "word_key": " what", "bytes_hex": "20 77 68 61 74", "compression": {"rwkv": "10.82% 10.82% 10.82% 10.82% 10.82%", "qwen": "11.11% 11.11% 11.11% 11.11% 11.11%"}, "model_tokens": {"rwkv": [[32464, " what", "normal", 0.04939144477248192]], "qwen": [[1128, " what", "normal", 0.045924846082925797]]}, "loss": {"rwkv": 10.820212806667223, "qwen": 11.11145338711783}, "topk": {"rwkv": [32464, 5, 0.04939144477248192, [[31296, 0.520295, " like", false], [22248, 0.096427, " our", false], [22590, 0.063157, " the", false], [59943, 0.05299, " knowledge", false], [32464, 0.049391, " what", false], [4596, 0.01953, " in", false], [38720, 0.015024, " human", false], [4835, 0.014422, " us", false], [32227, 0.011941, " that", false], [4601, 0.011006, " it", false]]], "qwen": [1128, 4, 0.045924846082925797, [[1039, 0.192355, " our", false], [601, 0.074176, " us", false], [279, 0.071885, " the", false], [1128, 0.045925, " what", false], [678, 0.043658, " all", false], [304, 0.040075, " in", false], [264, 0.038176, " a", false], [1075, 0.030652, " like", false], [2878, 0.026761, " within", false], [43613, 0.026124, " representations", false]]]}, "raw_delta": -0.016149806976318404, "tuned_delta": -0.0075780149457401556}, {"byte_start": 6735, "byte_end": 6738, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 1134, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"rwkv": "1.03% 1.03% 1.03%", "qwen": "0.56% 0.56% 0.56%"}, "model_tokens": {"rwkv": [[4858, " we", "normal", 0.8416891098022461]], "qwen": [[582, " we", "normal", 0.9115656614303589]]}, "loss": {"rwkv": 1.033180042303294, "qwen": 0.5565898267061866}, "topk": {"rwkv": [4858, 1, 0.8416891098022461, [[4858, 0.841689, " we", false], [31296, 0.051954, " like", false], [47, 0.012044, ".", false], [4600, 0.009299, " is", false], [22248, 0.007853, " our", false], [21413, 0.006039, " can", false], [22590, 0.004134, " the", false], [46227, 0.004081, " humans", false], [45, 0.003882, ",", false], [32232, 0.003829, " they", false]]], "qwen": [582, 1, 0.9115656614303589, [[582, 0.911566, " we", false], [374, 0.010946, " is", false], [1039, 0.007368, " our", false], [7952, 0.003925, " appears", false], [304, 0.002683, " in", false], [5868, 0.002403, " looks", false], [807, 0.002394, " they", false], [4977, 0.002156, " seems", false], [3643, 0.002092, " makes", false], [12677, 0.002075, " humans", false]]]}, "raw_delta": 0.026427773137887318, "tuned_delta": 0.034999565168465564}, {"byte_start": 6738, "byte_end": 6743, "display": {"text": " have", "kind": "normal"}, "is_word": true, "word_id": 1135, "word_key": " have", "bytes_hex": "20 68 61 76 65", "compression": {"rwkv": "9.75% 9.75% 9.75% 9.75% 9.75%", "qwen": "15.79% 15.79% 15.79% 15.79% 15.79%"}, "model_tokens": {"rwkv": [[31059, " have", "normal", 0.06702268868684769]], "qwen": [[614, " have", "normal", 0.012539910152554512]]}, "loss": {"rwkv": 9.749462581007448, "qwen": 15.793323332944}, "topk": {"rwkv": [31059, 5, 0.06702268868684769, [[21413, 0.199723, " can", false], [39942, 0.152266, " think", false], [31223, 0.147158, " know", false], [4491, 0.07182, " do", false], [31059, 0.067023, " have", false], [31296, 0.04986, " like", false], [32435, 0.029523, " want", false], [50888, 0.022951, " already", false], [51025, 0.018259, " believe", false], [39021, 0.017775, " might", false]]], "qwen": [614, 9, 0.012539910152554512, [[1744, 0.472448, " think", false], [1414, 0.110558, " know", false], [1366, 0.071092, " want", false], [646, 0.048242, " can", false], [4411, 0.046941, " believe", false], [2669, 0.041109, " already", false], [653, 0.021499, " do", false], [1035, 0.015672, " would", false], [614, 0.01254, " have", false], [1477, 0.010907, " find", false]]]}, "raw_delta": -0.3351428031921386, "tuned_delta": -0.3265710111615604}, {"byte_start": 6743, "byte_end": 6754, "display": {"text": " discovered", "kind": "normal"}, "is_word": true, "word_id": 1136, "word_key": " discovered", "bytes_hex": "20 64 69 73 63 6f 76 65 72 65 64", "compression": {"rwkv": "2.83% 2.83% 2.83% 2.83% 2.83% 2.83% 2.83% 2.83% 2.83% 2.83% 2.83%", "qwen": "3.06% 3.06% 3.06% 3.06% 3.06% 3.06% 3.06% 3.06% 3.06% 3.06% 3.06%"}, "model_tokens": {"rwkv": [[61885, " discovered", "normal", 0.17997170984745026]], "qwen": [[11105, " discovered", "normal", 0.15453387796878815]]}, "loss": {"rwkv": 2.830571768789603, "qwen": 3.061369163855374}, "topk": {"rwkv": [61885, 1, 0.17997170984745026, [[61885, 0.179972, " discovered", false], [47, 0.132954, ".", false], [4596, 0.084884, " in", false], [52112, 0.081874, " learned", false], [50888, 0.064199, " already", false], [53137, 0.047147, " thought", false], [4811, 0.032717, " to", false], [38547, 0.031827, " found", false], [22339, 0.029411, " put", false], [45, 0.02099, ",", false]]], "qwen": [11105, 2, 0.15453387796878815, [[304, 0.207364, " in", false], [11105, 0.154534, " discovered", false], [4766, 0.066517, " inside", false], [2669, 0.053761, " already", false], [1730, 0.043844, " found", false], [5798, 0.040682, " built", false], [9498, 0.036944, " learned", false], [3381, 0.029962, " thought", false], [13, 0.023349, ".", false], [382, 0.016495, ".\n\n", false]]]}, "raw_delta": -0.012798125093633483, "tuned_delta": -0.004226333063055235}, {"byte_start": 6754, "byte_end": 6755, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "5.64%", "qwen": "17.17%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.730880081653595]], "qwen": [[13, ".", "normal", 0.38600796461105347]]}, "loss": {"rwkv": 5.635527503472513, "qwen": 17.166218269075713}, "topk": {"rwkv": [47, 1, 0.730880081653595, [[47, 0.73088, ".", false], [45, 0.069008, ",", false], [31296, 0.032315, " like", false], [4596, 0.023469, " in", false], [21700, 0.018851, " for", false], [21265, 0.017739, " and", false], [50888, 0.011498, " already", false], [60, 0.010665, ";", false], [5346, 0.00961, "---", false], [60112, 0.009043, " ourselves", false]]], "qwen": [13, 1, 0.38600796461105347, [[13, 0.386008, ".", false], [382, 0.231522, ".\n\n", false], [304, 0.072136, " in", false], [11, 0.053785, ",", false], [911, 0.05076, " about", false], [323, 0.018208, " and", false], [13217, 0.017798, " ourselves", false], [2669, 0.015759, " already", false], [4766, 0.013275, " inside", false], [624, 0.012202, ".\n", false]]]}, "raw_delta": -0.6393972635269165, "tuned_delta": -0.6308254714963383}, {"byte_start": 6755, "byte_end": 6764, "display": {"text": " Building", "kind": "normal"}, "is_word": true, "word_id": 1137, "word_key": " building", "bytes_hex": "20 42 75 69 6c 64 69 6e 67", "compression": {"rwkv": "13.40% 13.40% 13.40% 13.40% 13.40% 13.40% 13.40% 13.40% 13.40%", "qwen": "12.49% 12.49% 12.49% 12.49% 12.49% 12.49% 12.49% 12.49% 12.49%"}, "model_tokens": {"rwkv": [[54879, " Building", "normal", 0.0012474644463509321]], "qwen": [[16858, " Building", "normal", 0.0019598412327468395]]}, "loss": {"rwkv": 13.400032063812418, "qwen": 12.493121683772598}, "topk": {"rwkv": [54879, 47, 0.0012474644463509321, [[261, 0.495125, "\n\n", false], [4331, 0.064093, " We", false], [20996, 0.062812, " The", false], [29894, 0.053125, " This", false], [19417, 0.017577, " And", false], [3913, 0.017541, " In", false], [0, 0.016396, "[0]", false], [20571, 0.013531, " Our", false], [3918, 0.012535, " It", false], [37453, 0.012277, " These", false]]], "qwen": [16858, 56, 0.0019598412327468395, [[1205, 0.156684, " We", false], [576, 0.135697, " The", false], [1096, 0.0787, " This", false], [758, 0.036291, " In", false], [220, 0.035951, " ", false], [1084, 0.029062, " It", false], [1597, 0.029, " And", false], [4220, 0.020506, " These", false], [1416, 0.019435, " If", false], [2014, 0.017807, " To", false]]]}, "raw_delta": 0.05028978983561205, "tuned_delta": 0.0588615818661903}, {"byte_start": 6764, "byte_end": 6767, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 1138, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "4.72% 4.72% 4.72%", "qwen": "3.09% 3.09% 3.09%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.45493388175964355]], "qwen": [[304, " in", "normal", 0.5984180569648743]]}, "loss": {"rwkv": 4.719754284158229, "qwen": 3.086560094633201}, "topk": {"rwkv": [4596, 1, 0.45493388175964355, [[4596, 0.454934, " in", false], [3609, 0.060028, " AI", false], [52224, 0.053594, " methods", false], [39936, 0.043946, " these", false], [32139, 0.038988, " such", false], [32234, 0.031919, " this", false], [22248, 0.029905, " our", false], [31162, 0.018893, " into", false], [22590, 0.018609, " the", false], [332, 0.016126, " a", false]]], "qwen": [304, 1, 0.5984180569648743, [[304, 0.598418, " in", false], [6540, 0.031385, " knowledge", false], [5413, 0.03018, " methods", false], [279, 0.027624, " the", false], [264, 0.025223, " a", false], [1039, 0.02026, " our", false], [389, 0.017346, " on", false], [1493, 0.014468, " these", false], [1741, 0.013214, " such", false], [419, 0.011646, " this", false]]]}, "raw_delta": 0.0905635158220927, "tuned_delta": 0.09913530785267094}, {"byte_start": 6767, "byte_end": 6771, "display": {"text": " our", "kind": "normal"}, "is_word": true, "word_id": 1139, "word_key": " our", "bytes_hex": "20 6f 75 72", "compression": {"rwkv": "7.36% 7.36% 7.36% 7.36%", "qwen": "8.73% 8.73% 8.73% 8.73%"}, "model_tokens": {"rwkv": [[22248, " our", "normal", 0.19305700063705444]], "qwen": [[1039, " our", "normal", 0.14410899579524994]]}, "loss": {"rwkv": 7.361407801410969, "qwen": 8.733648773512776}, "topk": {"rwkv": [22248, 1, 0.19305700063705444, [[22248, 0.193057, " our", false], [38720, 0.152005, " human", false], [32464, 0.10019, " what", false], [22590, 0.094854, " the", false], [59943, 0.08423, " knowledge", false], [21835, 0.052755, " how", false], [332, 0.029623, " a", false], [32234, 0.019984, " this", false], [39936, 0.017865, " these", false], [32139, 0.011579, " such", false]]], "qwen": [1039, 2, 0.14410899579524994, [[1128, 0.150954, " what", false], [1039, 0.144109, " our", false], [279, 0.11937, " the", false], [1246, 0.075014, " how", false], [3738, 0.067958, " human", false], [6540, 0.057701, " knowledge", false], [264, 0.026214, " a", false], [1741, 0.020343, " such", false], [894, 0.016577, " any", false], [419, 0.014827, " this", false]]]}, "raw_delta": -0.07609319686889648, "tuned_delta": -0.06752140483831824}, {"byte_start": 6771, "byte_end": 6783, "display": {"text": " discoveries", "kind": "normal"}, "is_word": true, "word_id": 1140, "word_key": " discoveries", "bytes_hex": "20 64 69 73 63 6f 76 65 72 69 65 73", "compression": {"rwkv": "7.75% 7.75% 7.75% 7.75% 7.75% 7.75% 7.75% 7.75% 7.75% 7.75% 7.75% 7.75%", "qwen": "9.32% 9.32% 9.32% 9.32% 9.32% 9.32% 9.32% 9.32% 9.32% 9.32% 9.32% 9.32%"}, "model_tokens": {"rwkv": [[63484, " discoveries", "normal", 0.0057210191152989864]], "qwen": [[52998, " discoveries", "normal", 0.002021820517256856]]}, "loss": {"rwkv": 7.748850317274705, "qwen": 9.323051232879088}, "topk": {"rwkv": [63484, 20, 0.0057210191152989864, [[59943, 0.27628, " knowledge", false], [22251, 0.116928, " own", false], [65034, 0.054143, " understanding", false], [38720, 0.05239, " human", false], [52224, 0.035159, " methods", false], [39026, 0.02814, " minds", false], [38735, 0.025784, " ideas", false], [32448, 0.021135, " ways", false], [57422, 0.015526, " thoughts", false], [57419, 0.014949, " thinking", false]]], "qwen": [52998, 43, 0.002021820517256856, [[1828, 0.254991, " own", false], [6540, 0.135437, " knowledge", false], [6708, 0.045557, " ideas", false], [8660, 0.039746, " understanding", false], [3738, 0.035428, " human", false], [5510, 0.035331, " ways", false], [11303, 0.032556, " thoughts", false], [1616, 0.026011, " way", false], [10502, 0.023597, " mental", false], [20062, 0.022822, " minds", false]]]}, "raw_delta": -0.08729223410288489, "tuned_delta": -0.07872044207230665}, {"byte_start": 6783, "byte_end": 6788, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 1141, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"rwkv": "19.16% 19.16% 19.16% 19.16% 19.16%", "qwen": "16.08% 16.08% 16.08% 16.08% 16.08%"}, "model_tokens": {"rwkv": [[31581, " only", "normal", 0.0048307329416275024]], "qwen": [[1172, " only", "normal", 0.01158465538173914]]}, "loss": {"rwkv": 19.160793511806542, "qwen": 16.079101744403204}, "topk": {"rwkv": [31581, 26, 0.0048307329416275024, [[4600, 0.244198, " is", false], [4706, 0.158148, " of", false], [45, 0.077005, ",", false], [37598, 0.063804, " about", false], [30659, 0.038105, " does", false], [21265, 0.033634, " and", false], [32475, 0.032491, " will", false], [4811, 0.024898, " to", false], [4596, 0.017436, " in", false], [4423, 0.016009, " as", false]]], "qwen": [1172, 16, 0.01158465538173914, [[374, 0.245717, " is", false], [11, 0.078962, ",", false], [686, 0.051181, " will", false], [1558, 0.046048, " does", false], [323, 0.039916, " and", false], [315, 0.031096, " of", false], [1035, 0.030783, " would", false], [911, 0.028587, " about", false], [3643, 0.028279, " makes", false], [311, 0.022778, " to", false]]]}, "raw_delta": 0.17088527679443355, "tuned_delta": 0.1794570688250118}, {"byte_start": 6788, "byte_end": 6794, "display": {"text": " makes", "kind": "normal"}, "is_word": true, "word_id": 1142, "word_key": " makes", "bytes_hex": "20 6d 61 6b 65 73", "compression": {"rwkv": "6.15% 6.15% 6.15% 6.15% 6.15% 6.15%", "qwen": "6.56% 6.56% 6.56% 6.56% 6.56% 6.56%"}, "model_tokens": {"rwkv": [[38964, " makes", "normal", 0.12994173169136047]], "qwen": [[3643, " makes", "normal", 0.11284811794757843]]}, "loss": {"rwkv": 6.15211752462416, "qwen": 6.557386758844204}, "topk": {"rwkv": [38964, 1, 0.12994173169136047, [[38964, 0.129942, " makes", false], [38875, 0.107182, " leads", false], [40212, 0.035878, " works", false], [30965, 0.026222, " gets", false], [39719, 0.025822, " slows", false], [46441, 0.025509, " limits", false], [30109, 0.022043, " adds", false], [47237, 0.019422, " serves", false], [45691, 0.018412, " delays", false], [38989, 0.017752, " means", false]]], "qwen": [3643, 1, 0.11284811794757843, [[3643, 0.112848, " makes", false], [69170, 0.060295, " slows", false], [11508, 0.059239, " leads", false], [81220, 0.028288, " wastes", false], [17045, 0.026327, " serves", false], [27236, 0.024041, " tends", false], [13388, 0.023396, " limits", false], [31074, 0.022752, " delays", false], [9044, 0.020737, " becomes", false], [305, 0.02037, " h", false]]]}, "raw_delta": -0.022472898165384947, "tuned_delta": -0.013901106134806699}, {"byte_start": 6794, "byte_end": 6797, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 1143, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "11.04% 11.04% 11.04%", "qwen": "15.04% 15.04% 15.04%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.15805332362651825]], "qwen": [[432, " it", "normal", 0.0819397121667862]]}, "loss": {"rwkv": 11.036241360967004, "qwen": 15.03872193505929}, "topk": {"rwkv": [4601, 2, 0.15805332362651825, [[22590, 0.195645, " the", false], [4601, 0.158053, " it", false], [32229, 0.110917, " them", false], [47539, 0.109523, " things", false], [4835, 0.099885, " us", false], [22248, 0.060683, " our", false], [21700, 0.051691, " for", false], [32234, 0.032858, " this", false], [39936, 0.014263, " these", false], [39931, 0.013189, " their", false]]], "qwen": [432, 4, 0.0819397121667862, [[279, 0.208293, " the", false], [1105, 0.119184, " them", false], [601, 0.115135, " us", false], [432, 0.08194, " it", false], [1039, 0.061006, " our", false], [2513, 0.045762, " things", false], [5530, 0.041568, " sense", false], [369, 0.036062, " for", false], [1493, 0.033041, " these", false], [15235, 0.028617, " AI", false]]]}, "raw_delta": -0.22194465001424157, "tuned_delta": -0.21337285798366332}, {"byte_start": 6797, "byte_end": 6804, "display": {"text": " harder", "kind": "normal"}, "is_word": true, "word_id": 1144, "word_key": " harder", "bytes_hex": "20 68 61 72 64 65 72", "compression": {"rwkv": "1.46% 1.46% 1.46% 1.46% 1.46% 1.46% 1.46%", "qwen": "1.70% 1.70% 1.70% 1.70% 1.70% 1.70% 1.70%"}, "model_tokens": {"rwkv": [[46162, " harder", "normal", 0.5653967261314392]], "qwen": [[15750, " harder", "normal", 0.5171852707862854]]}, "loss": {"rwkv": 1.4591990857205617, "qwen": 1.6986549836390592}, "topk": {"rwkv": [46162, 1, 0.5653967261314392, [[46162, 0.565397, " harder", false], [31458, 0.125876, " more", false], [45819, 0.054833, " easier", false], [31048, 0.044501, " hard", false], [59516, 0.027494, " difficult", false], [62082, 0.024767, " impossible", false], [40216, 0.015173, " worse", false], [31277, 0.013237, " less", false], [56895, 0.01245, " possible", false], [30788, 0.010421, " even", false]]], "qwen": [15750, 1, 0.5171852707862854, [[15750, 0.517185, " harder", false], [803, 0.171217, " more", false], [5000, 0.047931, " difficult", false], [2588, 0.045289, " hard", false], [8661, 0.030418, " easier", false], [11997, 0.028264, " impossible", false], [1753, 0.02736, " much", false], [2686, 0.022846, " less", false], [10960, 0.009127, " worse", false], [1602, 0.008539, " very", false]]]}, "raw_delta": -0.013278254440852566, "tuned_delta": -0.004706462410274318}, {"byte_start": 6804, "byte_end": 6807, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 1145, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "3.10% 3.10% 3.10%", "qwen": "4.58% 4.58% 4.58%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.5958136320114136]], "qwen": [[311, " to", "normal", 0.46676692366600037]]}, "loss": {"rwkv": 3.099540126909882, "qwen": 4.5801072380351435}, "topk": {"rwkv": [4811, 1, 0.5958136320114136, [[4811, 0.595814, " to", false], [21700, 0.310559, " for", false], [21265, 0.029345, " and", false], [45, 0.026034, ",", false], [47, 0.012896, ".", false], [38869, 0.005779, " later", false], [4596, 0.005435, " in", false], [4712, 0.001629, " on", false], [22187, 0.001515, " not", false], [275, 0.000943, " (", false]]], "qwen": [311, 2, 0.46676692366600037, [[369, 0.474168, " for", false], [311, 0.466767, " to", false], [11, 0.020797, ",", false], [323, 0.014098, " and", false], [304, 0.003788, " in", false], [382, 0.002963, ".\n\n", false], [13, 0.00262, ".", false], [2937, 0.002214, " later", false], [320, 0.001455, " (", false], [1091, 0.000865, " than", false]]]}, "raw_delta": -0.08210007349650067, "tuned_delta": -0.07352828146592243}, {"byte_start": 6807, "byte_end": 6811, "display": {"text": " see", "kind": "normal"}, "is_word": true, "word_id": 1146, "word_key": " see", "bytes_hex": "20 73 65 65", "compression": {"rwkv": "20.99% 20.99% 20.99% 20.99%", "qwen": "23.37% 23.37% 23.37% 23.37%"}, "model_tokens": {"rwkv": [[22449, " see", "normal", 0.009379914030432701]], "qwen": [[1490, " see", "normal", 0.005611109547317028]]}, "loss": {"rwkv": 20.99233995043511, "qwen": 23.367181732922425}, "topk": {"rwkv": [22449, 11, 0.009379914030432701, [[30858, 0.344819, " find", false], [56010, 0.330564, " discover", false], [31358, 0.039878, " make", false], [37923, 0.038278, " build", false], [4491, 0.02211, " do", false], [38877, 0.017383, " learn", false], [55851, 0.013285, " continue", false], [21751, 0.012672, " get", false], [31205, 0.011139, " keep", false], [39590, 0.01102, " scale", false]]], "qwen": [1490, 20, 0.005611109547317028, [[6997, 0.197757, " discover", false], [1477, 0.197086, " find", false], [1936, 0.079119, " build", false], [1281, 0.06395, " make", false], [653, 0.033076, " do", false], [5452, 0.029453, " scale", false], [633, 0.026675, " get", false], [7269, 0.024902, " improve", false], [3960, 0.022128, " learn", false], [11075, 0.018933, " achieve", false]]]}, "raw_delta": -0.131689190864563, "tuned_delta": -0.12311739883398475}, {"byte_start": 6811, "byte_end": 6815, "display": {"text": " how", "kind": "normal"}, "is_word": true, "word_id": 1147, "word_key": " how", "bytes_hex": "20 68 6f 77", "compression": {"rwkv": "10.99% 10.99% 10.99% 10.99%", "qwen": "7.47% 7.47% 7.47% 7.47%"}, "model_tokens": {"rwkv": [[21835, " how", "normal", 0.0870790183544159]], "qwen": [[1246, " how", "normal", 0.19070583581924438]]}, "loss": {"rwkv": 10.9892786317714, "qwen": 7.470559278009971}, "topk": {"rwkv": [21835, 4, 0.0870790183544159, [[22590, 0.220887, " the", false], [32464, 0.159291, " what", false], [32229, 0.122784, " them", false], [21835, 0.087079, " how", false], [22168, 0.050593, " new", false], [32227, 0.028315, " that", false], [21265, 0.024995, " and", false], [22248, 0.022659, " our", false], [51816, 0.019781, " further", false], [39936, 0.018033, " these", false]]], "qwen": [1246, 3, 0.19070583581924438, [[1128, 0.219279, " what", false], [279, 0.196197, " the", false], [1246, 0.190706, " how", false], [429, 0.055472, " that", false], [1380, 0.043963, " where", false], [1039, 0.03091, " our", false], [1105, 0.026745, " them", false], [501, 0.020996, " new", false], [323, 0.014204, " and", false], [979, 0.012656, " when", false]]]}, "raw_delta": 0.1951192319393158, "tuned_delta": 0.20369102396989405}, {"byte_start": 6815, "byte_end": 6819, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1148, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "11.27% 11.27% 11.27% 11.27%", "qwen": "10.42% 10.42% 10.42% 10.42%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.08182871341705322]], "qwen": [[279, " the", "normal", 0.0990520566701889]]}, "loss": {"rwkv": 11.271055006945026, "qwen": 10.423967358819077}, "topk": {"rwkv": [22590, 2, 0.08182871341705322, [[4811, 0.492341, " to", false], [22590, 0.081829, " the", false], [32232, 0.076447, " they", false], [4858, 0.075743, " we", false], [22248, 0.049603, " our", false], [31466, 0.032162, " much", false], [39936, 0.016714, " these", false], [3609, 0.011668, " AI", false], [39944, 0.011616, " those", false], [21660, 0.00751, " far", false]]], "qwen": [279, 3, 0.0990520566701889, [[311, 0.27446, " to", false], [582, 0.129452, " we", false], [279, 0.099052, " the", false], [807, 0.088681, " they", false], [1039, 0.063842, " our", false], [1753, 0.028114, " much", false], [1493, 0.026621, " these", false], [15235, 0.02435, " AI", false], [3041, 0.021774, " far", false], [2513, 0.01097, " things", false]]]}, "raw_delta": 0.04697251319885254, "tuned_delta": 0.05554430522943079}, {"byte_start": 6819, "byte_end": 6831, "display": {"text": " discovering", "kind": "normal"}, "is_word": true, "word_id": 1149, "word_key": " discovering", "bytes_hex": "20 64 69 73 63 6f 76 65 72 69 6e 67", "compression": {"rwkv": "11.18% 11.18% 11.18% 11.18% 11.18% 11.18% 11.18% 11.18% 11.18% 11.18% 11.18% 11.18%", "qwen": "11.51% 11.51% 11.51% 11.51% 11.51% 11.51% 11.51% 11.51% 11.51% 11.51% 11.51% 11.51%"}, "model_tokens": {"rwkv": [[63485, " discovering", "normal", 0.0005939074908383191]], "qwen": [[41587, " discovering", "normal", 0.00047218933468684554]]}, "loss": {"rwkv": 11.177129548553818, "qwen": 11.508694901152227}, "topk": {"rwkv": [63485, 113, 0.0005939074908383191, [[37636, 0.196601, " agent", false], [40213, 0.071975, " world", false], [45124, 0.064665, " agents", false], [3609, 0.052615, " AI", false], [52224, 0.049005, " methods", false], [63484, 0.043441, " discoveries", false], [59544, 0.038573, " discovery", false], [31427, 0.034552, " mind", false], [52391, 0.024791, " outside", false], [31835, 0.018326, " real", false]]], "qwen": [41587, 131, 0.00047218933468684554, [[1879, 0.122462, " world", false], [8315, 0.114564, " agent", false], [15235, 0.097821, " AI", false], [13009, 0.080342, " agents", false], [52998, 0.069388, " discoveries", false], [18335, 0.04886, " discovery", false], [5413, 0.035019, " methods", false], [1849, 0.023291, " system", false], [11105, 0.023193, " discovered", false], [1931, 0.017734, " real", false]]]}, "raw_delta": -0.018385887145996094, "tuned_delta": -0.009814095115417846}, {"byte_start": 6831, "byte_end": 6839, "display": {"text": " process", "kind": "normal"}, "is_word": true, "word_id": 1150, "word_key": " process", "bytes_hex": "20 70 72 6f 63 65 73 73", "compression": {"rwkv": "7.01% 7.01% 7.01% 7.01% 7.01% 7.01% 7.01% 7.01%", "qwen": "6.32% 6.32% 6.32% 6.32% 6.32% 6.32% 6.32% 6.32%"}, "model_tokens": {"rwkv": [[52571, " process", "normal", 0.04456682130694389]], "qwen": [[1882, " process", "normal", 0.06064356863498688]]}, "loss": {"rwkv": 7.009187332443938, "qwen": 6.317970785469655}, "topk": {"rwkv": [52571, 4, 0.04456682130694389, [[37636, 0.17422, " agent", false], [4600, 0.127275, " is", false], [21413, 0.088979, " can", false], [52571, 0.044567, " process", false], [22748, 0.034697, " was", false], [51896, 0.031748, " happens", false], [45124, 0.030507, " agents", false], [52224, 0.027709, " methods", false], [40212, 0.026038, " works", false], [38128, 0.024057, " could", false]]], "qwen": [1882, 7, 0.06064356863498688, [[646, 0.159018, " can", false], [1410, 0.095712, " could", false], [8315, 0.08047, " agent", false], [4278, 0.076773, " works", false], [374, 0.075503, " is", false], [1265, 0.065869, " should", false], [1882, 0.060644, " process", false], [3520, 0.036977, " actually", false], [5413, 0.026838, " methods", false], [572, 0.026468, " was", false]]]}, "raw_delta": 0.03832918405532837, "tuned_delta": 0.04690097608590662}, {"byte_start": 6839, "byte_end": 6843, "display": {"text": " can", "kind": "normal"}, "is_word": true, "word_id": 1151, "word_key": " can", "bytes_hex": "20 63 61 6e", "compression": {"rwkv": "8.38% 8.38% 8.38% 8.38%", "qwen": "9.65% 9.65% 9.65% 9.65%"}, "model_tokens": {"rwkv": [[21413, " can", "normal", 0.15695399045944214]], "qwen": [[646, " can", "normal", 0.11752419918775558]]}, "loss": {"rwkv": 8.382847161415363, "qwen": 9.653031478712043}, "topk": {"rwkv": [21413, 2, 0.15695399045944214, [[40212, 0.273946, " works", false], [21413, 0.156954, " can", false], [46342, 0.129513, " itself", false], [38128, 0.071819, " could", false], [39021, 0.063477, " might", false], [4600, 0.050706, " is", false], [47266, 0.02204, " should", false], [22074, 0.016739, " may", false], [55448, 0.014839, " actually", false], [40219, 0.013969, " would", false]]], "qwen": [646, 2, 0.11752419918775558, [[4278, 0.37059, " works", false], [646, 0.117524, " can", false], [5086, 0.064597, " itself", false], [1410, 0.063524, " could", false], [1265, 0.060406, " should", false], [3520, 0.059734, " actually", false], [2578, 0.044, " might", false], [374, 0.037924, " is", false], [2167, 0.033396, " really", false], [1035, 0.018969, " would", false]]]}, "raw_delta": -0.07043397426605225, "tuned_delta": -0.061862182235473996}, {"byte_start": 6843, "byte_end": 6846, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 1152, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"rwkv": "4.72% 4.72% 4.72%", "qwen": "5.28% 5.28% 5.28%"}, "model_tokens": {"rwkv": [[4435, " be", "normal", 0.45496514439582825]], "qwen": [[387, " be", "normal", 0.4152001440525055]]}, "loss": {"rwkv": 4.719754284158229, "qwen": 5.283838389237209}, "topk": {"rwkv": [4435, 1, 0.45496514439582825, [[4435, 0.454965, " be", false], [32499, 0.110847, " work", false], [55851, 0.059037, " continue", false], [52570, 0.054745, " proceed", false], [39590, 0.034829, " scale", false], [4559, 0.034412, " go", false], [46342, 0.020426, " itself", false], [46159, 0.015287, " happen", false], [30858, 0.013899, " find", false], [39166, 0.010863, " occur", false]]], "qwen": [387, 1, 0.4152001440525055, [[387, 0.4152, " be", false], [975, 0.147852, " work", false], [10354, 0.076191, " proceed", false], [3060, 0.061021, " continue", false], [5452, 0.036785, " scale", false], [728, 0.034755, " go", false], [5086, 0.013146, " itself", false], [11996, 0.013124, " succeed", false], [1477, 0.012888, " find", false], [3537, 0.01178, " happen", false]]]}, "raw_delta": -0.03127946456273395, "tuned_delta": -0.0227076725321557}, {"byte_start": 6846, "byte_end": 6851, "display": {"text": " done", "kind": "normal"}, "is_word": true, "word_id": 1153, "word_key": " done", "bytes_hex": "20 64 6f 6e 65", "compression": {"rwkv": "11.83% 11.83% 11.83% 11.83% 11.83%", "qwen": "11.39% 11.39% 11.39% 11.39% 11.39%"}, "model_tokens": {"rwkv": [[30666, " done", "normal", 0.03751043975353241]], "qwen": [[2814, " done", "normal", 0.04250689595937729]]}, "loss": {"rwkv": 11.834607757292277, "qwen": 11.390398067945}, "topk": {"rwkv": [30666, 4, 0.03751043975353241, [[59203, 0.222051, " automated", false], [31351, 0.096987, " made", false], [56418, 0.079672, " improved", false], [30666, 0.03751, " done", false], [63594, 0.037476, " generalized", false], [56189, 0.027683, " extended", false], [38547, 0.027383, " found", false], [55689, 0.023901, " captured", false], [47180, 0.017846, " scaled", false], [61885, 0.017119, " discovered", false]]], "qwen": [2814, 5, 0.04250689595937729, [[27498, 0.193687, " automated", false], [1865, 0.114809, " made", false], [12944, 0.06158, " improved", false], [30690, 0.057649, " scaled", false], [2814, 0.042507, " done", false], [66117, 0.037587, " generalized", false], [11577, 0.030584, " extended", false], [8570, 0.022971, " continued", false], [85610, 0.02253, " sped", false], [11691, 0.020541, " carried", false]]]}, "raw_delta": 0.02463221549987793, "tuned_delta": 0.03320400753045618}, {"byte_start": 6851, "byte_end": 6853, "display": {"text": ".\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e 0a", "compression": {"rwkv": "31.56% 98.06%", "qwen": "45.90% 45.90%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.17631813883781433], [11, "\n", "control", 0.0042694928124547005]], "qwen": [[624, ".\n", "control", 0.006153350230306387]]}, "loss": {"rwkv": 64.80856628993389, "qwen": 45.90257367451315}, "topk": {"rwkv": [47, 1, 0.17631813883781433, [[47, 0.176318, ".", false], [4450, 0.157159, " by", false], [4596, 0.101813, " in", false], [45, 0.079992, ",", false], [45301, 0.074809, " better", false], [31458, 0.039277, " more", false], [64839, 0.029597, " automatically", false], [32458, 0.027295, " well", false], [4424, 0.026983, " at", false], [53356, 0.01883, " without", false]]], "qwen": [624, 20, 0.006153350230306387, [[553, 0.132295, " by", false], [13, 0.127566, ".", false], [304, 0.122575, " in", false], [382, 0.113753, ".\n\n", false], [11, 0.091856, ",", false], [2664, 0.084548, " better", false], [803, 0.043739, " more", false], [9463, 0.017869, " automatically", false], [29720, 0.016849, " efficiently", false], [1632, 0.016194, " well", false]]]}, "raw_delta": 1.0483708381652832, "tuned_delta": 1.0569426301958615}], "meta": {"model_a": "RWKV7-G1D-1.5B", "model_b": "Qwen3-1.7B-Base", "avg_compression": {"rwkv": 9.315505162073826, "qwen": 9.47008618524935}, "avg_delta": -0.008571792030578248, "avg_delta_compression": -0.1545810231755847}}</script>
+    <script id="render-model" type="application/json">{"text": "The Bitter Lesson\nRich Sutton\nMarch 13, 2019\nThe biggest lesson that can be read from 70 years of AI research is that general methods that leverage computation are ultimately the most effective, and by a large margin. The ultimate reason for this is Moore's law, or rather its generalization of continued exponentially falling cost per unit of computation. Most AI research has been conducted as if the computation available to the agent were constant (in which case leveraging human knowledge would be one of the only ways to improve performance) but, over a slightly longer time than a typical research project, massively more computation inevitably becomes available. Seeking an improvement that makes a difference in the shorter term, researchers seek to leverage their human knowledge of the domain, but the only thing that matters in the long run is the leveraging of computation. These two need not run counter to each other, but in practice they tend to. Time spent on one is time not spent on the other. There are psychological commitments to investment in one approach or the other. And the human-knowledge approach tends to complicate methods in ways that make them less suited to taking advantage of general methods leveraging computation.  There were many examples of AI researchers' belated learning of this bitter lesson, and it is instructive to review some of the most prominent.\n\nIn computer chess, the methods that defeated the world champion, Kasparov, in 1997, were based on massive, deep search. At the time, this was looked upon with dismay by the majority of computer-chess researchers who had pursued methods that leveraged human understanding of the special structure of chess. When a simpler, search-based approach with special hardware and software proved vastly more effective, these human-knowledge-based chess researchers were not good losers. They said that ``brute force\" search may have won this time, but it was not a general strategy, and anyway it was not how people played chess. These researchers wanted methods based on human input to win and were disappointed when they did not.\n\nA similar pattern of research progress was seen in computer Go, only delayed by a further 20 years. Enormous initial efforts went into avoiding search by taking advantage of human knowledge, or of the special features of the game, but all those efforts proved irrelevant, or worse, once search was applied effectively at scale. Also important was the use of learning by self play to learn a value function (as it was in many other games and even in chess, although learning did not play a big role in the 1997 program that first beat a world champion). Learning by self play, and learning in general, is like search in that it enables massive computation to be brought to bear. Search and learning are the two most important classes of techniques for utilizing massive amounts of computation in AI research. In computer Go, as in computer chess, researchers' initial effort was directed towards utilizing human understanding (so that less search was needed) and only much later was much greater success had by embracing search and learning.\n\nIn speech recognition, there was an early competition, sponsored by DARPA, in the 1970s. Entrants included a host of special methods that took advantage of human knowledge---knowledge of words, of phonemes, of the human vocal tract, etc. On the other side were newer methods that were more statistical in nature and did much more computation, based on hidden Markov models (HMMs). Again, the statistical methods won out over the human-knowledge-based methods. This led to a major change in all of natural language processing, gradually over decades, where statistics and computation came to dominate the field. The recent rise of deep learning in speech recognition is the most recent step in this consistent direction. Deep learning methods rely even less on human knowledge, and use even more computation, together with learning on huge training sets, to produce dramatically better speech recognition systems. As in the games, researchers always tried to make systems that worked the way the researchers thought their own minds worked---they tried to put that knowledge in their systems---but it proved ultimately counterproductive, and a colossal waste of researcher's time, when, through Moore's law, massive computation became available and a means was found to put it to good use.\n\nIn computer vision, there has been a similar pattern. Early methods conceived of vision as searching for edges, or generalized cylinders, or in terms of SIFT features. But today all this is discarded. Modern deep-learning neural networks use only the notions of convolution and certain kinds of invariances, and perform much better.\n\nThis is a big lesson. As a field, we still have not thoroughly learned it, as we are continuing to make the same kind of mistakes. To see this, and to effectively resist it, we have to understand the appeal of these mistakes. We have to learn the bitter lesson that building in how we think we think does not work in the long run. The bitter lesson is based on the historical observations that 1) AI researchers have often tried to build knowledge into their agents, 2) this always helps in the short term, and is personally satisfying to the researcher, but 3) in the long run it plateaus and even inhibits further progress, and 4) breakthrough progress eventually arrives by an opposing approach based on scaling computation by search and learning. The eventual success is tinged with bitterness, and often incompletely digested, because it is success over a favored, human-centric approach.\n\nOne thing that should be learned from the bitter lesson is the great power of general purpose methods, of methods that continue to scale with increased computation even as the available computation becomes very great. The two methods that seem to scale arbitrarily in this way are search and learning.\n\nThe second general point to be learned from the bitter lesson is that the actual contents of minds are tremendously, irredeemably complex; we should stop trying to find simple ways to think about the contents of minds, such as simple ways to think about space, objects, multiple agents, or symmetries. All these are part of the arbitrary, intrinsically-complex, outside world. They are not what should be built in, as their complexity is endless; instead we should build in only the meta-methods that can find and capture this arbitrary complexity. Essential to these methods is that they can find good approximations, but the search for them should be by our methods, not by us. We want AI agents that can discover like we can, not which contain what we have discovered. Building in our discoveries only makes it harder to see how the discovering process can be done.\n", "tokens": [{"byte_start": 0, "byte_end": 3, "display": {"text": "The", "kind": "normal"}, "is_word": true, "word_id": 0, "word_key": "the", "bytes_hex": "54 68 65", "compression": {"rwkv": "21.88% 21.88% 21.88%", "qwen": "33.67% 33.67% 33.67%"}, "model_tokens": {"rwkv": [[6699, "The", "normal", 0.026203298941254616]], "qwen": [[785, "The", "normal", 0.003693073522299528]]}, "loss": {"rwkv": 21.884631805151592, "qwen": 33.67067739459524}, "topk": {"rwkv": [6699, 7, 0.026203298941254616, [[41775, 0.062368, "length", false], [34579, 0.049356, "https", false], [897, 0.046897, "CC", false], [24281, 0.043908, "User", false], [36, 0.035981, "#", false], [82, 0.03298, "Q", false], [6699, 0.026203, "The", false], [520, 0.020542, "**", false], [25623, 0.019473, "http", false], [1136, 0.018912, "In", false]]], "qwen": [785, 30, 0.003693073522299528, [[262, 0.036306, "   ", false], [286, 0.025112, "       ", false], [198, 0.021214, "\n", false], [310, 0.014187, "           ", false], [220, 0.012878, " ", false], [197, 0.01252, "\t", false], [16, 0.011983, "1", false], [2, 0.009983, "#", false], [256, 0.008925, "  ", false], [17, 0.008681, "2", false]]]}, "raw_delta": -0.6535571416219075, "tuned_delta": -0.6449853495913292}, {"byte_start": 3, "byte_end": 10, "display": {"text": " Bitter", "kind": "normal"}, "is_word": true, "word_id": 1, "word_key": " bitter", "bytes_hex": "20 42 69 74 74 65 72", "compression": {"rwkv": "40.58% 40.58% 40.58% 40.58% 8.97% 8.97% 8.97%", "qwen": "62.88% 62.88% 17.53% 17.53% 17.53% 17.53% 17.53%"}, "model_tokens": {"rwkv": [[19523, " Bit", "normal", 0.00012164174404460937], [8795, "ter", "normal", 0.2274768203496933]], "qwen": [[425, " B", "normal", 0.00093627575552091], [3248, "itter", "normal", 0.007752551697194576]]}, "loss": {"rwkv": 27.030405132727093, "qwen": 30.485520618743337}, "topk": {"rwkv": [19523, 1280, 0.00012164174404460937, [[32355, 0.028185, " user", false], [52569, 0.014494, " problem", false], [331, 0.012293, " `", false], [57009, 0.009806, " question", false], [45242, 0.008977, " author", false], [45010, 0.00747, " United", false], [32224, 0.007319, " text", false], [31894, 0.00697, " role", false], [39840, 0.006303, " study", false], [269, 0.005951, " \"", false]]], "qwen": [425, 134, 0.00093627575552091, [[2701, 0.032689, " following", false], [4226, 0.024054, " answer", false], [1156, 0.015003, " first", false], [4396, 0.011983, " correct", false], [1565, 0.011463, " `", false], [729, 0.010951, " function", false], [1887, 0.009331, " main", false], [2790, 0.008723, " total", false], [1372, 0.008478, " number", false], [3491, 0.00806, " problem", false]]]}, "raw_delta": -0.19159228461129324, "tuned_delta": -0.18302049258071498}, {"byte_start": 10, "byte_end": 17, "display": {"text": " Lesson", "kind": "normal"}, "is_word": true, "word_id": 2, "word_key": " lesson", "bytes_hex": "20 4c 65 73 73 6f 6e", "compression": {"rwkv": "19.61% 19.61% 19.61% 19.61% 19.61% 0.36% 0.36%", "qwen": "16.49% 16.49% 16.49% 16.49% 16.49% 16.49% 16.49%"}, "model_tokens": {"rwkv": [[29273, " Less", "normal", 0.004347627982497215], [2098, "on", "normal", 0.9603351354598999]], "qwen": [[48915, " Lesson", "normal", 0.0016589945880696177]]}, "loss": {"rwkv": 14.11083253799172, "qwen": 16.491920054712242}, "topk": {"rwkv": [29273, 22, 0.004347627982497215, [[37496, 0.206492, " Truth", false], [29584, 0.105174, " Pill", false], [26939, 0.042943, "root", false], [19826, 0.030786, " End", false], [29694, 0.029046, " Root", false], [44502, 0.025203, " Legacy", false], [44014, 0.021993, " Battle", false], [20979, 0.012415, " Tas", false], [46, 0.010383, "-", false], [21265, 0.009432, " and", false]]], "qwen": [48915, 78, 0.0016589945880696177, [[3972, 0.086547, " End", false], [18854, 0.033914, " Root", false], [2090, 0.0327, "ness", false], [2888, 0.032286, "root", false], [29098, 0.030777, " Truth", false], [34136, 0.021435, " Pill", false], [57981, 0.019807, " Taste", false], [323, 0.016665, " and", false], [26589, 0.016409, " Sweet", false], [55835, 0.013012, " Harvest", false]]]}, "raw_delta": -0.13203552791050505, "tuned_delta": -0.1234637358799268}, {"byte_start": 17, "byte_end": 18, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "33.67%", "qwen": "26.29%"}, "model_tokens": {"rwkv": [[11, "\n", "control", 0.1527043581008911]], "qwen": [[198, "\n", "control", 0.2327895313501358]]}, "loss": {"rwkv": 33.67227683324826, "qwen": 26.286273362980776}, "topk": {"rwkv": [11, 2, 0.1527043581008911, [[59, 0.368519, ":", false], [11, 0.152704, "\n", false], [261, 0.110118, "\n\n", false], [4600, 0.03812, " is", false], [4706, 0.029825, " of", false], [4450, 0.028067, " by", false], [275, 0.026209, " (", false], [280, 0.020331, " -", false], [45, 0.020245, ",", false], [3339, 0.012901, "  \n", false]]], "qwen": [198, 2, 0.2327895313501358, [[315, 0.281083, " of", false], [198, 0.23279, "\n", false], [25, 0.055722, ":", false], [271, 0.051887, "\n\n", false], [320, 0.027106, " (", false], [374, 0.02522, " is", false], [304, 0.019353, " in", false], [553, 0.013985, " by", false], [504, 0.013709, " from", false], [11, 0.013458, ",", false]]]}, "raw_delta": 0.4095669984817505, "tuned_delta": 0.4181387905123287}, {"byte_start": 18, "byte_end": 22, "display": {"text": "Rich", "kind": "normal"}, "is_word": true, "word_id": 3, "word_key": "rich", "bytes_hex": "52 69 63 68", "compression": {"rwkv": "42.55% 42.55% 42.55% 42.55%", "qwen": "39.68% 39.68% 39.68% 39.68%"}, "model_tokens": {"rwkv": [[24100, "Rich", "normal", 7.995641499292105e-05]], "qwen": [[27177, "Rich", "normal", 0.00015063985483720899]]}, "loss": {"rwkv": 42.54823265121747, "qwen": 39.67690060330372}, "topk": {"rwkv": [24100, 1367, 7.995641499292105e-05, [[6699, 0.09671, "The", false], [1782, 0.036423, "by", false], [66, 0.034416, "A", false], [1136, 0.030641, "In", false], [894, 0.02219, "By", false], [24242, 0.019256, "This", false], [74, 0.019003, "I", false], [35, 0.016756, "\"", false], [6018, 0.013143, "How", false], [24326, 0.011633, "What", false]]], "qwen": [27177, 744, 0.00015063985483720899, [[785, 0.164658, "The", false], [32, 0.037296, "A", false], [1359, 0.026936, "By", false], [1694, 0.024776, "by", false], [16, 0.017683, "1", false], [641, 0.01757, "In", false], [33, 0.01526, "B", false], [40, 0.012698, "I", false], [4498, 0.009365, "When", false], [25020, 0.00897, "Chapter", false]]]}, "raw_delta": 0.15922045707702637, "tuned_delta": 0.16779224910760462}, {"byte_start": 22, "byte_end": 29, "display": {"text": " Sutton", "kind": "normal"}, "is_word": true, "word_id": 4, "word_key": " sutton", "bytes_hex": "20 53 75 74 74 6f 6e", "compression": {"rwkv": "21.09% 21.09% 21.09% 21.09% 21.09% 21.09% 21.09%", "qwen": "23.54% 23.54% 23.54% 23.54% 23.54% 23.54% 23.54%"}, "model_tokens": {"rwkv": [[44940, " Sutton", "normal", 0.00026984905707649887]], "qwen": [[73013, " Sutton", "normal", 0.00010748509521363303]]}, "loss": {"rwkv": 21.09297437013998, "qwen": 23.54210068043684}, "topk": {"rwkv": [44940, 420, 0.00026984905707649887, [[46787, 0.056964, " people", false], [19712, 0.050819, " Dad", false], [21265, 0.048479, " and", false], [26269, 0.037071, "mond", false], [1941, 0.036013, "ie", false], [1858, 0.026592, "es", false], [8795, 0.025062, "ter", false], [4600, 0.023162, " is", false], [45, 0.02242, ",", false], [50202, 0.018359, " Epstein", false]]], "qwen": [73013, 761, 0.00010748509521363303, [[6712, 0.07193, "elle", false], [323, 0.065119, " and", false], [645, 0.064316, "ie", false], [12388, 0.06407, "mond", false], [288, 0.034253, "es", false], [32521, 0.028727, " Dad", false], [304, 0.027695, " in", false], [11, 0.024138, ",", false], [1933, 0.020337, "land", false], [2347, 0.01703, "ards", false]]]}, "raw_delta": -0.13580839974539605, "tuned_delta": -0.1272366077148178}, {"byte_start": 29, "byte_end": 30, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "36.91%", "qwen": "18.95%"}, "model_tokens": {"rwkv": [[11, "\n", "control", 0.12926216423511505]], "qwen": [[198, "\n", "control", 0.349587619304657]]}, "loss": {"rwkv": 36.91270514774496, "qwen": 18.95342543052871}, "topk": {"rwkv": [11, 3, 0.12926216423511505, [[45, 0.205069, ",", false], [21265, 0.136185, " and", false], [11, 0.129262, "\n", false], [4600, 0.094519, " is", false], [460, 0.059615, "'s", false], [28309, 0.032636, "’s", false], [21800, 0.029014, " has", false], [59, 0.020669, ":", false], [4712, 0.016245, " on", false], [275, 0.015072, " (", false]]], "qwen": [198, 1, 0.349587619304657, [[198, 0.349588, "\n", false], [11, 0.156176, ",", false], [323, 0.072967, " and", false], [594, 0.045174, "'s", false], [271, 0.036277, "\n\n", false], [320, 0.024252, " (", false], [374, 0.018142, " is", false], [748, 0.015414, "’s", false], [25, 0.013219, ":", false], [702, 0.013153, " has", false]]]}, "raw_delta": 0.9958739280700684, "tuned_delta": 1.0044457201006467}, {"byte_start": 30, "byte_end": 35, "display": {"text": "March", "kind": "normal"}, "is_word": true, "word_id": 5, "word_key": "march", "bytes_hex": "4d 61 72 63 68", "compression": {"rwkv": "21.19% 21.19% 21.19% 21.19% 21.19%", "qwen": "30.01% 30.01% 30.01% 30.01% 30.01%"}, "model_tokens": {"rwkv": [[33258, "March", "normal", 0.002797103952616453]], "qwen": [[27523, "March", "normal", 0.00024377863155677915]]}, "loss": {"rwkv": 21.18958341305665, "qwen": 30.005352182529908}, "topk": {"rwkv": [33258, 55, 0.002797103952616453, [[6699, 0.059922, "The", false], [640, 0.033635, "20", false], [66, 0.028625, "A", false], [58068, 0.027932, "Publisher", false], [1136, 0.02649, "In", false], [125, 0.018289, "|", false], [24242, 0.016773, "This", false], [41, 0.014946, "(", false], [37, 0.012467, "$", false], [58067, 0.011857, "Published", false]]], "qwen": [27523, 510, 0.00024377863155677915, [[785, 0.081713, "The", false], [16, 0.039271, "1", false], [32, 0.029568, "A", false], [1986, 0.018435, "This", false], [25020, 0.017801, "Chapter", false], [17, 0.015555, "2", false], [33, 0.014165, "B", false], [15, 0.011578, "0", false], [50, 0.010767, "S", false], [2082, 0.009907, "An", false]]]}, "raw_delta": -0.4888500213623046, "tuned_delta": -0.48027822933172637}, {"byte_start": 35, "byte_end": 38, "display": {"text": " 13", "kind": "normal"}, "is_word": true, "word_id": 6, "word_key": " 13", "bytes_hex": "20 31 33", "compression": {"rwkv": "23.29% 23.29% 23.29%", "qwen": "0.97% 20.04% 48.62%"}, "model_tokens": {"rwkv": [[3486, " 13", "normal", 0.020677877590060234]], "qwen": [[220, " ", "normal", 0.947685718536377], [16, "1", "normal", 0.32922863960266113], [18, "3", "normal", 0.0674586296081543]]}, "loss": {"rwkv": 23.29351368101972, "qwen": 23.209212465823803}, "topk": {"rwkv": [3486, 14, 0.020677877590060234, [[3493, 0.283004, " 20", false], [3492, 0.054418, " 19", false], [284, 0.033968, " 1", false], [3502, 0.025711, " 29", false], [3501, 0.025462, " 28", false], [3504, 0.023139, " 31", false], [3503, 0.022768, " 30", false], [290, 0.022622, " 7", false], [3487, 0.022213, " 14", false], [3485, 0.021901, " 12", false]]], "qwen": [220, 1, 0.947685718536377, [[220, 0.947686, " ", false], [11, 0.008321, ",", false], [315, 0.005407, " of", false], [287, 0.003772, "ing", false], [198, 0.003389, "\n", false], [374, 0.001193, " is", false], [4102, 0.001136, " ", false], [68, 0.000797, "e", false], [64, 0.000787, "a", false], [278, 0.000753, "al", false]]]}, "raw_delta": 0.004674651970466052, "tuned_delta": 0.0132464440010443}, {"byte_start": 38, "byte_end": 39, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "2.04%", "qwen": "1.07%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8922017812728882]], "qwen": [[11, ",", "normal", 0.9425589442253113]]}, "loss": {"rwkv": 2.042878720008786, "qwen": 1.0668151685550242}, "topk": {"rwkv": [45, 1, 0.8922017812728882, [[45, 0.892202, ",", false], [2209, 0.07081, "th", false], [3493, 0.014269, " 20", false], [11, 0.007555, "\n", false], [261, 0.002672, "\n\n", false], [46, 0.001494, "-", false], [9815, 0.001411, "–", false], [47, 0.001032, ".", false], [280, 0.000825, " -", false], [22897, 0.000727, " –", false]]], "qwen": [11, 1, 0.9425589442253113, [[11, 0.942559, ",", false], [339, 0.020566, "th", false], [220, 0.012831, " ", false], [198, 0.006914, "\n", false], [12, 0.00258, "-", false], [481, 0.002276, " -", false], [345, 0.001089, ",\n", false], [271, 0.001017, "\n\n", false], [13, 0.000906, ".", false], [15, 0.000865, "0", false]]]}, "raw_delta": 0.05412445589900017, "tuned_delta": 0.06269624792957841}, {"byte_start": 39, "byte_end": 42, "display": {"text": " 20", "kind": "normal"}, "is_word": true, "word_id": 7, "word_key": " 20", "bytes_hex": "20 32 30", "compression": {"rwkv": "0.32% 0.32% 0.32%", "qwen": "0.09% 1.65% 0.01%"}, "model_tokens": {"rwkv": [[3493, " 20", "normal", 0.9474717378616333]], "qwen": [[220, " ", "normal", 0.9952646493911743], [17, "2", "normal", 0.9127693772315979], [15, "0", "normal", 0.9992802739143372]]}, "loss": {"rwkv": 0.32433634850714205, "qwen": 0.5815180772308782}, "topk": {"rwkv": [3493, 1, 0.9474717378616333, [[3493, 0.947472, " 20", false], [3492, 0.048254, " 19", false], [11, 0.00068, "\n", false], [3491, 0.000552, " 18", false], [640, 0.000524, "20", false], [3490, 0.000169, " 17", false], [285, 8.2e-05, " 2", false], [284, 7.4e-05, " 1", false], [3485, 7.4e-05, " 12", false], [2430, 7e-05, " ", false]]], "qwen": [220, 1, 0.9952646493911743, [[220, 0.995265, " ", false], [17, 0.001133, "2", false], [4102, 0.000583, " ", false], [16, 0.000191, "1", false], [198, 7.9e-05, "\n", false], [715, 7e-05, " \n", false], [279, 5.3e-05, " the", false], [378, 5.2e-05, "\\xe2\\x80", true], [15585, 4.5e-05, " Chapter", false], [576, 3.2e-05, " The", false]]]}, "raw_delta": -0.014261183212511236, "tuned_delta": -0.005689391181932988}, {"byte_start": 42, "byte_end": 44, "display": {"text": "19", "kind": "normal"}, "is_word": true, "word_id": 8, "word_key": "19", "bytes_hex": "31 39", "compression": {"rwkv": "26.63% 26.63%", "qwen": "10.29% 37.86%"}, "model_tokens": {"rwkv": [[639, "19", "normal", 0.052171628922224045]], "qwen": [[16, "1", "normal", 0.5653393268585205], [24, "9", "normal", 0.12255670875310898]]}, "loss": {"rwkv": 26.627867453907623, "qwen": 24.070560140541627}, "topk": {"rwkv": [639, 8, 0.052171628922224045, [[636, 0.073967, "16", false], [637, 0.067844, "17", false], [638, 0.067624, "18", false], [635, 0.065077, "15", false], [634, 0.060304, "14", false], [633, 0.059129, "13", false], [640, 0.053509, "20", false], [639, 0.052172, "19", false], [632, 0.042047, "12", false], [641, 0.04079, "21", false]]], "qwen": [16, 1, 0.5653393268585205, [[16, 0.565339, "1", false], [15, 0.273209, "0", false], [17, 0.160743, "2", false], [18, 0.000155, "3", false], [19, 7.8e-05, "4", false], [20, 7.4e-05, "5", false], [24, 5.4e-05, "9", false], [220, 5e-05, " ", false], [21, 5e-05, "6", false], [198, 4.7e-05, "\n", false]]]}, "raw_delta": 0.14180722832679749, "tuned_delta": 0.15037902035737574}, {"byte_start": 44, "byte_end": 45, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "9.72%", "qwen": "5.68%"}, "model_tokens": {"rwkv": [[11, "\n", "control", 0.5851910710334778]], "qwen": [[198, "\n", "control", 0.7300056219100952]]}, "loss": {"rwkv": 9.721284943490085, "qwen": 5.675256033267606}, "topk": {"rwkv": [11, 1, 0.5851910710334778, [[11, 0.585191, "\n", false], [261, 0.248785, "\n\n", false], [45, 0.017942, ",", false], [280, 0.011406, " -", false], [4932, 0.010541, " ·", false], [359, 0.010516, " |", false], [22907, 0.00919, " •", false], [275, 0.005888, " (", false], [4424, 0.005582, " at", false], [3328, 0.003885, "\n\n\n", false]]], "qwen": [198, 1, 0.7300056219100952, [[198, 0.730006, "\n", false], [271, 0.076219, "\n\n", false], [220, 0.029873, " ", false], [11, 0.020279, ",", false], [481, 0.015444, " -", false], [760, 0.012802, " |", false], [7288, 0.010354, " •", false], [151643, 0.009148, "\u003c|endoftext|\u003e", false], [9592, 0.007784, " ·", false], [553, 0.007227, " by", false]]]}, "raw_delta": 0.22435948252677917, "tuned_delta": 0.23293127455735743}, {"byte_start": 45, "byte_end": 48, "display": {"text": "The", "kind": "normal"}, "is_word": true, "word_id": 9, "word_key": "the", "bytes_hex": "54 68 65", "compression": {"rwkv": "15.12% 15.12% 15.12%", "qwen": "15.35% 15.35% 15.35%"}, "model_tokens": {"rwkv": [[6699, "The", "normal", 0.08107690513134003]], "qwen": [[785, "The", "normal", 0.07778266817331314]]}, "loss": {"rwkv": 15.121998800984576, "qwen": 15.351697396288186}, "topk": {"rwkv": [6699, 1, 0.08107690513134003, [[6699, 0.081077, "The", false], [74, 0.04096, "I", false], [1136, 0.03956, "In", false], [24242, 0.029413, "This", false], [66, 0.024711, "A", false], [1141, 0.014467, "It", false], [35, 0.014443, "\"", false], [1589, 0.012034, "We", false], [24326, 0.011705, "What", false], [48743, 0.011603, "Summary", false]]], "qwen": [785, 1, 0.07778266817331314, [[785, 0.077783, "The", false], [16, 0.045669, "1", false], [1986, 0.029479, "This", false], [641, 0.02658, "In", false], [17, 0.021241, "2", false], [15949, 0.019793, "Abstract", false], [32, 0.017704, "A", false], [37155, 0.013513, "Introduction", false], [18, 0.013196, "3", false], [25020, 0.011838, "Chapter", false]]]}, "raw_delta": -0.012737194697062248, "tuned_delta": -0.004165402666484}, {"byte_start": 48, "byte_end": 56, "display": {"text": " biggest", "kind": "normal"}, "is_word": true, "word_id": 10, "word_key": " biggest", "bytes_hex": "20 62 69 67 67 65 73 74", "compression": {"rwkv": "15.08% 15.08% 15.08% 15.08% 15.08% 15.08% 15.08% 15.08%", "qwen": "17.46% 17.46% 17.46% 17.46% 17.46% 17.46% 17.46% 17.46%"}, "model_tokens": {"rwkv": [[51039, " biggest", "normal", 0.0012460439465939999]], "qwen": [[8538, " biggest", "normal", 0.00043262317194603384]]}, "loss": {"rwkv": 15.075036071788972, "qwen": 17.460315051400524}, "topk": {"rwkv": [51039, 78, 0.0012460439465939999, [[19523, 0.219893, " Bit", false], [30314, 0.013021, " book", false], [31461, 0.012643, " most", false], [59725, 0.012402, " following", false], [45315, 0.011792, " bitter", false], [46430, 0.011685, " lesson", false], [39966, 0.011423, " title", false], [21365, 0.010079, " bit", false], [39831, 0.009246, " story", false], [52569, 0.008596, " problem", false]]], "qwen": [8538, 212, 0.00043262317194603384, [[425, 0.396047, " B", false], [2701, 0.017174, " following", false], [1156, 0.01285, " first", false], [5795, 0.009658, " goal", false], [3491, 0.009548, " problem", false], [2311, 0.009273, " book", false], [17755, 0.005431, " lesson", false], [22079, 0.00476, " Problem", false], [220, 0.004692, " ", false], [1429, 0.004305, " most", false]]]}, "raw_delta": -0.13226795196533203, "tuned_delta": -0.12369615993475379}, {"byte_start": 56, "byte_end": 63, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 11, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"rwkv": "4.73% 4.73% 4.73% 4.73% 4.73% 4.73% 4.73%", "qwen": "4.68% 4.68% 4.68% 4.68% 4.68% 4.68% 4.68%"}, "model_tokens": {"rwkv": [[46430, " lesson", "normal", 0.15862658619880676]], "qwen": [[17755, " lesson", "normal", 0.16280625760555267]]}, "loss": {"rwkv": 4.729817726128715, "qwen": 4.676378416939369}, "topk": {"rwkv": [46430, 1, 0.15862658619880676, [[46430, 0.158627, " lesson", false], [52569, 0.092084, " problem", false], [59281, 0.053773, " challenge", false], [52245, 0.042922, " mistake", false], [47009, 0.029373, " reason", false], [56739, 0.023609, " obstacle", false], [39941, 0.01927, " thing", false], [31887, 0.018967, " risk", false], [47546, 0.011069, " threat", false], [52127, 0.010451, " lessons", false]]], "qwen": [17755, 1, 0.16280625760555267, [[17755, 0.162806, " lesson", false], [3491, 0.111456, " problem", false], [8645, 0.099703, " challenge", false], [16523, 0.061177, " mistake", false], [88374, 0.031043, " takeaway", false], [3166, 0.025807, " thing", false], [6672, 0.023547, " difference", false], [4265, 0.012921, " issue", false], [12761, 0.011748, " surprise", false], [323, 0.009962, " and", false]]]}, "raw_delta": 0.0029633045196533203, "tuned_delta": 0.011535096550231569}, {"byte_start": 63, "byte_end": 68, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 12, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "9.58% 9.58% 9.58% 9.58% 9.58%", "qwen": "9.58% 9.58% 9.58% 9.58% 9.58%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.07134293019771576]], "qwen": [[429, " that", "normal", 0.0701269581913948]]}, "loss": {"rwkv": 9.580396755903271, "qwen": 9.584716960092944}, "topk": {"rwkv": [32227, 3, 0.07134293019771576, [[308, 0.386223, " I", false], [4706, 0.107096, " of", false], [32227, 0.071343, " that", false], [4858, 0.06312, " we", false], [30917, 0.056591, " from", false], [4596, 0.049923, " in", false], [4811, 0.044091, " to", false], [22799, 0.033403, " you", false], [21700, 0.017966, " for", false], [4600, 0.013859, " is", false]]], "qwen": [429, 5, 0.0701269581913948, [[358, 0.284519, " I", false], [315, 0.126414, " of", false], [304, 0.088273, " in", false], [582, 0.079642, " we", false], [429, 0.070127, " that", false], [504, 0.051129, " from", false], [374, 0.033558, " is", false], [498, 0.0333, " you", false], [311, 0.024325, " to", false], [9498, 0.018782, " learned", false]]]}, "raw_delta": -0.0002395629882812056, "tuned_delta": 0.008332229042297043}, {"byte_start": 68, "byte_end": 72, "display": {"text": " can", "kind": "normal"}, "is_word": true, "word_id": 13, "word_key": " can", "bytes_hex": "20 63 61 6e", "compression": {"rwkv": "15.92% 15.92% 15.92% 15.92%", "qwen": "15.66% 15.66% 15.66% 15.66%"}, "model_tokens": {"rwkv": [[21413, " can", "normal", 0.029297227039933205]], "qwen": [[646, " can", "normal", 0.031018095090985298]]}, "loss": {"rwkv": 15.920365197309849, "qwen": 15.658581805299024}, "topk": {"rwkv": [21413, 7, 0.029297227039933205, [[308, 0.297925, " I", false], [52167, 0.06851, " machine", false], [3609, 0.05162, " AI", false], [22590, 0.036706, " the", false], [4858, 0.034413, " we", false], [61594, 0.029794, " artificial", false], [21413, 0.029297, " can", false], [332, 0.017781, " a", false], [22799, 0.017455, " you", false], [30597, 0.015215, " deep", false]]], "qwen": [646, 4, 0.031018095090985298, [[358, 0.439486, " I", false], [582, 0.078553, " we", false], [498, 0.037389, " you", false], [646, 0.031018, " can", false], [264, 0.028214, " a", false], [279, 0.026695, " the", false], [5662, 0.014207, " machine", false], [12677, 0.013768, " humans", false], [46069, 0.012944, " Rein", false], [4041, 0.011765, " comes", false]]]}, "raw_delta": 0.014516353607177734, "tuned_delta": 0.023088145637755984}, {"byte_start": 72, "byte_end": 75, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 14, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"rwkv": "0.73% 0.73% 0.73%", "qwen": "0.73% 0.73% 0.73%"}, "model_tokens": {"rwkv": [[4435, " be", "normal", 0.8857272863388062]], "qwen": [[387, " be", "normal", 0.8855698108673096]]}, "loss": {"rwkv": 0.7308574731065915, "qwen": 0.7305084468570671}, "topk": {"rwkv": [4435, 1, 0.8857272863388062, [[4435, 0.885727, " be", false], [30482, 0.03963, " come", false], [31073, 0.010376, " help", false], [39903, 0.009478, " teach", false], [30789, 0.00811, " ever", false], [56896, 0.006009, " possibly", false], [28310, 0.002412, "’t", false], [461, 0.002379, "'t", false], [45846, 0.00181, " emerge", false], [31946, 0.001196, " save", false]]], "qwen": [387, 1, 0.8855698108673096, [[387, 0.88557, " be", false], [2525, 0.048234, " come", false], [1492, 0.009508, " help", false], [3512, 0.005803, " ever", false], [4538, 0.003257, " teach", false], [10767, 0.002551, " possibly", false], [2297, 0.002033, " change", false], [32944, 0.001749, " emerge", false], [1281, 0.001438, " make", false], [944, 0.001403, "'t", false]]]}, "raw_delta": 1.9354124863944777e-05, "tuned_delta": 0.008591146155442193}, {"byte_start": 75, "byte_end": 80, "display": {"text": " read", "kind": "normal"}, "is_word": true, "word_id": 15, "word_key": " read", "bytes_hex": "20 72 65 61 64", "compression": {"rwkv": "26.15% 26.15% 26.15% 26.15% 26.15%", "qwen": "32.52% 32.52% 32.52% 32.52% 32.52%"}, "model_tokens": {"rwkv": [[31834, " read", "normal", 0.0006952342810109258]], "qwen": [[1349, " read", "normal", 0.00012139618047513068]]}, "loss": {"rwkv": 26.14884761611246, "qwen": 32.519972434549345}, "topk": {"rwkv": [31834, 15, 0.0006952342810109258, [[52112, 0.718141, " learned", false], [38297, 0.112894, " drawn", false], [39887, 0.04311, " taken", false], [47512, 0.02621, " taught", false], [46418, 0.022067, " learnt", false], [21762, 0.018003, " gle", false], [51438, 0.01264, " derived", false], [59697, 0.010629, " extracted", false], [46071, 0.005063, " gained", false], [50937, 0.001483, " applied", false]]], "qwen": [1349, 49, 0.00012139618047513068, [[9498, 0.829011, " learned", false], [49250, 0.066563, " learnt", false], [14764, 0.019995, " drawn", false], [15599, 0.019093, " taught", false], [4429, 0.013984, " taken", false], [14257, 0.008978, " derived", false], [18163, 0.006738, " gained", false], [94016, 0.005617, " glean", false], [27432, 0.004285, " extracted", false], [9251, 0.001362, " applied", false]]]}, "raw_delta": -0.35329017639160165, "tuned_delta": -0.3447183843610234}, {"byte_start": 80, "byte_end": 85, "display": {"text": " from", "kind": "normal"}, "is_word": true, "word_id": 16, "word_key": " from", "bytes_hex": "20 66 72 6f 6d", "compression": {"rwkv": "2.56% 2.56% 2.56% 2.56% 2.56%", "qwen": "1.74% 1.74% 1.74% 1.74% 1.74%"}, "model_tokens": {"rwkv": [[30917, " from", "normal", 0.491812527179718]], "qwen": [[504, " from", "normal", 0.6165587902069092]]}, "loss": {"rwkv": 2.564165014079993, "qwen": 1.7442240749686408}, "topk": {"rwkv": [30917, 1, 0.491812527179718, [[30917, 0.491813, " from", false], [31162, 0.325114, " into", false], [51035, 0.05571, " between", false], [4596, 0.047439, " in", false], [22249, 0.03067, " out", false], [22218, 0.006695, " off", false], [4450, 0.005362, " by", false], [4811, 0.003151, " to", false], [4712, 0.002252, " on", false], [11, 0.001954, "\n", false]]], "qwen": [504, 1, 0.6165587902069092, [[504, 0.616559, " from", false], [304, 0.120954, " in", false], [1119, 0.042574, " into", false], [700, 0.032714, " out", false], [911, 0.024167, " about", false], [1588, 0.015949, " here", false], [374, 0.013519, " is", false], [1007, 0.01317, " off", false], [389, 0.011411, " on", false], [1948, 0.010526, " between", false]]]}, "raw_delta": 0.04546718001365661, "tuned_delta": 0.05403897204423486}, {"byte_start": 85, "byte_end": 88, "display": {"text": " 70", "kind": "normal"}, "is_word": true, "word_id": 17, "word_key": " 70", "bytes_hex": "20 37 30", "compression": {"rwkv": "63.12% 63.12% 63.12%", "qwen": "94.00% 66.29% 22.98%"}, "model_tokens": {"rwkv": [[3543, " 70", "normal", 2.7540681912796572e-05]], "qwen": [[220, " ", "normal", 0.005448168609291315], [22, "7", "normal", 0.025329088792204857], [15, "0", "normal", 0.2796103358268738]]}, "loss": {"rwkv": 63.11790803889214, "qwen": 61.08993448195813}, "topk": {"rwkv": [3543, 1343, 2.7540681912796572e-05, [[22590, 0.397948, " the", false], [32234, 0.092111, " this", false], [332, 0.029461, " a", false], [44940, 0.016768, " Sutton", false], [28753, 0.015545, " Deep", false], [51929, 0.015387, " history", false], [3609, 0.014973, " AI", false], [4677, 0.014567, " my", false], [52167, 0.011005, " machine", false], [21256, 0.009521, " all", false]]], "qwen": [220, 15, 0.005448168609291315, [[279, 0.268288, " the", false], [419, 0.195308, " this", false], [73013, 0.057031, " Sutton", false], [1493, 0.041197, " these", false], [678, 0.032129, " all", false], [576, 0.020956, " The", false], [264, 0.020694, " a", false], [894, 0.015734, " any", false], [847, 0.015447, " my", false], [1039, 0.013623, " our", false]]]}, "raw_delta": 0.11245473225911458, "tuned_delta": 0.12102652428969282}, {"byte_start": 88, "byte_end": 94, "display": {"text": " years", "kind": "normal"}, "is_word": true, "word_id": 18, "word_key": " years", "bytes_hex": "20 79 65 61 72 73", "compression": {"rwkv": "0.94% 0.94% 0.94% 0.94% 0.94% 0.94%", "qwen": "2.10% 2.10% 2.10% 2.10% 2.10% 2.10%"}, "model_tokens": {"rwkv": [[40237, " years", "normal", 0.7334799766540527]], "qwen": [[1635, " years", "normal", 0.49800431728363037]]}, "loss": {"rwkv": 0.9392545839120855, "qwen": 2.0953538514617325}, "topk": {"rwkv": [40237, 1, 0.7334799766540527, [[40237, 0.73348, " years", false], [49, 0.083016, "0", false], [44, 0.033759, "+", false], [45, 0.019636, ",", false], [46, 0.019306, "-", false], [620, 0.016608, "00", false], [38, 0.015833, "%", false], [52232, 0.007649, " million", false], [116, 0.004217, "s", false], [51041, 0.004031, " billion", false]]], "qwen": [1635, 1, 0.49800431728363037, [[1635, 0.498004, " years", false], [15, 0.166918, "0", false], [11, 0.063044, ",", false], [10, 0.057261, "+", false], [82, 0.035846, "s", false], [4, 0.020973, "%", false], [594, 0.014383, "'s", false], [748, 0.011282, "’s", false], [3526, 0.011117, " million", false], [4666, 0.00788, "-year", false]]]}, "raw_delta": -0.06410775581995644, "tuned_delta": -0.05553596378937819}, {"byte_start": 94, "byte_end": 97, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 19, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.25% 0.25% 0.25%", "qwen": "0.21% 0.21% 0.21%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9601571559906006]], "qwen": [[315, " of", "normal", 0.9662426114082336]]}, "loss": {"rwkv": 0.2450867429895598, "qwen": 0.20642770791094583}, "topk": {"rwkv": [4706, 1, 0.9601571559906006, [[4706, 0.960157, " of", false], [4596, 0.009767, " in", false], [40218, 0.005726, " worth", false], [9820, 0.003616, "’", false], [40, 0.00344, "'", false], [4715, 0.002236, " or", false], [21240, 0.00155, " ago", false], [21265, 0.001358, " and", false], [11, 0.001258, "\n", false], [32487, 0.00109, " with", false]]], "qwen": [315, 1, 0.9662426114082336, [[315, 0.966243, " of", false], [304, 0.005526, " in", false], [5802, 0.004527, " worth", false], [198, 0.002633, "\n", false], [4134, 0.002496, " ago", false], [527, 0.00184, "’", false], [323, 0.001746, " and", false], [6, 0.001554, "'", false], [320, 0.001478, " (", false], [374, 0.000932, " is", false]]]}, "raw_delta": 0.002143712093432743, "tuned_delta": 0.010715504124010991}, {"byte_start": 97, "byte_end": 100, "display": {"text": " AI", "kind": "normal"}, "is_word": true, "word_id": 20, "word_key": " ai", "bytes_hex": "20 41 49", "compression": {"rwkv": "9.16% 9.16% 9.16%", "qwen": "18.81% 18.81% 18.81%"}, "model_tokens": {"rwkv": [[3609, " AI", "normal", 0.21808527410030365]], "qwen": [[15235, " AI", "normal", 0.04373104125261307]]}, "loss": {"rwkv": 9.157732193142833, "qwen": 18.813326929947113}, "topk": {"rwkv": [3609, 1, 0.21808527410030365, [[3609, 0.218085, " AI", false], [61594, 0.101622, " artificial", false], [52167, 0.064662, " machine", false], [51929, 0.050904, " history", false], [59346, 0.042182, " computing", false], [55809, 0.034715, " computer", false], [57103, 0.033097, " research", false], [22590, 0.023331, " the", false], [56950, 0.017641, " progress", false], [61290, 0.015472, " Artificial", false]]], "qwen": [15235, 3, 0.04373104125261307, [[3412, 0.184863, " research", false], [71278, 0.146839, " reinforcement", false], [15235, 0.043731, " AI", false], [5662, 0.039956, " machine", false], [3139, 0.035446, " experience", false], [975, 0.034034, " work", false], [6366, 0.015723, " computer", false], [3738, 0.015547, " human", false], [279, 0.013831, " the", false], [20443, 0.012459, " artificial", false]]]}, "raw_delta": -0.5354198614756267, "tuned_delta": -0.5268480694450485}, {"byte_start": 100, "byte_end": 109, "display": {"text": " research", "kind": "normal"}, "is_word": true, "word_id": 21, "word_key": " research", "bytes_hex": "20 72 65 73 65 61 72 63 68", "compression": {"rwkv": "1.38% 1.38% 1.38% 1.38% 1.38% 1.38% 1.38% 1.38% 1.38%", "qwen": "0.93% 0.93% 0.93% 0.93% 0.93% 0.93% 0.93% 0.93% 0.93%"}, "model_tokens": {"rwkv": [[57103, " research", "normal", 0.5041630268096924]], "qwen": [[3412, " research", "normal", 0.6299545168876648]]}, "loss": {"rwkv": 1.3775733897377254, "qwen": 0.925945037653647}, "topk": {"rwkv": [57103, 1, 0.5041630268096924, [[57103, 0.504163, " research", false], [4600, 0.147673, " is", false], [63469, 0.086549, " development", false], [56950, 0.071011, " progress", false], [51929, 0.057797, " history", false], [32499, 0.012227, " work", false], [21265, 0.006548, " and", false], [45, 0.006184, ",", false], [59, 0.005794, ":", false], [62183, 0.00323, " literature", false]]], "qwen": [3412, 1, 0.6299545168876648, [[3412, 0.629955, " research", false], [374, 0.16431, " is", false], [3840, 0.03876, " history", false], [3139, 0.016074, " experience", false], [323, 0.013818, " and", false], [4401, 0.013259, " development", false], [198, 0.012023, "\n", false], [5098, 0.008429, " progress", false], [11, 0.00837, ",", false], [975, 0.006823, " work", false]]]}, "raw_delta": 0.025043593512641068, "tuned_delta": 0.033615385543219314}, {"byte_start": 109, "byte_end": 112, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 22, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "1.34% 1.34% 1.34%", "qwen": "1.30% 1.30% 1.30%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.800688624382019]], "qwen": [[374, " is", "normal", 0.8059275150299072]]}, "loss": {"rwkv": 1.3384377820747217, "qwen": 1.2969914859798395}, "topk": {"rwkv": [4600, 1, 0.800688624382019, [[4600, 0.800689, " is", false], [45, 0.045093, ",", false], [59, 0.029849, ":", false], [21265, 0.016647, " and", false], [11, 0.007777, "\n", false], [275, 0.007463, " (", false], [4596, 0.007396, " in", false], [64, 0.004961, "?", false], [47, 0.004035, ".", false], [32227, 0.003329, " that", false]]], "qwen": [374, 1, 0.8059275150299072, [[374, 0.805928, " is", false], [323, 0.036311, " and", false], [11, 0.033098, ",", false], [198, 0.017596, "\n", false], [304, 0.013902, " in", false], [25, 0.01129, ":", false], [320, 0.008696, " (", false], [389, 0.0061, " on", false], [13, 0.003515, ".", false], [429, 0.002065, " that", false]]]}, "raw_delta": 0.002298270662625626, "tuned_delta": 0.010870062693203874}, {"byte_start": 112, "byte_end": 117, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 23, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "1.85% 1.85% 1.85% 1.85% 1.85%", "qwen": "2.50% 2.50% 2.50% 2.50% 2.50%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.5976323485374451]], "qwen": [[429, " that", "normal", 0.500173807144165]]}, "loss": {"rwkv": 1.8456352573872479, "qwen": 2.4987466833014254}, "topk": {"rwkv": [32227, 1, 0.5976323485374451, [[32227, 0.597632, " that", false], [32234, 0.139602, " this", false], [22187, 0.042725, " not", false], [59, 0.036704, ":", false], [22590, 0.035134, " the", false], [332, 0.011383, " a", false], [4811, 0.009509, " to", false], [21835, 0.008283, " how", false], [45, 0.007729, ",", false], [269, 0.006636, " \"", false]]], "qwen": [429, 1, 0.500173807144165, [[429, 0.500174, " that", false], [279, 0.096222, " the", false], [419, 0.095586, " this", false], [25, 0.052095, ":", false], [537, 0.02853, " not", false], [1246, 0.021607, " how", false], [311, 0.019934, " to", false], [825, 0.013768, " one", false], [11, 0.011314, ",", false], [4658, 0.010545, " probably", false]]]}, "raw_delta": -0.03621618747711182, "tuned_delta": -0.02764439544653357}, {"byte_start": 117, "byte_end": 125, "display": {"text": " general", "kind": "normal"}, "is_word": true, "word_id": 24, "word_key": " general", "bytes_hex": "20 67 65 6e 65 72 61 6c", "compression": {"rwkv": "14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09%", "qwen": "13.08% 13.08% 13.08% 13.08% 13.08% 13.08% 13.08% 13.08%"}, "model_tokens": {"rwkv": [[51832, " general", "normal", 0.0019046157831326127]], "qwen": [[4586, " general", "normal", 0.0030250304844230413]]}, "loss": {"rwkv": 14.088818758681281, "qwen": 13.076304223365101}, "topk": {"rwkv": [51832, 69, 0.0019046157831326127, [[22590, 0.104384, " the", false], [4601, 0.10392, " it", false], [4858, 0.056042, " we", false], [3609, 0.054266, " AI", false], [39934, 0.032553, " there", false], [45, 0.027136, ",", false], [22799, 0.021851, " you", false], [56950, 0.021794, " progress", false], [269, 0.018809, " \"", false], [4588, 0.018808, " if", false]]], "qwen": [4586, 48, 0.0030250304844230413, [[279, 0.099251, " the", false], [432, 0.067776, " it", false], [1052, 0.061612, " there", false], [582, 0.054925, " we", false], [498, 0.053064, " you", false], [264, 0.028246, " a", false], [12677, 0.0213, " humans", false], [6832, 0.019795, " learning", false], [421, 0.018688, " if", false], [902, 0.017065, " no", false]]]}, "raw_delta": 0.05614572763442993, "tuned_delta": 0.06471751966500817}, {"byte_start": 125, "byte_end": 133, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 25, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "11.55% 11.55% 11.55% 11.55% 11.55% 11.55% 11.55% 11.55%", "qwen": "9.43% 9.43% 9.43% 9.43% 9.43% 9.43% 9.43% 9.43%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.0059340461157262325]], "qwen": [[5413, " methods", "normal", 0.015259837731719017]]}, "loss": {"rwkv": 11.55283138211865, "qwen": 9.42830712328745}, "topk": {"rwkv": [52224, 13, 0.0059340461157262325, [[64452, 0.322388, " intelligence", false], [3609, 0.237909, " AI", false], [46, 0.129946, "-", false], [61594, 0.064977, " artificial", false], [52610, 0.041545, " purpose", false], [45, 0.022353, ",", false], [7919, 0.019636, "ist", false], [7933, 0.012819, "ity", false], [63659, 0.010023, " intelligent", false], [52167, 0.009209, " machine", false]]], "qwen": [5413, 11, 0.015259837731719017, [[2022, 0.265766, "ization", false], [11229, 0.17726, " intelligence", false], [58238, 0.089942, "-purpose", false], [3491, 0.04714, " problem", false], [15235, 0.046259, " AI", false], [4849, 0.044556, "izing", false], [7428, 0.026199, " purpose", false], [6832, 0.025554, " learning", false], [7923, 0.019115, "isation", false], [6540, 0.018468, " knowledge", false]]]}, "raw_delta": 0.11780864000320435, "tuned_delta": 0.1263804320337826}, {"byte_start": 133, "byte_end": 138, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 26, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "10.99% 10.99% 10.99% 10.99% 10.99%", "qwen": "10.81% 10.81% 10.81% 10.81% 10.81%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.04722457751631737]], "qwen": [[429, " that", "normal", 0.049904197454452515]]}, "loss": {"rwkv": 10.9892786317714, "qwen": 10.811737501632706}, "topk": {"rwkv": [32227, 4, 0.04722457751631737, [[21286, 0.158583, " are", false], [21700, 0.137361, " for", false], [4706, 0.104041, " of", false], [32227, 0.047225, " that", false], [21265, 0.044263, " and", false], [21413, 0.039054, " can", false], [21556, 0.03469, " don", false], [32475, 0.034499, " will", false], [45, 0.029011, ",", false], [4491, 0.0267, " do", false]]], "qwen": [429, 4, 0.049904197454452515, [[525, 0.289964, " are", false], [369, 0.190641, " for", false], [315, 0.055679, " of", false], [429, 0.049904, " that", false], [653, 0.046371, " do", false], [323, 0.030326, " and", false], [11, 0.025965, ",", false], [311, 0.023332, " to", false], [1513, 0.022734, " don", false], [614, 0.017888, " have", false]]]}, "raw_delta": 0.009844970703124956, "tuned_delta": 0.018416762733703206}, {"byte_start": 138, "byte_end": 147, "display": {"text": " leverage", "kind": "normal"}, "is_word": true, "word_id": 27, "word_key": " leverage", "bytes_hex": "20 6c 65 76 65 72 61 67 65", "compression": {"rwkv": "14.46% 14.46% 14.46% 14.46% 14.46% 14.46% 14.46% 14.46% 14.46%", "qwen": "14.46% 14.46% 14.46% 14.46% 14.46% 14.46% 14.46% 14.46% 14.46%"}, "model_tokens": {"rwkv": [[56540, " leverage", "normal", 0.0007237948011606932]], "qwen": [[32064, " leverage", "normal", 0.0007328909123316407]]}, "loss": {"rwkv": 14.464520592246116, "qwen": 14.464046684497074}, "topk": {"rwkv": [56540, 96, 0.0007237948011606932, [[32499, 0.409284, " work", false], [21286, 0.063323, " are", false], [31967, 0.047712, " seem", false], [31059, 0.02765, " have", false], [31324, 0.027242, " look", false], [21413, 0.023612, " can", false], [45185, 0.01999, " appear", false], [32462, 0.013896, " were", false], [39740, 0.01338, " solve", false], [53051, 0.013376, " succeed", false]]], "qwen": [32064, 95, 0.0007328909123316407, [[975, 0.316427, " work", false], [646, 0.150735, " can", false], [525, 0.097766, " are", false], [3796, 0.039363, " apply", false], [614, 0.021262, " have", false], [11625, 0.01701, " solve", false], [5452, 0.016156, " scale", false], [653, 0.015514, " do", false], [686, 0.013696, " will", false], [2138, 0.012736, " allow", false]]]}, "raw_delta": 2.6279025607700568e-05, "tuned_delta": 0.008598071056185949}, {"byte_start": 147, "byte_end": 159, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 28, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "8.97% 8.97% 8.97% 8.97% 8.97% 8.97% 8.97% 8.97% 8.97% 8.97% 8.97% 8.97%", "qwen": "11.05% 11.05% 11.05% 11.05% 11.05% 11.05% 11.05% 11.05% 11.05% 11.05% 11.05% 11.05%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.002536177635192871]], "qwen": [[34447, " computation", "normal", 0.0006424598395824432]]}, "loss": {"rwkv": 8.969881276360415, "qwen": 11.04594404885318}, "topk": {"rwkv": [63370, 65, 0.002536177635192871, [[22590, 0.130945, " the", false], [30597, 0.045286, " deep", false], [63885, 0.044737, " statistical", false], [332, 0.031537, " a", false], [30579, 0.027136, " data", false], [52167, 0.023547, " machine", false], [38864, 0.02346, " large", false], [52195, 0.022602, " massive", false], [55465, 0.019176, " advances", false], [38720, 0.019159, " human", false]]], "qwen": [34447, 201, 0.0006424598395824432, [[279, 0.123796, " the", false], [3738, 0.062438, " human", false], [264, 0.041242, " a", false], [821, 0.029322, " data", false], [4867, 0.02503, " prior", false], [7947, 0.023999, " domain", false], [28464, 0.021281, " statistical", false], [3460, 0.021071, " large", false], [6540, 0.018823, " knowledge", false], [3139, 0.015167, " experience", false]]]}, "raw_delta": -0.11512136459350587, "tuned_delta": -0.10654957256292763}, {"byte_start": 159, "byte_end": 163, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 29, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"rwkv": "9.09% 9.09% 9.09% 9.09%", "qwen": "5.74% 5.74% 5.74% 5.74%"}, "model_tokens": {"rwkv": [[21286, " are", "normal", 0.13226008415222168]], "qwen": [[525, " are", "normal", 0.2796705365180969]]}, "loss": {"rwkv": 9.087288099349427, "qwen": 5.744374248312017}, "topk": {"rwkv": [21286, 3, 0.13226008415222168, [[4811, 0.149732, " to", false], [21265, 0.141678, " and", false], [21286, 0.13226, " are", false], [32475, 0.041961, " will", false], [45, 0.040492, ",", false], [4596, 0.035777, " in", false], [21413, 0.034579, " can", false], [39339, 0.033575, " power", false], [31059, 0.03172, " have", false], [4491, 0.016033, " do", false]]], "qwen": [525, 1, 0.2796705365180969, [[525, 0.279671, " are", false], [323, 0.119331, " and", false], [311, 0.113936, " to", false], [2355, 0.060554, " power", false], [11, 0.03411, ",", false], [614, 0.030285, " have", false], [653, 0.027643, " do", false], [646, 0.026449, " can", false], [304, 0.024634, " in", false], [369, 0.016129, " for", false]]]}, "raw_delta": 0.18537050485610962, "tuned_delta": 0.19394229688668788}, {"byte_start": 163, "byte_end": 174, "display": {"text": " ultimately", "kind": "normal"}, "is_word": true, "word_id": 30, "word_key": " ultimately", "bytes_hex": "20 75 6c 74 69 6d 61 74 65 6c 79", "compression": {"rwkv": "9.38% 9.38% 9.38% 9.38% 9.38% 9.38% 9.38% 9.38% 9.38% 9.38% 9.38%", "qwen": "11.04% 11.04% 11.04% 11.04% 11.04% 11.04% 11.04% 11.04% 11.04% 11.04% 11.04%"}, "model_tokens": {"rwkv": [[62676, " ultimately", "normal", 0.0032697974238544703]], "qwen": [[13653, " ultimately", "normal", 0.0011913263006135821]]}, "loss": {"rwkv": 9.375468483049724, "qwen": 11.037744906263184}, "topk": {"rwkv": [62676, 53, 0.0032697974238544703, [[22590, 0.120008, " the", false], [22187, 0.062472, " not", false], [31458, 0.057449, " more", false], [46439, 0.040575, " likely", false], [31466, 0.038421, " much", false], [21660, 0.037073, " far", false], [332, 0.028238, " a", false], [38606, 0.027552, " going", false], [45145, 0.020359, " almost", false], [45301, 0.020349, " better", false]]], "qwen": [13653, 98, 0.0011913263006135821, [[537, 0.088327, " not", false], [803, 0.087442, " more", false], [279, 0.065257, " the", false], [1753, 0.050196, " much", false], [3041, 0.048153, " far", false], [2664, 0.031781, " better", false], [7565, 0.028479, " essential", false], [16353, 0.026478, " superior", false], [3545, 0.024984, " often", false], [1602, 0.021899, " very", false]]]}, "raw_delta": -0.09217617728493432, "tuned_delta": -0.08360438525435608}, {"byte_start": 174, "byte_end": 178, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 31, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "9.79% 9.79% 9.79% 9.79%", "qwen": "14.63% 14.63% 14.63% 14.63%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.11399377882480621]], "qwen": [[279, " the", "normal", 0.03898989409208298]]}, "loss": {"rwkv": 9.79172903728349, "qwen": 14.627363081809944}, "topk": {"rwkv": [22590, 2, 0.11399377882480621, [[31458, 0.160758, " more", false], [22590, 0.113994, " the", false], [45301, 0.055493, " better", false], [38606, 0.047442, " going", false], [45781, 0.043193, " doomed", false], [31466, 0.035475, " much", false], [31277, 0.033992, " less", false], [52140, 0.033616, " limited", false], [22187, 0.029268, " not", false], [57350, 0.027639, " superior", false]]], "qwen": [279, 7, 0.03898989409208298, [[803, 0.130619, " more", false], [7199, 0.071714, " limited", false], [16353, 0.06177, " superior", false], [2664, 0.047314, " better", false], [57637, 0.042213, " doomed", false], [537, 0.039317, " not", false], [279, 0.03899, " the", false], [1753, 0.037011, " much", false], [2686, 0.036432, " less", false], [37179, 0.020377, " inferior", false]]]}, "raw_delta": -0.26814448833465576, "tuned_delta": -0.25957269630407753}, {"byte_start": 178, "byte_end": 183, "display": {"text": " most", "kind": "normal"}, "is_word": true, "word_id": 32, "word_key": " most", "bytes_hex": "20 6d 6f 73 74", "compression": {"rwkv": "3.63% 3.63% 3.63% 3.63% 3.63%", "qwen": "4.69% 4.69% 4.69% 4.69% 4.69%"}, "model_tokens": {"rwkv": [[31461, " most", "normal", 0.35932987928390503]], "qwen": [[1429, " most", "normal", 0.272220253944397]]}, "loss": {"rwkv": 3.634915239739771, "qwen": 4.692884144744052}, "topk": {"rwkv": [31461, 1, 0.35932987928390503, [[31461, 0.35933, " most", false], [30273, 0.174263, " best", false], [31581, 0.123636, " only", false], [22752, 0.088107, " way", false], [21952, 0.051324, " key", false], [31580, 0.019204, " ones", false], [31637, 0.015273, " path", false], [39523, 0.011476, " right", false], [38879, 0.007943, " least", false], [51900, 0.006363, " hardest", false]]], "qwen": [1429, 1, 0.272220253944397, [[1429, 0.27222, " most", false], [1172, 0.173044, " only", false], [1850, 0.172389, " best", false], [1376, 0.117854, " key", false], [1616, 0.056885, " way", false], [6894, 0.021108, " keys", false], [6174, 0.015336, " ones", false], [1815, 0.009391, " path", false], [25648, 0.007474, " fastest", false], [2530, 0.006102, " source", false]]]}, "raw_delta": -0.05866625308990479, "tuned_delta": -0.05009446105932654}, {"byte_start": 183, "byte_end": 193, "display": {"text": " effective", "kind": "normal"}, "is_word": true, "word_id": 33, "word_key": " effective", "bytes_hex": "20 65 66 66 65 63 74 69 76 65", "compression": {"rwkv": "3.49% 3.49% 3.49% 3.49% 3.49% 3.49% 3.49% 3.49% 3.49% 3.49%", "qwen": "2.96% 2.96% 2.96% 2.96% 2.96% 2.96% 2.96% 2.96% 2.96% 2.96%"}, "model_tokens": {"rwkv": [[59593, " effective", "normal", 0.14336887001991272]], "qwen": [[7373, " effective", "normal", 0.19383913278579712]]}, "loss": {"rwkv": 3.4940270521529584, "qwen": 2.9588353158245524}, "topk": {"rwkv": [59593, 2, 0.14336887001991272, [[56900, 0.390074, " powerful", false], [59593, 0.143369, " effective", false], [60274, 0.102955, " promising", false], [59829, 0.102474, " important", false], [47687, 0.047406, " useful", false], [62603, 0.030807, " successful", false], [59594, 0.020389, " efficient", false], [56290, 0.020055, " fruitful", false], [47129, 0.013589, " robust", false], [57516, 0.012725, " valuable", false]]], "qwen": [7373, 2, 0.19383913278579712, [[7988, 0.240876, " powerful", false], [7373, 0.193839, " effective", false], [6849, 0.174028, " successful", false], [2989, 0.117221, " important", false], [5390, 0.059075, " useful", false], [15172, 0.055521, " valuable", false], [25383, 0.031705, " promising", false], [11050, 0.013268, " efficient", false], [88584, 0.011966, " fruitful", false], [21765, 0.011342, " robust", false]]]}, "raw_delta": 0.02967733144760132, "tuned_delta": 0.03824912347817957}, {"byte_start": 193, "byte_end": 194, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "48.18%", "qwen": "51.54%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.06937381625175476]], "qwen": [[11, ",", "normal", 0.057391125708818436]]}, "loss": {"rwkv": 48.183760154689985, "qwen": 51.53785610270818}, "topk": {"rwkv": [45, 3, 0.06937381625175476, [[47, 0.354282, ".", false], [22752, 0.212705, " way", false], [45, 0.069374, ",", false], [21700, 0.042457, " for", false], [21265, 0.039353, " and", false], [55532, 0.036333, " approach", false], [4424, 0.027216, " at", false], [31580, 0.024867, " ones", false], [32448, 0.020431, " ways", false], [39979, 0.015784, " tools", false]]], "qwen": [11, 5, 0.057391125708818436, [[13, 0.32337, ".", false], [1616, 0.101312, " way", false], [624, 0.098027, ".\n", false], [6174, 0.05969, " ones", false], [11, 0.057391, ",", false], [369, 0.041388, " for", false], [323, 0.03413, " and", false], [5413, 0.033294, " methods", false], [5486, 0.026549, " approach", false], [19827, 0.023389, " approaches", false]]]}, "raw_delta": -0.185990571975708, "tuned_delta": -0.17741877994512975}, {"byte_start": 194, "byte_end": 198, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 34, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "5.42% 5.42% 5.42% 5.42%", "qwen": "4.75% 4.75% 4.75% 4.75%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.3004497289657593]], "qwen": [[323, " and", "normal", 0.3485313057899475]]}, "loss": {"rwkv": 5.424195222092293, "qwen": 4.751999956303438}, "topk": {"rwkv": [21265, 1, 0.3004497289657593, [[21265, 0.30045, " and", false], [21400, 0.151419, " but", false], [40187, 0.091621, " while", false], [30788, 0.060656, " even", false], [22187, 0.02638, " not", false], [53339, 0.017655, " whereas", false], [51018, 0.015803, " because", false], [61953, 0.015454, " especially", false], [4423, 0.015271, " as", false], [51450, 0.012333, " despite", false]]], "qwen": [323, 1, 0.3485313057899475, [[323, 0.348531, " and", false], [714, 0.111823, " but", false], [1393, 0.062869, " while", false], [1496, 0.038513, " even", false], [537, 0.027169, " not", false], [1576, 0.026478, " because", false], [15484, 0.023397, " regardless", false], [518, 0.020713, " at", false], [438, 0.019853, " as", false], [5310, 0.019235, " especially", false]]]}, "raw_delta": 0.03727442026138306, "tuned_delta": 0.04584621229196131}, {"byte_start": 198, "byte_end": 201, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 35, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "38.32% 38.32% 38.32%", "qwen": "40.06% 40.06% 40.06%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.001680772635154426]], "qwen": [[553, " by", "normal", 0.0012753555784001946]]}, "loss": {"rwkv": 38.321587023613084, "qwen": 40.06201992019205}, "topk": {"rwkv": [4450, 55, 0.001680772635154426, [[32227, 0.390343, " that", false], [22590, 0.074397, " the", false], [32232, 0.029054, " they", false], [4858, 0.019176, " we", false], [4601, 0.014805, " it", false], [4788, 0.01335, " so", false], [4596, 0.010892, " in", false], [32239, 0.010173, " thus", false], [31461, 0.009507, " most", false], [32234, 0.009465, " this", false]]], "qwen": [553, 73, 0.0012753555784001946, [[429, 0.410987, " that", false], [279, 0.063035, " the", false], [4586, 0.027629, " general", false], [419, 0.023899, " this", false], [304, 0.018764, " in", false], [807, 0.014569, " they", false], [5413, 0.0122, " methods", false], [525, 0.009973, " are", false], [264, 0.009383, " a", false], [1846, 0.008567, " those", false]]]}, "raw_delta": -0.09651009241739894, "tuned_delta": -0.0879383003868207}, {"byte_start": 201, "byte_end": 203, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 36, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "17.82% 17.82%", "qwen": "34.47% 34.47%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.13725578784942627]], "qwen": [[264, " a", "normal", 0.021862488240003586]]}, "loss": {"rwkv": 17.82235572973182, "qwen": 34.47124158587966}, "topk": {"rwkv": [332, 2, 0.13725578784942627, [[21660, 0.43749, " far", false], [332, 0.137256, " a", false], [59695, 0.057826, " extension", false], [22590, 0.019556, " the", false], [63617, 0.019521, " implication", false], [22190, 0.019466, " now", false], [21265, 0.014707, " and", false], [55856, 0.013896, " contrast", false], [38888, 0.011271, " lever", false], [32234, 0.010589, " this", false]]], "qwen": [264, 10, 0.021862488240003586, [[3041, 0.264678, " far", false], [8894, 0.082611, " extension", false], [429, 0.061582, " that", false], [4586, 0.046859, " general", false], [76482, 0.036838, " leveraging", false], [419, 0.034214, " this", false], [44378, 0.027155, " inference", false], [12872, 0.023993, " contrast", false], [323, 0.022239, " and", false], [264, 0.021862, " a", false]]]}, "raw_delta": -0.9232102632522583, "tuned_delta": -0.9146384712216801}, {"byte_start": 203, "byte_end": 209, "display": {"text": " large", "kind": "normal"}, "is_word": true, "word_id": 37, "word_key": " large", "bytes_hex": "20 6c 61 72 67 65", "compression": {"rwkv": "5.10% 5.10% 5.10% 5.10% 5.10% 5.10%", "qwen": "5.14% 5.14% 5.14% 5.14% 5.14% 5.14%"}, "model_tokens": {"rwkv": [[38864, " large", "normal", 0.18366272747516632]], "qwen": [[3460, " large", "normal", 0.18076620995998383]]}, "loss": {"rwkv": 5.095456117723063, "qwen": 5.141256172539397}, "topk": {"rwkv": [38864, 2, 0.18366272747516632, [[32470, 0.397292, " wide", false], [38864, 0.183663, " large", false], [31323, 0.096898, " long", false], [31118, 0.093839, " huge", false], [32386, 0.053658, " very", false], [22031, 0.027433, " lot", false], [63870, 0.019972, " significant", false], [64313, 0.013458, " considerable", false], [21357, 0.012689, " big", false], [63893, 0.009749, " substantial", false]]], "qwen": [3460, 2, 0.18076620995998383, [[6884, 0.310814, " wide", false], [3460, 0.180766, " large", false], [1293, 0.126867, " long", false], [1602, 0.068904, " very", false], [6765, 0.045274, " huge", false], [8168, 0.035746, " factor", false], [5089, 0.029993, " significant", false], [11924, 0.013267, " substantial", false], [4745, 0.012768, " margin", false], [23839, 0.012653, " considerable", false]]]}, "raw_delta": -0.002539694309234619, "tuned_delta": 0.006032097721343629}, {"byte_start": 209, "byte_end": 216, "display": {"text": " margin", "kind": "normal"}, "is_word": true, "word_id": 38, "word_key": " margin", "bytes_hex": "20 6d 61 72 67 69 6e", "compression": {"rwkv": "0.21% 0.21% 0.21% 0.21% 0.21% 0.21% 0.21%", "qwen": "0.44% 0.44% 0.44% 0.44% 0.44% 0.44% 0.44%"}, "model_tokens": {"rwkv": [[46513, " margin", "normal", 0.9230954051017761]], "qwen": [[4745, " margin", "normal", 0.8445775508880615]]}, "loss": {"rwkv": 0.20630056039497588, "qwen": 0.43517526410812457}, "topk": {"rwkv": [46513, 1, 0.9230954051017761, [[46513, 0.923095, " margin", false], [45950, 0.014245, " factor", false], [45157, 0.014148, " amount", false], [39189, 0.013748, " order", false], [45690, 0.005961, " degree", false], [56024, 0.005351, " distance", false], [61863, 0.002691, " difference", false], [21732, 0.002382, " gap", false], [45865, 0.001953, " enough", false], [52208, 0.001923, " measure", false]]], "qwen": [4745, 1, 0.8445775508880615, [[4745, 0.844578, " margin", false], [8168, 0.082189, " factor", false], [8381, 0.016987, " degree", false], [3311, 0.01442, " amount", false], [12818, 0.003955, " extent", false], [14501, 0.003616, " stretch", false], [6629, 0.002516, " measure", false], [2990, 0.00228, " lead", false], [198, 0.001796, "\n", false], [323, 0.001686, " and", false]]]}, "raw_delta": -0.012691508446420944, "tuned_delta": -0.004119716415842696}, {"byte_start": 216, "byte_end": 217, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "2.25%", "qwen": "8.42%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.8820807337760925]], "qwen": [[13, ".", "normal", 0.6270043849945068]]}, "loss": {"rwkv": 2.254211001389005, "qwen": 8.418156274529066}, "topk": {"rwkv": [47, 1, 0.8820807337760925, [[47, 0.882081, ".", false], [45, 0.056219, ",", false], [59, 0.012809, ":", false], [275, 0.005843, " (", false], [60, 0.005022, ";", false], [11, 0.004298, "\n", false], [31601, 0.002773, " over", false], [9816, 0.002703, "—", false], [22590, 0.002614, " the", false], [34, 0.002302, "!", false]]], "qwen": [13, 1, 0.6270043849945068, [[13, 0.627004, ".", false], [624, 0.202733, ".\n", false], [11, 0.082328, ",", false], [320, 0.014542, " (", false], [382, 0.012179, ".\n\n", false], [198, 0.007495, "\n", false], [916, 0.006018, " over", false], [279, 0.004519, " the", false], [25, 0.003771, ":", false], [304, 0.002041, " in", false]]]}, "raw_delta": -0.3418017029762268, "tuned_delta": -0.3332299109456486}, {"byte_start": 217, "byte_end": 221, "display": {"text": " The", "kind": "normal"}, "is_word": true, "word_id": 39, "word_key": " the", "bytes_hex": "20 54 68 65", "compression": {"rwkv": "11.55% 11.55% 11.55% 11.55%", "qwen": "10.77% 10.77% 10.77% 10.77%"}, "model_tokens": {"rwkv": [[20996, " The", "normal", 0.07694127410650253]], "qwen": [[576, " The", "normal", 0.09180492162704468]]}, "loss": {"rwkv": 11.55283138211865, "qwen": 10.766514878566642}, "topk": {"rwkv": [20996, 2, 0.07694127410650253, [[11, 0.224108, "\n", false], [20996, 0.076941, " The", false], [29894, 0.071442, " This", false], [261, 0.058636, "\n\n", false], [3913, 0.035882, " In", false], [19555, 0.028653, " But", false], [3918, 0.021731, " It", false], [29889, 0.020379, " That", false], [37451, 0.016261, " There", false], [4331, 0.015068, " We", false]]], "qwen": [576, 2, 0.09180492162704468, [[1096, 0.102863, " This", false], [576, 0.091805, " The", false], [758, 0.053598, " In", false], [1084, 0.031458, " It", false], [358, 0.028216, " I", false], [2619, 0.027395, " There", false], [1205, 0.024915, " We", false], [1988, 0.020156, " But", false], [2938, 0.018816, " That", false], [1752, 0.018054, " For", false]]]}, "raw_delta": 0.04360264539718628, "tuned_delta": 0.05217443742776453}, {"byte_start": 221, "byte_end": 230, "display": {"text": " ultimate", "kind": "normal"}, "is_word": true, "word_id": 40, "word_key": " ultimate", "bytes_hex": "20 75 6c 74 69 6d 61 74 65", "compression": {"rwkv": "14.21% 14.21% 14.21% 14.21% 14.21% 14.21% 14.21% 14.21% 14.21%", "qwen": "12.07% 12.07% 12.07% 12.07% 12.07% 12.07% 12.07% 12.07% 12.07%"}, "model_tokens": {"rwkv": [[57481, " ultimate", "normal", 0.0008178133866749704]], "qwen": [[16724, " ultimate", "normal", 0.0024230415001511574]]}, "loss": {"rwkv": 14.214052703202896, "qwen": 12.068007323696538}, "topk": {"rwkv": [57481, 205, 0.0008178133866749704, [[31461, 0.033933, " most", false], [39193, 0.033696, " other", false], [47205, 0.030411, " second", false], [3609, 0.018932, " AI", false], [31581, 0.017685, " only", false], [46430, 0.017439, " lesson", false], [30273, 0.015236, " best", false], [47009, 0.01198, " reason", false], [38499, 0.011897, " first", false], [51929, 0.010594, " history", false]]], "qwen": [16724, 62, 0.0024230415001511574, [[1429, 0.049734, " most", false], [1850, 0.027735, " best", false], [17755, 0.025101, " lesson", false], [2874, 0.023272, " reason", false], [2070, 0.020655, " field", false], [2086, 0.019784, " second", false], [8538, 0.014146, " biggest", false], [1008, 0.013724, " other", false], [18366, 0.012607, " lessons", false], [1172, 0.012375, " only", false]]]}, "raw_delta": 0.11900202433268224, "tuned_delta": 0.12757381636326048}, {"byte_start": 230, "byte_end": 237, "display": {"text": " reason", "kind": "normal"}, "is_word": true, "word_id": 41, "word_key": " reason", "bytes_hex": "20 72 65 61 73 6f 6e", "compression": {"rwkv": "10.30% 10.30% 10.30% 10.30% 10.30% 10.30% 10.30%", "qwen": "10.78% 10.78% 10.78% 10.78% 10.78% 10.78% 10.78%"}, "model_tokens": {"rwkv": [[47009, " reason", "normal", 0.018070142716169357]], "qwen": [[2874, " reason", "normal", 0.015219236724078655]]}, "loss": {"rwkv": 10.304964577778307, "qwen": 10.782071477116876}, "topk": {"rwkv": [47009, 6, 0.018070142716169357, [[46430, 0.213371, " lesson", false], [30985, 0.0703, " goal", false], [32223, 0.023901, " test", false], [53052, 0.021456, " success", false], [39365, 0.021441, " proof", false], [47009, 0.01807, " reason", false], [51668, 0.017161, " example", false], [57009, 0.014925, " question", false], [3609, 0.014616, " AI", false], [22269, 0.012595, " pay", false]]], "qwen": [2874, 8, 0.015219236724078655, [[5795, 0.197554, " goal", false], [17755, 0.12357, " lesson", false], [4586, 0.046748, " general", false], [2393, 0.02311, " success", false], [9213, 0.020597, " aim", false], [3110, 0.016128, " example", false], [11064, 0.015232, " proof", false], [2874, 0.015219, " reason", false], [1273, 0.013686, " test", false], [1714, 0.013036, " method", false]]]}, "raw_delta": -0.02645642416817806, "tuned_delta": -0.01788463213759981}, {"byte_start": 237, "byte_end": 241, "display": {"text": " for", "kind": "normal"}, "is_word": true, "word_id": 42, "word_key": " for", "bytes_hex": "20 66 6f 72", "compression": {"rwkv": "6.09% 6.09% 6.09% 6.09%", "qwen": "3.90% 3.90% 3.90% 3.90%"}, "model_tokens": {"rwkv": [[21700, " for", "normal", 0.2587900459766388]], "qwen": [[369, " for", "normal", 0.4208017885684967]]}, "loss": {"rwkv": 6.093414113129654, "qwen": 3.902460211788234}, "topk": {"rwkv": [21700, 2, 0.2587900459766388, [[32227, 0.277901, " that", false], [21700, 0.25879, " for", false], [22763, 0.09179, " why", false], [4600, 0.074122, " is", false], [4858, 0.051622, " we", false], [4811, 0.046548, " to", false], [3609, 0.032191, " AI", false], [32234, 0.023367, " this", false], [22590, 0.019209, " the", false], [45290, 0.008831, " behind", false]]], "qwen": [369, 1, 0.4208017885684967, [[369, 0.420802, " for", false], [374, 0.30178, " is", false], [429, 0.070091, " that", false], [3170, 0.062996, " why", false], [4815, 0.032831, " behind", false], [419, 0.018419, " this", false], [582, 0.010519, " we", false], [11, 0.010184, ",", false], [1660, 0.004257, " being", false], [30, 0.004198, "?", false]]]}, "raw_delta": 0.12149228155612946, "tuned_delta": 0.1300640735867077}, {"byte_start": 241, "byte_end": 246, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 43, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "2.80% 2.80% 2.80% 2.80% 2.80%", "qwen": "0.38% 0.38% 0.38% 0.38% 0.38%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.4604005217552185]], "qwen": [[419, " this", "normal", 0.8994473218917847]]}, "loss": {"rwkv": 2.8036749329775748, "qwen": 0.3822233529835437}, "topk": {"rwkv": [32234, 1, 0.4604005217552185, [[32234, 0.460401, " this", false], [22590, 0.238819, " the", false], [32227, 0.073167, " that", false], [3609, 0.033307, " AI", false], [53052, 0.016651, " success", false], [22248, 0.010162, " our", false], [21256, 0.007483, " all", false], [56950, 0.006149, " progress", false], [4677, 0.004905, " my", false], [39936, 0.00456, " these", false]]], "qwen": [419, 1, 0.8994473218917847, [[419, 0.899447, " this", false], [429, 0.043323, " that", false], [279, 0.018447, " the", false], [3170, 0.004849, " why", false], [4586, 0.002428, " general", false], [1039, 0.00165, " our", false], [2393, 0.001436, " success", false], [862, 0.000959, " their", false], [678, 0.000934, " all", false], [1667, 0.000867, " using", false]]]}, "raw_delta": 0.134273786842823, "tuned_delta": 0.14284557887340127}, {"byte_start": 246, "byte_end": 249, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 44, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "1.70% 1.70% 1.70%", "qwen": "1.48% 1.48% 1.48%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.75510174036026]], "qwen": [[374, " is", "normal", 0.7817800045013428]]}, "loss": {"rwkv": 1.702398933340655, "qwen": 1.4798559807788028}, "topk": {"rwkv": [4600, 1, 0.75510174036026, [[4600, 0.755102, " is", false], [45, 0.028254, ",", false], [53052, 0.021732, " success", false], [46430, 0.012572, " lesson", false], [31291, 0.011227, " lies", false], [21800, 0.011028, " has", false], [22748, 0.008541, " was", false], [47092, 0.007684, " result", false], [30808, 0.006521, " fact", false], [21413, 0.006098, " can", false]]], "qwen": [374, 1, 0.7817800045013428, [[374, 0.78178, " is", false], [11, 0.022543, ",", false], [15448, 0.01882, " lies", false], [16688, 0.012301, " conclusion", false], [646, 0.009791, " can", false], [702, 0.009129, " has", false], [4977, 0.009058, " seems", false], [21930, 0.008822, " observation", false], [17755, 0.00673, " lesson", false], [1102, 0.006493, " result", false]]]}, "raw_delta": 0.012340401609738677, "tuned_delta": 0.020912193640316927}, {"byte_start": 249, "byte_end": 255, "display": {"text": " Moore", "kind": "normal"}, "is_word": true, "word_id": 45, "word_key": " moore", "bytes_hex": "20 4d 6f 6f 72 65", "compression": {"rwkv": "20.66% 20.66% 20.66% 20.66% 20.66% 20.66%", "qwen": "21.22% 21.22% 21.22% 21.22% 21.22% 21.22%"}, "model_tokens": {"rwkv": [[37045, " Moore", "normal", 0.0010319792199879885]], "qwen": [[20219, " Moore", "normal", 0.0008584775496274233]]}, "loss": {"rwkv": 20.66360084606588, "qwen": 21.22069134830696}, "topk": {"rwkv": [37045, 43, 0.0010319792199879885, [[32227, 0.64783, " that", false], [22590, 0.066861, " the", false], [51018, 0.038809, " because", false], [47284, 0.03059, " simple", false], [22187, 0.017243, " not", false], [47285, 0.015204, " simply", false], [332, 0.013898, " a", false], [45, 0.008819, ",", false], [56937, 0.004951, " probably", false], [4706, 0.004746, " of", false]]], "qwen": [20219, 42, 0.0008584775496274233, [[429, 0.652205, " that", false], [279, 0.065473, " the", false], [1576, 0.041846, " because", false], [4285, 0.032524, " simple", false], [537, 0.023759, " not", false], [4936, 0.023078, " simply", false], [264, 0.008186, " a", false], [54480, 0.007306, " computational", false], [11, 0.004318, ",", false], [4658, 0.003951, " probably", false]]]}, "raw_delta": -0.03089165687561035, "tuned_delta": -0.0223198648450321}, {"byte_start": 255, "byte_end": 257, "display": {"text": "'s", "kind": "normal"}, "is_word": true, "word_id": 46, "word_key": "'s", "bytes_hex": "27 73", "compression": {"rwkv": "6.62% 6.62%", "qwen": "8.29% 8.29%"}, "model_tokens": {"rwkv": [[460, "'s", "normal", 0.48003950715065]], "qwen": [[594, "'s", "normal", 0.3989563584327698]]}, "loss": {"rwkv": 6.621744816580202, "qwen": 8.285607095725963}, "topk": {"rwkv": [460, 2, 0.48003950715065, [[28309, 0.510863, "’s", false], [460, 0.48004, "'s", false], [116, 0.005299, "s", false], [45, 0.000361, ",", false], [21265, 0.000338, " and", false], [9819, 0.000336, "‘", false], [2496, 0.000312, "â", false], [46, 0.000228, "-", false], [47, 0.00013, ".", false], [9222, 0.000128, "´s", false]]], "qwen": [594, 2, 0.3989563584327698, [[748, 0.59176, "’s", false], [594, 0.398956, "'s", false], [527, 0.000957, "’", false], [17744, 0.000841, " ’", false], [42641, 0.000839, "‘s", false], [8835, 0.000813, "â", false], [75151, 0.000435, "’", false], [6, 0.000403, "'", false], [7506, 0.000396, " Law", false], [45149, 0.000378, "\u0026apos", false]]]}, "raw_delta": -0.09226411581039429, "tuned_delta": -0.08369232377981604}, {"byte_start": 257, "byte_end": 261, "display": {"text": " law", "kind": "normal"}, "is_word": true, "word_id": 47, "word_key": " law", "bytes_hex": "20 6c 61 77", "compression": {"rwkv": "4.39% 4.39% 4.39% 4.39%", "qwen": "3.23% 3.23% 3.23% 3.23%"}, "model_tokens": {"rwkv": [[21988, " law", "normal", 0.3774595856666565]], "qwen": [[2329, " law", "normal", 0.4886452555656433]]}, "loss": {"rwkv": 4.385144838639549, "qwen": 3.228564198816081}, "topk": {"rwkv": [21988, 2, 0.3774595856666565, [[20267, 0.617231, " Law", false], [21988, 0.37746, " law", false], [21265, 0.000485, " and", false], [45958, 0.000474, " famous", false], [275, 0.000372, " (", false], [47205, 0.000313, " second", false], [31259, 0.000256, " laws", false], [29262, 0.000249, " Laws", false], [53127, 0.000206, " theorem", false], [44847, 0.000162, " Second", false]]], "qwen": [2329, 2, 0.4886452555656433, [[7506, 0.505915, " Law", false], [2329, 0.488645, " law", false], [40989, 0.000736, " Laws", false], [198, 0.000675, "\n", false], [220, 0.000285, " ", false], [6872, 0.000245, " laws", false], [576, 0.000243, " The", false], [19915, 0.000168, "law", false], [323, 0.000159, " and", false], [57817, 0.000148, " theorem", false]]]}, "raw_delta": 0.06413444876670837, "tuned_delta": 0.07270624079728662}, {"byte_start": 261, "byte_end": 262, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "14.72%", "qwen": "17.39%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.4372738301753998]], "qwen": [[11, ",", "normal", 0.3811791241168976]]}, "loss": {"rwkv": 14.722815602821939, "qwen": 17.393237517997758}, "topk": {"rwkv": [45, 1, 0.4372738301753998, [[45, 0.437274, ",", false], [59, 0.225301, ":", false], [47, 0.130315, ".", false], [21265, 0.030338, " and", false], [275, 0.022843, " (", false], [9816, 0.01929, "—", false], [280, 0.018051, " -", false], [60, 0.014288, ";", false], [43274, 0.013256, "—the", false], [22898, 0.01146, " —", false]]], "qwen": [11, 1, 0.3811791241168976, [[11, 0.381179, ",", false], [25, 0.18403, ":", false], [13, 0.177942, ".", false], [323, 0.043685, " and", false], [624, 0.030055, ".\n", false], [26, 0.021415, ";", false], [481, 0.018391, " -", false], [1959, 0.016107, " —", false], [320, 0.014172, " (", false], [1177, 0.012551, " --", false]]]}, "raw_delta": -0.14807963371276855, "tuned_delta": -0.1395078416821903}, {"byte_start": 262, "byte_end": 265, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 48, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"rwkv": "27.05% 27.05% 27.05%", "qwen": "26.33% 26.33% 26.33%"}, "model_tokens": {"rwkv": [[4715, " or", "normal", 0.010971490293741226]], "qwen": [[476, " or", "normal", 0.012534013018012047]]}, "loss": {"rwkv": 27.05053201666806, "qwen": 26.325031803135847}, "topk": {"rwkv": [4715, 8, 0.010971490293741226, [[40186, 0.541628, " which", false], [21400, 0.117319, " but", false], [21265, 0.08488, " and", false], [22590, 0.079104, " the", false], [32227, 0.01547, " that", false], [332, 0.012908, " a", false], [340, 0.011832, " i", false], [4715, 0.010971, " or", false], [4596, 0.01015, " in", false], [4423, 0.008524, " as", false]]], "qwen": [476, 8, 0.012534013018012047, [[892, 0.639171, " which", false], [279, 0.084171, " the", false], [323, 0.051258, " and", false], [714, 0.029083, " but", false], [429, 0.024328, " that", false], [264, 0.018037, " a", false], [438, 0.014398, " as", false], [476, 0.012534, " or", false], [304, 0.011276, " in", false], [600, 0.007726, " i", false]]]}, "raw_delta": 0.04023027420043945, "tuned_delta": 0.0488020662310177}, {"byte_start": 265, "byte_end": 272, "display": {"text": " rather", "kind": "normal"}, "is_word": true, "word_id": 49, "word_key": " rather", "bytes_hex": "20 72 61 74 68 65 72", "compression": {"rwkv": "5.92% 5.92% 5.92% 5.92% 5.92% 5.92% 5.92%", "qwen": "5.90% 5.90% 5.90% 5.90% 5.90% 5.90% 5.90%"}, "model_tokens": {"rwkv": [[47001, " rather", "normal", 0.10089293122291565]], "qwen": [[4751, " rather", "normal", 0.10114416480064392]]}, "loss": {"rwkv": 5.9173038786461385, "qwen": 5.902705008482897}, "topk": {"rwkv": [47001, 4, 0.10089293122291565, [[22590, 0.238373, " the", false], [31458, 0.166759, " more", false], [4424, 0.123038, " at", false], [47001, 0.100893, " rather", false], [45, 0.038933, ",", false], [4596, 0.02585, " in", false], [52448, 0.019623, " perhaps", false], [332, 0.01609, " a", false], [37045, 0.013577, " Moore", false], [32074, 0.01318, " some", false]]], "qwen": [4751, 3, 0.10114416480064392, [[279, 0.211004, " the", false], [803, 0.133768, " more", false], [4751, 0.101144, " rather", false], [518, 0.099381, " at", false], [304, 0.062929, " in", false], [11, 0.049104, ",", false], [438, 0.029579, " as", false], [894, 0.023234, " any", false], [4936, 0.020661, " simply", false], [311, 0.016255, " to", false]]]}, "raw_delta": 0.0008095332554408641, "tuned_delta": 0.009381325286019112}, {"byte_start": 272, "byte_end": 276, "display": {"text": " its", "kind": "normal"}, "is_word": true, "word_id": 50, "word_key": " its", "bytes_hex": "20 69 74 73", "compression": {"rwkv": "10.14% 10.14% 10.14% 10.14%", "qwen": "14.29% 14.29% 14.29% 14.29%"}, "model_tokens": {"rwkv": [[21902, " its", "normal", 0.1046118214726448]], "qwen": [[1181, " its", "normal", 0.041973281651735306]]}, "loss": {"rwkv": 10.143949506250523, "qwen": 14.294952864439173}, "topk": {"rwkv": [21902, 3, 0.1046118214726448, [[45, 0.325682, ",", false], [22590, 0.303766, " the", false], [21902, 0.104612, " its", false], [32227, 0.04556, " that", false], [332, 0.037101, " a", false], [37045, 0.027419, " Moore", false], [21835, 0.011125, " how", false], [31458, 0.008867, " more", false], [4419, 0.006958, " an", false], [32464, 0.006922, " what", false]]], "qwen": [1181, 3, 0.041973281651735306, [[11, 0.411784, ",", false], [279, 0.324031, " the", false], [1181, 0.041973, " its", false], [264, 0.025174, " a", false], [429, 0.020966, " that", false], [20219, 0.015413, " Moore", false], [458, 0.008091, " an", false], [25, 0.007787, ":", false], [1128, 0.007512, " what", false], [1039, 0.007394, " our", false]]]}, "raw_delta": -0.2301805019378662, "tuned_delta": -0.22160870990728795}, {"byte_start": 276, "byte_end": 291, "display": {"text": " generalization", "kind": "normal"}, "is_word": true, "word_id": 51, "word_key": " generalization", "bytes_hex": "20 67 65 6e 65 72 61 6c 69 7a 61 74 69 6f 6e", "compression": {"rwkv": "7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29%", "qwen": "10.66% 10.66% 10.66% 10.66% 10.66% 10.66% 10.66% 10.66% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43%"}, "model_tokens": {"rwkv": [[65135, " generalization", "normal", 0.0022984459064900875]], "qwen": [[4586, " general", "normal", 0.008826144970953465], [2022, "ization", "normal", 0.8470881581306458]]}, "loss": {"rwkv": 7.288615571157784, "qwen": 5.886180447042385}, "topk": {"rwkv": [65135, 65, 0.0022984459064900875, [[52046, 0.062569, " inverse", false], [60588, 0.03859, " successor", false], [45606, 0.037796, " cousin", false], [21458, 0.037154, " cor", false], [63563, 0.029451, " exponential", false], [63774, 0.0237, " predecessor", false], [45828, 0.017706, " effect", false], [61841, 0.01581, " derivative", false], [31458, 0.014963, " more", false], [63454, 0.011169, " derivatives", false]]], "qwen": [4586, 20, 0.008826144970953465, [[1829, 0.076741, " cor", false], [9931, 0.057388, " reverse", false], [27949, 0.054086, " inverse", false], [33565, 0.046774, " successor", false], [14002, 0.029152, " opposite", false], [13578, 0.021762, " equivalent", false], [94240, 0.0146, " converse", false], [31805, 0.014345, " derivative", false], [3265, 0.014272, " close", false], [27397, 0.013097, " twin", false]]]}, "raw_delta": 0.07776751617590588, "tuned_delta": 0.08633930820648412}, {"byte_start": 291, "byte_end": 294, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 52, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "30.62% 30.62% 30.62%", "qwen": "37.00% 37.00% 37.00%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.006099262274801731]], "qwen": [[315, " of", "normal", 0.0021232785657048225]]}, "loss": {"rwkv": 30.619699435533988, "qwen": 36.99787668920725}, "topk": {"rwkv": [4706, 16, 0.006099262274801731, [[45, 0.249957, ",", false], [4811, 0.172878, " to", false], [116, 0.15567, "s", false], [59, 0.093979, ":", false], [32227, 0.058063, " that", false], [47, 0.057963, ".", false], [37045, 0.020132, " Moore", false], [38848, 0.014051, " known", false], [4596, 0.013601, " in", false], [4450, 0.01326, " by", false]]], "qwen": [315, 30, 0.0021232785657048225, [[11, 0.267544, ",", false], [25, 0.208771, ":", false], [311, 0.197383, " to", false], [13, 0.064783, ".", false], [429, 0.057587, " that", false], [481, 0.015406, " -", false], [892, 0.011045, " which", false], [624, 0.010519, ".\n", false], [320, 0.009481, " (", false], [369, 0.009388, " for", false]]]}, "raw_delta": -0.35368124643961596, "tuned_delta": -0.34510945440903773}, {"byte_start": 294, "byte_end": 304, "display": {"text": " continued", "kind": "normal"}, "is_word": true, "word_id": 53, "word_key": " continued", "bytes_hex": "20 63 6f 6e 74 69 6e 75 65 64", "compression": {"rwkv": "12.74% 12.74% 12.74% 12.74% 12.74% 12.74% 12.74% 12.74% 12.74% 12.74%", "qwen": "12.88% 12.88% 12.88% 12.88% 12.88% 12.88% 12.88% 12.88% 12.88% 12.88%"}, "model_tokens": {"rwkv": [[59392, " continued", "normal", 0.0008488447056151927]], "qwen": [[8570, " continued", "normal", 0.0007931358413770795]]}, "loss": {"rwkv": 12.736292157847878, "qwen": 12.875180187205157}, "topk": {"rwkv": [59392, 111, 0.0008488447056151927, [[22590, 0.228477, " the", false], [37045, 0.13122, " Moore", false], [63563, 0.044104, " exponential", false], [269, 0.031326, " \"", false], [32227, 0.024856, " that", false], [332, 0.021657, " a", false], [32234, 0.017551, " this", false], [4601, 0.012254, " it", false], [52805, 0.010373, " scaling", false], [62659, 0.010169, " transistor", false]]], "qwen": [8570, 110, 0.0007931358413770795, [[279, 0.276562, " the", false], [330, 0.038808, " \"", false], [20219, 0.037563, " Moore", false], [1036, 0.017845, " “", false], [429, 0.017202, " that", false], [71161, 0.014851, " Denn", false], [1128, 0.014283, " what", false], [58755, 0.013923, " exponential", false], [1246, 0.011885, " how", false], [24231, 0.011763, " computing", false]]]}, "raw_delta": -0.007701587677001909, "tuned_delta": 0.0008702043535763395}, {"byte_start": 304, "byte_end": 318, "display": {"text": " exponentially", "kind": "normal"}, "is_word": true, "word_id": 54, "word_key": " exponentially", "bytes_hex": "20 65 78 70 6f 6e 65 6e 74 69 61 6c 6c 79", "compression": {"rwkv": "8.98% 8.98% 8.98% 8.98% 8.98% 8.98% 8.98% 8.98% 8.98% 8.98% 8.98% 8.98% 8.98% 8.98%", "qwen": "7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29%"}, "model_tokens": {"rwkv": [[64911, " exponentially", "normal", 0.0009393105865456164]], "qwen": [[74151, " exponentially", "normal", 0.003478133585304022]]}, "loss": {"rwkv": 8.976590237674072, "qwen": 7.292385021382192}, "topk": {"rwkv": [64911, 39, 0.0009393105865456164, [[63563, 0.67353, " exponential", false], [46132, 0.05828, " growth", false], [63621, 0.032522, " improvement", false], [64423, 0.028943, " improvements", false], [56950, 0.018912, " progress", false], [59847, 0.013396, " increases", false], [46, 0.01233, "-", false], [37045, 0.012265, " Moore", false], [56045, 0.011355, " doubling", false], [52805, 0.008522, " scaling", false]]], "qwen": [74151, 35, 0.003478133585304022, [[58755, 0.241755, " exponential", false], [29016, 0.077583, " technological", false], [15673, 0.073068, " improvement", false], [5098, 0.061303, " progress", false], [18142, 0.050694, " improvements", false], [12703, 0.032734, " increases", false], [26943, 0.02385, " scaling", false], [6513, 0.023342, " growth", false], [5263, 0.022613, " increase", false], [54480, 0.017393, " computational", false]]]}, "raw_delta": 0.09339216777256557, "tuned_delta": 0.10196395980314381}, {"byte_start": 318, "byte_end": 326, "display": {"text": " falling", "kind": "normal"}, "is_word": true, "word_id": 55, "word_key": " falling", "bytes_hex": "20 66 61 6c 6c 69 6e 67", "compression": {"rwkv": "12.12% 12.12% 12.12% 12.12% 12.12% 12.12% 12.12% 12.12%", "qwen": "16.79% 16.79% 16.79% 16.79% 16.79% 16.79% 16.79% 16.79%"}, "model_tokens": {"rwkv": [[51709, " falling", "normal", 0.004628258291631937]], "qwen": [[15679, " falling", "normal", 0.0005811915034428239]]}, "loss": {"rwkv": 12.116384132465903, "qwen": 16.79484215747727}, "topk": {"rwkv": [51709, 19, 0.004628258291631937, [[62092, 0.341356, " increasing", false], [46, 0.12203, "-", false], [61816, 0.0991, " decreasing", false], [51876, 0.095055, " growing", false], [45961, 0.030608, " faster", false], [46132, 0.030241, " growth", false], [59832, 0.029976, " improving", false], [64230, 0.026563, " accelerating", false], [59453, 0.018792, " declining", false], [47122, 0.018043, " rising", false]]], "qwen": [15679, 81, 0.0005811915034428239, [[7703, 0.346143, " increasing", false], [18392, 0.14817, " improving", false], [68641, 0.054102, " accelerating", false], [7826, 0.047504, " growing", false], [10596, 0.044581, " faster", false], [43549, 0.021275, " decreasing", false], [4937, 0.01972, " fast", false], [2664, 0.016937, " better", false], [16062, 0.016582, " rising", false], [11048, 0.015995, " rapid", false]]]}, "raw_delta": -0.25942879915237427, "tuned_delta": -0.25085700712179604}, {"byte_start": 326, "byte_end": 331, "display": {"text": " cost", "kind": "normal"}, "is_word": true, "word_id": 56, "word_key": " cost", "bytes_hex": "20 63 6f 73 74", "compression": {"rwkv": "8.00% 8.00% 8.00% 8.00% 8.00%", "qwen": "8.69% 8.69% 8.69% 8.69% 8.69%"}, "model_tokens": {"rwkv": [[30510, " cost", "normal", 0.10817506164312363]], "qwen": [[2783, " cost", "normal", 0.08987583220005035]]}, "loss": {"rwkv": 8.002449054930967, "qwen": 8.689806956154829}, "topk": {"rwkv": [30510, 2, 0.10817506164312363, [[38124, 0.515085, " costs", false], [30510, 0.108175, " cost", false], [45860, 0.039054, " energy", false], [39339, 0.024575, " power", false], [46900, 0.024467, " prices", false], [56353, 0.022709, " hardware", false], [62659, 0.020326, " transistor", false], [22278, 0.016284, " per", false], [52805, 0.013065, " scaling", false], [32343, 0.0113, " unit", false]]], "qwen": [2783, 3, 0.08987583220005035, [[7049, 0.392977, " costs", false], [7576, 0.101625, " prices", false], [2783, 0.089876, " cost", false], [817, 0.047729, " per", false], [54480, 0.031836, " computational", false], [11773, 0.027092, " hardware", false], [34447, 0.025031, " computation", false], [24231, 0.023069, " computing", false], [304, 0.013094, " in", false], [4982, 0.012892, " unit", false]]]}, "raw_delta": -0.03811521530151368, "tuned_delta": -0.029543423270935433}, {"byte_start": 331, "byte_end": 335, "display": {"text": " per", "kind": "normal"}, "is_word": true, "word_id": 57, "word_key": " per", "bytes_hex": "20 70 65 72", "compression": {"rwkv": "5.28% 5.28% 5.28% 5.28%", "qwen": "9.24% 9.24% 9.24% 9.24%"}, "model_tokens": {"rwkv": [[22278, " per", "normal", 0.306733101606369]], "qwen": [[817, " per", "normal", 0.12882518768310547]]}, "loss": {"rwkv": 5.283307034505481, "qwen": 9.239104709507004}, "topk": {"rwkv": [22278, 1, 0.306733101606369, [[22278, 0.306733, " per", false], [47, 0.147779, ".", false], [4706, 0.123265, " of", false], [45, 0.076877, ",", false], [21700, 0.058715, " for", false], [45644, 0.038794, " curves", false], [4811, 0.031063, " to", false], [4596, 0.020581, " in", false], [21265, 0.019129, " and", false], [59, 0.016463, ":", false]]], "qwen": [817, 2, 0.12882518768310547, [[315, 0.442599, " of", false], [817, 0.128825, " per", false], [13, 0.073923, ".", false], [323, 0.053048, " and", false], [369, 0.040947, " for", false], [11, 0.03493, ",", false], [304, 0.031386, " in", false], [624, 0.021357, ".\n", false], [311, 0.016775, " to", false], [448, 0.014182, " with", false]]]}, "raw_delta": -0.2193560004234314, "tuned_delta": -0.21078420839285314}, {"byte_start": 335, "byte_end": 340, "display": {"text": " unit", "kind": "normal"}, "is_word": true, "word_id": 58, "word_key": " unit", "bytes_hex": "20 75 6e 69 74", "compression": {"rwkv": "4.51% 4.51% 4.51% 4.51% 4.51%", "qwen": "5.21% 5.21% 5.21% 5.21% 5.21%"}, "model_tokens": {"rwkv": [[32343, " unit", "normal", 0.2844639718532562]], "qwen": [[4982, " unit", "normal", 0.23570650815963745]]}, "loss": {"rwkv": 4.50842200277801, "qwen": 5.212341403323332}, "topk": {"rwkv": [32343, 1, 0.2844639718532562, [[32343, 0.284464, " unit", false], [63370, 0.099996, " computation", false], [62659, 0.099452, " transistor", false], [60096, 0.055853, " operation", false], [21365, 0.055329, " bit", false], [3806, 0.035438, " FL", false], [64862, 0.030839, " computational", false], [51266, 0.02392, " compute", false], [59346, 0.023771, " computing", false], [63750, 0.017952, " performance", false]]], "qwen": [4982, 1, 0.23570650815963745, [[4982, 0.235707, " unit", false], [2699, 0.213193, " bit", false], [34447, 0.047026, " computation", false], [97941, 0.026785, " transistor", false], [54480, 0.023907, " computational", false], [5068, 0.020639, " performance", false], [5666, 0.017223, " operation", false], [24231, 0.016224, " computing", false], [22302, 0.01419, " capability", false], [8692, 0.013948, " processing", false]]]}, "raw_delta": -0.03903357982635497, "tuned_delta": -0.03046178779577672}, {"byte_start": 340, "byte_end": 343, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 59, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "2.79% 2.79% 2.79%", "qwen": "1.60% 1.60% 1.60%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.6250545382499695]], "qwen": [[315, " of", "normal", 0.766579270362854]]}, "loss": {"rwkv": 2.794282387138454, "qwen": 1.5978879427888404}, "topk": {"rwkv": [4706, 1, 0.6250545382499695, [[4706, 0.625055, " of", false], [47, 0.089064, ".", false], [32251, 0.052469, " time", false], [45, 0.036225, ",", false], [63370, 0.027617, " computation", false], [59346, 0.009312, " computing", false], [63750, 0.008982, " performance", false], [275, 0.008307, " (", false], [21700, 0.00738, " for", false], [30173, 0.006321, " area", false]]], "qwen": [315, 1, 0.766579270362854, [[315, 0.766579, " of", false], [13, 0.030388, ".", false], [34447, 0.024931, " computation", false], [11, 0.01643, ",", false], [8692, 0.010762, " processing", false], [304, 0.010713, " in", false], [624, 0.007539, ".\n", false], [5666, 0.007468, " operation", false], [5068, 0.005944, " performance", false], [24231, 0.00588, " computing", false]]]}, "raw_delta": 0.06634219487508138, "tuned_delta": 0.07491398690565962}, {"byte_start": 343, "byte_end": 355, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 60, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49%", "qwen": "1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.37295469641685486]], "qwen": [[34447, " computation", "normal", 0.31194689869880676]]}, "loss": {"rwkv": 1.4851963108109854, "qwen": 1.750653682200866}, "topk": {"rwkv": [63370, 1, 0.37295469641685486, [[63370, 0.372955, " computation", false], [59346, 0.166053, " computing", false], [51266, 0.089957, " compute", false], [64862, 0.068879, " computational", false], [63750, 0.03173, " performance", false], [62378, 0.026331, " processing", false], [39339, 0.017784, " power", false], [63637, 0.01707, " information", false], [55809, 0.01283, " computer", false], [56353, 0.011179, " hardware", false]]], "qwen": [34447, 1, 0.31194689869880676, [[34447, 0.311947, " computation", false], [24231, 0.198532, " computing", false], [8692, 0.090849, " processing", false], [54480, 0.064271, " computational", false], [5068, 0.040201, " performance", false], [11773, 0.022831, " hardware", false], [6366, 0.01754, " computer", false], [882, 0.015558, " time", false], [12564, 0.013179, " compute", false], [1995, 0.011198, " information", false]]]}, "raw_delta": -0.01472008228302002, "tuned_delta": -0.006148290252441771}, {"byte_start": 355, "byte_end": 356, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "10.71%", "qwen": "12.53%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.5602073669433594]], "qwen": [[13, ".", "normal", 0.4991952180862427]]}, "loss": {"rwkv": 10.707502256597774, "qwen": 12.529050053861804}, "topk": {"rwkv": [47, 1, 0.5602073669433594, [[47, 0.560207, ".", false], [45, 0.163868, ",", false], [275, 0.035099, " (", false], [31601, 0.03259, " over", false], [59, 0.025043, ":", false], [4811, 0.018427, " to", false], [21265, 0.018182, " and", false], [39339, 0.017679, " power", false], [4423, 0.008745, " as", false], [4596, 0.008233, " in", false]]], "qwen": [13, 1, 0.4991952180862427, [[13, 0.499195, ".", false], [624, 0.12854, ".\n", false], [11, 0.104222, ",", false], [320, 0.03919, " (", false], [25, 0.023488, ":", false], [323, 0.020868, " and", false], [2355, 0.01891, " power", false], [311, 0.014753, " to", false], [429, 0.010954, " that", false], [304, 0.008801, " in", false]]]}, "raw_delta": -0.10100805759429932, "tuned_delta": -0.09243626556372107}, {"byte_start": 356, "byte_end": 361, "display": {"text": " Most", "kind": "normal"}, "is_word": true, "word_id": 61, "word_key": " most", "bytes_hex": "20 4d 6f 73 74", "compression": {"rwkv": "21.30% 21.30% 21.30% 21.30% 21.30%", "qwen": "19.99% 19.99% 19.99% 19.99% 19.99%"}, "model_tokens": {"rwkv": [[29425, " Most", "normal", 0.0027175736613571644]], "qwen": [[7496, " Most", "normal", 0.003920088987797499]]}, "loss": {"rwkv": 21.302293963126097, "qwen": 19.98724410174221}, "topk": {"rwkv": [29425, 49, 0.0027175736613571644, [[11, 0.159345, "\n", false], [20996, 0.101765, " The", false], [29894, 0.094614, " This", false], [261, 0.040463, "\n\n", false], [3913, 0.038089, " In", false], [19555, 0.037748, " But", false], [37045, 0.032184, " Moore", false], [3918, 0.029862, " It", false], [3641, 0.026704, " As", false], [3908, 0.021178, " If", false]]], "qwen": [7496, 44, 0.003920088987797499, [[1096, 0.116306, " This", false], [576, 0.11264, " The", false], [758, 0.047365, " In", false], [1084, 0.041821, " It", false], [1634, 0.034852, " As", false], [1416, 0.023749, " If", false], [1752, 0.019009, " For", false], [1205, 0.018853, " We", false], [2619, 0.018818, " There", false], [1988, 0.016239, " But", false]]]}, "raw_delta": 0.07292184829711901, "tuned_delta": 0.08149364032769725}, {"byte_start": 361, "byte_end": 364, "display": {"text": " AI", "kind": "normal"}, "is_word": true, "word_id": 62, "word_key": " ai", "bytes_hex": "20 41 49", "compression": {"rwkv": "13.06% 13.06% 13.06%", "qwen": "13.88% 13.88% 13.88%"}, "model_tokens": {"rwkv": [[3609, " AI", "normal", 0.11316458135843277]], "qwen": [[15235, " AI", "normal", 0.0993504747748375]]}, "loss": {"rwkv": 13.055638716377988, "qwen": 13.880539169353877}, "topk": {"rwkv": [3609, 2, 0.11316458135843277, [[4706, 0.296412, " of", false], [3609, 0.113165, " AI", false], [46787, 0.059094, " people", false], [39193, 0.034889, " other", false], [52224, 0.024476, " methods", false], [57103, 0.02051, " research", false], [47539, 0.010789, " things", false], [52167, 0.010439, " machine", false], [46588, 0.009972, " modern", false], [2030, 0.009561, "ly", false]]], "qwen": [15235, 2, 0.0993504747748375, [[315, 0.255866, " of", false], [15235, 0.09935, " AI", false], [5413, 0.047656, " methods", false], [1008, 0.034763, " other", false], [25185, 0.032398, " algorithms", false], [5662, 0.026303, " machine", false], [4586, 0.025553, " general", false], [3412, 0.024496, " research", false], [1251, 0.021594, " people", false], [5322, 0.020916, " problems", false]]]}, "raw_delta": -0.04574219385782874, "tuned_delta": -0.03717040182725049}, {"byte_start": 364, "byte_end": 373, "display": {"text": " research", "kind": "normal"}, "is_word": true, "word_id": 63, "word_key": " research", "bytes_hex": "20 72 65 73 65 61 72 63 68", "compression": {"rwkv": "2.86% 2.86% 2.86% 2.86% 2.86% 2.86% 2.86% 2.86% 2.86%", "qwen": "3.05% 3.05% 3.05% 3.05% 3.05% 3.05% 3.05% 3.05% 3.05%"}, "model_tokens": {"rwkv": [[57103, " research", "normal", 0.24100203812122345]], "qwen": [[3412, " research", "normal", 0.21799854934215546]]}, "loss": {"rwkv": 2.8647264809318607, "qwen": 3.0522353433308953}, "topk": {"rwkv": [57103, 1, 0.24100203812122345, [[57103, 0.241002, " research", false], [63843, 0.178493, " researchers", false], [52224, 0.077356, " methods", false], [53087, 0.07643, " systems", false], [62633, 0.025532, " techniques", false], [32499, 0.022854, " work", false], [56950, 0.022285, " progress", false], [61559, 0.020193, " algorithms", false], [64251, 0.019879, " applications", false], [4600, 0.016739, " is", false]]], "qwen": [3412, 1, 0.21799854934215546, [[3412, 0.217999, " research", false], [11811, 0.166973, " researchers", false], [5413, 0.156672, " methods", false], [25185, 0.064499, " algorithms", false], [12538, 0.055351, " techniques", false], [19827, 0.037726, " approaches", false], [5942, 0.036706, " systems", false], [5322, 0.027952, " problems", false], [8357, 0.013111, " applications", false], [374, 0.012034, " is", false]]]}, "raw_delta": -0.010397699144151479, "tuned_delta": -0.0018259071135732306}, {"byte_start": 373, "byte_end": 377, "display": {"text": " has", "kind": "normal"}, "is_word": true, "word_id": 64, "word_key": " has", "bytes_hex": "20 68 61 73", "compression": {"rwkv": "7.57% 7.57% 7.57% 7.57%", "qwen": "7.36% 7.36% 7.36% 7.36%"}, "model_tokens": {"rwkv": [[21800, " has", "normal", 0.18468452990055084]], "qwen": [[702, " has", "normal", 0.19522716104984283]]}, "loss": {"rwkv": 7.572740082791189, "qwen": 7.364920009609059}, "topk": {"rwkv": [21800, 1, 0.18468452990055084, [[21800, 0.184685, " has", false], [4600, 0.112504, " is", false], [4596, 0.045841, " in", false], [45, 0.045161, ",", false], [39971, 0.037255, " today", false], [31601, 0.026654, " over", false], [32227, 0.025539, " that", false], [56952, 0.024692, " projects", false], [46750, 0.023426, " papers", false], [51566, 0.020506, " efforts", false]]], "qwen": [702, 1, 0.19522716104984283, [[702, 0.195227, " has", false], [374, 0.139316, " is", false], [3351, 0.06346, " today", false], [304, 0.046102, " in", false], [11, 0.03967, ",", false], [916, 0.022977, " over", false], [23497, 0.017717, " focuses", false], [429, 0.016171, " that", false], [15689, 0.014485, " papers", false], [323, 0.014132, " and", false]]]}, "raw_delta": 0.011523991823196411, "tuned_delta": 0.02009578385377466}, {"byte_start": 377, "byte_end": 382, "display": {"text": " been", "kind": "normal"}, "is_word": true, "word_id": 65, "word_key": " been", "bytes_hex": "20 62 65 65 6e", "compression": {"rwkv": "3.92% 3.92% 3.92% 3.92% 3.92%", "qwen": "4.25% 4.25% 4.25% 4.25% 4.25%"}, "model_tokens": {"rwkv": [[30259, " been", "normal", 0.3382815420627594]], "qwen": [[1012, " been", "normal", 0.30757519602775574]]}, "loss": {"rwkv": 3.9166916149133963, "qwen": 4.252472262284453}, "topk": {"rwkv": [30259, 1, 0.3382815420627594, [[30259, 0.338282, " been", false], [51770, 0.149863, " focused", false], [56255, 0.021524, " followed", false], [39887, 0.021269, " taken", false], [22187, 0.016171, " not", false], [40013, 0.016112, " tried", false], [45953, 0.012666, " failed", false], [56540, 0.011556, " leverage", false], [64300, 0.011408, " concentrated", false], [56500, 0.011216, " involved", false]]], "qwen": [1012, 1, 0.30757519602775574, [[1012, 0.307575, " been", false], [10735, 0.185736, " focused", false], [8110, 0.022109, " followed", false], [37526, 0.018622, " concentrated", false], [537, 0.016617, " not", false], [4429, 0.015635, " taken", false], [6679, 0.014515, " tried", false], [7391, 0.009086, " spent", false], [1030, 0.008749, " had", false], [264, 0.008633, " a", false]]]}, "raw_delta": -0.01861963272094727, "tuned_delta": -0.010047840690369023}, {"byte_start": 382, "byte_end": 392, "display": {"text": " conducted", "kind": "normal"}, "is_word": true, "word_id": 66, "word_key": " conducted", "bytes_hex": "20 63 6f 6e 64 75 63 74 65 64", "compression": {"rwkv": "6.62% 6.62% 6.62% 6.62% 6.62% 6.62% 6.62% 6.62% 6.62% 6.62%", "qwen": "7.16% 7.16% 7.16% 7.16% 7.16% 7.16% 7.16% 7.16% 7.16% 7.16%"}, "model_tokens": {"rwkv": [[59355, " conducted", "normal", 0.025281056761741638]], "qwen": [[13075, " conducted", "normal", 0.01887700892984867]]}, "loss": {"rwkv": 6.621744816580202, "qwen": 7.159032376487684}, "topk": {"rwkv": [59355, 8, 0.025281056761741638, [[51770, 0.113002, " focused", false], [30666, 0.066695, " done", false], [45796, 0.035702, " driven", false], [37598, 0.034683, " about", false], [51459, 0.032152, " devoted", false], [37810, 0.028903, " based", false], [4596, 0.028449, " in", false], [59355, 0.025281, " conducted", false], [4712, 0.024528, " on", false], [332, 0.022119, " a", false]]], "qwen": [13075, 9, 0.01887700892984867, [[10735, 0.150755, " focused", false], [28229, 0.042238, " devoted", false], [304, 0.040494, " in", false], [911, 0.038982, " about", false], [16227, 0.037951, " driven", false], [3118, 0.033625, " based", false], [2814, 0.030086, " done", false], [264, 0.019769, " a", false], [13075, 0.018877, " conducted", false], [389, 0.018383, " on", false]]]}, "raw_delta": -0.029793548583984364, "tuned_delta": -0.021221756553406114}, {"byte_start": 392, "byte_end": 395, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 67, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"rwkv": "31.18% 31.18% 31.18%", "qwen": "28.91% 28.91% 28.91%"}, "model_tokens": {"rwkv": [[4423, " as", "normal", 0.005548461806029081]], "qwen": [[438, " as", "normal", 0.008154122158885002]]}, "loss": {"rwkv": 31.183252185881237, "qwen": 28.909395033008668}, "topk": {"rwkv": [4423, 14, 0.005548461806029081, [[4596, 0.222587, " in", false], [4712, 0.203379, " on", false], [32487, 0.118062, " with", false], [40085, 0.102983, " using", false], [4450, 0.086894, " by", false], [47806, 0.042485, " within", false], [40062, 0.034336, " under", false], [4424, 0.033606, " at", false], [31601, 0.012565, " over", false], [53356, 0.008114, " without", false]]], "qwen": [438, 16, 0.008154122158885002, [[304, 0.233193, " in", false], [389, 0.124188, " on", false], [553, 0.121443, " by", false], [448, 0.089342, " with", false], [1212, 0.067534, " under", false], [2878, 0.056427, " within", false], [1667, 0.0494, " using", false], [518, 0.029888, " at", false], [916, 0.023816, " over", false], [2163, 0.015385, " around", false]]]}, "raw_delta": 0.1260894139607749, "tuned_delta": 0.13466120599135314}, {"byte_start": 395, "byte_end": 398, "display": {"text": " if", "kind": "normal"}, "is_word": true, "word_id": 68, "word_key": " if", "bytes_hex": "20 69 66", "compression": {"rwkv": "9.11% 9.11% 9.11%", "qwen": "11.76% 11.76% 11.76%"}, "model_tokens": {"rwkv": [[4588, " if", "normal", 0.22035817801952362]], "qwen": [[421, " if", "normal", 0.14144553244113922]]}, "loss": {"rwkv": 9.11076946394723, "qwen": 11.757006318845464}, "topk": {"rwkv": [4588, 2, 0.22035817801952362, [[332, 0.289672, " a", false], [4588, 0.220358, " if", false], [4419, 0.105092, " an", false], [31633, 0.062675, " part", false], [47544, 0.060681, " though", false], [22590, 0.020766, " the", false], [269, 0.012641, " \"", false], [32074, 0.005624, " some", false], [57103, 0.005179, " research", false], [63625, 0.004966, " incremental", false]]], "qwen": [421, 2, 0.14144553244113922, [[264, 0.3322, " a", false], [421, 0.141446, " if", false], [458, 0.093673, " an", false], [949, 0.070602, " part", false], [3498, 0.029649, " though", false], [279, 0.018577, " the", false], [2987, 0.010033, " either", false], [330, 0.009308, " \"", false], [11017, 0.007624, " follows", false], [9251, 0.005406, " applied", false]]]}, "raw_delta": -0.14673852920532227, "tuned_delta": -0.138166737174744}, {"byte_start": 398, "byte_end": 402, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 69, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "8.00% 8.00% 8.00% 8.00%", "qwen": "8.42% 8.42% 8.42% 8.42%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.17217271029949188]], "qwen": [[279, " the", "normal", 0.1544894278049469]]}, "loss": {"rwkv": 7.995404645551628, "qwen": 8.420062594724723}, "topk": {"rwkv": [22590, 1, 0.17217271029949188, [[22590, 0.172173, " the", false], [32234, 0.123909, " this", false], [4601, 0.080611, " it", false], [4858, 0.077304, " we", false], [39934, 0.062592, " there", false], [37045, 0.0502, " Moore", false], [3609, 0.034168, " AI", false], [63370, 0.025696, " computation", false], [22226, 0.024657, " one", false], [51832, 0.016894, " general", false]]], "qwen": [279, 1, 0.1544894278049469, [[279, 0.154489, " the", false], [432, 0.100706, " it", false], [1052, 0.094937, " there", false], [419, 0.078101, " this", false], [582, 0.064453, " we", false], [34447, 0.05836, " computation", false], [20219, 0.025845, " Moore", false], [24231, 0.023952, " computing", false], [264, 0.020418, " a", false], [429, 0.016013, " that", false]]]}, "raw_delta": -0.023548036813735962, "tuned_delta": -0.014976244783157714}, {"byte_start": 402, "byte_end": 414, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 70, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "7.23% 7.23% 7.23% 7.23% 7.23% 7.23% 7.23% 7.23% 7.23% 7.23% 7.23% 7.23%", "qwen": "8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.008208324201405048]], "qwen": [[34447, " computation", "normal", 0.004578007850795984]]}, "loss": {"rwkv": 7.232260296123059, "qwen": 8.094858629573698}, "topk": {"rwkv": [63370, 15, 0.008208324201405048, [[30510, 0.16907, " cost", false], [31581, 0.043765, " only", false], [30985, 0.039155, " goal", false], [40213, 0.028927, " world", false], [52569, 0.027766, " problem", false], [64862, 0.021806, " computational", false], [57481, 0.018901, " ultimate", false], [46064, 0.017141, " future", false], [38124, 0.013501, " costs", false], [55809, 0.013307, " computer", false]]], "qwen": [34447, 29, 0.004578007850795984, [[2783, 0.218788, " cost", false], [3853, 0.04936, " future", false], [3491, 0.035279, " problem", false], [16724, 0.026408, " ultimate", false], [1879, 0.024884, " world", false], [1172, 0.024796, " only", false], [7049, 0.019743, " costs", false], [54480, 0.016114, " computational", false], [11773, 0.013483, " hardware", false], [6366, 0.01246, " computer", false]]]}, "raw_delta": -0.047832608222961426, "tuned_delta": -0.039260816192383176}, {"byte_start": 414, "byte_end": 424, "display": {"text": " available", "kind": "normal"}, "is_word": true, "word_id": 71, "word_key": " available", "bytes_hex": "20 61 76 61 69 6c 61 62 6c 65", "compression": {"rwkv": "7.66% 7.66% 7.66% 7.66% 7.66% 7.66% 7.66% 7.66% 7.66% 7.66%", "qwen": "4.96% 4.96% 4.96% 4.96% 4.96% 4.96% 4.96% 4.96% 4.96% 4.96%"}, "model_tokens": {"rwkv": [[59206, " available", "normal", 0.014257945120334625]], "qwen": [[2500, " available", "normal", 0.06380987167358398]]}, "loss": {"rwkv": 7.664317404722616, "qwen": 4.962595936959651}, "topk": {"rwkv": [59206, 11, 0.014257945120334625, [[22748, 0.226967, " was", false], [32462, 0.14286, " were", false], [4600, 0.099516, " is", false], [30510, 0.056174, " cost", false], [40219, 0.050933, " would", false], [38128, 0.036869, " could", false], [46342, 0.027247, " itself", false], [4706, 0.015667, " of", false], [52569, 0.015122, " problem", false], [21795, 0.014863, " had", false]]], "qwen": [2500, 4, 0.06380987167358398, [[2783, 0.125413, " cost", false], [374, 0.093354, " is", false], [572, 0.089454, " was", false], [2500, 0.06381, " available", false], [7049, 0.047193, " costs", false], [8039, 0.035703, " budget", false], [1033, 0.034068, " were", false], [315, 0.025528, " of", false], [686, 0.024158, " will", false], [3491, 0.023169, " problem", false]]]}, "raw_delta": 0.14981524944305422, "tuned_delta": 0.15838704147363247}, {"byte_start": 424, "byte_end": 427, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 72, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "6.95% 6.95% 6.95%", "qwen": "4.65% 4.65% 4.65%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.3134537637233734]], "qwen": [[311, " to", "normal", 0.4611510634422302]]}, "loss": {"rwkv": 6.9504839209494325, "qwen": 4.652869514643304}, "topk": {"rwkv": [4811, 1, 0.3134537637233734, [[4811, 0.313454, " to", false], [32462, 0.14886, " were", false], [22748, 0.139885, " was", false], [21700, 0.090638, " for", false], [4600, 0.084194, " is", false], [4596, 0.03288, " in", false], [40219, 0.024019, " would", false], [39971, 0.022133, " today", false], [4712, 0.020225, " on", false], [4424, 0.017158, " at", false]]], "qwen": [311, 1, 0.4611510634422302, [[311, 0.461151, " to", false], [572, 0.094041, " was", false], [3351, 0.084702, " today", false], [374, 0.061872, " is", false], [1033, 0.057448, " were", false], [304, 0.032404, " in", false], [1035, 0.02982, " would", false], [369, 0.024711, " for", false], [518, 0.024061, " at", false], [686, 0.020078, " will", false]]]}, "raw_delta": 0.12740679581960046, "tuned_delta": 0.13597858785017872}, {"byte_start": 427, "byte_end": 431, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 73, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "11.76% 11.76% 11.76% 11.76%", "qwen": "11.27% 11.27% 11.27% 11.27%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.0742250308394432]], "qwen": [[279, " the", "normal", 0.08203161507844925]]}, "loss": {"rwkv": 11.76416366349887, "qwen": 11.273987311142236}, "topk": {"rwkv": [22590, 5, 0.0742250308394432, [[63843, 0.190292, " researchers", false], [3609, 0.155574, " AI", false], [4835, 0.111417, " us", false], [4601, 0.082772, " it", false], [22590, 0.074225, " the", false], [332, 0.040541, " a", false], [39740, 0.034152, " solve", false], [4419, 0.025745, " an", false], [46227, 0.023081, " humans", false], [4491, 0.017032, " do", false]]], "qwen": [279, 3, 0.08203161507844925, [[601, 0.346554, " us", false], [432, 0.134368, " it", false], [279, 0.082032, " the", false], [264, 0.0735, " a", false], [11811, 0.03848, " researchers", false], [15235, 0.035806, " AI", false], [458, 0.03419, " an", false], [11625, 0.03216, " solve", false], [12677, 0.024675, " humans", false], [1105, 0.008507, " them", false]]]}, "raw_delta": 0.027181148529052734, "tuned_delta": 0.035752940559630984}, {"byte_start": 431, "byte_end": 437, "display": {"text": " agent", "kind": "normal"}, "is_word": true, "word_id": 74, "word_key": " agent", "bytes_hex": "20 61 67 65 6e 74", "compression": {"rwkv": "13.53% 13.53% 13.53% 13.53% 13.53% 13.53%", "qwen": "15.32% 15.32% 15.32% 15.32% 15.32% 15.32%"}, "model_tokens": {"rwkv": [[37636, " agent", "normal", 0.011057370342314243]], "qwen": [[8315, " agent", "normal", 0.006113724783062935]]}, "loss": {"rwkv": 13.52526600833403, "qwen": 15.320276165975551}, "topk": {"rwkv": [37636, 12, 0.011057370342314243, [[3609, 0.261469, " AI", false], [62496, 0.185476, " researcher", false], [63843, 0.140816, " researchers", false], [57103, 0.038766, " research", false], [52569, 0.030162, " problem", false], [59113, 0.022393, " algorithm", false], [52581, 0.0223, " project", false], [47487, 0.018635, " system", false], [40213, 0.016146, " world", false], [38478, 0.014444, " field", false]]], "qwen": [8315, 19, 0.006113724783062935, [[31085, 0.271469, " researcher", false], [15235, 0.14507, " AI", false], [2070, 0.099388, " field", false], [11811, 0.054255, " researchers", false], [3738, 0.051663, " human", false], [3412, 0.025836, " research", false], [5662, 0.024803, " machine", false], [1879, 0.024768, " world", false], [1849, 0.021812, " system", false], [12111, 0.016211, " algorithm", false]]]}, "raw_delta": -0.09953649838765466, "tuned_delta": -0.09096470635707642}, {"byte_start": 437, "byte_end": 442, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 75, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"rwkv": "6.06% 6.06% 6.06% 6.06% 6.06%", "qwen": "6.27% 6.27% 6.27% 6.27% 6.27%"}, "model_tokens": {"rwkv": [[32462, " were", "normal", 0.18527035415172577]], "qwen": [[1033, " were", "normal", 0.17594511806964874]]}, "loss": {"rwkv": 6.058192066232952, "qwen": 6.2670065216045385}, "topk": {"rwkv": [32462, 3, 0.18527035415172577, [[22748, 0.263561, " was", false], [4600, 0.210757, " is", false], [32462, 0.18527, " were", false], [40219, 0.064466, " would", false], [38128, 0.030505, " could", false], [4596, 0.021048, " in", false], [275, 0.018034, " (", false], [32475, 0.014222, " will", false], [21265, 0.010929, " and", false], [45, 0.010603, ",", false]]], "qwen": [1033, 3, 0.17594511806964874, [[374, 0.26816, " is", false], [572, 0.215074, " was", false], [1033, 0.175945, " were", false], [1035, 0.044511, " would", false], [686, 0.039311, " will", false], [1410, 0.025966, " could", false], [518, 0.021568, " at", false], [304, 0.018258, " in", false], [702, 0.016137, " has", false], [320, 0.014433, " (", false]]]}, "raw_delta": -0.011579132080078103, "tuned_delta": -0.0030073400494998546}, {"byte_start": 442, "byte_end": 451, "display": {"text": " constant", "kind": "normal"}, "is_word": true, "word_id": 76, "word_key": " constant", "bytes_hex": "20 63 6f 6e 73 74 61 6e 74", "compression": {"rwkv": "7.26% 7.26% 7.26% 7.26% 7.26% 7.26% 7.26% 7.26% 7.26%", "qwen": "8.21% 8.21% 8.21% 8.21% 8.21% 8.21% 8.21% 8.21% 8.21%"}, "model_tokens": {"rwkv": [[55836, " constant", "normal", 0.026913397014141083]], "qwen": [[6783, " constant", "normal", 0.01665637083351612]]}, "loss": {"rwkv": 7.2635687822534605, "qwen": 8.205253098838568}, "topk": {"rwkv": [55836, 8, 0.026913397014141083, [[38501, 0.153262, " fixed", false], [30911, 0.112204, " free", false], [56447, 0.110923, " infinite", false], [60706, 0.072948, " unlimited", false], [332, 0.043242, " a", false], [63507, 0.040686, " effectively", false], [22590, 0.029057, " the", false], [55836, 0.026913, " constant", false], [38594, 0.019031, " given", false], [22187, 0.016382, " not", false]]], "qwen": [6783, 8, 0.01665637083351612, [[23809, 0.144194, " infinite", false], [26764, 0.115091, " unlimited", false], [7199, 0.090128, " limited", false], [8356, 0.073454, " fixed", false], [264, 0.065811, " a", false], [1910, 0.037812, " free", false], [650, 0.032257, " un", false], [6783, 0.016656, " constant", false], [91559, 0.01608, " limitless", false], [537, 0.01543, " not", false]]]}, "raw_delta": -0.05221806632147896, "tuned_delta": -0.04364627429090071}, {"byte_start": 451, "byte_end": 453, "display": {"text": " (", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "20 28", "compression": {"rwkv": "29.87% 29.87%", "qwen": "29.14% 29.14%"}, "model_tokens": {"rwkv": [[275, " (", "normal", 0.03586556017398834]], "qwen": [[320, " (", "normal", 0.03947778046131134]]}, "loss": {"rwkv": 29.868295768404316, "qwen": 29.142595625040475}, "topk": {"rwkv": [275, 4, 0.03586556017398834, [[45, 0.506669, ",", false], [47, 0.216995, ".", false], [60, 0.040546, ";", false], [275, 0.035866, " (", false], [4715, 0.034542, " or", false], [31601, 0.033976, " over", false], [21265, 0.030495, " and", false], [4596, 0.017488, " in", false], [59, 0.007921, ":", false], [45093, 0.006493, " across", false]]], "qwen": [320, 5, 0.03947778046131134, [[11, 0.466767, ",", false], [13, 0.157859, ".", false], [476, 0.118998, " or", false], [323, 0.048784, " and", false], [320, 0.039478, " (", false], [624, 0.024425, ".\n", false], [304, 0.023464, " in", false], [26, 0.020988, ";", false], [916, 0.012563, " over", false], [25, 0.008847, ":", false]]]}, "raw_delta": 0.040241360664367676, "tuned_delta": 0.048813152694945926}, {"byte_start": 453, "byte_end": 455, "display": {"text": "in", "kind": "normal"}, "is_word": true, "word_id": 77, "word_key": "in", "bytes_hex": "69 6e", "compression": {"rwkv": "27.75% 27.75%", "qwen": "31.87% 31.87%"}, "model_tokens": {"rwkv": [[1950, "in", "normal", 0.046454381197690964]], "qwen": [[258, "in", "normal", 0.029175065457820892]]}, "loss": {"rwkv": 27.754972954602124, "qwen": 31.869503092109046}, "topk": {"rwkv": [1950, 4, 0.046454381197690964, [[2101, 0.249234, "or", false], [7005, 0.057784, "and", false], [106, 0.047246, "i", false], [1950, 0.046454, "in", false], [102, 0.035355, "e", false], [98, 0.031601, "a", false], [1751, 0.029916, "as", false], [36003, 0.027355, "which", false], [8801, 0.023637, "the", false], [1752, 0.017978, "at", false]]], "qwen": [258, 7, 0.029175065457820892, [[269, 0.199894, "or", false], [72, 0.072016, "i", false], [437, 0.065276, "and", false], [300, 0.051478, "as", false], [68, 0.049405, "e", false], [8206, 0.038289, "which", false], [258, 0.029175, "in", false], [4535, 0.027088, "though", false], [1782, 0.021445, "the", false], [1958, 0.018568, "for", false]]]}, "raw_delta": -0.22815799713134766, "tuned_delta": -0.2195862051007694}, {"byte_start": 455, "byte_end": 461, "display": {"text": " which", "kind": "normal"}, "is_word": true, "word_id": 78, "word_key": " which", "bytes_hex": "20 77 68 69 63 68", "compression": {"rwkv": "17.75% 17.75% 17.75% 17.75% 17.75% 17.75%", "qwen": "7.09% 7.09% 7.09% 7.09% 7.09% 7.09%"}, "model_tokens": {"rwkv": [[40186, " which", "normal", 0.0027163508348166943]], "qwen": [[892, " which", "normal", 0.09437352418899536]]}, "loss": {"rwkv": 17.751911635938416, "qwen": 7.0947379523325065}, "topk": {"rwkv": [40186, 45, 0.0027163508348166943, [[22590, 0.177608, " the", false], [30808, 0.075171, " fact", false], [39920, 0.073222, " terms", false], [62293, 0.069717, " particular", false], [32074, 0.042744, " some", false], [39193, 0.040109, " other", false], [332, 0.036753, " a", false], [32251, 0.031779, " time", false], [56901, 0.025685, " practice", false], [55856, 0.025613, " contrast", false]]], "qwen": [892, 3, 0.09437352418899536, [[279, 0.158246, " the", false], [2097, 0.094419, " fact", false], [892, 0.094374, " which", false], [3793, 0.060052, " terms", false], [6588, 0.042931, " practice", false], [264, 0.037449, " a", false], [37555, 0.036592, "dependent", false], [1045, 0.031777, " some", false], [1008, 0.031536, " other", false], [12872, 0.027771, " contrast", false]]]}, "raw_delta": 0.5909591913223267, "tuned_delta": 0.5995309833529049}, {"byte_start": 461, "byte_end": 466, "display": {"text": " case", "kind": "normal"}, "is_word": true, "word_id": 79, "word_key": " case", "bytes_hex": "20 63 61 73 65", "compression": {"rwkv": "0.13% 0.13% 0.13% 0.13% 0.13%", "qwen": "0.09% 0.09% 0.09% 0.09% 0.09%"}, "model_tokens": {"rwkv": [[30405, " case", "normal", 0.9655082821846008]], "qwen": [[1142, " case", "normal", 0.9761645793914795]]}, "loss": {"rwkv": 0.12591881765571397, "qwen": 0.08700916041125867}, "topk": {"rwkv": [30405, 1, 0.9655082821846008, [[30405, 0.965508, " case", false], [22590, 0.005911, " the", false], [4601, 0.00319, " it", false], [4858, 0.001724, " we", false], [37045, 0.001544, " Moore", false], [37970, 0.001112, " cases", false], [39631, 0.000927, " sense", false], [39934, 0.000776, " there", false], [332, 0.000761, " a", false], [45, 0.000534, ",", false]]], "qwen": [1142, 1, 0.9761645793914795, [[1142, 0.976165, " case", false], [432, 0.004039, " it", false], [279, 0.00354, " the", false], [5048, 0.002521, " cases", false], [374, 0.000955, " is", false], [582, 0.000813, " we", false], [11, 0.000769, ",", false], [5530, 0.000749, " sense", false], [498, 0.000373, " you", false], [678, 0.000372, " all", false]]]}, "raw_delta": 0.0021576095372438436, "tuned_delta": 0.010729401567822091}, {"byte_start": 466, "byte_end": 477, "display": {"text": " leveraging", "kind": "normal"}, "is_word": true, "word_id": 80, "word_key": " leveraging", "bytes_hex": "20 6c 65 76 65 72 61 67 69 6e 67", "compression": {"rwkv": "25.92% 25.92% 25.92% 25.92% 25.92% 25.92% 0.12% 0.12% 0.12% 0.12% 0.12%", "qwen": "13.60% 13.60% 13.60% 13.60% 13.60% 13.60% 13.60% 13.60% 13.60% 13.60% 13.60%"}, "model_tokens": {"rwkv": [[38888, " lever", "normal", 0.00018302799435332417], [33672, "aging", "normal", 0.9668365120887756]], "qwen": [[76482, " leveraging", "normal", 0.0002496717497706413]]}, "loss": {"rwkv": 14.195685650970148, "qwen": 13.59963599700304}, "topk": {"rwkv": [38888, 281, 0.00018302799435332417, [[22590, 0.243117, " the", false], [45, 0.114183, ",", false], [4601, 0.110919, " it", false], [4858, 0.044102, " we", false], [39934, 0.037523, " there", false], [22799, 0.02861, " you", false], [332, 0.020253, " a", false], [22226, 0.018473, " one", false], [3609, 0.013339, " AI", false], [21273, 0.012267, " any", false]]], "qwen": [76482, 226, 0.0002496717497706413, [[11, 0.249015, ",", false], [279, 0.172923, " the", false], [432, 0.080018, " it", false], [582, 0.052138, " we", false], [264, 0.025589, " a", false], [498, 0.025274, " you", false], [1052, 0.022696, " there", false], [825, 0.012884, " one", false], [1429, 0.012434, " most", false], [678, 0.010484, " all", false]]]}, "raw_delta": 0.03305201096968225, "tuned_delta": 0.0416238030002605}, {"byte_start": 477, "byte_end": 483, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 81, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "17.38% 17.38% 17.38% 17.38% 17.38% 17.38%", "qwen": "20.96% 20.96% 20.96% 20.96% 20.96% 20.96%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.0030587823130190372]], "qwen": [[3738, " human", "normal", 0.0009363950230181217]]}, "loss": {"rwkv": 17.37620980237358, "qwen": 20.959572955879473}, "topk": {"rwkv": [38720, 22, 0.0030587823130190372, [[63370, 0.494007, " computation", false], [22590, 0.091681, " the", false], [4601, 0.030275, " it", false], [51832, 0.028739, " general", false], [31458, 0.026942, " more", false], [64862, 0.018743, " computational", false], [32227, 0.016501, " that", false], [37045, 0.015856, " Moore", false], [3609, 0.010519, " AI", false], [51266, 0.009519, " compute", false]]], "qwen": [3738, 62, 0.0009363950230181217, [[34447, 0.467746, " computation", false], [432, 0.120113, " it", false], [279, 0.068171, " the", false], [803, 0.032484, " more", false], [264, 0.021402, " a", false], [54480, 0.01602, " computational", false], [429, 0.011881, " that", false], [24231, 0.01097, " computing", false], [4586, 0.008736, " general", false], [374, 0.008231, " is", false]]]}, "raw_delta": -0.19870384534200036, "tuned_delta": -0.1901320533114221}, {"byte_start": 483, "byte_end": 493, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 82, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "4.93% 4.93% 4.93% 4.93% 4.93% 4.93% 4.93% 4.93% 4.93% 4.93%", "qwen": "4.41% 4.41% 4.41% 4.41% 4.41% 4.41% 4.41% 4.41% 4.41% 4.41%"}, "model_tokens": {"rwkv": [[59943, " knowledge", "normal", 0.06464724987745285]], "qwen": [[6540, " knowledge", "normal", 0.08692403882741928]]}, "loss": {"rwkv": 4.931086565538449, "qwen": 4.405126212973418}, "topk": {"rwkv": [59943, 3, 0.06464724987745285, [[64452, 0.161429, " intelligence", false], [46, 0.126777, "-", false], [59943, 0.064647, " knowledge", false], [63370, 0.054055, " computation", false], [38853, 0.05125, " labor", false], [59917, 0.04144, " intuition", false], [59683, 0.02794, " expertise", false], [52022, 0.02161, " insight", false], [38775, 0.019138, " ingen", false], [59304, 0.018953, " cognition", false]]], "qwen": [6540, 3, 0.08692403882741928, [[11229, 0.127482, " intelligence", false], [18726, 0.106964, " expertise", false], [6540, 0.086924, " knowledge", false], [34447, 0.051886, " computation", false], [9327, 0.038036, " labor", false], [56251, 0.029934, " intuition", false], [20017, 0.020528, " insight", false], [27597, 0.01394, " creativity", false], [6203, 0.01205, " expert", false], [23389, 0.011551, " wisdom", false]]]}, "raw_delta": 0.029165434837341297, "tuned_delta": 0.03773722686791955}, {"byte_start": 493, "byte_end": 499, "display": {"text": " would", "kind": "normal"}, "is_word": true, "word_id": 83, "word_key": " would", "bytes_hex": "20 77 6f 75 6c 64", "compression": {"rwkv": "7.84% 7.84% 7.84% 7.84% 7.84% 7.84%", "qwen": "4.58% 4.58% 4.58% 4.58% 4.58% 4.58%"}, "model_tokens": {"rwkv": [[40219, " would", "normal", 0.07254761457443237]], "qwen": [[1035, " would", "normal", 0.21791388094425201]]}, "loss": {"rwkv": 7.842775775665913, "qwen": 4.579520705536263}, "topk": {"rwkv": [40219, 3, 0.07254761457443237, [[4600, 0.283654, " is", false], [21265, 0.121108, " and", false], [40219, 0.072548, " would", false], [4811, 0.044603, " to", false], [45, 0.034357, ",", false], [22748, 0.029148, " was", false], [4715, 0.02871, " or", false], [4596, 0.027646, " in", false], [4706, 0.021113, " of", false], [21413, 0.020752, " can", false]]], "qwen": [1035, 1, 0.21791388094425201, [[1035, 0.217914, " would", false], [374, 0.210744, " is", false], [323, 0.095186, " and", false], [311, 0.050285, " to", false], [11, 0.038354, ",", false], [476, 0.036735, " or", false], [572, 0.023529, " was", false], [304, 0.022526, " in", false], [4566, 0.020117, " via", false], [911, 0.017185, " about", false]]]}, "raw_delta": 0.18095328410466507, "tuned_delta": 0.18952507613524333}, {"byte_start": 499, "byte_end": 502, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 84, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"rwkv": "2.61% 2.61% 2.61%", "qwen": "2.55% 2.55% 2.55%"}, "model_tokens": {"rwkv": [[4435, " be", "normal", 0.6493578553199768]], "qwen": [[387, " be", "normal", 0.6547784805297852]]}, "loss": {"rwkv": 2.606431470356037, "qwen": 2.5455050039505354}, "topk": {"rwkv": [4435, 1, 0.6493578553199768, [[4435, 0.649358, " be", false], [31059, 0.078901, " have", false], [22187, 0.022228, " not", false], [31358, 0.014631, " make", false], [39820, 0.013749, " still", false], [45150, 0.013105, " always", false], [31967, 0.012157, " seem", false], [31581, 0.008333, " only", false], [52724, 0.006661, " require", false], [53056, 0.005835, " suffice", false]]], "qwen": [387, 1, 0.6547784805297852, [[387, 0.654778, " be", false], [614, 0.071888, " have", false], [537, 0.016801, " not", false], [2058, 0.015372, " still", false], [76156, 0.012673, " suffice", false], [1281, 0.011296, " make", false], [2677, 0.010566, " always", false], [2803, 0.008881, " seem", false], [4658, 0.008868, " probably", false], [4363, 0.008818, " likely", false]]]}, "raw_delta": 0.0033784806728363037, "tuned_delta": 0.011950272703414552}, {"byte_start": 502, "byte_end": 506, "display": {"text": " one", "kind": "normal"}, "is_word": true, "word_id": 85, "word_key": " one", "bytes_hex": "20 6f 6e 65", "compression": {"rwkv": "25.92% 25.92% 25.92% 25.92%", "qwen": "30.48% 30.48% 30.48% 30.48%"}, "model_tokens": {"rwkv": [[22226, " one", "normal", 0.003145243041217327]], "qwen": [[825, " one", "normal", 0.0011593190720304847]]}, "loss": {"rwkv": 25.92342651597356, "qwen": 30.476583356024122}, "topk": {"rwkv": [22226, 47, 0.003145243041217327, [[22590, 0.309162, " the", false], [332, 0.095442, " a", false], [52371, 0.032758, " optimal", false], [31458, 0.032095, " more", false], [31461, 0.028556, " most", false], [4419, 0.023288, " an", false], [31466, 0.016389, " much", false], [62606, 0.015595, " sufficient", false], [32386, 0.015147, " very", false], [59829, 0.013637, " important", false]]], "qwen": [825, 67, 0.0011593190720304847, [[279, 0.387049, " the", false], [803, 0.096544, " more", false], [264, 0.065433, " a", false], [22823, 0.037437, " optimal", false], [1429, 0.022295, " most", false], [458, 0.016741, " an", false], [1753, 0.01659, " much", false], [14016, 0.016242, " sufficient", false], [3041, 0.015432, " far", false], [2664, 0.014423, " better", false]]]}, "raw_delta": -0.2524806261062622, "tuned_delta": -0.24390883407568395}, {"byte_start": 506, "byte_end": 509, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 86, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "3.05% 3.05% 3.05%", "qwen": "4.45% 4.45% 4.45%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.6023615598678589]], "qwen": [[315, " of", "normal", 0.4768576920032501]]}, "loss": {"rwkv": 3.052577397714278, "qwen": 4.451538741005137}, "topk": {"rwkv": [4706, 1, 0.6023615598678589, [[4706, 0.602362, " of", false], [22752, 0.073385, " way", false], [39941, 0.05559, " thing", false], [460, 0.03488, "'s", false], [55532, 0.028022, " approach", false], [56895, 0.0144, " possible", false], [46713, 0.012885, " option", false], [46561, 0.01138, " method", false], [57260, 0.010802, " solution", false], [57317, 0.007598, " strategy", false]]], "qwen": [315, 1, 0.4768576920032501, [[315, 0.476858, " of", false], [1616, 0.127351, " way", false], [2999, 0.081661, " option", false], [5486, 0.029032, " approach", false], [6291, 0.027137, " solution", false], [3204, 0.023123, " possible", false], [594, 0.022702, "'s", false], [1714, 0.017687, " method", false], [7373, 0.012969, " effective", false], [8282, 0.008211, " strategy", false]]]}, "raw_delta": -0.07757488886515299, "tuned_delta": -0.06900309683457474}, {"byte_start": 509, "byte_end": 513, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 87, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "0.20% 0.20% 0.20% 0.20%", "qwen": "0.27% 0.27% 0.27% 0.27%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.9564296007156372]], "qwen": [[279, " the", "normal", 0.9428697228431702]]}, "loss": {"rwkv": 0.20142608069052145, "qwen": 0.26521777134132535}, "topk": {"rwkv": [22590, 1, 0.9564296007156372, [[22590, 0.95643, " the", false], [21902, 0.006275, " its", false], [52869, 0.005485, " several", false], [31370, 0.00482, " many", false], [22638, 0.003368, " two", false], [31581, 0.002841, " only", false], [21674, 0.002612, " few", false], [332, 0.002472, " a", false], [45, 0.00179, ",", false], [22248, 0.001758, " our", false]]], "qwen": [279, 1, 0.9428697228431702, [[279, 0.94287, " the", false], [1181, 0.008991, " its", false], [1172, 0.008451, " only", false], [1657, 0.007163, " many", false], [1039, 0.006467, " our", false], [3807, 0.004442, " several", false], [264, 0.00355, " a", false], [697, 0.003538, " your", false], [2421, 0.002282, " few", false], [1378, 0.00215, " two", false]]]}, "raw_delta": -0.003537362441420555, "tuned_delta": 0.005034429589157693}, {"byte_start": 513, "byte_end": 518, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 88, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"rwkv": "12.74% 12.74% 12.74% 12.74% 12.74%", "qwen": "9.09% 9.09% 9.09% 9.09% 9.09%"}, "model_tokens": {"rwkv": [[31581, " only", "normal", 0.02967231720685959]], "qwen": [[1172, " only", "normal", 0.08046524226665497]]}, "loss": {"rwkv": 12.73629215784788, "qwen": 9.08872587431064}, "topk": {"rwkv": [31581, 6, 0.02967231720685959, [[31461, 0.423654, " most", false], [30273, 0.101899, " best", false], [21674, 0.072791, " few", false], [51039, 0.051311, " biggest", false], [31458, 0.032277, " more", false], [31581, 0.029672, " only", false], [31356, 0.026761, " main", false], [51900, 0.013557, " hardest", false], [38879, 0.013002, " least", false], [51718, 0.012076, " fastest", false]]], "qwen": [1172, 4, 0.08046524226665497, [[1429, 0.287685, " most", false], [1850, 0.214394, " best", false], [2421, 0.089719, " few", false], [1172, 0.080465, " only", false], [1887, 0.038782, " main", false], [803, 0.03611, " more", false], [2664, 0.032344, " better", false], [6028, 0.021359, " primary", false], [1376, 0.015158, " key", false], [42049, 0.008197, " cheapest", false]]]}, "raw_delta": 0.20226402282714853, "tuned_delta": 0.2108358148577268}, {"byte_start": 518, "byte_end": 523, "display": {"text": " ways", "kind": "normal"}, "is_word": true, "word_id": 89, "word_key": " ways", "bytes_hex": "20 77 61 79 73", "compression": {"rwkv": "3.66% 3.66% 3.66% 3.66% 3.66%", "qwen": "6.60% 6.60% 6.60% 6.60% 6.60%"}, "model_tokens": {"rwkv": [[32448, " ways", "normal", 0.36083072423934937]], "qwen": [[5510, " ways", "normal", 0.16065028309822083]]}, "loss": {"rwkv": 3.6630928772571334, "qwen": 6.59501140337346}, "topk": {"rwkv": [32448, 1, 0.36083072423934937, [[32448, 0.360831, " ways", false], [59593, 0.078728, " effective", false], [47539, 0.069458, " things", false], [52373, 0.038043, " options", false], [52957, 0.023711, " sources", false], [56895, 0.02279, " possible", false], [47720, 0.021107, " viable", false], [52224, 0.020653, " methods", false], [60376, 0.019046, " remaining", false], [56212, 0.009926, " feasible", false]]], "qwen": [5510, 2, 0.16065028309822083, [[2606, 0.185292, " options", false], [5510, 0.16065, " ways", false], [7373, 0.121537, " effective", false], [30428, 0.061611, " viable", false], [5413, 0.035611, " methods", false], [3363, 0.030889, " means", false], [19827, 0.029106, " approaches", false], [3204, 0.028069, " possible", false], [2513, 0.027952, " things", false], [4586, 0.015256, " general", false]]]}, "raw_delta": -0.16258008480072023, "tuned_delta": -0.15400829277014197}, {"byte_start": 523, "byte_end": 526, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 90, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "1.25% 1.25% 1.25%", "qwen": "1.50% 1.50% 1.50%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.8142113089561462]], "qwen": [[311, " to", "normal", 0.7796909809112549]]}, "loss": {"rwkv": 1.2503826648329637, "qwen": 1.4959401207549632}, "topk": {"rwkv": [4811, 1, 0.8142113089561462, [[4811, 0.814211, " to", false], [4706, 0.04424, " of", false], [21700, 0.041475, " for", false], [4596, 0.02162, " in", false], [32227, 0.014735, " that", false], [22590, 0.010563, " the", false], [22799, 0.00714, " you", false], [51791, 0.005268, " forward", false], [4601, 0.004944, " it", false], [4858, 0.004208, " we", false]]], "qwen": [311, 1, 0.7796909809112549, [[311, 0.779691, " to", false], [315, 0.058685, " of", false], [429, 0.026445, " that", false], [582, 0.012324, " we", false], [458, 0.011095, " an", false], [369, 0.010228, " for", false], [498, 0.009548, " you", false], [4637, 0.009054, " forward", false], [701, 0.008555, "),", false], [279, 0.007961, " the", false]]]}, "raw_delta": -0.013616596659024552, "tuned_delta": -0.005044804628446304}, {"byte_start": 526, "byte_end": 534, "display": {"text": " improve", "kind": "normal"}, "is_word": true, "word_id": 91, "word_key": " improve", "bytes_hex": "20 69 6d 70 72 6f 76 65", "compression": {"rwkv": "3.15% 3.15% 3.15% 3.15% 3.15% 3.15% 3.15% 3.15%", "qwen": "3.96% 3.96% 3.96% 3.96% 3.96% 3.96% 3.96% 3.96%"}, "model_tokens": {"rwkv": [[51982, " improve", "normal", 0.24621953070163727]], "qwen": [[7269, " improve", "normal", 0.17285309731960297]]}, "loss": {"rwkv": 3.1523731972549367, "qwen": 3.9568462317260016}, "topk": {"rwkv": [51982, 1, 0.24621953070163727, [[51982, 0.24622, " improve", false], [21751, 0.111641, " get", false], [31358, 0.076892, " make", false], [30938, 0.068315, " gain", false], [56433, 0.067356, " increase", false], [50848, 0.02381, " achieve", false], [37886, 0.019291, " boost", false], [39590, 0.016851, " scale", false], [46694, 0.014257, " obtain", false], [56950, 0.011286, " progress", false]]], "qwen": [7269, 1, 0.17285309731960297, [[7269, 0.172853, " improve", false], [1281, 0.086589, " make", false], [633, 0.077066, " get", false], [8722, 0.046208, " gain", false], [11075, 0.041978, " achieve", false], [32064, 0.035684, " leverage", false], [653, 0.034434, " do", false], [11625, 0.030462, " solve", false], [7949, 0.025845, " reduce", false], [11912, 0.017287, " advance", false]]]}, "raw_delta": -0.04460945725440979, "tuned_delta": -0.03603766522383154}, {"byte_start": 534, "byte_end": 546, "display": {"text": " performance", "kind": "normal"}, "is_word": true, "word_id": 92, "word_key": " performance", "bytes_hex": "20 70 65 72 66 6f 72 6d 61 6e 63 65", "compression": {"rwkv": "1.50% 1.50% 1.50% 1.50% 1.50% 1.50% 1.50% 1.50% 1.50% 1.50% 1.50% 1.50%", "qwen": "0.92% 0.92% 0.92% 0.92% 0.92% 0.92% 0.92% 0.92% 0.92% 0.92% 0.92% 0.92%"}, "model_tokens": {"rwkv": [[63750, " performance", "normal", 0.36821308732032776]], "qwen": [[5068, " performance", "normal", 0.5418747663497925]]}, "loss": {"rwkv": 1.4969369931098861, "qwen": 0.9208005767516142}, "topk": {"rwkv": [63750, 1, 0.36821308732032776, [[63750, 0.368213, " performance", false], [22590, 0.107144, " the", false], [499, 0.100461, ").", false], [497, 0.084869, "),", false], [37636, 0.040538, " agent", false], [21902, 0.026867, " its", false], [42, 0.024772, ")", false], [3609, 0.021786, " AI", false], [52738, 0.016742, " results", false], [4712, 0.014022, " on", false]]], "qwen": [5068, 1, 0.5418747663497925, [[5068, 0.541875, " performance", false], [279, 0.105896, " the", false], [458, 0.056244, " an", false], [6832, 0.034256, " learning", false], [264, 0.028226, " a", false], [701, 0.014869, "),", false], [8315, 0.01308, " agent", false], [3059, 0.012277, " results", false], [432, 0.011117, " it", false], [1181, 0.009955, " its", false]]]}, "raw_delta": 0.03194778660933177, "tuned_delta": 0.04051957863991002}, {"byte_start": 546, "byte_end": 547, "display": {"text": ")", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29", "compression": {"rwkv": "52.13%", "qwen": "38.82%"}, "model_tokens": {"rwkv": [[42, ")", "normal", 0.05620365962386131]], "qwen": [[8, ")", "normal", 0.1161569133400917]]}, "loss": {"rwkv": 52.12862940712074, "qwen": 38.82316582572192}, "topk": {"rwkv": [42, 3, 0.05620365962386131, [[499, 0.436642, ").", false], [497, 0.350471, "),", false], [42, 0.056204, ")", false], [45, 0.039232, ",", false], [502, 0.022127, ");", false], [580, 0.012594, ".)", false], [31601, 0.004716, " over", false], [4712, 0.004529, " on", false], [45302, 0.003999, " beyond", false], [53356, 0.003695, " without", false]]], "qwen": [8, 3, 0.1161569133400917, [[701, 0.481042, "),", false], [568, 0.212925, ").", false], [8, 0.116157, ")", false], [11, 0.039897, ",", false], [4292, 0.036839, ").\n", false], [1215, 0.015695, ");", false], [11941, 0.009442, " significantly", false], [304, 0.008665, " in", false], [389, 0.006226, " on", false], [26, 0.005549, ";", false]]]}, "raw_delta": 0.7378115653991699, "tuned_delta": 0.7463833574297482}, {"byte_start": 547, "byte_end": 551, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 93, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"rwkv": "6.97% 6.97% 6.97% 6.97%", "qwen": "8.82% 8.82% 8.82% 8.82%"}, "model_tokens": {"rwkv": [[21400, " but", "normal", 0.21142247319221497]], "qwen": [[714, " but", "normal", 0.1414593905210495]]}, "loss": {"rwkv": 6.9739652855472345, "qwen": 8.817312958699693}, "topk": {"rwkv": [21400, 3, 0.21142247319221497, [[4715, 0.267768, " or", false], [21265, 0.226245, " and", false], [21400, 0.211422, " but", false], [47001, 0.030983, " rather", false], [40187, 0.030587, " while", false], [32465, 0.027229, " when", false], [53339, 0.01865, " whereas", false], [280, 0.015949, " -", false], [40186, 0.015909, " which", false], [4788, 0.014765, " so", false]]], "qwen": [714, 3, 0.1414593905210495, [[476, 0.532945, " or", false], [323, 0.185605, " and", false], [714, 0.141459, " but", false], [4751, 0.02819, " rather", false], [1177, 0.011847, " --", false], [1959, 0.011388, " —", false], [481, 0.010769, " -", false], [1365, 0.006627, " –", false], [19853, 0.006069, " whereas", false], [448, 0.005423, " with", false]]]}, "raw_delta": -0.10221689939498901, "tuned_delta": -0.09364510736441077}, {"byte_start": 551, "byte_end": 552, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "71.01%", "qwen": "57.75%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.01958964765071869]], "qwen": [[11, ",", "normal", 0.04066253453493118]]}, "loss": {"rwkv": 71.00764654375367, "qwen": 57.75195044194827}, "topk": {"rwkv": [45, 9, 0.01958964765071869, [[4596, 0.17061, " in", false], [32234, 0.147972, " this", false], [22590, 0.133822, " the", false], [32227, 0.077687, " that", false], [37045, 0.043538, " Moore", false], [4601, 0.039977, " it", false], [4423, 0.029204, " as", false], [4858, 0.026044, " we", false], [45, 0.01959, ",", false], [39934, 0.011875, " there", false]]], "qwen": [11, 6, 0.04066253453493118, [[304, 0.159878, " in", false], [279, 0.15586, " the", false], [419, 0.107942, " this", false], [438, 0.055029, " as", false], [429, 0.041814, " that", false], [11, 0.040663, ",", false], [432, 0.035516, " it", false], [582, 0.022734, " we", false], [448, 0.02131, " with", false], [1052, 0.014629, " there", false]]]}, "raw_delta": 0.7350518703460693, "tuned_delta": 0.7436236623766476}, {"byte_start": 552, "byte_end": 557, "display": {"text": " over", "kind": "normal"}, "is_word": true, "word_id": 94, "word_key": " over", "bytes_hex": "20 6f 76 65 72", "compression": {"rwkv": "19.16% 19.16% 19.16% 19.16% 19.16%", "qwen": "16.27% 16.27% 16.27% 16.27% 16.27%"}, "model_tokens": {"rwkv": [[31601, " over", "normal", 0.004932222422212362]], "qwen": [[916, " over", "normal", 0.010989399626851082]]}, "loss": {"rwkv": 19.160793511806542, "qwen": 16.269359271746694}, "topk": {"rwkv": [31601, 21, 0.004932222422212362, [[4596, 0.326112, " in", false], [4423, 0.296477, " as", false], [4706, 0.035262, " of", false], [32487, 0.018424, " with", false], [47532, 0.01812, " thanks", false], [21700, 0.016462, " for", false], [4588, 0.011504, " if", false], [4450, 0.009814, " by", false], [4811, 0.009197, " to", false], [4424, 0.008497, " at", false]]], "qwen": [916, 16, 0.010989399626851082, [[438, 0.261753, " as", false], [304, 0.210697, " in", false], [448, 0.049432, " with", false], [2474, 0.032234, " since", false], [369, 0.026634, " for", false], [2661, 0.020306, " given", false], [315, 0.019959, " of", false], [4518, 0.019633, " instead", false], [553, 0.016233, " by", false], [9339, 0.015698, " thanks", false]]]}, "raw_delta": 0.1603351593017578, "tuned_delta": 0.16890695133233605}, {"byte_start": 557, "byte_end": 559, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 95, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "40.86% 40.86%", "qwen": "44.14% 44.14%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.010926105082035065]], "qwen": [[264, " a", "normal", 0.007482042536139488]]}, "loss": {"rwkv": 40.857574400175714, "qwen": 44.1396999083741}, "topk": {"rwkv": [332, 5, 0.010926105082035065, [[22590, 0.661074, " the", false], [32251, 0.19141, " time", false], [3543, 0.027993, " 70", false], [51396, 0.013112, " decades", false], [332, 0.010926, " a", false], [32234, 0.0098, " this", false], [21265, 0.007761, " and", false], [37045, 0.005412, " Moore", false], [21256, 0.004755, " all", false], [31370, 0.004583, " many", false]]], "qwen": [264, 3, 0.007482042536139488, [[279, 0.658494, " the", false], [882, 0.28459, " time", false], [264, 0.007482, " a", false], [323, 0.004873, " and", false], [3213, 0.004735, " recent", false], [1657, 0.00455, " many", false], [220, 0.004311, " ", false], [10793, 0.00318, " decades", false], [1429, 0.002201, " most", false], [1293, 0.001318, " long", false]]]}, "raw_delta": -0.18199968338012695, "tuned_delta": -0.1734278913495487}, {"byte_start": 559, "byte_end": 568, "display": {"text": " slightly", "kind": "normal"}, "is_word": true, "word_id": 96, "word_key": " slightly", "bytes_hex": "20 73 6c 69 67 68 74 6c 79", "compression": {"rwkv": "16.41% 16.41% 16.41% 16.41% 16.41% 16.41% 16.41% 16.41% 16.41%", "qwen": "18.33% 18.33% 18.33% 18.33% 18.33% 18.33% 18.33% 18.33% 18.33%"}, "model_tokens": {"rwkv": [[57245, " slightly", "normal", 0.00027180774486623704]], "qwen": [[10078, " slightly", "normal", 0.00010625468712532893]]}, "loss": {"rwkv": 16.405646732331093, "qwen": 18.333591357686608}, "topk": {"rwkv": [57245, 160, 0.00027180774486623704, [[3543, 0.352651, " 70", false], [46790, 0.081259, " period", false], [31323, 0.072853, " long", false], [32251, 0.028968, " time", false], [32386, 0.028762, " very", false], [51158, 0.027304, " century", false], [46470, 0.024455, " longer", false], [32470, 0.019755, " wide", false], [39962, 0.019684, " times", false], [38864, 0.017952, " large", false]]], "qwen": [10078, 244, 0.00010625468712532893, [[4168, 0.154879, " period", false], [1293, 0.103377, " long", false], [9390, 0.074917, " span", false], [220, 0.070935, " ", false], [9294, 0.047748, " century", false], [3460, 0.046555, " large", false], [1602, 0.043272, " very", false], [2421, 0.028123, " few", false], [1753, 0.024449, " much", false], [6884, 0.024078, " wide", false]]]}, "raw_delta": -0.10690795050726998, "tuned_delta": -0.09833615847669173}, {"byte_start": 568, "byte_end": 575, "display": {"text": " longer", "kind": "normal"}, "is_word": true, "word_id": 97, "word_key": " longer", "bytes_hex": "20 6c 6f 6e 67 65 72", "compression": {"rwkv": "0.54% 0.54% 0.54% 0.54% 0.54% 0.54% 0.54%", "qwen": "1.14% 1.14% 1.14% 1.14% 1.14% 1.14% 1.14%"}, "model_tokens": {"rwkv": [[46470, " longer", "normal", 0.8115249872207642]], "qwen": [[5021, " longer", "normal", 0.6415794491767883]]}, "loss": {"rwkv": 0.5409100059136565, "qwen": 1.1433932558448097}, "topk": {"rwkv": [46470, 1, 0.8115249872207642, [[46470, 0.811525, " longer", false], [52888, 0.062396, " shorter", false], [46397, 0.029515, " larger", false], [31458, 0.02152, " more", false], [40192, 0.012926, " wider", false], [59513, 0.008585, " different", false], [51093, 0.007774, " broader", false], [31277, 0.007634, " less", false], [52932, 0.006084, " smaller", false], [56189, 0.005376, " extended", false]]], "qwen": [5021, 1, 0.6415794491767883, [[5021, 0.641579, " longer", false], [23327, 0.093429, " shorter", false], [803, 0.051857, " more", false], [2155, 0.041469, " different", false], [8131, 0.029925, " larger", false], [11577, 0.017777, " extended", false], [2686, 0.014145, " less", false], [9155, 0.013051, " smaller", false], [21864, 0.009469, " wider", false], [26829, 0.005714, " broader", false]]]}, "raw_delta": -0.03340876528194973, "tuned_delta": -0.024836973251371477}, {"byte_start": 575, "byte_end": 580, "display": {"text": " time", "kind": "normal"}, "is_word": true, "word_id": 98, "word_key": " time", "bytes_hex": "20 74 69 6d 65", "compression": {"rwkv": "2.86% 2.86% 2.86% 2.86% 2.86%", "qwen": "2.15% 2.15% 2.15% 2.15% 2.15%"}, "model_tokens": {"rwkv": [[32251, " time", "normal", 0.45157119631767273]], "qwen": [[882, " time", "normal", 0.551668107509613]]}, "loss": {"rwkv": 2.8600302080123003, "qwen": 2.145318681147023}, "topk": {"rwkv": [32251, 1, 0.45157119631767273, [[32251, 0.451571, " time", false], [46790, 0.231621, " period", false], [39962, 0.15603, " times", false], [51940, 0.057501, " horizon", false], [51929, 0.012244, " history", false], [57431, 0.010235, " timeline", false], [32219, 0.009432, " term", false], [32091, 0.006999, " span", false], [62061, 0.004207, " historical", false], [46, 0.004151, "-", false]]], "qwen": [882, 1, 0.551668107509613, [[882, 0.551668, " time", false], [3039, 0.204437, " times", false], [4168, 0.095723, " period", false], [4647, 0.016563, " term", false], [69953, 0.015943, " timeframe", false], [34074, 0.01331, " horizon", false], [9390, 0.011896, " span", false], [3840, 0.010853, " history", false], [13656, 0.010749, " historical", false], [1651, 0.009354, " view", false]]]}, "raw_delta": 0.03963202238082886, "tuned_delta": 0.04820381441140711}, {"byte_start": 580, "byte_end": 585, "display": {"text": " than", "kind": "normal"}, "is_word": true, "word_id": 99, "word_key": " than", "bytes_hex": "20 74 68 61 6e", "compression": {"rwkv": "18.71% 18.71% 18.71% 18.71% 18.71%", "qwen": "18.76% 18.76% 18.76% 18.76% 18.76%"}, "model_tokens": {"rwkv": [[32226, " than", "normal", 0.005589666310697794]], "qwen": [[1091, " than", "normal", 0.005510401912033558]]}, "loss": {"rwkv": 18.709951311528744, "qwen": 18.759066116962142}, "topk": {"rwkv": [32226, 11, 0.005589666310697794, [[51940, 0.228612, " horizon", false], [38549, 0.175132, " frame", false], [39590, 0.152856, " scale", false], [46790, 0.144326, " period", false], [34478, 0.11341, "frame", false], [32091, 0.061881, " span", false], [46, 0.059069, "-", false], [45, 0.023141, ",", false], [47797, 0.00688, " window", false], [56485, 0.006755, " interval", false]]], "qwen": [1091, 9, 0.005510401912033558, [[34074, 0.294978, " horizon", false], [5452, 0.278795, " scale", false], [4168, 0.118818, " period", false], [4034, 0.117693, " frame", false], [9390, 0.071881, " span", false], [11, 0.034453, ",", false], [12934, 0.018418, "-scale", false], [3241, 0.006431, " window", false], [1091, 0.00551, " than", false], [46767, 0.005317, "-frame", false]]]}, "raw_delta": -0.002723503112792791, "tuned_delta": 0.005848288917785457}, {"byte_start": 585, "byte_end": 587, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 100, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "33.11% 33.11%", "qwen": "33.10% 33.10%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.025658704340457916]], "qwen": [[264, " a", "normal", 0.025462068617343903]]}, "loss": {"rwkv": 33.10872408290101, "qwen": 33.09691532413615}, "topk": {"rwkv": [332, 8, 0.025658704340457916, [[22590, 0.213247, " the", false], [37045, 0.177998, " Moore", false], [32227, 0.119683, " that", false], [3543, 0.097836, " 70", false], [32234, 0.036235, " this", false], [4858, 0.034825, " we", false], [4601, 0.030683, " it", false], [332, 0.025659, " a", false], [22799, 0.02395, " you", false], [22226, 0.014899, " one", false]]], "qwen": [264, 9, 0.025462068617343903, [[20219, 0.190439, " Moore", false], [279, 0.189425, " the", false], [429, 0.086501, " that", false], [220, 0.058331, " ", false], [1429, 0.044907, " most", false], [582, 0.042566, " we", false], [358, 0.041866, " I", false], [1128, 0.027468, " what", false], [264, 0.025462, " a", false], [374, 0.022678, " is", false]]]}, "raw_delta": 0.0006548166275024414, "tuned_delta": 0.00922660865808069}, {"byte_start": 587, "byte_end": 595, "display": {"text": " typical", "kind": "normal"}, "is_word": true, "word_id": 101, "word_key": " typical", "bytes_hex": "20 74 79 70 69 63 61 6c", "compression": {"rwkv": "6.66% 6.66% 6.66% 6.66% 6.66% 6.66% 6.66% 6.66%", "qwen": "2.64% 2.64% 2.64% 2.64% 2.64% 2.64% 2.64% 2.64%"}, "model_tokens": {"rwkv": [[53216, " typical", "normal", 0.05195503309369087]], "qwen": [[14260, " typical", "normal", 0.30994606018066406]]}, "loss": {"rwkv": 6.656966863476906, "qwen": 2.640485647564225}, "topk": {"rwkv": [53216, 5, 0.05195503309369087, [[38720, 0.225584, " human", false], [51158, 0.140021, " century", false], [45674, 0.123761, " decade", false], [47289, 0.055681, " single", false], [53216, 0.051955, " typical", false], [3543, 0.046264, " 70", false], [32512, 0.041299, " year", false], [21674, 0.026703, " few", false], [62035, 0.023279, " generation", false], [56546, 0.022834, " lifetime", false]]], "qwen": [14260, 1, 0.30994606018066406, [[14260, 0.309946, " typical", false], [3175, 0.145236, " single", false], [3738, 0.103433, " human", false], [13212, 0.090959, " decade", false], [9471, 0.052553, " generation", false], [2421, 0.034489, " few", false], [9294, 0.033726, " century", false], [8338, 0.02265, " quarter", false], [6931, 0.017734, " career", false], [19031, 0.015397, " lifetime", false]]]}, "raw_delta": 0.22272101044654846, "tuned_delta": 0.23129280247712672}, {"byte_start": 595, "byte_end": 604, "display": {"text": " research", "kind": "normal"}, "is_word": true, "word_id": 102, "word_key": " research", "bytes_hex": "20 72 65 73 65 61 72 63 68", "compression": {"rwkv": "4.60% 4.60% 4.60% 4.60% 4.60% 4.60% 4.60% 4.60% 4.60%", "qwen": "4.11% 4.11% 4.11% 4.11% 4.11% 4.11% 4.11% 4.11% 4.11%"}, "model_tokens": {"rwkv": [[57103, " research", "normal", 0.10117557644844055]], "qwen": [[3412, " research", "normal", 0.12872017920017242]]}, "loss": {"rwkv": 4.602347461169218, "qwen": 4.107902594964088}, "topk": {"rwkv": [57103, 3, 0.10117557644844055, [[38720, 0.224203, " human", false], [3609, 0.155414, " AI", false], [57103, 0.101176, " research", false], [45418, 0.064269, " career", false], [56546, 0.034277, " lifetime", false], [37636, 0.032286, " agent", false], [46795, 0.023784, " person", false], [55427, 0.022258, " academic", false], [62496, 0.017639, " researcher", false], [31293, 0.016912, " life", false]]], "qwen": [3412, 1, 0.12872017920017242, [[3412, 0.12872, " research", false], [15235, 0.117699, " AI", false], [14250, 0.113605, " academic", false], [29561, 0.081167, " PhD", false], [3738, 0.06284, " human", false], [5567, 0.053965, " paper", false], [6931, 0.045386, " career", false], [220, 0.019262, " ", false], [31085, 0.01882, " researcher", false], [2390, 0.015059, " project", false]]]}, "raw_delta": 0.027417845196194113, "tuned_delta": 0.03598963722677236}, {"byte_start": 604, "byte_end": 612, "display": {"text": " project", "kind": "normal"}, "is_word": true, "word_id": 103, "word_key": " project", "bytes_hex": "20 70 72 6f 6a 65 63 74", "compression": {"rwkv": "6.87% 6.87% 6.87% 6.87% 6.87% 6.87% 6.87% 6.87%", "qwen": "2.24% 2.24% 2.24% 2.24% 2.24% 2.24% 2.24% 2.24%"}, "model_tokens": {"rwkv": [[52581, " project", "normal", 0.04778331145644188]], "qwen": [[2390, " project", "normal", 0.3694009780883789]]}, "loss": {"rwkv": 6.868299144857125, "qwen": 2.2449068743387732}, "topk": {"rwkv": [52581, 3, 0.04778331145644188, [[45418, 0.69158, " career", false], [56546, 0.070966, " lifetime", false], [52581, 0.047783, " project", false], [38172, 0.040292, " cycle", false], [46790, 0.021795, " period", false], [31293, 0.017644, " life", false], [52580, 0.012708, " program", false], [56545, 0.010023, " lifespan", false], [39227, 0.008893, " paper", false], [51136, 0.004323, " careers", false]]], "qwen": [2390, 1, 0.3694009780883789, [[2390, 0.369401, " project", false], [5567, 0.149084, " paper", false], [6931, 0.101524, " career", false], [2025, 0.099172, " program", false], [10775, 0.03564, " cycle", false], [2083, 0.016677, " team", false], [5041, 0.015622, " effort", false], [4168, 0.014426, " period", false], [4549, 0.013782, " article", false], [18402, 0.012573, " agenda", false]]]}, "raw_delta": 0.2563753053545952, "tuned_delta": 0.2649470973851734}, {"byte_start": 612, "byte_end": 613, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "4.51%", "qwen": "3.30%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.7766553163528442]], "qwen": [[11, ",", "normal", 0.832703709602356]]}, "loss": {"rwkv": 4.50842200277801, "qwen": 3.301560622637448}, "topk": {"rwkv": [45, 1, 0.7766553163528442, [[45, 0.776655, ",", false], [38867, 0.031888, " lasts", false], [40219, 0.021599, " would", false], [275, 0.019371, " (", false], [39751, 0.016786, " spans", false], [460, 0.012185, "'s", false], [4600, 0.007147, " is", false], [4596, 0.006393, " in", false], [39021, 0.006077, " might", false], [32091, 0.006073, " span", false]]], "qwen": [11, 1, 0.832703709602356, [[11, 0.832704, ",", false], [320, 0.039765, " (", false], [1035, 0.012515, " would", false], [39658, 0.008696, " lasts", false], [476, 0.008524, " or", false], [304, 0.005829, " in", false], [60861, 0.005639, " lifespan", false], [323, 0.005504, " and", false], [594, 0.005473, "'s", false], [44295, 0.004554, " spans", false]]]}, "raw_delta": 0.06692260503768921, "tuned_delta": 0.07549439706826745}, {"byte_start": 613, "byte_end": 623, "display": {"text": " massively", "kind": "normal"}, "is_word": true, "word_id": 104, "word_key": " massively", "bytes_hex": "20 6d 61 73 73 69 76 65 6c 79", "compression": {"rwkv": "15.44% 15.44% 15.44% 15.44% 15.44% 15.44% 15.44% 15.44% 15.44% 15.44%", "qwen": "16.97% 16.97% 16.97% 16.97% 16.97% 16.97% 16.97% 16.97% 16.97% 16.97%"}, "model_tokens": {"rwkv": [[59988, " massively", "normal", 0.00019152526510879397]], "qwen": [[63707, " massively", "normal", 8.201191667467356e-05]]}, "loss": {"rwkv": 15.441345359514685, "qwen": 16.967257989641936}, "topk": {"rwkv": [59988, 216, 0.00019152526510879397, [[22590, 0.256342, " the", false], [63370, 0.097579, " computation", false], [32234, 0.088188, " this", false], [37045, 0.069253, " Moore", false], [4858, 0.068895, " we", false], [4601, 0.035164, " it", false], [32227, 0.034894, " that", false], [39934, 0.025479, " there", false], [59346, 0.017852, " computing", false], [3609, 0.015093, " AI", false]]], "qwen": [63707, 349, 8.201191667467356e-05, [[279, 0.314859, " the", false], [419, 0.094283, " this", false], [34447, 0.08315, " computation", false], [20219, 0.059401, " Moore", false], [582, 0.056349, " we", false], [432, 0.035309, " it", false], [429, 0.026882, " that", false], [264, 0.017638, " a", false], [1052, 0.016266, " there", false], [58755, 0.015347, " exponential", false]]]}, "raw_delta": -0.0846145629882813, "tuned_delta": -0.07604277095770305}, {"byte_start": 623, "byte_end": 628, "display": {"text": " more", "kind": "normal"}, "is_word": true, "word_id": 105, "word_key": " more", "bytes_hex": "20 6d 6f 72 65", "compression": {"rwkv": "5.27% 5.27% 5.27% 5.27% 5.27%", "qwen": "5.55% 5.55% 5.55% 5.55% 5.55%"}, "model_tokens": {"rwkv": [[31458, " more", "normal", 0.23121775686740875]], "qwen": [[803, " more", "normal", 0.21473440527915955]]}, "loss": {"rwkv": 5.2692182157467995, "qwen": 5.548436778945468}, "topk": {"rwkv": [31458, 2, 0.23121775686740875, [[56812, 0.313952, " parallel", false], [31458, 0.231218, " more", false], [62092, 0.072949, " increasing", false], [59846, 0.053951, " increased", false], [56418, 0.049645, " improved", false], [56900, 0.023781, " powerful", false], [51178, 0.017607, " cheaper", false], [45301, 0.017191, " better", false], [45961, 0.01161, " faster", false], [59832, 0.011259, " improving", false]]], "qwen": [803, 1, 0.21473440527915955, [[803, 0.214734, " more", false], [23048, 0.151313, " cheaper", false], [7703, 0.085892, " increasing", false], [7172, 0.07638, " increased", false], [15279, 0.059274, " parallel", false], [12944, 0.033619, " improved", false], [4722, 0.026703, " lower", false], [11046, 0.023342, " reduced", false], [17719, 0.021584, " reducing", false], [15679, 0.019332, " falling", false]]]}, "raw_delta": -0.015483164787292503, "tuned_delta": -0.0069113727567142545}, {"byte_start": 628, "byte_end": 640, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 106, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75% 1.75%", "qwen": "0.69% 0.69% 0.69% 0.69% 0.69% 0.69% 0.69% 0.69% 0.69% 0.69% 0.69% 0.69%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.3156513571739197]], "qwen": [[34447, " computation", "normal", 0.6322945952415466]]}, "loss": {"rwkv": 1.7493616625362591, "qwen": 0.6888867195008749}, "topk": {"rwkv": [63370, 1, 0.3156513571739197, [[63370, 0.315651, " computation", false], [59346, 0.137415, " computing", false], [51266, 0.083689, " compute", false], [64862, 0.048811, " computational", false], [56900, 0.037103, " powerful", false], [60406, 0.033935, " resources", false], [39339, 0.021235, " power", false], [21265, 0.016942, " and", false], [4600, 0.015517, " is", false], [59345, 0.014426, " computers", false]]], "qwen": [34447, 1, 0.6322945952415466, [[34447, 0.632295, " computation", false], [24231, 0.092921, " computing", false], [54480, 0.077247, " computational", false], [7988, 0.025779, " powerful", false], [2355, 0.017244, " power", false], [4963, 0.011984, " resources", false], [12564, 0.009854, " compute", false], [374, 0.006309, " is", false], [6366, 0.005893, " computer", false], [82599, 0.005062, " computations", false]]]}, "raw_delta": 0.058805217345555626, "tuned_delta": 0.06737700937613388}, {"byte_start": 640, "byte_end": 651, "display": {"text": " inevitably", "kind": "normal"}, "is_word": true, "word_id": 107, "word_key": " inevitably", "bytes_hex": "20 69 6e 65 76 69 74 61 62 6c 79", "compression": {"rwkv": "19.78% 19.78% 19.78% 19.78% 19.78% 19.78% 19.78% 19.78% 19.78% 19.78% 19.78%", "qwen": "18.37% 18.37% 18.37% 18.37% 18.37% 18.37% 18.37% 18.37% 18.37% 18.37% 18.37%"}, "model_tokens": {"rwkv": [[62110, " inevitably", "normal", 5.769015842815861e-06]], "qwen": [[39505, " inevitably", "normal", 1.3586168279289268e-05]]}, "loss": {"rwkv": 19.775578330367185, "qwen": 18.37216081236056}, "topk": {"rwkv": [62110, 463, 5.769015842815861e-06, [[21800, 0.462911, " has", false], [4600, 0.279003, " is", false], [45283, 0.052535, " became", false], [22748, 0.036816, " was", false], [51019, 0.033473, " becomes", false], [21265, 0.022726, " and", false], [32475, 0.015381, " will", false], [275, 0.012254, " (", false], [22278, 0.011554, " per", false], [45, 0.007277, ",", false]]], "qwen": [39505, 250, 1.3586168279289268e-05, [[374, 0.368706, " is", false], [9044, 0.210179, " becomes", false], [702, 0.163419, " has", false], [686, 0.063317, " will", false], [6116, 0.05747, " became", false], [646, 0.030104, " can", false], [572, 0.019347, " was", false], [1091, 0.017925, " than", false], [1035, 0.013141, " would", false], [320, 0.007676, " (", false]]]}, "raw_delta": 0.07782199166037818, "tuned_delta": 0.08639378369095642}, {"byte_start": 651, "byte_end": 659, "display": {"text": " becomes", "kind": "normal"}, "is_word": true, "word_id": 108, "word_key": " becomes", "bytes_hex": "20 62 65 63 6f 6d 65 73", "compression": {"rwkv": "0.74% 0.74% 0.74% 0.74% 0.74% 0.74% 0.74% 0.74%", "qwen": "0.36% 0.36% 0.36% 0.36% 0.36% 0.36% 0.36% 0.36%"}, "model_tokens": {"rwkv": [[51019, " becomes", "normal", 0.7213101983070374]], "qwen": [[9044, " becomes", "normal", 0.8512977361679077]]}, "loss": {"rwkv": 0.7440657406928552, "qwen": 0.3629129528386432}, "topk": {"rwkv": [51019, 1, 0.7213101983070374, [[51019, 0.72131, " becomes", false], [45283, 0.117142, " became", false], [38087, 0.01949, " comes", false], [50956, 0.017396, " arrives", false], [21800, 0.016516, " has", false], [4600, 0.008403, " is", false], [30965, 0.007021, " gets", false], [45199, 0.006348, " arises", false], [50935, 0.004519, " appears", false], [32475, 0.004497, " will", false]]], "qwen": [9044, 1, 0.8512977361679077, [[9044, 0.851298, " becomes", false], [6116, 0.030535, " became", false], [29682, 0.015827, " arrives", false], [4041, 0.014727, " comes", false], [374, 0.00821, " is", false], [5221, 0.007622, " gets", false], [686, 0.007398, " will", false], [17066, 0.007118, " falls", false], [3635, 0.005005, " become", false], [3643, 0.00425, " makes", false]]]}, "raw_delta": 0.021135598421096802, "tuned_delta": 0.02970739045167505}, {"byte_start": 659, "byte_end": 669, "display": {"text": " available", "kind": "normal"}, "is_word": true, "word_id": 109, "word_key": " available", "bytes_hex": "20 61 76 61 69 6c 61 62 6c 65", "compression": {"rwkv": "0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10%", "qwen": "0.05% 0.05% 0.05% 0.05% 0.05% 0.05% 0.05% 0.05% 0.05% 0.05%"}, "model_tokens": {"rwkv": [[59206, " available", "normal", 0.9487120509147644]], "qwen": [[2500, " available", "normal", 0.9704382419586182]]}, "loss": {"rwkv": 0.09553980220730743, "qwen": 0.054114593021693955}, "topk": {"rwkv": [59206, 1, 0.9487120509147644, [[59206, 0.948712, " available", false], [56895, 0.006483, " possible", false], [61551, 0.005481, " affordable", false], [51178, 0.004853, " cheaper", false], [38006, 0.004825, " cheap", false], [61519, 0.004383, " accessible", false], [56212, 0.00248, " feasible", false], [31458, 0.002234, " more", false], [30911, 0.001406, " free", false], [46042, 0.001353, " freely", false]]], "qwen": [2500, 1, 0.9704382419586182, [[2500, 0.970438, " available", false], [15614, 0.012816, " accessible", false], [3204, 0.003238, " possible", false], [42203, 0.000999, " feasible", false], [30268, 0.000741, " readily", false], [16637, 0.000601, " affordable", false], [264, 0.000533, " a", false], [13570, 0.000506, " widely", false], [25580, 0.000454, " freely", false], [518, 0.000437, " at", false]]]}, "raw_delta": 0.0022971013560891154, "tuned_delta": 0.010868893386667364}, {"byte_start": 669, "byte_end": 670, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "9.51%", "qwen": "17.36%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.592117428779602]], "qwen": [[13, ".", "normal", 0.3819284737110138]]}, "loss": {"rwkv": 9.509952662109866, "qwen": 17.357820915727263}, "topk": {"rwkv": [47, 1, 0.592117428779602, [[47, 0.592117, ".", false], [45, 0.158111, ",", false], [4811, 0.064404, " to", false], [21265, 0.028117, " and", false], [275, 0.02226, " (", false], [4423, 0.016115, " as", false], [4424, 0.011413, " at", false], [21700, 0.01025, " for", false], [32226, 0.007665, " than", false], [4596, 0.006672, " in", false]]], "qwen": [13, 1, 0.3819284737110138, [[13, 0.381928, ".", false], [11, 0.185065, ",", false], [624, 0.141005, ".\n", false], [311, 0.064201, " to", false], [323, 0.06305, " and", false], [320, 0.031207, " (", false], [1091, 0.014719, " than", false], [369, 0.012568, " for", false], [518, 0.010692, " at", false], [1526, 0.007702, " through", false]]]}, "raw_delta": -0.4351782202720642, "tuned_delta": -0.426606428241486}, {"byte_start": 670, "byte_end": 678, "display": {"text": " Seeking", "kind": "normal"}, "is_word": true, "word_id": 110, "word_key": " seeking", "bytes_hex": "20 53 65 65 6b 69 6e 67", "compression": {"rwkv": "39.45% 39.45% 39.45% 39.45% 39.45% 0.28% 0.28% 0.28%", "qwen": "25.58% 25.58% 25.58% 25.58% 25.58% 25.58% 25.58% 25.58%"}, "model_tokens": {"rwkv": [[29753, " Seek", "normal", 1.7948577806237154e-05], [7856, "ing", "normal", 0.9542503952980042]], "qwen": [[58705, " Seeking", "normal", 1.1795600585173815e-05]]}, "loss": {"rwkv": 24.761098968382353, "qwen": 25.580299629670897}, "topk": {"rwkv": [29753, 976, 1.7948577806237154e-05, [[11, 0.250401, "\n", false], [29894, 0.107308, " This", false], [20996, 0.08133, " The", false], [261, 0.076909, "\n\n", false], [3913, 0.032213, " In", false], [3918, 0.022645, " It", false], [3641, 0.021672, " As", false], [19417, 0.018662, " And", false], [19907, 0.017877, " For", false], [4217, 0.015427, " So", false]]], "qwen": [58705, 1520, 1.1795600585173815e-05, [[1096, 0.168432, " This", false], [576, 0.107964, " The", false], [1634, 0.050958, " As", false], [758, 0.048782, " In", false], [1084, 0.034836, " It", false], [1597, 0.029178, " And", false], [1752, 0.019607, " For", false], [14301, 0.016932, " Thus", false], [1416, 0.015635, " If", false], [1205, 0.013743, " We", false]]]}, "raw_delta": -0.045426130294799805, "tuned_delta": -0.036854338264221555}, {"byte_start": 678, "byte_end": 681, "display": {"text": " an", "kind": "normal"}, "is_word": true, "word_id": 111, "word_key": " an", "bytes_hex": "20 61 6e", "compression": {"rwkv": "26.30% 26.30% 26.30%", "qwen": "26.75% 26.75% 26.75%"}, "model_tokens": {"rwkv": [[4419, " an", "normal", 0.01238006167113781]], "qwen": [[458, " an", "normal", 0.011676748283207417]]}, "loss": {"rwkv": 26.299128349538393, "qwen": 26.750906708712392}, "topk": {"rwkv": [4419, 11, 0.01238006167113781, [[4811, 0.391225, " to", false], [22249, 0.066677, " out", false], [332, 0.05737, " a", false], [52224, 0.042022, " methods", false], [51832, 0.038991, " general", false], [22590, 0.038221, " the", false], [32448, 0.037766, " ways", false], [30789, 0.015751, " ever", false], [59943, 0.014556, " knowledge", false], [31458, 0.013507, " more", false]]], "qwen": [458, 12, 0.011676748283207417, [[311, 0.346544, " to", false], [4586, 0.095296, " general", false], [264, 0.068085, " a", false], [279, 0.039555, " the", false], [5413, 0.029232, " methods", false], [501, 0.022304, " new", false], [5510, 0.022205, " ways", false], [2664, 0.02123, " better", false], [803, 0.018443, " more", false], [700, 0.015659, " out", false]]]}, "raw_delta": -0.025051911671956528, "tuned_delta": -0.01648011964137828}, {"byte_start": 681, "byte_end": 693, "display": {"text": " improvement", "kind": "normal"}, "is_word": true, "word_id": 112, "word_key": " improvement", "bytes_hex": "20 69 6d 70 72 6f 76 65 6d 65 6e 74", "compression": {"rwkv": "4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88%", "qwen": "5.62% 5.62% 5.62% 5.62% 5.62% 5.62% 5.62% 5.62% 5.62% 5.62% 5.62% 5.62%"}, "model_tokens": {"rwkv": [[63621, " improvement", "normal", 0.038731444627046585]], "qwen": [[15673, " improvement", "normal", 0.023840148001909256]]}, "loss": {"rwkv": 4.884123836342845, "qwen": 5.61506586758611}, "topk": {"rwkv": [63621, 6, 0.038731444627046585, [[59093, 0.06188, " advantage", false], [3609, 0.052639, " AI", false], [63277, 0.046593, " alternative", false], [37636, 0.041842, " agent", false], [30729, 0.040861, " edge", false], [63621, 0.038731, " improvement", false], [55532, 0.033366, " approach", false], [30789, 0.033068, " ever", false], [52371, 0.029619, " optimal", false], [63560, 0.027929, " explanation", false]]], "qwen": [15673, 10, 0.023840148001909256, [[22823, 0.143534, " optimal", false], [10555, 0.058327, " alternative", false], [16148, 0.05473, " explanation", false], [7373, 0.047727, " effective", false], [8315, 0.041014, " agent", false], [12111, 0.034582, " algorithm", false], [4226, 0.030941, " answer", false], [5486, 0.029412, " approach", false], [11050, 0.024839, " efficient", false], [15673, 0.02384, " improvement", false]]]}, "raw_delta": -0.04053203264872235, "tuned_delta": -0.0319602406181441}, {"byte_start": 693, "byte_end": 698, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 113, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "12.79% 12.79% 12.79% 12.79% 12.79%", "qwen": "10.43% 10.43% 10.43% 10.43% 10.43%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.02857709303498268]], "qwen": [[429, " that", "normal", 0.05540107935667038]]}, "loss": {"rwkv": 12.792647432882603, "qwen": 10.4348555804452}, "topk": {"rwkv": [32227, 4, 0.02857709303498268, [[4596, 0.465974, " in", false], [4706, 0.139946, " of", false], [4450, 0.128926, " by", false], [32227, 0.028577, " that", false], [31601, 0.024199, " over", false], [4811, 0.022141, " to", false], [4712, 0.021024, " on", false], [30917, 0.01734, " from", false], [32487, 0.014041, " with", false], [53140, 0.009575, " through", false]]], "qwen": [429, 4, 0.05540107935667038, [[304, 0.462232, " in", false], [916, 0.084486, " over", false], [389, 0.059968, " on", false], [429, 0.055401, " that", false], [311, 0.045035, " to", false], [315, 0.032579, " of", false], [553, 0.02508, " by", false], [374, 0.018459, " is", false], [7797, 0.0181, " beyond", false], [504, 0.015775, " from", false]]]}, "raw_delta": 0.13074374198913574, "tuned_delta": 0.139315534019714}, {"byte_start": 698, "byte_end": 704, "display": {"text": " makes", "kind": "normal"}, "is_word": true, "word_id": 114, "word_key": " makes", "bytes_hex": "20 6d 61 6b 65 73", "compression": {"rwkv": "15.03% 15.03% 15.03% 15.03% 15.03% 15.03%", "qwen": "16.07% 16.07% 16.07% 16.07% 16.07% 16.07%"}, "model_tokens": {"rwkv": [[38964, " makes", "normal", 0.006612562574446201]], "qwen": [[3643, " makes", "normal", 0.004769652150571346]]}, "loss": {"rwkv": 15.028073342593368, "qwen": 16.066458726462773}, "topk": {"rwkv": [38964, 22, 0.006612562574446201, [[4600, 0.234174, " is", false], [56540, 0.084545, " leverage", false], [57102, 0.057831, " requires", false], [21413, 0.043576, " can", false], [40219, 0.03494, " would", false], [38278, 0.028772, " doesn", false], [30659, 0.026621, " does", false], [47181, 0.026218, " scales", false], [31581, 0.025952, " only", false], [38087, 0.023144, " comes", false]]], "qwen": [3643, 24, 0.004769652150571346, [[374, 0.189496, " is", false], [7460, 0.158147, " requires", false], [1558, 0.100576, " does", false], [646, 0.047346, " can", false], [3171, 0.046745, " doesn", false], [27505, 0.046031, " lever", false], [1035, 0.036799, " would", false], [33644, 0.034925, " relies", false], [4157, 0.025388, " cannot", false], [28405, 0.019711, " scales", false]]]}, "raw_delta": -0.057580312093098884, "tuned_delta": -0.049008520062520634}, {"byte_start": 704, "byte_end": 706, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 115, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "27.33% 27.33%", "qwen": "28.80% 28.80%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.04826342687010765]], "qwen": [[264, " a", "normal", 0.041008658707141876]]}, "loss": {"rwkv": 27.332308391841686, "qwen": 28.799548280713836}, "topk": {"rwkv": [332, 4, 0.04826342687010765, [[22681, 0.277007, " use", false], [22590, 0.117123, " the", false], [4692, 0.051472, " no", false], [332, 0.048263, " a", false], [45301, 0.028659, " better", false], [30992, 0.026593, " good", false], [4601, 0.02471, " it", false], [22799, 0.019972, " you", false], [30923, 0.014912, " full", false], [39631, 0.014822, " sense", false]]], "qwen": [264, 4, 0.041008658707141876, [[990, 0.383282, " use", false], [902, 0.161169, " no", false], [279, 0.054144, " the", false], [264, 0.041009, " a", false], [2632, 0.038358, " little", false], [5530, 0.03482, " sense", false], [2664, 0.028742, " better", false], [1661, 0.016088, " good", false], [803, 0.015047, " more", false], [8811, 0.012346, " heavy", false]]]}, "raw_delta": -0.08136105537414551, "tuned_delta": -0.07278926334356726}, {"byte_start": 706, "byte_end": 717, "display": {"text": " difference", "kind": "normal"}, "is_word": true, "word_id": 116, "word_key": " difference", "bytes_hex": "20 64 69 66 66 65 72 65 6e 63 65", "compression": {"rwkv": "4.76% 4.76% 4.76% 4.76% 4.76% 4.76% 4.76% 4.76% 4.76% 4.76% 4.76%", "qwen": "4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66%"}, "model_tokens": {"rwkv": [[61863, " difference", "normal", 0.0547851137816906]], "qwen": [[6672, " difference", "normal", 0.05831332132220268]]}, "loss": {"rwkv": 4.764582343844943, "qwen": 4.659125709293158}, "topk": {"rwkv": [61863, 1, 0.0547851137816906, [[61863, 0.054785, " difference", false], [38594, 0.053527, " given", false], [52232, 0.042096, " million", false], [3483, 0.037914, " 10", false], [39720, 0.035245, " small", false], [38864, 0.023804, " large", false], [21357, 0.023661, " big", false], [63870, 0.020131, " significant", false], [56587, 0.018945, " marginal", false], [47487, 0.014988, " system", false]]], "qwen": [6672, 4, 0.05831332132220268, [[2613, 0.104232, " small", false], [3460, 0.064247, " large", false], [5089, 0.060479, " significant", false], [6672, 0.058313, " difference", false], [8131, 0.038904, " larger", false], [9155, 0.029102, " smaller", false], [3175, 0.028157, " single", false], [2409, 0.02704, " big", false], [11924, 0.025355, " substantial", false], [6765, 0.014296, " huge", false]]]}, "raw_delta": 0.005847757512872864, "tuned_delta": 0.014419549543451112}, {"byte_start": 717, "byte_end": 720, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 117, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "10.24% 10.24% 10.24%", "qwen": "9.94% 9.94% 9.94%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.17996846139431]], "qwen": [[304, " in", "normal", 0.1915179193019867]]}, "loss": {"rwkv": 10.237874964641732, "qwen": 9.935203413982654}, "topk": {"rwkv": [4596, 1, 0.17996846139431, [[4596, 0.179968, " in", false], [4811, 0.127566, " to", false], [4600, 0.08251, " is", false], [45, 0.061347, ",", false], [57102, 0.047158, " requires", false], [39971, 0.0367, " today", false], [4450, 0.029391, " by", false], [4712, 0.026849, " on", false], [32475, 0.02497, " will", false], [31601, 0.023289, " over", false]]], "qwen": [304, 1, 0.1915179193019867, [[304, 0.191518, " in", false], [374, 0.095014, " is", false], [311, 0.071833, " to", false], [916, 0.063177, " over", false], [389, 0.062715, " on", false], [7460, 0.046699, " requires", false], [979, 0.029425, " when", false], [11, 0.02619, ",", false], [518, 0.025189, " at", false], [369, 0.024353, " for", false]]]}, "raw_delta": 0.01678367455800378, "tuned_delta": 0.02535546658858203}, {"byte_start": 720, "byte_end": 724, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 118, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "4.86% 4.86% 4.86% 4.86%", "qwen": "6.17% 6.17% 6.17% 6.17%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.3386668860912323]], "qwen": [[279, " the", "normal", 0.2544078826904297]]}, "loss": {"rwkv": 4.8606424717450425, "qwen": 6.171202403560686}, "topk": {"rwkv": [22590, 1, 0.3386668860912323, [[22590, 0.338667, " the", false], [332, 0.136816, " a", false], [39920, 0.057402, " terms", false], [32234, 0.052054, " this", false], [31835, 0.032513, " real", false], [56901, 0.025827, " practice", false], [4419, 0.019037, " an", false], [63750, 0.017274, " performance", false], [38720, 0.014218, " human", false], [3483, 0.011752, " 10", false]]], "qwen": [279, 1, 0.2544078826904297, [[279, 0.254408, " the", false], [264, 0.166713, " a", false], [5068, 0.083839, " performance", false], [419, 0.063061, " this", false], [6588, 0.04657, " practice", false], [3793, 0.026816, " terms", false], [458, 0.026541, " an", false], [1741, 0.026428, " such", false], [429, 0.022521, " that", false], [220, 0.018603, " ", false]]]}, "raw_delta": -0.07267287373542786, "tuned_delta": -0.06410108170484961}, {"byte_start": 724, "byte_end": 732, "display": {"text": " shorter", "kind": "normal"}, "is_word": true, "word_id": 119, "word_key": " shorter", "bytes_hex": "20 73 68 6f 72 74 65 72", "compression": {"rwkv": "16.84% 16.84% 16.84% 16.84% 16.84% 16.84% 16.84% 16.84%", "qwen": "12.48% 12.48% 12.48% 12.48% 12.48% 12.48% 12.48% 12.48%"}, "model_tokens": {"rwkv": [[52888, " shorter", "normal", 0.0005724717047996819]], "qwen": [[23327, " shorter", "normal", 0.003942768555134535]]}, "loss": {"rwkv": 16.83613841662413, "qwen": 12.479024600292085}, "topk": {"rwkv": [52888, 159, 0.0005724717047996819, [[31835, 0.144439, " real", false], [31323, 0.082976, " long", false], [40213, 0.079928, " world", false], [30807, 0.059039, " face", false], [39675, 0.048322, " short", false], [32251, 0.029652, " time", false], [31515, 0.029592, " next", false], [31503, 0.026197, " near", false], [46064, 0.01899, " future", false], [38621, 0.017262, " grand", false]]], "qwen": [23327, 38, 0.003942768555134535, [[2805, 0.128871, " short", false], [3143, 0.081736, " near", false], [882, 0.065915, " time", false], [1293, 0.049215, " long", false], [1790, 0.041966, " next", false], [1931, 0.032048, " real", false], [5068, 0.026856, " performance", false], [1879, 0.024192, " world", false], [3853, 0.015901, " future", false], [1482, 0.015439, " current", false]]]}, "raw_delta": 0.24160969257354736, "tuned_delta": 0.2501814846041256}, {"byte_start": 732, "byte_end": 737, "display": {"text": " term", "kind": "normal"}, "is_word": true, "word_id": 120, "word_key": " term", "bytes_hex": "20 74 65 72 6d", "compression": {"rwkv": "1.29% 1.29% 1.29% 1.29% 1.29%", "qwen": "2.21% 2.21% 2.21% 2.21% 2.21%"}, "model_tokens": {"rwkv": [[32219, " term", "normal", 0.700069785118103]], "qwen": [[4647, " term", "normal", 0.5424668192863464]]}, "loss": {"rwkv": 1.2891269164193373, "qwen": 2.205982766520802}, "topk": {"rwkv": [32219, 1, 0.700069785118103, [[32219, 0.70007, " term", false], [22418, 0.13028, " run", false], [32251, 0.061417, " time", false], [46, 0.051884, "-", false], [4715, 0.006238, " or", false], [51940, 0.006192, " horizon", false], [21265, 0.004017, " and", false], [39962, 0.003759, " times", false], [39920, 0.003246, " terms", false], [45, 0.002884, ",", false]]], "qwen": [4647, 1, 0.5424668192863464, [[4647, 0.542467, " term", false], [882, 0.221836, " time", false], [1598, 0.063362, " run", false], [9663, 0.045174, "-term", false], [3039, 0.035426, " times", false], [69953, 0.024584, " timeframe", false], [4168, 0.010569, " period", false], [11, 0.008014, ",", false], [3793, 0.003769, " terms", false], [34074, 0.003366, " horizon", false]]]}, "raw_delta": -0.05084128379821777, "tuned_delta": -0.04226949176763952}, {"byte_start": 737, "byte_end": 738, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "40.58%", "qwen": "43.78%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.10559233278036118]], "qwen": [[11, ",", "normal", 0.08825676888227463]]}, "loss": {"rwkv": 40.57579802500209, "qwen": 43.776868109848834}, "topk": {"rwkv": [45, 2, 0.10559233278036118, [[4600, 0.294404, " is", false], [45, 0.105592, ",", false], [275, 0.043816, " (", false], [32475, 0.042771, " will", false], [22074, 0.037044, " may", false], [21413, 0.035054, " can", false], [4450, 0.031371, " by", false], [57102, 0.028618, " requires", false], [40187, 0.020229, " while", false], [53356, 0.018118, " without", false]]], "qwen": [11, 2, 0.08825676888227463, [[374, 0.300275, " is", false], [11, 0.088257, ",", false], [320, 0.058578, " (", false], [646, 0.038089, " can", false], [7460, 0.036124, " requires", false], [686, 0.034283, " will", false], [702, 0.026786, " has", false], [9044, 0.025306, " becomes", false], [1231, 0.024479, " may", false], [3363, 0.018381, " means", false]]]}, "raw_delta": -0.1775050163269043, "tuned_delta": -0.16893322429632604}, {"byte_start": 738, "byte_end": 750, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 121, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"rwkv": "5.21% 5.21% 5.21% 5.21% 5.21% 5.21% 5.21% 5.21% 5.21% 5.21% 5.21% 5.21%", "qwen": "6.27% 6.27% 6.27% 6.27% 6.27% 6.27% 6.27% 6.27% 6.27% 6.27% 6.27% 6.27%"}, "model_tokens": {"rwkv": [[63843, " researchers", "normal", 0.03088589571416378]], "qwen": [[11811, " researchers", "normal", 0.015444123186171055]]}, "loss": {"rwkv": 5.212862940712074, "qwen": 6.267497818710502}, "topk": {"rwkv": [63843, 8, 0.03088589571416378, [[22590, 0.053903, " the", false], [40187, 0.053659, " while", false], [4858, 0.048107, " we", false], [21265, 0.048091, " and", false], [21400, 0.042607, " but", false], [4601, 0.033219, " it", false], [22226, 0.032401, " one", false], [63843, 0.030886, " researchers", false], [53356, 0.027334, " without", false], [32230, 0.025364, " then", false]]], "qwen": [11811, 19, 0.015444123186171055, [[323, 0.06536, " and", false], [476, 0.056072, " or", false], [1741, 0.053032, " such", false], [4764, 0.039624, " however", false], [279, 0.035106, " the", false], [304, 0.032476, " in", false], [438, 0.029488, " as", false], [1393, 0.027959, " while", false], [1221, 0.025311, " then", false], [714, 0.025235, " but", false]]]}, "raw_delta": -0.0584813753763835, "tuned_delta": -0.04990958334580525}, {"byte_start": 750, "byte_end": 755, "display": {"text": " seek", "kind": "normal"}, "is_word": true, "word_id": 122, "word_key": " seek", "bytes_hex": "20 73 65 65 6b", "compression": {"rwkv": "22.32% 22.32% 22.32% 22.32% 22.32%", "qwen": "20.72% 20.72% 20.72% 20.72% 20.72%"}, "model_tokens": {"rwkv": [[31966, " seek", "normal", 0.0020592890214174986]], "qwen": [[5931, " seek", "normal", 0.003198388498276472]]}, "loss": {"rwkv": 22.31668891375115, "qwen": 20.72109751262683}, "topk": {"rwkv": [31966, 47, 0.0020592890214174986, [[31059, 0.204132, " have", false], [39171, 0.084378, " often", false], [32475, 0.064248, " will", false], [21286, 0.055041, " are", false], [32216, 0.046471, " tend", false], [21413, 0.03194, " can", false], [47266, 0.030567, " should", false], [22074, 0.023417, " may", false], [60687, 0.02341, " typically", false], [4596, 0.015502, " in", false]]], "qwen": [5931, 37, 0.003198388498276472, [[614, 0.303681, " have", false], [525, 0.074676, " are", false], [8376, 0.058613, " tend", false], [686, 0.058181, " will", false], [3545, 0.05436, " often", false], [646, 0.025166, " can", false], [1969, 0.024153, " must", false], [11136, 0.020928, " typically", false], [1265, 0.02013, " should", false], [1231, 0.017721, " may", false]]]}, "raw_delta": 0.08847837448120122, "tuned_delta": 0.09705016651177946}, {"byte_start": 755, "byte_end": 758, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 123, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "6.86% 6.86% 6.86%", "qwen": "7.10% 7.10% 7.10%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.3204927444458008]], "qwen": [[311, " to", "normal", 0.30715322494506836]]}, "loss": {"rwkv": 6.856558462558223, "qwen": 7.095706787932366}, "topk": {"rwkv": [4811, 1, 0.3204927444458008, [[4811, 0.320493, " to", false], [332, 0.108657, " a", false], [52224, 0.06442, " methods", false], [22249, 0.05465, " out", false], [32448, 0.036887, " ways", false], [4419, 0.035138, " an", false], [22590, 0.033257, " the", false], [64423, 0.021824, " improvements", false], [22168, 0.013475, " new", false], [31458, 0.010424, " more", false]]], "qwen": [311, 1, 0.30715322494506836, [[311, 0.307153, " to", false], [264, 0.063881, " a", false], [5510, 0.056106, " ways", false], [5413, 0.046561, " methods", false], [18142, 0.034417, " improvements", false], [700, 0.029936, " out", false], [279, 0.022782, " the", false], [54920, 0.019494, " shortcuts", false], [9904, 0.01759, " solutions", false], [458, 0.01636, " an", false]]]}, "raw_delta": -0.013261198997497559, "tuned_delta": -0.00468940696691931}, {"byte_start": 758, "byte_end": 767, "display": {"text": " leverage", "kind": "normal"}, "is_word": true, "word_id": 124, "word_key": " leverage", "bytes_hex": "20 6c 65 76 65 72 61 67 65", "compression": {"rwkv": "4.48% 4.48% 4.48% 4.48% 4.48% 4.48% 4.48% 4.48% 4.48%", "qwen": "3.38% 3.38% 3.38% 3.38% 3.38% 3.38% 3.38% 3.38% 3.38%"}, "model_tokens": {"rwkv": [[56540, " leverage", "normal", 0.10792125761508942]], "qwen": [[32064, " leverage", "normal", 0.1850433498620987]]}, "loss": {"rwkv": 4.4771135166476075, "qwen": 3.3806455308803502}, "topk": {"rwkv": [56540, 2, 0.10792125761508942, [[51982, 0.134886, " improve", false], [56540, 0.107921, " leverage", false], [51690, 0.049896, " exploit", false], [30858, 0.043265, " find", false], [31358, 0.036314, " make", false], [22681, 0.032648, " use", false], [37730, 0.025428, " apply", false], [4491, 0.019004, " do", false], [56433, 0.018679, " increase", false], [37923, 0.016749, " build", false]]], "qwen": [32064, 1, 0.1850433498620987, [[32064, 0.185043, " leverage", false], [7269, 0.073056, " improve", false], [1477, 0.054696, " find", false], [32194, 0.050307, " exploit", false], [1936, 0.034749, " build", false], [1281, 0.033653, " make", false], [990, 0.031825, " use", false], [2225, 0.027895, " develop", false], [3796, 0.022643, " apply", false], [653, 0.016222, " do", false]]]}, "raw_delta": 0.06080109543270535, "tuned_delta": 0.0693728874632836}, {"byte_start": 767, "byte_end": 773, "display": {"text": " their", "kind": "normal"}, "is_word": true, "word_id": 125, "word_key": " their", "bytes_hex": "20 74 68 65 69 72", "compression": {"rwkv": "10.00% 10.00% 10.00% 10.00% 10.00% 10.00%", "qwen": "12.25% 12.25% 12.25% 12.25% 12.25% 12.25%"}, "model_tokens": {"rwkv": [[39931, " their", "normal", 0.03585086762905121]], "qwen": [[862, " their", "normal", 0.016973810270428658]]}, "loss": {"rwkv": 10.00306131866371, "qwen": 12.251136838983184}, "topk": {"rwkv": [39931, 5, 0.03585086762905121, [[22590, 0.205718, " the", false], [38720, 0.135048, " human", false], [32234, 0.09498, " this", false], [32227, 0.064918, " that", false], [39931, 0.035851, " their", false], [32464, 0.034969, " what", false], [56173, 0.032333, " existing", false], [63370, 0.023644, " computation", false], [57564, 0.021696, " whatever", false], [31458, 0.019699, " more", false]]], "qwen": [862, 9, 0.016973810270428658, [[419, 0.2792, " this", false], [279, 0.185648, " the", false], [429, 0.078367, " that", false], [432, 0.056268, " it", false], [3738, 0.041902, " human", false], [34447, 0.036121, " computation", false], [6350, 0.028696, " existing", false], [1493, 0.018124, " these", false], [862, 0.016974, " their", false], [6540, 0.015419, " knowledge", false]]]}, "raw_delta": -0.12465977668762207, "tuned_delta": -0.11608798465704383}, {"byte_start": 773, "byte_end": 779, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 126, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "8.74% 8.74% 8.74% 8.74% 8.74% 8.74%", "qwen": "11.94% 11.94% 11.94% 11.94% 11.94% 11.94%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.05500245839357376]], "qwen": [[3738, " human", "normal", 0.01883947290480137]]}, "loss": {"rwkv": 8.735067630382394, "qwen": 11.937703473946366}, "topk": {"rwkv": [38720, 6, 0.05500245839357376, [[52140, 0.143004, " limited", false], [56173, 0.094856, " existing", false], [59943, 0.086163, " knowledge", false], [51372, 0.080133, " current", false], [22251, 0.061264, " own", false], [38720, 0.055002, " human", false], [59206, 0.024007, " available", false], [39720, 0.016505, " small", false], [65034, 0.015487, " understanding", false], [50888, 0.011818, " already", false]]], "qwen": [3738, 9, 0.01883947290480137, [[6540, 0.180166, " knowledge", false], [6350, 0.092155, " existing", false], [1482, 0.06157, " current", false], [1828, 0.058436, " own", false], [501, 0.031776, " new", false], [7199, 0.030736, " limited", false], [54480, 0.02952, " computational", false], [2500, 0.021754, " available", false], [3738, 0.018839, " human", false], [8660, 0.018359, " understanding", false]]]}, "raw_delta": -0.17759184042612708, "tuned_delta": -0.16902004839554882}, {"byte_start": 779, "byte_end": 789, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 127, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45%", "qwen": "1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12%"}, "model_tokens": {"rwkv": [[59943, " knowledge", "normal", 0.77864009141922]], "qwen": [[6540, " knowledge", "normal", 0.5378748774528503]]}, "loss": {"rwkv": 0.450842200277801, "qwen": 1.1183219167583118}, "topk": {"rwkv": [59943, 1, 0.77864009141922, [[59943, 0.77864, " knowledge", false], [64452, 0.026841, " intelligence", false], [46, 0.021343, "-", false], [59683, 0.02036, " expertise", false], [59917, 0.01509, " intuition", false], [65034, 0.013241, " understanding", false], [59305, 0.006079, " cognitive", false], [45346, 0.005684, " brains", false], [39356, 0.003994, " prior", false], [21265, 0.00361, " and", false]]], "qwen": [6540, 1, 0.5378748774528503, [[6540, 0.537875, " knowledge", false], [18726, 0.053629, " expertise", false], [56251, 0.046322, " intuition", false], [11229, 0.029525, " intelligence", false], [8660, 0.015324, " understanding", false], [6749, 0.015121, " ing", false], [4963, 0.01493, " resources", false], [7361, 0.013789, " skills", false], [24675, 0.009583, " cognitive", false], [20017, 0.008713, " insight", false]]]}, "raw_delta": -0.03701293468475342, "tuned_delta": -0.028441142654175168}, {"byte_start": 789, "byte_end": 792, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 128, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "20.38% 20.38% 20.38%", "qwen": "21.13% 21.13% 21.13%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.0335969440639019]], "qwen": [[315, " of", "normal", 0.029736023396253586]]}, "loss": {"rwkv": 20.38182447089225, "qwen": 21.13185227681502}, "topk": {"rwkv": [4706, 7, 0.0335969440639019, [[45, 0.190964, ",", false], [47, 0.143869, ".", false], [4811, 0.140904, " to", false], [21265, 0.096775, " and", false], [4596, 0.074511, " in", false], [275, 0.034033, " (", false], [4706, 0.033597, " of", false], [4423, 0.027631, " as", false], [4450, 0.027111, " by", false], [60, 0.021583, ";", false]]], "qwen": [315, 8, 0.029736023396253586, [[11, 0.156832, ",", false], [323, 0.11761, " and", false], [304, 0.102445, " in", false], [311, 0.089361, " to", false], [13, 0.086746, ".", false], [553, 0.039992, " by", false], [320, 0.033706, " (", false], [315, 0.029736, " of", false], [803, 0.025906, " more", false], [438, 0.024378, " as", false]]]}, "raw_delta": -0.04159037272135424, "tuned_delta": -0.03301858069077599}, {"byte_start": 792, "byte_end": 796, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 129, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "2.57% 2.57% 2.57% 2.57%", "qwen": "2.29% 2.29% 2.29% 2.29%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.5697708129882812]], "qwen": [[279, " the", "normal", 0.6019660830497742]]}, "loss": {"rwkv": 2.571209423459334, "qwen": 2.2882684032718967}, "topk": {"rwkv": [22590, 1, 0.5697708129882812, [[22590, 0.569771, " the", false], [21835, 0.092198, " how", false], [32464, 0.048099, " what", false], [332, 0.047394, " a", false], [40186, 0.009853, " which", false], [3609, 0.008663, " AI", false], [39931, 0.007546, " their", false], [32074, 0.007401, " some", false], [4419, 0.006931, " an", false], [56939, 0.005957, " problems", false]]], "qwen": [279, 1, 0.6019660830497742, [[279, 0.601966, " the", false], [1246, 0.100687, " how", false], [1128, 0.06234, " what", false], [264, 0.047222, " a", false], [458, 0.008219, " an", false], [7947, 0.007775, " domain", false], [3491, 0.007697, " problem", false], [5322, 0.007279, " problems", false], [15235, 0.006428, " AI", false], [3151, 0.005127, " specific", false]]]}, "raw_delta": 0.015689581632614136, "tuned_delta": 0.024261373663192386}, {"byte_start": 796, "byte_end": 803, "display": {"text": " domain", "kind": "normal"}, "is_word": true, "word_id": 130, "word_key": " domain", "bytes_hex": "20 64 6f 6d 61 69 6e", "compression": {"rwkv": "5.15% 5.15% 5.15% 5.15% 5.15% 5.15% 5.15%", "qwen": "6.36% 6.36% 6.36% 6.36% 6.36% 6.36% 6.36%"}, "model_tokens": {"rwkv": [[45775, " domain", "normal", 0.1363827884197235]], "qwen": [[7947, " domain", "normal", 0.08477343618869781]]}, "loss": {"rwkv": 5.1524822888891535, "qwen": 6.357578236407423}, "topk": {"rwkv": [45775, 3, 0.1363827884197235, [[40213, 0.312212, " world", false], [52569, 0.229817, " problem", false], [45775, 0.136383, " domain", false], [32202, 0.071761, " task", false], [63536, 0.032826, " environment", false], [57074, 0.017141, " relevant", false], [60511, 0.012049, " situation", false], [47506, 0.010262, " target", false], [56939, 0.009762, " problems", false], [57271, 0.009494, " specific", false]]], "qwen": [7947, 5, 0.08477343618869781, [[3491, 0.312582, " problem", false], [1879, 0.210592, " world", false], [4573, 0.120185, " environment", false], [3383, 0.095531, " task", false], [7947, 0.084773, " domain", false], [3151, 0.011941, " specific", false], [1849, 0.011441, " system", false], [8315, 0.010717, " agent", false], [5322, 0.007905, " problems", false], [1931, 0.006768, " real", false]]]}, "raw_delta": -0.06682470866612028, "tuned_delta": -0.05825291663554203}, {"byte_start": 803, "byte_end": 804, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "27.61%", "qwen": "28.85%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.2151898294687271]], "qwen": [[11, ",", "normal", 0.20195549726486206]]}, "loss": {"rwkv": 27.614084767015314, "qwen": 28.848632129270083}, "topk": {"rwkv": [45, 1, 0.2151898294687271, [[45, 0.21519, ",", false], [47, 0.18634, ".", false], [4811, 0.090568, " to", false], [4596, 0.083972, " in", false], [21265, 0.076304, " and", false], [32232, 0.048032, " they", false], [4706, 0.042126, " of", false], [275, 0.032307, " (", false], [60, 0.020903, ";", false], [4424, 0.020117, " at", false]]], "qwen": [11, 1, 0.20195549726486206, [[11, 0.201955, ",", false], [311, 0.127244, " to", false], [13, 0.126718, ".", false], [304, 0.109078, " in", false], [323, 0.086082, " and", false], [320, 0.048249, " (", false], [553, 0.0362, " by", false], [624, 0.020436, ".\n", false], [438, 0.017697, " as", false], [26, 0.017592, ";", false]]]}, "raw_delta": -0.06845784187316895, "tuned_delta": -0.059886049842590695}, {"byte_start": 804, "byte_end": 808, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 131, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"rwkv": "6.20% 6.20% 6.20% 6.20%", "qwen": "6.62% 6.62% 6.62% 6.62%"}, "model_tokens": {"rwkv": [[21400, " but", "normal", 0.24974967539310455]], "qwen": [[714, " but", "normal", 0.23051802814006805]]}, "loss": {"rwkv": 6.199080253819764, "qwen": 6.615776481149479}, "topk": {"rwkv": [21400, 1, 0.24974967539310455, [[21400, 0.24975, " but", false], [21265, 0.137721, " and", false], [40186, 0.103089, " which", false], [40187, 0.046215, " while", false], [4715, 0.035718, " or", false], [47001, 0.020354, " rather", false], [22590, 0.018736, " the", false], [4811, 0.017924, " to", false], [4596, 0.015757, " in", false], [53339, 0.014284, " whereas", false]]], "qwen": [714, 1, 0.23051802814006805, [[714, 0.230518, " but", false], [323, 0.130085, " and", false], [892, 0.082421, " which", false], [1393, 0.053377, " while", false], [476, 0.041299, " or", false], [3545, 0.026077, " often", false], [19853, 0.024233, " whereas", false], [438, 0.01806, " as", false], [304, 0.015485, " in", false], [311, 0.014344, " to", false]]]}, "raw_delta": -0.023106545209884644, "tuned_delta": -0.014534753179306395}, {"byte_start": 808, "byte_end": 812, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 132, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "10.85% 10.85% 10.85% 10.85%", "qwen": "11.14% 11.14% 11.14% 11.14%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.09046445041894913]], "qwen": [[279, " the", "normal", 0.08452223241329193]]}, "loss": {"rwkv": 10.848390444184586, "qwen": 11.139142163950115}, "topk": {"rwkv": [22590, 3, 0.09046445041894913, [[32234, 0.127832, " this", false], [4596, 0.110596, " in", false], [22590, 0.090464, " the", false], [31601, 0.051364, " over", false], [32227, 0.050588, " that", false], [4423, 0.036298, " as", false], [4588, 0.026089, " if", false], [4601, 0.025836, " it", false], [32232, 0.023972, " they", false], [45, 0.018252, ",", false]]], "qwen": [279, 3, 0.08452223241329193, [[304, 0.141637, " in", false], [419, 0.093016, " this", false], [279, 0.084522, " the", false], [11, 0.068891, ",", false], [916, 0.061476, " over", false], [438, 0.060623, " as", false], [979, 0.027856, " when", false], [432, 0.024868, " it", false], [429, 0.024163, " that", false], [421, 0.023443, " if", false]]]}, "raw_delta": -0.01612269878387451, "tuned_delta": -0.0075509067532962635}, {"byte_start": 812, "byte_end": 817, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 133, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"rwkv": "12.51% 12.51% 12.51% 12.51% 12.51%", "qwen": "15.16% 15.16% 15.16% 15.16% 15.16%"}, "model_tokens": {"rwkv": [[31581, " only", "normal", 0.03128838539123535]], "qwen": [[1172, " only", "normal", 0.014963667839765549]]}, "loss": {"rwkv": 12.510871057708977, "qwen": 15.155981426244061}, "topk": {"rwkv": [31581, 4, 0.03128838539123535, [[46470, 0.078024, " longer", false], [31323, 0.068596, " long", false], [57481, 0.032231, " ultimate", false], [31581, 0.031288, " only", false], [31461, 0.029091, " most", false], [31835, 0.024336, " real", false], [30510, 0.019972, " cost", false], [31458, 0.019332, " more", false], [30273, 0.015125, " best", false], [30808, 0.013432, " fact", false]]], "qwen": [1172, 7, 0.014963667839765549, [[5021, 0.128067, " longer", false], [1293, 0.036176, " long", false], [803, 0.031229, " more", false], [16724, 0.0267, " ultimate", false], [2783, 0.025294, " cost", false], [3491, 0.017783, " problem", false], [1172, 0.014964, " only", false], [1429, 0.012337, " most", false], [882, 0.012052, " time", false], [8131, 0.011567, " larger", false]]]}, "raw_delta": -0.14667606353759766, "tuned_delta": -0.1381042715070194}, {"byte_start": 817, "byte_end": 823, "display": {"text": " thing", "kind": "normal"}, "is_word": true, "word_id": 134, "word_key": " thing", "bytes_hex": "20 74 68 69 6e 67", "compression": {"rwkv": "9.39% 9.39% 9.39% 9.39% 9.39% 9.39%", "qwen": "7.54% 7.54% 7.54% 7.54% 7.54% 7.54%"}, "model_tokens": {"rwkv": [[39941, " thing", "normal", 0.043682076036930084]], "qwen": [[3166, " thing", "normal", 0.08142250776290894]]}, "loss": {"rwkv": 9.392545839120855, "qwen": 7.538392281036371}, "topk": {"rwkv": [39941, 2, 0.043682076036930084, [[22752, 0.554354, " way", false], [39941, 0.043682, " thing", false], [47009, 0.025316, " reason", false], [31323, 0.020507, " long", false], [31835, 0.01794, " real", false], [59593, 0.013501, " effective", false], [51832, 0.010951, " general", false], [56540, 0.008277, " leverage", false], [57075, 0.00795, " reliable", false], [31104, 0.007377, " hope", false]]], "qwen": [3166, 2, 0.08142250776290894, [[1616, 0.515129, " way", false], [3166, 0.081423, " thing", false], [7373, 0.028958, " effective", false], [5510, 0.019747, " ways", false], [3900, 0.019326, " hope", false], [1931, 0.012952, " real", false], [15673, 0.011414, " improvement", false], [1714, 0.010554, " method", false], [5413, 0.007542, " methods", false], [1293, 0.00617, " long", false]]]}, "raw_delta": 0.10281610488891606, "tuned_delta": 0.1113878969194943}, {"byte_start": 823, "byte_end": 828, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 135, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "1.53% 1.53% 1.53% 1.53% 1.53%", "qwen": "1.79% 1.79% 1.79% 1.79% 1.79%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.652611255645752]], "qwen": [[429, " that", "normal", 0.6083807945251465]]}, "loss": {"rwkv": 1.528636835316919, "qwen": 1.7923837317548124}, "topk": {"rwkv": [32227, 1, 0.652611255645752, [[32227, 0.652611, " that", false], [32232, 0.093333, " they", false], [4858, 0.022613, " we", false], [32234, 0.01926, " this", false], [22799, 0.011452, " you", false], [52072, 0.010524, " keeping", false], [31458, 0.009231, " more", false], [4811, 0.009198, " to", false], [62364, 0.009072, " preventing", false], [59206, 0.008492, " available", false]]], "qwen": [429, 1, 0.6083807945251465, [[429, 0.608381, " that", false], [807, 0.079125, " they", false], [582, 0.034568, " we", false], [12677, 0.025728, " humans", false], [279, 0.016112, " the", false], [419, 0.013132, " this", false], [803, 0.011792, " more", false], [3738, 0.009933, " human", false], [311, 0.009811, " to", false], [264, 0.008783, " a", false]]]}, "raw_delta": -0.014625233411788938, "tuned_delta": -0.0060534413812106894}, {"byte_start": 828, "byte_end": 836, "display": {"text": " matters", "kind": "normal"}, "is_word": true, "word_id": 136, "word_key": " matters", "bytes_hex": "20 6d 61 74 74 65 72 73", "compression": {"rwkv": "4.05% 4.05% 4.05% 4.05% 4.05% 4.05% 4.05% 4.05%", "qwen": "6.37% 6.37% 6.37% 6.37% 6.37% 6.37% 6.37% 6.37%"}, "model_tokens": {"rwkv": [[52201, " matters", "normal", 0.16600041091442108]], "qwen": [[12850, " matters", "normal", 0.05914688482880592]]}, "loss": {"rwkv": 4.050535393120868, "qwen": 6.374303165313985}, "topk": {"rwkv": [52201, 1, 0.16600041091442108, [[52201, 0.166, " matters", false], [21413, 0.114239, " can", false], [4600, 0.06301, " is", false], [32475, 0.061078, " will", false], [38964, 0.050549, " makes", false], [47008, 0.036114, " really", false], [460, 0.033469, "'s", false], [56925, 0.021555, " prevents", false], [52701, 0.018729, " remains", false], [62047, 0.018302, " guarantees", false]]], "qwen": [12850, 4, 0.05914688482880592, [[646, 0.182452, " can", false], [686, 0.080467, " will", false], [374, 0.078371, " is", false], [12850, 0.059147, " matters", false], [3643, 0.056159, " makes", false], [2167, 0.040223, " really", false], [702, 0.032976, " has", false], [12677, 0.023099, " humans", false], [9428, 0.021145, " truly", false], [594, 0.017699, "'s", false]]]}, "raw_delta": -0.12885704636573792, "tuned_delta": -0.12028525433515967}, {"byte_start": 836, "byte_end": 839, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 137, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "2.78% 2.78% 2.78%", "qwen": "4.64% 4.64% 4.64%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.6330277919769287]], "qwen": [[304, " in", "normal", 0.46231386065483093]]}, "loss": {"rwkv": 2.782541704839553, "qwen": 4.637731458395485}, "topk": {"rwkv": [4596, 1, 0.6330277919769287, [[4596, 0.633028, " in", false], [4600, 0.082556, " is", false], [21700, 0.069619, " for", false], [31323, 0.05688, " long", false], [31601, 0.048866, " over", false], [4811, 0.010968, " to", false], [4712, 0.008525, " on", false], [46470, 0.008246, " longer", false], [4424, 0.007736, " at", false], [31458, 0.007216, " more", false]]], "qwen": [304, 1, 0.46231386065483093, [[304, 0.462314, " in", false], [374, 0.248756, " is", false], [369, 0.083671, " for", false], [311, 0.033057, " to", false], [1293, 0.031607, " long", false], [916, 0.020673, " over", false], [979, 0.019231, " when", false], [438, 0.009893, " as", false], [518, 0.007377, " at", false], [911, 0.006492, " about", false]]]}, "raw_delta": -0.10287356376647949, "tuned_delta": -0.09430177173590125}, {"byte_start": 839, "byte_end": 843, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 138, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "0.14% 0.14% 0.14% 0.14%", "qwen": "0.45% 0.45% 0.45% 0.45%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.9696335196495056]], "qwen": [[279, " the", "normal", 0.9055376052856445]]}, "loss": {"rwkv": 0.13923715413852986, "qwen": 0.44735475489420745}, "topk": {"rwkv": [22590, 1, 0.9696335196495056, [[22590, 0.969634, " the", false], [332, 0.005256, " a", false], [56901, 0.003081, " practice", false], [32234, 0.002627, " this", false], [39920, 0.002346, " terms", false], [31323, 0.001343, " long", false], [3609, 0.001281, " AI", false], [32227, 0.001277, " that", false], [46470, 0.001018, " longer", false], [4419, 0.001008, " an", false]]], "qwen": [279, 1, 0.9055376052856445, [[279, 0.905538, " the", false], [3793, 0.022919, " terms", false], [264, 0.016748, " a", false], [419, 0.00897, " this", false], [15235, 0.003279, " AI", false], [1293, 0.00291, " long", false], [220, 0.002771, " ", false], [5021, 0.00245, " longer", false], [6588, 0.002284, " practice", false], [458, 0.002251, " an", false]]]}, "raw_delta": -0.017085667699575424, "tuned_delta": -0.008513875668997176}, {"byte_start": 843, "byte_end": 848, "display": {"text": " long", "kind": "normal"}, "is_word": true, "word_id": 139, "word_key": " long", "bytes_hex": "20 6c 6f 6e 67", "compression": {"rwkv": "1.78% 1.78% 1.78% 1.78% 1.78%", "qwen": "1.11% 1.11% 1.11% 1.11% 1.11%"}, "model_tokens": {"rwkv": [[31323, " long", "normal", 0.6108350157737732]], "qwen": [[1293, " long", "normal", 0.7342362403869629]]}, "loss": {"rwkv": 1.7822355729731822, "qwen": 1.1142093816195549}, "topk": {"rwkv": [31323, 1, 0.6108350157737732, [[31323, 0.610835, " long", false], [46470, 0.35425, " longer", false], [21616, 0.008056, " end", false], [32386, 0.003407, " very", false], [39675, 0.003014, " short", false], [46536, 0.002008, " medium", false], [52888, 0.001715, " shorter", false], [46064, 0.001254, " future", false], [51310, 0.001077, " context", false], [46397, 0.000997, " larger", false]]], "qwen": [1293, 1, 0.7342362403869629, [[1293, 0.734236, " long", false], [5021, 0.195004, " longer", false], [835, 0.021934, " end", false], [11051, 0.00635, " medium", false], [1602, 0.005318, " very", false], [2805, 0.003325, " short", false], [3853, 0.00324, " future", false], [3930, 0.002214, " limit", false], [8131, 0.001688, " larger", false], [2266, 0.001613, " context", false]]]}, "raw_delta": 0.03704323768615723, "tuned_delta": 0.04561502971673548}, {"byte_start": 848, "byte_end": 852, "display": {"text": " run", "kind": "normal"}, "is_word": true, "word_id": 140, "word_key": " run", "bytes_hex": "20 72 75 6e", "compression": {"rwkv": "3.21% 3.21% 3.21% 3.21%", "qwen": "5.04% 5.04% 5.04% 5.04%"}, "model_tokens": {"rwkv": [[22418, " run", "normal", 0.4916808307170868]], "qwen": [[1598, " run", "normal", 0.3270103633403778]]}, "loss": {"rwkv": 3.2052062675999915, "qwen": 5.0393491068108025}, "topk": {"rwkv": [22418, 1, 0.4916808307170868, [[22418, 0.491681, " run", false], [32219, 0.473208, " term", false], [46, 0.024563, "-", false], [31057, 0.003239, " haul", false], [27132, 0.001216, "term", false], [30941, 0.0012, " game", false], [32186, 0.00047, " tail", false], [32398, 0.00035, " view", false], [8661, 0.000324, "run", false], [45, 0.000261, ",", false]]], "qwen": [1598, 2, 0.3270103633403778, [[4647, 0.632555, " term", false], [1598, 0.32701, " run", false], [9663, 0.027619, "-term", false], [22973, 0.003781, "-run", false], [37868, 0.001621, " haul", false], [4991, 0.00115, "term", false], [1809, 0.000715, " game", false], [11, 0.000508, ",", false], [882, 0.000435, " time", false], [1651, 0.000375, " view", false]]]}, "raw_delta": -0.10170647501945496, "tuned_delta": -0.09313468298887671}, {"byte_start": 852, "byte_end": 855, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 141, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "0.40% 0.40% 0.40%", "qwen": "0.50% 0.50% 0.50%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.9357764720916748]], "qwen": [[374, " is", "normal", 0.9206897020339966]]}, "loss": {"rwkv": 0.39918319816263637, "qwen": 0.49672136711353176}, "topk": {"rwkv": [4600, 1, 0.9357764720916748, [[4600, 0.935776, " is", false], [21286, 0.023424, " are", false], [45, 0.015538, ",", false], [275, 0.006279, " (", false], [21700, 0.003928, " for", false], [4596, 0.002353, " in", false], [32475, 0.001746, " will", false], [37598, 0.001062, " about", false], [4601, 0.000875, " it", false], [4706, 0.00058, " of", false]]], "qwen": [374, 1, 0.9206897020339966, [[374, 0.92069, " is", false], [525, 0.025628, " are", false], [11, 0.016065, ",", false], [320, 0.009669, " (", false], [369, 0.004831, " for", false], [304, 0.00204, " in", false], [323, 0.002032, " and", false], [311, 0.001394, " to", false], [686, 0.00132, " will", false], [979, 0.001138, " when", false]]]}, "raw_delta": -0.00540866454442342, "tuned_delta": 0.003163127486154828}, {"byte_start": 855, "byte_end": 859, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 142, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "5.60% 5.60% 5.60% 5.60%", "qwen": "8.19% 8.19% 8.19% 8.19%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.28981590270996094]], "qwen": [[279, " the", "normal", 0.16274243593215942]]}, "loss": {"rwkv": 5.60030545657581, "qwen": 8.185430426273081}, "topk": {"rwkv": [22590, 1, 0.28981590270996094, [[22590, 0.289816, " the", false], [21835, 0.173152, " how", false], [32227, 0.114558, " that", false], [53342, 0.077344, " whether", false], [32464, 0.042637, " what", false], [38888, 0.028964, " lever", false], [40186, 0.017427, " which", false], [332, 0.013229, " a", false], [59832, 0.009594, " improving", false], [4811, 0.009205, " to", false]]], "qwen": [279, 1, 0.16274243593215942, [[279, 0.162742, " the", false], [76482, 0.093711, " leveraging", false], [311, 0.092522, " to", false], [34447, 0.065545, " computation", false], [1246, 0.045012, " how", false], [429, 0.041316, " that", false], [264, 0.034883, " a", false], [3425, 0.029197, " whether", false], [4586, 0.025029, " general", false], [1128, 0.024177, " what", false]]]}, "raw_delta": -0.1433497667312622, "tuned_delta": -0.13477797470068395}, {"byte_start": 859, "byte_end": 870, "display": {"text": " leveraging", "kind": "normal"}, "is_word": true, "word_id": 143, "word_key": " leveraging", "bytes_hex": "20 6c 65 76 65 72 61 67 69 6e 67", "compression": {"rwkv": "15.03% 15.03% 15.03% 15.03% 15.03% 15.03% 0.92% 0.92% 0.92% 0.92% 0.92%", "qwen": "9.31% 9.31% 9.31% 9.31% 9.31% 9.31% 9.31% 9.31% 9.31% 9.31% 9.31%"}, "model_tokens": {"rwkv": [[38888, " lever", "normal", 0.006754220928996801], [33672, "aging", "normal", 0.7784444093704224]], "qwen": [[76482, " leveraging", "normal", 0.0034172760788351297]]}, "loss": {"rwkv": 8.613391468375601, "qwen": 9.31015572616661}, "topk": {"rwkv": [38888, 29, 0.006754220928996801, [[50836, 0.084235, " ability", false], [30510, 0.061397, " cost", false], [45157, 0.042197, " amount", false], [63621, 0.032166, " improvement", false], [51832, 0.020987, " general", false], [56540, 0.019203, " leverage", false], [63370, 0.018766, " computation", false], [64862, 0.017476, " computational", false], [57481, 0.017034, " ultimate", false], [39984, 0.01658, " total", false]]], "qwen": [76482, 47, 0.0034172760788351297, [[5726, 0.169427, " ability", false], [990, 0.040495, " use", false], [4586, 0.040453, " general", false], [34447, 0.029547, " computation", false], [3311, 0.026409, " amount", false], [4401, 0.021444, " development", false], [54480, 0.017618, " computational", false], [4271, 0.015834, " quality", false], [15673, 0.014703, " improvement", false], [12111, 0.014498, " algorithm", false]]]}, "raw_delta": -0.03863681446422232, "tuned_delta": -0.03006502243364407}, {"byte_start": 870, "byte_end": 873, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 144, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.18% 0.18% 0.18%", "qwen": "0.09% 0.09% 0.09%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9712008237838745]], "qwen": [[315, " of", "normal", 0.9853333830833435]]}, "loss": {"rwkv": 0.17611023448351604, "qwen": 0.08881744489753073}, "topk": {"rwkv": [4706, 1, 0.9712008237838745, [[4706, 0.971201, " of", false], [22590, 0.003842, " the", false], [63370, 0.003557, " computation", false], [32227, 0.003371, " that", false], [31458, 0.001212, " more", false], [21265, 0.001107, " and", false], [59206, 0.00097, " available", false], [51832, 0.000649, " general", false], [275, 0.000576, " (", false], [38720, 0.000543, " human", false]]], "qwen": [315, 1, 0.9853333830833435, [[315, 0.985333, " of", false], [279, 0.002407, " the", false], [323, 0.002221, " and", false], [429, 0.000901, " that", false], [320, 0.000591, " (", false], [34447, 0.000498, " computation", false], [11, 0.000456, ",", false], [2355, 0.000411, " power", false], [476, 0.000368, " or", false], [862, 0.000324, " their", false]]]}, "raw_delta": 0.004840540078779061, "tuned_delta": 0.01341233210935731}, {"byte_start": 873, "byte_end": 885, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 145, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "1.88% 1.88% 1.88% 1.88% 1.88% 1.88% 1.88% 1.88% 1.88% 1.88% 1.88% 1.88%", "qwen": "1.52% 1.52% 1.52% 1.52% 1.52% 1.52% 1.52% 1.52% 1.52% 1.52% 1.52% 1.52%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.2883734107017517]], "qwen": [[34447, " computation", "normal", 0.3631451427936554]]}, "loss": {"rwkv": 1.878509167824171, "qwen": 1.5222727248108976}, "topk": {"rwkv": [63370, 1, 0.2883734107017517, [[63370, 0.288373, " computation", false], [22590, 0.129442, " the", false], [30789, 0.054575, " ever", false], [31458, 0.04456, " more", false], [51832, 0.038161, " general", false], [64862, 0.03177, " computational", false], [59988, 0.030973, " massively", false], [52195, 0.021507, " massive", false], [64430, 0.018577, " increasingly", false], [37045, 0.017253, " Moore", false]]], "qwen": [34447, 1, 0.3631451427936554, [[34447, 0.363145, " computation", false], [279, 0.183433, " the", false], [54480, 0.059844, " computational", false], [10951, 0.026548, " massive", false], [419, 0.025934, " this", false], [2500, 0.025503, " available", false], [803, 0.013521, " more", false], [3512, 0.012963, " ever", false], [74151, 0.012141, " exponentially", false], [678, 0.009145, " all", false]]]}, "raw_delta": 0.01975394288698833, "tuned_delta": 0.028325734917566577}, {"byte_start": 885, "byte_end": 886, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "9.09%", "qwen": "20.20%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.6067418456077576]], "qwen": [[13, ".", "normal", 0.3262180685997009]]}, "loss": {"rwkv": 9.087288099349427, "qwen": 20.201142364273302}, "topk": {"rwkv": [47, 1, 0.6067418456077576, [[47, 0.606742, ".", false], [45, 0.129655, ",", false], [32227, 0.037035, " that", false], [4811, 0.03598, " to", false], [21265, 0.020088, " and", false], [59206, 0.017486, " available", false], [275, 0.016574, " (", false], [4596, 0.014383, " in", false], [31601, 0.009885, " over", false], [46342, 0.009815, " itself", false]]], "qwen": [13, 2, 0.3262180685997009, [[624, 0.391796, ".\n", false], [13, 0.326218, ".", false], [11, 0.057867, ",", false], [5086, 0.030455, " itself", false], [311, 0.021595, " to", false], [382, 0.019031, ".\n\n", false], [304, 0.014615, " in", false], [320, 0.014332, " (", false], [2355, 0.011719, " power", false], [323, 0.011194, " and", false]]]}, "raw_delta": -0.6162829399108887, "tuned_delta": -0.6077111478803104}, {"byte_start": 886, "byte_end": 892, "display": {"text": " These", "kind": "normal"}, "is_word": true, "word_id": 146, "word_key": " these", "bytes_hex": "20 54 68 65 73 65", "compression": {"rwkv": "22.17% 22.17% 22.17% 22.17% 22.17% 22.17%", "qwen": "18.64% 18.64% 18.64% 18.64% 18.64% 18.64%"}, "model_tokens": {"rwkv": [[37453, " These", "normal", 0.0006322221015579998]], "qwen": [[4220, " These", "normal", 0.0020231707021594048]]}, "loss": {"rwkv": 22.166408180325217, "qwen": 18.64409600149811}, "topk": {"rwkv": [37453, 90, 0.0006322221015579998, [[11, 0.361544, "\n", false], [261, 0.140946, "\n\n", false], [20996, 0.066386, " The", false], [29894, 0.047772, " This", false], [3913, 0.024106, " In", false], [3908, 0.017849, " If", false], [3918, 0.017349, " It", false], [3641, 0.01397, " As", false], [19417, 0.013264, " And", false], [0, 0.010645, "[0]", false]]], "qwen": [4220, 65, 0.0020231707021594048, [[1096, 0.122805, " This", false], [576, 0.101877, " The", false], [758, 0.053649, " In", false], [1084, 0.03342, " It", false], [151643, 0.031468, "\u003c|endoftext|\u003e", false], [1597, 0.031053, " And", false], [1634, 0.027537, " As", false], [2938, 0.021748, " That", false], [2055, 0.020372, " So", false], [1416, 0.020039, " If", false]]]}, "raw_delta": 0.19531846046447754, "tuned_delta": 0.2038902524950558}, {"byte_start": 892, "byte_end": 896, "display": {"text": " two", "kind": "normal"}, "is_word": true, "word_id": 147, "word_key": " two", "bytes_hex": "20 74 77 6f", "compression": {"rwkv": "9.30% 9.30% 9.30% 9.30%", "qwen": "9.48% 9.48% 9.48% 9.48%"}, "model_tokens": {"rwkv": [[22638, " two", "normal", 0.12694168090820312]], "qwen": [[1378, " two", "normal", 0.122063048183918]]}, "loss": {"rwkv": 9.298620380729647, "qwen": 9.482192512477472}, "topk": {"rwkv": [22638, 1, 0.12694168090820312, [[22638, 0.126942, " two", false], [52127, 0.116239, " lessons", false], [21286, 0.112441, " are", false], [30582, 0.077645, " days", false], [52738, 0.042056, " results", false], [64495, 0.024045, " observations", false], [47539, 0.02168, " things", false], [38735, 0.020151, " ideas", false], [56463, 0.019488, " insights", false], [38440, 0.018844, " facts", false]]], "qwen": [1378, 2, 0.122063048183918, [[18366, 0.141717, " lessons", false], [1378, 0.122063, " two", false], [2849, 0.100338, " days", false], [525, 0.08124, " are", false], [4586, 0.054305, " general", false], [23722, 0.028487, " observations", false], [25709, 0.026367, " insights", false], [6708, 0.024223, " ideas", false], [16170, 0.021039, " principles", false], [5413, 0.017733, " methods", false]]]}, "raw_delta": -0.010179400444030762, "tuned_delta": -0.0016076084134525135}, {"byte_start": 896, "byte_end": 901, "display": {"text": " need", "kind": "normal"}, "is_word": true, "word_id": 148, "word_key": " need", "bytes_hex": "20 6e 65 65 64", "compression": {"rwkv": "38.77% 38.77% 38.77% 38.77% 38.77%", "qwen": "30.38% 30.38% 30.38% 30.38% 30.38%"}, "model_tokens": {"rwkv": [[31506, " need", "normal", 2.2071797502576374e-05]], "qwen": [[1184, " need", "normal", 0.00021952726820018142]]}, "loss": {"rwkv": 38.77242922389089, "qwen": 30.38328061814791}, "topk": {"rwkv": [31506, 1015, 2.2071797502576374e-05, [[52127, 0.144082, " lessons", false], [46853, 0.092754, " points", false], [38440, 0.089346, " facts", false], [47539, 0.052153, " things", false], [38735, 0.044716, " ideas", false], [51703, 0.041901, " factors", false], [64495, 0.035346, " observations", false], [47613, 0.035015, " trends", false], [56463, 0.024941, " insights", false], [46022, 0.022422, " forces", false]]], "qwen": [1184, 323, 0.00021952726820018142, [[18366, 0.094548, " lessons", false], [6708, 0.061324, " ideas", false], [9363, 0.049633, " factors", false], [2513, 0.046846, " things", false], [23722, 0.043611, " observations", false], [3501, 0.031732, " points", false], [16170, 0.03025, " principles", false], [525, 0.028089, " are", false], [12239, 0.026806, " statements", false], [13064, 0.024781, " facts", false]]]}, "raw_delta": 0.46519317626953116, "tuned_delta": 0.4737649683001094}, {"byte_start": 901, "byte_end": 905, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 149, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "2.50% 2.50% 2.50% 2.50%", "qwen": "2.32% 2.32% 2.32% 2.32%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.5746027827262878]], "qwen": [[537, " not", "normal", 0.59713214635849]]}, "loss": {"rwkv": 2.5007653296659274, "qwen": 2.324618280146211}, "topk": {"rwkv": [22187, 1, 0.5746027827262878, [[22187, 0.574603, " not", false], [4811, 0.347578, " to", false], [111, 0.041622, "n", false], [30719, 0.016453, " each", false], [122, 0.003112, "y", false], [4435, 0.002024, " be", false], [7592, 0.001194, "ful", false], [31581, 0.000894, " only", false], [4692, 0.000877, " no", false], [332, 0.000782, " a", false]]], "qwen": [537, 1, 0.59713214635849, [[537, 0.597132, " not", false], [311, 0.290475, " to", false], [77, 0.057425, "n", false], [1817, 0.022967, " each", false], [2581, 0.006973, " never", false], [387, 0.004935, " be", false], [1172, 0.002542, " only", false], [264, 0.002226, " a", false], [1045, 0.000731, " some", false], [279, 0.000689, " the", false]]]}, "raw_delta": 0.009767666459083557, "tuned_delta": 0.018339458489661807}, {"byte_start": 905, "byte_end": 909, "display": {"text": " run", "kind": "normal"}, "is_word": true, "word_id": 150, "word_key": " run", "bytes_hex": "20 72 75 6e", "compression": {"rwkv": "28.88% 28.88% 28.88% 28.88%", "qwen": "29.47% 29.47% 29.47% 29.47%"}, "model_tokens": {"rwkv": [[22418, " run", "normal", 0.0016512158326804638]], "qwen": [[1598, " run", "normal", 0.0014501496916636825]]}, "loss": {"rwkv": 28.88207845529663, "qwen": 29.467445055122692}, "topk": {"rwkv": [22418, 25, 0.0016512158326804638, [[4435, 0.698907, " be", false], [55824, 0.089738, " conflict", false], [4559, 0.023159, " go", false], [51255, 0.022956, " compete", false], [63717, 0.020847, " necessarily", false], [61779, 0.014937, " contradict", false], [45150, 0.013822, " always", false], [30788, 0.00674, " even", false], [30482, 0.005506, " come", false], [55769, 0.004843, " coincide", false]]], "qwen": [1598, 23, 0.0014501496916636825, [[387, 0.701583, " be", false], [2677, 0.060365, " always", false], [12055, 0.055626, " conflict", false], [728, 0.034565, " go", false], [14312, 0.01243, " necessarily", false], [42461, 0.012189, " contradict", false], [2525, 0.007426, " come", false], [614, 0.006855, " have", false], [20259, 0.006407, " compete", false], [2803, 0.005127, " seem", false]]]}, "raw_delta": -0.03245961666107178, "tuned_delta": -0.023887824630493527}, {"byte_start": 909, "byte_end": 917, "display": {"text": " counter", "kind": "normal"}, "is_word": true, "word_id": 151, "word_key": " counter", "bytes_hex": "20 63 6f 75 6e 74 65 72", "compression": {"rwkv": "8.49% 8.49% 8.49% 8.49% 8.49% 8.49% 8.49% 8.49%", "qwen": "8.42% 8.42% 8.42% 8.42% 8.42% 8.42% 8.42% 8.42%"}, "model_tokens": {"rwkv": [[51336, " counter", "normal", 0.023207833990454674]], "qwen": [[5546, " counter", "normal", 0.02388518676161766]]}, "loss": {"rwkv": 8.488513302105472, "qwen": 8.418343843107662}, "topk": {"rwkv": [51336, 6, 0.023207833990454674, [[4596, 0.684405, " in", false], [64301, 0.070829, " concurrently", false], [57435, 0.055325, " together", false], [56812, 0.051997, " parallel", false], [65167, 0.034097, " simultaneously", false], [51336, 0.023208, " counter", false], [4424, 0.014395, " at", false], [31162, 0.006264, " into", false], [32011, 0.005742, " side", false], [31044, 0.005019, " hand", false]]], "qwen": [5546, 6, 0.02388518676161766, [[304, 0.442034, " in", false], [15279, 0.205334, " parallel", false], [1424, 0.089002, " hand", false], [78026, 0.040503, " concurrently", false], [3108, 0.029114, " side", false], [5546, 0.023885, " counter", false], [518, 0.021003, " at", false], [3786, 0.014364, " together", false], [1119, 0.01417, " into", false], [700, 0.013769, " out", false]]]}, "raw_delta": 0.0038910210132598877, "tuned_delta": 0.012462813043838136}, {"byte_start": 917, "byte_end": 920, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 152, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "1.07% 1.07% 1.07%", "qwen": "2.00% 2.00% 2.00%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.8370802402496338]], "qwen": [[311, " to", "normal", 0.717501699924469]]}, "loss": {"rwkv": 1.0684020891999972, "qwen": 1.9956076760817911}, "topk": {"rwkv": [4811, 1, 0.8370802402496338, [[4811, 0.83708, " to", false], [45, 0.046543, ",", false], [46, 0.03329, "-", false], [60, 0.017668, ";", false], [59, 0.014434, ":", false], [47, 0.011907, ".", false], [30719, 0.006606, " each", false], [4596, 0.002597, " in", false], [21400, 0.00197, " but", false], [35408, 0.001863, "point", false]]], "qwen": [311, 1, 0.717501699924469, [[311, 0.717502, " to", false], [11, 0.076769, ",", false], [13, 0.03808, ".", false], [26, 0.031395, ";", false], [304, 0.01582, " in", false], [25, 0.01469, ":", false], [624, 0.010889, ".\n", false], [396, 0.009218, "int", false], [20052, 0.006652, "-int", false], [1576, 0.006468, " because", false]]]}, "raw_delta": -0.051415195067723594, "tuned_delta": -0.042843403037145344}, {"byte_start": 920, "byte_end": 925, "display": {"text": " each", "kind": "normal"}, "is_word": true, "word_id": 153, "word_key": " each", "bytes_hex": "20 65 61 63 68", "compression": {"rwkv": "1.20% 1.20% 1.20% 1.20% 1.20%", "qwen": "1.14% 1.14% 1.14% 1.14% 1.14%"}, "model_tokens": {"rwkv": [[30719, " each", "normal", 0.7160350680351257]], "qwen": [[1817, " each", "normal", 0.7294825911521912]]}, "loss": {"rwkv": 1.2045940038672498, "qwen": 1.1376362133851459}, "topk": {"rwkv": [30719, 1, 0.7160350680351257, [[30719, 0.716035, " each", false], [22226, 0.280017, " one", false], [22590, 0.001423, " the", false], [332, 0.000392, " a", false], [50919, 0.000242, " another", false], [45, 0.000173, ",", false], [39193, 0.000154, " other", false], [21273, 0.000147, " any", false], [62643, 0.000101, " themselves", false], [4715, 6.5e-05, " or", false]]], "qwen": [1817, 1, 0.7294825911521912, [[1817, 0.729483, " each", false], [825, 0.256977, " one", false], [279, 0.003538, " the", false], [264, 0.001226, " a", false], [5577, 0.000648, " themselves", false], [862, 0.000487, " their", false], [894, 0.000421, " any", false], [2987, 0.00039, " either", false], [1008, 0.000318, " other", false], [387, 0.000254, " be", false]]]}, "raw_delta": 0.0037129282951355036, "tuned_delta": 0.012284720325713752}, {"byte_start": 925, "byte_end": 931, "display": {"text": " other", "kind": "normal"}, "is_word": true, "word_id": 154, "word_key": " other", "bytes_hex": "20 6f 74 68 65 72", "compression": {"rwkv": "0.02% 0.02% 0.02% 0.02% 0.02% 0.02%", "qwen": "0.01% 0.01% 0.01% 0.01% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[39193, " other", "normal", 0.9946094751358032]], "qwen": [[1008, " other", "normal", 0.9954625964164734]]}, "loss": {"rwkv": 0.016235162241449132, "qwen": 0.013668722862061278}, "topk": {"rwkv": [39193, 1, 0.9946094751358032, [[39193, 0.994609, " other", false], [46, 0.001437, "-", false], [35297, 0.001021, "other", false], [50919, 0.000863, " another", false], [46726, 0.000635, " others", false], [45, 0.000382, ",", false], [47, 0.000115, ".", false], [11, 7.3e-05, "\n", false], [4596, 6.4e-05, " in", false], [4811, 5.9e-05, " to", false]]], "qwen": [1008, 1, 0.9954625964164734, [[1008, 0.995463, " other", false], [1575, 0.001111, "other", false], [2441, 0.0007, " another", false], [72472, 0.000452, "-other", false], [11, 0.000449, ",", false], [3800, 0.000196, " others", false], [13, 0.000177, ".", false], [26, 0.000133, ";", false], [198, 9.8e-05, "\n", false], [304, 9.2e-05, " in", false]]]}, "raw_delta": 0.00014231361759205663, "tuned_delta": 0.008714105648170305}, {"byte_start": 931, "byte_end": 932, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "18.60%", "qwen": "18.97%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.34999677538871765]], "qwen": [[11, ",", "normal", 0.34930193424224854]]}, "loss": {"rwkv": 18.597240761459293, "qwen": 18.968168643273927}, "topk": {"rwkv": [45, 1, 0.34999677538871765, [[45, 0.349997, ",", false], [47, 0.20553, ".", false], [59, 0.148101, ":", false], [60, 0.105455, ";", false], [21400, 0.015337, " but", false], [4596, 0.01408, " in", false], [51018, 0.013786, " because", false], [275, 0.013734, " (", false], [4424, 0.013089, " at", false], [280, 0.013078, " -", false]]], "qwen": [11, 1, 0.34930193424224854, [[11, 0.349302, ",", false], [13, 0.165296, ".", false], [26, 0.099456, ";", false], [25, 0.069394, ":", false], [624, 0.048078, ".\n", false], [304, 0.028062, " in", false], [438, 0.026407, " as", false], [323, 0.024873, " and", false], [1576, 0.023704, " because", false], [714, 0.02264, " but", false]]]}, "raw_delta": -0.0205686092376709, "tuned_delta": -0.01199681720709265}, {"byte_start": 932, "byte_end": 936, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 155, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"rwkv": "5.25% 5.25% 5.25% 5.25%", "qwen": "5.57% 5.57% 5.57% 5.57%"}, "model_tokens": {"rwkv": [[21400, " but", "normal", 0.3121977150440216]], "qwen": [[714, " but", "normal", 0.2908656597137451]]}, "loss": {"rwkv": 5.248084987608777, "qwen": 5.567422373730841}, "topk": {"rwkv": [21400, 1, 0.3121977150440216, [[21400, 0.312198, " but", false], [4423, 0.149926, " as", false], [21265, 0.095056, " and", false], [51948, 0.061952, " however", false], [39690, 0.061606, " since", false], [4596, 0.052091, " in", false], [51018, 0.047472, " because", false], [47544, 0.043504, " though", false], [4706, 0.021436, " of", false], [21700, 0.012967, " for", false]]], "qwen": [714, 1, 0.2908656597137451, [[714, 0.290866, " but", false], [323, 0.15414, " and", false], [438, 0.137591, " as", false], [4764, 0.078339, " however", false], [3498, 0.045718, " though", false], [315, 0.043956, " of", false], [304, 0.034507, " in", false], [1576, 0.03194, " because", false], [2474, 0.028332, " since", false], [369, 0.015484, " for", false]]]}, "raw_delta": -0.01770782470703125, "tuned_delta": -0.009136032676453002}, {"byte_start": 936, "byte_end": 939, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 156, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "19.44% 19.44% 19.44%", "qwen": "16.65% 16.65% 16.65%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.03985238075256348]], "qwen": [[304, " in", "normal", 0.06268417090177536]]}, "loss": {"rwkv": 19.44256988698017, "qwen": 16.64897829682268}, "topk": {"rwkv": [4596, 4, 0.03985238075256348, [[32232, 0.228443, " they", false], [4601, 0.112102, " it", false], [22590, 0.076137, " the", false], [4596, 0.039852, " in", false], [4588, 0.027184, " if", false], [21286, 0.022559, " are", false], [39934, 0.02241, " there", false], [21700, 0.017828, " for", false], [47001, 0.016026, " rather", false], [22226, 0.015842, " one", false]]], "qwen": [304, 3, 0.06268417090177536, [[807, 0.221437, " they", false], [279, 0.135123, " the", false], [304, 0.062684, " in", false], [432, 0.059239, " it", false], [421, 0.030862, " if", false], [1052, 0.027152, " there", false], [979, 0.017533, " when", false], [438, 0.017005, " as", false], [825, 0.016756, " one", false], [11, 0.015249, ",", false]]]}, "raw_delta": 0.15490961074829102, "tuned_delta": 0.16348140277886927}, {"byte_start": 939, "byte_end": 948, "display": {"text": " practice", "kind": "normal"}, "is_word": true, "word_id": 157, "word_key": " practice", "bytes_hex": "20 70 72 61 63 74 69 63 65", "compression": {"rwkv": "2.41% 2.41% 2.41% 2.41% 2.41% 2.41% 2.41% 2.41% 2.41%", "qwen": "3.59% 3.59% 3.59% 3.59% 3.59% 3.59% 3.59% 3.59% 3.59%"}, "model_tokens": {"rwkv": [[56901, " practice", "normal", 0.3012830317020416]], "qwen": [[6588, " practice", "normal", 0.16660629212856293]]}, "loss": {"rwkv": 2.410753432041019, "qwen": 3.5909516491104214}, "topk": {"rwkv": [56901, 2, 0.3012830317020416, [[22590, 0.319479, " the", false], [56901, 0.301283, " practice", false], [30808, 0.047371, " fact", false], [31370, 0.036926, " many", false], [31461, 0.028251, " most", false], [39189, 0.02413, " order", false], [51832, 0.019897, " general", false], [32074, 0.018274, " some", false], [332, 0.017392, " a", false], [32234, 0.015541, " this", false]]], "qwen": [6588, 2, 0.16660629212856293, [[279, 0.245173, " the", false], [6588, 0.166606, " practice", false], [2097, 0.10056, " fact", false], [4586, 0.077328, " general", false], [1657, 0.065613, " many", false], [1429, 0.044612, " most", false], [1973, 0.030774, " order", false], [264, 0.029953, " a", false], [894, 0.020458, " any", false], [847, 0.018656, " my", false]]]}, "raw_delta": -0.06544408533308242, "tuned_delta": -0.05687229330250417}, {"byte_start": 948, "byte_end": 953, "display": {"text": " they", "kind": "normal"}, "is_word": true, "word_id": 158, "word_key": " they", "bytes_hex": "20 74 68 65 79", "compression": {"rwkv": "3.92% 3.92% 3.92% 3.92% 3.92%", "qwen": "3.45% 3.45% 3.45% 3.45% 3.45%"}, "model_tokens": {"rwkv": [[32232, " they", "normal", 0.3347264230251312]], "qwen": [[807, " they", "normal", 0.3845542073249817]]}, "loss": {"rwkv": 3.9166916149133963, "qwen": 3.4468526409779168}, "topk": {"rwkv": [32232, 1, 0.3347264230251312, [[32232, 0.334726, " they", false], [45, 0.116147, ",", false], [22590, 0.097098, " the", false], [4601, 0.07882, " it", false], [39934, 0.034956, " there", false], [32234, 0.023624, " this", false], [63843, 0.021321, " researchers", false], [31461, 0.019253, " most", false], [4858, 0.016567, " we", false], [31370, 0.015238, " many", false]]], "qwen": [807, 1, 0.3845542073249817, [[807, 0.384554, " they", false], [11, 0.197659, ",", false], [279, 0.096124, " the", false], [432, 0.056831, " it", false], [1052, 0.02848, " there", false], [419, 0.017806, " this", false], [825, 0.012207, " one", false], [1429, 0.008678, " most", false], [11811, 0.008366, " researchers", false], [582, 0.007938, " we", false]]]}, "raw_delta": 0.02605340480804444, "tuned_delta": 0.03462519683862269}, {"byte_start": 953, "byte_end": 958, "display": {"text": " tend", "kind": "normal"}, "is_word": true, "word_id": 159, "word_key": " tend", "bytes_hex": "20 74 65 6e 64", "compression": {"rwkv": "11.38% 11.38% 11.38% 11.38% 11.38%", "qwen": "9.85% 9.85% 9.85% 9.85% 9.85%"}, "model_tokens": {"rwkv": [[32216, " tend", "normal", 0.04244176670908928]], "qwen": [[8376, " tend", "normal", 0.06506852805614471]]}, "loss": {"rwkv": 11.383765557014476, "qwen": 9.854740040906607}, "topk": {"rwkv": [32216, 5, 0.04244176670908928, [[4491, 0.258109, " do", false], [31059, 0.177194, " have", false], [39171, 0.160973, " often", false], [21286, 0.098834, " are", false], [32216, 0.042442, " tend", false], [21413, 0.030162, " can", false], [31967, 0.02112, " seem", false], [60523, 0.020637, " sometimes", false], [53248, 0.013855, " usually", false], [45145, 0.010364, " almost", false]]], "qwen": [8376, 3, 0.06506852805614471, [[653, 0.352733, " do", false], [3545, 0.258844, " often", false], [8376, 0.065069, " tend", false], [614, 0.053291, " have", false], [525, 0.047206, " are", false], [646, 0.021988, " can", false], [686, 0.017243, " will", false], [5990, 0.016247, " usually", false], [13814, 0.015728, " frequently", false], [4558, 0.013145, " almost", false]]]}, "raw_delta": 0.08478717803955071, "tuned_delta": 0.09335897007012896}, {"byte_start": 958, "byte_end": 961, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 160, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.10% 0.10% 0.10%", "qwen": "0.10% 0.10% 0.10%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.9841216802597046]], "qwen": [[311, " to", "normal", 0.9841543436050415]]}, "loss": {"rwkv": 0.0961268363222525, "qwen": 0.09601448775983339}, "topk": {"rwkv": [4811, 1, 0.9841216802597046, [[4811, 0.984122, " to", false], [22187, 0.009021, " not", false], [4491, 0.000918, " do", false], [53169, 0.00074, " towards", false], [47585, 0.000636, " toward", false], [4596, 0.000334, " in", false], [22418, 0.000317, " run", false], [45, 0.000246, ",", false], [21700, 0.000188, " for", false], [22614, 0.000153, " too", false]]], "qwen": [311, 1, 0.9841543436050415, [[311, 0.984154, " to", false], [537, 0.008721, " not", false], [653, 0.002119, " do", false], [6974, 0.000615, " towards", false], [8841, 0.000587, " toward", false], [11, 0.000378, ",", false], [320, 0.000358, " (", false], [304, 0.000216, " in", false], [13, 0.000197, ".", false], [2238, 0.000171, " too", false]]]}, "raw_delta": 6.229927142460852e-06, "tuned_delta": 0.00857802195772071}, {"byte_start": 961, "byte_end": 962, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "30.15%", "qwen": "33.55%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.18680818378925323]], "qwen": [[13, ".", "normal", 0.15557077527046204]]}, "loss": {"rwkv": 30.150072143577944, "qwen": 33.55446226805783}, "topk": {"rwkv": [47, 1, 0.18680818378925323, [[47, 0.186808, ".", false], [4491, 0.14348, " do", false], [4435, 0.140456, " be", false], [22418, 0.075125, " run", false], [51255, 0.038406, " compete", false], [45, 0.036937, ",", false], [55824, 0.027529, " conflict", false], [4559, 0.021421, " go", false], [31059, 0.019723, " have", false], [59, 0.018619, ":", false]]], "qwen": [13, 2, 0.15557077527046204, [[653, 0.266169, " do", false], [13, 0.155571, ".", false], [624, 0.094433, ".\n", false], [11, 0.067669, ",", false], [387, 0.065015, " be", false], [1598, 0.059061, " run", false], [12055, 0.045034, " conflict", false], [20259, 0.038881, " compete", false], [26, 0.013864, ";", false], [1576, 0.011937, " because", false]]]}, "raw_delta": -0.18877947330474854, "tuned_delta": -0.18020768127417028}, {"byte_start": 962, "byte_end": 967, "display": {"text": " Time", "kind": "normal"}, "is_word": true, "word_id": 161, "word_key": " time", "bytes_hex": "20 54 69 6d 65", "compression": {"rwkv": "31.56% 31.56% 31.56% 31.56% 31.56%", "qwen": "31.47% 31.47% 31.47% 31.47% 31.47%"}, "model_tokens": {"rwkv": [[29904, " Time", "normal", 0.00015415129018947482]], "qwen": [[4120, " Time", "normal", 0.00016235960356425494]]}, "loss": {"rwkv": 31.55895401944607, "qwen": 31.471297901954316}, "topk": {"rwkv": [29904, 259, 0.00015415129018947482, [[11, 0.384399, "\n", false], [261, 0.132226, "\n\n", false], [20996, 0.067632, " The", false], [19907, 0.024179, " For", false], [3913, 0.023985, " In", false], [29894, 0.020572, " This", false], [3918, 0.017416, " It", false], [3908, 0.01347, " If", false], [300, 0.01145, " A", false], [3641, 0.0101, " As", false]]], "qwen": [4120, 388, 0.00016235960356425494, [[576, 0.118124, " The", false], [758, 0.058879, " In", false], [1752, 0.055984, " For", false], [1096, 0.052615, " This", false], [1084, 0.03124, " It", false], [362, 0.02583, " A", false], [2619, 0.022786, " There", false], [1634, 0.021489, " As", false], [1416, 0.021447, " If", false], [151643, 0.019918, "\u003c|endoftext|\u003e", false]]]}, "raw_delta": 0.004860687255859419, "tuned_delta": 0.013432479286437668}, {"byte_start": 967, "byte_end": 973, "display": {"text": " spent", "kind": "normal"}, "is_word": true, "word_id": 162, "word_key": " spent", "bytes_hex": "20 73 70 65 6e 74", "compression": {"rwkv": "8.17% 8.17% 8.17% 8.17% 8.17% 8.17%", "qwen": "10.61% 10.61% 10.61% 10.61% 10.61% 10.61%"}, "model_tokens": {"rwkv": [[39762, " spent", "normal", 0.06628917157649994]], "qwen": [[7391, " spent", "normal", 0.02930413745343685]]}, "loss": {"rwkv": 8.171514880035144, "qwen": 10.609899235855616}, "topk": {"rwkv": [39762, 4, 0.06628917157649994, [[21265, 0.224257, " and", false], [32475, 0.173081, " will", false], [4600, 0.143911, " is", false], [39762, 0.066289, " spent", false], [4811, 0.046215, " to", false], [62307, 0.045497, " permitting", false], [46, 0.038669, "-", false], [21800, 0.019, " has", false], [45, 0.017429, ",", false], [63396, 0.013565, " constraints", false]]], "qwen": [7391, 5, 0.02930413745343685, [[323, 0.213747, " and", false], [374, 0.143557, " is", false], [311, 0.109366, " to", false], [11, 0.035483, ",", false], [7391, 0.029304, " spent", false], [686, 0.027268, " will", false], [369, 0.02348, " for", false], [1283, 0.022726, " after", false], [702, 0.021844, " has", false], [16982, 0.011835, " constraints", false]]]}, "raw_delta": -0.13521273930867517, "tuned_delta": -0.1266409472780969}, {"byte_start": 973, "byte_end": 976, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 163, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"rwkv": "9.67% 9.67% 9.67%", "qwen": "7.70% 7.70% 7.70%"}, "model_tokens": {"rwkv": [[4712, " on", "normal", 0.20093382894992828]], "qwen": [[389, " on", "normal", 0.2779558300971985]]}, "loss": {"rwkv": 9.674322214294481, "qwen": 7.696135485002118}, "topk": {"rwkv": [4712, 1, 0.20093382894992828, [[4712, 0.200934, " on", false], [4596, 0.047296, " in", false], [47629, 0.041765, " trying", false], [61857, 0.030057, " developing", false], [52834, 0.029152, " seeking", false], [38888, 0.028236, " lever", false], [59832, 0.02465, " improving", false], [56537, 0.023161, " learning", false], [60463, 0.020666, " searching", false], [57419, 0.019835, " thinking", false]]], "qwen": [389, 1, 0.2779558300971985, [[389, 0.277956, " on", false], [304, 0.045176, " in", false], [6832, 0.044051, " learning", false], [11220, 0.035835, " developing", false], [18392, 0.032943, " improving", false], [4460, 0.031147, " trying", false], [76482, 0.024253, " leveraging", false], [10887, 0.023543, " seeking", false], [4752, 0.023109, " building", false], [553, 0.017318, " by", false]]]}, "raw_delta": 0.10969396432240808, "tuned_delta": 0.11826575635298632}, {"byte_start": 976, "byte_end": 980, "display": {"text": " one", "kind": "normal"}, "is_word": true, "word_id": 164, "word_key": " one", "bytes_hex": "20 6f 6e 65", "compression": {"rwkv": "20.71% 20.71% 20.71% 20.71%", "qwen": "16.67% 16.67% 16.67% 16.67%"}, "model_tokens": {"rwkv": [[22226, " one", "normal", 0.010251494124531746]], "qwen": [[825, " one", "normal", 0.024803495034575462]]}, "loss": {"rwkv": 20.710563575261485, "qwen": 16.666602218969846}, "topk": {"rwkv": [22226, 11, 0.010251494124531746, [[22590, 0.10022, " the", false], [38720, 0.068896, " human", false], [332, 0.053036, " a", false], [57103, 0.036788, " research", false], [38888, 0.029657, " lever", false], [59832, 0.023433, " improving", false], [45775, 0.014009, " domain", false], [45490, 0.012178, " clever", false], [61857, 0.01184, " developing", false], [55666, 0.011527, " building", false]]], "qwen": [825, 6, 0.024803495034575462, [[76482, 0.065829, " leveraging", false], [279, 0.063352, " the", false], [3738, 0.052422, " human", false], [264, 0.041404, " a", false], [4586, 0.038453, " general", false], [825, 0.024803, " one", false], [7947, 0.024309, " domain", false], [3412, 0.023295, " research", false], [6540, 0.019125, " knowledge", false], [11220, 0.01882, " developing", false]]]}, "raw_delta": 0.2242448329925537, "tuned_delta": 0.23281662502313197}, {"byte_start": 980, "byte_end": 983, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 165, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "11.04% 11.04% 11.04%", "qwen": "11.59% 11.59% 11.59%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.15896400809288025]], "qwen": [[374, " is", "normal", 0.14543162286281586]]}, "loss": {"rwkv": 11.036241360967004, "qwen": 11.589945954769224}, "topk": {"rwkv": [4600, 1, 0.15896400809288025, [[4600, 0.158964, " is", false], [21413, 0.055196, " can", false], [32475, 0.03613, " will", false], [39914, 0.034497, " tends", false], [4715, 0.031097, " or", false], [39941, 0.024198, " thing", false], [30659, 0.022441, " does", false], [4424, 0.019978, " at", false], [32202, 0.019124, " task", false], [22074, 0.018737, " may", false]]], "qwen": [374, 1, 0.14543162286281586, [[374, 0.145432, " is", false], [3545, 0.093406, " often", false], [646, 0.040591, " can", false], [27236, 0.036611, " tends", false], [1231, 0.035747, " may", false], [686, 0.033684, " will", false], [315, 0.02875, " of", false], [476, 0.026719, " or", false], [5990, 0.022938, " usually", false], [11, 0.021252, ",", false]]]}, "raw_delta": -0.03070390224456787, "tuned_delta": -0.02213211021398962}, {"byte_start": 983, "byte_end": 988, "display": {"text": " time", "kind": "normal"}, "is_word": true, "word_id": 166, "word_key": " time", "bytes_hex": "20 74 69 6d 65", "compression": {"rwkv": "2.16% 2.16% 2.16% 2.16% 2.16%", "qwen": "5.03% 5.03% 5.03% 5.03% 5.03%"}, "model_tokens": {"rwkv": [[32251, " time", "normal", 0.5482905507087708]], "qwen": [[882, " time", "normal", 0.24824698269367218]]}, "loss": {"rwkv": 2.155589270078236, "qwen": 5.025379923483627}, "topk": {"rwkv": [32251, 1, 0.5482905507087708, [[32251, 0.548291, " time", false], [62110, 0.095722, " inevitably", false], [39762, 0.038598, " spent", false], [39171, 0.022766, " often", false], [332, 0.021824, " a", false], [63717, 0.019603, " necessarily", false], [47768, 0.012613, " wasted", false], [53248, 0.012257, " usually", false], [22187, 0.010862, " not", false], [46439, 0.010774, " likely", false]]], "qwen": [882, 1, 0.24824698269367218, [[882, 0.248247, " time", false], [3545, 0.205592, " often", false], [38828, 0.053793, " wasted", false], [5558, 0.037867, " lost", false], [4363, 0.029061, " likely", false], [5990, 0.02739, " usually", false], [7391, 0.022486, " spent", false], [264, 0.019575, " a", false], [518, 0.017265, " at", false], [537, 0.015288, " not", false]]]}, "raw_delta": -0.15913498401641843, "tuned_delta": -0.15056319198584017}, {"byte_start": 988, "byte_end": 992, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 167, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "2.85% 2.85% 2.85% 2.85%", "qwen": "2.82% 2.82% 2.82% 2.82%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.5307666063308716]], "qwen": [[537, " not", "normal", 0.5350255966186523]]}, "loss": {"rwkv": 2.8529857986329596, "qwen": 2.819750688799506}, "topk": {"rwkv": [22187, 1, 0.5307666063308716, [[22187, 0.530767, " not", false], [39762, 0.19014, " spent", false], [31334, 0.082802, " lost", false], [32227, 0.055468, " that", false], [47768, 0.02939, " wasted", false], [30211, 0.028751, " away", false], [39887, 0.020838, " taken", false], [63954, 0.008373, " unavailable", false], [31277, 0.00542, " less", false], [22218, 0.002672, " off", false]]], "qwen": [537, 1, 0.5350255966186523, [[537, 0.535026, " not", false], [429, 0.126795, " that", false], [7391, 0.11351, " spent", false], [5558, 0.090603, " lost", false], [38828, 0.022851, " wasted", false], [4429, 0.022105, " taken", false], [13628, 0.007204, " missed", false], [2115, 0.005417, " left", false], [2686, 0.004425, " less", false], [369, 0.002363, " for", false]]]}, "raw_delta": 0.0018429458141326904, "tuned_delta": 0.010414737844710939}, {"byte_start": 992, "byte_end": 998, "display": {"text": " spent", "kind": "normal"}, "is_word": true, "word_id": 168, "word_key": " spent", "bytes_hex": "20 73 70 65 6e 74", "compression": {"rwkv": "0.10% 0.10% 0.10% 0.10% 0.10% 0.10%", "qwen": "0.38% 0.38% 0.38% 0.38% 0.38% 0.38%"}, "model_tokens": {"rwkv": [[39762, " spent", "normal", 0.9659992456436157]], "qwen": [[7391, " spent", "normal", 0.8816502690315247]]}, "loss": {"rwkv": 0.10419855540274699, "qwen": 0.37858661859731446}, "topk": {"rwkv": [39762, 1, 0.9659992456436157, [[39762, 0.965999, " spent", false], [59206, 0.018936, " available", false], [51459, 0.002126, " devoted", false], [4712, 0.002086, " on", false], [56495, 0.001979, " invested", false], [32354, 0.00123, " used", false], [39761, 0.001206, " spend", false], [57278, 0.000584, " spending", false], [22339, 0.000523, " put", false], [38594, 0.000351, " given", false]]], "qwen": [7391, 1, 0.8816502690315247, [[7391, 0.88165, " spent", false], [2500, 0.076201, " available", false], [1660, 0.00788, " being", false], [27991, 0.003958, " invested", false], [8329, 0.002552, " spend", false], [4429, 0.00148, " taken", false], [38828, 0.001363, " wasted", false], [2115, 0.001313, " left", false], [18163, 0.001256, " gained", false], [28229, 0.001159, " devoted", false]]]}, "raw_delta": -0.015215304990609484, "tuned_delta": -0.006643512960031236}, {"byte_start": 998, "byte_end": 1001, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 169, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"rwkv": "0.19% 0.19% 0.19%", "qwen": "0.26% 0.26% 0.26%"}, "model_tokens": {"rwkv": [[4712, " on", "normal", 0.9695765972137451]], "qwen": [[389, " on", "normal", 0.9569395780563354]]}, "loss": {"rwkv": 0.18564953885137314, "qwen": 0.2645843802881575}, "topk": {"rwkv": [4712, 1, 0.9695765972137451, [[4712, 0.969577, " on", false], [38279, 0.002605, " doing", false], [22590, 0.002081, " the", false], [4596, 0.001891, " in", false], [38888, 0.001312, " lever", false], [61857, 0.001299, " developing", false], [59832, 0.001283, " improving", false], [21700, 0.001013, " for", false], [53362, 0.000967, " working", false], [59608, 0.000956, " elsewhere", false]]], "qwen": [389, 1, 0.9569395780563354, [[389, 0.95694, " on", false], [304, 0.005158, " in", false], [3730, 0.00416, " doing", false], [76482, 0.001945, " leveraging", false], [3238, 0.001614, " working", false], [18392, 0.001541, " improving", false], [33018, 0.001485, " pursuing", false], [279, 0.001283, " the", false], [17920, 0.001109, " elsewhere", false], [448, 0.000944, " with", false]]]}, "raw_delta": -0.004377077023188274, "tuned_delta": 0.004194715007389974}, {"byte_start": 1001, "byte_end": 1005, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 170, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "0.10% 0.10% 0.10% 0.10%", "qwen": "0.17% 0.17% 0.17% 0.17%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.9790688157081604]], "qwen": [[279, " the", "normal", 0.9620660543441772]]}, "loss": {"rwkv": 0.09575994000041184, "qwen": 0.17435043544470694}, "topk": {"rwkv": [22590, 1, 0.9790688157081604, [[22590, 0.979069, " the", false], [50919, 0.009265, " another", false], [39193, 0.001319, " other", false], [59832, 0.001289, " improving", false], [38888, 0.00061, " lever", false], [45833, 0.000422, " either", false], [30322, 0.000383, " both", false], [332, 0.000368, " a", false], [31458, 0.000266, " more", false], [32464, 0.000255, " what", false]]], "qwen": [279, 1, 0.9620660543441772, [[279, 0.962066, " the", false], [2441, 0.015389, " another", false], [1008, 0.00288, " other", false], [34447, 0.001726, " computation", false], [2494, 0.001625, " something", false], [264, 0.00138, " a", false], [76482, 0.001128, " leveraging", false], [2176, 0.001003, " both", false], [2987, 0.000812, " either", false], [18392, 0.000755, " improving", false]]]}, "raw_delta": -0.00435798242688179, "tuned_delta": 0.004213809603696458}, {"byte_start": 1005, "byte_end": 1011, "display": {"text": " other", "kind": "normal"}, "is_word": true, "word_id": 171, "word_key": " other", "bytes_hex": "20 6f 74 68 65 72", "compression": {"rwkv": "0.01% 0.01% 0.01% 0.01% 0.01% 0.01%", "qwen": "0.02% 0.02% 0.02% 0.02% 0.02% 0.02%"}, "model_tokens": {"rwkv": [[39193, " other", "normal", 0.9952180981636047]], "qwen": [[1008, " other", "normal", 0.994239330291748]]}, "loss": {"rwkv": 0.014400680632245842, "qwen": 0.017364419809424003}, "topk": {"rwkv": [39193, 1, 0.9952180981636047, [[39193, 0.995218, " other", false], [31515, 0.000768, " next", false], [46726, 0.000403, " others", false], [46405, 0.000402, " latter", false], [45301, 0.000374, " better", false], [31458, 0.000253, " more", false], [47205, 0.000222, " second", false], [45961, 0.000105, " faster", false], [31323, 0.000104, " long", false], [56767, 7.7e-05, " opposite", false]]], "qwen": [1008, 1, 0.994239330291748, [[1008, 0.994239, " other", false], [2086, 0.000546, " second", false], [2664, 0.000468, " better", false], [1790, 0.000465, " next", false], [15271, 0.000428, " latter", false], [3800, 0.000427, " others", false], [803, 0.000415, " more", false], [825, 0.000179, " one", false], [279, 0.00012, " the", false], [10555, 8e-05, " alternative", false]]]}, "raw_delta": -0.00016434459636608756, "tuned_delta": 0.008407447434212161}, {"byte_start": 1011, "byte_end": 1012, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "8.49%", "qwen": "22.39%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.6266527771949768]], "qwen": [[13, ".", "normal", 0.28900769352912903]]}, "loss": {"rwkv": 8.488513302105472, "qwen": 22.38525108738749}, "topk": {"rwkv": [47, 1, 0.6266527771949768, [[47, 0.626653, ".", false], [45, 0.302841, ",", false], [60, 0.016374, ";", false], [21265, 0.015433, " and", false], [275, 0.01133, " (", false], [59, 0.002982, ":", false], [34, 0.001864, "!", false], [9816, 0.001804, "—", false], [4596, 0.001661, " in", false], [280, 0.001412, " -", false]]], "qwen": [13, 2, 0.28900769352912903, [[624, 0.336423, ".\n", false], [13, 0.289008, ".", false], [11, 0.257568, ",", false], [26, 0.023685, ";", false], [323, 0.020717, " and", false], [382, 0.016234, ".\n\n", false], [320, 0.014207, " (", false], [25, 0.006255, ":", false], [481, 0.002701, " -", false], [1959, 0.002082, " —", false]]]}, "raw_delta": -0.7705987691879272, "tuned_delta": -0.762026977157349}, {"byte_start": 1012, "byte_end": 1018, "display": {"text": " There", "kind": "normal"}, "is_word": true, "word_id": 172, "word_key": " there", "bytes_hex": "20 54 68 65 72 65", "compression": {"rwkv": "13.99% 13.99% 13.99% 13.99% 13.99% 13.99%", "qwen": "11.67% 11.67% 11.67% 11.67% 11.67% 11.67%"}, "model_tokens": {"rwkv": [[37451, " There", "normal", 0.00949584599584341]], "qwen": [[2619, " There", "normal", 0.020563559606671333]]}, "loss": {"rwkv": 13.994893300290073, "qwen": 11.674512690575982}, "topk": {"rwkv": [37451, 14, 0.00949584599584341, [[11, 0.367848, "\n", false], [261, 0.106152, "\n\n", false], [20996, 0.067001, " The", false], [29894, 0.032806, " This", false], [3913, 0.025539, " In", false], [19555, 0.021221, " But", false], [3918, 0.017725, " It", false], [19417, 0.016521, " And", false], [3908, 0.015247, " If", false], [4217, 0.011594, " So", false]]], "qwen": [2619, 11, 0.020563559606671333, [[576, 0.113834, " The", false], [1096, 0.077977, " This", false], [758, 0.055176, " In", false], [1084, 0.037365, " It", false], [151643, 0.031481, "\u003c|endoftext|\u003e", false], [1597, 0.026793, " And", false], [1752, 0.025339, " For", false], [362, 0.02348, " A", false], [1634, 0.023457, " As", false], [1416, 0.020591, " If", false]]]}, "raw_delta": 0.12866922219594312, "tuned_delta": 0.13724101422652138}, {"byte_start": 1018, "byte_end": 1022, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 173, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"rwkv": "6.06% 6.06% 6.06% 6.06%", "qwen": "4.50% 4.50% 4.50% 4.50%"}, "model_tokens": {"rwkv": [[21286, " are", "normal", 0.26257655024528503]], "qwen": [[525, " are", "normal", 0.36894965171813965]]}, "loss": {"rwkv": 6.058192066232952, "qwen": 4.495325255191915}, "topk": {"rwkv": [21286, 2, 0.26257655024528503, [[4600, 0.48708, " is", false], [21286, 0.262577, " are", false], [460, 0.125651, "'s", false], [32475, 0.018146, " will", false], [21800, 0.01806, " has", false], [31059, 0.016646, " have", false], [22074, 0.010557, " may", false], [22748, 0.006616, " was", false], [21413, 0.005096, " can", false], [21896, 0.003484, " isn", false]]], "qwen": [525, 2, 0.36894965171813965, [[374, 0.456053, " is", false], [525, 0.36895, " are", false], [594, 0.058748, "'s", false], [614, 0.019578, " have", false], [702, 0.015429, " has", false], [686, 0.010607, " will", false], [572, 0.008044, " was", false], [1231, 0.007163, " may", false], [646, 0.00578, " can", false], [258, 0.003887, "in", false]]]}, "raw_delta": 0.08666373789310455, "tuned_delta": 0.0952355299236828}, {"byte_start": 1022, "byte_end": 1036, "display": {"text": " psychological", "kind": "normal"}, "is_word": true, "word_id": 174, "word_key": " psychological", "bytes_hex": "20 70 73 79 63 68 6f 6c 6f 67 69 63 61 6c", "compression": {"rwkv": "13.93% 13.93% 13.93% 13.93% 13.93% 13.93% 13.93% 13.93% 13.93% 13.93% 13.93% 13.93% 13.93% 13.93%", "qwen": "13.97% 13.97% 13.97% 13.97% 13.97% 13.97% 13.97% 13.97% 13.97% 13.97% 13.97% 13.97% 13.97% 13.97%"}, "model_tokens": {"rwkv": [[64997, " psychological", "normal", 2.0256720745237544e-05]], "qwen": [[23187, " psychological", "normal", 1.9427410734351724e-05]]}, "loss": {"rwkv": 13.927803687153498, "qwen": 13.97459525266324}, "topk": {"rwkv": [64997, 1190, 2.0256720745237544e-05, [[31370, 0.112075, " many", false], [332, 0.061086, " a", false], [22638, 0.058616, " two", false], [32074, 0.057009, " some", false], [61963, 0.039627, " exceptions", false], [45, 0.028475, ",", false], [4692, 0.024944, " no", false], [32448, 0.023521, " ways", false], [39193, 0.022537, " other", false], [46844, 0.021992, " plenty", false]]], "qwen": [23187, 1076, 1.9427410734351724e-05, [[1657, 0.127512, " many", false], [1378, 0.086523, " two", false], [264, 0.079205, " a", false], [1045, 0.068575, " some", false], [19585, 0.064439, " exceptions", false], [11, 0.03917, ",", false], [5510, 0.029527, " ways", false], [1083, 0.024977, " also", false], [1008, 0.022655, " other", false], [902, 0.021747, " no", false]]]}, "raw_delta": -0.002594675336565211, "tuned_delta": 0.005977116694013037}, {"byte_start": 1036, "byte_end": 1048, "display": {"text": " commitments", "kind": "normal"}, "is_word": true, "word_id": 175, "word_key": " commitments", "bytes_hex": "20 63 6f 6d 6d 69 74 6d 65 6e 74 73", "compression": {"rwkv": "11.60% 11.60% 11.60% 11.60% 11.60% 11.60% 11.60% 11.60% 11.60% 11.60% 11.60% 11.60%", "qwen": "14.92% 14.92% 14.92% 14.92% 14.92% 14.92% 14.92% 14.92% 14.92% 14.92% 14.92% 14.92%"}, "model_tokens": {"rwkv": [[63351, " commitments", "normal", 0.0004456617753021419]], "qwen": [[41256, " commitments", "normal", 4.8848836740944535e-05]]}, "loss": {"rwkv": 11.599794111314257, "qwen": 14.918037409382585}, "topk": {"rwkv": [63351, 78, 0.0004456617753021419, [[52654, 0.273222, " reasons", false], [21265, 0.212049, " and", false], [55600, 0.049575, " barriers", false], [45304, 0.042014, " biases", false], [45, 0.039875, ",", false], [51703, 0.034032, " factors", false], [2030, 0.031716, "ly", false], [64392, 0.01762, " explanations", false], [38124, 0.01718, " costs", false], [62202, 0.015761, " mechanisms", false]]], "qwen": [41256, 380, 4.8848836740944535e-05, [[7966, 0.364535, " reasons", false], [323, 0.129478, " and", false], [29640, 0.075673, " barriers", false], [9363, 0.072835, " factors", false], [40841, 0.033968, " explanations", false], [11, 0.032794, ",", false], [49083, 0.028542, " biases", false], [13566, 0.018777, " aspects", false], [6239, 0.015736, " effects", false], [13388, 0.012311, " limits", false]]]}, "raw_delta": -0.18400247891743984, "tuned_delta": -0.1754306868868616}, {"byte_start": 1048, "byte_end": 1051, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 176, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "7.37% 7.37% 7.37%", "qwen": "5.65% 5.65% 5.65%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.2906183898448944]], "qwen": [[311, " to", "normal", 0.3906971216201782]]}, "loss": {"rwkv": 7.373148483709871, "qwen": 5.649489270047869}, "topk": {"rwkv": [4811, 2, 0.2906183898448944, [[32227, 0.315365, " that", false], [4811, 0.290618, " to", false], [21265, 0.070367, " and", false], [45, 0.052378, ",", false], [56500, 0.037443, " involved", false], [4596, 0.021359, " in", false], [4712, 0.016909, " on", false], [4424, 0.012488, " at", false], [4423, 0.012136, " as", false], [47, 0.009632, ".", false]]], "qwen": [311, 1, 0.3906971216201782, [[311, 0.390697, " to", false], [429, 0.278774, " that", false], [323, 0.05839, " and", false], [11, 0.050985, ",", false], [304, 0.031427, " in", false], [320, 0.016949, " (", false], [518, 0.014043, " at", false], [389, 0.013031, " on", false], [1865, 0.012849, " made", false], [6398, 0.010115, " involved", false]]]}, "raw_delta": 0.09557996193567914, "tuned_delta": 0.10415175396625738}, {"byte_start": 1051, "byte_end": 1062, "display": {"text": " investment", "kind": "normal"}, "is_word": true, "word_id": 177, "word_key": " investment", "bytes_hex": "20 69 6e 76 65 73 74 6d 65 6e 74", "compression": {"rwkv": "13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12%", "qwen": "15.02% 15.02% 15.02% 15.02% 15.02% 15.02% 15.02% 15.02% 15.02% 15.02% 15.02%"}, "model_tokens": {"rwkv": [[62157, " investment", "normal", 0.00032562969136051834]], "qwen": [[9162, " investment", "normal", 0.00010466409003129229]]}, "loss": {"rwkv": 13.11540946262694, "qwen": 15.024939089071282}, "topk": {"rwkv": [62157, 229, 0.00032562969136051834, [[22590, 0.115616, " the", false], [30322, 0.093345, " both", false], [22226, 0.069928, " one", false], [30719, 0.051907, " each", false], [38720, 0.042149, " human", false], [332, 0.029714, " a", false], [39936, 0.028816, " these", false], [45833, 0.020094, " either", false], [38279, 0.019657, " doing", false], [51161, 0.018073, " certain", false]]], "qwen": [9162, 575, 0.00010466409003129229, [[279, 0.175419, " the", false], [3738, 0.05676, " human", false], [825, 0.047213, " one", false], [264, 0.036088, " a", false], [3953, 0.027353, " particular", false], [2176, 0.026776, " both", false], [387, 0.023164, " be", false], [32064, 0.020483, " leverage", false], [3654, 0.019666, " certain", false], [2987, 0.01964, " either", false]]]}, "raw_delta": -0.10588680614124645, "tuned_delta": -0.0973150141106682}, {"byte_start": 1062, "byte_end": 1065, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 178, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "3.87% 3.87% 3.87%", "qwen": "3.51% 3.51% 3.51%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.5252020359039307]], "qwen": [[304, " in", "normal", 0.5578750967979431]]}, "loss": {"rwkv": 3.8744251586373526, "qwen": 3.508274453247622}, "topk": {"rwkv": [4596, 1, 0.5252020359039307, [[4596, 0.525202, " in", false], [32227, 0.062513, " that", false], [4706, 0.055642, " of", false], [45, 0.041935, ",", false], [21265, 0.037269, " and", false], [56832, 0.03132, " patterns", false], [62581, 0.017144, " strategies", false], [47, 0.013758, ".", false], [59451, 0.013242, " decisions", false], [4712, 0.012996, " on", false]]], "qwen": [304, 1, 0.5578750967979431, [[304, 0.557875, " in", false], [429, 0.184454, " that", false], [11, 0.043663, ",", false], [315, 0.028122, " of", false], [323, 0.020908, " and", false], [14830, 0.016038, " strategies", false], [320, 0.009569, " (", false], [389, 0.007911, " on", false], [1865, 0.007348, " made", false], [311, 0.004942, " to", false]]]}, "raw_delta": 0.020303706328074128, "tuned_delta": 0.028875498358652378}, {"byte_start": 1065, "byte_end": 1069, "display": {"text": " one", "kind": "normal"}, "is_word": true, "word_id": 179, "word_key": " one", "bytes_hex": "20 6f 6e 65", "compression": {"rwkv": "6.87% 6.87% 6.87% 6.87%", "qwen": "6.33% 6.33% 6.33% 6.33%"}, "model_tokens": {"rwkv": [[22226, " one", "normal", 0.2196863889694214]], "qwen": [[825, " one", "normal", 0.24557806551456451]]}, "loss": {"rwkv": 6.868299144857125, "qwen": 6.330457263368079}, "topk": {"rwkv": [22226, 1, 0.2196863889694214, [[22226, 0.219686, " one", false], [22590, 0.153073, " the", false], [38720, 0.078761, " human", false], [45833, 0.047795, " either", false], [332, 0.044905, " a", false], [30719, 0.03915, " each", false], [57103, 0.029351, " research", false], [30322, 0.026071, " both", false], [62293, 0.020847, " particular", false], [51161, 0.020613, " certain", false]]], "qwen": [825, 1, 0.24557806551456451, [[825, 0.245578, " one", false], [3738, 0.138559, " human", false], [279, 0.09495, " the", false], [2987, 0.048882, " either", false], [264, 0.036417, " a", false], [1817, 0.034237, " each", false], [3953, 0.033059, " particular", false], [6540, 0.031027, " knowledge", false], [2176, 0.030117, " both", false], [7947, 0.019244, " domain", false]]]}, "raw_delta": 0.029824286699295044, "tuned_delta": 0.038396078729873294}, {"byte_start": 1069, "byte_end": 1078, "display": {"text": " approach", "kind": "normal"}, "is_word": true, "word_id": 180, "word_key": " approach", "bytes_hex": "20 61 70 70 72 6f 61 63 68", "compression": {"rwkv": "11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83%", "qwen": "9.74% 9.74% 9.74% 9.74% 9.74% 9.74% 9.74% 9.74% 9.74%"}, "model_tokens": {"rwkv": [[55532, " approach", "normal", 0.002671432215720415]], "qwen": [[5486, " approach", "normal", 0.007759560830891132]]}, "loss": {"rwkv": 11.834607757292277, "qwen": 9.735846141263135}, "topk": {"rwkv": [55532, 27, 0.002671432215720415, [[4715, 0.464741, " or", false], [31601, 0.084309, " over", false], [47717, 0.07464, " versus", false], [32227, 0.053685, " that", false], [30173, 0.036155, " area", false], [45775, 0.035111, " domain", false], [47001, 0.033718, " rather", false], [45, 0.020318, ",", false], [4851, 0.017065, " vs", false], [21265, 0.016709, " and", false]]], "qwen": [5486, 12, 0.007759560830891132, [[476, 0.472018, " or", false], [429, 0.140561, " that", false], [3082, 0.041787, " area", false], [11, 0.038737, ",", false], [916, 0.038003, " over", false], [315, 0.026333, " of", false], [518, 0.022409, " at", false], [323, 0.021068, " and", false], [4751, 0.020208, " rather", false], [7947, 0.008771, " domain", false]]]}, "raw_delta": 0.11638005574544276, "tuned_delta": 0.124951847776021}, {"byte_start": 1078, "byte_end": 1081, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 181, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"rwkv": "5.00% 5.00% 5.00%", "qwen": "6.65% 6.65% 6.65%"}, "model_tokens": {"rwkv": [[4715, " or", "normal", 0.4309472441673279]], "qwen": [[476, " or", "normal", 0.3309338688850403]]}, "loss": {"rwkv": 5.001530659331855, "qwen": 6.647437591430349}, "topk": {"rwkv": [4715, 1, 0.4309472441673279, [[4715, 0.430947, " or", false], [31601, 0.249141, " over", false], [47001, 0.05921, " rather", false], [32227, 0.057201, " that", false], [47717, 0.044691, " versus", false], [45, 0.0351, ",", false], [21265, 0.015548, " and", false], [4424, 0.01188, " at", false], [4811, 0.009707, " to", false], [47, 0.009567, ".", false]]], "qwen": [476, 1, 0.3309338688850403, [[476, 0.330934, " or", false], [429, 0.311298, " that", false], [916, 0.093059, " over", false], [11, 0.073283, ",", false], [4751, 0.024069, " rather", false], [518, 0.022481, " at", false], [323, 0.018029, " and", false], [320, 0.017136, " (", false], [19041, 0.01512, " versus", false], [892, 0.009402, " which", false]]]}, "raw_delta": -0.09126845995585126, "tuned_delta": -0.08269666792527301}, {"byte_start": 1081, "byte_end": 1085, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 182, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "2.62% 2.62% 2.62% 2.62%", "qwen": "2.20% 2.20% 2.20% 2.20%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.5624184012413025]], "qwen": [[279, " the", "normal", 0.6140246987342834]]}, "loss": {"rwkv": 2.6240424938043887, "qwen": 2.198848039377469}, "topk": {"rwkv": [22590, 1, 0.5624184012413025, [[22590, 0.562418, " the", false], [50919, 0.413225, " another", false], [39193, 0.006013, " other", false], [46561, 0.001506, " method", false], [332, 0.001272, " a", false], [4811, 0.00108, " to", false], [4596, 0.001017, " in", false], [57317, 0.00086, " strategy", false], [45775, 0.000419, " domain", false], [60624, 0.000386, " technique", false]]], "qwen": [279, 1, 0.6140246987342834, [[279, 0.614025, " the", false], [2441, 0.35995, " another", false], [311, 0.006021, " to", false], [1008, 0.004131, " other", false], [304, 0.001888, " in", false], [1496, 0.00076, " even", false], [1714, 0.000687, " method", false], [14762, 0.000628, " technique", false], [264, 0.000546, " a", false], [8282, 0.000436, " strategy", false]]]}, "raw_delta": 0.02357778698205948, "tuned_delta": 0.03214957901263773}, {"byte_start": 1085, "byte_end": 1091, "display": {"text": " other", "kind": "normal"}, "is_word": true, "word_id": 183, "word_key": " other", "bytes_hex": "20 6f 74 68 65 72", "compression": {"rwkv": "0.00% 0.00% 0.00% 0.00% 0.00% 0.00%", "qwen": "0.01% 0.01% 0.01% 0.01% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[39193, " other", "normal", 0.9987265467643738]], "qwen": [[1008, " other", "normal", 0.9981380701065063]]}, "loss": {"rwkv": 0.003852411379326913, "qwen": 0.0056014114668144314}, "topk": {"rwkv": [39193, 1, 0.9987265467643738, [[39193, 0.998727, " other", false], [31515, 0.000458, " next", false], [50919, 0.000175, " another", false], [46726, 9.4e-05, " others", false], [11, 2.4e-05, "\n", false], [22590, 2.2e-05, " the", false], [22226, 1.1e-05, " one", false], [63277, 1e-05, " alternative", false], [31601, 8e-06, " over", false], [46561, 8e-06, " method", false]]], "qwen": [1008, 1, 0.9981380701065063, [[1008, 0.998138, " other", false], [1790, 0.000309, " next", false], [2441, 0.000148, " another", false], [3800, 0.000101, " others", false], [198, 9.3e-05, "\n", false], [297, 3.4e-05, " o", false], [2086, 3.2e-05, " second", false], [320, 1.9e-05, " (", false], [279, 1.6e-05, " the", false], [1575, 1.5e-05, "other", false]]]}, "raw_delta": -9.69851583552857e-05, "tuned_delta": 0.008474806872222962}, {"byte_start": 1091, "byte_end": 1092, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "24.51%", "qwen": "55.87%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.2571321725845337]], "qwen": [[13, ".", "normal", 0.04514032602310181]]}, "loss": {"rwkv": 24.51454464010543, "qwen": 55.86799229046926}, "topk": {"rwkv": [47, 2, 0.2571321725845337, [[45, 0.430291, ",", false], [47, 0.257132, ".", false], [32227, 0.161271, " that", false], [275, 0.019846, " (", false], [60, 0.017894, ";", false], [21265, 0.017701, " and", false], [59, 0.010773, ":", false], [40186, 0.00887, " which", false], [4423, 0.007191, " as", false], [21400, 0.006463, " but", false]]], "qwen": [13, 3, 0.04514032602310181, [[429, 0.454984, " that", false], [11, 0.318301, ",", false], [13, 0.04514, ".", false], [320, 0.032908, " (", false], [892, 0.01886, " which", false], [323, 0.018353, " and", false], [624, 0.01653, ".\n", false], [26, 0.014231, ";", false], [714, 0.009631, " but", false], [518, 0.005769, " at", false]]]}, "raw_delta": -1.7386043071746826, "tuned_delta": -1.7300325151441043}, {"byte_start": 1092, "byte_end": 1096, "display": {"text": " And", "kind": "normal"}, "is_word": true, "word_id": 184, "word_key": " and", "bytes_hex": "20 41 6e 64", "compression": {"rwkv": "15.15% 15.15% 15.15% 15.15%", "qwen": "15.35% 15.35% 15.35% 15.35%"}, "model_tokens": {"rwkv": [[19417, " And", "normal", 0.034856654703617096]], "qwen": [[1597, " And", "normal", 0.0332515574991703]]}, "loss": {"rwkv": 15.145480165582377, "qwen": 15.345106877788247}, "topk": {"rwkv": [19417, 6, 0.034856654703617096, [[11, 0.171391, "\n", false], [19555, 0.079497, " But", false], [20996, 0.078147, " The", false], [37451, 0.064133, " There", false], [261, 0.045926, "\n\n", false], [19417, 0.034857, " And", false], [3918, 0.027092, " It", false], [3913, 0.02621, " In", false], [29894, 0.02114, " This", false], [19907, 0.015376, " For", false]]], "qwen": [1597, 7, 0.0332515574991703, [[576, 0.096157, " The", false], [2619, 0.086248, " There", false], [758, 0.045308, " In", false], [1084, 0.041811, " It", false], [1988, 0.041437, " But", false], [1096, 0.038606, " This", false], [1597, 0.033252, " And", false], [1752, 0.025937, " For", false], [1205, 0.019243, " We", false], [362, 0.018521, " A", false]]]}, "raw_delta": -0.011069655418395996, "tuned_delta": -0.002497863387817748}, {"byte_start": 1096, "byte_end": 1100, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 185, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "11.55% 11.55% 11.55% 11.55%", "qwen": "10.92% 10.92% 10.92% 10.92%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.07773029059171677]], "qwen": [[279, " the", "normal", 0.08881886303424835]]}, "loss": {"rwkv": 11.55283138211865, "qwen": 10.915593739900798}, "topk": {"rwkv": [22590, 3, 0.07773029059171677, [[39934, 0.164008, " there", false], [45, 0.102711, ",", false], [22590, 0.07773, " the", false], [4788, 0.056664, " so", false], [4601, 0.033388, " it", false], [4596, 0.031255, " in", false], [22797, 0.028624, " yet", false], [4706, 0.025536, " of", false], [30788, 0.017429, " even", false], [32230, 0.016482, " then", false]]], "qwen": [279, 3, 0.08881886303424835, [[1052, 0.102656, " there", false], [11, 0.094348, ",", false], [279, 0.088819, " the", false], [304, 0.047588, " in", false], [432, 0.04032, " it", false], [773, 0.035085, " so", false], [419, 0.03046, " this", false], [1496, 0.024501, " even", false], [421, 0.024116, " if", false], [438, 0.023613, " as", false]]]}, "raw_delta": 0.0353359580039978, "tuned_delta": 0.04390775003457605}, {"byte_start": 1100, "byte_end": 1106, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 186, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "13.99% 13.99% 13.99% 13.99% 13.99% 13.99%", "qwen": "14.69% 14.69% 14.69% 14.69% 14.69% 14.69%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.009649490937590599]], "qwen": [[3738, " human", "normal", 0.007529765367507935]]}, "loss": {"rwkv": 13.994893300290073, "qwen": 14.694123163902994}, "topk": {"rwkv": [38720, 12, 0.009649490937590599, [[64997, 0.014975, " psychological", false], [22638, 0.013903, " two", false], [46470, 0.013478, " longer", false], [30808, 0.013178, " fact", false], [30510, 0.012707, " cost", false], [52738, 0.011157, " results", false], [32251, 0.010943, " time", false], [62157, 0.010694, " investment", false], [31461, 0.010628, " most", false], [31458, 0.010564, " more", false]]], "qwen": [3738, 22, 0.007529765367507935, [[803, 0.027121, " more", false], [1378, 0.022444, " two", false], [5021, 0.021849, " longer", false], [1850, 0.016703, " best", false], [2783, 0.014548, " cost", false], [1172, 0.01435, " only", false], [3412, 0.014166, " research", false], [2097, 0.013188, " fact", false], [7049, 0.011543, " costs", false], [1102, 0.011421, " result", false]]]}, "raw_delta": -0.038773536682128906, "tuned_delta": -0.030201744651550656}, {"byte_start": 1106, "byte_end": 1116, "display": {"text": "-knowledge", "kind": "normal"}, "is_word": true, "word_id": 187, "word_key": "-knowledge", "bytes_hex": "2d 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "68.19% 2.76% 2.76% 2.76% 2.76% 2.76% 2.76% 2.76% 2.76% 2.76%", "qwen": "70.27% 70.27% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.022694796323776245], [58313, "knowledge", "normal", 0.2548525035381317]], "qwen": [[12646, "-k", "normal", 0.0004126753774471581], [51186, "nowledge", "normal", 0.9992349147796631]]}, "loss": {"rwkv": 9.298620380729645, "qwen": 14.05476201086571}, "topk": {"rwkv": [46, 5, 0.022694796323776245, [[59943, 0.190607, " knowledge", false], [31427, 0.065097, " mind", false], [37898, 0.055387, " brain", false], [45775, 0.029708, " domain", false], [46, 0.022695, "-", false], [57404, 0.021891, " tendency", false], [34889, 0.018041, "ities", false], [32011, 0.017197, " side", false], [31506, 0.015147, " need", false], [59324, 0.01321, " community", false]]], "qwen": [12646, 214, 0.0004126753774471581, [[6540, 0.142265, " knowledge", false], [8109, 0.11091, " brain", false], [3971, 0.089827, " mind", false], [8168, 0.021975, " factor", false], [2783, 0.01864, " cost", false], [49083, 0.017235, " biases", false], [30854, 0.015653, " tendency", false], [24675, 0.014819, " cognitive", false], [5726, 0.014369, " ability", false], [15470, 0.012073, " bias", false]]]}, "raw_delta": -0.26373649290180773, "tuned_delta": -0.2551647008712295}, {"byte_start": 1116, "byte_end": 1125, "display": {"text": " approach", "kind": "normal"}, "is_word": true, "word_id": 188, "word_key": " approach", "bytes_hex": "20 61 70 70 72 6f 61 63 68", "compression": {"rwkv": "2.04% 2.04% 2.04% 2.04% 2.04% 2.04% 2.04% 2.04% 2.04%", "qwen": "2.10% 2.10% 2.10% 2.10% 2.10% 2.10% 2.10% 2.10% 2.10%"}, "model_tokens": {"rwkv": [[55532, " approach", "normal", 0.3655596077442169]], "qwen": [[5486, " approach", "normal", 0.34987860918045044]]}, "loss": {"rwkv": 2.035051598476185, "qwen": 2.1042688826934364}, "topk": {"rwkv": [55532, 1, 0.3655596077442169, [[55532, 0.36556, " approach", false], [46, 0.203702, "-", false], [61590, 0.039443, " approaches", false], [38888, 0.037742, " lever", false], [52224, 0.019657, " methods", false], [56540, 0.018951, " leverage", false], [37810, 0.018358, " based", false], [62157, 0.013646, " investment", false], [46561, 0.013374, " method", false], [39552, 0.012595, " route", false]]], "qwen": [5486, 1, 0.34987860918045044, [[5486, 0.349879, " approach", false], [5980, 0.078859, "-based", false], [27505, 0.03808, " lever", false], [31405, 0.022445, "-driven", false], [3108, 0.021996, " side", false], [19827, 0.021535, " approaches", false], [3692, 0.017431, " component", false], [949, 0.016315, " part", false], [32064, 0.016224, " leverage", false], [3419, 0.011277, "-in", false]]]}, "raw_delta": -0.003838221232096359, "tuned_delta": 0.004733570798481889}, {"byte_start": 1125, "byte_end": 1131, "display": {"text": " tends", "kind": "normal"}, "is_word": true, "word_id": 189, "word_key": " tends", "bytes_hex": "20 74 65 6e 64 73", "compression": {"rwkv": "9.53% 9.53% 9.53% 9.53% 9.53% 9.53%", "qwen": "8.36% 8.36% 8.36% 8.36% 8.36% 8.36%"}, "model_tokens": {"rwkv": [[39914, " tends", "normal", 0.042093440890312195]], "qwen": [[27236, " tends", "normal", 0.061878807842731476]]}, "loss": {"rwkv": 9.533434026707669, "qwen": 8.363355794317577}, "topk": {"rwkv": [39914, 4, 0.042093440890312195, [[4600, 0.343703, " is", false], [21800, 0.115277, " has", false], [21413, 0.069634, " can", false], [39914, 0.042093, " tends", false], [45, 0.039557, ",", false], [4811, 0.023464, " to", false], [39620, 0.022001, " seems", false], [32475, 0.020162, " will", false], [30659, 0.019683, " does", false], [57102, 0.018662, " requires", false]]], "qwen": [27236, 3, 0.061878807842731476, [[374, 0.292251, " is", false], [702, 0.086251, " has", false], [27236, 0.061879, " tends", false], [646, 0.058099, " can", false], [11, 0.045678, ",", false], [3545, 0.032364, " often", false], [7460, 0.022891, " requires", false], [686, 0.020688, " will", false], [311, 0.019517, " to", false], [1231, 0.018998, " may", false]]]}, "raw_delta": 0.06488291422526044, "tuned_delta": 0.07345470625583868}, {"byte_start": 1131, "byte_end": 1134, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 190, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.16% 0.16% 0.16%", "qwen": "0.15% 0.15% 0.15%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.9735610485076904]], "qwen": [[311, " to", "normal", 0.9761614203453064]]}, "loss": {"rwkv": 0.15996679632252706, "qwen": 0.1450348505328503}, "topk": {"rwkv": [4811, 1, 0.9735610485076904, [[4811, 0.973561, " to", false], [22187, 0.006555, " not", false], [47585, 0.004646, " toward", false], [53169, 0.002838, " towards", false], [45, 0.002173, ",", false], [31458, 0.001475, " more", false], [4435, 0.000919, " be", false], [4596, 0.000662, " in", false], [30135, 0.000516, " also", false], [60048, 0.00042, " naturally", false]]], "qwen": [311, 1, 0.9761614203453064, [[311, 0.976161, " to", false], [537, 0.007941, " not", false], [11, 0.002714, ",", false], [8841, 0.001297, " toward", false], [6974, 0.001067, " towards", false], [387, 0.00085, " be", false], [803, 0.000807, " more", false], [1083, 0.00072, " also", false], [320, 0.000687, " (", false], [304, 0.000529, " in", false]]]}, "raw_delta": 0.0008280028899510707, "tuned_delta": 0.009399794920529319}, {"byte_start": 1134, "byte_end": 1145, "display": {"text": " complicate", "kind": "normal"}, "is_word": true, "word_id": 191, "word_key": " complicate", "bytes_hex": "20 63 6f 6d 70 6c 69 63 61 74 65", "compression": {"rwkv": "22.54% 22.54% 22.54% 22.54% 22.54% 22.54% 22.54% 22.54% 0.00% 0.00% 0.00%", "qwen": "35.72% 35.72% 35.72% 35.72% 35.72% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[51259, " complic", "normal", 4.4977648940403014e-05], [7066, "ate", "normal", 0.9994739890098572]], "qwen": [[1367, " comp", "normal", 4.99966845382005e-05], [48795, "licate", "normal", 0.999305009841919]]}, "loss": {"rwkv": 16.395118614580696, "qwen": 16.23728544000862}, "topk": {"rwkv": [51259, 732, 4.4977648940403014e-05, [[4435, 0.382936, " be", false], [31059, 0.050838, " have", false], [32499, 0.037088, " work", false], [56041, 0.026311, " dominate", false], [52724, 0.025118, " require", false], [32187, 0.022907, " take", false], [21751, 0.019408, " get", false], [31358, 0.018071, " make", false], [52573, 0.01676, " produce", false], [40239, 0.015551, " yield", false]]], "qwen": [1367, 775, 4.99966845382005e-05, [[387, 0.36151, " be", false], [614, 0.042109, " have", false], [1373, 0.036102, " require", false], [975, 0.030456, " work", false], [633, 0.021392, " get", false], [3690, 0.017015, " fail", false], [1896, 0.015833, " take", false], [1281, 0.013949, " make", false], [5244, 0.013403, " focus", false], [7676, 0.013377, " suffer", false]]]}, "raw_delta": 0.008752129596277056, "tuned_delta": 0.017323921626855303}, {"byte_start": 1145, "byte_end": 1153, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 192, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "13.24% 13.24% 13.24% 13.24% 13.24% 13.24% 13.24% 13.24%", "qwen": "18.08% 18.08% 18.08% 18.08% 18.08% 18.08% 18.08% 18.08%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.00280464137904346]], "qwen": [[5413, " methods", "normal", 0.00032932707108557224]]}, "loss": {"rwkv": 13.243489633160404, "qwen": 18.075299213488297}, "topk": {"rwkv": [52224, 21, 0.00280464137904346, [[22590, 0.358809, " the", false], [47539, 0.191182, " things", false], [52201, 0.127774, " matters", false], [21265, 0.043588, " and", false], [332, 0.018348, " a", false], [3609, 0.013723, " AI", false], [57103, 0.013021, " research", false], [47001, 0.012551, " rather", false], [45, 0.008806, ",", false], [65137, 0.008605, " implementation", false]]], "qwen": [5413, 156, 0.00032932707108557224, [[279, 0.495973, " the", false], [2513, 0.067816, " things", false], [323, 0.064714, " and", false], [12850, 0.032657, " matters", false], [4751, 0.024639, " rather", false], [11, 0.02087, ",", false], [3412, 0.010926, " research", false], [8129, 0.009122, " implementation", false], [264, 0.008041, " a", false], [4401, 0.005654, " development", false]]]}, "raw_delta": -0.2679324150085449, "tuned_delta": -0.2593606229779667}, {"byte_start": 1153, "byte_end": 1156, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 193, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "18.41% 18.41% 18.41%", "qwen": "22.10% 22.10% 22.10%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.046689558774232864]], "qwen": [[304, " in", "normal", 0.025293856859207153]]}, "loss": {"rwkv": 18.409389844676873, "qwen": 22.104454296729404}, "topk": {"rwkv": [4596, 5, 0.046689558774232864, [[45, 0.203399, ",", false], [32227, 0.192105, " that", false], [21265, 0.114402, " and", false], [47, 0.057281, ".", false], [4596, 0.04669, " in", false], [4811, 0.029125, " to", false], [21700, 0.025323, " for", false], [4788, 0.019003, " so", false], [31458, 0.018146, " more", false], [4450, 0.016926, " by", false]]], "qwen": [304, 6, 0.025293856859207153, [[429, 0.390262, " that", false], [11, 0.095794, ",", false], [323, 0.070518, " and", false], [369, 0.041975, " for", false], [4751, 0.027086, " rather", false], [304, 0.025294, " in", false], [315, 0.022812, " of", false], [553, 0.022671, " by", false], [13, 0.020143, ".", false], [1576, 0.016294, " because", false]]]}, "raw_delta": -0.20489788055419922, "tuned_delta": -0.19632608852362096}, {"byte_start": 1156, "byte_end": 1161, "display": {"text": " ways", "kind": "normal"}, "is_word": true, "word_id": 194, "word_key": " ways", "bytes_hex": "20 77 61 79 73", "compression": {"rwkv": "2.16% 2.16% 2.16% 2.16% 2.16%", "qwen": "6.36% 6.36% 6.36% 6.36% 6.36%"}, "model_tokens": {"rwkv": [[32448, " ways", "normal", 0.55156010389328]], "qwen": [[5510, " ways", "normal", 0.17169059813022614]]}, "loss": {"rwkv": 2.155589270078236, "qwen": 6.355292525555081}, "topk": {"rwkv": [32448, 1, 0.55156010389328, [[32448, 0.55156, " ways", false], [332, 0.177929, " a", false], [22590, 0.036819, " the", false], [32139, 0.034377, " such", false], [4419, 0.010719, " an", false], [63667, 0.008524, " interesting", false], [22184, 0.00629, " non", false], [39189, 0.006261, " order", false], [47451, 0.005871, " subtle", false], [22659, 0.004923, " unf", false]]], "qwen": [5510, 2, 0.17169059813022614, [[279, 0.208881, " the", false], [5510, 0.171691, " ways", false], [264, 0.13501, " a", false], [1008, 0.060408, " other", false], [4586, 0.037049, " general", false], [1741, 0.024941, " such", false], [1657, 0.021943, " many", false], [1045, 0.018936, " some", false], [1973, 0.018058, " order", false], [458, 0.016294, " an", false]]]}, "raw_delta": -0.23288099765777587, "tuned_delta": -0.2243092056271976}, {"byte_start": 1161, "byte_end": 1166, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 195, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "0.17% 0.17% 0.17% 0.17% 0.17%", "qwen": "0.27% 0.27% 0.27% 0.27% 0.27%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.9540926814079285]], "qwen": [[429, " that", "normal", 0.9284818768501282]]}, "loss": {"rwkv": 0.16906582510417537, "qwen": 0.2676359078751071}, "topk": {"rwkv": [32227, 1, 0.9540926814079285, [[32227, 0.954093, " that", false], [40186, 0.007496, " which", false], [22590, 0.006251, " the", false], [22187, 0.003973, " not", false], [40185, 0.00326, " where", false], [4811, 0.001461, " to", false], [32232, 0.001204, " they", false], [275, 0.001064, " (", false], [4596, 0.000686, " in", false], [4858, 0.00066, " we", false]]], "qwen": [429, 1, 0.9284818768501282, [[429, 0.928482, " that", false], [279, 0.011645, " the", false], [537, 0.005787, " not", false], [892, 0.005376, " which", false], [34447, 0.004525, " computation", false], [304, 0.003858, " in", false], [1380, 0.002201, " where", false], [807, 0.002154, " they", false], [432, 0.001872, " it", false], [311, 0.001355, " to", false]]]}, "raw_delta": -0.005465885996818543, "tuned_delta": 0.0031059060337597054}, {"byte_start": 1166, "byte_end": 1171, "display": {"text": " make", "kind": "normal"}, "is_word": true, "word_id": 196, "word_key": " make", "bytes_hex": "20 6d 61 6b 65", "compression": {"rwkv": "4.25% 4.25% 4.25% 4.25% 4.25%", "qwen": "6.13% 6.13% 6.13% 6.13% 6.13%"}, "model_tokens": {"rwkv": [[31358, " make", "normal", 0.30952146649360657]], "qwen": [[1281, " make", "normal", 0.18291719257831573]]}, "loss": {"rwkv": 4.254823265121747, "qwen": 6.12684367084774}, "topk": {"rwkv": [31358, 1, 0.30952146649360657, [[31358, 0.309521, " make", false], [21286, 0.094172, " are", false], [22590, 0.037461, " the", false], [47030, 0.034891, " reduce", false], [21413, 0.024152, " can", false], [56433, 0.023898, " increase", false], [32053, 0.01603, " slow", false], [32216, 0.014736, " tend", false], [38900, 0.014169, " limit", false], [31123, 0.013632, " hurt", false]]], "qwen": [1281, 1, 0.18291719257831573, [[1281, 0.182917, " make", false], [525, 0.147376, " are", false], [279, 0.042186, " the", false], [646, 0.036885, " can", false], [1367, 0.018263, " comp", false], [7949, 0.014246, " reduce", false], [653, 0.013098, " do", false], [11, 0.011434, ",", false], [1373, 0.01119, " require", false], [1231, 0.010123, " may", false]]]}, "raw_delta": -0.10380685329437259, "tuned_delta": -0.09523506126379434}, {"byte_start": 1171, "byte_end": 1176, "display": {"text": " them", "kind": "normal"}, "is_word": true, "word_id": 197, "word_key": " them", "bytes_hex": "20 74 68 65 6d", "compression": {"rwkv": "2.99% 2.99% 2.99% 2.99% 2.99%", "qwen": "2.85% 2.85% 2.85% 2.85% 2.85%"}, "model_tokens": {"rwkv": [[32229, " them", "normal", 0.43699005246162415]], "qwen": [[1105, " them", "normal", 0.4536651372909546]]}, "loss": {"rwkv": 2.9868295768404316, "qwen": 2.850750669106684}, "topk": {"rwkv": [32229, 1, 0.43699005246162415, [[32229, 0.43699, " them", false], [4601, 0.213979, " it", false], [22590, 0.053347, " the", false], [63370, 0.050107, " computation", false], [39931, 0.032802, " their", false], [38888, 0.01781, " lever", false], [332, 0.007162, " a", false], [51832, 0.005641, " general", false], [52805, 0.005592, " scaling", false], [65135, 0.00494, " generalization", false]]], "qwen": [1105, 1, 0.4536651372909546, [[1105, 0.453665, " them", false], [432, 0.178793, " it", false], [279, 0.064649, " the", false], [76482, 0.037198, " leveraging", false], [862, 0.026683, " their", false], [34447, 0.023364, " computation", false], [32064, 0.012587, " leverage", false], [990, 0.008797, " use", false], [4623, 0.00801, " further", false], [4586, 0.00795, " general", false]]]}, "raw_delta": 0.007545816898345936, "tuned_delta": 0.016117608928924186}, {"byte_start": 1176, "byte_end": 1181, "display": {"text": " less", "kind": "normal"}, "is_word": true, "word_id": 198, "word_key": " less", "bytes_hex": "20 6c 65 73 73", "compression": {"rwkv": "3.97% 3.97% 3.97% 3.97% 3.97%", "qwen": "5.01% 5.01% 5.01% 5.01% 5.01%"}, "model_tokens": {"rwkv": [[31277, " less", "normal", 0.33282899856567383]], "qwen": [[2686, " less", "normal", 0.248989537358284]]}, "loss": {"rwkv": 3.9730468899481215, "qwen": 5.014607360190208}, "topk": {"rwkv": [31277, 1, 0.33282899856567383, [[31277, 0.332829, " less", false], [46162, 0.252715, " harder", false], [31458, 0.083044, " more", false], [31048, 0.046206, " hard", false], [59516, 0.031681, " difficult", false], [31466, 0.01761, " much", false], [40216, 0.012972, " worse", false], [47313, 0.009219, " slower", false], [62699, 0.00891, " unsuitable", false], [64425, 0.007354, " incompatible", false]]], "qwen": [2686, 1, 0.248989537358284, [[2686, 0.24899, " less", false], [15750, 0.230981, " harder", false], [803, 0.126236, " more", false], [5000, 0.041384, " difficult", false], [2588, 0.036845, " hard", false], [3716, 0.024595, " comput", false], [28393, 0.021285, " slower", false], [1753, 0.014994, " much", false], [94649, 0.009414, " brittle", false], [10960, 0.00875, " worse", false]]]}, "raw_delta": -0.05775637626647947, "tuned_delta": -0.04918458423590122}, {"byte_start": 1181, "byte_end": 1188, "display": {"text": " suited", "kind": "normal"}, "is_word": true, "word_id": 199, "word_key": " suited", "bytes_hex": "20 73 75 69 74 65 64", "compression": {"rwkv": "13.61% 13.61% 13.61% 13.61% 13.61% 13.61% 13.61%", "qwen": "15.30% 15.30% 15.30% 15.30% 15.30% 15.30% 15.30%"}, "model_tokens": {"rwkv": [[47460, " suited", "normal", 0.005090330261737108]], "qwen": [[31499, " suited", "normal", 0.002638147445395589]]}, "loss": {"rwkv": 13.605773544097923, "qwen": 15.296891234506983}, "topk": {"rwkv": [47460, 22, 0.005090330261737108, [[30140, 0.220185, " amen", false], [59593, 0.218613, " effective", false], [51832, 0.092297, " general", false], [59594, 0.043193, " efficient", false], [46439, 0.038388, " likely", false], [47687, 0.031806, " useful", false], [57160, 0.017752, " scalable", false], [47129, 0.01705, " robust", false], [56248, 0.015402, " flexible", false], [45820, 0.011947, " easily", false]]], "qwen": [31499, 38, 0.002638147445395589, [[4586, 0.170988, " general", false], [7373, 0.162518, " effective", false], [3716, 0.074594, " comput", false], [68211, 0.073624, " scalable", false], [1079, 0.056863, " am", false], [11050, 0.039339, " efficient", false], [21765, 0.022776, " robust", false], [6707, 0.021299, " easily", false], [41829, 0.016703, " tract", false], [93748, 0.015319, " adaptable", false]]]}, "raw_delta": -0.09377547672816688, "tuned_delta": -0.08520368469758864}, {"byte_start": 1188, "byte_end": 1191, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 200, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "1.49% 1.49% 1.49%", "qwen": "1.70% 1.70% 1.70%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.77960205078125]], "qwen": [[311, " to", "normal", 0.7539805173873901]]}, "loss": {"rwkv": 1.4910666519604356, "qwen": 1.6975033396946884}, "topk": {"rwkv": [4811, 1, 0.77960205078125, [[4811, 0.779602, " to", false], [21700, 0.199966, " for", false], [32226, 0.0045, " than", false], [4423, 0.003286, " as", false], [53169, 0.001679, " towards", false], [4596, 0.001553, " in", false], [45, 0.001517, ",", false], [4715, 0.00093, " or", false], [21265, 0.000782, " and", false], [275, 0.000782, " (", false]]], "qwen": [311, 1, 0.7539805173873901, [[311, 0.753981, " to", false], [369, 0.22766, " for", false], [1091, 0.004099, " than", false], [438, 0.001821, " as", false], [11, 0.001675, ",", false], [6974, 0.001194, " towards", false], [476, 0.000963, " or", false], [320, 0.000937, " (", false], [323, 0.000754, " and", false], [304, 0.000699, " in", false]]]}, "raw_delta": -0.011447280645370483, "tuned_delta": -0.002875488614792235}, {"byte_start": 1191, "byte_end": 1198, "display": {"text": " taking", "kind": "normal"}, "is_word": true, "word_id": 201, "word_key": " taking", "bytes_hex": "20 74 61 6b 69 6e 67", "compression": {"rwkv": "10.47% 10.47% 10.47% 10.47% 10.47% 10.47% 10.47%", "qwen": "12.58% 12.58% 12.58% 12.58% 12.58% 12.58% 12.58%"}, "model_tokens": {"rwkv": [[47497, " taking", "normal", 0.016814475879073143]], "qwen": [[4633, " taking", "normal", 0.007579374127089977]]}, "loss": {"rwkv": 10.465979649306096, "qwen": 12.578045761309482}, "topk": {"rwkv": [47497, 9, 0.016814475879073143, [[22590, 0.232486, " the", false], [38888, 0.078267, " lever", false], [52805, 0.049971, " scaling", false], [63370, 0.034423, " computation", false], [51832, 0.032748, " general", false], [37832, 0.029173, " being", false], [56540, 0.023992, " leverage", false], [31323, 0.023183, " long", false], [47497, 0.016814, " taking", false], [38864, 0.014913, " large", false]]], "qwen": [4633, 19, 0.007579374127089977, [[279, 0.168114, " the", false], [32064, 0.113406, " leverage", false], [76482, 0.088211, " leveraging", false], [34447, 0.035141, " computation", false], [26943, 0.030086, " scaling", false], [70601, 0.021356, " exploiting", false], [4586, 0.02086, " general", false], [39661, 0.020574, " exploitation", false], [3460, 0.018556, " large", false], [990, 0.013438, " use", false]]]}, "raw_delta": -0.11711781365530827, "tuned_delta": -0.10854602162473002}, {"byte_start": 1198, "byte_end": 1208, "display": {"text": " advantage", "kind": "normal"}, "is_word": true, "word_id": 202, "word_key": " advantage", "bytes_hex": "20 61 64 76 61 6e 74 61 67 65", "compression": {"rwkv": "0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43%", "qwen": "0.14% 0.14% 0.14% 0.14% 0.14% 0.14% 0.14% 0.14% 0.14% 0.14%"}, "model_tokens": {"rwkv": [[59093, " advantage", "normal", 0.788828432559967]], "qwen": [[9423, " advantage", "normal", 0.9232712388038635]]}, "loss": {"rwkv": 0.42794786979494404, "qwen": 0.14396693232400448}, "topk": {"rwkv": [59093, 1, 0.788828432559967, [[59093, 0.788828, " advantage", false], [30923, 0.179803, " full", false], [52204, 0.005016, " maximum", false], [22590, 0.003543, " the", false], [52203, 0.002685, " maximal", false], [56540, 0.002071, " leverage", false], [61544, 0.002046, " advantages", false], [30273, 0.00117, " best", false], [4712, 0.00068, " on", false], [51030, 0.000639, " benefit", false]]], "qwen": [9423, 1, 0.9232712388038635, [[9423, 0.923271, " advantage", false], [2480, 0.047825, " full", false], [279, 0.004137, " the", false], [22146, 0.001789, " advantages", false], [8760, 0.00139, " benefit", false], [54480, 0.001342, " computational", false], [389, 0.001265, " on", false], [32064, 0.00112, " leverage", false], [2664, 0.001028, " better", false], [7192, 0.00101, " maximum", false]]]}, "raw_delta": 0.015747246891260145, "tuned_delta": 0.02431903892183839}, {"byte_start": 1208, "byte_end": 1211, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 203, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.01% 0.01% 0.01%", "qwen": "0.02% 0.02% 0.02%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9979496598243713]], "qwen": [[315, " of", "normal", 0.9961793422698975]]}, "loss": {"rwkv": 0.012291026781662055, "qwen": 0.02301089239628658}, "topk": {"rwkv": [4706, 1, 0.9979496598243713, [[4706, 0.99795, " of", false], [22590, 0.000468, " the", false], [45, 0.000106, ",", false], [4715, 9.5e-05, " or", false], [4596, 8.7e-05, " in", false], [275, 8.2e-05, " (", false], [4811, 8.1e-05, " to", false], [21265, 6.9e-05, " and", false], [47, 5.4e-05, ".", false], [4423, 5.1e-05, " as", false]]], "qwen": [315, 1, 0.9961793422698975, [[315, 0.996179, " of", false], [279, 0.000355, " the", false], [916, 0.000197, " over", false], [11, 0.000181, ",", false], [320, 0.000174, " (", false], [304, 0.000158, " in", false], [979, 0.000141, " when", false], [13, 0.00014, ".", false], [624, 0.000134, ".\n", false], [3716, 0.000128, " comput", false]]]}, "raw_delta": -0.0005944355701406797, "tuned_delta": 0.007977356460437568}, {"byte_start": 1211, "byte_end": 1219, "display": {"text": " general", "kind": "normal"}, "is_word": true, "word_id": 204, "word_key": " general", "bytes_hex": "20 67 65 6e 65 72 61 6c", "compression": {"rwkv": "9.93% 9.93% 9.93% 9.93% 9.93% 9.93% 9.93% 9.93%", "qwen": "15.64% 15.64% 15.64% 15.64% 15.64% 15.64% 15.64% 15.64%"}, "model_tokens": {"rwkv": [[51832, " general", "normal", 0.01215451955795288]], "qwen": [[4586, " general", "normal", 0.0009715748601593077]]}, "loss": {"rwkv": 9.932617224870304, "qwen": 15.636542228590956}, "topk": {"rwkv": [51832, 14, 0.01215451955795288, [[22590, 0.310744, " the", false], [63370, 0.139045, " computation", false], [30789, 0.030225, " ever", false], [37045, 0.026895, " Moore", false], [59846, 0.024509, " increased", false], [46064, 0.024085, " future", false], [22168, 0.019915, " new", false], [64862, 0.018301, " computational", false], [52195, 0.018082, " massive", false], [31458, 0.017865, " more", false]]], "qwen": [4586, 78, 0.0009715748601593077, [[279, 0.377646, " the", false], [34447, 0.123759, " computation", false], [501, 0.036997, " new", false], [54480, 0.03647, " computational", false], [10951, 0.024283, " massive", false], [3853, 0.02029, " future", false], [7172, 0.017718, " increased", false], [74151, 0.014298, " exponentially", false], [264, 0.010983, " a", false], [419, 0.009906, " this", false]]]}, "raw_delta": -0.31629276275634766, "tuned_delta": -0.3077209707257694}, {"byte_start": 1219, "byte_end": 1227, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 205, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "3.50% 3.50% 3.50% 3.50% 3.50% 3.50% 3.50% 3.50%", "qwen": "3.72% 3.72% 3.72% 3.72% 3.72% 3.72% 3.72% 3.72%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.20908476412296295]], "qwen": [[5413, " methods", "normal", 0.19181130826473236]]}, "loss": {"rwkv": 3.504593666221969, "qwen": 3.722250340864776}, "topk": {"rwkv": [52224, 2, 0.20908476412296295, [[63370, 0.477301, " computation", false], [52224, 0.209085, " methods", false], [46, 0.047819, "-", false], [64862, 0.031764, " computational", false], [61590, 0.021465, " approaches", false], [7933, 0.017499, "ity", false], [45, 0.013975, ",", false], [59346, 0.013237, " computing", false], [62633, 0.009677, " techniques", false], [41729, 0.009659, "izable", false]]], "qwen": [5413, 2, 0.19181130826473236, [[58238, 0.214484, "-purpose", false], [5413, 0.191811, " methods", false], [34447, 0.178298, " computation", false], [18142, 0.0596, " improvements", false], [54480, 0.056473, " computational", false], [2022, 0.028061, "ization", false], [24231, 0.019293, " computing", false], [12538, 0.017913, " techniques", false], [11, 0.01274, ",", false], [15673, 0.012652, " improvement", false]]]}, "raw_delta": -0.012069448828697205, "tuned_delta": -0.0034976567981189564}, {"byte_start": 1227, "byte_end": 1238, "display": {"text": " leveraging", "kind": "normal"}, "is_word": true, "word_id": 206, "word_key": " leveraging", "bytes_hex": "20 6c 65 76 65 72 61 67 69 6e 67", "compression": {"rwkv": "14.84% 14.84% 14.84% 14.84% 14.84% 14.84% 0.01% 0.01% 0.01% 0.01% 0.01%", "qwen": "9.42% 9.42% 9.42% 9.42% 9.42% 9.42% 9.42% 9.42% 9.42% 9.42% 9.42%"}, "model_tokens": {"rwkv": [[38888, " lever", "normal", 0.007249490357935429], [33672, "aging", "normal", 0.9961600303649902]], "qwen": [[76482, " leveraging", "normal", 0.003186533460393548]]}, "loss": {"rwkv": 8.10097072360851, "qwen": 9.424768873398197}, "topk": {"rwkv": [38888, 12, 0.007249490357935429, [[47, 0.530161, ".", false], [32227, 0.134713, " that", false], [45, 0.079152, ",", false], [4706, 0.036582, " of", false], [21265, 0.02621, " and", false], [21700, 0.026183, " for", false], [275, 0.017644, " (", false], [31296, 0.014269, " like", false], [37810, 0.011557, " based", false], [4596, 0.01063, " in", false]]], "qwen": [76482, 22, 0.003186533460393548, [[624, 0.246874, ".\n", false], [13, 0.230331, ".", false], [429, 0.156389, " that", false], [11, 0.072402, ",", false], [315, 0.049732, " of", false], [323, 0.033619, " and", false], [369, 0.023689, " for", false], [382, 0.019129, ".\n\n", false], [320, 0.01717, " (", false], [304, 0.014904, " in", false]]]}, "raw_delta": -0.07340695641257554, "tuned_delta": -0.0648351643819973}, {"byte_start": 1238, "byte_end": 1250, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 207, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "0.19% 0.19% 0.19% 0.19% 0.19% 0.19% 0.19% 0.19% 0.19% 0.19% 0.19% 0.19%", "qwen": "0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.880954384803772]], "qwen": [[34447, " computation", "normal", 0.8454323410987854]]}, "loss": {"rwkv": 0.1907860873571423, "qwen": 0.25233207199651386}, "topk": {"rwkv": [63370, 1, 0.880954384803772, [[63370, 0.880954, " computation", false], [22590, 0.013913, " the", false], [52195, 0.007068, " massive", false], [64862, 0.005728, " computational", false], [31458, 0.003763, " more", false], [30789, 0.003295, " ever", false], [51832, 0.003042, " general", false], [59846, 0.00304, " increased", false], [64298, 0.002804, " computations", false], [59988, 0.002763, " massively", false]]], "qwen": [34447, 1, 0.8454323410987854, [[34447, 0.845432, " computation", false], [279, 0.034439, " the", false], [54480, 0.015215, " computational", false], [803, 0.007779, " more", false], [10951, 0.006185, " massive", false], [7172, 0.004161, " increased", false], [7703, 0.003956, " increasing", false], [74151, 0.003853, " exponentially", false], [8570, 0.003264, " continued", false], [3460, 0.002766, " large", false]]]}, "raw_delta": -0.0034128340582052848, "tuned_delta": 0.005158957972372964}, {"byte_start": 1250, "byte_end": 1251, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "2.61%", "qwen": "17.46%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.8655523657798767]], "qwen": [[13, ".", "normal", 0.37966933846473694]]}, "loss": {"rwkv": 2.606431470356037, "qwen": 17.464808098154315}, "topk": {"rwkv": [47, 1, 0.8655523657798767, [[47, 0.865552, ".", false], [45, 0.063992, ",", false], [275, 0.018223, " (", false], [32227, 0.004995, " that", false], [4596, 0.004488, " in", false], [4811, 0.003288, " to", false], [21265, 0.003213, " and", false], [60, 0.002744, ";", false], [4423, 0.002031, " as", false], [59, 0.001612, ":", false]]], "qwen": [13, 2, 0.37966933846473694, [[624, 0.447089, ".\n", false], [13, 0.379669, ".", false], [11, 0.054649, ",", false], [382, 0.028451, ".\n\n", false], [320, 0.017153, " (", false], [304, 0.008535, " in", false], [311, 0.006268, " to", false], [26, 0.00412, ";", false], [429, 0.004086, " that", false], [323, 0.003441, " and", false]]]}, "raw_delta": -0.8239233493804932, "tuned_delta": -0.8153515573499149}, {"byte_start": 1251, "byte_end": 1258, "display": {"text": "  There", "kind": "normal"}, "is_word": true, "word_id": 208, "word_key": "  there", "bytes_hex": "20 20 54 68 65 72 65", "compression": {"rwkv": "83.41% 83.41% 12.51% 12.51% 12.51% 12.51% 12.51%", "qwen": "101.92% 13.40% 13.40% 13.40% 13.40% 13.40% 13.40%"}, "model_tokens": {"rwkv": [[267, "  ", "normal", 9.398390830028802e-05], [33504, "There", "normal", 0.03126389905810356]], "qwen": [[220, " ", "normal", 0.0035120798274874687], [2619, " There", "normal", 0.011573479510843754]]}, "loss": {"rwkv": 32.76656705590446, "qwen": 26.047306847837543}, "topk": {"rwkv": [267, 311, 9.398390830028802e-05, [[11, 0.409219, "\n", false], [261, 0.095854, "\n\n", false], [20996, 0.0661, " The", false], [29894, 0.03316, " This", false], [19555, 0.028544, " But", false], [3913, 0.025988, " In", false], [3918, 0.020972, " It", false], [4217, 0.016173, " So", false], [37451, 0.012744, " There", false], [19907, 0.012099, " For", false]]], "qwen": [220, 44, 0.0035120798274874687, [[576, 0.122041, " The", false], [1096, 0.072077, " This", false], [758, 0.061168, " In", false], [1084, 0.035065, " It", false], [1988, 0.033449, " But", false], [2619, 0.027887, " There", false], [151643, 0.026966, "\u003c|endoftext|\u003e", false], [1752, 0.026654, " For", false], [2055, 0.021972, " So", false], [4220, 0.021806, " These", false]]]}, "raw_delta": 0.3725949014936175, "tuned_delta": 0.38116669352419574}, {"byte_start": 1258, "byte_end": 1263, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 209, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"rwkv": "18.03% 18.03% 18.03% 18.03% 18.03%", "qwen": "18.96% 18.96% 18.96% 18.96% 18.96%"}, "model_tokens": {"rwkv": [[32462, " were", "normal", 0.006788540631532669]], "qwen": [[1033, " were", "normal", 0.005216585472226143]]}, "loss": {"rwkv": 18.03368801111204, "qwen": 18.956696540548123}, "topk": {"rwkv": [32462, 8, 0.006788540631532669, [[21286, 0.508979, " are", false], [4600, 0.303864, " is", false], [460, 0.07777, "'s", false], [31059, 0.03083, " have", false], [21800, 0.018207, " has", false], [22748, 0.009371, " was", false], [22074, 0.007386, " may", false], [32462, 0.006789, " were", false], [32475, 0.005485, " will", false], [28309, 0.003928, "’s", false]]], "qwen": [1033, 8, 0.005216585472226143, [[525, 0.480714, " are", false], [374, 0.368058, " is", false], [594, 0.03353, "'s", false], [614, 0.032211, " have", false], [702, 0.02271, " has", false], [572, 0.008697, " was", false], [1231, 0.005935, " may", false], [1033, 0.005217, " were", false], [646, 0.003663, " can", false], [686, 0.003034, " will", false]]]}, "raw_delta": -0.051182460784912065, "tuned_delta": -0.042610668754333815}, {"byte_start": 1263, "byte_end": 1268, "display": {"text": " many", "kind": "normal"}, "is_word": true, "word_id": 210, "word_key": " many", "bytes_hex": "20 6d 61 6e 79", "compression": {"rwkv": "9.58% 9.58% 9.58% 9.58% 9.58%", "qwen": "8.42% 8.42% 8.42% 8.42% 8.42%"}, "model_tokens": {"rwkv": [[31370, " many", "normal", 0.07024678587913513]], "qwen": [[1657, " many", "normal", 0.09687885642051697]]}, "loss": {"rwkv": 9.580396755903271, "qwen": 8.41918623562942}, "topk": {"rwkv": [31370, 4, 0.07024678587913513, [[332, 0.115769, " a", false], [22638, 0.097938, " two", false], [32074, 0.086856, " some", false], [31370, 0.070247, " many", false], [52869, 0.047081, " several", false], [39193, 0.040242, " other", false], [39962, 0.03514, " times", false], [61963, 0.025771, " exceptions", false], [45, 0.022101, ",", false], [39946, 0.021296, " three", false]]], "qwen": [1657, 3, 0.09687885642051697, [[1378, 0.182187, " two", false], [264, 0.116732, " a", false], [1657, 0.096879, " many", false], [1045, 0.0537, " some", false], [2326, 0.037893, " three", false], [3807, 0.036552, " several", false], [11, 0.035038, ",", false], [1008, 0.023848, " other", false], [3039, 0.022582, " times", false], [19585, 0.018904, " exceptions", false]]]}, "raw_delta": 0.0643911838531494, "tuned_delta": 0.07296297588372765}, {"byte_start": 1268, "byte_end": 1277, "display": {"text": " examples", "kind": "normal"}, "is_word": true, "word_id": 211, "word_key": " examples", "bytes_hex": "20 65 78 61 6d 70 6c 65 73", "compression": {"rwkv": "5.85% 5.85% 5.85% 5.85% 5.85% 5.85% 5.85% 5.85% 5.85%", "qwen": "9.31% 9.31% 9.31% 9.31% 9.31% 9.31% 9.31% 9.31% 9.31%"}, "model_tokens": {"rwkv": [[56162, " examples", "normal", 0.053704049438238144]], "qwen": [[10295, " examples", "normal", 0.009600982069969177]]}, "loss": {"rwkv": 5.854686906385332, "qwen": 9.309170560900908}, "topk": {"rwkv": [56162, 2, 0.053704049438238144, [[39193, 0.081316, " other", false], [56162, 0.053704, " examples", false], [52654, 0.030805, " reasons", false], [39962, 0.027373, " times", false], [30992, 0.024856, " good", false], [3609, 0.023526, " AI", false], [32448, 0.021246, " ways", false], [46787, 0.020874, " people", false], [38328, 0.020161, " early", false], [32139, 0.01657, " such", false]]], "qwen": [10295, 13, 0.009600982069969177, [[7966, 0.098679, " reasons", false], [4124, 0.048259, " early", false], [1008, 0.04031, " other", false], [2989, 0.033604, " important", false], [19827, 0.031808, " approaches", false], [1661, 0.029696, " good", false], [18366, 0.028182, " lessons", false], [13553, 0.025138, " attempts", false], [2244, 0.024823, " great", false], [5510, 0.014277, " ways", false]]]}, "raw_delta": -0.19155724843343103, "tuned_delta": -0.18298545640285277}, {"byte_start": 1277, "byte_end": 1280, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 212, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "3.19% 3.19% 3.19%", "qwen": "2.10% 2.10% 2.10%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.5908578634262085]], "qwen": [[315, " of", "normal", 0.7047458291053772]]}, "loss": {"rwkv": 3.193465585301091, "qwen": 2.103437752646663}, "topk": {"rwkv": [4706, 1, 0.5908578634262085, [[4706, 0.590858, " of", false], [4596, 0.166289, " in", false], [45805, 0.027147, " during", false], [40185, 0.022259, " where", false], [62650, 0.021529, " throughout", false], [31601, 0.021349, " over", false], [32227, 0.019645, " that", false], [30917, 0.018284, " from", false], [45, 0.014583, ",", false], [37678, 0.013007, " along", false]]], "qwen": [315, 1, 0.7047458291053772, [[315, 0.704746, " of", false], [304, 0.100277, " in", false], [1380, 0.026316, " where", false], [429, 0.018377, " that", false], [6814, 0.015871, " throughout", false], [11, 0.011269, ",", false], [2337, 0.010415, " during", false], [4124, 0.010242, " early", false], [3156, 0.008302, " along", false], [1573, 0.008228, " before", false]]]}, "raw_delta": 0.06044397751490275, "tuned_delta": 0.069015769545481}, {"byte_start": 1280, "byte_end": 1283, "display": {"text": " AI", "kind": "normal"}, "is_word": true, "word_id": 213, "word_key": " ai", "bytes_hex": "20 41 49", "compression": {"rwkv": "19.54% 19.54% 19.54%", "qwen": "23.33% 23.33% 23.33%"}, "model_tokens": {"rwkv": [[3609, " AI", "normal", 0.038678500801324844]], "qwen": [[15235, " AI", "normal", 0.02062762901186943]]}, "loss": {"rwkv": 19.536495345371375, "qwen": 23.330326567436906}, "topk": {"rwkv": [3609, 3, 0.038678500801324844, [[32234, 0.464153, " this", false], [22590, 0.072009, " the", false], [3609, 0.038679, " AI", false], [57103, 0.021769, " research", false], [63843, 0.019411, " researchers", false], [39936, 0.018715, " these", false], [52224, 0.017412, " methods", false], [38328, 0.014735, " early", false], [32139, 0.01308, " such", false], [46787, 0.012245, " people", false]]], "qwen": [15235, 8, 0.02062762901186943, [[419, 0.215455, " this", false], [279, 0.10999, " the", false], [3738, 0.044208, " human", false], [11811, 0.023512, " researchers", false], [3412, 0.021636, " research", false], [4124, 0.02119, " early", false], [4586, 0.020909, " general", false], [15235, 0.020628, " AI", false], [1741, 0.016156, " such", false], [1493, 0.016148, " these", false]]]}, "raw_delta": -0.21037467320760106, "tuned_delta": -0.2018028811770228}, {"byte_start": 1283, "byte_end": 1295, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 214, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"rwkv": "3.43% 3.43% 3.43% 3.43% 3.43% 3.43% 3.43% 3.43% 3.43% 3.43% 3.43% 3.43%", "qwen": "2.33% 2.33% 2.33% 2.33% 2.33% 2.33% 2.33% 2.33% 2.33% 2.33% 2.33% 2.33%"}, "model_tokens": {"rwkv": [[63843, " researchers", "normal", 0.10274555534124374]], "qwen": [[11811, " researchers", "normal", 0.21270927786827087]]}, "loss": {"rwkv": 3.4282792312791117, "qwen": 2.3260886422367912}, "topk": {"rwkv": [63843, 3, 0.10274555534124374, [[57103, 0.265672, " research", false], [53087, 0.104197, " systems", false], [63843, 0.102746, " researchers", false], [56952, 0.069278, " projects", false], [32227, 0.053649, " that", false], [52224, 0.040734, " methods", false], [61590, 0.028977, " approaches", false], [4596, 0.018487, " in", false], [45124, 0.01775, " agents", false], [60587, 0.01372, " successes", false]]], "qwen": [11811, 2, 0.21270927786827087, [[3412, 0.24725, " research", false], [11811, 0.212709, " researchers", false], [5942, 0.050485, " systems", false], [5413, 0.049835, " methods", false], [304, 0.035385, " in", false], [429, 0.03287, " that", false], [19827, 0.027719, " approaches", false], [7079, 0.020352, " projects", false], [1660, 0.017214, " being", false], [13009, 0.015859, " agents", false]]]}, "raw_delta": 0.06111842393875122, "tuned_delta": 0.06969021596932946}, {"byte_start": 1295, "byte_end": 1296, "display": {"text": "'", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "27", "compression": {"rwkv": "90.73%", "qwen": "76.98%"}, "model_tokens": {"rwkv": [[40, "'", "normal", 0.006481685675680637]], "qwen": [[6, "'", "normal", 0.013998657464981079]]}, "loss": {"rwkv": 90.73199280590745, "qwen": 76.98210025728152}, "topk": {"rwkv": [40, 29, 0.006481685675680637, [[22762, 0.263142, " who", false], [4596, 0.05885, " in", false], [46500, 0.033743, " making", false], [31601, 0.021434, " over", false], [32227, 0.018717, " that", false], [45, 0.01864, ",", false], [47629, 0.018436, " trying", false], [51844, 0.01631, " getting", false], [51709, 0.016165, " falling", false], [47497, 0.013437, " taking", false]]], "qwen": [6, 13, 0.013998657464981079, [[879, 0.162335, " who", false], [304, 0.061561, " in", false], [3259, 0.037806, " making", false], [4460, 0.024903, " trying", false], [429, 0.023692, " that", false], [10164, 0.019427, " spending", false], [1660, 0.018906, " being", false], [19405, 0.016969, " attempting", false], [3238, 0.01593, " working", false], [10887, 0.015721, " seeking", false]]]}, "raw_delta": 0.762455940246582, "tuned_delta": 0.7710277322771603}, {"byte_start": 1296, "byte_end": 1300, "display": {"text": " bel", "kind": "normal"}, "is_word": true, "word_id": 215, "word_key": " bel", "bytes_hex": "20 62 65 6c", "compression": {"rwkv": "40.86% 40.86% 40.86% 40.86%", "qwen": "38.94% 38.94% 38.94% 38.94%"}, "model_tokens": {"rwkv": [[21344, " bel", "normal", 0.00011797981278505176]], "qwen": [[1656, " bel", "normal", 0.00017736996232997626]]}, "loss": {"rwkv": 40.857574400175714, "qwen": 38.94047089230917}, "topk": {"rwkv": [21344, 795, 0.00011797981278505176, [[51708, 0.053583, " failure", false], [61701, 0.036525, " commitment", false], [62157, 0.032617, " investment", false], [55572, 0.024009, " attempts", false], [59834, 0.019105, " inability", false], [31601, 0.017552, " over", false], [56652, 0.01724, " mistakes", false], [51566, 0.015452, " efforts", false], [38530, 0.01479, " focus", false], [63678, 0.014635, " investments", false]]], "qwen": [1656, 650, 0.00017736996232997626, [[7901, 0.056277, " failure", false], [13553, 0.052514, " attempts", false], [8869, 0.043999, " efforts", false], [27850, 0.018851, " failures", false], [37450, 0.017477, " inability", false], [4124, 0.015337, " early", false], [15155, 0.013318, " commitment", false], [23187, 0.012418, " psychological", false], [975, 0.011972, " work", false], [5786, 0.011803, " mis", false]]]}, "raw_delta": 0.10630679130554199, "tuned_delta": 0.11487858333612024}, {"byte_start": 1300, "byte_end": 1304, "display": {"text": "ated", "kind": "normal"}, "is_word": true, "word_id": 216, "word_key": "ated", "bytes_hex": "61 74 65 64", "compression": {"rwkv": "2.29% 2.29% 2.29% 2.29%", "qwen": "0.37% 0.37% 0.37% 0.37%"}, "model_tokens": {"rwkv": [[24738, "ated", "normal", 0.6016695499420166]], "qwen": [[657, "ated", "normal", 0.9212166666984558]]}, "loss": {"rwkv": 2.289433048285708, "qwen": 0.3699612855722067}, "topk": {"rwkv": [24738, 1, 0.6016695499420166, [[24738, 0.60167, "ated", false], [7931, 0.137252, "itt", false], [1840, 0.1047, "ea", false], [27525, 0.031826, "ying", false], [24385, 0.027527, "abor", false], [34907, 0.025719, "ittle", false], [1848, 0.018884, "ei", false], [33943, 0.006157, "ating", false], [1956, 0.004247, "it", false], [34116, 0.003747, "ching", false]]], "qwen": [657, 1, 0.9212166666984558, [[657, 0.921217, "ated", false], [1442, 0.039761, "itt", false], [415, 0.008735, "lic", false], [370, 0.00741, "ab", false], [550, 0.004834, "ies", false], [7272, 0.003059, "iger", false], [4324, 0.002297, "abor", false], [6711, 0.001472, "lying", false], [1122, 0.000989, "ied", false], [4738, 0.000925, "ief", false]]]}, "raw_delta": 0.10643811523914337, "tuned_delta": 0.11500990726972161}, {"byte_start": 1304, "byte_end": 1313, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 217, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "10.96% 10.96% 10.96% 10.96% 10.96% 10.96% 10.96% 10.96% 10.96%", "qwen": "12.19% 12.19% 12.19% 12.19% 12.19% 12.19% 12.19% 12.19% 12.19%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.0042425720021128654]], "qwen": [[6832, " learning", "normal", 0.0022810553200542927]]}, "loss": {"rwkv": 10.957970145640996, "qwen": 12.189003806792723}, "topk": {"rwkv": [56537, 19, 0.0042425720021128654, [[63821, 0.439509, " recognition", false], [63820, 0.237798, " realization", false], [59544, 0.060548, " discovery", false], [64253, 0.024141, " appreciation", false], [59209, 0.023919, " awareness", false], [65034, 0.019285, " understanding", false], [61518, 0.009576, " acceptance", false], [55572, 0.009001, " attempts", false], [63484, 0.0088, " discoveries", false], [21265, 0.008673, " and", false]]], "qwen": [6832, 34, 0.0022810553200542927, [[398, 0.201051, "ly", false], [1931, 0.200269, " real", false], [17843, 0.121466, " recognition", false], [48703, 0.045398, " realization", false], [34896, 0.044657, " appreciation", false], [323, 0.020546, " and", false], [8660, 0.01876, " understanding", false], [17526, 0.013366, " awareness", false], [18335, 0.012287, " discovery", false], [24376, 0.011437, " adoption", false]]]}, "raw_delta": -0.06826300091213655, "tuned_delta": -0.0596912088815583}, {"byte_start": 1313, "byte_end": 1316, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 218, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "2.85% 2.85% 2.85%", "qwen": "7.03% 7.03% 7.03%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.6208587884902954]], "qwen": [[315, " of", "normal", 0.31049299240112305]]}, "loss": {"rwkv": 2.8529857986329596, "qwen": 7.0306973459062245}, "topk": {"rwkv": [4706, 1, 0.6208587884902954, [[4706, 0.620859, " of", false], [32227, 0.127111, " that", false], [37598, 0.059985, " about", false], [30917, 0.045809, " from", false], [32234, 0.023264, " this", false], [4811, 0.020601, " to", false], [116, 0.016251, "s", false], [22590, 0.012485, " the", false], [4596, 0.011576, " in", false], [45, 0.010873, ",", false]]], "qwen": [315, 1, 0.31049299240112305, [[315, 0.310493, " of", false], [429, 0.251639, " that", false], [419, 0.092231, " this", false], [311, 0.089571, " to", false], [911, 0.055374, " about", false], [279, 0.032315, " the", false], [504, 0.026661, " from", false], [304, 0.021464, " in", false], [11, 0.015319, ",", false], [13, 0.012185, ".", false]]]}, "raw_delta": -0.23166151841481528, "tuned_delta": -0.22308972638423702}, {"byte_start": 1316, "byte_end": 1321, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 219, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "2.73% 2.73% 2.73% 2.73% 2.73%", "qwen": "2.70% 2.70% 2.70% 2.70% 2.70%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.47909310460090637]], "qwen": [[419, " this", "normal", 0.472516268491745]]}, "loss": {"rwkv": 2.7332308391841686, "qwen": 2.7039101619735093}, "topk": {"rwkv": [32234, 1, 0.47909310460090637, [[32234, 0.479093, " this", false], [22590, 0.293509, " the", false], [39936, 0.097901, " these", false], [51832, 0.014763, " general", false], [21835, 0.013698, " how", false], [37045, 0.012207, " Moore", false], [32227, 0.010701, " that", false], [32464, 0.009894, " what", false], [332, 0.007488, " a", false], [52127, 0.003534, " lessons", false]]], "qwen": [419, 1, 0.472516268491745, [[419, 0.472516, " this", false], [279, 0.384657, " the", false], [1493, 0.041137, " these", false], [1246, 0.019493, " how", false], [20219, 0.010266, " Moore", false], [429, 0.008741, " that", false], [1128, 0.007593, " what", false], [18366, 0.004646, " lessons", false], [862, 0.004166, " their", false], [4586, 0.002033, " general", false]]]}, "raw_delta": 0.0016258835792541393, "tuned_delta": 0.010197675609832388}, {"byte_start": 1321, "byte_end": 1328, "display": {"text": " bitter", "kind": "normal"}, "is_word": true, "word_id": 220, "word_key": " bitter", "bytes_hex": "20 62 69 74 74 65 72", "compression": {"rwkv": "18.11% 18.11% 18.11% 18.11% 18.11% 18.11% 18.11%", "qwen": "13.15% 13.15% 13.15% 13.15% 13.15% 13.15% 13.15%"}, "model_tokens": {"rwkv": [[45315, " bitter", "normal", 0.000874691060744226]], "qwen": [[25180, " bitter", "normal", 0.006068412680178881]]}, "loss": {"rwkv": 18.114195546875937, "qwen": 13.150830294665546}, "topk": {"rwkv": [45315, 46, 0.000874691060744226, [[46430, 0.570191, " lesson", false], [30808, 0.080296, " fact", false], [4596, 0.031999, " in", false], [45, 0.028183, ",", false], [47, 0.022626, ".", false], [45805, 0.018087, " during", false], [40029, 0.017817, " truth", false], [31601, 0.017807, " over", false], [39310, 0.016515, " point", false], [63591, 0.013891, " fundamental", false]]], "qwen": [25180, 16, 0.006068412680178881, [[17755, 0.46085, " lesson", false], [8046, 0.050063, " truth", false], [2097, 0.04775, " fact", false], [13, 0.041519, ".", false], [11, 0.03482, ",", false], [304, 0.03178, " in", false], [17508, 0.019368, " principle", false], [916, 0.016598, " over", false], [2989, 0.015332, " important", false], [504, 0.009869, " from", false]]]}, "raw_delta": 0.2752274104527066, "tuned_delta": 0.28379920248328483}, {"byte_start": 1328, "byte_end": 1335, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 221, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"rwkv": "0.08% 0.08% 0.08% 0.08% 0.08% 0.08% 0.08%", "qwen": "0.31% 0.31% 0.31% 0.31% 0.31% 0.31% 0.31%"}, "model_tokens": {"rwkv": [[46430, " lesson", "normal", 0.9681681990623474]], "qwen": [[17755, " lesson", "normal", 0.8855627179145813]]}, "loss": {"rwkv": 0.08365236137967011, "qwen": 0.31309572112121836}, "topk": {"rwkv": [46430, 1, 0.9681681990623474, [[46430, 0.968168, " lesson", false], [40029, 0.014764, " truth", false], [30808, 0.001671, " fact", false], [45, 0.001323, ",", false], [46454, 0.001276, " little", false], [21400, 0.000933, " but", false], [31683, 0.000757, " pill", false], [52127, 0.000645, " lessons", false], [21265, 0.000598, " and", false], [7513, 0.000549, "est", false]]], "qwen": [17755, 1, 0.8855627179145813, [[17755, 0.885563, " lesson", false], [8046, 0.06927, " truth", false], [8729, 0.00557, " reality", false], [11, 0.003873, ",", false], [320, 0.003319, " (", false], [323, 0.002949, " and", false], [714, 0.002562, " but", false], [3139, 0.001814, " experience", false], [2097, 0.001787, " fact", false], [15177, 0.001644, " pill", false]]]}, "raw_delta": -0.012723041432244437, "tuned_delta": -0.004151249401666189}, {"byte_start": 1335, "byte_end": 1336, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "30.01%", "qwen": "27.29%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.19484630227088928]], "qwen": [[11, ",", "normal", 0.22016479074954987]]}, "loss": {"rwkv": 30.00918395599113, "qwen": 27.29180432778036}, "topk": {"rwkv": [45, 2, 0.19484630227088928, [[47, 0.306842, ".", false], [45, 0.194846, ",", false], [4596, 0.158516, " in", false], [31601, 0.066778, " over", false], [45805, 0.048276, " during", false], [59, 0.021409, ":", false], [32227, 0.020235, " that", false], [37634, 0.014823, " after", false], [30917, 0.012115, " from", false], [4423, 0.011576, " as", false]]], "qwen": [11, 2, 0.22016479074954987, [[13, 0.405673, ".", false], [11, 0.220165, ",", false], [304, 0.093385, " in", false], [916, 0.030259, " over", false], [25, 0.029627, ":", false], [2337, 0.021025, " during", false], [320, 0.013752, " (", false], [504, 0.013353, " from", false], [26, 0.012638, ";", false], [1573, 0.011087, " before", false]]]}, "raw_delta": 0.15068352222442627, "tuned_delta": 0.15925531425500453}, {"byte_start": 1336, "byte_end": 1340, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 222, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "8.31% 8.31% 8.31% 8.31%", "qwen": "8.53% 8.53% 8.53% 8.53%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.15665288269519806]], "qwen": [[323, " and", "normal", 0.15088005363941193]]}, "loss": {"rwkv": 8.312403067621956, "qwen": 8.52664346813911}, "topk": {"rwkv": [21265, 2, 0.15665288269519806, [[21400, 0.328388, " but", false], [21265, 0.156653, " and", false], [59841, 0.04821, " including", false], [40186, 0.037553, " which", false], [4423, 0.02878, " as", false], [32139, 0.024238, " such", false], [4596, 0.020691, " in", false], [30917, 0.015871, " from", false], [57295, 0.014906, " starting", false], [37634, 0.013393, " after", false]]], "qwen": [323, 2, 0.15088005363941193, [[714, 0.256902, " but", false], [323, 0.15088, " and", false], [2670, 0.06764, " including", false], [1741, 0.031191, " such", false], [1429, 0.030556, " most", false], [892, 0.024749, " which", false], [3545, 0.023168, " often", false], [1045, 0.021803, " some", false], [438, 0.021583, " as", false], [504, 0.02001, " from", false]]]}, "raw_delta": -0.01188001036643982, "tuned_delta": -0.003308218335861571}, {"byte_start": 1340, "byte_end": 1343, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 223, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "16.16% 16.16% 16.16%", "qwen": "17.43% 17.43% 17.43%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.06742258369922638]], "qwen": [[432, " it", "normal", 0.05506710335612297]]}, "loss": {"rwkv": 16.15517884328787, "qwen": 17.427773067479766}, "topk": {"rwkv": [4601, 4, 0.06742258369922638, [[22590, 0.108091, " the", false], [31370, 0.090336, " many", false], [39934, 0.069697, " there", false], [4601, 0.067423, " it", false], [308, 0.046217, " I", false], [32074, 0.035824, " some", false], [4706, 0.035493, " of", false], [32232, 0.031075, " they", false], [332, 0.026151, " a", false], [32234, 0.023182, " this", false]]], "qwen": [432, 4, 0.05506710335612297, [[279, 0.090421, " the", false], [1657, 0.079639, " many", false], [1045, 0.060173, " some", false], [432, 0.055067, " it", false], [358, 0.049406, " I", false], [807, 0.046728, " they", false], [304, 0.043768, " in", false], [1052, 0.042553, " there", false], [419, 0.037198, " this", false], [264, 0.030768, " a", false]]]}, "raw_delta": -0.07056760787963867, "tuned_delta": -0.06199581584906042}, {"byte_start": 1343, "byte_end": 1346, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 224, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "8.97% 8.97% 8.97%", "qwen": "8.51% 8.51% 8.51%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.22523117065429688]], "qwen": [[374, " is", "normal", 0.24256405234336853]]}, "loss": {"rwkv": 8.969881276360416, "qwen": 8.514843129358189}, "topk": {"rwkv": [4600, 1, 0.22523117065429688, [[4600, 0.225231, " is", false], [22748, 0.150831, " was", false], [460, 0.121432, "'s", false], [32272, 0.080876, " took", false], [21800, 0.054031, " has", false], [40219, 0.0229, " would", false], [39620, 0.018985, " seems", false], [59393, 0.015811, " continues", false], [39820, 0.013745, " still", false], [52701, 0.011672, " remains", false]]], "qwen": [374, 1, 0.24256405234336853, [[374, 0.242564, " is", false], [572, 0.19145, " was", false], [594, 0.078296, "'s", false], [3867, 0.069163, " took", false], [702, 0.052033, " has", false], [1035, 0.019592, " would", false], [4977, 0.01895, " seems", false], [646, 0.014081, " can", false], [6069, 0.012516, " led", false], [1231, 0.012319, " may", false]]]}, "raw_delta": 0.025232672691345215, "tuned_delta": 0.033804464721923465}, {"byte_start": 1346, "byte_end": 1355, "display": {"text": " instruct", "kind": "normal"}, "is_word": true, "word_id": 225, "word_key": " instruct", "bytes_hex": "20 69 6e 73 74 72 75 63 74", "compression": {"rwkv": "8.14% 8.14% 8.14% 8.14% 8.14% 8.14% 8.14% 8.14% 8.14%", "qwen": "7.18% 7.18% 7.18% 7.18% 7.18% 7.18% 7.18% 7.18% 7.18%"}, "model_tokens": {"rwkv": [[56469, " instruct", "normal", 0.017296679317951202]], "qwen": [[21066, " instruct", "normal", 0.027793802320957184]]}, "loss": {"rwkv": 8.14020639390474, "qwen": 7.179295850141927}, "topk": {"rwkv": [56469, 10, 0.017296679317951202, [[22187, 0.117222, " not", false], [332, 0.0805, " a", false], [39820, 0.063108, " still", false], [22226, 0.062491, " one", false], [40218, 0.041248, " worth", false], [31581, 0.028223, " only", false], [22590, 0.020621, " the", false], [31048, 0.019876, " hard", false], [59829, 0.01731, " important", false], [56469, 0.017297, " instruct", false]]], "qwen": [21066, 6, 0.027793802320957184, [[537, 0.062966, " not", false], [264, 0.055177, " a", false], [5802, 0.052327, " worth", false], [2588, 0.032805, " hard", false], [2058, 0.031659, " still", false], [21066, 0.027794, " instruct", false], [279, 0.025145, " the", false], [2989, 0.024531, " important", false], [825, 0.022382, " one", false], [4135, 0.021515, " easy", false]]]}, "raw_delta": 0.05328419473436147, "tuned_delta": 0.06185598676493972}, {"byte_start": 1355, "byte_end": 1358, "display": {"text": "ive", "kind": "normal"}, "is_word": true, "word_id": 226, "word_key": "ive", "bytes_hex": "69 76 65", "compression": {"rwkv": "0.01% 0.01% 0.01%", "qwen": "0.01% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[7938, "ive", "normal", 0.9983742237091064]], "qwen": [[533, "ive", "normal", 0.9985384941101074]]}, "loss": {"rwkv": 0.009860338649467695, "qwen": 0.008791913226163243}, "topk": {"rwkv": [7938, 1, 0.9983742237091064, [[7938, 0.998374, "ive", false], [7856, 0.000744, "ing", false], [34918, 0.000723, "ively", false], [4811, 3.1e-05, " to", false], [24381, 1.5e-05, "able", false], [25656, 1.2e-05, "ible", false], [1958, 6e-06, "iv", false], [2255, 6e-06, "ve", false], [49338, 5e-06, "iveness", false], [33948, 5e-06, "ative", false]]], "qwen": [533, 1, 0.9985384941101074, [[533, 0.998538, "ive", false], [3132, 0.000996, "ively", false], [1262, 0.000238, "ful", false], [287, 9.4e-05, "ing", false], [1388, 4.7e-05, "ative", false], [1238, 1.1e-05, "ible", false], [480, 7e-06, "able", false], [311, 6e-06, " to", false], [344, 6e-06, "iv", false], [82, 4e-06, "s", false]]]}, "raw_delta": 5.924608558416372e-05, "tuned_delta": 0.008631038116162412}, {"byte_start": 1358, "byte_end": 1361, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 227, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.85% 0.85% 0.85%", "qwen": "0.73% 0.73% 0.73%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.8673887848854065]], "qwen": [[311, " to", "normal", 0.8852441310882568]]}, "loss": {"rwkv": 0.8511994666703275, "qwen": 0.7327195883865194}, "topk": {"rwkv": [4811, 1, 0.8673887848854065, [[4811, 0.867389, " to", false], [32227, 0.050323, " that", false], [21700, 0.016309, " for", false], [47, 0.015216, ".", false], [4596, 0.007946, " in", false], [21265, 0.007142, " and", false], [21835, 0.00447, " how", false], [45, 0.004036, ",", false], [4423, 0.003195, " as", false], [31077, 0.002264, " here", false]]], "qwen": [311, 1, 0.8852441310882568, [[311, 0.885244, " to", false], [429, 0.027062, " that", false], [369, 0.016089, " for", false], [13, 0.015356, ".", false], [304, 0.00887, " in", false], [11, 0.006595, ",", false], [323, 0.003971, " and", false], [1588, 0.003628, " here", false], [537, 0.002653, " not", false], [315, 0.002501, " of", false]]]}, "raw_delta": 0.006569919486840568, "tuned_delta": 0.015141711517418817}, {"byte_start": 1361, "byte_end": 1368, "display": {"text": " review", "kind": "normal"}, "is_word": true, "word_id": 228, "word_key": " review", "bytes_hex": "20 72 65 76 69 65 77", "compression": {"rwkv": "6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68%", "qwen": "8.00% 8.00% 8.00% 8.00% 8.00% 8.00% 8.00%"}, "model_tokens": {"rwkv": [[47108, " review", "normal", 0.07426609098911285]], "qwen": [[3395, " review", "normal", 0.04484003409743309]]}, "loss": {"rwkv": 6.6821254684031235, "qwen": 7.998336949748838}, "topk": {"rwkv": [47108, 4, 0.07426609098911285, [[31324, 0.203314, " look", false], [22449, 0.081474, " see", false], [55832, 0.076239, " consider", false], [47108, 0.074266, " review", false], [51667, 0.045202, " examine", false], [52751, 0.038728, " revisit", false], [31834, 0.024186, " read", false], [52672, 0.021541, " reflect", false], [39942, 0.019766, " think", false], [38877, 0.019247, " learn", false]]], "qwen": [3395, 5, 0.04484003409743309, [[1401, 0.232227, " look", false], [1490, 0.08595, " see", false], [2908, 0.08425, " consider", false], [20961, 0.046059, " examine", false], [3395, 0.04484, " review", false], [1140, 0.028893, " list", false], [1896, 0.020682, " take", false], [11167, 0.019772, " highlight", false], [1349, 0.019264, " read", false], [38296, 0.016471, " cite", false]]]}, "raw_delta": -0.07298626218523296, "tuned_delta": -0.06441447015465472}, {"byte_start": 1368, "byte_end": 1373, "display": {"text": " some", "kind": "normal"}, "is_word": true, "word_id": 229, "word_key": " some", "bytes_hex": "20 73 6f 6d 65", "compression": {"rwkv": "3.97% 3.97% 3.97% 3.97% 3.97%", "qwen": "3.33% 3.33% 3.33% 3.33% 3.33%"}, "model_tokens": {"rwkv": [[32074, " some", "normal", 0.3287736773490906]], "qwen": [[1045, " some", "normal", 0.39698800444602966]]}, "loss": {"rwkv": 3.9730468899481215, "qwen": 3.33208173875113}, "topk": {"rwkv": [32074, 1, 0.3287736773490906, [[32074, 0.328774, " some", false], [32229, 0.230669, " them", false], [332, 0.16902, " a", false], [22590, 0.085175, " the", false], [39936, 0.029564, " these", false], [39944, 0.022045, " those", false], [52869, 0.013726, " several", false], [32464, 0.011551, " what", false], [22226, 0.009252, " one", false], [31198, 0.009173, " just", false]]], "qwen": [1045, 1, 0.39698800444602966, [[1045, 0.396988, " some", false], [1105, 0.183857, " them", false], [264, 0.129938, " a", false], [279, 0.071827, " the", false], [1846, 0.032438, " those", false], [1493, 0.028706, " these", false], [862, 0.018064, " their", false], [3807, 0.015456, " several", false], [1246, 0.013721, " how", false], [1128, 0.013609, " what", false]]]}, "raw_delta": 0.03554265499114989, "tuned_delta": 0.04411444702172814}, {"byte_start": 1373, "byte_end": 1376, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 230, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "1.12% 1.12% 1.12%", "qwen": "1.10% 1.10% 1.10%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.8286420106887817]], "qwen": [[315, " of", "normal", 0.8333882093429565]]}, "loss": {"rwkv": 1.1153648183956015, "qwen": 1.0955809912170524}, "topk": {"rwkv": [4706, 1, 0.8286420106887817, [[4706, 0.828642, " of", false], [47, 0.06279, ".", false], [56162, 0.026725, " examples", false], [32227, 0.007027, " that", false], [59, 0.004101, ":", false], [45, 0.004093, ",", false], [47014, 0.00407, " recent", false], [37970, 0.003799, " cases", false], [30917, 0.002866, " from", false], [21952, 0.002137, " key", false]]], "qwen": [315, 1, 0.8333882093429565, [[315, 0.833388, " of", false], [13, 0.05021, ".", false], [429, 0.014256, " that", false], [10295, 0.013134, " examples", false], [624, 0.007572, ".\n", false], [11, 0.0059, ",", false], [5048, 0.005518, " cases", false], [304, 0.004061, " in", false], [3213, 0.003573, " recent", false], [1376, 0.002602, " key", false]]]}, "raw_delta": 0.0010970483223597255, "tuned_delta": 0.009668840352937974}, {"byte_start": 1376, "byte_end": 1380, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 231, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "7.40% 7.40% 7.40% 7.40%", "qwen": "8.53% 8.53% 8.53% 8.53%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.19532449543476105]], "qwen": [[279, " the", "normal", 0.15079525113105774]]}, "loss": {"rwkv": 7.396629848307673, "qwen": 8.5291780624562}, "topk": {"rwkv": [22590, 2, 0.19532449543476105, [[32229, 0.596575, " them", false], [22590, 0.195324, " the", false], [39936, 0.134746, " these", false], [39944, 0.054173, " those", false], [39931, 0.01107, " their", false], [32234, 0.001394, " this", false], [32464, 0.001147, " what", false], [32227, 0.000845, " that", false], [4677, 0.000721, " my", false], [22248, 0.000481, " our", false]]], "qwen": [279, 2, 0.15079525113105774, [[1105, 0.632266, " them", false], [279, 0.150795, " the", false], [1493, 0.111533, " these", false], [1846, 0.076856, " those", false], [862, 0.017848, " their", false], [1181, 0.004362, " its", false], [419, 0.001052, " this", false], [432, 0.000924, " it", false], [429, 0.000873, " that", false], [1128, 0.000716, " what", false]]]}, "raw_delta": -0.06280180811882019, "tuned_delta": -0.05423001608824194}, {"byte_start": 1380, "byte_end": 1385, "display": {"text": " most", "kind": "normal"}, "is_word": true, "word_id": 232, "word_key": " most", "bytes_hex": "20 6d 6f 73 74", "compression": {"rwkv": "6.42% 6.42% 6.42% 6.42% 6.42%", "qwen": "5.22% 5.22% 5.22% 5.22% 5.22%"}, "model_tokens": {"rwkv": [[31461, " most", "normal", 0.16908559203147888]], "qwen": [[1429, " most", "normal", 0.2352813184261322]]}, "loss": {"rwkv": 6.424501353958664, "qwen": 5.218853526398253}, "topk": {"rwkv": [31461, 1, 0.16908559203147888, [[31461, 0.169086, " most", false], [56162, 0.072147, " examples", false], [31458, 0.068466, " more", false], [37970, 0.045497, " cases", false], [32448, 0.040482, " ways", false], [21952, 0.02283, " key", false], [38328, 0.021576, " early", false], [30273, 0.020988, " best", false], [31580, 0.01857, " ones", false], [56652, 0.017062, " mistakes", false]]], "qwen": [1429, 1, 0.2352813184261322, [[1429, 0.235281, " most", false], [803, 0.115337, " more", false], [1376, 0.040874, " key", false], [10295, 0.033427, " examples", false], [3598, 0.029234, " major", false], [1850, 0.02745, " best", false], [5510, 0.024026, " ways", false], [5048, 0.020669, " cases", false], [6174, 0.016742, " ones", false], [18366, 0.01493, " lessons", false]]]}, "raw_delta": 0.06685531139373779, "tuned_delta": 0.07542710342431604}, {"byte_start": 1385, "byte_end": 1395, "display": {"text": " prominent", "kind": "normal"}, "is_word": true, "word_id": 233, "word_key": " prominent", "bytes_hex": "20 70 72 6f 6d 69 6e 65 6e 74", "compression": {"rwkv": "3.80% 3.80% 3.80% 3.80% 3.80% 3.80% 3.80% 3.80% 3.80% 3.80%", "qwen": "3.58% 3.58% 3.58% 3.58% 3.58% 3.58% 3.58% 3.58% 3.58% 3.58%"}, "model_tokens": {"rwkv": [[60273, " prominent", "normal", 0.12190701812505722]], "qwen": [[20469, " prominent", "normal", 0.13768811523914337]]}, "loss": {"rwkv": 3.803981064843946, "qwen": 3.5756549627536587}, "topk": {"rwkv": [60273, 1, 0.12190701812505722, [[60273, 0.121907, " prominent", false], [52321, 0.089666, " notable", false], [59829, 0.086941, " important", false], [45958, 0.071268, " famous", false], [57323, 0.057441, " striking", false], [52796, 0.042793, " salient", false], [56056, 0.035765, " dramatic", false], [63870, 0.03498, " significant", false], [52346, 0.0335, " obvious", false], [47014, 0.032097, " recent", false]]], "qwen": [20469, 2, 0.13768811523914337, [[27190, 0.155824, " notable", false], [20469, 0.137688, " prominent", false], [2989, 0.103076, " important", false], [11245, 0.07209, " famous", false], [89068, 0.059458, " egregious", false], [21771, 0.050865, " dramatic", false], [5089, 0.043584, " significant", false], [4274, 0.026176, " sal", false], [7040, 0.020387, " interesting", false], [4185, 0.018432, " common", false]]]}, "raw_delta": 0.01266108751296996, "tuned_delta": 0.02123287954354821}, {"byte_start": 1395, "byte_end": 1397, "display": {"text": ".\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e 0a", "compression": {"rwkv": "19.58% 23.67%", "qwen": "47.88% 47.88%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.33353230357170105], [261, "\n\n", "control", 0.0719975084066391]], "qwen": [[382, ".\n\n", "control", 0.0003474658587947488]]}, "loss": {"rwkv": 21.626336794575767, "qwen": 47.87850528129607}, "topk": {"rwkv": [47, 1, 0.33353230357170105, [[47, 0.333532, ".", false], [56162, 0.160815, " examples", false], [31580, 0.159719, " ones", false], [4706, 0.08361, " of", false], [37970, 0.06234, " cases", false], [21265, 0.029149, " and", false], [45, 0.023184, ",", false], [59, 0.020474, ":", false], [4596, 0.012404, " in", false], [56200, 0.008557, " failures", false]]], "qwen": [382, 68, 0.0003474658587947488, [[6174, 0.231678, " ones", false], [13, 0.230389, ".", false], [10295, 0.146838, " examples", false], [5048, 0.070555, " cases", false], [315, 0.062951, " of", false], [323, 0.03409, " and", false], [624, 0.033358, ".\n", false], [11, 0.029415, ",", false], [4221, 0.014615, " among", false], [27850, 0.010837, " failures", false]]]}, "raw_delta": -1.4557293256123862, "tuned_delta": -1.4471575335818079}, {"byte_start": 1397, "byte_end": 1398, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "23.67%", "qwen": "47.88%"}, "model_tokens": {"rwkv": [[261, "\n\n", "control", 0.0719975084066391]], "qwen": [[382, ".\n\n", "control", 0.0003474658587947488]]}, "loss": {"rwkv": 23.669215514584554, "qwen": 47.87850528129607}, "topk": {"rwkv": [261, 3, 0.0719975084066391, [[267, 0.229874, "  ", false], [11, 0.21496, "\n", false], [261, 0.071998, "\n\n", false], [20996, 0.069066, " The", false], [3913, 0.033704, " In", false], [20556, 0.017704, " One", false], [265, 0.015609, " \n", false], [308, 0.013084, " I", false], [19907, 0.011463, " For", false], [37453, 0.009139, " These", false]]], "qwen": [382, 68, 0.0003474658587947488, [[6174, 0.231678, " ones", false], [13, 0.230389, ".", false], [10295, 0.146838, " examples", false], [5048, 0.070555, " cases", false], [315, 0.062951, " of", false], [323, 0.03409, " and", false], [624, 0.033358, ".\n", false], [11, 0.029415, ",", false], [4221, 0.014615, " among", false], [27850, 0.010837, " failures", false]]]}, "raw_delta": -1.3424480756123862, "tuned_delta": -1.3338762835818079}, {"byte_start": 1398, "byte_end": 1400, "display": {"text": "In", "kind": "normal"}, "is_word": true, "word_id": 234, "word_key": "in", "bytes_hex": "49 6e", "compression": {"rwkv": "30.01% 30.01%", "qwen": "28.37% 28.37%"}, "model_tokens": {"rwkv": [[1136, "In", "normal", 0.036061257123947144]], "qwen": [[641, "In", "normal", 0.043021783232688904]]}, "loss": {"rwkv": 30.00918395599113, "qwen": 28.367428971722216}, "topk": {"rwkv": [1136, 3, 0.036061257123947144, [[53648, 0.37618, "Question", false], [6699, 0.074905, "The", false], [1136, 0.036061, "In", false], [66, 0.026082, "A", false], [6393, 0.018312, "One", false], [33161, 0.016189, "Human", false], [820, 0.014187, "AI", false], [50, 0.010306, "1", false], [33504, 0.006586, "There", false], [24242, 0.006425, "This", false]]], "qwen": [641, 2, 0.043021783232688904, [[785, 0.132259, "The", false], [641, 0.043022, "In", false], [16, 0.029539, "1", false], [33975, 0.027545, "Human", false], [32, 0.022505, "A", false], [3966, 0.01935, "One", false], [22029, 0.013633, "Figure", false], [5338, 0.012848, "First", false], [2132, 0.011323, "It", false], [17, 0.009716, "2", false]]]}, "raw_delta": 0.09103822708129883, "tuned_delta": 0.09961001911187707}, {"byte_start": 1400, "byte_end": 1409, "display": {"text": " computer", "kind": "normal"}, "is_word": true, "word_id": 235, "word_key": " computer", "bytes_hex": "20 63 6f 6d 70 75 74 65 72", "compression": {"rwkv": "11.02% 11.02% 11.02% 11.02% 11.02% 11.02% 11.02% 11.02% 11.02%", "qwen": "12.68% 12.68% 12.68% 12.68% 12.68% 12.68% 12.68% 12.68% 12.68%"}, "model_tokens": {"rwkv": [[55809, " computer", "normal", 0.003919978626072407]], "qwen": [[6366, " computer", "normal", 0.001782963052392006]]}, "loss": {"rwkv": 11.020587117901803, "qwen": 12.682649431400927}, "topk": {"rwkv": [55809, 21, 0.003919978626072407, [[22590, 0.392629, " the", false], [3492, 0.203776, " 19", false], [3493, 0.037114, " 20", false], [332, 0.029135, " a", false], [21823, 0.016887, " his", false], [38328, 0.01654, " early", false], [31370, 0.015106, " many", false], [32234, 0.014, " this", false], [62293, 0.012302, " particular", false], [4677, 0.009593, " my", false]]], "qwen": [6366, 32, 0.001782963052392006, [[279, 0.399548, " the", false], [220, 0.326221, " ", false], [264, 0.019494, " a", false], [825, 0.011365, " one", false], [419, 0.009697, " this", false], [847, 0.008932, " my", false], [1657, 0.007462, " many", false], [1045, 0.006665, " some", false], [71278, 0.006415, " reinforcement", false], [806, 0.00632, " his", false]]]}, "raw_delta": -0.09216430452134872, "tuned_delta": -0.08359251249077047}, {"byte_start": 1409, "byte_end": 1415, "display": {"text": " chess", "kind": "normal"}, "is_word": true, "word_id": 236, "word_key": " chess", "bytes_hex": "20 63 68 65 73 73", "compression": {"rwkv": "13.06% 13.06% 13.06% 13.06% 13.06% 13.06%", "qwen": "7.39% 7.39% 7.39% 7.39% 7.39% 7.39%"}, "model_tokens": {"rwkv": [[38013, " chess", "normal", 0.012850133702158928]], "qwen": [[32719, " chess", "normal", 0.08553595095872879]]}, "loss": {"rwkv": 13.055638716377988, "qwen": 7.39026075747072}, "topk": {"rwkv": [38013, 5, 0.012850133702158928, [[47732, 0.682616, " vision", false], [52814, 0.189248, " science", false], [56329, 0.042617, " graphics", false], [38576, 0.019965, " games", false], [38013, 0.01285, " chess", false], [46, 0.012509, "-", false], [63795, 0.004776, " programming", false], [46075, 0.002631, " gaming", false], [57181, 0.002139, " security", false], [64254, 0.001833, " architecture", false]]], "qwen": [32719, 3, 0.08553595095872879, [[11129, 0.712659, " vision", false], [8038, 0.097844, " science", false], [32719, 0.085536, " chess", false], [3868, 0.012228, " games", false], [5994, 0.011351, " Go", false], [1809, 0.008439, " game", false], [14181, 0.006157, " graphics", false], [12, 0.005733, "-", false], [1506, 0.004232, "ized", false], [15473, 0.003795, " programming", false]]]}, "raw_delta": 0.31415526072184247, "tuned_delta": 0.3227270527524207}, {"byte_start": 1415, "byte_end": 1416, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "3.59%", "qwen": "5.84%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8189488053321838]], "qwen": [[11, ",", "normal", 0.7231948971748352]]}, "loss": {"rwkv": 3.592648783463727, "qwen": 5.84429509357174}, "topk": {"rwkv": [45, 1, 0.8189488053321838, [[45, 0.818949, ",", false], [21265, 0.018424, " and", false], [22590, 0.016361, " the", false], [4596, 0.014915, " in", false], [275, 0.0128, " (", false], [39934, 0.010286, " there", false], [4858, 0.008815, " we", false], [3609, 0.004934, " AI", false], [4601, 0.004804, " it", false], [11, 0.004743, "\n", false]]], "qwen": [11, 1, 0.7231948971748352, [[11, 0.723195, ",", false], [320, 0.040994, " (", false], [7468, 0.030147, " programs", false], [304, 0.029816, " in", false], [3412, 0.019746, " research", false], [323, 0.01594, " and", false], [279, 0.013935, " the", false], [1052, 0.012069, " there", false], [369, 0.007485, " for", false], [432, 0.005921, " it", false]]]}, "raw_delta": -0.12485778331756592, "tuned_delta": -0.11628599128698767}, {"byte_start": 1416, "byte_end": 1420, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 237, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "5.39% 5.39% 5.39% 5.39%", "qwen": "6.35% 6.35% 6.35% 6.35%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.30426910519599915]], "qwen": [[279, " the", "normal", 0.24443350732326508]]}, "loss": {"rwkv": 5.3889731751955905, "qwen": 6.351518688749366}, "topk": {"rwkv": [22590, 1, 0.30426910519599915, [[22590, 0.304269, " the", false], [21700, 0.06704, " for", false], [332, 0.042806, " a", false], [4601, 0.04143, " it", false], [22226, 0.028704, " one", false], [39934, 0.024578, " there", false], [4596, 0.017291, " in", false], [63843, 0.013153, " researchers", false], [38328, 0.011117, " early", false], [31370, 0.009775, " many", false]]], "qwen": [279, 1, 0.24443350732326508, [[279, 0.244434, " the", false], [264, 0.051798, " a", false], [369, 0.051381, " for", false], [1052, 0.042275, " there", false], [432, 0.040178, " it", false], [11811, 0.018852, " researchers", false], [304, 0.017217, " in", false], [825, 0.016138, " one", false], [32719, 0.013971, " chess", false], [892, 0.011749, " which", false]]]}, "raw_delta": -0.05337485671043396, "tuned_delta": -0.04480306467985571}, {"byte_start": 1420, "byte_end": 1428, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 238, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "14.23% 14.23% 14.23% 14.23% 14.23% 14.23% 14.23% 14.23%", "qwen": "14.12% 14.12% 14.12% 14.12% 14.12% 14.12% 14.12% 14.12%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.0018233939772471786]], "qwen": [[5413, " methods", "normal", 0.0019067905377596617]]}, "loss": {"rwkv": 14.229706946268095, "qwen": 14.116621903976391}, "topk": {"rwkv": [52224, 90, 0.0018233939772471786, [[38499, 0.126427, " first", false], [31461, 0.041958, " most", false], [30273, 0.027797, " best", false], [38328, 0.023165, " early", false], [31581, 0.019253, " only", false], [38720, 0.018662, " human", false], [39802, 0.015406, " state", false], [31356, 0.014352, " main", false], [3492, 0.011422, " 19", false], [52013, 0.010364, " initial", false]]], "qwen": [5413, 86, 0.0019067905377596617, [[1156, 0.0676, " first", false], [1429, 0.042103, " most", false], [1850, 0.030411, " best", false], [4124, 0.021152, " early", false], [3738, 0.020591, " human", false], [220, 0.016693, " ", false], [17755, 0.015041, " lesson", false], [3491, 0.01422, " problem", false], [5486, 0.012232, " approach", false], [2856, 0.01215, " initial", false]]]}, "raw_delta": 0.006270766258239746, "tuned_delta": 0.014842558288817994}, {"byte_start": 1428, "byte_end": 1433, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 239, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "3.86% 3.86% 3.86% 3.86% 3.86%", "qwen": "4.31% 4.31% 4.31% 4.31% 4.31%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.34377023577690125]], "qwen": [[429, " that", "normal", 0.3024786710739136]]}, "loss": {"rwkv": 3.860336339878671, "qwen": 4.3127367029732895}, "topk": {"rwkv": [32227, 1, 0.34377023577690125, [[32227, 0.34377, " that", false], [4706, 0.242646, " of", false], [32354, 0.03598, " used", false], [37810, 0.034131, " based", false], [59506, 0.033568, " developed", false], [21700, 0.032062, " for", false], [31461, 0.025372, " most", false], [32462, 0.017815, " were", false], [59206, 0.00914, " available", false], [4811, 0.007823, " to", false]]], "qwen": [429, 1, 0.3024786710739136, [[429, 0.302479, " that", false], [315, 0.16364, " of", false], [369, 0.053253, " for", false], [1483, 0.048816, " used", false], [7881, 0.047778, " developed", false], [1033, 0.037098, " were", false], [525, 0.017987, " are", false], [3118, 0.016369, " based", false], [614, 0.01535, " have", false], [1429, 0.014283, " most", false]]]}, "raw_delta": -0.025086402893066406, "tuned_delta": -0.016514610862488156}, {"byte_start": 1433, "byte_end": 1442, "display": {"text": " defeated", "kind": "normal"}, "is_word": true, "word_id": 240, "word_key": " defeated", "bytes_hex": "20 64 65 66 65 61 74 65 64", "compression": {"rwkv": "14.53% 14.53% 14.53% 14.53% 14.53% 14.53% 14.53% 14.53% 14.53%", "qwen": "15.80% 15.80% 15.80% 15.80% 15.80% 15.80% 15.80% 15.80% 15.80%"}, "model_tokens": {"rwkv": [[55934, " defeated", "normal", 0.0007086691330187023]], "qwen": [[23283, " defeated", "normal", 0.00037607268313877285]]}, "loss": {"rwkv": 14.527137564506921, "qwen": 15.800972930162544}, "topk": {"rwkv": [55934, 130, 0.0007086691330187023, [[56540, 0.134546, " leverage", false], [32462, 0.100875, " were", false], [31059, 0.058523, " have", false], [47812, 0.040695, " worked", false], [22777, 0.040539, " won", false], [21286, 0.031806, " are", false], [31351, 0.030178, " made", false], [21795, 0.020883, " had", false], [32272, 0.016664, " took", false], [61959, 0.01644, " eventually", false]]], "qwen": [23283, 231, 0.00037607268313877285, [[1033, 0.102351, " were", false], [614, 0.076363, " have", false], [32064, 0.056497, " leverage", false], [525, 0.055837, " are", false], [27505, 0.033256, " lever", false], [6439, 0.030144, " worked", false], [29701, 0.024997, " dominated", false], [975, 0.01789, " work", false], [1865, 0.016655, " made", false], [18651, 0.013735, " proved", false]]]}, "raw_delta": -0.07063643137613929, "tuned_delta": -0.062064639345561036}, {"byte_start": 1442, "byte_end": 1446, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 241, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "3.89% 3.89% 3.89% 3.89%", "qwen": "5.75% 5.75% 5.75% 5.75%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.42165428400039673]], "qwen": [[279, " the", "normal", 0.27914050221443176]]}, "loss": {"rwkv": 3.892036182085704, "qwen": 5.7529271605177374}, "topk": {"rwkv": [22590, 1, 0.42165428400039673, [[22590, 0.421654, " the", false], [38720, 0.083178, " human", false], [20184, 0.075613, " Kas", false], [38013, 0.072637, " chess", false], [40213, 0.053899, " world", false], [19948, 0.035155, " Gar", false], [46227, 0.028764, " humans", false], [38621, 0.028033, " grand", false], [22615, 0.012024, " top", false], [332, 0.010923, " a", false]]], "qwen": [279, 1, 0.27914050221443176, [[279, 0.279141, " the", false], [1879, 0.105652, " world", false], [3738, 0.097588, " human", false], [12677, 0.088407, " humans", false], [6662, 0.064503, " grand", false], [1909, 0.062897, " top", false], [32719, 0.05791, " chess", false], [3746, 0.012339, " strong", false], [678, 0.010331, " all", false], [37542, 0.009515, " Kas", false]]]}, "raw_delta": -0.10318970680236816, "tuned_delta": -0.09461791477178992}, {"byte_start": 1446, "byte_end": 1452, "display": {"text": " world", "kind": "normal"}, "is_word": true, "word_id": 242, "word_key": " world", "bytes_hex": "20 77 6f 72 6c 64", "compression": {"rwkv": "2.32% 2.32% 2.32% 2.32% 2.32% 2.32%", "qwen": "4.30% 4.30% 4.30% 4.30% 4.30% 4.30%"}, "model_tokens": {"rwkv": [[40213, " world", "normal", 0.4585268199443817]], "qwen": [[1879, " world", "normal", 0.2394600361585617]]}, "loss": {"rwkv": 2.3246550951824116, "qwen": 4.29613163471361}, "topk": {"rwkv": [40213, 1, 0.4585268199443817, [[40213, 0.458527, " world", false], [30273, 0.141294, " best", false], [38720, 0.092137, " human", false], [60571, 0.043762, " strongest", false], [22615, 0.038353, " top", false], [38621, 0.032671, " grand", false], [39471, 0.009689, " reign", false], [52196, 0.0082, " masters", false], [31461, 0.007884, " most", false], [37576, 0.006943, " World", false]]], "qwen": [1879, 2, 0.2394600361585617, [[1850, 0.356442, " best", false], [1879, 0.23946, " world", false], [29905, 0.048002, " strongest", false], [6662, 0.046616, " grand", false], [3738, 0.045049, " human", false], [1909, 0.040378, " top", false], [89956, 0.026188, " reigning", false], [32719, 0.013202, " chess", false], [1602, 0.012916, " very", false], [12677, 0.011226, " humans", false]]]}, "raw_delta": -0.10932187239329018, "tuned_delta": -0.10075008036271194}, {"byte_start": 1452, "byte_end": 1461, "display": {"text": " champion", "kind": "normal"}, "is_word": true, "word_id": 243, "word_key": " champion", "bytes_hex": "20 63 68 61 6d 70 69 6f 6e", "compression": {"rwkv": "0.90% 0.90% 0.90% 0.90% 0.90% 0.90% 0.90% 0.90% 0.90%", "qwen": "3.55% 3.55% 3.55% 3.55% 3.55% 3.55% 3.55% 3.55% 3.55%"}, "model_tokens": {"rwkv": [[55716, " champion", "normal", 0.6399039030075073]], "qwen": [[18319, " champion", "normal", 0.17004424333572388]]}, "loss": {"rwkv": 0.900118976249082, "qwen": 3.550024794365723}, "topk": {"rwkv": [55716, 1, 0.6399039030075073, [[55716, 0.639904, " champion", false], [59283, 0.18726, " champions", false], [460, 0.057858, "'s", false], [38013, 0.043835, " chess", false], [46, 0.015617, "-", false], [38621, 0.009147, " grand", false], [37996, 0.007886, " champ", false], [64275, 0.007686, " championship", false], [52196, 0.006802, " masters", false], [46526, 0.003423, " master", false]]], "qwen": [18319, 2, 0.17004424333572388, [[33738, 0.404083, " champions", false], [18319, 0.170044, " champion", false], [594, 0.129451, "'s", false], [32719, 0.105916, " chess", false], [14800, 0.066794, "-class", false], [536, 0.024879, " class", false], [11582, 0.016839, "-ch", false], [21553, 0.013702, " championship", false], [1909, 0.005558, " top", false], [6662, 0.005017, " grand", false]]]}, "raw_delta": -0.1469419797261556, "tuned_delta": -0.13837018769557735}, {"byte_start": 1461, "byte_end": 1462, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "47.62%", "qwen": "45.26%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.07186435908079147]], "qwen": [[11, ",", "normal", 0.08129944652318954]]}, "loss": {"rwkv": 47.620207404342736, "qwen": 45.25763013464507}, "topk": {"rwkv": [45, 3, 0.07186435908079147, [[32462, 0.233318, " were", false], [4596, 0.187459, " in", false], [45, 0.071864, ",", false], [275, 0.042282, " (", false], [21286, 0.025967, " are", false], [28951, 0.020477, " Gary", false], [52628, 0.01916, " quickly", false], [36381, 0.017631, " Bobby", false], [21265, 0.017185, " and", false], [4450, 0.014326, " by", false]]], "qwen": [11, 3, 0.08129944652318954, [[1033, 0.322275, " were", false], [304, 0.116513, " in", false], [11, 0.081299, ",", false], [525, 0.051066, " are", false], [320, 0.028895, " (", false], [37542, 0.015117, " Kas", false], [323, 0.013393, " and", false], [518, 0.013335, " at", false], [479, 0.011227, " G", false], [553, 0.00992, " by", false]]]}, "raw_delta": 0.13100910186767578, "tuned_delta": 0.13958089389825404}, {"byte_start": 1462, "byte_end": 1466, "display": {"text": " Kas", "kind": "normal"}, "is_word": true, "word_id": 244, "word_key": " kas", "bytes_hex": "20 4b 61 73", "compression": {"rwkv": "9.37% 9.37% 9.37% 9.37%", "qwen": "14.67% 14.67% 14.67% 14.67%"}, "model_tokens": {"rwkv": [[20184, " Kas", "normal", 0.12688720226287842]], "qwen": [[37542, " Kas", "normal", 0.03861033543944359]]}, "loss": {"rwkv": 9.369064474523052, "qwen": 14.671465882840577}, "topk": {"rwkv": [20184, 1, 0.12688720226287842, [[20184, 0.126887, " Kas", false], [21265, 0.07066, " and", false], [28753, 0.069056, " Deep", false], [19948, 0.067941, " Gar", false], [37404, 0.058358, " Stock", false], [22590, 0.048731, " the", false], [32139, 0.037743, " such", false], [28951, 0.036827, " Gary", false], [50239, 0.020798, " Fischer", false], [31296, 0.017045, " like", false]]], "qwen": [37542, 3, 0.03861033543944359, [[18183, 0.49022, " Deep", false], [479, 0.073292, " G", false], [37542, 0.03861, " Kas", false], [27922, 0.027501, " IBM", false], [24708, 0.025863, " Alpha", false], [279, 0.020899, " the", false], [323, 0.018803, " and", false], [2670, 0.017984, " including", false], [1075, 0.016334, " like", false], [23826, 0.010039, " Gary", false]]]}, "raw_delta": -0.29402756690979004, "tuned_delta": -0.2854557748792118}, {"byte_start": 1466, "byte_end": 1469, "display": {"text": "par", "kind": "normal"}, "is_word": true, "word_id": 245, "word_key": "par", "bytes_hex": "70 61 72", "compression": {"rwkv": "0.06% 0.06% 0.06%", "qwen": "0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[8469, "par", "normal", 0.9898763298988342]], "qwen": [[1732, "par", "normal", 0.9997996687889099]]}, "loss": {"rwkv": 0.06127168574738995, "qwen": 0.0012044744350566269}, "topk": {"rwkv": [8469, 1, 0.9898763298988342, [[8469, 0.989876, "par", false], [113, 0.002037, "p", false], [8484, 0.001454, "per", false], [2111, 0.000612, "pa", false], [2184, 0.00045, "si", false], [2190, 0.000335, "so", false], [8496, 0.000315, "pie", false], [26645, 0.000304, "para", false], [46, 0.000293, "-", false], [2124, 0.00027, "po", false]]], "qwen": [1732, 1, 0.9997996687889099, [[1732, 0.9998, "par", false], [318, 5.5e-05, "im", false], [712, 2.2e-05, "per", false], [4270, 2.1e-05, " Par", false], [4272, 1.8e-05, "Par", false], [1346, 1e-05, " par", false], [12, 6e-06, "-", false], [2396, 4e-06, "ram", false], [370, 4e-06, "ab", false], [3380, 3e-06, "pare", false]]]}, "raw_delta": 0.003330833453219384, "tuned_delta": 0.011902625483797632}, {"byte_start": 1469, "byte_end": 1471, "display": {"text": "ov", "kind": "normal"}, "is_word": true, "word_id": 246, "word_key": "ov", "bytes_hex": "6f 76", "compression": {"rwkv": "0.01% 0.01%", "qwen": "0.02% 0.02%"}, "model_tokens": {"rwkv": [[2105, "ov", "normal", 0.9990142583847046]], "qwen": [[859, "ov", "normal", 0.99774569272995]]}, "loss": {"rwkv": 0.008805511724175801, "qwen": 0.020349439880208684}, "topk": {"rwkv": [2105, 1, 0.9990142583847046, [[2105, 0.999014, "ov", false], [2106, 0.000755, "ow", false], [28017, 6.2e-05, "ов", false], [8443, 3.9e-05, "ova", false], [8311, 2.3e-05, "off", false], [112, 2e-05, "o", false], [7745, 1.3e-05, "ian", false], [8262, 1.3e-05, "nov", false], [45, 9e-06, ",", false], [8445, 8e-06, "ovi", false]]], "qwen": [859, 1, 0.99774569272995, [[859, 0.997746, "ov", false], [994, 0.001156, "ove", false], [363, 0.000447, "ow", false], [45088, 0.000114, "ovi", false], [1103, 7e-05, "ian", false], [1055, 5.9e-05, "of", false], [12660, 4.8e-05, "ova", false], [50114, 3.2e-05, "ovich", false], [30835, 2.2e-05, "iov", false], [2308, 1.8e-05, " No", false]]]}, "raw_delta": -0.0006401313003152609, "tuned_delta": 0.007931660730262987}, {"byte_start": 1471, "byte_end": 1472, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "1.93%", "qwen": "2.13%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8988778591156006]], "qwen": [[11, ",", "normal", 0.8888115882873535]]}, "loss": {"rwkv": 1.9284070675945004, "qwen": 2.125631262784684}, "topk": {"rwkv": [45, 1, 0.8988778591156006, [[45, 0.898878, ",", false], [4596, 0.045213, " in", false], [275, 0.036681, " (", false], [21265, 0.005375, " and", false], [460, 0.001492, "'s", false], [4424, 0.001003, " at", false], [32462, 0.000857, " were", false], [326, 0.00081, " [", false], [47, 0.000595, ".", false], [4450, 0.000436, " by", false]]], "qwen": [11, 1, 0.8888115882873535, [[11, 0.888812, ",", false], [304, 0.052188, " in", false], [320, 0.023062, " (", false], [323, 0.009136, " and", false], [594, 0.004451, "'s", false], [1154, 0.002869, " ,", false], [508, 0.002651, " [", false], [518, 0.001571, " at", false], [220, 0.001497, " ", false], [1033, 0.000954, " were", false]]]}, "raw_delta": -0.010936431586742401, "tuned_delta": -0.002364639556164153}, {"byte_start": 1472, "byte_end": 1475, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 247, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "6.57% 6.57% 6.57%", "qwen": "8.98% 8.98% 8.98%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.3365491032600403]], "qwen": [[304, " in", "normal", 0.22436822950839996]]}, "loss": {"rwkv": 6.574782087384598, "qwen": 8.983582560879153}, "topk": {"rwkv": [4596, 1, 0.3365491032600403, [[4596, 0.336549, " in", false], [32462, 0.324224, " were", false], [21265, 0.041704, " and", false], [21286, 0.020685, " are", false], [47054, 0.014559, " relied", false], [4450, 0.012535, " by", false], [32354, 0.011725, " used", false], [4424, 0.010701, " at", false], [56427, 0.00861, " included", false], [21795, 0.008175, " had", false]]], "qwen": [304, 2, 0.22436822950839996, [[1033, 0.40179, " were", false], [304, 0.224368, " in", false], [39913, 0.022348, " relied", false], [1030, 0.02026, " had", false], [323, 0.019035, " and", false], [1483, 0.018675, " used", false], [525, 0.01754, " are", false], [6398, 0.015118, " involved", false], [1521, 0.012167, " did", false], [518, 0.011098, " at", false]]]}, "raw_delta": -0.133572260538737, "tuned_delta": -0.12500046850815874}, {"byte_start": 1475, "byte_end": 1478, "display": {"text": " 19", "kind": "normal"}, "is_word": true, "word_id": 248, "word_key": " 19", "bytes_hex": "20 31 39", "compression": {"rwkv": "4.25% 4.25% 4.25%", "qwen": "11.89% 1.11% 0.01%"}, "model_tokens": {"rwkv": [[3492, " 19", "normal", 0.4993974566459656]], "qwen": [[220, " ", "normal", 0.5171647071838379], [16, "1", "normal", 0.9404540061950684], [24, "9", "normal", 0.999442994594574]]}, "loss": {"rwkv": 4.250126992202187, "qwen": 4.336161768515685}, "topk": {"rwkv": [3492, 1, 0.4993974566459656, [[3492, 0.499397, " 19", false], [22590, 0.25355, " the", false], [3493, 0.133876, " 20", false], [332, 0.034427, " a", false], [31198, 0.004014, " just", false], [21823, 0.004008, " his", false], [31277, 0.003156, " less", false], [20394, 0.00275, " May", false], [37598, 0.00239, " about", false], [47014, 0.002232, " recent", false]]], "qwen": [220, 1, 0.5171647071838379, [[220, 0.517165, " ", false], [279, 0.350851, " the", false], [264, 0.03867, " a", false], [806, 0.00853, " his", false], [32719, 0.006975, " chess", false], [1378, 0.003782, " two", false], [862, 0.003536, " their", false], [458, 0.002794, " an", false], [2326, 0.002367, " three", false], [39061, 0.002184, " tournaments", false]]]}, "raw_delta": -0.00477078101054453, "tuned_delta": 0.0038010110200337186}, {"byte_start": 1478, "byte_end": 1480, "display": {"text": "97", "kind": "normal"}, "is_word": true, "word_id": 249, "word_key": "97", "bytes_hex": "39 37", "compression": {"rwkv": "2.89% 2.89%", "qwen": "0.83% 2.49%"}, "model_tokens": {"rwkv": [[717, "97", "normal", 0.7258799076080322]], "qwen": [[24, "9", "normal", 0.9547744393348694], [22, "7", "normal", 0.8708397746086121]]}, "loss": {"rwkv": 2.8882078455296627, "qwen": 1.6643060414114925}, "topk": {"rwkv": [717, 1, 0.7258799076080322, [[717, 0.72588, "97", false], [716, 0.215199, "96", false], [719, 0.020191, "99", false], [710, 0.011702, "90", false], [718, 0.008255, "98", false], [709, 0.004508, "89", false], [713, 0.003529, "93", false], [715, 0.002784, "95", false], [705, 0.001783, "85", false], [711, 0.001693, "91", false]]], "qwen": [24, 1, 0.9547744393348694, [[24, 0.954774, "9", false], [23, 0.043984, "8", false], [22, 0.001088, "7", false], [21, 7.7e-05, "6", false], [20, 1.7e-05, "5", false], [339, 1.6e-05, "th", false], [19, 7e-06, "4", false], [220, 4e-06, " ", false], [15, 4e-06, "0", false], [18, 4e-06, "3", false]]]}, "raw_delta": 0.06786752678453922, "tuned_delta": 0.07643931881511747}, {"byte_start": 1480, "byte_end": 1481, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "34.94%", "qwen": "42.10%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.14454956352710724]], "qwen": [[11, ",", "normal", 0.09688328206539154]]}, "loss": {"rwkv": 34.94027052152958, "qwen": 42.095105661422956}, "topk": {"rwkv": [45, 3, 0.14454956352710724, [[32462, 0.371787, " were", false], [21265, 0.213639, " and", false], [45, 0.14455, ",", false], [275, 0.052413, " (", false], [32354, 0.021215, " used", false], [21286, 0.014041, " are", false], [21795, 0.012023, " had", false], [47054, 0.00872, " relied", false], [56500, 0.008076, " involved", false], [21532, 0.007348, " did", false]]], "qwen": [11, 3, 0.09688328206539154, [[1033, 0.439887, " were", false], [323, 0.13122, " and", false], [11, 0.096883, ",", false], [320, 0.035252, " (", false], [12, 0.027816, "-", false], [6398, 0.019639, " involved", false], [5230, 0.019083, " included", false], [525, 0.017318, " are", false], [1030, 0.014978, " had", false], [1521, 0.012527, " did", false]]]}, "raw_delta": -0.39674830436706543, "tuned_delta": -0.3881765123364872}, {"byte_start": 1481, "byte_end": 1486, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 250, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"rwkv": "5.95% 5.95% 5.95% 5.95% 5.95%", "qwen": "2.68% 2.68% 2.68% 2.68% 2.68%"}, "model_tokens": {"rwkv": [[32462, " were", "normal", 0.1922028809785843]], "qwen": [[1033, " were", "normal", 0.47591105103492737]]}, "loss": {"rwkv": 5.945481516163501, "qwen": 2.678090406599476}, "topk": {"rwkv": [32462, 2, 0.1922028809785843, [[3493, 0.27099, " 20", false], [32462, 0.192203, " were", false], [21265, 0.154762, " and", false], [3492, 0.098703, " 19", false], [32354, 0.012385, " used", false], [21286, 0.012159, " are", false], [22590, 0.011727, " the", false], [4596, 0.009792, " in", false], [47054, 0.007366, " relied", false], [21795, 0.00723, " had", false]]], "qwen": [1033, 1, 0.47591105103492737, [[1033, 0.475911, " were", false], [220, 0.043079, " ", false], [39913, 0.037907, " relied", false], [323, 0.032855, " and", false], [1521, 0.031137, " did", false], [1483, 0.029892, " used", false], [5230, 0.016554, " included", false], [1030, 0.015625, " had", false], [6398, 0.014981, " involved", false], [525, 0.013672, " are", false]]]}, "raw_delta": 0.18118263483047486, "tuned_delta": 0.18975442686105312}, {"byte_start": 1486, "byte_end": 1492, "display": {"text": " based", "kind": "normal"}, "is_word": true, "word_id": 251, "word_key": " based", "bytes_hex": "20 62 61 73 65 64", "compression": {"rwkv": "7.23% 7.23% 7.23% 7.23% 7.23% 7.23%", "qwen": "6.65% 6.65% 6.65% 6.65% 6.65% 6.65%"}, "model_tokens": {"rwkv": [[37810, " based", "normal", 0.08956412225961685]], "qwen": [[3118, " based", "normal", 0.109536312520504]]}, "loss": {"rwkv": 7.232260296123059, "qwen": 6.646914477533975}, "topk": {"rwkv": [37810, 1, 0.08956412225961685, [[37810, 0.089564, " based", false], [22187, 0.053974, " not", false], [22590, 0.049683, " the", false], [332, 0.046704, " a", false], [63541, 0.038035, " essentially", false], [52094, 0.036795, " largely", false], [52224, 0.030486, " methods", false], [39944, 0.024219, " those", false], [21256, 0.016626, " all", false], [32386, 0.016187, " very", false]]], "qwen": [3118, 1, 0.109536312520504, [[3118, 0.109536, " based", false], [537, 0.085856, " not", false], [279, 0.033277, " the", false], [678, 0.031775, " all", false], [264, 0.024103, " a", false], [1602, 0.01956, " very", false], [4586, 0.017779, " general", false], [13771, 0.016204, " largely", false], [1846, 0.0123, " those", false], [11368, 0.011981, " entirely", false]]]}, "raw_delta": 0.03245846430460614, "tuned_delta": 0.04103025633518439}, {"byte_start": 1492, "byte_end": 1495, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 252, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"rwkv": "1.04% 1.04% 1.04%", "qwen": "0.91% 0.91% 0.91%"}, "model_tokens": {"rwkv": [[4712, " on", "normal", 0.8390783667564392]], "qwen": [[389, " on", "normal", 0.860114574432373]]}, "loss": {"rwkv": 1.0449207246021952, "qwen": 0.9058302035883852}, "topk": {"rwkv": [4712, 1, 0.8390783667564392, [[4712, 0.839078, " on", false], [56131, 0.016467, " entirely", false], [60247, 0.014913, " primarily", false], [4596, 0.014284, " in", false], [52094, 0.013891, " largely", false], [45145, 0.013001, " almost", false], [32350, 0.010964, " upon", false], [51919, 0.008763, " heavily", false], [22187, 0.007125, " not", false], [47330, 0.005489, " solely", false]]], "qwen": [389, 1, 0.860114574432373, [[389, 0.860115, " on", false], [304, 0.015985, " in", false], [4558, 0.01554, " almost", false], [11368, 0.014561, " entirely", false], [13771, 0.012379, " largely", false], [537, 0.011577, " not", false], [5193, 0.008528, " upon", false], [15503, 0.00716, " primarily", false], [2163, 0.005406, " around", false], [16916, 0.004664, " heavily", false]]]}, "raw_delta": 0.007712816198666893, "tuned_delta": 0.016284608229245143}, {"byte_start": 1495, "byte_end": 1503, "display": {"text": " massive", "kind": "normal"}, "is_word": true, "word_id": 253, "word_key": " massive", "bytes_hex": "20 6d 61 73 73 69 76 65", "compression": {"rwkv": "10.50% 10.50% 10.50% 10.50% 10.50% 10.50% 10.50% 10.50%", "qwen": "14.62% 14.62% 14.62% 14.62% 14.62% 14.62% 14.62% 14.62%"}, "model_tokens": {"rwkv": [[52195, " massive", "normal", 0.009590300731360912]], "qwen": [[10951, " massive", "normal", 0.0015222453512251377]]}, "loss": {"rwkv": 10.496169975217555, "qwen": 14.624349085853574}, "topk": {"rwkv": [52195, 14, 0.009590300731360912, [[332, 0.125288, " a", false], [22590, 0.108478, " the", false], [51832, 0.057074, " general", false], [52224, 0.027377, " methods", false], [52167, 0.022165, " machine", false], [46658, 0.021982, " neural", false], [56537, 0.020004, " learning", false], [30597, 0.016778, " deep", false], [55531, 0.012636, " applying", false], [47202, 0.011492, " search", false]]], "qwen": [10951, 84, 0.0015222453512251377, [[264, 0.132264, " a", false], [279, 0.095771, " the", false], [4586, 0.042222, " general", false], [5538, 0.023053, " deep", false], [6832, 0.022309, " learning", false], [64098, 0.022067, " brute", false], [3738, 0.02184, " human", false], [458, 0.01992, " an", false], [2711, 0.019204, " search", false], [5662, 0.018349, " machine", false]]]}, "raw_delta": -0.22891485691070557, "tuned_delta": -0.2203430648801273}, {"byte_start": 1503, "byte_end": 1504, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "79.46%", "qwen": "80.63%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.012095452286303043]], "qwen": [[11, ",", "normal", 0.011436567641794682]]}, "loss": {"rwkv": 79.46093779896243, "qwen": 80.62753051629504}, "topk": {"rwkv": [45, 14, 0.012095452286303043, [[64423, 0.114045, " improvements", false], [50897, 0.110007, " amounts", false], [63370, 0.097949, " computation", false], [22681, 0.045297, " use", false], [56812, 0.028972, " parallel", false], [38720, 0.026104, " human", false], [51832, 0.02105, " general", false], [64862, 0.019825, " computational", false], [47202, 0.018326, " search", false], [63621, 0.017981, " improvement", false]]], "qwen": [11, 13, 0.011436567641794682, [[14713, 0.15872, " amounts", false], [34447, 0.131126, " computation", false], [2711, 0.066927, " search", false], [82599, 0.051758, " computations", false], [54480, 0.044446, " computational", false], [31806, 0.039818, " databases", false], [821, 0.031169, " data", false], [990, 0.029515, " use", false], [24231, 0.02003, " computing", false], [64098, 0.015096, " brute", false]]]}, "raw_delta": -0.06468963623046875, "tuned_delta": -0.0561178441998905}, {"byte_start": 1504, "byte_end": 1509, "display": {"text": " deep", "kind": "normal"}, "is_word": true, "word_id": 254, "word_key": " deep", "bytes_hex": "20 64 65 65 70", "compression": {"rwkv": "16.79% 16.79% 16.79% 16.79% 16.79%", "qwen": "14.99% 14.99% 14.99% 14.99% 14.99%"}, "model_tokens": {"rwkv": [[30597, " deep", "normal", 0.009489580988883972]], "qwen": [[5538, " deep", "normal", 0.01565556600689888]]}, "loss": {"rwkv": 16.79387196034809, "qwen": 14.99295219218517}, "topk": {"rwkv": [30597, 15, 0.009489580988883972, [[31044, 0.100107, " hand", false], [38720, 0.062638, " human", false], [51832, 0.055898, " general", false], [59262, 0.040896, " carefully", false], [59988, 0.033768, " massively", false], [21400, 0.020121, " but", false], [56812, 0.016347, " parallel", false], [39802, 0.015758, " state", false], [22323, 0.014956, " pre", false], [37920, 0.013377, " brute", false]]], "qwen": [5538, 10, 0.01565556600689888, [[855, 0.049514, " pre", false], [4586, 0.047162, " general", false], [64098, 0.044898, " brute", false], [63707, 0.034973, " massively", false], [15279, 0.026881, " parallel", false], [10951, 0.023684, " massive", false], [1424, 0.020637, " hand", false], [1550, 0.019098, " high", false], [3738, 0.017058, " human", false], [5538, 0.015656, " deep", false]]]}, "raw_delta": 0.09986419677734382, "tuned_delta": 0.10843598880792206}, {"byte_start": 1509, "byte_end": 1516, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 255, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "9.22% 9.22% 9.22% 9.22% 9.22% 9.22% 9.22%", "qwen": "5.54% 5.54% 5.54% 5.54% 5.54% 5.54% 5.54%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.027812570333480835]], "qwen": [[2711, " search", "normal", 0.11630882322788239]]}, "loss": {"rwkv": 9.218112844965754, "qwen": 5.542799371917312}, "topk": {"rwkv": [47202, 5, 0.027812570333480835, [[56537, 0.250962, " learning", false], [45, 0.165588, ",", false], [46658, 0.154947, " neural", false], [46, 0.033813, "-", false], [47202, 0.027813, " search", false], [32298, 0.014586, " tree", false], [56705, 0.012814, " networks", false], [63384, 0.012554, " connections", false], [51832, 0.011478, " general", false], [21265, 0.010674, " and", false]]], "qwen": [2711, 4, 0.11630882322788239, [[29728, 0.228634, " neural", false], [6832, 0.141765, " learning", false], [11, 0.125937, ",", false], [2711, 0.116309, " search", false], [14155, 0.035094, " networks", false], [26475, 0.026614, " searches", false], [6540, 0.022596, " knowledge", false], [6358, 0.015513, " analysis", false], [34447, 0.014, " computation", false], [82599, 0.011676, " computations", false]]]}, "raw_delta": 0.20380265372140063, "tuned_delta": 0.2123744457519789}, {"byte_start": 1516, "byte_end": 1517, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "33.25%", "qwen": "39.40%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.15849344432353973]], "qwen": [[13, ".", "normal", 0.11249887943267822]]}, "loss": {"rwkv": 33.24961227048782, "qwen": 39.40021921416191}, "topk": {"rwkv": [47, 1, 0.15849344432353973, [[47, 0.158493, ".", false], [45, 0.150797, ",", false], [21265, 0.079702, " and", false], [40085, 0.069838, " using", false], [4706, 0.066579, " of", false], [55780, 0.050283, " combined", false], [32487, 0.045227, " with", false], [4596, 0.042338, " in", false], [31601, 0.035346, " over", false], [275, 0.033037, " (", false]]], "qwen": [13, 2, 0.11249887943267822, [[315, 0.154114, " of", false], [13, 0.112499, ".", false], [11, 0.110164, ",", false], [323, 0.099218, " and", false], [429, 0.052457, " that", false], [320, 0.047566, " (", false], [448, 0.046324, " with", false], [10856, 0.041333, " combined", false], [1667, 0.030094, " using", false], [304, 0.020681, " in", false]]]}, "raw_delta": -0.341062068939209, "tuned_delta": -0.33249027690863076}, {"byte_start": 1517, "byte_end": 1520, "display": {"text": " At", "kind": "normal"}, "is_word": true, "word_id": 256, "word_key": " at", "bytes_hex": "20 41 74", "compression": {"rwkv": "28.74% 28.74% 28.74%", "qwen": "25.76% 25.76% 25.76%"}, "model_tokens": {"rwkv": [[3642, " At", "normal", 0.008294779807329178]], "qwen": [[2411, " At", "normal", 0.013779883272945881]]}, "loss": {"rwkv": 28.741190267709815, "qwen": 25.755385134193023}, "topk": {"rwkv": [3642, 17, 0.008294779807329178, [[20996, 0.16726, " The", false], [3913, 0.099724, " In", false], [29894, 0.074496, " This", false], [19555, 0.034937, " But", false], [29893, 0.030826, " They", false], [28753, 0.030702, " Deep", false], [3918, 0.025467, " It", false], [20184, 0.025448, " Kas", false], [37453, 0.024568, " These", false], [267, 0.024184, "  ", false]]], "qwen": [2411, 12, 0.013779883272945881, [[576, 0.210873, " The", false], [1096, 0.054783, " This", false], [2379, 0.052526, " They", false], [220, 0.048822, " ", false], [4220, 0.045169, " These", false], [758, 0.041157, " In", false], [1988, 0.029914, " But", false], [1084, 0.025989, " It", false], [2619, 0.018194, " There", false], [18183, 0.015407, " Deep", false]]]}, "raw_delta": 0.165568192799886, "tuned_delta": 0.17413998483046425}, {"byte_start": 1520, "byte_end": 1524, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 257, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "2.03% 2.03% 2.03% 2.03%", "qwen": "2.66% 2.66% 2.66% 2.66%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.6423044800758362]], "qwen": [[279, " the", "normal", 0.5542927980422974]]}, "loss": {"rwkv": 2.025267696560434, "qwen": 2.6602496788230656}, "topk": {"rwkv": [22590, 1, 0.6423044800758362, [[22590, 0.642304, " the", false], [32227, 0.203458, " that", false], [38499, 0.018085, " first", false], [332, 0.017556, " a", false], [38879, 0.015072, " least", false], [37598, 0.012445, " about", false], [32234, 0.011288, " this", false], [22226, 0.00807, " one", false], [32074, 0.00772, " some", false], [21902, 0.004991, " its", false]]], "qwen": [279, 1, 0.5542927980422974, [[279, 0.554293, " the", false], [429, 0.188296, " that", false], [1156, 0.067455, " first", false], [825, 0.020725, " one", false], [264, 0.01993, " a", false], [3245, 0.018709, " least", false], [1817, 0.017859, " each", false], [419, 0.017575, " this", false], [1181, 0.008022, " its", false], [220, 0.007143, " ", false]]]}, "raw_delta": -0.035210877656936646, "tuned_delta": -0.026639085626358396}, {"byte_start": 1524, "byte_end": 1529, "display": {"text": " time", "kind": "normal"}, "is_word": true, "word_id": 258, "word_key": " time", "bytes_hex": "20 74 69 6d 65", "compression": {"rwkv": "0.61% 0.61% 0.61% 0.61% 0.61%", "qwen": "1.04% 1.04% 1.04% 1.04% 1.04%"}, "model_tokens": {"rwkv": [[32251, " time", "normal", 0.8444154262542725]], "qwen": [[882, " time", "normal", 0.748907744884491]]}, "loss": {"rwkv": 0.6128636160026357, "qwen": 1.0428501251452447}, "topk": {"rwkv": [32251, 1, 0.8444154262542725, [[32251, 0.844415, " time", false], [31937, 0.053033, " same", false], [21616, 0.030037, " end", false], [59220, 0.008447, " beginning", false], [38887, 0.007236, " level", false], [39801, 0.007233, " start", false], [38676, 0.002994, " heart", false], [22615, 0.002662, " top", false], [3492, 0.00228, " 19", false], [32321, 0.002239, " turn", false]]], "qwen": [882, 1, 0.748907744884491, [[882, 0.748908, " time", false], [1852, 0.050884, " same", false], [1191, 0.023412, " start", false], [3704, 0.02151, " root", false], [835, 0.019151, " end", false], [7167, 0.014188, " beginning", false], [1909, 0.010463, " top", false], [4746, 0.008314, " heart", false], [1602, 0.006322, " very", false], [16162, 0.005947, " peak", false]]]}, "raw_delta": -0.02384351491928101, "tuned_delta": -0.01527172288870276}, {"byte_start": 1529, "byte_end": 1530, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "5.74%", "qwen": "5.66%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.7221240401268005]], "qwen": [[11, ",", "normal", 0.7307966351509094]]}, "loss": {"rwkv": 5.741193644162623, "qwen": 5.655725790924782}, "topk": {"rwkv": [45, 1, 0.7221240401268005, [[45, 0.722124, ",", false], [4706, 0.075869, " of", false], [32234, 0.037753, " this", false], [22590, 0.032489, " the", false], [4601, 0.026915, " it", false], [32232, 0.017926, " they", false], [32227, 0.015678, " that", false], [39934, 0.009674, " there", false], [20184, 0.008429, " Kas", false], [275, 0.006458, " (", false]]], "qwen": [11, 1, 0.7307966351509094, [[11, 0.730797, ",", false], [315, 0.122308, " of", false], [279, 0.024006, " the", false], [432, 0.020119, " it", false], [419, 0.017418, " this", false], [807, 0.012417, " they", false], [1052, 0.010927, " there", false], [320, 0.009159, " (", false], [1493, 0.006985, " these", false], [429, 0.006148, " that", false]]]}, "raw_delta": 0.004739344120025635, "tuned_delta": 0.013311136150603883}, {"byte_start": 1530, "byte_end": 1535, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 259, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "7.33% 7.33% 7.33% 7.33% 7.33%", "qwen": "10.78% 10.78% 10.78% 10.78% 10.78%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.13208968937397003]], "qwen": [[419, " this", "normal", 0.05038928985595703]]}, "loss": {"rwkv": 7.326185754514267, "qwen": 10.776847381252168}, "topk": {"rwkv": [32234, 2, 0.13208968937397003, [[22590, 0.208129, " the", false], [32234, 0.13209, " this", false], [4601, 0.096917, " it", false], [32232, 0.045646, " they", false], [39936, 0.038543, " these", false], [39934, 0.036859, " there", false], [4692, 0.019692, " no", false], [32227, 0.018609, " that", false], [332, 0.018595, " a", false], [47202, 0.015894, " search", false]]], "qwen": [419, 5, 0.05038928985595703, [[279, 0.223538, " the", false], [432, 0.092244, " it", false], [1052, 0.054495, " there", false], [32719, 0.054022, " chess", false], [419, 0.050389, " this", false], [902, 0.04243, " no", false], [1493, 0.02881, " these", false], [807, 0.024149, " they", false], [264, 0.02267, " a", false], [1429, 0.020667, " most", false]]]}, "raw_delta": -0.19134531021118162, "tuned_delta": -0.18277351818060336}, {"byte_start": 1535, "byte_end": 1539, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 260, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "2.25% 2.25% 2.25% 2.25%", "qwen": "3.42% 3.42% 3.42% 3.42%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.6059576272964478]], "qwen": [[572, " was", "normal", 0.46857208013534546]]}, "loss": {"rwkv": 2.2454054896648294, "qwen": 3.417678471487961}, "topk": {"rwkv": [22748, 1, 0.6059576272964478, [[22748, 0.605958, " was", false], [47211, 0.052989, " seemed", false], [55532, 0.040104, " approach", false], [46561, 0.028907, " method", false], [63841, 0.017092, " represented", false], [57101, 0.014504, " required", false], [31351, 0.011846, " made", false], [47202, 0.011302, " search", false], [38990, 0.011119, " meant", false], [21795, 0.011076, " had", false]]], "qwen": [572, 1, 0.46857208013534546, [[572, 0.468572, " was", false], [9324, 0.09243, " seemed", false], [5486, 0.078204, " approach", false], [1714, 0.041065, " method", false], [2567, 0.038069, " required", false], [2711, 0.021175, " search", false], [8791, 0.019898, " meant", false], [1030, 0.016118, " had", false], [1035, 0.015172, " would", false], [6398, 0.013176, " involved", false]]]}, "raw_delta": -0.0650046169757843, "tuned_delta": -0.05643282494520605}, {"byte_start": 1539, "byte_end": 1546, "display": {"text": " looked", "kind": "normal"}, "is_word": true, "word_id": 261, "word_key": " looked", "bytes_hex": "20 6c 6f 6f 6b 65 64", "compression": {"rwkv": "22.86% 22.86% 22.86% 22.86% 22.86% 22.86% 22.86%", "qwen": "21.48% 21.48% 21.48% 21.48% 21.48% 21.48% 21.48%"}, "model_tokens": {"rwkv": [[46471, " looked", "normal", 0.00014063648995943367]], "qwen": [[6966, " looked", "normal", 0.00023941117979120463]]}, "loss": {"rwkv": 22.864140156945616, "qwen": 21.47896731794644}, "topk": {"rwkv": [46471, 291, 0.00014063648995943367, [[22590, 0.209277, " the", false], [332, 0.169261, " a", false], [61755, 0.094635, " considered", false], [31968, 0.039652, " seen", false], [4419, 0.03881, " an", false], [53137, 0.033443, " thought", false], [22187, 0.029644, " not", false], [57059, 0.019155, " regarded", false], [47724, 0.012689, " viewed", false], [22168, 0.011154, " new", false]]], "qwen": [6966, 208, 0.00023941117979120463, [[279, 0.19248, " the", false], [264, 0.174535, " a", false], [6509, 0.114077, " considered", false], [537, 0.080483, " not", false], [458, 0.058191, " an", false], [3884, 0.025644, " seen", false], [3381, 0.022485, " thought", false], [29969, 0.009631, " unprecedented", false], [13570, 0.009015, " widely", false], [825, 0.008999, " one", false]]]}, "raw_delta": 0.0768102918352398, "tuned_delta": 0.08538208386581804}, {"byte_start": 1546, "byte_end": 1551, "display": {"text": " upon", "kind": "normal"}, "is_word": true, "word_id": 262, "word_key": " upon", "bytes_hex": "20 75 70 6f 6e", "compression": {"rwkv": "3.24% 3.24% 3.24% 3.24% 3.24%", "qwen": "1.64% 1.64% 1.64% 1.64% 1.64%"}, "model_tokens": {"rwkv": [[32350, " upon", "normal", 0.4067184627056122]], "qwen": [[5193, " upon", "normal", 0.6352965831756592]]}, "loss": {"rwkv": 3.240428314496695, "qwen": 1.6362445526461131}, "topk": {"rwkv": [32350, 1, 0.4067184627056122, [[32350, 0.406718, " upon", false], [4424, 0.29206, " at", false], [4712, 0.264328, " on", false], [30678, 0.013842, " down", false], [4811, 0.006693, " to", false], [4423, 0.004043, " as", false], [4833, 0.001548, " up", false], [4450, 0.001287, " by", false], [30218, 0.001161, " back", false], [21295, 0.001024, " ask", false]]], "qwen": [5193, 1, 0.6352965831756592, [[5193, 0.635297, " upon", false], [518, 0.167502, " at", false], [389, 0.115316, " on", false], [1495, 0.05384, " down", false], [311, 0.015149, " to", false], [1182, 0.00164, " back", false], [369, 0.001565, " for", false], [1075, 0.001294, " like", false], [438, 0.001074, " as", false], [4637, 0.000624, " forward", false]]]}, "raw_delta": 0.08895483613014221, "tuned_delta": 0.09752662816072045}, {"byte_start": 1551, "byte_end": 1556, "display": {"text": " with", "kind": "normal"}, "is_word": true, "word_id": 263, "word_key": " with", "bytes_hex": "20 77 69 74 68", "compression": {"rwkv": "7.13% 7.13% 7.13% 7.13% 7.13%", "qwen": "12.53% 12.53% 12.53% 12.53% 12.53%"}, "model_tokens": {"rwkv": [[32487, " with", "normal", 0.13835200667381287]], "qwen": [[448, " with", "normal", 0.03100200742483139]]}, "loss": {"rwkv": 7.128942291892729, "qwen": 12.528736615480607}, "topk": {"rwkv": [32487, 2, 0.13835200667381287, [[4423, 0.711724, " as", false], [32487, 0.138352, " with", false], [4450, 0.068183, " by", false], [60512, 0.034853, " skeptical", false], [4596, 0.005076, " in", false], [38458, 0.003401, " favor", false], [57263, 0.002588, " somewhat", false], [45, 0.002395, ",", false], [62624, 0.002145, " suspicious", false], [21295, 0.001884, " ask", false]]], "qwen": [448, 3, 0.03100200742483139, [[438, 0.876166, " as", false], [553, 0.03154, " by", false], [448, 0.031002, " with", false], [36579, 0.009905, " skept", false], [11, 0.006082, ",", false], [311, 0.004734, " to", false], [304, 0.004288, " in", false], [320, 0.002634, " (", false], [4694, 0.00257, " favor", false], [537, 0.002294, " not", false]]]}, "raw_delta": -0.2994281768798828, "tuned_delta": -0.2908563848493046}, {"byte_start": 1556, "byte_end": 1563, "display": {"text": " dismay", "kind": "normal"}, "is_word": true, "word_id": 264, "word_key": " dismay", "bytes_hex": "20 64 69 73 6d 61 79", "compression": {"rwkv": "13.44% 13.44% 13.44% 13.44% 13.44% 13.44% 13.44%", "qwen": "11.90% 11.90% 11.90% 11.90% 11.90% 11.90% 11.90%"}, "model_tokens": {"rwkv": [[45756, " dismay", "normal", 0.005509744398295879]], "qwen": [[71982, " dismay", "normal", 0.00986457522958517]]}, "loss": {"rwkv": 13.444758472570138, "qwen": 11.899155303056101}, "topk": {"rwkv": [45756, 19, 0.005509744398295879, [[62561, 0.263272, " skepticism", false], [60609, 0.212474, " suspicion", false], [32074, 0.077677, " some", false], [21542, 0.051934, " dis", false], [332, 0.044298, " a", false], [46271, 0.026665, " incred", false], [38629, 0.024728, " great", false], [39608, 0.02181, " scorn", false], [39599, 0.017621, " scept", false], [21523, 0.016758, " der", false]]], "qwen": [71982, 18, 0.00986457522958517, [[66133, 0.185542, " skepticism", false], [2244, 0.114888, " great", false], [37041, 0.105034, " suspicion", false], [1045, 0.05703, " some", false], [264, 0.036511, " a", false], [23839, 0.035585, " considerable", false], [9653, 0.031005, " incred", false], [87006, 0.024041, " scorn", false], [50417, 0.020561, " awe", false], [78398, 0.019158, " disdain", false]]]}, "raw_delta": 0.0857064383370536, "tuned_delta": 0.09427823036763185}, {"byte_start": 1563, "byte_end": 1566, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 265, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "5.57% 5.57% 5.57%", "qwen": "8.77% 8.77% 8.77%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.3952583074569702]], "qwen": [[553, " by", "normal", 0.23240253329277039]]}, "loss": {"rwkv": 5.565083409679106, "qwen": 8.772092628735642}, "topk": {"rwkv": [4450, 1, 0.3952583074569702, [[4450, 0.395258, " by", false], [45, 0.190716, ",", false], [4423, 0.147753, " as", false], [47, 0.083341, ".", false], [51018, 0.051481, " because", false], [21265, 0.030159, " and", false], [4596, 0.017165, " in", false], [59, 0.016393, ":", false], [60, 0.01203, ";", false], [30917, 0.008852, " from", false]]], "qwen": [553, 2, 0.23240253329277039, [[11, 0.27647, ",", false], [553, 0.232403, " by", false], [13, 0.163083, ".", false], [1576, 0.070035, " because", false], [323, 0.067026, " and", false], [438, 0.052422, " as", false], [25, 0.034901, ":", false], [26, 0.016396, ";", false], [320, 0.012731, " (", false], [2474, 0.009707, " since", false]]]}, "raw_delta": -0.17783435185750326, "tuned_delta": -0.169262559826925}, {"byte_start": 1566, "byte_end": 1570, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 266, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "7.68% 7.68% 7.68% 7.68%", "qwen": "9.55% 9.55% 9.55% 9.55%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.18160317838191986]], "qwen": [[279, " the", "normal", 0.12037070840597153]]}, "loss": {"rwkv": 7.678406223481298, "qwen": 9.545136012910124}, "topk": {"rwkv": [22590, 2, 0.18160317838191986, [[31370, 0.205778, " many", false], [22590, 0.181603, " the", false], [39944, 0.082015, " those", false], [32074, 0.077888, " some", false], [38013, 0.076814, " chess", false], [38720, 0.068789, " human", false], [31461, 0.026712, " most", false], [20184, 0.021205, " Kas", false], [332, 0.015787, " a", false], [55809, 0.013672, " computer", false]]], "qwen": [279, 3, 0.12037070840597153, [[1657, 0.225981, " many", false], [32719, 0.209662, " chess", false], [279, 0.120371, " the", false], [1846, 0.0733, " those", false], [1045, 0.071325, " some", false], [3738, 0.027125, " human", false], [1429, 0.026412, " most", false], [264, 0.017876, " a", false], [11811, 0.017368, " researchers", false], [6366, 0.017071, " computer", false]]]}, "raw_delta": -0.10351347923278809, "tuned_delta": -0.09494168720220984}, {"byte_start": 1570, "byte_end": 1579, "display": {"text": " majority", "kind": "normal"}, "is_word": true, "word_id": 267, "word_key": " majority", "bytes_hex": "20 6d 61 6a 6f 72 69 74 79", "compression": {"rwkv": "10.39% 10.39% 10.39% 10.39% 10.39% 10.39% 10.39% 10.39% 10.39%", "qwen": "9.64% 9.64% 9.64% 9.64% 9.64% 9.64% 9.64% 9.64% 9.64%"}, "model_tokens": {"rwkv": [[56573, " majority", "normal", 0.005612103268504143]], "qwen": [[8686, " majority", "normal", 0.008159642107784748]]}, "loss": {"rwkv": 10.394417395293745, "qwen": 9.63510921443859}, "topk": {"rwkv": [56573, 21, 0.005612103268504143, [[38720, 0.170913, " human", false], [38013, 0.169576, " chess", false], [38621, 0.076005, " grand", false], [55809, 0.05481, " computer", false], [40213, 0.036494, " world", false], [51685, 0.02337, " experts", false], [3609, 0.019848, " AI", false], [22615, 0.019308, " top", false], [45929, 0.018355, " expert", false], [59324, 0.017437, " community", false]]], "qwen": [8686, 8, 0.008159642107784748, [[32719, 0.593104, " chess", false], [3738, 0.052657, " human", false], [15235, 0.021827, " AI", false], [6366, 0.015761, " computer", false], [6662, 0.015289, " grand", false], [1879, 0.012535, " world", false], [3942, 0.012518, " community", false], [8686, 0.00816, " majority", false], [1251, 0.008023, " people", false], [47387, 0.007971, " Chess", false]]]}, "raw_delta": 0.04210498597886825, "tuned_delta": 0.0506767780094465}, {"byte_start": 1579, "byte_end": 1582, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 268, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.12% 0.12% 0.12%", "qwen": "0.25% 0.25% 0.25%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9806281328201294]], "qwen": [[315, " of", "normal", 0.9587160348892212]]}, "loss": {"rwkv": 0.11740682298901069, "qwen": 0.25343560494597595}, "topk": {"rwkv": [4706, 1, 0.9806281328201294, [[4706, 0.980628, " of", false], [45, 0.004248, ",", false], [47, 0.002026, ".", false], [4596, 0.001685, " in", false], [22762, 0.001408, " who", false], [59324, 0.001187, " community", false], [38013, 0.001015, " chess", false], [3609, 0.000869, " AI", false], [52367, 0.000761, " opinion", false], [275, 0.000644, " (", false]]], "qwen": [315, 1, 0.9587160348892212, [[315, 0.958716, " of", false], [11, 0.014388, ",", false], [13, 0.005598, ".", false], [879, 0.003266, " who", false], [320, 0.002792, " (", false], [304, 0.001867, " in", false], [9459, 0.00135, " opinion", false], [1576, 0.001321, " because", false], [25, 0.000955, ":", false], [438, 0.000939, " as", false]]]}, "raw_delta": -0.007543037335077922, "tuned_delta": 0.0010287546955003264}, {"byte_start": 1582, "byte_end": 1591, "display": {"text": " computer", "kind": "normal"}, "is_word": true, "word_id": 269, "word_key": " computer", "bytes_hex": "20 63 6f 6d 70 75 74 65 72", "compression": {"rwkv": "4.73% 4.73% 4.73% 4.73% 4.73% 4.73% 4.73% 4.73% 4.73%", "qwen": "4.84% 4.84% 4.84% 4.84% 4.84% 4.84% 4.84% 4.84% 4.84%"}, "model_tokens": {"rwkv": [[55809, " computer", "normal", 0.09370432049036026]], "qwen": [[6366, " computer", "normal", 0.08924874663352966]]}, "loss": {"rwkv": 4.727581405690829, "qwen": 4.841700493670846}, "topk": {"rwkv": [55809, 4, 0.09370432049036026, [[3609, 0.243718, " AI", false], [38013, 0.221257, " chess", false], [22590, 0.216489, " the", false], [55809, 0.093704, " computer", false], [63843, 0.072572, " researchers", false], [46787, 0.022371, " people", false], [51685, 0.015295, " experts", false], [38720, 0.01309, " human", false], [52489, 0.010965, " players", false], [39944, 0.008059, " those", false]]], "qwen": [6366, 4, 0.08924874663352966, [[32719, 0.430236, " chess", false], [279, 0.177072, " the", false], [11811, 0.107766, " researchers", false], [6366, 0.089249, " computer", false], [15235, 0.059845, " AI", false], [1251, 0.017006, " people", false], [3738, 0.011981, " human", false], [11647, 0.009664, " experts", false], [1846, 0.007894, " those", false], [3412, 0.007429, " research", false]]]}, "raw_delta": -0.006328105926513672, "tuned_delta": 0.0022436861040645763}, {"byte_start": 1591, "byte_end": 1597, "display": {"text": "-chess", "kind": "normal"}, "is_word": true, "word_id": 270, "word_key": "-chess", "bytes_hex": "2d 63 68 65 73 73", "compression": {"rwkv": "55.79% 8.28% 8.28% 8.28% 8.28% 0.03%", "qwen": "22.36% 22.36% 22.36% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.04488632455468178], [24991, "ches", "normal", 0.15904244780540466], [116, "s", "normal", 0.9983900785446167]], "qwen": [[11582, "-ch", "normal", 0.02424108237028122], [433, "ess", "normal", 0.9995290040969849]]}, "loss": {"rwkv": 14.821625368497653, "qwen": 11.181420540360765}, "topk": {"rwkv": [46, 3, 0.04488632455468178, [[38013, 0.620857, " chess", false], [62532, 0.155146, " scientists", false], [46, 0.044886, "-", false], [51685, 0.036822, " experts", false], [52489, 0.027644, " players", false], [63794, 0.026189, " programmers", false], [52814, 0.023006, " science", false], [63843, 0.012672, " researchers", false], [3609, 0.006459, " AI", false], [30941, 0.003699, " game", false]]], "qwen": [11582, 4, 0.02424108237028122, [[13923, 0.414545, " scientists", false], [32719, 0.39622, " chess", false], [8038, 0.050103, " science", false], [11582, 0.024241, "-ch", false], [54846, 0.019488, " programmers", false], [4217, 0.016435, " players", false], [11811, 0.016364, " researchers", false], [27468, 0.007223, " scientist", false], [11129, 0.006301, " vision", false], [11647, 0.003527, " experts", false]]]}, "raw_delta": 0.20185581706270259, "tuned_delta": 0.21042760909328084}, {"byte_start": 1597, "byte_end": 1609, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 271, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"rwkv": "0.37% 0.37% 0.37% 0.37% 0.37% 0.37% 0.37% 0.37% 0.37% 0.37% 0.37% 0.37%", "qwen": "0.84% 0.84% 0.84% 0.84% 0.84% 0.84% 0.84% 0.84% 0.84% 0.84% 0.84% 0.84%"}, "model_tokens": {"rwkv": [[63843, " researchers", "normal", 0.7792559862136841]], "qwen": [[11811, " researchers", "normal", 0.5727719068527222]]}, "loss": {"rwkv": 0.37129907770274634, "qwen": 0.8374660249788509}, "topk": {"rwkv": [63843, 1, 0.7792559862136841, [[63843, 0.779256, " researchers", false], [51685, 0.079981, " experts", false], [52489, 0.038938, " players", false], [63533, 0.015383, " enthusiasts", false], [64985, 0.010136, " practitioners", false], [57103, 0.008909, " research", false], [46, 0.007441, "-", false], [46787, 0.007054, " people", false], [63874, 0.005711, " specialists", false], [30819, 0.003354, " fans", false]]], "qwen": [11811, 1, 0.5727719068527222, [[11811, 0.572772, " researchers", false], [4217, 0.101854, " players", false], [11647, 0.098618, " experts", false], [54846, 0.034473, " programmers", false], [42348, 0.030855, " enthusiasts", false], [72085, 0.026601, "-playing", false], [3412, 0.015379, " research", false], [82962, 0.012889, " theorists", false], [15387, 0.006701, " professionals", false], [42095, 0.006361, " practitioners", false]]]}, "raw_delta": -0.02584978441397349, "tuned_delta": -0.017277992383395245}, {"byte_start": 1609, "byte_end": 1613, "display": {"text": " who", "kind": "normal"}, "is_word": true, "word_id": 272, "word_key": " who", "bytes_hex": "20 77 68 6f", "compression": {"rwkv": "12.89% 12.89% 12.89% 12.89%", "qwen": "11.10% 11.10% 11.10% 11.10%"}, "model_tokens": {"rwkv": [[22762, " who", "normal", 0.05782460421323776]], "qwen": [[879, " who", "normal", 0.08526797592639923]]}, "loss": {"rwkv": 12.891269164193373, "qwen": 11.099538859022683}, "topk": {"rwkv": [22762, 3, 0.05782460421323776, [[45, 0.493104, ",", false], [47, 0.262916, ".", false], [22762, 0.057825, " who", false], [4423, 0.048434, " as", false], [51018, 0.044163, " because", false], [275, 0.017412, " (", false], [59, 0.014396, ":", false], [60, 0.013908, ";", false], [21265, 0.011592, " and", false], [4596, 0.007335, " in", false]]], "qwen": [879, 3, 0.08526797592639923, [[11, 0.460601, ",", false], [13, 0.243955, ".", false], [879, 0.085268, " who", false], [1576, 0.048636, " because", false], [320, 0.030388, " (", false], [323, 0.02917, " and", false], [25, 0.018105, ":", false], [438, 0.018057, " as", false], [26, 0.015047, ";", false], [2474, 0.005002, " since", false]]]}, "raw_delta": 0.09935462474822998, "tuned_delta": 0.10792641677880822}, {"byte_start": 1613, "byte_end": 1617, "display": {"text": " had", "kind": "normal"}, "is_word": true, "word_id": 273, "word_key": " had", "bytes_hex": "20 68 61 64", "compression": {"rwkv": "8.81% 8.81% 8.81% 8.81%", "qwen": "6.76% 6.76% 6.76% 6.76%"}, "model_tokens": {"rwkv": [[21795, " had", "normal", 0.14216969907283783]], "qwen": [[1030, " had", "normal", 0.2232958972454071]]}, "loss": {"rwkv": 8.805511724175801, "qwen": 6.759285254378814}, "topk": {"rwkv": [21795, 1, 0.14216969907283783, [[21795, 0.14217, " had", false], [55616, 0.139973, " believed", false], [32462, 0.124577, " were", false], [53137, 0.103935, " thought", false], [30840, 0.040844, " felt", false], [22439, 0.028225, " saw", false], [60227, 0.02457, " preferred", false], [45, 0.021214, ",", false], [56175, 0.017539, " expected", false], [39820, 0.015485, " still", false]]], "qwen": [1030, 1, 0.2232958972454071, [[1030, 0.223296, " had", false], [1033, 0.171908, " were", false], [11585, 0.130731, " believed", false], [3381, 0.049534, " thought", false], [14890, 0.037662, " preferred", false], [11, 0.028434, ",", false], [6476, 0.017256, " felt", false], [4829, 0.015278, " wanted", false], [45503, 0.012905, " favored", false], [4518, 0.011503, " instead", false]]]}, "raw_delta": 0.11346688866615295, "tuned_delta": 0.1220386806967312}, {"byte_start": 1617, "byte_end": 1625, "display": {"text": " pursued", "kind": "normal"}, "is_word": true, "word_id": 274, "word_key": " pursued", "bytes_hex": "20 70 75 72 73 75 65 64", "compression": {"rwkv": "13.10% 13.10% 13.10% 13.10% 13.10% 13.10% 13.10% 13.10%", "qwen": "11.11% 11.11% 11.11% 11.11% 11.11% 11.11% 11.11% 11.11%"}, "model_tokens": {"rwkv": [[52611, " pursued", "normal", 0.002957211807370186]], "qwen": [[45431, " pursued", "normal", 0.007243321277201176]]}, "loss": {"rwkv": 13.102601445573592, "qwen": 11.108019753493355}, "topk": {"rwkv": [52611, 46, 0.002957211807370186, [[30259, 0.249961, " been", false], [39762, 0.085795, " spent", false], [62367, 0.072542, " previously", false], [30482, 0.02922, " come", false], [55616, 0.024881, " believed", false], [47812, 0.024567, " worked", false], [56495, 0.023266, " invested", false], [53137, 0.020698, " thought", false], [22187, 0.017016, " not", false], [38709, 0.015475, " hoped", false]]], "qwen": [45431, 21, 0.007243321277201176, [[1012, 0.228198, " been", false], [7391, 0.173035, " spent", false], [27991, 0.042318, " invested", false], [10735, 0.036404, " focused", false], [8597, 0.023174, " previously", false], [7881, 0.022822, " developed", false], [6439, 0.019705, " worked", false], [11585, 0.019437, " believed", false], [6679, 0.016472, " tried", false], [28229, 0.013101, " devoted", false]]]}, "raw_delta": 0.11060309410095215, "tuned_delta": 0.11917488613153039}, {"byte_start": 1625, "byte_end": 1633, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 275, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "5.95% 5.95% 5.95% 5.95% 5.95% 5.95% 5.95% 5.95%", "qwen": "5.07% 5.07% 5.07% 5.07% 5.07% 5.07% 5.07% 5.07%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.07155764102935791]], "qwen": [[5413, " methods", "normal", 0.10562748461961746]]}, "loss": {"rwkv": 5.952525925542842, "qwen": 5.067097970081733}, "topk": {"rwkv": [52224, 4, 0.07155764102935791, [[22590, 0.188231, " the", false], [332, 0.132115, " a", false], [39193, 0.079462, " other", false], [52224, 0.071558, " methods", false], [31458, 0.042285, " more", false], [63277, 0.028887, " alternative", false], [4419, 0.024123, " an", false], [38720, 0.017514, " human", false], [47202, 0.014367, " search", false], [53265, 0.012634, " various", false]]], "qwen": [5413, 2, 0.10562748461961746, [[264, 0.154715, " a", false], [5413, 0.105627, " methods", false], [279, 0.101364, " the", false], [1008, 0.059124, " other", false], [458, 0.029129, " an", false], [803, 0.02519, " more", false], [2155, 0.020887, " different", false], [25600, 0.016323, " shallow", false], [10555, 0.016134, " alternative", false], [1128, 0.016059, " what", false]]]}, "raw_delta": 0.04909855127334595, "tuned_delta": 0.0576703433039242}, {"byte_start": 1633, "byte_end": 1638, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 276, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "4.93% 4.93% 4.93% 4.93% 4.93%", "qwen": "4.99% 4.99% 4.99% 4.99% 4.99%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.25757429003715515]], "qwen": [[429, " that", "normal", 0.25049540400505066]]}, "loss": {"rwkv": 4.931086565538449, "qwen": 4.992860153988606}, "topk": {"rwkv": [32227, 2, 0.25757429003715515, [[37810, 0.371391, " based", false], [32227, 0.257574, " that", false], [4706, 0.072435, " of", false], [59927, 0.030102, " involving", false], [21700, 0.021525, " for", false], [52700, 0.018955, " relying", false], [31296, 0.01863, " like", false], [38888, 0.018359, " lever", false], [4596, 0.017246, " in", false], [32139, 0.016944, " such", false]]], "qwen": [429, 2, 0.25049540400505066, [[3118, 0.496231, " based", false], [429, 0.250495, " that", false], [315, 0.041951, " of", false], [38561, 0.014541, " relying", false], [1667, 0.012073, " using", false], [14606, 0.011522, " inspired", false], [448, 0.009377, " with", false], [369, 0.008967, " for", false], [803, 0.008254, " more", false], [311, 0.007694, " to", false]]]}, "raw_delta": -0.003425455093383767, "tuned_delta": 0.005146336937194481}, {"byte_start": 1638, "byte_end": 1648, "display": {"text": " leveraged", "kind": "normal"}, "is_word": true, "word_id": 277, "word_key": " leveraged", "bytes_hex": "20 6c 65 76 65 72 61 67 65 64", "compression": {"rwkv": "4.23% 4.23% 4.23% 4.23% 4.23% 4.23% 4.23% 4.23% 4.23% 0.26%", "qwen": "8.38% 8.38% 8.38% 8.38% 8.38% 8.38% 0.00% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[56540, " leverage", "normal", 0.12110395729541779], [101, "d", "normal", 0.9858278036117554]], "qwen": [[27505, " lever", "normal", 0.06148497387766838], [3279, "aged", "normal", 0.9993828535079956]]}, "loss": {"rwkv": 3.8298472555337124, "qwen": 5.030640959058762}, "topk": {"rwkv": [56540, 2, 0.12110395729541779, [[32462, 0.139173, " were", false], [56540, 0.121104, " leverage", false], [47054, 0.084049, " relied", false], [32354, 0.059584, " used", false], [56500, 0.033754, " involved", false], [59685, 0.027754, " exploited", false], [21532, 0.027139, " did", false], [31351, 0.024597, " made", false], [40219, 0.021734, " would", false], [47340, 0.020651, " sought", false]]], "qwen": [27505, 3, 0.06148497387766838, [[39913, 0.185761, " relied", false], [1033, 0.15033, " were", false], [27505, 0.061485, " lever", false], [1483, 0.056543, " used", false], [50663, 0.024234, " exploited", false], [6398, 0.024042, " involved", false], [32064, 0.021802, " leverage", false], [1030, 0.017015, " had", false], [6966, 0.014276, " looked", false], [10735, 0.013199, " focused", false]]]}, "raw_delta": -0.06658614160260186, "tuned_delta": -0.05801434957202361}, {"byte_start": 1648, "byte_end": 1654, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 278, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "1.54% 1.54% 1.54% 1.54% 1.54% 1.54%", "qwen": "1.39% 1.39% 1.39% 1.39% 1.39% 1.39%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.5997323393821716]], "qwen": [[3738, " human", "normal", 0.6296586990356445]]}, "loss": {"rwkv": 1.53802938115604, "qwen": 1.3903292474063027}, "topk": {"rwkv": [38720, 1, 0.5997323393821716, [[38720, 0.599732, " human", false], [59943, 0.064163, " knowledge", false], [22590, 0.057836, " the", false], [39931, 0.05362, " their", false], [45775, 0.020474, " domain", false], [51832, 0.015236, " general", false], [332, 0.013627, " a", false], [38013, 0.009546, " chess", false], [55809, 0.009065, " computer", false], [59792, 0.007936, " heuristic", false]]], "qwen": [3738, 1, 0.6296586990356445, [[3738, 0.629659, " human", false], [6540, 0.071354, " knowledge", false], [279, 0.045133, " the", false], [862, 0.042105, " their", false], [264, 0.014281, " a", false], [32719, 0.011978, " chess", false], [7947, 0.010835, " domain", false], [803, 0.007386, " more", false], [1172, 0.005906, " only", false], [4586, 0.005699, " general", false]]]}, "raw_delta": 0.008190234502156571, "tuned_delta": 0.01676202653273482}, {"byte_start": 1654, "byte_end": 1668, "display": {"text": " understanding", "kind": "normal"}, "is_word": true, "word_id": 279, "word_key": " understanding", "bytes_hex": "20 75 6e 64 65 72 73 74 61 6e 64 69 6e 67", "compression": {"rwkv": "6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68%", "qwen": "7.90% 7.90% 7.90% 7.90% 7.90% 7.90% 7.90% 7.90% 7.90% 7.90% 7.90% 7.90% 7.90% 7.90%"}, "model_tokens": {"rwkv": [[65034, " understanding", "normal", 0.0055396584793925285]], "qwen": [[8660, " understanding", "normal", 0.0021649186965078115]]}, "loss": {"rwkv": 6.6821254684031235, "qwen": 7.903099714162297}, "topk": {"rwkv": [65034, 5, 0.0055396584793925285, [[59943, 0.883994, " knowledge", false], [59683, 0.025255, " expertise", false], [46, 0.022538, "-", false], [38013, 0.013486, " chess", false], [65034, 0.00554, " understanding", false], [59917, 0.003281, " intuition", false], [62418, 0.003033, " psychology", false], [52022, 0.002299, " insight", false], [45929, 0.00215, " expert", false], [45775, 0.00209, " domain", false]]], "qwen": [8660, 9, 0.0021649186965078115, [[6540, 0.831445, " knowledge", false], [12646, 0.055003, "-k", false], [18726, 0.026358, " expertise", false], [32719, 0.025361, " chess", false], [6203, 0.004151, " expert", false], [7947, 0.004118, " domain", false], [56251, 0.003225, " intuition", false], [3139, 0.002364, " experience", false], [8660, 0.002165, " understanding", false], [6358, 0.001524, " analysis", false]]]}, "raw_delta": -0.0677051884787423, "tuned_delta": -0.059133396448164045}, {"byte_start": 1668, "byte_end": 1671, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 280, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "3.71% 3.71% 3.71%", "qwen": "2.64% 2.64% 2.64%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.5453326106071472]], "qwen": [[315, " of", "normal", 0.6447494029998779]]}, "loss": {"rwkv": 3.7100556064527375, "qwen": 2.63829000238821}, "topk": {"rwkv": [4706, 1, 0.5453326106071472, [[4706, 0.545333, " of", false], [47, 0.215073, ".", false], [45, 0.072792, ",", false], [21265, 0.057871, " and", false], [275, 0.021519, " (", false], [4596, 0.017123, " in", false], [4811, 0.01344, " to", false], [4715, 0.00484, " or", false], [59, 0.004384, ":", false], [47001, 0.003393, " rather", false]]], "qwen": [315, 1, 0.6447494029998779, [[315, 0.644749, " of", false], [13, 0.137459, ".", false], [11, 0.060294, ",", false], [323, 0.028427, " and", false], [320, 0.027727, " (", false], [311, 0.01483, " to", false], [304, 0.013108, " in", false], [4751, 0.007219, " rather", false], [553, 0.005149, " by", false], [803, 0.005016, " more", false]]]}, "raw_delta": 0.05943130453427631, "tuned_delta": 0.06800309656485455}, {"byte_start": 1671, "byte_end": 1675, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 281, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "2.02% 2.02% 2.02% 2.02%", "qwen": "2.04% 2.04% 2.04% 2.04%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.6395004987716675]], "qwen": [[279, " the", "normal", 0.6357907056808472]]}, "loss": {"rwkv": 2.0164621848362585, "qwen": 2.041800469404744}, "topk": {"rwkv": [22590, 1, 0.6395004987716675, [[22590, 0.6395, " the", false], [38013, 0.250885, " chess", false], [30941, 0.013298, " game", false], [38576, 0.009768, " games", false], [21835, 0.008793, " how", false], [57317, 0.005117, " strategy", false], [31702, 0.00386, " play", false], [32464, 0.003629, " what", false], [39072, 0.003538, " moves", false], [60563, 0.003109, " strategic", false]]], "qwen": [279, 1, 0.6357907056808472, [[279, 0.635791, " the", false], [32719, 0.282524, " chess", false], [1246, 0.015043, " how", false], [1809, 0.006775, " game", false], [1128, 0.003794, " what", false], [3868, 0.003788, " games", false], [4479, 0.00322, " board", false], [264, 0.002583, " a", false], [9892, 0.002425, " positions", false], [2309, 0.002364, " position", false]]]}, "raw_delta": -0.0014050528407096863, "tuned_delta": 0.007166739189868562}, {"byte_start": 1675, "byte_end": 1683, "display": {"text": " special", "kind": "normal"}, "is_word": true, "word_id": 282, "word_key": " special", "bytes_hex": "20 73 70 65 63 69 61 6c", "compression": {"rwkv": "22.96% 22.96% 22.96% 22.96% 22.96% 22.96% 22.96% 22.96%", "qwen": "21.71% 21.71% 21.71% 21.71% 21.71% 21.71% 21.71% 21.71%"}, "model_tokens": {"rwkv": [[52964, " special", "normal", 3.7776739191031083e-05]], "qwen": [[3281, " special", "normal", 6.576983287231997e-05]]}, "loss": {"rwkv": 22.96477457665049, "qwen": 21.706583899468352}, "topk": {"rwkv": [52964, 207, 3.7776739191031083e-05, [[30941, 0.776871, " game", false], [45775, 0.113485, " domain", false], [38013, 0.020491, " chess", false], [39558, 0.008626, " rules", false], [56893, 0.007699, " position", false], [37876, 0.006084, " board", false], [52569, 0.005186, " problem", false], [60572, 0.003166, " structure", false], [46642, 0.003003, " nature", false], [60563, 0.002563, " strategic", false]]], "qwen": [3281, 153, 6.576983287231997e-05, [[1809, 0.705544, " game", false], [7947, 0.075646, " domain", false], [32719, 0.062908, " chess", false], [5601, 0.027749, " rules", false], [4479, 0.024367, " board", false], [3491, 0.019437, " problem", false], [3868, 0.008428, " games", false], [2309, 0.006874, " position", false], [9666, 0.005155, " pieces", false], [16170, 0.003218, " principles", false]]]}, "raw_delta": 0.06976890563964844, "tuned_delta": 0.07834069767022668}, {"byte_start": 1683, "byte_end": 1693, "display": {"text": " structure", "kind": "normal"}, "is_word": true, "word_id": 283, "word_key": " structure", "bytes_hex": "20 73 74 72 75 63 74 75 72 65", "compression": {"rwkv": "3.16% 3.16% 3.16% 3.16% 3.16% 3.16% 3.16% 3.16% 3.16% 3.16%", "qwen": "4.73% 4.73% 4.73% 4.73% 4.73% 4.73% 4.73% 4.73% 4.73% 4.73%"}, "model_tokens": {"rwkv": [[60572, " structure", "normal", 0.17478929460048676]], "qwen": [[5944, " structure", "normal", 0.07244773954153061]]}, "loss": {"rwkv": 3.1558954019446075, "qwen": 4.733644462955164}, "topk": {"rwkv": [60572, 2, 0.17478929460048676, [[56215, 0.198867, " features", false], [60572, 0.174789, " structure", false], [62404, 0.108107, " properties", false], [65258, 0.088162, " characteristics", false], [46642, 0.078605, " nature", false], [30405, 0.046773, " case", false], [50964, 0.030504, " aspects", false], [39558, 0.022449, " rules", false], [64847, 0.014595, " circumstances", false], [59943, 0.014528, " knowledge", false]]], "qwen": [5944, 3, 0.07244773954153061, [[4419, 0.226434, " features", false], [5888, 0.196031, " properties", false], [5944, 0.072448, " structure", false], [17452, 0.046335, " characteristics", false], [6540, 0.043927, " knowledge", false], [1361, 0.035753, "ities", false], [13566, 0.027856, " aspects", false], [5601, 0.0259, " rules", false], [32719, 0.025622, " chess", false], [6993, 0.019552, " nature", false]]]}, "raw_delta": -0.08748898506164555, "tuned_delta": -0.07891719303106731}, {"byte_start": 1693, "byte_end": 1696, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 284, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.54% 0.54% 0.54%", "qwen": "0.28% 0.28% 0.28%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9133241176605225]], "qwen": [[315, " of", "normal", 0.9550149440765381]]}, "loss": {"rwkv": 0.5430065563241744, "qwen": 0.2766864276960394}, "topk": {"rwkv": [4706, 1, 0.9133241176605225, [[4706, 0.913324, " of", false], [21265, 0.05389, " and", false], [32227, 0.007661, " that", false], [4596, 0.007532, " in", false], [45, 0.002641, ",", false], [275, 0.001931, " (", false], [52544, 0.001214, " present", false], [4715, 0.000954, " or", false], [56454, 0.000948, " inherent", false], [56500, 0.00066, " involved", false]]], "qwen": [315, 1, 0.9550149440765381, [[315, 0.955015, " of", false], [323, 0.013298, " and", false], [304, 0.010245, " in", false], [429, 0.003382, " that", false], [16533, 0.002991, " underlying", false], [36988, 0.001696, " inherent", false], [3042, 0.001604, " present", false], [320, 0.001567, " (", false], [11, 0.001048, ",", false], [807, 0.000631, " they", false]]]}, "raw_delta": 0.0147679237027963, "tuned_delta": 0.02333971573337455}, {"byte_start": 1696, "byte_end": 1702, "display": {"text": " chess", "kind": "normal"}, "is_word": true, "word_id": 285, "word_key": " chess", "bytes_hex": "20 63 68 65 73 73", "compression": {"rwkv": "2.62% 2.62% 2.62% 2.62% 2.62% 2.62%", "qwen": "1.21% 1.21% 1.21% 1.21% 1.21% 1.21%"}, "model_tokens": {"rwkv": [[38013, " chess", "normal", 0.4181702733039856]], "qwen": [[32719, " chess", "normal", 0.6691892147064209]]}, "loss": {"rwkv": 2.618172152654938, "qwen": 1.2073206275629442}, "topk": {"rwkv": [38013, 2, 0.4181702733039856, [[22590, 0.476079, " the", false], [38013, 0.41817, " chess", false], [332, 0.012555, " a", false], [37876, 0.011526, " board", false], [32234, 0.01071, " this", false], [38576, 0.009492, " games", false], [32227, 0.005553, " that", false], [55809, 0.003802, " computer", false], [60202, 0.002747, " positions", false], [30941, 0.002439, " game", false]]], "qwen": [32719, 1, 0.6691892147064209, [[32719, 0.669189, " chess", false], [279, 0.276381, " the", false], [3868, 0.006729, " games", false], [264, 0.006351, " a", false], [419, 0.005637, " this", false], [1779, 0.005631, " check", false], [6366, 0.003659, " computer", false], [5994, 0.001782, " Go", false], [4479, 0.001778, " board", false], [47387, 0.001769, " Chess", false]]]}, "raw_delta": 0.07823422054449715, "tuned_delta": 0.08680601257507539}, {"byte_start": 1702, "byte_end": 1703, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "15.92%", "qwen": "14.68%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.4152854382991791]], "qwen": [[13, ".", "normal", 0.44312065839767456]]}, "loss": {"rwkv": 15.920365197309849, "qwen": 14.677857188103266}, "topk": {"rwkv": [47, 1, 0.4152854382991791, [[47, 0.415285, ".", false], [45, 0.138868, ",", false], [275, 0.060483, " (", false], [60202, 0.059551, " positions", false], [21265, 0.052644, " and", false], [4423, 0.038024, " as", false], [38576, 0.034104, " games", false], [56939, 0.02069, " problems", false], [4811, 0.015186, " to", false], [52616, 0.013291, " puzzles", false]]], "qwen": [13, 1, 0.44312065839767456, [[13, 0.443121, ".", false], [11, 0.128804, ",", false], [320, 0.080235, " (", false], [311, 0.048823, " to", false], [9892, 0.044417, " positions", false], [323, 0.028027, " and", false], [4751, 0.018054, " rather", false], [304, 0.017365, " in", false], [5322, 0.014898, " problems", false], [382, 0.010414, ".\n\n", false]]]}, "raw_delta": 0.06889927387237549, "tuned_delta": 0.07747106590295373}, {"byte_start": 1703, "byte_end": 1708, "display": {"text": " When", "kind": "normal"}, "is_word": true, "word_id": 286, "word_key": " when", "bytes_hex": "20 57 68 65 6e", "compression": {"rwkv": "17.92% 17.92% 17.92% 17.92% 17.92%", "qwen": "17.97% 17.97% 17.97% 17.97% 17.97%"}, "model_tokens": {"rwkv": [[30032, " When", "normal", 0.007001301273703575]], "qwen": [[3197, " When", "normal", 0.00685387896373868]]}, "loss": {"rwkv": 17.92097746104259, "qwen": 17.972159497939362}, "topk": {"rwkv": [30032, 27, 0.007001301273703575, [[20996, 0.146973, " The", false], [19555, 0.095088, " But", false], [3913, 0.06269, " In", false], [29894, 0.038998, " This", false], [3918, 0.035124, " It", false], [267, 0.033548, "  ", false], [37453, 0.028921, " These", false], [29893, 0.026198, " They", false], [275, 0.022298, " (", false], [50318, 0.022143, " However", false]]], "qwen": [3197, 26, 0.00685387896373868, [[576, 0.144867, " The", false], [220, 0.068299, " ", false], [4220, 0.058249, " These", false], [2379, 0.047176, " They", false], [758, 0.044735, " In", false], [1096, 0.041127, " This", false], [1084, 0.033302, " It", false], [1988, 0.029506, " But", false], [47387, 0.023685, " Chess", false], [10964, 0.023642, " Their", false]]]}, "raw_delta": -0.002838134765625, "tuned_delta": 0.005733657264953248}, {"byte_start": 1708, "byte_end": 1710, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 287, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "30.57% 30.57%", "qwen": "28.05% 28.05%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.033543530851602554]], "qwen": [[264, " a", "normal", 0.04458407685160637]]}, "loss": {"rwkv": 30.572736706338382, "qwen": 28.04579776699427}, "topk": {"rwkv": [332, 5, 0.033543530851602554, [[22590, 0.200279, " the", false], [20184, 0.119217, " Kas", false], [28753, 0.053023, " Deep", false], [4601, 0.051405, " it", false], [332, 0.033544, " a", false], [39936, 0.026697, " these", false], [36274, 0.025618, " Alpha", false], [39944, 0.02499, " those", false], [32234, 0.021867, " this", false], [32227, 0.018636, " that", false]]], "qwen": [264, 4, 0.04458407685160637, [[279, 0.201523, " the", false], [18183, 0.087553, " Deep", false], [358, 0.055487, " I", false], [264, 0.044584, " a", false], [37542, 0.044462, " Kas", false], [807, 0.039931, " they", false], [1493, 0.030735, " these", false], [32719, 0.020001, " chess", false], [5538, 0.01991, " deep", false], [419, 0.019768, " this", false]]]}, "raw_delta": 0.14012324810028076, "tuned_delta": 0.14869504013085902}, {"byte_start": 1710, "byte_end": 1718, "display": {"text": " simpler", "kind": "normal"}, "is_word": true, "word_id": 288, "word_key": " simpler", "bytes_hex": "20 73 69 6d 70 6c 65 72", "compression": {"rwkv": "15.08% 15.08% 15.08% 15.08% 15.08% 15.08% 15.08% 15.08%", "qwen": "19.53% 19.53% 19.53% 19.53% 19.53% 19.53% 19.53% 19.53%"}, "model_tokens": {"rwkv": [[52907, " simpler", "normal", 0.0012639120686799288]], "qwen": [[34288, " simpler", "normal", 0.00017262586334254593]]}, "loss": {"rwkv": 15.075036071788972, "qwen": 19.531349481138687}, "topk": {"rwkv": [52907, 83, 0.0012639120686799288, [[55809, 0.076037, " computer", false], [46561, 0.075533, " method", false], [52167, 0.063921, " machine", false], [38013, 0.061223, " chess", false], [38720, 0.060972, " human", false], [30597, 0.060776, " deep", false], [52580, 0.052468, " program", false], [51832, 0.038626, " general", false], [22168, 0.034404, " new", false], [47202, 0.027246, " search", false]]], "qwen": [34288, 364, 0.00017262586334254593, [[6366, 0.117928, " computer", false], [1714, 0.09407, " method", false], [32719, 0.084993, " chess", false], [3738, 0.071491, " human", false], [501, 0.042914, " new", false], [5538, 0.034239, " deep", false], [2025, 0.027557, " program", false], [6662, 0.022282, " grand", false], [1879, 0.015855, " world", false], [1849, 0.014348, " system", false]]]}, "raw_delta": -0.2471104860305786, "tuned_delta": -0.23853869400000036}, {"byte_start": 1718, "byte_end": 1719, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "33.25%", "qwen": "39.88%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.15707261860370636]], "qwen": [[11, ",", "normal", 0.10952530801296234]]}, "loss": {"rwkv": 33.24961227048782, "qwen": 39.88329698260418}, "topk": {"rwkv": [45, 2, 0.15707261860370636, [[46561, 0.473748, " method", false], [45, 0.157073, ",", false], [55532, 0.071119, " approach", false], [47202, 0.038367, " search", false], [21265, 0.029981, " and", false], [51832, 0.021128, " general", false], [21400, 0.014595, " but", false], [53275, 0.01257, " version", false], [47487, 0.011231, " system", false], [30597, 0.009506, " deep", false]]], "qwen": [11, 3, 0.10952530801296234, [[1714, 0.446108, " method", false], [5486, 0.126378, " approach", false], [11, 0.109525, ",", false], [12111, 0.029682, " algorithm", false], [323, 0.02904, " and", false], [2711, 0.021826, " search", false], [714, 0.018789, " but", false], [1849, 0.016111, " system", false], [2025, 0.013475, " program", false], [2319, 0.012094, " version", false]]]}, "raw_delta": -0.36784958839416504, "tuned_delta": -0.3592777963635868}, {"byte_start": 1719, "byte_end": 1726, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 289, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "12.00% 12.00% 12.00% 12.00% 12.00% 12.00% 12.00%", "qwen": "12.96% 12.96% 12.96% 12.96% 12.96% 12.96% 12.96%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.009499076753854752]], "qwen": [[2711, " search", "normal", 0.0065371133387088776]]}, "loss": {"rwkv": 11.99562282882006, "qwen": 12.95916177251648}, "topk": {"rwkv": [47202, 16, 0.009499076753854752, [[31458, 0.185807, " more", false], [38720, 0.093854, " human", false], [51832, 0.084545, " general", false], [31277, 0.073223, " less", false], [21400, 0.064149, " but", false], [45961, 0.045475, " faster", false], [52873, 0.028926, " shallow", false], [45301, 0.019571, " better", false], [45683, 0.018277, " deeper", false], [37920, 0.01491, " brute", false]]], "qwen": [2711, 21, 0.0065371133387088776, [[2686, 0.149039, " less", false], [803, 0.129059, " more", false], [3738, 0.076043, " human", false], [714, 0.072923, " but", false], [10596, 0.04321, " faster", false], [25600, 0.020209, " shallow", false], [19117, 0.019998, " deeper", false], [4586, 0.017421, " general", false], [5538, 0.015501, " deep", false], [2477, 0.013525, " non", false]]]}, "raw_delta": -0.05342994417463032, "tuned_delta": -0.04485815214405207}, {"byte_start": 1726, "byte_end": 1732, "display": {"text": "-based", "kind": "normal"}, "is_word": true, "word_id": 290, "word_key": "-based", "bytes_hex": "2d 62 61 73 65 64", "compression": {"rwkv": "0.74% 0.96% 0.96% 0.96% 0.96% 0.96%", "qwen": "3.60% 3.60% 3.60% 3.60% 3.60% 3.60%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.9595441222190857], [34011, "based", "normal", 0.7661516070365906]], "qwen": [[5980, "-based", "normal", 0.3017718195915222]]}, "loss": {"rwkv": 0.9223773531074152, "qwen": 3.600979193114894}, "topk": {"rwkv": [46, 1, 0.9595441222190857, [[46, 0.959544, "-", false], [37810, 0.006754, " based", false], [46561, 0.006426, " method", false], [26127, 0.005095, "less", false], [35003, 0.002918, "light", false], [45862, 0.001671, " engine", false], [34011, 0.001429, "based", false], [31277, 0.00105, " less", false], [32298, 0.001029, " tree", false], [55532, 0.001023, " approach", false]]], "qwen": [5980, 1, 0.3017718195915222, [[5980, 0.301772, "-based", false], [1717, 0.245659, "less", false], [12577, 0.082205, "-free", false], [54909, 0.076161, "-less", false], [12, 0.033105, "-", false], [2852, 0.026122, "-l", false], [3419, 0.017647, "-in", false], [6810, 0.01748, "-de", false], [17709, 0.015087, "-light", false], [18376, 0.013742, "-exp", false]]]}, "raw_delta": -0.1485332250595093, "tuned_delta": -0.13996143302893105}, {"byte_start": 1732, "byte_end": 1741, "display": {"text": " approach", "kind": "normal"}, "is_word": true, "word_id": 291, "word_key": " approach", "bytes_hex": "20 61 70 70 72 6f 61 63 68", "compression": {"rwkv": "3.08% 3.08% 3.08% 3.08% 3.08% 3.08% 3.08% 3.08% 3.08%", "qwen": "2.77% 2.77% 2.77% 2.77% 2.77% 2.77% 2.77% 2.77% 2.77%"}, "model_tokens": {"rwkv": [[55532, " approach", "normal", 0.21413181722164154]], "qwen": [[5486, " approach", "normal", 0.2512800395488739]]}, "loss": {"rwkv": 3.0838858838446805, "qwen": 2.7675443399547306}, "topk": {"rwkv": [55532, 2, 0.21413181722164154, [[46561, 0.566179, " method", false], [55532, 0.214132, " approach", false], [47487, 0.037443, " system", false], [52580, 0.021893, " program", false], [45, 0.020486, ",", false], [57260, 0.017414, " solution", false], [3609, 0.01615, " AI", false], [38013, 0.01427, " chess", false], [55809, 0.011896, " computer", false], [59113, 0.00571, " algorithm", false]]], "qwen": [5486, 2, 0.2512800395488739, [[1714, 0.624797, " method", false], [5486, 0.25128, " approach", false], [1849, 0.044035, " system", false], [2025, 0.013728, " program", false], [11, 0.01117, ",", false], [14762, 0.006686, " technique", false], [12111, 0.005863, " algorithm", false], [6291, 0.003235, " solution", false], [8282, 0.003155, " strategy", false], [6366, 0.002419, " computer", false]]]}, "raw_delta": 0.017541699939303934, "tuned_delta": 0.026113491969882184}, {"byte_start": 1741, "byte_end": 1746, "display": {"text": " with", "kind": "normal"}, "is_word": true, "word_id": 292, "word_key": " with", "bytes_hex": "20 77 69 74 68", "compression": {"rwkv": "20.06% 20.06% 20.06% 20.06% 20.06%", "qwen": "19.36% 19.36% 19.36% 19.36% 19.36%"}, "model_tokens": {"rwkv": [[32487, " with", "normal", 0.0038757920265197754]], "qwen": [[448, " with", "normal", 0.004661415237933397]]}, "loss": {"rwkv": 20.062477912362148, "qwen": 19.36253948022767}, "topk": {"rwkv": [32487, 34, 0.0038757920265197754, [[22748, 0.135995, " was", false], [22777, 0.104854, " won", false], [30256, 0.064874, " beat", false], [55934, 0.064274, " defeated", false], [51744, 0.052972, " finally", false], [61959, 0.042262, " eventually", false], [4811, 0.036133, " to", false], [45, 0.032198, ",", false], [32227, 0.026997, " that", false], [30383, 0.019303, " came", false]]], "qwen": [448, 36, 0.004661415237933397, [[572, 0.184156, " was", false], [2765, 0.070575, " won", false], [23283, 0.055593, " defeated", false], [374, 0.041249, " is", false], [9583, 0.028863, " eventually", false], [429, 0.026253, " that", false], [6116, 0.026081, " became", false], [29701, 0.020218, " dominated", false], [11, 0.01994, ",", false], [14816, 0.019933, " wins", false]]]}, "raw_delta": 0.0388128280639648, "tuned_delta": 0.04738462009454305}, {"byte_start": 1746, "byte_end": 1754, "display": {"text": " special", "kind": "normal"}, "is_word": true, "word_id": 293, "word_key": " special", "bytes_hex": "20 73 70 65 63 69 61 6c", "compression": {"rwkv": "17.33% 17.33% 17.33% 17.33% 17.33% 17.33% 17.33% 17.33%", "qwen": "20.77% 20.77% 20.77% 20.77% 20.77% 20.77% 20.77% 20.77%"}, "model_tokens": {"rwkv": [[52964, " special", "normal", 0.0004496047622524202]], "qwen": [[3281, " special", "normal", 9.964989294530824e-05]]}, "loss": {"rwkv": 17.329247073177978, "qwen": 20.769957783736956}, "topk": {"rwkv": [52964, 194, 0.0004496047622524202, [[332, 0.191682, " a", false], [22590, 0.048645, " the", false], [38720, 0.038933, " human", false], [31277, 0.036428, " less", false], [30597, 0.034435, " deep", false], [31466, 0.025209, " much", false], [52906, 0.023126, " similar", false], [4692, 0.018722, " no", false], [52195, 0.017973, " massive", false], [4419, 0.017767, " an", false]]], "qwen": [3281, 456, 9.964989294530824e-05, [[264, 0.162726, " a", false], [2686, 0.070888, " less", false], [279, 0.054744, " the", false], [16745, 0.040869, " fewer", false], [902, 0.036982, " no", false], [2664, 0.029638, " better", false], [29039, 0.028325, " comparable", false], [1172, 0.027494, " only", false], [4428, 0.02705, " similar", false], [1753, 0.022012, " much", false]]]}, "raw_delta": -0.19079351425170898, "tuned_delta": -0.18222172222113073}, {"byte_start": 1754, "byte_end": 1763, "display": {"text": " hardware", "kind": "normal"}, "is_word": true, "word_id": 294, "word_key": " hardware", "bytes_hex": "20 68 61 72 64 77 61 72 65", "compression": {"rwkv": "7.86% 7.86% 7.86% 7.86% 7.86% 7.86% 7.86% 7.86% 7.86%", "qwen": "12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55%"}, "model_tokens": {"rwkv": [[56353, " hardware", "normal", 0.01969507336616516]], "qwen": [[11773, " hardware", "normal", 0.0019082442158833146]]}, "loss": {"rwkv": 7.858430018731115, "qwen": 12.546581535334132}, "topk": {"rwkv": [56353, 10, 0.01969507336616516, [[46, 0.136974, "-", false], [52224, 0.067794, " methods", false], [59943, 0.043138, " knowledge", false], [60572, 0.043045, " structure", false], [62586, 0.037339, " structures", false], [39558, 0.033567, " rules", false], [59792, 0.0335, " heuristic", false], [56215, 0.025575, " features", false], [62633, 0.024171, " techniques", false], [56353, 0.019695, " hardware", false]]], "qwen": [11773, 41, 0.0019082442158833146, [[58238, 0.186541, "-purpose", false], [6540, 0.087972, " knowledge", false], [32719, 0.080224, " chess", false], [7428, 0.069225, " purpose", false], [5944, 0.042278, " structure", false], [5601, 0.032705, " rules", false], [566, 0.03113, " he", false], [3738, 0.030087, " human", false], [38485, 0.026627, "-case", false], [5413, 0.023169, " methods", false]]]}, "raw_delta": -0.25996632046169704, "tuned_delta": -0.2513945284311188}, {"byte_start": 1763, "byte_end": 1767, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 295, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "15.50% 15.50% 15.50% 15.50%", "qwen": "16.46% 16.46% 16.46% 16.46%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.0321439653635025]], "qwen": [[323, " and", "normal", 0.025942524895071983]]}, "loss": {"rwkv": 15.49770063454941, "qwen": 16.464178638904322}, "topk": {"rwkv": [21265, 7, 0.0321439653635025, [[22777, 0.162071, " won", false], [22748, 0.136268, " was", false], [55934, 0.077032, " defeated", false], [275, 0.048254, " (", false], [45, 0.045464, ",", false], [51744, 0.042829, " finally", false], [21265, 0.032144, " and", false], [61959, 0.026994, " eventually", false], [30256, 0.026825, " beat", false], [38128, 0.019286, " could", false]]], "qwen": [323, 7, 0.025942524895071983, [[572, 0.161828, " was", false], [6116, 0.055485, " became", false], [320, 0.053677, " (", false], [311, 0.04978, " to", false], [369, 0.043006, " for", false], [11, 0.026602, ",", false], [323, 0.025943, " and", false], [374, 0.025237, " is", false], [6519, 0.022702, " turned", false], [9583, 0.019155, " eventually", false]]]}, "raw_delta": -0.05359292030334473, "tuned_delta": -0.04502112827276648}, {"byte_start": 1767, "byte_end": 1776, "display": {"text": " software", "kind": "normal"}, "is_word": true, "word_id": 296, "word_key": " software", "bytes_hex": "20 73 6f 66 74 77 61 72 65", "compression": {"rwkv": "4.23% 4.23% 4.23% 4.23% 4.23% 4.23% 4.23% 4.23% 4.23%", "qwen": "3.74% 3.74% 3.74% 3.74% 3.74% 3.74% 3.74% 3.74% 3.74%"}, "model_tokens": {"rwkv": [[57257, " software", "normal", 0.12066756188869476]], "qwen": [[3162, " software", "normal", 0.1549476981163025]]}, "loss": {"rwkv": 4.226645627604385, "qwen": 3.73631496859156}, "topk": {"rwkv": [57257, 1, 0.12066756188869476, [[57257, 0.120668, " software", false], [332, 0.091038, " a", false], [52195, 0.040955, " massive", false], [38720, 0.033452, " human", false], [59988, 0.025548, " massively", false], [52964, 0.019492, " special", false], [31044, 0.019435, " hand", false], [4419, 0.017655, " an", false], [45301, 0.015361, " better", false], [31458, 0.013354, " more", false]]], "qwen": [3162, 1, 0.1549476981163025, [[3162, 0.154948, " software", false], [264, 0.118348, " a", false], [25185, 0.044363, " algorithms", false], [12538, 0.024099, " techniques", false], [3281, 0.020289, " special", false], [2711, 0.019608, " search", false], [15473, 0.017461, " programming", false], [458, 0.016747, " an", false], [27699, 0.015374, " clever", false], [27076, 0.012723, " specialized", false]]]}, "raw_delta": 0.027189705106947154, "tuned_delta": 0.035761497137525404}, {"byte_start": 1776, "byte_end": 1783, "display": {"text": " proved", "kind": "normal"}, "is_word": true, "word_id": 297, "word_key": " proved", "bytes_hex": "20 70 72 6f 76 65 64", "compression": {"rwkv": "12.08% 12.08% 12.08% 12.08% 12.08% 12.08% 12.08%", "qwen": "11.02% 11.02% 11.02% 11.02% 11.02% 11.02% 11.02%"}, "model_tokens": {"rwkv": [[46936, " proved", "normal", 0.009227147325873375]], "qwen": [[18651, " proved", "normal", 0.01385732926428318]]}, "loss": {"rwkv": 12.076130364583953, "qwen": 11.023584256828508}, "topk": {"rwkv": [46936, 17, 0.009227147325873375, [[22748, 0.155735, " was", false], [22777, 0.145421, " won", false], [55934, 0.076917, " defeated", false], [45, 0.048027, ",", false], [275, 0.037139, " (", false], [30256, 0.03504, " beat", false], [51744, 0.032274, " finally", false], [32227, 0.028484, " that", false], [61959, 0.026472, " eventually", false], [38128, 0.021097, " could", false]]], "qwen": [18651, 13, 0.01385732926428318, [[572, 0.160549, " was", false], [311, 0.048153, " to", false], [6116, 0.041038, " became", false], [6519, 0.034666, " turned", false], [369, 0.02844, " for", false], [320, 0.025774, " (", false], [1824, 0.019725, " support", false], [374, 0.01963, " is", false], [3697, 0.019219, " came", false], [11, 0.019093, ",", false]]]}, "raw_delta": 0.05836554936000271, "tuned_delta": 0.06693734139058095}, {"byte_start": 1783, "byte_end": 1790, "display": {"text": " vastly", "kind": "normal"}, "is_word": true, "word_id": 298, "word_key": " vastly", "bytes_hex": "20 76 61 73 74 6c 79", "compression": {"rwkv": "11.27% 11.27% 11.27% 11.27% 11.27% 11.27% 11.27%", "qwen": "16.44% 16.44% 16.44% 16.44% 16.44% 16.44% 16.44%"}, "model_tokens": {"rwkv": [[47708, " vastly", "normal", 0.012812004424631596]], "qwen": [[52008, " vastly", "normal", 0.0016954494640231133]]}, "loss": {"rwkv": 11.271055006945026, "qwen": 16.43592250359131}, "topk": {"rwkv": [47708, 17, 0.012812004424631596, [[4811, 0.272015, " to", false], [57350, 0.142239, " superior", false], [31458, 0.050594, " more", false], [62603, 0.03392, " successful", false], [51127, 0.033284, " capable", false], [32227, 0.031712, " that", false], [32393, 0.025362, " vict", false], [59593, 0.02474, " effective", false], [22590, 0.022994, " the", false], [46342, 0.018988, " itself", false]]], "qwen": [52008, 58, 0.0016954494640231133, [[311, 0.251034, " to", false], [6849, 0.098068, " successful", false], [16353, 0.072676, " superior", false], [14680, 0.052867, " competitive", false], [803, 0.036943, " more", false], [14016, 0.031679, " sufficient", false], [73710, 0.03152, " victorious", false], [18308, 0.025031, " equally", false], [438, 0.024942, " as", false], [7373, 0.024878, " effective", false]]]}, "raw_delta": -0.2864010674612863, "tuned_delta": -0.27782927543070807}, {"byte_start": 1790, "byte_end": 1795, "display": {"text": " more", "kind": "normal"}, "is_word": true, "word_id": 299, "word_key": " more", "bytes_hex": "20 6d 6f 72 65", "compression": {"rwkv": "3.72% 3.72% 3.72% 3.72% 3.72%", "qwen": "6.16% 6.16% 6.16% 6.16% 6.16%"}, "model_tokens": {"rwkv": [[31458, " more", "normal", 0.3574398159980774]], "qwen": [[803, " more", "normal", 0.1812962144613266]]}, "loss": {"rwkv": 3.719448152291858, "qwen": 6.158948102240927}, "topk": {"rwkv": [31458, 2, 0.3574398159980774, [[57350, 0.515153, " superior", false], [31458, 0.35744, " more", false], [45301, 0.07177, " better", false], [45961, 0.014264, " faster", false], [57326, 0.013514, " stronger", false], [59593, 0.003661, " effective", false], [22249, 0.002475, " out", false], [62603, 0.001708, " successful", false], [39855, 0.001371, " super", false], [56445, 0.001241, " inferior", false]]], "qwen": [803, 2, 0.1812962144613266, [[16353, 0.660181, " superior", false], [803, 0.181296, " more", false], [37179, 0.058894, " inferior", false], [700, 0.024377, " out", false], [2664, 0.023047, " better", false], [6849, 0.009693, " successful", false], [2686, 0.005975, " less", false], [10596, 0.005228, " faster", false], [7373, 0.003773, " effective", false], [8661, 0.00299, " easier", false]]]}, "raw_delta": -0.13527460098266603, "tuned_delta": -0.12670280895208777}, {"byte_start": 1795, "byte_end": 1805, "display": {"text": " effective", "kind": "normal"}, "is_word": true, "word_id": 300, "word_key": " effective", "bytes_hex": "20 65 66 66 65 63 74 69 76 65", "compression": {"rwkv": "1.18% 1.18% 1.18% 1.18% 1.18% 1.18% 1.18% 1.18% 1.18% 1.18%", "qwen": "1.37% 1.37% 1.37% 1.37% 1.37% 1.37% 1.37% 1.37% 1.37% 1.37%"}, "model_tokens": {"rwkv": [[59593, " effective", "normal", 0.5193632245063782]], "qwen": [[7373, " effective", "normal", 0.46875810623168945]]}, "loss": {"rwkv": 1.183460775729228, "qwen": 1.3663556183001244}, "topk": {"rwkv": [59593, 1, 0.5193632245063782, [[59593, 0.519363, " effective", false], [56900, 0.248142, " powerful", false], [62603, 0.087465, " successful", false], [51127, 0.040674, " capable", false], [59594, 0.032189, " efficient", false], [63362, 0.009723, " competitive", false], [47129, 0.005053, " robust", false], [55435, 0.004777, " accurate", false], [46876, 0.004775, " potent", false], [59330, 0.003539, " competent", false]]], "qwen": [7373, 1, 0.46875810623168945, [[7373, 0.468758, " effective", false], [6849, 0.270519, " successful", false], [7988, 0.08256, " powerful", false], [11050, 0.06984, " efficient", false], [14976, 0.015863, " practical", false], [14680, 0.00762, " competitive", false], [5390, 0.006265, " useful", false], [5411, 0.005939, " popular", false], [12875, 0.005797, " capable", false], [5000, 0.004134, " difficult", false]]]}, "raw_delta": -0.010141843557357783, "tuned_delta": -0.0015700515267795343}, {"byte_start": 1805, "byte_end": 1806, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "11.83%", "qwen": "11.38%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.517075777053833]], "qwen": [[11, ",", "normal", 0.5320721864700317]]}, "loss": {"rwkv": 11.834607757292277, "qwen": 11.378826860216636}, "topk": {"rwkv": [45, 1, 0.517075777053833, [[45, 0.517076, ",", false], [32226, 0.318234, " than", false], [4596, 0.058019, " in", false], [4424, 0.033092, " at", false], [275, 0.013151, " (", false], [50870, 0.010288, " against", false], [21265, 0.006574, " and", false], [21700, 0.005527, " for", false], [4712, 0.005304, " on", false], [32227, 0.003332, " that", false]]], "qwen": [11, 1, 0.5320721864700317, [[11, 0.532072, ",", false], [1091, 0.212294, " than", false], [304, 0.092278, " in", false], [518, 0.045037, " at", false], [320, 0.022672, " (", false], [369, 0.015273, " for", false], [2348, 0.008727, " against", false], [323, 0.006842, " and", false], [1283, 0.005439, " after", false], [389, 0.004736, " on", false]]]}, "raw_delta": 0.02527385950088501, "tuned_delta": 0.03384565153146326}, {"byte_start": 1806, "byte_end": 1812, "display": {"text": " these", "kind": "normal"}, "is_word": true, "word_id": 301, "word_key": " these", "bytes_hex": "20 74 68 65 73 65", "compression": {"rwkv": "10.24% 10.24% 10.24% 10.24% 10.24% 10.24%", "qwen": "10.84% 10.84% 10.84% 10.84% 10.84% 10.84%"}, "model_tokens": {"rwkv": [[39936, " these", "normal", 0.03285355120897293]], "qwen": [[1493, " these", "normal", 0.02717256359755993]]}, "loss": {"rwkv": 10.237874964641732, "qwen": 10.836886238030623}, "topk": {"rwkv": [39936, 7, 0.03285355120897293, [[22590, 0.291234, " the", false], [4601, 0.146537, " it", false], [31370, 0.061791, " many", false], [39934, 0.045832, " there", false], [32234, 0.039601, " this", false], [32232, 0.037792, " they", false], [39936, 0.032854, " these", false], [39944, 0.03154, " those", false], [332, 0.024274, " a", false], [32074, 0.02115, " some", false]]], "qwen": [1493, 8, 0.02717256359755993, [[279, 0.257182, " the", false], [432, 0.19001, " it", false], [1657, 0.046408, " many", false], [807, 0.03432, " they", false], [264, 0.033781, " a", false], [419, 0.031577, " this", false], [1052, 0.028688, " there", false], [1493, 0.027173, " these", false], [1429, 0.02651, " most", false], [11811, 0.023335, " researchers", false]]]}, "raw_delta": -0.033216238021850586, "tuned_delta": -0.024644445991272336}, {"byte_start": 1812, "byte_end": 1818, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 302, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "10.47% 10.47% 10.47% 10.47% 10.47% 10.47%", "qwen": "15.86% 15.86% 15.86% 15.86% 15.86% 15.86%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.03081255406141281]], "qwen": [[3738, " human", "normal", 0.0051124123856425285]]}, "loss": {"rwkv": 10.472688610619752, "qwen": 15.857875301118847}, "topk": {"rwkv": [38720, 3, 0.03081255406141281, [[63843, 0.426013, " researchers", false], [52224, 0.145729, " methods", false], [38720, 0.030813, " human", false], [61590, 0.030591, " approaches", false], [31937, 0.027987, " same", false], [46787, 0.018104, " people", false], [55809, 0.012532, " computer", false], [32462, 0.011953, " were", false], [39193, 0.011745, " other", false], [31458, 0.010867, " more", false]]], "qwen": [3738, 6, 0.0051124123856425285, [[11811, 0.839768, " researchers", false], [1852, 0.028461, " same", false], [5413, 0.018997, " methods", false], [1251, 0.010135, " people", false], [6366, 0.009566, " computer", false], [3738, 0.005112, " human", false], [3412, 0.004544, " research", false], [11647, 0.003293, " experts", false], [1033, 0.00309, " were", false], [803, 0.002939, " more", false]]]}, "raw_delta": -0.2986181577046713, "tuned_delta": -0.2900463656740931}, {"byte_start": 1818, "byte_end": 1828, "display": {"text": "-knowledge", "kind": "normal"}, "is_word": true, "word_id": 303, "word_key": "-knowledge", "bytes_hex": "2d 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "2.48% 0.84% 0.84% 0.84% 0.84% 0.84% 0.84% 0.84% 0.84% 0.84%", "qwen": "9.30% 9.30% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.871780276298523], [58313, "knowledge", "normal", 0.6595557928085327]], "qwen": [[12646, "-k", "normal", 0.3563463091850281], [51186, "nowledge", "normal", 0.9994348883628845]]}, "loss": {"rwkv": 1.002067234211206, "qwen": 1.8618295005851109}, "topk": {"rwkv": [46, 1, 0.871780276298523, [[46, 0.87178, "-", false], [25971, 0.030047, "ists", false], [38013, 0.012634, " chess", false], [51685, 0.011814, " experts", false], [52224, 0.010909, " methods", false], [7919, 0.010518, "ist", false], [61590, 0.007997, " approaches", false], [47202, 0.00402, " search", false], [59943, 0.00399, " knowledge", false], [63843, 0.003556, " researchers", false]]], "qwen": [12646, 1, 0.3563463091850281, [[12646, 0.356346, "-k", false], [71107, 0.225456, "-under", false], [12, 0.107033, "-", false], [8660, 0.059608, " understanding", false], [5980, 0.023717, "-based", false], [6540, 0.023538, " knowledge", false], [35085, 0.017064, "-oriented", false], [18376, 0.013196, "-exp", false], [3419, 0.010298, "-in", false], [51273, 0.009458, "-focused", false]]]}, "raw_delta": -0.04767534327111208, "tuned_delta": -0.03910355124053383}, {"byte_start": 1828, "byte_end": 1834, "display": {"text": "-based", "kind": "normal"}, "is_word": true, "word_id": 304, "word_key": "-based", "bytes_hex": "2d 62 61 73 65 64", "compression": {"rwkv": "30.57% 1.56% 1.56% 1.56% 1.56% 1.56%", "qwen": "6.90% 6.90% 6.90% 6.90% 6.90% 6.90%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.18554151058197021], [34011, "based", "normal", 0.6482729315757751]], "qwen": [[5980, "-based", "normal", 0.10055873543024063]]}, "loss": {"rwkv": 6.3986718529010815, "qwen": 6.903936816493413}, "topk": {"rwkv": [46, 3, 0.18554151058197021, [[52224, 0.265552, " methods", false], [61590, 0.238326, " approaches", false], [46, 0.185542, "-", false], [63843, 0.142978, " researchers", false], [37810, 0.066875, " based", false], [56777, 0.00802, " oriented", false], [51685, 0.006366, " experts", false], [38013, 0.00614, " chess", false], [55532, 0.003715, " approach", false], [59099, 0.003218, " advocates", false]]], "qwen": [5980, 3, 0.10055873543024063, [[11811, 0.458921, " researchers", false], [5413, 0.179589, " methods", false], [5980, 0.100559, "-based", false], [19827, 0.086535, " approaches", false], [3118, 0.018875, " based", false], [35085, 0.01782, "-oriented", false], [34316, 0.010812, " specialists", false], [11647, 0.009548, " experts", false], [1251, 0.007044, " people", false], [3412, 0.005827, " research", false]]]}, "raw_delta": -0.028017838795979817, "tuned_delta": -0.01944604676540157}, {"byte_start": 1834, "byte_end": 1840, "display": {"text": " chess", "kind": "normal"}, "is_word": true, "word_id": 305, "word_key": " chess", "bytes_hex": "20 63 68 65 73 73", "compression": {"rwkv": "11.04% 11.04% 11.04% 11.04% 11.04% 11.04%", "qwen": "18.40% 18.40% 18.40% 18.40% 18.40% 18.40%"}, "model_tokens": {"rwkv": [[38013, " chess", "normal", 0.025300495326519012]], "qwen": [[32719, " chess", "normal", 0.0021924730390310287]]}, "loss": {"rwkv": 11.036241360967004, "qwen": 18.40255210111632}, "topk": {"rwkv": [38013, 4, 0.025300495326519012, [[52224, 0.373073, " methods", false], [63843, 0.289508, " researchers", false], [61590, 0.210366, " approaches", false], [38013, 0.0253, " chess", false], [47202, 0.007561, " search", false], [3609, 0.006943, " AI", false], [57103, 0.006204, " research", false], [55809, 0.006163, " computer", false], [51685, 0.005402, " experts", false], [45, 0.004026, ",", false]]], "qwen": [32719, 9, 0.0021924730390310287, [[11811, 0.666725, " researchers", false], [5413, 0.185187, " methods", false], [19827, 0.078376, " approaches", false], [3412, 0.008964, " research", false], [6366, 0.004887, " computer", false], [8869, 0.004315, " efforts", false], [11647, 0.003867, " experts", false], [1714, 0.002293, " method", false], [32719, 0.002192, " chess", false], [12538, 0.002084, " techniques", false]]]}, "raw_delta": -0.4084750016530356, "tuned_delta": -0.39990320962245735}, {"byte_start": 1840, "byte_end": 1852, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 306, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"rwkv": "0.56% 0.56% 0.56% 0.56% 0.56% 0.56% 0.56% 0.56% 0.56% 0.56% 0.56% 0.56%", "qwen": "0.99% 0.99% 0.99% 0.99% 0.99% 0.99% 0.99% 0.99% 0.99% 0.99% 0.99% 0.99%"}, "model_tokens": {"rwkv": [[63843, " researchers", "normal", 0.6872232556343079]], "qwen": [[11811, " researchers", "normal", 0.5165534615516663]]}, "loss": {"rwkv": 0.5606175797725259, "qwen": 0.9927191530532772}, "topk": {"rwkv": [63843, 1, 0.6872232556343079, [[63843, 0.687223, " researchers", false], [52224, 0.09212, " methods", false], [51685, 0.042066, " experts", false], [46, 0.034204, "-", false], [61590, 0.023681, " approaches", false], [3609, 0.022106, " AI", false], [52489, 0.013138, " players", false], [56949, 0.012948, " programs", false], [57103, 0.009412, " research", false], [63874, 0.004496, " specialists", false]]], "qwen": [11811, 1, 0.5165534615516663, [[11811, 0.516553, " researchers", false], [7468, 0.102095, " programs", false], [5413, 0.096953, " methods", false], [54846, 0.035029, " programmers", false], [4217, 0.031163, " players", false], [72085, 0.028395, "-playing", false], [11647, 0.023772, " experts", false], [3412, 0.019797, " research", false], [5942, 0.016329, " systems", false], [19827, 0.013321, " approaches", false]]]}, "raw_delta": -0.023960798978805545, "tuned_delta": -0.015389006948227297}, {"byte_start": 1852, "byte_end": 1857, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 307, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"rwkv": "4.90% 4.90% 4.90% 4.90% 4.90%", "qwen": "4.53% 4.53% 4.53% 4.53% 4.53%"}, "model_tokens": {"rwkv": [[32462, " were", "normal", 0.25559622049331665]], "qwen": [[1033, " were", "normal", 0.2846704423427582]]}, "loss": {"rwkv": 4.902908928021086, "qwen": 4.531588495805858}, "topk": {"rwkv": [32462, 1, 0.25559622049331665, [[32462, 0.255596, " were", false], [21795, 0.046323, " had", false], [21532, 0.023956, " did", false], [45, 0.022912, ",", false], [38547, 0.016735, " found", false], [30840, 0.016341, " felt", false], [31334, 0.012921, " lost", false], [60419, 0.012504, " retreated", false], [38435, 0.012385, " faced", false], [52628, 0.011966, " quickly", false]]], "qwen": [1033, 1, 0.2846704423427582, [[1033, 0.28467, " were", false], [1030, 0.053464, " had", false], [11, 0.023811, ",", false], [6476, 0.022545, " felt", false], [5558, 0.019401, " lost", false], [6966, 0.015394, " looked", false], [22978, 0.014257, " abandoned", false], [6116, 0.014051, " became", false], [6157, 0.013707, " quickly", false], [1730, 0.013475, " found", false]]]}, "raw_delta": 0.020590376853942827, "tuned_delta": 0.029162168884521077}, {"byte_start": 1857, "byte_end": 1861, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 308, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "13.95% 13.95% 13.95% 13.95%", "qwen": "15.12% 15.12% 15.12% 15.12%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.04509412869811058]], "qwen": [[537, " not", "normal", 0.03495302423834801]]}, "loss": {"rwkv": 13.947930571094469, "qwen": 15.120121323712658}, "topk": {"rwkv": [22187, 4, 0.04509412869811058, [[32053, 0.1306, " slow", false], [46021, 0.06047, " forced", false], [31269, 0.045305, " left", false], [22187, 0.045094, " not", false], [62683, 0.027402, " understand", false], [39418, 0.026169, " quick", false], [47650, 0.017289, " unable", false], [60601, 0.01446, " surprised", false], [39820, 0.013581, " still", false], [45, 0.013549, ",", false]]], "qwen": [537, 3, 0.03495302423834801, [[26620, 0.055359, " shocked", false], [71982, 0.038058, " dismay", false], [537, 0.034953, " not", false], [14453, 0.031572, " surprised", false], [2115, 0.028282, " left", false], [9575, 0.022694, " forced", false], [46926, 0.021046, " stunned", false], [86998, 0.019709, " understandably", false], [11889, 0.015698, " unable", false], [3974, 0.015696, " quick", false]]]}, "raw_delta": -0.06500005722045898, "tuned_delta": -0.056428265189880734}, {"byte_start": 1861, "byte_end": 1866, "display": {"text": " good", "kind": "normal"}, "is_word": true, "word_id": 309, "word_key": " good", "bytes_hex": "20 67 6f 6f 64", "compression": {"rwkv": "30.43% 30.43% 30.43% 30.43% 30.43%", "qwen": "29.23% 29.23% 29.23% 29.23% 29.23%"}, "model_tokens": {"rwkv": [[30992, " good", "normal", 0.00022168979921843857]], "qwen": [[1661, " good", "normal", 0.0003018275019712746]]}, "loss": {"rwkv": 30.43184851875157, "qwen": 29.234969656602026}, "topk": {"rwkv": [30992, 284, 0.00022168979921843857, [[39418, 0.095821, " quick", false], [30093, 0.073438, " able", false], [31581, 0.065513, " only", false], [53350, 0.047835, " willing", false], [56914, 0.043708, " prepared", false], [39449, 0.035332, " ready", false], [32053, 0.035318, " slow", false], [60601, 0.030924, " surprised", false], [4424, 0.021641, " at", false], [56426, 0.020471, " inclined", false]]], "qwen": [1661, 234, 0.0003018275019712746, [[14453, 0.06331, " surprised", false], [24404, 0.051046, " impressed", false], [7945, 0.044645, " particularly", false], [518, 0.037477, " at", false], [2952, 0.037358, " able", false], [6247, 0.036072, " happy", false], [22166, 0.030846, " convinced", false], [279, 0.02569, " the", false], [8014, 0.024005, " interested", false], [1172, 0.023934, " only", false]]]}, "raw_delta": 0.06636905670166016, "tuned_delta": 0.0749408487322384}, {"byte_start": 1866, "byte_end": 1873, "display": {"text": " losers", "kind": "normal"}, "is_word": true, "word_id": 310, "word_key": " losers", "bytes_hex": "20 6c 6f 73 65 72 73", "compression": {"rwkv": "21.42% 21.42% 21.42% 21.42% 21.42% 21.42% 0.01%", "qwen": "23.81% 23.81% 23.81% 23.81% 23.81% 23.81% 23.81%"}, "model_tokens": {"rwkv": [[38935, " loser", "normal", 0.0007969274884089828], [116, "s", "normal", 0.9997172951698303]], "qwen": [[67356, " losers", "normal", 9.699879592517391e-05]]}, "loss": {"rwkv": 18.356440481301235, "qwen": 23.806560859563593}, "topk": {"rwkv": [38935, 25, 0.0007969274884089828, [[4424, 0.626598, " at", false], [45865, 0.227566, " enough", false], [37598, 0.04074, " about", false], [46, 0.010277, "-", false], [32487, 0.009293, " with", false], [4811, 0.00882, " to", false], [61653, 0.007227, " candidates", false], [57330, 0.003439, " students", false], [46356, 0.003353, " judges", false], [4712, 0.002797, " on", false]]], "qwen": [67356, 199, 9.699879592517391e-05, [[518, 0.431798, " at", false], [3322, 0.350935, " enough", false], [4143, 0.015584, " students", false], [23562, 0.013815, " listeners", false], [4780, 0.010812, " friends", false], [11178, 0.01081, " candidates", false], [369, 0.010241, " for", false], [911, 0.008406, " about", false], [10030, 0.006562, " prepared", false], [448, 0.00574, " with", false]]]}, "raw_delta": -0.3022188459123884, "tuned_delta": -0.29364705388181017}, {"byte_start": 1873, "byte_end": 1874, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "6.23%", "qwen": "11.44%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.7060011625289917]], "qwen": [[13, ".", "normal", 0.5303573608398438]]}, "loss": {"rwkv": 6.234302300716467, "qwen": 11.43704191264213}, "topk": {"rwkv": [47, 1, 0.7060011625289917, [[47, 0.706001, ".", false], [45, 0.148981, ",", false], [21265, 0.032215, " and", false], [60, 0.025791, ";", false], [59, 0.016035, ":", false], [275, 0.009601, " (", false], [21400, 0.007759, " but", false], [4596, 0.007044, " in", false], [4424, 0.006522, " at", false], [280, 0.002929, " -", false]]], "qwen": [13, 1, 0.5303573608398438, [[13, 0.530357, ".", false], [11, 0.106582, ",", false], [382, 0.087159, ".\n\n", false], [624, 0.053129, ".\n", false], [304, 0.035469, " in", false], [26, 0.029752, ";", false], [323, 0.027361, " and", false], [714, 0.024008, " but", false], [320, 0.017181, " (", false], [25, 0.0155, ":", false]]]}, "raw_delta": -0.28850114345550537, "tuned_delta": -0.27992935142492714}, {"byte_start": 1874, "byte_end": 1879, "display": {"text": " They", "kind": "normal"}, "is_word": true, "word_id": 311, "word_key": " they", "bytes_hex": "20 54 68 65 79", "compression": {"rwkv": "6.73% 6.73% 6.73% 6.73% 6.73%", "qwen": "7.04% 7.04% 7.04% 7.04% 7.04%"}, "model_tokens": {"rwkv": [[29893, " They", "normal", 0.15564467012882233]], "qwen": [[2379, " They", "normal", 0.14182904362678528]]}, "loss": {"rwkv": 6.7344553666496525, "qwen": 7.044437756478033}, "topk": {"rwkv": [29893, 2, 0.15564467012882233, [[261, 0.194605, "\n\n", false], [29893, 0.155645, " They", false], [20996, 0.067001, " The", false], [267, 0.047631, "  ", false], [19555, 0.046406, " But", false], [3913, 0.039858, " In", false], [37449, 0.03316, " Their", false], [3918, 0.024008, " It", false], [300, 0.014307, " A", false], [37451, 0.012311, " There", false]]], "qwen": [2379, 1, 0.14182904362678528, [[2379, 0.141829, " They", false], [220, 0.131886, " ", false], [576, 0.082841, " The", false], [758, 0.04453, " In", false], [10964, 0.038897, " Their", false], [12090, 0.034402, " Instead", false], [1988, 0.029294, " But", false], [1084, 0.028173, " It", false], [320, 0.026805, " (", false], [1096, 0.018467, " This", false]]]}, "raw_delta": -0.017189073562622115, "tuned_delta": -0.008617281532043867}, {"byte_start": 1879, "byte_end": 1884, "display": {"text": " said", "kind": "normal"}, "is_word": true, "word_id": 312, "word_key": " said", "bytes_hex": "20 73 61 69 64", "compression": {"rwkv": "23.11% 23.11% 23.11% 23.11% 23.11%", "qwen": "24.38% 24.38% 24.38% 24.38% 24.38%"}, "model_tokens": {"rwkv": [[31929, " said", "normal", 0.001669788733124733]], "qwen": [[1053, " said", "normal", 0.0011602459708228707]]}, "loss": {"rwkv": 23.1056627642373, "qwen": 24.378384255590834}, "topk": {"rwkv": [31929, 94, 0.001669788733124733, [[32462, 0.119811, " were", false], [21795, 0.087098, " had", false], [21532, 0.05324, " did", false], [59392, 0.03691, " continued", false], [39762, 0.01865, " spent", false], [40013, 0.018119, " tried", false], [39820, 0.017358, " still", false], [38128, 0.015004, " could", false], [45196, 0.014658, " argued", false], [60158, 0.01246, " persisted", false]]], "qwen": [1053, 110, 0.0011602459708228707, [[1033, 0.182277, " were", false], [1030, 0.157047, " had", false], [1521, 0.037867, " did", false], [8570, 0.02375, " continued", false], [5558, 0.023589, " lost", false], [7391, 0.017444, " spent", false], [1410, 0.017068, " could", false], [1035, 0.013185, " would", false], [6476, 0.011364, " felt", false], [11585, 0.010578, " believed", false]]]}, "raw_delta": -0.07057466506957999, "tuned_delta": -0.06200287303900174}, {"byte_start": 1884, "byte_end": 1889, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 313, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "3.51% 3.51% 3.51% 3.51% 3.51%", "qwen": "4.76% 4.76% 4.76% 4.76% 4.76%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.3803556561470032]], "qwen": [[429, " that", "normal", 0.26710042357444763]]}, "loss": {"rwkv": 3.508115870911639, "qwen": 4.761364626621232}, "topk": {"rwkv": [32227, 1, 0.3803556561470032, [[32227, 0.380356, " that", false], [45, 0.099526, ",", false], [22590, 0.097763, " the", false], [32232, 0.08083, " they", false], [47539, 0.048248, " things", false], [4601, 0.042272, " it", false], [39931, 0.026849, " their", false], [269, 0.023397, " \"", false], [38013, 0.019255, " chess", false], [31370, 0.011386, " many", false]]], "qwen": [429, 1, 0.26710042357444763, [[429, 0.2671, " that", false], [11, 0.250771, ",", false], [330, 0.068366, " \"", false], [807, 0.055191, " they", false], [432, 0.050815, " it", false], [2513, 0.03838, " things", false], [4302, 0.036074, " nothing", false], [279, 0.033549, " the", false], [25, 0.031332, ":", false], [311, 0.012669, " to", false]]]}, "raw_delta": -0.06949486732482912, "tuned_delta": -0.060923075294250874}, {"byte_start": 1889, "byte_end": 1892, "display": {"text": " ``", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "20 60 60", "compression": {"rwkv": "63.12% 63.12% 63.12%", "qwen": "64.29% 64.29% 64.29%"}, "model_tokens": {"rwkv": [[4404, " ``", "normal", 2.7912303266930394e-05]], "qwen": [[9902, " ``", "normal", 2.2649990569334477e-05]]}, "loss": {"rwkv": 63.11790803889214, "qwen": 64.29221131173843}, "topk": {"rwkv": [4404, 575, 2.7912303266930394e-05, [[22590, 0.30634, " the", false], [39931, 0.110249, " their", false], [32232, 0.084758, " they", false], [47202, 0.083649, " search", false], [4601, 0.032346, " it", false], [32234, 0.032225, " this", false], [332, 0.025036, " a", false], [30597, 0.02062, " deep", false], [45, 0.017945, ",", false], [39934, 0.016947, " there", false]]], "qwen": [9902, 723, 2.2649990569334477e-05, [[279, 0.227069, " the", false], [807, 0.152814, " they", false], [862, 0.072788, " their", false], [432, 0.062657, " it", false], [32719, 0.034045, " chess", false], [2711, 0.031921, " search", false], [264, 0.027836, " a", false], [419, 0.02541, " this", false], [1052, 0.022813, " there", false], [11, 0.019629, ",", false]]]}, "raw_delta": -0.0651172002156577, "tuned_delta": -0.05654540818507945}, {"byte_start": 1892, "byte_end": 1897, "display": {"text": "brute", "kind": "normal"}, "is_word": true, "word_id": 314, "word_key": "brute", "bytes_hex": "62 72 75 74 65", "compression": {"rwkv": "45.46% 45.46% 45.46% 0.02% 0.02%", "qwen": "64.52% 64.52% 0.20% 0.20% 0.20%"}, "model_tokens": {"rwkv": [[7184, "bru", "normal", 0.0005290898261591792], [2206, "te", "normal", 0.9979749321937561]], "qwen": [[1323, "br", "normal", 0.0007809735834598541], [1070, "ute", "normal", 0.9664857387542725]]}, "loss": {"rwkv": 27.283272698427684, "qwen": 25.92904569975074}, "topk": {"rwkv": [7184, 173, 0.0005290898261591792, [[8801, 0.129063, "the", false], [25116, 0.067519, "deep", false], [42233, 0.054828, "search", false], [34580, 0.042701, "human", false], [53865, 0.026487, "computer", false], [2278, 0.0246, "we", false], [2073, 0.021748, "no", false], [35755, 0.020988, "there", false], [24991, 0.020163, "ches", false], [1956, 0.018559, "it", false]]], "qwen": [1323, 137, 0.0007809735834598541, [[1782, 0.152667, "the", false], [896, 0.046311, "we", false], [331, 0.044493, "ch", false], [25312, 0.034654, "human", false], [1836, 0.031319, "search", false], [18532, 0.030247, "there", false], [275, 0.030046, "it", false], [64, 0.024511, "a", false], [64947, 0.020238, "comput", false], [785, 0.015029, "The", false]]]}, "raw_delta": 0.0750942900776864, "tuned_delta": 0.08366608210826464}, {"byte_start": 1897, "byte_end": 1903, "display": {"text": " force", "kind": "normal"}, "is_word": true, "word_id": 315, "word_key": " force", "bytes_hex": "20 66 6f 72 63 65", "compression": {"rwkv": "1.18% 1.18% 1.18% 1.18% 1.18% 1.18%", "qwen": "0.64% 0.64% 0.64% 0.64% 0.64% 0.64%"}, "model_tokens": {"rwkv": [[38536, " force", "normal", 0.673162579536438]], "qwen": [[5344, " force", "normal", 0.8073176741600037]]}, "loss": {"rwkv": 1.1799385710395573, "qwen": 0.6433158405242455}, "topk": {"rwkv": [38536, 1, 0.673162579536438, [[38536, 0.673163, " force", false], [46, 0.282958, "-", false], [57319, 0.006794, " strength", false], [439, 0.005511, "''", false], [39339, 0.003964, " power", false], [59346, 0.002994, " computing", false], [47202, 0.002701, " search", false], [63370, 0.002166, " computation", false], [46022, 0.0018, " forces", false], [51779, 0.00164, " forcing", false]]], "qwen": [5344, 1, 0.8073176741600037, [[5344, 0.807318, " force", false], [80049, 0.155477, "-force", false], [2355, 0.013885, " power", false], [8170, 0.005856, " strength", false], [2711, 0.002685, " search", false], [24231, 0.001879, " computing", false], [24913, 0.001521, " forcing", false], [34447, 0.001121, " computation", false], [15039, 0.000489, " searching", false], [19428, 0.000473, "-search", false]]]}, "raw_delta": 0.029756682614485417, "tuned_delta": 0.038328474645063663}, {"byte_start": 1903, "byte_end": 1904, "display": {"text": "\"", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "22", "compression": {"rwkv": "59.74%", "qwen": "60.17%"}, "model_tokens": {"rwkv": [[35, "\"", "normal", 0.036194030195474625]], "qwen": [[1, "\"", "normal", 0.0355585552752018]]}, "loss": {"rwkv": 59.73659153680863, "qwen": 60.17074454064671}, "topk": {"rwkv": [35, 3, 0.036194030195474625, [[439, 0.636685, "''", false], [4600, 0.06822, " is", false], [35, 0.036194, "\"", false], [40, 0.020316, "'", false], [47202, 0.018037, " search", false], [22748, 0.016308, " was", false], [32475, 0.015448, " will", false], [37825, 0.010313, " beats", false], [32481, 0.010184, " wins", false], [5341, 0.00864, ",''", false]]], "qwen": [1, 5, 0.0355585552752018, [[4605, 0.666866, "''", false], [374, 0.046522, " is", false], [6, 0.040162, "'", false], [2711, 0.039583, " search", false], [1, 0.035559, "\"", false], [40510, 0.018344, ",''", false], [572, 0.010485, " was", false], [50817, 0.007851, "'',", false], [11, 0.007359, ",", false], [686, 0.006617, " will", false]]]}, "raw_delta": -0.024074554443359375, "tuned_delta": -0.015502762412781127}, {"byte_start": 1904, "byte_end": 1911, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 316, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "7.04% 7.04% 7.04% 7.04% 7.04% 7.04% 7.04%", "qwen": "5.22% 5.22% 5.22% 5.22% 5.22% 5.22% 5.22%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.06495513767004013]], "qwen": [[2711, " search", "normal", 0.13174693286418915]]}, "loss": {"rwkv": 7.044409379340641, "qwen": 5.22171206232272}, "topk": {"rwkv": [47202, 4, 0.06495513767004013, [[22748, 0.248066, " was", false], [52224, 0.163488, " methods", false], [40219, 0.089023, " would", false], [47202, 0.064955, " search", false], [21795, 0.053909, " had", false], [4600, 0.040446, " is", false], [38128, 0.027898, " could", false], [61590, 0.024319, " approaches", false], [275, 0.014012, " (", false], [21265, 0.011585, " and", false]]], "qwen": [2711, 2, 0.13174693286418915, [[572, 0.244206, " was", false], [2711, 0.131747, " search", false], [1035, 0.095376, " would", false], [5413, 0.057583, " methods", false], [374, 0.057558, " is", false], [320, 0.044885, " (", false], [1030, 0.040804, " had", false], [323, 0.020798, " and", false], [32719, 0.013899, " chess", false], [476, 0.01116, " or", false]]]}, "raw_delta": 0.10107180050441197, "tuned_delta": 0.10964359253499022}, {"byte_start": 1911, "byte_end": 1915, "display": {"text": " may", "kind": "normal"}, "is_word": true, "word_id": 317, "word_key": " may", "bytes_hex": "20 6d 61 79", "compression": {"rwkv": "37.19% 37.19% 37.19% 37.19%", "qwen": "34.56% 34.56% 34.56% 34.56%"}, "model_tokens": {"rwkv": [[22074, " may", "normal", 0.0002585754555184394]], "qwen": [[1231, " may", "normal", 0.00046904574264772236]]}, "loss": {"rwkv": 37.194481522918586, "qwen": 34.556198865622754}, "topk": {"rwkv": [22074, 128, 0.0002585754555184394, [[22748, 0.403255, " was", false], [40219, 0.084631, " would", false], [52224, 0.075907, " methods", false], [21795, 0.067733, " had", false], [4600, 0.053641, " is", false], [38128, 0.045601, " could", false], [21532, 0.016726, " did", false], [45, 0.016359, ",", false], [47285, 0.009384, " simply", false], [32445, 0.008629, " wasn", false]]], "qwen": [1231, 92, 0.00046904574264772236, [[572, 0.389624, " was", false], [1035, 0.13415, " would", false], [374, 0.099906, " is", false], [1030, 0.037142, " had", false], [11, 0.030969, ",", false], [1410, 0.024413, " could", false], [5413, 0.017751, " methods", false], [320, 0.016459, " (", false], [686, 0.015828, " will", false], [323, 0.012574, " and", false]]]}, "raw_delta": 0.14629745483398438, "tuned_delta": 0.15486924686456263}, {"byte_start": 1915, "byte_end": 1920, "display": {"text": " have", "kind": "normal"}, "is_word": true, "word_id": 318, "word_key": " have", "bytes_hex": "20 68 61 76 65", "compression": {"rwkv": "4.45% 4.45% 4.45% 4.45% 4.45%", "qwen": "7.79% 7.79% 7.79% 7.79% 7.79%"}, "model_tokens": {"rwkv": [[31059, " have", "normal", 0.2906019389629364]], "qwen": [[614, " have", "normal", 0.11545616388320923]]}, "loss": {"rwkv": 4.4520667277432855, "qwen": 7.786456903625622}, "topk": {"rwkv": [31059, 2, 0.2906019389629364, [[4435, 0.36095, " be", false], [31059, 0.290602, " have", false], [32499, 0.107708, " work", false], [22770, 0.028328, " win", false], [22187, 0.026155, " not", false], [32458, 0.023707, " well", false], [61959, 0.020059, " eventually", false], [30256, 0.015342, " beat", false], [46272, 0.006488, " indeed", false], [31358, 0.005452, " make", false]]], "qwen": [614, 3, 0.11545616388320923, [[387, 0.394511, " be", false], [537, 0.152496, " not", false], [614, 0.115456, " have", false], [975, 0.048592, " work", false], [1632, 0.045093, " well", false], [9583, 0.024234, " eventually", false], [3164, 0.020108, " win", false], [13653, 0.011506, " ultimately", false], [12824, 0.009843, " indeed", false], [12118, 0.008267, " prove", false]]]}, "raw_delta": -0.18489785194396974, "tuned_delta": -0.17632605991339148}, {"byte_start": 1920, "byte_end": 1924, "display": {"text": " won", "kind": "normal"}, "is_word": true, "word_id": 319, "word_key": " won", "bytes_hex": "20 77 6f 6e", "compression": {"rwkv": "7.64% 7.64% 7.64% 7.64%", "qwen": "8.65% 8.65% 8.65% 8.65%"}, "model_tokens": {"rwkv": [[22777, " won", "normal", 0.18192946910858154]], "qwen": [[2765, " won", "normal", 0.14682579040527344]]}, "loss": {"rwkv": 7.643184176584596, "qwen": 8.649445530204561}, "topk": {"rwkv": [22777, 2, 0.18192946910858154, [[30259, 0.284607, " been", false], [22777, 0.181929, " won", false], [47812, 0.179618, " worked", false], [55934, 0.056501, " defeated", false], [45281, 0.029122, " beaten", false], [61959, 0.022459, " eventually", false], [47333, 0.014326, " solved", false], [30256, 0.010943, " beat", false], [60586, 0.010462, " succeeded", false], [31351, 0.010056, " made", false]]], "qwen": [2765, 2, 0.14682579040527344, [[1012, 0.28794, " been", false], [2765, 0.146826, " won", false], [30294, 0.072956, " beaten", false], [23283, 0.069093, " defeated", false], [6439, 0.037148, " worked", false], [264, 0.025148, " a", false], [700, 0.013904, " out", false], [279, 0.013003, " the", false], [6069, 0.010961, " led", false], [1030, 0.010471, " had", false]]]}, "raw_delta": -0.0557989776134491, "tuned_delta": -0.04722718558287085}, {"byte_start": 1924, "byte_end": 1929, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 320, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "16.68% 16.68% 16.68% 16.68% 16.68%", "qwen": "17.28% 17.28% 17.28% 17.28% 17.28%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.009804054163396358]], "qwen": [[419, " this", "normal", 0.008304568938910961]]}, "loss": {"rwkv": 16.681161410278637, "qwen": 17.279697151637894}, "topk": {"rwkv": [32234, 11, 0.009804054163396358, [[22590, 0.574802, " the", false], [45, 0.125965, ",", false], [50870, 0.054928, " against", false], [4596, 0.039392, " in", false], [4712, 0.038121, " on", false], [32229, 0.022023, " them", false], [21400, 0.013831, " but", false], [332, 0.012925, " a", false], [4424, 0.012721, " at", false], [21700, 0.01186, " for", false]]], "qwen": [419, 9, 0.008304568938910961, [[279, 0.444667, " the", false], [11, 0.260208, ",", false], [32719, 0.059978, " chess", false], [304, 0.037963, " in", false], [37542, 0.02516, " Kas", false], [714, 0.015706, " but", false], [2348, 0.012235, " against", false], [13, 0.009391, ".", false], [419, 0.008305, " this", false], [264, 0.007524, " a", false]]]}, "raw_delta": -0.03318986892700193, "tuned_delta": -0.02461807689642368}, {"byte_start": 1929, "byte_end": 1934, "display": {"text": " time", "kind": "normal"}, "is_word": true, "word_id": 321, "word_key": " time", "bytes_hex": "20 74 69 6d 65", "compression": {"rwkv": "4.79% 4.79% 4.79% 4.79% 4.79%", "qwen": "13.29% 13.29% 13.29% 13.29% 13.29%"}, "model_tokens": {"rwkv": [[32251, " time", "normal", 0.26396211981773376]], "qwen": [[882, " time", "normal", 0.02511478215456009]]}, "loss": {"rwkv": 4.7901983779516355, "qwen": 13.288298852929454}, "topk": {"rwkv": [32251, 1, 0.26396211981773376, [[32251, 0.263962, " time", false], [62293, 0.2201, " particular", false], [30941, 0.093729, " game", false], [39551, 0.077617, " round", false], [38981, 0.06603, " match", false], [45278, 0.042764, " battle", false], [22226, 0.040377, " one", false], [38013, 0.032679, " chess", false], [57271, 0.026488, " specific", false], [62653, 0.01863, " tournament", false]]], "qwen": [882, 12, 0.02511478215456009, [[3953, 0.221175, " particular", false], [1809, 0.1886, " game", false], [2432, 0.102998, " match", false], [8049, 0.067648, " battle", false], [32719, 0.04686, " chess", false], [825, 0.041474, " one", false], [6957, 0.034948, " race", false], [4116, 0.029859, " war", false], [10707, 0.02819, " competition", false], [4778, 0.028065, " round", false]]]}, "raw_delta": -0.4712347507476807, "tuned_delta": -0.46266295871710245}, {"byte_start": 1934, "byte_end": 1935, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "2.25%", "qwen": "5.44%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8824990391731262]], "qwen": [[11, ",", "normal", 0.7395690679550171]]}, "loss": {"rwkv": 2.2454054896648294, "qwen": 5.440540023273668}, "topk": {"rwkv": [45, 1, 0.8824990391731262, [[45, 0.882499, ",", false], [21400, 0.054787, " but", false], [275, 0.015165, " (", false], [45202, 0.013356, " around", false], [51018, 0.005571, " because", false], [50870, 0.0037, " against", false], [21265, 0.00283, " and", false], [47, 0.002494, ".", false], [4450, 0.001975, " by", false], [4596, 0.001817, " in", false]]], "qwen": [11, 1, 0.7395690679550171, [[11, 0.739569, ",", false], [714, 0.134095, " but", false], [13, 0.026886, ".", false], [1576, 0.021813, " because", false], [320, 0.012209, " (", false], [323, 0.008291, " and", false], [26, 0.007506, ";", false], [2163, 0.006502, " around", false], [304, 0.005369, " in", false], [553, 0.002741, " by", false]]]}, "raw_delta": -0.1771758794784546, "tuned_delta": -0.16860408744787633}, {"byte_start": 1935, "byte_end": 1939, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 322, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"rwkv": "0.12% 0.12% 0.12% 0.12%", "qwen": "0.29% 0.29% 0.29% 0.29%"}, "model_tokens": {"rwkv": [[21400, " but", "normal", 0.9737100005149841]], "qwen": [[714, " but", "normal", 0.9371599555015564]]}, "loss": {"rwkv": 0.11997509724189528, "qwen": 0.2926023471418245}, "topk": {"rwkv": [21400, 1, 0.9737100005149841, [[21400, 0.97371, " but", false], [21265, 0.011471, " and", false], [51018, 0.002272, " because", false], [4596, 0.000807, " in", false], [32227, 0.000668, " that", false], [4423, 0.000658, " as", false], [4715, 0.000573, " or", false], [4601, 0.000563, " it", false], [21700, 0.00055, " for", false], [39690, 0.000361, " since", false]]], "qwen": [714, 1, 0.9371599555015564, [[714, 0.93716, " but", false], [323, 0.028797, " and", false], [9902, 0.002806, " ``", false], [1576, 0.002413, " because", false], [537, 0.00212, " not", false], [1393, 0.001582, " while", false], [773, 0.001197, " so", false], [304, 0.001113, " in", false], [429, 0.001088, " that", false], [892, 0.001065, " which", false]]]}, "raw_delta": -0.009572487324476242, "tuned_delta": -0.0010006952938979938}, {"byte_start": 1939, "byte_end": 1942, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 323, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "5.00% 5.00% 5.00%", "qwen": "10.12% 10.12% 10.12%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.4341208338737488]], "qwen": [[432, " it", "normal", 0.1857195794582367]]}, "loss": {"rwkv": 5.001530659331855, "qwen": 10.120008804656042}, "topk": {"rwkv": [4601, 1, 0.4341208338737488, [[4601, 0.434121, " it", false], [32227, 0.09888, " that", false], [32232, 0.051912, " they", false], [22590, 0.049127, " the", false], [4596, 0.040486, " in", false], [40219, 0.039958, " would", false], [39934, 0.019556, " there", false], [37920, 0.016224, " brute", false], [32234, 0.01315, " this", false], [32475, 0.012144, " will", false]]], "qwen": [432, 2, 0.1857195794582367, [[429, 0.205034, " that", false], [432, 0.18572, " it", false], [807, 0.076933, " they", false], [279, 0.07421, " the", false], [9902, 0.054034, " ``", false], [304, 0.031521, " in", false], [3738, 0.027188, " human", false], [862, 0.02355, " their", false], [11, 0.012975, ",", false], [1052, 0.012856, " there", false]]]}, "raw_delta": -0.2838286956151327, "tuned_delta": -0.27525690358455446}, {"byte_start": 1942, "byte_end": 1946, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 324, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "8.84% 8.84% 8.84% 8.84%", "qwen": "6.05% 6.05% 6.05% 6.05%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.14146897196769714]], "qwen": [[572, " was", "normal", 0.26141783595085144]]}, "loss": {"rwkv": 8.840733771072504, "qwen": 6.048657778025745}, "topk": {"rwkv": [22748, 3, 0.14146897196769714, [[40219, 0.328436, " would", false], [32475, 0.152008, " will", false], [22748, 0.141469, " was", false], [4600, 0.070187, " is", false], [22777, 0.057875, " won", false], [38128, 0.044718, " could", false], [47816, 0.038036, " wouldn", false], [45599, 0.017827, " couldn", false], [21795, 0.014394, " had", false], [45409, 0.013113, " cannot", false]]], "qwen": [572, 1, 0.26141783595085144, [[572, 0.261418, " was", false], [1035, 0.232932, " would", false], [1030, 0.083405, " had", false], [374, 0.064521, " is", false], [686, 0.062818, " will", false], [5710, 0.039827, " wasn", false], [1521, 0.028683, " did", false], [1410, 0.025184, " could", false], [8270, 0.020922, " wouldn", false], [2765, 0.013033, " won", false]]]}, "raw_delta": 0.15482556819915771, "tuned_delta": 0.16339736022973597}, {"byte_start": 1946, "byte_end": 1950, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 325, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "6.41% 6.41% 6.41% 6.41%", "qwen": "5.50% 5.50% 5.50% 5.50%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.24128875136375427]], "qwen": [[537, " not", "normal", 0.295030802488327]]}, "loss": {"rwkv": 6.410412535199983, "qwen": 5.503320140188}, "topk": {"rwkv": [22187, 1, 0.24128875136375427, [[22187, 0.241289, " not", false], [332, 0.159051, " a", false], [31581, 0.063467, " only", false], [22590, 0.045234, " the", false], [4692, 0.037471, " no", false], [4419, 0.034066, " an", false], [57492, 0.02133, " unlikely", false], [31198, 0.02111, " just", false], [45781, 0.017322, " doomed", false], [39115, 0.012332, " never", false]]], "qwen": [537, 1, 0.295030802488327, [[537, 0.295031, " not", false], [264, 0.097277, " a", false], [1172, 0.061949, " only", false], [279, 0.038257, " the", false], [9902, 0.028887, " ``", false], [2058, 0.022418, " still", false], [2581, 0.021681, " never", false], [902, 0.018413, " no", false], [458, 0.015422, " an", false], [4969, 0.014254, " wrong", false]]]}, "raw_delta": 0.050299882888793945, "tuned_delta": 0.058871674919372195}, {"byte_start": 1950, "byte_end": 1952, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 326, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "9.79% 9.79%", "qwen": "19.45% 19.45%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.33454951643943787]], "qwen": [[264, " a", "normal", 0.11562146991491318]]}, "loss": {"rwkv": 9.79172903728349, "qwen": 19.453241410466205}, "topk": {"rwkv": [332, 1, 0.33454951643943787, [[332, 0.33455, " a", false], [22590, 0.164044, " the", false], [38606, 0.109563, " going", false], [4419, 0.046664, " an", false], [46439, 0.032817, " likely", false], [51832, 0.021246, " general", false], [30992, 0.014992, " good", false], [47008, 0.014346, " really", false], [4596, 0.011074, " in", false], [32464, 0.00847, " what", false]]], "qwen": [264, 2, 0.11562146991491318, [[279, 0.455008, " the", false], [264, 0.115621, " a", false], [2087, 0.036553, " going", false], [862, 0.026023, " their", false], [1128, 0.024629, " what", false], [2167, 0.020695, " really", false], [4586, 0.015172, " general", false], [458, 0.013861, " an", false], [14312, 0.013161, " necessarily", false], [1576, 0.007926, " because", false]]]}, "raw_delta": -0.5357480049133301, "tuned_delta": -0.5271762128827518}, {"byte_start": 1952, "byte_end": 1960, "display": {"text": " general", "kind": "normal"}, "is_word": true, "word_id": 327, "word_key": " general", "bytes_hex": "20 67 65 6e 65 72 61 6c", "compression": {"rwkv": "4.12% 4.12% 4.12% 4.12% 4.12% 4.12% 4.12% 4.12%", "qwen": "5.09% 5.09% 5.09% 5.09% 5.09% 5.09% 5.09% 5.09%"}, "model_tokens": {"rwkv": [[51832, " general", "normal", 0.16105210781097412]], "qwen": [[4586, " general", "normal", 0.10466268658638]]}, "loss": {"rwkv": 4.120979486914275, "qwen": 5.087782645968473}, "topk": {"rwkv": [51832, 1, 0.16105210781097412, [[51832, 0.161052, " general", false], [30992, 0.098127, " good", false], [46561, 0.056488, " method", false], [30811, 0.04894, " fair", false], [53283, 0.034534, " victory", false], [31835, 0.031968, " real", false], [53354, 0.027957, " winning", false], [40091, 0.022314, " valid", false], [32313, 0.022279, " true", false], [63910, 0.020254, " sustainable", false]]], "qwen": [4586, 1, 0.10466268658638, [[4586, 0.104663, " general", false], [1661, 0.085055, " good", false], [1602, 0.039174, " very", false], [1714, 0.03682, " method", false], [830, 0.034978, " true", false], [10987, 0.030614, " winning", false], [6624, 0.029465, " fair", false], [6291, 0.025684, " solution", false], [12560, 0.022494, " victory", false], [7394, 0.017502, " princip", false]]]}, "raw_delta": -0.05361095070838928, "tuned_delta": -0.04503915867781103}, {"byte_start": 1960, "byte_end": 1969, "display": {"text": " strategy", "kind": "normal"}, "is_word": true, "word_id": 328, "word_key": " strategy", "bytes_hex": "20 73 74 72 61 74 65 67 79", "compression": {"rwkv": "6.20% 6.20% 6.20% 6.20% 6.20% 6.20% 6.20% 6.20% 6.20%", "qwen": "9.24% 9.24% 9.24% 9.24% 9.24% 9.24% 9.24% 9.24% 9.24%"}, "model_tokens": {"rwkv": [[57317, " strategy", "normal", 0.04533086344599724]], "qwen": [[8282, " strategy", "normal", 0.009917660616338253]]}, "loss": {"rwkv": 6.199080253819764, "qwen": 9.244144876068852}, "topk": {"rwkv": [57317, 4, 0.04533086344599724, [[46561, 0.493444, " method", false], [55532, 0.154119, " approach", false], [57260, 0.106063, " solution", false], [57317, 0.045331, " strategy", false], [41729, 0.043446, "izable", false], [60250, 0.032022, " principle", false], [22752, 0.022479, " way", false], [46, 0.01435, "-", false], [45, 0.006075, ",", false], [53354, 0.005696, " winning", false]]], "qwen": [8282, 11, 0.009917660616338253, [[1714, 0.38849, " method", false], [5486, 0.148424, " approach", false], [8335, 0.098412, "izable", false], [6291, 0.068549, " solution", false], [58238, 0.068317, "-purpose", false], [10987, 0.02087, " winning", false], [12111, 0.01473, " algorithm", false], [7428, 0.013208, " purpose", false], [14762, 0.012738, " technique", false], [11, 0.012299, ",", false]]]}, "raw_delta": -0.1688542366027832, "tuned_delta": -0.16028244457220495}, {"byte_start": 1969, "byte_end": 1970, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "35.08%", "qwen": "33.33%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.14232106506824493]], "qwen": [[11, ",", "normal", 0.15751907229423523]]}, "loss": {"rwkv": 35.081158709116394, "qwen": 33.33002060911559}, "topk": {"rwkv": [45, 3, 0.14232106506824493, [[47, 0.377648, ".", false], [21700, 0.194098, " for", false], [45, 0.142321, ",", false], [32227, 0.125138, " that", false], [21265, 0.057005, " and", false], [60, 0.019251, ";", false], [4811, 0.01429, " to", false], [275, 0.008036, " (", false], [59, 0.005971, ":", false], [61586, 0.004592, " applicable", false]]], "qwen": [11, 3, 0.15751907229423523, [[13, 0.267979, ".", false], [429, 0.184571, " that", false], [11, 0.157519, ",", false], [369, 0.122608, " for", false], [323, 0.089749, " and", false], [26, 0.032851, ";", false], [382, 0.022751, ".\n\n", false], [8415, 0.016348, " applicable", false], [311, 0.011225, " to", false], [320, 0.009869, " (", false]]]}, "raw_delta": 0.09710371494293213, "tuned_delta": 0.10567550697351037}, {"byte_start": 1970, "byte_end": 1974, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 329, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "0.99% 0.99% 0.99% 0.99%", "qwen": "1.64% 1.64% 1.64% 1.64%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.8024763464927673]], "qwen": [[323, " and", "normal", 0.6953110098838806]]}, "loss": {"rwkv": 0.9862173131076897, "qwen": 1.6383427409866393}, "topk": {"rwkv": [21265, 1, 0.8024763464927673, [[21265, 0.802476, " and", false], [4601, 0.031419, " it", false], [4788, 0.024592, " so", false], [22185, 0.016011, " nor", false], [32227, 0.008448, " that", false], [22187, 0.008329, " not", false], [51018, 0.008077, " because", false], [40186, 0.007414, " which", false], [4423, 0.006721, " as", false], [4715, 0.006302, " or", false]]], "qwen": [323, 1, 0.6953110098838806, [[323, 0.695311, " and", false], [432, 0.04768, " it", false], [773, 0.025122, " so", false], [6329, 0.021133, " nor", false], [1576, 0.018084, " because", false], [438, 0.017532, " as", false], [2474, 0.014623, " since", false], [892, 0.014369, " which", false], [1101, 0.012344, " just", false], [537, 0.007646, " not", false]]]}, "raw_delta": -0.03616151213645935, "tuned_delta": -0.0275897201058811}, {"byte_start": 1974, "byte_end": 1981, "display": {"text": " anyway", "kind": "normal"}, "is_word": true, "word_id": 330, "word_key": " anyway", "bytes_hex": "20 61 6e 79 77 61 79", "compression": {"rwkv": "18.84% 18.84% 18.84% 18.84% 18.84% 18.84% 18.84%", "qwen": "25.02% 25.02% 25.02% 25.02% 25.02% 25.02% 25.02%"}, "model_tokens": {"rwkv": [[45179, " anyway", "normal", 0.000668044900521636]], "qwen": [[13657, " anyway", "normal", 6.052275057299994e-05]]}, "loss": {"rwkv": 18.838763368750975, "qwen": 25.021719020604834}, "topk": {"rwkv": [45179, 105, 0.000668044900521636, [[4601, 0.168485, " it", false], [32232, 0.097553, " they", false], [40219, 0.080985, " would", false], [22590, 0.077007, " the", false], [32227, 0.075758, " that", false], [4596, 0.028886, " in", false], [39934, 0.022722, " there", false], [60645, 0.019418, " therefore", false], [32465, 0.018131, " when", false], [4788, 0.017, " so", false]]], "qwen": [13657, 396, 6.052275057299994e-05, [[432, 0.176351, " it", false], [429, 0.112898, " that", false], [807, 0.084212, " they", false], [279, 0.076921, " the", false], [1035, 0.040495, " would", false], [304, 0.031902, " in", false], [862, 0.025066, " their", false], [1052, 0.022272, " there", false], [11, 0.020961, ",", false], [773, 0.020704, " so", false]]]}, "raw_delta": -0.342855862208775, "tuned_delta": -0.3342840701781968}, {"byte_start": 1981, "byte_end": 1984, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 331, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "11.04% 11.04% 11.04%", "qwen": "10.77% 10.77% 10.77%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.16004523634910583]], "qwen": [[432, " it", "normal", 0.16680200397968292]]}, "loss": {"rwkv": 11.036241360967004, "qwen": 10.765798642485237}, "topk": {"rwkv": [4601, 2, 0.16004523634910583, [[45, 0.272488, ",", false], [4601, 0.160045, " it", false], [32232, 0.113072, " they", false], [22590, 0.098783, " the", false], [37920, 0.02628, " brute", false], [39934, 0.022621, " there", false], [20184, 0.017527, " Kas", false], [38013, 0.015741, " chess", false], [4858, 0.014868, " we", false], [39931, 0.014708, " their", false]]], "qwen": [432, 2, 0.16680200397968292, [[11, 0.396045, ",", false], [432, 0.166802, " it", false], [279, 0.084714, " the", false], [807, 0.055127, " they", false], [9902, 0.024949, " ``", false], [1052, 0.022042, " there", false], [37542, 0.019368, " Kas", false], [429, 0.012784, " that", false], [862, 0.012405, " their", false], [32719, 0.011599, " chess", false]]]}, "raw_delta": 0.014996528625488281, "tuned_delta": 0.02356832065606653}, {"byte_start": 1984, "byte_end": 1988, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 332, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "4.00% 4.00% 4.00% 4.00%", "qwen": "4.60% 4.60% 4.60% 4.60%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.41470974683761597]], "qwen": [[572, " was", "normal", 0.3602137267589569]]}, "loss": {"rwkv": 3.997702322775814, "qwen": 4.6033591132832}, "topk": {"rwkv": [22748, 1, 0.41470974683761597, [[22748, 0.41471, " was", false], [40219, 0.093539, " would", false], [21795, 0.083712, " had", false], [21532, 0.038062, " did", false], [57101, 0.032465, " required", false], [4600, 0.030558, " is", false], [38128, 0.027898, " could", false], [32272, 0.021889, " took", false], [30633, 0.017073, " didn", false], [32445, 0.015023, " wasn", false]]], "qwen": [572, 1, 0.3602137267589569, [[572, 0.360214, " was", false], [1035, 0.139555, " would", false], [1030, 0.070819, " had", false], [1521, 0.059803, " did", false], [374, 0.039697, " is", false], [1410, 0.034259, " could", false], [2567, 0.022039, " required", false], [3867, 0.017384, " took", false], [3207, 0.012466, " didn", false], [5710, 0.011562, " wasn", false]]]}, "raw_delta": -0.03358474373817444, "tuned_delta": -0.02501295170759619}, {"byte_start": 1988, "byte_end": 1992, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 333, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "6.76% 6.76% 6.76% 6.76%", "qwen": "7.19% 7.19% 7.19% 7.19%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.22291997075080872]], "qwen": [[537, " not", "normal", 0.2031400054693222]]}, "loss": {"rwkv": 6.762633004167015, "qwen": 7.185793091940252}, "topk": {"rwkv": [22187, 1, 0.22291997075080872, [[22187, 0.22292, " not", false], [22614, 0.064934, " too", false], [332, 0.059773, " a", false], [31581, 0.034407, " only", false], [31198, 0.024346, " just", false], [55725, 0.020326, " cheating", false], [4692, 0.016252, " no", false], [4788, 0.015378, " so", false], [4419, 0.013394, " an", false], [4404, 0.013135, " ``", false]]], "qwen": [537, 1, 0.2031400054693222, [[537, 0.20314, " not", false], [264, 0.068181, " a", false], [2238, 0.048861, " too", false], [1172, 0.045624, " only", false], [279, 0.023624, " the", false], [1101, 0.018506, " just", false], [3118, 0.017074, " based", false], [458, 0.014615, " an", false], [9902, 0.013939, " ``", false], [2588, 0.010936, " hard", false]]]}, "raw_delta": -0.023464977741241455, "tuned_delta": -0.014893185710663207}, {"byte_start": 1992, "byte_end": 1996, "display": {"text": " how", "kind": "normal"}, "is_word": true, "word_id": 334, "word_key": " how", "bytes_hex": "20 68 6f 77", "compression": {"rwkv": "19.58% 19.58% 19.58% 19.58%", "qwen": "22.53% 22.53% 22.53% 22.53%"}, "model_tokens": {"rwkv": [[21835, " how", "normal", 0.013002678751945496]], "qwen": [[1246, " how", "normal", 0.00675914017483592]]}, "loss": {"rwkv": 19.58345807456698, "qwen": 22.52795154215777}, "topk": {"rwkv": [21835, 14, 0.013002678751945496, [[332, 0.11312, " a", false], [22590, 0.05675, " the", false], [32386, 0.05119, " very", false], [47008, 0.043505, " really", false], [30992, 0.0394, " good", false], [30788, 0.035621, " even", false], [32464, 0.029665, " what", false], [4423, 0.027903, " as", false], [4404, 0.022892, " ``", false], [38606, 0.022005, " going", false]]], "qwen": [1246, 25, 0.00675914017483592, [[279, 0.142635, " the", false], [264, 0.096139, " a", false], [1128, 0.042469, " what", false], [862, 0.025291, " their", false], [1602, 0.023666, " very", false], [4586, 0.017903, " general", false], [438, 0.017367, " as", false], [3204, 0.016983, " possible", false], [2797, 0.01667, " clear", false], [2087, 0.016029, " going", false]]]}, "raw_delta": -0.16327738761901855, "tuned_delta": -0.1547055955884403}, {"byte_start": 1996, "byte_end": 2003, "display": {"text": " people", "kind": "normal"}, "is_word": true, "word_id": 335, "word_key": " people", "bytes_hex": "20 70 65 6f 70 6c 65", "compression": {"rwkv": "8.33% 8.33% 8.33% 8.33% 8.33% 8.33% 8.33%", "qwen": "12.17% 12.17% 12.17% 12.17% 12.17% 12.17% 12.17%"}, "model_tokens": {"rwkv": [[46787, " people", "normal", 0.03884807601571083]], "qwen": [[1251, " people", "normal", 0.00887445081025362]]}, "loss": {"rwkv": 8.33252995156293, "qwen": 12.171654442663186}, "topk": {"rwkv": [46787, 6, 0.03884807601571083, [[32232, 0.287569, " they", false], [46227, 0.184412, " humans", false], [38013, 0.072462, " chess", false], [38720, 0.060286, " human", false], [22590, 0.055845, " the", false], [46787, 0.038848, " people", false], [4858, 0.036273, " we", false], [59345, 0.035608, " computers", false], [332, 0.032924, " a", false], [22226, 0.026625, " one", false]]], "qwen": [1251, 12, 0.00887445081025362, [[807, 0.505775, " they", false], [32719, 0.172376, " chess", false], [279, 0.065239, " the", false], [12677, 0.054809, " humans", false], [18495, 0.032193, " computers", false], [37542, 0.024116, " Kas", false], [862, 0.017381, " their", false], [264, 0.014293, " a", false], [432, 0.012555, " it", false], [3738, 0.011437, " human", false]]]}, "raw_delta": -0.21288626534598218, "tuned_delta": -0.20431447331540392}, {"byte_start": 2003, "byte_end": 2010, "display": {"text": " played", "kind": "normal"}, "is_word": true, "word_id": 336, "word_key": " played", "bytes_hex": "20 70 6c 61 79 65 64", "compression": {"rwkv": "2.74% 2.74% 2.74% 2.74% 2.74% 2.74% 2.74%", "qwen": "2.96% 2.96% 2.96% 2.96% 2.96% 2.96% 2.96%"}, "model_tokens": {"rwkv": [[46840, " played", "normal", 0.3473087251186371]], "qwen": [[6342, " played", "normal", 0.31700965762138367]]}, "loss": {"rwkv": 2.737256215972363, "qwen": 2.9596451391318017}, "topk": {"rwkv": [46840, 1, 0.3473087251186371, [[46840, 0.347309, " played", false], [31702, 0.25139, " play", false], [55448, 0.045466, " actually", false], [39942, 0.044385, " think", false], [56714, 0.043096, " normally", false], [53137, 0.038729, " thought", false], [40219, 0.025537, " would", false], [47008, 0.016811, " really", false], [47333, 0.015898, " solved", false], [53248, 0.014591, " usually", false]]], "qwen": [6342, 1, 0.31700965762138367, [[6342, 0.31701, " played", false], [1486, 0.260489, " play", false], [1744, 0.073582, " think", false], [3381, 0.072214, " thought", false], [3520, 0.031797, " actually", false], [1030, 0.023478, " had", false], [14279, 0.016623, " normally", false], [11136, 0.015295, " typically", false], [9498, 0.011615, " learned", false], [5990, 0.011504, " usually", false]]]}, "raw_delta": -0.012331860406058187, "tuned_delta": -0.003760068375479939}, {"byte_start": 2010, "byte_end": 2016, "display": {"text": " chess", "kind": "normal"}, "is_word": true, "word_id": 337, "word_key": " chess", "bytes_hex": "20 63 68 65 73 73", "compression": {"rwkv": "1.20% 1.20% 1.20% 1.20% 1.20% 1.20%", "qwen": "0.36% 0.36% 0.36% 0.36% 0.36% 0.36%"}, "model_tokens": {"rwkv": [[38013, " chess", "normal", 0.6706175804138184]], "qwen": [[32719, " chess", "normal", 0.8862245678901672]]}, "loss": {"rwkv": 1.2034199356373594, "qwen": 0.36303296000348356}, "topk": {"rwkv": [38013, 1, 0.6706175804138184, [[38013, 0.670618, " chess", false], [47, 0.164079, ".", false], [22590, 0.09552, " the", false], [45, 0.022467, ",", false], [275, 0.007571, " (", false], [4715, 0.005695, " or", false], [21265, 0.005432, " and", false], [4596, 0.002739, " in", false], [38576, 0.002639, " games", false], [60, 0.002549, ";", false]]], "qwen": [32719, 1, 0.8862245678901672, [[32719, 0.886225, " chess", false], [279, 0.046825, " the", false], [13, 0.031141, ".", false], [11, 0.006314, ",", false], [3868, 0.003067, " games", false], [382, 0.002365, ".\n\n", false], [320, 0.002193, " (", false], [304, 0.001716, " in", false], [862, 0.001423, " their", false], [323, 0.001294, " and", false]]]}, "raw_delta": 0.04660094901919365, "tuned_delta": 0.0551727410497719}, {"byte_start": 2016, "byte_end": 2017, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "4.93%", "qwen": "7.36%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.7578884959220886]], "qwen": [[13, ".", "normal", 0.6647235751152039]]}, "loss": {"rwkv": 4.931086565538449, "qwen": 7.364670097319523}, "topk": {"rwkv": [47, 1, 0.7578884959220886, [[47, 0.757888, ".", false], [45, 0.108649, ",", false], [275, 0.028499, " (", false], [45179, 0.014494, " anyway", false], [34, 0.013592, "!", false], [4596, 0.010393, " in", false], [21265, 0.010356, " and", false], [60, 0.007991, ";", false], [4715, 0.005646, " or", false], [4788, 0.003098, " so", false]]], "qwen": [13, 1, 0.6647235751152039, [[13, 0.664724, ".", false], [11, 0.093925, ",", false], [382, 0.059952, ".\n\n", false], [320, 0.025962, " (", false], [304, 0.022525, " in", false], [13657, 0.021117, " anyway", false], [26, 0.015994, ";", false], [624, 0.009761, ".\n", false], [323, 0.009525, " and", false], [1573, 0.007049, " before", false]]]}, "raw_delta": -0.1349465250968933, "tuned_delta": -0.12637473306631505}, {"byte_start": 2017, "byte_end": 2023, "display": {"text": " These", "kind": "normal"}, "is_word": true, "word_id": 338, "word_key": " these", "bytes_hex": "20 54 68 65 73 65", "compression": {"rwkv": "13.43% 13.43% 13.43% 13.43% 13.43% 13.43%", "qwen": "13.75% 13.75% 13.75% 13.75% 13.75% 13.75%"}, "model_tokens": {"rwkv": [[37453, " These", "normal", 0.011329433880746365]], "qwen": [[4220, " These", "normal", 0.010298359207808971]]}, "loss": {"rwkv": 13.43134054994282, "qwen": 13.753004001417803}, "topk": {"rwkv": [37453, 15, 0.011329433880746365, [[261, 0.154872, "\n\n", false], [29893, 0.095155, " They", false], [267, 0.074251, "  ", false], [20996, 0.072246, " The", false], [19555, 0.042003, " But", false], [29894, 0.039349, " This", false], [3913, 0.037968, " In", false], [3918, 0.028282, " It", false], [275, 0.022757, " (", false], [19417, 0.017849, " And", false]]], "qwen": [4220, 16, 0.010298359207808971, [[2379, 0.138351, " They", false], [220, 0.111454, " ", false], [576, 0.09405, " The", false], [1096, 0.040878, " This", false], [1084, 0.038529, " It", false], [758, 0.035303, " In", false], [1597, 0.02738, " And", false], [10964, 0.026182, " Their", false], [1988, 0.024559, " But", false], [320, 0.024182, " (", false]]]}, "raw_delta": -0.017836809158325195, "tuned_delta": -0.009265017127746947}, {"byte_start": 2023, "byte_end": 2035, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 339, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"rwkv": "2.90% 2.90% 2.90% 2.90% 2.90% 2.90% 2.90% 2.90% 2.90% 2.90% 2.90% 2.90%", "qwen": "0.81% 0.81% 0.81% 0.81% 0.81% 0.81% 0.81% 0.81% 0.81% 0.81% 0.81% 0.81%"}, "model_tokens": {"rwkv": [[63843, " researchers", "normal", 0.14677117764949799]], "qwen": [[11811, " researchers", "normal", 0.5851952433586121]]}, "loss": {"rwkv": 2.899948527828564, "qwen": 0.8052188300705875}, "topk": {"rwkv": [63843, 1, 0.14677117764949799, [[63843, 0.146771, " researchers", false], [46787, 0.141002, " people", false], [32462, 0.086447, " were", false], [38720, 0.06432, " human", false], [38013, 0.025646, " chess", false], [31937, 0.024281, " same", false], [21286, 0.023734, " are", false], [59165, 0.023505, " arguments", false], [40119, 0.016835, " views", false], [61803, 0.015363, " criticisms", false]]], "qwen": [11811, 1, 0.5851952433586121, [[11811, 0.585195, " researchers", false], [3738, 0.069799, " human", false], [32719, 0.031066, " chess", false], [1033, 0.029196, " were", false], [1251, 0.026365, " people", false], [1852, 0.025132, " same", false], [525, 0.018851, " are", false], [5413, 0.014455, " methods", false], [6366, 0.013637, " computer", false], [9902, 0.008271, " ``", false]]]}, "raw_delta": 0.11615647872289016, "tuned_delta": 0.1247282707534684}, {"byte_start": 2035, "byte_end": 2042, "display": {"text": " wanted", "kind": "normal"}, "is_word": true, "word_id": 340, "word_key": " wanted", "bytes_hex": "20 77 61 6e 74 65 64", "compression": {"rwkv": "14.97% 14.97% 14.97% 14.97% 14.97% 14.97% 14.97%", "qwen": "13.46% 13.46% 13.46% 13.46% 13.46% 13.46% 13.46%"}, "model_tokens": {"rwkv": [[47763, " wanted", "normal", 0.002969448920339346]], "qwen": [[4829, " wanted", "normal", 0.005385169759392738]]}, "loss": {"rwkv": 14.974401652084108, "qwen": 13.458558851854368}, "topk": {"rwkv": [47763, 48, 0.002969448920339346, [[32462, 0.22819, " were", false], [21795, 0.087504, " had", false], [40, 0.058233, "'", false], [21532, 0.042336, " did", false], [45, 0.034351, ",", false], [31059, 0.020011, " have", false], [21286, 0.019543, " are", false], [40219, 0.017185, " would", false], [30135, 0.015096, " also", false], [38128, 0.012906, " could", false]]], "qwen": [4829, 30, 0.005385169759392738, [[1033, 0.212382, " were", false], [1030, 0.053234, " had", false], [1521, 0.046063, " did", false], [1083, 0.040398, " also", false], [11, 0.032438, ",", false], [6, 0.021224, "'", false], [11585, 0.020043, " believed", false], [1053, 0.017736, " said", false], [525, 0.016484, " are", false], [614, 0.014885, " have", false]]]}, "raw_delta": 0.08405617305210666, "tuned_delta": 0.09262796508268491}, {"byte_start": 2042, "byte_end": 2050, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 341, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "9.72% 9.72% 9.72% 9.72% 9.72% 9.72% 9.72% 9.72%", "qwen": "12.30% 12.30% 12.30% 12.30% 12.30% 12.30% 12.30% 12.30%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.013591461814939976]], "qwen": [[5413, " methods", "normal", 0.004273268394172192]]}, "loss": {"rwkv": 9.721284943490085, "qwen": 12.29756893004144}, "topk": {"rwkv": [52224, 6, 0.013591461814939976, [[4811, 0.664396, " to", false], [332, 0.068835, " a", false], [39931, 0.060808, " their", false], [22590, 0.029243, " the", false], [38013, 0.016546, " chess", false], [52224, 0.013591, " methods", false], [4419, 0.013344, " an", false], [31458, 0.009715, " more", false], [45, 0.007355, ",", false], [38720, 0.007183, " human", false]]], "qwen": [5413, 10, 0.004273268394172192, [[311, 0.74202, " to", false], [264, 0.061502, " a", false], [279, 0.032519, " the", false], [862, 0.027466, " their", false], [803, 0.01411, " more", false], [3738, 0.009216, " human", false], [458, 0.008059, " an", false], [32719, 0.006059, " chess", false], [2494, 0.005639, " something", false], [5413, 0.004273, " methods", false]]]}, "raw_delta": -0.14285951852798462, "tuned_delta": -0.13428772649740636}, {"byte_start": 2050, "byte_end": 2056, "display": {"text": " based", "kind": "normal"}, "is_word": true, "word_id": 342, "word_key": " based", "bytes_hex": "20 62 61 73 65 64", "compression": {"rwkv": "9.06% 9.06% 9.06% 9.06% 9.06% 9.06%", "qwen": "7.00% 7.00% 7.00% 7.00% 7.00% 7.00%"}, "model_tokens": {"rwkv": [[37810, " based", "normal", 0.0484761968255043]], "qwen": [[3118, " based", "normal", 0.09755192697048187]]}, "loss": {"rwkv": 9.063806734751624, "qwen": 6.995178628936783}, "topk": {"rwkv": [37810, 3, 0.0484761968255043, [[32227, 0.763646, " that", false], [4811, 0.075396, " to", false], [37810, 0.048476, " based", false], [21700, 0.030739, " for", false], [4706, 0.011632, " of", false], [32232, 0.009019, " they", false], [32487, 0.005753, " with", false], [4596, 0.004702, " in", false], [45, 0.003848, ",", false], [31458, 0.003551, " more", false]]], "qwen": [3118, 2, 0.09755192697048187, [[429, 0.764439, " that", false], [3118, 0.097552, " based", false], [311, 0.034021, " to", false], [1075, 0.013267, " like", false], [315, 0.012646, " of", false], [369, 0.011456, " for", false], [448, 0.006683, " with", false], [4428, 0.004272, " similar", false], [803, 0.003858, " more", false], [76482, 0.003539, " leveraging", false]]]}, "raw_delta": 0.11470909913380938, "tuned_delta": 0.12328089116438762}, {"byte_start": 2056, "byte_end": 2059, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 343, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"rwkv": "0.19% 0.19% 0.19%", "qwen": "0.25% 0.25% 0.25%"}, "model_tokens": {"rwkv": [[4712, " on", "normal", 0.9695175290107727]], "qwen": [[389, " on", "normal", 0.959489107131958]]}, "loss": {"rwkv": 0.18564953885137314, "qwen": 0.24859024008723393}, "topk": {"rwkv": [4712, 1, 0.9695175290107727, [[4712, 0.969518, " on", false], [32350, 0.006262, " upon", false], [31458, 0.005079, " more", false], [4596, 0.003877, " in", false], [22187, 0.003003, " not", false], [31581, 0.001197, " only", false], [56003, 0.001081, " directly", false], [46957, 0.000884, " purely", false], [52028, 0.00077, " instead", false], [4423, 0.000643, " as", false]]], "qwen": [389, 1, 0.959489107131958, [[389, 0.959489, " on", false], [803, 0.008495, " more", false], [304, 0.007239, " in", false], [5193, 0.006055, " upon", false], [537, 0.002056, " not", false], [21063, 0.001594, " solely", false], [2163, 0.001537, " around", false], [1172, 0.001132, " only", false], [31127, 0.001066, " purely", false], [11, 0.001, ",", false]]]}, "raw_delta": -0.0034901735683282222, "tuned_delta": 0.005081618462250026}, {"byte_start": 2059, "byte_end": 2065, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 344, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "3.15% 3.15% 3.15% 3.15% 3.15% 3.15%", "qwen": "2.34% 2.34% 2.34% 2.34% 2.34% 2.34%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.35164931416511536]], "qwen": [[3738, " human", "normal", 0.4591285288333893]]}, "loss": {"rwkv": 3.146502856105486, "qwen": 2.3396458912854303}, "topk": {"rwkv": [38720, 1, 0.35164931416511536, [[38720, 0.351649, " human", false], [39931, 0.106248, " their", false], [22590, 0.074814, " the", false], [65034, 0.047961, " understanding", false], [51832, 0.034556, " general", false], [30597, 0.030661, " deep", false], [332, 0.028802, " a", false], [38013, 0.024469, " chess", false], [59943, 0.020981, " knowledge", false], [32464, 0.013386, " what", false]]], "qwen": [3738, 1, 0.4591285288333893, [[3738, 0.459129, " human", false], [862, 0.141376, " their", false], [279, 0.061694, " the", false], [4586, 0.028779, " general", false], [264, 0.02666, " a", false], [8660, 0.018119, " understanding", false], [6540, 0.016029, " knowledge", false], [76482, 0.014361, " leveraging", false], [5538, 0.012181, " deep", false], [70601, 0.009768, " exploiting", false]]]}, "raw_delta": 0.044741650422414125, "tuned_delta": 0.053313442452992375}, {"byte_start": 2065, "byte_end": 2071, "display": {"text": " input", "kind": "normal"}, "is_word": true, "word_id": 345, "word_key": " input", "bytes_hex": "20 69 6e 70 75 74", "compression": {"rwkv": "25.55% 25.55% 25.55% 25.55% 25.55% 25.55%", "qwen": "24.75% 24.75% 24.75% 24.75% 24.75% 24.75%"}, "model_tokens": {"rwkv": [[38786, " input", "normal", 0.0002019024977926165]], "qwen": [[1946, " input", "normal", 0.00026557513047009706]]}, "loss": {"rwkv": 25.547724682408727, "qwen": 24.747068050449464}, "topk": {"rwkv": [38786, 72, 0.0002019024977926165, [[59943, 0.43564, " knowledge", false], [65034, 0.339619, " understanding", false], [59683, 0.040743, " expertise", false], [46, 0.034344, "-", false], [38013, 0.02655, " chess", false], [31702, 0.014614, " play", false], [59917, 0.010166, " intuition", false], [62418, 0.007823, " psychology", false], [60323, 0.00728, " reasoning", false], [52022, 0.00606, " insight", false]]], "qwen": [1946, 53, 0.00026557513047009706, [[6540, 0.446881, " knowledge", false], [8660, 0.339385, " understanding", false], [12646, 0.115004, "-k", false], [18726, 0.016356, " expertise", false], [56251, 0.010285, " intuition", false], [71107, 0.004593, "-under", false], [32719, 0.004265, " chess", false], [32711, 0.003989, " reasoning", false], [20017, 0.003962, " insight", false], [12681, 0.002659, "-like", false]]]}, "raw_delta": 0.044397830963134766, "tuned_delta": 0.052969622993713016}, {"byte_start": 2071, "byte_end": 2074, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 346, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "16.06% 16.06% 16.06%", "qwen": "12.74% 12.74% 12.74%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.0680377185344696]], "qwen": [[311, " to", "normal", 0.12003070116043091]]}, "loss": {"rwkv": 16.061253384896663, "qwen": 12.743852801817559}, "topk": {"rwkv": [4811, 5, 0.0680377185344696, [[45, 0.329605, ",", false], [21265, 0.164667, " and", false], [47, 0.136455, ".", false], [32227, 0.082538, " that", false], [4811, 0.068038, " to", false], [4706, 0.038071, " of", false], [31162, 0.033628, " into", false], [60, 0.01405, ";", false], [47001, 0.012615, " rather", false], [275, 0.01243, " (", false]]], "qwen": [311, 3, 0.12003070116043091, [[11, 0.312136, ",", false], [323, 0.121356, " and", false], [311, 0.120031, " to", false], [13, 0.104371, ".", false], [315, 0.044556, " of", false], [429, 0.036089, " that", false], [320, 0.025742, " (", false], [304, 0.018819, " in", false], [369, 0.017285, " for", false], [4751, 0.017163, " rather", false]]]}, "raw_delta": 0.1839557488759359, "tuned_delta": 0.19252754090651417}, {"byte_start": 2074, "byte_end": 2078, "display": {"text": " win", "kind": "normal"}, "is_word": true, "word_id": 347, "word_key": " win", "bytes_hex": "20 77 69 6e", "compression": {"rwkv": "12.05% 12.05% 12.05% 12.05%", "qwen": "17.09% 17.09% 17.09% 17.09%"}, "model_tokens": {"rwkv": [[22770, " win", "normal", 0.06979643553495407]], "qwen": [[3164, " win", "normal", 0.022558091208338737]]}, "loss": {"rwkv": 12.045940038672496, "qwen": 17.09441013788265}, "topk": {"rwkv": [22770, 3, 0.06979643553495407, [[4435, 0.203171, " be", false], [22590, 0.109735, " the", false], [22770, 0.069796, " win", false], [30256, 0.033785, " beat", false], [38013, 0.027678, " chess", false], [47059, 0.026664, " remain", false], [31702, 0.020708, " play", false], [51982, 0.020194, " improve", false], [55851, 0.018556, " continue", false], [32499, 0.015507, " work", false]]], "qwen": [3164, 6, 0.022558091208338737, [[387, 0.205114, " be", false], [279, 0.061523, " the", false], [1486, 0.047995, " play", false], [8474, 0.047719, " guide", false], [7269, 0.041327, " improve", false], [3164, 0.022558, " win", false], [11625, 0.022102, " solve", false], [1281, 0.021222, " make", false], [975, 0.018889, " work", false], [32719, 0.017693, " chess", false]]]}, "raw_delta": -0.27994662523269653, "tuned_delta": -0.2713748332021183}, {"byte_start": 2078, "byte_end": 2082, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 348, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "26.21% 26.21% 26.21% 26.21%", "qwen": "21.92% 21.92% 21.92% 21.92%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.0029539780225604773]], "qwen": [[323, " and", "normal", 0.007743414957076311]]}, "loss": {"rwkv": 26.205202891147184, "qwen": 21.915044070579164}, "topk": {"rwkv": [21265, 23, 0.0029539780225604773, [[22590, 0.176022, " the", false], [45, 0.160544, ",", false], [37635, 0.139895, " again", false], [4596, 0.122245, " in", false], [38013, 0.09006, " chess", false], [47, 0.071366, ".", false], [50870, 0.026514, " against", false], [46064, 0.024483, " future", false], [4424, 0.015812, " at", false], [4712, 0.01217, " on", false]]], "qwen": [323, 16, 0.007743414957076311, [[11, 0.236852, ",", false], [279, 0.183753, " the", false], [32719, 0.144311, " chess", false], [13, 0.087307, ".", false], [518, 0.040148, " at", false], [304, 0.030065, " in", false], [1182, 0.021278, " back", false], [1549, 0.018115, " again", false], [678, 0.017551, " all", false], [803, 0.014423, " more", false]]]}, "raw_delta": 0.23789691925048828, "tuned_delta": 0.24646871128106654}, {"byte_start": 2082, "byte_end": 2087, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 349, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"rwkv": "10.03% 10.03% 10.03% 10.03% 10.03%", "qwen": "6.67% 6.67% 6.67% 6.67% 6.67%"}, "model_tokens": {"rwkv": [[32462, " were", "normal", 0.06204770505428314]], "qwen": [[1033, " were", "normal", 0.1573631316423416]]}, "loss": {"rwkv": 10.031238956181074, "qwen": 6.669576201481539}, "topk": {"rwkv": [32462, 3, 0.06204770505428314, [[32232, 0.132566, " they", false], [45, 0.070691, ",", false], [32462, 0.062048, " were", false], [4811, 0.049485, " to", false], [22187, 0.030569, " not", false], [4788, 0.027509, " so", false], [21795, 0.026674, " had", false], [21532, 0.021734, " did", false], [22777, 0.021721, " won", false], [22590, 0.020569, " the", false]]], "qwen": [1033, 1, 0.1573631316423416, [[1033, 0.157363, " were", false], [11, 0.057803, ",", false], [537, 0.046059, " not", false], [807, 0.045585, " they", false], [311, 0.04225, " to", false], [773, 0.031472, " so", false], [11585, 0.03093, " believed", false], [1521, 0.029817, " did", false], [1035, 0.022363, " would", false], [1030, 0.015981, " had", false]]]}, "raw_delta": 0.18641016483306888, "tuned_delta": 0.19498195686364714}, {"byte_start": 2087, "byte_end": 2100, "display": {"text": " disappointed", "kind": "normal"}, "is_word": true, "word_id": 350, "word_key": " disappointed", "bytes_hex": "20 64 69 73 61 70 70 6f 69 6e 74 65 64", "compression": {"rwkv": "4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66% 4.66%", "qwen": "4.56% 4.56% 4.56% 4.56% 4.56% 4.56% 4.56% 4.56% 4.56% 4.56% 4.56% 4.56% 4.56%"}, "model_tokens": {"rwkv": [[64362, " disappointed", "normal", 0.03446732833981514]], "qwen": [[24402, " disappointed", "normal", 0.03749189153313637]]}, "loss": {"rwkv": 4.660147743256117, "qwen": 4.555074611975615}, "topk": {"rwkv": [64362, 3, 0.03446732833981514, [[22187, 0.217453, " not", false], [60713, 0.048667, " unwilling", false], [64362, 0.034467, " disappointed", false], [32239, 0.029944, " thus", false], [53350, 0.022808, " willing", false], [62028, 0.019999, " frustrated", false], [45756, 0.014221, " dismay", false], [60374, 0.013732, " reluctant", false], [61853, 0.013632, " determined", false], [60645, 0.013492, " therefore", false]]], "qwen": [24402, 4, 0.03749189153313637, [[537, 0.212352, " not", false], [45143, 0.057787, " unwilling", false], [9831, 0.049617, " willing", false], [24402, 0.037492, " disappointed", false], [6247, 0.029933, " happy", false], [14453, 0.021838, " surprised", false], [1602, 0.015655, " very", false], [10030, 0.014863, " prepared", false], [8450, 0.012646, " thus", false], [42940, 0.011894, " reluctant", false]]]}, "raw_delta": 0.005826491575974702, "tuned_delta": 0.01439828360655295}, {"byte_start": 2100, "byte_end": 2105, "display": {"text": " when", "kind": "normal"}, "is_word": true, "word_id": 351, "word_key": " when", "bytes_hex": "20 77 68 65 6e", "compression": {"rwkv": "3.72% 3.72% 3.72% 3.72% 3.72%", "qwen": "3.83% 3.83% 3.83% 3.83% 3.83%"}, "model_tokens": {"rwkv": [[32465, " when", "normal", 0.35685861110687256]], "qwen": [[979, " when", "normal", 0.34567907452583313]]}, "loss": {"rwkv": 3.719448152291858, "qwen": 3.8312368753526838}, "topk": {"rwkv": [32465, 1, 0.35685861110687256, [[32465, 0.356859, " when", false], [32227, 0.257545, " that", false], [47, 0.097154, ".", false], [4811, 0.083437, " to", false], [4450, 0.061366, " by", false], [4596, 0.028412, " in", false], [45, 0.019553, ",", false], [4424, 0.019265, " at", false], [32487, 0.014428, " with", false], [21265, 0.012572, " and", false]]], "qwen": [979, 1, 0.34567907452583313, [[979, 0.345679, " when", false], [429, 0.229684, " that", false], [311, 0.205805, " to", false], [553, 0.114107, " by", false], [448, 0.034713, " with", false], [323, 0.011793, " and", false], [304, 0.011361, " in", false], [518, 0.009385, " at", false], [11, 0.007122, ",", false], [537, 0.00442, " not", false]]]}, "raw_delta": -0.006198883056640625, "tuned_delta": 0.0023729089739376232}, {"byte_start": 2105, "byte_end": 2110, "display": {"text": " they", "kind": "normal"}, "is_word": true, "word_id": 352, "word_key": " they", "bytes_hex": "20 74 68 65 79", "compression": {"rwkv": "4.14% 4.14% 4.14% 4.14% 4.14%", "qwen": "5.51% 5.51% 5.51% 5.51% 5.51%"}, "model_tokens": {"rwkv": [[32232, " they", "normal", 0.31571972370147705]], "qwen": [[807, " they", "normal", 0.21718207001686096]]}, "loss": {"rwkv": 4.1421127150522965, "qwen": 5.50755779270526}, "topk": {"rwkv": [32232, 1, 0.31571972370147705, [[32232, 0.31572, " they", false], [22590, 0.131504, " the", false], [37920, 0.105664, " brute", false], [4601, 0.061405, " it", false], [39931, 0.056841, " their", false], [332, 0.049243, " a", false], [47202, 0.029884, " search", false], [52224, 0.027449, " methods", false], [32234, 0.026024, " this", false], [32227, 0.021355, " that", false]]], "qwen": [807, 1, 0.21718207001686096, [[807, 0.217182, " they", false], [279, 0.146606, " the", false], [862, 0.087454, " their", false], [2711, 0.058103, " search", false], [432, 0.040035, " it", false], [1741, 0.038384, " such", false], [64098, 0.038306, " brute", false], [419, 0.037, " this", false], [264, 0.031455, " a", false], [429, 0.029938, " that", false]]]}, "raw_delta": -0.07571635246276859, "tuned_delta": -0.06714456043219034}, {"byte_start": 2110, "byte_end": 2114, "display": {"text": " did", "kind": "normal"}, "is_word": true, "word_id": 353, "word_key": " did", "bytes_hex": "20 64 69 64", "compression": {"rwkv": "5.04% 5.04% 5.04% 5.04%", "qwen": "8.23% 8.23% 8.23% 8.23%"}, "model_tokens": {"rwkv": [[21532, " did", "normal", 0.3273182213306427]], "qwen": [[1521, " did", "normal", 0.1610872596502304]]}, "loss": {"rwkv": 5.036752706228558, "qwen": 8.231518014583825}, "topk": {"rwkv": [21532, 1, 0.3273182213306427, [[21532, 0.327318, " did", false], [30633, 0.185, " didn", false], [31334, 0.114422, " lost", false], [45953, 0.111483, " failed", false], [32462, 0.064871, " were", false], [38128, 0.018362, " could", false], [38547, 0.016022, " found", false], [46936, 0.009529, " proved", false], [30383, 0.009396, " came", false], [45599, 0.008578, " couldn", false]]], "qwen": [1521, 1, 0.1610872596502304, [[1521, 0.161087, " did", false], [1033, 0.117427, " were", false], [1730, 0.114327, " found", false], [9498, 0.108848, " learned", false], [5485, 0.076586, " saw", false], [4641, 0.070985, " failed", false], [1410, 0.044698, " could", false], [11105, 0.033996, " discovered", false], [3207, 0.028945, " didn", false], [15043, 0.02417, " realized", false]]]}, "raw_delta": -0.17715540528297424, "tuned_delta": -0.168583613252396}, {"byte_start": 2114, "byte_end": 2118, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 354, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "0.07% 0.07% 0.07% 0.07%", "qwen": "0.03% 0.03% 0.03% 0.03%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.9849550724029541]], "qwen": [[537, " not", "normal", 0.9942071437835693]]}, "loss": {"rwkv": 0.06824271586236245, "qwen": 0.02619250425652555}, "topk": {"rwkv": [22187, 1, 0.9849550724029541, [[22187, 0.984955, " not", false], [47, 0.008415, ".", false], [4788, 0.001999, " so", false], [45, 0.00102, ",", false], [22770, 0.000965, " win", false], [45301, 0.000136, " better", false], [31332, 0.000135, " lose", false], [22590, 0.000112, " the", false], [4692, 0.000108, " no", false], [275, 0.000108, " (", false]]], "qwen": [537, 1, 0.9942071437835693, [[537, 0.994207, " not", false], [13, 0.001272, ".", false], [279, 0.000411, " the", false], [902, 0.00031, " no", false], [773, 0.000306, " so", false], [382, 0.000292, ".\n\n", false], [11, 0.000233, ",", false], [4302, 0.000182, " nothing", false], [2664, 0.000141, " better", false], [4518, 0.000124, " instead", false]]]}, "raw_delta": 0.002331758849322796, "tuned_delta": 0.010903550879901044}, {"byte_start": 2118, "byte_end": 2120, "display": {"text": ".\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e 0a", "compression": {"rwkv": "2.84% 8.45%", "qwen": "16.34% 16.34%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.8558160662651062], [261, "\n\n", "control", 0.3931463956832886]], "qwen": [[382, ".\n\n", "control", 0.06594829261302948]]}, "loss": {"rwkv": 5.644333015196689, "qwen": 16.343836645340584}, "topk": {"rwkv": [47, 1, 0.8558160662651062, [[47, 0.855816, ".", false], [45, 0.039462, ",", false], [22770, 0.031375, " win", false], [32499, 0.019109, " work", false], [4491, 0.004912, " do", false], [275, 0.0049, " (", false], [53051, 0.004546, " succeed", false], [60, 0.004252, ";", false], [4596, 0.002915, " in", false], [30482, 0.001322, " come", false]]], "qwen": [382, 5, 0.06594829261302948, [[13, 0.292512, ".", false], [3164, 0.140883, " win", false], [633, 0.097434, " get", false], [1477, 0.067145, " find", false], [382, 0.065948, ".\n\n", false], [11996, 0.057187, " succeed", false], [614, 0.046361, " have", false], [1490, 0.02706, " see", false], [11, 0.022252, ",", false], [975, 0.018473, " work", false]]]}, "raw_delta": -0.5933064619700114, "tuned_delta": -0.5847346699394331}, {"byte_start": 2120, "byte_end": 2121, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "8.45%", "qwen": "16.34%"}, "model_tokens": {"rwkv": [[261, "\n\n", "control", 0.3931463956832886]], "qwen": [[382, ".\n\n", "control", 0.06594829261302948]]}, "loss": {"rwkv": 8.45329125520877, "qwen": 16.343836645340584}, "topk": {"rwkv": [261, 1, 0.3931463956832886, [[261, 0.393146, "\n\n", false], [267, 0.07657, "  ", false], [29893, 0.060086, " They", false], [20996, 0.041803, " The", false], [19555, 0.035121, " But", false], [29894, 0.034772, " This", false], [3913, 0.030426, " In", false], [3918, 0.019266, " It", false], [3336, 0.014494, " \n\n", false], [37449, 0.012445, " Their", false]]], "qwen": [382, 5, 0.06594829261302948, [[13, 0.292512, ".", false], [3164, 0.140883, " win", false], [633, 0.097434, " get", false], [1477, 0.067145, " find", false], [382, 0.065948, ".\n\n", false], [11996, 0.057187, " succeed", false], [614, 0.046361, " have", false], [1490, 0.02706, " see", false], [11, 0.022252, ",", false], [975, 0.018473, " work", false]]]}, "raw_delta": -0.43754474322001136, "tuned_delta": -0.4289729511894331}, {"byte_start": 2121, "byte_end": 2122, "display": {"text": "A", "kind": "normal"}, "is_word": true, "word_id": 355, "word_key": "a", "bytes_hex": "41", "compression": {"rwkv": "51.57%", "qwen": "60.08%"}, "model_tokens": {"rwkv": [[66, "A", "normal", 0.0568917877972126]], "qwen": [[32, "A", "normal", 0.03574218973517418]]}, "loss": {"rwkv": 51.56507665677349, "qwen": 60.07785241134943}, "topk": {"rwkv": [66, 3, 0.0568917877972126, [[1136, 0.297876, "In", false], [6699, 0.154795, "The", false], [66, 0.056892, "A", false], [58094, 0.043348, "Similarly", false], [24242, 0.03946, "This", false], [33504, 0.021774, "There", false], [1141, 0.01801, "It", false], [24327, 0.016703, "When", false], [6393, 0.011491, "One", false], [5658, 0.010754, "But", false]]], "qwen": [32, 4, 0.03574218973517418, [[641, 0.353845, "In", false], [785, 0.115869, "The", false], [67691, 0.045728, "Similarly", false], [32, 0.035742, "A", false], [3862, 0.02463, "There", false], [14037, 0.023558, "Another", false], [4498, 0.021734, "When", false], [1986, 0.018385, "This", false], [3966, 0.011602, "One", false], [1655, 0.011292, "At", false]]]}, "raw_delta": -0.4720485210418701, "tuned_delta": -0.4634767290112919}, {"byte_start": 2122, "byte_end": 2130, "display": {"text": " similar", "kind": "normal"}, "is_word": true, "word_id": 356, "word_key": " similar", "bytes_hex": "20 73 69 6d 69 6c 61 72", "compression": {"rwkv": "1.47% 1.47% 1.47% 1.47% 1.47% 1.47% 1.47% 1.47%", "qwen": "1.47% 1.47% 1.47% 1.47% 1.47% 1.47% 1.47% 1.47%"}, "model_tokens": {"rwkv": [[52906, " similar", "normal", 0.5198955535888672]], "qwen": [[4428, " similar", "normal", 0.5214805603027344]]}, "loss": {"rwkv": 1.4705204579373587, "qwen": 1.4676789820776348}, "topk": {"rwkv": [52906, 1, 0.5198955535888672, [[52906, 0.519896, " similar", false], [31458, 0.041951, " more", false], [21674, 0.032268, " few", false], [52693, 0.030508, " related", false], [47205, 0.024086, " second", false], [32386, 0.017301, " very", false], [30992, 0.016075, " good", false], [59513, 0.01496, " different", false], [56812, 0.010946, " parallel", false], [21365, 0.010519, " bit", false]]], "qwen": [4428, 1, 0.5214805603027344, [[4428, 0.521481, " similar", false], [803, 0.048354, " more", false], [5435, 0.031472, " related", false], [2086, 0.028084, " second", false], [2421, 0.02363, " few", false], [2155, 0.022031, " different", false], [1602, 0.01837, " very", false], [14400, 0.010205, " somewhat", false], [13212, 0.009056, " decade", false], [11416, 0.008557, " classic", false]]]}, "raw_delta": 0.00015756487846374512, "tuned_delta": 0.008729356909041993}, {"byte_start": 2130, "byte_end": 2138, "display": {"text": " pattern", "kind": "normal"}, "is_word": true, "word_id": 357, "word_key": " pattern", "bytes_hex": "20 70 61 74 74 65 72 6e", "compression": {"rwkv": "7.15% 7.15% 7.15% 7.15% 7.15% 7.15% 7.15% 7.15%", "qwen": "6.29% 6.29% 6.29% 6.29% 6.29% 6.29% 6.29% 6.29%"}, "model_tokens": {"rwkv": [[52427, " pattern", "normal", 0.04210507869720459]], "qwen": [[5383, " pattern", "normal", 0.06150469928979874]]}, "loss": {"rwkv": 7.15007552003075, "qwen": 6.286187316698641}, "topk": {"rwkv": [52427, 5, 0.04210507869720459, [[39831, 0.281547, " story", false], [45315, 0.088449, " bitter", false], [60511, 0.079096, " situation", false], [65126, 0.055528, " disappointment", false], [52427, 0.042105, " pattern", false], [46430, 0.027427, " lesson", false], [30405, 0.021213, " case", false], [51668, 0.017758, " example", false], [45, 0.015309, ",", false], [57020, 0.01485, " reaction", false]]], "qwen": [5383, 4, 0.06150469928979874, [[6534, 0.161408, " situation", false], [3364, 0.133674, " story", false], [17755, 0.097952, " lesson", false], [5383, 0.061505, " pattern", false], [3110, 0.033002, " example", false], [3166, 0.029063, " thing", false], [12720, 0.022721, " reaction", false], [40598, 0.022441, " disappointment", false], [18915, 0.021367, " attitude", false], [24382, 0.020877, " fate", false]]]}, "raw_delta": 0.047904133796691895, "tuned_delta": 0.056475925827270144}, {"byte_start": 2138, "byte_end": 2141, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 358, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "17.09% 17.09% 17.09%", "qwen": "15.92% 15.92% 15.92%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.05823513865470886]], "qwen": [[315, " of", "normal", 0.07075536251068115]]}, "loss": {"rwkv": 17.094433427199956, "qwen": 15.920904076282552}, "topk": {"rwkv": [4706, 7, 0.05823513865470886, [[56745, 0.179856, " occurred", false], [22748, 0.134576, " was", false], [4600, 0.088215, " is", false], [21413, 0.073263, " can", false], [46840, 0.064228, " played", false], [51585, 0.058998, " emerged", false], [4706, 0.058235, " of", false], [21800, 0.032277, " has", false], [50935, 0.02939, " appears", false], [46697, 0.027455, " occurs", false]]], "qwen": [315, 5, 0.07075536251068115, [[572, 0.173193, " was", false], [21992, 0.146087, " emerged", false], [646, 0.09904, " can", false], [10017, 0.076013, " occurred", false], [315, 0.070755, " of", false], [374, 0.05973, " is", false], [702, 0.042734, " has", false], [6342, 0.0253, " played", false], [58596, 0.023844, " emerges", false], [312, 0.017661, " re", false]]]}, "raw_delta": 0.0650742848714192, "tuned_delta": 0.07364607690199744}, {"byte_start": 2141, "byte_end": 2150, "display": {"text": " research", "kind": "normal"}, "is_word": true, "word_id": 359, "word_key": " research", "bytes_hex": "20 72 65 73 65 61 72 63 68", "compression": {"rwkv": "11.71% 11.71% 11.71% 11.71% 11.71% 11.71% 11.71% 11.71% 11.71%", "qwen": "7.76% 7.76% 7.76% 7.76% 7.76% 7.76% 7.76% 7.76% 7.76%"}, "model_tokens": {"rwkv": [[57103, " research", "normal", 0.002921848325058818]], "qwen": [[3412, " research", "normal", 0.02082969807088375]]}, "loss": {"rwkv": 11.709373812770664, "qwen": 7.757242115177639}, "topk": {"rwkv": [57103, 25, 0.002921848325058818, [[45315, 0.352916, " bitter", false], [65126, 0.183364, " disappointment", false], [61640, 0.055511, " bitterness", false], [51708, 0.024754, " failure", false], [62500, 0.015933, " resistance", false], [38720, 0.01585, " human", false], [45685, 0.015144, " defeat", false], [45294, 0.010314, " belief", false], [55615, 0.010227, " behavior", false], [57419, 0.007118, " thinking", false]]], "qwen": [3412, 8, 0.02082969807088375, [[40598, 0.106948, " disappointment", false], [7709, 0.059513, " behavior", false], [3738, 0.049548, " human", false], [12720, 0.045738, " reaction", false], [1656, 0.034726, " bel", false], [7901, 0.033575, " failure", false], [13643, 0.023229, " resistance", false], [3412, 0.02083, " research", false], [7274, 0.019194, " thinking", false], [6832, 0.019006, " learning", false]]]}, "raw_delta": 0.21915271547105578, "tuned_delta": 0.22772450750163403}, {"byte_start": 2150, "byte_end": 2159, "display": {"text": " progress", "kind": "normal"}, "is_word": true, "word_id": 360, "word_key": " progress", "bytes_hex": "20 70 72 6f 67 72 65 73 73", "compression": {"rwkv": "12.27% 12.27% 12.27% 12.27% 12.27% 12.27% 12.27% 12.27% 12.27%", "qwen": "10.72% 10.72% 10.72% 10.72% 10.72% 10.72% 10.72% 10.72% 10.72%"}, "model_tokens": {"rwkv": [[56950, " progress", "normal", 0.0022138170897960663]], "qwen": [[5098, " progress", "normal", 0.00474706431850791]]}, "loss": {"rwkv": 12.272926563117915, "qwen": 10.720484080360402}, "topk": {"rwkv": [56950, 50, 0.0022138170897960663, [[51708, 0.153821, " failure", false], [65126, 0.131114, " disappointment", false], [22748, 0.063285, " was", false], [4600, 0.040835, " is", false], [21413, 0.035036, " can", false], [21265, 0.031881, " and", false], [46, 0.030735, "-", false], [4596, 0.024249, " in", false], [56745, 0.020649, " occurred", false], [21800, 0.020107, " has", false]]], "qwen": [5098, 36, 0.00474706431850791, [[572, 0.076821, " was", false], [323, 0.066671, " and", false], [374, 0.032934, " is", false], [7901, 0.028421, " failure", false], [10017, 0.023164, " occurred", false], [702, 0.020978, " has", false], [304, 0.020233, " in", false], [9162, 0.020032, " investment", false], [5041, 0.01999, " effort", false], [11, 0.017641, ",", false]]]}, "raw_delta": 0.08608569039238823, "tuned_delta": 0.09465748242296647}, {"byte_start": 2159, "byte_end": 2163, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 361, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "8.31% 8.31% 8.31% 8.31%", "qwen": "6.99% 6.99% 6.99% 6.99%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.15902355313301086]], "qwen": [[572, " was", "normal", 0.21211445331573486]]}, "loss": {"rwkv": 8.312403067621956, "qwen": 6.990891065621055}, "topk": {"rwkv": [22748, 1, 0.15902355313301086, [[22748, 0.159024, " was", false], [4596, 0.121666, " in", false], [21413, 0.115618, " can", false], [4600, 0.104086, " is", false], [56745, 0.097474, " occurred", false], [21800, 0.047412, " has", false], [21265, 0.047105, " and", false], [45, 0.020773, ",", false], [46840, 0.016361, " played", false], [51585, 0.015945, " emerged", false]]], "qwen": [572, 1, 0.21211445331573486, [[572, 0.212114, " was", false], [646, 0.094362, " can", false], [10017, 0.088096, " occurred", false], [374, 0.070937, " is", false], [304, 0.0703, " in", false], [323, 0.058003, " and", false], [8110, 0.03405, " followed", false], [702, 0.031553, " has", false], [21992, 0.026239, " emerged", false], [11, 0.018598, ",", false]]]}, "raw_delta": 0.07328018546104431, "tuned_delta": 0.08185197749162255}, {"byte_start": 2163, "byte_end": 2168, "display": {"text": " seen", "kind": "normal"}, "is_word": true, "word_id": 362, "word_key": " seen", "bytes_hex": "20 73 65 65 6e", "compression": {"rwkv": "3.30% 3.30% 3.30% 3.30% 3.30%", "qwen": "4.22% 4.22% 4.22% 4.22% 4.22%"}, "model_tokens": {"rwkv": [[31968, " seen", "normal", 0.4029674828052521]], "qwen": [[3884, " seen", "normal", 0.31041789054870605]]}, "loss": {"rwkv": 3.2967835895314197, "qwen": 4.2192912194968635}, "topk": {"rwkv": [31968, 1, 0.4029674828052521, [[31968, 0.402967, " seen", false], [51661, 0.141165, " evident", false], [56734, 0.110823, " observed", false], [57093, 0.04144, " repeated", false], [56255, 0.039543, " followed", false], [38547, 0.027996, " found", false], [55524, 0.02218, " apparent", false], [53296, 0.021982, " visible", false], [59676, 0.010409, " exhibited", false], [22590, 0.00836, " the", false]]], "qwen": [3884, 1, 0.31041789054870605, [[3884, 0.310418, " seen", false], [13166, 0.190853, " observed", false], [29476, 0.077438, " evident", false], [1730, 0.048113, " found", false], [11504, 0.029763, " repeated", false], [31026, 0.028457, " witnessed", false], [8110, 0.024862, " followed", false], [1083, 0.015594, " also", false], [304, 0.013705, " in", false], [10321, 0.010507, " experienced", false]]]}, "raw_delta": -0.05115468502044679, "tuned_delta": -0.04258289298986854}, {"byte_start": 2168, "byte_end": 2171, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 363, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "0.73% 0.73% 0.73%", "qwen": "0.94% 0.94% 0.94%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.8845621347427368]], "qwen": [[304, " in", "normal", 0.8556819558143616]]}, "loss": {"rwkv": 0.7337926436813167, "qwen": 0.9368891954426406}, "topk": {"rwkv": [4596, 1, 0.8845621347427368, [[4596, 0.884562, " in", false], [32487, 0.042789, " with", false], [32465, 0.010809, " when", false], [21700, 0.008234, " for", false], [4424, 0.004667, " at", false], [45, 0.004451, ",", false], [45805, 0.004283, " during", false], [45202, 0.002929, " around", false], [31601, 0.002847, " over", false], [4712, 0.002664, " on", false]]], "qwen": [304, 1, 0.8556819558143616, [[304, 0.855682, " in", false], [448, 0.046766, " with", false], [369, 0.018555, " for", false], [979, 0.011921, " when", false], [518, 0.011762, " at", false], [553, 0.010531, " by", false], [11, 0.005457, ",", false], [2337, 0.00533, " during", false], [916, 0.004182, " over", false], [4221, 0.003949, " among", false]]]}, "raw_delta": -0.01126206417878469, "tuned_delta": -0.0026902721482064424}, {"byte_start": 2171, "byte_end": 2180, "display": {"text": " computer", "kind": "normal"}, "is_word": true, "word_id": 364, "word_key": " computer", "bytes_hex": "20 63 6f 6d 70 75 74 65 72", "compression": {"rwkv": "3.87% 3.87% 3.87% 3.87% 3.87% 3.87% 3.87% 3.87% 3.87%", "qwen": "6.31% 6.31% 6.31% 6.31% 6.31% 6.31% 6.31% 6.31% 6.31%"}, "model_tokens": {"rwkv": [[55809, " computer", "normal", 0.14471325278282166]], "qwen": [[6366, " computer", "normal", 0.04282262921333313]]}, "loss": {"rwkv": 3.8665980371047524, "qwen": 6.313170678024638}, "topk": {"rwkv": [55809, 2, 0.14471325278282166, [[22590, 0.245204, " the", false], [55809, 0.144713, " computer", false], [52167, 0.044997, " machine", false], [3609, 0.037594, " AI", false], [38328, 0.035455, " early", false], [52299, 0.032372, " natural", false], [3851, 0.028316, " Go", false], [45929, 0.023532, " expert", false], [30941, 0.020615, " game", false], [61594, 0.018992, " artificial", false]]], "qwen": [6366, 3, 0.04282262921333313, [[279, 0.321339, " the", false], [1809, 0.056189, " game", false], [6366, 0.042823, " computer", false], [1008, 0.027065, " other", false], [6203, 0.022183, " expert", false], [5994, 0.020669, " Go", false], [5662, 0.018329, " machine", false], [20443, 0.016123, " artificial", false], [3868, 0.014979, " games", false], [5810, 0.013605, " natural", false]]]}, "raw_delta": -0.13566679424709746, "tuned_delta": -0.1270950022165192}, {"byte_start": 2180, "byte_end": 2183, "display": {"text": " Go", "kind": "normal"}, "is_word": true, "word_id": 365, "word_key": " go", "bytes_hex": "20 47 6f", "compression": {"rwkv": "4.27% 4.27% 4.27%", "qwen": "2.32% 2.32% 2.32%"}, "model_tokens": {"rwkv": [[3851, " Go", "normal", 0.4911113381385803]], "qwen": [[5994, " Go", "normal", 0.6799574494361877]]}, "loss": {"rwkv": 4.273608356799989, "qwen": 2.3186817435910383}, "topk": {"rwkv": [3851, 1, 0.4911113381385803, [[3851, 0.491111, " Go", false], [46, 0.096961, "-", false], [52814, 0.053694, " science", false], [39311, 0.042617, " poker", false], [4559, 0.026011, " go", false], [38576, 0.0252, " games", false], [47732, 0.022105, " vision", false], [47350, 0.017712, " speech", false], [52491, 0.01751, " playing", false], [31044, 0.01627, " hand", false]]], "qwen": [5994, 1, 0.6799574494361877, [[5994, 0.679957, " Go", false], [3868, 0.049785, " games", false], [20814, 0.030803, " poker", false], [728, 0.029928, " go", false], [1809, 0.02932, " game", false], [19926, 0.023104, "-go", false], [1182, 0.015382, " back", false], [1779, 0.009107, " check", false], [3701, 0.009033, " card", false], [12604, 0.007157, " GO", false]]]}, "raw_delta": 0.10840414961179096, "tuned_delta": 0.1169759416423692}, {"byte_start": 2183, "byte_end": 2184, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "22.54%", "qwen": "16.10%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.28818774223327637]], "qwen": [[11, ",", "normal", 0.40962767601013184]]}, "loss": {"rwkv": 22.542110013890053, "qwen": 16.09518771169503}, "topk": {"rwkv": [45, 2, 0.28818774223327637, [[47, 0.545737, ".", false], [45, 0.288188, ",", false], [4596, 0.049747, " in", false], [21265, 0.020126, " and", false], [275, 0.01743, " (", false], [59, 0.016158, ":", false], [31601, 0.006594, " over", false], [332, 0.003671, " a", false], [30917, 0.003334, " from", false], [60, 0.002923, ";", false]]], "qwen": [11, 2, 0.40962767601013184, [[13, 0.442132, ".", false], [11, 0.409628, ",", false], [304, 0.034679, " in", false], [320, 0.023862, " (", false], [323, 0.015349, " and", false], [3412, 0.006555, " research", false], [25, 0.006412, ":", false], [553, 0.005444, " by", false], [979, 0.005193, " when", false], [26, 0.002816, ";", false]]]}, "raw_delta": 0.3574932813644409, "tuned_delta": 0.36606507339501915}, {"byte_start": 2184, "byte_end": 2189, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 366, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"rwkv": "26.83% 26.83% 26.83% 26.83% 26.83%", "qwen": "31.91% 31.91% 31.91% 31.91% 31.91%"}, "model_tokens": {"rwkv": [[31581, " only", "normal", 0.0005948423640802503]], "qwen": [[1172, " only", "normal", 0.00014375371392816305]]}, "loss": {"rwkv": 26.825110916529162, "qwen": 31.910283618281632}, "topk": {"rwkv": [31581, 58, 0.0005948423640802503, [[40185, 0.426502, " where", false], [40186, 0.09853, " which", false], [21265, 0.05285, " and", false], [4596, 0.051349, " in", false], [22590, 0.048452, " the", false], [32487, 0.037382, " with", false], [332, 0.028634, " a", false], [50919, 0.015959, " another", false], [32465, 0.015691, " when", false], [57295, 0.015006, " starting", false]]], "qwen": [1172, 146, 0.00014375371392816305, [[1380, 0.360335, " where", false], [892, 0.147696, " which", false], [264, 0.065947, " a", false], [304, 0.062296, " in", false], [279, 0.05924, " the", false], [448, 0.042481, " with", false], [323, 0.029347, " and", false], [979, 0.018793, " when", false], [458, 0.015009, " an", false], [2441, 0.012311, " another", false]]]}, "raw_delta": -0.28198184967041007, "tuned_delta": -0.27341005763983184}, {"byte_start": 2189, "byte_end": 2197, "display": {"text": " delayed", "kind": "normal"}, "is_word": true, "word_id": 367, "word_key": " delayed", "bytes_hex": "20 64 65 6c 61 79 65 64", "compression": {"rwkv": "13.74% 13.74% 13.74% 13.74% 13.74% 13.74% 13.74% 13.74%", "qwen": "14.29% 14.29% 14.29% 14.29% 14.29% 14.29% 14.29% 14.29%"}, "model_tokens": {"rwkv": [[51419, " delayed", "normal", 0.0022904397919774055]], "qwen": [[22706, " delayed", "normal", 0.0017680253367871046]]}, "loss": {"rwkv": 13.73659828971425, "qwen": 14.28694599714994}, "topk": {"rwkv": [51419, 44, 0.0022904397919774055, [[332, 0.104567, " a", false], [31458, 0.082089, " more", false], [32487, 0.068922, " with", false], [31466, 0.060723, " much", false], [38869, 0.051716, " later", false], [32234, 0.051586, " this", false], [57245, 0.038719, " slightly", false], [4596, 0.038426, " in", false], [22590, 0.037312, " the", false], [37598, 0.03605, " about", false]]], "qwen": [22706, 45, 0.0017680253367871046, [[419, 0.243399, " this", false], [803, 0.134981, " more", false], [448, 0.060628, " with", false], [264, 0.05519, " a", false], [1753, 0.054965, " much", false], [304, 0.050239, " in", false], [311, 0.034538, " to", false], [432, 0.031966, " it", false], [279, 0.025637, " the", false], [429, 0.025317, " that", false]]]}, "raw_delta": -0.030517756938934326, "tuned_delta": -0.021945964908356076}, {"byte_start": 2197, "byte_end": 2200, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 368, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "3.19% 3.19% 3.19%", "qwen": "4.23% 4.23% 4.23%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.5878183245658875]], "qwen": [[553, " by", "normal", 0.49497660994529724]]}, "loss": {"rwkv": 3.193465585301091, "qwen": 4.227365804954872}, "topk": {"rwkv": [4450, 1, 0.5878183245658875, [[4450, 0.587818, " by", false], [332, 0.081254, " a", false], [57263, 0.06127, " somewhat", false], [21700, 0.041814, " for", false], [51018, 0.03781, " because", false], [57245, 0.031974, " slightly", false], [47, 0.0227, ".", false], [40076, 0.022327, " until", false], [4596, 0.012012, " in", false], [21265, 0.011976, " and", false]]], "qwen": [553, 1, 0.49497660994529724, [[553, 0.494977, " by", false], [3080, 0.072059, " until", false], [304, 0.060012, " in", false], [13, 0.051781, ".", false], [264, 0.044172, " a", false], [369, 0.040421, " for", false], [311, 0.02979, " to", false], [10078, 0.021066, " slightly", false], [1576, 0.020199, " because", false], [803, 0.016974, " more", false]]]}, "raw_delta": -0.05733160177866617, "tuned_delta": -0.04875980974808792}, {"byte_start": 2200, "byte_end": 2202, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 369, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "11.06% 11.06%", "qwen": "13.95% 13.95%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.29469388723373413]], "qwen": [[264, " a", "normal", 0.21295078098773956]]}, "loss": {"rwkv": 11.059722725564805, "qwen": 13.946301035477545}, "topk": {"rwkv": [332, 1, 0.29469388723373413, [[332, 0.294694, " a", false], [37598, 0.13754, " about", false], [22590, 0.122066, " the", false], [52869, 0.073772, " several", false], [22638, 0.033299, " two", false], [3483, 0.028246, " 10", false], [31370, 0.022508, " many", false], [31458, 0.018281, " more", false], [32074, 0.016117, " some", false], [30869, 0.015442, " five", false]]], "qwen": [264, 1, 0.21295078098773956, [[264, 0.212951, " a", false], [279, 0.190157, " the", false], [220, 0.099973, " ", false], [10793, 0.051928, " decades", false], [3807, 0.040558, " several", false], [803, 0.03866, " more", false], [1657, 0.034201, " many", false], [1378, 0.029853, " two", false], [911, 0.025934, " about", false], [2441, 0.018902, " another", false]]]}, "raw_delta": -0.1600658893585205, "tuned_delta": -0.15149409732794225}, {"byte_start": 2202, "byte_end": 2210, "display": {"text": " further", "kind": "normal"}, "is_word": true, "word_id": 370, "word_key": " further", "bytes_hex": "20 66 75 72 74 68 65 72", "compression": {"rwkv": "14.51% 14.51% 14.51% 14.51% 14.51% 14.51% 14.51% 14.51%", "qwen": "11.41% 11.41% 11.41% 11.41% 11.41% 11.41% 11.41% 11.41%"}, "model_tokens": {"rwkv": [[51816, " further", "normal", 0.0015914300456643105]], "qwen": [[4623, " further", "normal", 0.006346368696540594]]}, "loss": {"rwkv": 14.51148332144172, "qwen": 11.406020541992751}, "topk": {"rwkv": [51816, 14, 0.0015914300456643105, [[21674, 0.405744, " few", false], [45674, 0.309951, " decade", false], [45602, 0.109651, " couple", false], [32512, 0.038509, " year", false], [45950, 0.029282, " factor", false], [62035, 0.026727, " generation", false], [21365, 0.008774, " bit", false], [46454, 0.006501, " little", false], [46685, 0.005826, " number", false], [46530, 0.003238, " matter", false]]], "qwen": [4623, 17, 0.006346368696540594, [[13212, 0.361089, " decade", false], [2421, 0.127623, " few", false], [8168, 0.081854, " factor", false], [9471, 0.06511, " generation", false], [5021, 0.057878, " longer", false], [9294, 0.037375, " century", false], [5625, 0.029724, " couple", false], [1753, 0.023602, " much", false], [803, 0.017667, " more", false], [1042, 0.013761, " year", false]]]}, "raw_delta": 0.1722034215927124, "tuned_delta": 0.18077521362329066}, {"byte_start": 2210, "byte_end": 2213, "display": {"text": " 20", "kind": "normal"}, "is_word": true, "word_id": 371, "word_key": " 20", "bytes_hex": "20 32 30", "compression": {"rwkv": "21.32% 21.32% 21.32%", "qwen": "14.81% 15.29% 5.23%"}, "model_tokens": {"rwkv": [[3493, " 20", "normal", 0.028869060799479485]], "qwen": [[220, " ", "normal", 0.43981674313545227], [17, "2", "normal", 0.42840680480003357], [15, "0", "normal", 0.7482753396034241]]}, "loss": {"rwkv": 21.32107905480434, "qwen": 11.77637980616797}, "topk": {"rwkv": [3493, 11, 0.028869060799479485, [[45674, 0.256186, " decade", false], [3483, 0.092028, " 10", false], [30869, 0.068324, " five", false], [22638, 0.057827, " two", false], [22583, 0.050065, " ten", false], [3488, 0.045831, " 15", false], [39946, 0.033846, " three", false], [30905, 0.032757, " four", false], [21674, 0.032355, " few", false], [39644, 0.032022, " seven", false]]], "qwen": [220, 1, 0.43981674313545227, [[220, 0.439817, " ", false], [13212, 0.100761, " decade", false], [1378, 0.053785, " two", false], [5779, 0.039719, " ten", false], [4236, 0.037992, " five", false], [17073, 0.03225, " twenty", false], [9471, 0.030196, " generation", false], [2326, 0.028439, " three", false], [8168, 0.02575, " factor", false], [36655, 0.022671, " fifteen", false]]]}, "raw_delta": 0.5292705098787944, "tuned_delta": 0.5378423019093727}, {"byte_start": 2213, "byte_end": 2219, "display": {"text": " years", "kind": "normal"}, "is_word": true, "word_id": 372, "word_key": " years", "bytes_hex": "20 79 65 61 72 73", "compression": {"rwkv": "0.15% 0.15% 0.15% 0.15% 0.15% 0.15%", "qwen": "0.08% 0.08% 0.08% 0.08% 0.08% 0.08%"}, "model_tokens": {"rwkv": [[40237, " years", "normal", 0.9501520395278931]], "qwen": [[1635, " years", "normal", 0.9749020338058472]]}, "loss": {"rwkv": 0.1533626625293952, "qwen": 0.07639755989077397}, "topk": {"rwkv": [40237, 1, 0.9501520395278931, [[40237, 0.950152, " years", false], [4715, 0.01547, " or", false], [46, 0.013147, "-", false], [44, 0.005844, "+", false], [49, 0.002858, "0", false], [620, 0.001895, "00", false], [4811, 0.001188, " to", false], [32512, 0.001152, " year", false], [46596, 0.000922, " months", false], [38, 0.000819, "%", false]]], "qwen": [1635, 1, 0.9749020338058472, [[1635, 0.974902, " years", false], [476, 0.005643, " or", false], [12, 0.004019, "-", false], [311, 0.002986, " to", false], [4102, 0.00289, " ", false], [10, 0.002163, "+", false], [15, 0.001481, "0", false], [4142, 0.001073, "–", false], [56088, 0.00053, "-years", false], [22934, 0.000528, "-plus", false]]]}, "raw_delta": 0.00426785151163737, "tuned_delta": 0.012839643542215617}, {"byte_start": 2219, "byte_end": 2220, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "5.88%", "qwen": "6.47%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.719201385974884]], "qwen": [[13, ".", "normal", 0.6986647844314575]]}, "loss": {"rwkv": 5.882081831749435, "qwen": 6.466596042562159}, "topk": {"rwkv": [47, 1, 0.719201385974884, [[47, 0.719201, ".", false], [45, 0.076919, ",", false], [4715, 0.043867, " or", false], [51018, 0.027513, " because", false], [21572, 0.021136, " due", false], [21265, 0.018064, " and", false], [275, 0.017362, " (", false], [59, 0.013806, ":", false], [4706, 0.007526, " of", false], [37634, 0.006439, " after", false]]], "qwen": [13, 1, 0.6986647844314575, [[13, 0.698665, ".", false], [11, 0.08126, ",", false], [320, 0.02321, " (", false], [1576, 0.021752, " because", false], [315, 0.019394, " of", false], [323, 0.015811, " and", false], [476, 0.012819, " or", false], [1573, 0.011566, " before", false], [4152, 0.010564, " due", false], [504, 0.010561, " from", false]]]}, "raw_delta": -0.03241235017776489, "tuned_delta": -0.023840558147186643}, {"byte_start": 2220, "byte_end": 2223, "display": {"text": " En", "kind": "normal"}, "is_word": true, "word_id": 373, "word_key": " en", "bytes_hex": "20 45 6e", "compression": {"rwkv": "64.25% 64.25% 64.25%", "qwen": "67.94% 67.94% 67.94%"}, "model_tokens": {"rwkv": [[3785, " En", "normal", 2.30054010899039e-05]], "qwen": [[2925, " En", "normal", 1.2355040780676063e-05]]}, "loss": {"rwkv": 64.24501353958665, "qwen": 67.93558351169662}, "topk": {"rwkv": [3785, 910, 2.30054010899039e-05, [[20996, 0.178418, " The", false], [3913, 0.156782, " In", false], [37451, 0.027566, " There", false], [3851, 0.027197, " Go", false], [36251, 0.025745, " Again", false], [267, 0.025683, "  ", false], [300, 0.024986, " A", false], [30032, 0.023466, " When", false], [28753, 0.023235, " Deep", false], [29894, 0.022236, " This", false]]], "qwen": [2925, 1381, 1.2355040780676063e-05, [[576, 0.194352, " The", false], [758, 0.129986, " In", false], [3197, 0.042168, " When", false], [1084, 0.029462, " It", false], [1096, 0.028426, " This", false], [362, 0.026568, " A", false], [5994, 0.024987, " Go", false], [2411, 0.024318, " At", false], [18183, 0.022559, " Deep", false], [2619, 0.021317, " There", false]]]}, "raw_delta": -0.20464865366617824, "tuned_delta": -0.19607686163559998}, {"byte_start": 2223, "byte_end": 2226, "display": {"text": "orm", "kind": "normal"}, "is_word": true, "word_id": 374, "word_key": "orm", "bytes_hex": "6f 72 6d", "compression": {"rwkv": "10.71% 10.71% 10.71%", "qwen": "0.88% 0.88% 0.88%"}, "model_tokens": {"rwkv": [[8404, "orm", "normal", 0.16802969574928284]], "qwen": [[493, "orm", "normal", 0.8644454479217529]]}, "loss": {"rwkv": 10.707502256597774, "qwen": 0.8756382013579326}, "topk": {"rwkv": [8404, 2, 0.16802969574928284, [[26596, 0.450405, "ough", false], [8404, 0.16803, "orm", false], [35003, 0.112099, "light", false], [39552, 0.056283, " route", false], [34698, 0.039843, "igmat", false], [40885, 0.015508, "abling", false], [35590, 0.014525, "route", false], [54327, 0.013166, "rollment", false], [27567, 0.01029, "zyme", false], [2356, 0.010017, "zo", false]]], "qwen": [493, 1, 0.8644454479217529, [[493, 0.864445, "orm", false], [33132, 0.049235, "thus", false], [309, 0.017022, "am", false], [13013, 0.016572, "vision", false], [55247, 0.014893, "rico", false], [2152, 0.003988, "no", false], [18768, 0.002521, "abling", false], [12738, 0.002172, "zo", false], [1494, 0.001699, " pass", false], [98730, 0.001685, "igmatic", false]]]}, "raw_delta": 0.5451943079630533, "tuned_delta": 0.5537660999936316}, {"byte_start": 2226, "byte_end": 2229, "display": {"text": "ous", "kind": "normal"}, "is_word": true, "word_id": 375, "word_key": "ous", "bytes_hex": "6f 75 73", "compression": {"rwkv": "0.46% 0.46% 0.46%", "qwen": "0.45% 0.45% 0.45%"}, "model_tokens": {"rwkv": [[8439, "ous", "normal", 0.9265947937965393]], "qwen": [[782, "ous", "normal", 0.9285297393798828]]}, "loss": {"rwkv": 0.46082178023186693, "qwen": 0.4457498298154722}, "topk": {"rwkv": [8439, 1, 0.9265947937965393, [[8439, 0.926595, "ous", false], [35323, 0.072697, "ously", false], [2243, 0.000173, "us", false], [27340, 8.8e-05, "uous", false], [8435, 5.2e-05, "oul", false], [7933, 4.9e-05, "ity", false], [25902, 3.5e-05, "ious", false], [8440, 2.5e-05, "out", false], [2030, 2.2e-05, "ly", false], [7450, 2.2e-05, "ely", false]]], "qwen": [782, 1, 0.9285297393798828, [[782, 0.92853, "ous", false], [7017, 0.070054, "ously", false], [288, 0.000248, "es", false], [1530, 0.000137, "ouse", false], [283, 0.000123, "ou", false], [68, 0.000119, "e", false], [487, 0.000111, "ity", false], [78, 8.3e-05, "o", false], [33072, 7.9e-05, "eous", false], [480, 6.4e-05, "able", false]]]}, "raw_delta": 0.0008357663949330671, "tuned_delta": 0.009407558425511315}, {"byte_start": 2229, "byte_end": 2237, "display": {"text": " initial", "kind": "normal"}, "is_word": true, "word_id": 376, "word_key": " initial", "bytes_hex": "20 69 6e 69 74 69 61 6c", "compression": {"rwkv": "15.29% 15.29% 15.29% 15.29% 15.29% 15.29% 15.29% 15.29%", "qwen": "18.19% 18.19% 18.19% 18.19% 18.19% 18.19% 18.19% 18.19%"}, "model_tokens": {"rwkv": [[52013, " initial", "normal", 0.0011326418025419116]], "qwen": [[2856, " initial", "normal", 0.00031285788281820714]]}, "loss": {"rwkv": 15.286368353169191, "qwen": 18.19094464749472}, "topk": {"rwkv": [52013, 64, 0.0011326418025419116, [[56950, 0.28901, " progress", false], [64423, 0.146597, " improvements", false], [51566, 0.040142, " efforts", false], [55465, 0.037863, " advances", false], [50897, 0.032676, " amounts", false], [63621, 0.031678, " improvement", false], [45829, 0.030438, " effort", false], [57103, 0.021281, " research", false], [45, 0.018387, ",", false], [38720, 0.015586, " human", false]]], "qwen": [2856, 145, 0.00031285788281820714, [[2711, 0.142274, " search", false], [54480, 0.113539, " computational", false], [5098, 0.08119, " progress", false], [5041, 0.073557, " effort", false], [29903, 0.052898, " advances", false], [34447, 0.049092, " computation", false], [18142, 0.04861, " improvements", false], [14713, 0.038292, " amounts", false], [11, 0.025313, ",", false], [8869, 0.015892, " efforts", false]]]}, "raw_delta": -0.16106390953063965, "tuned_delta": -0.1524921175000614}, {"byte_start": 2237, "byte_end": 2245, "display": {"text": " efforts", "kind": "normal"}, "is_word": true, "word_id": 377, "word_key": " efforts", "bytes_hex": "20 65 66 66 6f 72 74 73", "compression": {"rwkv": "6.66% 6.66% 6.66% 6.66% 6.66% 6.66% 6.66% 6.66%", "qwen": "5.33% 5.33% 5.33% 5.33% 5.33% 5.33% 5.33% 5.33%"}, "model_tokens": {"rwkv": [[51566, " efforts", "normal", 0.05230437591671944]], "qwen": [[8869, " efforts", "normal", 0.09407690912485123]]}, "loss": {"rwkv": 6.656966863476906, "qwen": 5.328149360934822}, "topk": {"rwkv": [51566, 5, 0.05230437591671944, [[56950, 0.35329, " progress", false], [62157, 0.129804, " investment", false], [63678, 0.083329, " investments", false], [53052, 0.064681, " success", false], [51566, 0.052304, " efforts", false], [57103, 0.04055, " research", false], [45829, 0.038126, " effort", false], [60587, 0.028781, " successes", false], [55465, 0.023761, " advances", false], [38575, 0.020554, " gains", false]]], "qwen": [8869, 3, 0.09407690912485123, [[5041, 0.139331, " effort", false], [5098, 0.133733, " progress", false], [8869, 0.094077, " efforts", false], [9162, 0.085854, " investment", false], [29903, 0.07295, " advances", false], [54480, 0.068006, " computational", false], [2393, 0.050085, " success", false], [47088, 0.041195, " successes", false], [19619, 0.0384, " gains", false], [2711, 0.030214, " search", false]]]}, "raw_delta": 0.07368528842926025, "tuned_delta": 0.0822570804598385}, {"byte_start": 2245, "byte_end": 2250, "display": {"text": " went", "kind": "normal"}, "is_word": true, "word_id": 378, "word_key": " went", "bytes_hex": "20 77 65 6e 74", "compression": {"rwkv": "12.96% 12.96% 12.96% 12.96% 12.96%", "qwen": "14.21% 14.21% 14.21% 14.21% 14.21%"}, "model_tokens": {"rwkv": [[32460, " went", "normal", 0.027259374037384987]], "qwen": [[3937, " went", "normal", 0.01947474665939808]]}, "loss": {"rwkv": 12.96171325798678, "qwen": 14.205629375147302}, "topk": {"rwkv": [32460, 7, 0.027259374037384987, [[32462, 0.22322, " were", false], [4811, 0.216341, " to", false], [4596, 0.091994, " in", false], [4424, 0.056441, " at", false], [4450, 0.055174, " by", false], [51770, 0.046341, " focused", false], [32460, 0.027259, " went", false], [37810, 0.023881, " based", false], [45, 0.021706, ",", false], [4712, 0.016341, " on", false]]], "qwen": [3937, 9, 0.01947474665939808, [[1033, 0.326123, " were", false], [311, 0.202252, " to", false], [304, 0.091795, " in", false], [553, 0.044073, " by", false], [518, 0.034734, " at", false], [11, 0.032869, ",", false], [3118, 0.023143, " based", false], [1030, 0.020815, " had", false], [3937, 0.019475, " went", false], [389, 0.01851, " on", false]]]}, "raw_delta": -0.06897735595703125, "tuned_delta": -0.060405563926453}, {"byte_start": 2250, "byte_end": 2255, "display": {"text": " into", "kind": "normal"}, "is_word": true, "word_id": 379, "word_key": " into", "bytes_hex": "20 69 6e 74 6f", "compression": {"rwkv": "0.73% 0.73% 0.73% 0.73% 0.73%", "qwen": "0.39% 0.39% 0.39% 0.39% 0.39%"}, "model_tokens": {"rwkv": [[31162, " into", "normal", 0.8183413147926331]], "qwen": [[1119, " into", "normal", 0.8965668678283691]]}, "loss": {"rwkv": 0.725574166072086, "qwen": 0.39379216907816855}, "topk": {"rwkv": [31162, 1, 0.8183413147926331, [[31162, 0.818341, " into", false], [4811, 0.090753, " to", false], [47585, 0.044775, " toward", false], [53169, 0.01744, " towards", false], [4596, 0.015096, " in", false], [4712, 0.002648, " on", false], [56003, 0.00101, " directly", false], [52028, 0.000552, " instead", false], [45, 0.000477, ",", false], [38543, 0.000413, " forth", false]]], "qwen": [1119, 1, 0.8965668678283691, [[1119, 0.896567, " into", false], [8841, 0.040515, " toward", false], [6974, 0.020418, " towards", false], [311, 0.020106, " to", false], [304, 0.012883, " in", false], [389, 0.001529, " on", false], [1283, 0.001193, " after", false], [369, 0.000768, " for", false], [13771, 0.00056, " largely", false], [537, 0.000338, " not", false]]]}, "raw_delta": 0.018397900462150577, "tuned_delta": 0.026969692492728826}, {"byte_start": 2255, "byte_end": 2264, "display": {"text": " avoiding", "kind": "normal"}, "is_word": true, "word_id": 380, "word_key": " avoiding", "bytes_hex": "20 61 76 6f 69 64 69 6e 67", "compression": {"rwkv": "19.04% 19.04% 19.04% 19.04% 19.04% 19.04% 19.04% 19.04% 19.04%", "qwen": "18.25% 18.25% 18.25% 18.25% 18.25% 18.25% 18.25% 18.25% 18.25%"}, "model_tokens": {"rwkv": [[55586, " avoiding", "normal", 7.312235538847744e-05]], "qwen": [[30426, " avoiding", "normal", 0.0001108758442569524]]}, "loss": {"rwkv": 19.03555956728493, "qwen": 18.248287962858655}, "topk": {"rwkv": [55586, 585, 7.312235538847744e-05, [[52224, 0.124664, " methods", false], [61857, 0.076176, " developing", false], [38720, 0.066835, " human", false], [22590, 0.064859, " the", false], [47202, 0.035851, " search", false], [55882, 0.024303, " creating", false], [47629, 0.02362, " trying", false], [55666, 0.020139, " building", false], [59832, 0.019298, " improving", false], [55809, 0.017883, " computer", false]]], "qwen": [30426, 397, 0.0001108758442569524, [[11220, 0.192012, " developing", false], [5413, 0.153821, " methods", false], [3738, 0.062345, " human", false], [279, 0.032841, " the", false], [4460, 0.024713, " trying", false], [76482, 0.022661, " leveraging", false], [4752, 0.022024, " building", false], [6825, 0.019116, " creating", false], [9271, 0.019007, " finding", false], [8660, 0.016814, " understanding", false]]]}, "raw_delta": 0.04365560743543839, "tuned_delta": 0.05222739946601664}, {"byte_start": 2264, "byte_end": 2271, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 381, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "7.08% 7.08% 7.08% 7.08% 7.08% 7.08% 7.08%", "qwen": "6.52% 6.52% 6.52% 6.52% 6.52% 6.52% 6.52%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.06380629539489746]], "qwen": [[2711, " search", "normal", 0.07964933663606644]]}, "loss": {"rwkv": 7.084663147222587, "qwen": 6.518203890075754}, "topk": {"rwkv": [47202, 3, 0.06380629539489746, [[22590, 0.329888, " the", false], [37920, 0.219049, " brute", false], [47202, 0.063806, " search", false], [38720, 0.031973, " human", false], [30597, 0.031087, " deep", false], [332, 0.017288, " a", false], [4404, 0.015733, " ``", false], [63370, 0.008384, " computation", false], [52195, 0.00834, " massive", false], [32234, 0.00729, " this", false]]], "qwen": [2711, 3, 0.07964933663606644, [[279, 0.160157, " the", false], [9902, 0.08651, " ``", false], [2711, 0.079649, " search", false], [64098, 0.058393, " brute", false], [264, 0.039142, " a", false], [5538, 0.028358, " deep", false], [3738, 0.02146, " human", false], [5413, 0.01834, " methods", false], [6366, 0.017076, " computer", false], [4285, 0.015536, " simple", false]]]}, "raw_delta": 0.031411170959472656, "tuned_delta": 0.039982962990050906}, {"byte_start": 2271, "byte_end": 2274, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 382, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "13.81% 13.81% 13.81%", "qwen": "16.33% 16.33% 16.33%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.09918215870857239]], "qwen": [[553, " by", "normal", 0.06609392911195755]]}, "loss": {"rwkv": 13.807042383507657, "qwen": 16.33057678295906}, "topk": {"rwkv": [4450, 3, 0.09918215870857239, [[45, 0.234043, ",", false], [21265, 0.109957, " and", false], [4450, 0.099182, " by", false], [61566, 0.078327, " altogether", false], [47, 0.059861, ".", false], [46, 0.058658, "-", false], [52224, 0.04194, " methods", false], [56131, 0.040686, " entirely", false], [4424, 0.032649, " at", false], [4596, 0.029406, " in", false]]], "qwen": [553, 5, 0.06609392911195755, [[11, 0.249933, ",", false], [5980, 0.190714, "-based", false], [13, 0.076707, ".", false], [323, 0.074601, " and", false], [553, 0.066094, " by", false], [30055, 0.035941, " altogether", false], [5413, 0.028147, " methods", false], [304, 0.026033, " in", false], [320, 0.025177, " (", false], [518, 0.020442, " at", false]]]}, "raw_delta": -0.13993446032206214, "tuned_delta": -0.13136266829148388}, {"byte_start": 2274, "byte_end": 2281, "display": {"text": " taking", "kind": "normal"}, "is_word": true, "word_id": 383, "word_key": " taking", "bytes_hex": "20 74 61 6b 69 6e 67", "compression": {"rwkv": "15.22% 15.22% 15.22% 15.22% 15.22% 15.22% 15.22%", "qwen": "11.33% 11.33% 11.33% 11.33% 11.33% 11.33% 11.33%"}, "model_tokens": {"rwkv": [[47497, " taking", "normal", 0.002687763888388872]], "qwen": [[4633, " taking", "normal", 0.012311335653066635]]}, "loss": {"rwkv": 15.215924259375784, "qwen": 11.328337514157404}, "topk": {"rwkv": [47497, 58, 0.002687763888388872, [[40085, 0.080334, " using", false], [38720, 0.078829, " human", false], [31044, 0.077578, " hand", false], [38888, 0.037363, " lever", false], [47629, 0.025732, " trying", false], [46227, 0.022546, " humans", false], [61857, 0.021797, " developing", false], [38989, 0.021698, " means", false], [61984, 0.020016, " exploiting", false], [21273, 0.01784, " any", false]]], "qwen": [4633, 10, 0.012311335653066635, [[76482, 0.19438, " leveraging", false], [1667, 0.092285, " using", false], [70601, 0.072228, " exploiting", false], [38561, 0.036308, " relying", false], [11220, 0.028414, " developing", false], [3738, 0.022611, " human", false], [4460, 0.020352, " trying", false], [3259, 0.019752, " making", false], [9271, 0.012575, " finding", false], [4633, 0.012311, " taking", false]]]}, "raw_delta": 0.21557358333042687, "tuned_delta": 0.22414537536100512}, {"byte_start": 2281, "byte_end": 2291, "display": {"text": " advantage", "kind": "normal"}, "is_word": true, "word_id": 384, "word_key": " advantage", "bytes_hex": "20 61 64 76 61 6e 74 61 67 65", "compression": {"rwkv": "0.47% 0.47% 0.47% 0.47% 0.47% 0.47% 0.47% 0.47% 0.47% 0.47%", "qwen": "0.21% 0.21% 0.21% 0.21% 0.21% 0.21% 0.21% 0.21% 0.21% 0.21%"}, "model_tokens": {"rwkv": [[59093, " advantage", "normal", 0.7686576247215271]], "qwen": [[9423, " advantage", "normal", 0.8883240818977356]]}, "loss": {"rwkv": 0.471975428415823, "qwen": 0.21355244304141213}, "topk": {"rwkv": [59093, 1, 0.7686576247215271, [[59093, 0.768658, " advantage", false], [38720, 0.048083, " human", false], [332, 0.026224, " a", false], [22590, 0.017803, " the", false], [31044, 0.008921, " hand", false], [30923, 0.005653, " full", false], [4419, 0.004693, " an", false], [45929, 0.004575, " expert", false], [52964, 0.003557, " special", false], [39216, 0.003248, " pains", false]]], "qwen": [9423, 1, 0.8883240818977356, [[9423, 0.888324, " advantage", false], [3738, 0.020714, " human", false], [264, 0.013984, " a", false], [279, 0.010219, " the", false], [3281, 0.004454, " special", false], [458, 0.003345, " an", false], [1119, 0.003085, " into", false], [19760, 0.00281, " inspiration", false], [22146, 0.002526, " advantages", false], [2480, 0.001395, " full", false]]]}, "raw_delta": 0.014330013096332552, "tuned_delta": 0.0229018051269108}, {"byte_start": 2291, "byte_end": 2294, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 385, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.03% 0.03% 0.03%", "qwen": "0.02% 0.02% 0.02%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9949083924293518]], "qwen": [[315, " of", "normal", 0.997437596321106]]}, "loss": {"rwkv": 0.030819291034615302, "qwen": 0.015422807340620752}, "topk": {"rwkv": [4706, 1, 0.9949083924293518, [[4706, 0.994908, " of", false], [38720, 0.00164, " human", false], [45, 0.000835, ",", false], [52028, 0.000366, " instead", false], [22590, 0.000319, " the", false], [275, 0.000218, " (", false], [31581, 0.000146, " only", false], [4596, 0.000112, " in", false], [4423, 8.7e-05, " as", false], [21265, 8.1e-05, " and", false]]], "qwen": [315, 1, 0.997437596321106, [[315, 0.997438, " of", false], [3738, 0.000296, " human", false], [1172, 0.0002, " only", false], [11, 0.000194, ",", false], [4518, 0.000167, " instead", false], [320, 0.000163, " (", false], [916, 0.000138, " over", false], [279, 9.3e-05, " the", false], [198, 9e-05, "\n", false], [220, 7.1e-05, " ", false]]]}, "raw_delta": 0.0008537623410423597, "tuned_delta": 0.009425554371620608}, {"byte_start": 2294, "byte_end": 2300, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 386, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "2.75% 2.75% 2.75% 2.75% 2.75% 2.75%", "qwen": "6.58% 6.58% 6.58% 6.58% 6.58% 6.58%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.40167295932769775]], "qwen": [[3738, " human", "normal", 0.11216458678245544]]}, "loss": {"rwkv": 2.74731965794285, "qwen": 6.575647733393941}, "topk": {"rwkv": [38720, 1, 0.40167295932769775, [[38720, 0.401673, " human", false], [22590, 0.185124, " the", false], [52964, 0.042692, " special", false], [59943, 0.035366, " knowledge", false], [45775, 0.018048, " domain", false], [332, 0.015266, " a", false], [59792, 0.014431, " heuristic", false], [31044, 0.014003, " hand", false], [51832, 0.011934, " general", false], [46227, 0.009153, " humans", false]]], "qwen": [3738, 3, 0.11216458678245544, [[279, 0.509798, " the", false], [5994, 0.117232, " Go", false], [3738, 0.112165, " human", false], [3281, 0.049416, " special", false], [264, 0.015319, " a", false], [6540, 0.010242, " knowledge", false], [7947, 0.005956, " domain", false], [5888, 0.005153, " properties", false], [1045, 0.004887, " some", false], [1809, 0.003871, " game", false]]]}, "raw_delta": -0.2122875849405925, "tuned_delta": -0.20371579291001424}, {"byte_start": 2300, "byte_end": 2310, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 387, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "1.20% 1.20% 1.20% 1.20% 1.20% 1.20% 1.20% 1.20% 1.20% 1.20%", "qwen": "1.42% 1.42% 1.42% 1.42% 1.42% 1.42% 1.42% 1.42% 1.42% 1.42%"}, "model_tokens": {"rwkv": [[59943, " knowledge", "normal", 0.5131533145904541]], "qwen": [[6540, " knowledge", "normal", 0.45614248514175415]]}, "loss": {"rwkv": 1.1975495944879089, "qwen": 1.4155544802541344}, "topk": {"rwkv": [59943, 1, 0.5131533145904541, [[59943, 0.513153, " knowledge", false], [65034, 0.161099, " understanding", false], [46, 0.046622, "-", false], [59683, 0.035035, " expertise", false], [38786, 0.029546, " input", false], [59917, 0.028831, " intuition", false], [52022, 0.014413, " insight", false], [38013, 0.007878, " chess", false], [31702, 0.007873, " play", false], [62418, 0.005917, " psychology", false]]], "qwen": [6540, 1, 0.45614248514175415, [[6540, 0.456142, " knowledge", false], [8660, 0.220656, " understanding", false], [1946, 0.077828, " input", false], [18726, 0.045055, " expertise", false], [12646, 0.020202, "-k", false], [56251, 0.018437, " intuition", false], [71107, 0.007661, "-under", false], [20017, 0.00634, " insight", false], [5994, 0.004771, " Go", false], [6203, 0.004634, " expert", false]]]}, "raw_delta": -0.01208875775337219, "tuned_delta": -0.0035169657227939414}, {"byte_start": 2310, "byte_end": 2311, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "37.76%", "qwen": "45.93%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.12568451464176178]], "qwen": [[11, ",", "normal", 0.07831751555204391]]}, "loss": {"rwkv": 37.758034273265835, "qwen": 45.931514055087085}, "topk": {"rwkv": [45, 3, 0.12568451464176178, [[4706, 0.490393, " of", false], [47, 0.148935, ".", false], [45, 0.125685, ",", false], [37598, 0.08465, " about", false], [21265, 0.051184, " and", false], [4596, 0.02177, " in", false], [275, 0.019625, " (", false], [4811, 0.010303, " to", false], [60, 0.006758, ";", false], [32227, 0.003812, " that", false]]], "qwen": [11, 4, 0.07831751555204391, [[315, 0.576531, " of", false], [911, 0.126413, " about", false], [13, 0.089047, ".", false], [11, 0.078318, ",", false], [429, 0.028862, " that", false], [323, 0.024365, " and", false], [320, 0.016268, " (", false], [304, 0.009154, " in", false], [311, 0.009109, " to", false], [26, 0.005714, ";", false]]]}, "raw_delta": -0.4532339572906494, "tuned_delta": -0.4446621652600712}, {"byte_start": 2311, "byte_end": 2314, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 388, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"rwkv": "30.62% 30.62% 30.62%", "qwen": "34.32% 34.32% 34.32%"}, "model_tokens": {"rwkv": [[4715, " or", "normal", 0.006159464828670025]], "qwen": [[476, " or", "normal", 0.003315593581646681]]}, "loss": {"rwkv": 30.619699435533988, "qwen": 34.31882267814688}, "topk": {"rwkv": [4715, 19, 0.006159464828670025, [[21400, 0.394387, " but", false], [21265, 0.173016, " and", false], [32139, 0.038936, " such", false], [59841, 0.023127, " including", false], [40186, 0.018653, " which", false], [32487, 0.018028, " with", false], [4596, 0.017413, " in", false], [4423, 0.016758, " as", false], [21700, 0.011152, " for", false], [32230, 0.010708, " then", false]]], "qwen": [476, 25, 0.003315593581646681, [[714, 0.434782, " but", false], [323, 0.181965, " and", false], [448, 0.038411, " with", false], [1741, 0.030794, " such", false], [2670, 0.028073, " including", false], [1172, 0.024085, " only", false], [892, 0.023578, " which", false], [3080, 0.011885, " until", false], [304, 0.010632, " in", false], [438, 0.00972, " as", false]]]}, "raw_delta": -0.2051229476928711, "tuned_delta": -0.19655115566229284}, {"byte_start": 2314, "byte_end": 2317, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 389, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "15.87% 15.87% 15.87%", "qwen": "20.35% 20.35% 20.35%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.07145383208990097]], "qwen": [[315, " of", "normal", 0.03386511653661728]]}, "loss": {"rwkv": 15.873402468114245, "qwen": 20.350234124306272}, "topk": {"rwkv": [4706, 2, 0.07145383208990097, [[4450, 0.244458, " by", false], [4706, 0.071454, " of", false], [4424, 0.06519, " at", false], [30788, 0.037718, " even", false], [4404, 0.032433, " ``", false], [4596, 0.024966, " in", false], [40085, 0.023776, " using", false], [4788, 0.019072, " so", false], [45, 0.018771, ",", false], [47629, 0.018548, " trying", false]]], "qwen": [315, 7, 0.03386511653661728, [[9902, 0.18007, " ``", false], [11, 0.061641, ",", false], [518, 0.060405, " at", false], [553, 0.057777, " by", false], [304, 0.05474, " in", false], [1496, 0.033909, " even", false], [315, 0.033865, " of", false], [773, 0.029784, " so", false], [4751, 0.028175, " rather", false], [1119, 0.021958, " into", false]]]}, "raw_delta": -0.24824825922648108, "tuned_delta": -0.23967646719590283}, {"byte_start": 2317, "byte_end": 2321, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 390, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "10.57% 10.57% 10.57% 10.57%", "qwen": "6.59% 6.59% 6.59% 6.59%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.09579303115606308]], "qwen": [[279, " the", "normal", 0.23200125992298126]]}, "loss": {"rwkv": 10.566614069010962, "qwen": 6.586860823081602}, "topk": {"rwkv": [22590, 1, 0.09579303115606308, [[22590, 0.095793, " the", false], [38720, 0.064957, " human", false], [59792, 0.046383, " heuristic", false], [31044, 0.043984, " hand", false], [59943, 0.032278, " knowledge", false], [39193, 0.030453, " other", false], [332, 0.02655, " a", false], [4404, 0.023907, " ``", false], [32074, 0.018977, " some", false], [47202, 0.016324, " search", false]]], "qwen": [279, 1, 0.23200125992298126, [[279, 0.232001, " the", false], [3281, 0.062086, " special", false], [3738, 0.054244, " human", false], [5994, 0.043076, " Go", false], [1008, 0.037108, " other", false], [264, 0.033044, " a", false], [1045, 0.021499, " some", false], [9902, 0.019784, " ``", false], [1667, 0.007692, " using", false], [27076, 0.007412, " specialized", false]]]}, "raw_delta": 0.22068437933921814, "tuned_delta": 0.2292561713697964}, {"byte_start": 2321, "byte_end": 2329, "display": {"text": " special", "kind": "normal"}, "is_word": true, "word_id": 391, "word_key": " special", "bytes_hex": "20 73 70 65 63 69 61 6c", "compression": {"rwkv": "5.49% 5.49% 5.49% 5.49% 5.49% 5.49% 5.49% 5.49%", "qwen": "3.71% 3.71% 3.71% 3.71% 3.71% 3.71% 3.71% 3.71%"}, "model_tokens": {"rwkv": [[52964, " special", "normal", 0.08785334974527359]], "qwen": [[3281, " special", "normal", 0.1932644546031952]]}, "loss": {"rwkv": 5.4946393158857, "qwen": 3.7052372258510644}, "topk": {"rwkv": [52964, 2, 0.08785334974527359, [[60572, 0.132312, " structure", false], [52964, 0.087853, " special", false], [38720, 0.048425, " human", false], [30808, 0.037641, " fact", false], [62293, 0.025744, " particular", false], [30941, 0.017763, " game", false], [47484, 0.017089, " symmet", false], [57271, 0.015589, " specific", false], [4404, 0.014219, " ``", false], [39558, 0.013507, " rules", false]]], "qwen": [3281, 1, 0.1932644546031952, [[3281, 0.193264, " special", false], [5944, 0.122526, " structure", false], [2097, 0.03143, " fact", false], [5994, 0.02518, " Go", false], [1809, 0.020541, " game", false], [3738, 0.017236, " human", false], [7199, 0.01705, " limited", false], [9902, 0.012231, " ``", false], [1602, 0.011476, " very", false], [9981, 0.009489, " apparent", false]]]}, "raw_delta": 0.09922552108764648, "tuned_delta": 0.10779731311822473}, {"byte_start": 2329, "byte_end": 2338, "display": {"text": " features", "kind": "normal"}, "is_word": true, "word_id": 392, "word_key": " features", "bytes_hex": "20 66 65 61 74 75 72 65 73", "compression": {"rwkv": "8.83% 8.83% 8.83% 8.83% 8.83% 8.83% 8.83% 8.83% 8.83%", "qwen": "8.23% 8.23% 8.23% 8.23% 8.23% 8.23% 8.23% 8.23% 8.23%"}, "model_tokens": {"rwkv": [[56215, " features", "normal", 0.0121115418151021]], "qwen": [[4419, " features", "normal", 0.0164879709482193]]}, "loss": {"rwkv": 8.828993088773602, "qwen": 8.225613933782384}, "topk": {"rwkv": [56215, 6, 0.0121115418151021, [[60572, 0.63675, " structure", false], [62404, 0.034095, " properties", false], [46642, 0.021637, " nature", false], [62586, 0.02135, " structures", false], [47484, 0.012824, " symmet", false], [56215, 0.012112, " features", false], [56310, 0.012014, " geometry", false], [65258, 0.011735, " characteristics", false], [39558, 0.008685, " rules", false], [39654, 0.008449, " shape", false]]], "qwen": [4419, 4, 0.0164879709482193, [[5944, 0.698773, " structure", false], [5888, 0.067933, " properties", false], [6993, 0.024992, " nature", false], [4419, 0.016488, " features", false], [14389, 0.009091, " structures", false], [1809, 0.006874, " game", false], [17452, 0.00664, " characteristics", false], [6540, 0.00576, " knowledge", false], [5601, 0.005621, " rules", false], [45120, 0.004294, " symmetry", false]]]}, "raw_delta": 0.03345844480726451, "tuned_delta": 0.04203023683784276}, {"byte_start": 2338, "byte_end": 2341, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 393, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.20% 0.20% 0.20%", "qwen": "0.21% 0.21% 0.21%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9666310548782349]], "qwen": [[315, " of", "normal", 0.9655314683914185]]}, "loss": {"rwkv": 0.20399435494340606, "qwen": 0.21085330521885146}, "topk": {"rwkv": [4706, 1, 0.9666310548782349, [[4706, 0.966631, " of", false], [32227, 0.010082, " that", false], [21265, 0.00398, " and", false], [4596, 0.003571, " in", false], [275, 0.002553, " (", false], [45, 0.000726, ",", false], [47660, 0.000688, " unique", false], [57271, 0.000538, " specific", false], [56976, 0.000459, " provided", false], [32139, 0.000443, " such", false]]], "qwen": [315, 1, 0.9655314683914185, [[315, 0.965531, " of", false], [304, 0.006975, " in", false], [429, 0.006378, " that", false], [323, 0.004845, " and", false], [36988, 0.002197, " inherent", false], [320, 0.001166, " (", false], [11, 0.001155, ",", false], [3042, 0.000999, " present", false], [4911, 0.000969, " unique", false], [476, 0.000662, " or", false]]]}, "raw_delta": -0.00038034096360206604, "tuned_delta": 0.008191451066976182}, {"byte_start": 2341, "byte_end": 2345, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 394, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "3.84% 3.84% 3.84% 3.84%", "qwen": "5.12% 5.12% 5.12% 5.12%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.4348495900630951]], "qwen": [[279, " the", "normal", 0.3214719593524933]]}, "loss": {"rwkv": 3.839203111740649, "qwen": 5.116360250638249}, "topk": {"rwkv": [22590, 1, 0.4348495900630951, [[22590, 0.43485, " the", false], [3851, 0.269551, " Go", false], [37876, 0.047224, " board", false], [332, 0.023571, " a", false], [62293, 0.017269, " particular", false], [30941, 0.013335, " game", false], [52491, 0.0104, " playing", false], [38576, 0.009769, " games", false], [32234, 0.007583, " this", false], [51161, 0.006293, " certain", false]]], "qwen": [279, 2, 0.3214719593524933, [[5994, 0.547585, " Go", false], [279, 0.321472, " the", false], [419, 0.021368, " this", false], [264, 0.011347, " a", false], [4479, 0.008572, " board", false], [3738, 0.005747, " human", false], [32719, 0.00415, " chess", false], [6366, 0.003771, " computer", false], [728, 0.003709, " go", false], [9902, 0.003297, " ``", false]]]}, "raw_delta": -0.0708206295967102, "tuned_delta": -0.062248837566131955}, {"byte_start": 2345, "byte_end": 2350, "display": {"text": " game", "kind": "normal"}, "is_word": true, "word_id": 395, "word_key": " game", "bytes_hex": "20 67 61 6d 65", "compression": {"rwkv": "3.56% 3.56% 3.56% 3.56% 3.56%", "qwen": "4.66% 4.66% 4.66% 4.66% 4.66%"}, "model_tokens": {"rwkv": [[30941, " game", "normal", 0.3745507597923279]], "qwen": [[1809, " game", "normal", 0.275059312582016]]}, "loss": {"rwkv": 3.5644711459463645, "qwen": 4.655463299656067}, "topk": {"rwkv": [30941, 1, 0.3745507597923279, [[30941, 0.374551, " game", false], [37876, 0.254442, " board", false], [3851, 0.117418, " Go", false], [62293, 0.020858, " particular", false], [45775, 0.019811, " domain", false], [52569, 0.011625, " problem", false], [22638, 0.008441, " two", false], [38720, 0.008009, " human", false], [39558, 0.007313, " rules", false], [31012, 0.007254, " grid", false]]], "qwen": [1809, 2, 0.275059312582016, [[5994, 0.436529, " Go", false], [1809, 0.275059, " game", false], [4479, 0.128263, " board", false], [7947, 0.017312, " domain", false], [220, 0.008379, " ", false], [3738, 0.004586, " human", false], [3953, 0.004514, " particular", false], [2613, 0.004435, " small", false], [3491, 0.00443, " problem", false], [5944, 0.004076, " structure", false]]]}, "raw_delta": -0.06049745082855227, "tuned_delta": -0.05192565879797402}, {"byte_start": 2350, "byte_end": 2351, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "30.01%", "qwen": "29.58%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.1922062188386917]], "qwen": [[11, ",", "normal", 0.19395911693572998]]}, "loss": {"rwkv": 30.00918395599113, "qwen": 29.57719578377079}, "topk": {"rwkv": [45, 2, 0.1922062188386917, [[47, 0.363612, ".", false], [45, 0.192206, ",", false], [275, 0.071949, " (", false], [4706, 0.067428, " of", false], [32139, 0.044257, " such", false], [32227, 0.040145, " that", false], [460, 0.03844, "'s", false], [60572, 0.021663, " structure", false], [46342, 0.021244, " itself", false], [31296, 0.012087, " like", false]]], "qwen": [11, 2, 0.19395911693572998, [[13, 0.347763, ".", false], [11, 0.193959, ",", false], [315, 0.146011, " of", false], [4479, 0.062257, " board", false], [5086, 0.059378, " itself", false], [320, 0.048018, " (", false], [5994, 0.014755, " Go", false], [429, 0.014364, " that", false], [1741, 0.009644, " such", false], [323, 0.008801, " and", false]]]}, "raw_delta": 0.02395451068878174, "tuned_delta": 0.03252630271935999}, {"byte_start": 2351, "byte_end": 2355, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 396, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"rwkv": "5.57% 5.57% 5.57% 5.57%", "qwen": "5.01% 5.01% 5.01% 5.01%"}, "model_tokens": {"rwkv": [[21400, " but", "normal", 0.28987160325050354]], "qwen": [[714, " but", "normal", 0.3293311893939972]]}, "loss": {"rwkv": 5.565083409679106, "qwen": 5.007465673123974}, "topk": {"rwkv": [21400, 1, 0.28987160325050354, [[21400, 0.289872, " but", false], [32139, 0.233732, " such", false], [21265, 0.106829, " and", false], [4715, 0.104154, " or", false], [31296, 0.030195, " like", false], [4596, 0.02698, " in", false], [4811, 0.017742, " to", false], [59841, 0.012625, " including", false], [40186, 0.011637, " which", false], [4423, 0.010956, " as", false]]], "qwen": [714, 1, 0.3293311893939972, [[714, 0.329331, " but", false], [323, 0.146605, " and", false], [476, 0.131584, " or", false], [1741, 0.044465, " such", false], [3080, 0.036367, " until", false], [1172, 0.026147, " only", false], [892, 0.023762, " which", false], [448, 0.02018, " with", false], [2670, 0.018039, " including", false], [304, 0.016751, " in", false]]]}, "raw_delta": 0.03092089295387268, "tuned_delta": 0.03949268498445093}, {"byte_start": 2355, "byte_end": 2359, "display": {"text": " all", "kind": "normal"}, "is_word": true, "word_id": 397, "word_key": " all", "bytes_hex": "20 61 6c 6c", "compression": {"rwkv": "19.44% 19.44% 19.44% 19.44%", "qwen": "21.68% 21.68% 21.68% 21.68%"}, "model_tokens": {"rwkv": [[21256, " all", "normal", 0.013479495421051979]], "qwen": [[678, " all", "normal", 0.00816090777516365]]}, "loss": {"rwkv": 19.44256988698017, "qwen": 21.678297052967693}, "topk": {"rwkv": [21256, 15, 0.013479495421051979, [[39936, 0.150641, " these", false], [22590, 0.095963, " the", false], [32465, 0.091621, " when", false], [32234, 0.069119, " this", false], [4596, 0.065346, " in", false], [4601, 0.041442, " it", false], [4423, 0.035239, " as", false], [32232, 0.022459, " they", false], [32230, 0.02222, " then", false], [31578, 0.021448, " once", false]]], "qwen": [678, 25, 0.00816090777516365, [[1493, 0.137282, " these", false], [279, 0.095442, " the", false], [419, 0.089494, " this", false], [432, 0.06762, " it", false], [9583, 0.064241, " eventually", false], [304, 0.043861, " in", false], [979, 0.037487, " when", false], [1172, 0.029987, " only", false], [1221, 0.024956, " then", false], [11, 0.023043, ",", false]]]}, "raw_delta": -0.12397503852844238, "tuned_delta": -0.11540324649786414}, {"byte_start": 2359, "byte_end": 2365, "display": {"text": " those", "kind": "normal"}, "is_word": true, "word_id": 398, "word_key": " those", "bytes_hex": "20 74 68 6f 73 65", "compression": {"rwkv": "10.38% 10.38% 10.38% 10.38% 10.38% 10.38%", "qwen": "12.36% 12.36% 12.36% 12.36% 12.36% 12.36%"}, "model_tokens": {"rwkv": [[39944, " those", "normal", 0.03198657184839249]], "qwen": [[1846, " those", "normal", 0.01638016290962696]]}, "loss": {"rwkv": 10.378763152228546, "qwen": 12.358138711594995}, "topk": {"rwkv": [39944, 9, 0.03198657184839249, [[4706, 0.251499, " of", false], [39936, 0.157181, " these", false], [32139, 0.076099, " such", false], [32234, 0.065139, " this", false], [45953, 0.056934, " failed", false], [32462, 0.052521, " were", false], [32227, 0.049182, " that", false], [22590, 0.040221, " the", false], [39944, 0.031987, " those", false], [46936, 0.026999, " proved", false]]], "qwen": [1846, 11, 0.01638016290962696, [[315, 0.231068, " of", false], [1493, 0.211625, " these", false], [419, 0.083974, " this", false], [429, 0.068219, " that", false], [1741, 0.039104, " such", false], [1033, 0.033162, " were", false], [4641, 0.032745, " failed", false], [279, 0.027002, " the", false], [8869, 0.020748, " efforts", false], [304, 0.020119, " in", false]]]}, "raw_delta": -0.10975988705952955, "tuned_delta": -0.1011880950289513}, {"byte_start": 2365, "byte_end": 2373, "display": {"text": " efforts", "kind": "normal"}, "is_word": true, "word_id": 399, "word_key": " efforts", "bytes_hex": "20 65 66 66 6f 72 74 73", "compression": {"rwkv": "1.67% 1.67% 1.67% 1.67% 1.67% 1.67% 1.67% 1.67%", "qwen": "1.16% 1.16% 1.16% 1.16% 1.16% 1.16% 1.16% 1.16%"}, "model_tokens": {"rwkv": [[51566, " efforts", "normal", 0.4796241521835327]], "qwen": [[8869, " efforts", "normal", 0.5964605808258057]]}, "loss": {"rwkv": 1.6730472275934023, "qwen": 1.164845749811886}, "topk": {"rwkv": [51566, 1, 0.4796241521835327, [[51566, 0.479624, " efforts", false], [52224, 0.114917, " methods", false], [61590, 0.086399, " approaches", false], [38720, 0.024548, " human", false], [32462, 0.023234, " were", false], [55572, 0.019823, " attempts", false], [22762, 0.01328, " who", false], [45953, 0.010727, " failed", false], [32227, 0.009949, " that", false], [38328, 0.009683, " early", false]]], "qwen": [8869, 1, 0.5964605808258057, [[8869, 0.596461, " efforts", false], [5413, 0.095559, " methods", false], [19827, 0.069919, " approaches", false], [13553, 0.038784, " attempts", false], [4124, 0.02333, " early", false], [1635, 0.008638, " years", false], [2856, 0.007268, " initial", false], [12538, 0.005982, " techniques", false], [6708, 0.005706, " ideas", false], [3412, 0.005579, " research", false]]]}, "raw_delta": 0.028180673718452454, "tuned_delta": 0.036752465749030704}, {"byte_start": 2373, "byte_end": 2380, "display": {"text": " proved", "kind": "normal"}, "is_word": true, "word_id": 400, "word_key": " proved", "bytes_hex": "20 70 72 6f 76 65 64", "compression": {"rwkv": "6.68% 6.68% 6.68% 6.68% 6.68% 6.68% 6.68%", "qwen": "7.26% 7.26% 7.26% 7.26% 7.26% 7.26% 7.26%"}, "model_tokens": {"rwkv": [[46936, " proved", "normal", 0.07473129779100418]], "qwen": [[18651, " proved", "normal", 0.05967317521572113]]}, "loss": {"rwkv": 6.6821254684031235, "qwen": 7.262095805446487}, "topk": {"rwkv": [46936, 3, 0.07473129779100418, [[32462, 0.364346, " were", false], [45953, 0.129943, " failed", false], [46936, 0.074731, " proved", false], [62676, 0.041216, " ultimately", false], [61959, 0.028101, " eventually", false], [30383, 0.025273, " came", false], [21532, 0.020969, " did", false], [38367, 0.020479, " ended", false], [47638, 0.01424, " turned", false], [32460, 0.01336, " went", false]]], "qwen": [18651, 3, 0.05967317521572113, [[1033, 0.367029, " were", false], [4641, 0.179818, " failed", false], [18651, 0.059673, " proved", false], [13653, 0.048752, " ultimately", false], [9583, 0.031623, " eventually", false], [9482, 0.028981, " ended", false], [11, 0.015861, ",", false], [11052, 0.014836, " fell", false], [614, 0.014054, " have", false], [3697, 0.012633, " came", false]]]}, "raw_delta": -0.03216038431440077, "tuned_delta": -0.02358859228382252}, {"byte_start": 2380, "byte_end": 2391, "display": {"text": " irrelevant", "kind": "normal"}, "is_word": true, "word_id": 401, "word_key": " irrelevant", "bytes_hex": "20 69 72 72 65 6c 65 76 61 6e 74", "compression": {"rwkv": "8.91% 8.91% 8.91% 8.91% 8.91% 8.91% 8.91% 8.91% 8.91% 8.91% 8.91%", "qwen": "10.89% 10.89% 10.89% 10.89% 10.89% 10.89% 10.89% 10.89% 10.89% 10.89% 10.89%"}, "model_tokens": {"rwkv": [[62161, " irrelevant", "normal", 0.004359398037195206]], "qwen": [[39715, " irrelevant", "normal", 0.0013073112349957228]]}, "loss": {"rwkv": 8.914379869129245, "qwen": 10.885433943701791}, "topk": {"rwkv": [62161, 30, 0.004359398037195206, [[4811, 0.169799, " to", false], [62676, 0.108742, " ultimately", false], [62088, 0.062653, " inadequate", false], [63631, 0.060356, " ineffective", false], [21719, 0.059164, " fut", false], [31277, 0.044976, " less", false], [64450, 0.034119, " insufficient", false], [64616, 0.029121, " unsuccessful", false], [56445, 0.021643, " inferior", false], [38562, 0.019466, " fruit", false]]], "qwen": [39715, 63, 0.0013073112349957228, [[44925, 0.188567, " unsuccessful", false], [13779, 0.135968, " fruit", false], [311, 0.112288, " to", false], [84527, 0.065561, " futile", false], [38313, 0.053151, " insufficient", false], [54188, 0.041893, " ineffective", false], [13653, 0.034876, " ultimately", false], [45479, 0.024206, " inadequate", false], [38123, 0.017821, " disappointing", false], [2238, 0.01687, " too", false]]]}, "raw_delta": -0.10929844596169212, "tuned_delta": -0.10072665393111388}, {"byte_start": 2391, "byte_end": 2392, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "61.71%", "qwen": "49.52%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.03248727694153786]], "qwen": [[11, ",", "normal", 0.06418482959270477]]}, "loss": {"rwkv": 61.709026163024014, "qwen": 49.520297528472675}, "topk": {"rwkv": [45, 7, 0.03248727694153786, [[32465, 0.290877, " when", false], [4596, 0.165691, " in", false], [4811, 0.141382, " to", false], [47, 0.122309, ".", false], [4423, 0.084247, " as", false], [31578, 0.0398, " once", false], [45, 0.032487, ",", false], [21265, 0.013905, " and", false], [55794, 0.013724, " compared", false], [37634, 0.012328, " after", false]]], "qwen": [11, 6, 0.06418482959270477, [[13, 0.225093, ".", false], [979, 0.184171, " when", false], [304, 0.139454, " in", false], [311, 0.097434, " to", false], [438, 0.075705, " as", false], [11, 0.064185, ",", false], [3055, 0.046634, " once", false], [1283, 0.021483, " after", false], [369, 0.014886, " for", false], [323, 0.014392, " and", false]]]}, "raw_delta": 0.6758866310119629, "tuned_delta": 0.6844584230425411}, {"byte_start": 2392, "byte_end": 2395, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 402, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"rwkv": "20.19% 20.19% 20.19%", "qwen": "25.52% 25.52% 25.52%"}, "model_tokens": {"rwkv": [[4715, " or", "normal", 0.0346657894551754]], "qwen": [[476, " or", "normal", 0.01434085238724947]]}, "loss": {"rwkv": 20.19397355410984, "qwen": 25.515523797412175}, "topk": {"rwkv": [4715, 6, 0.0346657894551754, [[21265, 0.334903, " and", false], [4423, 0.1551, " as", false], [51018, 0.062139, " because", false], [4596, 0.052483, " in", false], [32465, 0.042149, " when", false], [4715, 0.034666, " or", false], [40187, 0.033495, " while", false], [31578, 0.02105, " once", false], [39690, 0.019456, " since", false], [32487, 0.015308, " with", false]]], "qwen": [476, 8, 0.01434085238724947, [[323, 0.510421, " and", false], [438, 0.138638, " as", false], [1576, 0.072281, " because", false], [2474, 0.031531, " since", false], [1496, 0.024779, " even", false], [304, 0.017724, " in", false], [448, 0.016665, " with", false], [476, 0.014341, " or", false], [369, 0.013842, " for", false], [518, 0.010165, " at", false]]]}, "raw_delta": -0.29508940378824855, "tuned_delta": -0.2865176117576703}, {"byte_start": 2395, "byte_end": 2401, "display": {"text": " worse", "kind": "normal"}, "is_word": true, "word_id": 403, "word_key": " worse", "bytes_hex": "20 77 6f 72 73 65", "compression": {"rwkv": "7.51% 7.51% 7.51% 7.51% 7.51% 7.51%", "qwen": "6.50% 6.50% 6.50% 6.50% 6.50% 6.50%"}, "model_tokens": {"rwkv": [[40216, " worse", "normal", 0.08160778880119324]], "qwen": [[10960, " worse", "normal", 0.1149168461561203]]}, "loss": {"rwkv": 7.514036671296684, "qwen": 6.502787283355913}, "topk": {"rwkv": [40216, 2, 0.08160778880119324, [[4424, 0.398658, " at", false], [40216, 0.081608, " worse", false], [30788, 0.054097, " even", false], [31581, 0.026726, " only", false], [31277, 0.015032, " less", false], [22187, 0.01217, " not", false], [62161, 0.011741, " irrelevant", false], [22614, 0.011484, " too", false], [51336, 0.010688, " counter", false], [63631, 0.010246, " ineffective", false]]], "qwen": [10960, 2, 0.1149168461561203, [[518, 0.291973, " at", false], [10960, 0.114917, " worse", false], [1496, 0.109925, " even", false], [1033, 0.072651, " were", false], [11, 0.019511, ",", false], [304, 0.019083, " in", false], [1172, 0.018328, " only", false], [4751, 0.0173, " rather", false], [1602, 0.008229, " very", false], [421, 0.007831, " if", false]]]}, "raw_delta": 0.0560755729675293, "tuned_delta": 0.06464736499810754}, {"byte_start": 2401, "byte_end": 2402, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "3.75%", "qwen": "5.24%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8126047253608704]], "qwen": [[11, ",", "normal", 0.7480016350746155]]}, "loss": {"rwkv": 3.7511479944988912, "qwen": 5.2360832858074735}, "topk": {"rwkv": [45, 1, 0.8126047253608704, [[45, 0.812605, ",", false], [47, 0.144453, ".", false], [59, 0.005925, ":", false], [32226, 0.005779, " than", false], [275, 0.00417, " (", false], [39820, 0.00309, " still", false], [22797, 0.002026, " yet", false], [4596, 0.001995, " in", false], [60, 0.001529, ";", false], [32465, 0.001258, " when", false]]], "qwen": [11, 1, 0.7480016350746155, [[11, 0.748002, ",", false], [13, 0.156205, ".", false], [1091, 0.024821, " than", false], [25, 0.013021, ":", false], [2058, 0.011146, " still", false], [382, 0.007431, ".\n\n", false], [320, 0.006354, " (", false], [3602, 0.006277, " yet", false], [304, 0.002296, " in", false], [1496, 0.001828, " even", false]]]}, "raw_delta": -0.08234229683876038, "tuned_delta": -0.07377050480818213}, {"byte_start": 2402, "byte_end": 2407, "display": {"text": " once", "kind": "normal"}, "is_word": true, "word_id": 404, "word_key": " once", "bytes_hex": "20 6f 6e 63 65", "compression": {"rwkv": "10.76% 10.76% 10.76% 10.76% 10.76%", "qwen": "17.17% 17.17% 17.17% 17.17% 17.17%"}, "model_tokens": {"rwkv": [[31578, " once", "normal", 0.05073611065745354]], "qwen": [[3055, " once", "normal", 0.008549327030777931]]}, "loss": {"rwkv": 10.7638575316325, "qwen": 17.174933919864813}, "topk": {"rwkv": [31578, 5, 0.05073611065745354, [[32465, 0.465948, " when", false], [4423, 0.139763, " as", false], [4596, 0.122279, " in", false], [4811, 0.071231, " to", false], [31578, 0.050736, " once", false], [51018, 0.014975, " because", false], [37634, 0.013941, " after", false], [22590, 0.009001, " the", false], [21265, 0.0075, " and", false], [55794, 0.005529, " compared", false]]], "qwen": [3055, 16, 0.008549327030777931, [[979, 0.130104, " when", false], [304, 0.094937, " in", false], [438, 0.081083, " as", false], [311, 0.047145, " to", false], [5546, 0.046519, " counter", false], [807, 0.035521, " they", false], [1033, 0.033083, " were", false], [1576, 0.0218, " because", false], [323, 0.018987, " and", false], [1283, 0.014799, " after", false]]]}, "raw_delta": -0.35550556182861326, "tuned_delta": -0.34693376979803503}, {"byte_start": 2407, "byte_end": 2414, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 405, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "7.00% 7.00% 7.00% 7.00% 7.00% 7.00% 7.00%", "qwen": "5.30% 5.30% 5.30% 5.30% 5.30% 5.30% 5.30%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.0654434785246849]], "qwen": [[2711, " search", "normal", 0.12801995873451233]]}, "loss": {"rwkv": 7.004155611458694, "qwen": 5.295641875914862}, "topk": {"rwkv": [47202, 4, 0.0654434785246849, [[22590, 0.252623, " the", false], [332, 0.098207, " a", false], [51832, 0.071414, " general", false], [47202, 0.065443, " search", false], [30597, 0.046835, " deep", false], [52224, 0.027957, " methods", false], [4601, 0.025044, " it", false], [52195, 0.02204, " massive", false], [59345, 0.016717, " computers", false], [63370, 0.013647, " computation", false]]], "qwen": [2711, 2, 0.12801995873451233, [[279, 0.272289, " the", false], [2711, 0.12802, " search", false], [264, 0.067083, " a", false], [5538, 0.042659, " deep", false], [64098, 0.025337, " brute", false], [5994, 0.021651, " Go", false], [6366, 0.020424, " computer", false], [432, 0.020042, " it", false], [10951, 0.016654, " massive", false], [803, 0.01515, " more", false]]]}, "raw_delta": 0.0947401182992118, "tuned_delta": 0.10331191032979005}, {"byte_start": 2414, "byte_end": 2418, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 406, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "9.02% 9.02% 9.02% 9.02%", "qwen": "9.35% 9.35% 9.35% 9.35%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.13477815687656403]], "qwen": [[572, " was", "normal", 0.12576831877231598]]}, "loss": {"rwkv": 9.01684400555602, "qwen": 9.347373162682981}, "topk": {"rwkv": [22748, 3, 0.13477815687656403, [[45283, 0.237867, " became", false], [46, 0.168972, "-", false], [22748, 0.134778, " was", false], [52224, 0.08936, " methods", false], [21795, 0.026584, " had", false], [32487, 0.017196, " with", false], [37810, 0.014106, " based", false], [21265, 0.012929, " and", false], [61559, 0.012752, " algorithms", false], [4450, 0.011651, " by", false]]], "qwen": [572, 3, 0.12576831877231598, [[5980, 0.388347, "-based", false], [6116, 0.183554, " became", false], [572, 0.125768, " was", false], [5413, 0.037246, " methods", false], [1030, 0.026783, " had", false], [18651, 0.025728, " proved", false], [3118, 0.018455, " based", false], [3697, 0.013409, " came", false], [1410, 0.012272, " could", false], [6009, 0.009349, " began", false]]]}, "raw_delta": -0.018328428268432617, "tuned_delta": -0.009756636237854369}, {"byte_start": 2418, "byte_end": 2426, "display": {"text": " applied", "kind": "normal"}, "is_word": true, "word_id": 407, "word_key": " applied", "bytes_hex": "20 61 70 70 6c 69 65 64", "compression": {"rwkv": "6.59% 6.59% 6.59% 6.59% 6.59% 6.59% 6.59% 6.59%", "qwen": "8.78% 8.78% 8.78% 8.78% 8.78% 8.78% 8.78% 8.78%"}, "model_tokens": {"rwkv": [[50937, " applied", "normal", 0.053955789655447006]], "qwen": [[9251, " applied", "normal", 0.0203444492071867]]}, "loss": {"rwkv": 6.5865227696835, "qwen": 8.780032494450476}, "topk": {"rwkv": [50937, 3, 0.053955789655447006, [[31351, 0.090637, " made", false], [59206, 0.089687, " available", false], [50937, 0.053956, " applied", false], [51744, 0.034488, " finally", false], [59506, 0.034336, " developed", false], [22590, 0.029703, " the", false], [51097, 0.027678, " brought", false], [64583, 0.025097, " sufficiently", false], [32354, 0.025039, " used", false], [63616, 0.020898, " implemented", false]]], "qwen": [9251, 12, 0.0203444492071867, [[1865, 0.053315, " made", false], [2500, 0.049449, " available", false], [5499, 0.049129, " finally", false], [11523, 0.040386, " introduced", false], [7117, 0.037536, " brought", false], [1483, 0.036969, " used", false], [11537, 0.035659, " implemented", false], [5420, 0.032594, " allowed", false], [279, 0.023325, " the", false], [3694, 0.021444, " added", false]]]}, "raw_delta": -0.12163400650024414, "tuned_delta": -0.1130622144696659}, {"byte_start": 2426, "byte_end": 2438, "display": {"text": " effectively", "kind": "normal"}, "is_word": true, "word_id": 408, "word_key": " effectively", "bytes_hex": "20 65 66 66 65 63 74 69 76 65 6c 79", "compression": {"rwkv": "7.98% 7.98% 7.98% 7.98% 7.98% 7.98% 7.98% 7.98% 7.98% 7.98% 7.98% 7.98%", "qwen": "6.01% 6.01% 6.01% 6.01% 6.01% 6.01% 6.01% 6.01% 6.01% 6.01% 6.01% 6.01%"}, "model_tokens": {"rwkv": [[63507, " effectively", "normal", 0.004854880273342133]], "qwen": [[13444, " effectively", "normal", 0.018304264172911644]]}, "loss": {"rwkv": 7.983663963252726, "qwen": 6.012163059512656}, "topk": {"rwkv": [63507, 22, 0.004854880273342133, [[47, 0.41929, ".", false], [4811, 0.169509, " to", false], [4596, 0.088032, " in", false], [21265, 0.044924, " and", false], [45, 0.027145, ",", false], [32487, 0.022463, " with", false], [4712, 0.020371, " on", false], [4424, 0.018365, " at", false], [4517, 0.01801, " en", false], [4423, 0.015975, " as", false]]], "qwen": [13444, 9, 0.018304264172911644, [[13, 0.52186, ".", false], [311, 0.097049, " to", false], [382, 0.055723, ".\n\n", false], [304, 0.043837, " in", false], [518, 0.029843, " at", false], [11, 0.029381, ",", false], [448, 0.027847, " with", false], [389, 0.02059, " on", false], [13444, 0.018304, " effectively", false], [323, 0.014927, " and", false]]]}, "raw_delta": 0.10932322343190505, "tuned_delta": 0.1178950154624833}, {"byte_start": 2438, "byte_end": 2441, "display": {"text": " at", "kind": "normal"}, "is_word": true, "word_id": 409, "word_key": " at", "bytes_hex": "20 61 74", "compression": {"rwkv": "31.37% 31.37% 31.37%", "qwen": "30.17% 30.17% 30.17%"}, "model_tokens": {"rwkv": [[4424, " at", "normal", 0.005401988048106432]], "qwen": [[518, " at", "normal", 0.006613673642277718]]}, "loss": {"rwkv": 31.371103102663653, "qwen": 30.16805292972565}, "topk": {"rwkv": [4424, 11, 0.005401988048106432, [[47, 0.573171, ".", false], [4811, 0.225641, " to", false], [21265, 0.052157, " and", false], [45, 0.032724, ",", false], [4596, 0.024689, " in", false], [275, 0.011357, " (", false], [32487, 0.011309, " with", false], [4450, 0.010695, " by", false], [4712, 0.008205, " on", false], [40085, 0.00728, " using", false]]], "qwen": [518, 12, 0.006613673642277718, [[13, 0.617983, ".", false], [382, 0.087803, ".\n\n", false], [311, 0.062098, " to", false], [11, 0.055043, ",", false], [3322, 0.032495, " enough", false], [323, 0.030829, " and", false], [304, 0.020317, " in", false], [553, 0.012897, " by", false], [320, 0.010857, " (", false], [448, 0.010341, " with", false]]]}, "raw_delta": 0.06671126683553052, "tuned_delta": 0.07528305886610877}, {"byte_start": 2441, "byte_end": 2447, "display": {"text": " scale", "kind": "normal"}, "is_word": true, "word_id": 410, "word_key": " scale", "bytes_hex": "20 73 63 61 6c 65", "compression": {"rwkv": "5.40% 5.40% 5.40% 5.40% 5.40% 5.40%", "qwen": "5.67% 5.67% 5.67% 5.67% 5.67% 5.67%"}, "model_tokens": {"rwkv": [[39590, " scale", "normal", 0.16841745376586914]], "qwen": [[5452, " scale", "normal", 0.151595801115036]]}, "loss": {"rwkv": 5.400713857494492, "qwen": 5.670204938641484}, "topk": {"rwkv": [39590, 3, 0.16841745376586914, [[332, 0.204759, " a", false], [22590, 0.170021, " the", false], [39590, 0.168417, " scale", false], [38864, 0.078099, " large", false], [52195, 0.053434, " massive", false], [4419, 0.029039, " an", false], [21256, 0.022619, " all", false], [31082, 0.016488, " high", false], [62606, 0.013832, " sufficient", false], [39855, 0.012291, " super", false]]], "qwen": [5452, 3, 0.151595801115036, [[279, 0.230702, " the", false], [264, 0.194575, " a", false], [5452, 0.151596, " scale", false], [678, 0.06696, " all", false], [458, 0.024789, " an", false], [3460, 0.013573, " large", false], [1602, 0.013524, " very", false], [1045, 0.01254, " some", false], [28405, 0.012332, " scales", false], [1550, 0.012189, " high", false]]]}, "raw_delta": -0.014943758646647098, "tuned_delta": -0.00637196661606885}, {"byte_start": 2447, "byte_end": 2448, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "2.99%", "qwen": "5.67%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.8458263278007507]], "qwen": [[13, ".", "normal", 0.7302824258804321]]}, "loss": {"rwkv": 2.9938739862197723, "qwen": 5.668420260341593}, "topk": {"rwkv": [47, 1, 0.8458263278007507, [[47, 0.845826, ".", false], [45, 0.033495, ",", false], [4811, 0.03331, " to", false], [21265, 0.0227, " and", false], [275, 0.013027, " (", false], [4450, 0.007837, " by", false], [4596, 0.007629, " in", false], [40085, 0.006791, " using", false], [32487, 0.006761, " with", false], [4712, 0.002454, " on", false]]], "qwen": [13, 1, 0.7302824258804321, [[13, 0.730282, ".", false], [382, 0.108808, ".\n\n", false], [11, 0.040343, ",", false], [311, 0.02045, " to", false], [323, 0.018308, " and", false], [320, 0.016744, " (", false], [304, 0.008748, " in", false], [448, 0.007164, " with", false], [624, 0.006981, ".\n", false], [553, 0.006571, " by", false]]]}, "raw_delta": -0.14830833673477173, "tuned_delta": -0.13973654470419347}, {"byte_start": 2448, "byte_end": 2453, "display": {"text": " Also", "kind": "normal"}, "is_word": true, "word_id": 411, "word_key": " also", "bytes_hex": "20 41 6c 73 6f", "compression": {"rwkv": "27.73% 27.73% 27.73% 27.73% 27.73%", "qwen": "28.49% 28.49% 28.49% 28.49% 28.49%"}, "model_tokens": {"rwkv": [[28402, " Also", "normal", 0.000463341100839898]], "qwen": [[7281, " Also", "normal", 0.0003707799769472331]]}, "loss": {"rwkv": 27.726795317084765, "qwen": 28.49287311726155}, "topk": {"rwkv": [28402, 125, 0.000463341100839898, [[261, 0.245212, "\n\n", false], [20996, 0.120486, " The", false], [3913, 0.042041, " In", false], [36251, 0.036602, " Again", false], [267, 0.035076, "  ", false], [29894, 0.032905, " This", false], [3918, 0.029586, " It", false], [300, 0.020538, " A", false], [37451, 0.017805, " There", false], [29511, 0.015977, " Once", false]]], "qwen": [7281, 176, 0.0003707799769472331, [[576, 0.178201, " The", false], [758, 0.057772, " In", false], [1096, 0.054582, " This", false], [220, 0.050601, " ", false], [1084, 0.038084, " It", false], [13759, 0.030587, " Again", false], [4220, 0.022767, " These", false], [362, 0.022738, " A", false], [320, 0.020443, " (", false], [2619, 0.020139, " There", false]]]}, "raw_delta": -0.04248037338256827, "tuned_delta": -0.03390858135199002}, {"byte_start": 2453, "byte_end": 2463, "display": {"text": " important", "kind": "normal"}, "is_word": true, "word_id": 412, "word_key": " important", "bytes_hex": "20 69 6d 70 6f 72 74 61 6e 74", "compression": {"rwkv": "15.22% 15.22% 15.22% 15.22% 15.22% 15.22% 15.22% 15.22% 15.22% 15.22%", "qwen": "11.92% 11.92% 11.92% 11.92% 11.92% 11.92% 11.92% 11.92% 11.92% 11.92%"}, "model_tokens": {"rwkv": [[59829, " important", "normal", 0.0002152388624381274]], "qwen": [[2989, " important", "normal", 0.0013470856938511133]]}, "loss": {"rwkv": 15.215924259375784, "qwen": 11.919928350385316}, "topk": {"rwkv": [59829, 111, 0.0002152388624381274, [[45, 0.390312, ",", false], [4596, 0.230308, " in", false], [31296, 0.080176, " like", false], [4423, 0.057574, " as", false], [4424, 0.031256, " at", false], [51419, 0.014735, " delayed", false], [32487, 0.011839, " with", false], [332, 0.010051, " a", false], [52906, 0.008664, " similar", false], [4712, 0.007033, " on", false]]], "qwen": [2989, 33, 0.0013470856938511133, [[11, 0.518282, ",", false], [304, 0.154027, " in", false], [4428, 0.038448, " similar", false], [1075, 0.03246, " like", false], [518, 0.026148, " at", false], [1490, 0.014715, " see", false], [79330, 0.012672, " delaying", false], [22706, 0.011817, " delayed", false], [438, 0.011266, " as", false], [279, 0.006489, " the", false]]]}, "raw_delta": 0.1827688217163086, "tuned_delta": 0.19134061374688685}, {"byte_start": 2463, "byte_end": 2467, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 413, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "7.22% 7.22% 7.22% 7.22%", "qwen": "5.04% 5.04% 5.04% 5.04%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.2006615549325943]], "qwen": [[572, " was", "normal", 0.32709893584251404]]}, "loss": {"rwkv": 7.220519613824157, "qwen": 5.038128029989677}, "topk": {"rwkv": [22748, 2, 0.2006615549325943, [[4596, 0.252713, " in", false], [22748, 0.200662, " was", false], [31077, 0.118265, " here", false], [45, 0.115576, ",", false], [32462, 0.089572, " were", false], [4811, 0.077186, " to", false], [4600, 0.05561, " is", false], [21700, 0.025312, " for", false], [21286, 0.014834, " are", false], [21400, 0.005999, " but", false]]], "qwen": [572, 1, 0.32709893584251404, [[572, 0.327099, " was", false], [304, 0.145178, " in", false], [374, 0.132326, " is", false], [1588, 0.093775, " here", false], [311, 0.089232, " to", false], [11, 0.0642, ",", false], [1033, 0.047665, " were", false], [369, 0.025981, " for", false], [25, 0.022407, ":", false], [525, 0.013844, " are", false]]]}, "raw_delta": 0.12101748585700989, "tuned_delta": 0.12958927788758814}, {"byte_start": 2467, "byte_end": 2471, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 414, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "1.36% 1.36% 1.36% 1.36%", "qwen": "2.14% 2.14% 2.14% 2.14%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.7405827045440674]], "qwen": [[279, " the", "normal", 0.622162401676178]]}, "loss": {"rwkv": 1.3648543172472491, "qwen": 2.1394903772153064}, "topk": {"rwkv": [22590, 1, 0.7405827045440674, [[22590, 0.740583, " the", false], [32227, 0.072345, " that", false], [332, 0.06375, " a", false], [4419, 0.013205, " an", false], [32499, 0.005354, " work", false], [56950, 0.004961, " progress", false], [57103, 0.004122, " research", false], [21835, 0.004078, " how", false], [38720, 0.003317, " human", false], [50919, 0.002861, " another", false]]], "qwen": [279, 1, 0.622162401676178, [[279, 0.622162, " the", false], [429, 0.178184, " that", false], [264, 0.082814, " a", false], [458, 0.020369, " an", false], [1246, 0.009444, " how", false], [3738, 0.003298, " human", false], [3412, 0.00252, " research", false], [5994, 0.00251, " Go", false], [537, 0.002483, " not", false], [5098, 0.002443, " progress", false]]]}, "raw_delta": -0.0429549440741539, "tuned_delta": -0.03438315204357565}, {"byte_start": 2471, "byte_end": 2475, "display": {"text": " use", "kind": "normal"}, "is_word": true, "word_id": 415, "word_key": " use", "bytes_hex": "20 75 73 65", "compression": {"rwkv": "18.32% 18.32% 18.32% 18.32%", "qwen": "21.57% 21.57% 21.57% 21.57%"}, "model_tokens": {"rwkv": [[22681, " use", "normal", 0.017374522984027863]], "qwen": [[990, " use", "normal", 0.008351313881576061]]}, "loss": {"rwkv": 18.315464386285665, "qwen": 21.57431634225604}, "topk": {"rwkv": [22681, 5, 0.017374522984027863, [[30808, 0.096526, " fact", false], [63469, 0.037724, " development", false], [59544, 0.033335, " discovery", false], [63820, 0.027142, " realization", false], [22681, 0.017375, " use", false], [63729, 0.01587, " observation", false], [31894, 0.014609, " role", false], [59612, 0.013572, " emergence", false], [63821, 0.01307, " recognition", false], [52013, 0.011464, " initial", false]]], "qwen": [990, 13, 0.008351313881576061, [[2097, 0.131559, " fact", false], [48703, 0.073433, " realization", false], [4401, 0.028247, " development", false], [18335, 0.026365, " discovery", false], [7901, 0.019405, " failure", false], [7626, 0.018758, " delay", false], [17843, 0.017594, " recognition", false], [6853, 0.017374, " lack", false], [48079, 0.0142, " emergence", false], [21930, 0.011831, " observation", false]]]}, "raw_delta": -0.1807091236114502, "tuned_delta": -0.17213733158087194}, {"byte_start": 2475, "byte_end": 2478, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 416, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.21% 0.21% 0.21%", "qwen": "0.25% 0.25% 0.25%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9654042720794678]], "qwen": [[315, " of", "normal", 0.9587425589561462]]}, "loss": {"rwkv": 0.21133228138021923, "qwen": 0.25326935505014186}, "topk": {"rwkv": [4706, 1, 0.9654042720794678, [[4706, 0.965404, " of", false], [45, 0.012247, ",", false], [4450, 0.008096, " by", false], [4596, 0.005176, " in", false], [275, 0.001271, " (", false], [4424, 0.000813, " at", false], [21265, 0.000751, " and", false], [31601, 0.000534, " over", false], [21700, 0.000303, " for", false], [32227, 0.000271, " that", false]]], "qwen": [315, 1, 0.9587425589561462, [[315, 0.958743, " of", false], [553, 0.015525, " by", false], [304, 0.007103, " in", false], [11, 0.006722, ",", false], [323, 0.001733, " and", false], [429, 0.001189, " that", false], [320, 0.001157, " (", false], [1865, 0.001034, " made", false], [311, 0.000661, " to", false], [518, 0.000401, " at", false]]]}, "raw_delta": -0.0023254851500193272, "tuned_delta": 0.006246306880558921}, {"byte_start": 2478, "byte_end": 2487, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 417, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "12.34% 12.34% 12.34% 12.34% 12.34% 12.34% 12.34% 12.34% 12.34%", "qwen": "12.02% 12.02% 12.02% 12.02% 12.02% 12.02% 12.02% 12.02% 12.02%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.002125680912286043]], "qwen": [[6832, " learning", "normal", 0.0024785639252513647]]}, "loss": {"rwkv": 12.335543535378722, "qwen": 12.022611547542127}, "topk": {"rwkv": [56537, 62, 0.002125680912286043, [[38720, 0.059488, " human", false], [332, 0.054038, " a", false], [22590, 0.043098, " the", false], [46658, 0.037007, " neural", false], [52195, 0.032594, " massive", false], [30597, 0.028056, " deep", false], [59988, 0.024844, " massively", false], [56812, 0.020321, " parallel", false], [52167, 0.018009, " machine", false], [63875, 0.017711, " specialized", false]]], "qwen": [6832, 63, 0.0024785639252513647, [[264, 0.079057, " a", false], [3738, 0.068136, " human", false], [279, 0.0513, " the", false], [5538, 0.047295, " deep", false], [29728, 0.02188, " neural", false], [11773, 0.018944, " hardware", false], [45767, 0.017372, " Monte", false], [9902, 0.01727, " ``", false], [71278, 0.014542, " reinforcement", false], [1602, 0.013646, " very", false]]]}, "raw_delta": 0.01735263400607645, "tuned_delta": 0.0259244260366547}, {"byte_start": 2487, "byte_end": 2490, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 418, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "21.13% 21.13% 21.13%", "qwen": "23.24% 23.24% 23.24%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.02975294552743435]], "qwen": [[553, " by", "normal", 0.02092740871012211]]}, "loss": {"rwkv": 21.133228138021924, "qwen": 23.243592850229273}, "topk": {"rwkv": [4450, 8, 0.02975294552743435, [[52224, 0.167015, " methods", false], [4811, 0.161166, " to", false], [61559, 0.123459, " algorithms", false], [45, 0.107821, ",", false], [30917, 0.101079, " from", false], [46, 0.034105, "-", false], [62633, 0.033417, " techniques", false], [4450, 0.029753, " by", false], [21265, 0.021394, " and", false], [275, 0.019614, " (", false]]], "qwen": [553, 11, 0.02092740871012211, [[311, 0.189302, " to", false], [5413, 0.157174, " methods", false], [11, 0.103816, ",", false], [5980, 0.077431, "-based", false], [25185, 0.067118, " algorithms", false], [12538, 0.049246, " techniques", false], [504, 0.0439, " from", false], [13, 0.031723, ".", false], [304, 0.028716, " in", false], [323, 0.027407, " and", false]]]}, "raw_delta": -0.11702346801757812, "tuned_delta": -0.10845167598699988}, {"byte_start": 2490, "byte_end": 2495, "display": {"text": " self", "kind": "normal"}, "is_word": true, "word_id": 419, "word_key": " self", "bytes_hex": "20 73 65 6c 66", "compression": {"rwkv": "16.57% 16.57% 16.57% 16.57% 16.57%", "qwen": "13.08% 13.08% 13.08% 13.08% 13.08%"}, "model_tokens": {"rwkv": [[31978, " self", "normal", 0.010073735378682613]], "qwen": [[656, " self", "normal", 0.026586027815937996]]}, "loss": {"rwkv": 16.568450860209186, "qwen": 13.082969625977602}, "topk": {"rwkv": [31978, 17, 0.010073735378682613, [[65003, 0.1349, " reinforcement", false], [59815, 0.102238, " imitation", false], [51668, 0.063129, " example", false], [30597, 0.061445, " deep", false], [46658, 0.042966, " neural", false], [38720, 0.032869, " human", false], [30218, 0.027649, " back", false], [22590, 0.02644, " the", false], [52491, 0.024558, " playing", false], [62557, 0.022996, " simulation", false]]], "qwen": [656, 7, 0.026586027815937996, [[5619, 0.168756, " playing", false], [3738, 0.110576, " human", false], [12677, 0.065122, " humans", false], [71278, 0.053049, " reinforcement", false], [3110, 0.036931, " example", false], [9091, 0.028179, " trial", false], [656, 0.026586, " self", false], [86840, 0.024489, " imitation", false], [1486, 0.023211, " play", false], [55103, 0.018182, " analogy", false]]]}, "raw_delta": 0.1932761192321777, "tuned_delta": 0.20184791126275595}, {"byte_start": 2495, "byte_end": 2500, "display": {"text": " play", "kind": "normal"}, "is_word": true, "word_id": 420, "word_key": " play", "bytes_hex": "20 70 6c 61 79", "compression": {"rwkv": "12.17% 12.17% 12.17% 12.17% 12.17%", "qwen": "15.15% 15.15% 15.15% 15.15% 15.15%"}, "model_tokens": {"rwkv": [[31702, " play", "normal", 0.03406842425465584]], "qwen": [[1486, " play", "normal", 0.014976556412875652]]}, "loss": {"rwkv": 12.172739407500629, "qwen": 15.15287541956948}, "topk": {"rwkv": [31702, 2, 0.03406842425465584, [[46, 0.945554, "-", false], [31702, 0.034068, " play", false], [26697, 0.008956, "play", false], [57453, 0.001425, " training", false], [63621, 0.000766, " improvement", false], [52491, 0.000756, " playing", false], [45, 0.000704, ",", false], [21265, 0.000694, " and", false], [4715, 0.000517, " or", false], [275, 0.000372, " (", false]]], "qwen": [1486, 3, 0.014976556412875652, [[26544, 0.943901, "-play", false], [1363, 0.017777, "play", false], [1486, 0.014977, " play", false], [12, 0.005114, "-", false], [72085, 0.003058, "-playing", false], [2371, 0.001586, "-g", false], [48793, 0.001382, "-te", false], [85370, 0.001343, "-training", false], [1331, 0.001274, "-s", false], [41912, 0.001197, "playing", false]]]}, "raw_delta": -0.16525382995605464, "tuned_delta": -0.1566820379254764}, {"byte_start": 2500, "byte_end": 2503, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 421, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "12.02% 12.02% 12.02%", "qwen": "12.75% 12.75% 12.75%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.13792358338832855]], "qwen": [[311, " to", "normal", 0.11986345052719116]]}, "loss": {"rwkv": 12.022458674074693, "qwen": 12.752235522858365}, "topk": {"rwkv": [4811, 2, 0.13792358338832855, [[45, 0.417633, ",", false], [4811, 0.137924, " to", false], [47, 0.114948, ".", false], [275, 0.042461, " (", false], [21265, 0.027035, " and", false], [4596, 0.026374, " in", false], [59, 0.02125, ":", false], [4706, 0.019343, " of", false], [32487, 0.01735, " with", false], [4712, 0.015412, " on", false]]], "qwen": [311, 3, 0.11986345052719116, [[11, 0.426174, ",", false], [13, 0.142018, ".", false], [311, 0.119863, " to", false], [304, 0.036712, " in", false], [320, 0.03566, " (", false], [382, 0.021482, ".\n\n", false], [323, 0.020301, " and", false], [4751, 0.017265, " rather", false], [25, 0.015469, ":", false], [429, 0.015155, " that", false]]]}, "raw_delta": -0.04046742121378588, "tuned_delta": -0.03189562918320763}, {"byte_start": 2503, "byte_end": 2509, "display": {"text": " learn", "kind": "normal"}, "is_word": true, "word_id": 422, "word_key": " learn", "bytes_hex": "20 6c 65 61 72 6e", "compression": {"rwkv": "11.04% 11.04% 11.04% 11.04% 11.04% 11.04%", "qwen": "11.45% 11.45% 11.45% 11.45% 11.45% 11.45%"}, "model_tokens": {"rwkv": [[38877, " learn", "normal", 0.025368090718984604]], "qwen": [[3960, " learn", "normal", 0.02213427983224392]]}, "loss": {"rwkv": 11.036241360967004, "qwen": 11.453278508072337}, "topk": {"rwkv": [38877, 4, 0.025368090718984604, [[51982, 0.162285, " improve", false], [30858, 0.030204, " find", false], [56010, 0.026963, " discover", false], [38877, 0.025368, " learn", false], [51456, 0.024142, " develop", false], [40000, 0.02404, " train", false], [37786, 0.019827, " avoid", false], [52640, 0.017333, " rapidly", false], [61516, 0.01656, " accelerate", false], [59771, 0.016493, " gradually", false]]], "qwen": [3960, 9, 0.02213427983224392, [[7269, 0.099804, " improve", false], [1477, 0.056095, " find", false], [6923, 0.047802, " generate", false], [6997, 0.040892, " discover", false], [5426, 0.039814, " train", false], [2225, 0.038448, " develop", false], [8193, 0.032726, " produce", false], [1855, 0.023893, " create", false], [3960, 0.022134, " learn", false], [13186, 0.020129, " explore", false]]]}, "raw_delta": -0.02312544981638598, "tuned_delta": -0.01455365778580773}, {"byte_start": 2509, "byte_end": 2511, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 423, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "22.26% 22.26%", "qwen": "24.36% 24.36%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.08501612395048141]], "qwen": [[264, " a", "normal", 0.06712794303894043]]}, "loss": {"rwkv": 22.260333638716425, "qwen": 24.355892794467625}, "topk": {"rwkv": [332, 4, 0.08501612395048141, [[22590, 0.130279, " the", false], [30917, 0.099003, " from", false], [4811, 0.095094, " to", false], [332, 0.085016, " a", false], [21835, 0.05709, " how", false], [37598, 0.026214, " about", false], [32464, 0.024185, " what", false], [47202, 0.023609, " search", false], [22168, 0.019606, " new", false], [4419, 0.016802, " an", false]]], "qwen": [264, 3, 0.06712794303894043, [[279, 0.236323, " the", false], [1246, 0.075652, " how", false], [264, 0.067128, " a", false], [504, 0.066064, " from", false], [311, 0.053305, " to", false], [3738, 0.026512, " human", false], [14830, 0.02373, " strategies", false], [1128, 0.020004, " what", false], [2664, 0.019458, " better", false], [1809, 0.017289, " game", false]]]}, "raw_delta": -0.1162024736404419, "tuned_delta": -0.10763068160986365}, {"byte_start": 2511, "byte_end": 2517, "display": {"text": " value", "kind": "normal"}, "is_word": true, "word_id": 424, "word_key": " value", "bytes_hex": "20 76 61 6c 75 65", "compression": {"rwkv": "17.09% 17.09% 17.09% 17.09% 17.09% 17.09%", "qwen": "17.96% 17.96% 17.96% 17.96% 17.96% 17.96%"}, "model_tokens": {"rwkv": [[40093, " value", "normal", 0.003398081986233592]], "qwen": [[897, " value", "normal", 0.0025432310067117214]]}, "loss": {"rwkv": 17.094433427199956, "qwen": 17.95650363059357}, "topk": {"rwkv": [40093, 40, 0.003398081986233592, [[51832, 0.077462, " general", false], [47202, 0.067976, " search", false], [30992, 0.062359, " good", false], [46857, 0.049598, " policy", false], [57317, 0.045921, " strategy", false], [39043, 0.037693, " model", false], [65161, 0.032359, " representation", false], [32386, 0.028991, " very", false], [45301, 0.028377, " better", false], [3851, 0.028315, " Go", false]]], "qwen": [897, 50, 0.0025432310067117214, [[8282, 0.080409, " strategy", false], [1661, 0.051989, " good", false], [1809, 0.05055, " game", false], [4842, 0.049585, " policy", false], [10987, 0.045937, " winning", false], [3738, 0.035362, " human", false], [1602, 0.032474, " very", false], [2664, 0.032441, " better", false], [9902, 0.030276, " ``", false], [501, 0.028941, " new", false]]]}, "raw_delta": -0.04780332247416186, "tuned_delta": -0.03923153044358361}, {"byte_start": 2517, "byte_end": 2526, "display": {"text": " function", "kind": "normal"}, "is_word": true, "word_id": 425, "word_key": " function", "bytes_hex": "20 66 75 6e 63 74 69 6f 6e", "compression": {"rwkv": "0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85%", "qwen": "0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65%"}, "model_tokens": {"rwkv": [[56292, " function", "normal", 0.6556443572044373]], "qwen": [[729, " function", "normal", 0.7247667908668518]]}, "loss": {"rwkv": 0.8453291255208769, "qwen": 0.6450156173193224}, "topk": {"rwkv": [56292, 1, 0.6556443572044373, [[56292, 0.655644, " function", false], [21700, 0.087647, " for", false], [56149, 0.061979, " estimate", false], [46, 0.036318, "-", false], [4706, 0.024888, " of", false], [39043, 0.01316, " model", false], [65161, 0.009733, " representation", false], [61955, 0.007907, " estimation", false], [59792, 0.00619, " heuristic", false], [47487, 0.00616, " system", false]]], "qwen": [729, 1, 0.7247667908668518, [[729, 0.724767, " function", false], [3922, 0.118357, " network", false], [5980, 0.032652, "-based", false], [33749, 0.022315, "-function", false], [16045, 0.013704, " estimate", false], [369, 0.00758, " for", false], [4179, 0.007473, " net", false], [315, 0.00721, " of", false], [16460, 0.006187, " evaluation", false], [13042, 0.004347, " representation", false]]]}, "raw_delta": 0.01110773947503832, "tuned_delta": 0.01967953150561657}, {"byte_start": 2526, "byte_end": 2528, "display": {"text": " (", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "20 28", "compression": {"rwkv": "34.94% 34.94%", "qwen": "27.56% 27.56%"}, "model_tokens": {"rwkv": [[275, " (", "normal", 0.02069687843322754]], "qwen": [[320, " (", "normal", 0.0470462329685688]]}, "loss": {"rwkv": 34.94027052152958, "qwen": 27.561105511417026}, "topk": {"rwkv": [275, 9, 0.02069687843322754, [[21700, 0.195586, " for", false], [32227, 0.177936, " that", false], [45, 0.157856, ",", false], [47, 0.07278, ".", false], [30917, 0.052868, " from", false], [4811, 0.046829, " to", false], [21265, 0.045101, " and", false], [4706, 0.042649, " of", false], [275, 0.020697, " (", false], [55536, 0.020321, " approxim", false]]], "qwen": [320, 6, 0.0470462329685688, [[11, 0.200767, ",", false], [429, 0.133146, " that", false], [369, 0.1235, " for", false], [13, 0.109011, ".", false], [323, 0.062236, " and", false], [320, 0.047046, " (", false], [311, 0.043689, " to", false], [504, 0.035917, " from", false], [3118, 0.021552, " based", false], [304, 0.018403, " in", false]]]}, "raw_delta": 0.40918779373168945, "tuned_delta": 0.4177595857622677}, {"byte_start": 2528, "byte_end": 2530, "display": {"text": "as", "kind": "normal"}, "is_word": true, "word_id": 426, "word_key": "as", "bytes_hex": "61 73", "compression": {"rwkv": "31.28% 31.28%", "qwen": "29.55% 29.55%"}, "model_tokens": {"rwkv": [[1751, "as", "normal", 0.03128112480044365]], "qwen": [[300, "as", "normal", 0.03771577402949333]]}, "loss": {"rwkv": 31.277177644272445, "qwen": 29.55430059337468}, "topk": {"rwkv": [1751, 7, 0.03128112480044365, [[2101, 0.080326, "or", false], [36003, 0.080096, "which", false], [98, 0.069288, "a", false], [8801, 0.05731, "the", false], [7005, 0.040737, "and", false], [7579, 0.03159, "for", false], [1751, 0.031281, "as", false], [2215, 0.023428, "to", false], [1746, 0.022925, "an", false], [1950, 0.021773, "in", false]]], "qwen": [300, 6, 0.03771577402949333, [[1782, 0.097205, "the", false], [8206, 0.075568, "which", false], [64, 0.075485, "a", false], [437, 0.049882, "and", false], [269, 0.042432, "or", false], [300, 0.037716, "as", false], [4060, 0.029328, "see", false], [258, 0.028759, "in", false], [276, 0.027044, "an", false], [9033, 0.024652, "that", false]]]}, "raw_delta": 0.09553658962249756, "tuned_delta": 0.1041083816530758}, {"byte_start": 2530, "byte_end": 2533, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 427, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "29.87% 29.87% 29.87%", "qwen": "35.37% 35.37% 35.37%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.006845293566584587]], "qwen": [[432, " it", "normal", 0.0027835743967443705]]}, "loss": {"rwkv": 29.868295768404316, "qwen": 35.37018988577891}, "topk": {"rwkv": [4601, 18, 0.006845293566584587, [[4596, 0.248739, " in", false], [52369, 0.244738, " opposed", false], [332, 0.049698, " a", false], [32458, 0.047174, " well", false], [22748, 0.033749, " was", false], [4419, 0.01949, " an", false], [32487, 0.019064, " with", false], [22590, 0.016928, " the", false], [4600, 0.016442, " is", false], [32354, 0.012238, " used", false]]], "qwen": [432, 23, 0.0027835743967443705, [[16087, 0.457368, " opposed", false], [304, 0.130405, " in", false], [1632, 0.102626, " well", false], [264, 0.022272, " a", false], [7481, 0.02131, " described", false], [14078, 0.018769, " discussed", false], [12460, 0.018734, " distinct", false], [572, 0.013752, " was", false], [279, 0.009101, " the", false], [1483, 0.00864, " used", false]]]}, "raw_delta": -0.30508979161580396, "tuned_delta": -0.29651799958522573}, {"byte_start": 2533, "byte_end": 2537, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 428, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "7.33% 7.33% 7.33% 7.33%", "qwen": "8.25% 8.25% 8.25% 8.25%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.198941171169281]], "qwen": [[572, " was", "normal", 0.16035059094429016]]}, "loss": {"rwkv": 7.326185754514267, "qwen": 8.252182267530776}, "topk": {"rwkv": [22748, 2, 0.198941171169281, [[47638, 0.242441, " turned", false], [22748, 0.198941, " was", false], [4600, 0.161035, " is", false], [32462, 0.105217, " were", false], [40040, 0.091945, " turns", false], [51896, 0.026667, " happens", false], [56348, 0.020272, " happened", false], [40219, 0.01411, " would", false], [21795, 0.011829, " had", false], [21800, 0.011143, " has", false]]], "qwen": [572, 2, 0.16035059094429016, [[374, 0.257658, " is", false], [572, 0.160351, " was", false], [10577, 0.100438, " turns", false], [6519, 0.080026, " turned", false], [1521, 0.034738, " did", false], [1035, 0.034517, " would", false], [1030, 0.034259, " had", false], [6116, 0.028161, " became", false], [1558, 0.026933, " does", false], [702, 0.023676, " has", false]]]}, "raw_delta": -0.05134814977645874, "tuned_delta": -0.04277635774588049}, {"byte_start": 2537, "byte_end": 2540, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 429, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "27.05% 27.05% 27.05%", "qwen": "21.74% 21.74% 21.74%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.01114705577492714]], "qwen": [[304, " in", "normal", 0.026875125244259834]]}, "loss": {"rwkv": 27.05053201666806, "qwen": 21.73993706822568}, "topk": {"rwkv": [4596, 13, 0.01114705577492714, [[45395, 0.333862, " called", false], [32230, 0.079106, " then", false], [38848, 0.051663, " known", false], [62275, 0.029972, " originally", false], [38869, 0.022371, " later", false], [59868, 0.019801, " initially", false], [22187, 0.018243, " not", false], [38499, 0.016669, " first", false], [62684, 0.01598, " understood", false], [45, 0.012787, ",", false]]], "qwen": [304, 6, 0.026875125244259834, [[2598, 0.379656, " called", false], [2814, 0.082709, " done", false], [1221, 0.063428, " then", false], [3881, 0.049845, " known", false], [2937, 0.031391, " later", false], [304, 0.026875, " in", false], [537, 0.017914, " not", false], [60837, 0.016524, " termed", false], [9251, 0.013353, " applied", false], [1083, 0.01199, " also", false]]]}, "raw_delta": 0.294481913248698, "tuned_delta": 0.3030537052792762}, {"byte_start": 2540, "byte_end": 2545, "display": {"text": " many", "kind": "normal"}, "is_word": true, "word_id": 430, "word_key": " many", "bytes_hex": "20 6d 61 6e 79", "compression": {"rwkv": "16.12% 16.12% 16.12% 16.12% 16.12%", "qwen": "16.15% 16.15% 16.15% 16.15% 16.15%"}, "model_tokens": {"rwkv": [[31370, " many", "normal", 0.011500372551381588]], "qwen": [[1657, " many", "normal", 0.011345302686095238]]}, "loss": {"rwkv": 16.11760865993139, "qwen": 16.154402628256975}, "topk": {"rwkv": [31370, 13, 0.011500372551381588, [[38013, 0.26649, " chess", false], [22590, 0.139523, " the", false], [3851, 0.113686, " Go", false], [30322, 0.042923, " both", false], [55809, 0.033523, " computer", false], [36274, 0.031875, " Alpha", false], [3492, 0.02359, " 19", false], [47202, 0.021193, " search", false], [38720, 0.01729, " human", false], [36466, 0.015516, " Chess", false]]], "qwen": [1657, 11, 0.011345302686095238, [[279, 0.303091, " the", false], [32719, 0.109606, " chess", false], [24708, 0.061578, " Alpha", false], [6366, 0.041331, " computer", false], [5994, 0.040199, " Go", false], [18183, 0.035052, " Deep", false], [264, 0.019417, " a", false], [1182, 0.017414, " back", false], [220, 0.01583, " ", false], [1008, 0.012868, " other", false]]]}, "raw_delta": -0.0020402908325194424, "tuned_delta": 0.006531501198058806}, {"byte_start": 2545, "byte_end": 2551, "display": {"text": " other", "kind": "normal"}, "is_word": true, "word_id": 431, "word_key": " other", "bytes_hex": "20 6f 74 68 65 72", "compression": {"rwkv": "2.91% 2.91% 2.91% 2.91% 2.91% 2.91%", "qwen": "4.74% 4.74% 4.74% 4.74% 4.74% 4.74%"}, "model_tokens": {"rwkv": [[39193, " other", "normal", 0.3769276738166809]], "qwen": [[1008, " other", "normal", 0.20644254982471466]]}, "loss": {"rwkv": 2.911689210127465, "qwen": 4.742057925894811}, "topk": {"rwkv": [39193, 1, 0.3769276738166809, [[39193, 0.376928, " other", false], [51551, 0.09823, " earlier", false], [4706, 0.06621, " of", false], [51515, 0.040781, " domains", false], [38576, 0.033758, " games", false], [38328, 0.032301, " early", false], [56926, 0.025966, " previous", false], [3609, 0.024194, " AI", false], [55809, 0.022975, " computer", false], [37970, 0.020843, " cases", false]]], "qwen": [1008, 1, 0.20644254982471466, [[1008, 0.206443, " other", false], [315, 0.192479, " of", false], [6366, 0.066459, " computer", false], [32719, 0.054559, " chess", false], [5048, 0.036724, " cases", false], [3868, 0.02637, " games", false], [4124, 0.02322, " early", false], [6788, 0.016202, " earlier", false], [5510, 0.014827, " ways", false], [3738, 0.011991, " human", false]]]}, "raw_delta": -0.10149719317754112, "tuned_delta": -0.09292540114696288}, {"byte_start": 2551, "byte_end": 2557, "display": {"text": " games", "kind": "normal"}, "is_word": true, "word_id": 432, "word_key": " games", "bytes_hex": "20 67 61 6d 65 73", "compression": {"rwkv": "6.53% 6.53% 6.53% 6.53% 6.53% 6.53%", "qwen": "5.62% 5.62% 5.62% 5.62% 5.62% 5.62%"}, "model_tokens": {"rwkv": [[38576, " games", "normal", 0.1139829158782959]], "qwen": [[3868, " games", "normal", 0.15397393703460693]]}, "loss": {"rwkv": 6.527819358188994, "qwen": 5.62342064144615}, "topk": {"rwkv": [38576, 2, 0.1139829158782959, [[51515, 0.433342, " domains", false], [38576, 0.113983, " games", false], [3609, 0.095083, " AI", false], [37738, 0.075944, " areas", false], [37970, 0.035832, " cases", false], [45976, 0.031162, " fields", false], [56939, 0.018183, " problems", false], [64251, 0.015185, " applications", false], [55809, 0.012712, " computer", false], [30941, 0.012314, " game", false]]], "qwen": [3868, 2, 0.15397393703460693, [[30476, 0.331291, " domains", false], [3868, 0.153974, " games", false], [5671, 0.08402, " areas", false], [8357, 0.054478, " applications", false], [15235, 0.034859, " AI", false], [5322, 0.029711, " problems", false], [37597, 0.027073, " contexts", false], [5048, 0.021655, " cases", false], [1809, 0.017305, " game", false], [5043, 0.016215, " fields", false]]]}, "raw_delta": 0.050150513648986816, "tuned_delta": 0.058722305679565066}, {"byte_start": 2557, "byte_end": 2561, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 433, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "20.57% 20.57% 20.57% 20.57%", "qwen": "16.39% 16.39% 16.39% 16.39%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.01029981765896082]], "qwen": [[323, " and", "normal", 0.02634415403008461]]}, "loss": {"rwkv": 20.56967538767467, "qwen": 16.394916925835595}, "topk": {"rwkv": [21265, 7, 0.01029981765896082, [[42, 0.300396, ")", false], [497, 0.201442, "),", false], [499, 0.168273, ").", false], [45, 0.125889, ",", false], [4423, 0.046018, " as", false], [4424, 0.019084, " at", false], [21265, 0.0103, " and", false], [45285, 0.009439, " before", false], [22614, 0.008871, " too", false], [32139, 0.008363, " such", false]]], "qwen": [323, 5, 0.02634415403008461, [[8, 0.282654, ")", false], [568, 0.194803, ").", false], [701, 0.179022, "),", false], [11, 0.100799, ",", false], [323, 0.026344, " and", false], [438, 0.024904, " as", false], [3593, 0.021138, ").\n\n", false], [518, 0.017665, " at", false], [1573, 0.015239, " before", false], [315, 0.011811, " of", false]]]}, "raw_delta": 0.23149776458740234, "tuned_delta": 0.2400695566179806}, {"byte_start": 2561, "byte_end": 2566, "display": {"text": " even", "kind": "normal"}, "is_word": true, "word_id": 434, "word_key": " even", "bytes_hex": "20 65 76 65 6e", "compression": {"rwkv": "18.71% 18.71% 18.71% 18.71% 18.71%", "qwen": "16.42% 16.42% 16.42% 16.42% 16.42%"}, "model_tokens": {"rwkv": [[30788, " even", "normal", 0.005658430512994528]], "qwen": [[1496, " even", "normal", 0.010534564033150673]]}, "loss": {"rwkv": 18.709951311528744, "qwen": 16.42181501243054}, "topk": {"rwkv": [30788, 23, 0.005658430512994528, [[51515, 0.383366, " domains", false], [4596, 0.12598, " in", false], [3609, 0.032943, " AI", false], [64251, 0.031425, " applications", false], [4423, 0.027926, " as", false], [39193, 0.026296, " other", false], [4811, 0.020793, " to", false], [56939, 0.017074, " problems", false], [31370, 0.012536, " many", false], [39898, 0.010971, " tasks", false]]], "qwen": [1496, 16, 0.010534564033150673, [[30476, 0.274515, " domains", false], [8357, 0.089942, " applications", false], [304, 0.088429, " in", false], [1008, 0.036862, " other", false], [5322, 0.032097, " problems", false], [374, 0.028859, " is", false], [9079, 0.026332, " tasks", false], [21737, 0.025758, " environments", false], [537, 0.017821, " not", false], [11, 0.014259, ",", false]]]}, "raw_delta": 0.12688121795654306, "tuned_delta": 0.13545300998712131}, {"byte_start": 2566, "byte_end": 2569, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 435, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "4.27% 4.27% 4.27%", "qwen": "4.87% 4.87% 4.87%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.48613446950912476]], "qwen": [[304, " in", "normal", 0.44450274109840393]]}, "loss": {"rwkv": 4.273608356799989, "qwen": 4.873898751154672}, "topk": {"rwkv": [4596, 1, 0.48613446950912476, [[4596, 0.486134, " in", false], [38013, 0.111113, " chess", false], [32074, 0.030967, " some", false], [31458, 0.024572, " more", false], [22184, 0.021033, " non", false], [4423, 0.013628, " as", false], [4811, 0.013192, " to", false], [31370, 0.013172, " many", false], [3851, 0.011135, " Go", false], [55809, 0.010021, " computer", false]]], "qwen": [304, 1, 0.44450274109840393, [[304, 0.444503, " in", false], [1045, 0.042425, " some", false], [32719, 0.033628, " chess", false], [1008, 0.0305, " other", false], [279, 0.02201, " the", false], [7797, 0.019831, " beyond", false], [2272, 0.019661, " life", false], [1657, 0.018959, " many", false], [803, 0.018664, " more", false], [11, 0.012248, ",", false]]]}, "raw_delta": -0.03328716754913333, "tuned_delta": -0.02471537551855508}, {"byte_start": 2569, "byte_end": 2575, "display": {"text": " chess", "kind": "normal"}, "is_word": true, "word_id": 436, "word_key": " chess", "bytes_hex": "20 63 68 65 73 73", "compression": {"rwkv": "3.78% 3.78% 3.78% 3.78% 3.78% 3.78%", "qwen": "4.06% 4.06% 4.06% 4.06% 4.06% 4.06%"}, "model_tokens": {"rwkv": [[38013, " chess", "normal", 0.2851180136203766]], "qwen": [[32719, " chess", "normal", 0.25881946086883545]]}, "loss": {"rwkv": 3.780499700246144, "qwen": 4.062462389958204}, "topk": {"rwkv": [38013, 1, 0.2851180136203766, [[38013, 0.285118, " chess", false], [22590, 0.076218, " the", false], [3851, 0.068435, " Go", false], [55809, 0.050382, " computer", false], [32074, 0.037516, " some", false], [31370, 0.030969, " many", false], [39311, 0.024418, " poker", false], [36274, 0.016639, " Alpha", false], [47202, 0.015812, " search", false], [38720, 0.015549, " human", false]]], "qwen": [32719, 1, 0.25881946086883545, [[32719, 0.258819, " chess", false], [279, 0.13382, " the", false], [1045, 0.055217, " some", false], [1008, 0.039027, " other", false], [1931, 0.031313, " real", false], [3738, 0.031129, " human", false], [6366, 0.029792, " computer", false], [1657, 0.025833, " many", false], [5810, 0.024103, " natural", false], [5994, 0.0238, " Go", false]]]}, "raw_delta": -0.015635331471761077, "tuned_delta": -0.007063539441182829}, {"byte_start": 2575, "byte_end": 2576, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "43.11%", "qwen": "48.06%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.0931757241487503]], "qwen": [[11, ",", "normal", 0.06960668414831161]]}, "loss": {"rwkv": 43.111785401564724, "qwen": 48.05787745339095}, "topk": {"rwkv": [45, 4, 0.0931757241487503, [[499, 0.282001, ").", false], [42, 0.259751, ")", false], [497, 0.189755, "),", false], [45, 0.093176, ",", false], [45285, 0.052042, " before", false], [4596, 0.012291, " in", false], [4424, 0.011912, " at", false], [39356, 0.009601, " prior", false], [502, 0.005652, ");", false], [37634, 0.004393, " after", false]]], "qwen": [11, 4, 0.06960668414831161, [[8, 0.311405, ")", false], [568, 0.216466, ").", false], [701, 0.159245, "),", false], [11, 0.069607, ",", false], [323, 0.032871, " and", false], [3593, 0.028469, ").\n\n", false], [304, 0.021751, " in", false], [518, 0.018202, " at", false], [1573, 0.014773, " before", false], [1215, 0.011096, ");", false]]]}, "raw_delta": -0.27426958084106445, "tuned_delta": -0.2656977888104862}, {"byte_start": 2576, "byte_end": 2585, "display": {"text": " although", "kind": "normal"}, "is_word": true, "word_id": 437, "word_key": " although", "bytes_hex": "20 61 6c 74 68 6f 75 67 68", "compression": {"rwkv": "7.04% 7.04% 7.04% 7.04% 7.04% 7.04% 7.04% 7.04% 7.04%", "qwen": "6.11% 6.11% 6.11% 6.11% 6.11% 6.11% 6.11% 6.11% 6.11%"}, "model_tokens": {"rwkv": [[55495, " although", "normal", 0.029813870787620544]], "qwen": [[7892, " although", "normal", 0.04747393727302551]]}, "loss": {"rwkv": 7.044409379340641, "qwen": 6.106556454033087}, "topk": {"rwkv": [55495, 6, 0.029813870787620544, [[21400, 0.200355, " but", false], [40185, 0.103638, " where", false], [47544, 0.065321, " though", false], [45285, 0.055038, " before", false], [4423, 0.036981, " as", false], [55495, 0.029814, " although", false], [21265, 0.029054, " and", false], [22590, 0.025076, " the", false], [21700, 0.024961, " for", false], [40186, 0.022637, " which", false]]], "qwen": [7892, 4, 0.04747393727302551, [[714, 0.253728, " but", false], [1380, 0.079006, " where", false], [3498, 0.063448, " though", false], [7892, 0.047474, " although", false], [1490, 0.044499, " see", false], [438, 0.039695, " as", false], [323, 0.024683, " and", false], [892, 0.022883, " which", false], [304, 0.021609, " in", false], [1573, 0.019246, " before", false]]]}, "raw_delta": 0.052005608876546205, "tuned_delta": 0.060577400907124455}, {"byte_start": 2585, "byte_end": 2594, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 438, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "10.46% 10.46% 10.46% 10.46% 10.46% 10.46% 10.46% 10.46% 10.46%", "qwen": "10.41% 10.41% 10.41% 10.41% 10.41% 10.41% 10.41% 10.41% 10.41%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.005482254084199667]], "qwen": [[6832, " learning", "normal", 0.005532432813197374]]}, "loss": {"rwkv": 10.457034367554552, "qwen": 10.413708115965523}, "topk": {"rwkv": [56537, 20, 0.005482254084199667, [[22590, 0.14525, " the", false], [4596, 0.112733, " in", false], [32227, 0.111733, " that", false], [4601, 0.072475, " it", false], [39934, 0.07201, " there", false], [22187, 0.052881, " not", false], [32234, 0.049834, " this", false], [38013, 0.041112, " chess", false], [47202, 0.016682, " search", false], [31277, 0.015004, " less", false]]], "qwen": [6832, 25, 0.005532432813197374, [[537, 0.222352, " not", false], [279, 0.082857, " the", false], [432, 0.069599, " it", false], [419, 0.059519, " this", false], [304, 0.058971, " in", false], [1052, 0.040108, " there", false], [429, 0.036923, " that", false], [5994, 0.033935, " Go", false], [1588, 0.025159, " here", false], [311, 0.020415, " to", false]]]}, "raw_delta": 0.0024025175306532365, "tuned_delta": 0.010974309561231485}, {"byte_start": 2594, "byte_end": 2598, "display": {"text": " did", "kind": "normal"}, "is_word": true, "word_id": 439, "word_key": " did", "bytes_hex": "20 64 69 64", "compression": {"rwkv": "27.05% 27.05% 27.05% 27.05%", "qwen": "20.85% 20.85% 20.85% 20.85%"}, "model_tokens": {"rwkv": [[21532, " did", "normal", 0.0025070246774703264]], "qwen": [[1521, " did", "normal", 0.009800087660551071]]}, "loss": {"rwkv": 27.05053201666806, "qwen": 20.8530920473809}, "topk": {"rwkv": [21532, 27, 0.0025070246774703264, [[4450, 0.402714, " by", false], [332, 0.136427, " a", false], [22590, 0.078279, " the", false], [22748, 0.053338, " was", false], [4706, 0.051219, " of", false], [4596, 0.03753, " in", false], [4811, 0.029705, " to", false], [30917, 0.019043, " from", false], [32227, 0.016914, " that", false], [4600, 0.013652, " is", false]]], "qwen": [1521, 14, 0.009800087660551071, [[553, 0.234046, " by", false], [572, 0.159847, " was", false], [304, 0.06377, " in", false], [264, 0.042462, " a", false], [374, 0.030726, " is", false], [897, 0.029572, " value", false], [279, 0.025313, " the", false], [311, 0.023479, " to", false], [504, 0.020341, " from", false], [5413, 0.018399, " methods", false]]]}, "raw_delta": 0.34365904331207275, "tuned_delta": 0.352230835342651}, {"byte_start": 2598, "byte_end": 2602, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 440, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "0.26% 0.26% 0.26% 0.26%", "qwen": "0.24% 0.24% 0.24% 0.24%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.9441571831703186]], "qwen": [[537, " not", "normal", 0.9479894638061523]]}, "loss": {"rwkv": 0.25866190689766416, "qwen": 0.2408033560754438}, "topk": {"rwkv": [22187, 1, 0.9441571831703186, [[22187, 0.944157, " not", false], [32187, 0.006166, " take", false], [39166, 0.004852, " occur", false], [31702, 0.004682, " play", false], [46159, 0.00249, " happen", false], [30482, 0.002195, " come", false], [61959, 0.001925, " eventually", false], [31967, 0.001481, " seem", false], [31466, 0.001419, " much", false], [37829, 0.001197, " begin", false]]], "qwen": [537, 1, 0.9479894638061523, [[537, 0.947989, " not", false], [1486, 0.011866, " play", false], [1896, 0.003933, " take", false], [12170, 0.002203, " occur", false], [614, 0.002135, " have", false], [12118, 0.002025, " prove", false], [1172, 0.001618, " only", false], [2803, 0.001143, " seem", false], [1492, 0.000945, " help", false], [2632, 0.000863, " little", false]]]}, "raw_delta": 0.000990288332104683, "tuned_delta": 0.009562080362682931}, {"byte_start": 2602, "byte_end": 2607, "display": {"text": " play", "kind": "normal"}, "is_word": true, "word_id": 441, "word_key": " play", "bytes_hex": "20 70 6c 61 79", "compression": {"rwkv": "9.19% 9.19% 9.19% 9.19% 9.19%", "qwen": "5.06% 5.06% 5.06% 5.06% 5.06%"}, "model_tokens": {"rwkv": [[31702, " play", "normal", 0.07770711183547974]], "qwen": [[1486, " play", "normal", 0.2457631230354309]]}, "loss": {"rwkv": 9.185909830660195, "qwen": 5.061649344724086}, "topk": {"rwkv": [31702, 1, 0.07770711183547974, [[31702, 0.077707, " play", false], [31967, 0.062265, " seem", false], [39801, 0.058786, " start", false], [39166, 0.04257, " occur", false], [56041, 0.036512, " dominate", false], [32499, 0.031206, " work", false], [46159, 0.030387, " happen", false], [45185, 0.027338, " appear", false], [22770, 0.02692, " win", false], [37829, 0.02434, " begin", false]]], "qwen": [1486, 1, 0.2457631230354309, [[1486, 0.245763, " play", false], [12118, 0.057356, " prove", false], [2803, 0.044004, " seem", false], [4994, 0.038472, " appear", false], [3635, 0.03657, " become", false], [975, 0.027108, " work", false], [1492, 0.026829, " help", false], [12170, 0.026608, " occur", false], [2525, 0.023338, " come", false], [3602, 0.022493, " yet", false]]]}, "raw_delta": 0.2286975622177124, "tuned_delta": 0.23726935424829065}, {"byte_start": 2607, "byte_end": 2609, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 442, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "7.89% 7.89%", "qwen": "4.35% 4.35%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.4145268499851227]], "qwen": [[264, " a", "normal", 0.6170863509178162]]}, "loss": {"rwkv": 7.889738504861517, "qwen": 4.3528478404219735}, "topk": {"rwkv": [332, 1, 0.4145268499851227, [[332, 0.414527, " a", false], [4423, 0.218792, " as", false], [32139, 0.092081, " such", false], [22590, 0.089039, " the", false], [4419, 0.038356, " an", false], [31466, 0.034285, " much", false], [32227, 0.033541, " that", false], [21273, 0.027088, " any", false], [4788, 0.011159, " so", false], [32234, 0.006514, " this", false]]], "qwen": [264, 1, 0.6170863509178162, [[264, 0.617086, " a", false], [438, 0.147431, " as", false], [1741, 0.048873, " such", false], [458, 0.047076, " an", false], [279, 0.029216, " the", false], [1753, 0.021222, " much", false], [894, 0.016069, " any", false], [7009, 0.013102, " nearly", false], [5008, 0.007137, " quite", false], [1052, 0.007039, " there", false]]]}, "raw_delta": 0.19612686336040497, "tuned_delta": 0.20469865539098323}, {"byte_start": 2609, "byte_end": 2613, "display": {"text": " big", "kind": "normal"}, "is_word": true, "word_id": 443, "word_key": " big", "bytes_hex": "20 62 69 67", "compression": {"rwkv": "17.47% 17.47% 17.47% 17.47%", "qwen": "13.34% 13.34% 13.34% 13.34%"}, "model_tokens": {"rwkv": [[21357, " big", "normal", 0.020496277138590813]], "qwen": [[2409, " big", "normal", 0.05184754729270935]]}, "loss": {"rwkv": 17.47013526076479, "qwen": 13.342438776442753}, "topk": {"rwkv": [21357, 10, 0.020496277138590813, [[31894, 0.35724, " role", false], [38961, 0.087679, " major", false], [51156, 0.079813, " central", false], [60273, 0.062897, " prominent", false], [38864, 0.053773, " large", false], [63870, 0.047491, " significant", false], [31633, 0.031742, " part", false], [56040, 0.031581, " dominant", false], [45752, 0.027115, " direct", false], [21357, 0.020496, " big", false]]], "qwen": [2409, 5, 0.05184754729270935, [[3476, 0.349896, " role", false], [3598, 0.160371, " major", false], [3460, 0.089409, " large", false], [5089, 0.068478, " significant", false], [2409, 0.051848, " big", false], [8622, 0.050104, " central", false], [20469, 0.038747, " prominent", false], [949, 0.029593, " part", false], [2118, 0.012775, " direct", false], [1376, 0.012518, " key", false]]]}, "raw_delta": 0.22888809442520142, "tuned_delta": 0.23745988645577967}, {"byte_start": 2613, "byte_end": 2618, "display": {"text": " role", "kind": "normal"}, "is_word": true, "word_id": 444, "word_key": " role", "bytes_hex": "20 72 6f 6c 65", "compression": {"rwkv": "0.50% 0.50% 0.50% 0.50% 0.50%", "qwen": "0.51% 0.51% 0.51% 0.51% 0.51%"}, "model_tokens": {"rwkv": [[31894, " role", "normal", 0.8702993392944336]], "qwen": [[3476, " role", "normal", 0.867730975151062]]}, "loss": {"rwkv": 0.5036752706228559, "qwen": 0.5117005723024768}, "topk": {"rwkv": [31894, 1, 0.8702993392944336, [[31894, 0.870299, " role", false], [31633, 0.099551, " part", false], [45865, 0.013572, " enough", false], [52013, 0.006282, " initial", false], [45752, 0.001327, " direct", false], [45, 0.001155, ",", false], [31895, 0.000607, " roll", false], [39568, 0.0006, " rôle", false], [4715, 0.000542, " or", false], [38328, 0.000513, " early", false]]], "qwen": [3476, 1, 0.867730975151062, [[3476, 0.867731, " role", false], [949, 0.121771, " part", false], [8168, 0.002727, " factor", false], [3322, 0.002314, " enough", false], [6502, 0.000408, " roll", false], [11, 0.000291, ",", false], [1809, 0.00026, " game", false], [2118, 0.00023, " direct", false], [14976, 0.000209, " practical", false], [2456, 0.000182, " effect", false]]]}, "raw_delta": -0.00044501721858978063, "tuned_delta": 0.008126774811988468}, {"byte_start": 2618, "byte_end": 2621, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 445, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "3.10% 3.10% 3.10%", "qwen": "2.27% 2.27% 2.27%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.5950484275817871]], "qwen": [[304, " in", "normal", 0.6852281093597412]]}, "loss": {"rwkv": 3.099540126909882, "qwen": 2.272265417609112}, "topk": {"rwkv": [4596, 1, 0.5950484275817871, [[4596, 0.595048, " in", false], [39934, 0.150896, " there", false], [499, 0.059296, ").", false], [40076, 0.034228, " until", false], [4424, 0.034011, " at", false], [59868, 0.017486, " initially", false], [42, 0.012552, ")", false], [32230, 0.011976, " then", false], [21700, 0.009663, " for", false], [31077, 0.009021, " here", false]]], "qwen": [304, 1, 0.6852281093597412, [[304, 0.685228, " in", false], [1052, 0.096012, " there", false], [3080, 0.035162, " until", false], [568, 0.034877, ").", false], [518, 0.027178, " at", false], [369, 0.01464, " for", false], [8, 0.013315, ")", false], [15102, 0.011603, " initially", false], [1221, 0.007446, " then", false], [1588, 0.007177, " here", false]]]}, "raw_delta": 0.04587385058403015, "tuned_delta": 0.0544456426146084}, {"byte_start": 2621, "byte_end": 2625, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 446, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "5.99% 5.99% 5.99% 5.99%", "qwen": "7.64% 7.64% 7.64% 7.64%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.26575765013694763]], "qwen": [[279, " the", "normal", 0.18346962332725525]]}, "loss": {"rwkv": 5.987747972439545, "qwen": 7.644958822563186}, "topk": {"rwkv": [22590, 2, 0.26575765013694763, [[38013, 0.269528, " chess", false], [22590, 0.265758, " the", false], [3851, 0.081561, " Go", false], [55809, 0.052864, " computer", false], [32227, 0.046727, " that", false], [39944, 0.027278, " those", false], [38328, 0.023411, " early", false], [53354, 0.013249, " winning", false], [47202, 0.010337, " search", false], [38720, 0.009971, " human", false]]], "qwen": [279, 2, 0.18346962332725525, [[32719, 0.341252, " chess", false], [279, 0.18347, " the", false], [5994, 0.154985, " Go", false], [6366, 0.07453, " computer", false], [1846, 0.02422, " those", false], [429, 0.018696, " that", false], [4124, 0.010531, " early", false], [1181, 0.010355, " its", false], [419, 0.010157, " this", false], [1493, 0.009928, " these", false]]]}, "raw_delta": -0.09189528226852417, "tuned_delta": -0.08332349023794593}, {"byte_start": 2625, "byte_end": 2628, "display": {"text": " 19", "kind": "normal"}, "is_word": true, "word_id": 447, "word_key": " 19", "bytes_hex": "20 31 39", "compression": {"rwkv": "23.48% 23.48% 23.48%", "qwen": "46.90% 1.40% 0.09%"}, "model_tokens": {"rwkv": [[3492, " 19", "normal", 0.02015720121562481]], "qwen": [[220, " ", "normal", 0.07424170523881912], [16, "1", "normal", 0.925460696220398], [24, "9", "normal", 0.9950696229934692]]}, "loss": {"rwkv": 23.481364597802134, "qwen": 16.127139440185175}, "topk": {"rwkv": [3492, 10, 0.02015720121562481, [[38328, 0.119445, " early", false], [38013, 0.104095, " chess", false], [47202, 0.086436, " search", false], [52013, 0.076176, " initial", false], [3851, 0.048838, " Go", false], [51551, 0.043884, " earlier", false], [38720, 0.036309, " human", false], [38499, 0.035452, " first", false], [38491, 0.026591, " final", false], [3492, 0.020157, " 19", false]]], "qwen": [220, 3, 0.07424170523881912, [[4124, 0.121692, " early", false], [32719, 0.103933, " chess", false], [220, 0.074242, " ", false], [6366, 0.056794, " computer", false], [2856, 0.037899, " initial", false], [2711, 0.036277, " search", false], [6788, 0.032006, " earlier", false], [3738, 0.031073, " human", false], [4401, 0.030849, " development", false], [5994, 0.026553, " Go", false]]]}, "raw_delta": 0.4078048346564173, "tuned_delta": 0.41637662668699554}, {"byte_start": 2628, "byte_end": 2630, "display": {"text": "97", "kind": "normal"}, "is_word": true, "word_id": 448, "word_key": "97", "bytes_hex": "39 37", "compression": {"rwkv": "2.85% 2.85%", "qwen": "0.56% 2.55%"}, "model_tokens": {"rwkv": [[717, "97", "normal", 0.7284044027328491]], "qwen": [[24, "9", "normal", 0.969538152217865], [22, "7", "normal", 0.8682795763015747]]}, "loss": {"rwkv": 2.8529857986329596, "qwen": 1.5524927134108706}, "topk": {"rwkv": [717, 1, 0.7284044027328491, [[717, 0.728404, "97", false], [710, 0.179865, "90", false], [716, 0.035469, "96", false], [700, 0.011845, "80", false], [690, 0.00909, "70", false], [709, 0.004971, "89", false], [719, 0.004885, "99", false], [670, 0.004309, "50", false], [715, 0.003452, "95", false], [711, 0.002343, "91", false]]], "qwen": [24, 1, 0.969538152217865, [[24, 0.969538, "9", false], [23, 0.017938, "8", false], [22, 0.009043, "7", false], [21, 0.001301, "6", false], [20, 0.00081, "5", false], [19, 0.00038, "4", false], [339, 0.000238, "th", false], [17, 0.000152, "2", false], [15, 0.000122, "0", false], [18, 8.3e-05, "3", false]]]}, "raw_delta": 0.07211464922875166, "tuned_delta": 0.0806864412593299}, {"byte_start": 2630, "byte_end": 2638, "display": {"text": " program", "kind": "normal"}, "is_word": true, "word_id": 449, "word_key": " program", "bytes_hex": "20 70 72 6f 67 72 61 6d", "compression": {"rwkv": "11.48% 11.48% 11.48% 11.48% 11.48% 11.48% 11.48% 11.48%", "qwen": "11.39% 11.39% 11.39% 11.39% 11.39% 11.39% 11.39% 11.39%"}, "model_tokens": {"rwkv": [[52580, " program", "normal", 0.006228081416338682]], "qwen": [[2025, " program", "normal", 0.00640413723886013]]}, "loss": {"rwkv": 11.482387288325246, "qwen": 11.385594377528088}, "topk": {"rwkv": [52580, 24, 0.006228081416338682, [[53283, 0.108538, " victory", false], [38013, 0.089222, " chess", false], [38981, 0.065294, " match", false], [46, 0.065221, "-", false], [30941, 0.063723, " game", false], [45685, 0.059596, " defeat", false], [20184, 0.044272, " Kas", false], [40213, 0.037546, " world", false], [21265, 0.035805, " and", false], [47202, 0.030445, " search", false]]], "qwen": [2025, 18, 0.00640413723886013, [[32719, 0.263852, " chess", false], [6366, 0.208496, " computer", false], [5994, 0.076176, " Go", false], [1879, 0.036089, " world", false], [12560, 0.034823, " victory", false], [37542, 0.027709, " Kas", false], [12, 0.023072, "-", false], [1142, 0.01972, " case", false], [1809, 0.017739, " game", false], [47387, 0.012744, " Chess", false]]]}, "raw_delta": 0.00536733865737915, "tuned_delta": 0.013939130687957399}, {"byte_start": 2638, "byte_end": 2643, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 450, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "14.37% 14.37% 14.37% 14.37% 14.37%", "qwen": "10.15% 10.15% 10.15% 10.15% 10.15%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.01888643205165863]], "qwen": [[429, " that", "normal", 0.06002192944288254]]}, "loss": {"rwkv": 14.370595133854907, "qwen": 10.145916127863138}, "topk": {"rwkv": [32227, 6, 0.01888643205165863, [[499, 0.68857, ").", false], [42, 0.068422, ")", false], [497, 0.06727, "),", false], [45, 0.03764, ",", false], [21700, 0.021178, " for", false], [32227, 0.018886, " that", false], [580, 0.016441, ".)", false], [21265, 0.010519, " and", false], [4706, 0.007717, " of", false], [47, 0.004464, ".", false]]], "qwen": [429, 5, 0.06002192944288254, [[568, 0.498181, ").", false], [8, 0.109327, ")", false], [3593, 0.094091, ").\n\n", false], [701, 0.070225, "),", false], [429, 0.060022, " that", false], [11, 0.027611, ",", false], [369, 0.026642, " for", false], [304, 0.00916, " in", false], [2348, 0.007056, " against", false], [594, 0.006991, "'s", false]]]}, "raw_delta": 0.23426594734191894, "tuned_delta": 0.2428377393724972}, {"byte_start": 2643, "byte_end": 2649, "display": {"text": " first", "kind": "normal"}, "is_word": true, "word_id": 451, "word_key": " first", "bytes_hex": "20 66 69 72 73 74", "compression": {"rwkv": "15.59% 15.59% 15.59% 15.59% 15.59% 15.59%", "qwen": "17.83% 17.83% 17.83% 17.83% 17.83% 17.83%"}, "model_tokens": {"rwkv": [[38499, " first", "normal", 0.005630576517432928]], "qwen": [[1156, " first", "normal", 0.002655275631695986]]}, "loss": {"rwkv": 15.591626092940619, "qwen": 17.82692186911223}, "topk": {"rwkv": [38499, 9, 0.005630576517432928, [[22777, 0.464782, " won", false], [55934, 0.223228, " defeated", false], [30256, 0.083291, " beat", false], [22748, 0.020675, " was", false], [51744, 0.017805, " finally", false], [61959, 0.009888, " eventually", false], [21532, 0.007498, " did", false], [62676, 0.007335, " ultimately", false], [38499, 0.005631, " first", false], [21994, 0.005627, " led", false]]], "qwen": [1156, 15, 0.002655275631695986, [[23283, 0.532717, " defeated", false], [9382, 0.188874, " beat", false], [2765, 0.122936, " won", false], [572, 0.010686, " was", false], [6342, 0.009291, " played", false], [3867, 0.008745, " took", false], [3937, 0.007337, " went", false], [29701, 0.006301, " dominated", false], [9583, 0.005843, " eventually", false], [18651, 0.003529, " proved", false]]]}, "raw_delta": -0.12395111719767249, "tuned_delta": -0.11537932516709425}, {"byte_start": 2649, "byte_end": 2654, "display": {"text": " beat", "kind": "normal"}, "is_word": true, "word_id": 452, "word_key": " beat", "bytes_hex": "20 62 65 61 74", "compression": {"rwkv": "5.55% 5.55% 5.55% 5.55% 5.55%", "qwen": "6.08% 6.08% 6.08% 6.08% 6.08%"}, "model_tokens": {"rwkv": [[30256, " beat", "normal", 0.21177823841571808]], "qwen": [[9382, " beat", "normal", 0.18517979979515076]]}, "loss": {"rwkv": 5.550994590920425, "qwen": 6.082503533758917}, "topk": {"rwkv": [30256, 3, 0.21177823841571808, [[22777, 0.286485, " won", false], [55934, 0.253486, " defeated", false], [30256, 0.211778, " beat", false], [31351, 0.012831, " made", false], [55437, 0.011345, " achieved", false], [32354, 0.006439, " used", false], [46936, 0.005962, " proved", false], [32272, 0.005958, " took", false], [47333, 0.005357, " solved", false], [51097, 0.004873, " brought", false]]], "qwen": [9382, 2, 0.18517979979515076, [[23283, 0.474552, " defeated", false], [9382, 0.18518, " beat", false], [2765, 0.039459, " won", false], [18651, 0.020258, " proved", false], [16994, 0.015913, " achieved", false], [3867, 0.015192, " took", false], [1483, 0.013701, " used", false], [3937, 0.013551, " went", false], [20459, 0.011575, " demonstrated", false], [6342, 0.010672, " played", false]]]}, "raw_delta": -0.029473114013671864, "tuned_delta": -0.020901321983093614}, {"byte_start": 2654, "byte_end": 2656, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 453, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "40.01% 40.01%", "qwen": "42.06% 42.06%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.011944356374442577]], "qwen": [[264, " a", "normal", 0.009427649900317192]]}, "loss": {"rwkv": 40.01224527465484, "qwen": 42.0555367530257}, "topk": {"rwkv": [332, 4, 0.011944356374442577, [[20184, 0.806659, " Kas", false], [22590, 0.126618, " the", false], [40213, 0.014172, " world", false], [332, 0.011944, " a", false], [38720, 0.010875, " human", false], [19948, 0.003774, " Gar", false], [38013, 0.003355, " chess", false], [46227, 0.001549, " humans", false], [38621, 0.001381, " grand", false], [22615, 0.001217, " top", false]]], "qwen": [264, 3, 0.009427649900317192, [[37542, 0.890068, " Kas", false], [279, 0.062893, " the", false], [264, 0.009428, " a", false], [730, 0.005613, " K", false], [3738, 0.005219, " human", false], [1879, 0.003376, " world", false], [32719, 0.002167, " chess", false], [220, 0.001656, " ", false], [5994, 0.000883, " Go", false], [12677, 0.000816, " humans", false]]]}, "raw_delta": -0.11330413818359375, "tuned_delta": -0.10473234615301551}, {"byte_start": 2656, "byte_end": 2662, "display": {"text": " world", "kind": "normal"}, "is_word": true, "word_id": 454, "word_key": " world", "bytes_hex": "20 77 6f 72 6c 64", "compression": {"rwkv": "2.61% 2.61% 2.61% 2.61% 2.61% 2.61%", "qwen": "3.36% 3.36% 3.36% 3.36% 3.36% 3.36%"}, "model_tokens": {"rwkv": [[40213, " world", "normal", 0.4182984530925751]], "qwen": [[1879, " world", "normal", 0.3270755708217621]]}, "loss": {"rwkv": 2.606431470356037, "qwen": 3.358966998306696}, "topk": {"rwkv": [40213, 1, 0.4182984530925751, [[40213, 0.418298, " world", false], [38720, 0.249122, " human", false], [38621, 0.153568, " grand", false], [22615, 0.061515, " top", false], [38013, 0.046831, " chess", false], [64532, 0.010259, " professional", false], [55716, 0.010002, " champion", false], [39471, 0.006408, " reign", false], [20184, 0.005079, " Kas", false], [47436, 0.003959, " strong", false]]], "qwen": [1879, 2, 0.3270755708217621, [[3738, 0.441339, " human", false], [1879, 0.327076, " world", false], [6662, 0.093183, " grand", false], [1909, 0.017116, " top", false], [6584, 0.016489, " professional", false], [32719, 0.01559, " chess", false], [89956, 0.012008, " reigning", false], [18319, 0.010819, " champion", false], [10304, 0.008297, " Grand", false], [2781, 0.005426, " player", false]]]}, "raw_delta": -0.041729430357615144, "tuned_delta": -0.033157638327036894}, {"byte_start": 2662, "byte_end": 2671, "display": {"text": " champion", "kind": "normal"}, "is_word": true, "word_id": 455, "word_key": " champion", "bytes_hex": "20 63 68 61 6d 70 69 6f 6e", "compression": {"rwkv": "0.54% 0.54% 0.54% 0.54% 0.54% 0.54% 0.54% 0.54% 0.54%", "qwen": "0.33% 0.33% 0.33% 0.33% 0.33% 0.33% 0.33% 0.33% 0.33%"}, "model_tokens": {"rwkv": [[55716, " champion", "normal", 0.7612940073013306]], "qwen": [[18319, " champion", "normal", 0.8487852215766907]]}, "loss": {"rwkv": 0.5439849465157495, "qwen": 0.32851188423501704}, "topk": {"rwkv": [55716, 1, 0.7612940073013306, [[55716, 0.761294, " champion", false], [38013, 0.123764, " chess", false], [46, 0.072842, "-", false], [38621, 0.011521, " grand", false], [37996, 0.007376, " champ", false], [64275, 0.007362, " championship", false], [38046, 0.002726, " class", false], [46526, 0.00215, " master", false], [38720, 0.001669, " human", false], [46841, 0.000877, " player", false]]], "qwen": [18319, 1, 0.8487852215766907, [[18319, 0.848785, " champion", false], [32719, 0.050926, " chess", false], [14800, 0.030213, "-class", false], [11582, 0.019481, "-ch", false], [6662, 0.008552, " grand", false], [34541, 0.0065, " champ", false], [21553, 0.006274, " championship", false], [536, 0.004128, " class", false], [2781, 0.003682, " player", false], [5994, 0.002991, " Go", false]]]}, "raw_delta": 0.011948363648520576, "tuned_delta": 0.020520155679098824}, {"byte_start": 2671, "byte_end": 2673, "display": {"text": ").", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29 2e", "compression": {"rwkv": "3.08% 3.08%", "qwen": "5.28% 5.28%"}, "model_tokens": {"rwkv": [[499, ").", "normal", 0.7121771574020386]], "qwen": [[568, ").", "normal", 0.5565124750137329]]}, "loss": {"rwkv": 3.0819291034615306, "qwen": 5.284463080386749}, "topk": {"rwkv": [499, 1, 0.7121771574020386, [[499, 0.712177, ").", false], [42, 0.054444, ")", false], [497, 0.049724, "),", false], [45, 0.049385, ",", false], [580, 0.032032, ".)", false], [47, 0.022036, ".", false], [4596, 0.019002, " in", false], [4424, 0.011766, " at", false], [21265, 0.006325, " and", false], [60, 0.004699, ";", false]]], "qwen": [568, 1, 0.5565124750137329, [[568, 0.556512, ").", false], [3593, 0.125492, ").\n\n", false], [8, 0.088581, ")", false], [304, 0.068221, " in", false], [701, 0.046289, "),", false], [11, 0.028162, ",", false], [6138, 0.011887, ".)", false], [518, 0.010606, " at", false], [553, 0.006713, " by", false], [448, 0.004133, " with", false]]]}, "raw_delta": -0.12213441729545593, "tuned_delta": -0.11356262526487769}, {"byte_start": 2673, "byte_end": 2682, "display": {"text": " Learning", "kind": "normal"}, "is_word": true, "word_id": 456, "word_key": " learning", "bytes_hex": "20 4c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "8.52% 8.52% 8.52% 8.52% 8.52% 8.52% 8.52% 8.52% 8.52%", "qwen": "7.34% 7.34% 7.34% 7.34% 7.34% 7.34% 7.34% 7.34% 7.34%"}, "model_tokens": {"rwkv": [[55122, " Learning", "normal", 0.014099424704909325]], "qwen": [[20909, " Learning", "normal", 0.025673646479845047]]}, "loss": {"rwkv": 8.515908227469575, "qwen": 7.338289033568737}, "topk": {"rwkv": [55122, 12, 0.014099424704909325, [[261, 0.277084, "\n\n", false], [20996, 0.098456, " The", false], [267, 0.055791, "  ", false], [29894, 0.053921, " This", false], [3913, 0.043547, " In", false], [19555, 0.033826, " But", false], [36251, 0.023086, " Again", false], [3918, 0.021389, " It", false], [37453, 0.017088, " These", false], [29511, 0.016195, " Once", false]]], "qwen": [20909, 6, 0.025673646479845047, [[1096, 0.131989, " This", false], [576, 0.113991, " The", false], [220, 0.064805, " ", false], [758, 0.056152, " In", false], [1084, 0.032568, " It", false], [20909, 0.025674, " Learning", false], [10115, 0.025323, " Self", false], [4220, 0.022711, " These", false], [362, 0.018038, " A", false], [3197, 0.017117, " When", false]]]}, "raw_delta": 0.06530107392205131, "tuned_delta": 0.07387286595262955}, {"byte_start": 2682, "byte_end": 2685, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 457, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "7.51% 7.51% 7.51%", "qwen": "7.34% 7.34% 7.34%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.2856481075286865]], "qwen": [[553, " by", "normal", 0.2946818768978119]]}, "loss": {"rwkv": 7.514036671296684, "qwen": 7.344873819313647}, "topk": {"rwkv": [4450, 1, 0.2856481075286865, [[4450, 0.285648, " by", false], [4600, 0.074767, " is", false], [22748, 0.067164, " was", false], [332, 0.056962, " a", false], [30917, 0.042613, " from", false], [4811, 0.037718, " to", false], [22590, 0.033044, " the", false], [4706, 0.032283, " of", false], [45, 0.022286, ",", false], [21800, 0.021196, " has", false]]], "qwen": [553, 1, 0.2946818768978119, [[553, 0.294682, " by", false], [572, 0.101215, " was", false], [374, 0.06683, " is", false], [702, 0.032769, " has", false], [11, 0.026648, ",", false], [304, 0.022976, " in", false], [1030, 0.01806, " had", false], [5980, 0.016686, "-based", false], [646, 0.016298, " can", false], [5413, 0.015814, " methods", false]]]}, "raw_delta": 0.009380380312601744, "tuned_delta": 0.017952172343179994}, {"byte_start": 2685, "byte_end": 2690, "display": {"text": " self", "kind": "normal"}, "is_word": true, "word_id": 458, "word_key": " self", "bytes_hex": "20 73 65 6c 66", "compression": {"rwkv": "0.74% 0.74% 0.74% 0.74% 0.74%", "qwen": "0.08% 0.08% 0.08% 0.08% 0.08%"}, "model_tokens": {"rwkv": [[31978, " self", "normal", 0.8137813806533813]], "qwen": [[656, " self", "normal", 0.9773311018943787]]}, "loss": {"rwkv": 0.7431851895204377, "qwen": 0.08270163994208604}, "topk": {"rwkv": [31978, 1, 0.8137813806533813, [[31978, 0.813781, " self", false], [47202, 0.029136, " search", false], [38720, 0.01375, " human", false], [46342, 0.012835, " itself", false], [52491, 0.008772, " playing", false], [65003, 0.007723, " reinforcement", false], [40093, 0.007475, " value", false], [59815, 0.005903, " imitation", false], [31702, 0.004359, " play", false], [62557, 0.004344, " simulation", false]]], "qwen": [656, 1, 0.9773311018943787, [[656, 0.977331, " self", false], [5086, 0.004029, " itself", false], [5619, 0.001925, " playing", false], [71278, 0.001007, " reinforcement", false], [3738, 0.000895, " human", false], [1486, 0.000809, " play", false], [11504, 0.000486, " repeated", false], [4862, 0.00044, " training", false], [10115, 0.000352, " Self", false], [2711, 0.000339, " search", false]]]}, "raw_delta": 0.03662498481571674, "tuned_delta": 0.04519677684629499}, {"byte_start": 2690, "byte_end": 2695, "display": {"text": " play", "kind": "normal"}, "is_word": true, "word_id": 459, "word_key": " play", "bytes_hex": "20 70 6c 61 79", "compression": {"rwkv": "1.13% 1.13% 1.13% 1.13% 1.13%", "qwen": "0.63% 0.63% 0.63% 0.63% 0.63%"}, "model_tokens": {"rwkv": [[31702, " play", "normal", 0.7305943965911865]], "qwen": [[1486, " play", "normal", 0.8401477932929993]]}, "loss": {"rwkv": 1.1271055006945025, "qwen": 0.6282122614234654}, "topk": {"rwkv": [31702, 1, 0.7305943965911865, [[31702, 0.730594, " play", false], [46, 0.264675, "-", false], [26697, 0.001694, "play", false], [39301, 0.000377, " plays", false], [52491, 0.000345, " playing", false], [4715, 0.000135, " or", false], [11, 7.4e-05, "\n", false], [45, 7.4e-05, ",", false], [32189, 6.3e-05, " talk", false], [47077, 6.2e-05, " replay", false]]], "qwen": [1486, 1, 0.8401477932929993, [[1486, 0.840148, " play", false], [26544, 0.153109, "-play", false], [1363, 0.002449, "play", false], [5619, 0.00096, " playing", false], [12, 0.000871, "-", false], [6342, 0.000397, " played", false], [11088, 0.00036, " plays", false], [72085, 0.000153, "-playing", false], [2268, 0.000136, "-p", false], [481, 0.000131, " -", false]]]}, "raw_delta": 0.027664515376091003, "tuned_delta": 0.03623630740666925}, {"byte_start": 2695, "byte_end": 2696, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "50.72%", "qwen": "51.11%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.06047001853585243]], "qwen": [[11, ",", "normal", 0.058770012110471725]]}, "loss": {"rwkv": 50.719747531252615, "qwen": 51.10970099381895}, "topk": {"rwkv": [45, 3, 0.06047001853585243, [[4600, 0.265067, " is", false], [22748, 0.154439, " was", false], [45, 0.06047, ",", false], [21800, 0.048743, " has", false], [46936, 0.023373, " proved", false], [30135, 0.018009, " also", false], [21795, 0.017133, " had", false], [21413, 0.016848, " can", false], [4596, 0.016831, " in", false], [21532, 0.012162, " did", false]]], "qwen": [11, 3, 0.058770012110471725, [[374, 0.186056, " is", false], [572, 0.16232, " was", false], [11, 0.05877, ",", false], [702, 0.054755, " has", false], [18651, 0.041368, " proved", false], [646, 0.024019, " can", false], [1558, 0.022965, " does", false], [1030, 0.018434, " had", false], [1521, 0.016502, " did", false], [1083, 0.015467, " also", false]]]}, "raw_delta": -0.021623611450195312, "tuned_delta": -0.013051819419617064}, {"byte_start": 2696, "byte_end": 2700, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 460, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "11.98% 11.98% 11.98% 11.98%", "qwen": "11.83% 11.83% 11.83% 11.83%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.0699387714266777]], "qwen": [[323, " and", "normal", 0.07252924889326096]]}, "loss": {"rwkv": 11.97549594487909, "qwen": 11.82904196875373}, "topk": {"rwkv": [21265, 4, 0.0699387714266777, [[4715, 0.106634, " or", false], [51948, 0.080174, " however", false], [4596, 0.073112, " in", false], [21265, 0.069939, " and", false], [40186, 0.05474, " which", false], [4423, 0.042955, " as", false], [4450, 0.028859, " by", false], [32487, 0.024602, " with", false], [47001, 0.019805, " rather", false], [32465, 0.019563, " when", false]]], "qwen": [323, 3, 0.07252924889326096, [[892, 0.120817, " which", false], [4764, 0.08481, " however", false], [323, 0.072529, " and", false], [304, 0.052395, " in", false], [476, 0.047287, " or", false], [438, 0.041698, " as", false], [1075, 0.030872, " like", false], [10856, 0.029464, " combined", false], [979, 0.023073, " when", false], [264, 0.018457, " a", false]]]}, "raw_delta": 0.008121132850646973, "tuned_delta": 0.016692924881225223}, {"byte_start": 2700, "byte_end": 2709, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 461, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "5.95% 5.95% 5.95% 5.95% 5.95% 5.95% 5.95% 5.95% 5.95%", "qwen": "5.58% 5.58% 5.58% 5.58% 5.58% 5.58% 5.58% 5.58% 5.58%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.051337603479623795]], "qwen": [[6832, " learning", "normal", 0.061622485518455505]]}, "loss": {"rwkv": 5.948612364776541, "qwen": 5.583887801632613}, "topk": {"rwkv": [56537, 3, 0.051337603479623795, [[22590, 0.14072, " the", false], [4450, 0.077418, " by", false], [56537, 0.051338, " learning", false], [47202, 0.05026, " search", false], [4596, 0.047363, " in", false], [32230, 0.039624, " then", false], [21902, 0.038404, " its", false], [39193, 0.02872, " other", false], [61953, 0.028545, " especially", false], [40085, 0.023326, " using", false]]], "qwen": [6832, 2, 0.061622485518455505, [[279, 0.169488, " the", false], [6832, 0.061622, " learning", false], [1181, 0.055484, " its", false], [304, 0.049826, " in", false], [5310, 0.043404, " especially", false], [1008, 0.036733, " other", false], [2937, 0.02753, " later", false], [1221, 0.024226, " then", false], [553, 0.023626, " by", false], [71278, 0.023571, " reinforcement", false]]]}, "raw_delta": 0.020224624209933817, "tuned_delta": 0.028796416240512067}, {"byte_start": 2709, "byte_end": 2712, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 462, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "20.85% 20.85% 20.85%", "qwen": "9.63% 9.63% 9.63%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.031202295795083046]], "qwen": [[304, " in", "normal", 0.20149588584899902]]}, "loss": {"rwkv": 20.851451762848296, "qwen": 9.62990697811478}, "topk": {"rwkv": [4596, 6, 0.031202295795083046, [[4450, 0.419549, " by", false], [30917, 0.107853, " from", false], [4811, 0.069568, " to", false], [332, 0.049121, " a", false], [22590, 0.037323, " the", false], [4596, 0.031202, " in", false], [4706, 0.030607, " of", false], [32487, 0.030387, " with", false], [22705, 0.013148, " via", false], [40093, 0.012071, " value", false]]], "qwen": [304, 2, 0.20149588584899902, [[553, 0.460229, " by", false], [304, 0.201496, " in", false], [504, 0.032372, " from", false], [803, 0.028194, " more", false], [311, 0.026235, " to", false], [8789, 0.022546, " generally", false], [315, 0.015536, " of", false], [448, 0.015369, " with", false], [5086, 0.011464, " itself", false], [518, 0.009877, " at", false]]]}, "raw_delta": 0.6222545703252157, "tuned_delta": 0.6308263623557939}, {"byte_start": 2712, "byte_end": 2720, "display": {"text": " general", "kind": "normal"}, "is_word": true, "word_id": 463, "word_key": " general", "bytes_hex": "20 67 65 6e 65 72 61 6c", "compression": {"rwkv": "1.47% 1.47% 1.47% 1.47% 1.47% 1.47% 1.47% 1.47%", "qwen": "0.29% 0.29% 0.29% 0.29% 0.29% 0.29% 0.29% 0.29%"}, "model_tokens": {"rwkv": [[51832, " general", "normal", 0.5234772562980652]], "qwen": [[4586, " general", "normal", 0.8802781701087952]]}, "loss": {"rwkv": 1.4705204579373587, "qwen": 0.2874509964834224}, "topk": {"rwkv": [51832, 1, 0.5234772562980652, [[51832, 0.523477, " general", false], [22590, 0.101166, " the", false], [332, 0.060567, " a", false], [39193, 0.024559, " other", false], [62293, 0.021128, " particular", false], [32234, 0.016136, " this", false], [47202, 0.013361, " search", false], [4419, 0.012075, " an", false], [56812, 0.01165, " parallel", false], [38576, 0.010957, " games", false]]], "qwen": [4586, 1, 0.8802781701087952, [[4586, 0.880278, " general", false], [1008, 0.024624, " other", false], [803, 0.015842, " more", false], [279, 0.009629, " the", false], [3953, 0.009389, " particular", false], [264, 0.006392, " a", false], [1657, 0.005726, " many", false], [3868, 0.004921, " games", false], [894, 0.003346, " any", false], [71278, 0.001897, " reinforcement", false]]]}, "raw_delta": 0.06560330092906952, "tuned_delta": 0.07417509295964776}, {"byte_start": 2720, "byte_end": 2721, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "1.28%", "qwen": "0.88%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.9317038059234619]], "qwen": [[11, ",", "normal", 0.9525086283683777]]}, "loss": {"rwkv": 1.276799200005491, "qwen": 0.8774496399791492}, "topk": {"rwkv": [45, 1, 0.9317038059234619, [[45, 0.931704, ",", false], [275, 0.008793, " (", false], [4450, 0.007177, " by", false], [30917, 0.005872, " from", false], [21286, 0.004578, " are", false], [4596, 0.004207, " in", false], [4600, 0.003044, " is", false], [4423, 0.002999, " as", false], [21700, 0.002112, " for", false], [32462, 0.00185, " were", false]]], "qwen": [11, 1, 0.9525086283683777, [[11, 0.952509, ",", false], [320, 0.011165, " (", false], [438, 0.003895, " as", false], [572, 0.002728, " was", false], [304, 0.002635, " in", false], [553, 0.002413, " by", false], [369, 0.001557, " for", false], [504, 0.001391, " from", false], [374, 0.001263, " is", false], [323, 0.001132, " and", false]]]}, "raw_delta": 0.02214464172720909, "tuned_delta": 0.03071643375778734}, {"byte_start": 2721, "byte_end": 2724, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 464, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "8.55% 8.55% 8.55%", "qwen": "9.93% 9.93% 9.93%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.239624485373497]], "qwen": [[374, " is", "normal", 0.19180235266685486]]}, "loss": {"rwkv": 8.547216713599978, "qwen": 9.926281813969146}, "topk": {"rwkv": [4600, 1, 0.239624485373497, [[4600, 0.239624, " is", false], [22748, 0.130871, " was", false], [21800, 0.096172, " has", false], [21286, 0.086335, " are", false], [32462, 0.04343, " were", false], [46936, 0.030249, " proved", false], [31059, 0.026591, " have", false], [21795, 0.025319, " had", false], [47638, 0.019544, " turned", false], [21413, 0.015931, " can", false]]], "qwen": [374, 2, 0.19180235266685486, [[572, 0.203406, " was", false], [374, 0.191802, " is", false], [702, 0.08035, " has", false], [525, 0.051294, " are", false], [1033, 0.048801, " were", false], [18651, 0.029424, " proved", false], [614, 0.022187, " have", false], [1030, 0.021144, " had", false], [6116, 0.019618, " became", false], [646, 0.014353, " can", false]]]}, "raw_delta": -0.07647160689036053, "tuned_delta": -0.06789981485978229}, {"byte_start": 2724, "byte_end": 2729, "display": {"text": " like", "kind": "normal"}, "is_word": true, "word_id": 465, "word_key": " like", "bytes_hex": "20 6c 69 6b 65", "compression": {"rwkv": "27.84% 27.84% 27.84% 27.84% 27.84%", "qwen": "27.71% 27.71% 27.71% 27.71% 27.71%"}, "model_tokens": {"rwkv": [[31296, " like", "normal", 0.0004481030919123441]], "qwen": [[1075, " like", "normal", 0.0004606365109793842]]}, "loss": {"rwkv": 27.839505867154212, "qwen": 27.710209310235552}, "topk": {"rwkv": [31296, 151, 0.0004481030919123441, [[332, 0.285115, " a", false], [22187, 0.072617, " not", false], [22590, 0.060805, " the", false], [4419, 0.059896, " an", false], [22226, 0.031702, " one", false], [31466, 0.027757, " much", false], [39171, 0.025885, " often", false], [50919, 0.022929, " another", false], [31458, 0.01857, " more", false], [32386, 0.01539, " very", false]]], "qwen": [1075, 154, 0.0004606365109793842, [[264, 0.256609, " a", false], [537, 0.086539, " not", false], [279, 0.061306, " the", false], [458, 0.054938, " an", false], [825, 0.03098, " one", false], [1431, 0.028723, " now", false], [2441, 0.01771, " another", false], [1602, 0.014805, " very", false], [3118, 0.01421, " based", false], [3545, 0.013818, " often", false]]]}, "raw_delta": 0.0071697235107421875, "tuned_delta": 0.015741515541320437}, {"byte_start": 2729, "byte_end": 2736, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 466, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "7.85% 7.85% 7.85% 7.85% 7.85% 7.85% 7.85%", "qwen": "8.18% 8.18% 8.18% 8.18% 8.18% 8.18% 8.18%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.04752352833747864]], "qwen": [[2711, " search", "normal", 0.04180444777011871]]}, "loss": {"rwkv": 7.849484736979571, "qwen": 8.178927946511084}, "topk": {"rwkv": [47202, 4, 0.04752352833747864, [[332, 0.146975, " a", false], [22590, 0.119602, " the", false], [38720, 0.067053, " human", false], [47202, 0.047524, " search", false], [37920, 0.03768, " brute", false], [38013, 0.021692, " chess", false], [60463, 0.021109, " searching", false], [21273, 0.021, " any", false], [56537, 0.020379, " learning", false], [30597, 0.019064, " deep", false]]], "qwen": [2711, 3, 0.04180444777011871, [[264, 0.205371, " a", false], [279, 0.14606, " the", false], [2711, 0.041804, " search", false], [3738, 0.039201, " human", false], [458, 0.029872, " an", false], [64098, 0.024256, " brute", false], [9902, 0.016597, " ``", false], [6832, 0.015212, " learning", false], [1667, 0.015136, " using", false], [15039, 0.014427, " searching", false]]]}, "raw_delta": -0.01826821054731098, "tuned_delta": -0.009696418516732733}, {"byte_start": 2736, "byte_end": 2739, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 467, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "5.64% 5.64% 5.64%", "qwen": "4.43% 4.43% 4.43%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.3910079598426819]], "qwen": [[304, " in", "normal", 0.478597491979599]]}, "loss": {"rwkv": 5.635527503472513, "qwen": 4.429646782739058}, "topk": {"rwkv": [4596, 1, 0.3910079598426819, [[4596, 0.391008, " in", false], [45, 0.202242, ",", false], [59, 0.099982, ":", false], [4450, 0.084479, " by", false], [47, 0.040716, ".", false], [21400, 0.03315, " but", false], [60, 0.02015, ";", false], [21265, 0.018215, " and", false], [32487, 0.008743, " with", false], [21700, 0.007815, " for", false]]], "qwen": [304, 1, 0.478597491979599, [[304, 0.478597, " in", false], [25, 0.13181, ":", false], [11, 0.102186, ",", false], [13, 0.028422, ".", false], [3118, 0.018091, " based", false], [26, 0.016742, ";", false], [369, 0.016629, " for", false], [714, 0.014212, " but", false], [5980, 0.01371, "-based", false], [448, 0.013334, " with", false]]]}, "raw_delta": 0.06686822573343912, "tuned_delta": 0.07544001776401736}, {"byte_start": 2739, "byte_end": 2744, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 468, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "1.62% 1.62% 1.62% 1.62% 1.62%", "qwen": "1.66% 1.66% 1.66% 1.66% 1.66%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.6378023028373718]], "qwen": [[429, " that", "normal", 0.6315386295318604]]}, "loss": {"rwkv": 1.6202141572483475, "qwen": 1.6576426340664636}, "topk": {"rwkv": [32227, 1, 0.6378023028373718, [[32227, 0.637802, " that", false], [22590, 0.088056, " the", false], [31370, 0.040742, " many", false], [21902, 0.030745, " its", false], [37832, 0.025968, " being", false], [32234, 0.023841, " this", false], [38013, 0.019362, " chess", false], [332, 0.018678, " a", false], [32074, 0.006937, " some", false], [39920, 0.006094, " terms", false]]], "qwen": [429, 1, 0.6315386295318604, [[429, 0.631539, " that", false], [279, 0.092578, " the", false], [419, 0.053061, " this", false], [264, 0.034964, " a", false], [32719, 0.02852, " chess", false], [1181, 0.0169, " its", false], [1657, 0.013024, " many", false], [825, 0.011143, " one", false], [2441, 0.009717, " another", false], [3793, 0.009374, " terms", false]]]}, "raw_delta": -0.0020754754543304416, "tuned_delta": 0.006496316576247807}, {"byte_start": 2744, "byte_end": 2747, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 469, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "2.21% 2.21% 2.21%", "qwen": "1.21% 1.21% 1.21%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.694502592086792]], "qwen": [[432, " it", "normal", 0.8172699809074402]]}, "loss": {"rwkv": 2.2072482721934006, "qwen": 1.2129804691136825}, "topk": {"rwkv": [4601, 1, 0.694502592086792, [[4601, 0.694503, " it", false], [22590, 0.090856, " the", false], [21902, 0.019429, " its", false], [45, 0.018944, ",", false], [332, 0.010958, " a", false], [39934, 0.010073, " there", false], [30322, 0.009476, " both", false], [56537, 0.007013, " learning", false], [22226, 0.006704, " one", false], [22799, 0.005822, " you", false]]], "qwen": [432, 1, 0.8172699809074402, [[432, 0.81727, " it", false], [279, 0.029159, " the", false], [11, 0.022253, ",", false], [1181, 0.019094, " its", false], [2176, 0.012306, " both", false], [807, 0.008344, " they", false], [1052, 0.006602, " there", false], [2711, 0.00489, " search", false], [264, 0.004275, " a", false], [304, 0.00391, " in", false]]]}, "raw_delta": 0.05513391395409902, "tuned_delta": 0.06370570598467727}, {"byte_start": 2747, "byte_end": 2755, "display": {"text": " enables", "kind": "normal"}, "is_word": true, "word_id": 470, "word_key": " enables", "bytes_hex": "20 65 6e 61 62 6c 65 73", "compression": {"rwkv": "11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83% 11.83%", "qwen": "11.85% 11.85% 11.85% 11.85% 11.85% 11.85% 11.85% 11.85%"}, "model_tokens": {"rwkv": [[51597, " enables", "normal", 0.005270105786621571]], "qwen": [[20081, " enables", "normal", 0.005207602400332689]]}, "loss": {"rwkv": 11.834607757292277, "qwen": 11.85181999596894}, "topk": {"rwkv": [51597, 25, 0.005270105786621571, [[4600, 0.253682, " is", false], [21413, 0.087753, " can", false], [56540, 0.045638, " leverage", false], [47181, 0.045148, " scales", false], [30659, 0.044006, " does", false], [57102, 0.034876, " requires", false], [56501, 0.025579, " involves", false], [21800, 0.023224, " has", false], [39914, 0.01778, " tends", false], [32356, 0.016487, " uses", false]]], "qwen": [20081, 26, 0.005207602400332689, [[374, 0.315095, " is", false], [1558, 0.083303, " does", false], [646, 0.064419, " can", false], [7460, 0.038913, " requires", false], [27505, 0.021124, " lever", false], [702, 0.020943, " has", false], [3643, 0.019325, " makes", false], [17601, 0.017854, " involves", false], [5711, 0.017011, " uses", false], [4990, 0.011349, " takes", false]]]}, "raw_delta": -0.0009544491767883301, "tuned_delta": 0.007617342853789918}, {"byte_start": 2755, "byte_end": 2763, "display": {"text": " massive", "kind": "normal"}, "is_word": true, "word_id": 471, "word_key": " massive", "bytes_hex": "20 6d 61 73 73 69 76 65", "compression": {"rwkv": "7.26% 7.26% 7.26% 7.26% 7.26% 7.26% 7.26% 7.26%", "qwen": "12.42% 12.42% 12.42% 12.42% 12.42% 12.42% 12.42% 12.42%"}, "model_tokens": {"rwkv": [[52195, " massive", "normal", 0.0401168130338192]], "qwen": [[10951, " massive", "normal", 0.004051612690091133]]}, "loss": {"rwkv": 7.25574166072086, "qwen": 12.417637542849741}, "topk": {"rwkv": [52195, 3, 0.0401168130338192, [[22590, 0.173718, " the", false], [332, 0.10964, " a", false], [52195, 0.040117, " massive", false], [22226, 0.034335, " one", false], [4419, 0.0304, " an", false], [59988, 0.029927, " massively", false], [38888, 0.027781, " lever", false], [52224, 0.027375, " methods", false], [51832, 0.023804, " general", false], [63370, 0.023168, " computation", false]]], "qwen": [10951, 27, 0.004051612690091133, [[279, 0.188626, " the", false], [264, 0.10628, " a", false], [4586, 0.06056, " general", false], [5413, 0.052981, " methods", false], [458, 0.04216, " an", false], [39661, 0.036924, " exploitation", false], [13009, 0.036775, " agents", false], [76482, 0.023248, " leveraging", false], [26403, 0.022925, " exploration", false], [6832, 0.018577, " learning", false]]]}, "raw_delta": -0.2862362861633301, "tuned_delta": -0.27766449413275185}, {"byte_start": 2763, "byte_end": 2775, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 472, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "3.52% 3.52% 3.52% 3.52% 3.52% 3.52% 3.52% 3.52% 3.52% 3.52% 3.52% 3.52%", "qwen": "3.18% 3.18% 3.18% 3.18% 3.18% 3.18% 3.18% 3.18% 3.18% 3.18% 3.18% 3.18%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.09728000313043594]], "qwen": [[34447, " computation", "normal", 0.12069942057132721]]}, "loss": {"rwkv": 3.5222046896703203, "qwen": 3.17761380105219}, "topk": {"rwkv": [63370, 4, 0.09728000313043594, [[45, 0.126396, ",", false], [56812, 0.121244, " parallel", false], [63621, 0.119267, " improvement", false], [63370, 0.09728, " computation", false], [64423, 0.075713, " improvements", false], [56950, 0.063865, " progress", false], [63562, 0.031557, " exploration", false], [56540, 0.023432, " leverage", false], [38888, 0.022804, " lever", false], [52805, 0.01612, " scaling", false]]], "qwen": [34447, 1, 0.12069942057132721, [[34447, 0.120699, " computation", false], [26403, 0.09624, " exploration", false], [2711, 0.075672, " search", false], [14713, 0.075473, " amounts", false], [15673, 0.049149, " improvement", false], [18142, 0.038987, " improvements", false], [39661, 0.034509, " exploitation", false], [11, 0.031238, ",", false], [26943, 0.031151, " scaling", false], [5452, 0.030295, " scale", false]]]}, "raw_delta": 0.019108176231384277, "tuned_delta": 0.027679968261962527}, {"byte_start": 2775, "byte_end": 2778, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 473, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "4.27% 4.27% 4.27%", "qwen": "6.63% 6.63% 6.63%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.4887532591819763]], "qwen": [[311, " to", "normal", 0.3317577838897705]]}, "loss": {"rwkv": 4.273608356799989, "qwen": 6.632490865881613}, "topk": {"rwkv": [4811, 1, 0.4887532591819763, [[4811, 0.488753, " to", false], [45, 0.089803, ",", false], [47, 0.079899, ".", false], [21265, 0.036857, " and", false], [53356, 0.031182, " without", false], [4706, 0.028676, " of", false], [4424, 0.027044, " at", false], [4596, 0.026625, " in", false], [32487, 0.026466, " with", false], [4712, 0.020952, " on", false]]], "qwen": [311, 1, 0.3317577838897705, [[311, 0.331758, " to", false], [11, 0.125657, ",", false], [13, 0.109759, ".", false], [2041, 0.058306, " without", false], [323, 0.0552, " and", false], [518, 0.033041, " at", false], [429, 0.032326, " that", false], [448, 0.026722, " with", false], [382, 0.02651, ".\n\n", false], [714, 0.022131, " but", false]]]}, "raw_delta": -0.13080422083536783, "tuned_delta": -0.12223242880478959}, {"byte_start": 2778, "byte_end": 2781, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 474, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"rwkv": "1.55% 1.55% 1.55%", "qwen": "2.03% 2.03% 2.03%"}, "model_tokens": {"rwkv": [[4435, " be", "normal", 0.7740868926048279]], "qwen": [[387, " be", "normal", 0.7130709290504456]]}, "loss": {"rwkv": 1.549770063454941, "qwen": 2.032843532330941}, "topk": {"rwkv": [4435, 1, 0.7740868926048279, [[4435, 0.774087, " be", false], [56540, 0.038693, " leverage", false], [32187, 0.00792, " take", false], [31358, 0.006221, " make", false], [45284, 0.006172, " become", false], [30858, 0.005718, " find", false], [31702, 0.005342, " play", false], [4491, 0.00497, " do", false], [51982, 0.004533, " improve", false], [52570, 0.004326, " proceed", false]]], "qwen": [387, 1, 0.7130709290504456, [[387, 0.713071, " be", false], [1896, 0.027526, " take", false], [614, 0.013965, " have", false], [3635, 0.012586, " become", false], [32064, 0.010333, " leverage", false], [1281, 0.009125, " make", false], [7269, 0.008625, " improve", false], [11075, 0.008269, " achieve", false], [22279, 0.007899, " overcome", false], [1486, 0.006836, " play", false]]]}, "raw_delta": -0.026787281036376953, "tuned_delta": -0.018215489005798703}, {"byte_start": 2781, "byte_end": 2789, "display": {"text": " brought", "kind": "normal"}, "is_word": true, "word_id": 475, "word_key": " brought", "bytes_hex": "20 62 72 6f 75 67 68 74", "compression": {"rwkv": "10.21% 10.21% 10.21% 10.21% 10.21% 10.21% 10.21% 10.21%", "qwen": "11.49% 11.49% 11.49% 11.49% 11.49% 11.49% 11.49% 11.49%"}, "model_tokens": {"rwkv": [[51097, " brought", "normal", 0.010964682325720787]], "qwen": [[7117, " brought", "normal", 0.0061202989891171455]]}, "loss": {"rwkv": 10.214393600043929, "qwen": 11.487784318887634}, "topk": {"rwkv": [51097, 8, 0.010964682325720787, [[50937, 0.351463, " applied", false], [56540, 0.165552, " leverage", false], [32354, 0.085808, " used", false], [30666, 0.057943, " done", false], [60152, 0.05008, " performed", false], [51139, 0.012738, " carried", false], [55957, 0.011391, " deployed", false], [51097, 0.010965, " brought", false], [31351, 0.010142, " made", false], [59355, 0.009901, " conducted", false]]], "qwen": [7117, 19, 0.0061202989891171455, [[1483, 0.209172, " used", false], [27505, 0.177003, " lever", false], [9251, 0.148379, " applied", false], [2814, 0.096124, " done", false], [10660, 0.041811, " performed", false], [1865, 0.026493, " made", false], [50663, 0.019872, " exploited", false], [26075, 0.011203, " deployed", false], [19446, 0.009398, " employed", false], [2182, 0.008854, " put", false]]]}, "raw_delta": -0.07061177492141724, "tuned_delta": -0.062039982890838986}, {"byte_start": 2789, "byte_end": 2792, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 476, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.26% 0.26% 0.26%", "qwen": "0.21% 0.21% 0.21%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.9572607278823853]], "qwen": [[311, " to", "normal", 0.965833842754364]]}, "loss": {"rwkv": 0.2612301811505488, "qwen": 0.2089710581155999}, "topk": {"rwkv": [4811, 1, 0.9572607278823853, [[4811, 0.957261, " to", false], [31162, 0.01716, " into", false], [40062, 0.004825, " under", false], [4596, 0.002499, " in", false], [56003, 0.001631, " directly", false], [30678, 0.001246, " down", false], [63507, 0.001037, " effectively", false], [52628, 0.000781, " quickly", false], [51791, 0.000753, " forward", false], [57435, 0.000639, " together", false]]], "qwen": [311, 1, 0.965833842754364, [[311, 0.965834, " to", false], [1119, 0.023412, " into", false], [304, 0.002711, " in", false], [1212, 0.001242, " under", false], [911, 0.000974, " about", false], [2860, 0.000767, " online", false], [3786, 0.000469, " together", false], [11872, 0.000411, " cheap", false], [389, 0.000329, " on", false], [8630, 0.000317, " onto", false]]]}, "raw_delta": 0.002897861103216808, "tuned_delta": 0.011469653133795056}, {"byte_start": 2792, "byte_end": 2797, "display": {"text": " bear", "kind": "normal"}, "is_word": true, "word_id": 477, "word_key": " bear", "bytes_hex": "20 62 65 61 72", "compression": {"rwkv": "0.04% 0.04% 0.04% 0.04% 0.04%", "qwen": "0.03% 0.03% 0.03% 0.03% 0.03%"}, "model_tokens": {"rwkv": [[30255, " bear", "normal", 0.989607036113739]], "qwen": [[11722, " bear", "normal", 0.9928228855133057]]}, "loss": {"rwkv": 0.037863700413955946, "qwen": 0.025979210499576095}, "topk": {"rwkv": [30255, 1, 0.989607036113739, [[30255, 0.989607, " bear", false], [22590, 0.002974, " the", false], [332, 0.001924, " a", false], [4419, 0.000646, " an", false], [39590, 0.000471, " scale", false], [31702, 0.000347, " play", false], [30235, 0.000283, " bare", false], [32202, 0.000196, " task", false], [22681, 0.000153, " use", false], [39898, 0.000123, " tasks", false]]], "qwen": [11722, 1, 0.9928228855133057, [[11722, 0.992823, " bear", false], [279, 0.003907, " the", false], [264, 0.000731, " a", false], [1486, 0.000568, " play", false], [3383, 0.000198, " task", false], [5452, 0.000198, " scale", false], [458, 0.000177, " an", false], [894, 8.3e-05, " any", false], [21828, 6.7e-05, " solving", false], [3491, 5.7e-05, " problem", false]]]}, "raw_delta": 0.0006590160541236399, "tuned_delta": 0.009230808084701888}, {"byte_start": 2797, "byte_end": 2798, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "44.52%", "qwen": "37.38%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.0853908360004425]], "qwen": [[13, ".", "normal", 0.12581726908683777]]}, "loss": {"rwkv": 44.52066727743285, "qwen": 37.38247575857672}, "topk": {"rwkv": [47, 2, 0.0853908360004425, [[4712, 0.611888, " on", false], [47, 0.085391, ".", false], [45, 0.06785, ",", false], [4596, 0.062799, " in", false], [4811, 0.025209, " to", false], [53356, 0.02008, " without", false], [4424, 0.010781, " at", false], [21265, 0.010185, " and", false], [31601, 0.006874, " over", false], [50870, 0.00669, " against", false]]], "qwen": [13, 3, 0.12581726908683777, [[389, 0.432773, " on", false], [11, 0.149686, ",", false], [13, 0.125817, ".", false], [304, 0.049302, " in", false], [382, 0.038853, ".\n\n", false], [2041, 0.035623, " without", false], [323, 0.029677, " and", false], [311, 0.019642, " to", false], [26, 0.011298, ";", false], [714, 0.00808, " but", false]]]}, "raw_delta": 0.3958253860473633, "tuned_delta": 0.4043971780779415}, {"byte_start": 2798, "byte_end": 2805, "display": {"text": " Search", "kind": "normal"}, "is_word": true, "word_id": 478, "word_key": " search", "bytes_hex": "20 53 65 61 72 63 68", "compression": {"rwkv": "9.78% 9.78% 9.78% 9.78% 9.78% 9.78% 9.78%", "qwen": "10.67% 10.67% 10.67% 10.67% 10.67% 10.67% 10.67%"}, "model_tokens": {"rwkv": [[44844, " Search", "normal", 0.022513993084430695]], "qwen": [[7542, " Search", "normal", 0.015871211886405945]]}, "loss": {"rwkv": 9.781665595313005, "qwen": 10.674007406894734}, "topk": {"rwkv": [44844, 9, 0.022513993084430695, [[261, 0.16093, "\n\n", false], [19555, 0.10747, " But", false], [20996, 0.091038, " The", false], [3918, 0.079995, " It", false], [3913, 0.053094, " In", false], [19417, 0.030495, " And", false], [55122, 0.029356, " Learning", false], [267, 0.025966, "  ", false], [44844, 0.022514, " Search", false], [29894, 0.022505, " This", false]]], "qwen": [7542, 10, 0.015871211886405945, [[1084, 0.136113, " It", false], [576, 0.094023, " The", false], [220, 0.081177, " ", false], [758, 0.062874, " In", false], [1988, 0.036261, " But", false], [20909, 0.03, " Learning", false], [1597, 0.028712, " And", false], [1096, 0.025151, " This", false], [4354, 0.017457, " However", false], [7542, 0.015871, " Search", false]]]}, "raw_delta": -0.04948193686349045, "tuned_delta": -0.0409101448329122}, {"byte_start": 2805, "byte_end": 2809, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 479, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "9.65% 9.65% 9.65% 9.65%", "qwen": "10.57% 10.57% 10.57% 10.57%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.11752758175134659]], "qwen": [[323, " and", "normal", 0.09580511599779129]]}, "loss": {"rwkv": 9.650840849696678, "qwen": 10.57422967576948}, "topk": {"rwkv": [21265, 2, 0.11752758175134659, [[4600, 0.182704, " is", false], [21265, 0.117528, " and", false], [45, 0.065288, ",", false], [22748, 0.055948, " was", false], [4596, 0.050092, " in", false], [46, 0.037843, "-", false], [21800, 0.03667, " has", false], [21413, 0.036002, " can", false], [4450, 0.018851, " by", false], [30659, 0.018669, " does", false]]], "qwen": [323, 2, 0.09580511599779129, [[374, 0.206357, " is", false], [323, 0.095805, " and", false], [5980, 0.071295, "-based", false], [646, 0.046686, " can", false], [11, 0.045902, ",", false], [572, 0.042375, " was", false], [702, 0.0265, " has", false], [304, 0.024422, " in", false], [553, 0.023038, " by", false], [20081, 0.018307, " enables", false]]]}, "raw_delta": -0.05120354890823364, "tuned_delta": -0.04263175687765539}, {"byte_start": 2809, "byte_end": 2818, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 480, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50%", "qwen": "0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.7790603041648865]], "qwen": [[6832, " learning", "normal", 0.8839277029037476]]}, "loss": {"rwkv": 0.5009357780864456, "qwen": 0.2472218956567819}, "topk": {"rwkv": [56537, 1, 0.7790603041648865, [[56537, 0.77906, " learning", false], [31978, 0.19959, " self", false], [30597, 0.00259, " deep", false], [65003, 0.001368, " reinforcement", false], [22590, 0.001093, " the", false], [39193, 0.001069, " other", false], [51832, 0.000805, " general", false], [21902, 0.000578, " its", false], [40093, 0.000557, " value", false], [38720, 0.000556, " human", false]]], "qwen": [6832, 1, 0.8839277029037476, [[6832, 0.883928, " learning", false], [656, 0.037151, " self", false], [3738, 0.005913, " human", false], [279, 0.004736, " the", false], [4586, 0.003994, " general", false], [1008, 0.003665, " other", false], [3960, 0.003263, " learn", false], [71278, 0.003174, " reinforcement", false], [11, 0.002926, ",", false], [5662, 0.002919, " machine", false]]]}, "raw_delta": 0.014068884982003106, "tuned_delta": 0.022640677012581354}, {"byte_start": 2818, "byte_end": 2822, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 481, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"rwkv": "4.44% 4.44% 4.44% 4.44%", "qwen": "4.28% 4.28% 4.28% 4.28%"}, "model_tokens": {"rwkv": [[21286, " are", "normal", 0.37734663486480713]], "qwen": [[525, " are", "normal", 0.3873915672302246]]}, "loss": {"rwkv": 4.437977908984604, "qwen": 4.275423669509565}, "topk": {"rwkv": [21286, 1, 0.37734663486480713, [[21286, 0.377347, " are", false], [21413, 0.066319, " can", false], [4450, 0.063431, " by", false], [31059, 0.055624, " have", false], [30322, 0.043189, " both", false], [32462, 0.035023, " were", false], [45, 0.032518, ",", false], [4596, 0.029261, " in", false], [4491, 0.013718, " do", false], [22074, 0.009527, " may", false]]], "qwen": [525, 1, 0.3873915672302246, [[525, 0.387392, " are", false], [553, 0.133823, " by", false], [646, 0.054331, " can", false], [614, 0.044623, " have", false], [2176, 0.03334, " both", false], [11, 0.030488, ",", false], [1033, 0.025587, " were", false], [304, 0.018692, " in", false], [22766, 0.015927, " complement", false], [653, 0.012731, " do", false]]]}, "raw_delta": 0.009013921022415161, "tuned_delta": 0.01758571305299341}, {"byte_start": 2822, "byte_end": 2826, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 482, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "13.24% 13.24% 13.24% 13.24%", "qwen": "12.84% 12.84% 12.84% 12.84%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.05241644009947777]], "qwen": [[279, " the", "normal", 0.05798915773630142]]}, "loss": {"rwkv": 13.243489633160404, "qwen": 12.837728815196645}, "topk": {"rwkv": [22590, 4, 0.05241644009947777, [[64857, 0.157054, " complementary", false], [30322, 0.117149, " both", false], [22187, 0.083916, " not", false], [22590, 0.052416, " the", false], [22638, 0.049132, " two", false], [32239, 0.021946, " thus", false], [59513, 0.018533, " different", false], [30135, 0.0165, " also", false], [39171, 0.01559, " often", false], [45, 0.015421, ",", false]]], "qwen": [279, 5, 0.05798915773630142, [[2176, 0.143617, " both", false], [537, 0.10829, " not", false], [57435, 0.095817, " complementary", false], [1378, 0.078652, " two", false], [279, 0.057989, " the", false], [1602, 0.029411, " very", false], [2155, 0.021551, " different", false], [42493, 0.017764, " fundamentally", false], [1075, 0.015924, " like", false], [3545, 0.015657, " often", false]]]}, "raw_delta": 0.022500157356262207, "tuned_delta": 0.031071949386840457}, {"byte_start": 2826, "byte_end": 2830, "display": {"text": " two", "kind": "normal"}, "is_word": true, "word_id": 483, "word_key": " two", "bytes_hex": "20 74 77 6f", "compression": {"rwkv": "4.72% 4.72% 4.72% 4.72%", "qwen": "3.14% 3.14% 3.14% 3.14%"}, "model_tokens": {"rwkv": [[22638, " two", "normal", 0.3510001003742218]], "qwen": [[1378, " two", "normal", 0.49840816855430603]]}, "loss": {"rwkv": 4.719754284158229, "qwen": 3.139376414584656}, "topk": {"rwkv": [22638, 1, 0.3510001003742218, [[22638, 0.351, " two", false], [31937, 0.12424, " same", false], [31581, 0.063199, " only", false], [31461, 0.054213, " most", false], [51832, 0.021634, " general", false], [52224, 0.020149, " methods", false], [31356, 0.01754, " main", false], [57481, 0.011627, " ultimate", false], [21952, 0.009799, " key", false], [37812, 0.008782, " basic", false]]], "qwen": [1378, 1, 0.49840816855430603, [[1378, 0.498408, " two", false], [1429, 0.062366, " most", false], [1172, 0.056847, " only", false], [4586, 0.038485, " general", false], [1852, 0.034889, " same", false], [1850, 0.016256, " best", false], [5413, 0.014677, " methods", false], [3363, 0.011128, " means", false], [1887, 0.011071, " main", false], [27397, 0.007124, " twin", false]]]}, "raw_delta": 0.08763475716114044, "tuned_delta": 0.09620654919171868}, {"byte_start": 2830, "byte_end": 2835, "display": {"text": " most", "kind": "normal"}, "is_word": true, "word_id": 484, "word_key": " most", "bytes_hex": "20 6d 6f 73 74", "compression": {"rwkv": "5.78% 5.78% 5.78% 5.78% 5.78%", "qwen": "6.89% 6.89% 6.89% 6.89% 6.89%"}, "model_tokens": {"rwkv": [[31461, " most", "normal", 0.19866539537906647]], "qwen": [[1429, " most", "normal", 0.14800553023815155]]}, "loss": {"rwkv": 5.776415691059325, "qwen": 6.890692575869345}, "topk": {"rwkv": [31461, 1, 0.19866539537906647, [[31461, 0.198665, " most", false], [31356, 0.111706, " main", false], [51832, 0.066345, " general", false], [52224, 0.04932, " methods", false], [39682, 0.02909, " sides", false], [61590, 0.028021, " approaches", false], [21357, 0.027703, " big", false], [37812, 0.025698, " basic", false], [63591, 0.025067, " fundamental", false], [38961, 0.0248, " major", false]]], "qwen": [1429, 1, 0.14800553023815155, [[1429, 0.148006, " most", false], [4586, 0.087399, " general", false], [1887, 0.080456, " main", false], [5413, 0.06258, " methods", false], [3598, 0.042226, " major", false], [11067, 0.038367, " sides", false], [5510, 0.034518, " ways", false], [15811, 0.02932, " fundamental", false], [6028, 0.027451, " primary", false], [19827, 0.023461, " approaches", false]]]}, "raw_delta": -0.06178863048553468, "tuned_delta": -0.05321683845495643}, {"byte_start": 2835, "byte_end": 2845, "display": {"text": " important", "kind": "normal"}, "is_word": true, "word_id": 485, "word_key": " important", "bytes_hex": "20 69 6d 70 6f 72 74 61 6e 74", "compression": {"rwkv": "2.92% 2.92% 2.92% 2.92% 2.92% 2.92% 2.92% 2.92% 2.92% 2.92%", "qwen": "3.02% 3.02% 3.02% 3.02% 3.02% 3.02% 3.02% 3.02% 3.02% 3.02%"}, "model_tokens": {"rwkv": [[59829, " important", "normal", 0.1988791674375534]], "qwen": [[2989, " important", "normal", 0.18727020919322968]]}, "loss": {"rwkv": 2.9163854830470246, "qwen": 3.0210083339813387}, "topk": {"rwkv": [59829, 2, 0.1988791674375534, [[51832, 0.234228, " general", false], [59829, 0.198879, " important", false], [59593, 0.173565, " effective", false], [56900, 0.095803, " powerful", false], [63591, 0.039601, " fundamental", false], [45534, 0.032414, " common", false], [37812, 0.022478, " basic", false], [60274, 0.018906, " promising", false], [59594, 0.01451, " efficient", false], [62603, 0.011655, " successful", false]]], "qwen": [2989, 2, 0.18727020919322968, [[7373, 0.220257, " effective", false], [2989, 0.18727, " important", false], [7988, 0.147371, " powerful", false], [4586, 0.067652, " general", false], [4185, 0.057547, " common", false], [20469, 0.025604, " prominent", false], [15811, 0.019474, " fundamental", false], [6770, 0.019341, " basic", false], [8036, 0.018842, " obvious", false], [6849, 0.017663, " successful", false]]]}, "raw_delta": -0.005801522731781, "tuned_delta": 0.002770269298797248}, {"byte_start": 2845, "byte_end": 2853, "display": {"text": " classes", "kind": "normal"}, "is_word": true, "word_id": 486, "word_key": " classes", "bytes_hex": "20 63 6c 61 73 73 65 73", "compression": {"rwkv": "10.50% 10.50% 10.50% 10.50% 10.50% 10.50% 10.50% 10.50%", "qwen": "11.57% 11.57% 11.57% 11.57% 11.57% 11.57% 11.57% 11.57%"}, "model_tokens": {"rwkv": [[51200, " classes", "normal", 0.009409043937921524]], "qwen": [[6846, " classes", "normal", 0.005898187402635813]]}, "loss": {"rwkv": 10.496169975217555, "qwen": 11.571113137905368}, "topk": {"rwkv": [51200, 19, 0.009409043937921524, [[51832, 0.171532, " general", false], [52224, 0.157667, " methods", false], [32448, 0.04766, " ways", false], [61590, 0.033871, " approaches", false], [62633, 0.032932, " techniques", false], [21265, 0.027545, " and", false], [39979, 0.024062, " tools", false], [45, 0.021598, ",", false], [38888, 0.019368, " lever", false], [64862, 0.017444, " computational", false]]], "qwen": [6846, 20, 0.005898187402635813, [[4586, 0.143531, " general", false], [5413, 0.132431, " methods", false], [5510, 0.094557, " ways", false], [7375, 0.058382, " tools", false], [19827, 0.049997, " approaches", false], [12538, 0.038348, " techniques", false], [3363, 0.028763, " means", false], [6813, 0.025909, " components", false], [54480, 0.024748, " computational", false], [13966, 0.021211, " ingredients", false]]]}, "raw_delta": -0.059607505798339844, "tuned_delta": -0.051035713767761594}, {"byte_start": 2853, "byte_end": 2856, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 487, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.06% 0.06% 0.06%", "qwen": "0.03% 0.03% 0.03%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9908678531646729]], "qwen": [[315, " of", "normal", 0.9943274855613708]]}, "loss": {"rwkv": 0.055034448276098755, "qwen": 0.034195892144145486}, "topk": {"rwkv": [4706, 1, 0.9908678531646729, [[4706, 0.990868, " of", false], [4596, 0.003537, " in", false], [45, 0.00085, ",", false], [21700, 0.000842, " for", false], [32227, 0.00058, " that", false], [275, 0.000406, " (", false], [47, 0.00033, ".", false], [4715, 0.000312, " or", false], [4811, 0.000249, " to", false], [21265, 0.000169, " and", false]]], "qwen": [315, 1, 0.9943274855613708, [[315, 0.994327, " of", false], [304, 0.001101, " in", false], [429, 0.000963, " that", false], [369, 0.000572, " for", false], [320, 0.000504, " (", false], [11, 0.000416, ",", false], [476, 0.000242, " or", false], [311, 0.000238, " to", false], [323, 0.000137, " and", false], [4221, 8.4e-05, " among", false]]]}, "raw_delta": 0.0011555349143842857, "tuned_delta": 0.009727326944962533}, {"byte_start": 2856, "byte_end": 2867, "display": {"text": " techniques", "kind": "normal"}, "is_word": true, "word_id": 488, "word_key": " techniques", "bytes_hex": "20 74 65 63 68 6e 69 71 75 65 73", "compression": {"rwkv": "5.43% 5.43% 5.43% 5.43% 5.43% 5.43% 5.43% 5.43% 5.43% 5.43% 5.43%", "qwen": "5.74% 5.74% 5.74% 5.74% 5.74% 5.74% 5.74% 5.74% 5.74% 5.74% 5.74%"}, "model_tokens": {"rwkv": [[62633, " techniques", "normal", 0.036410946398973465]], "qwen": [[12538, " techniques", "normal", 0.030211452394723892]]}, "loss": {"rwkv": 5.430599230618968, "qwen": 5.737227880581591}, "topk": {"rwkv": [62633, 5, 0.036410946398973465, [[52224, 0.401138, " methods", false], [51832, 0.213233, " general", false], [61559, 0.05683, " algorithms", false], [3609, 0.051195, " AI", false], [62633, 0.036411, " techniques", false], [61590, 0.033764, " approaches", false], [63370, 0.022006, " computation", false], [59113, 0.015465, " algorithm", false], [46561, 0.01065, " method", false], [64862, 0.010585, " computational", false]]], "qwen": [12538, 7, 0.030211452394723892, [[5413, 0.40924, " methods", false], [4586, 0.115374, " general", false], [1714, 0.07087, " method", false], [34447, 0.068192, " computation", false], [54480, 0.041362, " computational", false], [25185, 0.032391, " algorithms", false], [12538, 0.030211, " techniques", false], [19827, 0.02384, " approaches", false], [12111, 0.023117, " algorithm", false], [15235, 0.02189, " AI", false]]]}, "raw_delta": -0.01700310273603961, "tuned_delta": -0.008431310705461362}, {"byte_start": 2867, "byte_end": 2871, "display": {"text": " for", "kind": "normal"}, "is_word": true, "word_id": 489, "word_key": " for", "bytes_hex": "20 66 6f 72", "compression": {"rwkv": "5.25% 5.25% 5.25% 5.25%", "qwen": "5.20% 5.20% 5.20% 5.20%"}, "model_tokens": {"rwkv": [[21700, " for", "normal", 0.31299299001693726]], "qwen": [[369, " for", "normal", 0.31576159596443176]]}, "loss": {"rwkv": 5.248084987608777, "qwen": 5.19716361191722}, "topk": {"rwkv": [21700, 1, 0.31299299001693726, [[21700, 0.312993, " for", false], [32227, 0.235007, " that", false], [4596, 0.190611, " in", false], [45, 0.059024, ",", false], [47, 0.030487, ".", false], [4811, 0.029508, " to", false], [32354, 0.019552, " used", false], [59206, 0.012683, " available", false], [4450, 0.007349, " by", false], [21265, 0.005422, " and", false]]], "qwen": [369, 1, 0.31576159596443176, [[369, 0.315762, " for", false], [429, 0.26786, " that", false], [304, 0.126991, " in", false], [311, 0.066363, " to", false], [11, 0.043717, ",", false], [1483, 0.023521, " used", false], [2500, 0.016698, " available", false], [13, 0.015239, ".", false], [582, 0.005726, " we", false], [553, 0.00528, " by", false]]]}, "raw_delta": 0.0028236806392669678, "tuned_delta": 0.011395472669845216}, {"byte_start": 2871, "byte_end": 2881, "display": {"text": " utilizing", "kind": "normal"}, "is_word": true, "word_id": 490, "word_key": " utilizing", "bytes_hex": "20 75 74 69 6c 69 7a 69 6e 67", "compression": {"rwkv": "12.74% 12.74% 12.74% 12.74% 12.74% 12.74% 12.74% 12.74% 12.74% 12.74%", "qwen": "9.54% 9.54% 9.54% 9.54% 9.54% 9.54% 9.54% 9.54% 9.54% 9.54%"}, "model_tokens": {"rwkv": [[60720, " utilizing", "normal", 0.0008674556156620383]], "qwen": [[34888, " utilizing", "normal", 0.0050475276075303555]]}, "loss": {"rwkv": 12.736292157847878, "qwen": 9.537758817101363}, "topk": {"rwkv": [60720, 129, 0.0008674556156620383, [[51832, 0.092093, " general", false], [3609, 0.085782, " AI", false], [38888, 0.048469, " lever", false], [59832, 0.041083, " improving", false], [52949, 0.039655, " solving", false], [46500, 0.032191, " making", false], [55531, 0.020808, " applying", false], [47497, 0.019485, " taking", false], [22590, 0.019327, " the", false], [51392, 0.01912, " dealing", false]]], "qwen": [34888, 35, 0.0050475276075303555, [[76482, 0.162236, " leveraging", false], [21828, 0.083615, " solving", false], [4586, 0.049685, " general", false], [15235, 0.040716, " AI", false], [18392, 0.030699, " improving", false], [27362, 0.030692, " enabling", false], [4633, 0.023317, " taking", false], [70601, 0.022516, " exploiting", false], [1667, 0.017289, " using", false], [279, 0.016945, " the", false]]]}, "raw_delta": 0.17736434936523438, "tuned_delta": 0.18593614139581263}, {"byte_start": 2881, "byte_end": 2889, "display": {"text": " massive", "kind": "normal"}, "is_word": true, "word_id": 491, "word_key": " massive", "bytes_hex": "20 6d 61 73 73 69 76 65", "compression": {"rwkv": "4.42% 4.42% 4.42% 4.42% 4.42% 4.42% 4.42% 4.42%", "qwen": "4.69% 4.69% 4.69% 4.69% 4.69% 4.69% 4.69% 4.69%"}, "model_tokens": {"rwkv": [[52195, " massive", "normal", 0.14183133840560913]], "qwen": [[10951, " massive", "normal", 0.12494955211877823]]}, "loss": {"rwkv": 4.420366885536252, "qwen": 4.688409908592699}, "topk": {"rwkv": [52195, 2, 0.14183133840560913, [[63370, 0.505701, " computation", false], [52195, 0.141831, " massive", false], [51832, 0.088197, " general", false], [22590, 0.046436, " the", false], [59988, 0.040588, " massively", false], [38864, 0.022429, " large", false], [64862, 0.018896, " computational", false], [59346, 0.00621, " computing", false], [332, 0.005905, " a", false], [38720, 0.005461, " human", false]]], "qwen": [10951, 2, 0.12494955211877823, [[34447, 0.473113, " computation", false], [10951, 0.12495, " massive", false], [279, 0.085623, " the", false], [63707, 0.04671, " massively", false], [54480, 0.033167, " computational", false], [4586, 0.028939, " general", false], [3460, 0.018179, " large", false], [6366, 0.014301, " computer", false], [419, 0.012215, " this", false], [74151, 0.007824, " exponentially", false]]]}, "raw_delta": -0.014863461256027222, "tuned_delta": -0.0062916692254489735}, {"byte_start": 2889, "byte_end": 2897, "display": {"text": " amounts", "kind": "normal"}, "is_word": true, "word_id": 492, "word_key": " amounts", "bytes_hex": "20 61 6d 6f 75 6e 74 73", "compression": {"rwkv": "9.65% 9.65% 9.65% 9.65% 9.65% 9.65% 9.65% 9.65%", "qwen": "8.24% 8.24% 8.24% 8.24% 8.24% 8.24% 8.24% 8.24%"}, "model_tokens": {"rwkv": [[50897, " amounts", "normal", 0.013889632187783718]], "qwen": [[14713, " amounts", "normal", 0.02579469420015812]]}, "loss": {"rwkv": 9.650840849696678, "qwen": 8.244971894893352}, "topk": {"rwkv": [50897, 4, 0.013889632187783718, [[63370, 0.872918, " computation", false], [64862, 0.028989, " computational", false], [45, 0.01809, ",", false], [50897, 0.01389, " amounts", false], [59346, 0.007893, " computing", false], [56812, 0.007679, " parallel", false], [64298, 0.006149, " computations", false], [51832, 0.004509, " general", false], [51266, 0.004495, " compute", false], [59206, 0.002221, " available", false]]], "qwen": [14713, 3, 0.02579469420015812, [[34447, 0.834982, " computation", false], [54480, 0.052718, " computational", false], [14713, 0.025795, " amounts", false], [24231, 0.018217, " computing", false], [6366, 0.008259, " computer", false], [11, 0.006246, ",", false], [82599, 0.005775, " computations", false], [821, 0.002735, " data", false], [12564, 0.002578, " compute", false], [2500, 0.002349, " available", false]]]}, "raw_delta": 0.07795792818069458, "tuned_delta": 0.08652972021127282}, {"byte_start": 2897, "byte_end": 2900, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 493, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.01% 0.01% 0.01%", "qwen": "0.01% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9988504648208618]], "qwen": [[315, " of", "normal", 0.9980055689811707]]}, "loss": {"rwkv": 0.006925168074742427, "qwen": 0.012001000602508067}, "topk": {"rwkv": [4706, 1, 0.9988504648208618, [[4706, 0.99885, " of", false], [63370, 0.000213, " computation", false], [21265, 0.00016, " and", false], [275, 0.000135, " (", false], [4715, 9.2e-05, " or", false], [45, 5.4e-05, ",", false], [11, 4.6e-05, "\n", false], [4588, 3.2e-05, " if", false], [261, 2.8e-05, "\n\n", false], [267, 2.8e-05, "  ", false]]], "qwen": [315, 1, 0.9980055689811707, [[315, 0.998006, " of", false], [34447, 0.000474, " computation", false], [323, 0.000282, " and", false], [320, 0.000122, " (", false], [11, 9.3e-05, ",", false], [476, 8.8e-05, " or", false], [13, 7.9e-05, ".", false], [2500, 6.7e-05, " available", false], [198, 6e-05, "\n", false], [54480, 4.8e-05, " computational", false]]]}, "raw_delta": -0.00028146392044921714, "tuned_delta": 0.00829032811012903}, {"byte_start": 2900, "byte_end": 2912, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 494, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17%", "qwen": "0.22% 0.22% 0.22% 0.22% 0.22% 0.22% 0.22% 0.22% 0.22% 0.22% 0.22% 0.22%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.8953267335891724]], "qwen": [[34447, " computation", "normal", 0.8663378953933716]]}, "loss": {"rwkv": 0.16730472275934022, "qwen": 0.21562315894494896}, "topk": {"rwkv": [63370, 1, 0.8953267335891724, [[63370, 0.895327, " computation", false], [64862, 0.028066, " computational", false], [59346, 0.015039, " computing", false], [51266, 0.011506, " compute", false], [59206, 0.004368, " available", false], [55809, 0.004326, " computer", false], [51832, 0.003667, " general", false], [56812, 0.003351, " parallel", false], [56353, 0.00212, " hardware", false], [52167, 0.001729, " machine", false]]], "qwen": [34447, 1, 0.8663378953933716, [[34447, 0.866338, " computation", false], [54480, 0.034819, " computational", false], [821, 0.017538, " data", false], [6366, 0.013891, " computer", false], [24231, 0.0123, " computing", false], [2500, 0.011808, " available", false], [1995, 0.005185, " information", false], [12564, 0.003155, " compute", false], [3738, 0.001975, " human", false], [4586, 0.001658, " general", false]]]}, "raw_delta": -0.002679343024889627, "tuned_delta": 0.005892449005688621}, {"byte_start": 2912, "byte_end": 2915, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 495, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "14.46% 14.46% 14.46%", "qwen": "14.28% 14.28% 14.28%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.08931517601013184]], "qwen": [[304, " in", "normal", 0.09289742261171341]]}, "loss": {"rwkv": 14.464520592246117, "qwen": 14.284239778479177}, "topk": {"rwkv": [4596, 4, 0.08931517601013184, [[47, 0.455824, ".", false], [45, 0.17863, ",", false], [4811, 0.108767, " to", false], [4596, 0.089315, " in", false], [21700, 0.025316, " for", false], [21265, 0.016218, " and", false], [60, 0.015935, ";", false], [32227, 0.015852, " that", false], [63507, 0.012333, " effectively", false], [4712, 0.008639, " on", false]]], "qwen": [304, 4, 0.09289742261171341, [[13, 0.313173, ".", false], [11, 0.211635, ",", false], [382, 0.14766, ".\n\n", false], [304, 0.092897, " in", false], [311, 0.06056, " to", false], [323, 0.020972, " and", false], [26, 0.019117, ";", false], [369, 0.017094, " for", false], [624, 0.012426, ".\n", false], [429, 0.01229, " that", false]]]}, "raw_delta": 0.009996891021728516, "tuned_delta": 0.018568683052306766}, {"byte_start": 2915, "byte_end": 2918, "display": {"text": " AI", "kind": "normal"}, "is_word": true, "word_id": 496, "word_key": " ai", "bytes_hex": "20 41 49", "compression": {"rwkv": "4.70% 4.70% 4.70%", "qwen": "9.37% 9.37% 9.37%"}, "model_tokens": {"rwkv": [[3609, " AI", "normal", 0.4577257037162781]], "qwen": [[15235, " AI", "normal", 0.210323303937912]]}, "loss": {"rwkv": 4.696272919560427, "qwen": 9.372163745210477}, "topk": {"rwkv": [3609, 1, 0.4577257037162781, [[3609, 0.457726, " AI", false], [332, 0.093265, " a", false], [22590, 0.063462, " the", false], [51832, 0.051233, " general", false], [4419, 0.029316, " an", false], [52949, 0.020207, " solving", false], [61594, 0.016048, " artificial", false], [32448, 0.015452, " ways", false], [52167, 0.014971, " machine", false], [46588, 0.013959, " modern", false]]], "qwen": [15235, 1, 0.210323303937912, [[15235, 0.210323, " AI", false], [264, 0.094458, " a", false], [279, 0.078566, " the", false], [4586, 0.072917, " general", false], [458, 0.063759, " an", false], [5662, 0.041125, " machine", false], [1973, 0.030933, " order", false], [20443, 0.024568, " artificial", false], [71278, 0.022122, " reinforcement", false], [2711, 0.017161, " search", false]]]}, "raw_delta": -0.25928644339243573, "tuned_delta": -0.2507146513618575}, {"byte_start": 2918, "byte_end": 2927, "display": {"text": " research", "kind": "normal"}, "is_word": true, "word_id": 497, "word_key": " research", "bytes_hex": "20 72 65 73 65 61 72 63 68", "compression": {"rwkv": "2.88% 2.88% 2.88% 2.88% 2.88% 2.88% 2.88% 2.88% 2.88%", "qwen": "4.03% 4.03% 4.03% 4.03% 4.03% 4.03% 4.03% 4.03% 4.03%"}, "model_tokens": {"rwkv": [[57103, " research", "normal", 0.23793143033981323]], "qwen": [[3412, " research", "normal", 0.1335524618625641]]}, "loss": {"rwkv": 2.880380723997062, "qwen": 4.034057544249869}, "topk": {"rwkv": [57103, 2, 0.23793143033981323, [[47, 0.473299, ".", false], [57103, 0.237931, " research", false], [45, 0.134669, ",", false], [53087, 0.028497, " systems", false], [52224, 0.019277, " methods", false], [56949, 0.013444, " programs", false], [21265, 0.011196, " and", false], [60, 0.010851, ";", false], [275, 0.007695, " (", false], [45124, 0.005847, " agents", false]]], "qwen": [3412, 4, 0.1335524618625641, [[13, 0.313332, ".", false], [382, 0.201284, ".\n\n", false], [11, 0.157925, ",", false], [3412, 0.133552, " research", false], [5942, 0.023116, " systems", false], [26, 0.020041, ";", false], [5322, 0.018045, " problems", false], [323, 0.016884, " and", false], [624, 0.013142, ".\n", false], [8357, 0.010693, " applications", false]]]}, "raw_delta": -0.06397342681884766, "tuned_delta": -0.055401634788269406}, {"byte_start": 2927, "byte_end": 2928, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "5.53%", "qwen": "15.99%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.7364534735679626]], "qwen": [[13, ".", "normal", 0.41206297278404236]]}, "loss": {"rwkv": 5.529861362782403, "qwen": 15.988290820159683}, "topk": {"rwkv": [47, 1, 0.7364534735679626, [[47, 0.736453, ".", false], [45, 0.175021, ",", false], [21265, 0.017487, " and", false], [60, 0.014362, ";", false], [275, 0.012494, " (", false], [39971, 0.006398, " today", false], [51018, 0.003501, " because", false], [56949, 0.003443, " programs", false], [59, 0.00287, ":", false], [4596, 0.002828, " in", false]]], "qwen": [13, 1, 0.41206297278404236, [[13, 0.412063, ".", false], [382, 0.242195, ".\n\n", false], [11, 0.20158, ",", false], [323, 0.02533, " and", false], [3351, 0.02175, " today", false], [26, 0.021355, ";", false], [624, 0.019663, ".\n", false], [320, 0.01351, " (", false], [4192, 0.003885, ".\n\n\n", false], [25, 0.003144, ":", false]]]}, "raw_delta": -0.5799384713172913, "tuned_delta": -0.571366679286713}, {"byte_start": 2928, "byte_end": 2931, "display": {"text": " In", "kind": "normal"}, "is_word": true, "word_id": 498, "word_key": " in", "bytes_hex": "20 49 6e", "compression": {"rwkv": "20.57% 20.57% 20.57%", "qwen": "18.27% 18.27% 18.27%"}, "model_tokens": {"rwkv": [[3913, " In", "normal", 0.03227507695555687]], "qwen": [[758, " In", "normal", 0.047852978110313416]]}, "loss": {"rwkv": 20.56967538767467, "qwen": 18.27186391791443}, "topk": {"rwkv": [3913, 5, 0.03227507695555687, [[261, 0.423476, "\n\n", false], [20996, 0.063265, " The", false], [29893, 0.040221, " They", false], [267, 0.033824, "  ", false], [3913, 0.032275, " In", false], [44844, 0.022807, " Search", false], [3918, 0.021278, " It", false], [19555, 0.018017, " But", false], [28530, 0.016632, " Both", false], [19417, 0.016513, " And", false]]], "qwen": [758, 3, 0.047852978110313416, [[220, 0.127926, " ", false], [576, 0.096576, " The", false], [758, 0.047853, " In", false], [2379, 0.047493, " They", false], [7542, 0.038321, " Search", false], [1084, 0.034894, " It", false], [320, 0.028448, " (", false], [2619, 0.024459, " There", false], [4220, 0.018994, " These", false], [11733, 0.018804, " Both", false]]]}, "raw_delta": 0.12741772333780932, "tuned_delta": 0.13598951536838758}, {"byte_start": 2931, "byte_end": 2940, "display": {"text": " computer", "kind": "normal"}, "is_word": true, "word_id": 499, "word_key": " computer", "bytes_hex": "20 63 6f 6d 70 75 74 65 72", "compression": {"rwkv": "6.07% 6.07% 6.07% 6.07% 6.07% 6.07% 6.07% 6.07% 6.07%", "qwen": "5.53% 5.53% 5.53% 5.53% 5.53% 5.53% 5.53% 5.53% 5.53%"}, "model_tokens": {"rwkv": [[55809, " computer", "normal", 0.04809846356511116]], "qwen": [[6366, " computer", "normal", 0.06315793842077255]]}, "loss": {"rwkv": 6.073846309298153, "qwen": 5.534572731956873}, "topk": {"rwkv": [55809, 5, 0.04809846356511116, [[22590, 0.158746, " the", false], [38013, 0.094629, " chess", false], [30322, 0.078071, " both", false], [30808, 0.062159, " fact", false], [55809, 0.048098, " computer", false], [56901, 0.046506, " practice", false], [31370, 0.039199, " many", false], [32234, 0.031957, " this", false], [51832, 0.028731, " general", false], [332, 0.022042, " a", false]]], "qwen": [6366, 4, 0.06315793842077255, [[279, 0.183702, " the", false], [5994, 0.095047, " Go", false], [2097, 0.085396, " fact", false], [6366, 0.063158, " computer", false], [32719, 0.061677, " chess", false], [1657, 0.046327, " many", false], [2176, 0.041075, " both", false], [419, 0.034534, " this", false], [1045, 0.029164, " some", false], [264, 0.025614, " a", false]]]}, "raw_delta": 0.02990367677476674, "tuned_delta": 0.03847546880534499}, {"byte_start": 2940, "byte_end": 2943, "display": {"text": " Go", "kind": "normal"}, "is_word": true, "word_id": 500, "word_key": " go", "bytes_hex": "20 47 6f", "compression": {"rwkv": "3.97% 3.97% 3.97%", "qwen": "0.47% 0.47% 0.47%"}, "model_tokens": {"rwkv": [[3851, " Go", "normal", 0.5136668682098389]], "qwen": [[5994, " Go", "normal", 0.924994945526123]]}, "loss": {"rwkv": 3.968350617028561, "qwen": 0.468677580468661}, "topk": {"rwkv": [3851, 1, 0.5136668682098389, [[3851, 0.513667, " Go", false], [38013, 0.325252, " chess", false], [38576, 0.04543, " games", false], [52814, 0.02737, " science", false], [46, 0.026703, "-", false], [36466, 0.012349, " Chess", false], [47732, 0.005854, " vision", false], [47202, 0.004233, " search", false], [39311, 0.003728, " poker", false], [52491, 0.002707, " playing", false]]], "qwen": [5994, 1, 0.924994945526123, [[5994, 0.924995, " Go", false], [32719, 0.050755, " chess", false], [3868, 0.005219, " games", false], [11129, 0.002533, " vision", false], [728, 0.001525, " go", false], [19926, 0.001371, "-go", false], [20814, 0.001265, " poker", false], [1809, 0.000784, " game", false], [8038, 0.000777, " science", false], [47387, 0.00046, " Chess", false]]]}, "raw_delta": 0.1940630798538526, "tuned_delta": 0.20263487188443086}, {"byte_start": 2943, "byte_end": 2944, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "3.65%", "qwen": "2.89%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8168437480926514]], "qwen": [[11, ",", "normal", 0.851840615272522]]}, "loss": {"rwkv": 3.6454818538087816, "qwen": 2.891806851221859}, "topk": {"rwkv": [45, 1, 0.8168437480926514, [[45, 0.816844, ",", false], [21265, 0.051853, " and", false], [22590, 0.029782, " the", false], [4423, 0.013966, " as", false], [39934, 0.011708, " there", false], [4601, 0.011033, " it", false], [32232, 0.007683, " they", false], [275, 0.005776, " (", false], [4596, 0.004322, " in", false], [4424, 0.003153, " at", false]]], "qwen": [11, 1, 0.851840615272522, [[11, 0.851841, ",", false], [323, 0.023537, " and", false], [279, 0.017421, " the", false], [304, 0.013813, " in", false], [320, 0.009807, " (", false], [1052, 0.006973, " there", false], [432, 0.005671, " it", false], [419, 0.004637, " this", false], [1493, 0.004015, " these", false], [807, 0.003892, " they", false]]]}, "raw_delta": 0.0417926162481308, "tuned_delta": 0.05036440827870905}, {"byte_start": 2944, "byte_end": 2947, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 501, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"rwkv": "15.50% 15.50% 15.50%", "qwen": "17.78% 17.78% 17.78%"}, "model_tokens": {"rwkv": [[4423, " as", "normal", 0.07514823973178864]], "qwen": [[438, " as", "normal", 0.05194857344031334]]}, "loss": {"rwkv": 15.49770063454941, "qwen": 17.778216382387882}, "topk": {"rwkv": [4423, 4, 0.07514823973178864, [[22590, 0.228135, " the", false], [47202, 0.087917, " search", false], [56537, 0.087015, " learning", false], [4423, 0.075148, " as", false], [4601, 0.05964, " it", false], [39936, 0.038903, " these", false], [32232, 0.031231, " they", false], [30322, 0.023966, " both", false], [51948, 0.023287, " however", false], [21265, 0.022746, " and", false]]], "qwen": [438, 5, 0.05194857344031334, [[279, 0.195139, " the", false], [2711, 0.096289, " search", false], [6832, 0.074085, " learning", false], [1493, 0.066387, " these", false], [438, 0.051949, " as", false], [264, 0.029, " a", false], [432, 0.028833, " it", false], [2176, 0.024597, " both", false], [807, 0.023639, " they", false], [3738, 0.018343, " human", false]]]}, "raw_delta": -0.12645864486694336, "tuned_delta": -0.11788685283636512}, {"byte_start": 2947, "byte_end": 2950, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 502, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "0.83% 0.83% 0.83%", "qwen": "1.53% 1.53% 1.53%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.871487557888031]], "qwen": [[304, " in", "normal", 0.7752819657325745]]}, "loss": {"rwkv": 0.8335884432219759, "qwen": 1.530029321513405}, "topk": {"rwkv": [4596, 1, 0.871487557888031, [[4596, 0.871488, " in", false], [32487, 0.03339, " with", false], [32458, 0.024945, " well", false], [4601, 0.012148, " it", false], [59608, 0.00553, " elsewhere", false], [22748, 0.003998, " was", false], [332, 0.003713, " a", false], [22590, 0.003417, " the", false], [4600, 0.002758, " is", false], [4858, 0.002301, " we", false]]], "qwen": [304, 1, 0.7752819657325745, [[304, 0.775282, " in", false], [1632, 0.065017, " well", false], [448, 0.045322, " with", false], [17920, 0.014089, " elsewhere", false], [432, 0.009485, " it", false], [264, 0.008159, " a", false], [374, 0.007507, " is", false], [369, 0.007215, " for", false], [279, 0.006596, " the", false], [807, 0.004535, " they", false]]]}, "raw_delta": -0.038618882497151695, "tuned_delta": -0.030047090466573445}, {"byte_start": 2950, "byte_end": 2959, "display": {"text": " computer", "kind": "normal"}, "is_word": true, "word_id": 503, "word_key": " computer", "bytes_hex": "20 63 6f 6d 70 75 74 65 72", "compression": {"rwkv": "2.57% 2.57% 2.57% 2.57% 2.57% 2.57% 2.57% 2.57% 2.57%", "qwen": "2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47%"}, "model_tokens": {"rwkv": [[55809, " computer", "normal", 0.27854442596435547]], "qwen": [[6366, " computer", "normal", 0.29155558347702026]]}, "loss": {"rwkv": 2.567295862693034, "qwen": 2.4696627449869744}, "topk": {"rwkv": [55809, 2, 0.27854442596435547, [[38013, 0.450208, " chess", false], [55809, 0.278544, " computer", false], [31370, 0.081316, " many", false], [39193, 0.037325, " other", false], [22590, 0.032114, " the", false], [31461, 0.01344, " most", false], [21256, 0.010313, " all", false], [3609, 0.010308, " AI", false], [3851, 0.004859, " Go", false], [4788, 0.004682, " so", false]]], "qwen": [6366, 2, 0.29155558347702026, [[32719, 0.383288, " chess", false], [6366, 0.291556, " computer", false], [1657, 0.098925, " many", false], [1008, 0.058122, " other", false], [678, 0.038657, " all", false], [279, 0.024456, " the", false], [1429, 0.023449, " most", false], [773, 0.022911, " so", false], [1753, 0.004562, " much", false], [5994, 0.004359, " Go", false]]]}, "raw_delta": 0.0054139296213785715, "tuned_delta": 0.01398572165195682}, {"byte_start": 2959, "byte_end": 2965, "display": {"text": " chess", "kind": "normal"}, "is_word": true, "word_id": 504, "word_key": " chess", "bytes_hex": "20 63 68 65 73 73", "compression": {"rwkv": "0.07% 0.07% 0.07% 0.07% 0.07% 0.07%", "qwen": "0.04% 0.04% 0.04% 0.04% 0.04% 0.04%"}, "model_tokens": {"rwkv": [[38013, " chess", "normal", 0.9758548140525818]], "qwen": [[32719, " chess", "normal", 0.9878679513931274]]}, "loss": {"rwkv": 0.073012368046291, "qwen": 0.03668731444912257}, "topk": {"rwkv": [38013, 1, 0.9758548140525818, [[38013, 0.975855, " chess", false], [36466, 0.018626, " Chess", false], [3851, 0.000883, " Go", false], [47202, 0.000854, " search", false], [46, 0.00065, "-", false], [39311, 0.000558, " poker", false], [38576, 0.000248, " games", false], [51180, 0.000204, " checker", false], [20660, 0.000123, " Pok", false], [52814, 8.4e-05, " science", false]]], "qwen": [32719, 1, 0.9878679513931274, [[32719, 0.987868, " chess", false], [47387, 0.003848, " Chess", false], [20814, 0.001194, " poker", false], [5994, 0.001027, " Go", false], [1779, 0.00058, " check", false], [1182, 0.000245, " back", false], [14164, 0.000241, " bridge", false], [3868, 0.000149, " games", false], [11129, 0.00014, " vision", false], [61447, 0.000136, " tic", false]]]}, "raw_delta": 0.0020142886787652965, "tuned_delta": 0.010586080709343545}, {"byte_start": 2965, "byte_end": 2966, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "0.81%", "qwen": "1.98%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.9563775062561035]], "qwen": [[11, ",", "normal", 0.8959089517593384]]}, "loss": {"rwkv": 0.8057043227620858, "qwen": 1.9821993443024535}, "topk": {"rwkv": [45, 1, 0.9563775062561035, [[45, 0.956378, ",", false], [21265, 0.0132, " and", false], [45285, 0.007554, " before", false], [275, 0.00596, " (", false], [4596, 0.003062, " in", false], [22590, 0.0012, " the", false], [332, 0.001195, " a", false], [4601, 0.00068, " it", false], [51551, 0.000651, " earlier", false], [4424, 0.000578, " at", false]]], "qwen": [11, 1, 0.8959089517593384, [[11, 0.895909, ",", false], [323, 0.048074, " and", false], [1573, 0.013162, " before", false], [304, 0.009898, " in", false], [320, 0.009069, " (", false], [518, 0.001852, " at", false], [369, 0.00163, " for", false], [220, 0.001625, " ", false], [264, 0.001368, " a", false], [4867, 0.00135, " prior", false]]]}, "raw_delta": -0.06523873656988144, "tuned_delta": -0.05666694453930319}, {"byte_start": 2966, "byte_end": 2978, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 505, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"rwkv": "6.57% 6.57% 6.57% 6.57% 6.57% 6.57% 6.57% 6.57% 6.57% 6.57% 6.57% 6.57%", "qwen": "7.09% 7.09% 7.09% 7.09% 7.09% 7.09% 7.09% 7.09% 7.09% 7.09% 7.09% 7.09%"}, "model_tokens": {"rwkv": [[63843, " researchers", "normal", 0.012594263069331646]], "qwen": [[11811, " researchers", "normal", 0.008952687494456768]]}, "loss": {"rwkv": 6.574782087384598, "qwen": 7.086940688899014}, "topk": {"rwkv": [63843, 10, 0.012594263069331646, [[22590, 0.348165, " the", false], [47202, 0.093982, " search", false], [56537, 0.06539, " learning", false], [4601, 0.061346, " it", false], [39936, 0.052645, " these", false], [38720, 0.036401, " human", false], [39934, 0.031691, " there", false], [32232, 0.018513, " they", false], [332, 0.015389, " a", false], [63843, 0.012594, " researchers", false]]], "qwen": [11811, 15, 0.008952687494456768, [[279, 0.266813, " the", false], [2711, 0.094763, " search", false], [6832, 0.081794, " learning", false], [1493, 0.067788, " these", false], [432, 0.04355, " it", false], [3738, 0.03791, " human", false], [1052, 0.033235, " there", false], [264, 0.026297, " a", false], [64098, 0.019366, " brute", false], [807, 0.017445, " they", false]]]}, "raw_delta": -0.02840010325113934, "tuned_delta": -0.01982831122056109}, {"byte_start": 2978, "byte_end": 2979, "display": {"text": "'", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "27", "compression": {"rwkv": "63.96%", "qwen": "79.26%"}, "model_tokens": {"rwkv": [[40, "'", "normal", 0.029054807499051094]], "qwen": [[6, "'", "normal", 0.012339101172983646]]}, "loss": {"rwkv": 63.96323716441302, "qwen": 79.25774029696802}, "topk": {"rwkv": [40, 4, 0.029054807499051094, [[22762, 0.261008, " who", false], [32462, 0.079869, " were", false], [21795, 0.046791, " had", false], [40, 0.029055, "'", false], [21532, 0.024395, " did", false], [32487, 0.023957, " with", false], [59868, 0.021031, " initially", false], [31059, 0.018028, " have", false], [52112, 0.01637, " learned", false], [32227, 0.014176, " that", false]]], "qwen": [6, 12, 0.012339101172983646, [[879, 0.154815, " who", false], [1033, 0.119077, " were", false], [1030, 0.043249, " had", false], [614, 0.031094, " have", false], [9498, 0.030262, " learned", false], [304, 0.020639, " in", false], [15102, 0.018902, " initially", false], [525, 0.017185, " are", false], [1521, 0.016844, " did", false], [9583, 0.01548, " eventually", false]]]}, "raw_delta": -0.8481073379516602, "tuned_delta": -0.8395355459210819}, {"byte_start": 2979, "byte_end": 2987, "display": {"text": " initial", "kind": "normal"}, "is_word": true, "word_id": 506, "word_key": " initial", "bytes_hex": "20 69 6e 69 74 69 61 6c", "compression": {"rwkv": "5.35% 5.35% 5.35% 5.35% 5.35% 5.35% 5.35% 5.35%", "qwen": "4.61% 4.61% 4.61% 4.61% 4.61% 4.61% 4.61% 4.61%"}, "model_tokens": {"rwkv": [[52013, " initial", "normal", 0.09287940710783005]], "qwen": [[2856, " initial", "normal", 0.12912534177303314]]}, "loss": {"rwkv": 5.353751128298887, "qwen": 4.614306346456402}, "topk": {"rwkv": [52013, 1, 0.09287940710783005, [[52013, 0.092879, " initial", false], [62157, 0.073147, " investment", false], [38720, 0.063106, " human", false], [51566, 0.044173, " efforts", false], [61701, 0.028034, " commitment", false], [63678, 0.024073, " investments", false], [45294, 0.022275, " belief", false], [51024, 0.020855, " beliefs", false], [64997, 0.018628, " psychological", false], [65034, 0.017758, " understanding", false]]], "qwen": [2856, 1, 0.12912534177303314, [[2856, 0.129125, " initial", false], [7901, 0.106858, " failure", false], [3738, 0.028307, " human", false], [8660, 0.017108, " understanding", false], [40598, 0.014864, " disappointment", false], [82950, 0.014519, " reluctance", false], [6853, 0.014486, " lack", false], [5244, 0.013037, " focus", false], [8869, 0.011784, " efforts", false], [27850, 0.01027, " failures", false]]]}, "raw_delta": 0.041003525257110596, "tuned_delta": 0.049575317287688846}, {"byte_start": 2987, "byte_end": 2994, "display": {"text": " effort", "kind": "normal"}, "is_word": true, "word_id": 507, "word_key": " effort", "bytes_hex": "20 65 66 66 6f 72 74", "compression": {"rwkv": "13.93% 13.93% 13.93% 13.93% 13.93% 13.93% 13.93%", "qwen": "11.72% 11.72% 11.72% 11.72% 11.72% 11.72% 11.72%"}, "model_tokens": {"rwkv": [[45829, " effort", "normal", 0.004506670869886875]], "qwen": [[5041, " effort", "normal", 0.010584041476249695]]}, "loss": {"rwkv": 13.927803687153498, "qwen": 11.717795912378751}, "topk": {"rwkv": [45829, 37, 0.004506670869886875, [[51566, 0.151177, " efforts", false], [62157, 0.10848, " investment", false], [63678, 0.05266, " investments", false], [38530, 0.046918, " focus", false], [62500, 0.034469, " resistance", false], [61701, 0.028744, " commitment", false], [55572, 0.021242, " attempts", false], [62561, 0.018954, " skepticism", false], [62476, 0.01889, " reluctance", false], [45294, 0.017965, " belief", false]]], "qwen": [5041, 17, 0.010584041476249695, [[8869, 0.090965, " efforts", false], [7901, 0.074317, " failure", false], [5244, 0.066832, " focus", false], [40598, 0.032757, " disappointment", false], [15155, 0.032682, " commitment", false], [9162, 0.03148, " investment", false], [16396, 0.029786, " belief", false], [82950, 0.02839, " reluctance", false], [13553, 0.028032, " attempts", false], [3738, 0.026329, " human", false]]]}, "raw_delta": 0.12254885264805393, "tuned_delta": 0.1311206446786322}, {"byte_start": 2994, "byte_end": 2998, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 508, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "4.97% 4.97% 4.97% 4.97%", "qwen": "4.65% 4.65% 4.65% 4.65%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.3331619203090668]], "qwen": [[572, " was", "normal", 0.3565994203090668]]}, "loss": {"rwkv": 4.966308612435152, "qwen": 4.648823801930352}, "topk": {"rwkv": [22748, 1, 0.3331619203090668, [[22748, 0.333162, " was", false], [4811, 0.141249, " to", false], [4424, 0.090194, " at", false], [32460, 0.06933, " went", false], [4596, 0.042545, " in", false], [51770, 0.034064, " focused", false], [31162, 0.019866, " into", false], [21795, 0.019657, " had", false], [4712, 0.016957, " on", false], [47518, 0.016818, " tended", false]]], "qwen": [572, 1, 0.3565994203090668, [[572, 0.356599, " was", false], [311, 0.163238, " to", false], [304, 0.111005, " in", false], [3937, 0.058702, " went", false], [10735, 0.040209, " focused", false], [518, 0.027906, " at", false], [1521, 0.01743, " did", false], [1033, 0.015174, " were", false], [1030, 0.009388, " had", false], [11, 0.009278, ",", false]]]}, "raw_delta": 0.017605096101760864, "tuned_delta": 0.026176888132339114}, {"byte_start": 2998, "byte_end": 3007, "display": {"text": " directed", "kind": "normal"}, "is_word": true, "word_id": 509, "word_key": " directed", "bytes_hex": "20 64 69 72 65 63 74 65 64", "compression": {"rwkv": "6.61% 6.61% 6.61% 6.61% 6.61% 6.61% 6.61% 6.61% 6.61%", "qwen": "7.23% 7.23% 7.23% 7.23% 7.23% 7.23% 7.23% 7.23% 7.23%"}, "model_tokens": {"rwkv": [[56002, " directed", "normal", 0.037287674844264984]], "qwen": [[15540, " directed", "normal", 0.02707730233669281]]}, "loss": {"rwkv": 6.606090573515001, "qwen": 7.231627782151552}, "topk": {"rwkv": [56002, 9, 0.037287674844264984, [[4811, 0.192953, " to", false], [39762, 0.072596, " spent", false], [4596, 0.063694, " in", false], [51770, 0.062405, " focused", false], [22187, 0.060269, " not", false], [37810, 0.05508, " based", false], [51459, 0.045389, " devoted", false], [4712, 0.044941, " on", false], [56002, 0.037288, " directed", false], [56495, 0.023658, " invested", false]]], "qwen": [15540, 6, 0.02707730233669281, [[311, 0.359191, " to", false], [3118, 0.063251, " based", false], [304, 0.062321, " in", false], [10735, 0.050541, " focused", false], [537, 0.040582, " not", false], [15540, 0.027077, " directed", false], [13771, 0.021218, " largely", false], [7391, 0.021157, " spent", false], [28229, 0.019022, " devoted", false], [38828, 0.016841, " wasted", false]]]}, "raw_delta": -0.03468714820014107, "tuned_delta": -0.02611535616956282}, {"byte_start": 3007, "byte_end": 3015, "display": {"text": " towards", "kind": "normal"}, "is_word": true, "word_id": 510, "word_key": " towards", "bytes_hex": "20 74 6f 77 61 72 64 73", "compression": {"rwkv": "4.44% 4.44% 4.44% 4.44% 4.44% 4.44% 4.44% 4.44%", "qwen": "5.04% 5.04% 5.04% 5.04% 5.04% 5.04% 5.04% 5.04%"}, "model_tokens": {"rwkv": [[53169, " towards", "normal", 0.1395360380411148]], "qwen": [[6974, " towards", "normal", 0.10707979649305344]]}, "loss": {"rwkv": 4.437977908984604, "qwen": 5.036315225360426}, "topk": {"rwkv": [53169, 3, 0.1395360380411148, [[4424, 0.363651, " at", false], [47585, 0.238883, " toward", false], [53169, 0.139536, " towards", false], [4811, 0.111944, " to", false], [30211, 0.040751, " away", false], [50870, 0.020957, " against", false], [60247, 0.009616, " primarily", false], [4596, 0.00879, " in", false], [4450, 0.006458, " by", false], [31162, 0.005836, " into", false]]], "qwen": [6974, 3, 0.10707979649305344, [[518, 0.484283, " at", false], [8841, 0.184966, " toward", false], [6974, 0.10708, " towards", false], [311, 0.043649, " to", false], [2348, 0.037031, " against", false], [3123, 0.022275, " away", false], [15503, 0.014535, " primarily", false], [304, 0.010548, " in", false], [537, 0.00793, " not", false], [803, 0.007657, " more", false]]]}, "raw_delta": -0.033178865909576416, "tuned_delta": -0.024607073878998166}, {"byte_start": 3015, "byte_end": 3025, "display": {"text": " utilizing", "kind": "normal"}, "is_word": true, "word_id": 511, "word_key": " utilizing", "bytes_hex": "20 75 74 69 6c 69 7a 69 6e 67", "compression": {"rwkv": "10.93% 10.93% 10.93% 10.93% 10.93% 10.93% 10.93% 10.93% 10.93% 10.93%", "qwen": "10.55% 10.55% 10.55% 10.55% 10.55% 10.55% 10.55% 10.55% 10.55% 10.55%"}, "model_tokens": {"rwkv": [[60720, " utilizing", "normal", 0.0023603595327585936]], "qwen": [[34888, " utilizing", "normal", 0.002871462842449546]]}, "loss": {"rwkv": 10.932923356736676, "qwen": 10.554998360771686}, "topk": {"rwkv": [60720, 38, 0.0023603595327585936, [[52224, 0.203569, " methods", false], [38720, 0.117299, " human", false], [47202, 0.101278, " search", false], [22590, 0.097177, " the", false], [55586, 0.048863, " avoiding", false], [38888, 0.04015, " lever", false], [332, 0.027977, " a", false], [61590, 0.021083, " approaches", false], [40085, 0.015468, " using", false], [60463, 0.012611, " searching", false]]], "qwen": [34888, 40, 0.002871462842449546, [[5413, 0.125822, " methods", false], [3738, 0.120421, " human", false], [76482, 0.10533, " leveraging", false], [2711, 0.053487, " search", false], [279, 0.053393, " the", false], [30426, 0.041448, " avoiding", false], [264, 0.034367, " a", false], [70601, 0.029746, " exploiting", false], [1667, 0.025237, " using", false], [6832, 0.024637, " learning", false]]]}, "raw_delta": 0.02095661163330076, "tuned_delta": 0.02952840366387901}, {"byte_start": 3025, "byte_end": 3031, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 512, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "0.96% 0.96% 0.96% 0.96% 0.96% 0.96%", "qwen": "1.52% 1.52% 1.52% 1.52% 1.52% 1.52%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.7257537841796875]], "qwen": [[3738, " human", "normal", 0.6021825075149536]]}, "loss": {"rwkv": 0.9568656073604371, "qwen": 1.5244318236736045}, "topk": {"rwkv": [38720, 1, 0.7257537841796875, [[38720, 0.725754, " human", false], [39931, 0.10154, " their", false], [22590, 0.041212, " the", false], [59943, 0.022745, " knowledge", false], [47202, 0.014268, " search", false], [52195, 0.005148, " massive", false], [52964, 0.003961, " special", false], [332, 0.003898, " a", false], [39936, 0.003832, " these", false], [46227, 0.003764, " humans", false]]], "qwen": [3738, 1, 0.6021825075149536, [[3738, 0.602183, " human", false], [279, 0.087118, " the", false], [862, 0.060083, " their", false], [3281, 0.042672, " special", false], [6540, 0.030904, " knowledge", false], [2711, 0.016004, " search", false], [264, 0.011134, " a", false], [34447, 0.00597, " computation", false], [10951, 0.005759, " massive", false], [27076, 0.004542, " specialized", false]]]}, "raw_delta": -0.03147255380948385, "tuned_delta": -0.0229007617789056}, {"byte_start": 3031, "byte_end": 3045, "display": {"text": " understanding", "kind": "normal"}, "is_word": true, "word_id": 513, "word_key": " understanding", "bytes_hex": "20 75 6e 64 65 72 73 74 61 6e 64 69 6e 67", "compression": {"rwkv": "4.39% 4.39% 4.39% 4.39% 4.39% 4.39% 4.39% 4.39% 4.39% 4.39% 4.39% 4.39% 4.39% 4.39%", "qwen": "3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28%"}, "model_tokens": {"rwkv": [[65034, " understanding", "normal", 0.03325283154845238]], "qwen": [[8660, " understanding", "normal", 0.07843122631311417]]}, "loss": {"rwkv": 4.387660699132171, "qwen": 3.2789536567374693}, "topk": {"rwkv": [65034, 2, 0.03325283154845238, [[59943, 0.889831, " knowledge", false], [65034, 0.033253, " understanding", false], [59683, 0.018382, " expertise", false], [38786, 0.016128, " input", false], [46, 0.010098, "-", false], [52022, 0.002473, " insight", false], [38013, 0.002287, " chess", false], [59917, 0.002057, " intuition", false], [31702, 0.001625, " play", false], [45775, 0.001433, " domain", false]]], "qwen": [8660, 3, 0.07843122631311417, [[6540, 0.738685, " knowledge", false], [12646, 0.111411, "-k", false], [8660, 0.078431, " understanding", false], [1946, 0.025349, " input", false], [18726, 0.008945, " expertise", false], [323, 0.001976, " and", false], [1995, 0.001632, " information", false], [11229, 0.001501, " intelligence", false], [476, 0.001448, " or", false], [56251, 0.001325, " intuition", false]]]}, "raw_delta": 0.061479772840227424, "tuned_delta": 0.07005156487080567}, {"byte_start": 3045, "byte_end": 3047, "display": {"text": " (", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "20 28", "compression": {"rwkv": "39.45% 39.45%", "qwen": "37.90% 37.90%"}, "model_tokens": {"rwkv": [[275, " (", "normal", 0.01249697059392929]], "qwen": [[320, " (", "normal", 0.01495111733675003]]}, "loss": {"rwkv": 39.44869252430759, "qwen": 37.897516502681846}, "topk": {"rwkv": [275, 8, 0.01249697059392929, [[4706, 0.405488, " of", false], [45, 0.228967, ",", false], [47, 0.082108, ".", false], [21265, 0.073364, " and", false], [47001, 0.044919, " rather", false], [4596, 0.041555, " in", false], [4811, 0.036254, " to", false], [275, 0.012497, " (", false], [4423, 0.011074, " as", false], [52028, 0.009213, " instead", false]]], "qwen": [320, 9, 0.01495111733675003, [[315, 0.460297, " of", false], [11, 0.168162, ",", false], [323, 0.082457, " and", false], [311, 0.07492, " to", false], [13, 0.05549, ".", false], [4751, 0.029435, " rather", false], [476, 0.024722, " or", false], [304, 0.020419, " in", false], [320, 0.014951, " (", false], [4518, 0.007982, " instead", false]]]}, "raw_delta": 0.08601546287536621, "tuned_delta": 0.09458725490594445}, {"byte_start": 3047, "byte_end": 3049, "display": {"text": "so", "kind": "normal"}, "is_word": true, "word_id": 514, "word_key": "so", "bytes_hex": "73 6f", "compression": {"rwkv": "49.59% 49.59%", "qwen": "60.55% 60.55%"}, "model_tokens": {"rwkv": [[2190, "so", "normal", 0.0040810187347233295]], "qwen": [[704, "so", "normal", 0.0012126192450523376]]}, "loss": {"rwkv": 49.59264203055811, "qwen": 60.54785949832613}, "topk": {"rwkv": [2190, 38, 0.0040810187347233295, [[2101, 0.094433, "or", false], [7005, 0.087191, "and", false], [1950, 0.082559, "in", false], [2090, 0.057561, "of", false], [36003, 0.050845, "which", false], [1751, 0.040668, "as", false], [8801, 0.030303, "the", false], [98, 0.024738, "a", false], [42135, 0.019727, "rather", false], [1782, 0.018952, "by", false]]], "qwen": [704, 78, 0.0012126192450523376, [[269, 0.204208, "or", false], [437, 0.11614, "and", false], [258, 0.054871, "in", false], [300, 0.039512, "as", false], [8206, 0.037719, "which", false], [1782, 0.025826, "the", false], [1055, 0.025452, "of", false], [36141, 0.020878, "although", false], [64, 0.013947, "a", false], [4197, 0.013222, "with", false]]]}, "raw_delta": -0.6074862480163574, "tuned_delta": -0.5989144559857792}, {"byte_start": 3049, "byte_end": 3054, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 515, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "6.09% 6.09% 6.09% 6.09% 6.09%", "qwen": "7.08% 7.08% 7.08% 7.08% 7.08%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.1862810105085373]], "qwen": [[429, " that", "normal", 0.14031538367271423]]}, "loss": {"rwkv": 6.086369703750314, "qwen": 7.083137292575182}, "topk": {"rwkv": [32227, 2, 0.1862810105085373, [[46, 0.230581, "-", false], [32227, 0.186281, " that", false], [4423, 0.125813, " as", false], [32232, 0.062569, " they", false], [45395, 0.049735, " called", false], [22590, 0.025463, " the", false], [31466, 0.022861, " much", false], [45, 0.022699, ",", false], [4811, 0.02096, " to", false], [4601, 0.019518, " it", false]]], "qwen": [429, 2, 0.14031538367271423, [[18900, 0.328651, "-called", false], [429, 0.140315, " that", false], [2598, 0.064618, " called", false], [311, 0.061745, " to", false], [438, 0.047244, " as", false], [807, 0.039029, " they", false], [279, 0.023667, " the", false], [1753, 0.02324, " much", false], [11, 0.019221, ",", false], [432, 0.01812, " it", false]]]}, "raw_delta": -0.05527253150939937, "tuned_delta": -0.04670073947882112}, {"byte_start": 3054, "byte_end": 3059, "display": {"text": " less", "kind": "normal"}, "is_word": true, "word_id": 516, "word_key": " less", "bytes_hex": "20 6c 65 73 73", "compression": {"rwkv": "26.83% 26.83% 26.83% 26.83% 26.83%", "qwen": "24.53% 24.53% 24.53% 24.53% 24.53%"}, "model_tokens": {"rwkv": [[31277, " less", "normal", 0.0005903737619519234]], "qwen": [[2686, " less", "normal", 0.001113724778406322]]}, "loss": {"rwkv": 26.825110916529162, "qwen": 24.525978046734792}, "topk": {"rwkv": [31277, 99, 0.0005903737619519234, [[22590, 0.192673, " the", false], [32232, 0.118792, " they", false], [47202, 0.102596, " search", false], [4601, 0.072384, " it", false], [332, 0.039451, " a", false], [56537, 0.031491, " learning", false], [38720, 0.028914, " human", false], [39931, 0.025104, " their", false], [45, 0.022468, ",", false], [46227, 0.015888, " humans", false]]], "qwen": [2686, 73, 0.001113724778406322, [[279, 0.20481, " the", false], [807, 0.145276, " they", false], [432, 0.082475, " it", false], [11, 0.045246, ",", false], [3738, 0.043629, " human", false], [264, 0.041135, " a", false], [862, 0.032532, " their", false], [5994, 0.024569, " Go", false], [2711, 0.021499, " search", false], [12677, 0.017729, " humans", false]]]}, "raw_delta": 0.12749099731445312, "tuned_delta": 0.13606278934503138}, {"byte_start": 3059, "byte_end": 3066, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 517, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "7.49% 7.49% 7.49% 7.49% 7.49% 7.49% 7.49%", "qwen": "7.46% 7.46% 7.46% 7.46% 7.46% 7.46% 7.46%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.05517926067113876]], "qwen": [[2711, " search", "normal", 0.05523906648159027]]}, "loss": {"rwkv": 7.487200826042054, "qwen": 7.461012782105671}, "topk": {"rwkv": [47202, 4, 0.05517926067113876, [[63370, 0.279616, " computation", false], [52195, 0.09342, " massive", false], [45829, 0.076264, " effort", false], [47202, 0.055179, " search", false], [32251, 0.043486, " time", false], [56537, 0.030917, " learning", false], [4706, 0.030595, " of", false], [38720, 0.026767, " human", false], [22748, 0.026319, " was", false], [59346, 0.023582, " computing", false]]], "qwen": [2711, 3, 0.05523906648159027, [[34447, 0.337095, " computation", false], [882, 0.062932, " time", false], [2711, 0.055239, " search", false], [3738, 0.054309, " human", false], [5041, 0.049145, " effort", false], [315, 0.041335, " of", false], [54480, 0.029346, " computational", false], [24231, 0.026667, " computing", false], [6366, 0.022173, " computer", false], [572, 0.017356, " was", false]]]}, "raw_delta": 0.0014521735055106344, "tuned_delta": 0.010023965536088883}, {"byte_start": 3066, "byte_end": 3070, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 518, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "3.66% 3.66% 3.66% 3.66%", "qwen": "3.46% 3.46% 3.46% 3.46%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.44635388255119324]], "qwen": [[572, " was", "normal", 0.46383416652679443]]}, "loss": {"rwkv": 3.6630928772571334, "qwen": 3.463496799460949}, "topk": {"rwkv": [22748, 1, 0.44635388255119324, [[22748, 0.446354, " was", false], [40219, 0.259778, " would", false], [21265, 0.060199, " and", false], [4715, 0.05388, " or", false], [38128, 0.037509, " could", false], [21795, 0.028175, " had", false], [4600, 0.017478, " is", false], [32251, 0.01452, " time", false], [45829, 0.013382, " effort", false], [46650, 0.010046, " needed", false]]], "qwen": [572, 1, 0.46383416652679443, [[572, 0.463834, " was", false], [1035, 0.302694, " would", false], [1410, 0.052677, " could", false], [374, 0.044084, " is", false], [2578, 0.036068, " might", false], [5041, 0.022308, " effort", false], [323, 0.013622, " and", false], [11, 0.0084, ",", false], [5980, 0.006814, "-based", false], [1231, 0.005859, " may", false]]]}, "raw_delta": 0.011067956686019897, "tuned_delta": 0.019639748716598147}, {"byte_start": 3070, "byte_end": 3077, "display": {"text": " needed", "kind": "normal"}, "is_word": true, "word_id": 519, "word_key": " needed", "bytes_hex": "20 6e 65 65 64 65 64", "compression": {"rwkv": "1.85% 1.85% 1.85% 1.85% 1.85% 1.85% 1.85%", "qwen": "1.83% 1.83% 1.83% 1.83% 1.83% 1.83% 1.83%"}, "model_tokens": {"rwkv": [[46650, " needed", "normal", 0.48742541670799255]], "qwen": [[4362, " needed", "normal", 0.4906936287879944]]}, "loss": {"rwkv": 1.8516733225695396, "qwen": 1.834116965035213}, "topk": {"rwkv": [46650, 1, 0.48742541670799255, [[46650, 0.487425, " needed", false], [57101, 0.339497, " required", false], [60050, 0.132029, " necessary", false], [30666, 0.006985, " done", false], [56500, 0.006829, " involved", false], [60152, 0.003734, " performed", false], [55448, 0.003093, " actually", false], [32354, 0.001828, " used", false], [56895, 0.001333, " possible", false], [4811, 0.000938, " to", false]]], "qwen": [4362, 1, 0.4906936287879944, [[4362, 0.490694, " needed", false], [2567, 0.33809, " required", false], [5871, 0.128202, " necessary", false], [2814, 0.008532, " done", false], [1483, 0.004738, " used", false], [6398, 0.002998, " involved", false], [10660, 0.002806, " performed", false], [3204, 0.00258, " possible", false], [3520, 0.002044, " actually", false], [9251, 0.001293, " applied", false]]]}, "raw_delta": 0.0009735311780657008, "tuned_delta": 0.009545323208643949}, {"byte_start": 3077, "byte_end": 3078, "display": {"text": ")", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29", "compression": {"rwkv": "18.17%", "qwen": "23.27%"}, "model_tokens": {"rwkv": [[42, ")", "normal", 0.3699245750904083]], "qwen": [[8, ")", "normal", 0.27510666847229004]]}, "loss": {"rwkv": 18.174576198698855, "qwen": 23.27421221143226}, "topk": {"rwkv": [42, 1, 0.3699245750904083, [[42, 0.369925, ")", false], [497, 0.332328, "),", false], [499, 0.121045, ").", false], [45, 0.050915, ",", false], [4811, 0.044693, " to", false], [21265, 0.018407, " and", false], [4715, 0.00916, " or", false], [21700, 0.00907, " for", false], [4596, 0.008958, " in", false], [502, 0.008178, ");", false]]], "qwen": [8, 2, 0.27510666847229004, [[701, 0.362747, "),", false], [8, 0.275107, ")", false], [568, 0.237883, ").", false], [11, 0.02339, ",", false], [1215, 0.020628, ");", false], [311, 0.02036, " to", false], [3593, 0.014575, ").\n\n", false], [323, 0.012792, " and", false], [304, 0.004909, " in", false], [369, 0.00392, " for", false]]]}, "raw_delta": -0.2827838659286499, "tuned_delta": -0.2742120738980717}, {"byte_start": 3078, "byte_end": 3082, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 520, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "4.75% 4.75% 4.75% 4.75%", "qwen": "6.03% 6.03% 6.03% 6.03%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.34676387906074524]], "qwen": [[323, " and", "normal", 0.2626458406448364]]}, "loss": {"rwkv": 4.754976331054933, "qwen": 6.02752863447568}, "topk": {"rwkv": [21265, 1, 0.34676387906074524, [[21265, 0.346764, " and", false], [47001, 0.239757, " rather", false], [21400, 0.19219, " but", false], [4715, 0.063797, " or", false], [40187, 0.028047, " while", false], [52028, 0.015544, " instead", false], [4596, 0.015222, " in", false], [4423, 0.011613, " as", false], [45285, 0.010545, " before", false], [4811, 0.007172, " to", false]]], "qwen": [323, 2, 0.2626458406448364, [[714, 0.439768, " but", false], [323, 0.262646, " and", false], [4751, 0.118464, " rather", false], [476, 0.043201, " or", false], [4518, 0.016896, " instead", false], [311, 0.012526, " to", false], [304, 0.011211, " in", false], [1177, 0.010443, " --", false], [438, 0.006834, " as", false], [1393, 0.006713, " while", false]]]}, "raw_delta": -0.07056528329849243, "tuned_delta": -0.06199349126791418}, {"byte_start": 3082, "byte_end": 3087, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 521, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"rwkv": "10.93% 10.93% 10.93% 10.93% 10.93%", "qwen": "14.81% 14.81% 14.81% 14.81% 14.81%"}, "model_tokens": {"rwkv": [[31581, " only", "normal", 0.04779050499200821]], "qwen": [[1172, " only", "normal", 0.01648406870663166]]}, "loss": {"rwkv": 10.932923356736675, "qwen": 14.806959834583077}, "topk": {"rwkv": [31581, 6, 0.04779050499200821, [[32230, 0.106557, " then", false], [32234, 0.071504, " this", false], [22590, 0.064578, " the", false], [56537, 0.060568, " learning", false], [45, 0.05272, ",", false], [31581, 0.047791, " only", false], [32232, 0.041411, " they", false], [32227, 0.031797, " that", false], [4601, 0.028144, " it", false], [22187, 0.02412, " not", false]]], "qwen": [1172, 13, 0.01648406870663166, [[419, 0.085718, " this", false], [11, 0.082977, ",", false], [1221, 0.072507, " then", false], [279, 0.062896, " the", false], [862, 0.042075, " their", false], [6974, 0.042065, " towards", false], [807, 0.04025, " they", false], [429, 0.037697, " that", false], [537, 0.030036, " not", false], [432, 0.027768, " it", false]]]}, "raw_delta": -0.2148221969604492, "tuned_delta": -0.20625040492987096}, {"byte_start": 3087, "byte_end": 3092, "display": {"text": " much", "kind": "normal"}, "is_word": true, "word_id": 522, "word_key": " much", "bytes_hex": "20 6d 75 63 68", "compression": {"rwkv": "11.72% 11.72% 11.72% 11.72% 11.72%", "qwen": "15.20% 15.20% 15.20% 15.20% 15.20%"}, "model_tokens": {"rwkv": [[31466, " much", "normal", 0.03886871039867401]], "qwen": [[1753, " much", "normal", 0.0147688128054142]]}, "loss": {"rwkv": 11.721897207222828, "qwen": 15.20325601731323}, "topk": {"rwkv": [31466, 5, 0.03886871039867401, [[38869, 0.458746, " later", false], [37634, 0.128596, " after", false], [32465, 0.045201, " when", false], [61552, 0.044255, " afterwards", false], [31466, 0.038869, " much", false], [32230, 0.029004, " then", false], [47205, 0.027375, " second", false], [4596, 0.018488, " in", false], [4424, 0.014949, " at", false], [59771, 0.011795, " gradually", false]]], "qwen": [1753, 8, 0.0147688128054142, [[2937, 0.466931, " later", false], [1283, 0.152772, " after", false], [979, 0.060403, " when", false], [304, 0.04391, " in", false], [1221, 0.033484, " then", false], [264, 0.021305, " a", false], [26024, 0.015625, " gradually", false], [1753, 0.014769, " much", false], [518, 0.01123, " at", false], [3055, 0.008694, " once", false]]]}, "raw_delta": -0.19304752349853516, "tuned_delta": -0.1844757314679569}, {"byte_start": 3092, "byte_end": 3098, "display": {"text": " later", "kind": "normal"}, "is_word": true, "word_id": 523, "word_key": " later", "bytes_hex": "20 6c 61 74 65 72", "compression": {"rwkv": "0.06% 0.06% 0.06% 0.06% 0.06% 0.06%", "qwen": "0.05% 0.05% 0.05% 0.05% 0.05% 0.05%"}, "model_tokens": {"rwkv": [[38869, " later", "normal", 0.97950279712677]], "qwen": [[2937, " later", "normal", 0.9822579026222229]]}, "loss": {"rwkv": 0.062372374712911925, "qwen": 0.053804716338493846}, "topk": {"rwkv": [38869, 1, 0.97950279712677, [[38869, 0.979503, " later", false], [31458, 0.009658, " more", false], [45, 0.002336, ",", false], [31466, 0.00095, " much", false], [46405, 0.000949, " latter", false], [61552, 0.00082, " afterwards", false], [37634, 0.000819, " after", false], [31255, 0.000636, " late", false], [51816, 0.000634, " further", false], [31277, 0.000567, " less", false]]], "qwen": [2937, 1, 0.9822579026222229, [[2937, 0.982258, " later", false], [803, 0.005995, " more", false], [11, 0.003197, ",", false], [5021, 0.002368, " longer", false], [4623, 0.002054, " further", false], [1283, 0.000772, " after", false], [15271, 0.00027, " latter", false], [28393, 0.000231, " slower", false], [2686, 0.000211, " less", false], [8131, 0.000192, " larger", false]]]}, "raw_delta": 0.0004750918596982956, "tuned_delta": 0.009046883890276544}, {"byte_start": 3098, "byte_end": 3102, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 524, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "9.72% 9.72% 9.72% 9.72%", "qwen": "11.38% 11.38% 11.38% 11.38%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.11592810600996017]], "qwen": [[572, " was", "normal", 0.08012823015451431]]}, "loss": {"rwkv": 9.721284943490085, "qwen": 11.37982973404948}, "topk": {"rwkv": [22748, 2, 0.11592810600996017, [[21532, 0.541503, " did", false], [22748, 0.115928, " was", false], [32462, 0.10857, " were", false], [45, 0.073, ",", false], [53169, 0.025974, " towards", false], [47585, 0.012947, " toward", false], [275, 0.00969, " (", false], [30383, 0.009638, " came", false], [4712, 0.006647, " on", false], [4596, 0.005592, " in", false]]], "qwen": [572, 3, 0.08012823015451431, [[1521, 0.530067, " did", false], [11, 0.086312, ",", false], [572, 0.080128, " was", false], [1033, 0.063535, " were", false], [6974, 0.045399, " towards", false], [807, 0.045398, " they", false], [320, 0.023243, " (", false], [311, 0.015634, " to", false], [304, 0.007121, " in", false], [6519, 0.006442, " turned", false]]]}, "raw_delta": -0.09196925163269043, "tuned_delta": -0.08339745960211219}, {"byte_start": 3102, "byte_end": 3107, "display": {"text": " much", "kind": "normal"}, "is_word": true, "word_id": 525, "word_key": " much", "bytes_hex": "20 6d 75 63 68", "compression": {"rwkv": "21.64% 21.64% 21.64% 21.64% 21.64%", "qwen": "22.89% 22.89% 22.89% 22.89% 22.89%"}, "model_tokens": {"rwkv": [[31466, " much", "normal", 0.002497876062989235]], "qwen": [[1753, " much", "normal", 0.0017537848325446248]]}, "loss": {"rwkv": 21.640425613334447, "qwen": 22.88828185302624}, "topk": {"rwkv": [31466, 23, 0.002497876062989235, [[22590, 0.226275, " the", false], [4601, 0.195146, " it", false], [56537, 0.135421, " learning", false], [47202, 0.092641, " search", false], [39934, 0.043747, " there", false], [32234, 0.043389, " this", false], [32227, 0.032814, " that", false], [39931, 0.027075, " their", false], [52195, 0.018011, " massive", false], [332, 0.016077, " a", false]]], "qwen": [1753, 29, 0.0017537848325446248, [[279, 0.308798, " the", false], [432, 0.210639, " it", false], [2711, 0.118688, " search", false], [1052, 0.045521, " there", false], [419, 0.039567, " this", false], [264, 0.033565, " a", false], [429, 0.027979, " that", false], [862, 0.023797, " their", false], [807, 0.012551, " they", false], [458, 0.012507, " an", false]]]}, "raw_delta": -0.06919584274292001, "tuned_delta": -0.06062405071234176}, {"byte_start": 3107, "byte_end": 3115, "display": {"text": " greater", "kind": "normal"}, "is_word": true, "word_id": 526, "word_key": " greater", "bytes_hex": "20 67 72 65 61 74 65 72", "compression": {"rwkv": "7.40% 7.40% 7.40% 7.40% 7.40% 7.40% 7.40% 7.40%", "qwen": "5.54% 5.54% 5.54% 5.54% 5.54% 5.54% 5.54% 5.54%"}, "model_tokens": {"rwkv": [[51867, " greater", "normal", 0.037600304931402206]], "qwen": [[7046, " greater", "normal", 0.08576159179210663]]}, "loss": {"rwkv": 7.396629848307673, "qwen": 5.536756792190434}, "topk": {"rwkv": [51867, 5, 0.037600304931402206, [[31458, 0.344054, " more", false], [4706, 0.204652, " of", false], [45829, 0.075449, " effort", false], [47202, 0.044362, " search", false], [51867, 0.0376, " greater", false], [31277, 0.034233, " less", false], [59193, 0.021018, " attention", false], [56537, 0.018753, " learning", false], [45683, 0.016974, " deeper", false], [45301, 0.015936, " better", false]]], "qwen": [7046, 3, 0.08576159179210663, [[803, 0.497301, " more", false], [315, 0.092637, " of", false], [7046, 0.085762, " greater", false], [2664, 0.043084, " better", false], [8131, 0.034521, " larger", false], [2686, 0.027994, " less", false], [5041, 0.015091, " effort", false], [11243, 0.013299, " bigger", false], [2711, 0.013052, " search", false], [6529, 0.012105, " attention", false]]]}, "raw_delta": 0.10313326120376587, "tuned_delta": 0.11170505323434411}, {"byte_start": 3115, "byte_end": 3123, "display": {"text": " success", "kind": "normal"}, "is_word": true, "word_id": 527, "word_key": " success", "bytes_hex": "20 73 75 63 63 65 73 73", "compression": {"rwkv": "5.42% 5.42% 5.42% 5.42% 5.42% 5.42% 5.42% 5.42%", "qwen": "12.94% 12.94% 12.94% 12.94% 12.94% 12.94% 12.94% 12.94%"}, "model_tokens": {"rwkv": [[53052, " success", "normal", 0.0909983441233635]], "qwen": [[2393, " success", "normal", 0.003210589289665222]]}, "loss": {"rwkv": 5.424195222092293, "qwen": 12.942102936222147}, "topk": {"rwkv": [53052, 2, 0.0909983441233635, [[45829, 0.182586, " effort", false], [53052, 0.090998, " success", false], [47202, 0.084582, " search", false], [56950, 0.071137, " progress", false], [63370, 0.052609, " computation", false], [64862, 0.042148, " computational", false], [22681, 0.040962, " use", false], [64902, 0.038508, " effectiveness", false], [56103, 0.032701, " emphasis", false], [57077, 0.024547, " reliance", false]]], "qwen": [2393, 21, 0.003210589289665222, [[5041, 0.395522, " effort", false], [24654, 0.16705, " emphasis", false], [2711, 0.120219, " search", false], [6529, 0.045958, " attention", false], [54480, 0.03399, " computational", false], [5244, 0.025252, " focus", false], [990, 0.023858, " use", false], [32064, 0.016879, " leverage", false], [34447, 0.012279, " computation", false], [2355, 0.008149, " power", false]]]}, "raw_delta": -0.4168813228607178, "tuned_delta": -0.40830953083013954}, {"byte_start": 3123, "byte_end": 3127, "display": {"text": " had", "kind": "normal"}, "is_word": true, "word_id": 528, "word_key": " had", "bytes_hex": "20 68 61 64", "compression": {"rwkv": "16.55% 16.55% 16.55% 16.55%", "qwen": "15.10% 15.10% 15.10% 15.10%"}, "model_tokens": {"rwkv": [[21795, " had", "normal", 0.0256732739508152]], "qwen": [[1030, " had", "normal", 0.03509770333766937]]}, "loss": {"rwkv": 16.554362041450506, "qwen": 15.101498827298919}, "topk": {"rwkv": [21795, 6, 0.0256732739508152, [[55437, 0.408485, " achieved", false], [38547, 0.115582, " found", false], [56741, 0.076742, " obtained", false], [31968, 0.065383, " seen", false], [57027, 0.059663, " realized", false], [21795, 0.025673, " had", false], [55571, 0.024821, " attained", false], [4596, 0.022397, " in", false], [51097, 0.01655, " brought", false], [21572, 0.013365, " due", false]]], "qwen": [1030, 6, 0.03509770333766937, [[16994, 0.519765, " achieved", false], [12180, 0.081078, " obtained", false], [15043, 0.071143, " realized", false], [1730, 0.054407, " found", false], [62160, 0.038328, " attained", false], [1030, 0.035098, " had", false], [18163, 0.021739, " gained", false], [3204, 0.017975, " possible", false], [3884, 0.014565, " seen", false], [1865, 0.014538, " made", false]]]}, "raw_delta": 0.08056384325027466, "tuned_delta": 0.0891356352808529}, {"byte_start": 3127, "byte_end": 3130, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 529, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "8.88% 8.88% 8.88%", "qwen": "16.99% 16.99% 16.99%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.22978253662586212]], "qwen": [[553, " by", "normal", 0.05922115221619606]]}, "loss": {"rwkv": 8.875955817969208, "qwen": 16.990598901741535}, "topk": {"rwkv": [4450, 2, 0.22978253662586212, [[32487, 0.305985, " with", false], [4450, 0.229783, " by", false], [4596, 0.116747, " in", false], [30259, 0.083631, " been", false], [32465, 0.0293, " when", false], [30917, 0.028723, " from", false], [4712, 0.024422, " on", false], [40085, 0.020209, " using", false], [4811, 0.017967, " to", false], [30482, 0.013175, " come", false]]], "qwen": [553, 4, 0.05922115221619606, [[16994, 0.270542, " achieved", false], [304, 0.08869, " in", false], [311, 0.084446, " to", false], [553, 0.059221, " by", false], [15043, 0.053533, " realized", false], [279, 0.039495, " the", false], [1730, 0.03894, " found", false], [448, 0.024488, " with", false], [13, 0.020905, ".", false], [62160, 0.017123, " attained", false]]]}, "raw_delta": -0.44997135798136395, "tuned_delta": -0.4413995659507857}, {"byte_start": 3130, "byte_end": 3140, "display": {"text": " embracing", "kind": "normal"}, "is_word": true, "word_id": 530, "word_key": " embracing", "bytes_hex": "20 65 6d 62 72 61 63 69 6e 67", "compression": {"rwkv": "7.78% 7.78% 7.78% 7.78% 7.78% 7.78% 7.78% 7.78% 7.78% 7.78%", "qwen": "10.73% 10.73% 10.73% 10.73% 10.73% 10.73% 10.73% 10.73% 10.73% 10.73%"}, "model_tokens": {"rwkv": [[59611, " embracing", "normal", 0.013404577039182186]], "qwen": [[55401, " embracing", "normal", 0.002601034939289093]]}, "loss": {"rwkv": 7.777027954792068, "qwen": 10.733373606767065}, "topk": {"rwkv": [59611, 14, 0.013404577039182186, [[40085, 0.093338, " using", false], [38888, 0.083852, " lever", false], [56537, 0.070385, " learning", false], [60720, 0.061764, " utilizing", false], [22590, 0.043762, " the", false], [47497, 0.036913, " taking", false], [55531, 0.034593, " applying", false], [332, 0.022074, " a", false], [47285, 0.020393, " simply", false], [52700, 0.019382, " relying", false]]], "qwen": [55401, 51, 0.002601034939289093, [[76482, 0.100302, " leveraging", false], [1667, 0.070835, " using", false], [18950, 0.06986, " applying", false], [279, 0.038026, " the", false], [2711, 0.034177, " search", false], [34888, 0.033063, " utilizing", false], [5413, 0.032772, " methods", false], [11811, 0.031422, " researchers", false], [15039, 0.030786, " searching", false], [4633, 0.028974, " taking", false]]]}, "raw_delta": -0.16393461227416992, "tuned_delta": -0.15536282024359166}, {"byte_start": 3140, "byte_end": 3147, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 531, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "2.04% 2.04% 2.04% 2.04% 2.04% 2.04% 2.04%", "qwen": "3.91% 3.91% 3.91% 3.91% 3.91% 3.91% 3.91%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.44809770584106445]], "qwen": [[2711, " search", "normal", 0.21910656988620758]]}, "loss": {"rwkv": 2.042878720008786, "qwen": 3.9112417303970552}, "topk": {"rwkv": [47202, 1, 0.44809770584106445, [[47202, 0.448098, " search", false], [22590, 0.209414, " the", false], [52195, 0.063619, " massive", false], [56537, 0.055673, " learning", false], [21265, 0.038601, " and", false], [332, 0.023735, " a", false], [51832, 0.020836, " general", false], [63370, 0.01426, " computation", false], [37920, 0.008584, " brute", false], [31458, 0.006744, " more", false]]], "qwen": [2711, 2, 0.21910656988620758, [[279, 0.224037, " the", false], [2711, 0.219107, " search", false], [34447, 0.139735, " computation", false], [10951, 0.126667, " massive", false], [4586, 0.039499, " general", false], [64098, 0.023071, " brute", false], [54480, 0.015243, " computational", false], [264, 0.015111, " a", false], [6832, 0.013645, " learning", false], [3460, 0.010581, " large", false]]]}, "raw_delta": -0.10360404423304968, "tuned_delta": -0.09503225220247144}, {"byte_start": 3147, "byte_end": 3151, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 532, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "8.17% 8.17% 8.17% 8.17%", "qwen": "7.99% 7.99% 7.99% 7.99%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.16404545307159424]], "qwen": [[323, " and", "normal", 0.17001445591449738]]}, "loss": {"rwkv": 8.171514880035144, "qwen": 7.988345832625277}, "topk": {"rwkv": [21265, 2, 0.16404545307159424, [[47, 0.382502, ".", false], [21265, 0.164045, " and", false], [4423, 0.118605, " as", false], [45, 0.054232, ",", false], [275, 0.048288, " (", false], [46, 0.01957, "-", false], [4596, 0.01727, " in", false], [32487, 0.01584, " with", false], [46342, 0.014273, " itself", false], [31458, 0.012311, " more", false]]], "qwen": [323, 3, 0.17001445591449738, [[13, 0.275088, ".", false], [382, 0.179275, ".\n\n", false], [323, 0.170014, " and", false], [11, 0.060514, ",", false], [320, 0.046399, " (", false], [438, 0.042173, " as", false], [518, 0.029792, " at", false], [304, 0.025262, " in", false], [5980, 0.019391, "-based", false], [311, 0.009923, " to", false]]]}, "raw_delta": 0.01015704870223999, "tuned_delta": 0.01872884073281824}, {"byte_start": 3151, "byte_end": 3160, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 533, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "0.71% 0.71% 0.71% 0.71% 0.71% 0.71% 0.71% 0.71% 0.71%", "qwen": "0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.7037807703018188]], "qwen": [[6832, " learning", "normal", 0.6542668342590332]]}, "loss": {"rwkv": 0.7083544987003645, "qwen": 0.8500679044303276}, "topk": {"rwkv": [56537, 1, 0.7037807703018188, [[56537, 0.703781, " learning", false], [31978, 0.047677, " self", false], [38888, 0.033895, " lever", false], [22590, 0.021175, " the", false], [21902, 0.020025, " its", false], [45, 0.008132, ",", false], [55586, 0.007394, " avoiding", false], [4450, 0.006453, " by", false], [40085, 0.005997, " using", false], [52129, 0.005276, " letting", false]]], "qwen": [6832, 1, 0.6542668342590332, [[6832, 0.654267, " learning", false], [656, 0.038117, " self", false], [76482, 0.036463, " leveraging", false], [11, 0.035101, ",", false], [553, 0.017691, " by", false], [1181, 0.015146, " its", false], [1221, 0.013366, " then", false], [279, 0.013133, " the", false], [34447, 0.009518, " computation", false], [1008, 0.007302, " other", false]]]}, "raw_delta": -0.00785825981034173, "tuned_delta": 0.0007135322202365176}, {"byte_start": 3160, "byte_end": 3162, "display": {"text": ".\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e 0a", "compression": {"rwkv": "8.14% 4.09%", "qwen": "7.92% 7.92%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.6419187188148499], [261, "\n\n", "control", 0.6377475261688232]], "qwen": [[382, ".\n\n", "control", 0.2678096890449524]]}, "loss": {"rwkv": 6.111025136578006, "qwen": 7.919666352489161}, "topk": {"rwkv": [47, 1, 0.6419187188148499, [[47, 0.641919, ".", false], [4423, 0.078597, " as", false], [45, 0.048777, ",", false], [4450, 0.033713, " by", false], [275, 0.024425, " (", false], [4596, 0.020929, " in", false], [21265, 0.012378, " and", false], [4811, 0.010892, " to", false], [31458, 0.009224, " more", false], [52028, 0.009113, " instead", false]]], "qwen": [382, 2, 0.2678096890449524, [[13, 0.349543, ".", false], [382, 0.26781, ".\n\n", false], [438, 0.062033, " as", false], [11, 0.042986, ",", false], [320, 0.03386, " (", false], [518, 0.031675, " at", false], [304, 0.026401, " in", false], [553, 0.026048, " by", false], [624, 0.014623, ".\n", false], [311, 0.014055, " to", false]]]}, "raw_delta": -0.1002923647562663, "tuned_delta": -0.09172057272568805}, {"byte_start": 3162, "byte_end": 3163, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "4.09%", "qwen": "7.92%"}, "model_tokens": {"rwkv": [[261, "\n\n", "control", 0.6377475261688232]], "qwen": [[382, ".\n\n", "control", 0.2678096890449524]]}, "loss": {"rwkv": 4.085757440017572, "qwen": 7.919666352489161}, "topk": {"rwkv": [261, 1, 0.6377475261688232, [[261, 0.637748, "\n\n", false], [20996, 0.040391, " The", false], [267, 0.033178, "  ", false], [3913, 0.021198, " In", false], [29894, 0.020926, " This", false], [3918, 0.015197, " It", false], [3336, 0.014963, " \n\n", false], [19417, 0.01011, " And", false], [19555, 0.009394, " But", false], [3328, 0.008935, "\n\n\n", false]]], "qwen": [382, 2, 0.2678096890449524, [[13, 0.349543, ".", false], [382, 0.26781, ".\n\n", false], [438, 0.062033, " as", false], [11, 0.042986, ",", false], [320, 0.03386, " (", false], [518, 0.031675, " at", false], [304, 0.026401, " in", false], [553, 0.026048, " by", false], [624, 0.014623, ".\n", false], [311, 0.014055, " to", false]]]}, "raw_delta": -0.2125970522562663, "tuned_delta": -0.20402526022568804}, {"byte_start": 3163, "byte_end": 3165, "display": {"text": "In", "kind": "normal"}, "is_word": true, "word_id": 534, "word_key": "in", "bytes_hex": "49 6e", "compression": {"rwkv": "16.27% 16.27%", "qwen": "14.30% 14.30%"}, "model_tokens": {"rwkv": [[1136, "In", "normal", 0.16476811468601227]], "qwen": [[641, "In", "normal", 0.20481045544147491]]}, "loss": {"rwkv": 16.272585666276882, "qwen": 14.297742208057853}, "topk": {"rwkv": [1136, 1, 0.16476811468601227, [[1136, 0.164768, "In", false], [6699, 0.148463, "The", false], [66, 0.083091, "A", false], [48358, 0.057915, "Another", false], [33504, 0.039198, "There", false], [1141, 0.025535, "It", false], [24242, 0.018545, "This", false], [58094, 0.016799, "Similarly", false], [6393, 0.015119, "One", false], [33505, 0.015112, "These", false]]], "qwen": [641, 1, 0.20481045544147491, [[641, 0.20481, "In", false], [785, 0.130888, "The", false], [32, 0.057549, "A", false], [14037, 0.046997, "Another", false], [3862, 0.033794, "There", false], [37332, 0.019945, "Computer", false], [1986, 0.018975, "This", false], [2132, 0.016819, "It", false], [9485, 0.014706, "These", false], [3966, 0.013877, "One", false]]]}, "raw_delta": 0.10950857400894165, "tuned_delta": 0.1180803660395199}, {"byte_start": 3165, "byte_end": 3172, "display": {"text": " speech", "kind": "normal"}, "is_word": true, "word_id": 535, "word_key": " speech", "bytes_hex": "20 73 70 65 65 63 68", "compression": {"rwkv": "13.69% 13.69% 13.69% 13.69% 13.69% 13.69% 13.69%", "qwen": "13.46% 13.46% 13.46% 13.46% 13.46% 13.46% 13.46%"}, "model_tokens": {"rwkv": [[47350, " speech", "normal", 0.0049649751745164394]], "qwen": [[8806, " speech", "normal", 0.0053747124038636684]]}, "loss": {"rwkv": 13.686281079861814, "qwen": 13.46356600388949}, "topk": {"rwkv": [47350, 24, 0.0049649751745164394, [[55809, 0.327519, " computer", false], [22590, 0.123117, " the", false], [3492, 0.039047, " 19", false], [52299, 0.034119, " natural", false], [52766, 0.03024, " robotic", false], [52167, 0.029188, " machine", false], [3609, 0.027223, " AI", false], [51832, 0.021017, " general", false], [3493, 0.020056, " 20", false], [31370, 0.016802, " many", false]]], "qwen": [8806, 20, 0.0053747124038636684, [[279, 0.194954, " the", false], [6366, 0.167436, " computer", false], [73606, 0.065926, " robotics", false], [71278, 0.027959, " reinforcement", false], [5662, 0.025601, " machine", false], [1657, 0.023437, " many", false], [220, 0.021513, " ", false], [264, 0.018057, " a", false], [678, 0.017338, " all", false], [2176, 0.016811, " both", false]]]}, "raw_delta": 0.012349946158272895, "tuned_delta": 0.020921738188851145}, {"byte_start": 3172, "byte_end": 3184, "display": {"text": " recognition", "kind": "normal"}, "is_word": true, "word_id": 536, "word_key": " recognition", "bytes_hex": "20 72 65 63 6f 67 6e 69 74 69 6f 6e", "compression": {"rwkv": "0.14% 0.14% 0.14% 0.14% 0.14% 0.14% 0.14% 0.14% 0.14% 0.14% 0.14% 0.14%", "qwen": "0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45%"}, "model_tokens": {"rwkv": [[63821, " recognition", "normal", 0.910800576210022]], "qwen": [[17843, " recognition", "normal", 0.7405100464820862]]}, "loss": {"rwkv": 0.13942060229945022, "qwen": 0.45146749157513333}, "topk": {"rwkv": [63821, 1, 0.910800576210022, [[63821, 0.910801, " recognition", false], [21265, 0.017009, " and", false], [46, 0.015004, "-", false], [45, 0.012315, ",", false], [62378, 0.011844, " processing", false], [60615, 0.010048, " synthesis", false], [65034, 0.007881, " understanding", false], [63944, 0.002946, " translation", false], [62035, 0.002079, " generation", false], [62634, 0.000906, " technology", false]]], "qwen": [17843, 1, 0.7405100464820862, [[17843, 0.74051, " recognition", false], [323, 0.073654, " and", false], [38875, 0.037246, " synthesis", false], [11, 0.032458, ",", false], [8692, 0.024103, " processing", false], [8660, 0.015766, " understanding", false], [5440, 0.013933, " technology", false], [3412, 0.010654, " research", false], [59172, 0.008406, "-rec", false], [4686, 0.002944, "-to", false]]]}, "raw_delta": -0.0173035537203153, "tuned_delta": -0.008731761689737052}, {"byte_start": 3184, "byte_end": 3185, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "2.75%", "qwen": "3.65%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8587448000907898]], "qwen": [[11, ",", "normal", 0.8166376948356628]]}, "loss": {"rwkv": 2.74731965794285, "qwen": 3.6528986056272403}, "topk": {"rwkv": [45, 1, 0.8587448000907898, [[45, 0.858745, ",", false], [21265, 0.067216, " and", false], [275, 0.009614, " (", false], [22590, 0.009349, " the", false], [57103, 0.008136, " research", false], [39934, 0.007132, " there", false], [53087, 0.004491, " systems", false], [4601, 0.004453, " it", false], [4596, 0.00248, " in", false], [332, 0.002215, " a", false]]], "qwen": [11, 1, 0.8166376948356628, [[11, 0.816638, ",", false], [323, 0.053789, " and", false], [3412, 0.044563, " research", false], [320, 0.024043, " (", false], [304, 0.010581, " in", false], [5942, 0.007971, " systems", false], [1052, 0.004169, " there", false], [279, 0.003158, " the", false], [518, 0.002123, " at", false], [369, 0.002005, " for", false]]]}, "raw_delta": -0.050215959548950195, "tuned_delta": -0.041644167518371945}, {"byte_start": 3185, "byte_end": 3191, "display": {"text": " there", "kind": "normal"}, "is_word": true, "word_id": 537, "word_key": " there", "bytes_hex": "20 74 68 65 72 65", "compression": {"rwkv": "9.58% 9.58% 9.58% 9.58% 9.58% 9.58%", "qwen": "9.39% 9.39% 9.39% 9.39% 9.39% 9.39%"}, "model_tokens": {"rwkv": [[39934, " there", "normal", 0.041605982929468155]], "qwen": [[1052, " there", "normal", 0.0440269410610199]]}, "loss": {"rwkv": 9.580396755903271, "qwen": 9.386394592974995}, "topk": {"rwkv": [39934, 4, 0.041605982929468155, [[22590, 0.365746, " the", false], [63843, 0.086614, " researchers", false], [332, 0.049329, " a", false], [39934, 0.041606, " there", false], [4601, 0.024879, " it", false], [40186, 0.014319, " which", false], [50919, 0.013814, " another", false], [38328, 0.012859, " early", false], [22226, 0.012047, " one", false], [4423, 0.011603, " as", false]]], "qwen": [1052, 5, 0.0440269410610199, [[279, 0.276267, " the", false], [264, 0.065506, " a", false], [4124, 0.049636, " early", false], [11811, 0.047668, " researchers", false], [1052, 0.044027, " there", false], [458, 0.01796, " an", false], [432, 0.01707, " it", false], [304, 0.016023, " in", false], [3412, 0.015395, " research", false], [3738, 0.015389, " human", false]]]}, "raw_delta": 0.010757764180501339, "tuned_delta": 0.01932955621107959}, {"byte_start": 3191, "byte_end": 3195, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 538, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "3.75% 3.75% 3.75% 3.75%", "qwen": "3.51% 3.51% 3.51% 3.51%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.4342584013938904]], "qwen": [[572, " was", "normal", 0.4586254358291626]]}, "loss": {"rwkv": 3.7511479944988912, "qwen": 3.5144114570802074}, "topk": {"rwkv": [22748, 1, 0.4342584013938904, [[22748, 0.434258, " was", false], [32462, 0.205648, " were", false], [21800, 0.11211, " has", false], [4600, 0.093833, " is", false], [31059, 0.062746, " have", false], [21286, 0.047831, " are", false], [21795, 0.016404, " had", false], [30135, 0.00243, " also", false], [39620, 0.002053, " seems", false], [22614, 0.001832, " too", false]]], "qwen": [572, 1, 0.4586254358291626, [[572, 0.458625, " was", false], [1033, 0.19218, " were", false], [702, 0.119229, " has", false], [374, 0.079648, " is", false], [614, 0.058493, " have", false], [525, 0.046995, " are", false], [1030, 0.015486, " had", false], [1083, 0.003227, " also", false], [1483, 0.002581, " used", false], [15102, 0.002502, " initially", false]]]}, "raw_delta": 0.013127461075782776, "tuned_delta": 0.021699253106361026}, {"byte_start": 3195, "byte_end": 3198, "display": {"text": " an", "kind": "normal"}, "is_word": true, "word_id": 539, "word_key": " an", "bytes_hex": "20 61 6e", "compression": {"rwkv": "13.43% 13.43% 13.43%", "qwen": "11.65% 11.65% 11.65%"}, "model_tokens": {"rwkv": [[4419, " an", "normal", 0.10843311995267868]], "qwen": [[458, " an", "normal", 0.14387594163417816]]}, "loss": {"rwkv": 13.43134054994282, "qwen": 11.654594949822933}, "topk": {"rwkv": [4419, 2, 0.10843311995267868, [[332, 0.505881, " a", false], [4419, 0.108433, " an", false], [30135, 0.051776, " also", false], [22590, 0.031101, " the", false], [59868, 0.02628, " initially", false], [50919, 0.02625, " another", false], [30788, 0.021297, " even", false], [52906, 0.020631, " similar", false], [31466, 0.017201, " much", false], [4692, 0.015729, " no", false]]], "qwen": [458, 2, 0.14387594163417816, [[264, 0.44822, " a", false], [458, 0.143876, " an", false], [1083, 0.063595, " also", false], [15102, 0.039345, " initially", false], [1753, 0.020871, " much", false], [2441, 0.018998, " another", false], [279, 0.015884, " the", false], [1045, 0.013977, " some", false], [2856, 0.013189, " initial", false], [902, 0.012129, " no", false]]]}, "raw_delta": 0.09852369626363111, "tuned_delta": 0.10709548829420935}, {"byte_start": 3198, "byte_end": 3204, "display": {"text": " early", "kind": "normal"}, "is_word": true, "word_id": 540, "word_key": " early", "bytes_hex": "20 65 61 72 6c 79", "compression": {"rwkv": "4.98% 4.98% 4.98% 4.98% 4.98% 4.98%", "qwen": "5.60% 5.60% 5.60% 5.60% 5.60% 5.60%"}, "model_tokens": {"rwkv": [[38328, " early", "normal", 0.19043795764446259]], "qwen": [[4124, " early", "normal", 0.15495134890079498]]}, "loss": {"rwkv": 4.9780492947340536, "qwen": 5.604401510043859}, "topk": {"rwkv": [38328, 2, 0.19043795764446259, [[52013, 0.233134, " initial", false], [38328, 0.190438, " early", false], [30788, 0.15006, " even", false], [51639, 0.042763, " equally", false], [59134, 0.035616, " analogous", false], [51551, 0.022189, " earlier", false], [59829, 0.018427, " important", false], [45829, 0.016659, " effort", false], [56125, 0.012986, " enormous", false], [52035, 0.010989, " intense", false]]], "qwen": [4124, 2, 0.15495134890079498, [[2856, 0.439237, " initial", false], [4124, 0.154951, " early", false], [6788, 0.037533, " earlier", false], [1496, 0.026808, " even", false], [2989, 0.023843, " important", false], [5041, 0.02224, " effort", false], [7040, 0.019334, " interesting", false], [18308, 0.018332, " equally", false], [4774, 0.01645, " attempt", false], [22399, 0.014664, " enormous", false]]]}, "raw_delta": -0.03473234176635742, "tuned_delta": -0.026160549735779172}, {"byte_start": 3204, "byte_end": 3216, "display": {"text": " competition", "kind": "normal"}, "is_word": true, "word_id": 541, "word_key": " competition", "bytes_hex": "20 63 6f 6d 70 65 74 69 74 69 6f 6e", "compression": {"rwkv": "9.02% 9.02% 9.02% 9.02% 9.02% 9.02% 9.02% 9.02% 9.02% 9.02% 9.02% 9.02%", "qwen": "12.69% 12.69% 12.69% 12.69% 12.69% 12.69% 12.69% 12.69% 12.69% 12.69% 12.69% 12.69%"}, "model_tokens": {"rwkv": [[63361, " competition", "normal", 0.0025059119798243046]], "qwen": [[10707, " competition", "normal", 0.00021447411563713104]]}, "loss": {"rwkv": 9.01684400555602, "qwen": 12.694697293823454}, "topk": {"rwkv": [63361, 58, 0.0025059119798243046, [[45829, 0.128628, " effort", false], [45, 0.047331, ",", false], [46790, 0.047023, " period", false], [21265, 0.046186, " and", false], [50976, 0.043196, " attempt", false], [55532, 0.037538, " approach", false], [56103, 0.031512, " emphasis", false], [31813, 0.020199, " race", false], [32447, 0.016303, " wave", false], [45294, 0.015906, " belief", false]]], "qwen": [10707, 293, 0.00021447411563713104, [[5041, 0.176581, " effort", false], [4168, 0.084525, " period", false], [4774, 0.084485, " attempt", false], [11, 0.035262, ",", false], [16396, 0.030165, " belief", false], [12060, 0.025291, " wave", false], [323, 0.02347, " and", false], [3738, 0.020796, " human", false], [7901, 0.020668, " failure", false], [30854, 0.020547, " tendency", false]]]}, "raw_delta": -0.20394349098205566, "tuned_delta": -0.1953716989514774}, {"byte_start": 3216, "byte_end": 3217, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "72.13%", "qwen": "64.79%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.018264463171362877]], "qwen": [[11, ",", "normal", 0.027518654242157936]]}, "loss": {"rwkv": 72.13475204444816, "qwen": 64.7930792522237}, "topk": {"rwkv": [45, 5, 0.018264463171362877, [[51035, 0.769351, " between", false], [4811, 0.039499, " to", false], [37694, 0.033841, " among", false], [4596, 0.030007, " in", false], [45, 0.018264, ",", false], [32487, 0.016816, " with", false], [21700, 0.016061, " for", false], [4706, 0.012016, " of", false], [32227, 0.010963, " that", false], [275, 0.005901, " (", false]]], "qwen": [11, 8, 0.027518654242157936, [[304, 0.250155, " in", false], [1948, 0.178994, " between", false], [429, 0.107616, " that", false], [311, 0.068565, " to", false], [369, 0.033285, " for", false], [448, 0.030391, " with", false], [2598, 0.029603, " called", false], [11, 0.027519, ",", false], [320, 0.026758, " (", false], [518, 0.023081, " at", false]]]}, "raw_delta": 0.40710878372192383, "tuned_delta": 0.41568057575250206}, {"byte_start": 3217, "byte_end": 3227, "display": {"text": " sponsored", "kind": "normal"}, "is_word": true, "word_id": 542, "word_key": " sponsored", "bytes_hex": "20 73 70 6f 6e 73 6f 72 65 64", "compression": {"rwkv": "11.33% 11.33% 11.33% 11.33% 11.33% 11.33% 11.33% 11.33% 11.33% 11.33%", "qwen": "6.79% 6.79% 6.79% 6.79% 6.79% 6.79% 6.79% 6.79% 6.79% 6.79%"}, "model_tokens": {"rwkv": [[60543, " sponsored", "normal", 0.0018463052110746503]], "qwen": [[29538, " sponsored", "normal", 0.02318495884537697]]}, "loss": {"rwkv": 11.32741028197975, "qwen": 6.7883340915119526}, "topk": {"rwkv": [60543, 68, 0.0018463052110746503, [[4596, 0.18676, " in", false], [51035, 0.080088, " between", false], [22590, 0.040197, " the", false], [32487, 0.037731, " with", false], [30917, 0.034535, " from", false], [40186, 0.030379, " which", false], [57295, 0.024309, " starting", false], [21265, 0.020234, " and", false], [3492, 0.019021, " 19", false], [45202, 0.01845, " around", false]]], "qwen": [29538, 7, 0.02318495884537697, [[304, 0.261176, " in", false], [279, 0.133815, " the", false], [2598, 0.048218, " called", false], [323, 0.034305, " and", false], [5644, 0.030072, " held", false], [892, 0.023604, " which", false], [29538, 0.023185, " sponsored", false], [3881, 0.020487, " known", false], [448, 0.019819, " with", false], [96127, 0.017136, " DAR", false]]]}, "raw_delta": 0.25169982910156247, "tuned_delta": 0.2602716211321407}, {"byte_start": 3227, "byte_end": 3230, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 543, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "0.40% 0.40% 0.40%", "qwen": "0.17% 0.17% 0.17%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.9355474710464478]], "qwen": [[553, " by", "normal", 0.972740650177002]]}, "loss": {"rwkv": 0.40211836873736156, "qwen": 0.16613700982584528}, "topk": {"rwkv": [4450, 1, 0.9355474710464478, [[4450, 0.935547, " by", false], [4596, 0.0308, " in", false], [52063, 0.006403, " jointly", false], [21265, 0.003917, " and", false], [4424, 0.002611, " at", false], [21700, 0.002492, " for", false], [4423, 0.002065, " as", false], [59868, 0.001265, " initially", false], [46768, 0.001179, " partly", false], [45, 0.001036, ",", false]]], "qwen": [553, 1, 0.972740650177002, [[553, 0.972741, " by", false], [304, 0.010446, " in", false], [52158, 0.003276, " jointly", false], [323, 0.003095, " and", false], [518, 0.001075, " at", false], [27037, 0.000755, " partly", false], [438, 0.000746, " as", false], [11, 0.00068, ",", false], [15102, 0.000552, " initially", false], [369, 0.00038, " for", false]]]}, "raw_delta": 0.013085585087537764, "tuned_delta": 0.021657377118116012}, {"byte_start": 3230, "byte_end": 3234, "display": {"text": " DAR", "kind": "normal"}, "is_word": true, "word_id": 544, "word_key": " dar", "bytes_hex": "20 44 41 52", "compression": {"rwkv": "6.06% 6.06% 6.06% 6.06%", "qwen": "12.82% 12.82% 12.82% 12.82%"}, "model_tokens": {"rwkv": [[19678, " DAR", "normal", 0.26150837540626526]], "qwen": [[96127, " DAR", "normal", 0.05827023833990097]]}, "loss": {"rwkv": 6.058192066232952, "qwen": 12.815927864416649}, "topk": {"rwkv": [19678, 1, 0.26150837540626526, [[19678, 0.261508, " DAR", false], [22590, 0.203837, " the", false], [20077, 0.179209, " IBM", false], [28484, 0.093815, " Bell", false], [3620, 0.074024, " AT", false], [54894, 0.023838, " Carnegie", false], [323, 0.017206, " X", false], [332, 0.015336, " a", false], [36292, 0.007002, " Apple", false], [62041, 0.006133, " government", false]]], "qwen": [96127, 4, 0.05827023833990097, [[27922, 0.30154, " IBM", false], [17884, 0.282074, " Bell", false], [279, 0.10406, " the", false], [96127, 0.05827, " DAR", false], [7369, 0.046139, " AT", false], [1599, 0.022942, " X", false], [264, 0.017722, " a", false], [5085, 0.01045, " Google", false], [5100, 0.009302, " Microsoft", false], [15611, 0.0087, " Intel", false]]]}, "raw_delta": -0.3747284412384033, "tuned_delta": -0.3661566492078251}, {"byte_start": 3234, "byte_end": 3236, "display": {"text": "PA", "kind": "normal"}, "is_word": true, "word_id": 545, "word_key": "pa", "bytes_hex": "50 41", "compression": {"rwkv": "0.00% 0.00%", "qwen": "0.00% 0.00%"}, "model_tokens": {"rwkv": [[1342, "PA", "normal", 0.9996206760406494]], "qwen": [[8041, "PA", "normal", 0.9999293088912964]]}, "loss": {"rwkv": 0.0034052564870836106, "qwen": 0.0006373881968423287}, "topk": {"rwkv": [1342, 1, 0.9996206760406494, [[1342, 0.999621, "PA", false], [6405, 8.3e-05, "PAN", false], [81, 7.4e-05, "P", false], [66, 3.9e-05, "A", false], [85, 2.3e-05, "T", false], [1356, 1.5e-05, "PP", false], [2111, 1.2e-05, "pa", false], [1470, 1.2e-05, "TA", false], [827, 9e-06, "AP", false], [6407, 9e-06, "PAS", false]]], "qwen": [8041, 1, 0.9999293088912964, [[8041, 0.999929, "PA", false], [20291, 2.7e-05, "Pa", false], [6595, 6e-06, "pa", false], [47, 6e-06, "P", false], [12878, 3e-06, " PA", false], [4872, 3e-06, "PC", false], [23304, 3e-06, "WIN", false], [54, 2e-06, "W", false], [4406, 2e-06, "PP", false], [81450, 2e-06, "PCA", false]]]}, "raw_delta": 0.0001534832081233617, "tuned_delta": 0.00872527523870161}, {"byte_start": 3236, "byte_end": 3237, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "4.31%", "qwen": "2.21%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.7888008952140808]], "qwen": [[11, ",", "normal", 0.8846657872200012]]}, "loss": {"rwkv": 4.314700744846142, "qwen": 2.209944548117162}, "topk": {"rwkv": [45, 1, 0.7888008952140808, [[45, 0.788801, ",", false], [4596, 0.100737, " in", false], [21265, 0.054736, " and", false], [275, 0.023392, " (", false], [51035, 0.003307, " between", false], [21700, 0.0031, " for", false], [4811, 0.002906, " to", false], [4423, 0.002458, " as", false], [460, 0.001865, "'s", false], [45805, 0.001627, " during", false]]], "qwen": [11, 1, 0.8846657872200012, [[11, 0.884666, ",", false], [304, 0.040663, " in", false], [323, 0.027295, " and", false], [320, 0.020129, " (", false], [13, 0.005623, ".", false], [429, 0.002827, " that", false], [311, 0.001975, " to", false], [594, 0.001838, "'s", false], [518, 0.001258, " at", false], [369, 0.001099, " for", false]]]}, "raw_delta": 0.11671246588230133, "tuned_delta": 0.1252842579128796}, {"byte_start": 3237, "byte_end": 3240, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 546, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "15.22% 15.22% 15.22%", "qwen": "8.62% 8.62% 8.62%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.08052660524845123]], "qwen": [[304, " in", "normal", 0.23855070769786835]]}, "loss": {"rwkv": 15.215924259375784, "qwen": 8.615134095614458}, "topk": {"rwkv": [4596, 3, 0.08052660524845123, [[51035, 0.588954, " between", false], [4811, 0.137252, " to", false], [4596, 0.080527, " in", false], [32227, 0.055003, " that", false], [21700, 0.031132, " for", false], [32487, 0.014863, " with", false], [40186, 0.014385, " which", false], [37694, 0.009269, " among", false], [40185, 0.007082, " where", false], [4706, 0.00515, " of", false]]], "qwen": [304, 2, 0.23855070769786835, [[311, 0.238995, " to", false], [304, 0.238551, " in", false], [429, 0.175627, " that", false], [369, 0.05571, " for", false], [1948, 0.040542, " between", false], [892, 0.031381, " which", false], [1380, 0.031349, " where", false], [448, 0.028236, " with", false], [2598, 0.025995, " called", false], [323, 0.01324, " and", false]]]}, "raw_delta": 0.36602552731831867, "tuned_delta": 0.3745973193488969}, {"byte_start": 3240, "byte_end": 3244, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 547, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "11.98% 11.98% 11.98% 11.98%", "qwen": "8.54% 8.54% 8.54% 8.54%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.06948770582675934]], "qwen": [[279, " the", "normal", 0.1504439413547516]]}, "loss": {"rwkv": 11.97549594487909, "qwen": 8.539694264110675}, "topk": {"rwkv": [22590, 3, 0.06948770582675934, [[40186, 0.696188, " which", false], [3492, 0.089394, " 19", false], [22590, 0.069488, " the", false], [53342, 0.007611, " whether", false], [52224, 0.005943, " methods", false], [40085, 0.005289, " using", false], [22638, 0.005097, " two", false], [332, 0.004836, " a", false], [61857, 0.004387, " developing", false], [47350, 0.003569, " speech", false]]], "qwen": [279, 3, 0.1504439413547516, [[892, 0.647437, " which", false], [220, 0.170432, " ", false], [279, 0.150444, " the", false], [9902, 0.001091, " ``", false], [48083, 0.001075, " recognizing", false], [8806, 0.001071, " speech", false], [1246, 0.001006, " how", false], [264, 0.000975, " a", false], [1667, 0.000938, " using", false], [3309, 0.000766, " late", false]]]}, "raw_delta": 0.19052129983901978, "tuned_delta": 0.19909309186959803}, {"byte_start": 3244, "byte_end": 3247, "display": {"text": " 19", "kind": "normal"}, "is_word": true, "word_id": 548, "word_key": " 19", "bytes_hex": "20 31 39", "compression": {"rwkv": "6.01% 6.01% 6.01%", "qwen": "12.98% 0.19% 0.00%"}, "model_tokens": {"rwkv": [[3492, " 19", "normal", 0.3674902021884918]], "qwen": [[220, " ", "normal", 0.4868954122066498], [16, "1", "normal", 0.9896891117095947], [24, "9", "normal", 0.9997244477272034]]}, "loss": {"rwkv": 6.011229337037347, "qwen": 4.390276775293654}, "topk": {"rwkv": [3492, 1, 0.3674902021884918, [[3492, 0.36749, " 19", false], [31255, 0.149987, " late", false], [38328, 0.090776, " early", false], [22089, 0.055917, " mid", false], [22681, 0.03991, " use", false], [63469, 0.016627, " development", false], [30899, 0.011415, " form", false], [38478, 0.007578, " field", false], [4273, 0.007523, " US", false], [45010, 0.00728, " United", false]]], "qwen": [220, 1, 0.4868954122066498, [[220, 0.486895, " ", false], [3309, 0.207656, " late", false], [4124, 0.125531, " early", false], [5099, 0.097892, " mid", false], [990, 0.004568, " use", false], [3639, 0.004485, " United", false], [9902, 0.003857, " ``", false], [2274, 0.003569, " US", false], [4401, 0.003243, " development", false], [1042, 0.002953, " year", false]]]}, "raw_delta": 0.08988469583952487, "tuned_delta": 0.09845648787010311}, {"byte_start": 3247, "byte_end": 3249, "display": {"text": "70", "kind": "normal"}, "is_word": true, "word_id": 549, "word_key": "70", "bytes_hex": "37 30", "compression": {"rwkv": "8.00% 8.00%", "qwen": "25.38% 0.02%"}, "model_tokens": {"rwkv": [[690, "70", "normal", 0.41248324513435364]], "qwen": [[22, "7", "normal", 0.24479924142360687], [15, "0", "normal", 0.9991158843040466]]}, "loss": {"rwkv": 7.995404645551628, "qwen": 12.697532554416602}, "topk": {"rwkv": [690, 1, 0.41248324513435364, [[690, 0.412483, "70", false], [680, 0.283178, "60", false], [700, 0.129796, "80", false], [710, 0.115721, "90", false], [670, 0.025593, "50", false], [686, 0.003766, "66", false], [689, 0.00332, "69", false], [711, 0.002239, "91", false], [691, 0.002143, "71", false], [687, 0.001669, "67", false]]], "qwen": [22, 3, 0.24479924142360687, [[24, 0.345654, "9", false], [23, 0.263998, "8", false], [22, 0.244799, "7", false], [21, 0.126102, "6", false], [20, 0.016886, "5", false], [19, 0.001879, "4", false], [18, 0.000354, "3", false], [15, 0.000186, "0", false], [17, 6.5e-05, "2", false], [16, 1.6e-05, "1", false]]]}, "raw_delta": -0.26074133621295914, "tuned_delta": -0.2521695441823809}, {"byte_start": 3249, "byte_end": 3250, "display": {"text": "s", "kind": "normal"}, "is_word": true, "word_id": 550, "word_key": "s", "bytes_hex": "73", "compression": {"rwkv": "2.20%", "qwen": "1.25%"}, "model_tokens": {"rwkv": [[116, "s", "normal", 0.885227620601654]], "qwen": [[82, "s", "normal", 0.9332221746444702]]}, "loss": {"rwkv": 2.2013779310439503, "qwen": 1.2463441628509455}, "topk": {"rwkv": [116, 1, 0.885227620601654, [[116, 0.885228, "s", false], [460, 0.111462, "'s", false], [21265, 0.000614, " and", false], [46, 0.000477, "-", false], [28309, 0.000448, "’s", false], [97, 0.000223, "`", false], [350, 0.000156, " s", false], [40, 0.000148, "'", false], [9835, 0.000127, "′", false], [45, 8.5e-05, ",", false]]], "qwen": [82, 1, 0.9332221746444702, [[82, 0.933222, "s", false], [594, 0.0611, "'s", false], [748, 0.001087, "’s", false], [274, 0.001046, " s", false], [38515, 0.00053, "′", false], [12, 0.000401, "-", false], [550, 0.000263, "ies", false], [11, 0.000204, ",", false], [323, 0.000146, " and", false], [429, 0.000109, " that", false]]]}, "raw_delta": 0.05295831710100174, "tuned_delta": 0.06153010913157999}, {"byte_start": 3250, "byte_end": 3251, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "69.04%", "qwen": "44.10%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.021778911352157593]], "qwen": [[13, ".", "normal", 0.08669820427894592]]}, "loss": {"rwkv": 69.03521191753828, "qwen": 44.09817469732327}, "topk": {"rwkv": [47, 6, 0.021778911352157593, [[51035, 0.381235, " between", false], [45, 0.207386, ",", false], [21265, 0.173183, " and", false], [4811, 0.095693, " to", false], [32227, 0.040025, " that", false], [47, 0.021779, ".", false], [21700, 0.014593, " for", false], [4596, 0.009535, " in", false], [32487, 0.005555, " with", false], [37694, 0.005413, " among", false]]], "qwen": [13, 4, 0.08669820427894592, [[11, 0.429518, ",", false], [429, 0.095464, " that", false], [311, 0.095161, " to", false], [13, 0.086698, ".", false], [323, 0.082738, " and", false], [304, 0.04481, " in", false], [1948, 0.027085, " between", false], [2598, 0.020796, " called", false], [369, 0.017049, " for", false], [320, 0.014453, " (", false]]]}, "raw_delta": 1.382802963256836, "tuned_delta": 1.3913747552874143}, {"byte_start": 3251, "byte_end": 3260, "display": {"text": " Entrants", "kind": "normal"}, "is_word": true, "word_id": 551, "word_key": " entrants", "bytes_hex": "20 45 6e 74 72 61 6e 74 73", "compression": {"rwkv": "34.80% 34.80% 34.80% 34.80% 3.59% 3.59% 3.59% 3.59% 0.22%", "qwen": "40.55% 40.55% 40.55% 40.55% 40.55% 0.06% 0.06% 0.06% 0.06%"}, "model_tokens": {"rwkv": [[19830, " Ent", "normal", 0.0004425676597747952], [26809, "rant", "normal", 0.4516456723213196], [116, "s", "normal", 0.9878607392311096]], "qwen": [[47141, " Entr", "normal", 1.311307914875215e-05], [1783, "ants", "normal", 0.9865424633026123]]}, "loss": {"rwkv": 17.08758469585893, "qwen": 22.55302913193068}, "topk": {"rwkv": [19830, 108, 0.0004425676597747952, [[20996, 0.315605, " The", false], [20556, 0.145259, " One", false], [3918, 0.059293, " It", false], [3913, 0.043634, " In", false], [29894, 0.043511, " This", false], [37451, 0.028093, " There", false], [63222, 0.024791, " Researchers", false], [300, 0.022096, " A", false], [19678, 0.015182, " DAR", false], [29804, 0.015114, " Some", false]]], "qwen": [47141, 1259, 1.311307914875215e-05, [[576, 0.293552, " The", false], [1084, 0.109592, " It", false], [1096, 0.083515, " This", false], [758, 0.048719, " In", false], [362, 0.029816, " A", false], [2619, 0.027854, " There", false], [11445, 0.01968, " Its", false], [3776, 0.019046, " One", false], [2411, 0.01553, " At", false], [58150, 0.015228, " Researchers", false]]]}, "raw_delta": -0.3030685921096139, "tuned_delta": -0.29449680007903567}, {"byte_start": 3260, "byte_end": 3269, "display": {"text": " included", "kind": "normal"}, "is_word": true, "word_id": 552, "word_key": " included", "bytes_hex": "20 69 6e 63 6c 75 64 65 64", "compression": {"rwkv": "5.60% 5.60% 5.60% 5.60% 5.60% 5.60% 5.60% 5.60% 5.60%", "qwen": "8.71% 8.71% 8.71% 8.71% 8.71% 8.71% 8.71% 8.71% 8.71%"}, "model_tokens": {"rwkv": [[56427, " included", "normal", 0.06150316074490547]], "qwen": [[5230, " included", "normal", 0.012943398207426071]]}, "loss": {"rwkv": 5.60421901734211, "qwen": 8.710610741970532}, "topk": {"rwkv": [56427, 2, 0.06150316074490547, [[32462, 0.414593, " were", false], [56427, 0.061503, " included", false], [32354, 0.053603, " used", false], [21795, 0.042334, " had", false], [4811, 0.04173, " to", false], [55796, 0.022861, " competed", false], [38128, 0.022067, " could", false], [4596, 0.02121, " in", false], [22762, 0.01614, " who", false], [59506, 0.01222, " developed", false]]], "qwen": [5230, 13, 0.012943398207426071, [[1033, 0.298909, " were", false], [1483, 0.085028, " used", false], [304, 0.082163, " in", false], [1030, 0.052615, " had", false], [311, 0.051618, " to", false], [14634, 0.024043, " submitted", false], [2765, 0.022824, " won", false], [6, 0.015722, "'", false], [429, 0.014798, " that", false], [6679, 0.01377, " tried", false]]]}, "raw_delta": -0.17225493325127494, "tuned_delta": -0.1636831412206967}, {"byte_start": 3269, "byte_end": 3271, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 553, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "22.82% 22.82%", "qwen": "21.65% 21.65%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.07904893159866333]], "qwen": [[264, " a", "normal", 0.09066668152809143]]}, "loss": {"rwkv": 22.823886389063677, "qwen": 21.645521459279514}, "topk": {"rwkv": [332, 3, 0.07904893159866333, [[63843, 0.108868, " researchers", false], [22590, 0.097801, " the", false], [332, 0.079049, " a", false], [30322, 0.052179, " both", false], [22638, 0.027818, " two", false], [32074, 0.023717, " some", false], [31370, 0.023121, " many", false], [46787, 0.0176, " people", false], [46131, 0.015359, " groups", false], [52869, 0.015197, " several", false]]], "qwen": [264, 2, 0.09066668152809143, [[27922, 0.149647, " IBM", false], [264, 0.090667, " a", false], [11811, 0.083081, " researchers", false], [279, 0.074898, " the", false], [17884, 0.065079, " Bell", false], [14865, 0.02785, " MIT", false], [1657, 0.025836, " many", false], [1378, 0.018612, " two", false], [1045, 0.017207, " some", false], [3807, 0.016664, " several", false]]]}, "raw_delta": 0.06534242630004883, "tuned_delta": 0.07391421833062707}, {"byte_start": 3271, "byte_end": 3276, "display": {"text": " host", "kind": "normal"}, "is_word": true, "word_id": 554, "word_key": " host", "bytes_hex": "20 68 6f 73 74", "compression": {"rwkv": "27.28% 27.28% 27.28% 27.28% 27.28%", "qwen": "29.84% 29.84% 29.84% 29.84% 29.84%"}, "model_tokens": {"rwkv": [[31112, " host", "normal", 0.0005192694952711463]], "qwen": [[3468, " host", "normal", 0.00025549010024406016]]}, "loss": {"rwkv": 27.27595311680696, "qwen": 29.83611437477487}, "topk": {"rwkv": [31112, 126, 0.0005192694952711463, [[32207, 0.218117, " team", false], [38640, 0.105203, " group", false], [46685, 0.078566, " number", false], [38720, 0.036927, " human", false], [53264, 0.032496, " variety", false], [21674, 0.029699, " few", false], [47350, 0.029298, " speech", false], [47202, 0.024372, " search", false], [38864, 0.022772, " large", false], [57103, 0.020937, " research", false]]], "qwen": [3468, 250, 0.00025549010024406016, [[1372, 0.132876, " number", false], [1874, 0.058637, " group", false], [2421, 0.054193, " few", false], [2083, 0.043321, " team", false], [8806, 0.039168, " speech", false], [1714, 0.039105, " method", false], [2813, 0.03677, " company", false], [3738, 0.035784, " human", false], [8045, 0.028896, " variety", false], [3460, 0.026857, " large", false]]]}, "raw_delta": -0.1419654846191407, "tuned_delta": -0.13339369258856246}, {"byte_start": 3276, "byte_end": 3279, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 555, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.04% 0.04% 0.04%", "qwen": "0.01% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9926510453224182]], "qwen": [[315, " of", "normal", 0.9980087876319885]]}, "loss": {"rwkv": 0.044394454942719666, "qwen": 0.011981691743041081}, "topk": {"rwkv": [4706, 1, 0.9926510453224182, [[4706, 0.992651, " of", false], [22762, 0.00065, " who", false], [45, 0.000576, ",", false], [37747, 0.000511, " array", false], [32227, 0.000392, " that", false], [1851, 0.000307, "el", false], [46, 0.000304, "-", false], [275, 0.000231, " (", false], [32207, 0.000214, " team", false], [21265, 0.0002, " and", false]]], "qwen": [315, 1, 0.9980087876319885, [[315, 0.998009, " of", false], [433, 0.000175, "ess", false], [11, 0.000174, ",", false], [320, 0.000116, " (", false], [879, 8.6e-05, " who", false], [198, 8.4e-05, "\n", false], [1372, 7.1e-05, " number", false], [476, 6.8e-05, " or", false], [429, 5.9e-05, " that", false], [264, 5.5e-05, " a", false]]]}, "raw_delta": 0.001797345234081149, "tuned_delta": 0.010369137264659397}, {"byte_start": 3279, "byte_end": 3287, "display": {"text": " special", "kind": "normal"}, "is_word": true, "word_id": 556, "word_key": " special", "bytes_hex": "20 73 70 65 63 69 61 6c", "compression": {"rwkv": "14.30% 14.30% 14.30% 14.30% 14.30% 14.30% 14.30% 14.30%", "qwen": "14.77% 14.77% 14.77% 14.77% 14.77% 14.77% 14.77% 14.77%"}, "model_tokens": {"rwkv": [[52964, " special", "normal", 0.0017601862782612443]], "qwen": [[3281, " special", "normal", 0.0014242958277463913]]}, "loss": {"rwkv": 14.3001510400615, "qwen": 14.77427388685166}, "topk": {"rwkv": [52964, 73, 0.0017601862782612443, [[63843, 0.188318, " researchers", false], [38720, 0.075254, " human", false], [57103, 0.050293, " research", false], [46787, 0.025338, " people", false], [52224, 0.022181, " methods", false], [3609, 0.020609, " AI", false], [39904, 0.020084, " teams", false], [59513, 0.019582, " different", false], [55809, 0.018218, " computer", false], [46131, 0.017402, " groups", false]]], "qwen": [3281, 82, 0.0014242958277463913, [[11811, 0.180827, " researchers", false], [3738, 0.056594, " human", false], [5413, 0.053861, " methods", false], [5110, 0.031301, " companies", false], [2155, 0.028066, " different", false], [3412, 0.027185, " research", false], [8806, 0.024624, " speech", false], [5942, 0.018314, " systems", false], [19827, 0.01823, " approaches", false], [1602, 0.017551, " very", false]]]}, "raw_delta": -0.026290953159332275, "tuned_delta": -0.017719161128754025}, {"byte_start": 3287, "byte_end": 3295, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 557, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "6.80% 6.80% 6.80% 6.80% 6.80% 6.80% 6.80% 6.80%", "qwen": "8.12% 8.12% 8.12% 8.12% 8.12% 8.12% 8.12% 8.12%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.04879653826355934]], "qwen": [[5413, " methods", "normal", 0.027293074876070023]]}, "loss": {"rwkv": 6.797855051063719, "qwen": 8.117689684772923}, "topk": {"rwkv": [52224, 3, 0.04879653826355934, [[46, 0.652387, "-", false], [52610, 0.07975, " purpose", false], [52224, 0.048797, " methods", false], [62633, 0.021554, " techniques", false], [61590, 0.016459, " approaches", false], [53087, 0.008744, " systems", false], [25971, 0.007197, "ists", false], [38720, 0.006938, " human", false], [27161, 0.006379, "ties", false], [25940, 0.006283, "ised", false]]], "qwen": [5413, 3, 0.027293074876070023, [[58238, 0.773182, "-purpose", false], [7428, 0.037158, " purpose", false], [5413, 0.027293, " methods", false], [12538, 0.0171, " techniques", false], [25185, 0.007393, " algorithms", false], [38485, 0.006867, "-case", false], [19827, 0.005876, " approaches", false], [11, 0.005599, ",", false], [12, 0.005488, "-", false], [11647, 0.004813, " experts", false]]]}, "raw_delta": -0.07318717241287231, "tuned_delta": -0.06461538038229407}, {"byte_start": 3295, "byte_end": 3300, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 558, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "7.13% 7.13% 7.13% 7.13% 7.13%", "qwen": "4.54% 4.54% 4.54% 4.54% 4.54%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.13948602974414825]], "qwen": [[429, " that", "normal", 0.28388261795043945]]}, "loss": {"rwkv": 7.128942291892729, "qwen": 4.541584127474004}, "topk": {"rwkv": [32227, 2, 0.13948602974414825, [[45, 0.234957, ",", false], [32227, 0.139486, " that", false], [37810, 0.132836, " based", false], [21700, 0.111832, " for", false], [55966, 0.03012, " designed", false], [21265, 0.029156, " and", false], [38888, 0.025359, " lever", false], [47, 0.02045, ".", false], [4811, 0.017289, " to", false], [32139, 0.017098, " such", false]]], "qwen": [429, 1, 0.28388261795043945, [[429, 0.283883, " that", false], [3118, 0.205155, " based", false], [11, 0.141055, ",", false], [369, 0.076992, " for", false], [6188, 0.028651, " designed", false], [320, 0.023569, " (", false], [70601, 0.020602, " exploiting", false], [323, 0.016581, " and", false], [311, 0.012588, " to", false], [40791, 0.011173, " tailored", false]]]}, "raw_delta": 0.1434736013412476, "tuned_delta": 0.15204539337182585}, {"byte_start": 3300, "byte_end": 3305, "display": {"text": " took", "kind": "normal"}, "is_word": true, "word_id": 559, "word_key": " took", "bytes_hex": "20 74 6f 6f 6b", "compression": {"rwkv": "8.12% 8.12% 8.12% 8.12% 8.12%", "qwen": "6.42% 6.42% 6.42% 6.42% 6.42%"}, "model_tokens": {"rwkv": [[32272, " took", "normal", 0.1053810864686966]], "qwen": [[3867, " took", "normal", 0.16853733360767365]]}, "loss": {"rwkv": 8.115159605000418, "qwen": 6.422149921164743}, "topk": {"rwkv": [32272, 3, 0.1053810864686966, [[32462, 0.119223, " were", false], [56540, 0.116081, " leverage", false], [32272, 0.105381, " took", false], [59685, 0.070902, " exploited", false], [31351, 0.050261, " made", false], [32354, 0.046111, " used", false], [40013, 0.040103, " tried", false], [57510, 0.031828, " utilized", false], [21795, 0.026877, " had", false], [47054, 0.021588, " relied", false]]], "qwen": [3867, 1, 0.16853733360767365, [[3867, 0.168537, " took", false], [1033, 0.148943, " were", false], [27505, 0.138017, " lever", false], [50663, 0.068061, " exploited", false], [1865, 0.036492, " made", false], [39913, 0.027299, " relied", false], [1030, 0.02667, " had", false], [1483, 0.023096, " used", false], [1521, 0.016878, " did", false], [33616, 0.016635, " utilized", false]]]}, "raw_delta": 0.09388039112091068, "tuned_delta": 0.10245218315148892}, {"byte_start": 3305, "byte_end": 3315, "display": {"text": " advantage", "kind": "normal"}, "is_word": true, "word_id": 560, "word_key": " advantage", "bytes_hex": "20 61 64 76 61 6e 74 61 67 65", "compression": {"rwkv": "0.15% 0.15% 0.15% 0.15% 0.15% 0.15% 0.15% 0.15% 0.15% 0.15%", "qwen": "0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17% 0.17%"}, "model_tokens": {"rwkv": [[59093, " advantage", "normal", 0.9194269776344299]], "qwen": [[9423, " advantage", "normal", 0.91209876537323]]}, "loss": {"rwkv": 0.15145480165582373, "qwen": 0.1659225331283318}, "topk": {"rwkv": [59093, 1, 0.9194269776344299, [[59093, 0.919427, " advantage", false], [38720, 0.022346, " human", false], [30923, 0.00885, " full", false], [31162, 0.005785, " into", false], [61544, 0.004482, " advantages", false], [332, 0.002767, " a", false], [22590, 0.002495, " the", false], [38629, 0.002271, " great", false], [56540, 0.001736, " leverage", false], [50845, 0.001522, " account", false]]], "qwen": [9423, 1, 0.91209876537323, [[9423, 0.912099, " advantage", false], [3738, 0.019265, " human", false], [2480, 0.009981, " full", false], [2244, 0.006812, " great", false], [22146, 0.004719, " advantages", false], [264, 0.003321, " a", false], [279, 0.002832, " the", false], [3281, 0.002583, " special", false], [1119, 0.001649, " into", false], [5257, 0.001598, " various", false]]]}, "raw_delta": -0.0008022613823413845, "tuned_delta": 0.007769530648236864}, {"byte_start": 3315, "byte_end": 3318, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 561, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.03% 0.03% 0.03%", "qwen": "0.02% 0.02% 0.02%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.995306670665741]], "qwen": [[315, " of", "normal", 0.9974083304405212]]}, "loss": {"rwkv": 0.028434464942651023, "qwen": 0.01559934988305673}, "topk": {"rwkv": [4706, 1, 0.995306670665741, [[4706, 0.995307, " of", false], [45, 0.000963, ",", false], [4596, 0.000722, " in", false], [38720, 0.000713, " human", false], [45833, 0.000277, " either", false], [275, 0.000191, " (", false], [22590, 0.00014, " the", false], [22187, 0.000134, " not", false], [4715, 0.000111, " or", false], [53265, 9.7e-05, " various", false]]], "qwen": [315, 1, 0.9974083304405212, [[315, 0.997408, " of", false], [11, 0.000401, ",", false], [2987, 0.000314, " either", false], [537, 0.000232, " not", false], [3738, 0.000214, " human", false], [320, 0.000182, " (", false], [2176, 0.000108, " both", false], [304, 7.5e-05, " in", false], [311, 6.1e-05, " to", false], [279, 5.1e-05, " the", false]]]}, "raw_delta": 0.0007117299052576224, "tuned_delta": 0.00928352193583587}, {"byte_start": 3318, "byte_end": 3324, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 562, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "3.83% 3.83% 3.83% 3.83% 3.83% 3.83%", "qwen": "2.80% 2.80% 2.80% 2.80% 2.80% 2.80%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.2783218324184418]], "qwen": [[3738, " human", "normal", 0.3939196765422821]]}, "loss": {"rwkv": 3.8274624294417485, "qwen": 2.800055271452416}, "topk": {"rwkv": [38720, 1, 0.2783218324184418, [[38720, 0.278322, " human", false], [22590, 0.270218, " the", false], [59943, 0.056224, " knowledge", false], [62182, 0.035436, " linguistic", false], [45775, 0.015658, " domain", false], [332, 0.014945, " a", false], [52964, 0.013684, " special", false], [56215, 0.013602, " features", false], [62293, 0.010376, " particular", false], [53265, 0.009834, " various", false]]], "qwen": [3738, 1, 0.3939196765422821, [[3738, 0.39392, " human", false], [279, 0.212672, " the", false], [3281, 0.052552, " special", false], [6540, 0.026586, " knowledge", false], [264, 0.012291, " a", false], [7947, 0.01182, " domain", false], [8806, 0.010677, " speech", false], [5257, 0.010535, " various", false], [862, 0.010528, " their", false], [3953, 0.009571, " particular", false]]]}, "raw_delta": 0.05697154998779297, "tuned_delta": 0.06554334201837121}, {"byte_start": 3324, "byte_end": 3334, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 563, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "0.82% 0.82% 0.82% 0.82% 0.82% 0.82% 0.82% 0.82% 0.82% 0.82%", "qwen": "0.94% 0.94% 0.94% 0.94% 0.94% 0.94% 0.94% 0.94% 0.94% 0.94%"}, "model_tokens": {"rwkv": [[59943, " knowledge", "normal", 0.6355510950088501]], "qwen": [[6540, " knowledge", "normal", 0.592913031578064]]}, "loss": {"rwkv": 0.824195897382855, "qwen": 0.9426344371284479}, "topk": {"rwkv": [59943, 1, 0.6355510950088501, [[59943, 0.635551, " knowledge", false], [65034, 0.179749, " understanding", false], [62182, 0.046399, " linguistic", false], [46, 0.022666, "-", false], [38786, 0.016538, " input", false], [59683, 0.016386, " expertise", false], [56529, 0.011517, " language", false], [47350, 0.01107, " speech", false], [59917, 0.003494, " intuition", false], [63637, 0.002681, " information", false]]], "qwen": [6540, 1, 0.592913031578064, [[6540, 0.592913, " knowledge", false], [8660, 0.140599, " understanding", false], [18726, 0.080196, " expertise", false], [64667, 0.02676, " linguistic", false], [1946, 0.02544, " input", false], [12646, 0.021762, "-k", false], [4128, 0.007777, " language", false], [71107, 0.006643, "-under", false], [8806, 0.005197, " speech", false], [7947, 0.003196, " domain", false]]]}, "raw_delta": -0.006567627191543579, "tuned_delta": 0.002004164839034669}, {"byte_start": 3334, "byte_end": 3337, "display": {"text": "---", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d 2d 2d", "compression": {"rwkv": "48.84% 48.84% 48.84%", "qwen": "44.71% 44.71% 44.71%"}, "model_tokens": {"rwkv": [[5346, "---", "normal", 0.00029503233963623643]], "qwen": [[4421, "---", "normal", 0.0005885124555788934]]}, "loss": {"rwkv": 48.841238363428445, "qwen": 44.71099761076521}, "topk": {"rwkv": [5346, 42, 0.00029503233963623643, [[4706, 0.257508, " of", false], [45, 0.25072, ",", false], [47, 0.111356, ".", false], [37598, 0.100703, " about", false], [21265, 0.08588, " and", false], [275, 0.05165, " (", false], [4596, 0.037083, " in", false], [59, 0.019559, ":", false], [4811, 0.014264, " to", false], [32139, 0.008908, " such", false]]], "qwen": [4421, 31, 0.0005885124555788934, [[315, 0.28056, " of", false], [11, 0.207789, ",", false], [13, 0.10953, ".", false], [911, 0.10866, " about", false], [323, 0.065017, " and", false], [320, 0.057745, " (", false], [311, 0.040508, " to", false], [304, 0.033645, " in", false], [476, 0.015063, " or", false], [25, 0.011465, ":", false]]]}, "raw_delta": 0.22902917861938477, "tuned_delta": 0.23760097064996302}, {"byte_start": 3337, "byte_end": 3346, "display": {"text": "knowledge", "kind": "normal"}, "is_word": true, "word_id": 564, "word_key": "knowledge", "bytes_hex": "6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "6.79% 6.79% 6.79% 6.79% 6.79% 6.79% 6.79% 6.79% 6.79%", "qwen": "10.00% 10.00% 10.00% 10.00% 10.00% 10.00% 10.00% 10.00% 10.00%"}, "model_tokens": {"rwkv": [[58313, "knowledge", "normal", 0.0337136946618557]], "qwen": [[89053, "knowledge", "normal", 0.006804365664720535]]}, "loss": {"rwkv": 6.793941490297418, "qwen": 9.999060811112807}, "topk": {"rwkv": [58313, 5, 0.0337136946618557, [[35381, 0.06631, "phone", false], [7579, 0.05077, "for", false], [27095, 0.046591, "such", false], [58282, 0.035448, "including", false], [58313, 0.033714, "knowledge", false], [8801, 0.026144, "the", false], [1950, 0.025295, "in", false], [2090, 0.021315, "of", false], [6907, 0.015876, "aco", false], [98, 0.015545, "a", false]]], "qwen": [89053, 19, 0.006804365664720535, [[1958, 0.113174, "for", false], [1782, 0.039278, "the", false], [20805, 0.035593, "such", false], [51701, 0.034481, "phon", false], [258, 0.027204, "in", false], [16169, 0.025303, "including", false], [64, 0.023208, "a", false], [68, 0.022413, "e", false], [35742, 0.017526, "methods", false], [437, 0.014828, "and", false]]]}, "raw_delta": -0.17772955364651152, "tuned_delta": -0.16915776161593327}, {"byte_start": 3346, "byte_end": 3349, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 565, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "1.50% 1.50% 1.50%", "qwen": "4.17% 4.17% 4.17%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.7771164774894714]], "qwen": [[315, " of", "normal", 0.5000578165054321]]}, "loss": {"rwkv": 1.5028073342593367, "qwen": 4.165971939865932}, "topk": {"rwkv": [4706, 1, 0.7771164774894714, [[4706, 0.777116, " of", false], [37598, 0.087997, " about", false], [32227, 0.053327, " that", false], [46, 0.007534, "-", false], [32139, 0.005432, " such", false], [37810, 0.005192, " based", false], [4596, 0.003923, " in", false], [22187, 0.003118, " not", false], [55442, 0.002865, " acquired", false], [30917, 0.002861, " from", false]]], "qwen": [315, 1, 0.5000578165054321, [[315, 0.500058, " of", false], [911, 0.244429, " about", false], [429, 0.108862, " that", false], [1741, 0.013823, " such", false], [11, 0.012711, ",", false], [504, 0.008878, " from", false], [304, 0.004599, " in", false], [5980, 0.003731, "-based", false], [3118, 0.003642, " based", false], [18163, 0.003563, " gained", false]]]}, "raw_delta": -0.14767720301946002, "tuned_delta": -0.13910541098888177}, {"byte_start": 3349, "byte_end": 3355, "display": {"text": " words", "kind": "normal"}, "is_word": true, "word_id": 566, "word_key": " words", "bytes_hex": "20 77 6f 72 64 73", "compression": {"rwkv": "11.74% 11.74% 11.74% 11.74% 11.74% 11.74%", "qwen": "15.78% 15.78% 15.78% 15.78% 15.78% 15.78%"}, "model_tokens": {"rwkv": [[40210, " words", "normal", 0.020194733515381813]], "qwen": [[4244, " words", "normal", 0.005253321025520563]]}, "loss": {"rwkv": 11.740682298901067, "qwen": 15.77615487818387}, "topk": {"rwkv": [40210, 10, 0.020194733515381813, [[22590, 0.253503, " the", false], [39273, 0.138416, " phone", false], [56529, 0.059451, " language", false], [47350, 0.056894, " speech", false], [55440, 0.043914, " acoustic", false], [21835, 0.037936, " how", false], [62182, 0.035757, " linguistic", false], [51860, 0.034834, " grammar", false], [59946, 0.026252, " languages", false], [40210, 0.020195, " words", false]]], "qwen": [4244, 17, 0.005253321025520563, [[279, 0.353914, " the", false], [50823, 0.253003, " phon", false], [1246, 0.058093, " how", false], [4128, 0.035753, " language", false], [8806, 0.03563, " speech", false], [31428, 0.015489, " grammar", false], [1128, 0.013788, " what", false], [3281, 0.013287, " special", false], [6364, 0.010292, " English", false], [70622, 0.010262, " pronunciation", false]]]}, "raw_delta": -0.2237741152445476, "tuned_delta": -0.21520232321396934}, {"byte_start": 3355, "byte_end": 3356, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "6.06%", "qwen": "7.27%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.715740442276001]], "qwen": [[11, ",", "normal", 0.6681299209594727]]}, "loss": {"rwkv": 6.058192066232952, "qwen": 7.272493308360682}, "topk": {"rwkv": [45, 1, 0.715740442276001, [[45, 0.71574, ",", false], [21265, 0.188574, " and", false], [4596, 0.02537, " in", false], [275, 0.016159, " (", false], [32227, 0.009013, " that", false], [4715, 0.008957, " or", false], [5346, 0.004707, "---", false], [4423, 0.003686, " as", false], [40, 0.002234, "'", false], [30917, 0.001721, " from", false]]], "qwen": [11, 1, 0.6681299209594727, [[11, 0.66813, ",", false], [323, 0.21026, " and", false], [304, 0.026596, " in", false], [320, 0.019248, " (", false], [476, 0.016288, " or", false], [429, 0.011097, " that", false], [438, 0.007941, " as", false], [1660, 0.003235, " being", false], [1075, 0.002041, " like", false], [1741, 0.001965, " such", false]]]}, "raw_delta": -0.06733515858650208, "tuned_delta": -0.058763366555923825}, {"byte_start": 3356, "byte_end": 3359, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 567, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "10.38% 10.38% 10.38%", "qwen": "10.98% 10.98% 10.98%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.17572148144245148]], "qwen": [[315, " of", "normal", 0.16089268028736115]]}, "loss": {"rwkv": 10.378763152228546, "qwen": 10.982622186588632}, "topk": {"rwkv": [4706, 2, 0.17572148144245148, [[59943, 0.400852, " knowledge", false], [4706, 0.175721, " of", false], [51860, 0.054776, " grammar", false], [39273, 0.037322, " phone", false], [21265, 0.017596, " and", false], [64996, 0.014313, " pronunciation", false], [56529, 0.013782, " language", false], [47486, 0.013023, " syntax", false], [32497, 0.012532, " word", false], [47341, 0.012097, " sounds", false]]], "qwen": [315, 1, 0.16089268028736115, [[315, 0.160893, " of", false], [50823, 0.158093, " phon", false], [6540, 0.15273, " knowledge", false], [31428, 0.073357, " grammar", false], [323, 0.032645, " and", false], [862, 0.026638, " their", false], [70622, 0.02638, " pronunciation", false], [279, 0.025346, " the", false], [476, 0.017606, " or", false], [4128, 0.014281, " language", false]]]}, "raw_delta": -0.0334850549697876, "tuned_delta": -0.024913262939209348}, {"byte_start": 3359, "byte_end": 3368, "display": {"text": " phonemes", "kind": "normal"}, "is_word": true, "word_id": 568, "word_key": " phonemes", "bytes_hex": "20 70 68 6f 6e 65 6d 65 73", "compression": {"rwkv": "7.28% 7.28% 7.28% 7.28% 7.28% 7.28% 2.64% 2.64% 2.64%", "qwen": "5.17% 5.17% 5.17% 5.17% 5.17% 4.32% 4.32% 4.32% 4.32%"}, "model_tokens": {"rwkv": [[39273, " phone", "normal", 0.08897095918655396], [8164, "mes", "normal", 0.6444879770278931]], "qwen": [[50823, " phon", "normal", 0.23876725137233734], [15660, "emes", "normal", 0.383487343788147]]}, "loss": {"rwkv": 5.733366522630021, "qwen": 4.79037800427587}, "topk": {"rwkv": [39273, 2, 0.08897095918655396, [[51860, 0.168416, " grammar", false], [39273, 0.088971, " phone", false], [22590, 0.080181, " the", false], [56529, 0.053506, " language", false], [47350, 0.039147, " speech", false], [47486, 0.032729, " syntax", false], [64996, 0.025667, " pronunciation", false], [55440, 0.025221, " acoustic", false], [60476, 0.02402, " sentences", false], [51310, 0.023265, " context", false]]], "qwen": [50823, 1, 0.23876725137233734, [[50823, 0.238767, " phon", false], [279, 0.117382, " the", false], [70622, 0.049761, " pronunciation", false], [8806, 0.049463, " speech", false], [4128, 0.040122, " language", false], [31428, 0.030796, " grammar", false], [1246, 0.026751, " how", false], [3409, 0.026679, " word", false], [862, 0.02647, " their", false], [15459, 0.019261, " languages", false]]]}, "raw_delta": 0.0522903866238064, "tuned_delta": 0.06086217865438465}, {"byte_start": 3368, "byte_end": 3369, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "2.48%", "qwen": "2.14%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8706715703010559]], "qwen": [[11, ",", "normal", 0.8879333138465881]]}, "loss": {"rwkv": 2.483154306217576, "qwen": 2.1434594143297496}, "topk": {"rwkv": [45, 1, 0.8706715703010559, [[45, 0.870672, ",", false], [21265, 0.052177, " and", false], [275, 0.033585, " (", false], [4596, 0.012094, " in", false], [4715, 0.007122, " or", false], [5346, 0.005051, "---", false], [47, 0.003442, ".", false], [4706, 0.00294, " of", false], [4423, 0.001587, " as", false], [47806, 0.001463, " within", false]]], "qwen": [11, 1, 0.8879333138465881, [[11, 0.887933, ",", false], [323, 0.048608, " and", false], [320, 0.039137, " (", false], [476, 0.005605, " or", false], [304, 0.004284, " in", false], [429, 0.001585, " that", false], [13, 0.001211, ".", false], [438, 0.001177, " as", false], [4421, 0.001061, "---", false], [3489, 0.000585, " (\"", false]]]}, "raw_delta": 0.01883668452501297, "tuned_delta": 0.02740847655559122}, {"byte_start": 3369, "byte_end": 3372, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 569, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "1.53% 1.53% 1.53%", "qwen": "2.01% 2.01% 2.01%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.7766412496566772]], "qwen": [[315, " of", "normal", 0.7161024808883667]]}, "loss": {"rwkv": 1.526288698857139, "qwen": 2.0073415507340955}, "topk": {"rwkv": [4706, 1, 0.7766412496566772, [[4706, 0.776641, " of", false], [21265, 0.138856, " and", false], [21643, 0.022741, " etc", false], [4715, 0.010595, " or", false], [59943, 0.005057, " knowledge", false], [30788, 0.00494, " even", false], [22590, 0.002472, " the", false], [39273, 0.002387, " phone", false], [55440, 0.001789, " acoustic", false], [51860, 0.001327, " grammar", false]]], "qwen": [315, 1, 0.7161024808883667, [[315, 0.716102, " of", false], [323, 0.192834, " and", false], [476, 0.024667, " or", false], [4992, 0.023788, " etc", false], [6540, 0.009226, " knowledge", false], [1496, 0.00469, " even", false], [50823, 0.004016, " phon", false], [279, 0.001684, " the", false], [5601, 0.000789, " rules", false], [31428, 0.000649, " grammar", false]]]}, "raw_delta": -0.026675234238306672, "tuned_delta": -0.018103442207728422}, {"byte_start": 3372, "byte_end": 3376, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 570, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "10.64% 10.64% 10.64% 10.64%", "qwen": "8.30% 8.30% 8.30% 8.30%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.09426004439592361]], "qwen": [[279, " the", "normal", 0.1585163027048111]]}, "loss": {"rwkv": 10.637058162804367, "qwen": 8.304052772476783}, "topk": {"rwkv": [22590, 2, 0.09426004439592361, [[51860, 0.129075, " grammar", false], [22590, 0.09426, " the", false], [55440, 0.064723, " acoustic", false], [56529, 0.041231, " language", false], [51310, 0.039466, " context", false], [62182, 0.038495, " linguistic", false], [39273, 0.035438, " phone", false], [47350, 0.027224, " speech", false], [64996, 0.026239, " pronunciation", false], [47486, 0.020857, " syntax", false]]], "qwen": [279, 1, 0.1585163027048111, [[279, 0.158516, " the", false], [4128, 0.06611, " language", false], [50823, 0.065517, " phon", false], [8806, 0.064626, " speech", false], [31428, 0.045814, " grammar", false], [8709, 0.02981, " pros", false], [1246, 0.027838, " how", false], [3409, 0.027465, " word", false], [70622, 0.024873, " pronunciation", false], [15459, 0.024133, " languages", false]]]}, "raw_delta": 0.12936928868293762, "tuned_delta": 0.13794108071351588}, {"byte_start": 3376, "byte_end": 3382, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 571, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "15.50% 15.50% 15.50% 15.50% 15.50% 15.50%", "qwen": "16.97% 16.97% 16.97% 16.97% 16.97% 16.97%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.005730811506509781]], "qwen": [[3738, " human", "normal", 0.0035279719159007072]]}, "loss": {"rwkv": 15.49770063454941, "qwen": 16.97280156375475}, "topk": {"rwkv": [38720, 31, 0.005730811506509781, [[60572, 0.113852, " structure", false], [55440, 0.079798, " acoustic", false], [51860, 0.059951, " grammar", false], [39273, 0.027495, " phone", false], [22752, 0.026084, " way", false], [39747, 0.023744, " sound", false], [56529, 0.022356, " language", false], [47341, 0.021375, " sounds", false], [51310, 0.020774, " context", false], [47350, 0.01737, " speech", false]]], "qwen": [3738, 35, 0.0035279719159007072, [[5944, 0.196786, " structure", false], [3281, 0.084411, " special", false], [50823, 0.04054, " phon", false], [44066, 0.039506, " acoustic", false], [1616, 0.033336, " way", false], [8806, 0.03235, " speech", false], [4128, 0.024568, " language", false], [5112, 0.020068, " sound", false], [31428, 0.014308, " grammar", false], [2266, 0.013803, " context", false]]]}, "raw_delta": -0.0817969640096029, "tuned_delta": -0.07322517197902466}, {"byte_start": 3382, "byte_end": 3388, "display": {"text": " vocal", "kind": "normal"}, "is_word": true, "word_id": 572, "word_key": " vocal", "bytes_hex": "20 76 6f 63 61 6c", "compression": {"rwkv": "7.75% 7.75% 7.75% 7.75% 7.75% 7.75%", "qwen": "5.47% 5.47% 5.47% 5.47% 5.47% 5.47%"}, "model_tokens": {"rwkv": [[40136, " vocal", "normal", 0.07571001350879669]], "qwen": [[25407, " vocal", "normal", 0.1618843823671341]]}, "loss": {"rwkv": 7.748850317274705, "qwen": 5.472842306374786}, "topk": {"rwkv": [40136, 2, 0.07571001350879669, [[40139, 0.438532, " voice", false], [40136, 0.07571, " vocal", false], [47350, 0.064505, " speech", false], [56529, 0.045972, " language", false], [21590, 0.035777, " ear", false], [52963, 0.032602, " speaker", false], [55579, 0.029032, " auditory", false], [50905, 0.023315, " anatomy", false], [39070, 0.019673, " mouth", false], [37898, 0.016469, " brain", false]]], "qwen": [25407, 1, 0.1618843823671341, [[25407, 0.161884, " vocal", false], [7743, 0.124555, " voice", false], [8806, 0.082691, " speech", false], [4128, 0.069859, " language", false], [82529, 0.066939, " auditory", false], [2430, 0.040684, " ear", false], [8109, 0.039357, " brain", false], [50823, 0.034274, " phon", false], [10778, 0.031447, " hearing", false], [27564, 0.023384, " artic", false]]]}, "raw_delta": 0.12620868285497025, "tuned_delta": 0.1347804748855485}, {"byte_start": 3388, "byte_end": 3394, "display": {"text": " tract", "kind": "normal"}, "is_word": true, "word_id": 573, "word_key": " tract", "bytes_hex": "20 74 72 61 63 74", "compression": {"rwkv": "0.93% 0.93% 0.93% 0.93% 0.93% 0.93%", "qwen": "0.08% 0.08% 0.08% 0.08% 0.08% 0.08%"}, "model_tokens": {"rwkv": [[39996, " tract", "normal", 0.7332308888435364]], "qwen": [[41829, " tract", "normal", 0.9751889109611511]]}, "loss": {"rwkv": 0.9275139016131844, "qwen": 0.07551333841152351}, "topk": {"rwkv": [39996, 1, 0.7332308888435364, [[39996, 0.733231, " tract", false], [59153, 0.116333, " apparatus", false], [47487, 0.052536, " system", false], [50905, 0.030457, " anatomy", false], [38115, 0.009745, " cords", false], [38024, 0.00734, " chord", false], [59994, 0.005682, " mechanism", false], [46719, 0.005405, " organs", false], [46, 0.003949, "-", false], [62382, 0.003221, " production", false]]], "qwen": [41829, 1, 0.9751889109611511, [[41829, 0.975189, " tract", false], [40605, 0.007592, " apparatus", false], [1849, 0.002449, " system", false], [16953, 0.002247, " mechanism", false], [2872, 0.00137, " organ", false], [79617, 0.001342, " cords", false], [35753, 0.001225, " organs", false], [489, 0.001167, " tr", false], [61590, 0.00104, " anatomy", false], [3754, 0.000617, " track", false]]]}, "raw_delta": 0.04724494305749733, "tuned_delta": 0.05581673508807558}, {"byte_start": 3394, "byte_end": 3395, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "10.00%", "qwen": "3.67%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.5722053050994873]], "qwen": [[11, ",", "normal", 0.8159487247467041]]}, "loss": {"rwkv": 10.00306131866371, "qwen": 3.6681201451201666}, "topk": {"rwkv": [45, 1, 0.5722053050994873, [[45, 0.572205, ",", false], [47, 0.161537, ".", false], [5346, 0.128898, "---", false], [21265, 0.084454, " and", false], [275, 0.007558, " (", false], [568, 0.005787, "--", false], [60, 0.003431, ";", false], [21643, 0.002768, " etc", false], [50905, 0.002691, " anatomy", false], [116, 0.002302, "s", false]]], "qwen": [11, 1, 0.8159487247467041, [[11, 0.815949, ",", false], [13, 0.073331, ".", false], [323, 0.039013, " and", false], [4421, 0.033701, "---", false], [320, 0.010362, " (", false], [4992, 0.002894, " etc", false], [26, 0.002181, ";", false], [5944, 0.002157, " structure", false], [476, 0.002121, " or", false], [438, 0.001473, " as", false]]]}, "raw_delta": 0.3512837290763855, "tuned_delta": 0.3598555211069637}, {"byte_start": 3395, "byte_end": 3399, "display": {"text": " etc", "kind": "normal"}, "is_word": true, "word_id": 574, "word_key": " etc", "bytes_hex": "20 65 74 63", "compression": {"rwkv": "10.36% 10.36% 10.36% 10.36%", "qwen": "8.02% 8.02% 8.02% 8.02%"}, "model_tokens": {"rwkv": [[21643, " etc", "normal", 0.1010892316699028]], "qwen": [[4992, " etc", "normal", 0.16893409192562103]]}, "loss": {"rwkv": 10.355281787630743, "qwen": 8.017086283367588}, "topk": {"rwkv": [21643, 3, 0.1010892316699028, [[4706, 0.496547, " of", false], [21265, 0.323512, " and", false], [21643, 0.101089, " etc", false], [59943, 0.014964, " knowledge", false], [4715, 0.008195, " or", false], [22590, 0.006899, " the", false], [30788, 0.005034, " even", false], [55440, 0.002536, " acoustic", false], [4522, 0.001973, " et", false], [21256, 0.001644, " all", false]]], "qwen": [4992, 3, 0.16893409192562103, [[315, 0.404679, " of", false], [323, 0.344859, " and", false], [4992, 0.168934, " etc", false], [6540, 0.021371, " knowledge", false], [476, 0.011289, " or", false], [279, 0.005028, " the", false], [1496, 0.004895, " even", false], [678, 0.003127, " all", false], [50823, 0.002071, " phon", false], [1842, 0.002019, " et", false]]]}, "raw_delta": 0.1296570897102356, "tuned_delta": 0.13822888174081385}, {"byte_start": 3399, "byte_end": 3400, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "4.47%", "qwen": "1.88%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.7803417444229126]], "qwen": [[13, ".", "normal", 0.9009494781494141]]}, "loss": {"rwkv": 4.473199955881307, "qwen": 1.8810239662215529}, "topk": {"rwkv": [47, 1, 0.7803417444229126, [[47, 0.780342, ".", false], [5361, 0.09236, ".--", false], [583, 0.048006, ".,", false], [5346, 0.047938, "---", false], [45, 0.005661, ",", false], [584, 0.005269, ".-", false], [568, 0.00297, "--", false], [23326, 0.002968, ".—", false], [25358, 0.002714, "eter", false], [585, 0.002696, "..", false]]], "qwen": [13, 1, 0.9009494781494141, [[13, 0.900949, ".", false], [4421, 0.032714, "---", false], [2572, 0.032237, ".,", false], [11, 0.006014, ",", false], [1404, 0.005206, "eter", false], [32401, 0.005182, ".--", false], [382, 0.004326, ".\n\n", false], [7110, 0.00181, ".\\", false], [496, 0.001474, "..", false], [15642, 0.00098, ".;", false]]]}, "raw_delta": 0.14374075829982758, "tuned_delta": 0.15231255033040583}, {"byte_start": 3400, "byte_end": 3403, "display": {"text": " On", "kind": "normal"}, "is_word": true, "word_id": 575, "word_key": " on", "bytes_hex": "20 4f 6e", "compression": {"rwkv": "40.58% 40.58% 40.58%", "qwen": "40.04% 40.04% 40.04%"}, "model_tokens": {"rwkv": [[4095, " On", "normal", 0.00117211090400815]], "qwen": [[1913, " On", "normal", 0.0012803024146705866]]}, "loss": {"rwkv": 40.57579802500209, "qwen": 40.0387478011528}, "topk": {"rwkv": [4095, 80, 0.00117211090400815, [[20996, 0.155459, " The", false], [37453, 0.116238, " These", false], [19555, 0.06252, " But", false], [3913, 0.039468, " In", false], [29894, 0.031814, " This", false], [29804, 0.030002, " Some", false], [19407, 0.029717, " All", false], [37451, 0.026174, " There", false], [20556, 0.024466, " One", false], [29344, 0.021451, " Many", false]]], "qwen": [1913, 69, 0.0012803024146705866, [[4220, 0.13774, " These", false], [576, 0.116353, " The", false], [1988, 0.048123, " But", false], [1096, 0.045986, " This", false], [4421, 0.042403, "---", false], [2009, 0.032058, " All", false], [758, 0.031777, " In", false], [2619, 0.024885, " There", false], [1084, 0.022443, " It", false], [2240, 0.019998, " None", false]]]}, "raw_delta": 0.02978038787841797, "tuned_delta": 0.03835217990899622}, {"byte_start": 3403, "byte_end": 3407, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 576, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "2.87% 2.87% 2.87% 2.87%", "qwen": "3.02% 3.02% 3.02% 3.02%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.5254470109939575]], "qwen": [[279, " the", "normal", 0.5120087265968323]]}, "loss": {"rwkv": 2.8705968220813114, "qwen": 3.0179988525695527}, "topk": {"rwkv": [22590, 1, 0.5254470109939575, [[22590, 0.525447, " the", false], [332, 0.072098, " a", false], [32234, 0.050453, " this", false], [50987, 0.044821, " average", false], [22615, 0.042635, " top", false], [22226, 0.03378, " one", false], [30719, 0.014834, " each", false], [39931, 0.012789, " their", false], [32227, 0.012635, " that", false], [34514, 0.012627, "going", false]]], "qwen": [279, 1, 0.5120087265968323, [[279, 0.512009, " the", false], [825, 0.077259, " one", false], [264, 0.065043, " a", false], [419, 0.062111, " this", false], [5567, 0.028102, " paper", false], [5461, 0.020084, " average", false], [1493, 0.013356, " these", false], [10778, 0.012195, " hearing", false], [429, 0.010967, " that", false], [1181, 0.010632, " its", false]]]}, "raw_delta": -0.008173704147338867, "tuned_delta": 0.00039808788323938103}, {"byte_start": 3407, "byte_end": 3413, "display": {"text": " other", "kind": "normal"}, "is_word": true, "word_id": 577, "word_key": " other", "bytes_hex": "20 6f 74 68 65 72", "compression": {"rwkv": "2.29% 2.29% 2.29% 2.29% 2.29% 2.29%", "qwen": "3.91% 3.91% 3.91% 3.91% 3.91% 3.91%"}, "model_tokens": {"rwkv": [[39193, " other", "normal", 0.470399409532547]], "qwen": [[1008, " other", "normal", 0.2723727226257324]]}, "loss": {"rwkv": 2.289433048285708, "qwen": 3.909053865388579}, "topk": {"rwkv": [39193, 1, 0.470399409532547, [[39193, 0.470399, " other", false], [40190, 0.138401, " whole", false], [37815, 0.064786, " basis", false], [22226, 0.032974, " one", false], [30807, 0.018048, " face", false], [53064, 0.016245, " surface", false], [38499, 0.011105, " first", false], [19678, 0.007489, " DAR", false], [21509, 0.005219, " day", false], [30218, 0.005181, " back", false]]], "qwen": [1008, 1, 0.2723727226257324, [[1008, 0.272373, " other", false], [825, 0.128202, " one", false], [8037, 0.101598, " basis", false], [4361, 0.084979, " whole", false], [7329, 0.062224, " surface", false], [1156, 0.035604, " first", false], [1899, 0.020541, " day", false], [3579, 0.019704, " face", false], [8170, 0.016435, " strength", false], [24335, 0.007199, " assumption", false]]]}, "raw_delta": -0.08981084823608398, "tuned_delta": -0.08123905620550574}, {"byte_start": 3413, "byte_end": 3418, "display": {"text": " side", "kind": "normal"}, "is_word": true, "word_id": 578, "word_key": " side", "bytes_hex": "20 73 69 64 65", "compression": {"rwkv": "2.78% 2.78% 2.78% 2.78% 2.78%", "qwen": "13.41% 13.41% 13.41% 13.41% 13.41%"}, "model_tokens": {"rwkv": [[32011, " side", "normal", 0.4629760682582855]], "qwen": [[3108, " side", "normal", 0.024280866608023643]]}, "loss": {"rwkv": 2.7754972954602124, "qwen": 13.410090946877716}, "topk": {"rwkv": [32011, 2, 0.4629760682582855, [[31044, 0.514676, " hand", false], [32011, 0.462976, " side", false], [21616, 0.014103, " end", false], [45, 0.001928, ",", false], [32207, 0.000888, " team", false], [51699, 0.000887, " extreme", false], [32462, 0.000323, " were", false], [38559, 0.000305, " front", false], [22748, 0.000162, " was", false], [25548, 0.000155, "hand", false]]], "qwen": [3108, 2, 0.024280866608023643, [[1424, 0.966155, " hand", false], [3108, 0.024281, " side", false], [835, 0.005734, " end", false], [14226, 0.000471, " extreme", false], [6078, 0.000411, " hands", false], [1616, 0.000195, " way", false], [11, 0.000186, ",", false], [3579, 0.000149, " face", false], [24413, 8.5e-05, "-hand", false], [1030, 7.4e-05, " had", false]]]}, "raw_delta": -0.5897070884704589, "tuned_delta": -0.5811352964398807}, {"byte_start": 3418, "byte_end": 3423, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 579, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"rwkv": "4.03% 4.03% 4.03% 4.03% 4.03%", "qwen": "5.26% 5.26% 5.26% 5.26% 5.26%"}, "model_tokens": {"rwkv": [[32462, " were", "normal", 0.31780949234962463]], "qwen": [[1033, " were", "normal", 0.23232492804527283]]}, "loss": {"rwkv": 4.029402164982847, "qwen": 5.26446031571068}, "topk": {"rwkv": [32462, 1, 0.31780949234962463, [[32462, 0.317809, " were", false], [45, 0.316057, ",", false], [22748, 0.181299, " was", false], [4706, 0.149667, " of", false], [39934, 0.017661, " there", false], [39826, 0.005139, " stood", false], [22590, 0.001342, " the", false], [275, 0.001303, " (", false], [4858, 0.001141, " we", false], [5346, 0.000915, "---", false]]], "qwen": [1033, 2, 0.23232492804527283, [[315, 0.490659, " of", false], [1033, 0.232325, " were", false], [11, 0.166032, ",", false], [572, 0.082803, " was", false], [1052, 0.011907, " there", false], [14638, 0.003368, " stood", false], [320, 0.001514, " (", false], [7578, 0.001177, " sat", false], [582, 0.001015, " we", false], [279, 0.000952, " the", false]]]}, "raw_delta": -0.06848616600036622, "tuned_delta": -0.05991437396978797}, {"byte_start": 3423, "byte_end": 3429, "display": {"text": " newer", "kind": "normal"}, "is_word": true, "word_id": 580, "word_key": " newer", "bytes_hex": "20 6e 65 77 65 72", "compression": {"rwkv": "26.30% 26.30% 26.30% 26.30% 26.30% 26.30%", "qwen": "26.07% 26.07% 26.07% 26.07% 26.07% 26.07%"}, "model_tokens": {"rwkv": [[39116, " newer", "normal", 0.00016174896154552698]], "qwen": [[25546, " newer", "normal", 0.00017089667380787432]]}, "loss": {"rwkv": 26.299128349538393, "qwen": 26.072059655604225}, "topk": {"rwkv": [39116, 270, 0.00016174896154552698, [[52224, 0.239662, " methods", false], [22590, 0.121987, " the", false], [63843, 0.11326, " researchers", false], [332, 0.042692, " a", false], [61590, 0.022408, " approaches", false], [39944, 0.019127, " those", false], [39904, 0.018869, " teams", false], [51566, 0.01637, " efforts", false], [62633, 0.016064, " techniques", false], [53087, 0.014074, " systems", false]]], "qwen": [25546, 334, 0.00017089667380787432, [[5413, 0.14978, " methods", false], [279, 0.096848, " the", false], [264, 0.049531, " a", false], [29728, 0.035675, " neural", false], [1378, 0.033291, " two", false], [11811, 0.032846, " researchers", false], [5942, 0.031073, " systems", false], [4586, 0.021922, " general", false], [7468, 0.021892, " programs", false], [1657, 0.021721, " many", false]]]}, "raw_delta": 0.012591361999511719, "tuned_delta": 0.02116315403008997}, {"byte_start": 3429, "byte_end": 3437, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 581, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "1.51% 1.51% 1.51% 1.51% 1.51% 1.51% 1.51% 1.51%", "qwen": "1.34% 1.34% 1.34% 1.34% 1.34% 1.34% 1.34% 1.34%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.5125495791435242]], "qwen": [[5413, " methods", "normal", 0.5520504713058472]]}, "loss": {"rwkv": 1.514548016558238, "qwen": 1.3392624926301873}, "topk": {"rwkv": [52224, 1, 0.5125495791435242, [[52224, 0.51255, " methods", false], [45, 0.124348, ",", false], [61590, 0.109964, " approaches", false], [62633, 0.056274, " techniques", false], [38378, 0.041541, " entra", false], [21265, 0.024336, " and", false], [63843, 0.012209, " researchers", false], [57103, 0.009618, " research", false], [4404, 0.00684, " ``", false], [51566, 0.005897, " efforts", false]]], "qwen": [5413, 1, 0.5520504713058472, [[5413, 0.55205, " methods", false], [11, 0.132193, ",", false], [19827, 0.082683, " approaches", false], [12538, 0.043585, " techniques", false], [5942, 0.030773, " systems", false], [323, 0.017067, " and", false], [4586, 0.011913, " general", false], [7468, 0.010526, " programs", false], [9902, 0.006363, " ``", false], [11811, 0.005818, " researchers", false]]]}, "raw_delta": 0.009719893336296082, "tuned_delta": 0.01829168536687433}, {"byte_start": 3437, "byte_end": 3442, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 582, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "2.93% 2.93% 2.93% 2.93% 2.93%", "qwen": "2.18% 2.18% 2.18% 2.18% 2.18%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.4417383074760437]], "qwen": [[429, " that", "normal", 0.5460522174835205]]}, "loss": {"rwkv": 2.930474301805707, "qwen": 2.182222718369164}, "topk": {"rwkv": [32227, 1, 0.4417383074760437, [[32227, 0.441738, " that", false], [37810, 0.227342, " based", false], [45, 0.107697, ",", false], [4706, 0.039301, " of", false], [5346, 0.019834, "---", false], [40085, 0.017174, " using", false], [32139, 0.011853, " such", false], [21700, 0.011562, " for", false], [275, 0.009923, " (", false], [31296, 0.006963, " like", false]]], "qwen": [429, 1, 0.5460522174835205, [[429, 0.546052, " that", false], [3118, 0.155059, " based", false], [11, 0.141318, ",", false], [4421, 0.023036, "---", false], [320, 0.012567, " (", false], [315, 0.011942, " of", false], [1667, 0.009367, " using", false], [1741, 0.009027, " such", false], [1075, 0.008867, " like", false], [892, 0.007434, " which", false]]]}, "raw_delta": 0.04149187803268434, "tuned_delta": 0.05006367006326259}, {"byte_start": 3442, "byte_end": 3447, "display": {"text": " were", "kind": "normal"}, "is_word": true, "word_id": 583, "word_key": " were", "bytes_hex": "20 77 65 72 65", "compression": {"rwkv": "8.28% 8.28% 8.28% 8.28% 8.28%", "qwen": "7.93% 7.93% 7.93% 7.93% 7.93%"}, "model_tokens": {"rwkv": [[32462, " were", "normal", 0.10054638981819153]], "qwen": [[1033, " were", "normal", 0.1108400747179985]]}, "loss": {"rwkv": 8.284225430104593, "qwen": 7.933621598055672}, "topk": {"rwkv": [32462, 3, 0.10054638981819153, [[32354, 0.152801, " used", false], [32272, 0.116563, " took", false], [32462, 0.100546, " were", false], [21532, 0.055004, " did", false], [56540, 0.046257, " leverage", false], [31351, 0.038582, " made", false], [57510, 0.036171, " utilized", false], [47054, 0.034577, " relied", false], [21795, 0.019937, " had", false], [50937, 0.01773, " applied", false]]], "qwen": [1033, 2, 0.1108400747179985, [[1483, 0.118791, " used", false], [1033, 0.11084, " were", false], [3867, 0.110069, " took", false], [1521, 0.06304, " did", false], [27505, 0.052365, " lever", false], [39913, 0.052317, " relied", false], [1865, 0.034872, " made", false], [33616, 0.033021, " utilized", false], [9251, 0.020661, " applied", false], [50663, 0.019668, " exploited", false]]]}, "raw_delta": 0.019441604614257812, "tuned_delta": 0.028013396644836062}, {"byte_start": 3447, "byte_end": 3452, "display": {"text": " more", "kind": "normal"}, "is_word": true, "word_id": 584, "word_key": " more", "bytes_hex": "20 6d 6f 72 65", "compression": {"rwkv": "10.43% 10.43% 10.43% 10.43% 10.43%", "qwen": "10.64% 10.64% 10.64% 10.64% 10.64%"}, "model_tokens": {"rwkv": [[31458, " more", "normal", 0.05520031973719597]], "qwen": [[803, " more", "normal", 0.052396297454833984]]}, "loss": {"rwkv": 10.425725881424148, "qwen": 10.635978111756948}, "topk": {"rwkv": [31458, 2, 0.05520031973719597, [[37810, 0.26754, " based", false], [31458, 0.0552, " more", false], [22187, 0.055078, " not", false], [31466, 0.020558, " much", false], [63541, 0.020256, " essentially", false], [46957, 0.017689, " purely", false], [47202, 0.013153, " search", false], [31277, 0.011647, " less", false], [47285, 0.010488, " simply", false], [31198, 0.009328, " just", false]]], "qwen": [803, 3, 0.052396297454833984, [[3118, 0.30488, " based", false], [537, 0.055778, " not", false], [803, 0.052396, " more", false], [2686, 0.026301, " less", false], [1753, 0.025835, " much", false], [15791, 0.021092, " essentially", false], [4586, 0.016136, " general", false], [2711, 0.015008, " search", false], [13771, 0.01305, " largely", false], [1602, 0.011742, " very", false]]]}, "raw_delta": -0.011658859252929643, "tuned_delta": -0.003087067222351395}, {"byte_start": 3452, "byte_end": 3464, "display": {"text": " statistical", "kind": "normal"}, "is_word": true, "word_id": 585, "word_key": " statistical", "bytes_hex": "20 73 74 61 74 69 73 74 69 63 61 6c", "compression": {"rwkv": "8.17% 8.17% 8.17% 8.17% 8.17% 8.17% 8.17% 8.17% 8.17% 8.17% 8.17% 8.17%", "qwen": "9.61% 9.61% 9.61% 9.61% 9.61% 9.61% 9.61% 9.61% 9.61% 9.61% 9.61% 9.61%"}, "model_tokens": {"rwkv": [[63885, " statistical", "normal", 0.004327341448515654]], "qwen": [[28464, " statistical", "normal", 0.0016723305452615023]]}, "loss": {"rwkv": 8.171514880035144, "qwen": 9.608254362371156}, "topk": {"rwkv": [63885, 34, 0.004327341448515654, [[51832, 0.309702, " general", false], [31296, 0.098105, " like", false], [30579, 0.026066, " data", false], [59758, 0.025707, " generally", false], [59593, 0.024248, " effective", false], [4715, 0.020687, " or", false], [64862, 0.018046, " computational", false], [4596, 0.015982, " in", false], [52906, 0.014617, " similar", false], [37810, 0.014523, " based", false]]], "qwen": [28464, 55, 0.0016723305452615023, [[4586, 0.515447, " general", false], [1075, 0.03594, " like", false], [2711, 0.024862, " search", false], [3716, 0.018841, " comput", false], [476, 0.016976, " or", false], [7373, 0.016174, " effective", false], [54480, 0.015547, " computational", false], [13954, 0.014393, " generic", false], [3118, 0.013251, " based", false], [31499, 0.012603, " suited", false]]]}, "raw_delta": -0.07966975371042884, "tuned_delta": -0.0710979616798506}, {"byte_start": 3464, "byte_end": 3467, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 586, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "7.51% 7.51% 7.51%", "qwen": "7.96% 7.96% 7.96%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.28507310152053833]], "qwen": [[304, " in", "normal", 0.26591023802757263]]}, "loss": {"rwkv": 7.514036671296684, "qwen": 7.962453486240692}, "topk": {"rwkv": [4596, 2, 0.28507310152053833, [[45, 0.334784, ",", false], [4596, 0.285073, " in", false], [21265, 0.188728, " and", false], [47, 0.067821, ".", false], [5346, 0.03041, "---", false], [275, 0.024674, " (", false], [4715, 0.013308, " or", false], [32226, 0.008372, " than", false], [21400, 0.006468, " but", false], [59, 0.00586, ":", false]]], "qwen": [304, 1, 0.26591023802757263, [[304, 0.26591, " in", false], [11, 0.261915, ",", false], [323, 0.217155, " and", false], [4421, 0.069411, "---", false], [13, 0.061853, ".", false], [320, 0.038152, " (", false], [714, 0.021823, " but", false], [476, 0.011689, " or", false], [25, 0.009083, ":", false], [26, 0.005756, ";", false]]]}, "raw_delta": -0.02486550807952881, "tuned_delta": -0.01629371604895056}, {"byte_start": 3467, "byte_end": 3474, "display": {"text": " nature", "kind": "normal"}, "is_word": true, "word_id": 587, "word_key": " nature", "bytes_hex": "20 6e 61 74 75 72 65", "compression": {"rwkv": "0.78% 0.78% 0.78% 0.78% 0.78% 0.78% 0.78%", "qwen": "0.58% 0.58% 0.58% 0.58% 0.58% 0.58% 0.58%"}, "model_tokens": {"rwkv": [[46642, " nature", "normal", 0.7380651235580444]], "qwen": [[6993, " nature", "normal", 0.7982470989227295]]}, "loss": {"rwkv": 0.7799167527127138, "qwen": 0.5805226393643393}, "topk": {"rwkv": [46642, 1, 0.7380651235580444, [[46642, 0.738065, " nature", false], [55532, 0.066161, " approach", false], [59284, 0.065103, " character", false], [39931, 0.040284, " their", false], [46004, 0.027238, " flavor", false], [47362, 0.013647, " spirit", false], [22590, 0.012682, " the", false], [63735, 0.005605, " orientation", false], [32227, 0.0027, " that", false], [30899, 0.002066, " form", false]]], "qwen": [6993, 1, 0.7982470989227295, [[6993, 0.798247, " nature", false], [3668, 0.055633, " character", false], [17172, 0.04214, " flavor", false], [5486, 0.025221, " approach", false], [862, 0.024129, " their", false], [8913, 0.007035, " spirit", false], [279, 0.005846, " the", false], [16725, 0.004318, " orientation", false], [1352, 0.003448, " form", false], [5244, 0.003247, " focus", false]]]}, "raw_delta": 0.011056757399014064, "tuned_delta": 0.01962854942959231}, {"byte_start": 3474, "byte_end": 3478, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 588, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "6.97% 6.97% 6.97% 6.97%", "qwen": "7.11% 7.11% 7.11% 7.11%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.21052032709121704]], "qwen": [[323, " and", "normal", 0.20663084089756012]]}, "loss": {"rwkv": 6.9739652855472345, "qwen": 7.108976503486595}, "topk": {"rwkv": [21265, 2, 0.21052032709121704, [[45, 0.456307, ",", false], [21265, 0.21052, " and", false], [47, 0.20057, ".", false], [5346, 0.048755, "---", false], [275, 0.039368, " (", false], [21400, 0.013839, " but", false], [59, 0.010156, ":", false], [60, 0.006548, ";", false], [4715, 0.001868, " or", false], [32227, 0.001345, " that", false]]], "qwen": [323, 3, 0.20663084089756012, [[11, 0.348995, ",", false], [13, 0.261467, ".", false], [323, 0.206631, " and", false], [4421, 0.067034, "---", false], [320, 0.041091, " (", false], [714, 0.02972, " but", false], [25, 0.015691, ":", false], [26, 0.008932, ";", false], [429, 0.004058, " that", false], [313, 0.001818, "--", false]]]}, "raw_delta": -0.007486611604690552, "tuned_delta": 0.0010851804258876965}, {"byte_start": 3478, "byte_end": 3482, "display": {"text": " did", "kind": "normal"}, "is_word": true, "word_id": 589, "word_key": " did", "bytes_hex": "20 64 69 64", "compression": {"rwkv": "11.91% 11.91% 11.91% 11.91%", "qwen": "12.47% 12.47% 12.47% 12.47%"}, "model_tokens": {"rwkv": [[21532, " did", "normal", 0.07148892432451248]], "qwen": [[1521, " did", "normal", 0.06296456605195999]]}, "loss": {"rwkv": 11.905051851085684, "qwen": 12.466612827357629}, "topk": {"rwkv": [21532, 2, 0.07148892432451248, [[32227, 0.161816, " that", false], [21532, 0.071489, " did", false], [32354, 0.067243, " used", false], [37810, 0.054365, " based", false], [32462, 0.050358, " were", false], [31458, 0.047804, " more", false], [31277, 0.02681, " less", false], [21795, 0.024628, " had", false], [31351, 0.023634, " made", false], [47054, 0.022225, " relied", false]]], "qwen": [1521, 2, 0.06296456605195999, [[429, 0.120831, " that", false], [1521, 0.062965, " did", false], [1033, 0.058103, " were", false], [3867, 0.057854, " took", false], [11, 0.035677, ",", false], [1483, 0.033562, " used", false], [1865, 0.031942, " made", false], [39913, 0.028828, " relied", false], [892, 0.023499, " which", false], [1030, 0.023368, " had", false]]]}, "raw_delta": -0.0311395525932312, "tuned_delta": -0.02256776056265295}, {"byte_start": 3482, "byte_end": 3487, "display": {"text": " much", "kind": "normal"}, "is_word": true, "word_id": 590, "word_key": " much", "bytes_hex": "20 6d 75 63 68", "compression": {"rwkv": "22.32% 22.32% 22.32% 22.32% 22.32%", "qwen": "20.84% 20.84% 20.84% 20.84% 20.84%"}, "model_tokens": {"rwkv": [[31466, " much", "normal", 0.002074274467304349]], "qwen": [[1753, " much", "normal", 0.0030921902507543564]]}, "loss": {"rwkv": 22.31668891375115, "qwen": 20.84288874666184}, "topk": {"rwkv": [31466, 4, 0.002074274467304349, [[22187, 0.971966, " not", false], [30211, 0.004615, " away", false], [4692, 0.00315, " no", false], [31466, 0.002074, " much", false], [31277, 0.001834, " less", false], [46454, 0.001438, " little", false], [31458, 0.0013, " more", false], [332, 0.001027, " a", false], [45301, 0.000947, " better", false], [31856, 0.000638, " rely", false]]], "qwen": [1753, 4, 0.0030921902507543564, [[537, 0.949856, " not", false], [264, 0.004543, " a", false], [2664, 0.00393, " better", false], [1753, 0.003092, " much", false], [2686, 0.00274, " less", false], [1632, 0.002697, " well", false], [1373, 0.002249, " require", false], [2632, 0.001887, " little", false], [803, 0.001702, " more", false], [1602, 0.001505, " very", false]]]}, "raw_delta": 0.08172483444213863, "tuned_delta": 0.09029662647271687}, {"byte_start": 3487, "byte_end": 3492, "display": {"text": " more", "kind": "normal"}, "is_word": true, "word_id": 591, "word_key": " more", "bytes_hex": "20 6d 6f 72 65", "compression": {"rwkv": "9.19% 9.19% 9.19% 9.19% 9.19%", "qwen": "5.78% 5.78% 5.78% 5.78% 5.78%"}, "model_tokens": {"rwkv": [[31458, " more", "normal", 0.07819143682718277]], "qwen": [[803, " more", "normal", 0.20147407054901123]]}, "loss": {"rwkv": 9.185909830660195, "qwen": 5.778335017442954}, "topk": {"rwkv": [31458, 3, 0.07819143682718277, [[45301, 0.566712, " better", false], [31277, 0.246108, " less", false], [31458, 0.078191, " more", false], [4706, 0.027247, " of", false], [32487, 0.017617, " with", false], [22590, 0.015422, " the", false], [4811, 0.010659, " to", false], [45, 0.004582, ",", false], [4715, 0.003168, " or", false], [38475, 0.002385, " fewer", false]]], "qwen": [803, 3, 0.20147407054901123, [[2686, 0.413826, " less", false], [2664, 0.293949, " better", false], [803, 0.201474, " more", false], [315, 0.03732, " of", false], [10960, 0.006383, " worse", false], [448, 0.00482, " with", false], [311, 0.004143, " to", false], [11, 0.003658, ",", false], [6832, 0.003465, " learning", false], [279, 0.003133, " the", false]]]}, "raw_delta": 0.1889560699462891, "tuned_delta": 0.19752786197686736}, {"byte_start": 3492, "byte_end": 3504, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 592, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "3.50% 3.50% 3.50% 3.50% 3.50% 3.50% 3.50% 3.50% 3.50% 3.50% 3.50% 3.50%", "qwen": "1.86% 1.86% 1.86% 1.86% 1.86% 1.86% 1.86% 1.86% 1.86% 1.86% 1.86% 1.86%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.0981467068195343]], "qwen": [[34447, " computation", "normal", 0.2901773154735565]]}, "loss": {"rwkv": 3.4987233250725183, "qwen": 1.8593682153775188}, "topk": {"rwkv": [63370, 2, 0.0981467068195343, [[32487, 0.277294, " with", false], [63370, 0.098147, " computation", false], [4811, 0.049486, " to", false], [51832, 0.041776, " general", false], [4706, 0.032036, " of", false], [32499, 0.024771, " work", false], [56537, 0.024551, " learning", false], [52195, 0.01695, " massive", false], [47202, 0.015255, " search", false], [63507, 0.01412, " effectively", false]]], "qwen": [34447, 1, 0.2901773154735565, [[34447, 0.290177, " computation", false], [15039, 0.145217, " searching", false], [2711, 0.081705, " search", false], [315, 0.0751, " of", false], [448, 0.05351, " with", false], [24231, 0.031271, " computing", false], [6832, 0.022954, " learning", false], [4586, 0.018643, " general", false], [975, 0.017757, " work", false], [311, 0.01145, " to", false]]]}, "raw_delta": 0.09090514977773033, "tuned_delta": 0.09947694180830857}, {"byte_start": 3504, "byte_end": 3505, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "32.97%", "qwen": "45.12%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.1606893539428711]], "qwen": [[11, ",", "normal", 0.08190564066171646]]}, "loss": {"rwkv": 32.9678358953142, "qwen": 45.12366854832176}, "topk": {"rwkv": [45, 2, 0.1606893539428711, [[47, 0.49463, ".", false], [45, 0.160689, ",", false], [5346, 0.049153, "---", false], [275, 0.044913, " (", false], [4596, 0.033058, " in", false], [4811, 0.028661, " to", false], [4712, 0.021897, " on", false], [22278, 0.020443, " per", false], [21265, 0.017576, " and", false], [32226, 0.017341, " than", false]]], "qwen": [11, 2, 0.08190564066171646, [[13, 0.583414, ".", false], [11, 0.081906, ",", false], [1091, 0.070011, " than", false], [4421, 0.039688, "---", false], [320, 0.033191, " (", false], [304, 0.031476, " in", false], [817, 0.024267, " per", false], [389, 0.023708, " on", false], [311, 0.02129, " to", false], [323, 0.013687, " and", false]]]}, "raw_delta": -0.6740624904632568, "tuned_delta": -0.6654906984326786}, {"byte_start": 3505, "byte_end": 3511, "display": {"text": " based", "kind": "normal"}, "is_word": true, "word_id": 593, "word_key": " based", "bytes_hex": "20 62 61 73 65 64", "compression": {"rwkv": "12.96% 12.96% 12.96% 12.96% 12.96% 12.96%", "qwen": "13.62% 13.62% 13.62% 13.62% 13.62% 13.62%"}, "model_tokens": {"rwkv": [[37810, " based", "normal", 0.013464839197695255]], "qwen": [[3118, " based", "normal", 0.01076422818005085]]}, "loss": {"rwkv": 12.96171325798678, "qwen": 13.620024149393167}, "topk": {"rwkv": [37810, 13, 0.013464839197695255, [[21400, 0.256003, " but", false], [21265, 0.090732, " and", false], [59841, 0.056641, " including", false], [40085, 0.034153, " using", false], [4596, 0.02781, " in", false], [40186, 0.022788, " which", false], [32487, 0.018737, " with", false], [61953, 0.01661, " especially", false], [30322, 0.016132, " both", false], [55495, 0.01419, " although", false]]], "qwen": [3118, 12, 0.01076422818005085, [[714, 0.261164, " but", false], [323, 0.184254, " and", false], [2670, 0.10632, " including", false], [1741, 0.029872, " such", false], [5310, 0.020441, " especially", false], [448, 0.019934, " with", false], [892, 0.018584, " which", false], [304, 0.01769, " in", false], [7892, 0.014641, " although", false], [1667, 0.014108, " using", false]]]}, "raw_delta": -0.036504507064819336, "tuned_delta": -0.027932715034241086}, {"byte_start": 3511, "byte_end": 3514, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 594, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"rwkv": "0.57% 0.57% 0.57%", "qwen": "0.84% 0.84% 0.84%"}, "model_tokens": {"rwkv": [[4712, " on", "normal", 0.9089198112487793]], "qwen": [[389, " on", "normal", 0.8698983192443848]]}, "loss": {"rwkv": 0.572358262071427, "qwen": 0.8378387436300176}, "topk": {"rwkv": [4712, 1, 0.9089198112487793, [[4712, 0.90892, " on", false], [4596, 0.01225, " in", false], [32350, 0.011141, " upon", false], [52094, 0.008452, " largely", false], [46495, 0.007784, " mainly", false], [60247, 0.005817, " primarily", false], [45, 0.005664, ",", false], [46602, 0.005173, " mostly", false], [31581, 0.003709, " only", false], [31458, 0.003253, " more", false]]], "qwen": [389, 1, 0.8698983192443848, [[389, 0.869898, " on", false], [304, 0.021619, " in", false], [11, 0.011789, ",", false], [13771, 0.010429, " largely", false], [438, 0.008155, " as", false], [10008, 0.005441, " mostly", false], [537, 0.005329, " not", false], [2987, 0.005026, " either", false], [15503, 0.004967, " primarily", false], [5193, 0.004075, " upon", false]]]}, "raw_delta": -0.01472136378288269, "tuned_delta": -0.006149571752304442}, {"byte_start": 3514, "byte_end": 3521, "display": {"text": " hidden", "kind": "normal"}, "is_word": true, "word_id": 595, "word_key": " hidden", "bytes_hex": "20 68 69 64 64 65 6e", "compression": {"rwkv": "9.62% 9.62% 9.62% 9.62% 9.62% 9.62% 9.62%", "qwen": "10.98% 10.98% 10.98% 10.98% 10.98% 10.98% 10.98%"}, "model_tokens": {"rwkv": [[46196, " hidden", "normal", 0.023908214643597603]], "qwen": [[8177, " hidden", "normal", 0.014072589576244354]]}, "loss": {"rwkv": 9.62065052378522, "qwen": 10.983872234296777}, "topk": {"rwkv": [46196, 6, 0.023908214643597603, [[22590, 0.178736, " the", false], [56537, 0.070708, " learning", false], [332, 0.058205, " a", false], [52195, 0.051162, " massive", false], [38864, 0.043341, " large", false], [46196, 0.023908, " hidden", false], [63885, 0.023092, " statistical", false], [62633, 0.017139, " techniques", false], [52224, 0.01643, " methods", false], [57453, 0.013904, " training", false]]], "qwen": [8177, 7, 0.014072589576244354, [[279, 0.121637, " the", false], [264, 0.052986, " a", false], [6832, 0.03322, " learning", false], [3460, 0.029745, " large", false], [4862, 0.026799, " training", false], [29728, 0.015595, " neural", false], [8177, 0.014073, " hidden", false], [12538, 0.012574, " techniques", false], [5662, 0.012055, " machine", false], [5413, 0.010144, " methods", false]]]}, "raw_delta": -0.07559306280953537, "tuned_delta": -0.06702127077895713}, {"byte_start": 3521, "byte_end": 3528, "display": {"text": " Markov", "kind": "normal"}, "is_word": true, "word_id": 596, "word_key": " markov", "bytes_hex": "20 4d 61 72 6b 6f 76", "compression": {"rwkv": "0.11% 0.11% 0.11% 0.11% 0.11% 0.11% 0.11%", "qwen": "0.37% 0.37% 0.37% 0.37% 0.37% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[44557, " Markov", "normal", 0.959473192691803]], "qwen": [[4389, " Mark", "normal", 0.9030137658119202], [859, "ov", "normal", 0.9992189407348633]]}, "loss": {"rwkv": 0.10692407093642042, "qwen": 0.2648345104151857}, "topk": {"rwkv": [44557, 1, 0.959473192691803, [[44557, 0.959473, " Markov", false], [46, 0.018457, "-", false], [31376, 0.008027, " mark", false], [60725, 0.002314, " variables", false], [40069, 0.001311, " units", false], [47398, 0.000993, " states", false], [57518, 0.000764, " variable", false], [39802, 0.000665, " state", false], [46587, 0.000534, " models", false], [275, 0.000464, " (", false]]], "qwen": [4389, 1, 0.9030137658119202, [[4389, 0.903014, " Mark", false], [1868, 0.035682, " mark", false], [5251, 0.009038, "-M", false], [28904, 0.007059, "-mark", false], [12, 0.006278, "-", false], [1448, 0.004914, "-m", false], [20733, 0.004111, "-state", false], [1584, 0.002487, " state", false], [8949, 0.001597, "Mark", false], [64096, 0.001461, "-memory", false]]]}, "raw_delta": -0.008756414072455043, "tuned_delta": -0.0001846220418767943}, {"byte_start": 3528, "byte_end": 3535, "display": {"text": " models", "kind": "normal"}, "is_word": true, "word_id": 597, "word_key": " models", "bytes_hex": "20 6d 6f 64 65 6c 73", "compression": {"rwkv": "0.15% 0.15% 0.15% 0.15% 0.15% 0.15% 0.15%", "qwen": "0.08% 0.08% 0.08% 0.08% 0.08% 0.08% 0.08%"}, "model_tokens": {"rwkv": [[46587, " models", "normal", 0.9444479942321777]], "qwen": [[4119, " models", "normal", 0.9691730737686157]]}, "loss": {"rwkv": 0.147177838818367, "qwen": 0.08066737789838634}, "topk": {"rwkv": [46587, 1, 0.9444479942321777, [[46587, 0.944448, " models", false], [39043, 0.015857, " model", false], [56658, 0.00883, " modeling", false], [46, 0.007083, "-", false], [45447, 0.003356, " chains", false], [21265, 0.003224, " and", false], [4715, 0.002533, " or", false], [44592, 0.00183, " Models", false], [60261, 0.001642, " processes", false], [275, 0.00117, " (", false]]], "qwen": [4119, 1, 0.9691730737686157, [[4119, 0.969173, " models", false], [1614, 0.012049, " model", false], [26874, 0.00448, " Models", false], [33479, 0.003152, " modeling", false], [476, 0.002071, " or", false], [26179, 0.001405, " chains", false], [28244, 0.001231, "-model", false], [323, 0.00104, " and", false], [11364, 0.000769, " processes", false], [4194, 0.000413, " random", false]]]}, "raw_delta": 0.00368812307715416, "tuned_delta": 0.012259915107732408}, {"byte_start": 3535, "byte_end": 3537, "display": {"text": " (", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "20 28", "compression": {"rwkv": "17.19% 17.19%", "qwen": "16.60% 16.60%"}, "model_tokens": {"rwkv": [[275, " (", "normal", 0.1487080305814743]], "qwen": [[320, " (", "normal", 0.15871939063072205]]}, "loss": {"rwkv": 17.188358885591164, "qwen": 16.59656013462283}, "topk": {"rwkv": [275, 4, 0.1487080305814743, [[47, 0.283415, ".", false], [21265, 0.247813, " and", false], [45, 0.190994, ",", false], [275, 0.148708, " (", false], [4715, 0.039965, " or", false], [4706, 0.01696, " of", false], [32227, 0.013779, " that", false], [5346, 0.012509, "---", false], [32487, 0.007722, " with", false], [21700, 0.006554, " for", false]]], "qwen": [320, 4, 0.15871939063072205, [[323, 0.328073, " and", false], [11, 0.233007, ",", false], [13, 0.175975, ".", false], [320, 0.158719, " (", false], [476, 0.035767, " or", false], [448, 0.013998, " with", false], [429, 0.010125, " that", false], [4421, 0.006499, "---", false], [315, 0.006206, " of", false], [369, 0.003851, " for", false]]]}, "raw_delta": 0.032816290855407715, "tuned_delta": 0.041388082885985965}, {"byte_start": 3537, "byte_end": 3541, "display": {"text": "HMMs", "kind": "normal"}, "is_word": true, "word_id": 598, "word_key": "hmms", "bytes_hex": "48 4d 4d 73", "compression": {"rwkv": "2.69% 2.69% 0.94% 0.94%", "qwen": "6.68% 0.03% 0.03% 2.60%"}, "model_tokens": {"rwkv": [[1082, "HM", "normal", 0.743228554725647], [1261, "Ms", "normal", 0.9010351896286011]], "qwen": [[39, "H", "normal", 0.6906211972236633], [8035, "MM", "normal", 0.9962831139564514], [82, "s", "normal", 0.8658856153488159]]}, "loss": {"rwkv": 1.818338171042303, "qwen": 2.334867245282211}, "topk": {"rwkv": [1082, 1, 0.743228554725647, [[1082, 0.743229, "HM", false], [36003, 0.023631, "which", false], [98, 0.02212, "a", false], [7005, 0.018637, "and", false], [1926, 0.014106, "hm", false], [2101, 0.01403, "or", false], [8695, 0.011904, "see", false], [8801, 0.009683, "the", false], [27142, 0.006171, "that", false], [58443, 0.005013, "statistic", false]]], "qwen": [39, 1, 0.6906211972236633, [[39, 0.690621, "H", false], [8206, 0.047421, "which", false], [437, 0.039519, "and", false], [64, 0.024801, "a", false], [269, 0.016491, "or", false], [1782, 0.01081, "the", false], [258, 0.009388, "in", false], [71, 0.008746, "h", false], [300, 0.006994, "as", false], [4197, 0.006513, "with", false]]]}, "raw_delta": -0.028642453718930483, "tuned_delta": -0.020070661688352233}, {"byte_start": 3541, "byte_end": 3543, "display": {"text": ").", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29 2e", "compression": {"rwkv": "7.22% 7.22%", "qwen": "9.13% 9.13%"}, "model_tokens": {"rwkv": [[499, ").", "normal", 0.44534578919410706]], "qwen": [[568, ").", "normal", 0.3631744682788849]]}, "loss": {"rwkv": 7.220519613824157, "qwen": 9.132908647273922}, "topk": {"rwkv": [499, 1, 0.44534578919410706, [[499, 0.445346, ").", false], [42, 0.328558, ")", false], [497, 0.201617, "),", false], [5308, 0.008746, ")--", false], [45, 0.005604, ",", false], [502, 0.002893, ");", false], [60, 0.001664, ";", false], [5346, 0.0007, "---", false], [21700, 0.000687, " for", false], [501, 0.000635, "):", false]]], "qwen": [568, 2, 0.3631744682788849, [[8, 0.385691, ")", false], [568, 0.363174, ").", false], [701, 0.229154, "),", false], [11, 0.006967, ",", false], [3593, 0.002974, ").\n\n", false], [1215, 0.002065, ");", false], [29621, 0.001574, ")--", false], [26, 0.001246, ";", false], [323, 0.001242, " and", false], [4421, 0.000941, "---", false]]]}, "raw_delta": -0.10604536533355713, "tuned_delta": -0.09747357330297889}, {"byte_start": 3543, "byte_end": 3549, "display": {"text": " Again", "kind": "normal"}, "is_word": true, "word_id": 599, "word_key": " again", "bytes_hex": "20 41 67 61 69 6e", "compression": {"rwkv": "16.81% 16.81% 16.81% 16.81% 16.81% 16.81%", "qwen": "15.64% 15.64% 15.64% 15.64% 15.64% 15.64%"}, "model_tokens": {"rwkv": [[36251, " Again", "normal", 0.003723106812685728]], "qwen": [[13759, " Again", "normal", 0.005494527984410524]]}, "loss": {"rwkv": 16.812657052026328, "qwen": 15.641225889449453}, "topk": {"rwkv": [36251, 32, 0.003723106812685728, [[20996, 0.324433, " The", false], [37453, 0.087602, " These", false], [3866, 0.072985, " HM", false], [3913, 0.057136, " In", false], [3918, 0.026648, " It", false], [29894, 0.022694, " This", false], [3642, 0.019202, " At", false], [267, 0.018116, "  ", false], [37451, 0.016326, " There", false], [54829, 0.014108, " Although", false]]], "qwen": [13759, 31, 0.005494527984410524, [[576, 0.262557, " The", false], [4220, 0.073662, " These", false], [472, 0.071914, " H", false], [758, 0.057428, " In", false], [1096, 0.038843, " This", false], [1084, 0.028376, " It", false], [2411, 0.020486, " At", false], [2619, 0.016192, " There", false], [3197, 0.015853, " When", false], [3216, 0.014445, " By", false]]]}, "raw_delta": 0.06495793660481763, "tuned_delta": 0.07352972863539588}, {"byte_start": 3549, "byte_end": 3550, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "2.61%", "qwen": "3.05%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.865909218788147]], "qwen": [[11, ",", "normal", 0.8445719480514526]]}, "loss": {"rwkv": 2.606431470356037, "qwen": 3.0463466991666914}, "topk": {"rwkv": [45, 1, 0.865909218788147, [[45, 0.865909, ",", false], [22590, 0.047503, " the", false], [39934, 0.014524, " there", false], [21265, 0.009154, " and", false], [3866, 0.008656, " HM", false], [4601, 0.007596, " it", false], [4596, 0.005665, " in", false], [39936, 0.005091, " these", false], [32234, 0.003568, " this", false], [47202, 0.002804, " search", false]]], "qwen": [11, 1, 0.8445719480514526, [[11, 0.844572, ",", false], [279, 0.053969, " the", false], [1052, 0.015605, " there", false], [432, 0.015465, " it", false], [304, 0.009116, " in", false], [419, 0.005411, " this", false], [1493, 0.005168, " these", false], [323, 0.0044, " and", false], [264, 0.003203, " a", false], [11811, 0.002799, " researchers", false]]]}, "raw_delta": -0.02439408004283905, "tuned_delta": -0.0158222880122608}, {"byte_start": 3550, "byte_end": 3554, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 600, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "3.24% 3.24% 3.24% 3.24%", "qwen": "4.65% 4.65% 4.65% 4.65%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.49406540393829346]], "qwen": [[279, " the", "normal", 0.356892853975296]]}, "loss": {"rwkv": 3.240428314496695, "qwen": 4.645115963466906}, "topk": {"rwkv": [22590, 1, 0.49406540393829346, [[22590, 0.494065, " the", false], [3866, 0.06066, " HM", false], [39934, 0.046454, " there", false], [39936, 0.038909, " these", false], [38720, 0.034166, " human", false], [4601, 0.031346, " it", false], [4596, 0.021296, " in", false], [32234, 0.020433, " this", false], [63843, 0.015117, " researchers", false], [332, 0.012578, " a", false]]], "qwen": [279, 1, 0.356892853975296, [[279, 0.356893, " the", false], [432, 0.05677, " it", false], [3738, 0.041688, " human", false], [1052, 0.038032, " there", false], [304, 0.035916, " in", false], [472, 0.034717, " H", false], [1493, 0.033768, " these", false], [419, 0.021128, " this", false], [4124, 0.020707, " early", false], [438, 0.017895, " as", false]]]}, "raw_delta": -0.07789242267608643, "tuned_delta": -0.06932063064550818}, {"byte_start": 3554, "byte_end": 3566, "display": {"text": " statistical", "kind": "normal"}, "is_word": true, "word_id": 601, "word_key": " statistical", "bytes_hex": "20 73 74 61 74 69 73 74 69 63 61 6c", "compression": {"rwkv": "4.98% 4.98% 4.98% 4.98% 4.98% 4.98% 4.98% 4.98% 4.98% 4.98% 4.98% 4.98%", "qwen": "4.40% 4.40% 4.40% 4.40% 4.40% 4.40% 4.40% 4.40% 4.40% 4.40% 4.40% 4.40%"}, "model_tokens": {"rwkv": [[63885, " statistical", "normal", 0.03652314469218254]], "qwen": [[28464, " statistical", "normal", 0.05349557474255562]]}, "loss": {"rwkv": 4.978049294734053, "qwen": 4.400454877538232}, "topk": {"rwkv": [63885, 4, 0.03652314469218254, [[3866, 0.201409, " HM", false], [38720, 0.184401, " human", false], [38328, 0.046366, " early", false], [63885, 0.036523, " statistical", false], [52224, 0.034727, " methods", false], [47202, 0.030684, " search", false], [52013, 0.026483, " initial", false], [47798, 0.02279, " winner", false], [52964, 0.017055, " special", false], [63843, 0.01606, " researchers", false]]], "qwen": [28464, 4, 0.05349557474255562, [[3738, 0.136382, " human", false], [472, 0.068326, " H", false], [4124, 0.056395, " early", false], [28464, 0.053496, " statistical", false], [2856, 0.047444, " initial", false], [5413, 0.042712, " methods", false], [25546, 0.032433, " newer", false], [15271, 0.031915, " latter", false], [13632, 0.028531, " winner", false], [3281, 0.025215, " special", false]]]}, "raw_delta": 0.03202863534291587, "tuned_delta": 0.04060042737349412}, {"byte_start": 3566, "byte_end": 3574, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 602, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "0.63% 0.63% 0.63% 0.63% 0.63% 0.63% 0.63% 0.63%", "qwen": "0.92% 0.92% 0.92% 0.92% 0.92% 0.92% 0.92% 0.92%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.7541329860687256]], "qwen": [[5413, " methods", "normal", 0.664587140083313]]}, "loss": {"rwkv": 0.6295940882785698, "qwen": 0.9210465029849182}, "topk": {"rwkv": [52224, 1, 0.7541329860687256, [[52224, 0.754133, " methods", false], [55532, 0.056963, " approach", false], [61590, 0.045995, " approaches", false], [46561, 0.032751, " method", false], [45, 0.015164, ",", false], [46587, 0.014644, " models", false], [46, 0.01364, "-", false], [3866, 0.01118, " HM", false], [62633, 0.008179, " techniques", false], [32011, 0.005531, " side", false]]], "qwen": [5413, 1, 0.664587140083313, [[5413, 0.664587, " methods", false], [5486, 0.064661, " approach", false], [19827, 0.043287, " approaches", false], [1714, 0.034178, " method", false], [11, 0.026638, ",", false], [323, 0.014655, " and", false], [472, 0.014598, " H", false], [320, 0.013281, " (", false], [5980, 0.012254, "-based", false], [4119, 0.010203, " models", false]]]}, "raw_delta": -0.01616155356168747, "tuned_delta": -0.007589761531109221}, {"byte_start": 3574, "byte_end": 3578, "display": {"text": " won", "kind": "normal"}, "is_word": true, "word_id": 603, "word_key": " won", "bytes_hex": "20 77 6f 6e", "compression": {"rwkv": "3.84% 3.84% 3.84% 3.84%", "qwen": "8.76% 8.76% 8.76% 8.76%"}, "model_tokens": {"rwkv": [[22777, " won", "normal", 0.424134761095047]], "qwen": [[2765, " won", "normal", 0.1433647722005844]]}, "loss": {"rwkv": 3.839203111740649, "qwen": 8.7569921936927}, "topk": {"rwkv": [22777, 1, 0.424134761095047, [[22777, 0.424135, " won", false], [32462, 0.173788, " were", false], [46936, 0.039287, " proved", false], [45, 0.037533, ",", false], [61959, 0.026863, " eventually", false], [21795, 0.023217, " had", false], [60244, 0.01898, " prevailed", false], [21532, 0.01613, " did", false], [30256, 0.012252, " beat", false], [47211, 0.011561, " seemed", false]]], "qwen": [2765, 1, 0.1433647722005844, [[2765, 0.143365, " won", false], [1033, 0.120753, " were", false], [18651, 0.109853, " proved", false], [11, 0.049774, ",", false], [29701, 0.047198, " dominated", false], [9583, 0.046813, " eventually", false], [13653, 0.027808, " ultimately", false], [9382, 0.026061, " beat", false], [3118, 0.025765, " based", false], [1521, 0.018119, " did", false]]]}, "raw_delta": -0.27270013093948364, "tuned_delta": -0.2641283389089054}, {"byte_start": 3578, "byte_end": 3582, "display": {"text": " out", "kind": "normal"}, "is_word": true, "word_id": 604, "word_key": " out", "bytes_hex": "20 6f 75 74", "compression": {"rwkv": "10.43% 10.43% 10.43% 10.43%", "qwen": "13.68% 13.68% 13.68% 13.68%"}, "model_tokens": {"rwkv": [[22249, " out", "normal", 0.0996764749288559]], "qwen": [[700, " out", "normal", 0.048153363168239594]]}, "loss": {"rwkv": 10.425725881424148, "qwen": 13.675686334344915}, "topk": {"rwkv": [22249, 4, 0.0996764749288559, [[45, 0.271348, ",", false], [47, 0.190689, ".", false], [22590, 0.123692, " the", false], [22249, 0.099676, " out", false], [4450, 0.059841, " by", false], [4596, 0.040531, " in", false], [21265, 0.028968, " and", false], [5346, 0.026318, "---", false], [32234, 0.011701, " this", false], [21357, 0.010701, " big", false]]], "qwen": [700, 4, 0.048153363168239594, [[11, 0.257229, ",", false], [13, 0.197844, ".", false], [279, 0.160048, " the", false], [700, 0.048153, " out", false], [323, 0.043212, " and", false], [304, 0.038485, " in", false], [553, 0.02944, " by", false], [382, 0.023635, ".\n\n", false], [4421, 0.02173, "---", false], [419, 0.013421, " this", false]]]}, "raw_delta": -0.18021607398986816, "tuned_delta": -0.1716442819592899}, {"byte_start": 3582, "byte_end": 3587, "display": {"text": " over", "kind": "normal"}, "is_word": true, "word_id": 605, "word_key": " over", "bytes_hex": "20 6f 76 65 72", "compression": {"rwkv": "12.57% 12.57% 12.57% 12.57% 12.57%", "qwen": "13.65% 13.65% 13.65% 13.65% 13.65%"}, "model_tokens": {"rwkv": [[31601, " over", "normal", 0.030751002952456474]], "qwen": [[916, " over", "normal", 0.022708440199494362]]}, "loss": {"rwkv": 12.567226332743704, "qwen": 13.651568347301168}, "topk": {"rwkv": [31601, 6, 0.030751002952456474, [[45, 0.315893, ",", false], [47, 0.222139, ".", false], [4596, 0.14563, " in", false], [21265, 0.053644, " and", false], [4450, 0.03463, " by", false], [31601, 0.030751, " over", false], [61959, 0.029524, " eventually", false], [5346, 0.017705, "---", false], [51018, 0.011196, " because", false], [55925, 0.008306, " decisive", false]]], "qwen": [916, 6, 0.022708440199494362, [[11, 0.350947, ",", false], [13, 0.276182, ".", false], [304, 0.087414, " in", false], [323, 0.057563, " and", false], [382, 0.034446, ".\n\n", false], [916, 0.022708, " over", false], [4421, 0.021969, "---", false], [33022, 0.014341, " decis", false], [553, 0.013826, " by", false], [320, 0.01148, " (", false]]]}, "raw_delta": -0.06012868881225586, "tuned_delta": -0.05155689678167761}, {"byte_start": 3587, "byte_end": 3591, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 606, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "2.57% 2.57% 2.57% 2.57%", "qwen": "1.04% 1.04% 1.04% 1.04%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.569801390171051]], "qwen": [[279, " the", "normal", 0.7941256165504456]]}, "loss": {"rwkv": 2.571209423459334, "qwen": 1.0392525974289544}, "topk": {"rwkv": [22590, 1, 0.569801390171051, [[22590, 0.569801, " the", false], [32251, 0.230766, " time", false], [332, 0.040427, " a", false], [38720, 0.02062, " human", false], [52224, 0.018804, " methods", false], [39944, 0.015984, " those", false], [31370, 0.013614, " many", false], [31323, 0.008454, " long", false], [52869, 0.004427, " several", false], [3866, 0.004113, " HM", false]]], "qwen": [279, 1, 0.7941256165504456, [[279, 0.794126, " the", false], [678, 0.024315, " all", false], [882, 0.023916, " time", false], [264, 0.023365, " a", false], [3738, 0.019839, " human", false], [3281, 0.012307, " special", false], [1657, 0.00971, " many", false], [1846, 0.008672, " those", false], [5413, 0.006965, " methods", false], [803, 0.005373, " more", false]]]}, "raw_delta": 0.08494972437620163, "tuned_delta": 0.09352151640677987}, {"byte_start": 3591, "byte_end": 3597, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 607, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "2.79% 2.79% 2.79% 2.79% 2.79% 2.79%", "qwen": "4.50% 4.50% 4.50% 4.50% 4.50% 4.50%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.39809736609458923]], "qwen": [[3738, " human", "normal", 0.22361716628074646]]}, "loss": {"rwkv": 2.794282387138454, "qwen": 4.501869105482948}, "topk": {"rwkv": [38720, 1, 0.39809736609458923, [[38720, 0.398097, " human", false], [52224, 0.093048, " methods", false], [31458, 0.066597, " more", false], [52964, 0.041854, " special", false], [63875, 0.028607, " specialized", false], [31580, 0.019392, " ones", false], [39174, 0.019105, " older", false], [47202, 0.017081, " search", false], [59943, 0.015856, " knowledge", false], [3866, 0.014252, " HM", false]]], "qwen": [3738, 2, 0.22361716628074646, [[3281, 0.358286, " special", false], [3738, 0.223617, " human", false], [5413, 0.075183, " methods", false], [6540, 0.072806, " knowledge", false], [803, 0.040975, " more", false], [3800, 0.022162, " others", false], [27076, 0.0214, " specialized", false], [6788, 0.014749, " earlier", false], [1008, 0.01418, " other", false], [4124, 0.010068, " early", false]]]}, "raw_delta": -0.09468871355056763, "tuned_delta": -0.08611692151998938}, {"byte_start": 3597, "byte_end": 3607, "display": {"text": "-knowledge", "kind": "normal"}, "is_word": true, "word_id": 608, "word_key": "-knowledge", "bytes_hex": "2d 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "4.68% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13%", "qwen": "2.63% 2.63% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.7723766565322876], [58313, "knowledge", "normal", 0.9389006495475769]], "qwen": [[12646, "-k", "normal", 0.7466897964477539], [51186, "nowledge", "normal", 0.998958945274353]]}, "loss": {"rwkv": 0.5829248761404382, "qwen": 0.5286522461362759}, "topk": {"rwkv": [46, 1, 0.7723766565322876, [[46, 0.772377, "-", false], [59943, 0.128563, " knowledge", false], [52224, 0.05253, " methods", false], [61590, 0.00985, " approaches", false], [34864, 0.006816, "istic", false], [7919, 0.004152, "ist", false], [65034, 0.001804, " understanding", false], [46561, 0.001197, " method", false], [46587, 0.001169, " models", false], [55532, 0.001133, " approach", false]]], "qwen": [12646, 1, 0.7466897964477539, [[12646, 0.74669, "-k", false], [6540, 0.156835, " knowledge", false], [12, 0.014235, "-", false], [5980, 0.012712, "-based", false], [8660, 0.010945, " understanding", false], [71107, 0.010203, "-under", false], [5413, 0.004288, " methods", false], [35085, 0.002812, "-oriented", false], [50297, 0.002317, "-method", false], [3419, 0.00195, "-in", false]]]}, "raw_delta": 0.003009513637516648, "tuned_delta": 0.011581305668094895}, {"byte_start": 3607, "byte_end": 3613, "display": {"text": "-based", "kind": "normal"}, "is_word": true, "word_id": 609, "word_key": "-based", "bytes_hex": "2d 62 61 73 65 64", "compression": {"rwkv": "30.71% 0.46% 0.46% 0.46% 0.46% 0.46%", "qwen": "3.14% 3.14% 3.14% 3.14% 3.14% 3.14%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.1845637559890747], [34011, "based", "normal", 0.880551278591156]], "qwen": [[5980, "-based", "normal", 0.35163143277168274]]}, "loss": {"rwkv": 5.50050965703515, "qwen": 3.141383505864803}, "topk": {"rwkv": [46, 2, 0.1845637559890747, [[52224, 0.670292, " methods", false], [46, 0.184564, "-", false], [61590, 0.080086, " approaches", false], [37810, 0.017626, " based", false], [55532, 0.009256, " approach", false], [31580, 0.008055, " ones", false], [46561, 0.002841, " method", false], [45, 0.002271, ",", false], [51566, 0.001977, " efforts", false], [46587, 0.001846, " models", false]]], "qwen": [5980, 2, 0.35163143277168274, [[5413, 0.454863, " methods", false], [5980, 0.351631, "-based", false], [19827, 0.061546, " approaches", false], [3118, 0.04312, " based", false], [6174, 0.026549, " ones", false], [5486, 0.006416, " approach", false], [31405, 0.005861, "-driven", false], [12538, 0.002516, " techniques", false], [2331, 0.002066, " base", false], [35085, 0.002062, "-oriented", false]]]}, "raw_delta": 0.13081773122151694, "tuned_delta": 0.1393895232520952}, {"byte_start": 3613, "byte_end": 3621, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 610, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "0.66% 0.66% 0.66% 0.66% 0.66% 0.66% 0.66% 0.66%", "qwen": "0.44% 0.44% 0.44% 0.44% 0.44% 0.44% 0.44% 0.44%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.7432807087898254]], "qwen": [[5413, " methods", "normal", 0.8244560956954956]]}, "loss": {"rwkv": 0.6648161351752729, "qwen": 0.4351335400805226}, "topk": {"rwkv": [52224, 1, 0.7432807087898254, [[52224, 0.743281, " methods", false], [61590, 0.109698, " approaches", false], [31580, 0.089866, " ones", false], [55532, 0.009513, " approach", false], [51566, 0.00478, " efforts", false], [45, 0.004181, ",", false], [46561, 0.002382, " method", false], [47, 0.002334, ".", false], [63363, 0.002329, " competitors", false], [62633, 0.002109, " techniques", false]]], "qwen": [5413, 1, 0.8244560956954956, [[5413, 0.824456, " methods", false], [19827, 0.067382, " approaches", false], [6174, 0.052365, " ones", false], [5942, 0.006073, " systems", false], [5486, 0.005619, " approach", false], [8869, 0.00496, " efforts", false], [12538, 0.003728, " techniques", false], [3281, 0.003131, " special", false], [1714, 0.002541, " method", false], [11, 0.002202, ",", false]]]}, "raw_delta": 0.012736307457089424, "tuned_delta": 0.021308099487667674}, {"byte_start": 3621, "byte_end": 3622, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "14.37%", "qwen": "17.17%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.45558494329452515]], "qwen": [[13, ".", "normal", 0.38593173027038574]]}, "loss": {"rwkv": 14.370595133854907, "qwen": 17.169780459731708}, "topk": {"rwkv": [47, 1, 0.45558494329452515, [[47, 0.455585, ".", false], [45, 0.309949, ",", false], [4596, 0.058838, " in", false], [21265, 0.033201, " and", false], [4450, 0.031756, " by", false], [5346, 0.012278, "---", false], [275, 0.011693, " (", false], [51018, 0.010177, " because", false], [32227, 0.006678, " that", false], [37634, 0.004424, " after", false]]], "qwen": [13, 1, 0.38593173027038574, [[13, 0.385932, ".", false], [11, 0.298631, ",", false], [382, 0.07573, ".\n\n", false], [304, 0.050795, " in", false], [323, 0.034481, " and", false], [553, 0.020631, " by", false], [4421, 0.019415, "---", false], [320, 0.015519, " (", false], [26, 0.007749, ";", false], [518, 0.005623, " at", false]]]}, "raw_delta": -0.15521979331970215, "tuned_delta": -0.1466480012891239}, {"byte_start": 3622, "byte_end": 3627, "display": {"text": " This", "kind": "normal"}, "is_word": true, "word_id": 611, "word_key": " this", "bytes_hex": "20 54 68 69 73", "compression": {"rwkv": "10.03% 10.03% 10.03% 10.03% 10.03%", "qwen": "8.12% 8.12% 8.12% 8.12% 8.12%"}, "model_tokens": {"rwkv": [[29894, " This", "normal", 0.06170455738902092]], "qwen": [[1096, " This", "normal", 0.10536638647317886]]}, "loss": {"rwkv": 10.031238956181074, "qwen": 8.116282651710552}, "topk": {"rwkv": [29894, 4, 0.06170455738902092, [[261, 0.184556, "\n\n", false], [20996, 0.13913, " The", false], [3913, 0.075887, " In", false], [29894, 0.061705, " This", false], [19555, 0.033519, " But", false], [3918, 0.02886, " It", false], [267, 0.021632, "  ", false], [19417, 0.019461, " And", false], [300, 0.018988, " A", false], [37451, 0.018419, " There", false]]], "qwen": [1096, 2, 0.10536638647317886, [[576, 0.147242, " The", false], [1096, 0.105366, " This", false], [758, 0.077956, " In", false], [1084, 0.038441, " It", false], [2619, 0.034625, " There", false], [362, 0.023556, " A", false], [220, 0.023178, " ", false], [65694, 0.022903, " Statistical", false], [472, 0.021494, " H", false], [4220, 0.019384, " These", false]]]}, "raw_delta": 0.1061877250671387, "tuned_delta": 0.11475951709771694}, {"byte_start": 3627, "byte_end": 3631, "display": {"text": " led", "kind": "normal"}, "is_word": true, "word_id": 612, "word_key": " led", "bytes_hex": "20 6c 65 64", "compression": {"rwkv": "21.84% 21.84% 21.84% 21.84%", "qwen": "20.00% 20.00% 20.00% 20.00%"}, "model_tokens": {"rwkv": [[21994, " led", "normal", 0.0078525235876441]], "qwen": [[6069, " led", "normal", 0.01184548158198595]]}, "loss": {"rwkv": 21.837669075955986, "qwen": 19.99849735654479}, "topk": {"rwkv": [21994, 11, 0.0078525235876441, [[22748, 0.335846, " was", false], [32251, 0.127685, " time", false], [4600, 0.092788, " is", false], [63361, 0.060595, " competition", false], [52427, 0.04616, " pattern", false], [56348, 0.010858, " happened", false], [38328, 0.010419, " early", false], [53283, 0.010181, " victory", false], [22074, 0.009366, " may", false], [47092, 0.009033, " result", false]]], "qwen": [6069, 8, 0.01184548158198595, [[572, 0.290054, " was", false], [374, 0.138482, " is", false], [5383, 0.073053, " pattern", false], [882, 0.046901, " time", false], [9149, 0.018298, " trend", false], [10707, 0.012723, " competition", false], [6932, 0.011943, " happened", false], [6069, 0.011845, " led", false], [12560, 0.010531, " victory", false], [4124, 0.010371, " early", false]]]}, "raw_delta": 0.10198533535003662, "tuned_delta": 0.11055712738061486}, {"byte_start": 3631, "byte_end": 3634, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 613, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "1.91% 1.91% 1.91%", "qwen": "1.64% 1.64% 1.64%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.7254297137260437]], "qwen": [[311, " to", "normal", 0.7614275813102722]]}, "loss": {"rwkv": 1.9137312147208743, "qwen": 1.638421924665474}, "topk": {"rwkv": [4811, 1, 0.7254297137260437, [[4811, 0.72543, " to", false], [32074, 0.053977, " some", false], [31370, 0.044685, " many", false], [22590, 0.035891, " the", false], [332, 0.018427, " a", false], [63843, 0.017706, " researchers", false], [46787, 0.011179, " people", false], [22226, 0.009128, " one", false], [45, 0.007413, ",", false], [19678, 0.004704, " DAR", false]]], "qwen": [311, 1, 0.7614275813102722, [[311, 0.761428, " to", false], [1045, 0.048317, " some", false], [1657, 0.041988, " many", false], [279, 0.02385, " the", false], [264, 0.018831, " a", false], [11811, 0.016607, " researchers", false], [11, 0.008645, ",", false], [825, 0.007132, " one", false], [304, 0.005231, " in", false], [1251, 0.003191, " people", false]]]}, "raw_delta": 0.015266388654708862, "tuned_delta": 0.023838180685287112}, {"byte_start": 3634, "byte_end": 3636, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 614, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "10.07% 10.07%", "qwen": "8.44% 8.44%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.32784348726272583]], "qwen": [[264, " a", "normal", 0.3922613263130188]]}, "loss": {"rwkv": 10.073505412457116, "qwen": 8.438206226944965}, "topk": {"rwkv": [332, 1, 0.32784348726272583, [[332, 0.327843, " a", false], [22590, 0.231271, " the", false], [4419, 0.048289, " an", false], [31466, 0.028891, " much", false], [32074, 0.024626, " some", false], [31370, 0.020084, " many", false], [51816, 0.014236, " further", false], [50919, 0.012117, " another", false], [65126, 0.011758, " disappointment", false], [31458, 0.008876, " more", false]]], "qwen": [264, 1, 0.3922613263130188, [[264, 0.392261, " a", false], [279, 0.185976, " the", false], [458, 0.075346, " an", false], [1657, 0.02746, " many", false], [1045, 0.025467, " some", false], [1753, 0.018786, " much", false], [2441, 0.014868, " another", false], [4623, 0.009604, " further", false], [1128, 0.007172, " what", false], [803, 0.005978, " more", false]]]}, "raw_delta": 0.09068024158477783, "tuned_delta": 0.09925203361535608}, {"byte_start": 3636, "byte_end": 3642, "display": {"text": " major", "kind": "normal"}, "is_word": true, "word_id": 615, "word_key": " major", "bytes_hex": "20 6d 61 6a 6f 72", "compression": {"rwkv": "11.98% 11.98% 11.98% 11.98% 11.98% 11.98%", "qwen": "12.44% 12.44% 12.44% 12.44% 12.44% 12.44%"}, "model_tokens": {"rwkv": [[38961, " major", "normal", 0.018703404814004898]], "qwen": [[3598, " major", "normal", 0.015963859856128693]]}, "loss": {"rwkv": 11.97549594487909, "qwen": 12.43551513940693}, "topk": {"rwkv": [38961, 8, 0.018703404814004898, [[31323, 0.072443, " long", false], [46790, 0.056268, " period", false], [45315, 0.030924, " bitter", false], [55591, 0.023598, " backlash", false], [38629, 0.022737, " great", false], [22031, 0.022407, " lot", false], [51816, 0.022389, " further", false], [38961, 0.018703, " major", false], [45674, 0.018517, " decade", false], [39664, 0.018253, " shift", false]]], "qwen": [3598, 10, 0.015963859856128693, [[1293, 0.075389, " long", false], [25180, 0.037527, " bitter", false], [4168, 0.029762, " period", false], [4586, 0.023005, " general", false], [2696, 0.019431, " lot", false], [501, 0.019248, " new", false], [2244, 0.017001, " great", false], [3460, 0.016283, " large", false], [1372, 0.016052, " number", false], [3598, 0.015964, " major", false]]]}, "raw_delta": -0.025508880615234375, "tuned_delta": -0.016937088584656125}, {"byte_start": 3642, "byte_end": 3649, "display": {"text": " change", "kind": "normal"}, "is_word": true, "word_id": 616, "word_key": " change", "bytes_hex": "20 63 68 61 6e 67 65", "compression": {"rwkv": "4.81% 4.81% 4.81% 4.81% 4.81% 4.81% 4.81%", "qwen": "6.66% 6.66% 6.66% 6.66% 6.66% 6.66% 6.66%"}, "model_tokens": {"rwkv": [[45450, " change", "normal", 0.15361158549785614]], "qwen": [[2297, " change", "normal", 0.07551056891679764]]}, "loss": {"rwkv": 4.81032526189261, "qwen": 6.6556739224766694}, "topk": {"rwkv": [45450, 2, 0.15361158549785614, [[39664, 0.203584, " shift", false], [45450, 0.153612, " change", false], [56810, 0.036295, " paradigm", false], [57103, 0.030638, " research", false], [45829, 0.030009, " effort", false], [4757, 0.029589, " re", false], [22378, 0.019607, " ret", false], [63415, 0.015852, " controversy", false], [55591, 0.015402, " backlash", false], [57138, 0.014776, " revision", false]]], "qwen": [2297, 2, 0.07551056891679764, [[6407, 0.115522, " shift", false], [2297, 0.075511, " change", false], [48240, 0.05293, " paradigm", false], [312, 0.050844, " re", false], [11004, 0.035189, " debate", false], [3412, 0.020011, " research", false], [47056, 0.018988, " backlash", false], [40598, 0.018954, " disappointment", false], [25573, 0.018221, " controversy", false], [5041, 0.011259, " effort", false]]]}, "raw_delta": -0.102327857698713, "tuned_delta": -0.09375606566813476}, {"byte_start": 3649, "byte_end": 3652, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 617, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "0.55% 0.55% 0.55%", "qwen": "0.75% 0.75% 0.75%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.9128422141075134]], "qwen": [[304, " in", "normal", 0.882537305355072]]}, "loss": {"rwkv": 0.5459417268988996, "qwen": 0.7511284501011392}, "topk": {"rwkv": [4596, 1, 0.9128422141075134, [[4596, 0.912842, " in", false], [4706, 0.03714, " of", false], [45, 0.015217, ",", false], [59, 0.006536, ":", false], [47, 0.003765, ".", false], [4811, 0.001911, " to", false], [32227, 0.001871, " that", false], [4424, 0.001563, " at", false], [31601, 0.001483, " over", false], [30917, 0.001482, " from", false]]], "qwen": [304, 1, 0.882537305355072, [[304, 0.882537, " in", false], [315, 0.081219, " of", false], [11, 0.007828, ",", false], [504, 0.00465, " from", false], [25, 0.002838, ":", false], [4421, 0.002085, "---", false], [311, 0.001744, " to", false], [916, 0.001621, " over", false], [429, 0.001302, " that", false], [369, 0.001157, " for", false]]]}, "raw_delta": -0.011377967894077301, "tuned_delta": -0.002806175863499053}, {"byte_start": 3652, "byte_end": 3656, "display": {"text": " all", "kind": "normal"}, "is_word": true, "word_id": 618, "word_key": " all", "bytes_hex": "20 61 6c 6c", "compression": {"rwkv": "35.08% 35.08% 35.08% 35.08%", "qwen": "32.00% 32.00% 32.00% 32.00%"}, "model_tokens": {"rwkv": [[21256, " all", "normal", 0.00040676642674952745]], "qwen": [[678, " all", "normal", 0.0008276173612102866]]}, "loss": {"rwkv": 35.081158709116394, "qwen": 31.99608877249348}, "topk": {"rwkv": [21256, 86, 0.00040676642674952745, [[22590, 0.462505, " the", false], [47350, 0.114987, " speech", false], [3609, 0.079406, " AI", false], [57103, 0.057021, " research", false], [59526, 0.039207, " direction", false], [56103, 0.028247, " emphasis", false], [38530, 0.017078, " focus", false], [21835, 0.01464, " how", false], [57419, 0.010613, " thinking", false], [55574, 0.009997, " attitude", false]]], "qwen": [678, 54, 0.0008276173612102866, [[279, 0.515891, " the", false], [3412, 0.07072, " research", false], [8806, 0.070528, " speech", false], [1246, 0.067919, " how", false], [15235, 0.028624, " AI", false], [7274, 0.019499, " thinking", false], [5244, 0.016435, " focus", false], [24654, 0.012447, " emphasis", false], [5106, 0.011719, " direction", false], [6366, 0.011553, " computer", false]]]}, "raw_delta": 0.1710726022720337, "tuned_delta": 0.17964439430261195}, {"byte_start": 3656, "byte_end": 3659, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 619, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "13.24% 13.24% 13.24%", "qwen": "13.25% 13.25% 13.25%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.109671451151371]], "qwen": [[315, " of", "normal", 0.11038658767938614]]}, "loss": {"rwkv": 13.243489633160404, "qwen": 13.247346344106003}, "topk": {"rwkv": [4706, 2, 0.109671451151371, [[47350, 0.439427, " speech", false], [4706, 0.109671, " of", false], [3609, 0.067718, " AI", false], [22590, 0.067576, " the", false], [62597, 0.067054, " subsequent", false], [57103, 0.042091, " research", false], [46064, 0.020986, " future", false], [37738, 0.018781, " areas", false], [50964, 0.01707, " aspects", false], [38720, 0.009232, " human", false]]], "qwen": [315, 3, 0.11038658767938614, [[8806, 0.358103, " speech", false], [17420, 0.151202, " subsequent", false], [315, 0.110387, " of", false], [279, 0.08224, " the", false], [3412, 0.050408, " research", false], [15235, 0.029133, " AI", false], [5671, 0.024269, " areas", false], [3853, 0.014411, " future", false], [19827, 0.012652, " approaches", false], [13566, 0.011898, " aspects", false]]]}, "raw_delta": -0.00021386146545410156, "tuned_delta": 0.008357930565124147}, {"byte_start": 3659, "byte_end": 3667, "display": {"text": " natural", "kind": "normal"}, "is_word": true, "word_id": 620, "word_key": " natural", "bytes_hex": "20 6e 61 74 75 72 61 6c", "compression": {"rwkv": "13.53% 13.53% 13.53% 13.53% 13.53% 13.53% 13.53% 13.53%", "qwen": "10.22% 10.22% 10.22% 10.22% 10.22% 10.22% 10.22% 10.22%"}, "model_tokens": {"rwkv": [[52299, " natural", "normal", 0.002481764182448387]], "qwen": [[5810, " natural", "normal", 0.010747061111032963]]}, "loss": {"rwkv": 13.52526600833403, "qwen": 10.218615774122611}, "topk": {"rwkv": [52299, 9, 0.002481764182448387, [[47350, 0.755028, " speech", false], [3609, 0.07456, " AI", false], [22590, 0.06515, " the", false], [55809, 0.029765, " computer", false], [57103, 0.009415, " research", false], [19678, 0.007169, " DAR", false], [64862, 0.006673, " computational", false], [52167, 0.003082, " machine", false], [52299, 0.002482, " natural", false], [38720, 0.002255, " human", false]]], "qwen": [5810, 6, 0.010747061111032963, [[8806, 0.68847, " speech", false], [279, 0.089251, " the", false], [15235, 0.083967, " AI", false], [6366, 0.029443, " computer", false], [451, 0.013061, " N", false], [5810, 0.010747, " natural", false], [5662, 0.006164, " machine", false], [3412, 0.006111, " research", false], [3738, 0.005999, " human", false], [4128, 0.004576, " language", false]]]}, "raw_delta": 0.18335962295532227, "tuned_delta": 0.19193141498590052}, {"byte_start": 3667, "byte_end": 3676, "display": {"text": " language", "kind": "normal"}, "is_word": true, "word_id": 621, "word_key": " language", "bytes_hex": "20 6c 61 6e 67 75 61 67 65", "compression": {"rwkv": "0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43% 0.43%", "qwen": "0.89% 0.89% 0.89% 0.89% 0.89% 0.89% 0.89% 0.89% 0.89%"}, "model_tokens": {"rwkv": [[56529, " language", "normal", 0.8071631789207458]], "qwen": [[4128, " language", "normal", 0.6401944160461426]]}, "loss": {"rwkv": 0.43049168429303913, "qwen": 0.8936361857707253}, "topk": {"rwkv": [56529, 1, 0.8071631789207458, [[56529, 0.807163, " language", false], [46, 0.18598, "-", false], [59946, 0.002354, " languages", false], [47350, 0.002111, " speech", false], [21265, 0.000347, " and", false], [275, 0.000189, " (", false], [34864, 0.000178, "istic", false], [62378, 0.00015, " processing", false], [48, 0.000104, "/", false], [52814, 9e-05, " science", false]]], "qwen": [4128, 1, 0.6401944160461426, [[4128, 0.640194, " language", false], [43558, 0.341647, "-language", false], [8806, 0.003305, " speech", false], [1331, 0.002551, "-s", false], [11476, 0.001883, "-com", false], [323, 0.001119, " and", false], [15459, 0.001004, " languages", false], [12, 0.000899, "-", false], [8038, 0.000572, " science", false], [24231, 0.000527, " computing", false]]]}, "raw_delta": -0.025682184431287978, "tuned_delta": -0.01711039240070973}, {"byte_start": 3676, "byte_end": 3687, "display": {"text": " processing", "kind": "normal"}, "is_word": true, "word_id": 622, "word_key": " processing", "bytes_hex": "20 70 72 6f 63 65 73 73 69 6e 67", "compression": {"rwkv": "0.15% 0.15% 0.15% 0.15% 0.15% 0.15% 0.15% 0.15% 0.15% 0.15% 0.15%", "qwen": "0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16% 0.16%"}, "model_tokens": {"rwkv": [[62378, " processing", "normal", 0.9100680947303772]], "qwen": [[8692, " processing", "normal", 0.9070752859115601]]}, "loss": {"rwkv": 0.15449670570599364, "qwen": 0.15989290567035236}, "topk": {"rwkv": [62378, 1, 0.9100680947303772, [[62378, 0.910068, " processing", false], [57103, 0.046873, " research", false], [65034, 0.020287, " understanding", false], [45, 0.003555, ",", false], [21265, 0.00215, " and", false], [275, 0.00147, " (", false], [63821, 0.001433, " recognition", false], [62634, 0.001212, " technology", false], [47, 0.00121, ".", false], [46, 0.000894, "-", false]]], "qwen": [8692, 1, 0.9070752859115601, [[8692, 0.907075, " processing", false], [3412, 0.032684, " research", false], [8660, 0.014011, " understanding", false], [69193, 0.007294, "-processing", false], [323, 0.005977, " and", false], [8806, 0.003086, " speech", false], [320, 0.002747, " (", false], [15235, 0.002486, " AI", false], [11, 0.002392, ",", false], [24231, 0.001239, " computing", false]]]}, "raw_delta": -0.0002992288632826367, "tuned_delta": 0.008272563167295612}, {"byte_start": 3687, "byte_end": 3688, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "21.70%", "qwen": "22.27%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.3021651804447174]], "qwen": [[11, ",", "normal", 0.29089972376823425]]}, "loss": {"rwkv": 21.696780888369172, "qwen": 22.26757840788402}, "topk": {"rwkv": [45, 1, 0.3021651804447174, [[45, 0.302165, ",", false], [275, 0.219077, " (", false], [47, 0.153554, ".", false], [57103, 0.093974, " research", false], [59, 0.052152, ":", false], [5346, 0.0422, "---", false], [21265, 0.035003, " and", false], [4596, 0.01944, " in", false], [32227, 0.012163, " that", false], [31601, 0.00587, " over", false]]], "qwen": [11, 1, 0.29089972376823425, [[11, 0.2909, ",", false], [320, 0.28355, " (", false], [13, 0.098036, ".", false], [3412, 0.078873, " research", false], [323, 0.062554, " and", false], [4421, 0.032666, "---", false], [25, 0.021578, ":", false], [304, 0.018883, " in", false], [382, 0.015774, ".\n\n", false], [369, 0.014402, " for", false]]]}, "raw_delta": -0.03165173530578613, "tuned_delta": -0.023079943275207883}, {"byte_start": 3688, "byte_end": 3698, "display": {"text": " gradually", "kind": "normal"}, "is_word": true, "word_id": 623, "word_key": " gradually", "bytes_hex": "20 67 72 61 64 75 61 6c 6c 79", "compression": {"rwkv": "14.88% 14.88% 14.88% 14.88% 14.88% 14.88% 14.88% 14.88% 14.88% 14.88%", "qwen": "17.05% 17.05% 17.05% 17.05% 17.05% 17.05% 17.05% 17.05% 17.05% 17.05%"}, "model_tokens": {"rwkv": [[59771, " gradually", "normal", 0.00026331678964197636]], "qwen": [[26024, " gradually", "normal", 7.828678644727916e-05]]}, "loss": {"rwkv": 14.877792609167432, "qwen": 17.051089212978507}, "topk": {"rwkv": [59771, 128, 0.00026331678964197636, [[40186, 0.18027, " which", false], [21265, 0.113458, " and", false], [30917, 0.091548, " from", false], [40185, 0.073692, " where", false], [32487, 0.071375, " with", false], [4423, 0.052657, " as", false], [4811, 0.044154, " to", false], [4596, 0.040929, " in", false], [30211, 0.023158, " away", false], [59841, 0.020795, " including", false]]], "qwen": [26024, 308, 7.828678644727916e-05, [[323, 0.155709, " and", false], [892, 0.104721, " which", false], [438, 0.092851, " as", false], [448, 0.086681, " with", false], [2670, 0.081711, " including", false], [1380, 0.071378, " where", false], [304, 0.038294, " in", false], [504, 0.033125, " from", false], [264, 0.019029, " a", false], [1576, 0.013909, " because", false]]]}, "raw_delta": -0.12051315307617197, "tuned_delta": -0.11194136104559373}, {"byte_start": 3698, "byte_end": 3703, "display": {"text": " over", "kind": "normal"}, "is_word": true, "word_id": 624, "word_key": " over", "bytes_hex": "20 6f 76 65 72", "compression": {"rwkv": "16.68% 16.68% 16.68% 16.68% 16.68%", "qwen": "12.23% 12.23% 12.23% 12.23% 12.23%"}, "model_tokens": {"rwkv": [[31601, " over", "normal", 0.009676050394773483]], "qwen": [[916, " over", "normal", 0.0336746983230114]]}, "loss": {"rwkv": 16.681161410278637, "qwen": 12.230478282961545}, "topk": {"rwkv": [31601, 19, 0.009676050394773483, [[46612, 0.15327, " moving", false], [60385, 0.134453, " replacing", false], [57209, 0.126251, " shifting", false], [52107, 0.029412, " leading", false], [45, 0.022168, ",", false], [39856, 0.02079, " suppl", false], [46500, 0.020352, " making", false], [30917, 0.020219, " from", false], [50834, 0.019002, " abandon", false], [55660, 0.018108, " bringing", false]]], "qwen": [916, 7, 0.0336746983230114, [[24891, 0.07919, " replacing", false], [7218, 0.063611, " moving", false], [11, 0.043552, ",", false], [714, 0.037893, " but", false], [6388, 0.037171, " leading", false], [31831, 0.036395, " shifting", false], [916, 0.033675, " over", false], [10018, 0.027561, " changing", false], [3259, 0.023925, " making", false], [2714, 0.02245, " er", false]]]}, "raw_delta": 0.24679827690124512, "tuned_delta": 0.25537006893182335}, {"byte_start": 3703, "byte_end": 3711, "display": {"text": " decades", "kind": "normal"}, "is_word": true, "word_id": 625, "word_key": " decades", "bytes_hex": "20 64 65 63 61 64 65 73", "compression": {"rwkv": "8.52% 8.52% 8.52% 8.52% 8.52% 8.52% 8.52% 8.52%", "qwen": "10.19% 10.19% 10.19% 10.19% 10.19% 10.19% 10.19% 10.19%"}, "model_tokens": {"rwkv": [[51396, " decades", "normal", 0.022979633882641792]], "qwen": [[10793, " decades", "normal", 0.010877071879804134]]}, "loss": {"rwkv": 8.523735349002175, "qwen": 10.191509158563496}, "topk": {"rwkv": [51396, 6, 0.022979633882641792, [[22590, 0.511333, " the", false], [332, 0.151255, " a", false], [32251, 0.107072, " time", false], [31370, 0.062735, " many", false], [52869, 0.042528, " several", false], [51396, 0.02298, " decades", false], [37598, 0.017119, " about", false], [3493, 0.014353, " 20", false], [22638, 0.008469, " two", false], [31458, 0.005752, " more", false]]], "qwen": [10793, 9, 0.010877071879804134, [[279, 0.336972, " the", false], [264, 0.297456, " a", false], [1657, 0.081974, " many", false], [220, 0.055959, " ", false], [882, 0.054568, " time", false], [3807, 0.053385, " several", false], [458, 0.01625, " an", false], [803, 0.011744, " more", false], [10793, 0.010877, " decades", false], [7009, 0.00856, " nearly", false]]]}, "raw_delta": -0.09248101711273193, "tuned_delta": -0.08390922508215369}, {"byte_start": 3711, "byte_end": 3712, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "12.26%", "qwen": "11.64%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.5042016506195068]], "qwen": [[11, ",", "normal", 0.5245233774185181]]}, "loss": {"rwkv": 12.257272320052715, "qwen": 11.636512765570654}, "topk": {"rwkv": [45, 1, 0.5042016506195068, [[45, 0.504202, ",", false], [47, 0.347258, ".", false], [21265, 0.017231, " and", false], [4706, 0.016622, " of", false], [59, 0.015157, ":", false], [4423, 0.011844, " as", false], [30917, 0.008682, " from", false], [4811, 0.008501, " to", false], [275, 0.007981, " (", false], [21400, 0.007161, " but", false]]], "qwen": [11, 1, 0.5245233774185181, [[11, 0.524523, ",", false], [13, 0.264647, ".", false], [382, 0.065992, ".\n\n", false], [315, 0.032031, " of", false], [323, 0.017668, " and", false], [320, 0.01125, " (", false], [25, 0.009036, ":", false], [4421, 0.008871, "---", false], [438, 0.007894, " as", false], [311, 0.005143, " to", false]]]}, "raw_delta": 0.034422218799591064, "tuned_delta": 0.042994010830169314}, {"byte_start": 3712, "byte_end": 3718, "display": {"text": " where", "kind": "normal"}, "is_word": true, "word_id": 626, "word_key": " where", "bytes_hex": "20 77 68 65 72 65", "compression": {"rwkv": "10.90% 10.90% 10.90% 10.90% 10.90% 10.90%", "qwen": "13.11% 13.11% 13.11% 13.11% 13.11% 13.11%"}, "model_tokens": {"rwkv": [[40185, " where", "normal", 0.02696811780333519]], "qwen": [[1380, " where", "normal", 0.012734335847198963]]}, "loss": {"rwkv": 10.89535317338019, "qwen": 13.114859509013838}, "topk": {"rwkv": [40185, 12, 0.02696811780333519, [[30917, 0.187083, " from", false], [4423, 0.116297, " as", false], [32487, 0.089598, " with", false], [4811, 0.087584, " to", false], [30211, 0.065642, " away", false], [21265, 0.062838, " and", false], [53169, 0.047793, " towards", false], [4596, 0.045397, " in", false], [21400, 0.030748, " but", false], [40186, 0.029044, " which", false]]], "qwen": [1380, 16, 0.012734335847198963, [[438, 0.176274, " as", false], [323, 0.137214, " and", false], [504, 0.105461, " from", false], [311, 0.068331, " to", false], [448, 0.06198, " with", false], [304, 0.041964, " in", false], [3123, 0.027893, " away", false], [714, 0.027693, " but", false], [773, 0.025551, " so", false], [2670, 0.023168, " including", false]]]}, "raw_delta": -0.12307556470235193, "tuned_delta": -0.11450377267177368}, {"byte_start": 3718, "byte_end": 3729, "display": {"text": " statistics", "kind": "normal"}, "is_word": true, "word_id": 627, "word_key": " statistics", "bytes_hex": "20 73 74 61 74 69 73 74 69 63 73", "compression": {"rwkv": "10.20% 10.20% 10.20% 10.20% 10.20% 10.20% 10.20% 10.20% 10.20% 10.20% 10.20%", "qwen": "10.25% 10.25% 10.25% 10.25% 10.25% 10.25% 10.25% 10.25% 10.25% 10.25% 10.25%"}, "model_tokens": {"rwkv": [[62577, " statistics", "normal", 0.0020087799057364464]], "qwen": [[13142, " statistics", "normal", 0.0019320999272167683]]}, "loss": {"rwkv": 10.19518157446391, "qwen": 10.245016674508697}, "topk": {"rwkv": [62577, 42, 0.0020087799057364464, [[22590, 0.218629, " the", false], [63885, 0.190964, " statistical", false], [3866, 0.06995, " HM", false], [52224, 0.048869, " methods", false], [38720, 0.043119, " human", false], [4601, 0.021841, " it", false], [31458, 0.021768, " more", false], [21256, 0.015081, " all", false], [31461, 0.013634, " most", false], [332, 0.013095, " a", false]]], "qwen": [13142, 61, 0.0019320999272167683, [[279, 0.191419, " the", false], [28464, 0.104236, " statistical", false], [3738, 0.073572, " human", false], [472, 0.053897, " H", false], [5413, 0.042883, " methods", false], [264, 0.030919, " a", false], [803, 0.021692, " more", false], [6788, 0.020739, " earlier", false], [11811, 0.020264, " researchers", false], [678, 0.020051, " all", false]]]}, "raw_delta": -0.0027634447271174256, "tuned_delta": 0.005808347303460823}, {"byte_start": 3729, "byte_end": 3733, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 628, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "11.06% 11.06% 11.06% 11.06%", "qwen": "9.20% 9.20% 9.20% 9.20%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.08643412590026855]], "qwen": [[323, " and", "normal", 0.129806786775589]]}, "loss": {"rwkv": 11.059722725564805, "qwen": 9.20488231176844}, "topk": {"rwkv": [21265, 2, 0.08643412590026855, [[45283, 0.091928, " became", false], [21265, 0.086434, " and", false], [30383, 0.067295, " came", false], [32272, 0.060775, " took", false], [57094, 0.059678, " replaced", false], [46, 0.059529, "-", false], [31059, 0.050042, " have", false], [22777, 0.035994, " won", false], [32462, 0.035378, " were", false], [37828, 0.034083, " began", false]]], "qwen": [323, 1, 0.129806786775589, [[323, 0.129807, " and", false], [6116, 0.110121, " became", false], [702, 0.052799, " has", false], [5980, 0.051573, "-based", false], [4421, 0.050791, "---", false], [11, 0.048703, ",", false], [572, 0.041111, " was", false], [3867, 0.034376, " took", false], [320, 0.031195, " (", false], [12575, 0.023812, " replaced", false]]]}, "raw_delta": 0.10285419225692749, "tuned_delta": 0.11142598428750573}, {"byte_start": 3733, "byte_end": 3745, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 629, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "3.01% 3.01% 3.01% 3.01% 3.01% 3.01% 3.01% 3.01% 3.01% 3.01% 3.01% 3.01%", "qwen": "1.57% 1.57% 1.57% 1.57% 1.57% 1.57% 1.57% 1.57% 1.57% 1.57% 1.57% 1.57%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.13499867916107178]], "qwen": [[34447, " computation", "normal", 0.3509063720703125]]}, "loss": {"rwkv": 3.0056146685186733, "qwen": 1.5737937108487454}, "topk": {"rwkv": [63370, 3, 0.13499867916107178, [[3866, 0.163178, " HM", false], [56537, 0.151697, " learning", false], [63370, 0.134999, " computation", false], [47202, 0.090606, " search", false], [52167, 0.062742, " machine", false], [63885, 0.059155, " statistical", false], [52195, 0.033744, " massive", false], [56935, 0.019006, " probabil", false], [31458, 0.013914, " more", false], [63787, 0.013857, " probability", false]]], "qwen": [34447, 1, 0.3509063720703125, [[34447, 0.350906, " computation", false], [5662, 0.09078, " machine", false], [6832, 0.047997, " learning", false], [472, 0.044146, " H", false], [2711, 0.035162, " search", false], [28464, 0.026352, " statistical", false], [54480, 0.021034, " computational", false], [10951, 0.019022, " massive", false], [24231, 0.016781, " computing", false], [279, 0.016624, " the", false]]]}, "raw_delta": 0.07939701279004416, "tuned_delta": 0.0879688048206224}, {"byte_start": 3745, "byte_end": 3750, "display": {"text": " came", "kind": "normal"}, "is_word": true, "word_id": 630, "word_key": " came", "bytes_hex": "20 63 61 6d 65", "compression": {"rwkv": "8.06% 8.06% 8.06% 8.06% 8.06%", "qwen": "11.08% 11.08% 11.08% 11.08% 11.08%"}, "model_tokens": {"rwkv": [[30383, " came", "normal", 0.10698934644460678]], "qwen": [[3697, " came", "normal", 0.04633750766515732]]}, "loss": {"rwkv": 8.058804329965694, "qwen": 11.079189441815968}, "topk": {"rwkv": [30383, 2, 0.10698934644460678, [[31059, 0.108267, " have", false], [30383, 0.106989, " came", false], [45283, 0.103023, " became", false], [32272, 0.089009, " took", false], [57094, 0.058479, " replaced", false], [32462, 0.052215, " were", false], [22777, 0.040453, " won", false], [22190, 0.028635, " now", false], [61959, 0.028579, " eventually", false], [59771, 0.028253, " gradually", false]]], "qwen": [3697, 6, 0.04633750766515732, [[6116, 0.155787, " became", false], [614, 0.143535, " have", false], [1033, 0.084004, " were", false], [3867, 0.052117, " took", false], [29701, 0.04924, " dominated", false], [3697, 0.046338, " came", false], [11, 0.026066, ",", false], [525, 0.022455, " are", false], [1431, 0.021502, " now", false], [916, 0.018227, " over", false]]]}, "raw_delta": -0.16748571395874023, "tuned_delta": -0.15891392192816198}, {"byte_start": 3750, "byte_end": 3753, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 631, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.25% 0.25% 0.25%", "qwen": "0.19% 0.19% 0.19%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.9597342610359192]], "qwen": [[311, " to", "normal", 0.9691116213798523]]}, "loss": {"rwkv": 0.24655432827692242, "qwen": 0.18860515475946268}, "topk": {"rwkv": [4811, 1, 0.9597342610359192, [[4811, 0.959734, " to", false], [38499, 0.011867, " first", false], [31162, 0.006523, " into", false], [4596, 0.005717, " in", false], [22249, 0.00207, " out", false], [64430, 0.001754, " increasingly", false], [57435, 0.001214, " together", false], [45285, 0.000735, " before", false], [30218, 0.00061, " back", false], [4712, 0.000538, " on", false]]], "qwen": [311, 1, 0.9691116213798523, [[311, 0.969112, " to", false], [1119, 0.006749, " into", false], [14756, 0.005994, " increasingly", false], [304, 0.002393, " in", false], [700, 0.002006, " out", false], [518, 0.00129, " at", false], [1156, 0.000882, " first", false], [315, 0.000805, " of", false], [803, 0.000767, " more", false], [1182, 0.000627, " back", false]]]}, "raw_delta": 0.003213384499152502, "tuned_delta": 0.01178517652973075}, {"byte_start": 3753, "byte_end": 3762, "display": {"text": " dominate", "kind": "normal"}, "is_word": true, "word_id": 632, "word_key": " dominate", "bytes_hex": "20 64 6f 6d 69 6e 61 74 65", "compression": {"rwkv": "1.89% 1.89% 1.89% 1.89% 1.89% 1.89% 1.89% 1.89% 1.89%", "qwen": "0.88% 0.88% 0.88% 0.88% 0.88% 0.88% 0.88% 0.88% 0.88%"}, "model_tokens": {"rwkv": [[56041, " dominate", "normal", 0.3885592222213745]], "qwen": [[40736, " dominate", "normal", 0.6446137428283691]]}, "loss": {"rwkv": 1.8863362893567714, "qwen": 0.8798515971554768}, "topk": {"rwkv": [56041, 1, 0.3885592222213745, [[56041, 0.388559, " dominate", false], [4435, 0.274421, " be", false], [31702, 0.051946, " play", false], [52716, 0.045106, " replace", false], [31907, 0.043391, " rule", false], [32187, 0.029668, " take", false], [56906, 0.026743, " predomin", false], [22590, 0.020774, " the", false], [52550, 0.008612, " prevail", false], [31059, 0.005651, " have", false]]], "qwen": [40736, 1, 0.6446137428283691, [[40736, 0.644614, " dominate", false], [1486, 0.059636, " play", false], [279, 0.044036, " the", false], [387, 0.039062, " be", false], [1896, 0.037964, " take", false], [4162, 0.030339, " pred", false], [8290, 0.025675, " replace", false], [1026, 0.009732, " sup", false], [65728, 0.008506, " prevail", false], [5912, 0.008304, " rule", false]]]}, "raw_delta": 0.05581136213408576, "tuned_delta": 0.064383154164664}, {"byte_start": 3762, "byte_end": 3766, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 633, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "12.33% 12.33% 12.33% 12.33%", "qwen": "9.96% 9.96% 9.96% 9.96%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.06447254866361618]], "qwen": [[279, " the", "normal", 0.10979695618152618]]}, "loss": {"rwkv": 12.327716413846122, "qwen": 9.959656122260641}, "topk": {"rwkv": [22590, 3, 0.06447254866361618, [[47, 0.53756, ".", false], [45, 0.14881, ",", false], [22590, 0.064473, " the", false], [31601, 0.054655, " over", false], [21265, 0.054523, " and", false], [275, 0.013618, " (", false], [57103, 0.010165, " research", false], [4596, 0.009688, " in", false], [52224, 0.007401, " methods", false], [40187, 0.007125, " while", false]]], "qwen": [279, 3, 0.10979695618152618, [[13, 0.282776, ".", false], [382, 0.179756, ".\n\n", false], [279, 0.109797, " the", false], [916, 0.090845, " over", false], [11, 0.083813, ",", false], [323, 0.025576, " and", false], [3738, 0.023952, " human", false], [678, 0.019848, " all", false], [320, 0.015324, " (", false], [5413, 0.012913, " methods", false]]]}, "raw_delta": 0.13131314516067505, "tuned_delta": 0.1398849371912533}, {"byte_start": 3766, "byte_end": 3772, "display": {"text": " field", "kind": "normal"}, "is_word": true, "word_id": 634, "word_key": " field", "bytes_hex": "20 66 69 65 6c 64", "compression": {"rwkv": "3.55% 3.55% 3.55% 3.55% 3.55% 3.55%", "qwen": "0.73% 0.73% 0.73% 0.73% 0.73% 0.73%"}, "model_tokens": {"rwkv": [[38478, " field", "normal", 0.3058306574821472]], "qwen": [[2070, " field", "normal", 0.7843818068504333]]}, "loss": {"rwkv": 3.5456860542681228, "qwen": 0.7299417550650444}, "topk": {"rwkv": [38478, 1, 0.3058306574821472, [[38478, 0.305831, " field", false], [57103, 0.227717, " research", false], [52224, 0.069457, " methods", false], [39597, 0.028572, " scene", false], [39802, 0.028022, " state", false], [55532, 0.023143, " approach", false], [61590, 0.017995, " approaches", false], [45829, 0.01575, " effort", false], [59945, 0.012382, " landscape", false], [3609, 0.011517, " AI", false]]], "qwen": [2070, 1, 0.7843818068504333, [[2070, 0.784382, " field", false], [5413, 0.030536, " methods", false], [3412, 0.025925, " research", false], [3082, 0.015, " area", false], [5486, 0.009158, " approach", false], [25364, 0.007416, " discipline", false], [7947, 0.007026, " domain", false], [3738, 0.006482, " human", false], [1616, 0.005541, " way", false], [990, 0.004777, " use", false]]]}, "raw_delta": 0.15613801777362823, "tuned_delta": 0.1647098098042065}, {"byte_start": 3772, "byte_end": 3773, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "7.29%", "qwen": "13.96%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.6675684452056885]], "qwen": [[13, ".", "normal", 0.46101492643356323]]}, "loss": {"rwkv": 7.290963707617563, "qwen": 13.963933556757253}, "topk": {"rwkv": [47, 1, 0.6675684452056885, [[47, 0.667568, ".", false], [45, 0.162354, ",", false], [21265, 0.051791, " and", false], [275, 0.015237, " (", false], [31601, 0.014673, " over", false], [4706, 0.013431, " of", false], [40187, 0.00995, " while", false], [4596, 0.006824, " in", false], [5346, 0.006287, "---", false], [4423, 0.005711, " as", false]]], "qwen": [13, 1, 0.46101492643356323, [[13, 0.461015, ".", false], [382, 0.256917, ".\n\n", false], [11, 0.13449, ",", false], [323, 0.027926, " and", false], [320, 0.020551, " (", false], [4421, 0.01885, "---", false], [304, 0.007144, " in", false], [916, 0.007141, " over", false], [624, 0.005872, ".\n", false], [315, 0.00569, " of", false]]]}, "raw_delta": -0.370028018951416, "tuned_delta": -0.3614562269208378}, {"byte_start": 3773, "byte_end": 3777, "display": {"text": " The", "kind": "normal"}, "is_word": true, "word_id": 635, "word_key": " the", "bytes_hex": "20 54 68 65", "compression": {"rwkv": "10.92% 10.92% 10.92% 10.92%", "qwen": "9.02% 9.02% 9.02% 9.02%"}, "model_tokens": {"rwkv": [[20996, " The", "normal", 0.08902532607316971]], "qwen": [[576, " The", "normal", 0.13527105748653412]]}, "loss": {"rwkv": 10.918834537977993, "qwen": 9.018984114667694}, "topk": {"rwkv": [20996, 2, 0.08902532607316971, [[261, 0.374472, "\n\n", false], [20996, 0.089025, " The", false], [29894, 0.041615, " This", false], [3913, 0.035407, " In", false], [3918, 0.029797, " It", false], [267, 0.022017, "  ", false], [37451, 0.019905, " There", false], [275, 0.01648, " (", false], [36251, 0.015892, " Again", false], [19555, 0.014609, " But", false]]], "qwen": [576, 1, 0.13527105748653412, [[576, 0.135271, " The", false], [1096, 0.087521, " This", false], [758, 0.070972, " In", false], [1084, 0.059122, " It", false], [220, 0.042533, " ", false], [2619, 0.033782, " There", false], [320, 0.031058, " (", false], [362, 0.024504, " A", false], [65694, 0.018292, " Statistical", false], [3776, 0.01478, " One", false]]]}, "raw_delta": 0.1053500771522522, "tuned_delta": 0.11392186918283044}, {"byte_start": 3777, "byte_end": 3784, "display": {"text": " recent", "kind": "normal"}, "is_word": true, "word_id": 636, "word_key": " recent", "bytes_hex": "20 72 65 63 65 6e 74", "compression": {"rwkv": "15.62% 15.62% 15.62% 15.62% 15.62% 15.62% 15.62%", "qwen": "16.84% 16.84% 16.84% 16.84% 16.84% 16.84% 16.84%"}, "model_tokens": {"rwkv": [[47014, " recent", "normal", 0.002348215552046895]], "qwen": [[3213, " recent", "normal", 0.001448009512387216]]}, "loss": {"rwkv": 15.618461938195253, "qwen": 16.842344533425265}, "topk": {"rwkv": [47014, 69, 0.002348215552046895, [[38720, 0.086211, " human", false], [63885, 0.079259, " statistical", false], [38328, 0.032405, " early", false], [19678, 0.028031, " DAR", false], [46430, 0.019183, " lesson", false], [52224, 0.018234, " methods", false], [52013, 0.017128, " initial", false], [62577, 0.014863, " statistics", false], [31937, 0.014523, " same", false], [47798, 0.014323, " winner", false]]], "qwen": [3213, 106, 0.001448009512387216, [[3738, 0.08607, " human", false], [17755, 0.057509, " lesson", false], [1852, 0.039748, " same", false], [2297, 0.033862, " change", false], [2874, 0.025564, " reason", false], [4124, 0.023552, " early", false], [28464, 0.022176, " statistical", false], [2070, 0.021218, " field", false], [18366, 0.013596, " lessons", false], [2856, 0.012939, " initial", false]]]}, "raw_delta": -0.06786646161760601, "tuned_delta": -0.05929466958702776}, {"byte_start": 3784, "byte_end": 3789, "display": {"text": " rise", "kind": "normal"}, "is_word": true, "word_id": 637, "word_key": " rise", "bytes_hex": "20 72 69 73 65", "compression": {"rwkv": "12.68% 12.68% 12.68% 12.68% 12.68%", "qwen": "11.77% 11.77% 11.77% 11.77% 11.77%"}, "model_tokens": {"rwkv": [[31886, " rise", "normal", 0.029765283688902855]], "qwen": [[10000, " rise", "normal", 0.03823969513177872]]}, "loss": {"rwkv": 12.679936882813154, "qwen": 11.7719630767155}, "topk": {"rwkv": [31886, 5, 0.029765283688902855, [[53052, 0.158568, " success", false], [59687, 0.068896, " explosion", false], [60587, 0.045996, " successes", false], [22377, 0.032422, " res", false], [31886, 0.029765, " rise", false], [56950, 0.02179, " progress", false], [63469, 0.020988, " development", false], [32499, 0.020036, " work", false], [55465, 0.017368, " advances", false], [64266, 0.016526, " breakthrough", false]]], "qwen": [10000, 4, 0.03823969513177872, [[2393, 0.155085, " success", false], [90490, 0.075235, " resurgence", false], [9902, 0.065232, " ``", false], [10000, 0.03824, " rise", false], [48079, 0.031369, " emergence", false], [4401, 0.023977, " development", false], [975, 0.023407, " work", false], [47088, 0.022941, " successes", false], [24199, 0.016634, " explosion", false], [12560, 0.010869, " victory", false]]]}, "raw_delta": 0.050348758697509766, "tuned_delta": 0.058920550728088016}, {"byte_start": 3789, "byte_end": 3792, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 638, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.83% 0.83% 0.83%", "qwen": "0.88% 0.88% 0.88%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.871516227722168]], "qwen": [[315, " of", "normal", 0.8635035753250122]]}, "loss": {"rwkv": 0.8277181020725253, "qwen": 0.8821916360987787}, "topk": {"rwkv": [4706, 1, 0.871516227722168, [[4706, 0.871516, " of", false], [4596, 0.097808, " in", false], [4811, 0.015521, " to", false], [21265, 0.009588, " and", false], [45, 0.002323, ",", false], [275, 0.001096, " (", false], [37635, 0.00029, " again", false], [30917, 0.000124, " from", false], [4600, 0.000124, " is", false], [30218, 0.000119, " back", false]]], "qwen": [315, 1, 0.8635035753250122, [[315, 0.863504, " of", false], [304, 0.106901, " in", false], [311, 0.014329, " to", false], [323, 0.010539, " and", false], [11, 0.001082, ",", false], [320, 0.000833, " (", false], [1549, 0.000326, " again", false], [702, 0.000226, " has", false], [504, 0.000149, " from", false], [8841, 0.000125, " toward", false]]]}, "raw_delta": -0.0030206541220347063, "tuned_delta": 0.005551137908543542}, {"byte_start": 3792, "byte_end": 3797, "display": {"text": " deep", "kind": "normal"}, "is_word": true, "word_id": 639, "word_key": " deep", "bytes_hex": "20 64 65 65 70", "compression": {"rwkv": "2.14% 2.14% 2.14% 2.14% 2.14%", "qwen": "2.71% 2.71% 2.71% 2.71% 2.71%"}, "model_tokens": {"rwkv": [[30597, " deep", "normal", 0.547441840171814]], "qwen": [[5538, " deep", "normal", 0.47233864665031433]]}, "loss": {"rwkv": 2.141500451319555, "qwen": 2.7052662451755625}, "topk": {"rwkv": [30597, 1, 0.547441840171814, [[30597, 0.547442, " deep", false], [46658, 0.132981, " neural", false], [60342, 0.02775, " recurrent", false], [52167, 0.023649, " machine", false], [22590, 0.022831, " the", false], [59193, 0.020559, " attention", false], [4404, 0.020213, " ``", false], [64597, 0.009582, " transformers", false], [32497, 0.008067, " word", false], [63939, 0.007948, " transformer", false]]], "qwen": [5538, 1, 0.47233864665031433, [[5538, 0.472339, " deep", false], [29728, 0.166442, " neural", false], [5662, 0.030954, " machine", false], [279, 0.029208, " the", false], [3460, 0.017315, " large", false], [9902, 0.017042, " ``", false], [6529, 0.013668, " attention", false], [1766, 0.011558, " gener", false], [15235, 0.010287, " AI", false], [28464, 0.010208, " statistical", false]]]}, "raw_delta": -0.031261813640594494, "tuned_delta": -0.022690021610016244}, {"byte_start": 3797, "byte_end": 3806, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 640, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "0.38% 0.38% 0.38% 0.38% 0.38% 0.38% 0.38% 0.38% 0.38%", "qwen": "0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.8255179524421692]], "qwen": [[6832, " learning", "normal", 0.7984076142311096]]}, "loss": {"rwkv": 0.38352895509743484, "qwen": 0.4511146733470222}, "topk": {"rwkv": [56537, 1, 0.8255179524421692, [[56537, 0.825518, " learning", false], [46658, 0.135234, " neural", false], [46, 0.01012, "-", false], [56705, 0.006017, " networks", false], [31510, 0.002088, " nets", false], [47350, 0.001926, " speech", false], [56529, 0.001691, " language", false], [46086, 0.001264, " genera", false], [45, 0.001217, ",", false], [46587, 0.000945, " models", false]]], "qwen": [6832, 1, 0.7984076142311096, [[6832, 0.798408, " learning", false], [29728, 0.147366, " neural", false], [70756, 0.025295, "-learning", false], [14155, 0.00426, " networks", false], [71278, 0.00325, " reinforcement", false], [52457, 0.002188, " nets", false], [55712, 0.00194, " convolution", false], [11, 0.001538, ",", false], [1766, 0.001425, " gener", false], [320, 0.001152, " (", false]]]}, "raw_delta": -0.003747748004065618, "tuned_delta": 0.00482404402651263}, {"byte_start": 3806, "byte_end": 3809, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 641, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "10.19% 10.19% 10.19%", "qwen": "10.72% 10.72% 10.72%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.18572263419628143]], "qwen": [[304, " in", "normal", 0.16819624602794647]]}, "loss": {"rwkv": 10.190912235446126, "qwen": 10.715761006811082}, "topk": {"rwkv": [4596, 1, 0.18572263419628143, [[4596, 0.185723, " in", false], [45, 0.147007, ",", false], [21800, 0.124324, " has", false], [4600, 0.097739, " is", false], [52224, 0.050718, " methods", false], [21265, 0.038394, " and", false], [275, 0.032991, " (", false], [22748, 0.027951, " was", false], [21413, 0.024213, " can", false], [21700, 0.021879, " for", false]]], "qwen": [304, 2, 0.16819624602794647, [[702, 0.183061, " has", false], [304, 0.168196, " in", false], [374, 0.121965, " is", false], [11, 0.09634, ",", false], [572, 0.051172, " was", false], [323, 0.048385, " and", false], [5413, 0.047639, " methods", false], [320, 0.035923, " (", false], [1083, 0.016303, " also", false], [646, 0.015431, " can", false]]]}, "raw_delta": -0.02910379568735766, "tuned_delta": -0.02053200365677941}, {"byte_start": 3809, "byte_end": 3816, "display": {"text": " speech", "kind": "normal"}, "is_word": true, "word_id": 642, "word_key": " speech", "bytes_hex": "20 73 70 65 65 63 68", "compression": {"rwkv": "3.34% 3.34% 3.34% 3.34% 3.34% 3.34% 3.34%", "qwen": "3.08% 3.08% 3.08% 3.08% 3.08% 3.08% 3.08%"}, "model_tokens": {"rwkv": [[47350, " speech", "normal", 0.27548930048942566]], "qwen": [[8806, " speech", "normal", 0.30251842737197876]]}, "loss": {"rwkv": 3.3410627342015617, "qwen": 3.0801874720096674}, "topk": {"rwkv": [47350, 1, 0.27548930048942566, [[47350, 0.275489, " speech", false], [4047, 0.223361, " NL", false], [52299, 0.202829, " natural", false], [55809, 0.074227, " computer", false], [22590, 0.034189, " the", false], [32234, 0.033955, " this", false], [3609, 0.013477, " AI", false], [62293, 0.011698, " particular", false], [56529, 0.010611, " language", false], [52167, 0.010464, " machine", false]]], "qwen": [8806, 1, 0.30251842737197876, [[8806, 0.302518, " speech", false], [5810, 0.227938, " natural", false], [451, 0.12571, " N", false], [6366, 0.050058, " computer", false], [279, 0.045199, " the", false], [419, 0.039475, " this", false], [5662, 0.023615, " machine", false], [4128, 0.021623, " language", false], [678, 0.016251, " all", false], [29728, 0.015388, " neural", false]]]}, "raw_delta": 0.014465996197291803, "tuned_delta": 0.023037788227870053}, {"byte_start": 3816, "byte_end": 3828, "display": {"text": " recognition", "kind": "normal"}, "is_word": true, "word_id": 643, "word_key": " recognition", "bytes_hex": "20 72 65 63 6f 67 6e 69 74 69 6f 6e", "compression": {"rwkv": "0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48%", "qwen": "0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25%"}, "model_tokens": {"rwkv": [[63821, " recognition", "normal", 0.7280098795890808]], "qwen": [[17843, " recognition", "normal", 0.845000684261322]]}, "loss": {"rwkv": 0.47549763310549326, "qwen": 0.25309961175671214}, "topk": {"rwkv": [63821, 1, 0.7280098795890808, [[63821, 0.72801, " recognition", false], [21265, 0.124131, " and", false], [62378, 0.04523, " processing", false], [21800, 0.017489, " has", false], [45, 0.016553, ",", false], [4600, 0.012477, " is", false], [275, 0.004673, " (", false], [46, 0.004609, "-", false], [22748, 0.004023, " was", false], [62634, 0.003172, " technology", false]]], "qwen": [17843, 1, 0.845000684261322, [[17843, 0.845001, " recognition", false], [323, 0.051257, " and", false], [8692, 0.02725, " processing", false], [702, 0.014117, " has", false], [59172, 0.012267, "-rec", false], [11, 0.009875, ",", false], [374, 0.007562, " is", false], [572, 0.002541, " was", false], [3412, 0.00192, " research", false], [320, 0.00178, " (", false]]]}, "raw_delta": 0.012332364916801453, "tuned_delta": 0.020904156947379703}, {"byte_start": 3828, "byte_end": 3831, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 644, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "8.08% 8.08% 8.08%", "qwen": "7.52% 7.52% 7.52%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.2587813138961792]], "qwen": [[374, " is", "normal", 0.2861829102039337]]}, "loss": {"rwkv": 8.077589421643935, "qwen": 7.520794156286835}, "topk": {"rwkv": [4600, 1, 0.2587813138961792, [[4600, 0.258781, " is", false], [21800, 0.16979, " has", false], [21265, 0.153793, " and", false], [45, 0.102155, ",", false], [22748, 0.078371, " was", false], [21413, 0.023739, " can", false], [275, 0.020406, " (", false], [39680, 0.007059, " shows", false], [22074, 0.006559, " may", false], [30135, 0.006528, " also", false]]], "qwen": [374, 1, 0.2861829102039337, [[374, 0.286183, " is", false], [702, 0.119782, " has", false], [11, 0.093267, ",", false], [572, 0.083613, " was", false], [323, 0.074318, " and", false], [646, 0.039305, " can", false], [320, 0.032056, " (", false], [1083, 0.024595, " also", false], [4933, 0.013609, " shows", false], [1231, 0.009235, " may", false]]]}, "raw_delta": 0.03087528546651208, "tuned_delta": 0.03944707749709033}, {"byte_start": 3831, "byte_end": 3835, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 645, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "10.78% 10.78% 10.78% 10.78%", "qwen": "11.99% 11.99% 11.99% 11.99%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.09131397306919098]], "qwen": [[279, " the", "normal", 0.0699431374669075]]}, "loss": {"rwkv": 10.777946350391181, "qwen": 11.992730756278679}, "topk": {"rwkv": [22590, 2, 0.09131397306919098, [[332, 0.252089, " a", false], [22590, 0.091314, " the", false], [4419, 0.089771, " an", false], [50919, 0.049306, " another", false], [31198, 0.035743, " just", false], [22797, 0.031289, " yet", false], [4596, 0.023604, " in", false], [47285, 0.021613, " simply", false], [21572, 0.020608, " due", false], [52906, 0.018816, " similar", false]]], "qwen": [279, 4, 0.0699431374669075, [[264, 0.234943, " a", false], [2441, 0.142371, " another", false], [458, 0.090994, " an", false], [279, 0.069943, " the", false], [3602, 0.038998, " yet", false], [1101, 0.03188, " just", false], [1083, 0.027514, " also", false], [304, 0.021343, " in", false], [537, 0.01635, " not", false], [8365, 0.014277, " perhaps", false]]]}, "raw_delta": -0.06736195087432861, "tuned_delta": -0.05879015884375036}, {"byte_start": 3835, "byte_end": 3840, "display": {"text": " most", "kind": "normal"}, "is_word": true, "word_id": 646, "word_key": " most", "bytes_hex": "20 6d 6f 73 74", "compression": {"rwkv": "8.06% 8.06% 8.06% 8.06% 8.06%", "qwen": "5.85% 5.85% 5.85% 5.85% 5.85%"}, "model_tokens": {"rwkv": [[31461, " most", "normal", 0.10850495100021362]], "qwen": [[1429, " most", "normal", 0.1974916160106659]]}, "loss": {"rwkv": 8.058804329965694, "qwen": 5.850342003576077}, "topk": {"rwkv": [31461, 2, 0.10850495100021362, [[46404, 0.375387, " latest", false], [31461, 0.108505, " most", false], [45635, 0.106246, " culmin", false], [52299, 0.05548, " natural", false], [64328, 0.047418, " continuation", false], [52154, 0.035014, " logical", false], [47092, 0.029192, " result", false], [31515, 0.028893, " next", false], [31937, 0.018856, " same", false], [38491, 0.015832, " final", false]]], "qwen": [1429, 2, 0.1974916160106659, [[5535, 0.307636, " latest", false], [1429, 0.197492, " most", false], [92201, 0.057313, " culmination", false], [1102, 0.04321, " result", false], [16724, 0.030106, " ultimate", false], [1590, 0.026096, " final", false], [5810, 0.019535, " natural", false], [1790, 0.018574, " next", false], [6481, 0.016573, " modern", false], [1850, 0.013925, " best", false]]]}, "raw_delta": 0.12246315479278569, "tuned_delta": 0.13103494682336395}, {"byte_start": 3840, "byte_end": 3847, "display": {"text": " recent", "kind": "normal"}, "is_word": true, "word_id": 647, "word_key": " recent", "bytes_hex": "20 72 65 63 65 6e 74", "compression": {"rwkv": "1.53% 1.53% 1.53% 1.53% 1.53% 1.53% 1.53%", "qwen": "1.77% 1.77% 1.77% 1.77% 1.77% 1.77% 1.77%"}, "model_tokens": {"rwkv": [[47014, " recent", "normal", 0.5541421175003052]], "qwen": [[3213, " recent", "normal", 0.5033757090568542]]}, "loss": {"rwkv": 1.529643179513968, "qwen": 1.7683793607497929}, "topk": {"rwkv": [47014, 1, 0.5541421175003052, [[47014, 0.554142, " recent", false], [56056, 0.097038, " dramatic", false], [52346, 0.083036, " obvious", false], [63878, 0.028788, " spectacular", false], [51699, 0.023407, " extreme", false], [60273, 0.023087, " prominent", false], [53296, 0.020328, " visible", false], [57323, 0.020291, " striking", false], [59829, 0.014216, " important", false], [45752, 0.011239, " direct", false]]], "qwen": [3213, 1, 0.5033757090568542, [[3213, 0.503376, " recent", false], [21771, 0.087077, " dramatic", false], [20469, 0.041847, " prominent", false], [8036, 0.041745, " obvious", false], [14226, 0.036954, " extreme", false], [27709, 0.034373, " spectacular", false], [9434, 0.032216, " visible", false], [2989, 0.022292, " important", false], [5089, 0.018553, " significant", false], [27190, 0.017109, " notable", false]]]}, "raw_delta": -0.01323834487370082, "tuned_delta": -0.004666552843122571}, {"byte_start": 3847, "byte_end": 3852, "display": {"text": " step", "kind": "normal"}, "is_word": true, "word_id": 648, "word_key": " step", "bytes_hex": "20 73 74 65 70", "compression": {"rwkv": "17.47% 17.47% 17.47% 17.47% 17.47%", "qwen": "19.09% 19.09% 19.09% 19.09% 19.09%"}, "model_tokens": {"rwkv": [[32115, " step", "normal", 0.007795756217092276]], "qwen": [[3019, " step", "normal", 0.005021218676120043]]}, "loss": {"rwkv": 17.47013526076479, "qwen": 19.094366932737294}, "topk": {"rwkv": [32115, 18, 0.007795756217092276, [[51668, 0.367121, " example", false], [64955, 0.082502, " manifestation", false], [21265, 0.05559, " and", false], [45, 0.030289, ",", false], [56467, 0.028381, " instance", false], [53275, 0.023527, " version", false], [59695, 0.021506, " extension", false], [63469, 0.018923, " development", false], [59932, 0.016977, " iteration", false], [4706, 0.016629, " of", false]]], "qwen": [3019, 20, 0.005021218676120043, [[3110, 0.454865, " example", false], [62950, 0.143977, " manifestation", false], [323, 0.034289, " and", false], [2867, 0.031439, " instance", false], [315, 0.018749, " of", false], [7493, 0.01635, " expression", false], [3598, 0.014601, " major", false], [39034, 0.014404, " illustration", false], [11, 0.013451, ",", false], [2319, 0.011413, " version", false]]]}, "raw_delta": -0.09006652832031259, "tuned_delta": -0.08149473628973435}, {"byte_start": 3852, "byte_end": 3855, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 649, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "1.51% 1.51% 1.51%", "qwen": "1.46% 1.46% 1.46%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.7774576544761658]], "qwen": [[304, " in", "normal", 0.7840771675109863]]}, "loss": {"rwkv": 1.514548016558238, "qwen": 1.4622185329127406}, "topk": {"rwkv": [4596, 1, 0.7774576544761658, [[4596, 0.777458, " in", false], [37678, 0.097522, " along", false], [4706, 0.049117, " of", false], [45, 0.009862, ",", false], [4712, 0.009206, " on", false], [47, 0.007668, ".", false], [53169, 0.006621, " towards", false], [30678, 0.005657, " down", false], [47585, 0.00557, " toward", false], [30211, 0.005053, " away", false]]], "qwen": [304, 1, 0.7840771675109863, [[304, 0.784077, " in", false], [6974, 0.047984, " towards", false], [3156, 0.033861, " along", false], [315, 0.021732, " of", false], [11, 0.021365, ",", false], [389, 0.013445, " on", false], [4637, 0.011178, " forward", false], [8841, 0.00769, " toward", false], [311, 0.007191, " to", false], [13, 0.006736, ".", false]]]}, "raw_delta": 0.0029017627239227295, "tuned_delta": 0.011473554754500978}, {"byte_start": 3855, "byte_end": 3860, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 650, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "1.73% 1.73% 1.73% 1.73% 1.73%", "qwen": "1.39% 1.39% 1.39% 1.39% 1.39%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.6161835193634033]], "qwen": [[419, " this", "normal", 0.6810057759284973]]}, "loss": {"rwkv": 1.725880297938457, "qwen": 1.3856527166618726}, "topk": {"rwkv": [32234, 1, 0.6161835193634033, [[32234, 0.616184, " this", false], [32227, 0.182241, " that", false], [22590, 0.116104, " the", false], [332, 0.058396, " a", false], [4419, 0.006048, " an", false], [32464, 0.002821, " what", false], [39936, 0.002457, " these", false], [61774, 0.001212, " continuing", false], [59725, 0.00076, " following", false], [55531, 0.000565, " applying", false]]], "qwen": [419, 1, 0.6810057759284973, [[419, 0.681006, " this", false], [429, 0.131548, " that", false], [279, 0.095718, " the", false], [264, 0.054598, " a", false], [458, 0.004845, " an", false], [1128, 0.003424, " what", false], [1493, 0.001981, " these", false], [1741, 0.001159, " such", false], [14354, 0.001105, " continuing", false], [5810, 0.000941, " natural", false]]]}, "raw_delta": 0.01886622309684753, "tuned_delta": 0.02743801512742578}, {"byte_start": 3860, "byte_end": 3871, "display": {"text": " consistent", "kind": "normal"}, "is_word": true, "word_id": 651, "word_key": " consistent", "bytes_hex": "20 63 6f 6e 73 69 73 74 65 6e 74", "compression": {"rwkv": "17.83% 17.83% 17.83% 17.83% 17.83% 17.83% 17.83% 17.83% 17.83% 17.83% 17.83%", "qwen": "15.36% 15.36% 15.36% 15.36% 15.36% 15.36% 15.36% 15.36% 15.36% 15.36% 15.36%"}, "model_tokens": {"rwkv": [[61756, " consistent", "normal", 1.863027318904642e-05]], "qwen": [[12966, " consistent", "normal", 8.523379074176773e-05]]}, "loss": {"rwkv": 17.82875973825849, "qwen": 15.361607635964383}, "topk": {"rwkv": [61756, 861, 1.863027318904642e-05, [[52571, 0.155838, " process", false], [31323, 0.116301, " long", false], [59657, 0.081685, " evolution", false], [40009, 0.073981, " trend", false], [59526, 0.063072, " direction", false], [31937, 0.042181, " same", false], [51832, 0.031156, " general", false], [45450, 0.030962, " change", false], [63797, 0.029158, " progression", false], [52427, 0.023598, " pattern", false]]], "qwen": [12966, 291, 8.523379074176773e-05, [[1882, 0.186448, " process", false], [9149, 0.135534, " trend", false], [1293, 0.100552, " long", false], [15379, 0.066108, " evolution", false], [5106, 0.0499, " direction", false], [2297, 0.042591, " change", false], [4586, 0.030231, " general", false], [9142, 0.027419, " transition", false], [32724, 0.022523, " progression", false], [5383, 0.02007, " pattern", false]]]}, "raw_delta": 0.1368079618974165, "tuned_delta": 0.14537975392799476}, {"byte_start": 3871, "byte_end": 3881, "display": {"text": " direction", "kind": "normal"}, "is_word": true, "word_id": 652, "word_key": " direction", "bytes_hex": "20 64 69 72 65 63 74 69 6f 6e", "compression": {"rwkv": "7.83% 7.83% 7.83% 7.83% 7.83% 7.83% 7.83% 7.83% 7.83% 7.83%", "qwen": "6.56% 6.56% 6.56% 6.56% 6.56% 6.56% 6.56% 6.56% 6.56% 6.56%"}, "model_tokens": {"rwkv": [[59526, " direction", "normal", 0.012842195108532906]], "qwen": [[5106, " direction", "normal", 0.02627510018646717]]}, "loss": {"rwkv": 7.833383229826794, "qwen": 6.5626997328859815}, "topk": {"rwkv": [59526, 12, 0.012842195108532906, [[52427, 0.258604, " pattern", false], [40009, 0.198655, " trend", false], [45, 0.0538, ",", false], [63797, 0.03342, " progression", false], [59657, 0.032109, " evolution", false], [56950, 0.031539, " progress", false], [21265, 0.027424, " and", false], [45450, 0.026849, " change", false], [39664, 0.023627, " shift", false], [52571, 0.019469, " process", false]]], "qwen": [5106, 9, 0.02627510018646717, [[9149, 0.299869, " trend", false], [5383, 0.093218, " pattern", false], [2297, 0.054152, " change", false], [6407, 0.051961, " shift", false], [15379, 0.044662, " evolution", false], [1882, 0.03035, " process", false], [11, 0.029086, ",", false], [323, 0.026876, " and", false], [5106, 0.026275, " direction", false], [3271, 0.022239, " move", false]]]}, "raw_delta": 0.07046165466308596, "tuned_delta": 0.0790334466936642}, {"byte_start": 3881, "byte_end": 3882, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "5.78%", "qwen": "22.29%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.7278621196746826]], "qwen": [[13, ".", "normal", 0.29059064388275146]]}, "loss": {"rwkv": 5.776415691059325, "qwen": 22.286748024105815}, "topk": {"rwkv": [47, 1, 0.7278621196746826, [[47, 0.727862, ".", false], [45, 0.125623, ",", false], [4706, 0.062274, " of", false], [5346, 0.010447, "---", false], [21265, 0.009084, " and", false], [4596, 0.006474, " in", false], [30917, 0.006027, " from", false], [53169, 0.006012, " towards", false], [275, 0.005598, " (", false], [32227, 0.005451, " that", false]]], "qwen": [13, 2, 0.29059064388275146, [[382, 0.405737, ".\n\n", false], [13, 0.290591, ".", false], [11, 0.135025, ",", false], [315, 0.061821, " of", false], [4421, 0.019762, "---", false], [320, 0.011173, " (", false], [624, 0.010594, ".\n", false], [323, 0.009096, " and", false], [26, 0.006324, ";", false], [304, 0.005766, " in", false]]]}, "raw_delta": -0.9155272245407104, "tuned_delta": -0.9069554325101322}, {"byte_start": 3882, "byte_end": 3887, "display": {"text": " Deep", "kind": "normal"}, "is_word": true, "word_id": 653, "word_key": " deep", "bytes_hex": "20 44 65 65 70", "compression": {"rwkv": "13.98% 13.98% 13.98% 13.98% 13.98%", "qwen": "11.75% 11.75% 11.75% 11.75% 11.75%"}, "model_tokens": {"rwkv": [[28753, " Deep", "normal", 0.02122342400252819]], "qwen": [[18183, " Deep", "normal", 0.03847718983888626]]}, "loss": {"rwkv": 13.976108208611832, "qwen": 11.749631989414219}, "topk": {"rwkv": [28753, 4, 0.02122342400252819, [[261, 0.624039, "\n\n", false], [20996, 0.042449, " The", false], [3918, 0.033713, " It", false], [28753, 0.021223, " Deep", false], [3913, 0.020742, " In", false], [267, 0.018436, "  ", false], [44900, 0.011442, " Speech", false], [37451, 0.011002, " There", false], [29894, 0.009622, " This", false], [3336, 0.008285, " \n\n", false]]], "qwen": [18183, 6, 0.03847718983888626, [[576, 0.116875, " The", false], [220, 0.098938, " ", false], [758, 0.08166, " In", false], [1084, 0.064057, " It", false], [1096, 0.03989, " This", false], [18183, 0.038477, " Deep", false], [2619, 0.035076, " There", false], [320, 0.027231, " (", false], [362, 0.017175, " A", false], [1634, 0.014003, " As", false]]]}, "raw_delta": 0.12346205711364744, "tuned_delta": 0.1320338491442257}, {"byte_start": 3887, "byte_end": 3896, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 654, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "0.12% 0.12% 0.12% 0.12% 0.12% 0.12% 0.12% 0.12% 0.12%", "qwen": "0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13% 0.13%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.9430890083312988]], "qwen": [[6832, " learning", "normal", 0.9382525086402893]]}, "loss": {"rwkv": 0.11789601808479822, "qwen": 0.12771088284932422}, "topk": {"rwkv": [56537, 1, 0.9430890083312988, [[56537, 0.943089, " learning", false], [46658, 0.019796, " neural", false], [46, 0.011293, "-", false], [56705, 0.003299, " networks", false], [47350, 0.001933, " speech", false], [31510, 0.00187, " nets", false], [55122, 0.001551, " Learning", false], [46587, 0.001416, " models", false], [45, 0.001409, ",", false], [52224, 0.001401, " methods", false]]], "qwen": [6832, 1, 0.9382525086402893, [[6832, 0.938253, " learning", false], [29728, 0.024987, " neural", false], [70756, 0.01787, "-learning", false], [14155, 0.00314, " networks", false], [52457, 0.00118, " nets", false], [4119, 0.000807, " models", false], [20909, 0.000775, " Learning", false], [5413, 0.000722, " methods", false], [11, 0.000584, ",", false], [71278, 0.000508, " reinforcement", false]]]}, "raw_delta": -0.0005442516671286691, "tuned_delta": 0.00802754036344958}, {"byte_start": 3896, "byte_end": 3904, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 655, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "4.68% 4.68% 4.68% 4.68% 4.68% 4.68% 4.68% 4.68%", "qwen": "6.29% 6.29% 6.29% 6.29% 6.29% 6.29% 6.29% 6.29%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.1253858208656311]], "qwen": [[5413, " methods", "normal", 0.061479464173316956]]}, "loss": {"rwkv": 4.684532237261526, "qwen": 6.287111723447028}, "topk": {"rwkv": [52224, 2, 0.1253858208656311, [[4600, 0.220187, " is", false], [52224, 0.125386, " methods", false], [45, 0.089534, ",", false], [21800, 0.074177, " has", false], [21413, 0.028607, " can", false], [32356, 0.025294, " uses", false], [30659, 0.0252, " does", false], [22748, 0.017888, " was", false], [4596, 0.016556, " in", false], [62633, 0.015841, " techniques", false]]], "qwen": [5413, 4, 0.061479464173316956, [[374, 0.355186, " is", false], [702, 0.088279, " has", false], [11, 0.080589, ",", false], [5413, 0.061479, " methods", false], [304, 0.034315, " in", false], [572, 0.032036, " was", false], [323, 0.024567, " and", false], [646, 0.016037, " can", false], [1558, 0.012097, " does", false], [320, 0.010785, " (", false]]]}, "raw_delta": -0.08886587619781494, "tuned_delta": -0.0802940841672367}, {"byte_start": 3904, "byte_end": 3909, "display": {"text": " rely", "kind": "normal"}, "is_word": true, "word_id": 656, "word_key": " rely", "bytes_hex": "20 72 65 6c 79", "compression": {"rwkv": "17.13% 17.13% 17.13% 17.13% 17.13%", "qwen": "19.16% 19.16% 19.16% 19.16% 19.16%"}, "model_tokens": {"rwkv": [[31856, " rely", "normal", 0.008645105175673962]], "qwen": [[17188, " rely", "normal", 0.0049310470931231976]]}, "loss": {"rwkv": 17.13200361055644, "qwen": 19.159725499544685}, "topk": {"rwkv": [31856, 16, 0.008645105175673962, [[21286, 0.264944, " are", false], [45, 0.115213, ",", false], [31059, 0.094583, " have", false], [4491, 0.04506, " do", false], [21413, 0.033538, " can", false], [22681, 0.022545, " use", false], [56540, 0.019318, " leverage", false], [32187, 0.017729, " take", false], [32462, 0.015626, " were", false], [4596, 0.012693, " in", false]]], "qwen": [17188, 23, 0.0049310470931231976, [[525, 0.272963, " are", false], [614, 0.124843, " have", false], [11, 0.080843, ",", false], [1033, 0.030006, " were", false], [646, 0.027957, " can", false], [429, 0.027579, " that", false], [653, 0.021692, " do", false], [369, 0.017541, " for", false], [304, 0.015921, " in", false], [320, 0.012085, " (", false]]]}, "raw_delta": -0.11244077682495113, "tuned_delta": -0.10386898479437288}, {"byte_start": 3909, "byte_end": 3914, "display": {"text": " even", "kind": "normal"}, "is_word": true, "word_id": 657, "word_key": " even", "bytes_hex": "20 65 76 65 6e", "compression": {"rwkv": "21.19% 21.19% 21.19% 21.19% 21.19%", "qwen": "14.45% 14.45% 14.45% 14.45% 14.45%"}, "model_tokens": {"rwkv": [[30788, " even", "normal", 0.0027790244203060865]], "qwen": [[1496, " even", "normal", 0.01821867562830448]]}, "loss": {"rwkv": 21.18958341305665, "qwen": 14.44609551758368}, "topk": {"rwkv": [30788, 25, 0.0027790244203060865, [[4712, 0.70067, " on", false], [51919, 0.120362, " heavily", false], [31458, 0.014284, " more", false], [32350, 0.014111, " upon", false], [4596, 0.010824, " in", false], [45, 0.009702, ",", false], [31466, 0.009266, " much", false], [32386, 0.008866, " very", false], [45145, 0.007483, " almost", false], [60247, 0.005988, " primarily", false]]], "qwen": [1496, 5, 0.01821867562830448, [[389, 0.546781, " on", false], [16916, 0.192428, " heavily", false], [803, 0.041072, " more", false], [1753, 0.027618, " much", false], [1496, 0.018219, " even", false], [2686, 0.014777, " less", false], [4558, 0.014529, " almost", false], [5193, 0.008048, " upon", false], [1602, 0.006943, " very", false], [15503, 0.006629, " primarily", false]]]}, "raw_delta": 0.3739383697509766, "tuned_delta": 0.38251016178155484}, {"byte_start": 3914, "byte_end": 3919, "display": {"text": " less", "kind": "normal"}, "is_word": true, "word_id": 658, "word_key": " less", "bytes_hex": "20 6c 65 73 73", "compression": {"rwkv": "10.99% 10.99% 10.99% 10.99% 10.99%", "qwen": "11.69% 11.69% 11.69% 11.69% 11.69%"}, "model_tokens": {"rwkv": [[31277, " less", "normal", 0.04748174548149109]], "qwen": [[2686, " less", "normal", 0.039091095328330994]]}, "loss": {"rwkv": 10.9892786317714, "qwen": 11.692540628633799}, "topk": {"rwkv": [31277, 2, 0.04748174548149109, [[31458, 0.944053, " more", false], [31277, 0.047482, " less", false], [51816, 0.004451, " further", false], [4712, 0.001177, " on", false], [45501, 0.000384, " closer", false], [51918, 0.000374, " heavier", false], [31466, 0.000311, " much", false], [57326, 0.000217, " stronger", false], [4596, 0.000203, " in", false], [51919, 0.000181, " heavily", false]]], "qwen": [2686, 2, 0.039091095328330994, [[803, 0.941949, " more", false], [2686, 0.039091, " less", false], [4623, 0.007461, " further", false], [1753, 0.002388, " much", false], [15750, 0.001907, " harder", false], [16245, 0.001344, " stronger", false], [16916, 0.000838, " heavily", false], [7046, 0.000763, " greater", false], [43822, 0.00046, " heavier", false], [389, 0.000449, " on", false]]]}, "raw_delta": -0.03899712562561031, "tuned_delta": -0.030425333595032057}, {"byte_start": 3919, "byte_end": 3922, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 659, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"rwkv": "0.55% 0.55% 0.55%", "qwen": "0.46% 0.46% 0.46%"}, "model_tokens": {"rwkv": [[4712, " on", "normal", 0.9120094180107117]], "qwen": [[389, " on", "normal", 0.9263618588447571]]}, "loss": {"rwkv": 0.5547472386230755, "qwen": 0.45980081239096365}, "topk": {"rwkv": [4712, 1, 0.9120094180107117, [[4712, 0.912009, " on", false], [32226, 0.044922, " than", false], [32350, 0.022266, " upon", false], [56003, 0.007307, " directly", false], [45, 0.002262, ",", false], [51919, 0.00214, " heavily", false], [275, 0.002018, " (", false], [61983, 0.001878, " explicitly", false], [4706, 0.000545, " of", false], [4596, 0.00038, " in", false]]], "qwen": [389, 1, 0.9263618588447571, [[389, 0.926362, " on", false], [1091, 0.018097, " than", false], [16916, 0.015518, " heavily", false], [5193, 0.011774, " upon", false], [5961, 0.005576, " directly", false], [11, 0.004045, ",", false], [320, 0.002729, " (", false], [20975, 0.002665, " explicitly", false], [16510, 0.001793, " strongly", false], [3738, 0.001346, " human", false]]]}, "raw_delta": 0.005264947811762493, "tuned_delta": 0.013836739842340741}, {"byte_start": 3922, "byte_end": 3928, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 660, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "1.01% 1.01% 1.01% 1.01% 1.01% 1.01%", "qwen": "0.68% 0.68% 0.68% 0.68% 0.68% 0.68%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.7140908241271973]], "qwen": [[3738, " human", "normal", 0.7977262735366821]]}, "loss": {"rwkv": 1.009698677705492, "qwen": 0.6792380897031334}, "topk": {"rwkv": [38720, 1, 0.7140908241271973, [[38720, 0.714091, " human", false], [22590, 0.044683, " the", false], [59943, 0.034845, " knowledge", false], [45775, 0.01886, " domain", false], [52964, 0.017018, " special", false], [56179, 0.0119, " explicit", false], [21273, 0.011628, " any", false], [39356, 0.011557, " prior", false], [63875, 0.010436, " specialized", false], [65034, 0.009299, " understanding", false]]], "qwen": [3738, 1, 0.7977262735366821, [[3738, 0.797726, " human", false], [279, 0.021198, " the", false], [3281, 0.020519, " special", false], [11464, 0.01508, " explicit", false], [894, 0.014222, " any", false], [6540, 0.0102, " knowledge", false], [28464, 0.009826, " statistical", false], [4867, 0.007139, " prior", false], [27076, 0.004095, " specialized", false], [70601, 0.003108, " exploiting", false]]]}, "raw_delta": 0.018324625988801326, "tuned_delta": 0.026896418019379573}, {"byte_start": 3928, "byte_end": 3938, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 661, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50%", "qwen": "0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48% 0.48%"}, "model_tokens": {"rwkv": [[59943, " knowledge", "normal", 0.7569496035575867]], "qwen": [[6540, " knowledge", "normal", 0.7678873538970947]]}, "loss": {"rwkv": 0.5001530659331854, "qwen": 0.4762917629958522}, "topk": {"rwkv": [59943, 1, 0.7569496035575867, [[59943, 0.75695, " knowledge", false], [46, 0.081589, "-", false], [65034, 0.081567, " understanding", false], [38786, 0.044524, " input", false], [59683, 0.006586, " expertise", false], [45775, 0.002684, " domain", false], [62182, 0.001964, " linguistic", false], [46297, 0.00156, " inputs", false], [52022, 0.001245, " insight", false], [39356, 0.001195, " prior", false]]], "qwen": [6540, 1, 0.7678873538970947, [[6540, 0.767887, " knowledge", false], [12646, 0.131365, "-k", false], [8660, 0.05767, " understanding", false], [1946, 0.018732, " input", false], [18726, 0.002581, " expertise", false], [71107, 0.001571, "-under", false], [1995, 0.000701, " information", false], [7947, 0.000522, " domain", false], [56251, 0.000467, " intuition", false], [12, 0.000397, "-", false]]]}, "raw_delta": 0.0013231515884399407, "tuned_delta": 0.009894943619018189}, {"byte_start": 3938, "byte_end": 3939, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "36.35%", "qwen": "43.23%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.1320059448480606]], "qwen": [[11, ",", "normal", 0.09096557646989822]]}, "loss": {"rwkv": 36.34915239739771, "qwen": 43.23169600531254}, "topk": {"rwkv": [45, 3, 0.1320059448480606, [[32226, 0.434867, " than", false], [21265, 0.176853, " and", false], [45, 0.132006, ",", false], [47, 0.057793, ".", false], [4706, 0.049093, " of", false], [5346, 0.038115, "---", false], [275, 0.023135, " (", false], [37598, 0.016251, " about", false], [4596, 0.013484, " in", false], [60, 0.008025, ";", false]]], "qwen": [11, 3, 0.09096557646989822, [[1091, 0.532951, " than", false], [323, 0.195286, " and", false], [11, 0.090966, ",", false], [315, 0.045367, " of", false], [13, 0.018696, ".", false], [382, 0.016803, ".\n\n", false], [320, 0.015955, " (", false], [911, 0.011983, " about", false], [4421, 0.009853, "---", false], [311, 0.009667, " to", false]]]}, "raw_delta": -0.3816492557525635, "tuned_delta": -0.37307746372198525}, {"byte_start": 3939, "byte_end": 3943, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 662, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "4.07% 4.07% 4.07% 4.07%", "qwen": "3.32% 3.32% 3.32% 3.32%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.40637195110321045]], "qwen": [[323, " and", "normal", 0.4790298044681549]]}, "loss": {"rwkv": 4.0681464165692205, "qwen": 3.3181647414095763}, "topk": {"rwkv": [21265, 1, 0.40637195110321045, [[21265, 0.406372, " and", false], [21400, 0.121094, " but", false], [55495, 0.042003, " although", false], [39690, 0.036786, " since", false], [4423, 0.025259, " as", false], [52700, 0.021972, " relying", false], [40186, 0.021811, " which", false], [4788, 0.016831, " so", false], [30788, 0.015641, " even", false], [4596, 0.015513, " in", false]]], "qwen": [323, 1, 0.4790298044681549, [[323, 0.47903, " and", false], [714, 0.071377, " but", false], [476, 0.027249, " or", false], [892, 0.022689, " which", false], [304, 0.019728, " in", false], [1496, 0.017436, " even", false], [438, 0.01599, " as", false], [38561, 0.014133, " relying", false], [7892, 0.013545, " although", false], [525, 0.013027, " are", false]]]}, "raw_delta": 0.041587814688682556, "tuned_delta": 0.050159606719260806}, {"byte_start": 3943, "byte_end": 3947, "display": {"text": " use", "kind": "normal"}, "is_word": true, "word_id": 663, "word_key": " use", "bytes_hex": "20 75 73 65", "compression": {"rwkv": "20.15% 20.15% 20.15% 20.15%", "qwen": "18.30% 18.30% 18.30% 18.30%"}, "model_tokens": {"rwkv": [[22681, " use", "normal", 0.011399897746741772]], "qwen": [[990, " use", "normal", 0.017263662070035934]]}, "loss": {"rwkv": 20.147010824914233, "qwen": 18.300368609106183}, "topk": {"rwkv": [22681, 17, 0.011399897746741772, [[31458, 0.165242, " more", false], [21286, 0.117427, " are", false], [32232, 0.065597, " they", false], [30788, 0.052148, " even", false], [31059, 0.035736, " have", false], [52028, 0.033725, " instead", false], [22590, 0.02727, " the", false], [4596, 0.022122, " in", false], [31856, 0.019772, " rely", false], [31466, 0.016966, " much", false]]], "qwen": [990, 13, 0.017263662070035934, [[803, 0.107137, " more", false], [525, 0.079429, " are", false], [1496, 0.055057, " even", false], [1373, 0.044111, " require", false], [807, 0.043144, " they", false], [4518, 0.037029, " instead", false], [1753, 0.035006, " much", false], [304, 0.031479, " in", false], [614, 0.031112, " have", false], [279, 0.024103, " the", false]]]}, "raw_delta": 0.10239958763122559, "tuned_delta": 0.11097137966180383}, {"byte_start": 3947, "byte_end": 3952, "display": {"text": " even", "kind": "normal"}, "is_word": true, "word_id": 664, "word_key": " even", "bytes_hex": "20 65 76 65 6e", "compression": {"rwkv": "9.24% 9.24% 9.24% 9.24% 9.24%", "qwen": "5.53% 5.53% 5.53% 5.53% 5.53%"}, "model_tokens": {"rwkv": [[30788, " even", "normal", 0.07655905187129974]], "qwen": [[1496, " even", "normal", 0.2160256952047348]]}, "loss": {"rwkv": 9.24226510569492, "qwen": 5.52681297029586}, "topk": {"rwkv": [30788, 2, 0.07655905187129974, [[52195, 0.315936, " massive", false], [30788, 0.076559, " even", false], [31458, 0.062224, " more", false], [31466, 0.056573, " much", false], [63370, 0.054929, " computation", false], [21660, 0.038872, " far", false], [22590, 0.031434, " the", false], [332, 0.027923, " a", false], [31581, 0.024429, " only", false], [59988, 0.017011, " massively", false]]], "qwen": [1496, 1, 0.2160256952047348, [[1496, 0.216026, " even", false], [803, 0.132534, " more", false], [3041, 0.118427, " far", false], [1753, 0.10704, " much", false], [34447, 0.06405, " computation", false], [10951, 0.027769, " massive", false], [264, 0.02091, " a", false], [279, 0.015844, " the", false], [2058, 0.013601, " still", false], [1657, 0.013031, " many", false]]]}, "raw_delta": 0.20602841377258296, "tuned_delta": 0.21460020580316122}, {"byte_start": 3952, "byte_end": 3957, "display": {"text": " more", "kind": "normal"}, "is_word": true, "word_id": 665, "word_key": " more", "bytes_hex": "20 6d 6f 72 65", "compression": {"rwkv": "1.01% 1.01% 1.01% 1.01% 1.01%", "qwen": "0.44% 0.44% 0.44% 0.44% 0.44%"}, "model_tokens": {"rwkv": [[31458, " more", "normal", 0.7560068368911743]], "qwen": [[803, " more", "normal", 0.8862769603729248]]}, "loss": {"rwkv": 1.0143949506250522, "qwen": 0.4354261591556644}, "topk": {"rwkv": [31458, 1, 0.7560068368911743, [[31458, 0.756007, " more", false], [31277, 0.148203, " less", false], [46397, 0.019507, " larger", false], [51867, 0.018695, " greater", false], [38475, 0.016358, " fewer", false], [52195, 0.00631, " massive", false], [45305, 0.004635, " bigger", false], [51918, 0.003655, " heavier", false], [31466, 0.002748, " much", false], [52932, 0.002498, " smaller", false]]], "qwen": [803, 1, 0.8862769603729248, [[803, 0.886277, " more", false], [7046, 0.069768, " greater", false], [8131, 0.011515, " larger", false], [1753, 0.009957, " much", false], [2686, 0.005961, " less", false], [5080, 0.002148, " higher", false], [11243, 0.002051, " bigger", false], [19117, 0.001932, " deeper", false], [16745, 0.000835, " fewer", false], [3041, 0.000817, " far", false]]]}, "raw_delta": 0.03210484683513641, "tuned_delta": 0.04067663886571466}, {"byte_start": 3957, "byte_end": 3969, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 666, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28%", "qwen": "0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.8277170062065125]], "qwen": [[34447, " computation", "normal", 0.8317679166793823]]}, "loss": {"rwkv": 0.2832439604609883, "qwen": 0.2768198933990527}, "topk": {"rwkv": [63370, 1, 0.8277170062065125, [[63370, 0.827717, " computation", false], [52195, 0.091086, " massive", false], [4706, 0.011687, " of", false], [47202, 0.007348, " search", false], [64862, 0.006919, " computational", false], [59346, 0.005382, " computing", false], [63885, 0.003743, " statistical", false], [62577, 0.003425, " statistics", false], [51266, 0.003089, " compute", false], [64298, 0.003076, " computations", false]]], "qwen": [34447, 1, 0.8317679166793823, [[34447, 0.831768, " computation", false], [10951, 0.075317, " massive", false], [54480, 0.013324, " computational", false], [315, 0.012591, " of", false], [24231, 0.011308, " computing", false], [7988, 0.004662, " powerful", false], [6366, 0.003931, " computer", false], [63707, 0.00252, " massively", false], [82599, 0.002164, " computations", false], [320, 0.001896, " (", false]]]}, "raw_delta": 0.00035622591773668867, "tuned_delta": 0.008928017948314937}, {"byte_start": 3969, "byte_end": 3970, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "16.62%", "qwen": "14.02%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.38943740725517273]], "qwen": [[11, ",", "normal", 0.4596511125564575]]}, "loss": {"rwkv": 16.62480613524391, "qwen": 14.017361042139353}, "topk": {"rwkv": [45, 1, 0.38943740725517273, [[45, 0.389437, ",", false], [47, 0.335641, ".", false], [32226, 0.171496, " than", false], [275, 0.024748, " (", false], [4811, 0.019178, " to", false], [5346, 0.013557, "---", false], [21265, 0.007835, " and", false], [4596, 0.006923, " in", false], [22278, 0.004351, " per", false], [21700, 0.003568, " for", false]]], "qwen": [11, 1, 0.4596511125564575, [[11, 0.459651, ",", false], [13, 0.147939, ".", false], [382, 0.145457, ".\n\n", false], [1091, 0.121472, " than", false], [311, 0.033275, " to", false], [320, 0.017124, " (", false], [4421, 0.013298, "---", false], [323, 0.01034, " and", false], [817, 0.00947, " per", false], [304, 0.007553, " in", false]]]}, "raw_delta": 0.1445874571800232, "tuned_delta": 0.15315924921060145}, {"byte_start": 3970, "byte_end": 3979, "display": {"text": " together", "kind": "normal"}, "is_word": true, "word_id": 667, "word_key": " together", "bytes_hex": "20 74 6f 67 65 74 68 65 72", "compression": {"rwkv": "22.67% 22.67% 22.67% 22.67% 22.67% 22.67% 22.67% 22.67% 22.67%", "qwen": "21.58% 21.58% 21.58% 21.58% 21.58% 21.58% 21.58% 21.58% 21.58%"}, "model_tokens": {"rwkv": [[57435, " together", "normal", 1.166057882073801e-05]], "qwen": [[3786, " together", "normal", 2.100588972098194e-05]]}, "loss": {"rwkv": 22.667343958411664, "qwen": 21.581732138615322}, "topk": {"rwkv": [57435, 399, 1.166057882073801e-05, [[32226, 0.419946, " than", false], [21265, 0.179234, " and", false], [21400, 0.127153, " but", false], [4788, 0.052421, " so", false], [4811, 0.041217, " to", false], [40186, 0.028096, " which", false], [4596, 0.015641, " in", false], [4423, 0.010753, " as", false], [46500, 0.009051, " making", false], [55495, 0.00834, " although", false]]], "qwen": [3786, 322, 2.100588972098194e-05, [[1091, 0.619293, " than", false], [323, 0.154646, " and", false], [311, 0.065051, " to", false], [714, 0.024441, " but", false], [304, 0.014371, " in", false], [773, 0.010733, " so", false], [7707, 0.007883, " compared", false], [892, 0.007188, " which", false], [438, 0.007071, " as", false], [369, 0.004787, " for", false]]]}, "raw_delta": 0.06019910176595045, "tuned_delta": 0.06877089379652869}, {"byte_start": 3979, "byte_end": 3984, "display": {"text": " with", "kind": "normal"}, "is_word": true, "word_id": 668, "word_key": " with", "bytes_hex": "20 77 69 74 68", "compression": {"rwkv": "0.66% 0.66% 0.66% 0.66% 0.66%", "qwen": "0.70% 0.70% 0.70% 0.70% 0.70%"}, "model_tokens": {"rwkv": [[32487, " with", "normal", 0.8343991041183472]], "qwen": [[448, " with", "normal", 0.8225528001785278]]}, "loss": {"rwkv": 0.6551300722786797, "qwen": 0.7045495557269997}, "topk": {"rwkv": [32487, 1, 0.8343991041183472, [[32487, 0.834399, " with", false], [47, 0.039435, ".", false], [4811, 0.014426, " to", false], [4596, 0.012325, " in", false], [45, 0.011111, ",", false], [57581, 0.006438, " yielding", false], [46500, 0.005494, " making", false], [56109, 0.004559, " enabling", false], [52107, 0.004248, " leading", false], [60264, 0.004239, " producing", false]]], "qwen": [448, 1, 0.8225528001785278, [[448, 0.822553, " with", false], [311, 0.044499, " to", false], [11, 0.017739, ",", false], [13, 0.012832, ".", false], [382, 0.012299, ".\n\n", false], [27362, 0.008633, " enabling", false], [304, 0.007544, " in", false], [3259, 0.00511, " making", false], [1091, 0.004741, " than", false], [6388, 0.00336, " leading", false]]]}, "raw_delta": -0.0027403980493545532, "tuned_delta": 0.005831393981223695}, {"byte_start": 3984, "byte_end": 3993, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 669, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "7.98% 7.98% 7.98% 7.98% 7.98% 7.98% 7.98% 7.98% 7.98%", "qwen": "7.55% 7.55% 7.55% 7.55% 7.55% 7.55% 7.55% 7.55% 7.55%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.01860511116683483]], "qwen": [[6832, " learning", "normal", 0.02309095859527588]]}, "loss": {"rwkv": 7.983663963252727, "qwen": 7.550733469424535}, "topk": {"rwkv": [56537, 6, 0.01860511116683483, [[52195, 0.365601, " massive", false], [22590, 0.073595, " the", false], [332, 0.051126, " a", false], [38864, 0.029114, " large", false], [31458, 0.019268, " more", false], [56537, 0.018605, " learning", false], [31466, 0.01559, " much", false], [45301, 0.014824, " better", false], [30789, 0.014687, " ever", false], [39193, 0.014503, " other", false]]], "qwen": [6832, 7, 0.02309095859527588, [[264, 0.073963, " a", false], [803, 0.049149, " more", false], [279, 0.046292, " the", false], [1753, 0.030189, " much", false], [28464, 0.029183, " statistical", false], [1008, 0.024636, " other", false], [6832, 0.023091, " learning", false], [7988, 0.022235, " powerful", false], [5413, 0.020202, " methods", false], [1602, 0.01773, " very", false]]]}, "raw_delta": 0.024006764094034794, "tuned_delta": 0.032578556124613044}, {"byte_start": 3993, "byte_end": 3996, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 670, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"rwkv": "31.93% 31.93% 31.93%", "qwen": "37.45% 37.45% 37.45%"}, "model_tokens": {"rwkv": [[4712, " on", "normal", 0.004880957771092653]], "qwen": [[389, " on", "normal", 0.001969738397747278]]}, "loss": {"rwkv": 31.934655853010906, "qwen": 37.44908463925589}, "topk": {"rwkv": [4712, 18, 0.004880957771092653, [[47, 0.30545, ".", false], [4450, 0.176563, " by", false], [45, 0.122019, ",", false], [30917, 0.088815, " from", false], [4811, 0.039794, " to", false], [4596, 0.033555, " in", false], [61559, 0.031364, " algorithms", false], [21265, 0.019146, " and", false], [275, 0.017849, " (", false], [52224, 0.017621, " methods", false]]], "qwen": [389, 23, 0.001969738397747278, [[553, 0.332966, " by", false], [11, 0.146714, ",", false], [13, 0.082028, ".", false], [382, 0.066914, ".\n\n", false], [311, 0.0633, " to", false], [504, 0.056364, " from", false], [323, 0.042003, " and", false], [5413, 0.028665, " methods", false], [12538, 0.026802, " techniques", false], [304, 0.026564, " in", false]]]}, "raw_delta": -0.30578486124674487, "tuned_delta": -0.29721306921616664}, {"byte_start": 3996, "byte_end": 4001, "display": {"text": " huge", "kind": "normal"}, "is_word": true, "word_id": 671, "word_key": " huge", "bytes_hex": "20 68 75 67 65", "compression": {"rwkv": "12.74% 12.74% 12.74% 12.74% 12.74%", "qwen": "13.87% 13.87% 13.87% 13.87% 13.87%"}, "model_tokens": {"rwkv": [[31118, " huge", "normal", 0.02925737574696541]], "qwen": [[6765, " huge", "normal", 0.021390043199062347]]}, "loss": {"rwkv": 12.73629215784788, "qwen": 13.867291345757915}, "topk": {"rwkv": [31118, 5, 0.02925737574696541, [[52195, 0.548794, " massive", false], [22590, 0.085755, " the", false], [38864, 0.072956, " large", false], [332, 0.054133, " a", false], [31118, 0.029257, " huge", false], [30579, 0.023986, " data", false], [31466, 0.023553, " much", false], [32386, 0.016041, " very", false], [32373, 0.014164, " vast", false], [38720, 0.010161, " human", false]]], "qwen": [6765, 7, 0.021390043199062347, [[264, 0.206652, " a", false], [656, 0.19224, " self", false], [3460, 0.116152, " large", false], [10951, 0.100546, " massive", false], [279, 0.081583, " the", false], [821, 0.028143, " data", false], [6765, 0.02139, " huge", false], [1753, 0.014829, " much", false], [458, 0.013544, " an", false], [1602, 0.013479, " very", false]]]}, "raw_delta": -0.06271591186523429, "tuned_delta": -0.054144119834656036}, {"byte_start": 4001, "byte_end": 4010, "display": {"text": " training", "kind": "normal"}, "is_word": true, "word_id": 672, "word_key": " training", "bytes_hex": "20 74 72 61 69 6e 69 6e 67", "compression": {"rwkv": "9.08% 9.08% 9.08% 9.08% 9.08% 9.08% 9.08% 9.08% 9.08%", "qwen": "7.17% 7.17% 7.17% 7.17% 7.17% 7.17% 7.17% 7.17% 7.17%"}, "model_tokens": {"rwkv": [[57453, " training", "normal", 0.010948601178824902]], "qwen": [[4862, " training", "normal", 0.027948863804340363]]}, "loss": {"rwkv": 9.079460977816826, "qwen": 7.1681480302589184}, "topk": {"rwkv": [57453, 9, 0.010948601178824902, [[50897, 0.658448, " amounts", false], [55913, 0.081205, " datasets", false], [30579, 0.070438, " data", false], [45588, 0.030048, " corpor", false], [59442, 0.023973, " databases", false], [62426, 0.020156, " quantities", false], [45, 0.013483, ",", false], [63344, 0.013247, " collections", false], [57453, 0.010949, " training", false], [53304, 0.010588, " volumes", false]]], "qwen": [4862, 5, 0.027948863804340363, [[14713, 0.489025, " amounts", false], [29425, 0.179325, " datasets", false], [821, 0.127879, " data", false], [32676, 0.028737, " quantities", false], [4862, 0.027949, " training", false], [8368, 0.022283, " corpor", false], [31806, 0.017646, " databases", false], [11, 0.011832, ",", false], [26282, 0.008516, " volumes", false], [7289, 0.007055, " sets", false]]]}, "raw_delta": 0.10598569446139863, "tuned_delta": 0.11455748649197688}, {"byte_start": 4010, "byte_end": 4015, "display": {"text": " sets", "kind": "normal"}, "is_word": true, "word_id": 673, "word_key": " sets", "bytes_hex": "20 73 65 74 73", "compression": {"rwkv": "1.69% 1.69% 1.69% 1.69% 1.69%", "qwen": "1.70% 1.70% 1.70% 1.70% 1.70%"}, "model_tokens": {"rwkv": [[31989, " sets", "normal", 0.6259512305259705]], "qwen": [[7289, " sets", "normal", 0.6247401833534241]]}, "loss": {"rwkv": 1.6906582510417538, "qwen": 1.6966794711376174}, "topk": {"rwkv": [31989, 1, 0.6259512305259705, [[31989, 0.625951, " sets", false], [30579, 0.173782, " data", false], [55913, 0.104321, " datasets", false], [45588, 0.068904, " corpor", false], [59442, 0.011071, " databases", false], [63344, 0.004355, " collections", false], [52800, 0.001882, " samples", false], [21265, 0.001335, " and", false], [45590, 0.000819, " corpus", false], [56162, 0.000751, " examples", false]]], "qwen": [7289, 1, 0.6247401833534241, [[7289, 0.62474, " sets", false], [821, 0.205242, " data", false], [29425, 0.120632, " datasets", false], [8368, 0.01474, " corpor", false], [31806, 0.006376, " databases", false], [10469, 0.004582, " samples", false], [10295, 0.003663, " examples", false], [323, 0.003389, " and", false], [738, 0.002761, " set", false], [15302, 0.001929, " collections", false]]]}, "raw_delta": -0.0003338873386383029, "tuned_delta": 0.008237904691939945}, {"byte_start": 4015, "byte_end": 4016, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "40.01%", "qwen": "25.69%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.10759126394987106]], "qwen": [[11, ",", "normal", 0.24055695533752441]]}, "loss": {"rwkv": 40.01224527465484, "qwen": 25.694371422421927}, "topk": {"rwkv": [45, 3, 0.10759126394987106, [[47, 0.626975, ".", false], [4706, 0.129354, " of", false], [45, 0.107591, ",", false], [32227, 0.027114, " that", false], [275, 0.018844, " (", false], [21265, 0.010868, " and", false], [5346, 0.010591, "---", false], [4811, 0.009913, " to", false], [30917, 0.007722, " from", false], [4596, 0.003982, " in", false]]], "qwen": [11, 2, 0.24055695533752441, [[13, 0.279001, ".", false], [11, 0.240557, ",", false], [382, 0.232527, ".\n\n", false], [311, 0.071379, " to", false], [315, 0.041802, " of", false], [320, 0.027236, " (", false], [323, 0.025563, " and", false], [429, 0.01288, " that", false], [304, 0.007643, " in", false], [4421, 0.006589, "---", false]]]}, "raw_delta": 0.7939515113830566, "tuned_delta": 0.8025233034136349}, {"byte_start": 4016, "byte_end": 4019, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 674, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "5.82% 5.82% 5.82%", "qwen": "5.31% 5.31% 5.31%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.3826839327812195]], "qwen": [[311, " to", "normal", 0.4131651222705841]]}, "loss": {"rwkv": 5.82337842025493, "qwen": 5.313373543145382}, "topk": {"rwkv": [4811, 1, 0.3826839327812195, [[4811, 0.382684, " to", false], [21265, 0.166266, " and", false], [32226, 0.067666, " than", false], [40186, 0.055081, " which", false], [4788, 0.050425, " so", false], [21400, 0.038161, " but", false], [4596, 0.026396, " in", false], [4423, 0.018309, " as", false], [21700, 0.012002, " for", false], [30322, 0.008568, " both", false]]], "qwen": [311, 1, 0.4131651222705841, [[311, 0.413165, " to", false], [1091, 0.289355, " than", false], [323, 0.077884, " and", false], [304, 0.044376, " in", false], [892, 0.016596, " which", false], [773, 0.008746, " so", false], [429, 0.00852, " that", false], [438, 0.008271, " as", false], [369, 0.007668, " for", false], [714, 0.007464, " but", false]]]}, "raw_delta": 0.028280675411224365, "tuned_delta": 0.036852467441802615}, {"byte_start": 4019, "byte_end": 4027, "display": {"text": " produce", "kind": "normal"}, "is_word": true, "word_id": 675, "word_key": " produce", "bytes_hex": "20 70 72 6f 64 75 63 65", "compression": {"rwkv": "7.50% 7.50% 7.50% 7.50% 7.50% 7.50% 7.50% 7.50%", "qwen": "6.17% 6.17% 6.17% 6.17% 6.17% 6.17% 6.17% 6.17%"}, "model_tokens": {"rwkv": [[52573, " produce", "normal", 0.03572550788521767]], "qwen": [[8193, " produce", "normal", 0.06479889154434204]]}, "loss": {"rwkv": 7.5022959889977825, "qwen": 6.168573756231406}, "topk": {"rwkv": [52573, 3, 0.03572550788521767, [[50848, 0.177285, " achieve", false], [31358, 0.063811, " make", false], [52573, 0.035726, " produce", false], [51982, 0.032574, " improve", false], [22249, 0.030236, " out", false], [45851, 0.026567, " enable", false], [4491, 0.024796, " do", false], [39740, 0.022546, " solve", false], [38877, 0.019398, " learn", false], [30256, 0.017436, " beat", false]]], "qwen": [8193, 2, 0.06479889154434204, [[11075, 0.208723, " achieve", false], [8193, 0.064799, " produce", false], [1281, 0.043523, " make", false], [700, 0.042999, " out", false], [9382, 0.038458, " beat", false], [7269, 0.036169, " improve", false], [653, 0.031651, " do", false], [2736, 0.031527, " perform", false], [11625, 0.023982, " solve", false], [3960, 0.021608, " learn", false]]]}, "raw_delta": 0.07395726442337036, "tuned_delta": 0.0825290564539486}, {"byte_start": 4027, "byte_end": 4040, "display": {"text": " dramatically", "kind": "normal"}, "is_word": true, "word_id": 676, "word_key": " dramatically", "bytes_hex": "20 64 72 61 6d 61 74 69 63 61 6c 6c 79", "compression": {"rwkv": "7.41% 7.41% 7.41% 7.41% 7.41% 7.41% 7.41% 7.41% 7.41% 7.41% 7.41% 7.41% 7.41%", "qwen": "6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95% 6.95%"}, "model_tokens": {"rwkv": [[64374, " dramatically", "normal", 0.004814160987734795]], "qwen": [[27957, " dramatically", "normal", 0.006656334735453129]]}, "loss": {"rwkv": 7.412886177644616, "qwen": 6.952938422064054}, "topk": {"rwkv": [64374, 41, 0.004814160987734795, [[62084, 0.072649, " impressive", false], [22590, 0.070349, " the", false], [39802, 0.057424, " state", false], [45301, 0.054554, " better", false], [32386, 0.052813, " very", false], [52738, 0.043075, " results", false], [30992, 0.033619, " good", false], [62477, 0.026332, " remarkable", false], [53087, 0.025269, " systems", false], [31466, 0.025226, " much", false]]], "qwen": [27957, 33, 0.006656334735453129, [[1584, 0.126618, " state", false], [2664, 0.055133, " better", false], [15978, 0.047918, " impressive", false], [3059, 0.047126, " results", false], [279, 0.040378, " the", false], [1602, 0.028198, " very", false], [9073, 0.027886, " excellent", false], [22804, 0.027785, " remarkable", false], [264, 0.025321, " a", false], [5942, 0.022768, " systems", false]]]}, "raw_delta": 0.025504919198843123, "tuned_delta": 0.03407671122942137}, {"byte_start": 4040, "byte_end": 4047, "display": {"text": " better", "kind": "normal"}, "is_word": true, "word_id": 677, "word_key": " better", "bytes_hex": "20 62 65 74 74 65 72", "compression": {"rwkv": "1.45% 1.45% 1.45% 1.45% 1.45% 1.45% 1.45%", "qwen": "1.41% 1.41% 1.41% 1.41% 1.41% 1.41% 1.41%"}, "model_tokens": {"rwkv": [[45301, " better", "normal", 0.5686437487602234]], "qwen": [[2664, " better", "normal", 0.5791397094726562]]}, "loss": {"rwkv": 1.4491356437500749, "qwen": 1.4071724911633026}, "topk": {"rwkv": [45301, 1, 0.5686437487602234, [[45301, 0.568644, " better", false], [56418, 0.206021, " improved", false], [31458, 0.111422, " more", false], [57350, 0.037369, " superior", false], [46198, 0.018186, " higher", false], [51867, 0.00769, " greater", false], [59593, 0.005926, " effective", false], [62603, 0.005844, " successful", false], [57326, 0.004773, " stronger", false], [46397, 0.003331, " larger", false]]], "qwen": [2664, 1, 0.5791397094726562, [[2664, 0.57914, " better", false], [12944, 0.182639, " improved", false], [803, 0.081216, " more", false], [16353, 0.067956, " superior", false], [5080, 0.019567, " higher", false], [7046, 0.011218, " greater", false], [7172, 0.005289, " increased", false], [700, 0.005247, " out", false], [4722, 0.005004, " lower", false], [6849, 0.004503, " successful", false]]]}, "raw_delta": 0.0023269312722342395, "tuned_delta": 0.010898723302812488}, {"byte_start": 4047, "byte_end": 4054, "display": {"text": " speech", "kind": "normal"}, "is_word": true, "word_id": 678, "word_key": " speech", "bytes_hex": "20 73 70 65 65 63 68", "compression": {"rwkv": "6.84% 6.84% 6.84% 6.84% 6.84% 6.84% 6.84%", "qwen": "6.50% 6.50% 6.50% 6.50% 6.50% 6.50% 6.50%"}, "model_tokens": {"rwkv": [[47350, " speech", "normal", 0.06968890875577927]], "qwen": [[8806, " speech", "normal", 0.08017592877149582]]}, "loss": {"rwkv": 6.843140539930907, "qwen": 6.501226745540583}, "topk": {"rwkv": [47350, 3, 0.06968890875577927, [[52738, 0.428004, " results", false], [63750, 0.334254, " performance", false], [47350, 0.069689, " speech", false], [53087, 0.060757, " systems", false], [63821, 0.015339, " recognition", false], [52224, 0.011108, " methods", false], [46587, 0.010234, " models", false], [32497, 0.005204, " word", false], [55434, 0.004574, " accuracy", false], [56529, 0.004012, " language", false]]], "qwen": [8806, 3, 0.08017592877149582, [[3059, 0.494967, " results", false], [5068, 0.302497, " performance", false], [8806, 0.080176, " speech", false], [17843, 0.031126, " recognition", false], [5942, 0.018468, " systems", false], [4119, 0.010573, " models", false], [23675, 0.008674, " performances", false], [13403, 0.006383, " accuracy", false], [8084, 0.002414, " overall", false], [12205, 0.002009, " scores", false]]]}, "raw_delta": 0.018959726606096516, "tuned_delta": 0.027531518636674766}, {"byte_start": 4054, "byte_end": 4066, "display": {"text": " recognition", "kind": "normal"}, "is_word": true, "word_id": 679, "word_key": " recognition", "bytes_hex": "20 72 65 63 6f 67 6e 69 74 69 6f 6e", "compression": {"rwkv": "0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28% 0.28%", "qwen": "0.31% 0.31% 0.31% 0.31% 0.31% 0.31% 0.31% 0.31% 0.31% 0.31% 0.31% 0.31%"}, "model_tokens": {"rwkv": [[63821, " recognition", "normal", 0.827271044254303]], "qwen": [[17843, " recognition", "normal", 0.8116647601127625]]}, "loss": {"rwkv": 0.28471154574835084, "qwen": 0.3135876343703854}, "topk": {"rwkv": [63821, 1, 0.827271044254303, [[63821, 0.827271, " recognition", false], [46, 0.077582, "-", false], [60335, 0.045979, " recognize", false], [53087, 0.012585, " systems", false], [65034, 0.009922, " understanding", false], [21265, 0.007315, " and", false], [62378, 0.003192, " processing", false], [46587, 0.001954, " models", false], [64591, 0.001364, " technologies", false], [62380, 0.001078, " processors", false]]], "qwen": [17843, 1, 0.8116647601127625, [[17843, 0.811665, " recognition", false], [59172, 0.117195, "-rec", false], [5829, 0.02908, " recogn", false], [12, 0.015159, "-", false], [323, 0.003871, " and", false], [4686, 0.00245, "-to", false], [5504, 0.001691, "-re", false], [45840, 0.001459, " transcription", false], [8660, 0.001436, " understanding", false], [93159, 0.001286, " recognizer", false]]]}, "raw_delta": -0.0016012303531169891, "tuned_delta": 0.006970561677461259}, {"byte_start": 4066, "byte_end": 4074, "display": {"text": " systems", "kind": "normal"}, "is_word": true, "word_id": 680, "word_key": " systems", "bytes_hex": "20 73 79 73 74 65 6d 73", "compression": {"rwkv": "2.31% 2.31% 2.31% 2.31% 2.31% 2.31% 2.31% 2.31%", "qwen": "2.70% 2.70% 2.70% 2.70% 2.70% 2.70% 2.70% 2.70%"}, "model_tokens": {"rwkv": [[53087, " systems", "normal", 0.36058366298675537]], "qwen": [[5942, " systems", "normal", 0.3021843433380127]]}, "loss": {"rwkv": 2.30704407173406, "qwen": 2.6976548304941583}, "topk": {"rwkv": [53087, 1, 0.36058366298675537, [[53087, 0.360584, " systems", false], [47, 0.255342, ".", false], [63750, 0.091043, " performance", false], [32226, 0.072549, " than", false], [52738, 0.059611, " results", false], [21265, 0.02609, " and", false], [45, 0.021148, ",", false], [51616, 0.0197, " engines", false], [46587, 0.008751, " models", false], [55434, 0.008507, " accuracy", false]]], "qwen": [5942, 1, 0.3021843433380127, [[5942, 0.302184, " systems", false], [1091, 0.180007, " than", false], [5068, 0.14868, " performance", false], [3059, 0.097481, " results", false], [13, 0.070357, ".", false], [382, 0.070091, ".\n\n", false], [13403, 0.015708, " accuracy", false], [11, 0.015176, ",", false], [323, 0.009859, " and", false], [12205, 0.008681, " scores", false]]]}, "raw_delta": -0.021660059690475464, "tuned_delta": -0.013088267659897216}, {"byte_start": 4074, "byte_end": 4075, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "5.32%", "qwen": "24.80%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.7467849850654602]], "qwen": [[13, ".", "normal", 0.25276753306388855]]}, "loss": {"rwkv": 5.3185290814021835, "qwen": 24.80146114675672}, "topk": {"rwkv": [47, 1, 0.7467849850654602, [[47, 0.746785, ".", false], [32226, 0.159068, " than", false], [45, 0.028283, ",", false], [275, 0.008789, " (", false], [5346, 0.008286, "---", false], [32227, 0.007375, " that", false], [21265, 0.006074, " and", false], [4596, 0.00593, " in", false], [21700, 0.004052, " for", false], [39971, 0.003315, " today", false]]], "qwen": [13, 3, 0.25276753306388855, [[1091, 0.349262, " than", false], [382, 0.288776, ".\n\n", false], [13, 0.252768, ".", false], [11, 0.031671, ",", false], [320, 0.011297, " (", false], [304, 0.010227, " in", false], [624, 0.006941, ".\n", false], [429, 0.005702, " that", false], [4421, 0.005591, "---", false], [3351, 0.003167, " today", false]]]}, "raw_delta": -1.080363154411316, "tuned_delta": -1.0717913623807376}, {"byte_start": 4075, "byte_end": 4078, "display": {"text": " As", "kind": "normal"}, "is_word": true, "word_id": 681, "word_key": " as", "bytes_hex": "20 41 73", "compression": {"rwkv": "31.56% 31.56% 31.56%", "qwen": "25.03% 25.03% 25.03%"}, "model_tokens": {"rwkv": [[3641, " As", "normal", 0.005242753308266401]], "qwen": [[1634, " As", "normal", 0.015550422482192516]]}, "loss": {"rwkv": 31.55895401944607, "qwen": 25.028761300675168}, "topk": {"rwkv": [3641, 16, 0.005242753308266401, [[261, 0.680003, "\n\n", false], [20996, 0.037509, " The", false], [267, 0.022622, "  ", false], [3913, 0.016002, " In", false], [29894, 0.015575, " This", false], [3918, 0.012984, " It", false], [3336, 0.012386, " \n\n", false], [275, 0.011553, " (", false], [37453, 0.00886, " These", false], [28753, 0.008466, " Deep", false]]], "qwen": [1634, 11, 0.015550422482192516, [[576, 0.121241, " The", false], [220, 0.096089, " ", false], [1096, 0.088579, " This", false], [758, 0.065973, " In", false], [1084, 0.043178, " It", false], [18183, 0.032035, " Deep", false], [4220, 0.031349, " These", false], [2619, 0.029938, " There", false], [320, 0.023987, " (", false], [362, 0.016137, " A", false]]]}, "raw_delta": 0.3621107737223308, "tuned_delta": 0.37068256575290903}, {"byte_start": 4078, "byte_end": 4081, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 682, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "9.20% 9.20% 9.20%", "qwen": "7.85% 7.85% 7.85%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.21443837881088257]], "qwen": [[304, " in", "normal", 0.27106383442878723]]}, "loss": {"rwkv": 9.204694922338437, "qwen": 7.847064593021805}, "topk": {"rwkv": [4596, 2, 0.21443837881088257, [[32487, 0.270293, " with", false], [4596, 0.214438, " in", false], [332, 0.063033, " a", false], [22590, 0.045334, " the", false], [45150, 0.02772, " always", false], [47350, 0.018437, " speech", false], [4858, 0.016752, " we", false], [21700, 0.016353, " for", false], [31458, 0.015313, " more", false], [45285, 0.014527, " before", false]]], "qwen": [304, 1, 0.27106383442878723, [[304, 0.271064, " in", false], [448, 0.141271, " with", false], [264, 0.106352, " a", false], [279, 0.039938, " the", false], [582, 0.020754, " we", false], [315, 0.019944, " of", false], [374, 0.018514, " is", false], [369, 0.016189, " for", false], [419, 0.014837, " this", false], [458, 0.012199, " an", false]]]}, "raw_delta": 0.0752830108006795, "tuned_delta": 0.08385480283125775}, {"byte_start": 4081, "byte_end": 4085, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 683, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "7.71% 7.71% 7.71% 7.71%", "qwen": "8.97% 8.97% 8.97% 8.97%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.17889811098575592]], "qwen": [[279, " the", "normal", 0.13674281537532806]]}, "loss": {"rwkv": 7.713628270378002, "qwen": 8.970197473629971}, "topk": {"rwkv": [22590, 3, 0.17889811098575592, [[55809, 0.350947, " computer", false], [38013, 0.180859, " chess", false], [22590, 0.178898, " the", false], [3851, 0.066754, " Go", false], [39193, 0.048008, " other", false], [31370, 0.025676, " many", false], [21256, 0.020174, " all", false], [47350, 0.017067, " speech", false], [47202, 0.012969, " search", false], [51551, 0.010352, " earlier", false]]], "qwen": [279, 3, 0.13674281537532806, [[6366, 0.37974, " computer", false], [5994, 0.182268, " Go", false], [279, 0.136743, " the", false], [32719, 0.101986, " chess", false], [1008, 0.060014, " other", false], [678, 0.031429, " all", false], [1657, 0.026397, " many", false], [8806, 0.014696, " speech", false], [5810, 0.004728, " natural", false], [773, 0.004164, " so", false]]]}, "raw_delta": -0.06967899203300476, "tuned_delta": -0.06110720000242651}, {"byte_start": 4085, "byte_end": 4091, "display": {"text": " games", "kind": "normal"}, "is_word": true, "word_id": 684, "word_key": " games", "bytes_hex": "20 67 61 6d 65 73", "compression": {"rwkv": "16.25% 16.25% 16.25% 16.25% 16.25% 16.25%", "qwen": "18.95% 18.95% 18.95% 18.95% 18.95% 18.95%"}, "model_tokens": {"rwkv": [[38576, " games", "normal", 0.004468951374292374]], "qwen": [[3868, " games", "normal", 0.0018289807485416532]]}, "loss": {"rwkv": 16.24910430167908, "qwen": 18.947384539917156}, "topk": {"rwkv": [38576, 21, 0.004468951374292374, [[39193, 0.298413, " other", false], [30405, 0.132221, " case", false], [51551, 0.084788, " earlier", false], [38013, 0.072867, " chess", false], [56926, 0.064135, " previous", false], [37970, 0.039929, " cases", false], [55809, 0.039734, " computer", false], [22638, 0.035154, " two", false], [31636, 0.022564, " past", false], [3851, 0.016283, " Go", false]]], "qwen": [3868, 27, 0.0018289807485416532, [[1142, 0.338963, " case", false], [1008, 0.280844, " other", false], [6788, 0.07526, " earlier", false], [5994, 0.053692, " Go", false], [5048, 0.035354, " cases", false], [3681, 0.027521, " previous", false], [6366, 0.026768, " computer", false], [32719, 0.01479, " chess", false], [2070, 0.011252, " field", false], [4124, 0.01084, " early", false]]]}, "raw_delta": -0.14962442715962732, "tuned_delta": -0.14105263512904906}, {"byte_start": 4091, "byte_end": 4092, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "11.20%", "qwen": "13.51%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.5409867167472839]], "qwen": [[11, ",", "normal", 0.472660630941391]]}, "loss": {"rwkv": 11.20061091315162, "qwen": 13.514041990582097}, "topk": {"rwkv": [45, 1, 0.5409867167472839, [[45, 0.540987, ",", false], [4706, 0.1395, " of", false], [21265, 0.069385, " and", false], [37599, 0.059481, " above", false], [60003, 0.044097, " mentioned", false], [59546, 0.016139, " discussed", false], [56162, 0.015386, " examples", false], [37970, 0.009827, " cases", false], [45285, 0.009579, " before", false], [32227, 0.006431, " that", false]]], "qwen": [11, 1, 0.472660630941391, [[11, 0.472661, ",", false], [323, 0.207851, " and", false], [315, 0.160039, " of", false], [9733, 0.033301, " mentioned", false], [3403, 0.018764, " above", false], [14078, 0.015981, " discussed", false], [7947, 0.012767, " domain", false], [2070, 0.006106, " field", false], [7481, 0.005491, " described", false], [3110, 0.005347, " example", false]]]}, "raw_delta": -0.12828385829925537, "tuned_delta": -0.11971206626867713}, {"byte_start": 4092, "byte_end": 4104, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 685, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"rwkv": "5.78% 5.78% 5.78% 5.78% 5.78% 5.78% 5.78% 5.78% 5.78% 5.78% 5.78% 5.78%", "qwen": "6.37% 6.37% 6.37% 6.37% 6.37% 6.37% 6.37% 6.37% 6.37% 6.37% 6.37% 6.37%"}, "model_tokens": {"rwkv": [[63843, " researchers", "normal", 0.021582767367362976]], "qwen": [[11811, " researchers", "normal", 0.014395827427506447]]}, "loss": {"rwkv": 5.776415691059325, "qwen": 6.3731309960591975}, "topk": {"rwkv": [63843, 9, 0.021582767367362976, [[22590, 0.309165, " the", false], [39934, 0.066722, " there", false], [4601, 0.061405, " it", false], [32234, 0.054552, " this", false], [39936, 0.047268, " these", false], [38720, 0.039012, " human", false], [56537, 0.033539, " learning", false], [30597, 0.031057, " deep", false], [63843, 0.021583, " researchers", false], [31578, 0.018969, " once", false]]], "qwen": [11811, 14, 0.014395827427506447, [[279, 0.297215, " the", false], [1052, 0.067666, " there", false], [419, 0.066505, " this", false], [432, 0.041822, " it", false], [304, 0.040851, " in", false], [3738, 0.033822, " human", false], [323, 0.022787, " and", false], [2711, 0.02126, " search", false], [264, 0.019594, " a", false], [6832, 0.018681, " learning", false]]]}, "raw_delta": -0.03308892250061035, "tuned_delta": -0.0245171304700321}, {"byte_start": 4104, "byte_end": 4111, "display": {"text": " always", "kind": "normal"}, "is_word": true, "word_id": 686, "word_key": " always", "bytes_hex": "20 61 6c 77 61 79 73", "compression": {"rwkv": "22.70% 22.70% 22.70% 22.70% 22.70% 22.70% 22.70%", "qwen": "22.92% 22.92% 22.92% 22.92% 22.92% 22.92% 22.92%"}, "model_tokens": {"rwkv": [[45150, " always", "normal", 0.00015241364599205554]], "qwen": [[2677, " always", "normal", 0.0001365811040159315]]}, "loss": {"rwkv": 22.703125085417838, "qwen": 22.924918825760535}, "topk": {"rwkv": [45150, 241, 0.00015241364599205554, [[40, 0.249077, "'", false], [22762, 0.242983, " who", false], [32462, 0.036638, " were", false], [4596, 0.031876, " in", false], [21286, 0.029154, " are", false], [32487, 0.028677, " with", false], [59868, 0.027397, " initially", false], [31059, 0.027013, " have", false], [4424, 0.015884, " at", false], [21795, 0.014565, " had", false]]], "qwen": [2677, 263, 0.0001365811040159315, [[6, 0.21676, "'", false], [879, 0.110363, " who", false], [15102, 0.091388, " initially", false], [304, 0.081451, " in", false], [1033, 0.065001, " were", false], [1030, 0.022644, " had", false], [614, 0.022178, " have", false], [525, 0.016846, " are", false], [9498, 0.013413, " learned", false], [6009, 0.011756, " began", false]]]}, "raw_delta": -0.012298856462751084, "tuned_delta": -0.003727064432172836}, {"byte_start": 4111, "byte_end": 4117, "display": {"text": " tried", "kind": "normal"}, "is_word": true, "word_id": 687, "word_key": " tried", "bytes_hex": "20 74 72 69 65 64", "compression": {"rwkv": "14.18% 14.18% 14.18% 14.18% 14.18% 14.18%", "qwen": "9.37% 9.37% 9.37% 9.37% 9.37% 9.37%"}, "model_tokens": {"rwkv": [[40013, " tried", "normal", 0.008999734185636044]], "qwen": [[6679, " tried", "normal", 0.04428163915872574]]}, "loss": {"rwkv": 14.182744217072491, "qwen": 9.369057308579267}, "topk": {"rwkv": [40013, 23, 0.008999734185636044, [[21795, 0.048539, " had", false], [31059, 0.048114, " have", false], [47763, 0.042829, " wanted", false], [32435, 0.038282, " want", false], [31967, 0.026346, " seem", false], [55800, 0.022902, " complain", false], [32216, 0.02241, " tend", false], [22441, 0.018634, " say", false], [47211, 0.017705, " seemed", false], [38709, 0.017428, " hoped", false]]], "qwen": [6679, 4, 0.04428163915872574, [[4829, 0.168017, " wanted", false], [1030, 0.070548, " had", false], [3381, 0.049538, " thought", false], [6679, 0.044282, " tried", false], [6966, 0.036923, " looked", false], [9324, 0.036395, " seemed", false], [11585, 0.032255, " believed", false], [2803, 0.022574, " seem", false], [14890, 0.019978, " preferred", false], [3855, 0.018211, " started", false]]]}, "raw_delta": 0.26692748069763184, "tuned_delta": 0.27549927272821007}, {"byte_start": 4117, "byte_end": 4120, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 688, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "1.51% 1.51% 1.51%", "qwen": "1.01% 1.01% 1.01%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.779309093952179]], "qwen": [[311, " to", "normal", 0.8456106185913086]]}, "loss": {"rwkv": 1.514548016558238, "qwen": 1.0080607221046183}, "topk": {"rwkv": [4811, 1, 0.779309093952179, [[4811, 0.779309, " to", false], [22590, 0.026492, " the", false], [52224, 0.024956, " methods", false], [38720, 0.019605, " human", false], [39931, 0.013916, " their", false], [22249, 0.010137, " out", false], [46162, 0.009724, " harder", false], [45, 0.008365, ",", false], [31048, 0.008113, " hard", false], [21700, 0.007562, " for", false]]], "qwen": [311, 1, 0.8456106185913086, [[311, 0.845611, " to", false], [1156, 0.02425, " first", false], [3738, 0.017506, " human", false], [369, 0.011429, " for", false], [5413, 0.009274, " methods", false], [2588, 0.007665, " hard", false], [279, 0.006218, " the", false], [862, 0.005177, " their", false], [11, 0.004996, ",", false], [15750, 0.004074, " harder", false]]]}, "raw_delta": 0.0280856192111969, "tuned_delta": 0.03665741124177515}, {"byte_start": 4120, "byte_end": 4125, "display": {"text": " make", "kind": "normal"}, "is_word": true, "word_id": 689, "word_key": " make", "bytes_hex": "20 6d 61 6b 65", "compression": {"rwkv": "13.19% 13.19% 13.19% 13.19% 13.19%", "qwen": "12.03% 12.03% 12.03% 12.03% 12.03%"}, "model_tokens": {"rwkv": [[31358, " make", "normal", 0.025832204148173332]], "qwen": [[1281, " make", "normal", 0.035619549453258514]]}, "loss": {"rwkv": 13.187134358125679, "qwen": 12.027967851657332}, "topk": {"rwkv": [31358, 8, 0.025832204148173332, [[30858, 0.068083, " find", false], [22681, 0.062439, " use", false], [37786, 0.034549, " avoid", false], [21751, 0.034263, " get", false], [56540, 0.032047, " leverage", false], [51982, 0.031184, " improve", false], [32187, 0.027907, " take", false], [31358, 0.025832, " make", false], [37730, 0.023612, " apply", false], [37911, 0.022465, " bring", false]]], "qwen": [1281, 5, 0.035619549453258514, [[5648, 0.15674, " avoid", false], [32064, 0.111753, " leverage", false], [990, 0.087157, " use", false], [1896, 0.074023, " take", false], [1281, 0.03562, " make", false], [653, 0.034822, " do", false], [1477, 0.031611, " find", false], [32194, 0.024721, " exploit", false], [3164, 0.023025, " win", false], [633, 0.018305, " get", false]]]}, "raw_delta": 0.06427783966064449, "tuned_delta": 0.07284963169122273}, {"byte_start": 4125, "byte_end": 4133, "display": {"text": " systems", "kind": "normal"}, "is_word": true, "word_id": 690, "word_key": " systems", "bytes_hex": "20 73 79 73 74 65 6d 73", "compression": {"rwkv": "11.98% 11.98% 11.98% 11.98% 11.98% 11.98% 11.98% 11.98%", "qwen": "12.37% 12.37% 12.37% 12.37% 12.37% 12.37% 12.37% 12.37%"}, "model_tokens": {"rwkv": [[53087, " systems", "normal", 0.00490612955763936]], "qwen": [[5942, " systems", "normal", 0.00414033979177475]]}, "loss": {"rwkv": 11.97549594487909, "qwen": 12.368805218920382}, "topk": {"rwkv": [53087, 21, 0.00490612955763936, [[39931, 0.314755, " their", false], [22590, 0.159961, " the", false], [22681, 0.074439, " use", false], [332, 0.057305, " a", false], [38720, 0.051242, " human", false], [32157, 0.031961, " sure", false], [39631, 0.0204, " sense", false], [52224, 0.020064, " methods", false], [4601, 0.019969, " it", false], [56950, 0.017963, " progress", false]]], "qwen": [5942, 23, 0.00414033979177475, [[279, 0.224454, " the", false], [862, 0.147851, " their", false], [990, 0.093358, " use", false], [8806, 0.070922, " speech", false], [264, 0.043604, " a", false], [5098, 0.03824, " progress", false], [2664, 0.030784, " better", false], [5413, 0.026733, " methods", false], [653, 0.021345, " do", false], [3738, 0.020873, " human", false]]]}, "raw_delta": -0.021809697151184082, "tuned_delta": -0.013237905120605834}, {"byte_start": 4133, "byte_end": 4138, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 691, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "1.82% 1.82% 1.82% 1.82% 1.82%", "qwen": "2.36% 2.36% 2.36% 2.36% 2.36%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.603221595287323]], "qwen": [[429, " that", "normal", 0.5194821357727051]]}, "loss": {"rwkv": 1.8174576198698855, "qwen": 2.3621350593066297}, "topk": {"rwkv": [32227, 1, 0.603221595287323, [[32227, 0.603222, " that", false], [37810, 0.081903, " based", false], [32499, 0.039989, " work", false], [32487, 0.030928, " with", false], [45301, 0.022007, " better", false], [31458, 0.019397, " more", false], [40085, 0.016495, " using", false], [21700, 0.014673, " for", false], [22681, 0.008881, " use", false], [4491, 0.008791, " do", false]]], "qwen": [429, 1, 0.5194821357727051, [[429, 0.519482, " that", false], [3118, 0.150236, " based", false], [2664, 0.058277, " better", false], [803, 0.051618, " more", false], [448, 0.026351, " with", false], [975, 0.020437, " work", false], [9902, 0.015163, " ``", false], [1667, 0.007924, " using", false], [438, 0.006488, " as", false], [369, 0.006078, " for", false]]]}, "raw_delta": -0.030203330516815185, "tuned_delta": -0.02163153848623694}, {"byte_start": 4138, "byte_end": 4145, "display": {"text": " worked", "kind": "normal"}, "is_word": true, "word_id": 692, "word_key": " worked", "bytes_hex": "20 77 6f 72 6b 65 64", "compression": {"rwkv": "6.96% 6.96% 6.96% 6.96% 6.96% 6.96% 6.96%", "qwen": "8.39% 8.39% 8.39% 8.39% 8.39% 8.39% 8.39%"}, "model_tokens": {"rwkv": [[47812, " worked", "normal", 0.06686489284038544]], "qwen": [[6439, " worked", "normal", 0.03847305104136467]]}, "loss": {"rwkv": 6.963901843576749, "qwen": 8.392871293065653}, "topk": {"rwkv": [47812, 5, 0.06686489284038544, [[32462, 0.11901, " were", false], [40219, 0.11162, " would", false], [32354, 0.090664, " used", false], [38128, 0.084713, " could", false], [47812, 0.066865, " worked", false], [21532, 0.063689, " did", false], [47054, 0.037808, " relied", false], [56540, 0.0283, " leverage", false], [32272, 0.025586, " took", false], [31351, 0.019677, " made", false]]], "qwen": [6439, 8, 0.03847305104136467, [[1033, 0.177715, " were", false], [1035, 0.086483, " would", false], [3867, 0.082084, " took", false], [1483, 0.047169, " used", false], [39913, 0.046838, " relied", false], [1410, 0.041457, " could", false], [27505, 0.03997, " lever", false], [6439, 0.038473, " worked", false], [1521, 0.032498, " did", false], [50663, 0.028108, " exploited", false]]]}, "raw_delta": -0.0792388916015625, "tuned_delta": -0.07066709957098426}, {"byte_start": 4145, "byte_end": 4149, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 693, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "21.70% 21.70% 21.70% 21.70%", "qwen": "25.85% 25.85% 25.85% 25.85%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.008162806741893291]], "qwen": [[279, " the", "normal", 0.0032348092645406723]]}, "loss": {"rwkv": 21.696780888369172, "qwen": 25.850323140441187}, "topk": {"rwkv": [22590, 15, 0.008162806741893291, [[32458, 0.341334, " well", false], [32487, 0.112616, " with", false], [4596, 0.100526, " in", false], [4712, 0.071727, " on", false], [4450, 0.061649, " by", false], [53356, 0.037994, " without", false], [21700, 0.037633, " for", false], [45301, 0.037044, " better", false], [4423, 0.019666, " as", false], [37810, 0.019405, " based", false]]], "qwen": [279, 28, 0.0032348092645406723, [[1632, 0.210527, " well", false], [553, 0.183147, " by", false], [2664, 0.122462, " better", false], [448, 0.090211, " with", false], [389, 0.036326, " on", false], [1850, 0.034978, " best", false], [2041, 0.032927, " without", false], [304, 0.030127, " in", false], [3118, 0.029257, " based", false], [1667, 0.022388, " using", false]]]}, "raw_delta": -0.23032128810882568, "tuned_delta": -0.22174949607824743}, {"byte_start": 4149, "byte_end": 4153, "display": {"text": " way", "kind": "normal"}, "is_word": true, "word_id": 694, "word_key": " way", "bytes_hex": "20 77 61 79", "compression": {"rwkv": "1.51% 1.51% 1.51% 1.51%", "qwen": "1.80% 1.80% 1.80% 1.80%"}, "model_tokens": {"rwkv": [[22752, " way", "normal", 0.7143092751502991]], "qwen": [[1616, " way", "normal", 0.6703117489814758]]}, "loss": {"rwkv": 1.514548016558238, "qwen": 1.8034244536221318}, "topk": {"rwkv": [22752, 1, 0.7143092751502991, [[22752, 0.714309, " way", false], [30273, 0.117729, " best", false], [31937, 0.062102, " same", false], [39523, 0.019476, " right", false], [38499, 0.01691, " first", false], [31461, 0.013271, " most", false], [38720, 0.011546, " human", false], [4404, 0.010584, " ``", false], [51718, 0.003699, " fastest", false], [51555, 0.003047, " easiest", false]]], "qwen": [1616, 1, 0.6703117489814758, [[1616, 0.670312, " way", false], [1850, 0.105118, " best", false], [1852, 0.093585, " same", false], [3738, 0.023929, " human", false], [2310, 0.02321, " old", false], [9902, 0.017485, " ``", false], [1156, 0.013976, " first", false], [2588, 0.005618, " hard", false], [8606, 0.004595, " traditional", false], [1008, 0.002564, " other", false]]]}, "raw_delta": -0.016018711030483246, "tuned_delta": -0.007446918999904998}, {"byte_start": 4153, "byte_end": 4157, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 695, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "15.92% 15.92% 15.92% 15.92%", "qwen": "16.31% 16.31% 16.31% 16.31%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.029294833540916443]], "qwen": [[279, " the", "normal", 0.026834776625037193]]}, "loss": {"rwkv": 15.920365197309849, "qwen": 16.311725692938552}, "topk": {"rwkv": [22590, 6, 0.029294833540916443, [[32232, 0.33019, " they", false], [46227, 0.2556, " humans", false], [46787, 0.156969, " people", false], [38720, 0.070664, " human", false], [32227, 0.062082, " that", false], [22590, 0.029295, " the", false], [51685, 0.019072, " experts", false], [332, 0.015409, " a", false], [39931, 0.011945, " their", false], [4601, 0.004655, " it", false]]], "qwen": [279, 6, 0.026834776625037193, [[1251, 0.338643, " people", false], [12677, 0.333696, " humans", false], [807, 0.124633, " they", false], [429, 0.074541, " that", false], [3738, 0.036561, " human", false], [279, 0.026835, " the", false], [264, 0.011034, " a", false], [862, 0.008604, " their", false], [582, 0.008014, " we", false], [1429, 0.00515, " most", false]]]}, "raw_delta": -0.0217016339302063, "tuned_delta": -0.01312984189962805}, {"byte_start": 4157, "byte_end": 4169, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 696, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"rwkv": "8.08% 8.08% 8.08% 8.08% 8.08% 8.08% 8.08% 8.08% 8.08% 8.08% 8.08% 8.08%", "qwen": "9.76% 9.76% 9.76% 9.76% 9.76% 9.76% 9.76% 9.76% 9.76% 9.76% 9.76% 9.76%"}, "model_tokens": {"rwkv": [[63843, " researchers", "normal", 0.0046857683919370174]], "qwen": [[11811, " researchers", "normal", 0.0015071507077664137]]}, "loss": {"rwkv": 8.077589421643935, "qwen": 9.764542163153973}, "topk": {"rwkv": [63843, 13, 0.0046857683919370174, [[38720, 0.550796, " human", false], [51685, 0.110782, " experts", false], [46227, 0.071634, " humans", false], [40213, 0.048832, " world", false], [45775, 0.014298, " domain", false], [53087, 0.011699, " systems", false], [30273, 0.009457, " best", false], [47487, 0.009286, " system", false], [45929, 0.009068, " expert", false], [4404, 0.007293, " ``", false]]], "qwen": [11811, 28, 0.0015071507077664137, [[3738, 0.503164, " human", false], [12677, 0.108089, " humans", false], [1879, 0.094028, " world", false], [11647, 0.063805, " experts", false], [1850, 0.047976, " best", false], [1251, 0.022485, " people", false], [6203, 0.01531, " expert", false], [5461, 0.011294, " average", false], [8686, 0.006228, " majority", false], [33738, 0.00596, " champions", false]]]}, "raw_delta": -0.09354452292124434, "tuned_delta": -0.08497273089066609}, {"byte_start": 4169, "byte_end": 4177, "display": {"text": " thought", "kind": "normal"}, "is_word": true, "word_id": 697, "word_key": " thought", "bytes_hex": "20 74 68 6f 75 67 68 74", "compression": {"rwkv": "3.01% 3.01% 3.01% 3.01% 3.01% 3.01% 3.01% 3.01%", "qwen": "3.65% 3.65% 3.65% 3.65% 3.65% 3.65% 3.65% 3.65%"}, "model_tokens": {"rwkv": [[53137, " thought", "normal", 0.2654259204864502]], "qwen": [[3381, " thought", "normal", 0.19764433801174164]]}, "loss": {"rwkv": 3.011485009668124, "qwen": 3.654721084280602}, "topk": {"rwkv": [53137, 1, 0.2654259204864502, [[53137, 0.265426, " thought", false], [47763, 0.245852, " wanted", false], [31220, 0.126704, " knew", false], [62684, 0.075654, " understood", false], [62643, 0.044594, " themselves", false], [55616, 0.044529, " believed", false], [21532, 0.021053, " did", false], [56175, 0.019688, " expected", false], [40219, 0.015921, " would", false], [40, 0.013553, "'", false]]], "qwen": [3381, 2, 0.19764433801174164, [[4829, 0.216252, " wanted", false], [3381, 0.197644, " thought", false], [5577, 0.095206, " themselves", false], [6876, 0.091078, " knew", false], [6342, 0.039408, " played", false], [3601, 0.039298, " expected", false], [1521, 0.038354, " did", false], [15985, 0.033178, " understood", false], [1035, 0.025781, " would", false], [11585, 0.016411, " believed", false]]]}, "raw_delta": -0.03566858172416687, "tuned_delta": -0.02709678969358862}, {"byte_start": 4177, "byte_end": 4183, "display": {"text": " their", "kind": "normal"}, "is_word": true, "word_id": 698, "word_key": " their", "bytes_hex": "20 74 68 65 69 72", "compression": {"rwkv": "14.28% 14.28% 14.28% 14.28% 14.28% 14.28%", "qwen": "15.82% 15.82% 15.82% 15.82% 15.82% 15.82%"}, "model_tokens": {"rwkv": [[39931, " their", "normal", 0.008585930801928043]], "qwen": [[862, " their", "normal", 0.005176984239369631]]}, "loss": {"rwkv": 14.276669675463697, "qwen": 15.82015090665209}, "topk": {"rwkv": [39931, 20, 0.008585930801928043, [[22590, 0.207213, " the", false], [46227, 0.132329, " humans", false], [32232, 0.094845, " they", false], [47350, 0.088168, " speech", false], [46787, 0.083652, " people", false], [38720, 0.068032, " human", false], [45, 0.036853, ",", false], [22748, 0.035229, " was", false], [30273, 0.020521, " best", false], [332, 0.019366, " a", false]]], "qwen": [862, 20, 0.005176984239369631, [[1251, 0.166699, " people", false], [807, 0.156441, " they", false], [279, 0.124674, " the", false], [12677, 0.096171, " humans", false], [572, 0.055338, " was", false], [11, 0.052921, ",", false], [1035, 0.051776, " would", false], [3738, 0.037222, " human", false], [429, 0.036515, " that", false], [264, 0.028396, " a", false]]]}, "raw_delta": -0.08558877309163415, "tuned_delta": -0.07701698106105591}, {"byte_start": 4183, "byte_end": 4187, "display": {"text": " own", "kind": "normal"}, "is_word": true, "word_id": 699, "word_key": " own", "bytes_hex": "20 6f 77 6e", "compression": {"rwkv": "19.16% 19.16% 19.16% 19.16%", "qwen": "9.08% 9.08% 9.08% 9.08%"}, "model_tokens": {"rwkv": [[22251, " own", "normal", 0.014240657910704613]], "qwen": [[1828, " own", "normal", 0.1334380805492401]]}, "loss": {"rwkv": 19.160793511806542, "qwen": 9.08049263485721}, "topk": {"rwkv": [22251, 7, 0.014240657910704613, [[53087, 0.29197, " systems", false], [38720, 0.176664, " human", false], [59943, 0.066479, " knowledge", false], [47487, 0.064513, " system", false], [45775, 0.061871, " domain", false], [52224, 0.049945, " methods", false], [22251, 0.014241, " own", false], [65034, 0.013689, " understanding", false], [47350, 0.011999, " speech", false], [38478, 0.010275, " field", false]]], "qwen": [1828, 3, 0.1334380805492401, [[3738, 0.201269, " human", false], [5942, 0.165008, " systems", false], [1828, 0.133438, " own", false], [61440, 0.070908, " predecessors", false], [7947, 0.044888, " domain", false], [1849, 0.024061, " system", false], [3281, 0.019679, " special", false], [5413, 0.016345, " methods", false], [6540, 0.016087, " knowledge", false], [34102, 0.012111, " brains", false]]]}, "raw_delta": 0.55897057056427, "tuned_delta": 0.5675423625948482}, {"byte_start": 4187, "byte_end": 4193, "display": {"text": " minds", "kind": "normal"}, "is_word": true, "word_id": 700, "word_key": " minds", "bytes_hex": "20 6d 69 6e 64 73", "compression": {"rwkv": "12.21% 12.21% 12.21% 12.21% 12.21% 12.21%", "qwen": "9.01% 9.01% 9.01% 9.01% 9.01% 9.01%"}, "model_tokens": {"rwkv": [[39026, " minds", "normal", 0.017391813918948174]], "qwen": [[20062, " minds", "normal", 0.0499066598713398]]}, "loss": {"rwkv": 12.210309590857111, "qwen": 9.009633632918597}, "topk": {"rwkv": [39026, 10, 0.017391813918948174, [[38720, 0.231769, " human", false], [59943, 0.149483, " knowledge", false], [53087, 0.099329, " systems", false], [52224, 0.066865, " methods", false], [47487, 0.040331, " system", false], [65034, 0.029332, " understanding", false], [47350, 0.025544, " speech", false], [59683, 0.022126, " expertise", false], [45775, 0.017956, " domain", false], [39026, 0.017392, " minds", false]]], "qwen": [20062, 5, 0.0499066598713398, [[3738, 0.156074, " human", false], [5942, 0.091684, " systems", false], [7947, 0.073352, " domain", false], [34102, 0.062548, " brains", false], [20062, 0.049907, " minds", false], [6540, 0.04608, " knowledge", false], [5413, 0.044033, " methods", false], [12677, 0.035771, " humans", false], [1616, 0.034793, " way", false], [3281, 0.025066, " special", false]]]}, "raw_delta": 0.1774831612904867, "tuned_delta": 0.18605495332106495}, {"byte_start": 4193, "byte_end": 4200, "display": {"text": " worked", "kind": "normal"}, "is_word": true, "word_id": 701, "word_key": " worked", "bytes_hex": "20 77 6f 72 6b 65 64", "compression": {"rwkv": "1.08% 1.08% 1.08% 1.08% 1.08% 1.08% 1.08%", "qwen": "0.70% 0.70% 0.70% 0.70% 0.70% 0.70% 0.70%"}, "model_tokens": {"rwkv": [[47812, " worked", "normal", 0.6561989784240723]], "qwen": [[6439, " worked", "normal", 0.7613739371299744]]}, "loss": {"rwkv": 1.081820011827313, "qwen": 0.7023623279756674}, "topk": {"rwkv": [47812, 1, 0.6561989784240723, [[47812, 0.656199, " worked", false], [21532, 0.13238, " did", false], [40219, 0.087434, " would", false], [47266, 0.035626, " should", false], [53137, 0.016959, " thought", false], [32499, 0.012029, " work", false], [32462, 0.009216, " were", false], [39021, 0.008043, " might", false], [56760, 0.005808, " operated", false], [39196, 0.0058, " ought", false]]], "qwen": [6439, 1, 0.7613739371299744, [[6439, 0.761374, " worked", false], [1035, 0.091885, " would", false], [1521, 0.045518, " did", false], [1265, 0.037856, " should", false], [975, 0.008386, " work", false], [1030, 0.007429, " had", false], [21776, 0.005342, " ought", false], [1969, 0.004679, " must", false], [323, 0.004666, " and", false], [1033, 0.004177, " were", false]]]}, "raw_delta": 0.02104160189628601, "tuned_delta": 0.02961339392686426}, {"byte_start": 4200, "byte_end": 4203, "display": {"text": "---", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d 2d 2d", "compression": {"rwkv": "16.62% 16.62% 16.62%", "qwen": "14.36% 14.36% 14.36%"}, "model_tokens": {"rwkv": [[5346, "---", "normal", 0.06219616159796715]], "qwen": [[4421, "---", "normal", 0.0916820615530014]]}, "loss": {"rwkv": 16.62480613524391, "qwen": 14.363403392671328}, "topk": {"rwkv": [5346, 3, 0.06219616159796715, [[45, 0.542713, ",", false], [47, 0.252916, ".", false], [5346, 0.062196, "---", false], [275, 0.027437, " (", false], [30273, 0.022266, " best", false], [60, 0.021071, ";", false], [21265, 0.017501, " and", false], [32465, 0.007372, " when", false], [4596, 0.006008, " in", false], [21400, 0.004508, " but", false]]], "qwen": [4421, 3, 0.0916820615530014, [[11, 0.463088, ",", false], [13, 0.217557, ".", false], [4421, 0.091682, "---", false], [320, 0.047334, " (", false], [323, 0.041853, " and", false], [382, 0.035104, ".\n\n", false], [26, 0.016768, ";", false], [304, 0.009855, " in", false], [979, 0.007711, " when", false], [714, 0.007509, " but", false]]]}, "raw_delta": 0.12539879480997718, "tuned_delta": 0.13397058684055543}, {"byte_start": 4203, "byte_end": 4207, "display": {"text": "they", "kind": "normal"}, "is_word": true, "word_id": 702, "word_key": "they", "bytes_hex": "74 68 65 79", "compression": {"rwkv": "17.54% 17.54% 17.54% 17.54%", "qwen": "16.97% 16.97% 16.97% 16.97%"}, "model_tokens": {"rwkv": [[27148, "they", "normal", 0.02055172808468342]], "qwen": [[20069, "they", "normal", 0.023210639134049416]]}, "loss": {"rwkv": 17.540579354558197, "qwen": 16.96584343233859}, "topk": {"rwkv": [27148, 14, 0.02055172808468342, [[27142, 0.101266, "that", false], [1950, 0.074633, "in", false], [7005, 0.057043, "and", false], [7195, 0.048548, "but", false], [1782, 0.043067, "by", false], [27493, 0.037862, "with", false], [8801, 0.034769, "the", false], [36003, 0.032613, "which", false], [98, 0.029583, "a", false], [49750, 0.025774, "systems", false]]], "qwen": [20069, 12, 0.023210639134049416, [[9033, 0.113276, "that", false], [29939, 0.078263, "based", false], [437, 0.058803, "and", false], [970, 0.053, "using", false], [4197, 0.042315, "with", false], [1782, 0.039568, "the", false], [1694, 0.037741, "by", false], [258, 0.035452, "in", false], [64, 0.030492, "a", false], [8088, 0.027657, "but", false]]]}, "raw_delta": 0.031870126724243164, "tuned_delta": 0.040441918754821414}, {"byte_start": 4207, "byte_end": 4213, "display": {"text": " tried", "kind": "normal"}, "is_word": true, "word_id": 703, "word_key": " tried", "bytes_hex": "20 74 72 69 65 64", "compression": {"rwkv": "7.00% 7.00% 7.00% 7.00% 7.00% 7.00%", "qwen": "7.13% 7.13% 7.13% 7.13% 7.13% 7.13%"}, "model_tokens": {"rwkv": [[40013, " tried", "normal", 0.09664983302354813]], "qwen": [[6679, " tried", "normal", 0.09341413527727127]]}, "loss": {"rwkv": 6.9974466501450365, "qwen": 7.125449037615954}, "topk": {"rwkv": [40013, 2, 0.09664983302354813, [[47763, 0.106261, " wanted", false], [40013, 0.09665, " tried", false], [32462, 0.093518, " were", false], [21532, 0.062411, " did", false], [53137, 0.056074, " thought", false], [32354, 0.048292, " used", false], [45150, 0.035507, " always", false], [21795, 0.03244, " had", false], [47812, 0.028795, " worked", false], [40219, 0.024284, " would", false]]], "qwen": [6679, 3, 0.09341413527727127, [[4829, 0.184392, " wanted", false], [1521, 0.118051, " did", false], [6679, 0.093414, " tried", false], [1033, 0.086483, " were", false], [3381, 0.045878, " thought", false], [1483, 0.0269, " used", false], [11585, 0.02205, " believed", false], [1030, 0.020286, " had", false], [2581, 0.018875, " never", false], [3867, 0.015135, " took", false]]]}, "raw_delta": -0.007097959518432617, "tuned_delta": 0.001473832512145631}, {"byte_start": 4213, "byte_end": 4216, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 704, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.76% 0.76% 0.76%", "qwen": "0.75% 0.75% 0.75%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.8819284439086914]], "qwen": [[311, " to", "normal", 0.8823504447937012]]}, "loss": {"rwkv": 0.757274008279119, "qwen": 0.7524013456532673}, "topk": {"rwkv": [4811, 1, 0.8819284439086914, [[4811, 0.881928, " to", false], [52224, 0.012025, " methods", false], [38499, 0.008718, " first", false], [38720, 0.007755, " human", false], [31048, 0.007378, " hard", false], [22249, 0.005742, " out", false], [21700, 0.005071, " for", false], [22590, 0.00433, " the", false], [45, 0.00394, ",", false], [22187, 0.002952, " not", false]]], "qwen": [311, 1, 0.8823504447937012, [[311, 0.88235, " to", false], [3738, 0.023664, " human", false], [5413, 0.015564, " methods", false], [3281, 0.005675, " special", false], [2588, 0.004839, " hard", false], [537, 0.004669, " not", false], [369, 0.004409, " for", false], [1667, 0.004191, " using", false], [279, 0.003089, " the", false], [11, 0.003054, ",", false]]]}, "raw_delta": 0.00027019778887430596, "tuned_delta": 0.008841989819452554}, {"byte_start": 4216, "byte_end": 4220, "display": {"text": " put", "kind": "normal"}, "is_word": true, "word_id": 705, "word_key": " put", "bytes_hex": "20 70 75 74", "compression": {"rwkv": "19.44% 19.44% 19.44% 19.44%", "qwen": "23.32% 23.32% 23.32% 23.32%"}, "model_tokens": {"rwkv": [[22339, " put", "normal", 0.013433695770800114]], "qwen": [[2182, " put", "normal", 0.005670353304594755]]}, "loss": {"rwkv": 19.44256988698017, "qwen": 23.31983060957362}, "topk": {"rwkv": [22339, 17, 0.013433695770800114, [[31358, 0.0724, " make", false], [22681, 0.068449, " use", false], [37923, 0.061063, " build", false], [39025, 0.049412, " mimic", false], [39043, 0.031307, " model", false], [4516, 0.025971, " em", false], [32187, 0.024617, " take", false], [45854, 0.019379, " encode", false], [4491, 0.017422, " do", false], [45616, 0.016928, " create", false]]], "qwen": [2182, 32, 0.005670353304594755, [[1281, 0.136003, " make", false], [990, 0.085992, " use", false], [32064, 0.0754, " leverage", false], [1896, 0.066793, " take", false], [1936, 0.041364, " build", false], [32194, 0.029387, " exploit", false], [5648, 0.025347, " avoid", false], [653, 0.020886, " do", false], [9902, 0.019416, " ``", false], [65485, 0.019378, " emulate", false]]]}, "raw_delta": -0.21500098705291748, "tuned_delta": -0.20642919502233922}, {"byte_start": 4220, "byte_end": 4225, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 706, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "26.49% 26.49% 26.49% 26.49% 26.49%", "qwen": "23.14% 23.14% 23.14% 23.14% 23.14%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.0006495369016192853]], "qwen": [[429, " that", "normal", 0.001635799533687532]]}, "loss": {"rwkv": 26.48697926632081, "qwen": 23.139471113743912}, "topk": {"rwkv": [32227, 82, 0.0006495369016192853, [[4596, 0.182866, " in", false], [39931, 0.178564, " their", false], [22590, 0.107867, " the", false], [38720, 0.078455, " human", false], [57435, 0.054727, " together", false], [21256, 0.029646, " all", false], [40210, 0.029152, " words", false], [332, 0.02602, " a", false], [59943, 0.022969, " knowledge", false], [4404, 0.021274, " ``", false]]], "qwen": [429, 38, 0.001635799533687532, [[862, 0.155009, " their", false], [304, 0.148532, " in", false], [3738, 0.101256, " human", false], [279, 0.100274, " the", false], [5577, 0.09738, " themselves", false], [264, 0.042682, " a", false], [3786, 0.026835, " together", false], [6540, 0.024458, " knowledge", false], [12677, 0.021355, " humans", false], [1119, 0.015779, " into", false]]]}, "raw_delta": 0.18562526702880855, "tuned_delta": 0.1941970590593868}, {"byte_start": 4225, "byte_end": 4235, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 707, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "2.59% 2.59% 2.59% 2.59% 2.59% 2.59% 2.59% 2.59% 2.59% 2.59%", "qwen": "3.29% 3.29% 3.29% 3.29% 3.29% 3.29% 3.29% 3.29% 3.29% 3.29%"}, "model_tokens": {"rwkv": [[59943, " knowledge", "normal", 0.23726817965507507]], "qwen": [[6540, " knowledge", "normal", 0.16167356073856354]]}, "loss": {"rwkv": 2.592342651597356, "qwen": 3.286055311770598}, "topk": {"rwkv": [59943, 1, 0.23726817965507507, [[59943, 0.237268, " knowledge", false], [38720, 0.216031, " human", false], [31162, 0.045316, " into", false], [52964, 0.030301, " special", false], [4596, 0.02453, " in", false], [65034, 0.023088, " understanding", false], [4404, 0.022945, " ``", false], [47487, 0.020702, " system", false], [38434, 0.015141, " extra", false], [31427, 0.014325, " mind", false]]], "qwen": [6540, 2, 0.16167356073856354, [[3738, 0.232212, " human", false], [6540, 0.161674, " knowledge", false], [1119, 0.066522, " into", false], [8660, 0.053874, " understanding", false], [304, 0.053395, " in", false], [3093, 0.047307, " kind", false], [3281, 0.028993, " special", false], [1616, 0.027035, " way", false], [3381, 0.025701, " thought", false], [9902, 0.025343, " ``", false]]]}, "raw_delta": -0.03846759796142579, "tuned_delta": -0.029895805930847542}, {"byte_start": 4235, "byte_end": 4238, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 708, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "9.16% 9.16% 9.16%", "qwen": "17.62% 17.62% 17.62%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.21844901144504547]], "qwen": [[304, " in", "normal", 0.053343866020441055]]}, "loss": {"rwkv": 9.157732193142833, "qwen": 17.618891654628577}, "topk": {"rwkv": [4596, 2, 0.21844901144504547, [[31162, 0.553753, " into", false], [4596, 0.218449, " in", false], [4706, 0.039429, " of", false], [4811, 0.038389, " to", false], [32232, 0.034851, " they", false], [56003, 0.015738, " directly", false], [45, 0.015472, ",", false], [32227, 0.009432, " that", false], [21265, 0.008139, " and", false], [46301, 0.007721, " inside", false]]], "qwen": [304, 3, 0.053343866020441055, [[1119, 0.64124, " into", false], [311, 0.188813, " to", false], [304, 0.053344, " in", false], [5961, 0.017141, " directly", false], [315, 0.013351, " of", false], [518, 0.012458, " at", false], [11, 0.010536, ",", false], [389, 0.009964, " on", false], [4766, 0.00838, " inside", false], [323, 0.008258, " and", false]]]}, "raw_delta": -0.46918630599975586, "tuned_delta": -0.46061451396917763}, {"byte_start": 4238, "byte_end": 4244, "display": {"text": " their", "kind": "normal"}, "is_word": true, "word_id": 709, "word_key": " their", "bytes_hex": "20 74 68 65 69 72", "compression": {"rwkv": "6.53% 6.53% 6.53% 6.53% 6.53% 6.53%", "qwen": "5.88% 5.88% 5.88% 5.88% 5.88% 5.88%"}, "model_tokens": {"rwkv": [[39931, " their", "normal", 0.11392802745103836]], "qwen": [[862, " their", "normal", 0.14135323464870453]]}, "loss": {"rwkv": 6.527819358188994, "qwen": 5.8804651948313245}, "topk": {"rwkv": [39931, 2, 0.11392802745103836, [[22590, 0.584285, " the", false], [39931, 0.113928, " their", false], [45, 0.050233, ",", false], [332, 0.041784, " a", false], [47, 0.038236, ".", false], [21265, 0.0143, " and", false], [4423, 0.013226, " as", false], [38559, 0.008859, " front", false], [39934, 0.008139, " there", false], [4811, 0.007723, " to", false]]], "qwen": [862, 2, 0.14135323464870453, [[279, 0.568154, " the", false], [862, 0.141353, " their", false], [264, 0.072226, " a", false], [311, 0.030093, " to", false], [5942, 0.012445, " systems", false], [12645, 0.011967, " machines", false], [1992, 0.011912, " place", false], [11, 0.011863, ",", false], [6366, 0.010402, " computer", false], [13, 0.008414, ".", false]]]}, "raw_delta": 0.03589693705240887, "tuned_delta": 0.04446872908298712}, {"byte_start": 4244, "byte_end": 4252, "display": {"text": " systems", "kind": "normal"}, "is_word": true, "word_id": 710, "word_key": " systems", "bytes_hex": "20 73 79 73 74 65 6d 73", "compression": {"rwkv": "1.90% 1.90% 1.90% 1.90% 1.90% 1.90% 1.90% 1.90%", "qwen": "1.52% 1.52% 1.52% 1.52% 1.52% 1.52% 1.52% 1.52%"}, "model_tokens": {"rwkv": [[53087, " systems", "normal", 0.4285065233707428]], "qwen": [[5942, " systems", "normal", 0.5105169415473938]]}, "loss": {"rwkv": 1.901990532421973, "qwen": 1.5155768221501569}, "topk": {"rwkv": [53087, 1, 0.4285065233707428, [[53087, 0.428507, " systems", false], [46587, 0.110786, " models", false], [52224, 0.098029, " methods", false], [47487, 0.076208, " system", false], [61559, 0.048317, " algorithms", false], [56949, 0.037343, " programs", false], [47350, 0.01668, " speech", false], [30469, 0.016335, " code", false], [56567, 0.016307, " machines", false], [22251, 0.015295, " own", false]]], "qwen": [5942, 1, 0.5105169415473938, [[5942, 0.510517, " systems", false], [7468, 0.084851, " programs", false], [12645, 0.07608, " machines", false], [4119, 0.03891, " models", false], [8806, 0.036206, " speech", false], [1849, 0.034784, " system", false], [18495, 0.024004, " computers", false], [5413, 0.020255, " methods", false], [25185, 0.019073, " algorithms", false], [6366, 0.018461, " computer", false]]]}, "raw_delta": 0.021427325904369354, "tuned_delta": 0.029999117934947604}, {"byte_start": 4252, "byte_end": 4255, "display": {"text": "---", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2d 2d 2d", "compression": {"rwkv": "9.25% 9.25% 9.25%", "qwen": "8.18% 8.18% 8.18%"}, "model_tokens": {"rwkv": [[5346, "---", "normal", 0.2115027755498886]], "qwen": [[4421, "---", "normal", 0.2565803825855255]]}, "loss": {"rwkv": 9.251657651534043, "qwen": 8.177155194389064}, "topk": {"rwkv": [5346, 3, 0.2115027755498886, [[47, 0.358047, ".", false], [45, 0.223329, ",", false], [5346, 0.211503, "---", false], [21265, 0.050371, " and", false], [4596, 0.01938, " in", false], [4423, 0.014669, " as", false], [47001, 0.011381, " rather", false], [4450, 0.011237, " by", false], [4811, 0.009672, " to", false], [4788, 0.008337, " so", false]]], "qwen": [4421, 2, 0.2565803825855255, [[13, 0.326225, ".", false], [4421, 0.25658, "---", false], [11, 0.202918, ",", false], [323, 0.047183, " and", false], [382, 0.031108, ".\n\n", false], [4518, 0.01422, " instead", false], [311, 0.013798, " to", false], [304, 0.01277, " in", false], [320, 0.010513, " (", false], [773, 0.010385, " so", false]]]}, "raw_delta": 0.05958306789398199, "tuned_delta": 0.06815485992456023}, {"byte_start": 4255, "byte_end": 4258, "display": {"text": "but", "kind": "normal"}, "is_word": true, "word_id": 711, "word_key": "but", "bytes_hex": "62 75 74", "compression": {"rwkv": "2.45% 2.45% 2.45%", "qwen": "4.04% 4.04% 4.04%"}, "model_tokens": {"rwkv": [[7195, "but", "normal", 0.6669910550117493]], "qwen": [[8088, "but", "normal", 0.5108304619789124]]}, "loss": {"rwkv": 2.4538026004703233, "qwen": 4.037848089647843}, "topk": {"rwkv": [7195, 1, 0.6669910550117493, [[7195, 0.666991, "but", false], [7005, 0.214964, "and", false], [35898, 0.014185, "until", false], [36003, 0.008452, "which", false], [26476, 0.008341, "only", false], [2190, 0.008284, "so", false], [36004, 0.006571, "while", false], [42135, 0.00612, "rather", false], [36002, 0.006116, "where", false], [9122, 0.003406, "yet", false]]], "qwen": [8088, 1, 0.5108304619789124, [[8088, 0.51083, "but", false], [437, 0.291467, "and", false], [3243, 0.029564, "only", false], [38730, 0.02406, "until", false], [73203, 0.021517, "rather", false], [64837, 0.0121, "instead", false], [28996, 0.006618, "without", false], [14801, 0.006535, "before", false], [704, 0.006166, "so", false], [3472, 0.005263, "while", false]]]}, "raw_delta": -0.08783813317616779, "tuned_delta": -0.07926634114558954}, {"byte_start": 4258, "byte_end": 4261, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 712, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "17.19% 17.19% 17.19%", "qwen": "16.16% 16.16% 16.16%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.057567186653614044]], "qwen": [[432, " it", "normal", 0.06796281039714813]]}, "loss": {"rwkv": 17.188358885591164, "qwen": 16.162961058239414}, "topk": {"rwkv": [4601, 5, 0.057567186653614044, [[22590, 0.160855, " the", false], [32232, 0.108364, " they", false], [4596, 0.076378, " in", false], [32234, 0.060832, " this", false], [4601, 0.057567, " it", false], [32227, 0.045204, " that", false], [45, 0.039228, ",", false], [30597, 0.037068, " deep", false], [61959, 0.031903, " eventually", false], [4423, 0.023895, " as", false]]], "qwen": [432, 4, 0.06796281039714813, [[279, 0.138948, " the", false], [807, 0.087394, " they", false], [304, 0.079733, " in", false], [432, 0.067963, " it", false], [419, 0.061158, " this", false], [11, 0.044456, ",", false], [429, 0.039143, " that", false], [1172, 0.028256, " only", false], [979, 0.026061, " when", false], [438, 0.025101, " as", false]]]}, "raw_delta": 0.0568601290384928, "tuned_delta": 0.06543192106907104}, {"byte_start": 4261, "byte_end": 4268, "display": {"text": " proved", "kind": "normal"}, "is_word": true, "word_id": 713, "word_key": " proved", "bytes_hex": "20 70 72 6f 76 65 64", "compression": {"rwkv": "8.86% 8.86% 8.86% 8.86% 8.86% 8.86% 8.86%", "qwen": "8.43% 8.43% 8.43% 8.43% 8.43% 8.43% 8.43%"}, "model_tokens": {"rwkv": [[46936, " proved", "normal", 0.03177895024418831]], "qwen": [[18651, " proved", "normal", 0.037908583879470825]]}, "loss": {"rwkv": 8.855828934028233, "qwen": 8.430949480414185}, "topk": {"rwkv": [46936, 6, 0.03177895024418831, [[22748, 0.346219, " was", false], [47638, 0.1177, " turned", false], [4600, 0.101375, " is", false], [21532, 0.053398, " did", false], [40040, 0.052259, " turns", false], [46936, 0.031779, " proved", false], [39115, 0.024252, " never", false], [30633, 0.021177, " didn", false], [21800, 0.017562, " has", false], [45150, 0.014967, " always", false]]], "qwen": [18651, 5, 0.037908583879470825, [[572, 0.403749, " was", false], [6519, 0.079842, " turned", false], [1521, 0.075345, " did", false], [374, 0.066288, " is", false], [18651, 0.037909, " proved", false], [3867, 0.037231, " took", false], [2581, 0.036642, " never", false], [10577, 0.016711, " turns", false], [3207, 0.015634, " didn", false], [6116, 0.015539, " became", false]]]}, "raw_delta": 0.023560319628034287, "tuned_delta": 0.03213211165861254}, {"byte_start": 4268, "byte_end": 4279, "display": {"text": " ultimately", "kind": "normal"}, "is_word": true, "word_id": 714, "word_key": " ultimately", "bytes_hex": "20 75 6c 74 69 6d 61 74 65 6c 79", "compression": {"rwkv": "6.43% 6.43% 6.43% 6.43% 6.43% 6.43% 6.43% 6.43% 6.43% 6.43% 6.43%", "qwen": "7.08% 7.08% 7.08% 7.08% 7.08% 7.08% 7.08% 7.08% 7.08% 7.08% 7.08%"}, "model_tokens": {"rwkv": [[62676, " ultimately", "normal", 0.01972923055291176]], "qwen": [[13653, " ultimately", "normal", 0.013284618966281414]]}, "loss": {"rwkv": 6.429624560780002, "qwen": 7.08420381953233}, "topk": {"rwkv": [62676, 12, 0.01972923055291176, [[4811, 0.185411, " to", false], [62082, 0.059732, " impossible", false], [22187, 0.057852, " not", false], [332, 0.056209, " a", false], [21719, 0.05288, " fut", false], [31466, 0.049094, " much", false], [32227, 0.037396, " that", false], [62161, 0.035025, " irrelevant", false], [31458, 0.034246, " more", false], [31277, 0.02764, " less", false]]], "qwen": [13653, 17, 0.013284618966281414, [[311, 0.178685, " to", false], [11997, 0.07576, " impossible", false], [39715, 0.058243, " irrelevant", false], [537, 0.045833, " not", false], [264, 0.045779, " a", false], [54188, 0.043133, " ineffective", false], [429, 0.038112, " that", false], [84527, 0.025843, " futile", false], [1753, 0.025481, " much", false], [5000, 0.020392, " difficult", false]]]}, "raw_delta": -0.0362975814125755, "tuned_delta": -0.027725789381997247}, {"byte_start": 4279, "byte_end": 4287, "display": {"text": " counter", "kind": "normal"}, "is_word": true, "word_id": 715, "word_key": " counter", "bytes_hex": "20 63 6f 75 6e 74 65 72", "compression": {"rwkv": "10.64% 10.64% 10.64% 10.64% 10.64% 10.64% 10.64% 10.64%", "qwen": "8.72% 8.72% 8.72% 8.72% 8.72% 8.72% 8.72% 8.72%"}, "model_tokens": {"rwkv": [[51336, " counter", "normal", 0.008901496417820454]], "qwen": [[5546, " counter", "normal", 0.020920855924487114]]}, "loss": {"rwkv": 10.637058162804367, "qwen": 8.717053522596084}, "topk": {"rwkv": [51336, 17, 0.008901496417820454, [[4811, 0.184686, " to", false], [21719, 0.145053, " fut", false], [62161, 0.087515, " irrelevant", false], [22187, 0.083214, " not", false], [31458, 0.064921, " more", false], [62082, 0.037568, " impossible", false], [31277, 0.032762, " less", false], [332, 0.031811, " a", false], [31466, 0.028849, " much", false], [32227, 0.026914, " that", false]]], "qwen": [5546, 12, 0.020920855924487114, [[39715, 0.214401, " irrelevant", false], [311, 0.13551, " to", false], [11997, 0.082176, " impossible", false], [54188, 0.055731, " ineffective", false], [84527, 0.043993, " futile", false], [650, 0.040503, " un", false], [264, 0.037476, " a", false], [537, 0.035118, " not", false], [28848, 0.030893, " useless", false], [2686, 0.029788, " less", false]]]}, "raw_delta": 0.10646766424179077, "tuned_delta": 0.11503945627236901}, {"byte_start": 4287, "byte_end": 4297, "display": {"text": "productive", "kind": "normal"}, "is_word": true, "word_id": 716, "word_key": "productive", "bytes_hex": "70 72 6f 64 75 63 74 69 76 65", "compression": {"rwkv": "0.26% 0.26% 0.26% 0.26% 0.26% 0.26% 0.26% 0.26% 0.26% 0.26%", "qwen": "0.29% 0.29% 0.29% 0.29% 0.29% 0.29% 0.29% 0.29% 0.29% 0.29%"}, "model_tokens": {"rwkv": [[61076, "productive", "normal", 0.8636018633842468]], "qwen": [[33270, "productive", "normal", 0.8513615727424622]]}, "loss": {"rwkv": 0.26416535172527406, "qwen": 0.29019508716709524}, "topk": {"rwkv": [61076, 1, 0.8636018633842468, [[61076, 0.863602, "productive", false], [46, 0.113879, "-", false], [62383, 0.01852, " productive", false], [4811, 0.001983, " to", false], [49587, 0.000345, "product", false], [59918, 0.000264, " intuitive", false], [47687, 0.000215, " useful", false], [59593, 0.000179, " effective", false], [7865, 0.000142, "int", false], [52574, 9.4e-05, " product", false]]], "qwen": [33270, 1, 0.8513615727424622, [[33270, 0.851362, "productive", false], [28645, 0.090052, "-product", false], [26236, 0.045962, " productive", false], [311, 0.007526, " to", false], [69, 0.001049, "f", false], [3031, 0.000766, "product", false], [52321, 0.00068, "-effective", false], [396, 0.000502, "int", false], [20052, 0.000213, "-int", false], [1985, 0.000205, " product", false]]]}, "raw_delta": -0.001443395018577577, "tuned_delta": 0.007128397012000671}, {"byte_start": 4297, "byte_end": 4298, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "47.06%", "qwen": "32.14%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.07382529228925705]], "qwen": [[11, ",", "normal", 0.16827599704265594]]}, "loss": {"rwkv": 47.05665465399548, "qwen": 32.13873548268536}, "topk": {"rwkv": [45, 3, 0.07382529228925705, [[47, 0.73699, ".", false], [4811, 0.090839, " to", false], [45, 0.073825, ",", false], [21265, 0.025615, " and", false], [4596, 0.016618, " in", false], [21700, 0.009107, " for", false], [4423, 0.007689, " as", false], [51018, 0.00695, " because", false], [275, 0.004281, " (", false], [32465, 0.00344, " when", false]]], "qwen": [11, 3, 0.16827599704265594, [[13, 0.353762, ".", false], [382, 0.180349, ".\n\n", false], [11, 0.168276, ",", false], [311, 0.077022, " to", false], [304, 0.039872, " in", false], [323, 0.038458, " and", false], [1576, 0.023677, " because", false], [979, 0.021899, " when", false], [438, 0.017857, " as", false], [25, 0.017265, ":", false]]]}, "raw_delta": 0.8272250890731812, "tuned_delta": 0.8357968811037594}, {"byte_start": 4298, "byte_end": 4302, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 717, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "4.90% 4.90% 4.90% 4.90%", "qwen": "5.12% 5.12% 5.12% 5.12%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.3399445116519928]], "qwen": [[323, " and", "normal", 0.3214159905910492]]}, "loss": {"rwkv": 4.895864518641745, "qwen": 5.117144921482811}, "topk": {"rwkv": [21265, 1, 0.3399445116519928, [[21265, 0.339945, " and", false], [4423, 0.127708, " as", false], [51018, 0.062052, " because", false], [39690, 0.030129, " since", false], [4596, 0.028861, " in", false], [30788, 0.024208, " even", false], [61953, 0.019965, " especially", false], [4424, 0.019914, " at", false], [22187, 0.019226, " not", false], [31198, 0.017515, " just", false]]], "qwen": [323, 1, 0.3214159905910492, [[323, 0.321416, " and", false], [438, 0.148337, " as", false], [1576, 0.10391, " because", false], [304, 0.049118, " in", false], [2474, 0.042246, " since", false], [6388, 0.035436, " leading", false], [448, 0.014209, " with", false], [2176, 0.013179, " both", false], [5310, 0.012899, " especially", false], [537, 0.011847, " not", false]]]}, "raw_delta": -0.01227039098739624, "tuned_delta": -0.003698598956817992}, {"byte_start": 4302, "byte_end": 4304, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 718, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "33.39% 33.39%", "qwen": "41.39% 41.39%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.02479836903512478]], "qwen": [[264, " a", "normal", 0.010144878178834915]]}, "loss": {"rwkv": 33.39050045807464, "qwen": 41.39440534614516}, "topk": {"rwkv": [332, 6, 0.02479836903512478, [[22590, 0.140634, " the", false], [32232, 0.114203, " they", false], [4601, 0.03931, " it", false], [4596, 0.032636, " in", false], [22748, 0.026399, " was", false], [332, 0.024798, " a", false], [22190, 0.021132, " now", false], [61959, 0.020945, " eventually", false], [31581, 0.01996, " only", false], [39931, 0.018339, " their", false]]], "qwen": [264, 15, 0.010144878178834915, [[279, 0.161362, " the", false], [807, 0.086711, " they", false], [304, 0.066773, " in", false], [432, 0.041896, " it", false], [1172, 0.023338, " only", false], [862, 0.021538, " their", false], [5538, 0.020492, " deep", false], [6069, 0.020044, " led", false], [2711, 0.016448, " search", false], [572, 0.01333, " was", false]]]}, "raw_delta": -0.4438307285308838, "tuned_delta": -0.43525893650030556}, {"byte_start": 4304, "byte_end": 4313, "display": {"text": " colossal", "kind": "normal"}, "is_word": true, "word_id": 719, "word_key": " colossal", "bytes_hex": "20 63 6f 6c 6f 73 73 61 6c", "compression": {"rwkv": "39.73% 39.73% 39.73% 39.73% 0.02% 0.02% 0.02% 0.02% 0.91%", "qwen": "18.90% 18.90% 18.90% 18.90% 18.90% 18.90% 18.90% 18.90% 18.90%"}, "model_tokens": {"rwkv": [[21454, " col", "normal", 0.00015093869296833873], [26568, "ossa", "normal", 0.9960336089134216], [109, "l", "normal", 0.9505134224891663]], "qwen": [[96837, " colossal", "normal", 8.025064744288102e-05]]}, "loss": {"rwkv": 17.767198982681776, "qwen": 18.896010933456505}, "topk": {"rwkv": [21454, 589, 0.00015093869296833873, [[38961, 0.064862, " major", false], [40166, 0.037564, " waste", false], [45301, 0.031831, " better", false], [22168, 0.028106, " new", false], [31466, 0.024427, " much", false], [52245, 0.019058, " mistake", false], [30585, 0.018882, " dead", false], [47342, 0.018667, " source", false], [59513, 0.017021, " different", false], [31458, 0.016709, " more", false]]], "qwen": [96837, 808, 8.025064744288102e-05, [[3598, 0.053847, " major", false], [2711, 0.046389, " search", false], [501, 0.041305, " new", false], [803, 0.038808, " more", false], [1753, 0.032122, " much", false], [2155, 0.027745, " different", false], [17755, 0.02686, " lesson", false], [2244, 0.026337, " great", false], [4586, 0.024132, " general", false], [5538, 0.017797, " deep", false]]]}, "raw_delta": -0.06259462568494999, "tuned_delta": -0.05402283365437174}, {"byte_start": 4313, "byte_end": 4319, "display": {"text": " waste", "kind": "normal"}, "is_word": true, "word_id": 720, "word_key": " waste", "bytes_hex": "20 77 61 73 74 65", "compression": {"rwkv": "0.67% 0.67% 0.67% 0.67% 0.67% 0.67%", "qwen": "2.68% 2.68% 2.68% 2.68% 2.68% 2.68%"}, "model_tokens": {"rwkv": [[40166, " waste", "normal", 0.8000627756118774]], "qwen": [[12291, " waste", "normal", 0.4097566604614258]]}, "loss": {"rwkv": 0.6721540616120861, "qwen": 2.6815848432569753}, "topk": {"rwkv": [40166, 1, 0.8000627756118774, [[40166, 0.800063, " waste", false], [52245, 0.084998, " mistake", false], [38392, 0.012419, " error", false], [31333, 0.011166, " loss", false], [51708, 0.008317, " failure", false], [32251, 0.007249, " time", false], [45157, 0.00592, " amount", false], [45829, 0.003701, " effort", false], [63494, 0.002904, " distraction", false], [22097, 0.002578, " mis", false]]], "qwen": [12291, 1, 0.4097566604614258, [[12291, 0.409757, " waste", false], [16523, 0.093011, " mistake", false], [7901, 0.071587, " failure", false], [2393, 0.051838, " success", false], [54480, 0.019745, " computational", false], [4709, 0.019731, " loss", false], [1465, 0.015853, " error", false], [9162, 0.015468, " investment", false], [5041, 0.014599, " effort", false], [3311, 0.013996, " amount", false]]]}, "raw_delta": -0.11142650246620178, "tuned_delta": -0.10285471043562354}, {"byte_start": 4319, "byte_end": 4322, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 721, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.12% 0.12% 0.12%", "qwen": "0.21% 0.21% 0.21%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9799205660820007]], "qwen": [[315, " of", "normal", 0.9657832384109497]]}, "loss": {"rwkv": 0.1225433714947799, "qwen": 0.20928595655784377}, "topk": {"rwkv": [4706, 1, 0.9799205660820007, [[4706, 0.979921, " of", false], [47, 0.007993, ".", false], [45, 0.003699, ",", false], [4596, 0.002837, " in", false], [4811, 0.001225, " to", false], [21700, 0.000496, " for", false], [32465, 0.000248, " when", false], [4588, 0.000233, " if", false], [115, 0.000213, "r", false], [30322, 0.000212, " both", false]]], "qwen": [315, 1, 0.9657832384109497, [[315, 0.965783, " of", false], [13, 0.009533, ".", false], [382, 0.00845, ".\n\n", false], [11, 0.006116, ",", false], [304, 0.002787, " in", false], [311, 0.000845, " to", false], [979, 0.000714, " when", false], [369, 0.00057, " for", false], [421, 0.000532, " if", false], [429, 0.000438, " that", false]]]}, "raw_delta": -0.004810030261675517, "tuned_delta": 0.003761761768902731}, {"byte_start": 4322, "byte_end": 4333, "display": {"text": " researcher", "kind": "normal"}, "is_word": true, "word_id": 722, "word_key": " researcher", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72", "compression": {"rwkv": "11.17% 11.17% 11.17% 11.17% 11.17% 11.17% 11.17% 11.17% 11.17% 11.17% 11.17%", "qwen": "8.72% 8.72% 8.72% 8.72% 8.72% 8.72% 8.72% 8.72% 8.72% 8.72% 8.72%"}, "model_tokens": {"rwkv": [[62496, " researcher", "normal", 0.0010917175095528364]], "qwen": [[31085, " researcher", "normal", 0.004892498254776001]]}, "loss": {"rwkv": 11.168590870518251, "qwen": 8.721832783659178}, "topk": {"rwkv": [62496, 29, 0.0010917175095528364, [[32251, 0.440795, " time", false], [45829, 0.220168, " effort", false], [57103, 0.078411, " research", false], [60406, 0.075986, " resources", false], [38720, 0.043124, " human", false], [59346, 0.021317, " computing", false], [64862, 0.011585, " computational", false], [22590, 0.011012, " the", false], [63370, 0.008455, " computation", false], [39052, 0.008243, " money", false]]], "qwen": [31085, 16, 0.004892498254776001, [[882, 0.407485, " time", false], [5041, 0.179142, " effort", false], [3412, 0.074444, " research", false], [4963, 0.057635, " resources", false], [3738, 0.038905, " human", false], [54480, 0.034954, " computational", false], [24231, 0.02493, " computing", false], [34447, 0.024742, " computation", false], [279, 0.013204, " the", false], [862, 0.012156, " their", false]]]}, "raw_delta": 0.13567707755348898, "tuned_delta": 0.14424886958406724}, {"byte_start": 4333, "byte_end": 4335, "display": {"text": "'s", "kind": "normal"}, "is_word": true, "word_id": 723, "word_key": "'s", "bytes_hex": "27 73", "compression": {"rwkv": "24.09% 24.09%", "qwen": "24.62% 24.62%"}, "model_tokens": {"rwkv": [[460, "'s", "normal", 0.06930006295442581]], "qwen": [[594, "'s", "normal", 0.06518886238336563]]}, "loss": {"rwkv": 24.091880077344992, "qwen": 24.62019143274732}, "topk": {"rwkv": [460, 3, 0.06930006295442581, [[32251, 0.671968, " time", false], [45829, 0.15504, " effort", false], [460, 0.0693, "'s", false], [21265, 0.041618, " and", false], [45860, 0.011513, " energy", false], [46, 0.008188, "-", false], [60406, 0.005903, " resources", false], [51566, 0.003552, " efforts", false], [38853, 0.00325, " labor", false], [59193, 0.002949, " attention", false]]], "qwen": [594, 3, 0.06518886238336563, [[882, 0.681477, " time", false], [5041, 0.188081, " effort", false], [594, 0.065189, "'s", false], [4963, 0.014736, " resources", false], [4802, 0.01146, " energy", false], [323, 0.006305, " and", false], [8869, 0.004525, " efforts", false], [6529, 0.004199, " attention", false], [10772, 0.002837, " talent", false], [9327, 0.001501, " labor", false]]]}, "raw_delta": -0.029295802116394043, "tuned_delta": -0.020724010085815793}, {"byte_start": 4335, "byte_end": 4340, "display": {"text": " time", "kind": "normal"}, "is_word": true, "word_id": 724, "word_key": " time", "bytes_hex": "20 74 69 6d 65", "compression": {"rwkv": "0.51% 0.51% 0.51% 0.51% 0.51%", "qwen": "1.10% 1.10% 1.10% 1.10% 1.10%"}, "model_tokens": {"rwkv": [[32251, " time", "normal", 0.866916298866272]], "qwen": [[882, " time", "normal", 0.7375895977020264]]}, "loss": {"rwkv": 0.5142418846918668, "qwen": 1.0977745045247913}, "topk": {"rwkv": [32251, 1, 0.866916298866272, [[32251, 0.866916, " time", false], [45829, 0.042071, " effort", false], [21265, 0.021866, " and", false], [51566, 0.018416, " efforts", false], [45860, 0.005459, " energy", false], [56903, 0.003187, " precious", false], [38720, 0.002723, " human", false], [57516, 0.002453, " valuable", false], [59193, 0.002409, " attention", false], [60406, 0.001895, " resources", false]]], "qwen": [882, 1, 0.7375895977020264, [[882, 0.73759, " time", false], [5041, 0.128003, " effort", false], [8869, 0.025919, " efforts", false], [4802, 0.008823, " energy", false], [4963, 0.006566, " resources", false], [26400, 0.00652, " precious", false], [3738, 0.006044, " human", false], [6529, 0.005272, " attention", false], [323, 0.004589, " and", false], [15172, 0.004549, " valuable", false]]]}, "raw_delta": -0.03235791921615601, "tuned_delta": -0.02378612718557776}, {"byte_start": 4340, "byte_end": 4341, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "35.93%", "qwen": "40.43%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.13542591035366058]], "qwen": [[11, ",", "normal", 0.10624746233224869]]}, "loss": {"rwkv": 35.92648783463727, "qwen": 40.4312466069519}, "topk": {"rwkv": [45, 3, 0.13542591035366058, [[47, 0.598064, ".", false], [21265, 0.166502, " and", false], [45, 0.135426, ",", false], [4811, 0.028994, " to", false], [4596, 0.011701, " in", false], [275, 0.008524, " (", false], [32227, 0.005544, " that", false], [5346, 0.004165, "---", false], [4423, 0.003963, " as", false], [32465, 0.003101, " when", false]]], "qwen": [11, 4, 0.10624746233224869, [[323, 0.304828, " and", false], [13, 0.26084, ".", false], [382, 0.254418, ".\n\n", false], [11, 0.106247, ",", false], [304, 0.010195, " in", false], [311, 0.009514, " to", false], [320, 0.00708, " (", false], [624, 0.005238, ".\n", false], [4421, 0.004562, "---", false], [979, 0.004306, " when", false]]]}, "raw_delta": -0.24979686737060547, "tuned_delta": -0.2412250753400272}, {"byte_start": 4341, "byte_end": 4346, "display": {"text": " when", "kind": "normal"}, "is_word": true, "word_id": 725, "word_key": " when", "bytes_hex": "20 77 68 65 6e", "compression": {"rwkv": "13.30% 13.30% 13.30% 13.30% 13.30%", "qwen": "12.28% 12.28% 12.28% 12.28% 12.28%"}, "model_tokens": {"rwkv": [[32465, " when", "normal", 0.025247817859053612]], "qwen": [[979, " when", "normal", 0.03321311995387077]]}, "loss": {"rwkv": 13.299844908195132, "qwen": 12.280257801340529}, "topk": {"rwkv": [32465, 7, 0.025247817859053612, [[4811, 0.548573, " to", false], [51018, 0.050523, " because", false], [4423, 0.044626, " as", false], [4596, 0.030249, " in", false], [21700, 0.028655, " for", false], [21265, 0.027587, " and", false], [32465, 0.025248, " when", false], [22187, 0.023942, " not", false], [39690, 0.020568, " since", false], [45860, 0.019586, " energy", false]]], "qwen": [979, 9, 0.03321311995387077, [[5041, 0.246581, " effort", false], [4802, 0.103955, " energy", false], [1576, 0.079911, " because", false], [438, 0.069456, " as", false], [323, 0.051911, " and", false], [3220, 0.050327, " money", false], [304, 0.041387, " in", false], [311, 0.035333, " to", false], [979, 0.033213, " when", false], [4963, 0.023515, " resources", false]]]}, "raw_delta": 0.05653791427612309, "tuned_delta": 0.06510970630670133}, {"byte_start": 4346, "byte_end": 4347, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "98.06%", "qwen": "80.84%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.004391924012452364]], "qwen": [[11, ",", "normal", 0.01130516454577446]]}, "loss": {"rwkv": 98.05817856042172, "qwen": 80.8359218943455}, "topk": {"rwkv": [45, 32, 0.004391924012452364, [[22590, 0.253762, " the", false], [32232, 0.102642, " they", false], [4601, 0.098824, " it", false], [30597, 0.034525, " deep", false], [32227, 0.030201, " that", false], [4596, 0.026019, " in", false], [332, 0.025607, " a", false], [39931, 0.018047, " their", false], [45301, 0.017256, " better", false], [32464, 0.016987, " what", false]]], "qwen": [11, 14, 0.01130516454577446, [[279, 0.162434, " the", false], [7707, 0.108965, " compared", false], [432, 0.107384, " it", false], [807, 0.078017, " they", false], [2711, 0.070108, " search", false], [264, 0.035017, " a", false], [10951, 0.027206, " massive", false], [803, 0.022081, " more", false], [304, 0.018598, " in", false], [5538, 0.014809, " deep", false]]]}, "raw_delta": 0.9550046920776367, "tuned_delta": 0.963576484108215}, {"byte_start": 4347, "byte_end": 4355, "display": {"text": " through", "kind": "normal"}, "is_word": true, "word_id": 726, "word_key": " through", "bytes_hex": "20 74 68 72 6f 75 67 68", "compression": {"rwkv": "14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09%", "qwen": "15.75% 15.75% 15.75% 15.75% 15.75% 15.75% 15.75% 15.75%"}, "model_tokens": {"rwkv": [[53140, " through", "normal", 0.0019288297044113278]], "qwen": [[1526, " through", "normal", 0.0009252128074876964]]}, "loss": {"rwkv": 14.088818758681281, "qwen": 15.746761609962658}, "topk": {"rwkv": [53140, 38, 0.0019288297044113278, [[4596, 0.254129, " in", false], [52028, 0.21454, " instead", false], [4423, 0.069479, " as", false], [31578, 0.039127, " once", false], [4450, 0.033198, " by", false], [32487, 0.032611, " with", false], [61959, 0.02865, " eventually", false], [31601, 0.021773, " over", false], [37634, 0.021175, " after", false], [51744, 0.018751, " finally", false]]], "qwen": [1526, 62, 0.0009252128074876964, [[304, 0.329289, " in", false], [438, 0.123083, " as", false], [4518, 0.066681, " instead", false], [518, 0.054587, " at", false], [448, 0.034583, " with", false], [916, 0.0274, " over", false], [1283, 0.022602, " after", false], [553, 0.021075, " by", false], [389, 0.020413, " on", false], [3055, 0.018127, " once", false]]]}, "raw_delta": -0.09193587303161621, "tuned_delta": -0.08336408100103797}, {"byte_start": 4355, "byte_end": 4361, "display": {"text": " Moore", "kind": "normal"}, "is_word": true, "word_id": 727, "word_key": " moore", "bytes_hex": "20 4d 6f 6f 72 65", "compression": {"rwkv": "14.75% 14.75% 14.75% 14.75% 14.75% 14.75%", "qwen": "16.54% 16.54% 16.54% 16.54% 16.54% 16.54%"}, "model_tokens": {"rwkv": [[37045, " Moore", "normal", 0.007424832321703434]], "qwen": [[20219, " Moore", "normal", 0.0040683140978217125]]}, "loss": {"rwkv": 14.746296967419742, "qwen": 16.54448593772471}, "topk": {"rwkv": [37045, 19, 0.007424832321703434, [[52195, 0.171718, " massive", false], [22590, 0.171164, " the", false], [56537, 0.057447, " learning", false], [63370, 0.047718, " computation", false], [30597, 0.036371, " deep", false], [39660, 0.023785, " sheer", false], [63885, 0.02346, " statistical", false], [332, 0.020174, " a", false], [47202, 0.019178, " search", false], [57103, 0.017832, " research", false]]], "qwen": [20219, 27, 0.0040683140978217125, [[279, 0.237795, " the", false], [10951, 0.09182, " massive", false], [6832, 0.059796, " learning", false], [32538, 0.048165, " sheer", false], [2711, 0.044429, " search", false], [34447, 0.035206, " computation", false], [5538, 0.024726, " deep", false], [264, 0.02464, " a", false], [1753, 0.015854, " much", false], [990, 0.013902, " use", false]]]}, "raw_delta": -0.09971276919047034, "tuned_delta": -0.0911409771598921}, {"byte_start": 4361, "byte_end": 4363, "display": {"text": "'s", "kind": "normal"}, "is_word": true, "word_id": 728, "word_key": "'s", "bytes_hex": "27 73", "compression": {"rwkv": "0.04% 0.04%", "qwen": "0.03% 0.03%"}, "model_tokens": {"rwkv": [[460, "'s", "normal", 0.9960860013961792]], "qwen": [[594, "'s", "normal", 0.9965344667434692]]}, "loss": {"rwkv": 0.0354972191380837, "qwen": 0.03130233932751536}, "topk": {"rwkv": [460, 1, 0.9960860013961792, [[460, 0.996086, "'s", false], [116, 0.001754, "s", false], [28309, 0.000765, "’s", false], [40, 0.000344, "'", false], [21265, 0.00018, " and", false], [45, 0.000148, ",", false], [46, 0.000134, "-", false], [439, 4.1e-05, "''", false], [4522, 3.6e-05, " et", false], [97, 2.3e-05, "`", false]]], "qwen": [594, 1, 0.9965344667434692, [[594, 0.996534, "'s", false], [748, 0.000975, "’s", false], [11, 0.000548, ",", false], [2329, 0.000432, " law", false], [6, 0.000262, "'", false], [12681, 0.000169, "-like", false], [323, 0.000102, " and", false], [4605, 9.1e-05, "''", false], [11297, 6.5e-05, "-style", false], [364, 4.8e-05, " '", false]]]}, "raw_delta": 0.0002326135290786624, "tuned_delta": 0.00880440555965691}, {"byte_start": 4363, "byte_end": 4367, "display": {"text": " law", "kind": "normal"}, "is_word": true, "word_id": 729, "word_key": " law", "bytes_hex": "20 6c 61 77", "compression": {"rwkv": "0.43% 0.43% 0.43% 0.43%", "qwen": "0.30% 0.30% 0.30% 0.30%"}, "model_tokens": {"rwkv": [[21988, " law", "normal", 0.909474790096283]], "qwen": [[2329, " law", "normal", 0.9363114237785339]]}, "loss": {"rwkv": 0.4292686965535703, "qwen": 0.29668629688294773}, "topk": {"rwkv": [21988, 1, 0.909474790096283, [[21988, 0.909475, " law", false], [20267, 0.088024, " Law", false], [31259, 0.000338, " laws", false], [21265, 0.000272, " and", false], [45828, 0.000207, " effect", false], [45, 0.00013, ",", false], [53127, 8.8e-05, " theorem", false], [4715, 7.9e-05, " or", false], [275, 6.8e-05, " (", false], [46, 6.6e-05, "-", false]]], "qwen": [2329, 1, 0.9363114237785339, [[2329, 0.936311, " law", false], [7506, 0.050916, " Law", false], [6872, 0.003729, " laws", false], [220, 0.000412, " ", false], [5912, 0.000322, " rule", false], [323, 0.000269, " and", false], [5098, 0.000241, " progress", false], [320, 0.000219, " (", false], [30312, 0.000192, "-law", false], [10963, 0.000187, " magic", false]]]}, "raw_delta": 0.007351929321885109, "tuned_delta": 0.01592372135246336}, {"byte_start": 4367, "byte_end": 4368, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "2.36%", "qwen": "2.48%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8766926527023315]], "qwen": [[11, ",", "normal", 0.8713169097900391]]}, "loss": {"rwkv": 2.3598771420791147, "qwen": 2.4841316513756824}, "topk": {"rwkv": [45, 1, 0.8766926527023315, [[45, 0.876693, ",", false], [21265, 0.085212, " and", false], [4706, 0.01144, " of", false], [4715, 0.008383, " or", false], [275, 0.003987, " (", false], [46, 0.003422, "-", false], [460, 0.000729, "'s", false], [4596, 0.000654, " in", false], [45796, 0.000635, " driven", false], [22590, 0.000513, " the", false]]], "qwen": [11, 1, 0.8713169097900391, [[11, 0.871317, ",", false], [323, 0.097784, " and", false], [320, 0.006191, " (", false], [476, 0.002729, " or", false], [31405, 0.002712, "-driven", false], [315, 0.001506, " of", false], [594, 0.001459, "'s", false], [304, 0.001161, " in", false], [10856, 0.00105, " combined", false], [12681, 0.001013, "-like", false]]]}, "raw_delta": -0.006890133023262024, "tuned_delta": 0.0016816590073162243}, {"byte_start": 4368, "byte_end": 4376, "display": {"text": " massive", "kind": "normal"}, "is_word": true, "word_id": 730, "word_key": " massive", "bytes_hex": "20 6d 61 73 73 69 76 65", "compression": {"rwkv": "7.40% 7.40% 7.40% 7.40% 7.40% 7.40% 7.40% 7.40%", "qwen": "6.46% 6.46% 6.46% 6.46% 6.46% 6.46% 6.46% 6.46%"}, "model_tokens": {"rwkv": [[52195, " massive", "normal", 0.03779609128832817]], "qwen": [[10951, " massive", "normal", 0.057061079889535904]]}, "loss": {"rwkv": 7.396629848307673, "qwen": 6.455233363797967}, "topk": {"rwkv": [52195, 6, 0.03779609128832817, [[22590, 0.273887, " the", false], [63370, 0.084655, " computation", false], [32232, 0.075957, " they", false], [4601, 0.043927, " it", false], [31458, 0.041796, " more", false], [52195, 0.037796, " massive", false], [30597, 0.027417, " deep", false], [332, 0.026901, " a", false], [45301, 0.026221, " better", false], [32227, 0.021507, " that", false]]], "qwen": [10951, 5, 0.057061079889535904, [[279, 0.17426, " the", false], [807, 0.081228, " they", false], [803, 0.074922, " more", false], [34447, 0.072744, " computation", false], [10951, 0.057061, " massive", false], [1753, 0.047729, " much", false], [432, 0.04672, " it", false], [264, 0.032111, " a", false], [862, 0.018677, " their", false], [1052, 0.016162, " there", false]]]}, "raw_delta": 0.05220210552215576, "tuned_delta": 0.06077389755273401}, {"byte_start": 4376, "byte_end": 4388, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 731, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "2.32% 2.32% 2.32% 2.32% 2.32% 2.32% 2.32% 2.32% 2.32% 2.32% 2.32% 2.32%", "qwen": "1.84% 1.84% 1.84% 1.84% 1.84% 1.84% 1.84% 1.84% 1.84% 1.84% 1.84% 1.84%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.21400213241577148]], "qwen": [[34447, " computation", "normal", 0.2932566702365875]]}, "loss": {"rwkv": 2.3246550951824116, "qwen": 1.8435042490241822}, "topk": {"rwkv": [63370, 2, 0.21400213241577148, [[50897, 0.395801, " amounts", false], [63370, 0.214002, " computation", false], [64423, 0.042162, " improvements", false], [22168, 0.035789, " new", false], [45, 0.028302, ",", false], [64862, 0.026595, " computational", false], [59847, 0.017846, " increases", false], [31458, 0.017664, " more", false], [51832, 0.014237, " general", false], [63621, 0.013986, " improvement", false]]], "qwen": [34447, 2, 0.2932566702365875, [[14713, 0.427977, " amounts", false], [34447, 0.293257, " computation", false], [54480, 0.049017, " computational", false], [24231, 0.022304, " computing", false], [11, 0.02115, ",", false], [5107, 0.014191, " additional", false], [32676, 0.012414, " quantities", false], [12703, 0.01168, " increases", false], [803, 0.011543, " more", false], [501, 0.009909, " new", false]]]}, "raw_delta": 0.02668066819508869, "tuned_delta": 0.035252460225666936}, {"byte_start": 4388, "byte_end": 4395, "display": {"text": " became", "kind": "normal"}, "is_word": true, "word_id": 732, "word_key": " became", "bytes_hex": "20 62 65 63 61 6d 65", "compression": {"rwkv": "2.62% 2.62% 2.62% 2.62% 2.62% 2.62% 2.62%", "qwen": "2.41% 2.41% 2.41% 2.41% 2.41% 2.41% 2.41%"}, "model_tokens": {"rwkv": [[45283, " became", "normal", 0.3594065308570862]], "qwen": [[6116, " became", "normal", 0.39302074909210205]]}, "loss": {"rwkv": 2.616494912326524, "qwen": 2.405933328200484}, "topk": {"rwkv": [45283, 1, 0.3594065308570862, [[45283, 0.359407, " became", false], [22748, 0.1922, " was", false], [30383, 0.059947, " came", false], [21265, 0.051972, " and", false], [38128, 0.042128, " could", false], [51744, 0.039702, " finally", false], [31351, 0.015692, " made", false], [61959, 0.013754, " eventually", false], [45, 0.011628, ",", false], [57094, 0.009835, " replaced", false]]], "qwen": [6116, 1, 0.39302074909210205, [[6116, 0.393021, " became", false], [572, 0.194667, " was", false], [1410, 0.040672, " could", false], [3697, 0.03836, " came", false], [9583, 0.036963, " eventually", false], [323, 0.022499, " and", false], [9044, 0.021965, " becomes", false], [374, 0.019237, " is", false], [1035, 0.015391, " would", false], [5499, 0.014598, " finally", false]]]}, "raw_delta": 0.011676013469696045, "tuned_delta": 0.020247805500274295}, {"byte_start": 4395, "byte_end": 4405, "display": {"text": " available", "kind": "normal"}, "is_word": true, "word_id": 733, "word_key": " available", "bytes_hex": "20 61 76 61 69 6c 61 62 6c 65", "compression": {"rwkv": "0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85% 0.85%", "qwen": "0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83%"}, "model_tokens": {"rwkv": [[59206, " available", "normal", 0.6220821738243103]], "qwen": [[2500, " available", "normal", 0.6327334046363831]]}, "loss": {"rwkv": 0.8523735349002174, "qwen": 0.8254128896160231}, "topk": {"rwkv": [59206, 1, 0.6220821738243103, [[59206, 0.622082, " available", false], [22590, 0.114845, " the", false], [31458, 0.033297, " more", false], [332, 0.028031, " a", false], [56895, 0.012456, " possible", false], [52648, 0.011136, " readily", false], [64430, 0.011072, " increasingly", false], [4788, 0.010731, " so", false], [31466, 0.010326, " much", false], [51178, 0.008644, " cheaper", false]]], "qwen": [2500, 1, 0.6327334046363831, [[2500, 0.632733, " available", false], [30268, 0.039508, " readily", false], [279, 0.037552, " the", false], [803, 0.032959, " more", false], [3204, 0.02564, " possible", false], [1753, 0.019598, " much", false], [773, 0.017614, " so", false], [13570, 0.013775, " widely", false], [14756, 0.01292, " increasingly", false], [264, 0.01292, " a", false]]]}, "raw_delta": 0.0014950156211853, "tuned_delta": 0.010066807651763548}, {"byte_start": 4405, "byte_end": 4409, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 734, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "12.54% 12.54% 12.54% 12.54%", "qwen": "11.87% 11.87% 11.87% 11.87%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.06176622211933136]], "qwen": [[323, " and", "normal", 0.07190161198377609]]}, "loss": {"rwkv": 12.539048695226342, "qwen": 11.868226065969685}, "topk": {"rwkv": [21265, 4, 0.06176622211933136, [[47, 0.325989, ".", false], [4811, 0.230561, " to", false], [4424, 0.07997, " at", false], [21265, 0.061766, " and", false], [45, 0.052388, ",", false], [52028, 0.050491, " instead", false], [21700, 0.037084, " for", false], [4596, 0.036406, " in", false], [32227, 0.033453, " that", false], [4423, 0.009834, " as", false]]], "qwen": [323, 5, 0.07190161198377609, [[382, 0.23149, ".\n\n", false], [13, 0.215409, ".", false], [311, 0.10388, " to", false], [429, 0.0986, " that", false], [323, 0.071902, " and", false], [11, 0.058201, ",", false], [304, 0.038352, " in", false], [518, 0.032441, " at", false], [369, 0.027997, " for", false], [4518, 0.015276, " instead", false]]]}, "raw_delta": 0.03719830513000488, "tuned_delta": 0.04577009716058313}, {"byte_start": 4409, "byte_end": 4411, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 735, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "43.96% 43.96%", "qwen": "37.09% 37.09%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.007724887225776911]], "qwen": [[264, " a", "normal", 0.01634964533150196]]}, "loss": {"rwkv": 43.9571145270856, "qwen": 37.0912317384731}, "topk": {"rwkv": [332, 22, 0.007724887225776911, [[22590, 0.157717, " the", false], [22748, 0.066187, " was", false], [38128, 0.065747, " could", false], [4601, 0.041408, " it", false], [31351, 0.039964, " made", false], [51596, 0.028288, " enabled", false], [50887, 0.026077, " allowed", false], [45, 0.015678, ",", false], [46936, 0.01519, " proved", false], [63843, 0.014301, " researchers", false]]], "qwen": [264, 10, 0.01634964533150196, [[279, 0.120917, " the", false], [1410, 0.117716, " could", false], [572, 0.067555, " was", false], [432, 0.034898, " it", false], [4362, 0.022412, " needed", false], [2711, 0.020414, " search", false], [429, 0.019385, " that", false], [803, 0.017654, " more", false], [5538, 0.017278, " deep", false], [264, 0.01635, " a", false]]]}, "raw_delta": 0.3807253837585449, "tuned_delta": 0.38929717578912315}, {"byte_start": 4411, "byte_end": 4417, "display": {"text": " means", "kind": "normal"}, "is_word": true, "word_id": 736, "word_key": " means", "bytes_hex": "20 6d 65 61 6e 73", "compression": {"rwkv": "28.55% 28.55% 28.55% 28.55% 28.55% 28.55%", "qwen": "27.04% 27.04% 27.04% 27.04% 27.04% 27.04%"}, "model_tokens": {"rwkv": [[38989, " means", "normal", 7.455547893187031e-05]], "qwen": [[3363, " means", "normal", 0.0001237821561517194]]}, "loss": {"rwkv": 28.553339350927395, "qwen": 27.041477130100134}, "topk": {"rwkv": [38989, 463, 7.455547893187031e-05, [[59513, 0.145706, " different", false], [45301, 0.142446, " better", false], [22168, 0.091024, " new", false], [31466, 0.065912, " much", false], [31458, 0.064476, " more", false], [63885, 0.048841, " statistical", false], [52907, 0.025329, " simpler", false], [47202, 0.017838, " search", false], [60315, 0.016518, " radically", false], [51832, 0.016076, " general", false]]], "qwen": [3363, 346, 0.0001237821561517194, [[2711, 0.096738, " search", false], [2155, 0.089491, " different", false], [501, 0.086501, " new", false], [1753, 0.050604, " much", false], [2664, 0.050082, " better", false], [803, 0.047499, " more", false], [4285, 0.04206, " simple", false], [4586, 0.039017, " general", false], [28464, 0.035356, " statistical", false], [1714, 0.027322, " method", false]]]}, "raw_delta": 0.08383544286092115, "tuned_delta": 0.09240723489149939}, {"byte_start": 4417, "byte_end": 4421, "display": {"text": " was", "kind": "normal"}, "is_word": true, "word_id": 737, "word_key": " was", "bytes_hex": "20 77 61 73", "compression": {"rwkv": "10.57% 10.57% 10.57% 10.57%", "qwen": "10.58% 10.58% 10.58% 10.58%"}, "model_tokens": {"rwkv": [[22748, " was", "normal", 0.0957559198141098]], "qwen": [[572, " was", "normal", 0.09576229751110077]]}, "loss": {"rwkv": 10.566614069010962, "qwen": 10.576245097459278}, "topk": {"rwkv": [22748, 3, 0.0957559198141098, [[4706, 0.502468, " of", false], [4811, 0.246519, " to", false], [22748, 0.095756, " was", false], [21700, 0.074487, " for", false], [4450, 0.01781, " by", false], [38128, 0.014682, " could", false], [32227, 0.005941, " that", false], [51680, 0.005413, " existed", false], [21795, 0.003417, " had", false], [38547, 0.003039, " found", false]]], "qwen": [572, 4, 0.09576229751110077, [[315, 0.379491, " of", false], [311, 0.286611, " to", false], [369, 0.135096, " for", false], [572, 0.095762, " was", false], [1410, 0.023275, " could", false], [429, 0.01598, " that", false], [1030, 0.009299, " had", false], [553, 0.00645, " by", false], [803, 0.003219, " more", false], [2664, 0.002605, " better", false]]]}, "raw_delta": -0.0005340576171875, "tuned_delta": 0.008037734413390748}, {"byte_start": 4421, "byte_end": 4427, "display": {"text": " found", "kind": "normal"}, "is_word": true, "word_id": 738, "word_key": " found", "bytes_hex": "20 66 6f 75 6e 64", "compression": {"rwkv": "0.53% 0.53% 0.53% 0.53% 0.53% 0.53%", "qwen": "1.24% 1.24% 1.24% 1.24% 1.24% 1.24%"}, "model_tokens": {"rwkv": [[38547, " found", "normal", 0.8374359011650085]], "qwen": [[1730, " found", "normal", 0.6622791886329651]]}, "loss": {"rwkv": 0.5253955328758227, "qwen": 1.2385177429836738}, "topk": {"rwkv": [38547, 1, 0.8374359011650085, [[38547, 0.837436, " found", false], [61885, 0.047187, " discovered", false], [51744, 0.019061, " finally", false], [56976, 0.016228, " provided", false], [59506, 0.01444, " developed", false], [51458, 0.007916, " devised", false], [47340, 0.005037, " sought", false], [56492, 0.004759, " invented", false], [46650, 0.004718, " needed", false], [59206, 0.004589, " available", false]]], "qwen": [1730, 1, 0.6622791886329651, [[1730, 0.662279, " found", false], [11105, 0.070285, " discovered", false], [3897, 0.054142, " provided", false], [4362, 0.043026, " needed", false], [5499, 0.015155, " finally", false], [3465, 0.011804, " created", false], [2500, 0.00995, " available", false], [518, 0.009313, " at", false], [9555, 0.008666, " established", false], [7881, 0.008553, " developed", false]]]}, "raw_delta": -0.03954389194647472, "tuned_delta": -0.030972099915896473}, {"byte_start": 4427, "byte_end": 4430, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 739, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "1.31% 1.31% 1.31%", "qwen": "0.98% 0.98% 0.98%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.8043674230575562]], "qwen": [[311, " to", "normal", 0.8500741124153137]]}, "loss": {"rwkv": 1.3149564174769197, "qwen": 0.976414391582807}, "topk": {"rwkv": [4811, 1, 0.8043674230575562, [[4811, 0.804367, " to", false], [4706, 0.097612, " of", false], [21700, 0.04111, " for", false], [275, 0.012771, " (", false], [32227, 0.011524, " that", false], [45, 0.011088, ",", false], [4450, 0.006413, " by", false], [5346, 0.002836, "---", false], [22187, 0.001534, " not", false], [4596, 0.001271, " in", false]]], "qwen": [311, 1, 0.8500741124153137, [[311, 0.850074, " to", false], [369, 0.070927, " for", false], [315, 0.019311, " of", false], [429, 0.013787, " that", false], [11, 0.006648, ",", false], [553, 0.005246, " by", false], [304, 0.004791, " in", false], [320, 0.002589, " (", false], [537, 0.002422, " not", false], [1526, 0.002282, " through", false]]]}, "raw_delta": 0.0187727560599645, "tuned_delta": 0.02734454809054275}, {"byte_start": 4430, "byte_end": 4434, "display": {"text": " put", "kind": "normal"}, "is_word": true, "word_id": 740, "word_key": " put", "bytes_hex": "20 70 75 74", "compression": {"rwkv": "13.24% 13.24% 13.24% 13.24%", "qwen": "10.10% 10.10% 10.10% 10.10%"}, "model_tokens": {"rwkv": [[22339, " put", "normal", 0.05298086255788803]], "qwen": [[2182, " put", "normal", 0.10636377334594727]]}, "loss": {"rwkv": 13.243489633160404, "qwen": 10.102878974332917}, "topk": {"rwkv": [22339, 6, 0.05298086255788803, [[22681, 0.133746, " use", false], [31358, 0.094149, " make", false], [56540, 0.090845, " leverage", false], [32187, 0.08296, " take", false], [53251, 0.056313, " utilize", false], [22339, 0.052981, " put", false], [37730, 0.036128, " apply", false], [37911, 0.036024, " bring", false], [51690, 0.031508, " exploit", false], [21751, 0.020391, " get", false]]], "qwen": [2182, 1, 0.10636377334594727, [[2182, 0.106364, " put", false], [32064, 0.095979, " leverage", false], [1896, 0.090858, " take", false], [1281, 0.090596, " make", false], [990, 0.085173, " use", false], [32408, 0.044063, " harness", false], [32194, 0.036651, " exploit", false], [4446, 0.033395, " bring", false], [3796, 0.030367, " apply", false], [28066, 0.025767, " utilize", false]]]}, "raw_delta": 0.1741524338722229, "tuned_delta": 0.18272422590280116}, {"byte_start": 4434, "byte_end": 4437, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 741, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "5.80% 5.80% 5.80%", "qwen": "3.44% 3.44% 3.44%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.38305723667144775]], "qwen": [[432, " it", "normal", 0.5642081499099731]]}, "loss": {"rwkv": 5.799897055657127, "qwen": 3.44041941494408}, "topk": {"rwkv": [4601, 2, 0.38305723667144775, [[32227, 0.414391, " that", false], [4601, 0.383057, " it", false], [22590, 0.058964, " the", false], [52195, 0.020023, " massive", false], [21256, 0.015544, " all", false], [32234, 0.012122, " this", false], [63370, 0.008196, " computation", false], [332, 0.008017, " a", false], [31466, 0.00777, " much", false], [31458, 0.00695, " more", false]]], "qwen": [432, 1, 0.5642081499099731, [[432, 0.564208, " it", false], [429, 0.290662, " that", false], [419, 0.021829, " this", false], [279, 0.014798, " the", false], [678, 0.013609, " all", false], [803, 0.010546, " more", false], [10951, 0.010346, " massive", false], [34447, 0.009711, " computation", false], [1496, 0.005578, " even", false], [264, 0.005563, " a", false]]]}, "raw_delta": 0.13083722194035846, "tuned_delta": 0.13940901397093672}, {"byte_start": 4437, "byte_end": 4440, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 742, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "1.48% 1.48% 1.48%", "qwen": "0.97% 0.97% 0.97%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.7803198099136353]], "qwen": [[311, " to", "normal", 0.8510703444480896]]}, "loss": {"rwkv": 1.4793259696615346, "qwen": 0.9693738518131108}, "topk": {"rwkv": [4811, 1, 0.7803198099136353, [[4811, 0.78032, " to", false], [4596, 0.086069, " in", false], [31162, 0.041428, " into", false], [21256, 0.030616, " all", false], [39934, 0.015893, " there", false], [4424, 0.013482, " at", false], [40185, 0.004383, " where", false], [63507, 0.003866, " effectively", false], [46301, 0.003237, " inside", false], [56003, 0.001885, " directly", false]]], "qwen": [311, 1, 0.8510703444480896, [[311, 0.85107, " to", false], [304, 0.050348, " in", false], [1119, 0.038508, " into", false], [13444, 0.021227, " effectively", false], [5961, 0.009136, " directly", false], [990, 0.002848, " use", false], [518, 0.002263, " at", false], [29720, 0.002102, " efficiently", false], [678, 0.001641, " all", false], [7225, 0.001396, " fully", false]]]}, "raw_delta": 0.02827774981657664, "tuned_delta": 0.03684954184715489}, {"byte_start": 4440, "byte_end": 4445, "display": {"text": " good", "kind": "normal"}, "is_word": true, "word_id": 743, "word_key": " good", "bytes_hex": "20 67 6f 6f 64", "compression": {"rwkv": "8.40% 8.40% 8.40% 8.40% 8.40%", "qwen": "8.16% 8.16% 8.16% 8.16% 8.16%"}, "model_tokens": {"rwkv": [[30992, " good", "normal", 0.09741509705781937]], "qwen": [[1661, " good", "normal", 0.10399079322814941]]}, "loss": {"rwkv": 8.396935980174044, "qwen": 8.163681070288343}, "topk": {"rwkv": [30992, 3, 0.09741509705781937, [[22681, 0.350954, " use", false], [32499, 0.243058, " work", false], [30992, 0.097415, " good", false], [59593, 0.083261, " effective", false], [45301, 0.056173, " better", false], [22590, 0.019862, " the", false], [31466, 0.017513, " much", false], [62383, 0.016633, " productive", false], [30273, 0.010195, " best", false], [31458, 0.007053, " more", false]]], "qwen": [1661, 3, 0.10399079322814941, [[990, 0.247732, " use", false], [975, 0.241505, " work", false], [1661, 0.103991, " good", false], [2664, 0.088417, " better", false], [7373, 0.053809, " effective", false], [279, 0.039391, " the", false], [1850, 0.03241, " best", false], [1753, 0.018473, " much", false], [803, 0.014827, " more", false], [26236, 0.01261, " productive", false]]]}, "raw_delta": 0.012934398651123058, "tuned_delta": 0.021506190681701308}, {"byte_start": 4445, "byte_end": 4449, "display": {"text": " use", "kind": "normal"}, "is_word": true, "word_id": 744, "word_key": " use", "bytes_hex": "20 75 73 65", "compression": {"rwkv": "0.16% 0.16% 0.16% 0.16%", "qwen": "0.16% 0.16% 0.16% 0.16%"}, "model_tokens": {"rwkv": [[22681, " use", "normal", 0.964491605758667]], "qwen": [[990, " use", "normal", 0.9658353328704834]]}, "loss": {"rwkv": 0.1629019668972523, "qwen": 0.15672154192403911}, "topk": {"rwkv": [22681, 1, 0.964491605758667, [[22681, 0.964492, " use", false], [45828, 0.00888, " effect", false], [45, 0.004338, ",", false], [59093, 0.004256, " advantage", false], [51832, 0.001895, " general", false], [32499, 0.001795, " work", false], [21265, 0.001371, " and", false], [60212, 0.000986, " practical", false], [32356, 0.000764, " uses", false], [275, 0.000744, " (", false]]], "qwen": [990, 1, 0.9658353328704834, [[990, 0.965835, " use", false], [2456, 0.0087, " effect", false], [975, 0.007098, " work", false], [2692, 0.002582, " account", false], [9423, 0.001591, " advantage", false], [323, 0.001557, " and", false], [11, 0.001498, ",", false], [5711, 0.00129, " uses", false], [7428, 0.001177, " purpose", false], [320, 0.001028, " (", false]]]}, "raw_delta": 0.0003427155315876007, "tuned_delta": 0.008914507562165849}, {"byte_start": 4449, "byte_end": 4451, "display": {"text": ".\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e 0a", "compression": {"rwkv": "3.31% 2.05%", "qwen": "4.00% 4.00%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.8317354321479797], [261, "\n\n", "control", 0.7984659075737]], "qwen": [[382, ".\n\n", "control", 0.5144608616828918]]}, "loss": {"rwkv": 2.6812783200115313, "qwen": 3.9952780839930266}, "topk": {"rwkv": [47, 1, 0.8317354321479797, [[47, 0.831735, ".", false], [4596, 0.047742, " in", false], [45, 0.025462, ",", false], [5346, 0.019369, "---", false], [53356, 0.011946, " without", false], [52028, 0.011257, " instead", false], [275, 0.005403, " (", false], [4450, 0.005214, " by", false], [21700, 0.003337, " for", false], [4712, 0.002923, " on", false]]], "qwen": [382, 1, 0.5144608616828918, [[382, 0.514461, ".\n\n", false], [13, 0.244287, ".", false], [304, 0.056674, " in", false], [11, 0.029495, ",", false], [624, 0.01973, ".\n", false], [553, 0.017578, " by", false], [2041, 0.017143, " without", false], [4192, 0.014547, ".\n\n\n", false], [4421, 0.014191, "---", false], [1526, 0.009009, " through", false]]]}, "raw_delta": -0.07286361853281656, "tuned_delta": -0.06429182650223832}, {"byte_start": 4451, "byte_end": 4452, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "2.05%", "qwen": "4.00%"}, "model_tokens": {"rwkv": [[261, "\n\n", "control", 0.7984659075737]], "qwen": [[382, ".\n\n", "control", 0.5144608616828918]]}, "loss": {"rwkv": 2.0516842317329615, "qwen": 3.9952780839930266}, "topk": {"rwkv": [261, 1, 0.7984659075737, [[261, 0.798466, "\n\n", false], [20996, 0.02136, " The", false], [267, 0.017026, "  ", false], [3913, 0.01181, " In", false], [3336, 0.009919, " \n\n", false], [3918, 0.009581, " It", false], [3328, 0.009526, "\n\n\n", false], [0, 0.007907, "[0]", false], [29894, 0.006895, " This", false], [11, 0.005135, "\n", false]]], "qwen": [382, 1, 0.5144608616828918, [[382, 0.514461, ".\n\n", false], [13, 0.244287, ".", false], [304, 0.056674, " in", false], [11, 0.029495, ",", false], [624, 0.01973, ".\n", false], [553, 0.017578, " by", false], [2041, 0.017143, " without", false], [4192, 0.014547, ".\n\n\n", false], [4421, 0.014191, "---", false], [1526, 0.009009, " through", false]]]}, "raw_delta": -0.10777572790781656, "tuned_delta": -0.09920393587723832}, {"byte_start": 4452, "byte_end": 4454, "display": {"text": "In", "kind": "normal"}, "is_word": true, "word_id": 745, "word_key": "in", "bytes_hex": "49 6e", "compression": {"rwkv": "11.48% 11.48%", "qwen": "11.56% 11.56%"}, "model_tokens": {"rwkv": [[1136, "In", "normal", 0.28333574533462524]], "qwen": [[641, "In", "normal", 0.2775447964668274]]}, "loss": {"rwkv": 11.482387288325246, "qwen": 11.557545856535429}, "topk": {"rwkv": [1136, 1, 0.28333574533462524, [[1136, 0.283336, "In", false], [6699, 0.119155, "The", false], [66, 0.060258, "A", false], [33504, 0.055928, "There", false], [48358, 0.034444, "Another", false], [33505, 0.029975, "These", false], [1141, 0.026713, "It", false], [24242, 0.01586, "This", false], [58094, 0.013487, "Similarly", false], [6393, 0.013408, "One", false]]], "qwen": [641, 1, 0.2775447964668274, [[641, 0.277545, "In", false], [785, 0.116033, "The", false], [32, 0.040546, "A", false], [3862, 0.038229, "There", false], [9485, 0.028259, "These", false], [14037, 0.017428, "Another", false], [67691, 0.016609, "Similarly", false], [1986, 0.015898, "This", false], [2132, 0.014444, "It", false], [33464, 0.012972, "Deep", false]]]}, "raw_delta": -0.004167675971984863, "tuned_delta": 0.004404116058593385}, {"byte_start": 4454, "byte_end": 4463, "display": {"text": " computer", "kind": "normal"}, "is_word": true, "word_id": 746, "word_key": " computer", "bytes_hex": "20 63 6f 6d 70 75 74 65 72", "compression": {"rwkv": "3.05% 3.05% 3.05% 3.05% 3.05% 3.05% 3.05% 3.05% 3.05%", "qwen": "3.91% 3.91% 3.91% 3.91% 3.91% 3.91% 3.91% 3.91% 3.91%"}, "model_tokens": {"rwkv": [[55809, " computer", "normal", 0.21826326847076416]], "qwen": [[6366, " computer", "normal", 0.1419302076101303]]}, "loss": {"rwkv": 3.0525773977142774, "qwen": 3.9121478810505597}, "topk": {"rwkv": [55809, 1, 0.21826326847076416, [[55809, 0.218263, " computer", false], [52766, 0.136421, " robotic", false], [22590, 0.083853, " the", false], [52299, 0.037856, " natural", false], [21256, 0.027232, " all", false], [52167, 0.026895, " machine", false], [65003, 0.019705, " reinforcement", false], [52209, 0.019266, " medical", false], [38744, 0.01909, " image", false], [51832, 0.017083, " general", false]]], "qwen": [6366, 1, 0.1419302076101303, [[6366, 0.14193, " computer", false], [279, 0.130395, " the", false], [73606, 0.125936, " robotics", false], [5662, 0.046521, " machine", false], [678, 0.036918, " all", false], [71278, 0.034866, " reinforcement", false], [11129, 0.030967, " vision", false], [12305, 0.027495, " robot", false], [5810, 0.025839, " natural", false], [2168, 0.024849, " image", false]]]}, "raw_delta": -0.04766470856136745, "tuned_delta": -0.0390929165307892}, {"byte_start": 4463, "byte_end": 4470, "display": {"text": " vision", "kind": "normal"}, "is_word": true, "word_id": 747, "word_key": " vision", "bytes_hex": "20 76 69 73 69 6f 6e", "compression": {"rwkv": "0.19% 0.19% 0.19% 0.19% 0.19% 0.19% 0.19%", "qwen": "0.56% 0.56% 0.56% 0.56% 0.56% 0.56% 0.56%"}, "model_tokens": {"rwkv": [[47732, " vision", "normal", 0.9274498820304871]], "qwen": [[11129, " vision", "normal", 0.8056734204292297]]}, "loss": {"rwkv": 0.19497918817817844, "qwen": 0.5566659584607483}, "topk": {"rwkv": [47732, 1, 0.9274498820304871, [[47732, 0.92745, " vision", false], [63944, 0.012066, " translation", false], [52814, 0.008668, " science", false], [46, 0.006332, "-", false], [52766, 0.004298, " robotic", false], [56329, 0.004237, " graphics", false], [56529, 0.003973, " language", false], [31044, 0.002612, " hand", false], [38744, 0.001578, " image", false], [45032, 0.001509, " Vision", false]]], "qwen": [11129, 1, 0.8056734204292297, [[11129, 0.805673, " vision", false], [5994, 0.035949, " Go", false], [3868, 0.02343, " games", false], [1809, 0.018173, " game", false], [8038, 0.007636, " science", false], [73606, 0.006905, " robotics", false], [8273, 0.006662, "-v", false], [14181, 0.006551, " graphics", false], [20814, 0.005766, " poker", false], [2766, 0.005482, " video", false]]]}, "raw_delta": -0.02005617320537567, "tuned_delta": -0.011484381174797423}, {"byte_start": 4470, "byte_end": 4471, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "1.47%", "qwen": "1.78%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.9220231175422668]], "qwen": [[11, ",", "normal", 0.9061692357063293]]}, "loss": {"rwkv": 1.4705204579373587, "qwen": 1.7768446692927307}, "topk": {"rwkv": [45, 1, 0.9220231175422668, [[45, 0.922023, ",", false], [21265, 0.036312, " and", false], [275, 0.008781, " (", false], [39934, 0.005697, " there", false], [5346, 0.003784, "---", false], [57103, 0.003593, " research", false], [22590, 0.00272, " the", false], [22614, 0.001771, " too", false], [53087, 0.001476, " systems", false], [4423, 0.001091, " as", false]]], "qwen": [11, 1, 0.9061692357063293, [[11, 0.906169, ",", false], [323, 0.034152, " and", false], [1052, 0.011199, " there", false], [320, 0.011075, " (", false], [3412, 0.004476, " research", false], [279, 0.00315, " the", false], [4421, 0.002759, "---", false], [438, 0.002543, " as", false], [304, 0.002428, " in", false], [11811, 0.002211, " researchers", false]]]}, "raw_delta": -0.016986221075057983, "tuned_delta": -0.008414429044479735}, {"byte_start": 4471, "byte_end": 4477, "display": {"text": " there", "kind": "normal"}, "is_word": true, "word_id": 748, "word_key": " there", "bytes_hex": "20 74 68 65 72 65", "compression": {"rwkv": "6.62% 6.62% 6.62% 6.62% 6.62% 6.62%", "qwen": "5.20% 5.20% 5.20% 5.20% 5.20% 5.20%"}, "model_tokens": {"rwkv": [[39934, " there", "normal", 0.11340678483247757]], "qwen": [[1052, " there", "normal", 0.1774648129940033]]}, "loss": {"rwkv": 6.621744816580202, "qwen": 5.19665644224577}, "topk": {"rwkv": [39934, 2, 0.11340678483247757, [[22590, 0.336809, " the", false], [39934, 0.113407, " there", false], [332, 0.059531, " a", false], [63843, 0.043764, " researchers", false], [4601, 0.026649, " it", false], [50919, 0.020071, " another", false], [37635, 0.017193, " again", false], [52224, 0.016136, " methods", false], [4596, 0.014111, " in", false], [22226, 0.01232, " one", false]]], "qwen": [1052, 2, 0.1774648129940033, [[279, 0.208848, " the", false], [1052, 0.177465, " there", false], [11811, 0.082833, " researchers", false], [264, 0.054324, " a", false], [4124, 0.053299, " early", false], [304, 0.021776, " in", false], [5413, 0.016807, " methods", false], [3738, 0.015499, " human", false], [432, 0.01524, " it", false], [458, 0.013534, " an", false]]]}, "raw_delta": 0.07902367909749347, "tuned_delta": 0.08759547112807171}, {"byte_start": 4477, "byte_end": 4481, "display": {"text": " has", "kind": "normal"}, "is_word": true, "word_id": 749, "word_key": " has", "bytes_hex": "20 68 61 73", "compression": {"rwkv": "9.44% 9.44% 9.44% 9.44%", "qwen": "10.06% 10.06% 10.06% 10.06%"}, "model_tokens": {"rwkv": [[21800, " has", "normal", 0.12311496585607529]], "qwen": [[702, " has", "normal", 0.10737162828445435]]}, "loss": {"rwkv": 9.439508568316459, "qwen": 10.06035948858179}, "topk": {"rwkv": [21800, 3, 0.12311496585607529, [[22748, 0.419516, " was", false], [32462, 0.222666, " were", false], [21800, 0.123115, " has", false], [31059, 0.101793, " have", false], [4600, 0.069628, " is", false], [21286, 0.03921, " are", false], [21795, 0.003589, " had", false], [22614, 0.002321, " too", false], [30135, 0.002106, " also", false], [37635, 0.002008, " again", false]]], "qwen": [702, 3, 0.10737162828445435, [[572, 0.514358, " was", false], [1033, 0.172868, " were", false], [702, 0.107372, " has", false], [374, 0.077177, " is", false], [614, 0.052585, " have", false], [525, 0.039749, " are", false], [1030, 0.007536, " had", false], [1083, 0.006672, " also", false], [1549, 0.003572, " again", false], [2238, 0.002997, " too", false]]]}, "raw_delta": -0.03442728519439697, "tuned_delta": -0.025855493163818723}, {"byte_start": 4481, "byte_end": 4486, "display": {"text": " been", "kind": "normal"}, "is_word": true, "word_id": 750, "word_key": " been", "bytes_hex": "20 62 65 65 6e", "compression": {"rwkv": "1.05% 1.05% 1.05% 1.05% 1.05%", "qwen": "0.81% 0.81% 0.81% 0.81% 0.81%"}, "model_tokens": {"rwkv": [[30259, " been", "normal", 0.747715413570404]], "qwen": [[1012, " been", "normal", 0.7988281846046448]]}, "loss": {"rwkv": 1.0496169975217555, "qwen": 0.8101072398579089}, "topk": {"rwkv": [30259, 1, 0.747715413570404, [[30259, 0.747715, " been", false], [30135, 0.153006, " also", false], [45150, 0.021881, " always", false], [31323, 0.012638, " long", false], [22187, 0.01022, " not", false], [56548, 0.007506, " likewise", false], [57036, 0.00583, " recently", false], [37635, 0.005008, " again", false], [60505, 0.004354, " similarly", false], [45, 0.004121, ",", false]]], "qwen": [1012, 1, 0.7988281846046448, [[1012, 0.798828, " been", false], [1083, 0.083231, " also", false], [2677, 0.046376, " always", false], [1293, 0.017368, " long", false], [2581, 0.007312, " never", false], [537, 0.00695, " not", false], [34801, 0.003097, " historically", false], [1549, 0.00252, " again", false], [35242, 0.002296, " traditionally", false], [5926, 0.001962, " recently", false]]]}, "raw_delta": 0.013281241059303284, "tuned_delta": 0.021853033089881534}, {"byte_start": 4486, "byte_end": 4488, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 751, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "3.86% 3.86%", "qwen": "4.90% 4.90%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.6513375639915466]], "qwen": [[264, " a", "normal", 0.5807908177375793]]}, "loss": {"rwkv": 3.856814135189001, "qwen": 4.899434233538717}, "topk": {"rwkv": [332, 1, 0.6513375639915466, [[332, 0.651338, " a", false], [4419, 0.134001, " an", false], [52906, 0.020983, " similar", false], [50919, 0.016473, " another", false], [22590, 0.015272, " the", false], [31466, 0.01459, " much", false], [30788, 0.012737, " even", false], [45, 0.011664, ",", false], [4692, 0.007404, " no", false], [31458, 0.005878, " more", false]]], "qwen": [264, 1, 0.5807908177375793, [[264, 0.580791, " a", false], [458, 0.147467, " an", false], [1753, 0.035839, " much", false], [4428, 0.027938, " similar", false], [1045, 0.012506, " some", false], [29193, 0.009416, " similarly", false], [902, 0.008481, " no", false], [279, 0.007541, " the", false], [23839, 0.00746, " considerable", false], [803, 0.007214, " more", false]]]}, "raw_delta": -0.05781513452529907, "tuned_delta": -0.04924334249472082}, {"byte_start": 4488, "byte_end": 4496, "display": {"text": " similar", "kind": "normal"}, "is_word": true, "word_id": 752, "word_key": " similar", "bytes_hex": "20 73 69 6d 69 6c 61 72", "compression": {"rwkv": "1.76% 1.76% 1.76% 1.76% 1.76% 1.76% 1.76% 1.76%", "qwen": "2.80% 2.80% 2.80% 2.80% 2.80% 2.80% 2.80% 2.80%"}, "model_tokens": {"rwkv": [[52906, " similar", "normal", 0.45986196398735046]], "qwen": [[4428, " similar", "normal", 0.28896403312683105]]}, "loss": {"rwkv": 1.7611023448351601, "qwen": 2.7984971265504583}, "topk": {"rwkv": [52906, 1, 0.45986196398735046, [[52906, 0.459862, " similar", false], [31323, 0.106699, " long", false], [32386, 0.024848, " very", false], [47405, 0.01726, " steady", false], [60505, 0.014995, " similarly", false], [52427, 0.014722, " pattern", false], [38961, 0.013573, " major", false], [61774, 0.011334, " continuing", false], [51859, 0.010981, " gradual", false], [61756, 0.009168, " consistent", false]]], "qwen": [4428, 1, 0.28896403312683105, [[4428, 0.288964, " similar", false], [1293, 0.235387, " long", false], [29193, 0.019415, " similarly", false], [3598, 0.018889, " major", false], [2244, 0.017125, " great", false], [1602, 0.016404, " very", false], [12966, 0.013811, " consistent", false], [2696, 0.012967, " lot", false], [5383, 0.012706, " pattern", false], [24020, 0.011707, " steady", false]]]}, "raw_delta": -0.057525381445884705, "tuned_delta": -0.048953589415306455}, {"byte_start": 4496, "byte_end": 4504, "display": {"text": " pattern", "kind": "normal"}, "is_word": true, "word_id": 753, "word_key": " pattern", "bytes_hex": "20 70 61 74 74 65 72 6e", "compression": {"rwkv": "1.95% 1.95% 1.95% 1.95% 1.95% 1.95% 1.95% 1.95%", "qwen": "2.23% 2.23% 2.23% 2.23% 2.23% 2.23% 2.23% 2.23%"}, "model_tokens": {"rwkv": [[52427, " pattern", "normal", 0.4187702536582947]], "qwen": [[5383, " pattern", "normal", 0.3711734712123871]]}, "loss": {"rwkv": 1.946018091042852, "qwen": 2.234116440973038}, "topk": {"rwkv": [52427, 1, 0.4187702536582947, [[52427, 0.41877, " pattern", false], [39831, 0.118149, " story", false], [51929, 0.059372, " history", false], [45, 0.035831, ",", false], [39664, 0.021719, " shift", false], [59657, 0.020292, " evolution", false], [63797, 0.019084, " progression", false], [62660, 0.017703, " transition", false], [45450, 0.014281, " change", false], [45315, 0.011194, " bitter", false]]], "qwen": [5383, 1, 0.3711734712123871, [[5383, 0.371173, " pattern", false], [9149, 0.085054, " trend", false], [3364, 0.058034, " story", false], [6407, 0.041732, " shift", false], [32724, 0.033134, " progression", false], [2297, 0.022624, " change", false], [1293, 0.02091, " long", false], [9142, 0.01898, " transition", false], [3840, 0.017896, " history", false], [11, 0.013164, ",", false]]]}, "raw_delta": -0.01597556471824646, "tuned_delta": -0.007403772687668212}, {"byte_start": 4504, "byte_end": 4505, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "15.08%", "qwen": "22.93%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.4318086802959442]], "qwen": [[13, ".", "normal", 0.2804797291755676]]}, "loss": {"rwkv": 15.075036071788972, "qwen": 22.925394849169177}, "topk": {"rwkv": [47, 1, 0.4318086802959442, [[47, 0.431809, ".", false], [4706, 0.29945, " of", false], [45, 0.145887, ",", false], [31601, 0.020864, " over", false], [4596, 0.017669, " in", false], [59, 0.016538, ":", false], [5346, 0.008867, "---", false], [39690, 0.006442, " since", false], [21700, 0.005976, " for", false], [32487, 0.00581, " with", false]]], "qwen": [13, 2, 0.2804797291755676, [[315, 0.466759, " of", false], [13, 0.28048, ".", false], [11, 0.082198, ",", false], [311, 0.037578, " to", false], [304, 0.027072, " in", false], [916, 0.01584, " over", false], [25, 0.013909, ":", false], [4421, 0.010026, "---", false], [504, 0.00752, " from", false], [369, 0.007465, " for", false]]]}, "raw_delta": -0.4353163242340088, "tuned_delta": -0.42674453220343056}, {"byte_start": 4505, "byte_end": 4511, "display": {"text": " Early", "kind": "normal"}, "is_word": true, "word_id": 754, "word_key": " early", "bytes_hex": "20 45 61 72 6c 79", "compression": {"rwkv": "5.96% 5.96% 5.96% 5.96% 5.96% 5.96%", "qwen": "5.03% 5.03% 5.03% 5.03% 5.03% 5.03%"}, "model_tokens": {"rwkv": [[36607, " Early", "normal", 0.13682277500629425]], "qwen": [[22752, " Early", "normal", 0.18737633526325226]]}, "loss": {"rwkv": 5.964266607841743, "qwen": 5.033310903428166}, "topk": {"rwkv": [36607, 2, 0.13682277500629425, [[20996, 0.154913, " The", false], [36607, 0.136823, " Early", false], [3913, 0.09772, " In", false], [37451, 0.040401, " There", false], [19907, 0.038629, " For", false], [63222, 0.035554, " Researchers", false], [50438, 0.024645, " Methods", false], [3642, 0.01935, " At", false], [58864, 0.018602, " Initially", false], [36809, 0.018484, " Human", false]]], "qwen": [22752, 1, 0.18737633526325226, [[22752, 0.187376, " Early", false], [758, 0.112628, " In", false], [576, 0.098623, " The", false], [2619, 0.094991, " There", false], [58150, 0.057391, " Researchers", false], [58556, 0.028442, " Initially", false], [1752, 0.025186, " For", false], [362, 0.024925, " A", false], [2411, 0.017526, " At", false], [11097, 0.01484, " Human", false]]]}, "raw_delta": 0.051623145739237486, "tuned_delta": 0.060194937769815736}, {"byte_start": 4511, "byte_end": 4519, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 755, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "3.03% 3.03% 3.03% 3.03% 3.03% 3.03% 3.03% 3.03%", "qwen": "4.38% 4.38% 4.38% 4.38% 4.38% 4.38% 4.38% 4.38%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.260214626789093]], "qwen": [[5413, " methods", "normal", 0.1432800143957138]]}, "loss": {"rwkv": 3.029096033116476, "qwen": 4.379829231113428}, "topk": {"rwkv": [52224, 1, 0.260214626789093, [[52224, 0.260215, " methods", false], [55809, 0.103162, " computer", false], [57103, 0.098552, " research", false], [51566, 0.098348, " efforts", false], [32499, 0.053475, " work", false], [61590, 0.05319, " approaches", false], [63843, 0.046697, " researchers", false], [4712, 0.034582, " on", false], [47732, 0.029301, " vision", false], [55572, 0.025312, " attempts", false]]], "qwen": [5413, 1, 0.1432800143957138, [[5413, 0.14328, " methods", false], [304, 0.120413, " in", false], [975, 0.118516, " work", false], [8869, 0.092872, " efforts", false], [6366, 0.087719, " computer", false], [11811, 0.059996, " researchers", false], [3412, 0.051687, " research", false], [11129, 0.049252, " vision", false], [19827, 0.043755, " approaches", false], [389, 0.037572, " on", false]]]}, "raw_delta": -0.0749005526304245, "tuned_delta": -0.06632876059984626}, {"byte_start": 4519, "byte_end": 4529, "display": {"text": " conceived", "kind": "normal"}, "is_word": true, "word_id": 756, "word_key": " conceived", "bytes_hex": "20 63 6f 6e 63 65 69 76 65 64", "compression": {"rwkv": "19.27% 19.27% 19.27% 19.27% 19.27% 19.27% 19.27% 19.27% 19.27% 19.27%", "qwen": "18.27% 18.27% 18.27% 18.27% 18.27% 18.27% 18.27% 18.27% 18.27% 18.27%"}, "model_tokens": {"rwkv": [[59348, " conceived", "normal", 2.25853655138053e-05]], "qwen": [[49078, " conceived", "normal", 3.9800819649826735e-05]]}, "loss": {"rwkv": 19.27350406187599, "qwen": 18.27105330635336}, "topk": {"rwkv": [59348, 527, 2.25853655138053e-05, [[32462, 0.174569, " were", false], [47054, 0.143228, " relied", false], [45, 0.091219, ",", false], [32354, 0.067284, " used", false], [4596, 0.066749, " in", false], [21700, 0.04945, " for", false], [32227, 0.035534, " that", false], [40013, 0.033949, " tried", false], [4706, 0.023363, " of", false], [56427, 0.022307, " included", false]]], "qwen": [49078, 410, 3.9800819649826735e-05, [[1033, 0.22463, " were", false], [39913, 0.084109, " relied", false], [304, 0.066021, " in", false], [369, 0.064234, " for", false], [3867, 0.063007, " took", false], [11, 0.057171, ",", false], [429, 0.040702, " that", false], [3118, 0.038395, " based", false], [10735, 0.038008, " focused", false], [315, 0.026742, " of", false]]]}, "raw_delta": 0.05558767318725599, "tuned_delta": 0.06415946521783424}, {"byte_start": 4529, "byte_end": 4532, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 757, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "5.38% 5.38% 5.38%", "qwen": "9.18% 9.18% 9.18%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.40571919083595276]], "qwen": [[315, " of", "normal", 0.21719248592853546]]}, "loss": {"rwkv": 5.377232492896689, "qwen": 9.178974916901904}, "topk": {"rwkv": [4706, 1, 0.40571919083595276, [[4706, 0.405719, " of", false], [4450, 0.163427, " by", false], [4596, 0.088176, " in", false], [4811, 0.047341, " to", false], [4423, 0.034336, " as", false], [21265, 0.031606, " and", false], [22590, 0.016049, " the", false], [332, 0.015414, " a", false], [4712, 0.012725, " on", false], [32487, 0.012659, " with", false]]], "qwen": [315, 1, 0.21719248592853546, [[315, 0.217192, " of", false], [304, 0.155638, " in", false], [438, 0.152512, " as", false], [323, 0.076464, " and", false], [553, 0.074736, " by", false], [311, 0.05731, " to", false], [389, 0.032373, " on", false], [448, 0.032037, " with", false], [279, 0.015105, " the", false], [3118, 0.014067, " based", false]]]}, "raw_delta": -0.2108133633931478, "tuned_delta": -0.20224157136256954}, {"byte_start": 4532, "byte_end": 4539, "display": {"text": " vision", "kind": "normal"}, "is_word": true, "word_id": 758, "word_key": " vision", "bytes_hex": "20 76 69 73 69 6f 6e", "compression": {"rwkv": "8.21% 8.21% 8.21% 8.21% 8.21% 8.21% 8.21%", "qwen": "6.55% 6.55% 6.55% 6.55% 6.55% 6.55% 6.55%"}, "model_tokens": {"rwkv": [[47732, " vision", "normal", 0.04103774577379227]], "qwen": [[11129, " vision", "normal", 0.07862947881221771]]}, "loss": {"rwkv": 8.21176864791709, "qwen": 6.551403298153559}, "topk": {"rwkv": [47732, 7, 0.04103774577379227, [[4423, 0.258047, " as", false], [22590, 0.097834, " the", false], [332, 0.06878, " a", false], [4450, 0.062958, " by", false], [55809, 0.047489, " computer", false], [4596, 0.044303, " in", false], [47732, 0.041038, " vision", false], [46249, 0.025295, " images", false], [52342, 0.020283, " objects", false], [38744, 0.018771, " image", false]]], "qwen": [11129, 3, 0.07862947881221771, [[438, 0.122214, " as", false], [279, 0.107035, " the", false], [11129, 0.078629, " vision", false], [264, 0.064636, " a", false], [6366, 0.062212, " computer", false], [1667, 0.031913, " using", false], [4633, 0.028064, " taking", false], [304, 0.024232, " in", false], [3738, 0.023334, " human", false], [9902, 0.018649, " ``", false]]]}, "raw_delta": 0.09207020487104145, "tuned_delta": 0.10064199690161969}, {"byte_start": 4539, "byte_end": 4542, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 759, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"rwkv": "2.61% 2.61% 2.61%", "qwen": "1.65% 1.65% 1.65%"}, "model_tokens": {"rwkv": [[4423, " as", "normal", 0.6463713645935059]], "qwen": [[438, " as", "normal", 0.7599860429763794]]}, "loss": {"rwkv": 2.606431470356037, "qwen": 1.64981326720481}, "topk": {"rwkv": [4423, 1, 0.6463713645935059, [[4423, 0.646371, " as", false], [4596, 0.137363, " in", false], [56939, 0.039319, " problems", false], [53087, 0.037758, " systems", false], [39898, 0.034812, " tasks", false], [30917, 0.008588, " from", false], [4450, 0.007895, " by", false], [21265, 0.006168, " and", false], [62378, 0.005735, " processing", false], [45, 0.005301, ",", false]]], "qwen": [438, 1, 0.7599860429763794, [[438, 0.759986, " as", false], [304, 0.108452, " in", false], [5942, 0.014882, " systems", false], [5322, 0.009305, " problems", false], [11, 0.006321, ",", false], [25185, 0.005025, " algorithms", false], [553, 0.005003, " by", false], [9079, 0.004906, " tasks", false], [3118, 0.003904, " based", false], [323, 0.003779, " and", false]]]}, "raw_delta": 0.05304617683092753, "tuned_delta": 0.06161796886150578}, {"byte_start": 4542, "byte_end": 4552, "display": {"text": " searching", "kind": "normal"}, "is_word": true, "word_id": 760, "word_key": " searching", "bytes_hex": "20 73 65 61 72 63 68 69 6e 67", "compression": {"rwkv": "14.20% 14.20% 14.20% 14.20% 14.20% 14.20% 14.20% 14.20% 14.20% 14.20%", "qwen": "12.93% 12.93% 12.93% 12.93% 12.93% 12.93% 12.93% 12.93% 12.93% 12.93%"}, "model_tokens": {"rwkv": [[60463, " searching", "normal", 0.00038259965367615223]], "qwen": [[15039, " searching", "normal", 0.0007701599388383329]]}, "loss": {"rwkv": 14.201529308750729, "qwen": 12.928192979420364}, "topk": {"rwkv": [60463, 118, 0.00038259965367615223, [[332, 0.498589, " a", false], [37832, 0.07855, " being", false], [4419, 0.070187, " an", false], [22590, 0.04413, " the", false], [60522, 0.024242, " something", false], [63541, 0.017786, " essentially", false], [52906, 0.013338, " similar", false], [59927, 0.012703, " involving", false], [59134, 0.009976, " analogous", false], [46170, 0.007928, " having", false]]], "qwen": [15039, 85, 0.0007701599388383329, [[264, 0.487278, " a", false], [458, 0.071254, " an", false], [279, 0.06089, " the", false], [1660, 0.035027, " being", false], [2494, 0.020415, " something", false], [15860, 0.01772, " involving", false], [9902, 0.01342, " ``", false], [3432, 0.012937, " having", false], [4633, 0.01076, " taking", false], [15791, 0.007221, " essentially", false]]]}, "raw_delta": 0.07060875892639162, "tuned_delta": 0.07918055095696987}, {"byte_start": 4552, "byte_end": 4556, "display": {"text": " for", "kind": "normal"}, "is_word": true, "word_id": 761, "word_key": " for", "bytes_hex": "20 66 6f 72", "compression": {"rwkv": "3.86% 3.86% 3.86% 3.86%", "qwen": "3.44% 3.44% 3.44% 3.44%"}, "model_tokens": {"rwkv": [[21700, " for", "normal", 0.4267788529396057]], "qwen": [[369, " for", "normal", 0.46674421429634094]]}, "loss": {"rwkv": 3.856814135189001, "qwen": 3.4352999751290993}, "topk": {"rwkv": [21700, 1, 0.4267788529396057, [[21700, 0.426779, " for", false], [53140, 0.155739, " through", false], [332, 0.086099, " a", false], [31601, 0.063356, " over", false], [22590, 0.04669, " the", false], [4596, 0.044139, " in", false], [45, 0.022467, ",", false], [4419, 0.014625, " an", false], [21265, 0.009688, " and", false], [5346, 0.009635, "---", false]]], "qwen": [369, 1, 0.46674421429634094, [[369, 0.466744, " for", false], [1526, 0.183925, " through", false], [11, 0.047437, ",", false], [304, 0.046804, " in", false], [264, 0.044039, " a", false], [323, 0.028121, " and", false], [279, 0.024204, " the", false], [916, 0.021524, " over", false], [553, 0.009388, " by", false], [13, 0.008407, ".", false]]]}, "raw_delta": 0.023373708128929138, "tuned_delta": 0.03194550015950739}, {"byte_start": 4556, "byte_end": 4562, "display": {"text": " edges", "kind": "normal"}, "is_word": true, "word_id": 762, "word_key": " edges", "bytes_hex": "20 65 64 67 65 73", "compression": {"rwkv": "9.86% 9.86% 9.86% 9.86% 9.86% 9.86%", "qwen": "16.52% 16.52% 16.52% 16.52% 16.52% 16.52%"}, "model_tokens": {"rwkv": [[38332, " edges", "normal", 0.037653230130672455]], "qwen": [[12822, " edges", "normal", 0.004106951877474785]]}, "loss": {"rwkv": 9.862173131076897, "qwen": 16.516075836990932}, "topk": {"rwkv": [38332, 5, 0.037653230130672455, [[52342, 0.21613, " objects", false], [56832, 0.066548, " patterns", false], [56215, 0.053318, " features", false], [332, 0.041254, " a", false], [38332, 0.037653, " edges", false], [47734, 0.033464, " visual", false], [57271, 0.026871, " specific", false], [22590, 0.026812, " the", false], [4404, 0.023431, " ``", false], [46691, 0.022311, " object", false]]], "qwen": [12822, 35, 0.004106951877474785, [[12624, 0.108482, " patterns", false], [4419, 0.107189, " features", false], [6171, 0.101189, " objects", false], [264, 0.056917, " a", false], [279, 0.037417, " the", false], [3151, 0.02735, " specific", false], [4274, 0.01985, " sal", false], [3281, 0.017533, " special", false], [9124, 0.016381, " visual", false], [3738, 0.01627, " human", false]]]}, "raw_delta": -0.3689707120259604, "tuned_delta": -0.36039891999538215}, {"byte_start": 4562, "byte_end": 4563, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "22.12%", "qwen": "14.23%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.2914634644985199]], "qwen": [[11, ",", "normal", 0.45429813861846924]]}, "loss": {"rwkv": 22.11944545112961, "qwen": 14.228608407085709}, "topk": {"rwkv": [45, 2, 0.2914634644985199, [[21265, 0.336078, " and", false], [45, 0.291463, ",", false], [4596, 0.133942, " in", false], [4715, 0.097066, " or", false], [47, 0.030694, ".", false], [5346, 0.024753, "---", false], [275, 0.021554, " (", false], [4706, 0.011554, " of", false], [32227, 0.006539, " that", false], [4811, 0.006144, " to", false]]], "qwen": [11, 1, 0.45429813861846924, [[11, 0.454298, ",", false], [323, 0.403713, " and", false], [476, 0.040795, " or", false], [304, 0.040111, " in", false], [320, 0.015853, " (", false], [13, 0.01289, ".", false], [4421, 0.003669, "---", false], [26, 0.002524, ";", false], [389, 0.002163, " on", false], [315, 0.002136, " of", false]]]}, "raw_delta": 0.43756091594696045, "tuned_delta": 0.4461327079775387}, {"byte_start": 4563, "byte_end": 4566, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 763, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"rwkv": "9.02% 9.02% 9.02%", "qwen": "12.30% 12.30% 12.30%"}, "model_tokens": {"rwkv": [[4715, " or", "normal", 0.22449207305908203]], "qwen": [[476, " or", "normal", 0.12923438847064972]]}, "loss": {"rwkv": 9.01684400555602, "qwen": 12.299742002494527}, "topk": {"rwkv": [4715, 1, 0.22449207305908203, [[4715, 0.224492, " or", false], [21265, 0.20366, " and", false], [51327, 0.091674, " corners", false], [32230, 0.055477, " then", false], [38905, 0.035899, " lines", false], [40186, 0.027468, " which", false], [47253, 0.022247, " shapes", false], [21700, 0.020649, " for", false], [40085, 0.014609, " using", false], [21643, 0.014268, " etc", false]]], "qwen": [476, 2, 0.12923438847064972, [[323, 0.188974, " and", false], [476, 0.129234, " or", false], [23462, 0.072278, " corners", false], [1221, 0.052065, " then", false], [20816, 0.035317, " shapes", false], [49031, 0.032121, " contours", false], [5128, 0.031306, " lines", false], [76899, 0.028993, " blobs", false], [369, 0.026087, " for", false], [4419, 0.025871, " features", false]]]}, "raw_delta": -0.1820425192515055, "tuned_delta": -0.17347072722092724}, {"byte_start": 4566, "byte_end": 4578, "display": {"text": " generalized", "kind": "normal"}, "is_word": true, "word_id": 764, "word_key": " generalized", "bytes_hex": "20 67 65 6e 65 72 61 6c 69 7a 65 64", "compression": {"rwkv": "14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09% 14.09%", "qwen": "14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 14.96%"}, "model_tokens": {"rwkv": [[63594, " generalized", "normal", 8.530707418685779e-05]], "qwen": [[66117, " generalized", "normal", 4.747543061967008e-05]]}, "loss": {"rwkv": 14.088818758681281, "qwen": 14.960895485977597}, "topk": {"rwkv": [63594, 518, 8.530707418685779e-05, [[21700, 0.223051, " for", false], [39193, 0.072967, " other", false], [38905, 0.047639, " lines", false], [47253, 0.040854, " shapes", false], [51327, 0.038605, " corners", false], [31458, 0.026516, " more", false], [55852, 0.024301, " contours", false], [57413, 0.020505, " textures", false], [37865, 0.019896, " blobs", false], [4423, 0.019723, " as", false]]], "qwen": [66117, 800, 4.747543061967008e-05, [[315, 0.154972, " of", false], [438, 0.084378, " as", false], [76899, 0.062551, " blobs", false], [369, 0.050894, " for", false], [23462, 0.042371, " corners", false], [20816, 0.039494, " shapes", false], [1008, 0.028485, " other", false], [4419, 0.025384, " features", false], [49031, 0.022003, " contours", false], [29853, 0.020409, " textures", false]]]}, "raw_delta": -0.04835820198059082, "tuned_delta": -0.03978640995001257}, {"byte_start": 4578, "byte_end": 4588, "display": {"text": " cylinders", "kind": "normal"}, "is_word": true, "word_id": 765, "word_key": " cylinders", "bytes_hex": "20 63 79 6c 69 6e 64 65 72 73", "compression": {"rwkv": "18.94% 18.94% 18.94% 18.94% 18.94% 18.94% 18.94% 18.94% 18.94% 18.94%", "qwen": "14.63% 14.63% 14.63% 14.63% 14.63% 14.63% 14.63% 14.63% 14.63% 14.63%"}, "model_tokens": {"rwkv": [[59439, " cylinders", "normal", 2.7507401682669297e-05]], "qwen": [[74321, " cylinders", "normal", 0.00029981572879478335]]}, "loss": {"rwkv": 18.935372411667647, "qwen": 14.629545971606023}, "topk": {"rwkv": [59439, 812, 2.7507401682669297e-05, [[38332, 0.323782, " edges", false], [47253, 0.084554, " shapes", false], [30729, 0.052577, " edge", false], [57527, 0.036641, " versions", false], [4811, 0.036129, " to", false], [56215, 0.028999, " features", false], [56832, 0.026346, " patterns", false], [38541, 0.020935, " forms", false], [38905, 0.017084, " lines", false], [32229, 0.014818, " them", false]]], "qwen": [74321, 155, 0.00029981572879478335, [[12822, 0.516086, " edges", false], [4419, 0.114138, " features", false], [20816, 0.039735, " shapes", false], [10795, 0.018152, " versions", false], [311, 0.013885, " to", false], [12624, 0.011384, " patterns", false], [7586, 0.010593, " forms", false], [5335, 0.008431, " images", false], [76899, 0.00804, " blobs", false], [49031, 0.007564, " contours", false]]]}, "raw_delta": 0.23876571655273438, "tuned_delta": 0.24733750858331263}, {"byte_start": 4588, "byte_end": 4589, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "11.98%", "qwen": "8.56%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.5074355602264404]], "qwen": [[11, ",", "normal", 0.6220842599868774]]}, "loss": {"rwkv": 11.97549594487909, "qwen": 8.560225767948992}, "topk": {"rwkv": [45, 1, 0.5074355602264404, [[45, 0.507436, ",", false], [47, 0.07487, ".", false], [275, 0.068072, " (", false], [4715, 0.061727, " or", false], [21265, 0.057446, " and", false], [4596, 0.04451, " in", false], [4706, 0.040184, " of", false], [5346, 0.024133, "---", false], [32227, 0.022551, " that", false], [45395, 0.010373, " called", false]]], "qwen": [11, 1, 0.6220842599868774, [[11, 0.622084, ",", false], [476, 0.072416, " or", false], [13, 0.071301, ".", false], [320, 0.061127, " (", false], [323, 0.044242, " and", false], [304, 0.04152, " in", false], [315, 0.022199, " of", false], [429, 0.008502, " that", false], [4421, 0.007446, "---", false], [26, 0.005209, ";", false]]]}, "raw_delta": 0.18938279151916504, "tuned_delta": 0.1979545835497433}, {"byte_start": 4589, "byte_end": 4592, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 766, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"rwkv": "4.77% 4.77% 4.77%", "qwen": "2.07% 2.07% 2.07%"}, "model_tokens": {"rwkv": [[4715, " or", "normal", 0.45057412981987]], "qwen": [[476, " or", "normal", 0.7081467509269714]]}, "loss": {"rwkv": 4.766717013353834, "qwen": 2.0744988052614812}, "topk": {"rwkv": [4715, 1, 0.45057412981987, [[4715, 0.450574, " or", false], [21265, 0.14221, " and", false], [4596, 0.121982, " in", false], [21643, 0.053046, " etc", false], [40186, 0.021115, " which", false], [32227, 0.018409, " that", false], [4811, 0.014874, " to", false], [32487, 0.008585, " with", false], [4423, 0.007932, " as", false], [40085, 0.007516, " using", false]]], "qwen": [476, 1, 0.7081467509269714, [[476, 0.708147, " or", false], [323, 0.091256, " and", false], [304, 0.034837, " in", false], [4992, 0.033548, " etc", false], [892, 0.009402, " which", false], [429, 0.006675, " that", false], [3118, 0.005765, " based", false], [448, 0.005734, " with", false], [1667, 0.005297, " using", false], [438, 0.004923, " as", false]]]}, "raw_delta": 0.14928827683130902, "tuned_delta": 0.15786006886188728}, {"byte_start": 4592, "byte_end": 4595, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 767, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "32.87% 32.87% 32.87%", "qwen": "29.69% 29.69% 29.69%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.004255402367562056]], "qwen": [[304, " in", "normal", 0.007163698319345713]]}, "loss": {"rwkv": 32.87391043692299, "qwen": 29.687831506476456}, "topk": {"rwkv": [4596, 36, 0.004255402367562056, [[39193, 0.137982, " other", false], [63594, 0.124483, " generalized", false], [32074, 0.062221, " some", false], [38905, 0.025453, " lines", false], [31458, 0.020996, " more", false], [22590, 0.019826, " the", false], [30788, 0.019388, " even", false], [37865, 0.018238, " blobs", false], [57564, 0.014912, " whatever", false], [332, 0.011824, " a", false]]], "qwen": [304, 23, 0.007163698319345713, [[1008, 0.095454, " other", false], [76899, 0.049573, " blobs", false], [315, 0.041197, " of", false], [1045, 0.028895, " some", false], [2494, 0.028273, " something", false], [66117, 0.027925, " generalized", false], [20816, 0.020533, " shapes", false], [8820, 0.020296, " whatever", false], [438, 0.018271, " as", false], [12300, 0.016067, " faces", false]]]}, "raw_delta": 0.176673730214437, "tuned_delta": 0.18524552224501525}, {"byte_start": 4595, "byte_end": 4601, "display": {"text": " terms", "kind": "normal"}, "is_word": true, "word_id": 768, "word_key": " terms", "bytes_hex": "20 74 65 72 6d 73", "compression": {"rwkv": "10.19% 10.19% 10.19% 10.19% 10.19% 10.19%", "qwen": "10.86% 10.86% 10.86% 10.86% 10.86% 10.86%"}, "model_tokens": {"rwkv": [[39920, " terms", "normal", 0.03363630920648575]], "qwen": [[3793, " terms", "normal", 0.02695387974381447]]}, "loss": {"rwkv": 10.190912235446126, "qwen": 10.861173054709965}, "topk": {"rwkv": [39920, 7, 0.03363630920648575, [[32074, 0.252682, " some", false], [39193, 0.181931, " other", false], [22590, 0.094999, " the", false], [51832, 0.072975, " general", false], [332, 0.055862, " a", false], [31458, 0.03984, " more", false], [39920, 0.033636, " terms", false], [22226, 0.023774, " one", false], [53265, 0.016313, " various", false], [31370, 0.015086, " many", false]]], "qwen": [3793, 7, 0.02695387974381447, [[1045, 0.208606, " some", false], [279, 0.132075, " the", false], [1008, 0.123278, " other", false], [264, 0.050137, " a", false], [4586, 0.029927, " general", false], [220, 0.028146, " ", false], [3793, 0.026954, " terms", false], [54611, 0.019275, "variants", false], [947, 0.018864, "var", false], [803, 0.013371, " more", false]]]}, "raw_delta": -0.037167151769002316, "tuned_delta": -0.028595359738424066}, {"byte_start": 4601, "byte_end": 4604, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 769, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.15% 0.15% 0.15%", "qwen": "0.05% 0.05% 0.05%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9748835563659668]], "qwen": [[315, " of", "normal", 0.9919356107711792]]}, "loss": {"rwkv": 0.15262886988571386, "qwen": 0.04867343032269244}, "topk": {"rwkv": [4706, 1, 0.9748835563659668, [[4706, 0.974884, " of", false], [32227, 0.006181, " that", false], [31458, 0.00471, " more", false], [52906, 0.001592, " similar", false], [39193, 0.001341, " other", false], [31296, 0.000741, " like", false], [52693, 0.000488, " related", false], [56205, 0.000383, " familiar", false], [56466, 0.000291, " inspired", false], [22590, 0.000259, " the", false]]], "qwen": [315, 1, 0.9919356107711792, [[315, 0.991936, " of", false], [429, 0.002911, " that", false], [3118, 0.000341, " based", false], [4428, 0.000316, " similar", false], [803, 0.000269, " more", false], [5435, 0.000265, " related", false], [1075, 0.000195, " like", false], [15860, 0.000164, " involving", false], [1008, 0.000144, " other", false], [1602, 8.6e-05, " very", false]]]}, "raw_delta": 0.005764513586958248, "tuned_delta": 0.014336305617536496}, {"byte_start": 4604, "byte_end": 4609, "display": {"text": " SIFT", "kind": "normal"}, "is_word": true, "word_id": 770, "word_key": " sift", "bytes_hex": "20 53 49 46 54", "compression": {"rwkv": "45.65% 45.65% 45.65% 0.00% 0.00%", "qwen": "73.93% 73.93% 0.86% 0.86% 0.86%"}, "model_tokens": {"rwkv": [[4191, " SI", "normal", 0.0005048418533988297], [1023, "FT", "normal", 0.9994822144508362]], "qwen": [[328, " S", "normal", 0.00027484563179314137], [14292, "IFT", "normal", 0.8664654493331909]]}, "loss": {"rwkv": 27.39050732089366, "qwen": 30.089691130898576}, "topk": {"rwkv": [4191, 259, 0.0005048418533988297, [[332, 0.099233, " a", false], [22590, 0.072216, " the", false], [39193, 0.029142, " other", false], [31044, 0.027975, " hand", false], [38720, 0.027118, " human", false], [32074, 0.020387, " some", false], [63885, 0.013919, " statistical", false], [51725, 0.013622, " feature", false], [59767, 0.012094, " geometric", false], [56215, 0.01152, " features", false]]], "qwen": [328, 446, 0.00027484563179314137, [[279, 0.059039, " the", false], [3738, 0.05651, " human", false], [264, 0.042507, " a", false], [4419, 0.025916, " features", false], [4565, 0.022914, " feature", false], [2205, 0.020055, " local", false], [1045, 0.016433, " some", false], [1008, 0.014731, " other", false], [1894, 0.014299, " color", false], [4285, 0.014204, " simple", false]]]}, "raw_delta": -0.14967453181743626, "tuned_delta": -0.141102739786858}, {"byte_start": 4609, "byte_end": 4618, "display": {"text": " features", "kind": "normal"}, "is_word": true, "word_id": 771, "word_key": " features", "bytes_hex": "20 66 65 61 74 75 72 65 73", "compression": {"rwkv": "3.54% 3.54% 3.54% 3.54% 3.54% 3.54% 3.54% 3.54% 3.54%", "qwen": "1.16% 1.16% 1.16% 1.16% 1.16% 1.16% 1.16% 1.16% 1.16%"}, "model_tokens": {"rwkv": [[56215, " features", "normal", 0.17301976680755615]], "qwen": [[4419, " features", "normal", 0.5602641105651855]]}, "loss": {"rwkv": 3.5378589327355217, "qwen": 1.1608624703841681}, "topk": {"rwkv": [56215, 2, 0.17301976680755615, [[45, 0.186963, ",", false], [56215, 0.17302, " features", false], [275, 0.143896, " (", false], [4715, 0.07172, " or", false], [63458, 0.064991, " descriptors", false], [21265, 0.063587, " and", false], [47, 0.047308, ".", false], [5346, 0.034819, "---", false], [46, 0.026713, "-", false], [59940, 0.0221, " keypoints", false]]], "qwen": [4419, 1, 0.5602641105651855, [[4419, 0.560264, " features", false], [47517, 0.058171, " descriptors", false], [320, 0.049761, " (", false], [82, 0.040318, "s", false], [11, 0.039659, ",", false], [476, 0.036471, " or", false], [12681, 0.031961, "-like", false], [323, 0.01962, " and", false], [13, 0.019555, ".", false], [3501, 0.009528, " points", false]]]}, "raw_delta": 0.1318086716863844, "tuned_delta": 0.14038046371696267}, {"byte_start": 4618, "byte_end": 4619, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "20.57%", "qwen": "17.12%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.32082709670066833]], "qwen": [[13, ".", "normal", 0.3871019184589386]]}, "loss": {"rwkv": 20.56967538767467, "qwen": 17.115182417432173}, "topk": {"rwkv": [47, 2, 0.32082709670066833, [[45, 0.36196, ",", false], [47, 0.320827, ".", false], [275, 0.078872, " (", false], [5346, 0.051381, "---", false], [21265, 0.047438, " and", false], [4715, 0.037554, " or", false], [32227, 0.027323, " that", false], [4596, 0.008005, " in", false], [60, 0.007978, ";", false], [4706, 0.005888, " of", false]]], "qwen": [13, 1, 0.3871019184589386, [[13, 0.387102, ".", false], [11, 0.377043, ",", false], [320, 0.066533, " (", false], [323, 0.048637, " and", false], [476, 0.046631, " or", false], [4421, 0.016091, "---", false], [429, 0.010928, " that", false], [26, 0.009214, ";", false], [304, 0.005007, " in", false], [508, 0.002577, " [", false]]]}, "raw_delta": 0.19155776500701904, "tuned_delta": 0.2001295570375973}, {"byte_start": 4619, "byte_end": 4623, "display": {"text": " But", "kind": "normal"}, "is_word": true, "word_id": 772, "word_key": " but", "bytes_hex": "20 42 75 74", "compression": {"rwkv": "15.29% 15.29% 15.29% 15.29%", "qwen": "17.70% 17.70% 17.70% 17.70%"}, "model_tokens": {"rwkv": [[19555, " But", "normal", 0.03335017338395119]], "qwen": [[1988, " But", "normal", 0.019717730581760406]]}, "loss": {"rwkv": 15.286368353169191, "qwen": 17.701133758271173}, "topk": {"rwkv": [19555, 5, 0.03335017338395119, [[37453, 0.272282, " These", false], [20996, 0.05809, " The", false], [36918, 0.0496, " Later", false], [29894, 0.039383, " This", false], [19555, 0.03335, " But", false], [3913, 0.032863, " In", false], [29890, 0.032073, " Then", false], [19407, 0.026237, " All", false], [29421, 0.022944, " More", false], [37451, 0.022828, " There", false]]], "qwen": [1988, 10, 0.019717730581760406, [[4220, 0.179589, " These", false], [24885, 0.126057, " Later", false], [576, 0.057926, " The", false], [2619, 0.040932, " There", false], [2009, 0.036093, " All", false], [758, 0.033983, " In", false], [4398, 0.030353, " More", false], [5005, 0.028521, " Then", false], [1096, 0.026708, " This", false], [1988, 0.019718, " But", false]]]}, "raw_delta": -0.13390302658081055, "tuned_delta": -0.1253312345502323}, {"byte_start": 4623, "byte_end": 4629, "display": {"text": " today", "kind": "normal"}, "is_word": true, "word_id": 773, "word_key": " today", "bytes_hex": "20 74 6f 64 61 79", "compression": {"rwkv": "22.82% 22.82% 22.82% 22.82% 22.82% 22.82%", "qwen": "19.59% 19.59% 19.59% 19.59% 19.59% 19.59%"}, "model_tokens": {"rwkv": [[39971, " today", "normal", 0.0005062879645265639]], "qwen": [[3351, " today", "normal", 0.0014754984294995666]]}, "loss": {"rwkv": 22.823886389063677, "qwen": 19.592878424267994}, "topk": {"rwkv": [39971, 107, 0.0005062879645265639, [[22590, 0.115556, " the", false], [39936, 0.114644, " these", false], [45, 0.089872, ",", false], [4423, 0.055648, " as", false], [4596, 0.053503, " in", false], [32487, 0.031316, " with", false], [4601, 0.027264, " it", false], [39944, 0.024523, " those", false], [32465, 0.023059, " when", false], [32230, 0.020954, " then", false]]], "qwen": [3351, 61, 0.0014754984294995666, [[1493, 0.162007, " these", false], [279, 0.083008, " the", false], [11, 0.069522, ",", false], [678, 0.054504, " all", false], [1846, 0.04808, " those", false], [432, 0.040395, " it", false], [438, 0.032433, " as", false], [419, 0.031545, " this", false], [2711, 0.028393, " search", false], [304, 0.027728, " in", false]]]}, "raw_delta": 0.17916512489318848, "tuned_delta": 0.18773691692376673}, {"byte_start": 4629, "byte_end": 4633, "display": {"text": " all", "kind": "normal"}, "is_word": true, "word_id": 774, "word_key": " all", "bytes_hex": "20 61 6c 6c", "compression": {"rwkv": "23.67% 23.67% 23.67% 23.67%", "qwen": "24.88% 24.88% 24.88% 24.88%"}, "model_tokens": {"rwkv": [[21256, " all", "normal", 0.005297759082168341]], "qwen": [[678, " all", "normal", 0.004013643134385347]]}, "loss": {"rwkv": 23.669215514584554, "qwen": 24.877724703498696}, "topk": {"rwkv": [21256, 13, 0.005297759082168341, [[45, 0.489995, ",", false], [460, 0.2643, "'s", false], [22590, 0.055336, " the", false], [39934, 0.021747, " there", false], [4601, 0.021558, " it", false], [4858, 0.019624, " we", false], [30597, 0.01306, " deep", false], [39936, 0.0102, " these", false], [31461, 0.009053, " most", false], [47732, 0.007525, " vision", false]]], "qwen": [678, 13, 0.004013643134385347, [[11, 0.467636, ",", false], [594, 0.310312, "'s", false], [279, 0.045603, " the", false], [582, 0.021165, " we", false], [432, 0.014184, " it", false], [1052, 0.013138, " there", false], [5538, 0.010651, " deep", false], [1429, 0.01032, " most", false], [6366, 0.009914, " computer", false], [11129, 0.007534, " vision", false]]]}, "raw_delta": -0.06701397895812988, "tuned_delta": -0.05844218692755163}, {"byte_start": 4633, "byte_end": 4638, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 775, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "15.44% 15.44% 15.44% 15.44% 15.44%", "qwen": "12.47% 12.47% 12.47% 12.47% 12.47%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.013896853663027287]], "qwen": [[419, " this", "normal", 0.031515933573246]]}, "loss": {"rwkv": 15.441345359514685, "qwen": 12.469436997463111}, "topk": {"rwkv": [32234, 14, 0.013896853663027287, [[22590, 0.211601, " the", false], [4706, 0.135503, " of", false], [52224, 0.088675, " methods", false], [39936, 0.073791, " these", false], [55809, 0.047185, " computer", false], [62603, 0.039381, " successful", false], [32227, 0.034496, " that", false], [47732, 0.03381, " vision", false], [38961, 0.030639, " major", false], [39944, 0.024235, " those", false]]], "qwen": [419, 9, 0.031515933573246, [[315, 0.226157, " of", false], [279, 0.127321, " the", false], [6366, 0.115761, " computer", false], [429, 0.090816, " that", false], [1846, 0.039523, " those", false], [5413, 0.036473, " methods", false], [3598, 0.035435, " major", false], [1493, 0.033718, " these", false], [419, 0.031516, " this", false], [11129, 0.028523, " vision", false]]]}, "raw_delta": 0.16479759216308587, "tuned_delta": 0.17336938419366413}, {"byte_start": 4638, "byte_end": 4641, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 776, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "4.93% 4.93% 4.93%", "qwen": "7.06% 7.06% 7.06%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.4382253587245941]], "qwen": [[374, " is", "normal", 0.3087458312511444]]}, "loss": {"rwkv": 4.931086565538449, "qwen": 7.064618774005778}, "topk": {"rwkv": [4600, 1, 0.4382253587245941, [[4600, 0.438225, " is", false], [21800, 0.212744, " has", false], [32499, 0.052106, " work", false], [39620, 0.047211, " seems", false], [57103, 0.026847, " research", false], [38720, 0.020936, " human", false], [31615, 0.01203, " pale", false], [45829, 0.010238, " effort", false], [38932, 0.008502, " looks", false], [22748, 0.007898, " was", false]]], "qwen": [374, 1, 0.3087458312511444, [[374, 0.308746, " is", false], [702, 0.20507, " has", false], [6540, 0.059443, " knowledge", false], [3738, 0.055794, " human", false], [975, 0.049138, " work", false], [3412, 0.038615, " research", false], [5041, 0.020935, " effort", false], [2711, 0.015505, " search", false], [11129, 0.013739, " vision", false], [15039, 0.007819, " searching", false]]]}, "raw_delta": -0.11830814679463703, "tuned_delta": -0.10973635476405878}, {"byte_start": 4641, "byte_end": 4651, "display": {"text": " discarded", "kind": "normal"}, "is_word": true, "word_id": 777, "word_key": " discarded", "bytes_hex": "20 64 69 73 63 61 72 64 65 64", "compression": {"rwkv": "11.38% 11.38% 11.38% 11.38% 11.38% 11.38% 11.38% 11.38% 11.38% 11.38%", "qwen": "11.54% 11.54% 11.54% 11.54% 11.54% 11.54% 11.54% 11.54% 11.54% 11.54%"}, "model_tokens": {"rwkv": [[59536, " discarded", "normal", 0.001785344211384654]], "qwen": [[43210, " discarded", "normal", 0.0016657938249409199]]}, "loss": {"rwkv": 11.383765557014474, "qwen": 11.536967702403063}, "topk": {"rwkv": [59536, 92, 0.001785344211384654, [[332, 0.061481, " a", false], [30666, 0.042728, " done", false], [45290, 0.038686, " behind", false], [38319, 0.03661, " dwarf", false], [62161, 0.033108, " irrelevant", false], [31968, 0.025987, " seen", false], [52094, 0.023844, " largely", false], [56738, 0.023731, " obsolete", false], [31323, 0.02197, " long", false], [4596, 0.021353, " in", false]]], "qwen": [43210, 93, 0.0016657938249409199, [[2814, 0.106711, " done", false], [46066, 0.081737, " obsolete", false], [264, 0.044212, " a", false], [39715, 0.026981, " irrelevant", false], [13771, 0.026165, " largely", false], [3884, 0.024434, " seen", false], [1660, 0.023346, " being", false], [12575, 0.021129, " replaced", false], [1632, 0.015291, " well", false], [6509, 0.014365, " considered", false]]]}, "raw_delta": -0.008495330810546875, "tuned_delta": 7.646122003137322e-05}, {"byte_start": 4651, "byte_end": 4652, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "39.45%", "qwen": "45.59%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.11266692727804184]], "qwen": [[13, ".", "normal", 0.07983085513114929]]}, "loss": {"rwkv": 39.44869252430759, "qwen": 45.58637497176933}, "topk": {"rwkv": [47, 3, 0.11266692727804184, [[4596, 0.366475, " in", false], [45, 0.223278, ",", false], [47, 0.112667, ".", false], [21265, 0.099154, " and", false], [4423, 0.083951, " as", false], [21700, 0.02073, " for", false], [60, 0.018032, ";", false], [5346, 0.015629, "---", false], [51018, 0.011631, " because", false], [4450, 0.007607, " by", false]]], "qwen": [13, 4, 0.07983085513114929, [[304, 0.359606, " in", false], [11, 0.254916, ",", false], [323, 0.151327, " and", false], [13, 0.079831, ".", false], [438, 0.028933, " as", false], [4421, 0.024645, "---", false], [369, 0.020899, " for", false], [26, 0.015377, ";", false], [553, 0.012128, " by", false], [25, 0.007039, ":", false]]]}, "raw_delta": -0.3403453826904297, "tuned_delta": -0.33177359065985146}, {"byte_start": 4652, "byte_end": 4659, "display": {"text": " Modern", "kind": "normal"}, "is_word": true, "word_id": 778, "word_key": " modern", "bytes_hex": "20 4d 6f 64 65 72 6e", "compression": {"rwkv": "10.71% 10.71% 10.71% 10.71% 10.71% 10.71% 10.71%", "qwen": "10.06% 10.06% 10.06% 10.06% 10.06% 10.06% 10.06%"}, "model_tokens": {"rwkv": [[44593, " Modern", "normal", 0.01586654782295227]], "qwen": [[18265, " Modern", "normal", 0.020121648907661438]]}, "loss": {"rwkv": 10.707502256597774, "qwen": 10.062692617507867}, "topk": {"rwkv": [44593, 13, 0.01586654782295227, [[50342, 0.261398, " Instead", false], [20996, 0.157116, " The", false], [45032, 0.039057, " Vision", false], [28753, 0.030913, " Deep", false], [3913, 0.030549, " In", false], [3918, 0.027309, " It", false], [36607, 0.026227, " Early", false], [37451, 0.020768, " There", false], [54932, 0.017308, " Computer", false], [50438, 0.017166, " Methods", false]]], "qwen": [18265, 8, 0.020121648907661438, [[12090, 0.211263, " Instead", false], [576, 0.121408, " The", false], [30441, 0.099468, " Vision", false], [2619, 0.037192, " There", false], [758, 0.035085, " In", false], [18183, 0.031522, " Deep", false], [1084, 0.020505, " It", false], [18265, 0.020122, " Modern", false], [17407, 0.018563, " Computer", false], [18801, 0.015824, " Methods", false]]]}, "raw_delta": 0.03575583866664345, "tuned_delta": 0.0443276306972217}, {"byte_start": 4659, "byte_end": 4664, "display": {"text": " deep", "kind": "normal"}, "is_word": true, "word_id": 779, "word_key": " deep", "bytes_hex": "20 64 65 65 70", "compression": {"rwkv": "14.77% 14.77% 14.77% 14.77% 14.77%", "qwen": "11.38% 11.38% 11.38% 11.38% 11.38%"}, "model_tokens": {"rwkv": [[30597, " deep", "normal", 0.01665862463414669]], "qwen": [[5538, " deep", "normal", 0.042633719742298126]]}, "loss": {"rwkv": 14.765082059097983, "qwen": 11.379653451832345}, "topk": {"rwkv": [30597, 7, 0.01665862463414669, [[52224, 0.420391, " methods", false], [55809, 0.195413, " computer", false], [47732, 0.122881, " vision", false], [53087, 0.054055, " systems", false], [61590, 0.051621, " approaches", false], [57103, 0.025345, " research", false], [30597, 0.016659, " deep", false], [38744, 0.009217, " image", false], [45, 0.008537, ",", false], [62633, 0.00787, " techniques", false]]], "qwen": [5538, 6, 0.042633719742298126, [[5413, 0.268403, " methods", false], [6366, 0.264064, " computer", false], [11129, 0.13221, " vision", false], [5942, 0.080928, " systems", false], [19827, 0.067449, " approaches", false], [5538, 0.042634, " deep", false], [12538, 0.016512, " techniques", false], [975, 0.010687, " work", false], [3412, 0.010184, " research", false], [25185, 0.006606, " algorithms", false]]]}, "raw_delta": 0.1877280235290527, "tuned_delta": 0.19629981555963097}, {"byte_start": 4664, "byte_end": 4673, "display": {"text": "-learning", "kind": "normal"}, "is_word": true, "word_id": 780, "word_key": "-learning", "bytes_hex": "2d 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "45.93% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10%", "qwen": "3.60% 3.60% 3.60% 3.60% 3.60% 3.60% 3.60% 3.60% 3.60%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.0782984271645546], [54126, "learning", "normal", 0.9556092023849487]], "qwen": [[70756, "-learning", "normal", 0.16620495915412903]]}, "loss": {"rwkv": 5.194273527072148, "qwen": 3.5957841227348726}, "topk": {"rwkv": [46, 2, 0.0782984271645546, [[56537, 0.619999, " learning", false], [46, 0.078298, "-", false], [63421, 0.061007, " convolution", false], [46658, 0.059126, " neural", false], [47732, 0.048795, " vision", false], [56705, 0.03477, " networks", false], [52224, 0.018726, " methods", false], [19593, 0.016758, " CNN", false], [47734, 0.009307, " visual", false], [52307, 0.008272, " network", false]]], "qwen": [70756, 2, 0.16620495915412903, [[6832, 0.627562, " learning", false], [70756, 0.166205, "-learning", false], [29728, 0.074835, " neural", false], [14155, 0.035269, " networks", false], [55712, 0.022559, " convolution", false], [11129, 0.014643, " vision", false], [5413, 0.007685, " methods", false], [12, 0.005075, "-", false], [3922, 0.004662, " network", false], [52457, 0.004097, " nets", false]]]}, "raw_delta": 0.08863907390170632, "tuned_delta": 0.09721086593228456}, {"byte_start": 4673, "byte_end": 4680, "display": {"text": " neural", "kind": "normal"}, "is_word": true, "word_id": 781, "word_key": " neural", "bytes_hex": "20 6e 65 75 72 61 6c", "compression": {"rwkv": "16.58% 16.58% 16.58% 16.58% 16.58% 16.58% 16.58%", "qwen": "16.49% 16.49% 16.49% 16.49% 16.49% 16.49% 16.49%"}, "model_tokens": {"rwkv": [[46658, " neural", "normal", 0.0016307620098814368]], "qwen": [[29728, " neural", "normal", 0.0016614794731140137]]}, "loss": {"rwkv": 16.58455236736196, "qwen": 16.488063957990402}, "topk": {"rwkv": [46658, 21, 0.0016307620098814368, [[52224, 0.451256, " methods", false], [46, 0.134434, "-", false], [61590, 0.09121, " approaches", false], [47732, 0.086641, " vision", false], [53087, 0.081947, " systems", false], [55809, 0.04924, " computer", false], [62633, 0.015111, " techniques", false], [46587, 0.010419, " models", false], [57103, 0.008534, " research", false], [37810, 0.008078, " based", false]]], "qwen": [29728, 21, 0.0016614794731140137, [[5413, 0.297083, " methods", false], [5980, 0.277579, "-based", false], [5942, 0.09559, " systems", false], [19827, 0.068918, " approaches", false], [11129, 0.056684, " vision", false], [6366, 0.050089, " computer", false], [12538, 0.027737, " techniques", false], [3118, 0.026534, " based", false], [4119, 0.01504, " models", false], [77235, 0.009815, " architectures", false]]]}, "raw_delta": 0.005350453513009112, "tuned_delta": 0.01392224554358736}, {"byte_start": 4680, "byte_end": 4689, "display": {"text": " networks", "kind": "normal"}, "is_word": true, "word_id": 782, "word_key": " networks", "bytes_hex": "20 6e 65 74 77 6f 72 6b 73", "compression": {"rwkv": "0.97% 0.97% 0.97% 0.97% 0.97% 0.97% 0.97% 0.97% 0.97%", "qwen": "1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12% 1.12%"}, "model_tokens": {"rwkv": [[56705, " networks", "normal", 0.6159466505050659]], "qwen": [[14155, " networks", "normal", 0.5725714564323425]]}, "loss": {"rwkv": 0.9666495092761881, "qwen": 1.1173226736703195}, "topk": {"rwkv": [56705, 1, 0.6159466505050659, [[56705, 0.615947, " networks", false], [46, 0.126019, "-", false], [52307, 0.115085, " network", false], [31510, 0.090473, " nets", false], [22166, 0.016425, " net", false], [53087, 0.00905, " systems", false], [47732, 0.007823, " vision", false], [61590, 0.004813, " approaches", false], [52224, 0.004112, " methods", false], [64833, 0.002053, " architectures", false]]], "qwen": [14155, 1, 0.5725714564323425, [[14155, 0.572571, " networks", false], [3922, 0.180329, " network", false], [56732, 0.095167, "-network", false], [52457, 0.089963, " nets", false], [4179, 0.025765, " net", false], [66496, 0.019738, "-net", false], [77235, 0.002377, " architectures", false], [5413, 0.001393, " methods", false], [4119, 0.001261, " models", false], [11129, 0.000954, " vision", false]]]}, "raw_delta": -0.008355094326867, "tuned_delta": 0.00021669770371124907}, {"byte_start": 4689, "byte_end": 4693, "display": {"text": " use", "kind": "normal"}, "is_word": true, "word_id": 783, "word_key": " use", "bytes_hex": "20 75 73 65", "compression": {"rwkv": "16.70% 16.70% 16.70% 16.70%", "qwen": "20.07% 20.07% 20.07% 20.07%"}, "model_tokens": {"rwkv": [[22681, " use", "normal", 0.024639911949634552]], "qwen": [[990, " use", "normal", 0.011658454313874245]]}, "loss": {"rwkv": 16.69525022903732, "qwen": 20.070248518484753}, "topk": {"rwkv": [22681, 9, 0.024639911949634552, [[45, 0.127213, ",", false], [21286, 0.116796, " are", false], [31059, 0.107893, " have", false], [38877, 0.066003, " learn", false], [21413, 0.041754, " can", false], [4491, 0.038278, " do", false], [32227, 0.031818, " that", false], [32499, 0.024642, " work", false], [22681, 0.02464, " use", false], [32187, 0.019137, " take", false]]], "qwen": [990, 16, 0.011658454313874245, [[525, 0.195085, " are", false], [614, 0.08028, " have", false], [11, 0.079562, ",", false], [369, 0.045916, " for", false], [653, 0.037626, " do", false], [429, 0.036058, " that", false], [646, 0.035558, " can", false], [3960, 0.028118, " learn", false], [8193, 0.024127, " produce", false], [975, 0.020111, " work", false]]]}, "raw_delta": -0.18714964389801025, "tuned_delta": -0.178577851867432}, {"byte_start": 4693, "byte_end": 4698, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 784, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"rwkv": "15.33% 15.33% 15.33% 15.33% 15.33%", "qwen": "14.56% 14.56% 14.56% 14.56% 14.56%"}, "model_tokens": {"rwkv": [[31581, " only", "normal", 0.014325984753668308]], "qwen": [[1172, " only", "normal", 0.01767251081764698]]}, "loss": {"rwkv": 15.328634809445234, "qwen": 14.555872043629412}, "topk": {"rwkv": [31581, 8, 0.014325984753668308, [[52195, 0.390215, " massive", false], [332, 0.05208, " a", false], [63421, 0.047013, " convolution", false], [59988, 0.031819, " massively", false], [56640, 0.026825, " millions", false], [22590, 0.02301, " the", false], [31118, 0.019377, " huge", false], [31581, 0.014326, " only", false], [56125, 0.013456, " enormous", false], [32386, 0.013305, " very", false]]], "qwen": [1172, 14, 0.01767251081764698, [[10951, 0.12976, " massive", false], [264, 0.099447, " a", false], [34447, 0.044404, " computation", false], [1657, 0.032764, " many", false], [1753, 0.030882, " much", false], [1602, 0.027839, " very", false], [6765, 0.023795, " huge", false], [3460, 0.022523, " large", false], [902, 0.02079, " no", false], [279, 0.020385, " the", false]]]}, "raw_delta": 0.04285106658935545, "tuned_delta": 0.051422858619933697}, {"byte_start": 4698, "byte_end": 4702, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 785, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "10.64% 10.64% 10.64% 10.64%", "qwen": "13.86% 13.86% 13.86% 13.86%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.09487435966730118]], "qwen": [[279, " the", "normal", 0.04623117297887802]]}, "loss": {"rwkv": 10.637058162804367, "qwen": 13.859344457418173}, "topk": {"rwkv": [22590, 2, 0.09487435966730118, [[332, 0.18061, " a", false], [22590, 0.094874, " the", false], [52195, 0.076957, " massive", false], [63421, 0.053056, " convolution", false], [32386, 0.039989, " very", false], [63885, 0.02103, " statistical", false], [47284, 0.018884, " simple", false], [62577, 0.018354, " statistics", false], [22363, 0.017736, " raw", false], [22226, 0.016553, " one", false]]], "qwen": [279, 4, 0.04623117297887802, [[34447, 0.191654, " computation", false], [264, 0.084767, " a", false], [10951, 0.058609, " massive", false], [279, 0.046231, " the", false], [825, 0.040496, " one", false], [2205, 0.032466, " local", false], [15751, 0.027486, " pixels", false], [1602, 0.020954, " very", false], [4285, 0.019496, " simple", false], [1378, 0.018379, " two", false]]]}, "raw_delta": -0.17868149280548096, "tuned_delta": -0.1701097007749027}, {"byte_start": 4702, "byte_end": 4710, "display": {"text": " notions", "kind": "normal"}, "is_word": true, "word_id": 786, "word_key": " notions", "bytes_hex": "20 6e 6f 74 69 6f 6e 73", "compression": {"rwkv": "18.74% 18.74% 18.74% 18.74% 18.74% 18.74% 18.74% 18.74%", "qwen": "21.11% 21.11% 21.11% 21.11% 21.11% 21.11% 21.11% 21.11%"}, "model_tokens": {"rwkv": [[52326, " notions", "normal", 0.00024144651251845062]], "qwen": [[58582, " notions", "normal", 8.57186532812193e-05]]}, "loss": {"rwkv": 18.738128949046104, "qwen": 21.109423589359373}, "topk": {"rwkv": [52326, 396, 0.00024144651251845062, [[22363, 0.082594, " raw", false], [63370, 0.056164, " computation", false], [52195, 0.048287, " massive", false], [63885, 0.035906, " statistical", false], [31461, 0.034227, " most", false], [37812, 0.027825, " basic", false], [30579, 0.026856, " data", false], [62577, 0.022559, " statistics", false], [32386, 0.021313, " very", false], [31937, 0.013605, " same", false]]], "qwen": [58582, 710, 8.57186532812193e-05, [[7112, 0.240242, " raw", false], [1946, 0.050263, " input", false], [1429, 0.04968, " most", false], [34447, 0.040505, " computation", false], [821, 0.030689, " data", false], [15751, 0.021541, " pixels", false], [44548, 0.013875, " simplest", false], [54480, 0.01277, " computational", false], [2550, 0.012747, " output", false], [1995, 0.011851, " information", false]]]}, "raw_delta": -0.1314924955368042, "tuned_delta": -0.12292070350622596}, {"byte_start": 4710, "byte_end": 4713, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 787, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "1.01% 1.01% 1.01%", "qwen": "0.50% 0.50% 0.50%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.8455100655555725]], "qwen": [[315, " of", "normal", 0.9205737113952637]]}, "loss": {"rwkv": 1.009698677705492, "qwen": 0.4974787177974093}, "topk": {"rwkv": [4706, 1, 0.8455100655555725, [[4706, 0.84551, " of", false], [32227, 0.097821, " that", false], [4404, 0.004486, " ``", false], [21265, 0.003961, " and", false], [30917, 0.003564, " from", false], [56412, 0.002612, " implicit", false], [38547, 0.002136, " found", false], [52112, 0.002092, " learned", false], [45, 0.002004, ",", false], [46650, 0.001869, " needed", false]]], "qwen": [315, 1, 0.9205737113952637, [[315, 0.920574, " of", false], [429, 0.042324, " that", false], [9902, 0.005987, " ``", false], [323, 0.004754, " and", false], [11, 0.001434, ",", false], [504, 0.001303, " from", false], [304, 0.001071, " in", false], [2500, 0.000902, " available", false], [1730, 0.000823, " found", false], [3897, 0.000765, " provided", false]]]}, "raw_delta": 0.028403505682945255, "tuned_delta": 0.0369752977135235}, {"byte_start": 4713, "byte_end": 4725, "display": {"text": " convolution", "kind": "normal"}, "is_word": true, "word_id": 788, "word_key": " convolution", "bytes_hex": "20 63 6f 6e 76 6f 6c 75 74 69 6f 6e", "compression": {"rwkv": "2.86% 2.86% 2.86% 2.86% 2.86% 2.86% 2.86% 2.86% 2.86% 2.86% 2.86% 2.86%", "qwen": "7.81% 7.81% 7.81% 7.81% 7.81% 7.81% 7.81% 7.81% 7.81% 7.81% 7.81% 7.81%"}, "model_tokens": {"rwkv": [[63421, " convolution", "normal", 0.14818428456783295]], "qwen": [[55712, " convolution", "normal", 0.005531262140721083]]}, "loss": {"rwkv": 2.864726480931861, "qwen": 7.810599254878239}, "topk": {"rwkv": [63421, 1, 0.14818428456783295, [[63421, 0.148184, " convolution", false], [4404, 0.105011, " ``", false], [46826, 0.047699, " pixels", false], [38332, 0.043432, " edges", false], [332, 0.040121, " a", false], [56324, 0.03039, " gradient", false], [59770, 0.018632, " gradients", false], [62554, 0.017616, " similarity", false], [39289, 0.015778, " pixel", false], [22590, 0.015391, " the", false]]], "qwen": [55712, 21, 0.005531262140721083, [[15751, 0.210336, " pixels", false], [9902, 0.163015, " ``", false], [1946, 0.080249, " input", false], [12955, 0.049233, " pixel", false], [11127, 0.038684, " inputs", false], [821, 0.02286, " data", false], [264, 0.022442, " a", false], [2168, 0.017997, " image", false], [5335, 0.01565, " images", false], [13617, 0.014336, " layers", false]]]}, "raw_delta": -0.2742574214935303, "tuned_delta": -0.26568562946295204}, {"byte_start": 4725, "byte_end": 4729, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 789, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "3.22% 3.22% 3.22% 3.22%", "qwen": "2.59% 2.59% 2.59% 2.59%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.4923631250858307]], "qwen": [[323, " and", "normal", 0.563117504119873]]}, "loss": {"rwkv": 3.2228172910483432, "qwen": 2.5890375750044}, "topk": {"rwkv": [21265, 1, 0.4923631250858307, [[21265, 0.492363, " and", false], [116, 0.196919, "s", false], [45, 0.143742, ",", false], [1744, 0.079053, "al", false], [275, 0.020357, " (", false], [32487, 0.007552, " with", false], [5346, 0.006894, "---", false], [4706, 0.006807, " of", false], [4596, 0.004937, " in", false], [4715, 0.003917, " or", false]]], "qwen": [323, 1, 0.563117504119873, [[323, 0.563118, " and", false], [11, 0.249865, ",", false], [278, 0.088523, "al", false], [320, 0.033634, " (", false], [448, 0.007711, " with", false], [304, 0.007127, " in", false], [315, 0.006006, " of", false], [4421, 0.005023, "---", false], [311, 0.003296, " to", false], [476, 0.002801, " or", false]]]}, "raw_delta": 0.03514420986175537, "tuned_delta": 0.04371600189233362}, {"byte_start": 4729, "byte_end": 4737, "display": {"text": " certain", "kind": "normal"}, "is_word": true, "word_id": 790, "word_key": " certain", "bytes_hex": "20 63 65 72 74 61 69 6e", "compression": {"rwkv": "20.01% 20.01% 20.01% 20.01% 20.01% 20.01% 20.01% 20.01%", "qwen": "22.03% 22.03% 22.03% 22.03% 22.03% 22.03% 22.03% 22.03%"}, "model_tokens": {"rwkv": [[51161, " certain", "normal", 0.00014390598516911268]], "qwen": [[3654, " certain", "normal", 5.696467269444838e-05]]}, "loss": {"rwkv": 20.00612263732742, "qwen": 22.0305820154288}, "topk": {"rwkv": [51161, 315, 0.00014390598516911268, [[52513, 0.516895, " pooling", false], [56324, 0.021, " gradient", false], [30218, 0.01963, " back", false], [46528, 0.018212, " matrix", false], [22590, 0.017681, " the", false], [61531, 0.01542, " activation", false], [4706, 0.012175, " of", false], [22073, 0.01208, " max", false], [46442, 0.012005, " linear", false], [332, 0.011744, " a", false]]], "qwen": [3654, 512, 5.696467269444838e-05, [[74410, 0.323474, " pooling", false], [1182, 0.152139, " back", false], [15099, 0.053239, " activation", false], [1932, 0.031181, " max", false], [7608, 0.024382, " rect", false], [315, 0.020933, " of", false], [20169, 0.020894, " gradient", false], [279, 0.015892, " the", false], [2205, 0.01021, " local", false], [2477, 0.009828, " non", false]]]}, "raw_delta": -0.1122598648071289, "tuned_delta": -0.10368807277655066}, {"byte_start": 4737, "byte_end": 4743, "display": {"text": " kinds", "kind": "normal"}, "is_word": true, "word_id": 791, "word_key": " kinds", "bytes_hex": "20 6b 69 6e 64 73", "compression": {"rwkv": "7.19% 7.19% 7.19% 7.19% 7.19% 7.19%", "qwen": "7.10% 7.10% 7.10% 7.10% 7.10% 7.10%"}, "model_tokens": {"rwkv": [[38841, " kinds", "normal", 0.09110265225172043]], "qwen": [[12829, " kinds", "normal", 0.09435734152793884]]}, "loss": {"rwkv": 7.185297566927454, "qwen": 7.095252467096338}, "topk": {"rwkv": [38841, 2, 0.09110265225172043, [[39193, 0.10053, " other", false], [38841, 0.091103, " kinds", false], [40050, 0.085254, " types", false], [38541, 0.050381, " forms", false], [47284, 0.044576, " simple", false], [57520, 0.03626, " variants", false], [37812, 0.029429, " basic", false], [64481, 0.01774, " mathematical", false], [65135, 0.01715, " generalization", false], [46442, 0.015364, " linear", false]]], "qwen": [12829, 2, 0.09435734152793884, [[1008, 0.125553, " other", false], [12829, 0.094357, " kinds", false], [4494, 0.07733, " types", false], [15099, 0.043503, " activation", false], [4285, 0.025572, " simple", false], [13482, 0.019895, " linear", false], [7525, 0.018981, " operations", false], [13617, 0.018745, " layers", false], [2477, 0.016965, " non", false], [6770, 0.016653, " basic", false]]]}, "raw_delta": 0.004993160565694155, "tuned_delta": 0.013564952596272403}, {"byte_start": 4743, "byte_end": 4746, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 792, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.01% 0.01% 0.01%", "qwen": "0.01% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9987161159515381]], "qwen": [[315, " of", "normal", 0.99803227186203]]}, "loss": {"rwkv": 0.0077506847988839086, "qwen": 0.011840085975758403}, "topk": {"rwkv": [4706, 1, 0.9987161159515381, [[4706, 0.998716, " of", false], [21265, 0.000264, " and", false], [275, 0.000172, " (", false], [45, 4.1e-05, ",", false], [4715, 3.8e-05, " or", false], [46442, 2.2e-05, " linear", false], [63421, 1.9e-05, " convolution", false], [4588, 1.9e-05, " if", false], [267, 1.8e-05, "  ", false], [59751, 1.4e-05, " functions", false]]], "qwen": [315, 1, 0.99803227186203, [[315, 0.998032, " of", false], [323, 0.000492, " and", false], [320, 0.000466, " (", false], [476, 0.000258, " or", false], [11, 0.000107, ",", false], [198, 5.8e-05, "\n", false], [220, 2.7e-05, " ", false], [4421, 1.4e-05, "---", false], [369, 1.3e-05, " for", false], [389, 1.2e-05, " on", false]]]}, "raw_delta": -0.00022676455167432627, "tuned_delta": 0.008345027478903921}, {"byte_start": 4746, "byte_end": 4758, "display": {"text": " invariances", "kind": "normal"}, "is_word": true, "word_id": 793, "word_key": " invariances", "bytes_hex": "20 69 6e 76 61 72 69 61 6e 63 65 73", "compression": {"rwkv": "15.22% 15.22% 15.22% 15.22% 15.22% 15.22% 15.22% 8.68% 8.68% 8.68% 8.68% 8.68%", "qwen": "45.30% 45.30% 45.30% 0.94% 0.94% 0.94% 5.83% 5.83% 5.83% 5.83% 5.83% 5.83%"}, "model_tokens": {"rwkv": [[46326, " invari", "normal", 0.002731385873630643], [33764, "ances", "normal", 0.09060946851968765]], "qwen": [[304, " in", "normal", 0.0005338663468137383], [947, "var", "normal", 0.855250895023346], [21813, "iances", "normal", 0.14363746345043182]]}, "loss": {"rwkv": 12.492085966030738, "qwen": 14.475323252503442}, "topk": {"rwkv": [46326, 55, 0.002731385873630643, [[52513, 0.215602, " pooling", false], [61531, 0.075048, " activation", false], [51743, 0.038729, " filters", false], [31333, 0.029012, " loss", false], [60060, 0.028117, " nonlinear", false], [22184, 0.024564, " non", false], [46442, 0.016425, " linear", false], [51725, 0.015429, " feature", false], [60342, 0.013442, " recurrent", false], [46528, 0.013061, " matrix", false]]], "qwen": [304, 149, 0.0005338663468137383, [[74410, 0.326134, " pooling", false], [15099, 0.094545, " activation", false], [2477, 0.030159, " non", false], [13617, 0.025877, " layers", false], [73998, 0.020388, " nonlinear", false], [1182, 0.019519, " back", false], [2205, 0.01408, " local", false], [6193, 0.014002, " layer", false], [13482, 0.013913, " linear", false], [20169, 0.012127, " gradient", false]]]}, "raw_delta": -0.10997402667999263, "tuned_delta": -0.10140223464941439}, {"byte_start": 4758, "byte_end": 4759, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "21.98%", "qwen": "22.09%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.2971969246864319]], "qwen": [[11, ",", "normal", 0.29383400082588196]]}, "loss": {"rwkv": 21.9785572635428, "qwen": 22.086583866116}, "topk": {"rwkv": [45, 1, 0.2971969246864319, [[45, 0.297197, ",", false], [47, 0.152599, ".", false], [4811, 0.123485, " to", false], [32227, 0.102124, " that", false], [275, 0.093389, " (", false], [5346, 0.036716, "---", false], [21265, 0.035848, " and", false], [4596, 0.017245, " in", false], [4706, 0.014828, " of", false], [60, 0.01097, ";", false]]], "qwen": [11, 1, 0.29383400082588196, [[11, 0.293834, ",", false], [311, 0.188356, " to", false], [13, 0.157803, ".", false], [320, 0.106901, " (", false], [4421, 0.052737, "---", false], [323, 0.043261, " and", false], [304, 0.021859, " in", false], [315, 0.020711, " of", false], [429, 0.014442, " that", false], [369, 0.013225, " for", false]]]}, "raw_delta": -0.005990266799926758, "tuned_delta": 0.0025815252306514904}, {"byte_start": 4759, "byte_end": 4763, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 794, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "4.39% 4.39% 4.39% 4.39%", "qwen": "3.81% 3.81% 3.81% 3.81%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.3746629059314728]], "qwen": [[323, " and", "normal", 0.4295869469642639]]}, "loss": {"rwkv": 4.385144838639549, "qwen": 3.8093060776712857}, "topk": {"rwkv": [21265, 1, 0.3746629059314728, [[21265, 0.374663, " and", false], [21400, 0.168011, " but", false], [40186, 0.054604, " which", false], [32139, 0.051539, " such", false], [32487, 0.02725, " with", false], [53356, 0.025751, " without", false], [22187, 0.020457, " not", false], [4423, 0.014145, " as", false], [31296, 0.013973, " like", false], [22797, 0.012327, " yet", false]]], "qwen": [323, 1, 0.4295869469642639, [[323, 0.429587, " and", false], [892, 0.107556, " which", false], [2041, 0.049767, " without", false], [448, 0.047513, " with", false], [1741, 0.036292, " such", false], [714, 0.035953, " but", false], [438, 0.015502, " as", false], [3156, 0.012447, " along", false], [304, 0.011674, " in", false], [311, 0.011388, " to", false]]]}, "raw_delta": 0.031931281089782715, "tuned_delta": 0.040503073120360965}, {"byte_start": 4763, "byte_end": 4771, "display": {"text": " perform", "kind": "normal"}, "is_word": true, "word_id": 795, "word_key": " perform", "bytes_hex": "20 70 65 72 66 6f 72 6d", "compression": {"rwkv": "12.19% 12.19% 12.19% 12.19% 12.19% 12.19% 12.19% 12.19%", "qwen": "10.87% 10.87% 10.87% 10.87% 10.87% 10.87% 10.87% 10.87%"}, "model_tokens": {"rwkv": [[52446, " perform", "normal", 0.004482059273868799]], "qwen": [[2736, " perform", "normal", 0.008039688691496849]]}, "loss": {"rwkv": 12.186828226259308, "qwen": 10.872882923450586}, "topk": {"rwkv": [52446, 38, 0.004482059273868799, [[32232, 0.14487, " they", false], [39936, 0.089294, " these", false], [22590, 0.065345, " the", false], [4491, 0.037091, " do", false], [21286, 0.032853, " are", false], [22797, 0.0274, " yet", false], [31059, 0.025442, " have", false], [38877, 0.025026, " learn", false], [39944, 0.020124, " those", false], [4596, 0.019057, " in", false]]], "qwen": [2736, 27, 0.008039688691496849, [[807, 0.101894, " they", false], [1493, 0.078591, " these", false], [525, 0.053959, " are", false], [279, 0.049706, " the", false], [653, 0.038032, " do", false], [614, 0.034809, " have", false], [3960, 0.026716, " learn", false], [678, 0.021493, " all", false], [990, 0.018424, " use", false], [304, 0.014912, " in", false]]]}, "raw_delta": 0.07286059856414795, "tuned_delta": 0.08143239059472619}, {"byte_start": 4771, "byte_end": 4776, "display": {"text": " much", "kind": "normal"}, "is_word": true, "word_id": 796, "word_key": " much", "bytes_hex": "20 6d 75 63 68", "compression": {"rwkv": "13.41% 13.41% 13.41% 13.41% 13.41%", "qwen": "12.78% 12.78% 12.78% 12.78% 12.78%"}, "model_tokens": {"rwkv": [[31466, " much", "normal", 0.024248937144875526]], "qwen": [[1753, " much", "normal", 0.02893921546638012]]}, "loss": {"rwkv": 13.412555458264581, "qwen": 12.777076123673485}, "topk": {"rwkv": [31466, 9, 0.024248937144875526, [[22590, 0.094189, " the", false], [39931, 0.087639, " their", false], [32386, 0.046725, " very", false], [32458, 0.044061, " well", false], [50892, 0.04163, " amazing", false], [332, 0.038638, " a", false], [52195, 0.03686, " massive", false], [62478, 0.029377, " remarkably", false], [31466, 0.024249, " much", false], [21256, 0.021847, " all", false]]], "qwen": [1753, 6, 0.02893921546638012, [[10951, 0.108828, " massive", false], [264, 0.058312, " a", false], [34447, 0.051205, " computation", false], [279, 0.036593, " the", false], [82599, 0.032326, " computations", false], [1753, 0.028939, " much", false], [678, 0.028153, " all", false], [1172, 0.024633, " only", false], [63707, 0.023228, " massively", false], [3041, 0.022704, " far", false]]]}, "raw_delta": 0.035238456726074285, "tuned_delta": 0.043810248756652535}, {"byte_start": 4776, "byte_end": 4783, "display": {"text": " better", "kind": "normal"}, "is_word": true, "word_id": 797, "word_key": " better", "bytes_hex": "20 62 65 74 74 65 72", "compression": {"rwkv": "0.73% 0.73% 0.73% 0.73% 0.73% 0.73% 0.73%", "qwen": "13.20% 13.20% 13.20% 13.20% 13.20% 13.20% 13.20%"}, "model_tokens": {"rwkv": [[45301, " better", "normal", 0.7511299252510071]], "qwen": [[2664, " better", "normal", 0.005944317672401667]]}, "loss": {"rwkv": 0.7295995428602808, "qwen": 13.204058925107585}, "topk": {"rwkv": [45301, 1, 0.7511299252510071, [[45301, 0.75113, " better", false], [31458, 0.154028, " more", false], [45, 0.019599, ",", false], [4706, 0.016179, " of", false], [22590, 0.012248, " the", false], [31466, 0.008137, " much", false], [31277, 0.004959, " less", false], [45961, 0.004018, " faster", false], [46198, 0.003279, " higher", false], [4715, 0.003223, " or", false]]], "qwen": [2664, 10, 0.005944317672401667, [[803, 0.738744, " more", false], [11, 0.077369, ",", false], [7046, 0.036871, " greater", false], [34447, 0.032189, " computation", false], [8131, 0.022939, " larger", false], [1753, 0.014226, " much", false], [315, 0.012348, " of", false], [2686, 0.009427, " less", false], [19117, 0.007091, " deeper", false], [2664, 0.005944, " better", false]]]}, "raw_delta": -0.6917309079851421, "tuned_delta": -0.6831591159545639}, {"byte_start": 4783, "byte_end": 4785, "display": {"text": ".\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e 0a", "compression": {"rwkv": "16.27% 23.81%", "qwen": "23.55% 23.55%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.4038146436214447], [261, "\n\n", "control", 0.07171101123094559]], "qwen": [[382, ".\n\n", "control", 0.019882136955857277]]}, "loss": {"rwkv": 20.041344684224125, "qwen": 23.551598012848235}, "topk": {"rwkv": [47, 1, 0.4038146436214447, [[47, 0.403815, ".", false], [32226, 0.226057, " than", false], [45, 0.066152, ",", false], [4712, 0.066079, " on", false], [4596, 0.038707, " in", false], [4424, 0.032568, " at", false], [5346, 0.027397, "---", false], [32487, 0.021845, " with", false], [21265, 0.010803, " and", false], [4450, 0.01077, " by", false]]], "qwen": [382, 8, 0.019882136955857277, [[1091, 0.471128, " than", false], [13, 0.246018, ".", false], [11, 0.053335, ",", false], [304, 0.03831, " in", false], [389, 0.03272, " on", false], [518, 0.025199, " at", false], [323, 0.020144, " and", false], [382, 0.019882, ".\n\n", false], [320, 0.01196, " (", false], [4421, 0.011649, "---", false]]]}, "raw_delta": -0.19464977582295728, "tuned_delta": -0.18607798379237903}, {"byte_start": 4785, "byte_end": 4786, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "23.81%", "qwen": "23.55%"}, "model_tokens": {"rwkv": [[261, "\n\n", "control", 0.07171101123094559]], "qwen": [[382, ".\n\n", "control", 0.019882136955857277]]}, "loss": {"rwkv": 23.810103702171368, "qwen": 23.551598012848235}, "topk": {"rwkv": [261, 3, 0.07171101123094559, [[20996, 0.140689, " The", false], [29894, 0.09324, " This", false], [261, 0.071711, "\n\n", false], [36251, 0.06361, " Again", false], [3913, 0.044152, " In", false], [3918, 0.03636, " It", false], [37451, 0.033717, " There", false], [29893, 0.02838, " They", false], [37453, 0.021943, " These", false], [3641, 0.021111, " As", false]]], "qwen": [382, 8, 0.019882136955857277, [[1091, 0.471128, " than", false], [13, 0.246018, ".", false], [11, 0.053335, ",", false], [304, 0.03831, " in", false], [389, 0.03272, " on", false], [518, 0.025199, " at", false], [323, 0.020144, " and", false], [382, 0.019882, ".\n\n", false], [320, 0.01196, " (", false], [4421, 0.011649, "---", false]]]}, "raw_delta": 0.014334599177042717, "tuned_delta": 0.022906391207620967}, {"byte_start": 4786, "byte_end": 4790, "display": {"text": "This", "kind": "normal"}, "is_word": true, "word_id": 798, "word_key": "this", "bytes_hex": "54 68 69 73", "compression": {"rwkv": "17.40% 17.40% 17.40% 17.40%", "qwen": "18.53% 18.53% 18.53% 18.53%"}, "model_tokens": {"rwkv": [[24242, "This", "normal", 0.02099331095814705]], "qwen": [[1986, "This", "normal", 0.016417063772678375]]}, "loss": {"rwkv": 17.399691166971383, "qwen": 18.527063240774723}, "topk": {"rwkv": [24242, 8, 0.02099331095814705, [[1136, 0.236235, "In", false], [6699, 0.114129, "The", false], [33504, 0.068052, "There", false], [33505, 0.045878, "These", false], [1141, 0.035715, "It", false], [66, 0.034916, "A", false], [5559, 0.028935, "All", false], [24242, 0.020993, "This", false], [1461, 0.013711, "So", false], [58094, 0.013548, "Similarly", false]]], "qwen": [1986, 8, 0.016417063772678375, [[641, 0.367578, "In", false], [785, 0.092108, "The", false], [3862, 0.037181, "There", false], [9485, 0.026937, "These", false], [32, 0.026351, "A", false], [2403, 0.01976, "All", false], [2132, 0.018167, "It", false], [1986, 0.016417, "This", false], [67691, 0.016169, "Similarly", false], [23949, 0.012105, "Finally", false]]]}, "raw_delta": -0.0625147819519043, "tuned_delta": -0.05394298992132605}, {"byte_start": 4790, "byte_end": 4793, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 799, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "8.55% 8.55% 8.55%", "qwen": "11.80% 11.80% 11.80%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.24036209285259247]], "qwen": [[374, " is", "normal", 0.14036953449249268]]}, "loss": {"rwkv": 8.547216713599978, "qwen": 11.802909204955125}, "topk": {"rwkv": [4600, 1, 0.24036209285259247, [[4600, 0.240362, " is", false], [52427, 0.215301, " pattern", false], [46430, 0.023896, " lesson", false], [31937, 0.021227, " same", false], [21800, 0.019253, " has", false], [45315, 0.016246, " bitter", false], [51832, 0.015342, " general", false], [21365, 0.013791, " bit", false], [30659, 0.013637, " does", false], [31254, 0.012731, " last", false]]], "qwen": [374, 2, 0.14036953449249268, [[5383, 0.312502, " pattern", false], [374, 0.14037, " is", false], [25180, 0.084028, " bitter", false], [9149, 0.038647, " trend", false], [1852, 0.025313, " same", false], [17755, 0.017518, " lesson", false], [572, 0.015478, " was", false], [702, 0.013894, " has", false], [4586, 0.013448, " general", false], [78996, 0.009663, " bitterness", false]]]}, "raw_delta": -0.1805339256922404, "tuned_delta": -0.17196213366166213}, {"byte_start": 4793, "byte_end": 4795, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 800, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "18.60% 18.60%", "qwen": "16.10% 16.10%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.12615233659744263]], "qwen": [[264, " a", "normal", 0.16762448847293854]]}, "loss": {"rwkv": 18.597240761459293, "qwen": 16.104344712961908}, "topk": {"rwkv": [332, 2, 0.12615233659744263, [[22187, 0.401821, " not", false], [332, 0.126152, " a", false], [22590, 0.077981, " the", false], [21256, 0.03986, " all", false], [31198, 0.037754, " just", false], [4419, 0.028315, " an", false], [32313, 0.019864, " true", false], [22226, 0.015876, " one", false], [31581, 0.015499, " only", false], [4450, 0.013564, " by", false]]], "qwen": [264, 2, 0.16762448847293854, [[537, 0.305703, " not", false], [264, 0.167624, " a", false], [279, 0.080188, " the", false], [830, 0.049772, " true", false], [458, 0.044748, " an", false], [1101, 0.033786, " just", false], [1083, 0.030415, " also", false], [678, 0.026734, " all", false], [1172, 0.017125, " only", false], [825, 0.015389, " one", false]]]}, "raw_delta": 0.13823550939559937, "tuned_delta": 0.14680730142617762}, {"byte_start": 4795, "byte_end": 4799, "display": {"text": " big", "kind": "normal"}, "is_word": true, "word_id": 801, "word_key": " big", "bytes_hex": "20 62 69 67", "compression": {"rwkv": "23.11% 23.11% 23.11% 23.11%", "qwen": "18.40% 18.40% 18.40% 18.40%"}, "model_tokens": {"rwkv": [[21357, " big", "normal", 0.005916913505643606]], "qwen": [[2409, " big", "normal", 0.016895288601517677]]}, "loss": {"rwkv": 23.1056627642373, "qwen": 18.397609749687152}, "topk": {"rwkv": [21357, 23, 0.005916913505643606, [[52427, 0.151616, " pattern", false], [51832, 0.138843, " general", false], [32386, 0.077253, " very", false], [46430, 0.050761, " lesson", false], [45534, 0.025772, " common", false], [30992, 0.019185, " good", false], [31323, 0.018731, " long", false], [21365, 0.016426, " bit", false], [53216, 0.013408, " typical", false], [39831, 0.011666, " story", false]]], "qwen": [2409, 6, 0.016895288601517677, [[5383, 0.145758, " pattern", false], [25180, 0.106271, " bitter", false], [4586, 0.053672, " general", false], [1602, 0.04959, " very", false], [1293, 0.028695, " long", false], [2409, 0.016895, " big", false], [1661, 0.01616, " good", false], [45250, 0.014066, " recurring", false], [4185, 0.013676, " common", false], [12126, 0.013605, " summary", false]]]}, "raw_delta": 0.2610698938369751, "tuned_delta": 0.2696416858675533}, {"byte_start": 4799, "byte_end": 4806, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 802, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"rwkv": "2.36% 2.36% 2.36% 2.36% 2.36% 2.36% 2.36%", "qwen": "2.75% 2.75% 2.75% 2.75% 2.75% 2.75% 2.75%"}, "model_tokens": {"rwkv": [[46430, " lesson", "normal", 0.39640820026397705]], "qwen": [[17755, " lesson", "normal", 0.34429696202278137]]}, "loss": {"rwkv": 2.3649088630643575, "qwen": 2.746919184055841}, "topk": {"rwkv": [46430, 1, 0.39640820026397705, [[46430, 0.396408, " lesson", false], [45450, 0.077684, " change", false], [30587, 0.046992, " deal", false], [39932, 0.036886, " theme", false], [45, 0.034727, ",", false], [39831, 0.03342, " story", false], [52427, 0.027727, " pattern", false], [31633, 0.022082, " part", false], [39981, 0.019946, " topic", false], [21265, 0.018497, " and", false]]], "qwen": [17755, 1, 0.34429696202278137, [[17755, 0.344297, " lesson", false], [5383, 0.15431, " pattern", false], [6802, 0.054268, " picture", false], [2297, 0.05139, " change", false], [6912, 0.033931, " theme", false], [3364, 0.032475, " story", false], [4586, 0.019287, " general", false], [11, 0.018384, ",", false], [323, 0.018098, " and", false], [3491, 0.016748, " problem", false]]]}, "raw_delta": -0.021183150155203695, "tuned_delta": -0.012611358124625447}, {"byte_start": 4806, "byte_end": 4807, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "29.87%", "qwen": "24.30%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.1890116184949875]], "qwen": [[13, ".", "normal", 0.25993290543556213]]}, "loss": {"rwkv": 29.868295768404316, "qwen": 24.297360649029603}, "topk": {"rwkv": [47, 1, 0.1890116184949875, [[47, 0.189012, ".", false], [21700, 0.179171, " for", false], [45, 0.177697, ",", false], [32227, 0.080117, " that", false], [4811, 0.075661, " to", false], [59, 0.068448, ":", false], [4596, 0.064481, " in", false], [37598, 0.036516, " about", false], [4706, 0.02082, " of", false], [30917, 0.019844, " from", false]]], "qwen": [13, 1, 0.25993290543556213, [[13, 0.259933, ".", false], [369, 0.230987, " for", false], [11, 0.149982, ",", false], [25, 0.080439, ":", false], [311, 0.076702, " to", false], [429, 0.042925, " that", false], [304, 0.033457, " in", false], [911, 0.020299, " about", false], [315, 0.013647, " of", false], [4421, 0.013556, "---", false]]]}, "raw_delta": 0.3089182376861572, "tuned_delta": 0.31749002971673546}, {"byte_start": 4807, "byte_end": 4810, "display": {"text": " As", "kind": "normal"}, "is_word": true, "word_id": 803, "word_key": " as", "bytes_hex": "20 41 73", "compression": {"rwkv": "25.92% 25.92% 25.92%", "qwen": "25.48% 25.48% 25.48%"}, "model_tokens": {"rwkv": [[3641, " As", "normal", 0.013599949888885021]], "qwen": [[1634, " As", "normal", 0.014417086727917194]]}, "loss": {"rwkv": 25.92342651597356, "qwen": 25.483652545829788}, "topk": {"rwkv": [3641, 10, 0.013599949888885021, [[3918, 0.215962, " It", false], [20996, 0.140166, " The", false], [3913, 0.047111, " In", false], [3908, 0.041719, " If", false], [37451, 0.028886, " There", false], [30032, 0.027224, " When", false], [4331, 0.021836, " We", false], [300, 0.014039, " A", false], [19907, 0.013748, " For", false], [3641, 0.0136, " As", false]]], "qwen": [1634, 10, 0.014417086727917194, [[1084, 0.165845, " It", false], [576, 0.106745, " The", false], [758, 0.058878, " In", false], [1416, 0.035811, " If", false], [2619, 0.029166, " There", false], [1205, 0.024241, " We", false], [3197, 0.022053, " When", false], [58150, 0.018399, " Researchers", false], [11097, 0.01658, " Human", false], [1634, 0.014417, " As", false]]]}, "raw_delta": 0.024386246999104744, "tuned_delta": 0.032958039029682994}, {"byte_start": 4810, "byte_end": 4812, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 804, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "20.57% 20.57%", "qwen": "25.17% 25.17%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.10101870447397232]], "qwen": [[264, " a", "normal", 0.06133865565061569]]}, "loss": {"rwkv": 20.56967538767467, "qwen": 25.169123507988093}, "topk": {"rwkv": [332, 1, 0.10101870447397232, [[332, 0.101019, " a", false], [22590, 0.071726, " the", false], [3609, 0.069767, " AI", false], [31323, 0.066281, " long", false], [4858, 0.05641, " we", false], [308, 0.036531, " I", false], [4596, 0.028283, " in", false], [21660, 0.025114, " far", false], [63843, 0.022032, " researchers", false], [32079, 0.021067, " soon", false]]], "qwen": [264, 3, 0.06133865565061569, [[20219, 0.109935, " Moore", false], [304, 0.062056, " in", false], [264, 0.061339, " a", false], [279, 0.060003, " the", false], [582, 0.052603, " we", false], [1293, 0.04475, " long", false], [358, 0.031471, " I", false], [448, 0.024315, " with", false], [15235, 0.023857, " AI", false], [11811, 0.020073, " researchers", false]]]}, "raw_delta": -0.2550475597381592, "tuned_delta": -0.24647576770758092}, {"byte_start": 4812, "byte_end": 4818, "display": {"text": " field", "kind": "normal"}, "is_word": true, "word_id": 805, "word_key": " field", "bytes_hex": "20 66 69 65 6c 64", "compression": {"rwkv": "12.68% 12.68% 12.68% 12.68% 12.68% 12.68%", "qwen": "9.42% 9.42% 9.42% 9.42% 9.42% 9.42%"}, "model_tokens": {"rwkv": [[38478, " field", "normal", 0.014523682184517384]], "qwen": [[2070, " field", "normal", 0.043501608073711395]]}, "loss": {"rwkv": 12.679936882813154, "qwen": 9.422473686748498}, "topk": {"rwkv": [38478, 10, 0.014523682184517384, [[51832, 0.243275, " general", false], [62496, 0.057557, " researcher", false], [47092, 0.05675, " result", false], [31907, 0.044584, " rule", false], [46530, 0.026454, " matter", false], [60212, 0.025288, " practical", false], [57103, 0.016576, " research", false], [52942, 0.016178, " society", false], [21458, 0.01524, " cor", false], [38478, 0.014524, " field", false]]], "qwen": [2070, 5, 0.043501608073711395, [[1102, 0.13028, " result", false], [4586, 0.081515, " general", false], [5912, 0.055403, " rule", false], [28674, 0.047317, " consequence", false], [2070, 0.043502, " field", false], [31085, 0.04242, " researcher", false], [1829, 0.032466, " cor", false], [6366, 0.02916, " computer", false], [3108, 0.020903, " side", false], [14976, 0.020808, " practical", false]]]}, "raw_delta": 0.1806321144104004, "tuned_delta": 0.18920390644097865}, {"byte_start": 4818, "byte_end": 4819, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "8.84%", "qwen": "4.97%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.6092252731323242]], "qwen": [[11, ",", "normal", 0.7591410279273987]]}, "loss": {"rwkv": 8.840733771072504, "qwen": 4.969501577837577}, "topk": {"rwkv": [45, 1, 0.6092252731323242, [[45, 0.609225, ",", false], [4706, 0.171511, " of", false], [4858, 0.034033, " we", false], [32227, 0.02243, " that", false], [38642, 0.02184, " grows", false], [46531, 0.019879, " mature", false], [39072, 0.009967, " moves", false], [55981, 0.008931, " develops", false], [62394, 0.007743, " progresses", false], [4596, 0.005394, " in", false]]], "qwen": [11, 1, 0.7591410279273987, [[11, 0.759141, ",", false], [315, 0.071774, " of", false], [88626, 0.035103, " matures", false], [429, 0.014541, " that", false], [582, 0.013315, " we", false], [27715, 0.009727, " grows", false], [702, 0.005493, " has", false], [91954, 0.005326, " evolves", false], [432, 0.004382, " it", false], [9044, 0.003944, " becomes", false]]]}, "raw_delta": 0.2146666944026947, "tuned_delta": 0.22323848643327296}, {"byte_start": 4819, "byte_end": 4822, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 806, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"rwkv": "9.44% 9.44% 9.44%", "qwen": "11.50% 11.50% 11.50%"}, "model_tokens": {"rwkv": [[4858, " we", "normal", 0.20773224532604218]], "qwen": [[582, " we", "normal", 0.14750812947750092]]}, "loss": {"rwkv": 9.439508568316459, "qwen": 11.504723535106052}, "topk": {"rwkv": [4858, 2, 0.20773224532604218, [[3609, 0.41938, " AI", false], [4858, 0.207732, " we", false], [55809, 0.154025, " computer", false], [4601, 0.037014, " it", false], [61594, 0.028619, " artificial", false], [52167, 0.022356, " machine", false], [22590, 0.017376, " the", false], [22248, 0.007635, " our", false], [21265, 0.006665, " and", false], [39934, 0.004918, " there", false]]], "qwen": [582, 2, 0.14750812947750092, [[15235, 0.45968, " AI", false], [582, 0.147508, " we", false], [6366, 0.123506, " computer", false], [279, 0.039406, " the", false], [5662, 0.032863, " machine", false], [432, 0.026634, " it", false], [20443, 0.018288, " artificial", false], [11129, 0.007375, " vision", false], [5538, 0.006872, " deep", false], [323, 0.006621, " and", false]]]}, "raw_delta": -0.11451983451843262, "tuned_delta": -0.10594804248785437}, {"byte_start": 4822, "byte_end": 4828, "display": {"text": " still", "kind": "normal"}, "is_word": true, "word_id": 807, "word_key": " still", "bytes_hex": "20 73 74 69 6c 6c", "compression": {"rwkv": "16.91% 16.91% 16.91% 16.91% 16.91% 16.91%", "qwen": "16.40% 16.40% 16.40% 16.40% 16.40% 16.40%"}, "model_tokens": {"rwkv": [[39820, " still", "normal", 0.0035765713546425104]], "qwen": [[2058, " still", "normal", 0.00426615821197629]]}, "loss": {"rwkv": 16.90658251041754, "qwen": 16.40176470171745}, "topk": {"rwkv": [39820, 29, 0.0035765713546425104, [[31059, 0.240231, " have", false], [31506, 0.153746, " need", false], [47266, 0.14672, " should", false], [21286, 0.097353, " are", false], [31475, 0.035653, " must", false], [21413, 0.029261, " can", false], [32216, 0.019803, " tend", false], [4491, 0.012959, " do", false], [5231, 0.01285, "'ve", false], [22190, 0.010097, " now", false]]], "qwen": [2058, 25, 0.00426615821197629, [[614, 0.341647, " have", false], [1184, 0.100251, " need", false], [525, 0.09699, " are", false], [1265, 0.090401, " should", false], [1969, 0.046019, " must", false], [646, 0.017051, " can", false], [3003, 0.014424, "'ve", false], [1033, 0.014299, " were", false], [8376, 0.013918, " tend", false], [1431, 0.012259, " now", false]]]}, "raw_delta": 0.027993043263753292, "tuned_delta": 0.03656483529433154}, {"byte_start": 4828, "byte_end": 4833, "display": {"text": " have", "kind": "normal"}, "is_word": true, "word_id": 808, "word_key": " have", "bytes_hex": "20 68 61 76 65", "compression": {"rwkv": "4.85% 4.85% 4.85% 4.85% 4.85%", "qwen": "3.75% 3.75% 3.75% 3.75% 3.75%"}, "model_tokens": {"rwkv": [[31059, " have", "normal", 0.2598569095134735]], "qwen": [[614, " have", "normal", 0.35401177406311035]]}, "loss": {"rwkv": 4.846553652986361, "qwen": 3.745326811723812}, "topk": {"rwkv": [31059, 1, 0.2598569095134735, [[31059, 0.259857, " have", false], [32216, 0.091551, " tend", false], [31506, 0.051154, " need", false], [4491, 0.040088, " do", false], [39942, 0.037661, " think", false], [31967, 0.021362, " seem", false], [57328, 0.017307, " struggle", false], [39761, 0.016216, " spend", false], [39171, 0.015666, " often", false], [21556, 0.013541, " don", false]]], "qwen": [614, 1, 0.35401177406311035, [[614, 0.354012, " have", false], [1184, 0.089251, " need", false], [653, 0.062919, " do", false], [8376, 0.039788, " tend", false], [1744, 0.02565, " think", false], [4411, 0.025608, " believe", false], [2803, 0.02214, " seem", false], [1513, 0.015161, " don", false], [8990, 0.014136, " haven", false], [1430, 0.012707, " try", false]]]}, "raw_delta": 0.06106498241424561, "tuned_delta": 0.06963677444482386}, {"byte_start": 4833, "byte_end": 4837, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 809, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "8.95% 8.95% 8.95% 8.95%", "qwen": "11.42% 11.42% 11.42% 11.42%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.13639238476753235]], "qwen": [[537, " not", "normal", 0.07942873239517212]]}, "loss": {"rwkv": 8.946399911762613, "qwen": 11.419359946350298}, "topk": {"rwkv": [22187, 2, 0.13639238476753235, [[332, 0.311102, " a", false], [22187, 0.136392, " not", false], [4811, 0.079346, " to", false], [31466, 0.069057, " much", false], [31370, 0.05811, " many", false], [32074, 0.036899, " some", false], [22590, 0.031385, " the", false], [4419, 0.018718, " an", false], [31335, 0.014693, " lots", false], [22614, 0.013194, " too", false]]], "qwen": [537, 3, 0.07942873239517212, [[264, 0.426092, " a", false], [1753, 0.093368, " much", false], [537, 0.079429, " not", false], [311, 0.049156, " to", false], [1657, 0.03934, " many", false], [1045, 0.03253, " some", false], [458, 0.023293, " an", false], [279, 0.021844, " the", false], [2238, 0.01847, " too", false], [975, 0.009718, " work", false]]]}, "raw_delta": -0.1371300220489502, "tuned_delta": -0.12855823001837194}, {"byte_start": 4837, "byte_end": 4848, "display": {"text": " thoroughly", "kind": "normal"}, "is_word": true, "word_id": 810, "word_key": " thoroughly", "bytes_hex": "20 74 68 6f 72 6f 75 67 68 6c 79", "compression": {"rwkv": "11.73% 11.73% 11.73% 11.73% 11.73% 11.73% 11.73% 11.73% 11.73% 11.73% 11.73%", "qwen": "11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96% 11.96%"}, "model_tokens": {"rwkv": [[62646, " thoroughly", "normal", 0.0007897895411588252]], "qwen": [[26364, " thoroughly", "normal", 0.0006773083587177098]]}, "loss": {"rwkv": 11.732143620865504, "qwen": 11.963522043682426}, "topk": {"rwkv": [62646, 94, 0.0007897895411588252, [[52112, 0.217577, " learned", false], [38566, 0.205699, " fully", false], [22797, 0.046931, " yet", false], [39423, 0.026941, " quite", false], [46112, 0.023693, " gotten", false], [56098, 0.023239, " embraced", false], [30482, 0.023224, " come", false], [56480, 0.021566, " internal", false], [61717, 0.019571, " completely", false], [31351, 0.019036, " made", false]]], "qwen": [26364, 96, 0.0006773083587177098, [[9498, 0.296307, " learned", false], [7225, 0.056839, " fully", false], [3602, 0.054157, " yet", false], [17019, 0.035025, " gotten", false], [2167, 0.029621, " really", false], [24692, 0.027863, " figured", false], [2525, 0.026812, " come", false], [5008, 0.024497, " quite", false], [70225, 0.022509, " mastered", false], [42503, 0.020379, " embraced", false]]]}, "raw_delta": -0.012830344113436642, "tuned_delta": -0.004258552082858394}, {"byte_start": 4848, "byte_end": 4856, "display": {"text": " learned", "kind": "normal"}, "is_word": true, "word_id": 811, "word_key": " learned", "bytes_hex": "20 6c 65 61 72 6e 65 64", "compression": {"rwkv": "4.47% 4.47% 4.47% 4.47% 4.47% 4.47% 4.47% 4.47%", "qwen": "3.39% 3.39% 3.39% 3.39% 3.39% 3.39% 3.39% 3.39%"}, "model_tokens": {"rwkv": [[52112, " learned", "normal", 0.13818806409835815]], "qwen": [[9498, " learned", "normal", 0.22197359800338745]]}, "loss": {"rwkv": 4.473199955881307, "qwen": 3.393031207836185}, "topk": {"rwkv": [52112, 2, 0.13818806409835815, [[56480, 0.196796, " internal", false], [52112, 0.138188, " learned", false], [56098, 0.117499, " embraced", false], [62684, 0.083172, " understood", false], [55423, 0.064751, " absorbed", false], [38625, 0.036738, " grasp", false], [45746, 0.028517, " digest", false], [37761, 0.024372, " assim", false], [62141, 0.023075, " integrated", false], [63289, 0.020703, " appreciated", false]]], "qwen": [9498, 1, 0.22197359800338745, [[9498, 0.221974, " learned", false], [42503, 0.174885, " embraced", false], [5306, 0.10591, " internal", false], [15985, 0.089439, " understood", false], [70225, 0.066635, " mastered", false], [41001, 0.047362, " absorbed", false], [48987, 0.040584, " gras", false], [35031, 0.013365, " explored", false], [24692, 0.012867, " figured", false], [11666, 0.010591, " accepted", false]]]}, "raw_delta": 0.059897273778915405, "tuned_delta": 0.06846906580949365}, {"byte_start": 4856, "byte_end": 4859, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 812, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "2.24% 2.24% 2.24%", "qwen": "5.48% 5.48% 5.48%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.6888904571533203]], "qwen": [[432, " it", "normal", 0.4015727937221527]]}, "loss": {"rwkv": 2.242470319090104, "qwen": 5.484444327661428}, "topk": {"rwkv": [4601, 1, 0.6888904571533203, [[4601, 0.68889, " it", false], [32234, 0.105858, " this", false], [22590, 0.045903, " the", false], [32227, 0.035526, " that", false], [30917, 0.025735, " from", false], [4811, 0.025269, " to", false], [21835, 0.023128, " how", false], [32464, 0.009804, " what", false], [21265, 0.006502, " and", false], [22248, 0.003925, " our", false]]], "qwen": [432, 1, 0.4015727937221527, [[432, 0.401573, " it", false], [1246, 0.116987, " how", false], [279, 0.11032, " the", false], [419, 0.089393, " this", false], [504, 0.053228, " from", false], [429, 0.047667, " that", false], [311, 0.042615, " to", false], [1128, 0.022051, " what", false], [911, 0.019256, " about", false], [1039, 0.015275, " our", false]]]}, "raw_delta": -0.179773211479187, "tuned_delta": -0.17120141944860875}, {"byte_start": 4859, "byte_end": 4860, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "25.64%", "qwen": "22.17%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.24268387258052826]], "qwen": [[11, ",", "normal", 0.2925507724285126]]}, "loss": {"rwkv": 25.641650140799932, "qwen": 22.16551530372949}, "topk": {"rwkv": [45, 2, 0.24268387258052826, [[47, 0.653606, ".", false], [45, 0.242684, ",", false], [5346, 0.018404, "---", false], [21265, 0.017578, " and", false], [22797, 0.01482, " yet", false], [60, 0.007195, ";", false], [59, 0.006336, ":", false], [4715, 0.005869, " or", false], [275, 0.005326, " (", false], [4596, 0.004724, " in", false]]], "qwen": [11, 2, 0.2925507724285126, [[13, 0.547799, ".", false], [11, 0.292551, ",", false], [382, 0.042821, ".\n\n", false], [323, 0.01752, " and", false], [3602, 0.014398, " yet", false], [624, 0.0134, ".\n", false], [4421, 0.011376, "---", false], [25, 0.011239, ":", false], [26, 0.00771, ";", false], [320, 0.005204, " (", false]]]}, "raw_delta": 0.19275784492492676, "tuned_delta": 0.20132963695550501}, {"byte_start": 4860, "byte_end": 4863, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 813, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"rwkv": "24.80% 24.80% 24.80%", "qwen": "26.90% 26.90% 26.90%"}, "model_tokens": {"rwkv": [[4423, " as", "normal", 0.016042407602071762]], "qwen": [[438, " as", "normal", 0.011395213194191456]]}, "loss": {"rwkv": 24.796321015279055, "qwen": 26.89761650903091}, "topk": {"rwkv": [4423, 7, 0.016042407602071762, [[21265, 0.345716, " and", false], [21400, 0.33421, " but", false], [55495, 0.042687, " although", false], [4715, 0.038293, " or", false], [30788, 0.025219, " even", false], [51018, 0.023825, " because", false], [4423, 0.016042, " as", false], [22185, 0.014719, " nor", false], [4788, 0.014672, " so", false], [47544, 0.013463, " though", false]]], "qwen": [438, 11, 0.011395213194191456, [[323, 0.414459, " and", false], [714, 0.295449, " but", false], [7892, 0.052773, " although", false], [476, 0.032967, " or", false], [6329, 0.023723, " nor", false], [1496, 0.020777, " even", false], [3498, 0.014762, " though", false], [8818, 0.01382, " despite", false], [1576, 0.012854, " because", false], [773, 0.012796, " so", false]]]}, "raw_delta": -0.1165205637613933, "tuned_delta": -0.10794877173081506}, {"byte_start": 4863, "byte_end": 4866, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 814, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"rwkv": "11.74% 11.74% 11.74%", "qwen": "8.57% 8.57% 8.57%"}, "model_tokens": {"rwkv": [[4858, " we", "normal", 0.14369505643844604]], "qwen": [[582, " we", "normal", 0.24048909544944763]]}, "loss": {"rwkv": 11.740682298901067, "qwen": 8.566485936440397}, "topk": {"rwkv": [4858, 2, 0.14369505643844604, [[4601, 0.162894, " it", false], [4858, 0.143695, " we", false], [59655, 0.108984, " evidenced", false], [39934, 0.053337, " there", false], [332, 0.045773, " a", false], [22590, 0.035668, " the", false], [31370, 0.030317, " many", false], [4600, 0.026523, " is", false], [308, 0.020256, " I", false], [31466, 0.017239, " much", false]]], "qwen": [582, 1, 0.24048909544944763, [[582, 0.240489, " we", false], [68357, 0.109104, " evidenced", false], [1052, 0.062233, " there", false], [279, 0.055876, " the", false], [432, 0.052813, " it", false], [264, 0.03345, " a", false], [1657, 0.022085, " many", false], [3602, 0.020279, " yet", false], [374, 0.018945, " is", false], [1039, 0.01833, " our", false]]]}, "raw_delta": 0.1760148207346598, "tuned_delta": 0.18458661276523805}, {"byte_start": 4866, "byte_end": 4870, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 815, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"rwkv": "10.99% 10.99% 10.99% 10.99%", "qwen": "12.75% 12.75% 12.75% 12.75%"}, "model_tokens": {"rwkv": [[21286, " are", "normal", 0.08767735213041306]], "qwen": [[525, " are", "normal", 0.05910564213991165]]}, "loss": {"rwkv": 10.9892786317714, "qwen": 12.751750388464055}, "topk": {"rwkv": [21286, 3, 0.08767735213041306, [[31059, 0.244129, " have", false], [39820, 0.097822, " still", false], [21286, 0.087677, " are", false], [47266, 0.058725, " should", false], [55851, 0.035146, " continue", false], [22449, 0.023081, " see", false], [21413, 0.022533, " can", false], [21532, 0.018698, " did", false], [32475, 0.018211, " will", false], [31967, 0.017509, " seem", false]]], "qwen": [525, 3, 0.05910564213991165, [[614, 0.339705, " have", false], [2058, 0.161847, " still", false], [525, 0.059106, " are", false], [3060, 0.03749, " continue", false], [1521, 0.033827, " did", false], [1265, 0.032813, " should", false], [686, 0.015527, " will", false], [653, 0.014244, " do", false], [1033, 0.010461, " were", false], [1030, 0.009776, " had", false]]]}, "raw_delta": -0.09773218631744385, "tuned_delta": -0.0891603942868656}, {"byte_start": 4870, "byte_end": 4881, "display": {"text": " continuing", "kind": "normal"}, "is_word": true, "word_id": 816, "word_key": " continuing", "bytes_hex": "20 63 6f 6e 74 69 6e 75 69 6e 67", "compression": {"rwkv": "9.43% 9.43% 9.43% 9.43% 9.43% 9.43% 9.43% 9.43% 9.43% 9.43% 9.43%", "qwen": "8.10% 8.10% 8.10% 8.10% 8.10% 8.10% 8.10% 8.10% 8.10% 8.10% 8.10%"}, "model_tokens": {"rwkv": [[61774, " continuing", "normal", 0.0032059645745903254]], "qwen": [[14354, " continuing", "normal", 0.007154079619795084]]}, "loss": {"rwkv": 9.42670055126311, "qwen": 8.098884261357814}, "topk": {"rwkv": [61774, 22, 0.0032059645745903254, [[39820, 0.631963, " still", false], [21256, 0.022194, " all", false], [22187, 0.021499, " not", false], [4596, 0.015967, " in", false], [4788, 0.014402, " so", false], [22190, 0.012031, " now", false], [22614, 0.01169, " too", false], [39364, 0.011389, " prone", false], [61760, 0.007598, " constantly", false], [39171, 0.00746, " often", false]]], "qwen": [14354, 20, 0.007154079619795084, [[2058, 0.387489, " still", false], [537, 0.032653, " not", false], [304, 0.030534, " in", false], [1431, 0.029945, " now", false], [1172, 0.025649, " only", false], [3545, 0.024299, " often", false], [1101, 0.019831, " just", false], [2238, 0.019285, " too", false], [6301, 0.01608, " slow", false], [3602, 0.013849, " yet", false]]]}, "raw_delta": 0.07362976941195398, "tuned_delta": 0.08220156144253223}, {"byte_start": 4881, "byte_end": 4884, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 817, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.42% 0.42% 0.42%", "qwen": "0.67% 0.67% 0.67%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.932659924030304]], "qwen": [[311, " to", "normal", 0.8951485753059387]]}, "loss": {"rwkv": 0.41972939218571315, "qwen": 0.6658374165262169}, "topk": {"rwkv": [4811, 1, 0.932659924030304, [[4811, 0.93266, " to", false], [22590, 0.011447, " the", false], [45, 0.00952, ",", false], [22248, 0.006447, " our", false], [4596, 0.00543, " in", false], [32487, 0.004372, " with", false], [332, 0.003248, " a", false], [4712, 0.002375, " on", false], [51566, 0.001911, " efforts", false], [57103, 0.001478, " research", false]]], "qwen": [311, 1, 0.8951485753059387, [[311, 0.895149, " to", false], [448, 0.020321, " with", false], [1039, 0.013346, " our", false], [1495, 0.010645, " down", false], [304, 0.009115, " in", false], [389, 0.006475, " on", false], [279, 0.005177, " the", false], [11, 0.003922, ",", false], [3412, 0.003907, " research", false], [264, 0.002929, " a", false]]]}, "raw_delta": -0.013647126654783884, "tuned_delta": -0.005075334624205636}, {"byte_start": 4884, "byte_end": 4889, "display": {"text": " make", "kind": "normal"}, "is_word": true, "word_id": 818, "word_key": " make", "bytes_hex": "20 6d 61 6b 65", "compression": {"rwkv": "12.57% 12.57% 12.57% 12.57% 12.57%", "qwen": "9.57% 9.57% 9.57% 9.57% 9.57%"}, "model_tokens": {"rwkv": [[31358, " make", "normal", 0.030505675822496414]], "qwen": [[1281, " make", "normal", 0.07037892192602158]]}, "loss": {"rwkv": 12.567226332743704, "qwen": 9.5717812850083}, "topk": {"rwkv": [31358, 5, 0.030505675822496414, [[46330, 0.081087, " invest", false], [22626, 0.051773, " try", false], [46960, 0.033906, " pursue", false], [22339, 0.033775, " put", false], [31358, 0.030506, " make", false], [31856, 0.027364, " rely", false], [39761, 0.024688, " spend", false], [4435, 0.023275, " be", false], [38530, 0.021599, " focus", false], [40166, 0.02144, " waste", false]]], "qwen": [1281, 3, 0.07037892192602158, [[22729, 0.090621, " pursue", false], [1430, 0.080991, " try", false], [1281, 0.070379, " make", false], [2725, 0.056145, " invest", false], [8329, 0.031418, " spend", false], [387, 0.031217, " be", false], [12291, 0.02088, " waste", false], [2225, 0.020268, " develop", false], [990, 0.020147, " use", false], [653, 0.019984, " do", false]]]}, "raw_delta": 0.1661027431488037, "tuned_delta": 0.17467453517938195}, {"byte_start": 4889, "byte_end": 4893, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 819, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "11.98% 11.98% 11.98% 11.98%", "qwen": "11.47% 11.47% 11.47% 11.47%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.0704706534743309]], "qwen": [[279, " the", "normal", 0.07849346101284027]]}, "loss": {"rwkv": 11.97549594487909, "qwen": 11.472761634334766}, "topk": {"rwkv": [22590, 2, 0.0704706534743309, [[51566, 0.085147, " efforts", false], [22590, 0.070471, " the", false], [56950, 0.069084, " progress", false], [52224, 0.054982, " methods", false], [22681, 0.033814, " use", false], [56652, 0.033148, " mistakes", false], [57103, 0.028527, " research", false], [332, 0.021892, " a", false], [38961, 0.020088, " major", false], [22248, 0.019366, " our", false]]], "qwen": [279, 3, 0.07849346101284027, [[5098, 0.106727, " progress", false], [20643, 0.085339, " mistakes", false], [279, 0.078493, " the", false], [2244, 0.032022, " great", false], [8869, 0.02644, " efforts", false], [5413, 0.024356, " methods", false], [264, 0.020544, " a", false], [5089, 0.018895, " significant", false], [1657, 0.018697, " many", false], [2989, 0.015426, " important", false]]]}, "raw_delta": 0.027877509593963623, "tuned_delta": 0.03644930162454187}, {"byte_start": 4893, "byte_end": 4898, "display": {"text": " same", "kind": "normal"}, "is_word": true, "word_id": 820, "word_key": " same", "bytes_hex": "20 73 61 6d 65", "compression": {"rwkv": "3.92% 3.92% 3.92% 3.92% 3.92%", "qwen": "3.22% 3.22% 3.22% 3.22% 3.22%"}, "model_tokens": {"rwkv": [[31937, " same", "normal", 0.3347090482711792]], "qwen": [[1852, " same", "normal", 0.40971702337265015]]}, "loss": {"rwkv": 3.9166916149133963, "qwen": 3.218250506732995}, "topk": {"rwkv": [31937, 1, 0.3347090482711792, [[31937, 0.334709, " same", false], [52245, 0.240849, " mistake", false], [56652, 0.058142, " mistakes", false], [38720, 0.027209, " human", false], [62660, 0.017263, " transition", false], [45829, 0.016415, " effort", false], [38392, 0.0125, " error", false], [22221, 0.011733, " old", false], [45315, 0.009555, " bitter", false], [38841, 0.007034, " kinds", false]]], "qwen": [1852, 1, 0.40971702337265015, [[1852, 0.409717, " same", false], [16523, 0.186574, " mistake", false], [20643, 0.049671, " mistakes", false], [3738, 0.044813, " human", false], [4969, 0.020748, " wrong", false], [1465, 0.012287, " error", false], [2310, 0.011683, " old", false], [1429, 0.011365, " most", false], [9142, 0.009277, " transition", false], [1850, 0.008689, " best", false]]]}, "raw_delta": 0.038729798793792736, "tuned_delta": 0.047301590824370986}, {"byte_start": 4898, "byte_end": 4903, "display": {"text": " kind", "kind": "normal"}, "is_word": true, "word_id": 821, "word_key": " kind", "bytes_hex": "20 6b 69 6e 64", "compression": {"rwkv": "18.15% 18.15% 18.15% 18.15% 18.15%", "qwen": "18.33% 18.33% 18.33% 18.33% 18.33%"}, "model_tokens": {"rwkv": [[31214, " kind", "normal", 0.006520731840282679]], "qwen": [[3093, " kind", "normal", 0.006207973230630159]]}, "loss": {"rwkv": 18.146398561181492, "qwen": 18.329154205294348}, "topk": {"rwkv": [31214, 7, 0.006520731840282679, [[56652, 0.735291, " mistakes", false], [52245, 0.111483, " mistake", false], [38841, 0.024679, " kinds", false], [45888, 0.015524, " errors", false], [22221, 0.006977, " old", false], [39745, 0.00681, " sorts", false], [31214, 0.006521, " kind", false], [38392, 0.005356, " error", false], [37812, 0.004696, " basic", false], [21325, 0.004467, " bad", false]]], "qwen": [3093, 10, 0.006207973230630159, [[20643, 0.750139, " mistakes", false], [5975, 0.035275, " errors", false], [12829, 0.023533, " kinds", false], [16523, 0.016307, " mistake", false], [2310, 0.010712, " old", false], [20853, 0.010077, " sorts", false], [4124, 0.008521, " early", false], [3738, 0.008324, " human", false], [2856, 0.008138, " initial", false], [3093, 0.006208, " kind", false]]]}, "raw_delta": -0.010134124755859286, "tuned_delta": -0.001562332725281038}, {"byte_start": 4903, "byte_end": 4906, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 822, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.03% 0.03% 0.03%", "qwen": "0.01% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9945980310440063]], "qwen": [[315, " of", "normal", 0.9986101388931274]]}, "loss": {"rwkv": 0.0326537726438186, "qwen": 0.008360422639164542}, "topk": {"rwkv": [4706, 1, 0.9945980310440063, [[4706, 0.994598, " of", false], [56652, 0.00315, " mistakes", false], [45888, 0.000598, " errors", false], [45, 0.00014, ",", false], [46, 0.000104, "-", false], [275, 9.5e-05, " (", false], [51566, 8.9e-05, " efforts", false], [21265, 7.7e-05, " and", false], [52245, 6.1e-05, " mistake", false], [4715, 5.9e-05, " or", false]]], "qwen": [315, 1, 0.9986101388931274, [[315, 0.99861, " of", false], [323, 0.000309, " and", false], [20643, 0.000172, " mistakes", false], [476, 0.000135, " or", false], [320, 0.000128, " (", false], [11, 0.000117, ",", false], [5975, 7.1e-05, " errors", false], [8869, 3.4e-05, " efforts", false], [220, 2.5e-05, " ", false], [198, 2.4e-05, "\n", false]]]}, "raw_delta": 0.0013471093649665515, "tuned_delta": 0.009918901395544799}, {"byte_start": 4906, "byte_end": 4915, "display": {"text": " mistakes", "kind": "normal"}, "is_word": true, "word_id": 823, "word_key": " mistakes", "bytes_hex": "20 6d 69 73 74 61 6b 65 73", "compression": {"rwkv": "1.01% 1.01% 1.01% 1.01% 1.01% 1.01% 1.01% 1.01% 1.01%", "qwen": "1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49%"}, "model_tokens": {"rwkv": [[56652, " mistakes", "normal", 0.6053490042686462]], "qwen": [[20643, " mistakes", "normal", 0.4746242165565491]]}, "loss": {"rwkv": 1.009698677705492, "qwen": 1.4932533397067185}, "topk": {"rwkv": [56652, 1, 0.6053490042686462, [[56652, 0.605349, " mistakes", false], [52245, 0.041975, " mistake", false], [51566, 0.025594, " efforts", false], [45888, 0.024898, " errors", false], [57103, 0.021704, " research", false], [45829, 0.018067, " effort", false], [63678, 0.015487, " investments", false], [52224, 0.015085, " methods", false], [38392, 0.011439, " error", false], [38720, 0.011376, " human", false]]], "qwen": [20643, 1, 0.4746242165565491, [[20643, 0.474624, " mistakes", false], [16523, 0.065973, " mistake", false], [5975, 0.056037, " errors", false], [3738, 0.039857, " human", false], [4124, 0.029794, " early", false], [1465, 0.026912, " error", false], [9162, 0.021732, " investment", false], [21786, 0.017071, " investments", false], [5098, 0.014993, " progress", false], [2856, 0.01144, " initial", false]]]}, "raw_delta": -0.026813964049021397, "tuned_delta": -0.01824217201844315}, {"byte_start": 4915, "byte_end": 4916, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "29.45%", "qwen": "28.04%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.19574415683746338]], "qwen": [[13, ".", "normal", 0.21126553416252136]]}, "loss": {"rwkv": 29.445631205643878, "qwen": 28.03588296717203}, "topk": {"rwkv": [47, 1, 0.19574415683746338, [[47, 0.195744, ".", false], [4596, 0.162787, " in", false], [31601, 0.138742, " over", false], [32227, 0.107937, " that", false], [45, 0.106589, ",", false], [4423, 0.057475, " as", false], [4858, 0.039757, " we", false], [37635, 0.023249, " again", false], [32487, 0.022469, " with", false], [4712, 0.011689, " on", false]]], "qwen": [13, 1, 0.21126553416252136, [[13, 0.211266, ".", false], [916, 0.195751, " over", false], [11, 0.095069, ",", false], [429, 0.074492, " that", false], [304, 0.072692, " in", false], [438, 0.048917, " as", false], [4421, 0.042336, "---", false], [582, 0.035252, " we", false], [1549, 0.028672, " again", false], [323, 0.021516, " and", false]]]}, "raw_delta": 0.07817304134368896, "tuned_delta": 0.08674483337426721}, {"byte_start": 4916, "byte_end": 4919, "display": {"text": " To", "kind": "normal"}, "is_word": true, "word_id": 824, "word_key": " to", "bytes_hex": "20 54 6f", "compression": {"rwkv": "31.18% 31.18% 31.18%", "qwen": "28.46% 28.46% 28.46%"}, "model_tokens": {"rwkv": [[4255, " To", "normal", 0.005641411058604717]], "qwen": [[2014, " To", "normal", 0.008780253119766712]]}, "loss": {"rwkv": 31.183252185881237, "qwen": 28.464673695275074}, "topk": {"rwkv": [4255, 27, 0.005641411058604717, [[4331, 0.134701, " We", false], [20996, 0.081061, " The", false], [261, 0.066953, "\n\n", false], [3913, 0.061582, " In", false], [19555, 0.053585, " But", false], [3918, 0.046274, " It", false], [37451, 0.045053, " There", false], [19907, 0.026815, " For", false], [29894, 0.023136, " This", false], [308, 0.020625, " I", false]]], "qwen": [2014, 18, 0.008780253119766712, [[1205, 0.111953, " We", false], [1988, 0.093285, " But", false], [576, 0.089017, " The", false], [1084, 0.063892, " It", false], [758, 0.048323, " In", false], [2619, 0.039947, " There", false], [1096, 0.032974, " This", false], [1597, 0.031907, " And", false], [358, 0.026578, " I", false], [1752, 0.022181, " For", false]]]}, "raw_delta": 0.1507500012715659, "tuned_delta": 0.15932179330214416}, {"byte_start": 4919, "byte_end": 4923, "display": {"text": " see", "kind": "normal"}, "is_word": true, "word_id": 825, "word_key": " see", "bytes_hex": "20 73 65 65", "compression": {"rwkv": "16.77% 16.77% 16.77% 16.77%", "qwen": "19.52% 19.52% 19.52% 19.52%"}, "model_tokens": {"rwkv": [[22449, " see", "normal", 0.024376166984438896]], "qwen": [[1490, " see", "normal", 0.013163922354578972]]}, "loss": {"rwkv": 16.765694322830726, "qwen": 19.522709502715966}, "topk": {"rwkv": [22449, 10, 0.024376166984438896, [[4435, 0.099156, " be", false], [31358, 0.060039, " make", false], [32187, 0.040712, " take", false], [22590, 0.034171, " the", false], [21751, 0.032115, " get", false], [37786, 0.028702, " avoid", false], [62683, 0.027854, " understand", false], [4491, 0.026741, " do", false], [32074, 0.024892, " some", false], [22449, 0.024376, " see", false]]], "qwen": [1490, 17, 0.013163922354578972, [[387, 0.110351, " be", false], [3960, 0.067301, " learn", false], [5648, 0.063263, " avoid", false], [1281, 0.062849, " make", false], [3535, 0.030926, " understand", false], [653, 0.02404, " do", false], [279, 0.02172, " the", false], [633, 0.021199, " get", false], [1896, 0.020937, " take", false], [13153, 0.020529, " repeat", false]]]}, "raw_delta": -0.15288138389587402, "tuned_delta": -0.14430959186529577}, {"byte_start": 4923, "byte_end": 4928, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 826, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "8.17% 8.17% 8.17% 8.17% 8.17%", "qwen": "6.74% 6.74% 6.74% 6.74% 6.74%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.10356917977333069]], "qwen": [[419, " this", "normal", 0.15444213151931763]]}, "loss": {"rwkv": 8.171514880035144, "qwen": 6.737154634354944}, "topk": {"rwkv": [32234, 4, 0.10356917977333069, [[22590, 0.18071, " the", false], [22763, 0.165182, " why", false], [21835, 0.145519, " how", false], [32234, 0.103569, " this", false], [32464, 0.063456, " what", false], [4601, 0.061808, " it", false], [32227, 0.048837, " that", false], [332, 0.033685, " a", false], [4419, 0.01726, " an", false], [40185, 0.012608, " where", false]]], "qwen": [419, 1, 0.15444213151931763, [[419, 0.154442, " this", false], [3170, 0.139609, " why", false], [279, 0.133873, " the", false], [1246, 0.12847, " how", false], [1128, 0.07713, " what", false], [429, 0.055649, " that", false], [264, 0.035625, " a", false], [1045, 0.034062, " some", false], [432, 0.033593, " it", false], [1380, 0.028605, " where", false]]]}, "raw_delta": 0.07953782081604005, "tuned_delta": 0.0881096128466183}, {"byte_start": 4928, "byte_end": 4929, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "13.38%", "qwen": "8.79%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.4706677496433258]], "qwen": [[11, ",", "normal", 0.6143350005149841]]}, "loss": {"rwkv": 13.384377820747218, "qwen": 8.786281376580419}, "topk": {"rwkv": [45, 1, 0.4706677496433258, [[45, 0.470668, ",", false], [46430, 0.121789, " lesson", false], [52427, 0.058859, " pattern", false], [4596, 0.052895, " in", false], [31458, 0.052536, " more", false], [51208, 0.042406, " clearly", false], [4423, 0.019694, " as", false], [4600, 0.010563, " is", false], [52245, 0.009951, " mistake", false], [31461, 0.008372, " most", false]]], "qwen": [11, 1, 0.6143350005149841, [[11, 0.614335, ",", false], [304, 0.049511, " in", false], [9355, 0.0491, " clearly", false], [17755, 0.031125, " lesson", false], [5383, 0.025883, " pattern", false], [803, 0.020151, " more", false], [374, 0.012446, " is", false], [2664, 0.011206, " better", false], [1459, 0.007334, " point", false], [369, 0.007332, " for", false]]]}, "raw_delta": 0.2549726068973541, "tuned_delta": 0.26354439892793236}, {"byte_start": 4929, "byte_end": 4933, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 827, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "23.81% 23.81% 23.81% 23.81%", "qwen": "25.09% 25.09% 25.09% 25.09%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.005093383602797985]], "qwen": [[323, " and", "normal", 0.0038293139077723026]]}, "loss": {"rwkv": 23.810103702171368, "qwen": 25.089682571771426}, "topk": {"rwkv": [21265, 21, 0.005093383602797985, [[4601, 0.200636, " it", false], [4858, 0.164141, " we", false], [55832, 0.134672, " consider", false], [22001, 0.075261, " let", false], [22226, 0.072453, " one", false], [31324, 0.061285, " look", false], [31198, 0.038013, " just", false], [51250, 0.030382, " compare", false], [32187, 0.022115, " take", false], [308, 0.014481, " I", false]]], "qwen": [323, 26, 0.0038293139077723026, [[2908, 0.195418, " consider", false], [1401, 0.155159, " look", false], [432, 0.101601, " it", false], [582, 0.080695, " we", false], [825, 0.057995, " one", false], [1077, 0.041057, " let", false], [5185, 0.036375, " note", false], [1101, 0.03611, " just", false], [1896, 0.025511, " take", false], [9429, 0.025018, " compare", false]]]}, "raw_delta": -0.07095491886138916, "tuned_delta": -0.06238312683081091}, {"byte_start": 4933, "byte_end": 4936, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 828, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "3.36% 3.36% 3.36%", "qwen": "3.45% 3.45% 3.45%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.5713860392570496]], "qwen": [[311, " to", "normal", 0.5629984140396118]]}, "loss": {"rwkv": 3.357835137485705, "qwen": 3.4533216967306837}, "topk": {"rwkv": [4811, 1, 0.5713860392570496, [[4811, 0.571386, " to", false], [22590, 0.063481, " the", false], [21835, 0.021663, " how", false], [38877, 0.020491, " learn", false], [22763, 0.018488, " why", false], [21902, 0.015733, " its", false], [30135, 0.014389, " also", false], [39193, 0.013611, " other", false], [22449, 0.012867, " see", false], [32464, 0.012248, " what", false]]], "qwen": [311, 1, 0.5629984140396118, [[311, 0.562998, " to", false], [279, 0.091902, " the", false], [1246, 0.030864, " how", false], [1083, 0.022423, " also", false], [1008, 0.021903, " other", false], [3170, 0.021149, " why", false], [264, 0.017367, " a", false], [1128, 0.014932, " what", false], [369, 0.01095, " for", false], [1045, 0.010928, " some", false]]]}, "raw_delta": -0.005294899145762144, "tuned_delta": 0.003276892884816104}, {"byte_start": 4936, "byte_end": 4948, "display": {"text": " effectively", "kind": "normal"}, "is_word": true, "word_id": 829, "word_key": " effectively", "bytes_hex": "20 65 66 66 65 63 74 69 76 65 6c 79", "compression": {"rwkv": "13.34% 13.34% 13.34% 13.34% 13.34% 13.34% 13.34% 13.34% 13.34% 13.34% 13.34% 13.34%", "qwen": "13.85% 13.85% 13.85% 13.85% 13.85% 13.85% 13.85% 13.85% 13.85% 13.85% 13.85% 13.85%"}, "model_tokens": {"rwkv": [[63507, " effectively", "normal", 0.00013784487964585423]], "qwen": [[13444, " effectively", "normal", 9.947544458555058e-05]]}, "loss": {"rwkv": 13.337415091551614, "qwen": 13.849271290238262}, "topk": {"rwkv": [63507, 303, 0.00013784487964585423, [[22449, 0.225273, " see", false], [62683, 0.158171, " understand", false], [38877, 0.087, " learn", false], [37786, 0.046839, " avoid", false], [61588, 0.041666, " appreciate", false], [21751, 0.03552, " get", false], [4435, 0.029543, " be", false], [31358, 0.026092, " make", false], [52653, 0.012859, " realize", false], [22626, 0.012111, " try", false]]], "qwen": [13444, 431, 9.947544458555058e-05, [[3535, 0.19748, " understand", false], [1490, 0.11596, " see", false], [3960, 0.075994, " learn", false], [387, 0.03856, " be", false], [5648, 0.03285, " avoid", false], [15401, 0.029415, " appreciate", false], [1281, 0.024992, " make", false], [633, 0.023834, " get", false], [614, 0.021632, " have", false], [15282, 0.016598, " recognize", false]]]}, "raw_delta": -0.02838333447774244, "tuned_delta": -0.01981154244716419}, {"byte_start": 4948, "byte_end": 4955, "display": {"text": " resist", "kind": "normal"}, "is_word": true, "word_id": 830, "word_key": " resist", "bytes_hex": "20 72 65 73 69 73 74", "compression": {"rwkv": "15.14% 15.14% 15.14% 15.14% 15.14% 15.14% 15.14%", "qwen": "19.98% 19.98% 19.98% 19.98% 19.98% 19.98% 19.98%"}, "model_tokens": {"rwkv": [[47087, " resist", "normal", 0.0028409697115421295]], "qwen": [[22106, " resist", "normal", 0.00042875210056081414]]}, "loss": {"rwkv": 15.135416723611891, "qwen": 19.97780200852034}, "topk": {"rwkv": [47087, 42, 0.0028409697115421295, [[38877, 0.119497, " learn", false], [37730, 0.104816, " apply", false], [37786, 0.085516, " avoid", false], [22681, 0.059306, " use", false], [51336, 0.03759, " counter", false], [50855, 0.031638, " address", false], [56540, 0.030998, " leverage", false], [32187, 0.024057, " take", false], [31358, 0.020605, " make", false], [45522, 0.019548, " combat", false]]], "qwen": [22106, 164, 0.00042875210056081414, [[3960, 0.262567, " learn", false], [5648, 0.123221, " avoid", false], [3796, 0.078308, " apply", false], [32064, 0.030248, " leverage", false], [3271, 0.028553, " move", false], [990, 0.022574, " use", false], [1896, 0.020608, " take", false], [1281, 0.020517, " make", false], [4538, 0.017982, " teach", false], [4211, 0.017053, " implement", false]]]}, "raw_delta": -0.26851885659354074, "tuned_delta": -0.2599470645629625}, {"byte_start": 4955, "byte_end": 4958, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 831, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "13.24% 13.24% 13.24%", "qwen": "12.15% 12.15% 12.15%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.10896933078765869]], "qwen": [[432, " it", "normal", 0.1325092613697052]]}, "loss": {"rwkv": 13.243489633160404, "qwen": 12.1493130773511}, "topk": {"rwkv": [4601, 2, 0.10896933078765869, [[22590, 0.456799, " the", false], [4601, 0.108969, " it", false], [32234, 0.092467, " this", false], [46500, 0.056916, " making", false], [39936, 0.042893, " these", false], [39944, 0.017961, " those", false], [60384, 0.017759, " repeating", false], [32227, 0.017459, " that", false], [332, 0.011967, " a", false], [51709, 0.011382, " falling", false]]], "qwen": [432, 2, 0.1325092613697052, [[279, 0.322693, " the", false], [432, 0.132509, " it", false], [1493, 0.083273, " these", false], [419, 0.069625, " this", false], [1105, 0.037731, " them", false], [1741, 0.032003, " such", false], [1181, 0.025679, " its", false], [15679, 0.018607, " falling", false], [3259, 0.018244, " making", false], [1846, 0.017832, " those", false]]]}, "raw_delta": 0.06067403157552087, "tuned_delta": 0.06924582360609911}, {"byte_start": 4958, "byte_end": 4959, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "0.99%", "qwen": "1.24%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.9466332197189331]], "qwen": [[11, ",", "normal", 0.9333043098449707]]}, "loss": {"rwkv": 0.9862173131076897, "qwen": 1.2447570854509522}, "topk": {"rwkv": [45, 1, 0.9466332197189331, [[45, 0.946633, ",", false], [4596, 0.017383, " in", false], [275, 0.004334, " (", false], [4423, 0.003516, " as", false], [32465, 0.003453, " when", false], [37635, 0.001884, " again", false], [4600, 0.001832, " is", false], [5346, 0.001451, "---", false], [21265, 0.001444, " and", false], [38606, 0.001085, " going", false]]], "qwen": [11, 1, 0.9333043098449707, [[11, 0.933304, ",", false], [304, 0.029313, " in", false], [979, 0.003033, " when", false], [320, 0.002939, " (", false], [323, 0.002854, " and", false], [504, 0.002625, " from", false], [2087, 0.002564, " going", false], [369, 0.002483, " for", false], [438, 0.00187, " as", false], [518, 0.001153, " at", false]]]}, "raw_delta": -0.014336489140987396, "tuned_delta": -0.005764697110409148}, {"byte_start": 4959, "byte_end": 4962, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 832, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"rwkv": "5.24% 5.24% 5.24%", "qwen": "6.28% 6.28% 6.28%"}, "model_tokens": {"rwkv": [[4858, " we", "normal", 0.4178939163684845]], "qwen": [[582, " we", "normal", 0.35177427530288696]]}, "loss": {"rwkv": 5.236344305309876, "qwen": 6.280325574681734}, "topk": {"rwkv": [4858, 1, 0.4178939163684845, [[4858, 0.417894, " we", false], [4601, 0.204802, " it", false], [22226, 0.090999, " one", false], [4600, 0.042974, " is", false], [57102, 0.038263, " requires", false], [22590, 0.028853, " the", false], [22799, 0.022359, " you", false], [308, 0.020666, " I", false], [332, 0.015554, " a", false], [22001, 0.011749, " let", false]]], "qwen": [582, 1, 0.35177427530288696, [[582, 0.351774, " we", false], [432, 0.128463, " it", false], [825, 0.091517, " one", false], [7460, 0.063632, " requires", false], [498, 0.041468, " you", false], [279, 0.033669, " the", false], [374, 0.031293, " is", false], [11811, 0.021768, " researchers", false], [264, 0.020178, " a", false], [2908, 0.017095, " consider", false]]]}, "raw_delta": -0.05789061387379968, "tuned_delta": -0.04931882184322143}, {"byte_start": 4962, "byte_end": 4967, "display": {"text": " have", "kind": "normal"}, "is_word": true, "word_id": 833, "word_key": " have", "bytes_hex": "20 68 61 76 65", "compression": {"rwkv": "10.09% 10.09% 10.09% 10.09% 10.09%", "qwen": "11.52% 11.52% 11.52% 11.52% 11.52%"}, "model_tokens": {"rwkv": [[31059, " have", "normal", 0.06028171628713608]], "qwen": [[614, " have", "normal", 0.04098060354590416]]}, "loss": {"rwkv": 10.087594231215798, "qwen": 11.522287263325417}, "topk": {"rwkv": [31059, 4, 0.06028171628713608, [[31506, 0.592673, " need", false], [31475, 0.151163, " must", false], [47266, 0.062411, " should", false], [31059, 0.060282, " have", false], [21413, 0.039595, " can", false], [32475, 0.0155, " will", false], [38499, 0.011462, " first", false], [40219, 0.006171, " would", false], [39021, 0.005365, " might", false], [22074, 0.005097, " may", false]]], "qwen": [614, 3, 0.04098060354590416, [[1184, 0.608809, " need", false], [1969, 0.254305, " must", false], [614, 0.040981, " have", false], [686, 0.027231, " will", false], [1265, 0.024201, " should", false], [646, 0.009551, " can", false], [1035, 0.003053, " would", false], [1156, 0.003053, " first", false], [525, 0.002076, " are", false], [1083, 0.001956, " also", false]]]}, "raw_delta": -0.07955627441406254, "tuned_delta": -0.0709844823834843}, {"byte_start": 4967, "byte_end": 4970, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 834, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.45% 0.45% 0.45%", "qwen": "0.25% 0.25% 0.25%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.928294837474823]], "qwen": [[311, " to", "normal", 0.9586803913116455]]}, "loss": {"rwkv": 0.44614592735824055, "qwen": 0.25365889127563124}, "topk": {"rwkv": [4811, 1, 0.928294837474823, [[4811, 0.928295, " to", false], [31581, 0.01285, " only", false], [332, 0.010268, " a", false], [22638, 0.004383, " two", false], [32074, 0.001995, " some", false], [22590, 0.0017, " the", false], [4419, 0.001557, " an", false], [39946, 0.00145, " three", false], [30259, 0.001226, " been", false], [38499, 0.001074, " first", false]]], "qwen": [311, 1, 0.9586803913116455, [[311, 0.95868, " to", false], [264, 0.005949, " a", false], [1378, 0.005568, " two", false], [1172, 0.002125, " only", false], [3807, 0.00138, " several", false], [2326, 0.001378, " three", false], [279, 0.001253, " the", false], [518, 0.00111, " at", false], [537, 0.001098, " not", false], [1045, 0.001079, " some", false]]]}, "raw_delta": 0.010673747708400091, "tuned_delta": 0.01924553973897834}, {"byte_start": 4970, "byte_end": 4981, "display": {"text": " understand", "kind": "normal"}, "is_word": true, "word_id": 835, "word_key": " understand", "bytes_hex": "20 75 6e 64 65 72 73 74 61 6e 64", "compression": {"rwkv": "3.23% 3.23% 3.23% 3.23% 3.23% 3.23% 3.23% 3.23% 3.23% 3.23% 3.23%", "qwen": "3.93% 3.93% 3.93% 3.93% 3.93% 3.93% 3.93% 3.93% 3.93% 3.93% 3.93%"}, "model_tokens": {"rwkv": [[62683, " understand", "normal", 0.1398772895336151]], "qwen": [[3535, " understand", "normal", 0.09098818153142929]]}, "loss": {"rwkv": 3.2276202974433486, "qwen": 3.9297465052446636}, "topk": {"rwkv": [62683, 1, 0.1398772895336151, [[62683, 0.139877, " understand", false], [4435, 0.068481, " be", false], [31324, 0.067404, " look", false], [38877, 0.032759, " learn", false], [60335, 0.030881, " recognize", false], [21295, 0.02982, " ask", false], [31059, 0.029113, " have", false], [39942, 0.026514, " think", false], [22449, 0.026296, " see", false], [31205, 0.026092, " keep", false]]], "qwen": [3535, 2, 0.09098818153142929, [[387, 0.107454, " be", false], [3535, 0.090988, " understand", false], [1401, 0.068165, " look", false], [15282, 0.044598, " recognize", false], [3960, 0.037387, " learn", false], [1744, 0.029901, " think", false], [614, 0.027115, " have", false], [1490, 0.025923, " see", false], [1281, 0.021878, " make", false], [728, 0.021751, " go", false]]]}, "raw_delta": -0.03893414410677822, "tuned_delta": -0.030362352076199972}, {"byte_start": 4981, "byte_end": 4985, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 836, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "5.39% 5.39% 5.39% 5.39%", "qwen": "6.04% 6.04% 6.04% 6.04%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.30333784222602844]], "qwen": [[279, " the", "normal", 0.26193827390670776]]}, "loss": {"rwkv": 5.3889731751955905, "qwen": 6.039691032566385}, "topk": {"rwkv": [22590, 1, 0.30333784222602844, [[22590, 0.303338, " the", false], [32464, 0.13074, " what", false], [22763, 0.109415, " why", false], [4601, 0.106478, " it", false], [21835, 0.086119, " how", false], [32227, 0.026279, " that", false], [21902, 0.019398, " its", false], [332, 0.01811, " a", false], [21265, 0.016685, " and", false], [51665, 0.014394, " exactly", false]]], "qwen": [279, 1, 0.26193827390670776, [[279, 0.261938, " the", false], [1128, 0.127375, " what", false], [3170, 0.11478, " why", false], [432, 0.090524, " it", false], [1246, 0.058081, " how", false], [429, 0.055388, " that", false], [1181, 0.033889, " its", false], [1378, 0.019473, " two", false], [419, 0.016042, " this", false], [1045, 0.014734, " some", false]]]}, "raw_delta": -0.03608345985412598, "tuned_delta": -0.027511667823547727}, {"byte_start": 4985, "byte_end": 4992, "display": {"text": " appeal", "kind": "normal"}, "is_word": true, "word_id": 837, "word_key": " appeal", "bytes_hex": "20 61 70 70 65 61 6c", "compression": {"rwkv": "20.77% 20.77% 20.77% 20.77% 20.77% 20.77% 20.77%", "qwen": "25.58% 25.58% 25.58% 25.58% 25.58% 25.58% 25.58%"}, "model_tokens": {"rwkv": [[45184, " appeal", "normal", 0.0003196117759216577]], "qwen": [[14303, " appeal", "normal", 4.866080416832119e-05]]}, "loss": {"rwkv": 20.770944227084403, "qwen": 25.583714099514278}, "topk": {"rwkv": [45184, 292, 0.0003196117759216577, [[46642, 0.095806, " nature", false], [46430, 0.050476, " lesson", false], [52127, 0.03419, " lessons", false], [51929, 0.030761, " history", false], [52654, 0.028853, " reasons", false], [51832, 0.024896, " general", false], [37812, 0.024573, " basic", false], [62680, 0.02384, " underlying", false], [62418, 0.023291, " psychology", false], [52427, 0.018902, " pattern", false]]], "qwen": [14303, 1067, 4.866080416832119e-05, [[7966, 0.083915, " reasons", false], [6993, 0.045704, " nature", false], [6672, 0.027063, " difference", false], [3840, 0.025021, " history", false], [25180, 0.023007, " bitter", false], [16533, 0.021936, " underlying", false], [15811, 0.020883, " fundamental", false], [1378, 0.020182, " two", false], [29918, 0.013321, " psychology", false], [3491, 0.011962, " problem", false]]]}, "raw_delta": -0.26687662942068924, "tuned_delta": -0.258304837390111}, {"byte_start": 4992, "byte_end": 4995, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 838, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.87% 0.87% 0.87%", "qwen": "0.62% 0.62% 0.62%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.8628022074699402]], "qwen": [[315, " of", "normal", 0.9012525081634521]]}, "loss": {"rwkv": 0.8746808312681296, "qwen": 0.624986207275609}, "topk": {"rwkv": [4706, 1, 0.8628022074699402, [[4706, 0.862802, " of", false], [4811, 0.039641, " to", false], [21265, 0.036568, " and", false], [32227, 0.016825, " that", false], [45, 0.013967, ",", false], [21700, 0.004149, " for", false], [47, 0.004116, ".", false], [5346, 0.003409, "---", false], [4601, 0.00203, " it", false], [4858, 0.001565, " we", false]]], "qwen": [315, 1, 0.9012525081634521, [[315, 0.901253, " of", false], [323, 0.02613, " and", false], [429, 0.023416, " that", false], [311, 0.021789, " to", false], [11, 0.010386, ",", false], [369, 0.002979, " for", false], [304, 0.00221, " in", false], [320, 0.001709, " (", false], [4421, 0.001039, "---", false], [13, 0.000806, ".", false]]]}, "raw_delta": 0.013846009969711304, "tuned_delta": 0.022417802000289554}, {"byte_start": 4995, "byte_end": 5001, "display": {"text": " these", "kind": "normal"}, "is_word": true, "word_id": 839, "word_key": " these", "bytes_hex": "20 74 68 65 73 65", "compression": {"rwkv": "9.39% 9.39% 9.39% 9.39% 9.39% 9.39%", "qwen": "11.26% 11.26% 11.26% 11.26% 11.26% 11.26%"}, "model_tokens": {"rwkv": [[39936, " these", "normal", 0.04402855783700943]], "qwen": [[1493, " these", "normal", 0.023618167266249657]]}, "loss": {"rwkv": 9.392545839120855, "qwen": 11.258248032210776}, "topk": {"rwkv": [39936, 4, 0.04402855783700943, [[22590, 0.314405, " the", false], [38720, 0.228851, " human", false], [52224, 0.077048, " methods", false], [39936, 0.044029, " these", false], [22248, 0.018348, " our", false], [32234, 0.013944, " this", false], [332, 0.012823, " a", false], [47629, 0.012164, " trying", false], [61590, 0.010988, " approaches", false], [57103, 0.010512, " research", false]]], "qwen": [1493, 5, 0.023618167266249657, [[279, 0.309243, " the", false], [3738, 0.306688, " human", false], [3281, 0.033718, " special", false], [5413, 0.030899, " methods", false], [1493, 0.023618, " these", false], [1039, 0.012996, " our", false], [1045, 0.012859, " some", false], [264, 0.009896, " a", false], [1817, 0.009332, " each", false], [3654, 0.00927, " certain", false]]]}, "raw_delta": -0.10345649719238281, "tuned_delta": -0.09488470516180457}, {"byte_start": 5001, "byte_end": 5010, "display": {"text": " mistakes", "kind": "normal"}, "is_word": true, "word_id": 840, "word_key": " mistakes", "bytes_hex": "20 6d 69 73 74 61 6b 65 73", "compression": {"rwkv": "12.90% 12.90% 12.90% 12.90% 12.90% 12.90% 12.90% 12.90% 12.90%", "qwen": "10.98% 10.98% 10.98% 10.98% 10.98% 10.98% 10.98% 10.98% 10.98%"}, "model_tokens": {"rwkv": [[56652, " mistakes", "normal", 0.0015993948327377439]], "qwen": [[20643, " mistakes", "normal", 0.004172160755842924]]}, "loss": {"rwkv": 12.899096285725975, "qwen": 10.979152675472264}, "topk": {"rwkv": [56652, 46, 0.0015993948327377439, [[38720, 0.193543, " human", false], [39193, 0.121086, " other", false], [52224, 0.072802, " methods", false], [22221, 0.069215, " old", false], [39174, 0.066841, " older", false], [51551, 0.065484, " earlier", false], [63277, 0.037843, " alternative", false], [61590, 0.034219, " approaches", false], [38841, 0.024445, " kinds", false], [52964, 0.019217, " special", false]]], "qwen": [20643, 20, 0.004172160755842924, [[3738, 0.209033, " human", false], [3281, 0.137328, " special", false], [4124, 0.075919, " early", false], [6788, 0.071177, " earlier", false], [5413, 0.063224, " methods", false], [1008, 0.050898, " other", false], [19827, 0.048362, " approaches", false], [2310, 0.043633, " old", false], [9014, 0.036111, " older", false], [10555, 0.017361, " alternative", false]]]}, "raw_delta": 0.10646428002251518, "tuned_delta": 0.11503607205309342}, {"byte_start": 5010, "byte_end": 5011, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "12.89%", "qwen": "18.89%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.4857923090457916]], "qwen": [[13, ".", "normal", 0.3507641553878784]]}, "loss": {"rwkv": 12.891269164193373, "qwen": 18.892835942629745}, "topk": {"rwkv": [47, 1, 0.4857923090457916, [[47, 0.485792, ".", false], [45, 0.262081, ",", false], [21265, 0.14136, " and", false], [4811, 0.021574, " to", false], [5346, 0.019084, "---", false], [4596, 0.017449, " in", false], [21700, 0.006586, " for", false], [59, 0.005962, ":", false], [4423, 0.005793, " as", false], [60, 0.004013, ";", false]]], "qwen": [13, 1, 0.3507641553878784, [[13, 0.350764, ".", false], [11, 0.283279, ",", false], [323, 0.138152, " and", false], [382, 0.08834, ".\n\n", false], [304, 0.02879, " in", false], [4421, 0.028449, "---", false], [438, 0.00939, " as", false], [624, 0.007296, ".\n", false], [25, 0.005875, ":", false], [311, 0.005231, " to", false]]]}, "raw_delta": -0.3327975273132324, "tuned_delta": -0.3242257352826542}, {"byte_start": 5011, "byte_end": 5014, "display": {"text": " We", "kind": "normal"}, "is_word": true, "word_id": 841, "word_key": " we", "bytes_hex": "20 57 65", "compression": {"rwkv": "17.47% 17.47% 17.47%", "qwen": "14.90% 14.90% 14.90%"}, "model_tokens": {"rwkv": [[4331, " We", "normal", 0.054759811609983444]], "qwen": [[1205, " We", "normal", 0.08380118012428284]]}, "loss": {"rwkv": 17.47013526076479, "qwen": 14.903689756734355}, "topk": {"rwkv": [4331, 3, 0.054759811609983444, [[261, 0.395245, "\n\n", false], [20996, 0.077614, " The", false], [4331, 0.05476, " We", false], [3913, 0.027977, " In", false], [29893, 0.024518, " They", false], [3918, 0.024238, " It", false], [37451, 0.022188, " There", false], [21152, 0.021068, " Why", false], [4255, 0.01825, " To", false], [19417, 0.018046, " And", false]]], "qwen": [1205, 2, 0.08380118012428284, [[576, 0.111714, " The", false], [1205, 0.083801, " We", false], [8429, 0.070663, " Why", false], [1084, 0.06605, " It", false], [220, 0.059405, " ", false], [758, 0.046129, " In", false], [2619, 0.037961, " There", false], [3776, 0.036161, " One", false], [2379, 0.033422, " They", false], [1096, 0.033081, " This", false]]]}, "raw_delta": 0.14231395721435547, "tuned_delta": 0.15088574924493373}, {"byte_start": 5014, "byte_end": 5019, "display": {"text": " have", "kind": "normal"}, "is_word": true, "word_id": 842, "word_key": " have", "bytes_hex": "20 68 61 76 65", "compression": {"rwkv": "4.17% 4.17% 4.17% 4.17% 4.17%", "qwen": "3.33% 3.33% 3.33% 3.33% 3.33%"}, "model_tokens": {"rwkv": [[31059, " have", "normal", 0.3120371997356415]], "qwen": [[614, " have", "normal", 0.397343248128891]]}, "loss": {"rwkv": 4.170290352569659, "qwen": 3.328855774177571}, "topk": {"rwkv": [31059, 1, 0.3120371997356415, [[31059, 0.312037, " have", false], [31506, 0.105877, " need", false], [21413, 0.104254, " can", false], [32475, 0.072976, " will", false], [31475, 0.061082, " must", false], [21286, 0.043713, " are", false], [47266, 0.030198, " should", false], [30135, 0.02125, " also", false], [4491, 0.015971, " do", false], [31223, 0.011014, " know", false]]], "qwen": [614, 1, 0.397343248128891, [[614, 0.397343, " have", false], [1184, 0.100606, " need", false], [1969, 0.078978, " must", false], [686, 0.051475, " will", false], [646, 0.046523, " can", false], [1083, 0.042537, " also", false], [1265, 0.024587, " should", false], [525, 0.022719, " are", false], [678, 0.017195, " all", false], [653, 0.017034, " do", false]]]}, "raw_delta": 0.04665904045104982, "tuned_delta": 0.05523083248162807}, {"byte_start": 5019, "byte_end": 5022, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 843, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.97% 0.97% 0.97%", "qwen": "1.06% 1.06% 1.06%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.8508479595184326]], "qwen": [[311, " to", "normal", 0.8381847143173218]]}, "loss": {"rwkv": 0.9686062896593381, "qwen": 1.0610827942170276}, "topk": {"rwkv": [4811, 1, 0.8508479595184326, [[4811, 0.850848, " to", false], [332, 0.01689, " a", false], [31968, 0.012974, " seen", false], [50888, 0.009887, " already", false], [30259, 0.006838, " been", false], [30135, 0.006364, " also", false], [22590, 0.004833, " the", false], [21256, 0.004547, " all", false], [22638, 0.003885, " two", false], [4419, 0.003203, " an", false]]], "qwen": [311, 1, 0.8381847143173218, [[311, 0.838185, " to", false], [264, 0.017542, " a", false], [3884, 0.015281, " seen", false], [1012, 0.010706, " been", false], [1083, 0.007613, " also", false], [537, 0.006748, " not", false], [2669, 0.005927, " already", false], [11, 0.005638, ",", false], [458, 0.004663, " an", false], [678, 0.003852, " all", false]]]}, "raw_delta": -0.005127986272176109, "tuned_delta": 0.003443805758402139}, {"byte_start": 5022, "byte_end": 5028, "display": {"text": " learn", "kind": "normal"}, "is_word": true, "word_id": 844, "word_key": " learn", "bytes_hex": "20 6c 65 61 72 6e", "compression": {"rwkv": "12.77% 12.77% 12.77% 12.77% 12.77% 12.77%", "qwen": "13.20% 13.20% 13.20% 13.20% 13.20% 13.20%"}, "model_tokens": {"rwkv": [[38877, " learn", "normal", 0.014352542348206043]], "qwen": [[3960, " learn", "normal", 0.012385758571326733]]}, "loss": {"rwkv": 12.773862341204364, "qwen": 13.198279693814845}, "topk": {"rwkv": [38877, 6, 0.014352542348206043, [[62683, 0.66888, " understand", false], [22449, 0.067032, " see", false], [21295, 0.023327, " ask", false], [4435, 0.022155, " be", false], [31223, 0.01982, " know", false], [38877, 0.014353, " learn", false], [60335, 0.014054, " recognize", false], [31324, 0.009366, " look", false], [52653, 0.008152, " realize", false], [61588, 0.008049, " appreciate", false]]], "qwen": [3960, 8, 0.012385758571326733, [[3535, 0.416839, " understand", false], [1490, 0.093795, " see", false], [387, 0.080511, " be", false], [15282, 0.071187, " recognize", false], [1414, 0.048619, " know", false], [13083, 0.024323, " realize", false], [15401, 0.014749, " appreciate", false], [3960, 0.012386, " learn", false], [614, 0.011074, " have", false], [22106, 0.009968, " resist", false]]]}, "raw_delta": -0.0235346953074137, "tuned_delta": -0.014962903276835452}, {"byte_start": 5028, "byte_end": 5032, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 845, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "9.72% 9.72% 9.72% 9.72%", "qwen": "9.99% 9.99% 9.99% 9.99%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.11565075069665909]], "qwen": [[279, " the", "normal", 0.10899939388036728]]}, "loss": {"rwkv": 9.721284943490085, "qwen": 9.992525231515227}, "topk": {"rwkv": [22590, 3, 0.11565075069665909, [[4811, 0.235363, " to", false], [22763, 0.144022, " why", false], [22590, 0.115651, " the", false], [21835, 0.103323, " how", false], [32464, 0.080975, " what", false], [30917, 0.060809, " from", false], [37598, 0.044134, " about", false], [32227, 0.039768, " that", false], [22187, 0.019824, " not", false], [45, 0.014333, ",", false]]], "qwen": [279, 2, 0.10899939388036728, [[311, 0.280491, " to", false], [279, 0.108999, " the", false], [3170, 0.097243, " why", false], [504, 0.096747, " from", false], [1246, 0.095497, " how", false], [1128, 0.084064, " what", false], [429, 0.062275, " that", false], [911, 0.026732, " about", false], [537, 0.024654, " not", false], [862, 0.012204, " their", false]]]}, "raw_delta": -0.015040755271911621, "tuned_delta": -0.006468963241333373}, {"byte_start": 5032, "byte_end": 5039, "display": {"text": " bitter", "kind": "normal"}, "is_word": true, "word_id": 846, "word_key": " bitter", "bytes_hex": "20 62 69 74 74 65 72", "compression": {"rwkv": "5.84% 5.84% 5.84% 5.84% 5.84% 5.84% 5.84%", "qwen": "6.93% 6.93% 6.93% 6.93% 6.93% 6.93% 6.93%"}, "model_tokens": {"rwkv": [[45315, " bitter", "normal", 0.10421230643987656]], "qwen": [[25180, " bitter", "normal", 0.06782101839780807]]}, "loss": {"rwkv": 5.836796342882247, "qwen": 6.932363910751027}, "topk": {"rwkv": [45315, 3, 0.10421230643987656, [[46430, 0.132265, " lesson", false], [52127, 0.115146, " lessons", false], [45315, 0.104212, " bitter", false], [52654, 0.052029, " reasons", false], [62418, 0.025685, " psychology", false], [51929, 0.021571, " history", false], [46642, 0.013865, " nature", false], [64997, 0.013822, " psychological", false], [39831, 0.012239, " story", false], [51832, 0.012164, " general", false]]], "qwen": [25180, 2, 0.06782101839780807, [[18366, 0.074521, " lessons", false], [25180, 0.067821, " bitter", false], [29918, 0.056861, " psychology", false], [7966, 0.049741, " reasons", false], [17755, 0.045587, " lesson", false], [3840, 0.026809, " history", false], [23187, 0.019314, " psychological", false], [6672, 0.015804, " difference", false], [5510, 0.014425, " ways", false], [3738, 0.012123, " human", false]]]}, "raw_delta": -0.060751165662493, "tuned_delta": -0.05217937363191475}, {"byte_start": 5039, "byte_end": 5046, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 847, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"rwkv": "1.09% 1.09% 1.09% 1.09% 1.09% 1.09% 1.09%", "qwen": "0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83%"}, "model_tokens": {"rwkv": [[46430, " lesson", "normal", 0.657513439655304]], "qwen": [[17755, " lesson", "normal", 0.7237542867660522]]}, "loss": {"rwkv": 1.086851732812556, "qwen": 0.8329073714504341}, "topk": {"rwkv": [46430, 1, 0.657513439655304, [[46430, 0.657513, " lesson", false], [52127, 0.284651, " lessons", false], [45, 0.010466, ",", false], [7513, 0.006494, "est", false], [40029, 0.004498, " truth", false], [39899, 0.004173, " taste", false], [21265, 0.003299, " and", false], [46, 0.002331, "-", false], [39831, 0.001557, " story", false], [47009, 0.000994, " reason", false]]], "qwen": [17755, 1, 0.7237542867660522, [[17755, 0.723754, " lesson", false], [18366, 0.11963, " lessons", false], [8046, 0.027578, " truth", false], [11, 0.016569, ",", false], [12656, 0.015943, " taste", false], [3139, 0.009252, " experience", false], [3840, 0.007859, " history", false], [323, 0.005836, " and", false], [8729, 0.002913, " reality", false], [512, 0.002361, " le", false]]]}, "raw_delta": 0.01408166544778006, "tuned_delta": 0.022653457478358306}, {"byte_start": 5046, "byte_end": 5051, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 848, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "9.07% 9.07% 9.07% 9.07% 9.07%", "qwen": "7.36% 7.36% 7.36% 7.36% 7.36%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.07928112149238586]], "qwen": [[429, " that", "normal", 0.1298098862171173]]}, "loss": {"rwkv": 9.073199280590746, "qwen": 7.363818998176066}, "topk": {"rwkv": [32227, 5, 0.07928112149238586, [[47, 0.258066, ".", false], [4706, 0.171253, " of", false], [45, 0.126456, ",", false], [21265, 0.081146, " and", false], [32227, 0.079281, " that", false], [59, 0.034091, ":", false], [4596, 0.02317, " in", false], [32458, 0.021089, " well", false], [5346, 0.019392, "---", false], [30917, 0.0171, " from", false]]], "qwen": [429, 2, 0.1298098862171173, [[382, 0.154984, ".\n\n", false], [429, 0.12981, " that", false], [13, 0.129599, ".", false], [315, 0.094392, " of", false], [11, 0.087151, ",", false], [323, 0.042616, " and", false], [1632, 0.037236, " well", false], [624, 0.026237, ".\n", false], [504, 0.025933, " from", false], [304, 0.024922, " in", false]]]}, "raw_delta": 0.09478816986083988, "tuned_delta": 0.10335996189141812}, {"byte_start": 5051, "byte_end": 5060, "display": {"text": " building", "kind": "normal"}, "is_word": true, "word_id": 849, "word_key": " building", "bytes_hex": "20 62 75 69 6c 64 69 6e 67", "compression": {"rwkv": "20.16% 20.16% 20.16% 20.16% 20.16% 20.16% 20.16% 20.16% 20.16%", "qwen": "14.69% 14.69% 14.69% 14.69% 14.69% 14.69% 14.69% 14.69% 14.69%"}, "model_tokens": {"rwkv": [[55666, " building", "normal", 4.278751293895766e-05]], "qwen": [[4752, " building", "normal", 0.0006548331002704799]]}, "loss": {"rwkv": 20.162665067979436, "qwen": 14.68970129885748}, "topk": {"rwkv": [55666, 749, 4.278751293895766e-05, [[22590, 0.094302, " the", false], [4858, 0.088073, " we", false], [63370, 0.064448, " computation", false], [51832, 0.053794, " general", false], [52195, 0.052991, " massive", false], [47202, 0.049379, " search", false], [45, 0.046746, ",", false], [4601, 0.035439, " it", false], [37045, 0.026211, " Moore", false], [39936, 0.020011, " these", false]]], "qwen": [4752, 142, 0.0006548331002704799, [[279, 0.103325, " the", false], [4586, 0.063643, " general", false], [432, 0.060562, " it", false], [582, 0.052497, " we", false], [11, 0.051867, ",", false], [3738, 0.037563, " human", false], [1052, 0.022888, " there", false], [374, 0.02135, " is", false], [1493, 0.018889, " these", false], [304, 0.016522, " in", false]]]}, "raw_delta": 0.3034855524698894, "tuned_delta": 0.3120573445004676}, {"byte_start": 5060, "byte_end": 5063, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 850, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "28.74% 28.74% 28.74%", "qwen": "33.67% 33.67% 33.67%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.008279256522655487]], "qwen": [[304, " in", "normal", 0.0036908648908138275]]}, "loss": {"rwkv": 28.741190267709815, "qwen": 33.674271831998276}, "topk": {"rwkv": [4596, 16, 0.008279256522655487, [[52224, 0.157471, " methods", false], [53087, 0.139396, " systems", false], [332, 0.113857, " a", false], [4712, 0.054041, " on", false], [38720, 0.04874, " human", false], [22248, 0.045829, " our", false], [3609, 0.031711, " AI", false], [51832, 0.031, " general", false], [22590, 0.020907, " the", false], [47202, 0.017241, " search", false]]], "qwen": [304, 37, 0.0036908648908138275, [[5942, 0.208604, " systems", false], [264, 0.125894, " a", false], [5413, 0.058349, " methods", false], [15235, 0.057395, " AI", false], [458, 0.03022, " an", false], [4119, 0.025556, " models", false], [24514, 0.022974, " intelligent", false], [389, 0.022105, " on", false], [4586, 0.02147, " general", false], [2664, 0.017385, " better", false]]]}, "raw_delta": -0.2735481262207031, "tuned_delta": -0.2649763341901249}, {"byte_start": 5063, "byte_end": 5067, "display": {"text": " how", "kind": "normal"}, "is_word": true, "word_id": 851, "word_key": " how", "bytes_hex": "20 68 6f 77", "compression": {"rwkv": "41.14% 41.14% 41.14% 41.14%", "qwen": "38.38% 38.38% 38.38% 38.38%"}, "model_tokens": {"rwkv": [[21835, " how", "normal", 0.00010841196490218863]], "qwen": [[1246, " how", "normal", 0.00020085007417947054]]}, "loss": {"rwkv": 41.13935077534934, "qwen": 38.379979433147284}, "topk": {"rwkv": [21835, 259, 0.00010841196490218863, [[38720, 0.438515, " human", false], [22248, 0.067943, " our", false], [22590, 0.053666, " the", false], [52195, 0.038905, " massive", false], [332, 0.032204, " a", false], [59943, 0.028475, " knowledge", false], [51832, 0.027865, " general", false], [47202, 0.016437, " search", false], [31458, 0.013131, " more", false], [21256, 0.011241, " all", false]]], "qwen": [1246, 180, 0.00020085007417947054, [[3738, 0.52517, " human", false], [279, 0.077771, " the", false], [1039, 0.054292, " our", false], [6540, 0.04219, " knowledge", false], [264, 0.02268, " a", false], [7947, 0.015423, " domain", false], [25312, 0.015209, "human", false], [3281, 0.012182, " special", false], [4867, 0.008671, " prior", false], [323, 0.007345, " and", false]]]}, "raw_delta": 0.15301203727722168, "tuned_delta": 0.16158382930779994}, {"byte_start": 5067, "byte_end": 5070, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 852, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"rwkv": "7.61% 7.61% 7.61%", "qwen": "9.51% 9.51% 9.51%"}, "model_tokens": {"rwkv": [[4858, " we", "normal", 0.28450843691825867]], "qwen": [[582, " we", "normal", 0.2055639922618866]]}, "loss": {"rwkv": 7.607962129687892, "qwen": 9.50975201568386}, "topk": {"rwkv": [4858, 1, 0.28450843691825867, [[4858, 0.284508, " we", false], [46227, 0.172225, " humans", false], [46787, 0.076883, " people", false], [22590, 0.06279, " the", false], [4811, 0.061105, " to", false], [22248, 0.060481, " our", false], [38720, 0.056891, " human", false], [332, 0.045204, " a", false], [22226, 0.030347, " one", false], [22799, 0.024038, " you", false]]], "qwen": [582, 2, 0.2055639922618866, [[279, 0.246858, " the", false], [582, 0.205564, " we", false], [12677, 0.134287, " humans", false], [1039, 0.085343, " our", false], [1251, 0.076924, " people", false], [264, 0.066651, " a", false], [311, 0.043537, " to", false], [3738, 0.032875, " human", false], [825, 0.014076, " one", false], [2513, 0.009328, " things", false]]]}, "raw_delta": -0.10545762379964196, "tuned_delta": -0.09688583176906372}, {"byte_start": 5070, "byte_end": 5076, "display": {"text": " think", "kind": "normal"}, "is_word": true, "word_id": 853, "word_key": " think", "bytes_hex": "20 74 68 69 6e 6b", "compression": {"rwkv": "2.14% 2.14% 2.14% 2.14% 2.14% 2.14%", "qwen": "1.44% 1.44% 1.44% 1.44% 1.44% 1.44%"}, "model_tokens": {"rwkv": [[39942, " think", "normal", 0.4875118136405945]], "qwen": [[1744, " think", "normal", 0.6184293031692505]]}, "loss": {"rwkv": 2.1368041783999945, "qwen": 1.444415283022331}, "topk": {"rwkv": [39942, 1, 0.4875118136405945, [[39942, 0.487512, " think", false], [62683, 0.0669, " understand", false], [31223, 0.06606, " know", false], [32435, 0.048042, " want", false], [45, 0.026571, ",", false], [60112, 0.025746, " ourselves", false], [46227, 0.023297, " humans", false], [22449, 0.017294, " see", false], [4423, 0.015454, " as", false], [51968, 0.014877, " imagine", false]]], "qwen": [1744, 1, 0.6184293031692505, [[1744, 0.618429, " think", false], [3535, 0.038989, " understand", false], [4411, 0.034441, " believe", false], [1720, 0.032975, " expect", false], [975, 0.025085, " work", false], [12677, 0.01914, " humans", false], [1366, 0.017792, " want", false], [1414, 0.01713, " know", false], [653, 0.014336, " do", false], [525, 0.009446, " are", false]]]}, "raw_delta": 0.038394192854563386, "tuned_delta": 0.046965984885141636}, {"byte_start": 5076, "byte_end": 5079, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 854, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"rwkv": "9.11% 9.11% 9.11%", "qwen": "17.15% 17.15% 17.15%"}, "model_tokens": {"rwkv": [[4858, " we", "normal", 0.2213239073753357]], "qwen": [[582, " we", "normal", 0.057669106870889664]]}, "loss": {"rwkv": 9.11076946394723, "qwen": 17.150238931027424}, "topk": {"rwkv": [4858, 1, 0.2213239073753357, [[4858, 0.221324, " we", false], [37598, 0.146123, " about", false], [4600, 0.145352, " is", false], [22248, 0.106594, " our", false], [45, 0.070646, ",", false], [22590, 0.044996, " the", false], [21265, 0.027026, " and", false], [5346, 0.018853, "---", false], [47001, 0.014404, " rather", false], [4706, 0.01332, " of", false]]], "qwen": [582, 5, 0.057669106870889664, [[374, 0.197221, " is", false], [1039, 0.178334, " our", false], [911, 0.084625, " about", false], [11, 0.061796, ",", false], [582, 0.057669, " we", false], [279, 0.050208, " the", false], [323, 0.028571, " and", false], [12677, 0.026298, " humans", false], [686, 0.023324, " will", false], [4421, 0.019348, "---", false]]]}, "raw_delta": -0.44580284754435223, "tuned_delta": -0.437231055513774}, {"byte_start": 5079, "byte_end": 5085, "display": {"text": " think", "kind": "normal"}, "is_word": true, "word_id": 855, "word_key": " think", "bytes_hex": "20 74 68 69 6e 6b", "compression": {"rwkv": "3.19% 3.19% 3.19% 3.19% 3.19% 3.19%", "qwen": "1.35% 1.35% 1.35% 1.35% 1.35% 1.35%"}, "model_tokens": {"rwkv": [[39942, " think", "normal", 0.3434136211872101]], "qwen": [[1744, " think", "normal", 0.6386187672615051]]}, "loss": {"rwkv": 3.193465585301091, "qwen": 1.3478607294303546}, "topk": {"rwkv": [39942, 1, 0.3434136211872101, [[39942, 0.343414, " think", false], [21286, 0.160343, " are", false], [47266, 0.076611, " should", false], [31223, 0.051239, " know", false], [32475, 0.046138, " will", false], [62683, 0.035482, " understand", false], [32499, 0.026556, " work", false], [21413, 0.024884, " can", false], [32435, 0.02415, " want", false], [5230, 0.022209, "'re", false]]], "qwen": [1744, 1, 0.6386187672615051, [[1744, 0.638619, " think", false], [1414, 0.071785, " know", false], [3535, 0.049039, " understand", false], [975, 0.045229, " work", false], [1265, 0.035646, " should", false], [653, 0.0287, " do", false], [525, 0.015335, " are", false], [12677, 0.012244, " humans", false], [646, 0.010578, " can", false], [21776, 0.007312, " ought", false]]]}, "raw_delta": 0.10234206418196361, "tuned_delta": 0.11091385621254185}, {"byte_start": 5085, "byte_end": 5090, "display": {"text": " does", "kind": "normal"}, "is_word": true, "word_id": 856, "word_key": " does", "bytes_hex": "20 64 6f 65 73", "compression": {"rwkv": "17.36% 17.36% 17.36% 17.36% 17.36%", "qwen": "17.11% 17.11% 17.11% 17.11% 17.11%"}, "model_tokens": {"rwkv": [[30659, " does", "normal", 0.008141069673001766]], "qwen": [[1558, " does", "normal", 0.008711479604244232]]}, "loss": {"rwkv": 17.35742471069534, "qwen": 17.10716587611883}, "topk": {"rwkv": [30659, 15, 0.008141069673001766, [[4600, 0.35955, " is", false], [45, 0.160617, ",", false], [5346, 0.054572, "---", false], [32475, 0.034889, " will", false], [38964, 0.02888, " makes", false], [37598, 0.028654, " about", false], [38686, 0.028542, " helps", false], [21265, 0.024325, " and", false], [40212, 0.01893, " works", false], [275, 0.0153, " (", false]]], "qwen": [1558, 16, 0.008711479604244232, [[374, 0.427321, " is", false], [11, 0.107602, ",", false], [4421, 0.075485, "---", false], [686, 0.042633, " will", false], [320, 0.034348, " (", false], [323, 0.020956, " and", false], [11508, 0.017248, " leads", false], [646, 0.016237, " can", false], [1119, 0.015159, " into", false], [911, 0.014814, " about", false]]]}, "raw_delta": 0.013877296447753928, "tuned_delta": 0.02244908847833218}, {"byte_start": 5090, "byte_end": 5094, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 857, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "0.43% 0.43% 0.43% 0.43%", "qwen": "0.58% 0.58% 0.58% 0.58%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.9085621237754822]], "qwen": [[537, " not", "normal", 0.8796513676643372]]}, "loss": {"rwkv": 0.4314700744846143, "qwen": 0.5781132315259238}, "topk": {"rwkv": [22187, 1, 0.9085621237754822, [[22187, 0.908562, " not", false], [31458, 0.014172, " more", false], [4835, 0.013025, " us", false], [31466, 0.007076, " much", false], [4692, 0.004324, " no", false], [332, 0.004023, " a", false], [21660, 0.003528, " far", false], [31049, 0.002812, " harm", false], [45, 0.002667, ",", false], [4788, 0.002106, " so", false]]], "qwen": [537, 1, 0.8796513676643372, [[537, 0.879651, " not", false], [601, 0.026351, " us", false], [803, 0.015866, " more", false], [902, 0.011103, " no", false], [2632, 0.010846, " little", false], [4302, 0.009943, " nothing", false], [279, 0.004964, " the", false], [2686, 0.003646, " less", false], [264, 0.002525, " a", false], [1602, 0.002124, " very", false]]]}, "raw_delta": -0.008131623268127441, "tuned_delta": 0.0004401687624508068}, {"byte_start": 5094, "byte_end": 5099, "display": {"text": " work", "kind": "normal"}, "is_word": true, "word_id": 858, "word_key": " work", "bytes_hex": "20 77 6f 72 6b", "compression": {"rwkv": "4.28% 4.28% 4.28% 4.28% 4.28%", "qwen": "4.62% 4.62% 4.62% 4.62% 4.62%"}, "model_tokens": {"rwkv": [[32499, " work", "normal", 0.30648013949394226]], "qwen": [[975, " work", "normal", 0.27795347571372986]]}, "loss": {"rwkv": 4.28300090263911, "qwen": 4.6177118179217995}, "topk": {"rwkv": [32499, 1, 0.30648013949394226, [[32499, 0.30648, " work", false], [31073, 0.153813, " help", false], [31358, 0.117898, " make", false], [31262, 0.044946, " lead", false], [22269, 0.030662, " pay", false], [51982, 0.022369, " improve", false], [40239, 0.021061, " yield", false], [63717, 0.017719, " necessarily", false], [45150, 0.014854, " always", false], [45851, 0.013678, " enable", false]]], "qwen": [975, 1, 0.27795347571372986, [[975, 0.277953, " work", false], [1492, 0.141885, " help", false], [1281, 0.130175, " make", false], [14312, 0.047249, " necessarily", false], [2677, 0.039702, " always", false], [2990, 0.034625, " lead", false], [2291, 0.028309, " pay", false], [7269, 0.019406, " improve", false], [5452, 0.01876, " scale", false], [8193, 0.016406, " produce", false]]]}, "raw_delta": -0.01856031417846682, "tuned_delta": -0.00998852214788857}, {"byte_start": 5099, "byte_end": 5102, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 859, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "22.17% 22.17% 22.17%", "qwen": "14.61% 14.61% 14.61%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.025334522128105164]], "qwen": [[304, " in", "normal", 0.08799804002046585]]}, "loss": {"rwkv": 22.166408180325217, "qwen": 14.609937656305648}, "topk": {"rwkv": [4596, 5, 0.025334522128105164, [[47, 0.557546, ".", false], [45, 0.203756, ",", false], [21265, 0.032659, " and", false], [4423, 0.030164, " as", false], [4596, 0.025335, " in", false], [32458, 0.024674, " well", false], [5346, 0.018759, "---", false], [21700, 0.01802, " for", false], [32386, 0.013154, " very", false], [60, 0.012424, ";", false]]], "qwen": [304, 4, 0.08799804002046585, [[11, 0.228025, ",", false], [13, 0.186119, ".", false], [1632, 0.11878, " well", false], [304, 0.087998, " in", false], [382, 0.056287, ".\n\n", false], [979, 0.046167, " when", false], [369, 0.033962, " for", false], [4421, 0.032596, "---", false], [323, 0.027918, " and", false], [1602, 0.02747, " very", false]]]}, "raw_delta": 0.41901969909667985, "tuned_delta": 0.4275914911272581}, {"byte_start": 5102, "byte_end": 5106, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 860, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "8.03% 8.03% 8.03% 8.03%", "qwen": "5.12% 5.12% 5.12% 5.12%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.16564661264419556]], "qwen": [[279, " the", "normal", 0.3210839331150055]]}, "loss": {"rwkv": 8.030626692448331, "qwen": 5.121805113875409}, "topk": {"rwkv": [22590, 3, 0.16564661264419556, [[3609, 0.307636, " AI", false], [51832, 0.246449, " general", false], [22590, 0.165647, " the", false], [332, 0.034936, " a", false], [56901, 0.033283, " practice", false], [32234, 0.027718, " this", false], [52167, 0.018159, " machine", false], [31461, 0.016012, " most", false], [55809, 0.013437, " computer", false], [61594, 0.008507, " artificial", false]]], "qwen": [279, 1, 0.3210839331150055, [[279, 0.321084, " the", false], [15235, 0.237011, " AI", false], [4586, 0.070292, " general", false], [264, 0.049939, " a", false], [419, 0.04585, " this", false], [6588, 0.034317, " practice", false], [458, 0.020227, " an", false], [6366, 0.019437, " computer", false], [1657, 0.015189, " many", false], [1429, 0.014388, " most", false]]]}, "raw_delta": 0.16129931807518005, "tuned_delta": 0.1698711101057583}, {"byte_start": 5106, "byte_end": 5111, "display": {"text": " long", "kind": "normal"}, "is_word": true, "word_id": 861, "word_key": " long", "bytes_hex": "20 6c 6f 6e 67", "compression": {"rwkv": "1.67% 1.67% 1.67% 1.67% 1.67%", "qwen": "2.14% 2.14% 2.14% 2.14% 2.14%"}, "model_tokens": {"rwkv": [[31323, " long", "normal", 0.6261128783226013]], "qwen": [[1293, " long", "normal", 0.5521554946899414]]}, "loss": {"rwkv": 1.669525022903732, "qwen": 2.1421337774313574}, "topk": {"rwkv": [31323, 1, 0.6261128783226013, [[31323, 0.626113, " long", false], [51832, 0.051677, " general", false], [30807, 0.041278, " face", false], [31835, 0.024926, " real", false], [21616, 0.023988, " end", false], [46470, 0.020722, " longer", false], [3609, 0.013909, " AI", false], [51310, 0.012343, " context", false], [31937, 0.011603, " same", false], [56916, 0.011568, " presence", false]]], "qwen": [1293, 1, 0.5521554946899414, [[1293, 0.552155, " long", false], [3579, 0.056277, " face", false], [1852, 0.040254, " same", false], [1616, 0.039427, " way", false], [2266, 0.035569, " context", false], [835, 0.029098, " end", false], [1879, 0.022416, " world", false], [4586, 0.020575, " general", false], [4231, 0.017114, " age", false], [1931, 0.016012, " real", false]]]}, "raw_delta": -0.026206994056701672, "tuned_delta": -0.017635202026123425}, {"byte_start": 5111, "byte_end": 5115, "display": {"text": " run", "kind": "normal"}, "is_word": true, "word_id": 862, "word_key": " run", "bytes_hex": "20 72 75 6e", "compression": {"rwkv": "0.52% 0.52% 0.52% 0.52%", "qwen": "0.81% 0.81% 0.81% 0.81%"}, "model_tokens": {"rwkv": [[22418, " run", "normal", 0.892048180103302]], "qwen": [[1598, " run", "normal", 0.8350721001625061]]}, "loss": {"rwkv": 0.5151224358642844, "qwen": 0.812585509856842}, "topk": {"rwkv": [22418, 1, 0.892048180103302, [[22418, 0.892048, " run", false], [32219, 0.094978, " term", false], [46, 0.008566, "-", false], [31057, 0.001793, " haul", false], [45, 0.000386, ",", false], [4715, 0.00027, " or", false], [21265, 0.000258, " and", false], [39438, 0.000208, " range", false], [8661, 0.000132, "run", false], [32251, 7.4e-05, " time", false]]], "qwen": [1598, 1, 0.8350721001625061, [[1598, 0.835072, " run", false], [4647, 0.149661, " term", false], [22973, 0.006208, "-run", false], [9663, 0.00508, "-term", false], [1809, 0.000577, " game", false], [37868, 0.000539, " haul", false], [11, 0.00049, ",", false], [1651, 0.000252, " view", false], [835, 0.000126, " end", false], [1424, 0.000122, " hand", false]]]}, "raw_delta": -0.016494855284690857, "tuned_delta": -0.007923063254112609}, {"byte_start": 5115, "byte_end": 5116, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "6.83%", "qwen": "17.50%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.6870548129081726]], "qwen": [[13, ".", "normal", 0.3790284991264343]]}, "loss": {"rwkv": 6.833077097960421, "qwen": 17.495271600079956}, "topk": {"rwkv": [47, 1, 0.6870548129081726, [[47, 0.687055, ".", false], [45, 0.201355, ",", false], [21265, 0.039974, " and", false], [5346, 0.014201, "---", false], [60, 0.012268, ";", false], [4423, 0.004079, " as", false], [4596, 0.004047, " in", false], [4588, 0.003963, " if", false], [275, 0.003757, " (", false], [51018, 0.003714, " because", false]]], "qwen": [13, 1, 0.3790284991264343, [[13, 0.379028, ".", false], [11, 0.312495, ",", false], [382, 0.143711, ".\n\n", false], [323, 0.029924, " and", false], [4421, 0.02744, "---", false], [26, 0.020779, ";", false], [979, 0.016691, " when", false], [624, 0.013268, ".\n", false], [320, 0.006766, " (", false], [369, 0.006157, " for", false]]]}, "raw_delta": -0.5912376046180725, "tuned_delta": -0.5826658125874943}, {"byte_start": 5116, "byte_end": 5120, "display": {"text": " The", "kind": "normal"}, "is_word": true, "word_id": 863, "word_key": " the", "bytes_hex": "20 54 68 65", "compression": {"rwkv": "12.54% 12.54% 12.54% 12.54%", "qwen": "11.54% 11.54% 11.54% 11.54%"}, "model_tokens": {"rwkv": [[20996, " The", "normal", 0.0623793862760067]], "qwen": [[576, " The", "normal", 0.07735802233219147]]}, "loss": {"rwkv": 12.539048695226342, "qwen": 11.53845363250652}, "topk": {"rwkv": [20996, 3, 0.0623793862760067, [[261, 0.353309, "\n\n", false], [4331, 0.110811, " We", false], [20996, 0.062379, " The", false], [3918, 0.047851, " It", false], [29894, 0.028177, " This", false], [19417, 0.027652, " And", false], [3913, 0.022502, " In", false], [4255, 0.019988, " To", false], [267, 0.018998, "  ", false], [37451, 0.0166, " There", false]]], "qwen": [576, 3, 0.07735802233219147, [[1205, 0.201504, " We", false], [1084, 0.085766, " It", false], [576, 0.077358, " The", false], [220, 0.049018, " ", false], [1597, 0.043184, " And", false], [758, 0.04095, " In", false], [12090, 0.036267, " Instead", false], [1096, 0.031497, " This", false], [2014, 0.020006, " To", false], [1416, 0.018401, " If", false]]]}, "raw_delta": 0.055484771728515625, "tuned_delta": 0.06405656375909387}, {"byte_start": 5120, "byte_end": 5127, "display": {"text": " bitter", "kind": "normal"}, "is_word": true, "word_id": 864, "word_key": " bitter", "bytes_hex": "20 62 69 74 74 65 72", "compression": {"rwkv": "8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09%", "qwen": "11.57% 11.57% 11.57% 11.57% 11.57% 11.57% 11.57%"}, "model_tokens": {"rwkv": [[45315, " bitter", "normal", 0.04283943399786949]], "qwen": [[25180, " bitter", "normal", 0.011190979741513729]]}, "loss": {"rwkv": 8.091007344271251, "qwen": 11.574142489455566}, "topk": {"rwkv": [45315, 3, 0.04283943399786949, [[46430, 0.077597, " lesson", false], [45184, 0.045862, " appeal", false], [45315, 0.042839, " bitter", false], [47009, 0.029321, " reason", false], [31581, 0.023927, " only", false], [31461, 0.023058, " most", false], [38720, 0.021002, " human", false], [30273, 0.015989, " best", false], [52127, 0.013819, " lessons", false], [21357, 0.013423, " big", false]]], "qwen": [25180, 12, 0.011190979741513729, [[1172, 0.059374, " only", false], [3738, 0.059229, " human", false], [17755, 0.042784, " lesson", false], [1850, 0.034479, " best", false], [1429, 0.026778, " most", false], [2070, 0.024099, " field", false], [2874, 0.019449, " reason", false], [1616, 0.018545, " way", false], [803, 0.015485, " more", false], [1376, 0.012972, " key", false]]]}, "raw_delta": -0.19314602443150108, "tuned_delta": -0.18457423240092283}, {"byte_start": 5127, "byte_end": 5134, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 865, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"rwkv": "0.31% 0.31% 0.31% 0.31% 0.31% 0.31% 0.31%", "qwen": "0.27% 0.27% 0.27% 0.27% 0.27% 0.27% 0.27%"}, "model_tokens": {"rwkv": [[46430, " lesson", "normal", 0.8862361311912537]], "qwen": [[17755, " lesson", "normal", 0.9021850824356079]]}, "loss": {"rwkv": 0.3119667010850856, "qwen": 0.2651869017991099}, "topk": {"rwkv": [46430, 1, 0.8862361311912537, [[46430, 0.886236, " lesson", false], [52127, 0.043298, " lessons", false], [7513, 0.027198, "est", false], [31633, 0.006349, " part", false], [39899, 0.004205, " taste", false], [46, 0.003502, "-", false], [40029, 0.002673, " truth", false], [47009, 0.001869, " reason", false], [45, 0.001406, ",", false], [21265, 0.000988, " and", false]]], "qwen": [17755, 1, 0.9021850824356079, [[17755, 0.902185, " lesson", false], [18366, 0.020929, " lessons", false], [8046, 0.011496, " truth", false], [11, 0.004877, ",", false], [477, 0.004274, "est", false], [12656, 0.003808, " taste", false], [3139, 0.003217, " experience", false], [949, 0.00215, " part", false], [374, 0.001937, " is", false], [323, 0.001742, " and", false]]]}, "raw_delta": 0.002594022878578732, "tuned_delta": 0.01116581490915698}, {"byte_start": 5134, "byte_end": 5137, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 866, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "2.97% 2.97% 2.97%", "qwen": "4.62% 4.62% 4.62%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.6106763482093811]], "qwen": [[374, " is", "normal", 0.4638510048389435]]}, "loss": {"rwkv": 2.9703926216219703, "qwen": 4.617777529626316}, "topk": {"rwkv": [4600, 1, 0.6106763482093811, [[4600, 0.610676, " is", false], [4706, 0.043832, " of", false], [32227, 0.043181, " that", false], [45, 0.030191, ",", false], [21800, 0.025671, " has", false], [30135, 0.023286, " also", false], [21413, 0.01885, " can", false], [50938, 0.010327, " applies", false], [30659, 0.009446, " does", false], [4596, 0.009378, " in", false]]], "qwen": [374, 1, 0.4638510048389435, [[374, 0.463851, " is", false], [429, 0.060347, " that", false], [315, 0.045223, " of", false], [702, 0.037756, " has", false], [11, 0.030756, ",", false], [1231, 0.021503, " may", false], [646, 0.019577, " can", false], [1083, 0.01896, " also", false], [686, 0.015643, " will", false], [572, 0.013588, " was", false]]]}, "raw_delta": -0.0913504163424174, "tuned_delta": -0.08277862431183916}, {"byte_start": 5137, "byte_end": 5143, "display": {"text": " based", "kind": "normal"}, "is_word": true, "word_id": 867, "word_key": " based", "bytes_hex": "20 62 61 73 65 64", "compression": {"rwkv": "19.44% 19.44% 19.44% 19.44% 19.44% 19.44%", "qwen": "21.48% 21.48% 21.48% 21.48% 21.48% 21.48%"}, "model_tokens": {"rwkv": [[37810, " based", "normal", 0.0015793975908309221]], "qwen": [[3118, " based", "normal", 0.0007878189207985997]]}, "loss": {"rwkv": 19.44256988698017, "qwen": 21.47885020595085}, "topk": {"rwkv": [37810, 43, 0.0015793975908309221, [[32227, 0.501362, " that", false], [22187, 0.062458, " not", false], [22590, 0.047505, " the", false], [30135, 0.030121, " also", false], [32234, 0.028763, " this", false], [332, 0.024128, " a", false], [4811, 0.019839, " to", false], [59, 0.018992, ":", false], [45, 0.015691, ",", false], [37598, 0.014904, " about", false]]], "qwen": [3118, 87, 0.0007878189207985997, [[429, 0.420396, " that", false], [537, 0.060272, " not", false], [264, 0.042158, " a", false], [1083, 0.040813, " also", false], [279, 0.035126, " the", false], [25180, 0.026915, " bitter", false], [419, 0.024569, " this", false], [825, 0.021177, " one", false], [11, 0.015526, ",", false], [25, 0.013466, ":", false]]]}, "raw_delta": -0.11291535695393873, "tuned_delta": -0.10434356492336049}, {"byte_start": 5143, "byte_end": 5146, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 868, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"rwkv": "0.58% 0.58% 0.58%", "qwen": "0.63% 0.63% 0.63%"}, "model_tokens": {"rwkv": [[4712, " on", "normal", 0.9080391526222229]], "qwen": [[389, " on", "normal", 0.9003555178642273]]}, "loss": {"rwkv": 0.584098944370328, "qwen": 0.6309720544814594}, "topk": {"rwkv": [4712, 1, 0.9080391526222229, [[4712, 0.908039, " on", false], [4596, 0.039021, " in", false], [22187, 0.012283, " not", false], [32350, 0.010816, " upon", false], [45, 0.007775, ",", false], [46768, 0.001574, " partly", false], [31458, 0.001391, " more", false], [45202, 0.001182, " around", false], [60247, 0.001127, " primarily", false], [30322, 0.001012, " both", false]]], "qwen": [389, 1, 0.9003555178642273, [[389, 0.900356, " on", false], [304, 0.02386, " in", false], [537, 0.01802, " not", false], [11, 0.010356, ",", false], [5193, 0.009928, " upon", false], [1172, 0.00229, " only", false], [11368, 0.002201, " entirely", false], [803, 0.002024, " more", false], [13771, 0.001939, " largely", false], [2163, 0.001594, " around", false]]]}, "raw_delta": -0.002599197129408523, "tuned_delta": 0.005972594901169725}, {"byte_start": 5146, "byte_end": 5150, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 869, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "4.31% 4.31% 4.31% 4.31%", "qwen": "5.10% 5.10% 5.10% 5.10%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.3865814208984375]], "qwen": [[279, " the", "normal", 0.32240262627601624]]}, "loss": {"rwkv": 4.314700744846142, "qwen": 5.103327190377551}, "topk": {"rwkv": [22590, 1, 0.3865814208984375, [[22590, 0.386581, " the", false], [332, 0.141616, " a", false], [37045, 0.07456, " Moore", false], [22638, 0.044492, " two", false], [4419, 0.029966, " an", false], [32464, 0.023575, " what", false], [32234, 0.016644, " this", false], [21835, 0.016211, " how", false], [39946, 0.013038, " three", false], [65034, 0.010476, " understanding", false]]], "qwen": [279, 1, 0.32240262627601624, [[279, 0.322403, " the", false], [264, 0.118365, " a", false], [1378, 0.048474, " two", false], [20219, 0.045589, " Moore", false], [458, 0.021637, " an", false], [1128, 0.020198, " what", false], [3139, 0.017951, " experience", false], [2326, 0.017125, " three", false], [1039, 0.012978, " our", false], [3738, 0.00938, " human", false]]]}, "raw_delta": -0.043730735778808594, "tuned_delta": -0.035158943748230344}, {"byte_start": 5150, "byte_end": 5161, "display": {"text": " historical", "kind": "normal"}, "is_word": true, "word_id": 870, "word_key": " historical", "bytes_hex": "20 68 69 73 74 6f 72 69 63 61 6c", "compression": {"rwkv": "10.96% 10.96% 10.96% 10.96% 10.96% 10.96% 10.96% 10.96% 10.96% 10.96% 10.96%", "qwen": "9.95% 9.95% 9.95% 9.95% 9.95% 9.95% 9.95% 9.95% 9.95% 9.95% 9.95%"}, "model_tokens": {"rwkv": [[62061, " historical", "normal", 0.001241572666913271]], "qwen": [[13656, " historical", "normal", 0.002314023906365037]]}, "loss": {"rwkv": 10.963662597664705, "qwen": 9.949296415046708}, "topk": {"rwkv": [62061, 110, 0.001241572666913271, [[30808, 0.136299, " fact", false], [63729, 0.073991, " observation", false], [59725, 0.059779, " following", false], [51832, 0.027097, " general", false], [31135, 0.023824, " idea", false], [46681, 0.015575, " notion", false], [47284, 0.013786, " simple", false], [60250, 0.01375, " principle", false], [52022, 0.011658, " insight", false], [63820, 0.011656, " realization", false]]], "qwen": [13656, 51, 0.002314023906365037, [[2097, 0.133914, " fact", false], [21930, 0.114291, " observation", false], [2701, 0.046345, " following", false], [4285, 0.033885, " simple", false], [4522, 0.023517, " idea", false], [24335, 0.022318, " assumption", false], [17508, 0.021572, " principle", false], [15811, 0.016477, " fundamental", false], [48703, 0.015829, " realization", false], [17843, 0.012666, " recognition", false]]]}, "raw_delta": 0.05624840476296156, "tuned_delta": 0.0648201967935398}, {"byte_start": 5161, "byte_end": 5174, "display": {"text": " observations", "kind": "normal"}, "is_word": true, "word_id": 871, "word_key": " observations", "bytes_hex": "20 6f 62 73 65 72 76 61 74 69 6f 6e 73", "compression": {"rwkv": "6.76% 6.76% 6.76% 6.76% 6.76% 6.76% 6.76% 6.76% 6.76% 6.76% 6.76% 6.76% 6.76%", "qwen": "8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09% 8.09%"}, "model_tokens": {"rwkv": [[64495, " observations", "normal", 0.007574328221380711]], "qwen": [[23722, " observations", "normal", 0.002941312501206994]]}, "loss": {"rwkv": 6.762633004167015, "qwen": 8.085888687000958}, "topk": {"rwkv": [64495, 16, 0.007574328221380711, [[52427, 0.168155, " pattern", false], [30808, 0.118657, " fact", false], [47024, 0.104024, " record", false], [56157, 0.058514, " evidence", false], [56162, 0.051737, " examples", false], [61979, 0.050051, " experience", false], [51668, 0.034355, " example", false], [38440, 0.024553, " facts", false], [63729, 0.022453, " observation", false], [30579, 0.018244, " data", false]]], "qwen": [23722, 34, 0.002941312501206994, [[2097, 0.276674, " fact", false], [3255, 0.119615, " record", false], [3139, 0.067845, " experience", false], [5904, 0.037318, " evidence", false], [5383, 0.035484, " pattern", false], [8729, 0.034271, " reality", false], [21930, 0.024844, " observation", false], [2393, 0.017481, " success", false], [4401, 0.016759, " development", false], [323, 0.014835, " and", false]]]}, "raw_delta": -0.07337687565730167, "tuned_delta": -0.06480508362672342}, {"byte_start": 5174, "byte_end": 5179, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 872, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "3.56% 3.56% 3.56% 3.56% 3.56%", "qwen": "3.07% 3.07% 3.07% 3.07% 3.07%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.3737061023712158]], "qwen": [[429, " that", "normal", 0.42726224660873413]]}, "loss": {"rwkv": 3.5644711459463645, "qwen": 3.067015627891962}, "topk": {"rwkv": [32227, 1, 0.3737061023712158, [[32227, 0.373706, " that", false], [4706, 0.160495, " of", false], [45, 0.045392, ",", false], [37599, 0.043534, " above", false], [47, 0.033779, ".", false], [59488, 0.032704, " described", false], [4596, 0.030989, " in", false], [37598, 0.023491, " about", false], [31198, 0.022236, " just", false], [21265, 0.021996, " and", false]]], "qwen": [429, 1, 0.42726224660873413, [[429, 0.427262, " that", false], [315, 0.291769, " of", false], [323, 0.027302, " and", false], [1865, 0.027231, " made", false], [11, 0.024236, ",", false], [3403, 0.020542, " above", false], [304, 0.019367, " in", false], [911, 0.018508, " about", false], [7481, 0.010782, " described", false], [68629, 0.008892, " summarized", false]]]}, "raw_delta": 0.02758479118347168, "tuned_delta": 0.03615658321404993}, {"byte_start": 5179, "byte_end": 5181, "display": {"text": " 1", "kind": "normal"}, "is_word": true, "word_id": 873, "word_key": " 1", "bytes_hex": "20 31", "compression": {"rwkv": "46.77% 46.77%", "qwen": "89.94% 5.89%"}, "model_tokens": {"rwkv": [[284, " 1", "normal", 0.005633039399981499]], "qwen": [[220, " ", "normal", 0.006822048686444759], [16, "1", "normal", 0.7212427258491516]]}, "loss": {"rwkv": 46.77487827882186, "qwen": 47.918891555156414}, "topk": {"rwkv": [284, 32, 0.005633039399981499, [[22590, 0.096831, " the", false], [4858, 0.070248, " we", false], [45, 0.060374, ",", false], [59, 0.051346, ":", false], [47202, 0.042919, " search", false], [38720, 0.027865, " human", false], [52224, 0.02731, " methods", false], [63370, 0.02686, " computation", false], [4596, 0.024258, " in", false], [52195, 0.02262, " massive", false]]], "qwen": [220, 31, 0.006822048686444759, [[279, 0.114873, " the", false], [11, 0.074743, ",", false], [582, 0.039058, " we", false], [3738, 0.037648, " human", false], [1052, 0.032026, " there", false], [11811, 0.025722, " researchers", false], [304, 0.022724, " in", false], [614, 0.018306, " have", false], [1429, 0.018006, " most", false], [1447, 0.01739, ":\n\n", false]]]}, "raw_delta": -0.0634375661611557, "tuned_delta": -0.05486577413057745}, {"byte_start": 5181, "byte_end": 5182, "display": {"text": ")", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29", "compression": {"rwkv": "1.57%", "qwen": "2.71%"}, "model_tokens": {"rwkv": [[42, ")", "normal", 0.916594922542572]], "qwen": [[8, ")", "normal", 0.8606036901473999]]}, "loss": {"rwkv": 1.5673810869032927, "qwen": 2.7072382949905966}, "topk": {"rwkv": [42, 1, 0.916594922542572, [[42, 0.916595, ")", false], [47, 0.053489, ".", false], [580, 0.00931, ".)", false], [48, 0.007099, "/", false], [45, 0.003575, ",", false], [46, 0.001759, "-", false], [59, 0.001194, ":", false], [499, 0.000951, ").", false], [276, 0.000381, " )", false], [98, 0.000339, "a", false]]], "qwen": [8, 1, 0.8606036901473999, [[8, 0.860604, ")", false], [13, 0.071884, ".", false], [24, 0.027879, "9", false], [15, 0.009732, "0", false], [6138, 0.005238, ".)", false], [11, 0.001529, ",", false], [25, 0.001528, ":", false], [279, 0.001499, " the", false], [14, 0.001431, "/", false], [12, 0.001183, "-", false]]]}, "raw_delta": -0.06320710480213165, "tuned_delta": -0.0546353127715534}, {"byte_start": 5182, "byte_end": 5185, "display": {"text": " AI", "kind": "normal"}, "is_word": true, "word_id": 874, "word_key": " ai", "bytes_hex": "20 41 49", "compression": {"rwkv": "28.93% 28.93% 28.93%", "qwen": "35.42% 35.42% 35.42%"}, "model_tokens": {"rwkv": [[3609, " AI", "normal", 0.008249612525105476]], "qwen": [[15235, " AI", "normal", 0.002759526250883937]]}, "loss": {"rwkv": 28.929041184492235, "qwen": 35.42234935740809}, "topk": {"rwkv": [3609, 22, 0.008249612525105476, [[22590, 0.111227, " the", false], [52195, 0.106297, " massive", false], [47202, 0.079443, " search", false], [63370, 0.044649, " computation", false], [52224, 0.037926, " methods", false], [38720, 0.037749, " human", false], [4596, 0.023473, " in", false], [39934, 0.02338, " there", false], [4858, 0.022097, " we", false], [37045, 0.021416, " Moore", false]]], "qwen": [15235, 51, 0.002759526250883937, [[279, 0.12742, " the", false], [3738, 0.091542, " human", false], [1052, 0.030641, " there", false], [1429, 0.029236, " most", false], [304, 0.026788, " in", false], [582, 0.026313, " we", false], [4586, 0.024561, " general", false], [5413, 0.022817, " methods", false], [432, 0.017832, " it", false], [979, 0.016287, " when", false]]]}, "raw_delta": -0.3600654602050781, "tuned_delta": -0.3514936681744999}, {"byte_start": 5185, "byte_end": 5197, "display": {"text": " researchers", "kind": "normal"}, "is_word": true, "word_id": 875, "word_key": " researchers", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72 73", "compression": {"rwkv": "2.36% 2.36% 2.36% 2.36% 2.36% 2.36% 2.36% 2.36% 2.36% 2.36% 2.36% 2.36%", "qwen": "1.30% 1.30% 1.30% 1.30% 1.30% 1.30% 1.30% 1.30% 1.30% 1.30% 1.30% 1.30%"}, "model_tokens": {"rwkv": [[63843, " researchers", "normal", 0.20665737986564636]], "qwen": [[11811, " researchers", "normal", 0.4211137890815735]]}, "loss": {"rwkv": 2.3598771420791147, "qwen": 1.2997062142088494}, "topk": {"rwkv": [63843, 2, 0.20665737986564636, [[57103, 0.355594, " research", false], [63843, 0.206657, " researchers", false], [52224, 0.08492, " methods", false], [53087, 0.043916, " systems", false], [4600, 0.032844, " is", false], [21800, 0.028624, " has", false], [56950, 0.017856, " progress", false], [56949, 0.012839, " programs", false], [62633, 0.010243, " techniques", false], [22748, 0.008962, " was", false]]], "qwen": [11811, 1, 0.4211137890815735, [[11811, 0.421114, " researchers", false], [3412, 0.241596, " research", false], [702, 0.051568, " has", false], [374, 0.045421, " is", false], [5413, 0.030513, " methods", false], [572, 0.024486, " was", false], [5942, 0.016856, " systems", false], [594, 0.005651, "'s", false], [646, 0.004245, " can", false], [304, 0.004208, " in", false]]]}, "raw_delta": 0.05878835916519165, "tuned_delta": 0.0673601511957699}, {"byte_start": 5197, "byte_end": 5202, "display": {"text": " have", "kind": "normal"}, "is_word": true, "word_id": 876, "word_key": " have", "bytes_hex": "20 68 61 76 65", "compression": {"rwkv": "6.09% 6.09% 6.09% 6.09% 6.09%", "qwen": "6.84% 6.84% 6.84% 6.84% 6.84%"}, "model_tokens": {"rwkv": [[31059, " have", "normal", 0.18479271233081818]], "qwen": [[614, " have", "normal", 0.15027377009391785]]}, "loss": {"rwkv": 6.086369703750314, "qwen": 6.835836989550142}, "topk": {"rwkv": [31059, 1, 0.18479271233081818, [[31059, 0.184793, " have", false], [40, 0.125531, "'", false], [21286, 0.08591, " are", false], [32216, 0.043883, " tend", false], [22762, 0.039098, " who", false], [45, 0.029817, ",", false], [4491, 0.018315, " do", false], [39171, 0.017601, " often", false], [32462, 0.016839, " were", false], [45150, 0.01482, " always", false]]], "qwen": [614, 1, 0.15027377009391785, [[614, 0.150274, " have", false], [525, 0.076383, " are", false], [6, 0.065294, "'", false], [8376, 0.048428, " tend", false], [879, 0.039182, " who", false], [1033, 0.037454, " were", false], [2677, 0.02672, " always", false], [653, 0.024378, " do", false], [11, 0.023063, ",", false], [3545, 0.021426, " often", false]]]}, "raw_delta": -0.04155929088592525, "tuned_delta": -0.032987498855347}, {"byte_start": 5202, "byte_end": 5208, "display": {"text": " often", "kind": "normal"}, "is_word": true, "word_id": 877, "word_key": " often", "bytes_hex": "20 6f 66 74 65 6e", "compression": {"rwkv": "11.55% 11.55% 11.55% 11.55% 11.55% 11.55%", "qwen": "10.20% 10.20% 10.20% 10.20% 10.20% 10.20%"}, "model_tokens": {"rwkv": [[39171, " often", "normal", 0.02140750177204609]], "qwen": [[3545, " often", "normal", 0.033567722886800766]]}, "loss": {"rwkv": 11.55283138211865, "qwen": 10.201628187783637}, "topk": {"rwkv": [39171, 7, 0.02140750177204609, [[30259, 0.153282, " been", false], [22187, 0.071969, " not", false], [45150, 0.064603, " always", false], [332, 0.051983, " a", false], [47518, 0.030179, " tended", false], [21795, 0.028723, " had", false], [39171, 0.021408, " often", false], [31351, 0.020213, " made", false], [39762, 0.019188, " spent", false], [56495, 0.018302, " invested", false]]], "qwen": [3545, 6, 0.033567722886800766, [[1012, 0.116053, " been", false], [2677, 0.102586, " always", false], [537, 0.060681, " not", false], [48790, 0.050558, " tended", false], [264, 0.035441, " a", false], [3545, 0.033568, " often", false], [1865, 0.03193, " made", false], [8789, 0.03124, " generally", false], [6679, 0.025189, " tried", false], [7391, 0.021125, " spent", false]]]}, "raw_delta": 0.07492661476135254, "tuned_delta": 0.08349840679193078}, {"byte_start": 5208, "byte_end": 5214, "display": {"text": " tried", "kind": "normal"}, "is_word": true, "word_id": 878, "word_key": " tried", "bytes_hex": "20 74 72 69 65 64", "compression": {"rwkv": "9.02% 9.02% 9.02% 9.02% 9.02% 9.02%", "qwen": "7.22% 7.22% 7.22% 7.22% 7.22% 7.22%"}, "model_tokens": {"rwkv": [[40013, " tried", "normal", 0.049675680696964264]], "qwen": [[6679, " tried", "normal", 0.09043993800878525]]}, "loss": {"rwkv": 9.01684400555602, "qwen": 7.2227009271126}, "topk": {"rwkv": [40013, 3, 0.049675680696964264, [[30259, 0.175788, " been", false], [31351, 0.056235, " made", false], [40013, 0.049676, " tried", false], [21795, 0.033501, " had", false], [53137, 0.027602, " thought", false], [45953, 0.026995, " failed", false], [22187, 0.026353, " not", false], [56495, 0.02413, " invested", false], [37924, 0.023808, " built", false], [56651, 0.02061, " mistaken", false]]], "qwen": [6679, 2, 0.09043993800878525, [[1012, 0.204918, " been", false], [6679, 0.09044, " tried", false], [1865, 0.062135, " made", false], [7391, 0.025583, " spent", false], [11585, 0.020182, " believed", false], [1030, 0.019235, " had", false], [3381, 0.019098, " thought", false], [4641, 0.018346, " failed", false], [45431, 0.016739, " pursued", false], [10735, 0.016659, " focused", false]]]}, "raw_delta": 0.09948841730753583, "tuned_delta": 0.10806020933811407}, {"byte_start": 5214, "byte_end": 5217, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 879, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "1.89% 1.89% 1.89%", "qwen": "0.87% 0.87% 0.87%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.7269521951675415]], "qwen": [[311, " to", "normal", 0.8649898171424866]]}, "loss": {"rwkv": 1.890249850123072, "qwen": 0.8718540455931668}, "topk": {"rwkv": [4811, 1, 0.7269521951675415, [[4811, 0.726952, " to", false], [52224, 0.101673, " methods", false], [22590, 0.010989, " the", false], [39931, 0.010568, " their", false], [45, 0.010553, ",", false], [61590, 0.008753, " approaches", false], [38720, 0.00633, " human", false], [32448, 0.005422, " ways", false], [55666, 0.005143, " building", false], [22249, 0.005037, " out", false]]], "qwen": [311, 1, 0.8649898171424866, [[311, 0.86499, " to", false], [5413, 0.01351, " methods", false], [11, 0.010121, ",", false], [3738, 0.007356, " human", false], [323, 0.006901, " and", false], [304, 0.004482, " in", false], [2588, 0.004469, " hard", false], [279, 0.004439, " the", false], [2238, 0.004154, " too", false], [1602, 0.004112, " very", false]]]}, "raw_delta": 0.056471854448318475, "tuned_delta": 0.06504364647889672}, {"byte_start": 5217, "byte_end": 5223, "display": {"text": " build", "kind": "normal"}, "is_word": true, "word_id": 880, "word_key": " build", "bytes_hex": "20 62 75 69 6c 64", "compression": {"rwkv": "5.89% 5.89% 5.89% 5.89% 5.89% 5.89%", "qwen": "4.01% 4.01% 4.01% 4.01% 4.01% 4.01%"}, "model_tokens": {"rwkv": [[37923, " build", "normal", 0.1399841010570526]], "qwen": [[1936, " build", "normal", 0.2630777955055237]]}, "loss": {"rwkv": 5.8938225140483365, "qwen": 4.013413654526509}, "topk": {"rwkv": [37923, 1, 0.1399841010570526, [[37923, 0.139984, " build", false], [31358, 0.06772, " make", false], [22339, 0.065152, " put", false], [22681, 0.050738, " use", false], [56540, 0.044043, " leverage", false], [32187, 0.04041, " take", false], [51982, 0.034896, " improve", false], [37730, 0.029011, " apply", false], [4491, 0.023135, " do", false], [39740, 0.022475, " solve", false]]], "qwen": [1936, 1, 0.2630777955055237, [[1936, 0.263078, " build", false], [1281, 0.147193, " make", false], [32064, 0.035578, " leverage", false], [2182, 0.035405, " put", false], [990, 0.032568, " use", false], [65485, 0.025452, " emulate", false], [11625, 0.02464, " solve", false], [653, 0.023266, " do", false], [55359, 0.016776, " mimic", false], [3796, 0.016032, " apply", false]]]}, "raw_delta": 0.10427200794219972, "tuned_delta": 0.11284379997277796}, {"byte_start": 5223, "byte_end": 5233, "display": {"text": " knowledge", "kind": "normal"}, "is_word": true, "word_id": 881, "word_key": " knowledge", "bytes_hex": "20 6b 6e 6f 77 6c 65 64 67 65", "compression": {"rwkv": "9.30% 9.30% 9.30% 9.30% 9.30% 9.30% 9.30% 9.30% 9.30% 9.30%", "qwen": "11.44% 11.44% 11.44% 11.44% 11.44% 11.44% 11.44% 11.44% 11.44% 11.44%"}, "model_tokens": {"rwkv": [[59943, " knowledge", "normal", 0.005743762012571096]], "qwen": [[6540, " knowledge", "normal", 0.001757561694830656]]}, "loss": {"rwkv": 9.298620380729647, "qwen": 11.440260997909652}, "topk": {"rwkv": [59943, 17, 0.005743762012571096, [[4596, 0.161759, " in", false], [3609, 0.158346, " AI", false], [53087, 0.150292, " systems", false], [52224, 0.127166, " methods", false], [39931, 0.11992, " their", false], [332, 0.023776, " a", false], [63659, 0.017988, " intelligent", false], [64452, 0.01705, " intelligence", false], [22590, 0.015152, " the", false], [51832, 0.011605, " general", false]]], "qwen": [6540, 38, 0.001757561694830656, [[5942, 0.383208, " systems", false], [304, 0.147803, " in", false], [5413, 0.048333, " methods", false], [15235, 0.036416, " AI", false], [264, 0.036301, " a", false], [12645, 0.028511, " machines", false], [4119, 0.023244, " models", false], [862, 0.022203, " their", false], [24514, 0.020137, " intelligent", false], [279, 0.015744, " the", false]]]}, "raw_delta": -0.11875777244567876, "tuned_delta": -0.11018598041510051}, {"byte_start": 5233, "byte_end": 5238, "display": {"text": " into", "kind": "normal"}, "is_word": true, "word_id": 882, "word_key": " into", "bytes_hex": "20 69 6e 74 6f", "compression": {"rwkv": "3.97% 3.97% 3.97% 3.97% 3.97%", "qwen": "2.58% 2.58% 2.58% 2.58% 2.58%"}, "model_tokens": {"rwkv": [[31162, " into", "normal", 0.3309861421585083]], "qwen": [[1119, " into", "normal", 0.4887540638446808]]}, "loss": {"rwkv": 3.9730468899481215, "qwen": 2.5820486300299623}, "topk": {"rwkv": [31162, 2, 0.3309861421585083, [[46, 0.366979, "-", false], [31162, 0.330986, " into", false], [4706, 0.061737, " of", false], [21265, 0.034483, " and", false], [53087, 0.027927, " systems", false], [4596, 0.027338, " in", false], [37598, 0.023705, " about", false], [56003, 0.015832, " directly", false], [4715, 0.012908, " or", false], [45, 0.011031, ",", false]]], "qwen": [1119, 1, 0.4887540638446808, [[1119, 0.488754, " into", false], [5980, 0.177835, "-based", false], [5961, 0.056711, " directly", false], [304, 0.044363, " in", false], [23092, 0.020867, " bases", false], [12, 0.017732, "-", false], [11, 0.013609, ",", false], [13042, 0.011556, " representation", false], [43613, 0.011007, " representations", false], [323, 0.010619, " and", false]]]}, "raw_delta": 0.07713332176208496, "tuned_delta": 0.0857051137926632}, {"byte_start": 5238, "byte_end": 5244, "display": {"text": " their", "kind": "normal"}, "is_word": true, "word_id": 883, "word_key": " their", "bytes_hex": "20 74 68 65 69 72", "compression": {"rwkv": "1.57% 1.57% 1.57% 1.57% 1.57% 1.57%", "qwen": "2.35% 2.35% 2.35% 2.35% 2.35% 2.35%"}, "model_tokens": {"rwkv": [[39931, " their", "normal", 0.5923572778701782]], "qwen": [[862, " their", "normal", 0.45808759331703186]]}, "loss": {"rwkv": 1.573251428052743, "qwen": 2.3464680489182497}, "topk": {"rwkv": [39931, 1, 0.5923572778701782, [[39931, 0.592357, " their", false], [3609, 0.124498, " AI", false], [52224, 0.06675, " methods", false], [53087, 0.061587, " systems", false], [22590, 0.058529, " the", false], [56949, 0.011045, " programs", false], [332, 0.008555, " a", false], [61559, 0.005536, " algorithms", false], [56567, 0.004553, " machines", false], [4419, 0.003581, " an", false]]], "qwen": [862, 1, 0.45808759331703186, [[862, 0.458088, " their", false], [5942, 0.145753, " systems", false], [15235, 0.106452, " AI", false], [279, 0.098164, " the", false], [5413, 0.032825, " methods", false], [264, 0.022574, " a", false], [12645, 0.013158, " machines", false], [25185, 0.011579, " algorithms", false], [458, 0.009804, " an", false], [13009, 0.009332, " agents", false]]]}, "raw_delta": -0.04287623365720112, "tuned_delta": -0.03430444162662287}, {"byte_start": 5244, "byte_end": 5251, "display": {"text": " agents", "kind": "normal"}, "is_word": true, "word_id": 884, "word_key": " agents", "bytes_hex": "20 61 67 65 6e 74 73", "compression": {"rwkv": "13.28% 13.28% 13.28% 13.28% 13.28% 13.28% 13.28%", "qwen": "9.16% 9.16% 9.16% 9.16% 9.16% 9.16% 9.16%"}, "model_tokens": {"rwkv": [[45124, " agents", "normal", 0.00581713393330574]], "qwen": [[13009, " agents", "normal", 0.02860068529844284]]}, "loss": {"rwkv": 13.283743401042354, "qwen": 9.156797344590643}, "topk": {"rwkv": [45124, 11, 0.00581713393330574, [[53087, 0.363531, " systems", false], [52224, 0.312871, " methods", false], [3609, 0.080099, " AI", false], [56949, 0.060257, " programs", false], [61590, 0.020752, " approaches", false], [57103, 0.019518, " research", false], [61559, 0.019268, " algorithms", false], [46587, 0.017875, " models", false], [32499, 0.012338, " work", false], [56567, 0.006306, " machines", false]]], "qwen": [13009, 5, 0.02860068529844284, [[5942, 0.584944, " systems", false], [5413, 0.162817, " methods", false], [15235, 0.040642, " AI", false], [25185, 0.035244, " algorithms", false], [13009, 0.028601, " agents", false], [7468, 0.026119, " programs", false], [4119, 0.013486, " models", false], [12645, 0.012212, " machines", false], [19827, 0.011931, " approaches", false], [1849, 0.00816, " system", false]]]}, "raw_delta": 0.228846481868199, "tuned_delta": 0.23741827389877726}, {"byte_start": 5251, "byte_end": 5252, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "15.15%", "qwen": "16.14%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.434590220451355]], "qwen": [[11, ",", "normal", 0.4085323214530945]]}, "loss": {"rwkv": 15.145480165582377, "qwen": 16.1434739907079}, "topk": {"rwkv": [45, 1, 0.434590220451355, [[45, 0.43459, ",", false], [21265, 0.131458, " and", false], [4596, 0.063392, " in", false], [4811, 0.052394, " to", false], [275, 0.039203, " (", false], [60, 0.034373, ";", false], [45285, 0.022127, " before", false], [32227, 0.019831, " that", false], [21400, 0.018695, " but", false], [5346, 0.015708, "---", false]]], "qwen": [11, 1, 0.4085323214530945, [[11, 0.408532, ",", false], [323, 0.095241, " and", false], [304, 0.061851, " in", false], [26, 0.057017, ";", false], [320, 0.038999, " (", false], [438, 0.028618, " as", false], [429, 0.028383, " that", false], [2041, 0.024179, " without", false], [553, 0.023365, " by", false], [4421, 0.022919, "---", false]]]}, "raw_delta": -0.05534052848815918, "tuned_delta": -0.04676873645758093}, {"byte_start": 5252, "byte_end": 5254, "display": {"text": " 2", "kind": "normal"}, "is_word": true, "word_id": 885, "word_key": " 2", "bytes_hex": "20 32", "compression": {"rwkv": "20.01% 20.01%", "qwen": "37.18% 0.11%"}, "model_tokens": {"rwkv": [[285, " 2", "normal", 0.10914670675992966]], "qwen": [[220, " ", "normal", 0.1272447109222412], [17, "2", "normal", 0.994102418422699]]}, "loss": {"rwkv": 20.00612263732742, "qwen": 18.642849443588588}, "topk": {"rwkv": [285, 2, 0.10914670675992966, [[21265, 0.421511, " and", false], [285, 0.109147, " 2", false], [21400, 0.065315, " but", false], [4596, 0.03874, " in", false], [4423, 0.02439, " as", false], [30788, 0.021679, " even", false], [4715, 0.021674, " or", false], [4811, 0.01869, " to", false], [32487, 0.017204, " with", false], [40186, 0.015772, " which", false]]], "qwen": [220, 2, 0.1272447109222412, [[323, 0.393957, " and", false], [220, 0.127245, " ", false], [714, 0.073304, " but", false], [4751, 0.029262, " rather", false], [304, 0.024752, " in", false], [438, 0.022122, " as", false], [448, 0.020125, " with", false], [2987, 0.01689, " either", false], [1496, 0.014024, " even", false], [892, 0.012988, " which", false]]]}, "raw_delta": 0.07559591764584184, "tuned_delta": 0.08416770967642008}, {"byte_start": 5254, "byte_end": 5255, "display": {"text": ")", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29", "compression": {"rwkv": "0.02%", "qwen": "0.02%"}, "model_tokens": {"rwkv": [[42, ")", "normal", 0.998727023601532]], "qwen": [[8, ")", "normal", 0.9990455508232117]]}, "loss": {"rwkv": 0.022839296034580986, "qwen": 0.017220137660109158}, "topk": {"rwkv": [42, 1, 0.998727023601532, [[42, 0.998727, ")", false], [497, 0.000637, "),", false], [276, 9.6e-05, " )", false], [48, 8.6e-05, "/", false], [98, 7.4e-05, "a", false], [499, 4.8e-05, ").", false], [47, 4.8e-05, ".", false], [580, 3.9e-05, ".)", false], [45, 2.7e-05, ",", false], [46, 1.9e-05, "-", false]]], "qwen": [8, 1, 0.9990455508232117, [[8, 0.999046, ")", false], [701, 0.00022, "),", false], [64, 0.000148, "a", false], [873, 0.000108, " )", false], [13, 4.8e-05, ".", false], [6138, 3.7e-05, ".)", false], [11, 3.5e-05, ",", false], [15, 3.4e-05, "0", false], [323, 2.6e-05, " and", false], [429, 1.9e-05, " that", false]]]}, "raw_delta": 0.0003115923027507961, "tuned_delta": 0.008883384333329044}, {"byte_start": 5255, "byte_end": 5260, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 886, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "7.89% 7.89% 7.89% 7.89% 7.89%", "qwen": "9.24% 9.24% 9.24% 9.24% 9.24%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.11136122792959213]], "qwen": [[419, " this", "normal", 0.07725539803504944]]}, "loss": {"rwkv": 7.889738504861517, "qwen": 9.235550903005239}, "topk": {"rwkv": [32234, 2, 0.11136122792959213, [[32227, 0.199419, " that", false], [32234, 0.111361, " this", false], [22590, 0.085605, " the", false], [39936, 0.050789, " these", false], [32232, 0.045699, " they", false], [32465, 0.041929, " when", false], [4596, 0.026535, " in", false], [32139, 0.025946, " such", false], [59943, 0.02394, " knowledge", false], [39944, 0.022067, " those", false]]], "qwen": [419, 3, 0.07725539803504944, [[279, 0.106956, " the", false], [807, 0.088234, " they", false], [419, 0.077255, " this", false], [429, 0.070534, " that", false], [6540, 0.044582, " knowledge", false], [1493, 0.042293, " these", false], [1846, 0.035526, " those", false], [304, 0.034022, " in", false], [862, 0.026684, " their", false], [15235, 0.026366, " AI", false]]]}, "raw_delta": -0.07462768554687504, "tuned_delta": -0.0660558935162968}, {"byte_start": 5260, "byte_end": 5267, "display": {"text": " always", "kind": "normal"}, "is_word": true, "word_id": 887, "word_key": " always", "bytes_hex": "20 61 6c 77 61 79 73", "compression": {"rwkv": "11.59% 11.59% 11.59% 11.59% 11.59% 11.59% 11.59%", "qwen": "16.09% 16.09% 16.09% 16.09% 16.09% 16.09% 16.09%"}, "model_tokens": {"rwkv": [[45150, " always", "normal", 0.011080559343099594]], "qwen": [[2677, " always", "normal", 0.0019399260636419058]]}, "loss": {"rwkv": 11.593085150000599, "qwen": 16.088897139127845}, "topk": {"rwkv": [45150, 11, 0.011080559343099594, [[59943, 0.251005, " knowledge", false], [21800, 0.201708, " has", false], [4600, 0.065389, " is", false], [39171, 0.044568, " often", false], [55532, 0.03673, " approach", false], [45829, 0.034193, " effort", false], [22748, 0.025524, " was", false], [30659, 0.021778, " does", false], [38964, 0.017035, " makes", false], [38720, 0.012337, " human", false]]], "qwen": [2677, 40, 0.0019399260636419058, [[702, 0.303916, " has", false], [6540, 0.21361, " knowledge", false], [374, 0.076746, " is", false], [5486, 0.04863, " approach", false], [3545, 0.043218, " often", false], [572, 0.026249, " was", false], [5041, 0.01478, " effort", false], [3093, 0.013744, " kind", false], [1558, 0.012532, " does", false], [27236, 0.009465, " tends", false]]]}, "raw_delta": -0.2493007523672921, "tuned_delta": -0.24072896033671384}, {"byte_start": 5267, "byte_end": 5273, "display": {"text": " helps", "kind": "normal"}, "is_word": true, "word_id": 888, "word_key": " helps", "bytes_hex": "20 68 65 6c 70 73", "compression": {"rwkv": "21.32% 21.32% 21.32% 21.32% 21.32% 21.32%", "qwen": "17.04% 17.04% 17.04% 17.04% 17.04% 17.04%"}, "model_tokens": {"rwkv": [[38686, " helps", "normal", 0.0008338545449078083]], "qwen": [[8609, " helps", "normal", 0.0034472723491489887]]}, "loss": {"rwkv": 21.32107905480434, "qwen": 17.04235134776367}, "topk": {"rwkv": [38686, 105, 0.0008338545449078083, [[38964, 0.06304, " makes", false], [21800, 0.059982, " has", false], [40040, 0.056542, " turns", false], [38875, 0.053095, " leads", false], [38442, 0.047763, " fails", false], [39620, 0.042737, " seems", false], [46936, 0.042604, " proved", false], [31351, 0.03373, " made", false], [47638, 0.033328, " turned", false], [45953, 0.029506, " failed", false]]], "qwen": [8609, 48, 0.0034472723491489887, [[11508, 0.082167, " leads", false], [702, 0.055408, " has", false], [4977, 0.051891, " seems", false], [14525, 0.044846, " fails", false], [4041, 0.041755, " comes", false], [6069, 0.035197, " led", false], [18651, 0.033772, " proved", false], [3643, 0.030163, " makes", false], [4641, 0.028432, " failed", false], [10335, 0.025981, " ends", false]]]}, "raw_delta": 0.237263043721517, "tuned_delta": 0.24583483575209525}, {"byte_start": 5273, "byte_end": 5276, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 889, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "8.03% 8.03% 8.03%", "qwen": "6.63% 6.63% 6.63%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.2614516019821167]], "qwen": [[304, " in", "normal", 0.3321073055267334]]}, "loss": {"rwkv": 8.030626692448331, "qwen": 6.626161187735484}, "topk": {"rwkv": [4596, 1, 0.2614516019821167, [[4596, 0.261452, " in", false], [31581, 0.076774, " only", false], [45, 0.072435, ",", false], [32229, 0.070311, " them", false], [332, 0.051969, " a", false], [4424, 0.043171, " at", false], [21700, 0.040395, " for", false], [4811, 0.039668, " to", false], [22590, 0.035948, " the", false], [32465, 0.021311, " when", false]]], "qwen": [304, 1, 0.3321073055267334, [[304, 0.332107, " in", false], [279, 0.083113, " the", false], [1105, 0.073144, " them", false], [264, 0.042835, " a", false], [11, 0.033876, ",", false], [311, 0.032151, " to", false], [979, 0.02858, " when", false], [369, 0.026255, " for", false], [15102, 0.02395, " initially", false], [4124, 0.019933, " early", false]]]}, "raw_delta": 0.07788010438283283, "tuned_delta": 0.08645189641341107}, {"byte_start": 5276, "byte_end": 5280, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 890, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "1.21% 1.21% 1.21% 1.21%", "qwen": "0.72% 0.72% 0.72% 0.72%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.7659869194030762]], "qwen": [[279, " the", "normal", 0.8523589968681335]]}, "loss": {"rwkv": 1.2063551062120847, "qwen": 0.7202089926085409}, "topk": {"rwkv": [22590, 1, 0.7659869194030762, [[22590, 0.765987, " the", false], [32074, 0.070148, " some", false], [39675, 0.019721, " short", false], [332, 0.012314, " a", false], [38576, 0.005521, " games", false], [46639, 0.00543, " narrow", false], [39720, 0.003654, " small", false], [51515, 0.003286, " domains", false], [38328, 0.003227, " early", false], [47535, 0.002907, " theory", false]]], "qwen": [279, 1, 0.8523589968681335, [[279, 0.852359, " the", false], [2805, 0.01926, " short", false], [1045, 0.019121, " some", false], [264, 0.010473, " a", false], [6588, 0.00565, " practice", false], [4862, 0.004612, " training", false], [2613, 0.004378, " small", false], [3793, 0.004265, " terms", false], [3259, 0.003964, " making", false], [862, 0.002562, " their", false]]]}, "raw_delta": 0.026957664638757706, "tuned_delta": 0.035529456669335956}, {"byte_start": 5280, "byte_end": 5286, "display": {"text": " short", "kind": "normal"}, "is_word": true, "word_id": 891, "word_key": " short", "bytes_hex": "20 73 68 6f 72 74", "compression": {"rwkv": "0.29% 0.29% 0.29% 0.29% 0.29% 0.29%", "qwen": "0.38% 0.38% 0.38% 0.38% 0.38% 0.38%"}, "model_tokens": {"rwkv": [[39675, " short", "normal", 0.9099187254905701]], "qwen": [[2805, " short", "normal", 0.8821887969970703]]}, "loss": {"rwkv": 0.2861791310357135, "qwen": 0.37675137560658395}, "topk": {"rwkv": [39675, 1, 0.9099187254905701, [[39675, 0.909919, " short", false], [59220, 0.012985, " beginning", false], [31323, 0.009941, " long", false], [38328, 0.008594, " early", false], [52888, 0.008279, " shorter", false], [38499, 0.006497, " first", false], [31503, 0.004843, " near", false], [52013, 0.004601, " initial", false], [59816, 0.003968, " immediate", false], [32386, 0.003736, " very", false]]], "qwen": [2805, 1, 0.8821887969970703, [[2805, 0.882189, " short", false], [4124, 0.03014, " early", false], [23327, 0.010896, " shorter", false], [13922, 0.009542, " immediate", false], [1602, 0.009541, " very", false], [2856, 0.007255, " initial", false], [7167, 0.005843, " beginning", false], [3143, 0.005533, " near", false], [1293, 0.003011, " long", false], [11051, 0.002668, " medium", false]]]}, "raw_delta": -0.005022391676902771, "tuned_delta": 0.0035494003536754772}, {"byte_start": 5286, "byte_end": 5291, "display": {"text": " term", "kind": "normal"}, "is_word": true, "word_id": 892, "word_key": " term", "bytes_hex": "20 74 65 72 6d", "compression": {"rwkv": "3.75% 3.75% 3.75% 3.75% 3.75%", "qwen": "2.27% 2.27% 2.27% 2.27% 2.27%"}, "model_tokens": {"rwkv": [[32219, " term", "normal", 0.35302820801734924]], "qwen": [[4647, " term", "normal", 0.5326520204544067]]}, "loss": {"rwkv": 3.7476257898092213, "qwen": 2.2718368583409934}, "topk": {"rwkv": [32219, 2, 0.35302820801734924, [[22418, 0.618986, " run", false], [32219, 0.353028, " term", false], [46, 0.0225, "-", false], [4811, 0.000834, " to", false], [4715, 0.000747, " or", false], [21265, 0.000664, " and", false], [8661, 0.000368, "run", false], [32251, 0.00029, " time", false], [45, 0.000235, ",", false], [39438, 0.00019, " range", false]]], "qwen": [4647, 1, 0.5326520204544067, [[4647, 0.532652, " term", false], [1598, 0.433524, " run", false], [9663, 0.017027, "-term", false], [22973, 0.007456, "-run", false], [311, 0.001493, " to", false], [882, 0.001204, " time", false], [323, 0.001141, " and", false], [11, 0.000983, ",", false], [12, 0.000648, "-", false], [4686, 0.000535, "-to", false]]]}, "raw_delta": 0.08183511495590212, "tuned_delta": 0.09040690698648036}, {"byte_start": 5291, "byte_end": 5292, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "4.61%", "qwen": "7.41%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.775114893913269]], "qwen": [[11, ",", "normal", 0.6631759405136108]]}, "loss": {"rwkv": 4.61408814346812, "qwen": 7.406705344419314}, "topk": {"rwkv": [45, 1, 0.775114893913269, [[45, 0.775115, ",", false], [21400, 0.097752, " but", false], [275, 0.036147, " (", false], [21265, 0.029023, " and", false], [32465, 0.008431, " when", false], [5346, 0.005627, "---", false], [4450, 0.004008, " by", false], [4596, 0.003845, " in", false], [51018, 0.002883, " because", false], [4424, 0.002792, " at", false]]], "qwen": [11, 1, 0.6631759405136108, [[11, 0.663176, ",", false], [714, 0.176976, " but", false], [320, 0.032339, " (", false], [323, 0.030976, " and", false], [220, 0.013957, " ", false], [979, 0.011009, " when", false], [553, 0.010002, " by", false], [4421, 0.009404, "---", false], [1576, 0.007255, " because", false], [304, 0.005778, " in", false]]]}, "raw_delta": -0.15485557913780212, "tuned_delta": -0.14628378710722387}, {"byte_start": 5292, "byte_end": 5296, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 893, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "6.38% 6.38% 6.38% 6.38%", "qwen": "6.55% 6.55% 6.55% 6.55%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.2431361973285675]], "qwen": [[323, " and", "normal", 0.23368458449840546]]}, "loss": {"rwkv": 6.37519048830328, "qwen": 6.55426742351418}, "topk": {"rwkv": [21265, 3, 0.2431361973285675, [[21400, 0.359584, " but", false], [286, 0.278356, " 3", false], [21265, 0.243136, " and", false], [32465, 0.008133, " when", false], [30788, 0.007754, " even", false], [40076, 0.007155, " until", false], [4423, 0.006963, " as", false], [51018, 0.006009, " because", false], [4596, 0.004779, " in", false], [39171, 0.004488, " often", false]]], "qwen": [323, 3, 0.23368458449840546, [[714, 0.386545, " but", false], [220, 0.264845, " ", false], [323, 0.233685, " and", false], [1496, 0.014745, " even", false], [979, 0.008836, " when", false], [1576, 0.006399, " because", false], [438, 0.006186, " as", false], [518, 0.004264, " at", false], [3602, 0.00402, " yet", false], [5310, 0.003229, " especially", false]]]}, "raw_delta": -0.009930133819580078, "tuned_delta": -0.00135834178900183}, {"byte_start": 5296, "byte_end": 5299, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 894, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "35.32% 35.32% 35.32%", "qwen": "36.50% 36.50% 36.50%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.0027636028826236725]], "qwen": [[374, " is", "normal", 0.0023053758777678013]]}, "loss": {"rwkv": 35.31597235509441, "qwen": 36.50326031808084}, "topk": {"rwkv": [4600, 9, 0.0027636028826236725, [[286, 0.91861, " 3", false], [39171, 0.007677, " often", false], [45, 0.006756, ",", false], [60523, 0.005081, " sometimes", false], [32230, 0.004573, " then", false], [31581, 0.004088, " only", false], [32227, 0.003895, " that", false], [4596, 0.003376, " in", false], [4600, 0.002764, " is", false], [61959, 0.001976, " eventually", false]]], "qwen": [374, 10, 0.0023053758777678013, [[220, 0.928814, " ", false], [1172, 0.006544, " only", false], [1221, 0.005395, " then", false], [304, 0.005333, " in", false], [11, 0.003971, ",", false], [7025, 0.002931, " sometimes", false], [429, 0.002917, " that", false], [279, 0.002799, " the", false], [3545, 0.002413, " often", false], [374, 0.002305, " is", false]]]}, "raw_delta": -0.0658372243245442, "tuned_delta": -0.05726543229396595}, {"byte_start": 5299, "byte_end": 5310, "display": {"text": " personally", "kind": "normal"}, "is_word": true, "word_id": 895, "word_key": " personally", "bytes_hex": "20 70 65 72 73 6f 6e 61 6c 6c 79", "compression": {"rwkv": "13.22% 13.22% 13.22% 13.22% 13.22% 13.22% 13.22% 13.22% 13.22% 13.22% 13.22%", "qwen": "17.72% 17.72% 17.72% 17.72% 17.72% 17.72% 17.72% 17.72% 17.72% 17.72% 17.72%"}, "model_tokens": {"rwkv": [[62309, " personally", "normal", 0.000304235378280282]], "qwen": [[15726, " personally", "normal", 2.0252231479389593e-05]]}, "loss": {"rwkv": 13.217873599053709, "qwen": 17.717680834502143}, "topk": {"rwkv": [62309, 245, 0.000304235378280282, [[39171, 0.140777, " often", false], [332, 0.053596, " a", false], [60645, 0.042091, " therefore", false], [22187, 0.032508, " not", false], [60523, 0.03211, " sometimes", false], [45150, 0.029338, " always", false], [32386, 0.026068, " very", false], [30724, 0.025437, " easy", false], [32239, 0.022997, " thus", false], [57403, 0.020189, " tempting", false]]], "qwen": [15726, 1258, 2.0252231479389593e-05, [[3545, 0.115149, " often", false], [264, 0.065454, " a", false], [279, 0.055977, " the", false], [6966, 0.035276, " looked", false], [2677, 0.031695, " always", false], [7025, 0.025693, " sometimes", false], [8916, 0.023796, " therefore", false], [537, 0.022601, " not", false], [3884, 0.020386, " seen", false], [5310, 0.019291, " especially", false]]]}, "raw_delta": -0.24952229586514554, "tuned_delta": -0.2409505038345673}, {"byte_start": 5310, "byte_end": 5321, "display": {"text": " satisfying", "kind": "normal"}, "is_word": true, "word_id": 896, "word_key": " satisfying", "bytes_hex": "20 73 61 74 69 73 66 79 69 6e 67", "compression": {"rwkv": "1.35% 1.35% 1.35% 1.35% 1.35% 1.35% 1.35% 1.35% 1.35% 1.35% 1.35%", "qwen": "0.86% 0.86% 0.86% 0.86% 0.86% 0.86% 0.86% 0.86% 0.86% 0.86% 0.86%"}, "model_tokens": {"rwkv": [[62527, " satisfying", "normal", 0.4378766119480133]], "qwen": [[36054, " satisfying", "normal", 0.5923541188240051]]}, "loss": {"rwkv": 1.3512457991280684, "qwen": 0.858486580051204}, "topk": {"rwkv": [62527, 1, 0.4378766119480133, [[62527, 0.437877, " satisfying", false], [31004, 0.107398, " grat", false], [59154, 0.107104, " appealing", false], [60428, 0.096222, " rewarding", false], [61694, 0.034863, " comforting", false], [32386, 0.025518, " very", false], [21265, 0.021764, " and", false], [56874, 0.021491, " pleasing", false], [61617, 0.018987, " attractive", false], [62029, 0.007011, " fulfilling", false]]], "qwen": [36054, 1, 0.5923541188240051, [[36054, 0.592354, " satisfying", false], [40993, 0.13555, " rewarding", false], [8728, 0.07889, " grat", false], [49598, 0.032174, " fulfilling", false], [1602, 0.013924, " very", false], [32252, 0.01271, " appealing", false], [68030, 0.008722, " comforting", false], [88589, 0.008718, " motivating", false], [18879, 0.007923, " attractive", false], [5390, 0.007654, " useful", false]]]}, "raw_delta": 0.027324373071843933, "tuned_delta": 0.03589616510242218}, {"byte_start": 5321, "byte_end": 5324, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 897, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "8.88% 8.88% 8.88%", "qwen": "10.03% 10.03% 10.03%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.2312353104352951]], "qwen": [[311, " to", "normal", 0.18857607245445251]]}, "loss": {"rwkv": 8.875955817969208, "qwen": 10.02825677701511}, "topk": {"rwkv": [4811, 2, 0.2312353104352951, [[45, 0.579151, ",", false], [4811, 0.231235, " to", false], [21700, 0.060822, " for", false], [21265, 0.035763, " and", false], [4596, 0.024416, " in", false], [275, 0.010831, " (", false], [4423, 0.009268, " as", false], [51018, 0.007781, " because", false], [47, 0.005236, ".", false], [21400, 0.004564, " but", false]]], "qwen": [311, 2, 0.18857607245445251, [[11, 0.56908, ",", false], [311, 0.188576, " to", false], [369, 0.075684, " for", false], [304, 0.048536, " in", false], [323, 0.025997, " and", false], [320, 0.018352, " (", false], [1576, 0.011494, " because", false], [979, 0.007177, " when", false], [714, 0.006805, " but", false], [518, 0.006291, " at", false]]]}, "raw_delta": -0.06389713287353516, "tuned_delta": -0.055325340842956906}, {"byte_start": 5324, "byte_end": 5328, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 898, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "2.68% 2.68% 2.68% 2.68%", "qwen": "2.68% 2.68% 2.68% 2.68%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.559503436088562]], "qwen": [[279, " the", "normal", 0.5514378547668457]]}, "loss": {"rwkv": 2.6768755641494435, "qwen": 2.6835307552920504}, "topk": {"rwkv": [22590, 1, 0.559503436088562, [[22590, 0.559503, " the", false], [63843, 0.091696, " researchers", false], [4491, 0.072447, " do", false], [39944, 0.046482, " those", false], [32229, 0.034027, " them", false], [31059, 0.016784, " have", false], [31370, 0.013396, " many", false], [32499, 0.011874, " work", false], [332, 0.010146, " a", false], [3609, 0.008619, " AI", false]]], "qwen": [279, 1, 0.5514378547668457, [[279, 0.551438, " the", false], [11811, 0.121601, " researchers", false], [653, 0.081151, " do", false], [1846, 0.069355, " those", false], [1936, 0.029654, " build", false], [1105, 0.010795, " them", false], [1430, 0.008679, " try", false], [1657, 0.007836, " many", false], [15235, 0.004722, " AI", false], [1490, 0.004643, " see", false]]]}, "raw_delta": -0.00036904215812683105, "tuned_delta": 0.008202749872451417}, {"byte_start": 5328, "byte_end": 5339, "display": {"text": " researcher", "kind": "normal"}, "is_word": true, "word_id": 899, "word_key": " researcher", "bytes_hex": "20 72 65 73 65 61 72 63 68 65 72", "compression": {"rwkv": "1.47% 1.47% 1.47% 1.47% 1.47% 1.47% 1.47% 1.47% 1.47% 1.47% 1.47%", "qwen": "2.10% 2.10% 2.10% 2.10% 2.10% 2.10% 2.10% 2.10% 2.10% 2.10% 2.10%"}, "model_tokens": {"rwkv": [[62496, " researcher", "normal", 0.4059281349182129]], "qwen": [[31085, " researcher", "normal", 0.2772934138774872]]}, "loss": {"rwkv": 1.4729219611348614, "qwen": 2.1028576694971903}, "topk": {"rwkv": [62496, 1, 0.4059281349182129, [[62496, 0.405928, " researcher", false], [63843, 0.350129, " researchers", false], [37636, 0.06722, " agent", false], [3609, 0.037711, " AI", false], [38720, 0.021742, " human", false], [45124, 0.018909, " agents", false], [62105, 0.009099, " individual", false], [46787, 0.007936, " people", false], [57103, 0.004754, " research", false], [64951, 0.004345, " investigators", false]]], "qwen": [31085, 2, 0.2772934138774872, [[11811, 0.537529, " researchers", false], [31085, 0.277293, " researcher", false], [3738, 0.018354, " human", false], [13402, 0.012415, " developers", false], [8315, 0.01054, " agent", false], [1251, 0.010197, " people", false], [15235, 0.007937, " AI", false], [3412, 0.007739, " research", false], [3842, 0.007146, " individual", false], [12014, 0.007041, " authors", false]]]}, "raw_delta": -0.034931052814830436, "tuned_delta": -0.026359260784252186}, {"byte_start": 5339, "byte_end": 5340, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "2.82%", "qwen": "4.25%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8550218939781189]], "qwen": [[11, ",", "normal", 0.7900545597076416]]}, "loss": {"rwkv": 2.8177637517362566, "qwen": 4.249697752169408}, "topk": {"rwkv": [45, 1, 0.8550218939781189, [[45, 0.855022, ",", false], [22762, 0.026986, " who", false], [21265, 0.019284, " and", false], [275, 0.015934, " (", false], [47, 0.009862, ".", false], [4596, 0.007708, " in", false], [286, 0.00665, " 3", false], [51018, 0.006173, " because", false], [4811, 0.004574, " to", false], [60, 0.003876, ";", false]]], "qwen": [11, 1, 0.7900545597076416, [[11, 0.790055, ",", false], [879, 0.068329, " who", false], [320, 0.024808, " (", false], [4421, 0.010228, "---", false], [323, 0.00911, " and", false], [4460, 0.008482, " trying", false], [311, 0.007447, " to", false], [13, 0.006437, ".", false], [3730, 0.00533, " doing", false], [1576, 0.004422, " because", false]]]}, "raw_delta": -0.07940328121185303, "tuned_delta": -0.07083148918127478}, {"byte_start": 5340, "byte_end": 5344, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 900, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"rwkv": "6.06% 6.06% 6.06% 6.06%", "qwen": "4.45% 4.45% 4.45% 4.45%"}, "model_tokens": {"rwkv": [[21400, " but", "normal", 0.26175305247306824]], "qwen": [[714, " but", "normal", 0.37229880690574646]]}, "loss": {"rwkv": 6.058192066232952, "qwen": 4.45458444626276}, "topk": {"rwkv": [21400, 3, 0.26175305247306824, [[286, 0.423515, " 3", false], [21265, 0.266668, " and", false], [21400, 0.261753, " but", false], [22762, 0.008996, " who", false], [30788, 0.003798, " even", false], [51018, 0.003428, " because", false], [4423, 0.002328, " as", false], [40187, 0.002235, " while", false], [4788, 0.002218, " so", false], [22797, 0.001451, " yet", false]]], "qwen": [714, 1, 0.37229880690574646, [[714, 0.372299, " but", false], [323, 0.322522, " and", false], [220, 0.249809, " ", false], [1496, 0.006742, " even", false], [1576, 0.006304, " because", false], [3602, 0.003455, " yet", false], [438, 0.003381, " as", false], [1393, 0.002528, " while", false], [773, 0.002484, " so", false], [5310, 0.001837, " especially", false]]]}, "raw_delta": 0.0889228880405426, "tuned_delta": 0.09749468007112085}, {"byte_start": 5344, "byte_end": 5346, "display": {"text": " 3", "kind": "normal"}, "is_word": true, "word_id": 901, "word_key": " 3", "bytes_hex": "20 33", "compression": {"rwkv": "2.91% 2.91%", "qwen": "4.66% 0.05%"}, "model_tokens": {"rwkv": [[286, " 3", "normal", 0.7265291213989258]], "qwen": [[220, " ", "normal", 0.7723115682601929], [18, "3", "normal", 0.9974400997161865]]}, "loss": {"rwkv": 2.9058188689780144, "qwen": 2.35276879806534}, "topk": {"rwkv": [286, 1, 0.7265291213989258, [[286, 0.726529, " 3", false], [45, 0.033719, ",", false], [4600, 0.025319, " is", false], [4596, 0.019004, " in", false], [4601, 0.018985, " it", false], [32227, 0.013282, " that", false], [31601, 0.012459, " over", false], [61959, 0.011353, " eventually", false], [62676, 0.010438, " ultimately", false], [30659, 0.00992, " does", false]]], "qwen": [220, 1, 0.7723115682601929, [[220, 0.772312, " ", false], [374, 0.023632, " is", false], [1558, 0.023287, " does", false], [304, 0.022494, " in", false], [432, 0.015446, " it", false], [537, 0.010833, " not", false], [2581, 0.007654, " never", false], [1172, 0.007199, " only", false], [13653, 0.006963, " ultimately", false], [279, 0.00546, " the", false]]]}, "raw_delta": 0.030667607788927853, "tuned_delta": 0.0392393998195061}, {"byte_start": 5346, "byte_end": 5347, "display": {"text": ")", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29", "compression": {"rwkv": "0.01%", "qwen": "0.01%"}, "model_tokens": {"rwkv": [[42, ")", "normal", 0.9992398023605347]], "qwen": [[8, ")", "normal", 0.9994556307792664]]}, "loss": {"rwkv": 0.013827405129369813, "qwen": 0.009819685564566784}, "topk": {"rwkv": [42, 1, 0.9992398023605347, [[42, 0.99924, ")", false], [497, 0.000284, "),", false], [499, 4.7e-05, ").", false], [47, 4.6e-05, ".", false], [276, 4.5e-05, " )", false], [45, 3.8e-05, ",", false], [98, 2.8e-05, "a", false], [4600, 2.5e-05, " is", false], [30659, 1.8e-05, " does", false], [4596, 1.2e-05, " in", false]]], "qwen": [8, 1, 0.9994556307792664, [[8, 0.999456, ")", false], [64, 0.000158, "a", false], [701, 4.8e-05, "),", false], [873, 3e-05, " )", false], [11, 2.3e-05, ",", false], [65, 1.3e-05, "b", false], [13, 1.3e-05, ".", false], [340, 1.2e-05, ")\n", false], [692, 1.1e-05, ")\n\n", false], [568, 1e-05, ").", false]]]}, "raw_delta": 0.00022223516134545207, "tuned_delta": 0.0087940271919237}, {"byte_start": 5347, "byte_end": 5350, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 902, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "13.24% 13.24% 13.24%", "qwen": "12.09% 12.09% 12.09%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.11017217487096786]], "qwen": [[304, " in", "normal", 0.1338699460029602]]}, "loss": {"rwkv": 13.243489633160404, "qwen": 12.087900939105507}, "topk": {"rwkv": [4596, 2, 0.11017217487096786, [[4601, 0.222461, " it", false], [4596, 0.110172, " in", false], [22590, 0.107652, " the", false], [32234, 0.077103, " this", false], [31601, 0.042091, " over", false], [32227, 0.032452, " that", false], [32465, 0.02627, " when", false], [61959, 0.02495, " eventually", false], [4423, 0.018162, " as", false], [31578, 0.014734, " once", false]]], "qwen": [304, 2, 0.1338699460029602, [[432, 0.22157, " it", false], [304, 0.13387, " in", false], [279, 0.106598, " the", false], [419, 0.075664, " this", false], [9583, 0.036889, " eventually", false], [916, 0.021513, " over", false], [979, 0.021205, " when", false], [438, 0.015544, " as", false], [13653, 0.013909, " ultimately", false], [1493, 0.012713, " these", false]]]}, "raw_delta": 0.06407944361368811, "tuned_delta": 0.07265123564426636}, {"byte_start": 5350, "byte_end": 5354, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 903, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "0.63% 0.63% 0.63% 0.63%", "qwen": "0.35% 0.35% 0.35% 0.35%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.8694505095481873]], "qwen": [[279, " the", "normal", 0.9242848753929138]]}, "loss": {"rwkv": 0.6295940882785698, "qwen": 0.35497037750131616}, "topk": {"rwkv": [22590, 1, 0.8694505095481873, [[22590, 0.869451, " the", false], [51832, 0.030552, " general", false], [56901, 0.02449, " practice", false], [332, 0.012814, " a", false], [31461, 0.007921, " most", false], [45145, 0.004309, " almost", false], [30808, 0.003205, " fact", false], [31323, 0.00295, " long", false], [21256, 0.002759, " all", false], [31370, 0.002502, " many", false]]], "qwen": [279, 1, 0.9242848753929138, [[279, 0.924285, " the", false], [6588, 0.021992, " practice", false], [4586, 0.005897, " general", false], [2097, 0.004719, " fact", false], [76553, 0.003382, " retrospect", false], [8729, 0.003154, " reality", false], [1429, 0.003066, " most", false], [264, 0.002704, " a", false], [1657, 0.002187, " many", false], [3793, 0.002115, " terms", false]]]}, "raw_delta": 0.015228372067213058, "tuned_delta": 0.02380016409779131}, {"byte_start": 5354, "byte_end": 5359, "display": {"text": " long", "kind": "normal"}, "is_word": true, "word_id": 904, "word_key": " long", "bytes_hex": "20 6c 6f 6e 67", "compression": {"rwkv": "0.46% 0.46% 0.46% 0.46% 0.46%", "qwen": "0.23% 0.23% 0.23% 0.23% 0.23%"}, "model_tokens": {"rwkv": [[31323, " long", "normal", 0.8808698058128357]], "qwen": [[1293, " long", "normal", 0.9382081031799316]]}, "loss": {"rwkv": 0.4578866096571417, "qwen": 0.23005022816518658}, "topk": {"rwkv": [31323, 1, 0.8808698058128357, [[31323, 0.88087, " long", false], [46470, 0.079796, " longer", false], [21616, 0.012357, " end", false], [32386, 0.004316, " very", false], [50837, 0.002124, " absence", false], [46536, 0.002025, " medium", false], [31466, 0.001539, " much", false], [39675, 0.000905, " short", false], [30405, 0.000877, " case", false], [46397, 0.000751, " larger", false]]], "qwen": [1293, 1, 0.9382081031799316, [[1293, 0.938208, " long", false], [5021, 0.030905, " longer", false], [835, 0.014702, " end", false], [11051, 0.003611, " medium", false], [1602, 0.001793, " very", false], [2805, 0.001152, " short", false], [3930, 0.000565, " limit", false], [3853, 0.000481, " future", false], [1931, 0.000452, " real", false], [19265, 0.000355, " absence", false]]]}, "raw_delta": 0.012633931636810303, "tuned_delta": 0.02120572366738855}, {"byte_start": 5359, "byte_end": 5363, "display": {"text": " run", "kind": "normal"}, "is_word": true, "word_id": 905, "word_key": " run", "bytes_hex": "20 72 75 6e", "compression": {"rwkv": "1.63% 1.63% 1.63% 1.63%", "qwen": "1.93% 1.93% 1.93% 1.93%"}, "model_tokens": {"rwkv": [[22418, " run", "normal", 0.696638822555542]], "qwen": [[1598, " run", "normal", 0.6518276333808899]]}, "loss": {"rwkv": 1.6290196689725231, "qwen": 1.929492304993734}, "topk": {"rwkv": [22418, 1, 0.696638822555542, [[22418, 0.696639, " run", false], [32219, 0.29224, " term", false], [46, 0.007287, "-", false], [31057, 0.000752, " haul", false], [32251, 0.000254, " time", false], [45, 0.000249, ",", false], [27132, 0.000197, "term", false], [39438, 0.000183, " range", false], [39920, 0.000141, " terms", false], [32186, 0.000122, " tail", false]]], "qwen": [1598, 1, 0.6518276333808899, [[1598, 0.651828, " run", false], [4647, 0.340334, " term", false], [9663, 0.004076, "-term", false], [22973, 0.00116, "-run", false], [11, 0.000488, ",", false], [37868, 0.000388, " haul", false], [882, 0.000245, " time", false], [3793, 0.000145, " terms", false], [320, 9.5e-05, " (", false], [835, 7.2e-05, " end", false]]]}, "raw_delta": -0.016661740839481354, "tuned_delta": -0.008089948808903106}, {"byte_start": 5363, "byte_end": 5366, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 906, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "10.05% 10.05% 10.05%", "qwen": "9.72% 9.72% 9.72%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.1925484836101532]], "qwen": [[432, " it", "normal", 0.19834871590137482]]}, "loss": {"rwkv": 10.050024047859313, "qwen": 9.724538281968906}, "topk": {"rwkv": [4601, 2, 0.1925484836101532, [[45, 0.570428, ",", false], [4601, 0.192548, " it", false], [32234, 0.07024, " this", false], [22590, 0.046824, " the", false], [39936, 0.011848, " these", false], [32139, 0.011633, " such", false], [275, 0.005885, " (", false], [32227, 0.005665, " that", false], [4600, 0.003679, " is", false], [39934, 0.00306, " there", false]]], "qwen": [432, 2, 0.19834871590137482, [[11, 0.483205, ",", false], [432, 0.198349, " it", false], [279, 0.080016, " the", false], [419, 0.063814, " this", false], [34447, 0.010684, " computation", false], [1052, 0.00918, " there", false], [1493, 0.007101, " these", false], [678, 0.006852, " all", false], [6540, 0.006494, " knowledge", false], [320, 0.006237, " (", false]]]}, "raw_delta": 0.018048763275146484, "tuned_delta": 0.026620555305724734}, {"byte_start": 5366, "byte_end": 5375, "display": {"text": " plateaus", "kind": "normal"}, "is_word": true, "word_id": 907, "word_key": " plateaus", "bytes_hex": "20 70 6c 61 74 65 61 75 73", "compression": {"rwkv": "30.01% 30.01% 30.01% 30.01% 30.01% 30.01% 30.01% 30.01% 0.13%", "qwen": "45.10% 45.10% 45.10% 45.10% 45.10% 45.10% 0.02% 0.02% 0.02%"}, "model_tokens": {"rwkv": [[52488, " plateau", "normal", 1.6992586324704462e-06], [116, "s", "normal", 0.9926484227180481]], "qwen": [[11968, " plate", "normal", 3.0405055895244004e-07], [11855, "aus", "normal", 0.9973642230033875]]}, "loss": {"rwkv": 26.689628334750797, "qwen": 30.073601910940067}, "topk": {"rwkv": [52488, 1640, 1.6992586324704462e-06, [[4600, 0.294624, " is", false], [30659, 0.109196, " does", false], [45150, 0.05864, " always", false], [39115, 0.052263, " never", false], [21800, 0.03202, " has", false], [45145, 0.023423, " almost", false], [39914, 0.020226, " tends", false], [38964, 0.018081, " makes", false], [39171, 0.016802, " often", false], [38724, 0.016613, " hurts", false]]], "qwen": [11968, 3160, 3.0405055895244004e-07, [[374, 0.266822, " is", false], [1558, 0.1476, " does", false], [2677, 0.056765, " always", false], [43064, 0.033064, " hurts", false], [9044, 0.026317, " becomes", false], [702, 0.025968, " has", false], [305, 0.023234, " h", false], [1172, 0.021983, " only", false], [2581, 0.021418, " never", false], [83396, 0.020202, " harms", false]]]}, "raw_delta": -0.18764733947399576, "tuned_delta": -0.1790755474434175}, {"byte_start": 5375, "byte_end": 5379, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 908, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "6.73% 6.73% 6.73% 6.73%", "qwen": "6.21% 6.21% 6.21% 6.21%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.22643521428108215]], "qwen": [[323, " and", "normal", 0.25207898020744324]]}, "loss": {"rwkv": 6.727410957270312, "qwen": 6.212663121117438}, "topk": {"rwkv": [21265, 3, 0.22643521428108215, [[45, 0.35756, ",", false], [4715, 0.231589, " or", false], [21265, 0.226435, " and", false], [4596, 0.037887, " in", false], [22249, 0.032709, " out", false], [275, 0.013597, " (", false], [4424, 0.01314, " at", false], [47, 0.01166, ".", false], [4423, 0.008217, " as", false], [40187, 0.005346, " while", false]]], "qwen": [323, 2, 0.25207898020744324, [[11, 0.284829, ",", false], [323, 0.252079, " and", false], [476, 0.094555, " or", false], [4421, 0.054411, "---", false], [5068, 0.052599, " performance", false], [518, 0.037941, " at", false], [279, 0.025653, " the", false], [304, 0.02063, " in", false], [320, 0.018466, " (", false], [13, 0.016911, ".", false]]]}, "raw_delta": 0.028543680906295776, "tuned_delta": 0.037115472936874026}, {"byte_start": 5379, "byte_end": 5384, "display": {"text": " even", "kind": "normal"}, "is_word": true, "word_id": 909, "word_key": " even", "bytes_hex": "20 65 76 65 6e", "compression": {"rwkv": "13.58% 13.58% 13.58% 13.58% 13.58%", "qwen": "10.78% 10.78% 10.78% 10.78% 10.78%"}, "model_tokens": {"rwkv": [[30788, " even", "normal", 0.022958513349294662]], "qwen": [[1496, " even", "normal", 0.05034052953124046]]}, "loss": {"rwkv": 13.581621283368756, "qwen": 10.780339488977937}, "topk": {"rwkv": [30788, 7, 0.022958513349294662, [[32230, 0.113568, " then", false], [4600, 0.086859, " is", false], [30659, 0.068003, " does", false], [51019, 0.050926, " becomes", false], [22590, 0.045561, " the", false], [61959, 0.045538, " eventually", false], [30788, 0.022959, " even", false], [39115, 0.021391, " never", false], [39171, 0.021272, " often", false], [38442, 0.018677, " fails", false]]], "qwen": [1496, 5, 0.05034052953124046, [[1221, 0.112166, " then", false], [9044, 0.086393, " becomes", false], [374, 0.068139, " is", false], [1558, 0.066127, " does", false], [1496, 0.050341, " even", false], [14525, 0.038145, " fails", false], [9583, 0.037363, " eventually", false], [3545, 0.026048, " often", false], [279, 0.025496, " the", false], [17066, 0.022589, " falls", false]]]}, "raw_delta": 0.1553360462188721, "tuned_delta": 0.16390783824945035}, {"byte_start": 5384, "byte_end": 5393, "display": {"text": " inhibits", "kind": "normal"}, "is_word": true, "word_id": 910, "word_key": " inhibits", "bytes_hex": "20 69 6e 68 69 62 69 74 73", "compression": {"rwkv": "10.21% 10.21% 10.21% 10.21% 10.21% 10.21% 10.21% 10.21% 0.01%", "qwen": "20.57% 20.57% 20.57% 20.57% 20.57% 20.57% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[52011, " inhibit", "normal", 0.010673652403056622], [116, "s", "normal", 0.9995808005332947]], "qwen": [[20142, " inhib", "normal", 0.0010657573584467173], [1199, "its", "normal", 0.9995834231376648]]}, "loss": {"rwkv": 9.08030178188771, "qwen": 13.714591980118762}, "topk": {"rwkv": [52011, 26, 0.010673652403056622, [[38724, 0.084977, " hurts", false], [55929, 0.064589, " declines", false], [52688, 0.057091, " regress", false], [46201, 0.05617, " hinder", false], [51417, 0.048086, " degrade", false], [31049, 0.03523, " harm", false], [51019, 0.029307, " becomes", false], [59456, 0.029264, " decreases", false], [30218, 0.02554, " back", false], [30965, 0.024325, " gets", false]]], "qwen": [20142, 91, 0.0010657573584467173, [[56954, 0.174928, " declines", false], [46193, 0.106602, " wors", false], [17066, 0.083355, " falls", false], [38336, 0.071724, " deterior", false], [9044, 0.038606, " becomes", false], [42054, 0.033706, " decreases", false], [5221, 0.029796, " gets", false], [5780, 0.026763, " goes", false], [14525, 0.019451, " fails", false], [69170, 0.017272, " slows", false]]]}, "raw_delta": -0.2569796147840355, "tuned_delta": -0.24840782275345727}, {"byte_start": 5393, "byte_end": 5401, "display": {"text": " further", "kind": "normal"}, "is_word": true, "word_id": 911, "word_key": " further", "bytes_hex": "20 66 75 72 74 68 65 72", "compression": {"rwkv": "6.13% 6.13% 6.13% 6.13% 6.13% 6.13% 6.13% 6.13%", "qwen": "5.51% 5.51% 5.51% 5.51% 5.51% 5.51% 5.51% 5.51%"}, "model_tokens": {"rwkv": [[51816, " further", "normal", 0.06583872437477112]], "qwen": [[4623, " further", "normal", 0.0866326093673706]]}, "loss": {"rwkv": 6.128636160026358, "qwen": 5.513978227529439}, "topk": {"rwkv": [51816, 3, 0.06583872437477112, [[56950, 0.604828, " progress", false], [22590, 0.073033, " the", false], [51816, 0.065839, " further", false], [63750, 0.054296, " performance", false], [56537, 0.025818, " learning", false], [63621, 0.023078, " improvement", false], [57103, 0.022705, " research", false], [45, 0.020699, ",", false], [46064, 0.00738, " future", false], [63469, 0.007257, " development", false]]], "qwen": [4623, 3, 0.0866326093673706, [[5098, 0.393611, " progress", false], [5068, 0.238207, " performance", false], [4623, 0.086633, " further", false], [279, 0.064738, " the", false], [15673, 0.021279, " improvement", false], [3853, 0.013209, " future", false], [3412, 0.01273, " research", false], [2393, 0.009553, " success", false], [1293, 0.009438, " long", false], [11, 0.009293, ",", false]]]}, "raw_delta": 0.03408387303352356, "tuned_delta": 0.04265566506410181}, {"byte_start": 5401, "byte_end": 5410, "display": {"text": " progress", "kind": "normal"}, "is_word": true, "word_id": 912, "word_key": " progress", "bytes_hex": "20 70 72 6f 67 72 65 73 73", "compression": {"rwkv": "0.53% 0.53% 0.53% 0.53% 0.53% 0.53% 0.53% 0.53% 0.53%", "qwen": "0.73% 0.73% 0.73% 0.73% 0.73% 0.73% 0.73% 0.73% 0.73%"}, "model_tokens": {"rwkv": [[56950, " progress", "normal", 0.7676780223846436]], "qwen": [[5098, " progress", "normal", 0.6947980523109436]]}, "loss": {"rwkv": 0.5283307034505481, "qwen": 0.7296311412600225}, "topk": {"rwkv": [56950, 1, 0.7676780223846436, [[56950, 0.767678, " progress", false], [63621, 0.064471, " improvement", false], [57103, 0.03445, " research", false], [63469, 0.026276, " development", false], [63750, 0.017198, " performance", false], [56537, 0.0125, " learning", false], [64423, 0.009459, " improvements", false], [46132, 0.007171, " growth", false], [55465, 0.005687, " advances", false], [53052, 0.00488, " success", false]]], "qwen": [5098, 1, 0.6947980523109436, [[5098, 0.694798, " progress", false], [15673, 0.081768, " improvement", false], [5068, 0.06162, " performance", false], [19619, 0.038062, " gains", false], [18142, 0.027084, " improvements", false], [29903, 0.015329, " advances", false], [4401, 0.011739, " development", false], [2393, 0.011474, " success", false], [3412, 0.004793, " research", false], [11912, 0.004657, " advance", false]]]}, "raw_delta": -0.011162466473049588, "tuned_delta": -0.0025906744424713402}, {"byte_start": 5410, "byte_end": 5411, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "16.84%", "qwen": "24.12%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.39145898818969727]], "qwen": [[11, ",", "normal", 0.2625139057636261]]}, "loss": {"rwkv": 16.83613841662413, "qwen": 24.11917802360319}, "topk": {"rwkv": [45, 2, 0.39145898818969727, [[47, 0.44562, ".", false], [45, 0.391459, ",", false], [21265, 0.018936, " and", false], [4450, 0.015545, " by", false], [4596, 0.015309, " in", false], [5346, 0.015023, "---", false], [51018, 0.014348, " because", false], [4423, 0.014031, " as", false], [275, 0.01284, " (", false], [60, 0.007438, ";", false]]], "qwen": [11, 2, 0.2625139057636261, [[13, 0.474898, ".", false], [11, 0.262514, ",", false], [382, 0.117923, ".\n\n", false], [304, 0.022742, " in", false], [1576, 0.016775, " because", false], [320, 0.014746, " (", false], [323, 0.010745, " and", false], [553, 0.010258, " by", false], [4421, 0.008457, "---", false], [624, 0.007372, ".\n", false]]]}, "raw_delta": -0.4038574695587158, "tuned_delta": -0.3952856775281376}, {"byte_start": 5411, "byte_end": 5415, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 913, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "2.89% 2.89% 2.89% 2.89%", "qwen": "2.82% 2.82% 2.82% 2.82%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.5252609848976135]], "qwen": [[323, " and", "normal", 0.535361111164093]]}, "loss": {"rwkv": 2.8882078455296627, "qwen": 2.8169242614217325}, "topk": {"rwkv": [21265, 1, 0.5252609848976135, [[21265, 0.525261, " and", false], [287, 0.108301, " 4", false], [51018, 0.057239, " because", false], [40187, 0.045891, " while", false], [4423, 0.03307, " as", false], [53339, 0.019971, " whereas", false], [4715, 0.009878, " or", false], [32465, 0.0089, " when", false], [61953, 0.008477, " especially", false], [40186, 0.008407, " which", false]]], "qwen": [323, 1, 0.535361111164093, [[323, 0.535361, " and", false], [220, 0.107731, " ", false], [1576, 0.095174, " because", false], [438, 0.060538, " as", false], [1393, 0.013686, " while", false], [1496, 0.010414, " even", false], [4152, 0.009644, " due", false], [2474, 0.009604, " since", false], [304, 0.008119, " in", false], [773, 0.007076, " so", false]]]}, "raw_delta": 0.00395280122756958, "tuned_delta": 0.012524593258147828}, {"byte_start": 5415, "byte_end": 5417, "display": {"text": " 4", "kind": "normal"}, "is_word": true, "word_id": 914, "word_key": " 4", "bytes_hex": "20 34", "compression": {"rwkv": "1.51% 1.51%", "qwen": "2.80% 0.02%"}, "model_tokens": {"rwkv": [[287, " 4", "normal", 0.8443912863731384]], "qwen": [[220, " ", "normal", 0.8563111424446106], [19, "4", "normal", 0.9990171194076538]]}, "loss": {"rwkv": 1.514548016558238, "qwen": 1.407572999090544}, "topk": {"rwkv": [287, 1, 0.8443912863731384, [[287, 0.844391, " 4", false], [4600, 0.015825, " is", false], [32227, 0.010586, " that", false], [22590, 0.008069, " the", false], [51744, 0.007588, " finally", false], [61959, 0.006686, " eventually", false], [4601, 0.00656, " it", false], [45, 0.005482, ",", false], [30788, 0.004141, " even", false], [32234, 0.003679, " this", false]]], "qwen": [220, 1, 0.8563111424446106, [[220, 0.856311, " ", false], [429, 0.02449, " that", false], [374, 0.014326, " is", false], [304, 0.01074, " in", false], [279, 0.009291, " the", false], [5499, 0.005781, " finally", false], [11, 0.005532, ",", false], [432, 0.003642, " it", false], [3545, 0.002983, " often", false], [9583, 0.002595, " eventually", false]]]}, "raw_delta": 0.005931954539846629, "tuned_delta": 0.014503746570424877}, {"byte_start": 5417, "byte_end": 5418, "display": {"text": ")", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "29", "compression": {"rwkv": "0.02%", "qwen": "0.01%"}, "model_tokens": {"rwkv": [[42, ")", "normal", 0.9990647435188293]], "qwen": [[8, ")", "normal", 0.9994415640830994]]}, "loss": {"rwkv": 0.016716713663865, "qwen": 0.010073219314950659}, "topk": {"rwkv": [42, 1, 0.9990647435188293, [[42, 0.999065, ")", false], [47, 0.000141, ".", false], [497, 0.000141, "),", false], [499, 0.00012, ").", false], [276, 0.00012, " )", false], [98, 6.4e-05, "a", false], [45, 4.3e-05, ",", false], [580, 3.9e-05, ".)", false], [22590, 3e-05, " the", false], [32227, 1.7e-05, " that", false]]], "qwen": [8, 1, 0.9994415640830994, [[8, 0.999442, ")", false], [701, 0.000149, "),", false], [11, 4.9e-05, ",", false], [64, 4.9e-05, "a", false], [873, 4.5e-05, " )", false], [568, 1.8e-05, ").", false], [13, 1.6e-05, ".", false], [6138, 1.3e-05, ".)", false], [323, 1.3e-05, " and", false], [692, 1.2e-05, ")\n\n", false]]]}, "raw_delta": 0.0003683935501612723, "tuned_delta": 0.00894018558073952}, {"byte_start": 5418, "byte_end": 5431, "display": {"text": " breakthrough", "kind": "normal"}, "is_word": true, "word_id": 915, "word_key": " breakthrough", "bytes_hex": "20 62 72 65 61 6b 74 68 72 6f 75 67 68", "compression": {"rwkv": "13.01% 13.01% 13.01% 13.01% 13.01% 13.01% 13.01% 13.01% 13.01% 13.01% 13.01% 13.01% 13.01%", "qwen": "12.14% 12.14% 12.14% 12.14% 12.14% 12.14% 12.14% 12.14% 12.14% 12.14% 12.14% 12.14% 12.14%"}, "model_tokens": {"rwkv": [[64266, " breakthrough", "normal", 8.692935080034658e-05]], "qwen": [[41345, " breakthrough", "normal", 0.00015804381109774113]]}, "loss": {"rwkv": 13.005063469551951, "qwen": 12.14171849988146}, "topk": {"rwkv": [64266, 358, 8.692935080034658e-05, [[22590, 0.210888, " the", false], [4601, 0.071538, " it", false], [4596, 0.059609, " in", false], [52028, 0.043644, " instead", false], [39934, 0.032084, " there", false], [52224, 0.030895, " methods", false], [32234, 0.029483, " this", false], [32465, 0.027287, " when", false], [332, 0.02339, " a", false], [32227, 0.02271, " that", false]]], "qwen": [41345, 300, 0.00015804381109774113, [[279, 0.178854, " the", false], [304, 0.09324, " in", false], [432, 0.061079, " it", false], [419, 0.046795, " this", false], [1052, 0.037482, " there", false], [979, 0.030111, " when", false], [438, 0.018218, " as", false], [582, 0.016687, " we", false], [429, 0.016293, " that", false], [20219, 0.015668, " Moore", false]]]}, "raw_delta": 0.04787401052621698, "tuned_delta": 0.05644580255679523}, {"byte_start": 5431, "byte_end": 5440, "display": {"text": " progress", "kind": "normal"}, "is_word": true, "word_id": 916, "word_key": " progress", "bytes_hex": "20 70 72 6f 67 72 65 73 73", "compression": {"rwkv": "5.01% 5.01% 5.01% 5.01% 5.01% 5.01% 5.01% 5.01% 5.01%", "qwen": "6.42% 6.42% 6.42% 6.42% 6.42% 6.42% 6.42% 6.42% 6.42%"}, "model_tokens": {"rwkv": [[56950, " progress", "normal", 0.08195258677005768]], "qwen": [[5098, " progress", "normal", 0.040597595274448395]]}, "loss": {"rwkv": 5.009357780864455, "qwen": 6.420086081581431}, "topk": {"rwkv": [56950, 2, 0.08195258677005768, [[116, 0.784498, "s", false], [56950, 0.081953, " progress", false], [52224, 0.054013, " methods", false], [63750, 0.008182, " performance", false], [64423, 0.008025, " improvements", false], [62633, 0.007093, " techniques", false], [57103, 0.006015, " research", false], [55465, 0.005452, " advances", false], [52738, 0.005396, " results", false], [61590, 0.004307, " approaches", false]]], "qwen": [5098, 2, 0.040597595274448395, [[82, 0.860475, "s", false], [5098, 0.040598, " progress", false], [5413, 0.019827, " methods", false], [3059, 0.011784, " results", false], [29903, 0.004517, " advances", false], [3412, 0.004024, " research", false], [18142, 0.003056, " improvements", false], [15235, 0.003025, " AI", false], [4041, 0.002972, " comes", false], [5068, 0.002947, " performance", false]]]}, "raw_delta": -0.07822738753424752, "tuned_delta": -0.06965559550366927}, {"byte_start": 5440, "byte_end": 5451, "display": {"text": " eventually", "kind": "normal"}, "is_word": true, "word_id": 917, "word_key": " eventually", "bytes_hex": "20 65 76 65 6e 74 75 61 6c 6c 79", "compression": {"rwkv": "11.12% 11.12% 11.12% 11.12% 11.12% 11.12% 11.12% 11.12% 11.12% 11.12% 11.12%", "qwen": "7.91% 7.91% 7.91% 7.91% 7.91% 7.91% 7.91% 7.91% 7.91% 7.91% 7.91%"}, "model_tokens": {"rwkv": [[61959, " eventually", "normal", 0.0011185797629877925]], "qwen": [[9583, " eventually", "normal", 0.008022933267056942]]}, "loss": {"rwkv": 11.117358802304864, "qwen": 7.910971326589175}, "topk": {"rwkv": [61959, 47, 0.0011185797629877925, [[4600, 0.260561, " is", false], [38087, 0.154675, " comes", false], [21800, 0.089359, " has", false], [4596, 0.076166, " in", false], [45150, 0.053771, " always", false], [21413, 0.050387, " can", false], [46697, 0.026159, " occurs", false], [45, 0.02253, ",", false], [51896, 0.020185, " happens", false], [45145, 0.019772, " almost", false]]], "qwen": [9583, 19, 0.008022933267056942, [[374, 0.216913, " is", false], [4041, 0.17991, " comes", false], [304, 0.122485, " in", false], [702, 0.053817, " has", false], [13666, 0.036241, " occurs", false], [2677, 0.034178, " always", false], [7460, 0.031665, " requires", false], [8573, 0.028992, " happens", false], [646, 0.028319, " can", false], [3545, 0.019932, " often", false]]]}, "raw_delta": 0.17779987508600412, "tuned_delta": 0.18637166711658237}, {"byte_start": 5451, "byte_end": 5459, "display": {"text": " arrives", "kind": "normal"}, "is_word": true, "word_id": 918, "word_key": " arrives", "bytes_hex": "20 61 72 72 69 76 65 73", "compression": {"rwkv": "9.09% 9.09% 9.09% 9.09% 9.09% 9.09% 9.09% 9.09%", "qwen": "8.48% 8.48% 8.48% 8.48% 8.48% 8.48% 8.48% 8.48%"}, "model_tokens": {"rwkv": [[50956, " arrives", "normal", 0.017871713265776634]], "qwen": [[29682, " arrives", "normal", 0.02329213172197342]]}, "loss": {"rwkv": 9.087288099349427, "qwen": 8.475021263145285}, "topk": {"rwkv": [50956, 7, 0.017871713265776634, [[38087, 0.660999, " comes", false], [46697, 0.061924, " occurs", false], [51896, 0.038454, " happens", false], [57102, 0.028955, " requires", false], [30659, 0.025431, " does", false], [4600, 0.018528, " is", false], [50956, 0.017872, " arrives", false], [45199, 0.009327, " arises", false], [51586, 0.008961, " emerges", false], [52738, 0.007925, " results", false]]], "qwen": [29682, 7, 0.02329213172197342, [[4041, 0.635852, " comes", false], [8573, 0.055551, " happens", false], [13666, 0.050596, " occurs", false], [7460, 0.040678, " requires", false], [3697, 0.023872, " came", false], [3059, 0.023389, " results", false], [29682, 0.023292, " arrives", false], [13798, 0.013052, " depends", false], [33644, 0.009571, " relies", false], [702, 0.009373, " has", false]]]}, "raw_delta": 0.0339512825012207, "tuned_delta": 0.04252307453179895}, {"byte_start": 5459, "byte_end": 5462, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 919, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "14.18% 14.18% 14.18%", "qwen": "13.84% 13.84% 13.84%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.09448861330747604]], "qwen": [[553, " by", "normal", 0.0999731495976448]]}, "loss": {"rwkv": 14.182744217072491, "qwen": 13.842981024782954}, "topk": {"rwkv": [4450, 3, 0.09448861330747604, [[32465, 0.256046, " when", false], [30917, 0.128342, " from", false], [4450, 0.094489, " by", false], [31581, 0.090725, " only", false], [53140, 0.079759, " through", false], [22705, 0.040717, " via", false], [32487, 0.039308, " with", false], [45, 0.035888, ",", false], [4596, 0.028899, " in", false], [32227, 0.028239, " that", false]]], "qwen": [553, 3, 0.0999731495976448, [[979, 0.241971, " when", false], [504, 0.153203, " from", false], [553, 0.099973, " by", false], [1526, 0.089356, " through", false], [11, 0.072803, ",", false], [304, 0.045917, " in", false], [1172, 0.044993, " only", false], [448, 0.036462, " with", false], [518, 0.023641, " at", false], [429, 0.023147, " that", false]]]}, "raw_delta": 0.018840471903483147, "tuned_delta": 0.027412263934061397}, {"byte_start": 5462, "byte_end": 5465, "display": {"text": " an", "kind": "normal"}, "is_word": true, "word_id": 920, "word_key": " an", "bytes_hex": "20 61 6e", "compression": {"rwkv": "33.81% 33.81% 33.81%", "qwen": "35.53% 35.53% 35.53%"}, "model_tokens": {"rwkv": [[4419, " an", "normal", 0.003557920688763261]], "qwen": [[458, " an", "normal", 0.0027115787379443645]]}, "loss": {"rwkv": 33.81316502083508, "qwen": 35.52771166208167}, "topk": {"rwkv": [4419, 44, 0.003557920688763261, [[38888, 0.094816, " lever", false], [40085, 0.070304, " using", false], [47497, 0.067727, " taking", false], [59611, 0.067172, " embracing", false], [38989, 0.049284, " means", false], [55666, 0.038724, " building", false], [332, 0.035454, " a", false], [46500, 0.0348, " making", false], [39193, 0.034005, " other", false], [55586, 0.02101, " avoiding", false]]], "qwen": [458, 61, 0.0027115787379443645, [[76482, 0.117065, " leveraging", false], [1667, 0.062866, " using", false], [55401, 0.034076, " embracing", false], [4752, 0.031185, " building", false], [18950, 0.026335, " applying", false], [264, 0.025556, " a", false], [4633, 0.025075, " taking", false], [77239, 0.025066, " abandoning", false], [7218, 0.022691, " moving", false], [4936, 0.022481, " simply", false]]]}, "raw_delta": -0.09507465362548828, "tuned_delta": -0.08650286159491004}, {"byte_start": 5465, "byte_end": 5474, "display": {"text": " opposing", "kind": "normal"}, "is_word": true, "word_id": 921, "word_key": " opposing", "bytes_hex": "20 6f 70 70 6f 73 69 6e 67", "compression": {"rwkv": "13.90% 13.90% 13.90% 13.90% 13.90% 13.90% 13.90% 13.90% 13.90%", "qwen": "17.69% 17.69% 17.69% 17.69% 17.69% 17.69% 17.69% 17.69% 17.69%"}, "model_tokens": {"rwkv": [[56766, " opposing", "normal", 0.0009504445479251444]], "qwen": [[30222, " opposing", "normal", 0.00014682918845210224]]}, "loss": {"rwkv": 13.900967841898863, "qwen": 17.685518689032}, "topk": {"rwkv": [56766, 55, 0.0009504445479251444, [[63277, 0.399267, " alternative", false], [56131, 0.25246, " entirely", false], [55532, 0.084354, " approach", false], [59121, 0.017096, " alternate", false], [56767, 0.014497, " opposite", false], [63627, 0.01305, " independent", false], [39193, 0.011962, " other", false], [62688, 0.008506, " unexpected", false], [37636, 0.006338, " agent", false], [63621, 0.00584, " improvement", false]]], "qwen": [30222, 267, 0.00014682918845210224, [[11368, 0.350579, " entirely", false], [5486, 0.224518, " approach", false], [10555, 0.062742, " alternative", false], [7373, 0.0206, " effective", false], [9489, 0.020104, " independent", false], [650, 0.017477, " un", false], [16500, 0.016767, " unexpected", false], [3766, 0.016207, " application", false], [30055, 0.015551, " altogether", false], [4558, 0.010551, " almost", false]]]}, "raw_delta": -0.20986005995008666, "tuned_delta": -0.2012882679195084}, {"byte_start": 5474, "byte_end": 5483, "display": {"text": " approach", "kind": "normal"}, "is_word": true, "word_id": 922, "word_key": " approach", "bytes_hex": "20 61 70 70 72 6f 61 63 68", "compression": {"rwkv": "4.20% 4.20% 4.20% 4.20% 4.20% 4.20% 4.20% 4.20% 4.20%", "qwen": "3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28% 3.28%"}, "model_tokens": {"rwkv": [[55532, " approach", "normal", 0.1232675313949585]], "qwen": [[5486, " approach", "normal", 0.19462503492832184]]}, "loss": {"rwkv": 4.195337141473982, "qwen": 3.279487246561189}, "topk": {"rwkv": [55532, 2, 0.1232675313949585, [[39552, 0.302602, " route", false], [55532, 0.123268, " approach", false], [46561, 0.1229, " method", false], [31637, 0.07388, " path", false], [45, 0.073874, ",", false], [57317, 0.051959, " strategy", false], [38536, 0.035433, " force", false], [38989, 0.025893, " means", false], [59526, 0.019725, " direction", false], [51832, 0.016345, " general", false]]], "qwen": [5486, 2, 0.19462503492832184, [[6021, 0.198698, " route", false], [5486, 0.194625, " approach", false], [1714, 0.128327, " method", false], [3363, 0.111152, " means", false], [1815, 0.099305, " path", false], [11, 0.036819, ",", false], [5344, 0.02711, " force", false], [8282, 0.026197, " strategy", false], [16953, 0.015982, " mechanism", false], [1882, 0.014992, " process", false]]]}, "raw_delta": 0.050785501797994, "tuned_delta": 0.05935729382857225}, {"byte_start": 5483, "byte_end": 5489, "display": {"text": " based", "kind": "normal"}, "is_word": true, "word_id": 923, "word_key": " based", "bytes_hex": "20 62 61 73 65 64", "compression": {"rwkv": "10.61% 10.61% 10.61% 10.61% 10.61% 10.61%", "qwen": "11.40% 11.40% 11.40% 11.40% 11.40% 11.40%"}, "model_tokens": {"rwkv": [[37810, " based", "normal", 0.029513614252209663]], "qwen": [[3118, " based", "normal", 0.022526785731315613]]}, "loss": {"rwkv": 10.613576798206566, "qwen": 11.400447587510417}, "topk": {"rwkv": [37810, 5, 0.029513614252209663, [[32227, 0.381868, " that", false], [45, 0.224016, ",", false], [47, 0.123714, ".", false], [5346, 0.114852, "---", false], [37810, 0.029514, " based", false], [4706, 0.020603, " of", false], [59, 0.019219, ":", false], [4811, 0.013707, " to", false], [275, 0.01159, " (", false], [21265, 0.00929, " and", false]]], "qwen": [3118, 8, 0.022526785731315613, [[429, 0.246227, " that", false], [11, 0.240545, ",", false], [4421, 0.184119, "---", false], [13, 0.09639, ".", false], [25, 0.051621, ":", false], [315, 0.030846, " of", false], [382, 0.028947, ".\n\n", false], [3118, 0.022527, " based", false], [320, 0.021723, " (", false], [311, 0.01038, " to", false]]]}, "raw_delta": -0.04363338152567553, "tuned_delta": -0.03506158949509728}, {"byte_start": 5489, "byte_end": 5492, "display": {"text": " on", "kind": "normal"}, "is_word": true, "word_id": 924, "word_key": " on", "bytes_hex": "20 6f 6e", "compression": {"rwkv": "0.50% 0.50% 0.50%", "qwen": "0.40% 0.40% 0.40%"}, "model_tokens": {"rwkv": [[4712, " on", "normal", 0.9195689558982849]], "qwen": [[389, " on", "normal", 0.9363231658935547]]}, "loss": {"rwkv": 0.504849338852746, "qwen": 0.39550657634180847}, "topk": {"rwkv": [4712, 1, 0.9195689558982849, [[4712, 0.919569, " on", false], [31581, 0.01471, " only", false], [47330, 0.011791, " solely", false], [31458, 0.00854, " more", false], [46957, 0.007562, " purely", false], [22187, 0.00604, " not", false], [4596, 0.003631, " in", false], [52028, 0.003594, " instead", false], [56131, 0.003026, " entirely", false], [47285, 0.001941, " simply", false]]], "qwen": [389, 1, 0.9363231658935547, [[389, 0.936323, " on", false], [21063, 0.011515, " solely", false], [31127, 0.005355, " purely", false], [1172, 0.004652, " only", false], [537, 0.004412, " not", false], [803, 0.004253, " more", false], [304, 0.003795, " in", false], [11368, 0.003471, " entirely", false], [13771, 0.002031, " largely", false], [4558, 0.001982, " almost", false]]]}, "raw_delta": 0.00606325020392736, "tuned_delta": 0.014635042234505609}, {"byte_start": 5492, "byte_end": 5500, "display": {"text": " scaling", "kind": "normal"}, "is_word": true, "word_id": 925, "word_key": " scaling", "bytes_hex": "20 73 63 61 6c 69 6e 67", "compression": {"rwkv": "15.78% 15.78% 15.78% 15.78% 15.78% 15.78% 15.78% 15.78%", "qwen": "12.54% 12.54% 12.54% 12.54% 12.54% 12.54% 12.54% 12.54%"}, "model_tokens": {"rwkv": [[52805, " scaling", "normal", 0.0008995500393211842]], "qwen": [[26943, " scaling", "normal", 0.003844857681542635]]}, "loss": {"rwkv": 15.779477009723035, "qwen": 12.535710082016466}, "topk": {"rwkv": [52805, 51, 0.0008995500393211842, [[52195, 0.47432, " massive", false], [63370, 0.151678, " computation", false], [59988, 0.039656, " massively", false], [38888, 0.027267, " lever", false], [22590, 0.026972, " the", false], [47202, 0.024024, " search", false], [51832, 0.022338, " general", false], [31458, 0.013133, " more", false], [332, 0.012098, " a", false], [31466, 0.011167, " much", false]]], "qwen": [26943, 27, 0.003844857681542635, [[76482, 0.224468, " leveraging", false], [34447, 0.194775, " computation", false], [10951, 0.113851, " massive", false], [279, 0.040022, " the", false], [63707, 0.024968, " massively", false], [2711, 0.022049, " search", false], [32064, 0.02161, " leverage", false], [4586, 0.019638, " general", false], [6832, 0.014682, " learning", false], [54480, 0.013875, " computational", false]]]}, "raw_delta": 0.17987263202667236, "tuned_delta": 0.18844442405725062}, {"byte_start": 5500, "byte_end": 5512, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 926, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "1.51% 1.51% 1.51% 1.51% 1.51% 1.51% 1.51% 1.51% 1.51% 1.51% 1.51% 1.51%", "qwen": "2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47% 2.47%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.3625050485134125]], "qwen": [[34447, " computation", "normal", 0.1930505931377411]]}, "loss": {"rwkv": 1.514548016558238, "qwen": 2.471822082714474}, "topk": {"rwkv": [63370, 2, 0.3625050485134125, [[4833, 0.368705, " up", false], [63370, 0.362505, " computation", false], [21265, 0.043918, " and", false], [45, 0.027719, ",", false], [52195, 0.02201, " massive", false], [47, 0.017585, ".", false], [4706, 0.012807, " of", false], [64862, 0.011428, " computational", false], [22590, 0.010869, " the", false], [46, 0.008844, "-", false]]], "qwen": [34447, 2, 0.1930505931377411, [[705, 0.524018, " up", false], [34447, 0.193051, " computation", false], [5239, 0.053742, "-up", false], [279, 0.033484, " the", false], [63707, 0.019079, " massively", false], [323, 0.01254, " and", false], [700, 0.010937, " out", false], [990, 0.010724, " use", false], [315, 0.010249, " of", false], [10951, 0.009639, " massive", false]]]}, "raw_delta": -0.05308254559834801, "tuned_delta": -0.04451075356776976}, {"byte_start": 5512, "byte_end": 5515, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 927, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "26.30% 26.30% 26.30%", "qwen": "23.53% 23.53% 23.53%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.012551532126963139]], "qwen": [[553, " by", "normal", 0.019953183829784393]]}, "loss": {"rwkv": 26.299128349538393, "qwen": 23.530156075851913}, "topk": {"rwkv": [4450, 10, 0.012551532126963139, [[21265, 0.341814, " and", false], [47, 0.206012, ".", false], [45, 0.134494, ",", false], [4811, 0.054574, " to", false], [4833, 0.028509, " up", false], [275, 0.020292, " (", false], [4596, 0.020291, " in", false], [47001, 0.020043, " rather", false], [5346, 0.017119, "---", false], [4450, 0.012552, " by", false]]], "qwen": [553, 8, 0.019953183829784393, [[13, 0.347101, ".", false], [382, 0.137095, ".\n\n", false], [11, 0.105796, ",", false], [311, 0.075456, " to", false], [323, 0.055648, " and", false], [705, 0.049668, " up", false], [4421, 0.022753, "---", false], [553, 0.019953, " by", false], [320, 0.015454, " (", false], [4751, 0.014441, " rather", false]]]}, "raw_delta": 0.15354442596435547, "tuned_delta": 0.16211621799493373}, {"byte_start": 5515, "byte_end": 5522, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 928, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "11.67% 11.67% 11.67% 11.67% 11.67% 11.67% 11.67%", "qwen": "17.54% 17.54% 17.54% 17.54% 17.54% 17.54% 17.54%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.010901223868131638]], "qwen": [[2711, " search", "normal", 0.001106332871131599]]}, "loss": {"rwkv": 11.673592685764493, "qwen": 17.53571224553878}, "topk": {"rwkv": [47202, 12, 0.010901223868131638, [[37045, 0.371462, " Moore", false], [52195, 0.17144, " massive", false], [332, 0.047983, " a", false], [59988, 0.040987, " massively", false], [38888, 0.038125, " lever", false], [40085, 0.022373, " using", false], [46718, 0.016342, " orders", false], [22590, 0.014957, " the", false], [51832, 0.013006, " general", false], [38989, 0.012471, " means", false]]], "qwen": [2711, 77, 0.001106332871131599, [[20219, 0.245247, " Moore", false], [264, 0.113989, " a", false], [76482, 0.085343, " leveraging", false], [279, 0.025898, " the", false], [63707, 0.024991, " massively", false], [10951, 0.02362, " massive", false], [1667, 0.023573, " using", false], [803, 0.022908, " more", false], [10163, 0.020346, " orders", false], [458, 0.019338, " an", false]]]}, "raw_delta": -0.3250649315970285, "tuned_delta": -0.31649313956645025}, {"byte_start": 5522, "byte_end": 5526, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 929, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "3.73% 3.73% 3.73% 3.73%", "qwen": "1.60% 1.60% 1.60% 1.60%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.4349638819694519]], "qwen": [[323, " and", "normal", 0.7012136578559875]]}, "loss": {"rwkv": 3.7335369710505395, "qwen": 1.600231116832549}, "topk": {"rwkv": [21265, 1, 0.4349638819694519, [[21265, 0.434964, " and", false], [4715, 0.385931, " or", false], [45, 0.078134, ",", false], [47, 0.034275, ".", false], [275, 0.02465, " (", false], [48, 0.009226, "/", false], [5346, 0.004794, "---", false], [4596, 0.004341, " in", false], [52224, 0.002546, " methods", false], [4811, 0.001489, " to", false]]], "qwen": [323, 1, 0.7012136578559875, [[323, 0.701214, " and", false], [476, 0.160536, " or", false], [11, 0.06367, ",", false], [13, 0.02418, ".", false], [320, 0.011431, " (", false], [382, 0.009288, ".\n\n", false], [9777, 0.003663, "-and", false], [5413, 0.003568, " methods", false], [5980, 0.002035, "-based", false], [4421, 0.001439, "---", false]]]}, "raw_delta": 0.1182955950498581, "tuned_delta": 0.12686738708043635}, {"byte_start": 5526, "byte_end": 5535, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 930, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "0.90% 0.90% 0.90% 0.90% 0.90% 0.90% 0.90% 0.90% 0.90%", "qwen": "0.42% 0.42% 0.42% 0.42% 0.42% 0.42% 0.42% 0.42% 0.42%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.6373797059059143]], "qwen": [[6832, " learning", "normal", 0.8108955025672913]]}, "loss": {"rwkv": 0.9040325370153822, "qwen": 0.4200167166734307}, "topk": {"rwkv": [56537, 1, 0.6373797059059143, [[56537, 0.63738, " learning", false], [48, 0.146796, "/", false], [4450, 0.081643, " by", false], [31978, 0.01792, " self", false], [38888, 0.013293, " lever", false], [62577, 0.009892, " statistics", false], [63885, 0.008487, " statistical", false], [45, 0.005723, ",", false], [32230, 0.004032, " then", false], [22590, 0.003748, " the", false]]], "qwen": [6832, 1, 0.8108955025672913, [[6832, 0.810896, " learning", false], [5144, 0.053234, "/or", false], [553, 0.026637, " by", false], [76482, 0.009203, " leveraging", false], [389, 0.00778, " on", false], [5538, 0.007117, " deep", false], [5662, 0.006245, " machine", false], [1008, 0.004239, " other", false], [656, 0.004126, " self", false], [1221, 0.004103, " then", false]]]}, "raw_delta": 0.026839536097314626, "tuned_delta": 0.035411328127892876}, {"byte_start": 5535, "byte_end": 5536, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "10.57%", "qwen": "10.93%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.5536013841629028]], "qwen": [[13, ".", "normal", 0.5454769134521484]]}, "loss": {"rwkv": 10.566614069010962, "qwen": 10.930124124115569}, "topk": {"rwkv": [47, 1, 0.5536013841629028, [[47, 0.553601, ".", false], [45, 0.187041, ",", false], [5346, 0.050885, "---", false], [4450, 0.040365, " by", false], [21265, 0.031979, " and", false], [275, 0.019057, " (", false], [4596, 0.01244, " in", false], [4712, 0.008232, " on", false], [4811, 0.007784, " to", false], [47001, 0.007466, " rather", false]]], "qwen": [13, 1, 0.5454769134521484, [[13, 0.545477, ".", false], [382, 0.178999, ".\n\n", false], [11, 0.11097, ",", false], [320, 0.025356, " (", false], [624, 0.016818, ".\n", false], [5413, 0.016496, " methods", false], [4421, 0.014729, "---", false], [323, 0.010313, " and", false], [12538, 0.008433, " techniques", false], [4751, 0.006221, " rather", false]]]}, "raw_delta": -0.020157277584075928, "tuned_delta": -0.01158548555349768}, {"byte_start": 5536, "byte_end": 5540, "display": {"text": " The", "kind": "normal"}, "is_word": true, "word_id": 931, "word_key": " the", "bytes_hex": "20 54 68 65", "compression": {"rwkv": "11.69% 11.69% 11.69% 11.69%", "qwen": "8.76% 8.76% 8.76% 8.76%"}, "model_tokens": {"rwkv": [[20996, " The", "normal", 0.07541705667972565]], "qwen": [[576, " The", "normal", 0.14312496781349182]]}, "loss": {"rwkv": 11.693719569705465, "qwen": 8.76454008228244}, "topk": {"rwkv": [20996, 2, 0.07541705667972565, [[261, 0.52264, "\n\n", false], [20996, 0.075417, " The", false], [29894, 0.042126, " This", false], [4331, 0.03552, " We", false], [267, 0.034, "  ", false], [3913, 0.02105, " In", false], [3918, 0.017224, " It", false], [3336, 0.013511, " \n\n", false], [37453, 0.013192, " These", false], [4255, 0.012783, " To", false]]], "qwen": [576, 2, 0.14312496781349182, [[220, 0.151022, " ", false], [576, 0.143125, " The", false], [1096, 0.06928, " This", false], [1205, 0.054866, " We", false], [1084, 0.044859, " It", false], [4220, 0.043008, " These", false], [758, 0.041557, " In", false], [2014, 0.022343, " To", false], [2619, 0.02132, " There", false], [1634, 0.01157, " As", false]]]}, "raw_delta": 0.16242820024490356, "tuned_delta": 0.17099999227548182}, {"byte_start": 5540, "byte_end": 5549, "display": {"text": " eventual", "kind": "normal"}, "is_word": true, "word_id": 932, "word_key": " eventual", "bytes_hex": "20 65 76 65 6e 74 75 61 6c", "compression": {"rwkv": "16.28% 16.28% 16.28% 16.28% 16.28% 16.28% 16.28% 16.28% 16.28%", "qwen": "14.95% 14.95% 14.95% 14.95% 14.95% 14.95% 14.95% 14.95% 14.95%"}, "model_tokens": {"rwkv": [[56154, " eventual", "normal", 0.00029455721960403025]], "qwen": [[41735, " eventual", "normal", 0.0005762152140960097]]}, "loss": {"rwkv": 16.28041278780948, "qwen": 14.945978379663178}, "topk": {"rwkv": [56154, 332, 0.00029455721960403025, [[45315, 0.201228, " bitter", false], [46430, 0.107066, " lesson", false], [47009, 0.022126, " reason", false], [45184, 0.021001, " appeal", false], [21952, 0.020405, " key", false], [52127, 0.015971, " lessons", false], [38499, 0.013635, " first", false], [31461, 0.012251, " most", false], [21365, 0.011016, " bit", false], [62061, 0.009609, " historical", false]]], "qwen": [41735, 191, 0.0005762152140960097, [[25180, 0.315766, " bitter", false], [17755, 0.034954, " lesson", false], [78996, 0.024005, " bitterness", false], [1376, 0.015684, " key", false], [1429, 0.014092, " most", false], [1156, 0.013176, " first", false], [1172, 0.011851, " only", false], [2874, 0.009096, " reason", false], [1293, 0.00799, " long", false], [1537, 0.007683, " last", false]]]}, "raw_delta": 0.07399675581190324, "tuned_delta": 0.08256854784248148}, {"byte_start": 5549, "byte_end": 5557, "display": {"text": " success", "kind": "normal"}, "is_word": true, "word_id": 933, "word_key": " success", "bytes_hex": "20 73 75 63 63 65 73 73", "compression": {"rwkv": "4.61% 4.61% 4.61% 4.61% 4.61% 4.61% 4.61% 4.61%", "qwen": "7.22% 7.22% 7.22% 7.22% 7.22% 7.22% 7.22% 7.22%"}, "model_tokens": {"rwkv": [[53052, " success", "normal", 0.1292545348405838]], "qwen": [[2393, " success", "normal", 0.04058763012290001]]}, "loss": {"rwkv": 4.61408814346812, "qwen": 7.22314987349079}, "topk": {"rwkv": [53052, 1, 0.1292545348405838, [[53052, 0.129255, " success", false], [64266, 0.089544, " breakthrough", false], [57260, 0.039538, " solution", false], [47798, 0.032321, " winner", false], [53198, 0.026578, " triumph", false], [7933, 0.026454, "ity", false], [56950, 0.022981, " progress", false], [46430, 0.018824, " lesson", false], [53283, 0.017154, " victory", false], [52382, 0.015983, " outcome", false]]], "qwen": [2393, 4, 0.04058763012290001, [[41345, 0.226281, " breakthrough", false], [5486, 0.093374, " approach", false], [37486, 0.045089, " triumph", false], [2393, 0.040588, " success", false], [5098, 0.026488, " progress", false], [18647, 0.015863, " arrival", false], [13632, 0.015807, " winner", false], [15274, 0.014492, " outcome", false], [48079, 0.012363, " emergence", false], [12560, 0.011613, " victory", false]]]}, "raw_delta": -0.14467710256576538, "tuned_delta": -0.13610531053518712}, {"byte_start": 5557, "byte_end": 5560, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 934, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "17.09% 17.09% 17.09%", "qwen": "18.80% 18.80% 18.80%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.05810806155204773]], "qwen": [[374, " is", "normal", 0.04383223131299019]]}, "loss": {"rwkv": 17.094433427199956, "qwen": 18.799433598134907}, "topk": {"rwkv": [4600, 2, 0.05810806155204773, [[4706, 0.784938, " of", false], [4600, 0.058108, " is", false], [4596, 0.0279, " in", false], [38087, 0.012747, " comes", false], [45, 0.007718, ",", false], [51434, 0.007197, " depends", false], [32475, 0.0068, " will", false], [4450, 0.006312, " by", false], [21800, 0.00585, " has", false], [22748, 0.004845, " was", false]]], "qwen": [374, 3, 0.04383223131299019, [[315, 0.707315, " of", false], [304, 0.068246, " in", false], [374, 0.043832, " is", false], [702, 0.016581, " has", false], [553, 0.014604, " by", false], [572, 0.013944, " was", false], [429, 0.013445, " that", false], [448, 0.01158, " with", false], [11, 0.009154, ",", false], [4041, 0.008134, " comes", false]]]}, "raw_delta": -0.09454528490702307, "tuned_delta": -0.08597349287644483}, {"byte_start": 5560, "byte_end": 5565, "display": {"text": " ting", "kind": "normal"}, "is_word": true, "word_id": 935, "word_key": " ting", "bytes_hex": "20 74 69 6e 67", "compression": {"rwkv": "49.59% 49.59% 49.59% 49.59% 49.59%", "qwen": "39.10% 39.10% 39.10% 39.10% 39.10%"}, "model_tokens": {"rwkv": [[32252, " ting", "normal", 1.0751234640338225e-06]], "qwen": [[42227, " ting", "normal", 1.9561890439945273e-05]]}, "loss": {"rwkv": 49.59264203055811, "qwen": 39.103987697183264}, "topk": {"rwkv": [32252, 4981, 1.0751234640338225e-06, [[37810, 0.134978, " based", false], [22187, 0.130543, " not", false], [21572, 0.056394, " due", false], [45150, 0.056135, " always", false], [332, 0.044849, " a", false], [22590, 0.039081, " the", false], [4596, 0.016419, " in", false], [4450, 0.014284, " by", false], [62109, 0.01383, " inevitable", false], [39171, 0.012576, " often", false]]], "qwen": [42227, 1268, 1.9561890439945273e-05, [[3118, 0.144691, " based", false], [537, 0.08893, " not", false], [4152, 0.060983, " due", false], [2677, 0.049161, " always", false], [264, 0.041665, " a", false], [3545, 0.040587, " often", false], [16994, 0.029664, " achieved", false], [553, 0.027469, " by", false], [279, 0.026745, " the", false], [304, 0.019998, " in", false]]]}, "raw_delta": 0.5816144943237305, "tuned_delta": 0.5901862863543087}, {"byte_start": 5565, "byte_end": 5567, "display": {"text": "ed", "kind": "normal"}, "is_word": true, "word_id": 936, "word_key": "ed", "bytes_hex": "65 64", "compression": {"rwkv": "0.01% 0.01%", "qwen": "0.01% 0.01%"}, "model_tokens": {"rwkv": [[1843, "ed", "normal", 0.9993645548820496]], "qwen": [[291, "ed", "normal", 0.9991808533668518]]}, "loss": {"rwkv": 0.005744220538817808, "qwen": 0.007389000931368411}, "topk": {"rwkv": [1843, 1, 0.9993645548820496, [[1843, 0.999365, "ed", false], [1858, 0.000125, "es", false], [25206, 0.000118, "eing", false], [102, 0.000106, "e", false], [8067, 7.6e-05, "led", false], [7856, 4.4e-05, "ing", false], [2030, 2.7e-05, "ly", false], [101, 1.7e-05, "d", false], [26151, 1.4e-05, "ling", false], [116, 1.2e-05, "s", false]]], "qwen": [291, 1, 0.9991808533668518, [[291, 0.999181, "ed", false], [2718, 0.000341, "ling", false], [832, 0.000193, "led", false], [3556, 4.4e-05, "ged", false], [75, 2.1e-05, "l", false], [1151, 1.4e-05, "red", false], [12336, 1.2e-05, "ered", false], [3018, 1.2e-05, "ored", false], [3260, 9e-06, "ued", false], [2181, 8e-06, "iled", false]]]}, "raw_delta": -9.120599133893847e-05, "tuned_delta": 0.00848058603923931}, {"byte_start": 5567, "byte_end": 5572, "display": {"text": " with", "kind": "normal"}, "is_word": true, "word_id": 937, "word_key": " with", "bytes_hex": "20 77 69 74 68", "compression": {"rwkv": "0.46% 0.46% 0.46% 0.46% 0.46%", "qwen": "0.47% 0.47% 0.47% 0.47% 0.47%"}, "model_tokens": {"rwkv": [[32487, " with", "normal", 0.8810338377952576]], "qwen": [[448, " with", "normal", 0.8772037029266357]]}, "loss": {"rwkv": 0.4578866096571417, "qwen": 0.47254039142390725}, "topk": {"rwkv": [32487, 1, 0.8810338377952576, [[32487, 0.881034, " with", false], [4450, 0.08964, " by", false], [45, 0.007895, ",", false], [4596, 0.005228, " in", false], [332, 0.00273, " a", false], [57263, 0.002144, " somewhat", false], [57245, 0.001472, " slightly", false], [4706, 0.000865, " of", false], [22187, 0.000576, " not", false], [30322, 0.000513, " both", false]]], "qwen": [448, 1, 0.8772037029266357, [[448, 0.877204, " with", false], [553, 0.096491, " by", false], [11, 0.009353, ",", false], [304, 0.002796, " in", false], [264, 0.001064, " a", false], [537, 0.001013, " not", false], [14400, 0.000839, " somewhat", false], [315, 0.000753, " of", false], [311, 0.000588, " to", false], [320, 0.000395, " (", false]]]}, "raw_delta": -0.0008125782012939446, "tuned_delta": 0.007759213829284304}, {"byte_start": 5572, "byte_end": 5583, "display": {"text": " bitterness", "kind": "normal"}, "is_word": true, "word_id": 938, "word_key": " bitterness", "bytes_hex": "20 62 69 74 74 65 72 6e 65 73 73", "compression": {"rwkv": "3.16% 3.16% 3.16% 3.16% 3.16% 3.16% 3.16% 3.16% 3.16% 3.16% 3.16%", "qwen": "1.50% 1.50% 1.50% 1.50% 1.50% 1.50% 1.50% 1.50% 1.50% 1.50% 1.50%"}, "model_tokens": {"rwkv": [[61640, " bitterness", "normal", 0.14697323739528656]], "qwen": [[78996, " bitterness", "normal", 0.40061235427856445]]}, "loss": {"rwkv": 3.1635802121766146, "qwen": 1.4996831456310211}, "topk": {"rwkv": [61640, 2, 0.14697323739528656, [[332, 0.148044, " a", false], [61640, 0.146973, " bitterness", false], [22590, 0.103511, " the", false], [45315, 0.088484, " bitter", false], [52793, 0.071181, " sadness", false], [47048, 0.04781, " regret", false], [38805, 0.041348, " irony", false], [65126, 0.040868, " disappointment", false], [53178, 0.034561, " tragedy", false], [63588, 0.019909, " frustration", false]]], "qwen": [78996, 1, 0.40061235427856445, [[78996, 0.400612, " bitterness", false], [50878, 0.184147, " sadness", false], [22231, 0.077142, " regret", false], [264, 0.058002, " a", false], [25180, 0.050059, " bitter", false], [279, 0.027139, " the", false], [50605, 0.026256, " irony", false], [40598, 0.02382, " disappointment", false], [57496, 0.012962, " sorrow", false], [86063, 0.007106, " melanch", false]]]}, "raw_delta": 0.09226604483344338, "tuned_delta": 0.10083783686402162}, {"byte_start": 5583, "byte_end": 5584, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "17.33%", "qwen": "22.51%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.38802972435951233]], "qwen": [[11, ",", "normal", 0.28709185123443604]]}, "loss": {"rwkv": 17.329247073177978, "qwen": 22.50519823744862}, "topk": {"rwkv": [45, 1, 0.38802972435951233, [[45, 0.38803, ",", false], [51018, 0.203718, " because", false], [21700, 0.081682, " for", false], [47, 0.058162, ".", false], [4423, 0.036781, " as", false], [5346, 0.032045, "---", false], [32227, 0.026848, " that", false], [21265, 0.025683, " and", false], [4596, 0.022714, " in", false], [59, 0.020702, ":", false]]], "qwen": [11, 2, 0.28709185123443604, [[1576, 0.375146, " because", false], [11, 0.287092, ",", false], [553, 0.066923, " by", false], [13, 0.044343, ".", false], [369, 0.032616, " for", false], [323, 0.026326, " and", false], [438, 0.023125, " as", false], [382, 0.015253, ".\n\n", false], [518, 0.013712, " at", false], [304, 0.013023, " in", false]]]}, "raw_delta": -0.2870156764984131, "tuned_delta": -0.27844388446783486}, {"byte_start": 5584, "byte_end": 5588, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 939, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "12.61% 12.61% 12.61% 12.61%", "qwen": "9.34% 9.34% 9.34% 9.34%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.061159905046224594]], "qwen": [[323, " and", "normal", 0.1260937601327896]]}, "loss": {"rwkv": 12.609492789019747, "qwen": 9.335722412978594}, "topk": {"rwkv": [21265, 4, 0.061159905046224594, [[51018, 0.275527, " because", false], [21400, 0.27325, " but", false], [4423, 0.179361, " as", false], [21265, 0.06116, " and", false], [21700, 0.025996, " for", false], [4596, 0.025641, " in", false], [39690, 0.025492, " since", false], [22187, 0.016954, " not", false], [40186, 0.0074, " which", false], [4706, 0.006747, " of", false]]], "qwen": [323, 3, 0.1260937601327896, [[1576, 0.302206, " because", false], [438, 0.175248, " as", false], [323, 0.126094, " and", false], [714, 0.084405, " but", false], [369, 0.046944, " for", false], [537, 0.036781, " not", false], [2474, 0.03465, " since", false], [892, 0.015301, " which", false], [304, 0.013924, " in", false], [773, 0.010399, " so", false]]]}, "raw_delta": 0.18153637647628784, "tuned_delta": 0.1901081685068661}, {"byte_start": 5588, "byte_end": 5594, "display": {"text": " often", "kind": "normal"}, "is_word": true, "word_id": 940, "word_key": " often", "bytes_hex": "20 6f 66 74 65 6e", "compression": {"rwkv": "15.31% 15.31% 15.31% 15.31% 15.31% 15.31%", "qwen": "11.66% 11.66% 11.66% 11.66% 11.66% 11.66%"}, "model_tokens": {"rwkv": [[39171, " often", "normal", 0.0061404891312122345]], "qwen": [[3545, " often", "normal", 0.020638203248381615]]}, "loss": {"rwkv": 15.309849717766994, "qwen": 11.663622605804472}, "topk": {"rwkv": [39171, 27, 0.0061404891312122345, [[22590, 0.157922, " the", false], [4601, 0.092219, " it", false], [4858, 0.064718, " we", false], [4600, 0.05719, " is", false], [32234, 0.048891, " this", false], [32227, 0.028623, " that", false], [63843, 0.028011, " researchers", false], [4788, 0.023514, " so", false], [39934, 0.0213, " there", false], [4596, 0.017706, " in", false]]], "qwen": [3545, 9, 0.020638203248381615, [[279, 0.181648, " the", false], [419, 0.066944, " this", false], [432, 0.062067, " it", false], [374, 0.05647, " is", false], [582, 0.040288, " we", false], [429, 0.040272, " that", false], [773, 0.023409, " so", false], [264, 0.021673, " a", false], [3545, 0.020638, " often", false], [304, 0.019978, " in", false]]]}, "raw_delta": 0.20218976338704434, "tuned_delta": 0.2107615554176226}, {"byte_start": 5594, "byte_end": 5607, "display": {"text": " incompletely", "kind": "normal"}, "is_word": true, "word_id": 941, "word_key": " incompletely", "bytes_hex": "20 69 6e 63 6f 6d 70 6c 65 74 65 6c 79", "compression": {"rwkv": "13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 13.12% 12.33% 12.33%", "qwen": "25.61% 25.61% 25.61% 25.61% 25.61% 25.61% 10.83% 10.83% 10.83% 10.83% 10.83% 10.83% 10.83%"}, "model_tokens": {"rwkv": [[62091, " incomplete", "normal", 0.0003408551274333149], [2030, "ly", "normal", 0.25676867365837097]], "qwen": [[52890, " incom", "normal", 0.00019925166270695627], [49168, "pletely", "normal", 0.014954663813114166]]}, "loss": {"rwkv": 12.994225916660662, "qwen": 17.650366464151663}, "topk": {"rwkv": [62091, 280, 0.0003408551274333149, [[32487, 0.058794, " with", false], [22590, 0.058553, " the", false], [56501, 0.050013, " involves", false], [4600, 0.035464, " is", false], [4601, 0.030968, " it", false], [332, 0.026724, " a", false], [38087, 0.02284, " comes", false], [38875, 0.02024, " leads", false], [63843, 0.018899, " researchers", false], [39934, 0.018716, " there", false]]], "qwen": [52890, 448, 0.00019925166270695627, [[448, 0.113979, " with", false], [279, 0.073731, " the", false], [374, 0.044957, " is", false], [23943, 0.031305, " accompanied", false], [4041, 0.030687, " comes", false], [432, 0.024818, " it", false], [11811, 0.020573, " researchers", false], [264, 0.018769, " a", false], [11508, 0.015304, " leads", false], [17601, 0.013093, " involves", false]]]}, "raw_delta": -0.2581912554227388, "tuned_delta": -0.24961946339216054}, {"byte_start": 5607, "byte_end": 5616, "display": {"text": " digested", "kind": "normal"}, "is_word": true, "word_id": 942, "word_key": " digested", "bytes_hex": "20 64 69 67 65 73 74 65 64", "compression": {"rwkv": "15.94% 15.94% 15.94% 15.94% 15.94% 15.94% 15.94% 0.06% 0.06%", "qwen": "40.72% 40.72% 40.72% 40.72% 0.00% 0.00% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[45746, " digest", "normal", 0.0020771108102053404], [1843, "ed", "normal", 0.9938040971755981]], "qwen": [[4078, " dig", "normal", 0.00011939474643440917], [9980, "ested", "normal", 0.9998053908348083]]}, "loss": {"rwkv": 12.410757281356057, "qwen": 18.100352509323848}, "topk": {"rwkv": [45746, 26, 0.0020771108102053404, [[62684, 0.53488, " understood", false], [63289, 0.202622, " appreciated", false], [62438, 0.040571, " recognized", false], [64238, 0.017612, " acknowledged", false], [57027, 0.015666, " realized", false], [55428, 0.01557, " accepted", false], [52112, 0.011024, " learned", false], [38625, 0.010959, " grasp", false], [4788, 0.007556, " so", false], [45, 0.006183, ",", false]]], "qwen": [4078, 214, 0.00011939474643440917, [[15985, 0.482853, " understood", false], [25498, 0.044029, " acknowledged", false], [9498, 0.037975, " learned", false], [14975, 0.036413, " recognized", false], [25808, 0.033701, " appreciated", false], [11247, 0.031423, " explained", false], [773, 0.02678, " so", false], [15043, 0.024798, " realized", false], [34416, 0.021106, " justified", false], [26471, 0.019687, " remembered", false]]]}, "raw_delta": -0.31549815126345493, "tuned_delta": -0.3069263592328767}, {"byte_start": 5616, "byte_end": 5617, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "17.47%", "qwen": "27.08%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.3821512460708618]], "qwen": [[11, ",", "normal", 0.22278772294521332]]}, "loss": {"rwkv": 17.47013526076479, "qwen": 27.07822767280638}, "topk": {"rwkv": [45, 1, 0.3821512460708618, [[45, 0.382151, ",", false], [4450, 0.263127, " by", false], [47, 0.176273, ".", false], [4596, 0.023382, " in", false], [5346, 0.018755, "---", false], [21265, 0.012854, " and", false], [32465, 0.012324, " when", false], [40076, 0.010249, " until", false], [4423, 0.009236, " as", false], [4424, 0.008984, " at", false]]], "qwen": [11, 2, 0.22278772294521332, [[553, 0.285165, " by", false], [11, 0.222788, ",", false], [13, 0.206131, ".", false], [382, 0.079159, ".\n\n", false], [304, 0.021819, " in", false], [518, 0.019729, " at", false], [323, 0.017123, " and", false], [369, 0.011375, " for", false], [438, 0.010354, " as", false], [476, 0.010326, " or", false]]]}, "raw_delta": -0.5327857732772827, "tuned_delta": -0.5242139812467045}, {"byte_start": 5617, "byte_end": 5625, "display": {"text": " because", "kind": "normal"}, "is_word": true, "word_id": 943, "word_key": " because", "bytes_hex": "20 62 65 63 61 75 73 65", "compression": {"rwkv": "3.66% 3.66% 3.66% 3.66% 3.66% 3.66% 3.66% 3.66%", "qwen": "3.01% 3.01% 3.01% 3.01% 3.01% 3.01% 3.01% 3.01%"}, "model_tokens": {"rwkv": [[51018, " because", "normal", 0.19768062233924866]], "qwen": [[1576, " because", "normal", 0.26296961307525635]]}, "loss": {"rwkv": 3.6630928772571334, "qwen": 3.0109873348721896}, "topk": {"rwkv": [51018, 2, 0.19768062233924866, [[21400, 0.39533, " but", false], [51018, 0.197681, " because", false], [4423, 0.095918, " as", false], [21265, 0.050934, " and", false], [4450, 0.050033, " by", false], [21700, 0.022768, " for", false], [4788, 0.01819, " so", false], [4596, 0.017289, " in", false], [32465, 0.014035, " when", false], [30788, 0.012179, " even", false]]], "qwen": [1576, 1, 0.26296961307525635, [[1576, 0.26297, " because", false], [714, 0.15885, " but", false], [438, 0.139906, " as", false], [323, 0.089964, " and", false], [553, 0.056858, " by", false], [369, 0.040796, " for", false], [773, 0.025334, " so", false], [2474, 0.021178, " since", false], [304, 0.01481, " in", false], [1496, 0.012878, " even", false]]]}, "raw_delta": 0.036160409450531006, "tuned_delta": 0.044732201481109256}, {"byte_start": 5625, "byte_end": 5628, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 944, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "9.77% 9.77% 9.77%", "qwen": "9.17% 9.17% 9.17%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.19962885975837708]], "qwen": [[432, " it", "normal", 0.2176695615053177]]}, "loss": {"rwkv": 9.768247672685687, "qwen": 9.165785280769484}, "topk": {"rwkv": [4601, 2, 0.19962885975837708, [[22590, 0.319802, " the", false], [4601, 0.199629, " it", false], [4706, 0.09383, " of", false], [4858, 0.073552, " we", false], [63843, 0.061128, " researchers", false], [284, 0.019924, " 1", false], [39934, 0.014404, " there", false], [46787, 0.00946, " people", false], [332, 0.009233, " a", false], [3609, 0.009022, " AI", false]]], "qwen": [432, 2, 0.2176695615053177, [[279, 0.285832, " the", false], [432, 0.21767, " it", false], [315, 0.098557, " of", false], [11811, 0.038652, " researchers", false], [582, 0.033831, " we", false], [220, 0.029431, " ", false], [1052, 0.021834, " there", false], [304, 0.018553, " in", false], [11, 0.010721, ",", false], [1429, 0.00928, " most", false]]]}, "raw_delta": 0.0334076086680094, "tuned_delta": 0.04197940069858765}, {"byte_start": 5628, "byte_end": 5631, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 945, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "7.51% 7.51% 7.51%", "qwen": "7.18% 7.18% 7.18%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.2882640063762665]], "qwen": [[374, " is", "normal", 0.3027406334877014]]}, "loss": {"rwkv": 7.514036671296684, "qwen": 7.182690596578126}, "topk": {"rwkv": [4600, 1, 0.2882640063762665, [[4600, 0.288264, " is", false], [30659, 0.062116, " does", false], [22748, 0.06041, " was", false], [21800, 0.039604, " has", false], [56501, 0.034766, " involves", false], [39888, 0.033837, " takes", false], [38087, 0.029904, " comes", false], [39620, 0.024831, " seems", false], [57102, 0.022864, " requires", false], [31908, 0.015377, " runs", false]]], "qwen": [374, 1, 0.3027406334877014, [[374, 0.302741, " is", false], [4041, 0.105995, " comes", false], [29682, 0.065926, " arrives", false], [1558, 0.04941, " does", false], [572, 0.02891, " was", false], [7460, 0.028253, " requires", false], [4990, 0.026667, " takes", false], [702, 0.020119, " has", false], [8573, 0.015152, " happens", false], [3697, 0.012295, " came", false]]]}, "raw_delta": 0.018373727798461914, "tuned_delta": 0.026945519829040164}, {"byte_start": 5631, "byte_end": 5639, "display": {"text": " success", "kind": "normal"}, "is_word": true, "word_id": 946, "word_key": " success", "bytes_hex": "20 73 75 63 63 65 73 73", "compression": {"rwkv": "22.82% 22.82% 22.82% 22.82% 22.82% 22.82% 22.82% 22.82%", "qwen": "22.30% 22.30% 22.30% 22.30% 22.30% 22.30% 22.30% 22.30%"}, "model_tokens": {"rwkv": [[53052, " success", "normal", 4.079076097696088e-05]], "qwen": [[2393, " success", "normal", 5.052114283898845e-05]]}, "loss": {"rwkv": 22.823886389063677, "qwen": 22.301177368513205}, "topk": {"rwkv": [53052, 865, 4.079076097696088e-05, [[22187, 0.132184, " not", false], [4788, 0.095865, " so", false], [332, 0.071927, " a", false], [31048, 0.07044, " hard", false], [45315, 0.059021, " bitter", false], [22590, 0.038532, " the", false], [37810, 0.036888, " based", false], [51336, 0.034481, " counter", false], [59516, 0.029296, " difficult", false], [31968, 0.0164, " seen", false]]], "qwen": [2393, 891, 5.052114283898845e-05, [[537, 0.12214, " not", false], [264, 0.085189, " a", false], [3118, 0.077157, " based", false], [773, 0.071189, " so", false], [279, 0.042447, " the", false], [3545, 0.025751, " often", false], [5546, 0.024856, " counter", false], [2238, 0.022544, " too", false], [2588, 0.021346, " hard", false], [16500, 0.017735, " unexpected", false]]]}, "raw_delta": 0.028985142707824707, "tuned_delta": 0.03755693473840296}, {"byte_start": 5639, "byte_end": 5644, "display": {"text": " over", "kind": "normal"}, "is_word": true, "word_id": 947, "word_key": " over", "bytes_hex": "20 6f 76 65 72", "compression": {"rwkv": "22.09% 22.09% 22.09% 22.09% 22.09%", "qwen": "14.60% 14.60% 14.60% 14.60% 14.60%"}, "model_tokens": {"rwkv": [[31601, " over", "normal", 0.002152421046048403]], "qwen": [[916, " over", "normal", 0.01744821108877659]]}, "loss": {"rwkv": 22.09126781361225, "qwen": 14.601942756142542}, "topk": {"rwkv": [31601, 41, 0.002152421046048403, [[32227, 0.142402, " that", false], [37810, 0.117379, " based", false], [4596, 0.089234, " in", false], [37634, 0.072337, " after", false], [4450, 0.053094, " by", false], [4424, 0.04055, " at", false], [50870, 0.038967, " against", false], [31581, 0.036845, " only", false], [55437, 0.031206, " achieved", false], [37924, 0.029755, " built", false]]], "qwen": [916, 14, 0.01744821108877659, [[304, 0.155545, " in", false], [429, 0.120506, " that", false], [518, 0.07092, " at", false], [2348, 0.067026, " against", false], [553, 0.062182, " by", false], [16994, 0.051364, " achieved", false], [3118, 0.048459, " based", false], [315, 0.036886, " of", false], [1283, 0.032752, " after", false], [369, 0.032327, " for", false]]]}, "raw_delta": 0.4152963638305664, "tuned_delta": 0.4238681558611446}, {"byte_start": 5644, "byte_end": 5646, "display": {"text": " a", "kind": "normal"}, "is_word": true, "word_id": 948, "word_key": " a", "bytes_hex": "20 61", "compression": {"rwkv": "10.99% 10.99%", "qwen": "10.54% 10.54%"}, "model_tokens": {"rwkv": [[332, " a", "normal", 0.2956809997558594]], "qwen": [[264, " a", "normal", 0.3108728528022766]]}, "loss": {"rwkv": 10.9892786317714, "qwen": 10.535021930939031}, "topk": {"rwkv": [332, 1, 0.2956809997558594, [[332, 0.295681, " a", false], [22590, 0.156365, " the", false], [38720, 0.056497, " human", false], [4419, 0.04167, " an", false], [51396, 0.025634, " decades", false], [32464, 0.022762, " what", false], [32251, 0.022253, " time", false], [32139, 0.019951, " such", false], [31370, 0.016971, " many", false], [60522, 0.016744, " something", false]]], "qwen": [264, 1, 0.3108728528022766, [[264, 0.310873, " a", false], [279, 0.133102, " the", false], [458, 0.105017, " an", false], [10793, 0.034139, " decades", false], [1128, 0.025159, " what", false], [882, 0.023667, " time", false], [1657, 0.022911, " many", false], [2494, 0.017569, " something", false], [892, 0.015761, " which", false], [3738, 0.012052, " human", false]]]}, "raw_delta": 0.025189340114593506, "tuned_delta": 0.033761132145171756}, {"byte_start": 5646, "byte_end": 5654, "display": {"text": " favored", "kind": "normal"}, "is_word": true, "word_id": 949, "word_key": " favored", "bytes_hex": "20 66 61 76 6f 72 65 64", "compression": {"rwkv": "23.95% 23.95% 23.95% 23.95% 23.95% 23.95% 23.95% 23.95%", "qwen": "23.85% 23.85% 23.85% 23.85% 23.85% 23.85% 23.85% 23.85%"}, "model_tokens": {"rwkv": [[51722, " favored", "normal", 2.4290700821438804e-05]], "qwen": [[45503, " favored", "normal", 2.53817252087174e-05]]}, "loss": {"rwkv": 23.95099188975818, "qwen": 23.852890835922896}, "topk": {"rwkv": [51722, 888, 2.4290700821438804e-05, [[31323, 0.379958, " long", false], [32386, 0.105367, " very", false], [46470, 0.065834, " longer", false], [31466, 0.057021, " much", false], [46790, 0.019398, " period", false], [31118, 0.015977, " huge", false], [62471, 0.015084, " relatively", false], [39675, 0.014525, " short", false], [38864, 0.014124, " large", false], [32251, 0.013945, " time", false]]], "qwen": [45503, 1111, 2.53817252087174e-05, [[1293, 0.219826, " long", false], [1602, 0.085832, " very", false], [1753, 0.078482, " much", false], [4168, 0.072124, " period", false], [882, 0.056071, " time", false], [5021, 0.048234, " longer", false], [2155, 0.021774, " different", false], [12767, 0.011735, " vast", false], [1714, 0.010897, " method", false], [3460, 0.010863, " large", false]]]}, "raw_delta": 0.005439877510070801, "tuned_delta": 0.014011669540649049}, {"byte_start": 5654, "byte_end": 5655, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "68.47%", "qwen": "59.41%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.022521788254380226]], "qwen": [[11, ",", "normal", 0.03708159551024437]]}, "loss": {"rwkv": 68.47165916719104, "qwen": 59.41441213738106}, "topk": {"rwkv": [45, 6, 0.022521788254380226, [[55532, 0.449047, " approach", false], [46561, 0.125214, " method", false], [22752, 0.052567, " way", false], [38720, 0.037699, " human", false], [21400, 0.036149, " but", false], [45, 0.022522, ",", false], [21265, 0.015819, " and", false], [63277, 0.0157, " alternative", false], [57317, 0.01437, " strategy", false], [31135, 0.013747, " idea", false]]], "qwen": [11, 3, 0.03708159551024437, [[5486, 0.512128, " approach", false], [1815, 0.046588, " path", false], [11, 0.037082, ",", false], [1714, 0.029168, " method", false], [323, 0.024596, " and", false], [1616, 0.019403, " way", false], [714, 0.014412, " but", false], [10555, 0.013887, " alternative", false], [2856, 0.013755, " initial", false], [2309, 0.013726, " position", false]]]}, "raw_delta": 0.5022404193878174, "tuned_delta": 0.5108122114183956}, {"byte_start": 5655, "byte_end": 5661, "display": {"text": " human", "kind": "normal"}, "is_word": true, "word_id": 950, "word_key": " human", "bytes_hex": "20 68 75 6d 61 6e", "compression": {"rwkv": "6.06% 6.06% 6.06% 6.06% 6.06% 6.06%", "qwen": "7.77% 7.77% 7.77% 7.77% 7.77% 7.77%"}, "model_tokens": {"rwkv": [[38720, " human", "normal", 0.13161326944828033]], "qwen": [[3738, " human", "normal", 0.07525920867919922]]}, "loss": {"rwkv": 6.058192066232952, "qwen": 7.774975198535144}, "topk": {"rwkv": [38720, 2, 0.13161326944828033, [[21400, 0.261989, " but", false], [38720, 0.131613, " human", false], [21265, 0.067886, " and", false], [56847, 0.044525, " personal", false], [39675, 0.027583, " short", false], [31323, 0.023109, " long", false], [62309, 0.018654, " personally", false], [47544, 0.016238, " though", false], [30437, 0.014396, " cher", false], [56205, 0.014345, " familiar", false]]], "qwen": [3738, 2, 0.07525920867919922, [[714, 0.151215, " but", false], [3738, 0.075259, " human", false], [323, 0.063641, " and", false], [1293, 0.049341, " long", false], [3281, 0.018588, " special", false], [81044, 0.017409, " entrenched", false], [2805, 0.013023, " short", false], [4345, 0.011846, " personal", false], [15102, 0.011559, " initially", false], [4124, 0.011314, " early", false]]]}, "raw_delta": -0.09519867102305096, "tuned_delta": -0.08662687899247272}, {"byte_start": 5661, "byte_end": 5669, "display": {"text": "-centric", "kind": "normal"}, "is_word": true, "word_id": 951, "word_key": "-centric", "bytes_hex": "2d 63 65 6e 74 72 69 63", "compression": {"rwkv": "5.32% 6.72% 6.72% 6.72% 6.72% 6.72% 6.72% 6.72%", "qwen": "7.71% 7.71% 7.71% 7.71% 7.71% 7.71% 7.71% 7.71%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.7443927526473999], [48948, "centric", "normal", 0.07364126294851303]], "qwen": [[64424, "-centric", "normal", 0.032710764557123184]]}, "loss": {"rwkv": 6.54689796692471, "qwen": 7.709516810130813}, "topk": {"rwkv": [46, 1, 0.7443927526473999, [[46, 0.744393, "-", false], [22752, 0.057986, " way", false], [55532, 0.045527, " approach", false], [45, 0.028108, ",", false], [2030, 0.022282, "ly", false], [34864, 0.015767, "istic", false], [46561, 0.007028, " method", false], [7919, 0.00693, "ist", false], [65034, 0.005707, " understanding", false], [59943, 0.004915, " knowledge", false]]], "qwen": [64424, 4, 0.032710764557123184, [[12646, 0.578206, "-k", false], [49382, 0.05646, "-centered", false], [71107, 0.045622, "-under", false], [64424, 0.032711, "-centric", false], [12681, 0.023995, "-like", false], [35085, 0.021641, "-oriented", false], [6540, 0.017246, " knowledge", false], [5980, 0.016713, "-based", false], [12, 0.014339, "-", false], [3419, 0.010668, "-in", false]]]}, "raw_delta": -0.06446927785873413, "tuned_delta": -0.05589748582815588}, {"byte_start": 5669, "byte_end": 5678, "display": {"text": " approach", "kind": "normal"}, "is_word": true, "word_id": 952, "word_key": " approach", "bytes_hex": "20 61 70 70 72 6f 61 63 68", "compression": {"rwkv": "1.37% 1.37% 1.37% 1.37% 1.37% 1.37% 1.37% 1.37% 1.37%", "qwen": "1.34% 1.34% 1.34% 1.34% 1.34% 1.34% 1.34% 1.34% 1.34%"}, "model_tokens": {"rwkv": [[55532, " approach", "normal", 0.5075794458389282]], "qwen": [[5486, " approach", "normal", 0.5117776393890381]]}, "loss": {"rwkv": 1.3697462682051245, "qwen": 1.342237523767222}, "topk": {"rwkv": [55532, 1, 0.5075794458389282, [[55532, 0.507579, " approach", false], [45, 0.133189, ",", false], [46561, 0.05707, " method", false], [22752, 0.054261, " way", false], [32398, 0.042187, " view", false], [46681, 0.016602, " notion", false], [57317, 0.013877, " strategy", false], [56810, 0.010144, " paradigm", false], [63708, 0.008959, " methodology", false], [31135, 0.008109, " idea", false]]], "qwen": [5486, 1, 0.5117776393890381, [[5486, 0.511778, " approach", false], [11, 0.194958, ",", false], [1651, 0.037037, " view", false], [1616, 0.025717, " way", false], [13057, 0.025309, " perspective", false], [11129, 0.017677, " vision", false], [1714, 0.013919, " method", false], [48240, 0.010254, " paradigm", false], [1614, 0.008498, " model", false], [42556, 0.006575, " conception", false]]]}, "raw_delta": 0.001525408691830099, "tuned_delta": 0.010097200722408347}, {"byte_start": 5678, "byte_end": 5680, "display": {"text": ".\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e 0a", "compression": {"rwkv": "11.55% 9.65%", "qwen": "13.81% 13.81%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.5315477252006531], [261, "\n\n", "control", 0.34259605407714844]], "qwen": [[382, ".\n\n", "control", 0.10044247657060623]]}, "loss": {"rwkv": 10.601836115907664, "qwen": 13.814827464836712}, "topk": {"rwkv": [47, 1, 0.5315477252006531, [[47, 0.531548, ".", false], [32227, 0.152361, " that", false], [45, 0.149682, ",", false], [4811, 0.070093, " to", false], [21265, 0.015953, " and", false], [5346, 0.013315, "---", false], [60, 0.006668, ";", false], [4596, 0.005774, " in", false], [47001, 0.005749, " rather", false], [275, 0.005231, " (", false]]], "qwen": [382, 4, 0.10044247657060623, [[13, 0.279323, ".", false], [11, 0.207899, ",", false], [429, 0.159146, " that", false], [382, 0.100442, ".\n\n", false], [311, 0.059556, " to", false], [4421, 0.037203, "---", false], [323, 0.026511, " and", false], [4751, 0.016863, " rather", false], [3118, 0.014959, " based", false], [320, 0.011289, " (", false]]]}, "raw_delta": -0.1781660715738932, "tuned_delta": -0.16959427954331494}, {"byte_start": 5680, "byte_end": 5681, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "9.65%", "qwen": "13.81%"}, "model_tokens": {"rwkv": [[261, "\n\n", "control", 0.34259605407714844]], "qwen": [[382, ".\n\n", "control", 0.10044247657060623]]}, "loss": {"rwkv": 9.650840849696678, "qwen": 13.814827464836712}, "topk": {"rwkv": [261, 1, 0.34259605407714844, [[261, 0.342596, "\n\n", false], [19555, 0.139247, " But", false], [20996, 0.086645, " The", false], [3918, 0.042543, " It", false], [29894, 0.041358, " This", false], [4331, 0.037635, " We", false], [267, 0.021008, "  ", false], [3913, 0.018412, " In", false], [19417, 0.011484, " And", false], [37451, 0.00935, " There", false]]], "qwen": [382, 4, 0.10044247657060623, [[13, 0.279323, ".", false], [11, 0.207899, ",", false], [429, 0.159146, " that", false], [382, 0.100442, ".\n\n", false], [311, 0.059556, " to", false], [4421, 0.037203, "---", false], [323, 0.026511, " and", false], [4751, 0.016863, " rather", false], [3118, 0.014959, " based", false], [320, 0.011289, " (", false]]]}, "raw_delta": -0.2309004465738932, "tuned_delta": -0.22232865454331494}, {"byte_start": 5681, "byte_end": 5684, "display": {"text": "One", "kind": "normal"}, "is_word": true, "word_id": 953, "word_key": "one", "bytes_hex": "4f 6e 65", "compression": {"rwkv": "24.04% 24.04% 24.04%", "qwen": "25.47% 25.47% 25.47%"}, "model_tokens": {"rwkv": [[6393, "One", "normal", 0.018186720088124275]], "qwen": [[3966, "One", "normal", 0.014451012015342712]]}, "loss": {"rwkv": 24.044917348149387, "qwen": 25.46952417106141}, "topk": {"rwkv": [6393, 12, 0.018186720088124275, [[6699, 0.173339, "The", false], [1136, 0.074415, "In", false], [24242, 0.05702, "This", false], [1589, 0.045547, "We", false], [1500, 0.041338, "To", false], [33504, 0.039424, "There", false], [66, 0.031859, "A", false], [1141, 0.030634, "It", false], [74, 0.030074, "I", false], [24326, 0.022752, "What", false]]], "qwen": [3966, 12, 0.014451012015342712, [[785, 0.170455, "The", false], [1986, 0.064505, "This", false], [641, 0.054122, "In", false], [3862, 0.035957, "There", false], [2132, 0.034442, "It", false], [1654, 0.034082, "We", false], [32, 0.026993, "A", false], [1249, 0.026394, "To", false], [40, 0.018889, "I", false], [3983, 0.016479, "But", false]]]}, "raw_delta": -0.07899697621663426, "tuned_delta": -0.07042518418605602}, {"byte_start": 5684, "byte_end": 5690, "display": {"text": " thing", "kind": "normal"}, "is_word": true, "word_id": 954, "word_key": " thing", "bytes_hex": "20 74 68 69 6e 67", "compression": {"rwkv": "11.55% 11.55% 11.55% 11.55% 11.55% 11.55%", "qwen": "11.64% 11.64% 11.64% 11.64% 11.64% 11.64%"}, "model_tokens": {"rwkv": [[39941, " thing", "normal", 0.021191934123635292]], "qwen": [[3166, " thing", "normal", 0.020781708881258965]]}, "loss": {"rwkv": 11.55283138211865, "qwen": 11.642795506784987}, "topk": {"rwkv": [39941, 7, 0.021191934123635292, [[4706, 0.154792, " of", false], [22752, 0.140198, " way", false], [47009, 0.063192, " reason", false], [21413, 0.045563, " can", false], [39021, 0.041041, " might", false], [51668, 0.022052, " example", false], [39941, 0.021192, " thing", false], [46430, 0.017946, " lesson", false], [56895, 0.016454, " possible", false], [59829, 0.015548, " important", false]]], "qwen": [3166, 5, 0.020781708881258965, [[315, 0.175248, " of", false], [2874, 0.116729, " reason", false], [1616, 0.105777, " way", false], [646, 0.042688, " can", false], [3166, 0.020782, " thing", false], [2578, 0.019364, " might", false], [2989, 0.016264, " important", false], [5486, 0.014129, " approach", false], [1590, 0.01315, " final", false], [803, 0.013112, " more", false]]]}, "raw_delta": -0.004988670349121094, "tuned_delta": 0.0035831216814571545}, {"byte_start": 5690, "byte_end": 5695, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 955, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "2.49% 2.49% 2.49% 2.49% 2.49%", "qwen": "2.65% 2.65% 2.65% 2.65% 2.65%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.49741557240486145]], "qwen": [[429, " that", "normal", 0.47998541593551636]]}, "loss": {"rwkv": 2.4937209202865867, "qwen": 2.6473437782348497}, "topk": {"rwkv": [32227, 1, 0.49741557240486145, [[32227, 0.497416, " that", false], [4858, 0.150318, " we", false], [4811, 0.113244, " to", false], [4600, 0.033267, " is", false], [32234, 0.03034, " this", false], [308, 0.026921, " I", false], [22590, 0.02312, " the", false], [37598, 0.010763, " about", false], [3609, 0.006933, " AI", false], [39936, 0.004753, " these", false]]], "qwen": [429, 1, 0.47998541593551636, [[429, 0.479985, " that", false], [311, 0.16196, " to", false], [582, 0.093175, " we", false], [374, 0.059273, " is", false], [358, 0.025259, " I", false], [911, 0.022871, " about", false], [279, 0.016734, " the", false], [419, 0.014615, " this", false], [5802, 0.008468, " worth", false], [15235, 0.00763, " AI", false]]]}, "raw_delta": -0.008518660068511957, "tuned_delta": 5.313196206629088e-05}, {"byte_start": 5695, "byte_end": 5702, "display": {"text": " should", "kind": "normal"}, "is_word": true, "word_id": 956, "word_key": " should", "bytes_hex": "20 73 68 6f 75 6c 64", "compression": {"rwkv": "11.11% 11.11% 11.11% 11.11% 11.11% 11.11% 11.11%", "qwen": "11.03% 11.03% 11.03% 11.03% 11.03% 11.03% 11.03%"}, "model_tokens": {"rwkv": [[47266, " should", "normal", 0.013386623933911324]], "qwen": [[1265, " should", "normal", 0.013812181539833546]]}, "loss": {"rwkv": 11.110039935417243, "qwen": 11.031991751560685}, "topk": {"rwkv": [47266, 16, 0.013386623933911324, [[4600, 0.196296, " is", false], [21800, 0.078812, " has", false], [4858, 0.062292, " we", false], [38964, 0.04568, " makes", false], [21413, 0.045268, " can", false], [22590, 0.029351, " the", false], [39021, 0.021661, " might", false], [38686, 0.021108, " helps", false], [308, 0.019905, " I", false], [32234, 0.019869, " this", false]]], "qwen": [1265, 15, 0.013812181539833546, [[374, 0.176985, " is", false], [646, 0.06568, " can", false], [582, 0.061963, " we", false], [702, 0.052179, " has", false], [3643, 0.036484, " makes", false], [279, 0.036215, " the", false], [8609, 0.036166, " helps", false], [1558, 0.028032, " does", false], [11811, 0.024418, " researchers", false], [358, 0.023333, " I", false]]]}, "raw_delta": 0.004327910287039605, "tuned_delta": 0.012899702317617853}, {"byte_start": 5702, "byte_end": 5705, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 957, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"rwkv": "2.14% 2.14% 2.14%", "qwen": "3.09% 3.09% 3.09%"}, "model_tokens": {"rwkv": [[4435, " be", "normal", 0.7007312774658203]], "qwen": [[387, " be", "normal", 0.5976617932319641]]}, "loss": {"rwkv": 2.1368041783999945, "qwen": 3.094161369504148}, "topk": {"rwkv": [4435, 1, 0.7007312774658203, [[4435, 0.700731, " be", false], [31073, 0.056464, " help", false], [22187, 0.049648, " not", false], [31059, 0.023253, " have", false], [31358, 0.013951, " make", false], [30135, 0.010645, " also", false], [30482, 0.010423, " come", false], [45284, 0.008644, " become", false], [45150, 0.006725, " always", false], [47428, 0.00665, " strike", false]]], "qwen": [387, 1, 0.5976617932319641, [[387, 0.597662, " be", false], [537, 0.079499, " not", false], [1492, 0.06085, " help", false], [1281, 0.035471, " make", false], [614, 0.023218, " have", false], [1083, 0.012459, " also", false], [2525, 0.011101, " come", false], [2968, 0.008135, " give", false], [3635, 0.007961, " become", false], [32944, 0.006529, " emerge", false]]]}, "raw_delta": -0.05308715502421061, "tuned_delta": -0.04451536299363236}, {"byte_start": 5705, "byte_end": 5713, "display": {"text": " learned", "kind": "normal"}, "is_word": true, "word_id": 958, "word_key": " learned", "bytes_hex": "20 6c 65 61 72 6e 65 64", "compression": {"rwkv": "5.57% 5.57% 5.57% 5.57% 5.57% 5.57% 5.57% 5.57%", "qwen": "7.63% 7.63% 7.63% 7.63% 7.63% 7.63% 7.63% 7.63%"}, "model_tokens": {"rwkv": [[52112, " learned", "normal", 0.08431340008974075]], "qwen": [[9498, " learned", "normal", 0.033842235803604126]]}, "loss": {"rwkv": 5.565083409679106, "qwen": 7.632860917966555}, "topk": {"rwkv": [52112, 2, 0.08431340008974075, [[38049, 0.299266, " clear", false], [52112, 0.084313, " learned", false], [39140, 0.082093, " noted", false], [52346, 0.057422, " obvious", false], [62684, 0.037237, " understood", false], [61934, 0.02881, " emphasized", false], [31207, 0.024649, " kept", false], [55524, 0.021464, " apparent", false], [31351, 0.018904, " made", false], [63289, 0.017947, " appreciated", false]]], "qwen": [9498, 7, 0.033842235803604126, [[2797, 0.275875, " clear", false], [10342, 0.093688, " noted", false], [8036, 0.061994, " obvious", false], [3694, 0.059659, " added", false], [1053, 0.05515, " said", false], [45628, 0.043568, " emphasized", false], [9498, 0.033842, " learned", false], [31547, 0.029003, " stressed", false], [29476, 0.021034, " evident", false], [9733, 0.019105, " mentioned", false]]]}, "raw_delta": -0.11466193199157715, "tuned_delta": -0.1060901399609989}, {"byte_start": 5713, "byte_end": 5718, "display": {"text": " from", "kind": "normal"}, "is_word": true, "word_id": 959, "word_key": " from", "bytes_hex": "20 66 72 6f 6d", "compression": {"rwkv": "2.13% 2.13% 2.13% 2.13% 2.13%", "qwen": "2.05% 2.05% 2.05% 2.05% 2.05%"}, "model_tokens": {"rwkv": [[30917, " from", "normal", 0.5561042428016663]], "qwen": [[504, " from", "normal", 0.5667757391929626]]}, "loss": {"rwkv": 2.1274116325608734, "qwen": 2.0478752459729774}, "topk": {"rwkv": [30917, 1, 0.5561042428016663, [[30917, 0.556104, " from", false], [4600, 0.269363, " is", false], [45, 0.045566, ",", false], [31077, 0.017917, " here", false], [4450, 0.014278, " by", false], [37598, 0.013777, " about", false], [4596, 0.012411, " in", false], [21265, 0.00878, " and", false], [31458, 0.00544, " more", false], [32458, 0.004925, " well", false]]], "qwen": [504, 1, 0.5667757391929626, [[504, 0.566776, " from", false], [374, 0.260513, " is", false], [11, 0.046342, ",", false], [304, 0.019425, " in", false], [1588, 0.018739, " here", false], [553, 0.014429, " by", false], [911, 0.012014, " about", false], [323, 0.004805, " and", false], [438, 0.004626, " as", false], [518, 0.004103, " at", false]]]}, "raw_delta": 0.004410433769226077, "tuned_delta": 0.012982225799804325}, {"byte_start": 5718, "byte_end": 5722, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 960, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "5.99% 5.99% 5.99% 5.99%", "qwen": "7.25% 7.25% 7.25% 7.25%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.26441845297813416]], "qwen": [[279, " the", "normal", 0.20029723644256592]]}, "loss": {"rwkv": 5.987747972439545, "qwen": 7.249329932518381}, "topk": {"rwkv": [22590, 2, 0.26441845297813416, [[32234, 0.383667, " this", false], [22590, 0.264418, " the", false], [39936, 0.180487, " these", false], [21256, 0.056352, " all", false], [3609, 0.018239, " AI", false], [45315, 0.013758, " bitter", false], [51929, 0.008418, " history", false], [55809, 0.003554, " computer", false], [31636, 0.003259, " past", false], [22248, 0.00314, " our", false]]], "qwen": [279, 2, 0.20029723644256592, [[419, 0.461009, " this", false], [279, 0.200297, " the", false], [1493, 0.151398, " these", false], [678, 0.087104, " all", false], [6366, 0.00636, " computer", false], [15235, 0.004603, " AI", false], [3840, 0.003931, " history", false], [20219, 0.003923, " Moore", false], [1817, 0.003834, " each", false], [264, 0.003543, " a", false]]]}, "raw_delta": -0.0699569582939148, "tuned_delta": -0.061385166263336545}, {"byte_start": 5722, "byte_end": 5729, "display": {"text": " bitter", "kind": "normal"}, "is_word": true, "word_id": 961, "word_key": " bitter", "bytes_hex": "20 62 69 74 74 65 72", "compression": {"rwkv": "0.76% 0.76% 0.76% 0.76% 0.76% 0.76% 0.76%", "qwen": "0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45%"}, "model_tokens": {"rwkv": [[45315, " bitter", "normal", 0.7465822100639343]], "qwen": [[25180, " bitter", "normal", 0.8381265997886658]]}, "loss": {"rwkv": 0.7597898687717407, "qwen": 0.45492843128433225}, "topk": {"rwkv": [45315, 1, 0.7465822100639343, [[45315, 0.746582, " bitter", false], [51929, 0.04974, " history", false], [31636, 0.011954, " past", false], [37599, 0.011739, " above", false], [60587, 0.009584, " successes", false], [61640, 0.008671, " bitterness", false], [62061, 0.007071, " historical", false], [3609, 0.00692, " AI", false], [56162, 0.006886, " examples", false], [52427, 0.005523, " pattern", false]]], "qwen": [25180, 1, 0.8381265997886658, [[25180, 0.838127, " bitter", false], [3840, 0.020017, " history", false], [3403, 0.01126, " above", false], [78996, 0.010213, " bitterness", false], [6366, 0.008315, " computer", false], [18366, 0.00567, " lessons", false], [3139, 0.005327, " experience", false], [13656, 0.004365, " historical", false], [3267, 0.004178, " past", false], [4124, 0.003944, " early", false]]]}, "raw_delta": 0.016905107668467933, "tuned_delta": 0.02547689969904618}, {"byte_start": 5729, "byte_end": 5736, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 962, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"rwkv": "1.49% 1.49% 1.49% 1.49% 1.49% 1.49% 1.49%", "qwen": "0.52% 0.52% 0.52% 0.52% 0.52% 0.52% 0.52%"}, "model_tokens": {"rwkv": [[46430, " lesson", "normal", 0.5590899586677551]], "qwen": [[17755, " lesson", "normal", 0.8182079195976257]]}, "loss": {"rwkv": 1.4893894116320212, "qwen": 0.5168938955571559}, "topk": {"rwkv": [46430, 1, 0.5590899586677551, [[46430, 0.55909, " lesson", false], [52127, 0.399026, " lessons", false], [61979, 0.008515, " experience", false], [46, 0.007213, "-", false], [31636, 0.002694, " past", false], [63558, 0.002306, " experiences", false], [51929, 0.002008, " history", false], [39899, 0.001541, " taste", false], [45, 0.001254, ",", false], [39831, 0.000541, " story", false]]], "qwen": [17755, 1, 0.8182079195976257, [[17755, 0.818208, " lesson", false], [18366, 0.105563, " lessons", false], [3139, 0.03114, " experience", false], [3840, 0.013571, " history", false], [11449, 0.004299, " experiences", false], [15235, 0.003162, " AI", false], [11, 0.001942, ",", false], [13656, 0.00183, " historical", false], [3267, 0.001488, " past", false], [323, 0.000688, " and", false]]]}, "raw_delta": 0.05392660200595856, "tuned_delta": 0.06249839403653681}, {"byte_start": 5736, "byte_end": 5739, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 963, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "1.06% 1.06% 1.06%", "qwen": "1.21% 1.21% 1.21%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.8394970297813416]], "qwen": [[374, " is", "normal", 0.817969799041748]]}, "loss": {"rwkv": 1.0566614069010962, "qwen": 1.2078356797725596}, "topk": {"rwkv": [4600, 1, 0.8394970297813416, [[4600, 0.839497, " is", false], [4706, 0.056035, " of", false], [45, 0.04297, ",", false], [4596, 0.011184, " in", false], [32227, 0.009509, " that", false], [37598, 0.00805, " about", false], [59, 0.004939, ":", false], [21265, 0.004035, " and", false], [5346, 0.002418, "---", false], [4712, 0.001878, " on", false]]], "qwen": [374, 1, 0.817969799041748, [[374, 0.81797, " is", false], [315, 0.068726, " of", false], [11, 0.038809, ",", false], [304, 0.012614, " in", false], [911, 0.007968, " about", false], [429, 0.006566, " that", false], [25, 0.006301, ":", false], [4421, 0.005378, "---", false], [323, 0.004139, " and", false], [389, 0.002969, " on", false]]]}, "raw_delta": -0.008382881681124374, "tuned_delta": 0.0001889103494538743}, {"byte_start": 5739, "byte_end": 5743, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 964, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "11.27% 11.27% 11.27% 11.27%", "qwen": "10.35% 10.35% 10.35% 10.35%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.08066534996032715]], "qwen": [[279, " the", "normal", 0.10073703527450562]]}, "loss": {"rwkv": 11.271055006945026, "qwen": 10.347918780390678}, "topk": {"rwkv": [22590, 3, 0.08066534996032715, [[32227, 0.687518, " that", false], [4811, 0.096033, " to", false], [22590, 0.080665, " the", false], [22187, 0.028248, " not", false], [21835, 0.022794, " how", false], [32234, 0.014226, " this", false], [332, 0.013353, " a", false], [45, 0.005186, ",", false], [59, 0.005085, ":", false], [32464, 0.004776, " what", false]]], "qwen": [279, 2, 0.10073703527450562, [[429, 0.677339, " that", false], [279, 0.100737, " the", false], [311, 0.073085, " to", false], [1246, 0.036996, " how", false], [537, 0.025421, " not", false], [264, 0.013102, " a", false], [419, 0.009452, " this", false], [1128, 0.009201, " what", false], [911, 0.00403, " about", false], [1101, 0.003283, " just", false]]]}, "raw_delta": 0.051189541816711426, "tuned_delta": 0.059761333847289676}, {"byte_start": 5743, "byte_end": 5749, "display": {"text": " great", "kind": "normal"}, "is_word": true, "word_id": 965, "word_key": " great", "bytes_hex": "20 67 72 65 61 74", "compression": {"rwkv": "16.72% 16.72% 16.72% 16.72% 16.72% 16.72%", "qwen": "13.41% 13.41% 13.41% 13.41% 13.41% 13.41%"}, "model_tokens": {"rwkv": [[38629, " great", "normal", 0.0038409861735999584]], "qwen": [[2244, " great", "normal", 0.011553216725587845]]}, "loss": {"rwkv": 16.718731593635123, "qwen": 13.40742062958532}, "topk": {"rwkv": [38629, 27, 0.0038409861735999584, [[62079, 0.236673, " importance", false], [31506, 0.113577, " need", false], [40093, 0.043038, " value", false], [59725, 0.018497, " following", false], [30808, 0.015713, " fact", false], [45661, 0.013849, " danger", false], [21719, 0.012937, " fut", false], [31135, 0.008465, " idea", false], [60051, 0.008357, " necessity", false], [63820, 0.008164, " realization", false]]], "qwen": [2244, 10, 0.011553216725587845, [[12650, 0.178247, " importance", false], [1184, 0.076754, " need", false], [897, 0.037843, " value", false], [2355, 0.019332, " power", false], [2097, 0.017897, " fact", false], [3476, 0.012779, " role", false], [6672, 0.012589, " difference", false], [23389, 0.012551, " wisdom", false], [17755, 0.012181, " lesson", false], [2244, 0.011553, " great", false]]]}, "raw_delta": 0.18361806869506836, "tuned_delta": 0.19218986072564662}, {"byte_start": 5749, "byte_end": 5755, "display": {"text": " power", "kind": "normal"}, "is_word": true, "word_id": 966, "word_key": " power", "bytes_hex": "20 70 6f 77 65 72", "compression": {"rwkv": "7.84% 7.84% 7.84% 7.84% 7.84% 7.84%", "qwen": "6.64% 6.64% 6.64% 6.64% 6.64% 6.64%"}, "model_tokens": {"rwkv": [[39339, " power", "normal", 0.07397116720676422]], "qwen": [[2355, " power", "normal", 0.10960918664932251]]}, "loss": {"rwkv": 7.842775775665913, "qwen": 6.644915179217694}, "topk": {"rwkv": [39339, 3, 0.07397116720676422, [[62079, 0.249328, " importance", false], [40093, 0.20345, " value", false], [39339, 0.073971, " power", false], [60211, 0.029027, " potential", false], [59093, 0.028662, " advantage", false], [51030, 0.02592, " benefit", false], [45661, 0.018144, " danger", false], [61865, 0.018045, " difficulty", false], [31506, 0.01731, " need", false], [30510, 0.013183, " cost", false]]], "qwen": [2355, 3, 0.10960918664932251, [[12650, 0.233723, " importance", false], [897, 0.15247, " value", false], [2355, 0.109609, " power", false], [4650, 0.025403, " potential", false], [16829, 0.025179, " difficulty", false], [6672, 0.019781, " difference", false], [1184, 0.019257, " need", false], [9423, 0.014658, " advantage", false], [7978, 0.011806, " danger", false], [8760, 0.011559, " benefit", false]]]}, "raw_delta": 0.066423495610555, "tuned_delta": 0.07499528764113324}, {"byte_start": 5755, "byte_end": 5758, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 967, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "1.32% 1.32% 1.32%", "qwen": "0.86% 0.86% 0.86%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.8027152419090271]], "qwen": [[315, " of", "normal", 0.8665686249732971]]}, "loss": {"rwkv": 1.3208267586263702, "qwen": 0.8608919430866092}, "topk": {"rwkv": [4706, 1, 0.8027152419090271, [[4706, 0.802715, " of", false], [32227, 0.08327, " that", false], [21265, 0.047147, " and", false], [4596, 0.011247, " in", false], [45, 0.009468, ",", false], [4811, 0.008144, " to", false], [4858, 0.003839, " we", false], [59206, 0.003084, " available", false], [56454, 0.001722, " inherent", false], [275, 0.001532, " (", false]]], "qwen": [315, 1, 0.8665686249732971, [[315, 0.866569, " of", false], [429, 0.055394, " that", false], [323, 0.03366, " and", false], [304, 0.016253, " in", false], [11, 0.004085, ",", false], [2500, 0.002322, " available", false], [582, 0.001572, " we", false], [36988, 0.001447, " inherent", false], [320, 0.001337, " (", false], [311, 0.001265, " to", false]]]}, "raw_delta": 0.025504201650619507, "tuned_delta": 0.03407599368119776}, {"byte_start": 5758, "byte_end": 5766, "display": {"text": " general", "kind": "normal"}, "is_word": true, "word_id": 968, "word_key": " general", "bytes_hex": "20 67 65 6e 65 72 61 6c", "compression": {"rwkv": "7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29% 7.29%", "qwen": "8.35% 8.35% 8.35% 8.35% 8.35% 8.35% 8.35% 8.35%"}, "model_tokens": {"rwkv": [[51832, " general", "normal", 0.039375290274620056]], "qwen": [[4586, " general", "normal", 0.02458660677075386]]}, "loss": {"rwkv": 7.290963707617563, "qwen": 8.353099537273936}, "topk": {"rwkv": [51832, 7, 0.039375290274620056, [[63370, 0.118311, " computation", false], [22590, 0.097759, " the", false], [47202, 0.095433, " search", false], [52195, 0.082458, " massive", false], [37045, 0.044575, " Moore", false], [56537, 0.043099, " learning", false], [51832, 0.039375, " general", false], [30597, 0.034995, " deep", false], [38720, 0.030198, " human", false], [52805, 0.030027, " scaling", false]]], "qwen": [4586, 8, 0.02458660677075386, [[2711, 0.130795, " search", false], [34447, 0.084417, " computation", false], [6832, 0.075878, " learning", false], [26943, 0.074503, " scaling", false], [279, 0.052316, " the", false], [76482, 0.037135, " leveraging", false], [3738, 0.027417, " human", false], [4586, 0.024587, " general", false], [5538, 0.022336, " deep", false], [20219, 0.017969, " Moore", false]]]}, "raw_delta": -0.058897316455841064, "tuned_delta": -0.050325524425262814}, {"byte_start": 5766, "byte_end": 5774, "display": {"text": " purpose", "kind": "normal"}, "is_word": true, "word_id": 969, "word_key": " purpose", "bytes_hex": "20 70 75 72 70 6f 73 65", "compression": {"rwkv": "15.00% 15.00% 15.00% 15.00% 15.00% 15.00% 15.00% 15.00%", "qwen": "13.16% 13.16% 13.16% 13.16% 13.16% 13.16% 13.16% 13.16%"}, "model_tokens": {"rwkv": [[52610, " purpose", "normal", 0.0012786333682015538]], "qwen": [[7428, " purpose", "normal", 0.0029112529009580612]]}, "loss": {"rwkv": 15.004591977995565, "qwen": 13.162725505423662}, "topk": {"rwkv": [52610, 24, 0.0012786333682015538, [[52224, 0.728638, " methods", false], [7933, 0.05501, "ity", false], [45, 0.035518, ",", false], [63370, 0.027367, " computation", false], [61590, 0.025408, " approaches", false], [47202, 0.021693, " search", false], [46, 0.015861, "-", false], [62633, 0.00846, " techniques", false], [64862, 0.006902, " computational", false], [61559, 0.006029, " algorithms", false]]], "qwen": [7428, 16, 0.0029112529009580612, [[5413, 0.702868, " methods", false], [58238, 0.059669, "-purpose", false], [2022, 0.028043, "ization", false], [11, 0.025752, ",", false], [12538, 0.025624, " techniques", false], [19827, 0.023412, " approaches", false], [34447, 0.018258, " computation", false], [4849, 0.013943, "izing", false], [2711, 0.010966, " search", false], [16170, 0.00461, " principles", false]]]}, "raw_delta": 0.10213476419448853, "tuned_delta": 0.11070655622506677}, {"byte_start": 5774, "byte_end": 5782, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 970, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "3.49% 3.49% 3.49% 3.49% 3.49% 3.49% 3.49% 3.49%", "qwen": "1.14% 1.14% 1.14% 1.14% 1.14% 1.14% 1.14% 1.14%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.21236179769039154]], "qwen": [[5413, " methods", "normal", 0.6017976403236389]]}, "loss": {"rwkv": 3.4869826427736172, "qwen": 1.1447650286248554}, "topk": {"rwkv": [52224, 2, 0.21236179769039154, [[63370, 0.399466, " computation", false], [52224, 0.212362, " methods", false], [45, 0.075849, ",", false], [47202, 0.046389, " search", false], [59346, 0.036532, " computing", false], [61590, 0.018706, " approaches", false], [52167, 0.017686, " machine", false], [64862, 0.016841, " computational", false], [56537, 0.015442, " learning", false], [61559, 0.013269, " algorithms", false]]], "qwen": [5413, 1, 0.6017976403236389, [[5413, 0.601798, " methods", false], [34447, 0.076976, " computation", false], [11, 0.038898, ",", false], [12538, 0.035484, " techniques", false], [6832, 0.021442, " learning", false], [19827, 0.019211, " approaches", false], [2711, 0.018296, " search", false], [24231, 0.017946, " computing", false], [25185, 0.015499, " algorithms", false], [7375, 0.010698, " tools", false]]]}, "raw_delta": 0.1298801228404045, "tuned_delta": 0.13845191487098277}, {"byte_start": 5782, "byte_end": 5783, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "35.36%", "qwen": "36.43%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.14271970093250275]], "qwen": [[11, ",", "normal", 0.1326359212398529]]}, "loss": {"rwkv": 35.362935084290015, "qwen": 36.430706570436854}, "topk": {"rwkv": [45, 3, 0.14271970093250275, [[47, 0.2773, ".", false], [32227, 0.192116, " that", false], [45, 0.14272, ",", false], [37810, 0.105475, " based", false], [21700, 0.036589, " for", false], [4811, 0.028232, " to", false], [38888, 0.027374, " lever", false], [4596, 0.022836, " in", false], [5346, 0.021902, "---", false], [21265, 0.020357, " and", false]]], "qwen": [11, 3, 0.1326359212398529, [[429, 0.30262, " that", false], [13, 0.202239, ".", false], [11, 0.132636, ",", false], [3118, 0.076307, " based", false], [369, 0.057671, " for", false], [76482, 0.053195, " leveraging", false], [4421, 0.025408, "---", false], [323, 0.017669, " and", false], [320, 0.012069, " (", false], [315, 0.009734, " of", false]]]}, "raw_delta": -0.05920982360839844, "tuned_delta": -0.05063803157782019}, {"byte_start": 5783, "byte_end": 5786, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 971, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "25.17% 25.17% 25.17%", "qwen": "27.84% 27.84% 27.84%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.015138182789087296]], "qwen": [[315, " of", "normal", 0.009746178984642029]]}, "loss": {"rwkv": 25.172022848843888, "qwen": 27.83728098492755}, "topk": {"rwkv": [4706, 13, 0.015138182789087296, [[21265, 0.219321, " and", false], [40186, 0.088054, " which", false], [37810, 0.070383, " based", false], [32139, 0.05106, " such", false], [61953, 0.048148, " especially", false], [31296, 0.045576, " like", false], [4423, 0.035435, " as", false], [4596, 0.028835, " in", false], [32227, 0.023601, " that", false], [30788, 0.018099, " even", false]]], "qwen": [315, 21, 0.009746178984642029, [[323, 0.2285, " and", false], [892, 0.108199, " which", false], [1741, 0.049188, " such", false], [5310, 0.043817, " especially", false], [5413, 0.043779, " methods", false], [429, 0.04067, " that", false], [3118, 0.03595, " based", false], [304, 0.033636, " in", false], [438, 0.024886, " as", false], [1075, 0.021069, " like", false]]]}, "raw_delta": -0.14779329299926758, "tuned_delta": -0.13922150096868932}, {"byte_start": 5786, "byte_end": 5794, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 972, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "2.50% 2.50% 2.50% 2.50% 2.50% 2.50% 2.50% 2.50%", "qwen": "1.69% 1.69% 1.69% 1.69% 1.69% 1.69% 1.69% 1.69%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.3314961791038513]], "qwen": [[5413, " methods", "normal", 0.4725334644317627]]}, "loss": {"rwkv": 2.5007653296659274, "qwen": 1.6898617563899454}, "topk": {"rwkv": [52224, 1, 0.3314961791038513, [[52224, 0.331496, " methods", false], [63370, 0.076128, " computation", false], [51832, 0.061012, " general", false], [22590, 0.052537, " the", false], [47202, 0.045617, " search", false], [38888, 0.031043, " lever", false], [52195, 0.021047, " massive", false], [56537, 0.017199, " learning", false], [52805, 0.016802, " scaling", false], [39944, 0.015506, " those", false]]], "qwen": [5413, 1, 0.4725334644317627, [[5413, 0.472533, " methods", false], [76482, 0.103653, " leveraging", false], [2711, 0.027005, " search", false], [892, 0.024523, " which", false], [12538, 0.022774, " techniques", false], [279, 0.018274, " the", false], [4586, 0.016407, " general", false], [1667, 0.015324, " using", false], [26943, 0.014974, " scaling", false], [34447, 0.013791, " computation", false]]]}, "raw_delta": 0.044966042041778564, "tuned_delta": 0.053537834072356814}, {"byte_start": 5794, "byte_end": 5799, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 973, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "0.99% 0.99% 0.99% 0.99% 0.99%", "qwen": "0.76% 0.76% 0.76% 0.76% 0.76%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.7592579126358032]], "qwen": [[429, " that", "normal", 0.8100671768188477]]}, "loss": {"rwkv": 0.9932617224870304, "qwen": 0.7597162156659493}, "topk": {"rwkv": [32227, 1, 0.7592579126358032, [[32227, 0.759258, " that", false], [37810, 0.087618, " based", false], [22187, 0.0145, " not", false], [31296, 0.012691, " like", false], [37924, 0.008564, " built", false], [40191, 0.007539, " whose", false], [38888, 0.007425, " lever", false], [21700, 0.007131, " for", false], [4596, 0.006644, " in", false], [55966, 0.006543, " designed", false]]], "qwen": [429, 1, 0.8100671768188477, [[429, 0.810067, " that", false], [3118, 0.062734, " based", false], [76482, 0.010371, " leveraging", false], [537, 0.009305, " not", false], [892, 0.007798, " which", false], [369, 0.006217, " for", false], [304, 0.004875, " in", false], [6693, 0.004694, " whose", false], [315, 0.004501, " of", false], [448, 0.004247, " with", false]]]}, "raw_delta": 0.012950512766838068, "tuned_delta": 0.021522304797416316}, {"byte_start": 5799, "byte_end": 5808, "display": {"text": " continue", "kind": "normal"}, "is_word": true, "word_id": 974, "word_key": " continue", "bytes_hex": "20 63 6f 6e 74 69 6e 75 65", "compression": {"rwkv": "20.04% 20.04% 20.04% 20.04% 20.04% 20.04% 20.04% 20.04% 20.04%", "qwen": "17.37% 17.37% 17.37% 17.37% 17.37% 17.37% 17.37% 17.37% 17.37%"}, "model_tokens": {"rwkv": [[55851, " continue", "normal", 4.608542803907767e-05]], "qwen": [[3060, " continue", "normal", 0.00017152675718534738]]}, "loss": {"rwkv": 20.03743112345782, "qwen": 17.373998869850823}, "topk": {"rwkv": [55851, 480, 4.608542803907767e-05, [[21286, 0.197445, " are", false], [21413, 0.136272, " can", false], [4491, 0.12731, " do", false], [56540, 0.060552, " leverage", false], [32499, 0.054995, " work", false], [31358, 0.031331, " make", false], [39590, 0.030566, " scale", false], [22681, 0.029318, " use", false], [32187, 0.028249, " take", false], [37730, 0.015528, " apply", false]]], "qwen": [3060, 229, 0.00017152675718534738, [[32064, 0.184149, " leverage", false], [646, 0.143933, " can", false], [653, 0.121026, " do", false], [525, 0.112008, " are", false], [1896, 0.035563, " take", false], [5452, 0.028873, " scale", false], [975, 0.026423, " work", false], [1281, 0.025458, " make", false], [990, 0.024203, " use", false], [32194, 0.013727, " exploit", false]]]}, "raw_delta": 0.14769204457600915, "tuned_delta": 0.1562638366065874}, {"byte_start": 5808, "byte_end": 5811, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 975, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.42% 0.42% 0.42%", "qwen": "0.29% 0.29% 0.29%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.9320844411849976]], "qwen": [[311, " to", "normal", 0.9529430270195007]]}, "loss": {"rwkv": 0.42266456276043846, "qwen": 0.28974210546681106}, "topk": {"rwkv": [4811, 1, 0.9320844411849976, [[4811, 0.932084, " to", false], [38888, 0.003386, " lever", false], [22590, 0.003359, " the", false], [45, 0.003307, ",", false], [4596, 0.002794, " in", false], [52805, 0.002777, " scaling", false], [53362, 0.002759, " working", false], [39931, 0.002388, " their", false], [4712, 0.002205, " on", false], [59832, 0.001889, " improving", false]]], "qwen": [311, 1, 0.9529430270195007, [[311, 0.952943, " to", false], [26943, 0.00323, " scaling", false], [6832, 0.002523, " learning", false], [3238, 0.002497, " working", false], [40928, 0.002333, " evolving", false], [18392, 0.001735, " improving", false], [15039, 0.001664, " searching", false], [279, 0.001274, " the", false], [862, 0.001127, " their", false], [304, 0.001102, " in", false]]]}, "raw_delta": 0.007370786120494206, "tuned_delta": 0.015942578151072452}, {"byte_start": 5811, "byte_end": 5817, "display": {"text": " scale", "kind": "normal"}, "is_word": true, "word_id": 976, "word_key": " scale", "bytes_hex": "20 73 63 61 6c 65", "compression": {"rwkv": "5.92% 5.92% 5.92% 5.92% 5.92% 5.92%", "qwen": "8.58% 8.58% 8.58% 8.58% 8.58% 8.58%"}, "model_tokens": {"rwkv": [[39590, " scale", "normal", 0.1392880231142044]], "qwen": [[5452, " scale", "normal", 0.05761812999844551]]}, "loss": {"rwkv": 5.9173038786461385, "qwen": 8.577778030658298}, "topk": {"rwkv": [39590, 2, 0.1392880231142044, [[32499, 0.140866, " work", false], [39590, 0.139288, " scale", false], [51982, 0.134192, " improve", false], [4435, 0.07867, " be", false], [56540, 0.040068, " leverage", false], [31358, 0.025031, " make", false], [52573, 0.024293, " produce", false], [38877, 0.020745, " learn", false], [21751, 0.019687, " get", false], [31017, 0.019045, " grow", false]]], "qwen": [5452, 4, 0.05761812999844551, [[387, 0.151001, " be", false], [975, 0.120046, " work", false], [7269, 0.116449, " improve", false], [5452, 0.057618, " scale", false], [37580, 0.044474, " evolve", false], [1281, 0.040973, " make", false], [3063, 0.036439, " grow", false], [32064, 0.021143, " leverage", false], [8760, 0.01922, " benefit", false], [3960, 0.013668, " learn", false]]]}, "raw_delta": -0.1475280125935872, "tuned_delta": -0.13895622056300894}, {"byte_start": 5817, "byte_end": 5822, "display": {"text": " with", "kind": "normal"}, "is_word": true, "word_id": 977, "word_key": " with", "bytes_hex": "20 77 69 74 68", "compression": {"rwkv": "6.82% 6.82% 6.82% 6.82% 6.82%", "qwen": "4.33% 4.33% 4.33% 4.33% 4.33%"}, "model_tokens": {"rwkv": [[32487, " with", "normal", 0.14969824254512787]], "qwen": [[448, " with", "normal", 0.3008979856967926]]}, "loss": {"rwkv": 6.81898827920174, "qwen": 4.331634156650095}, "topk": {"rwkv": [32487, 1, 0.14969824254512787, [[32487, 0.149698, " with", false], [4596, 0.095813, " in", false], [4423, 0.094629, " as", false], [21265, 0.084582, " and", false], [45, 0.080031, ",", false], [63370, 0.05234, " computation", false], [47, 0.046884, ".", false], [64911, 0.036911, " exponentially", false], [4833, 0.028026, " up", false], [39931, 0.021112, " their", false]]], "qwen": [448, 1, 0.3008979856967926, [[448, 0.300898, " with", false], [438, 0.116872, " as", false], [705, 0.065229, " up", false], [323, 0.064483, " and", false], [11, 0.062953, ",", false], [13, 0.04911, ".", false], [34447, 0.038239, " computation", false], [304, 0.036669, " in", false], [1632, 0.029503, " well", false], [553, 0.024149, " by", false]]]}, "raw_delta": 0.1379281997680664, "tuned_delta": 0.14649999179864465}, {"byte_start": 5822, "byte_end": 5832, "display": {"text": " increased", "kind": "normal"}, "is_word": true, "word_id": 978, "word_key": " increased", "bytes_hex": "20 69 6e 63 72 65 61 73 65 64", "compression": {"rwkv": "6.09% 6.09% 6.09% 6.09% 6.09% 6.09% 6.09% 6.09% 6.09% 6.09%", "qwen": "7.67% 7.67% 7.67% 7.67% 7.67% 7.67% 7.67% 7.67% 7.67% 7.67%"}, "model_tokens": {"rwkv": [[59846, " increased", "normal", 0.03413951396942139]], "qwen": [[7172, " increased", "normal", 0.014236995950341225]]}, "loss": {"rwkv": 6.0863697037503135, "qwen": 7.667763937045909}, "topk": {"rwkv": [59846, 6, 0.03413951396942139, [[22590, 0.22892, " the", false], [63370, 0.133219, " computation", false], [31458, 0.076002, " more", false], [30789, 0.057314, " ever", false], [62092, 0.051011, " increasing", false], [59846, 0.03414, " increased", false], [37045, 0.03338, " Moore", false], [61535, 0.02794, " additional", false], [51816, 0.027925, " further", false], [52195, 0.024579, " massive", false]]], "qwen": [7172, 8, 0.014236995950341225, [[20219, 0.292234, " Moore", false], [279, 0.172921, " the", false], [34447, 0.141059, " computation", false], [7703, 0.047749, " increasing", false], [2500, 0.027034, " available", false], [54480, 0.016824, " computational", false], [803, 0.015453, " more", false], [7172, 0.014237, " increased", false], [10951, 0.012732, " massive", false], [501, 0.01187, " new", false]]]}, "raw_delta": -0.08769111633300782, "tuned_delta": -0.07911932430242957}, {"byte_start": 5832, "byte_end": 5844, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 979, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "1.16% 1.16% 1.16% 1.16% 1.16% 1.16% 1.16% 1.16% 1.16% 1.16% 1.16% 1.16%", "qwen": "0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65% 0.65%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.45999717712402344]], "qwen": [[34447, " computation", "normal", 0.6468513011932373]]}, "loss": {"rwkv": 1.1623275475912058, "qwen": 0.6546811617302088}, "topk": {"rwkv": [63370, 1, 0.45999717712402344, [[63370, 0.459997, " computation", false], [64862, 0.124821, " computational", false], [59346, 0.078693, " computing", false], [60406, 0.063126, " resources", false], [50897, 0.021716, " amounts", false], [51266, 0.021144, " compute", false], [39339, 0.015046, " power", false], [59206, 0.014973, " available", false], [56353, 0.012508, " hardware", false], [30579, 0.010723, " data", false]]], "qwen": [34447, 1, 0.6468513011932373, [[34447, 0.646851, " computation", false], [54480, 0.09894, " computational", false], [14713, 0.078807, " amounts", false], [24231, 0.046903, " computing", false], [2500, 0.015446, " available", false], [18048, 0.013459, " availability", false], [6366, 0.010488, " computer", false], [2783, 0.006107, " cost", false], [4963, 0.005944, " resources", false], [11773, 0.005312, " hardware", false]]]}, "raw_delta": 0.028149892886479694, "tuned_delta": 0.03672168491705794}, {"byte_start": 5844, "byte_end": 5849, "display": {"text": " even", "kind": "normal"}, "is_word": true, "word_id": 980, "word_key": " even", "bytes_hex": "20 65 76 65 6e", "compression": {"rwkv": "17.47% 17.47% 17.47% 17.47% 17.47%", "qwen": "19.09% 19.09% 19.09% 19.09% 19.09%"}, "model_tokens": {"rwkv": [[30788, " even", "normal", 0.007824920117855072]], "qwen": [[1496, " even", "normal", 0.005025168415158987]]}, "loss": {"rwkv": 17.47013526076479, "qwen": 19.091530938824565}, "topk": {"rwkv": [30788, 8, 0.007824920117855072, [[47, 0.437822, ".", false], [45, 0.262274, ",", false], [21265, 0.148169, " and", false], [5346, 0.016194, "---", false], [31601, 0.01369, " over", false], [4423, 0.009461, " as", false], [275, 0.008932, " (", false], [30788, 0.007825, " even", false], [4596, 0.007705, " in", false], [59206, 0.00638, " available", false]]], "qwen": [1496, 15, 0.005025168415158987, [[13, 0.533932, ".", false], [11, 0.231739, ",", false], [323, 0.065042, " and", false], [2355, 0.018454, " power", false], [2500, 0.016098, " available", false], [320, 0.012527, " (", false], [304, 0.01184, " in", false], [438, 0.010132, " as", false], [4421, 0.00899, "---", false], [382, 0.007814, ".\n\n", false]]]}, "raw_delta": -0.08990926742553706, "tuned_delta": -0.08133747539495882}, {"byte_start": 5849, "byte_end": 5852, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 981, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"rwkv": "6.39% 6.39% 6.39%", "qwen": "6.94% 6.94% 6.94%"}, "model_tokens": {"rwkv": [[4423, " as", "normal", 0.34426066279411316]], "qwen": [[438, " as", "normal", 0.3154607117176056]]}, "loss": {"rwkv": 6.386931170602182, "qwen": 6.935282804396296}, "topk": {"rwkv": [4423, 1, 0.34426066279411316, [[4423, 0.344261, " as", false], [32465, 0.230062, " when", false], [4596, 0.099522, " in", false], [4588, 0.095085, " if", false], [47544, 0.068938, " though", false], [37634, 0.057283, " after", false], [40187, 0.019861, " while", false], [53356, 0.007973, " without", false], [31601, 0.007471, " over", false], [21700, 0.006294, " for", false]]], "qwen": [438, 1, 0.3154607117176056, [[438, 0.315461, " as", false], [979, 0.261261, " when", false], [421, 0.124773, " if", false], [1283, 0.103627, " after", false], [304, 0.055037, " in", false], [3498, 0.036656, " though", false], [1393, 0.022834, " while", false], [7797, 0.017056, " beyond", false], [2041, 0.010729, " without", false], [518, 0.007943, " at", false]]]}, "raw_delta": -0.030407071113586426, "tuned_delta": -0.021835279083008176}, {"byte_start": 5852, "byte_end": 5856, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 982, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "5.92% 5.92% 5.92% 5.92%", "qwen": "5.45% 5.45% 5.45% 5.45%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.2669343650341034]], "qwen": [[279, " the", "normal", 0.2983497083187103]]}, "loss": {"rwkv": 5.9173038786461385, "qwen": 5.452886765268265}, "topk": {"rwkv": [22590, 1, 0.2669343650341034, [[22590, 0.266934, " the", false], [32232, 0.183427, " they", false], [4858, 0.110678, " we", false], [38720, 0.074014, " human", false], [39931, 0.037862, " their", false], [31458, 0.024239, " more", false], [39193, 0.018828, " other", false], [22248, 0.018089, " our", false], [63370, 0.014987, " computation", false], [46227, 0.011221, " humans", false]]], "qwen": [279, 1, 0.2983497083187103, [[279, 0.29835, " the", false], [807, 0.211722, " they", false], [3738, 0.084128, " human", false], [862, 0.071106, " their", false], [34447, 0.025875, " computation", false], [803, 0.025603, " more", false], [582, 0.01675, " we", false], [501, 0.016648, " new", false], [3151, 0.015792, " specific", false], [11811, 0.012698, " researchers", false]]]}, "raw_delta": 0.025752753019332886, "tuned_delta": 0.034324545049911136}, {"byte_start": 5856, "byte_end": 5866, "display": {"text": " available", "kind": "normal"}, "is_word": true, "word_id": 983, "word_key": " available", "bytes_hex": "20 61 76 61 69 6c 61 62 6c 65", "compression": {"rwkv": "8.57% 8.57% 8.57% 8.57% 8.57% 8.57% 8.57% 8.57% 8.57% 8.57%", "qwen": "8.28% 8.28% 8.28% 8.28% 8.28% 8.28% 8.28% 8.28% 8.28% 8.28%"}, "model_tokens": {"rwkv": [[59206, " available", "normal", 0.008583514019846916]], "qwen": [[2500, " available", "normal", 0.010146329179406166]]}, "loss": {"rwkv": 8.56600180527822, "qwen": 8.278623095252737}, "topk": {"rwkv": [59206, 23, 0.008583514019846916, [[45775, 0.115198, " domain", false], [52569, 0.100676, " problem", false], [38720, 0.061424, " human", false], [62680, 0.036014, " underlying", false], [52224, 0.029215, " methods", false], [45157, 0.026914, " amount", false], [56939, 0.021285, " problems", false], [37636, 0.019084, " agent", false], [57103, 0.018668, " research", false], [59943, 0.018022, " knowledge", false]]], "qwen": [2500, 19, 0.010146329179406166, [[34447, 0.102133, " computation", false], [3738, 0.094568, " human", false], [3311, 0.074239, " amount", false], [7947, 0.047311, " domain", false], [3151, 0.036203, " specific", false], [5413, 0.034137, " methods", false], [3491, 0.030156, " problem", false], [6540, 0.021283, " knowledge", false], [54480, 0.019491, " computational", false], [6993, 0.016969, " nature", false]]]}, "raw_delta": 0.015935659408569336, "tuned_delta": 0.024507451439147586}, {"byte_start": 5866, "byte_end": 5878, "display": {"text": " computation", "kind": "normal"}, "is_word": true, "word_id": 984, "word_key": " computation", "bytes_hex": "20 63 6f 6d 70 75 74 61 74 69 6f 6e", "compression": {"rwkv": "3.62% 3.62% 3.62% 3.62% 3.62% 3.62% 3.62% 3.62% 3.62% 3.62% 3.62% 3.62%", "qwen": "1.13% 1.13% 1.13% 1.13% 1.13% 1.13% 1.13% 1.13% 1.13% 1.13% 1.13% 1.13%"}, "model_tokens": {"rwkv": [[63370, " computation", "normal", 0.09044206142425537]], "qwen": [[34447, " computation", "normal", 0.47061216831207275]]}, "loss": {"rwkv": 3.6161301480615293, "qwen": 1.132697444927869}, "topk": {"rwkv": [63370, 3, 0.09044206142425537, [[38720, 0.459459, " human", false], [59943, 0.184088, " knowledge", false], [63370, 0.090442, " computation", false], [30579, 0.044916, " data", false], [45775, 0.032191, " domain", false], [63637, 0.028861, " information", false], [45157, 0.010843, " amount", false], [60406, 0.010127, " resources", false], [64862, 0.008399, " computational", false], [22363, 0.007413, " raw", false]]], "qwen": [34447, 1, 0.47061216831207275, [[34447, 0.470612, " computation", false], [6540, 0.165297, " knowledge", false], [3738, 0.115396, " human", false], [3311, 0.043473, " amount", false], [54480, 0.022194, " computational", false], [5413, 0.011345, " methods", false], [11773, 0.007348, " hardware", false], [7947, 0.0073, " domain", false], [821, 0.00552, " data", false], [1995, 0.005116, " information", false]]]}, "raw_delta": 0.13771075010299683, "tuned_delta": 0.14628254213357508}, {"byte_start": 5878, "byte_end": 5886, "display": {"text": " becomes", "kind": "normal"}, "is_word": true, "word_id": 985, "word_key": " becomes", "bytes_hex": "20 62 65 63 6f 6d 65 73", "compression": {"rwkv": "8.07% 8.07% 8.07% 8.07% 8.07% 8.07% 8.07% 8.07%", "qwen": "6.26% 6.26% 6.26% 6.26% 6.26% 6.26% 6.26% 6.26%"}, "model_tokens": {"rwkv": [[51019, " becomes", "normal", 0.027750374749302864]], "qwen": [[9044, " becomes", "normal", 0.06228700652718544]]}, "loss": {"rwkv": 8.065848739345034, "qwen": 6.257695165908513}, "topk": {"rwkv": [51019, 6, 0.027750374749302864, [[59847, 0.466229, " increases", false], [38642, 0.213637, " grows", false], [4600, 0.039365, " is", false], [59393, 0.036534, " continues", false], [47181, 0.030308, " scales", false], [51019, 0.02775, " becomes", false], [46342, 0.025315, " itself", false], [30659, 0.019472, " does", false], [51682, 0.007159, " expands", false], [51165, 0.007093, " changes", false]]], "qwen": [9044, 4, 0.06228700652718544, [[12703, 0.253245, " increases", false], [5086, 0.142313, " itself", false], [27715, 0.085325, " grows", false], [9044, 0.062287, " becomes", false], [374, 0.053701, " is", false], [9539, 0.046072, " continues", false], [28405, 0.03588, " scales", false], [39296, 0.033377, " doubles", false], [37168, 0.017151, " rises", false], [5221, 0.016072, " gets", false]]]}, "raw_delta": 0.10026532411575317, "tuned_delta": 0.10883711614633142}, {"byte_start": 5886, "byte_end": 5891, "display": {"text": " very", "kind": "normal"}, "is_word": true, "word_id": 986, "word_key": " very", "bytes_hex": "20 76 65 72 79", "compression": {"rwkv": "14.77% 14.77% 14.77% 14.77% 14.77%", "qwen": "15.78% 15.78% 15.78% 15.78% 15.78%"}, "model_tokens": {"rwkv": [[32386, " very", "normal", 0.016866842284798622]], "qwen": [[1602, " very", "normal", 0.012585463002324104]]}, "loss": {"rwkv": 14.765082059097983, "qwen": 15.780244052345884}, "topk": {"rwkv": [32386, 15, 0.016866842284798622, [[31458, 0.198606, " more", false], [64430, 0.078598, " increasingly", false], [30789, 0.071104, " ever", false], [51867, 0.060054, " greater", false], [47708, 0.049904, " vastly", false], [46397, 0.046751, " larger", false], [32373, 0.040181, " vast", false], [59988, 0.036478, " massively", false], [31466, 0.030799, " much", false], [31277, 0.03058, " less", false]]], "qwen": [1602, 14, 0.012585463002324104, [[803, 0.190779, " more", false], [23048, 0.136486, " cheaper", false], [74151, 0.043393, " exponentially", false], [2686, 0.043111, " less", false], [3512, 0.039846, " ever", false], [14756, 0.035201, " increasingly", false], [1753, 0.026386, " much", false], [52008, 0.024412, " vastly", false], [9155, 0.018486, " smaller", false], [8131, 0.017435, " larger", false]]]}, "raw_delta": -0.05629253387451172, "tuned_delta": -0.04772074184393347}, {"byte_start": 5891, "byte_end": 5897, "display": {"text": " great", "kind": "normal"}, "is_word": true, "word_id": 987, "word_key": " great", "bytes_hex": "20 67 72 65 61 74", "compression": {"rwkv": "14.09% 14.09% 14.09% 14.09% 14.09% 14.09%", "qwen": "14.65% 14.65% 14.65% 14.65% 14.65% 14.65%"}, "model_tokens": {"rwkv": [[38629, " great", "normal", 0.009130761958658695]], "qwen": [[2244, " great", "normal", 0.00763477198779583]]}, "loss": {"rwkv": 14.088818758681281, "qwen": 14.652497629639166}, "topk": {"rwkv": [38629, 11, 0.009130761958658695, [[38864, 0.648381, " large", false], [45, 0.039464, ",", false], [31466, 0.039348, " much", false], [52195, 0.03162, " massive", false], [59682, 0.029665, " expensive", false], [52140, 0.024815, " limited", false], [38006, 0.021361, " cheap", false], [55425, 0.016649, " abundant", false], [32386, 0.013949, " very", false], [31082, 0.012535, " high", false]]], "qwen": [2244, 12, 0.00763477198779583, [[3460, 0.591815, " large", false], [11392, 0.079838, " expensive", false], [11872, 0.058693, " cheap", false], [33248, 0.030851, " costly", false], [10951, 0.025125, " massive", false], [1753, 0.021907, " much", false], [1550, 0.015571, " high", false], [2155, 0.015023, " different", false], [11, 0.01191, ",", false], [2613, 0.010517, " small", false]]]}, "raw_delta": -0.03125699361165368, "tuned_delta": -0.022685201581075433}, {"byte_start": 5897, "byte_end": 5898, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "3.12%", "qwen": "4.96%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.8422117233276367]], "qwen": [[13, ".", "normal", 0.7596530914306641]]}, "loss": {"rwkv": 3.1171511503582336, "qwen": 4.957342404421576}, "topk": {"rwkv": [47, 1, 0.8422117233276367, [[47, 0.842212, ".", false], [45, 0.091486, ",", false], [21265, 0.017741, " and", false], [5346, 0.015824, "---", false], [275, 0.009558, " (", false], [46272, 0.004551, " indeed", false], [4596, 0.002794, " in", false], [59, 0.002333, ":", false], [31601, 0.001695, " over", false], [60, 0.001498, ";", false]]], "qwen": [13, 1, 0.7596530914306641, [[13, 0.759653, ".", false], [11, 0.090143, ",", false], [12824, 0.03693, " indeed", false], [323, 0.028389, " and", false], [382, 0.018928, ".\n\n", false], [320, 0.013618, " (", false], [304, 0.013529, " in", false], [4421, 0.007694, "---", false], [7707, 0.004819, " compared", false], [624, 0.002992, ".\n", false]]]}, "raw_delta": -0.10204187035560608, "tuned_delta": -0.09347007832502784}, {"byte_start": 5898, "byte_end": 5902, "display": {"text": " The", "kind": "normal"}, "is_word": true, "word_id": 988, "word_key": " the", "bytes_hex": "20 54 68 65", "compression": {"rwkv": "9.51% 9.51% 9.51% 9.51%", "qwen": "9.63% 9.63% 9.63% 9.63%"}, "model_tokens": {"rwkv": [[20996, " The", "normal", 0.12276290357112885]], "qwen": [[576, " The", "normal", 0.11811265349388123]]}, "loss": {"rwkv": 9.509952662109866, "qwen": 9.63051465014783}, "topk": {"rwkv": [20996, 1, 0.12276290357112885, [[20996, 0.122763, " The", false], [29894, 0.100596, " This", false], [37453, 0.074076, " These", false], [49964, 0.050826, " Another", false], [3913, 0.046974, " In", false], [3918, 0.040912, " It", false], [4331, 0.037225, " We", false], [19555, 0.025029, " But", false], [37451, 0.023522, " There", false], [300, 0.022858, " A", false]]], "qwen": [576, 1, 0.11811265349388123, [[576, 0.118113, " The", false], [4220, 0.089386, " These", false], [1096, 0.089242, " This", false], [758, 0.044741, " In", false], [1084, 0.040934, " It", false], [18801, 0.036011, " Methods", false], [3251, 0.02725, " General", false], [15132, 0.026036, " Such", false], [1205, 0.022733, " We", false], [362, 0.021711, " A", false]]]}, "raw_delta": -0.006685376167297363, "tuned_delta": 0.001886415863280885}, {"byte_start": 5902, "byte_end": 5906, "display": {"text": " two", "kind": "normal"}, "is_word": true, "word_id": 989, "word_key": " two", "bytes_hex": "20 74 77 6f", "compression": {"rwkv": "25.22% 25.22% 25.22% 25.22%", "qwen": "22.49% 22.49% 22.49% 22.49%"}, "model_tokens": {"rwkv": [[22638, " two", "normal", 0.0037508720997720957]], "qwen": [[1378, " two", "normal", 0.006819556001573801]]}, "loss": {"rwkv": 25.218985578039494, "qwen": 22.487832289277748}, "topk": {"rwkv": [22638, 44, 0.0037508720997720957, [[52224, 0.048183, " methods", false], [45315, 0.046474, " bitter", false], [39193, 0.042814, " other", false], [51832, 0.032339, " general", false], [31461, 0.029584, " most", false], [39339, 0.023737, " power", false], [46430, 0.02333, " lesson", false], [38720, 0.022358, " human", false], [38629, 0.0196, " great", false], [31458, 0.013139, " more", false]]], "qwen": [1378, 22, 0.006819556001573801, [[25180, 0.054846, " bitter", false], [2244, 0.045813, " great", false], [2355, 0.035684, " power", false], [1429, 0.035433, " most", false], [1008, 0.02844, " other", false], [803, 0.023813, " more", false], [1850, 0.019804, " best", false], [17755, 0.019538, " lesson", false], [4586, 0.018616, " general", false], [16724, 0.018521, " ultimate", false]]]}, "raw_delta": 0.15144729614257812, "tuned_delta": 0.16001908817315638}, {"byte_start": 5906, "byte_end": 5914, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 990, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "6.83% 6.83% 6.83% 6.83% 6.83% 6.83% 6.83% 6.83%", "qwen": "7.09% 7.09% 7.09% 7.09% 7.09% 7.09% 7.09% 7.09%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.04795757681131363]], "qwen": [[5413, " methods", "normal", 0.04310791566967964]]}, "loss": {"rwkv": 6.833077097960421, "qwen": 7.0873491476948125}, "topk": {"rwkv": [52224, 3, 0.04795757681131363, [[31461, 0.227209, " most", false], [56162, 0.089797, " examples", false], [52224, 0.047958, " methods", false], [31356, 0.043051, " main", false], [61590, 0.040895, " approaches", false], [51832, 0.034791, " general", false], [39193, 0.028591, " other", false], [21357, 0.027638, " big", false], [38629, 0.026169, " great", false], [38841, 0.021979, " kinds", false]]], "qwen": [5413, 3, 0.04310791566967964, [[1429, 0.319986, " most", false], [2244, 0.061233, " great", false], [5413, 0.043108, " methods", false], [1850, 0.038617, " best", false], [1887, 0.037959, " main", false], [19827, 0.027477, " approaches", false], [6846, 0.022287, " classes", false], [10295, 0.02201, " examples", false], [3598, 0.021598, " major", false], [4586, 0.016298, " general", false]]]}, "raw_delta": -0.014099836349487305, "tuned_delta": -0.0055280443189090565}, {"byte_start": 5914, "byte_end": 5919, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 991, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "1.85% 1.85% 1.85% 1.85% 1.85%", "qwen": "1.54% 1.54% 1.54% 1.54% 1.54%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.600534975528717]], "qwen": [[429, " that", "normal", 0.651837944984436]]}, "loss": {"rwkv": 1.8456352573872479, "qwen": 1.5435369822310456}, "topk": {"rwkv": [32227, 1, 0.600534975528717, [[32227, 0.600535, " that", false], [31461, 0.0362, " most", false], [60003, 0.033344, " mentioned", false], [4596, 0.032641, " in", false], [45, 0.031235, ",", false], [4706, 0.024974, " of", false], [21286, 0.022882, " are", false], [4858, 0.018746, " we", false], [59546, 0.018099, " discussed", false], [5346, 0.010903, "---", false]]], "qwen": [429, 1, 0.651837944984436, [[429, 0.651838, " that", false], [315, 0.050855, " of", false], [1429, 0.033235, " most", false], [11, 0.026012, ",", false], [448, 0.022792, " with", false], [369, 0.017932, " for", false], [304, 0.012973, " in", false], [582, 0.011556, " we", false], [4421, 0.010776, "---", false], [525, 0.009607, " are", false]]]}, "raw_delta": 0.016751885414123535, "tuned_delta": 0.025323677444701785}, {"byte_start": 5919, "byte_end": 5924, "display": {"text": " seem", "kind": "normal"}, "is_word": true, "word_id": 992, "word_key": " seem", "bytes_hex": "20 73 65 65 6d", "compression": {"rwkv": "17.02% 17.02% 17.02% 17.02% 17.02%", "qwen": "14.39% 14.39% 14.39% 14.39% 14.39%"}, "model_tokens": {"rwkv": [[31967, " seem", "normal", 0.008849682286381721]], "qwen": [[2803, " seem", "normal", 0.01850428618490696]]}, "loss": {"rwkv": 17.019293060486987, "qwen": 14.389991337219216}, "topk": {"rwkv": [31967, 16, 0.008849682286381721, [[31059, 0.280323, " have", false], [21286, 0.099518, " are", false], [56041, 0.072332, " dominate", false], [22777, 0.031133, " won", false], [39590, 0.029646, " scale", false], [56540, 0.02449, " leverage", false], [4491, 0.02119, " do", false], [22770, 0.0181, " win", false], [31461, 0.014474, " most", false], [52597, 0.013958, " provide", false]]], "qwen": [2803, 5, 0.01850428618490696, [[614, 0.365672, " have", false], [525, 0.109491, " are", false], [40736, 0.044416, " dominate", false], [582, 0.019356, " we", false], [2803, 0.018504, " seem", false], [653, 0.01835, " do", false], [358, 0.015936, " I", false], [1033, 0.015454, " were", false], [975, 0.013802, " work", false], [29701, 0.01267, " dominated", false]]]}, "raw_delta": 0.14579944610595696, "tuned_delta": 0.15437123813653522}, {"byte_start": 5924, "byte_end": 5927, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 993, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "2.90% 2.90% 2.90%", "qwen": "2.36% 2.36% 2.36%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.6157535910606384]], "qwen": [[311, " to", "normal", 0.6752561926841736]]}, "loss": {"rwkv": 2.8999485278285637, "qwen": 2.360387894722458}, "topk": {"rwkv": [4811, 1, 0.6157535910606384, [[4811, 0.615754, " to", false], [31461, 0.208454, " most", false], [30273, 0.025807, " best", false], [46439, 0.015218, " likely", false], [22590, 0.013669, " the", false], [31296, 0.008436, " like", false], [61953, 0.006983, " especially", false], [45, 0.006332, ",", false], [55971, 0.005988, " destined", false], [64507, 0.004612, " particularly", false]]], "qwen": [311, 1, 0.6752561926841736, [[311, 0.675256, " to", false], [1429, 0.155037, " most", false], [1850, 0.035498, " best", false], [4363, 0.016922, " likely", false], [279, 0.012212, " the", false], [7945, 0.004961, " particularly", false], [5310, 0.003635, " especially", false], [3245, 0.0036, " least", false], [2677, 0.0034, " always", false], [1075, 0.002733, " like", false]]]}, "raw_delta": 0.029919594526290894, "tuned_delta": 0.038491386556869144}, {"byte_start": 5927, "byte_end": 5933, "display": {"text": " scale", "kind": "normal"}, "is_word": true, "word_id": 994, "word_key": " scale", "bytes_hex": "20 73 63 61 6c 65", "compression": {"rwkv": "11.55% 11.55% 11.55% 11.55% 11.55% 11.55%", "qwen": "11.71% 11.71% 11.71% 11.71% 11.71% 11.71%"}, "model_tokens": {"rwkv": [[39590, " scale", "normal", 0.021370796486735344]], "qwen": [[5452, " scale", "normal", 0.02033877931535244]]}, "loss": {"rwkv": 11.55283138211865, "qwen": 11.707547691429212}, "topk": {"rwkv": [39590, 7, 0.021370796486735344, [[4435, 0.256499, " be", false], [31059, 0.189022, " have", false], [56041, 0.07728, " dominate", false], [4491, 0.042717, " do", false], [32499, 0.026914, " work", false], [22770, 0.021801, " win", false], [39590, 0.021371, " scale", false], [52597, 0.020961, " provide", false], [39169, 0.015354, " offer", false], [4660, 0.012185, " me", false]]], "qwen": [5452, 6, 0.02033877931535244, [[614, 0.291799, " have", false], [387, 0.190763, " be", false], [975, 0.063204, " work", false], [40736, 0.052469, " dominate", false], [653, 0.026229, " do", false], [5452, 0.020339, " scale", false], [3010, 0.016682, " offer", false], [6359, 0.01375, " deliver", false], [1850, 0.013632, " best", false], [3410, 0.01356, " provide", false]]]}, "raw_delta": -0.008579293886820438, "tuned_delta": -7.501856242190033e-06}, {"byte_start": 5933, "byte_end": 5945, "display": {"text": " arbitrarily", "kind": "normal"}, "is_word": true, "word_id": 995, "word_key": " arbitrarily", "bytes_hex": "20 61 72 62 69 74 72 61 72 69 6c 79", "compression": {"rwkv": "15.50% 15.50% 15.50% 15.50% 15.50% 15.50% 15.50% 15.50% 15.50% 15.50% 15.50% 15.50%", "qwen": "15.63% 15.63% 15.63% 15.63% 15.63% 15.63% 15.63% 15.63% 15.63% 15.63% 15.63% 15.63%"}, "model_tokens": {"rwkv": [[63293, " arbitrarily", "normal", 3.4344517189310864e-05]], "qwen": [[85657, " arbitrarily", "normal", 3.0418892492889427e-05]]}, "loss": {"rwkv": 15.49770063454941, "qwen": 15.62986786854872}, "topk": {"rwkv": [63293, 355, 3.4344517189310864e-05, [[30273, 0.288058, " best", false], [31461, 0.157965, " most", false], [32487, 0.118358, " with", false], [22590, 0.108727, " the", false], [4596, 0.055994, " in", false], [21286, 0.028604, " are", false], [32234, 0.019026, " this", false], [4811, 0.012696, " to", false], [32458, 0.012521, " well", false], [4424, 0.010743, " at", false]]], "qwen": [85657, 371, 3.0418892492889427e-05, [[279, 0.217243, " the", false], [1850, 0.180104, " best", false], [1429, 0.147235, " most", false], [1632, 0.076015, " well", false], [773, 0.056074, " so", false], [448, 0.047299, " with", false], [304, 0.03944, " in", false], [525, 0.015779, " are", false], [1602, 0.011276, " very", false], [311, 0.010897, " to", false]]]}, "raw_delta": -0.007328907648722294, "tuned_delta": 0.0012428843818559545}, {"byte_start": 5945, "byte_end": 5948, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 996, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "25.92% 25.92% 25.92%", "qwen": "19.13% 19.13% 19.13%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.013327537104487419]], "qwen": [[304, " in", "normal", 0.04151996970176697]]}, "loss": {"rwkv": 25.92342651597356, "qwen": 19.125211734531785}, "topk": {"rwkv": [4596, 7, 0.013327537104487419, [[32458, 0.580077, " well", false], [21286, 0.163976, " are", false], [45, 0.059394, ",", false], [32487, 0.055862, " with", false], [5346, 0.020386, "---", false], [30826, 0.01591, " fast", false], [4596, 0.013328, " in", false], [275, 0.010466, " (", false], [21265, 0.007186, " and", false], [21660, 0.005985, " far", false]]], "qwen": [304, 5, 0.04151996970176697, [[1632, 0.421549, " well", false], [448, 0.154494, " with", false], [525, 0.142794, " are", false], [11, 0.07809, ",", false], [304, 0.04152, " in", false], [323, 0.027385, " and", false], [320, 0.014245, " (", false], [4421, 0.01004, "---", false], [438, 0.008332, " as", false], [311, 0.007703, " to", false]]]}, "raw_delta": 0.3769730726877849, "tuned_delta": 0.38554486471836313}, {"byte_start": 5948, "byte_end": 5953, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 997, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "2.27% 2.27% 2.27% 2.27% 2.27%", "qwen": "3.12% 3.12% 3.12% 3.12% 3.12%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.5358603000640869]], "qwen": [[419, " this", "normal", 0.42092493176460266]]}, "loss": {"rwkv": 2.2682998201476865, "qwen": 3.1209128408892304}, "topk": {"rwkv": [32234, 1, 0.5358603000640869, [[32234, 0.53586, " this", false], [22590, 0.103242, " the", false], [39339, 0.034922, " power", false], [332, 0.029159, " a", false], [32227, 0.024856, " that", false], [39931, 0.024263, " their", false], [3609, 0.01975, " AI", false], [21256, 0.018288, " all", false], [63370, 0.016905, " computation", false], [39920, 0.014474, " terms", false]]], "qwen": [419, 1, 0.42092493176460266, [[419, 0.420925, " this", false], [279, 0.199113, " the", false], [264, 0.028031, " a", false], [3793, 0.022434, " terms", false], [429, 0.019819, " that", false], [15235, 0.015791, " AI", false], [6588, 0.015505, " practice", false], [862, 0.015268, " their", false], [678, 0.014585, " all", false], [34447, 0.011417, " computation", false]]]}, "raw_delta": -0.04727890491485595, "tuned_delta": -0.0387071128842777}, {"byte_start": 5953, "byte_end": 5957, "display": {"text": " way", "kind": "normal"}, "is_word": true, "word_id": 998, "word_key": " way", "bytes_hex": "20 77 61 79", "compression": {"rwkv": "1.24% 1.24% 1.24% 1.24%", "qwen": "1.40% 1.40% 1.40% 1.40%"}, "model_tokens": {"rwkv": [[22752, " way", "normal", 0.7598547339439392]], "qwen": [[1616, " way", "normal", 0.7331099510192871]]}, "loss": {"rwkv": 1.241577153108788, "qwen": 1.3996826851072117}, "topk": {"rwkv": [22752, 1, 0.7598547339439392, [[22752, 0.759855, " way", false], [51717, 0.051551, " fashion", false], [46505, 0.041358, " manner", false], [39631, 0.038833, " sense", false], [47043, 0.037563, " regard", false], [52731, 0.021625, " respect", false], [59526, 0.009479, " direction", false], [51310, 0.007768, " context", false], [30405, 0.004511, " case", false], [32375, 0.003053, " vein", false]]], "qwen": [1616, 1, 0.7331099510192871, [[1616, 0.73311, " way", false], [5530, 0.073809, " sense", false], [11566, 0.067566, " manner", false], [5091, 0.025314, " respect", false], [5250, 0.023959, " regard", false], [11153, 0.023104, " fashion", false], [4586, 0.003667, " general", false], [5106, 0.003347, " direction", false], [2266, 0.003034, " context", false], [8913, 0.002671, " spirit", false]]]}, "raw_delta": -0.008767232298851013, "tuned_delta": -0.00019544026827276496}, {"byte_start": 5957, "byte_end": 5961, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 999, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"rwkv": "0.63% 0.63% 0.63% 0.63%", "qwen": "1.42% 1.42% 1.42% 1.42%"}, "model_tokens": {"rwkv": [[21286, " are", "normal", 0.8693117499351501]], "qwen": [[525, " are", "normal", 0.7301681637763977]]}, "loss": {"rwkv": 0.6295940882785698, "qwen": 1.4178103283153818}, "topk": {"rwkv": [21286, 1, 0.8693117499351501, [[21286, 0.869312, " are", false], [45, 0.06059, ",", false], [5346, 0.015101, "---", false], [4596, 0.010288, " in", false], [275, 0.007978, " (", false], [21265, 0.006446, " and", false], [31059, 0.002976, " have", false], [21700, 0.001804, " for", false], [32462, 0.001268, " were", false], [32227, 0.001243, " that", false]]], "qwen": [525, 1, 0.7301681637763977, [[525, 0.730168, " are", false], [11, 0.117868, ",", false], [4421, 0.057707, "---", false], [320, 0.011839, " (", false], [323, 0.009408, " and", false], [614, 0.008631, " have", false], [304, 0.008361, " in", false], [313, 0.004455, "--", false], [1033, 0.003958, " were", false], [448, 0.002738, " with", false]]]}, "raw_delta": -0.043707989156246185, "tuned_delta": -0.035136197125667935}, {"byte_start": 5961, "byte_end": 5968, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 1000, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "2.07% 2.07% 2.07% 2.07% 2.07% 2.07% 2.07%", "qwen": "1.19% 1.19% 1.19% 1.19% 1.19% 1.19% 1.19%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.45155325531959534]], "qwen": [[2711, " search", "normal", 0.6300439238548279]]}, "loss": {"rwkv": 2.073069045920245, "qwen": 1.190135069230555}, "topk": {"rwkv": [47202, 1, 0.45155325531959534, [[47202, 0.451553, " search", false], [56537, 0.216898, " learning", false], [30597, 0.063031, " deep", false], [22590, 0.024574, " the", false], [52224, 0.015205, " methods", false], [275, 0.014344, " (", false], [51832, 0.014287, " general", false], [59, 0.014113, ":", false], [31978, 0.013708, " self", false], [284, 0.012589, " 1", false]]], "qwen": [2711, 1, 0.6300439238548279, [[2711, 0.630044, " search", false], [5538, 0.037948, " deep", false], [220, 0.03342, " ", false], [71278, 0.0333, " reinforcement", false], [6832, 0.030104, " learning", false], [279, 0.020244, " the", false], [320, 0.019229, " (", false], [29728, 0.015948, " neural", false], [5413, 0.006827, " methods", false], [4586, 0.006082, " general", false]]]}, "raw_delta": 0.04896025572504315, "tuned_delta": 0.0575320477556214}, {"byte_start": 5968, "byte_end": 5972, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 1001, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "0.75% 0.75% 0.75% 0.75%", "qwen": "0.94% 0.94% 0.94% 0.94%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.8481370210647583]], "qwen": [[323, " and", "normal", 0.8115851879119873]]}, "loss": {"rwkv": 0.752871252417031, "qwen": 0.9412047507262832}, "topk": {"rwkv": [21265, 1, 0.8481370210647583, [[21265, 0.848137, " and", false], [275, 0.037155, " (", false], [45, 0.035785, ",", false], [4450, 0.014302, " by", false], [46, 0.009083, "-", false], [21700, 0.007965, " for", false], [4596, 0.007037, " in", false], [48, 0.006575, "/", false], [52224, 0.006182, " methods", false], [5346, 0.005235, "---", false]]], "qwen": [323, 1, 0.8115851879119873, [[323, 0.811585, " and", false], [11, 0.049152, ",", false], [5980, 0.035495, "-based", false], [320, 0.035066, " (", false], [5413, 0.017255, " methods", false], [3118, 0.00808, " based", false], [448, 0.006759, " with", false], [304, 0.004219, " in", false], [553, 0.004205, " by", false], [4421, 0.003902, "---", false]]]}, "raw_delta": -0.010443426668643951, "tuned_delta": -0.0018716346380657032}, {"byte_start": 5972, "byte_end": 5981, "display": {"text": " learning", "kind": "normal"}, "is_word": true, "word_id": 1002, "word_key": " learning", "bytes_hex": "20 6c 65 61 72 6e 69 6e 67", "compression": {"rwkv": "0.09% 0.09% 0.09% 0.09% 0.09% 0.09% 0.09% 0.09% 0.09%", "qwen": "0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45%"}, "model_tokens": {"rwkv": [[56537, " learning", "normal", 0.955946683883667]], "qwen": [[6832, " learning", "normal", 0.7982138395309448]]}, "loss": {"rwkv": 0.09001189762490819, "qwen": 0.4516011214976917}, "topk": {"rwkv": [56537, 1, 0.955946683883667, [[56537, 0.955947, " learning", false], [31978, 0.007853, " self", false], [30597, 0.007209, " deep", false], [63885, 0.002888, " statistical", false], [63370, 0.002856, " computation", false], [62577, 0.002222, " statistics", false], [52167, 0.002175, " machine", false], [22590, 0.001699, " the", false], [45, 0.001113, ",", false], [38877, 0.000974, " learn", false]]], "qwen": [6832, 1, 0.7982138395309448, [[6832, 0.798214, " learning", false], [5538, 0.078967, " deep", false], [5662, 0.018328, " machine", false], [71278, 0.009165, " reinforcement", false], [29728, 0.007465, " neural", false], [4586, 0.007452, " general", false], [279, 0.006766, " the", false], [656, 0.006574, " self", false], [28464, 0.004518, " statistical", false], [11, 0.004284, ",", false]]]}, "raw_delta": -0.020050764083862305, "tuned_delta": -0.011478972053284056}, {"byte_start": 5981, "byte_end": 5983, "display": {"text": ".\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e 0a", "compression": {"rwkv": "6.62% 30.29%", "qwen": "20.61% 20.61%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.6958373785018921], [261, "\n\n", "control", 0.03502431884407997]], "qwen": [[382, ".\n\n", "control", 0.03244423121213913]]}, "loss": {"rwkv": 18.45635257387248, "qwen": 20.607891365885145}, "topk": {"rwkv": [47, 1, 0.6958373785018921, [[47, 0.695837, ".", false], [45, 0.143549, ",", false], [4450, 0.058391, " by", false], [5346, 0.044315, "---", false], [275, 0.020473, " (", false], [60, 0.008673, ";", false], [37810, 0.003398, " based", false], [59, 0.002846, ":", false], [4596, 0.002768, " in", false], [22705, 0.002312, " via", false]]], "qwen": [382, 4, 0.03244423121213913, [[13, 0.64142, ".", false], [11, 0.169912, ",", false], [553, 0.05934, " by", false], [382, 0.032444, ".\n\n", false], [320, 0.022388, " (", false], [4421, 0.014733, "---", false], [26, 0.010116, ";", false], [25, 0.006254, ":", false], [624, 0.004282, ".\n", false], [389, 0.003554, " on", false]]]}, "raw_delta": -0.11930664380391431, "tuned_delta": -0.11073485177333607}, {"byte_start": 5983, "byte_end": 5984, "display": {"text": "\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "0a", "compression": {"rwkv": "30.29%", "qwen": "20.61%"}, "model_tokens": {"rwkv": [[261, "\n\n", "control", 0.03502431884407997]], "qwen": [[382, ".\n\n", "control", 0.03244423121213913]]}, "loss": {"rwkv": 30.290960331164754, "qwen": 20.607891365885145}, "topk": {"rwkv": [261, 7, 0.03502431884407997, [[20996, 0.118947, " The", false], [44844, 0.08454, " Search", false], [37453, 0.06573, " These", false], [29893, 0.049894, " They", false], [3913, 0.043841, " In", false], [28530, 0.038686, " Both", false], [261, 0.035024, "\n\n", false], [29894, 0.030989, " This", false], [37451, 0.02994, " There", false], [3918, 0.029626, " It", false]]], "qwen": [382, 4, 0.03244423121213913, [[13, 0.64142, ".", false], [11, 0.169912, ",", false], [553, 0.05934, " by", false], [382, 0.032444, ".\n\n", false], [320, 0.022388, " (", false], [4421, 0.014733, "---", false], [26, 0.010116, ";", false], [25, 0.006254, ":", false], [624, 0.004282, ".\n", false], [389, 0.003554, " on", false]]]}, "raw_delta": 0.5369433561960857, "tuned_delta": 0.5455151482266639}, {"byte_start": 5984, "byte_end": 5987, "display": {"text": "The", "kind": "normal"}, "is_word": true, "word_id": 1003, "word_key": "the", "bytes_hex": "54 68 65", "compression": {"rwkv": "10.75% 10.75% 10.75%", "qwen": "11.43% 11.43% 11.43%"}, "model_tokens": {"rwkv": [[6699, "The", "normal", 0.167260080575943]], "qwen": [[785, "The", "normal", 0.14927057921886444]]}, "loss": {"rwkv": 10.754464985793378, "qwen": 11.433325654194736}, "topk": {"rwkv": [6699, 1, 0.167260080575943, [[6699, 0.16726, "The", false], [1136, 0.07729, "In", false], [40754, 0.060815, "Search", false], [48358, 0.059455, "Another", false], [66, 0.048495, "A", false], [33504, 0.04158, "There", false], [24242, 0.032702, "This", false], [1141, 0.027615, "It", false], [1589, 0.026254, "We", false], [6393, 0.021957, "One", false]]], "qwen": [785, 1, 0.14927057921886444, [[785, 0.149271, "The", false], [5890, 0.131513, "Search", false], [641, 0.051216, "In", false], [14037, 0.033545, "Another", false], [32, 0.029603, "A", false], [3862, 0.029517, "There", false], [2132, 0.018916, "It", false], [1986, 0.01801, "This", false], [3966, 0.017081, "One", false], [1654, 0.015245, "We", false]]]}, "raw_delta": -0.037644028663635254, "tuned_delta": -0.029072236633057004}, {"byte_start": 5987, "byte_end": 5994, "display": {"text": " second", "kind": "normal"}, "is_word": true, "word_id": 1004, "word_key": " second", "bytes_hex": "20 73 65 63 6f 6e 64", "compression": {"rwkv": "7.53% 7.53% 7.53% 7.53% 7.53% 7.53% 7.53%", "qwen": "7.41% 7.41% 7.41% 7.41% 7.41% 7.41% 7.41%"}, "model_tokens": {"rwkv": [[47205, " second", "normal", 0.05338800325989723]], "qwen": [[2086, " second", "normal", 0.05633553862571716]]}, "loss": {"rwkv": 7.527454593924, "qwen": 7.410376790125389}, "topk": {"rwkv": [47205, 2, 0.05338800325989723, [[39193, 0.078959, " other", false], [47205, 0.053388, " second", false], [45315, 0.042152, " bitter", false], [38499, 0.040274, " first", false], [47202, 0.0356, " search", false], [46430, 0.021967, " lesson", false], [31515, 0.020945, " next", false], [31461, 0.020122, " most", false], [45184, 0.018424, " appeal", false], [19523, 0.017487, " Bit", false]]], "qwen": [2086, 3, 0.05633553862571716, [[25180, 0.123237, " bitter", false], [1008, 0.085452, " other", false], [2086, 0.056336, " second", false], [17755, 0.025586, " lesson", false], [1156, 0.024374, " first", false], [425, 0.024121, " B", false], [1378, 0.023931, " two", false], [2711, 0.02016, " search", false], [1790, 0.019953, " next", false], [1429, 0.018854, " most", false]]]}, "raw_delta": 0.006492171968732585, "tuned_delta": 0.015063963999310833}, {"byte_start": 5994, "byte_end": 6002, "display": {"text": " general", "kind": "normal"}, "is_word": true, "word_id": 1005, "word_key": " general", "bytes_hex": "20 67 65 6e 65 72 61 6c", "compression": {"rwkv": "10.92% 10.92% 10.92% 10.92% 10.92% 10.92% 10.92% 10.92%", "qwen": "13.77% 13.77% 13.77% 13.77% 13.77% 13.77% 13.77% 13.77%"}, "model_tokens": {"rwkv": [[51832, " general", "normal", 0.007929818704724312]], "qwen": [[4586, " general", "normal", 0.0022193738259375095]]}, "loss": {"rwkv": 10.918834537977993, "qwen": 13.774423723988388}, "topk": {"rwkv": [51832, 13, 0.007929818704724312, [[46430, 0.444956, " lesson", false], [39941, 0.236752, " thing", false], [21357, 0.0326, " big", false], [45, 0.02639, ",", false], [59829, 0.022833, " important", false], [4600, 0.018489, " is", false], [38629, 0.016371, " great", false], [45315, 0.013829, " bitter", false], [38961, 0.01184, " major", false], [21365, 0.011642, " bit", false]]], "qwen": [4586, 32, 0.0022193738259375095, [[17755, 0.239377, " lesson", false], [3166, 0.11453, " thing", false], [25180, 0.067352, " bitter", false], [2409, 0.06589, " big", false], [1429, 0.053341, " most", false], [2989, 0.039198, " important", false], [2244, 0.033994, " great", false], [949, 0.02987, " part", false], [374, 0.025651, " is", false], [1459, 0.022695, " point", false]]]}, "raw_delta": -0.158347487449646, "tuned_delta": -0.14977569541906774}, {"byte_start": 6002, "byte_end": 6008, "display": {"text": " point", "kind": "normal"}, "is_word": true, "word_id": 1006, "word_key": " point", "bytes_hex": "20 70 6f 69 6e 74", "compression": {"rwkv": "11.93% 11.93% 11.93% 11.93% 11.93% 11.93%", "qwen": "13.17% 13.17% 13.17% 13.17% 13.17% 13.17%"}, "model_tokens": {"rwkv": [[39310, " point", "normal", 0.01900864765048027]], "qwen": [[1459, " point", "normal", 0.012501237913966179]]}, "loss": {"rwkv": 11.928533215683485, "qwen": 13.170385541033655}, "topk": {"rwkv": [39310, 6, 0.01900864765048027, [[46430, 0.635106, " lesson", false], [46561, 0.116598, " method", false], [60250, 0.032214, " principle", false], [63729, 0.022525, " observation", false], [52610, 0.020929, " purpose", false], [39310, 0.019009, " point", false], [38046, 0.014627, " class", false], [55532, 0.012005, " approach", false], [52022, 0.011643, " insight", false], [46, 0.009202, "-", false]]], "qwen": [1459, 8, 0.012501237913966179, [[17755, 0.291199, " lesson", false], [1714, 0.180131, " method", false], [58238, 0.152266, "-purpose", false], [2022, 0.074681, "ization", false], [7428, 0.073605, " purpose", false], [17508, 0.0455, " principle", false], [5486, 0.015525, " approach", false], [1459, 0.012501, " point", false], [5912, 0.009425, " rule", false], [8335, 0.008556, "izable", false]]]}, "raw_delta": -0.0688629150390625, "tuned_delta": -0.06029112300848425}, {"byte_start": 6008, "byte_end": 6011, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 1007, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "13.90% 13.90% 13.90%", "qwen": "10.77% 10.77% 10.77%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.09831735491752625]], "qwen": [[311, " to", "normal", 0.16670064628124237]]}, "loss": {"rwkv": 13.900967841898865, "qwen": 10.769451840627315}, "topk": {"rwkv": [4811, 3, 0.09831735491752625, [[4600, 0.585693, " is", false], [32227, 0.135859, " that", false], [4811, 0.098317, " to", false], [45, 0.039834, ",", false], [4706, 0.025722, " of", false], [4858, 0.01797, " we", false], [30917, 0.014022, " from", false], [37598, 0.009947, " about", false], [47266, 0.00759, " should", false], [55817, 0.005214, " concerns", false]]], "qwen": [311, 3, 0.16670064628124237, [[374, 0.369789, " is", false], [429, 0.215947, " that", false], [311, 0.166701, " to", false], [911, 0.052649, " about", false], [315, 0.040486, " of", false], [504, 0.027561, " from", false], [11, 0.024677, ",", false], [582, 0.01348, " we", false], [304, 0.010125, " in", false], [358, 0.009444, " I", false]]]}, "raw_delta": 0.17364811897277832, "tuned_delta": 0.18221991100335658}, {"byte_start": 6011, "byte_end": 6014, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 1008, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"rwkv": "6.11% 6.11% 6.11%", "qwen": "4.18% 4.18% 4.18%"}, "model_tokens": {"rwkv": [[4435, " be", "normal", 0.3609258234500885]], "qwen": [[387, " be", "normal", 0.4988078474998474]]}, "loss": {"rwkv": 6.105154795428556, "qwen": 4.1810164805473455}, "topk": {"rwkv": [4435, 1, 0.3609258234500885, [[4435, 0.360926, " be", false], [38877, 0.262821, " learn", false], [32187, 0.127006, " take", false], [31539, 0.038513, " note", false], [31358, 0.035555, " make", false], [62683, 0.03092, " understand", false], [30681, 0.01531, " draw", false], [38625, 0.012491, " grasp", false], [31205, 0.008879, " keep", false], [45846, 0.007584, " emerge", false]]], "qwen": [387, 1, 0.4988078474998474, [[387, 0.498808, " be", false], [3960, 0.15009, " learn", false], [1281, 0.088365, " make", false], [1896, 0.042628, " take", false], [5185, 0.040671, " note", false], [3535, 0.036939, " understand", false], [32944, 0.021993, " emerge", false], [4038, 0.017, " draw", false], [2908, 0.011306, " consider", false], [2525, 0.009433, " come", false]]]}, "raw_delta": 0.10669688383738202, "tuned_delta": 0.11526867586796026}, {"byte_start": 6014, "byte_end": 6022, "display": {"text": " learned", "kind": "normal"}, "is_word": true, "word_id": 1009, "word_key": " learned", "bytes_hex": "20 6c 65 61 72 6e 65 64", "compression": {"rwkv": "0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45% 0.45%", "qwen": "0.95% 0.95% 0.95% 0.95% 0.95% 0.95% 0.95% 0.95%"}, "model_tokens": {"rwkv": [[52112, " learned", "normal", 0.8210574984550476]], "qwen": [[9498, " learned", "normal", 0.6572651267051697]]}, "loss": {"rwkv": 0.4468797200019219, "qwen": 0.9460197275046579}, "topk": {"rwkv": [52112, 1, 0.8210574984550476, [[52112, 0.821057, " learned", false], [31351, 0.078871, " made", false], [38297, 0.025474, " drawn", false], [39887, 0.010846, " taken", false], [51438, 0.009887, " derived", false], [62684, 0.009239, " understood", false], [39140, 0.005854, " noted", false], [59697, 0.004733, " extracted", false], [46071, 0.002809, " gained", false], [21762, 0.002261, " gle", false]]], "qwen": [9498, 1, 0.6572651267051697, [[9498, 0.657265, " learned", false], [1865, 0.20109, " made", false], [14764, 0.041951, " drawn", false], [15985, 0.020831, " understood", false], [4429, 0.011879, " taken", false], [94016, 0.009719, " glean", false], [14257, 0.008286, " derived", false], [49250, 0.004656, " learnt", false], [10342, 0.004631, " noted", false], [27432, 0.004047, " extracted", false]]]}, "raw_delta": -0.027678199112415314, "tuned_delta": -0.019106407081837064}, {"byte_start": 6022, "byte_end": 6027, "display": {"text": " from", "kind": "normal"}, "is_word": true, "word_id": 1010, "word_key": " from", "bytes_hex": "20 66 72 6f 6d", "compression": {"rwkv": "3.86% 3.86% 3.86% 3.86% 3.86%", "qwen": "2.35% 2.35% 2.35% 2.35% 2.35%"}, "model_tokens": {"rwkv": [[30917, " from", "normal", 0.3454531133174896]], "qwen": [[504, " from", "normal", 0.5210452675819397]]}, "loss": {"rwkv": 3.860336339878671, "qwen": 2.3512986474540782}, "topk": {"rwkv": [30917, 2, 0.3454531133174896, [[4600, 0.592108, " is", false], [30917, 0.345453, " from", false], [45, 0.019722, ",", false], [4450, 0.00699, " by", false], [31077, 0.004617, " here", false], [37598, 0.003657, " about", false], [4596, 0.003493, " in", false], [21800, 0.002493, " has", false], [47266, 0.002059, " should", false], [52694, 0.001808, " relates", false]]], "qwen": [504, 1, 0.5210452675819397, [[504, 0.521045, " from", false], [374, 0.421965, " is", false], [11, 0.026251, ",", false], [911, 0.004493, " about", false], [1588, 0.004179, " here", false], [304, 0.004135, " in", false], [320, 0.002605, " (", false], [553, 0.001493, " by", false], [429, 0.000956, " that", false], [702, 0.000948, " has", false]]]}, "raw_delta": 0.08367881774902342, "tuned_delta": 0.09225060977960166}, {"byte_start": 6027, "byte_end": 6031, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1011, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "0.91% 0.91% 0.91% 0.91%", "qwen": "1.49% 1.49% 1.49% 1.49%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.8171052932739258]], "qwen": [[279, " the", "normal", 0.7185409665107727]]}, "loss": {"rwkv": 0.9069677075901075, "qwen": 1.4901802247141136}, "topk": {"rwkv": [22590, 1, 0.8171052932739258, [[22590, 0.817105, " the", false], [32234, 0.11575, " this", false], [45315, 0.014828, " bitter", false], [39936, 0.010304, " these", false], [51929, 0.00431, " history", false], [3609, 0.003942, " AI", false], [31636, 0.00205, " past", false], [21256, 0.001959, " all", false], [22248, 0.001788, " our", false], [332, 0.001571, " a", false]]], "qwen": [279, 1, 0.7185409665107727, [[279, 0.718541, " the", false], [419, 0.167578, " this", false], [1493, 0.048285, " these", false], [678, 0.017376, " all", false], [25180, 0.007513, " bitter", false], [20219, 0.003286, " Moore", false], [220, 0.00309, " ", false], [264, 0.002845, " a", false], [15235, 0.002356, " AI", false], [1039, 0.002221, " our", false]]]}, "raw_delta": -0.032340168952941895, "tuned_delta": -0.023768376922363645}, {"byte_start": 6031, "byte_end": 6038, "display": {"text": " bitter", "kind": "normal"}, "is_word": true, "word_id": 1012, "word_key": " bitter", "bytes_hex": "20 62 69 74 74 65 72", "compression": {"rwkv": "0.11% 0.11% 0.11% 0.11% 0.11% 0.11% 0.11%", "qwen": "0.06% 0.06% 0.06% 0.06% 0.06% 0.06% 0.06%"}, "model_tokens": {"rwkv": [[45315, " bitter", "normal", 0.9597883820533752]], "qwen": [[25180, " bitter", "normal", 0.9765259623527527]]}, "loss": {"rwkv": 0.10566614069010961, "qwen": 0.061195885097820216}, "topk": {"rwkv": [45315, 1, 0.9597883820533752, [[45315, 0.959788, " bitter", false], [61640, 0.012349, " bitterness", false], [51929, 0.003987, " history", false], [21365, 0.00252, " bit", false], [31636, 0.001694, " past", false], [19523, 0.001433, " Bit", false], [62061, 0.001389, " historical", false], [46430, 0.001035, " lesson", false], [52127, 0.000987, " lessons", false], [31323, 0.000483, " long", false]]], "qwen": [25180, 1, 0.9765259623527527, [[25180, 0.976526, " bitter", false], [78996, 0.005516, " bitterness", false], [17755, 0.001699, " lesson", false], [3840, 0.001541, " history", false], [425, 0.001217, " B", false], [3403, 0.00092, " above", false], [18366, 0.000657, " lessons", false], [13656, 0.000452, " historical", false], [3412, 0.000375, " research", false], [3139, 0.000287, " experience", false]]]}, "raw_delta": 0.002465954582606043, "tuned_delta": 0.01103774661318429}, {"byte_start": 6038, "byte_end": 6045, "display": {"text": " lesson", "kind": "normal"}, "is_word": true, "word_id": 1013, "word_key": " lesson", "bytes_hex": "20 6c 65 73 73 6f 6e", "compression": {"rwkv": "0.11% 0.11% 0.11% 0.11% 0.11% 0.11% 0.11%", "qwen": "0.08% 0.08% 0.08% 0.08% 0.08% 0.08% 0.08%"}, "model_tokens": {"rwkv": [[46430, " lesson", "normal", 0.9592282176017761]], "qwen": [[17755, " lesson", "normal", 0.970899760723114]]}, "loss": {"rwkv": 0.10692407093642042, "qwen": 0.07608165533722623}, "topk": {"rwkv": [46430, 1, 0.9592282176017761, [[46430, 0.959228, " lesson", false], [52127, 0.034556, " lessons", false], [61979, 0.002478, " experience", false], [46, 0.000568, "-", false], [31636, 0.000347, " past", false], [26127, 0.000233, "less", false], [39899, 0.000181, " taste", false], [4600, 0.000177, " is", false], [51929, 0.000101, " history", false], [45, 9.6e-05, ",", false]]], "qwen": [17755, 1, 0.970899760723114, [[17755, 0.9709, " lesson", false], [18366, 0.014189, " lessons", false], [3139, 0.006979, " experience", false], [3840, 0.001089, " history", false], [11, 0.000636, ",", false], [15235, 0.000578, " AI", false], [323, 0.000363, " and", false], [320, 0.000222, " (", false], [12, 0.000184, "-", false], [512, 0.000149, " le", false]]]}, "raw_delta": 0.001710266673139164, "tuned_delta": 0.010282058703717413}, {"byte_start": 6045, "byte_end": 6048, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 1014, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "0.28% 0.28% 0.28%", "qwen": "0.40% 0.40% 0.40%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.9542855620384216]], "qwen": [[374, " is", "normal", 0.9348880052566528]]}, "loss": {"rwkv": 0.28324396046098826, "qwen": 0.4047272649340828}, "topk": {"rwkv": [4600, 1, 0.9542855620384216, [[4600, 0.954286, " is", false], [45, 0.014459, ",", false], [21800, 0.004434, " has", false], [55817, 0.004251, " concerns", false], [4706, 0.003805, " of", false], [4596, 0.002038, " in", false], [47266, 0.001625, " should", false], [52694, 0.001195, " relates", false], [275, 0.001172, " (", false], [37598, 0.001067, " about", false]]], "qwen": [374, 1, 0.9348880052566528, [[374, 0.934888, " is", false], [11, 0.019629, ",", false], [315, 0.014443, " of", false], [10520, 0.003587, " concerns", false], [320, 0.002818, " (", false], [429, 0.002524, " that", false], [304, 0.00217, " in", false], [702, 0.002084, " has", false], [911, 0.002025, " about", false], [4421, 0.001162, "---", false]]]}, "raw_delta": -0.00673646479845047, "tuned_delta": 0.0018353272321277782}, {"byte_start": 6048, "byte_end": 6053, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 1015, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "0.97% 0.97% 0.97% 0.97% 0.97%", "qwen": "1.29% 1.29% 1.29% 1.29% 1.29%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.7683013677597046]], "qwen": [[429, " that", "normal", 0.6995595693588257]]}, "loss": {"rwkv": 0.9650840849696678, "qwen": 1.2887028716958038}, "topk": {"rwkv": [32227, 1, 0.7683013677597046, [[32227, 0.768301, " that", false], [22590, 0.12915, " the", false], [21835, 0.018802, " how", false], [4811, 0.015453, " to", false], [32234, 0.009228, " this", false], [332, 0.009012, " a", false], [37598, 0.005823, " about", false], [32464, 0.005314, " what", false], [45, 0.005166, ",", false], [22763, 0.002526, " why", false]]], "qwen": [429, 1, 0.6995595693588257, [[429, 0.69956, " that", false], [279, 0.185011, " the", false], [911, 0.015583, " about", false], [311, 0.014676, " to", false], [419, 0.011509, " this", false], [264, 0.008822, " a", false], [1246, 0.00828, " how", false], [537, 0.005344, " not", false], [1128, 0.005076, " what", false], [825, 0.00361, " one", false]]]}, "raw_delta": -0.017945235967636114, "tuned_delta": -0.009373443937057866}, {"byte_start": 6053, "byte_end": 6057, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1016, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "7.89% 7.89% 7.89% 7.89%", "qwen": "8.51% 8.51% 8.51% 8.51%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.17340393364429474]], "qwen": [[279, " the", "normal", 0.1515452116727829]]}, "loss": {"rwkv": 7.889738504861517, "qwen": 8.506812256157275}, "topk": {"rwkv": [22590, 1, 0.17340393364429474, [[22590, 0.173404, " the", false], [45, 0.061805, ",", false], [4601, 0.060114, " it", false], [38720, 0.053581, " human", false], [39934, 0.048522, " there", false], [4858, 0.031781, " we", false], [47202, 0.026266, " search", false], [4596, 0.02513, " in", false], [56537, 0.020867, " learning", false], [52224, 0.018407, " methods", false]]], "qwen": [279, 1, 0.1515452116727829, [[279, 0.151545, " the", false], [1052, 0.060307, " there", false], [3738, 0.059422, " human", false], [432, 0.053269, " it", false], [11, 0.04297, ",", false], [582, 0.033542, " we", false], [304, 0.030668, " in", false], [4586, 0.024622, " general", false], [5413, 0.017795, " methods", false], [264, 0.017794, " a", false]]]}, "raw_delta": -0.03421783447265625, "tuned_delta": -0.025646042442078}, {"byte_start": 6057, "byte_end": 6064, "display": {"text": " actual", "kind": "normal"}, "is_word": true, "word_id": 1017, "word_key": " actual", "bytes_hex": "20 61 63 74 75 61 6c", "compression": {"rwkv": "18.36% 18.36% 18.36% 18.36% 18.36% 18.36% 18.36%", "qwen": "18.34% 18.34% 18.34% 18.34% 18.34% 18.34% 18.34%"}, "model_tokens": {"rwkv": [[45098, " actual", "normal", 0.0008110906346701086]], "qwen": [[5042, " actual", "normal", 0.0008084636065177619]]}, "loss": {"rwkv": 18.355718154167608, "qwen": 18.343802213357833}, "topk": {"rwkv": [45098, 177, 0.0008110906346701086, [[38720, 0.093456, " human", false], [52224, 0.041066, " methods", false], [22638, 0.032892, " two", false], [31461, 0.029555, " most", false], [47202, 0.023482, " search", false], [45184, 0.020337, " appeal", false], [30273, 0.018515, " best", false], [22752, 0.015234, " way", false], [31581, 0.014188, " only", false], [22681, 0.011798, " use", false]]], "qwen": [5042, 193, 0.0008084636065177619, [[3738, 0.05743, " human", false], [1429, 0.036709, " most", false], [1850, 0.02961, " best", false], [1378, 0.027693, " two", false], [2070, 0.019168, " field", false], [25180, 0.013765, " bitter", false], [803, 0.013295, " more", false], [5413, 0.013289, " methods", false], [2711, 0.013264, " search", false], [1172, 0.013, " only", false]]]}, "raw_delta": 0.000660760062081378, "tuned_delta": 0.009232552092659626}, {"byte_start": 6064, "byte_end": 6073, "display": {"text": " contents", "kind": "normal"}, "is_word": true, "word_id": 1018, "word_key": " contents", "bytes_hex": "20 63 6f 6e 74 65 6e 74 73", "compression": {"rwkv": "14.21% 14.21% 14.21% 14.21% 14.21% 14.21% 14.21% 14.21% 14.21%", "qwen": "15.03% 15.03% 15.03% 15.03% 15.03% 15.03% 15.03% 15.03% 15.03%"}, "model_tokens": {"rwkv": [[55847, " contents", "normal", 0.000837124593090266]], "qwen": [[8794, " contents", "normal", 0.0005515777156688273]]}, "loss": {"rwkv": 14.214052703202896, "qwen": 15.03353856905412}, "topk": {"rwkv": [55847, 198, 0.000837124593090266, [[52224, 0.063427, " methods", false], [56950, 0.028036, " progress", false], [53052, 0.021613, " success", false], [38720, 0.020718, " human", false], [63370, 0.020555, " computation", false], [57103, 0.019124, " research", false], [22752, 0.015117, " way", false], [62633, 0.014898, " techniques", false], [52571, 0.013858, " process", false], [51308, 0.013646, " content", false]]], "qwen": [8794, 287, 0.0005515777156688273, [[3738, 0.026625, " human", false], [3311, 0.024815, " amount", false], [5413, 0.023012, " methods", false], [5068, 0.02043, " performance", false], [2393, 0.017845, " success", false], [8129, 0.016658, " implementation", false], [897, 0.01486, " value", false], [11, 0.013857, ",", false], [6832, 0.013082, " learning", false], [990, 0.013004, " use", false]]]}, "raw_delta": -0.045441945393880245, "tuned_delta": -0.036870153363301995}, {"byte_start": 6073, "byte_end": 6076, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 1019, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.24% 0.24% 0.24%", "qwen": "0.24% 0.24% 0.24%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9604994058609009]], "qwen": [[315, " of", "normal", 0.9605894684791565]]}, "loss": {"rwkv": 0.24361915770219716, "qwen": 0.24170031949848864}, "topk": {"rwkv": [4706, 1, 0.9604994058609009, [[4706, 0.960499, " of", false], [21265, 0.014781, " and", false], [45, 0.00482, ",", false], [32227, 0.004616, " that", false], [4715, 0.004418, " or", false], [275, 0.001733, " (", false], [21286, 0.001075, " are", false], [4596, 0.001068, " in", false], [46530, 0.000867, " matter", false], [5346, 0.000758, "---", false]]], "qwen": [315, 1, 0.9605894684791565, [[315, 0.960589, " of", false], [323, 0.017903, " and", false], [11, 0.005787, ",", false], [429, 0.002832, " that", false], [320, 0.002554, " (", false], [476, 0.002003, " or", false], [525, 0.001233, " are", false], [4925, 0.000675, " matter", false], [4421, 0.00062, "---", false], [304, 0.000604, " in", false]]]}, "raw_delta": 0.00010640298326810259, "tuned_delta": 0.00867819501384635}, {"byte_start": 6076, "byte_end": 6082, "display": {"text": " minds", "kind": "normal"}, "is_word": true, "word_id": 1020, "word_key": " minds", "bytes_hex": "20 6d 69 6e 64 73", "compression": {"rwkv": "24.04% 24.04% 24.04% 24.04% 24.04% 24.04%", "qwen": "22.99% 22.99% 22.99% 22.99% 22.99% 22.99%"}, "model_tokens": {"rwkv": [[39026, " minds", "normal", 0.0003299340314697474]], "qwen": [[20062, " minds", "normal", 0.0004761377349495888]]}, "loss": {"rwkv": 24.044917348149387, "qwen": 22.992360593848883}, "topk": {"rwkv": [39026, 91, 0.0003299340314697474, [[22590, 0.358819, " the", false], [332, 0.089015, " a", false], [59943, 0.077085, " knowledge", false], [38720, 0.056439, " human", false], [3609, 0.052565, " AI", false], [39936, 0.036217, " these", false], [22248, 0.029482, " our", false], [32464, 0.027882, " what", false], [52224, 0.025358, " methods", false], [4419, 0.022947, " an", false]]], "qwen": [20062, 80, 0.0004761377349495888, [[279, 0.313124, " the", false], [3738, 0.179506, " human", false], [6540, 0.121824, " knowledge", false], [264, 0.092694, " a", false], [1039, 0.031638, " our", false], [458, 0.027065, " an", false], [1128, 0.023767, " what", false], [894, 0.013029, " any", false], [825, 0.012983, " one", false], [15235, 0.012561, " AI", false]]]}, "raw_delta": 0.058366139729817634, "tuned_delta": 0.06693793176039588}, {"byte_start": 6082, "byte_end": 6086, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 1021, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"rwkv": "5.67% 5.67% 5.67% 5.67%", "qwen": "4.95% 4.95% 4.95% 4.95%"}, "model_tokens": {"rwkv": [[21286, " are", "normal", 0.2817038893699646]], "qwen": [[525, " are", "normal", 0.3335510194301605]]}, "loss": {"rwkv": 5.670749550369216, "qwen": 4.950064313615376}, "topk": {"rwkv": [21286, 1, 0.2817038893699646, [[21286, 0.281704, " are", false], [45, 0.179858, ",", false], [21265, 0.077366, " and", false], [4600, 0.053538, " is", false], [5346, 0.048175, "---", false], [4491, 0.045656, " do", false], [4715, 0.031378, " or", false], [275, 0.027799, " (", false], [4706, 0.024976, " of", false], [32227, 0.022278, " that", false]]], "qwen": [525, 1, 0.3335510194301605, [[525, 0.333551, " are", false], [11, 0.114802, ",", false], [4421, 0.079364, "---", false], [323, 0.063299, " and", false], [4925, 0.05121, " matter", false], [653, 0.043679, " do", false], [320, 0.036484, " (", false], [646, 0.036335, " can", false], [1745, 0.021339, " differ", false], [429, 0.018434, " that", false]]]}, "raw_delta": 0.03996327519416809, "tuned_delta": 0.04853506722474634}, {"byte_start": 6086, "byte_end": 6099, "display": {"text": " tremendously", "kind": "normal"}, "is_word": true, "word_id": 1022, "word_key": " tremendously", "bytes_hex": "20 74 72 65 6d 65 6e 64 6f 75 73 6c 79", "compression": {"rwkv": "14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 14.96% 0.06% 0.06%", "qwen": "12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55% 12.55%"}, "model_tokens": {"rwkv": [[62670, " tremendous", "normal", 0.00010990122973453254], [2030, "ly", "normal", 0.9931179285049438]], "qwen": [[71323, " tremendously", "normal", 0.00011814780737040564]]}, "loss": {"rwkv": 12.667829304192416, "qwen": 12.545307540774282}, "topk": {"rwkv": [62670, 312, 0.00010990122973453254, [[22187, 0.270501, " not", false], [62161, 0.149868, " irrelevant", false], [31277, 0.042152, " less", false], [39171, 0.030398, " often", false], [31466, 0.028387, " much", false], [32386, 0.027819, " very", false], [4706, 0.02619, " of", false], [332, 0.018336, " a", false], [45, 0.015417, ",", false], [52094, 0.015258, " largely", false]]], "qwen": [71323, 309, 0.00011814780737040564, [[537, 0.245593, " not", false], [39715, 0.157858, " irrelevant", false], [2686, 0.040909, " less", false], [3545, 0.037021, " often", false], [315, 0.036599, " of", false], [4893, 0.025389, " imm", false], [13771, 0.022763, " largely", false], [650, 0.02013, " un", false], [264, 0.015697, " a", false], [11, 0.014247, ",", false]]]}, "raw_delta": 0.006794049189640943, "tuned_delta": 0.015365841220219192}, {"byte_start": 6099, "byte_end": 6100, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "96.37%", "qwen": "102.99%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.004739854019135237]], "qwen": [[11, ",", "normal", 0.003309671999886632]]}, "loss": {"rwkv": 96.36752030937997, "qwen": 102.98869758321233}, "topk": {"rwkv": [45, 17, 0.004739854019135237, [[51258, 0.180527, " complex", false], [63366, 0.161625, " complicated", false], [59516, 0.145637, " difficult", false], [31048, 0.101267, " hard", false], [31458, 0.064857, " more", false], [59829, 0.042214, " important", false], [31277, 0.034056, " less", false], [51507, 0.024857, " diverse", false], [57518, 0.017939, " variable", false], [46162, 0.016899, " harder", false]]], "qwen": [11, 36, 0.003309671999886632, [[2989, 0.192251, " important", false], [2686, 0.099634, " less", false], [6351, 0.078771, " complex", false], [39715, 0.076917, " irrelevant", false], [2155, 0.043931, " different", false], [16965, 0.038716, " complicated", false], [803, 0.037987, " more", false], [5000, 0.034358, " difficult", false], [2588, 0.022752, " hard", false], [650, 0.022206, " un", false]]]}, "raw_delta": -0.3671560287475586, "tuned_delta": -0.35858423671698036}, {"byte_start": 6100, "byte_end": 6105, "display": {"text": " irre", "kind": "normal"}, "is_word": true, "word_id": 1023, "word_key": " irre", "bytes_hex": "20 69 72 72 65", "compression": {"rwkv": "18.82% 18.82% 18.82% 18.82% 18.82%", "qwen": "16.00% 16.00% 16.00% 16.00% 16.00%"}, "model_tokens": {"rwkv": [[31170, " irre", "normal", 0.005436149891465902]], "qwen": [[24870, " irre", "normal", 0.011836192570626736]]}, "loss": {"rwkv": 18.822661861598192, "qwen": 16.001626999842525}, "topk": {"rwkv": [31170, 36, 0.005436149891465902, [[21265, 0.095776, " and", false], [52448, 0.0491, " perhaps", false], [46269, 0.048716, " incomp", false], [30788, 0.037951, " even", false], [64911, 0.03376, " exponentially", false], [59988, 0.029059, " massively", false], [47708, 0.02749, " vastly", false], [21400, 0.025175, " but", false], [45145, 0.019054, " almost", false], [31427, 0.017959, " mind", false]]], "qwen": [24870, 15, 0.011836192570626736, [[323, 0.207878, " and", false], [714, 0.051271, " but", false], [1496, 0.050814, " even", false], [421, 0.023342, " if", false], [52890, 0.022976, " incom", false], [8365, 0.02207, " perhaps", false], [3498, 0.020079, " though", false], [83544, 0.018703, " unknow", false], [4558, 0.015977, " almost", false], [71323, 0.015372, " tremendously", false]]]}, "raw_delta": 0.15643138885498042, "tuned_delta": 0.16500318088555868}, {"byte_start": 6105, "byte_end": 6113, "display": {"text": "deemably", "kind": "normal"}, "is_word": true, "word_id": 1024, "word_key": "deemably", "bytes_hex": "64 65 65 6d 61 62 6c 79", "compression": {"rwkv": "20.57% 20.57% 20.57% 0.03% 0.03% 0.01% 0.01% 0.01%", "qwen": "26.66% 26.66% 0.01% 0.01% 0.01% 0.01% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[7333, "dee", "normal", 0.03222240135073662], [2034, "ma", "normal", 0.9963411688804626], [7166, "bly", "normal", 0.9980254173278809]], "qwen": [[450, "de", "normal", 0.051972292363643646], [336, "em", "normal", 0.9987937211990356], [2845, "ably", "normal", 0.9985482096672058]]}, "loss": {"rwkv": 7.726286193481504, "qwen": 6.671797688020069}, "topk": {"rwkv": [7333, 5, 0.03222240135073662, [[7387, 0.633821, "duc", false], [27190, 0.09252, "trie", false], [27418, 0.069613, "vers", false], [35986, 0.054719, "vocab", false], [7333, 0.032222, "dee", false], [34176, 0.020238, "cover", false], [35389, 0.016771, "place", false], [26645, 0.010755, "para", false], [25053, 0.009233, "conc", false], [7595, 0.009066, "fut", false]]], "qwen": [450, 5, 0.051972292363643646, [[7545, 0.391993, "duc", false], [8927, 0.16819, "trie", false], [3004, 0.134581, "vers", false], [78285, 0.059703, "ducible", false], [450, 0.051972, "de", false], [40446, 0.049267, "conc", false], [1732, 0.029554, "par", false], [3449, 0.025845, "lev", false], [273, 0.024408, "le", false], [32094, 0.020225, "levance", false]]]}, "raw_delta": 0.05847325875947718, "tuned_delta": 0.06704505079005543}, {"byte_start": 6113, "byte_end": 6121, "display": {"text": " complex", "kind": "normal"}, "is_word": true, "word_id": 1025, "word_key": " complex", "bytes_hex": "20 63 6f 6d 70 6c 65 78", "compression": {"rwkv": "4.83% 4.83% 4.83% 4.83% 4.83% 4.83% 4.83% 4.83%", "qwen": "5.27% 5.27% 5.27% 5.27% 5.27% 5.27% 5.27% 5.27%"}, "model_tokens": {"rwkv": [[51258, " complex", "normal", 0.11706952005624771]], "qwen": [[6351, " complex", "normal", 0.09666675329208374]]}, "loss": {"rwkv": 4.825420424848339, "qwen": 5.2669321363602055}, "topk": {"rwkv": [51258, 2, 0.11706952005624771, [[59516, 0.150604, " difficult", false], [51258, 0.11707, " complex", false], [31048, 0.110542, " hard", false], [63366, 0.104429, " complicated", false], [45, 0.103886, ",", false], [39011, 0.080194, " messy", false], [59829, 0.038833, " important", false], [62161, 0.021655, " irrelevant", false], [46706, 0.016982, " opaque", false], [62590, 0.010168, " subjective", false]]], "qwen": [6351, 2, 0.09666675329208374, [[11, 0.242719, ",", false], [6351, 0.096667, " complex", false], [2155, 0.091925, " different", false], [16965, 0.03225, " complicated", false], [2989, 0.031886, " important", false], [39715, 0.025306, " irrelevant", false], [650, 0.024848, " un", false], [5000, 0.020229, " difficult", false], [869, 0.017272, " private", false], [46484, 0.014961, " opaque", false]]]}, "raw_delta": -0.0244826078414917, "tuned_delta": -0.01591081581091345}, {"byte_start": 6121, "byte_end": 6122, "display": {"text": ";", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "3b", "compression": {"rwkv": "83.97%", "qwen": "82.18%"}, "model_tokens": {"rwkv": [[60, ";", "normal", 0.009439690038561821]], "qwen": [[26, ";", "normal", 0.010491050779819489]]}, "loss": {"rwkv": 83.96935980174044, "qwen": 82.18371553262716}, "topk": {"rwkv": [60, 6, 0.009439690038561821, [[47, 0.448298, ".", false], [45, 0.296146, ",", false], [5346, 0.111241, "---", false], [21265, 0.068237, " and", false], [4596, 0.010706, " in", false], [60, 0.00944, ";", false], [275, 0.008439, " (", false], [4811, 0.006937, " to", false], [21700, 0.006069, " for", false], [59, 0.004702, ":", false]]], "qwen": [26, 5, 0.010491050779819489, [[13, 0.562278, ".", false], [11, 0.241227, ",", false], [323, 0.091116, " and", false], [4421, 0.037604, "---", false], [26, 0.010491, ";", false], [320, 0.00747, " (", false], [311, 0.00652, " to", false], [382, 0.005579, ".\n\n", false], [25, 0.004955, ":", false], [2513, 0.004913, " things", false]]]}, "raw_delta": 0.09901714324951172, "tuned_delta": 0.10758893528008996}, {"byte_start": 6122, "byte_end": 6125, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 1026, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"rwkv": "17.94% 17.94% 17.94%", "qwen": "14.50% 14.50% 14.50%"}, "model_tokens": {"rwkv": [[4858, " we", "normal", 0.050800591707229614]], "qwen": [[582, " we", "normal", 0.08956600725650787]]}, "loss": {"rwkv": 17.939762552720833, "qwen": 14.503769899550523}, "topk": {"rwkv": [4858, 6, 0.050800591707229614, [[32232, 0.087932, " they", false], [22590, 0.087926, " the", false], [21265, 0.084758, " and", false], [39934, 0.063725, " there", false], [32227, 0.058954, " that", false], [4858, 0.050801, " we", false], [4601, 0.042259, " it", false], [32234, 0.036455, " this", false], [21400, 0.033681, " but", false], [4596, 0.028743, " in", false]]], "qwen": [582, 2, 0.08956600725650787, [[323, 0.130866, " and", false], [582, 0.089566, " we", false], [279, 0.07098, " the", false], [432, 0.067737, " it", false], [807, 0.059452, " they", false], [429, 0.053745, " that", false], [1052, 0.030598, " there", false], [419, 0.028595, " this", false], [304, 0.025112, " in", false], [773, 0.018137, " so", false]]]}, "raw_delta": 0.19053188959757483, "tuned_delta": 0.1991036816281531}, {"byte_start": 6125, "byte_end": 6132, "display": {"text": " should", "kind": "normal"}, "is_word": true, "word_id": 1027, "word_key": " should", "bytes_hex": "20 73 68 6f 75 6c 64", "compression": {"rwkv": "8.45% 8.45% 8.45% 8.45% 8.45% 8.45% 8.45%", "qwen": "6.97% 6.97% 6.97% 6.97% 6.97% 6.97% 6.97%"}, "model_tokens": {"rwkv": [[47266, " should", "normal", 0.03814317286014557]], "qwen": [[1265, " should", "normal", 0.06674191355705261]]}, "loss": {"rwkv": 8.45329125520877, "qwen": 6.973683971068322}, "topk": {"rwkv": [47266, 7, 0.03814317286014557, [[31059, 0.14752, " have", false], [4491, 0.145967, " do", false], [21286, 0.117571, " are", false], [45409, 0.09505, " cannot", false], [21413, 0.086851, " can", false], [32475, 0.040993, " will", false], [47266, 0.038143, " should", false], [31223, 0.036915, " know", false], [46227, 0.026478, " humans", false], [21556, 0.022666, " don", false]]], "qwen": [1265, 6, 0.06674191355705261, [[653, 0.17182, " do", false], [614, 0.130978, " have", false], [4157, 0.13019, " cannot", false], [646, 0.105554, " can", false], [525, 0.073844, " are", false], [1265, 0.066742, " should", false], [1414, 0.033922, " know", false], [1513, 0.027113, " don", false], [686, 0.020999, " will", false], [4936, 0.019961, " simply", false]]]}, "raw_delta": 0.08204684938703266, "tuned_delta": 0.0906186414176109}, {"byte_start": 6132, "byte_end": 6137, "display": {"text": " stop", "kind": "normal"}, "is_word": true, "word_id": 1028, "word_key": " stop", "bytes_hex": "20 73 74 6f 70", "compression": {"rwkv": "15.33% 15.33% 15.33% 15.33% 15.33%", "qwen": "17.86% 17.86% 17.86% 17.86% 17.86%"}, "model_tokens": {"rwkv": [[32122, " stop", "normal", 0.014346488751471043]], "qwen": [[2936, " stop", "normal", 0.00706950668245554]]}, "loss": {"rwkv": 15.328634809445234, "qwen": 17.860436128285865}, "topk": {"rwkv": [32122, 9, 0.014346488751471043, [[22187, 0.429127, " not", false], [39115, 0.097004, " never", false], [45926, 0.063851, " expect", false], [4435, 0.056317, " be", false], [60645, 0.028603, " therefore", false], [31059, 0.020275, " have", false], [45084, 0.017353, " accept", false], [45150, 0.015625, " always", false], [32122, 0.014346, " stop", false], [38877, 0.010446, " learn", false]]], "qwen": [2936, 13, 0.00706950668245554, [[537, 0.530159, " not", false], [387, 0.074207, " be", false], [2581, 0.044176, " never", false], [8916, 0.022915, " therefore", false], [5648, 0.019162, " avoid", false], [1430, 0.013761, " try", false], [1720, 0.010714, " expect", false], [614, 0.008325, " have", false], [2677, 0.007854, " always", false], [5274, 0.007544, " leave", false]]]}, "raw_delta": -0.1403928756713867, "tuned_delta": -0.13182108364080844}, {"byte_start": 6137, "byte_end": 6144, "display": {"text": " trying", "kind": "normal"}, "is_word": true, "word_id": 1029, "word_key": " trying", "bytes_hex": "20 74 72 79 69 6e 67", "compression": {"rwkv": "1.38% 1.38% 1.38% 1.38% 1.38% 1.38% 1.38%", "qwen": "1.79% 1.79% 1.79% 1.79% 1.79% 1.79% 1.79%"}, "model_tokens": {"rwkv": [[47629, " trying", "normal", 0.5826796889305115]], "qwen": [[4460, " trying", "normal", 0.4985191822052002]]}, "loss": {"rwkv": 1.3786915499566683, "qwen": 1.7933555412213442}, "topk": {"rwkv": [47629, 1, 0.5826796889305115, [[47629, 0.58268, " trying", false], [57419, 0.094989, " thinking", false], [62360, 0.044284, " pretending", false], [59681, 0.017607, " expecting", false], [53320, 0.016909, " wasting", false], [52157, 0.015668, " looking", false], [46500, 0.01265, " making", false], [46217, 0.010758, " hoping", false], [59224, 0.010693, " believing", false], [59813, 0.008519, " imagining", false]]], "qwen": [4460, 1, 0.4985191822052002, [[4460, 0.498519, " trying", false], [7274, 0.087178, " thinking", false], [47797, 0.028093, " wasting", false], [39776, 0.019131, " worrying", false], [3259, 0.018178, " making", false], [54806, 0.017214, " pretending", false], [3330, 0.016465, " looking", false], [26625, 0.016464, " treating", false], [10161, 0.015371, " asking", false], [25538, 0.014384, " assuming", false]]]}, "raw_delta": -0.022993854113987505, "tuned_delta": -0.014422062083409256}, {"byte_start": 6144, "byte_end": 6147, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 1030, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.21% 0.21% 0.21%", "qwen": "0.14% 0.14% 0.14%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.9659410715103149]], "qwen": [[311, " to", "normal", 0.9774839878082275]]}, "loss": {"rwkv": 0.20839711080549397, "qwen": 0.13689611868117005}, "topk": {"rwkv": [4811, 1, 0.9659410715103149, [[4811, 0.965941, " to", false], [47, 0.00777, ".", false], [45, 0.005024, ",", false], [4788, 0.004535, " so", false], [21265, 0.002311, " and", false], [4596, 0.002285, " in", false], [21700, 0.001095, " for", false], [275, 0.000932, " (", false], [63461, 0.000789, " desperately", false], [22614, 0.000692, " too", false]]], "qwen": [311, 1, 0.9774839878082275, [[311, 0.977484, " to", false], [11, 0.003888, ",", false], [773, 0.002972, " so", false], [37543, 0.001506, " desperately", false], [304, 0.00114, " in", false], [323, 0.001132, " and", false], [369, 0.001086, " for", false], [320, 0.000969, " (", false], [13, 0.000955, ".", false], [2238, 0.000853, " too", false]]]}, "raw_delta": 0.0039648568878571195, "tuned_delta": 0.012536648918435367}, {"byte_start": 6147, "byte_end": 6152, "display": {"text": " find", "kind": "normal"}, "is_word": true, "word_id": 1031, "word_key": " find", "bytes_hex": "20 66 69 6e 64", "compression": {"rwkv": "17.58% 17.58% 17.58% 17.58% 17.58%", "qwen": "17.29% 17.29% 17.29% 17.29% 17.29%"}, "model_tokens": {"rwkv": [[30858, " find", "normal", 0.007629687432199717]], "qwen": [[1477, " find", "normal", 0.008287807926535606]]}, "loss": {"rwkv": 17.58284581083424, "qwen": 17.28698405655495}, "topk": {"rwkv": [30858, 25, 0.007629687432199717, [[39043, 0.101693, " model", false], [62683, 0.084843, " understand", false], [37923, 0.08271, " build", false], [22339, 0.0639, " put", false], [31358, 0.046281, " make", false], [47030, 0.026574, " reduce", false], [51133, 0.019362, " capture", false], [39025, 0.019198, " mimic", false], [60386, 0.01884, " replicate", false], [63292, 0.0171, " approximate", false]]], "qwen": [1477, 12, 0.008287807926535606, [[3535, 0.28374, " understand", false], [1614, 0.094508, " model", false], [1936, 0.090455, " build", false], [1281, 0.026458, " make", false], [2182, 0.02417, " put", false], [4009, 0.016793, " represent", false], [12322, 0.016563, " capture", false], [633, 0.015462, " get", false], [7949, 0.014764, " reduce", false], [7512, 0.013279, " describe", false]]]}, "raw_delta": 0.01640605926513672, "tuned_delta": 0.02497785129571497}, {"byte_start": 6152, "byte_end": 6159, "display": {"text": " simple", "kind": "normal"}, "is_word": true, "word_id": 1032, "word_key": " simple", "bytes_hex": "20 73 69 6d 70 6c 65", "compression": {"rwkv": "5.92% 5.92% 5.92% 5.92% 5.92% 5.92% 5.92%", "qwen": "5.90% 5.90% 5.90% 5.90% 5.90% 5.90% 5.90%"}, "model_tokens": {"rwkv": [[47284, " simple", "normal", 0.1009325236082077]], "qwen": [[4285, " simple", "normal", 0.10120167583227158]]}, "loss": {"rwkv": 5.9173038786461385, "qwen": 5.901241313279305}, "topk": {"rwkv": [47284, 2, 0.1009325236082077, [[332, 0.133364, " a", false], [47284, 0.100933, " simple", false], [32448, 0.100101, " ways", false], [22590, 0.068825, " the", false], [22249, 0.047653, " out", false], [51832, 0.037114, " general", false], [32229, 0.029899, " them", false], [4419, 0.026561, " an", false], [30724, 0.01999, " easy", false], [38720, 0.017781, " human", false]]], "qwen": [4285, 3, 0.10120167583227158, [[700, 0.118878, " out", false], [264, 0.101372, " a", false], [4285, 0.101202, " simple", false], [5510, 0.095032, " ways", false], [1105, 0.049416, " them", false], [279, 0.049007, " the", false], [458, 0.016485, " an", false], [1661, 0.01402, " good", false], [894, 0.01358, " any", false], [11464, 0.013484, " explicit", false]]]}, "raw_delta": 0.0008906977517263992, "tuned_delta": 0.009462489782304647}, {"byte_start": 6159, "byte_end": 6164, "display": {"text": " ways", "kind": "normal"}, "is_word": true, "word_id": 1033, "word_key": " ways", "bytes_hex": "20 77 61 79 73", "compression": {"rwkv": "7.78% 7.78% 7.78% 7.78% 7.78%", "qwen": "10.46% 10.46% 10.46% 10.46% 10.46%"}, "model_tokens": {"rwkv": [[32448, " ways", "normal", 0.11449906975030899]], "qwen": [[5510, " ways", "normal", 0.05498006194829941]]}, "loss": {"rwkv": 7.777027954792068, "qwen": 10.462368505016979}, "topk": {"rwkv": [32448, 2, 0.11449906975030899, [[45, 0.191352, ",", false], [32448, 0.114499, " ways", false], [46587, 0.089249, " models", false], [64392, 0.067039, " explanations", false], [65275, 0.04155, " representations", false], [64351, 0.041112, " descriptions", false], [39558, 0.03746, " rules", false], [60521, 0.022346, " solutions", false], [38720, 0.021478, " human", false], [51832, 0.018319, " general", false]]], "qwen": [5510, 5, 0.05498006194829941, [[11, 0.200505, ",", false], [4119, 0.119313, " models", false], [43613, 0.083355, " representations", false], [40841, 0.072082, " explanations", false], [5510, 0.05498, " ways", false], [323, 0.034541, " and", false], [10502, 0.028146, " mental", false], [27787, 0.025921, " descriptions", false], [5601, 0.019599, " rules", false], [23400, 0.014106, " analog", false]]]}, "raw_delta": -0.1489068984985351, "tuned_delta": -0.14033510646795685}, {"byte_start": 6164, "byte_end": 6167, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 1034, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "1.48% 1.48% 1.48%", "qwen": "1.91% 1.91% 1.91%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.7835110425949097]], "qwen": [[311, " to", "normal", 0.7277523875236511]]}, "loss": {"rwkv": 1.4793259696615346, "qwen": 1.9103352739607122}, "topk": {"rwkv": [4811, 1, 0.7835110425949097, [[4811, 0.783511, " to", false], [4706, 0.169309, " of", false], [21700, 0.014905, " for", false], [4596, 0.011627, " in", false], [32227, 0.004023, " that", false], [45202, 0.002926, " around", false], [45, 0.002862, ",", false], [275, 0.001867, " (", false], [31162, 0.001472, " into", false], [22249, 0.001421, " out", false]]], "qwen": [311, 1, 0.7277523875236511, [[311, 0.727752, " to", false], [315, 0.238862, " of", false], [304, 0.005255, " in", false], [429, 0.00495, " that", false], [369, 0.004693, " for", false], [1119, 0.00412, " into", false], [11, 0.003879, ",", false], [700, 0.002278, " out", false], [320, 0.001997, " (", false], [2163, 0.001271, " around", false]]]}, "raw_delta": -0.023900230725606278, "tuned_delta": -0.01532843869502803}, {"byte_start": 6167, "byte_end": 6173, "display": {"text": " think", "kind": "normal"}, "is_word": true, "word_id": 1035, "word_key": " think", "bytes_hex": "20 74 68 69 6e 6b", "compression": {"rwkv": "15.50% 15.50% 15.50% 15.50% 15.50% 15.50%", "qwen": "13.14% 13.14% 13.14% 13.14% 13.14% 13.14%"}, "model_tokens": {"rwkv": [[39942, " think", "normal", 0.005826219916343689]], "qwen": [[1744, " think", "normal", 0.012629715725779533]]}, "loss": {"rwkv": 15.49770063454941, "qwen": 13.139653674513227}, "topk": {"rwkv": [39942, 23, 0.005826219916343689, [[60389, 0.137841, " represent", false], [55961, 0.131746, " describe", false], [39043, 0.102576, " model", false], [22339, 0.062984, " put", false], [51133, 0.049694, " capture", false], [62683, 0.039643, " understand", false], [51688, 0.036405, " explain", false], [37923, 0.034396, " build", false], [45854, 0.031101, " encode", false], [31358, 0.024102, " make", false]]], "qwen": [1744, 10, 0.012629715725779533, [[4009, 0.175052, " represent", false], [3535, 0.125118, " understand", false], [1614, 0.116433, " model", false], [7512, 0.06857, " describe", false], [12322, 0.057066, " capture", false], [1936, 0.050149, " build", false], [16164, 0.022086, " encode", false], [10339, 0.019037, " explain", false], [633, 0.013144, " get", false], [1744, 0.01263, " think", false]]]}, "raw_delta": 0.13075788815816247, "tuned_delta": 0.13932968018874073}, {"byte_start": 6173, "byte_end": 6179, "display": {"text": " about", "kind": "normal"}, "is_word": true, "word_id": 1036, "word_key": " about", "bytes_hex": "20 61 62 6f 75 74", "compression": {"rwkv": "2.23% 2.23% 2.23% 2.23% 2.23% 2.23%", "qwen": "3.15% 3.15% 3.15% 3.15% 3.15% 3.15%"}, "model_tokens": {"rwkv": [[37598, " about", "normal", 0.4756644070148468]], "qwen": [[911, " about", "normal", 0.35096195340156555]]}, "loss": {"rwkv": 2.230729636791203, "qwen": 3.1471112447329133}, "topk": {"rwkv": [37598, 1, 0.4756644070148468, [[37598, 0.475664, " about", false], [31296, 0.232608, " like", false], [47, 0.046353, ".", false], [4706, 0.038336, " of", false], [21265, 0.033355, " and", false], [45, 0.02902, ",", false], [32227, 0.024073, " that", false], [4596, 0.022565, " in", false], [4715, 0.009774, " or", false], [4423, 0.008723, " as", false]]], "qwen": [911, 1, 0.35096195340156555, [[911, 0.350962, " about", false], [13, 0.1403, ".", false], [11, 0.080916, ",", false], [429, 0.079425, " that", false], [323, 0.075951, " and", false], [315, 0.051051, " of", false], [1075, 0.042088, " like", false], [476, 0.022743, " or", false], [304, 0.022563, " in", false], [382, 0.012704, ".\n\n", false]]]}, "raw_delta": -0.050814986228942864, "tuned_delta": -0.042243194198364614}, {"byte_start": 6179, "byte_end": 6183, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1037, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "9.65% 9.65% 9.65% 9.65%", "qwen": "12.21% 12.21% 12.21% 12.21%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.11691730469465256]], "qwen": [[279, " the", "normal", 0.06668713688850403]]}, "loss": {"rwkv": 9.650840849696678, "qwen": 12.207648875929388}, "topk": {"rwkv": [22590, 3, 0.11691730469465256, [[32229, 0.388506, " them", false], [39026, 0.163565, " minds", false], [22590, 0.116917, " the", false], [21835, 0.04894, " how", false], [4601, 0.024438, " it", false], [32464, 0.024369, " what", false], [51258, 0.022859, " complex", false], [22248, 0.017387, " our", false], [38720, 0.016553, " human", false], [21265, 0.016518, " and", false]]], "qwen": [279, 3, 0.06668713688850403, [[1105, 0.503293, " them", false], [20062, 0.069343, " minds", false], [279, 0.066687, " the", false], [1128, 0.034867, " what", false], [1246, 0.030605, " how", false], [15235, 0.024006, " AI", false], [6351, 0.020271, " complex", false], [419, 0.017523, " this", false], [323, 0.017303, " and", false], [476, 0.016512, " or", false]]]}, "raw_delta": -0.14177954196929932, "tuned_delta": -0.13320774993872106}, {"byte_start": 6183, "byte_end": 6192, "display": {"text": " contents", "kind": "normal"}, "is_word": true, "word_id": 1038, "word_key": " contents", "bytes_hex": "20 63 6f 6e 74 65 6e 74 73", "compression": {"rwkv": "4.04% 4.04% 4.04% 4.04% 4.04% 4.04% 4.04% 4.04% 4.04%", "qwen": "3.10% 3.10% 3.10% 3.10% 3.10% 3.10% 3.10% 3.10% 3.10%"}, "model_tokens": {"rwkv": [[55847, " contents", "normal", 0.13328483700752258]], "qwen": [[8794, " contents", "normal", 0.2131236046552658]]}, "loss": {"rwkv": 4.038794710821968, "qwen": 3.0975522941036595}, "topk": {"rwkv": [55847, 3, 0.13328483700752258, [[40213, 0.245528, " world", false], [31427, 0.235026, " mind", false], [55847, 0.133285, " contents", false], [39026, 0.099565, " minds", false], [51258, 0.037006, " complex", false], [38720, 0.03131, " human", false], [61720, 0.025837, " complexity", false], [37898, 0.010584, " brain", false], [22752, 0.010093, " way", false], [52569, 0.007788, " problem", false]]], "qwen": [8794, 1, 0.2131236046552658, [[8794, 0.213124, " contents", false], [3971, 0.117353, " mind", false], [1879, 0.113957, " world", false], [20062, 0.074614, " minds", false], [23094, 0.047547, " complexity", false], [6351, 0.021124, " complex", false], [2213, 0.020462, " content", false], [3491, 0.019065, " problem", false], [3738, 0.018264, " human", false], [5322, 0.015819, " problems", false]]]}, "raw_delta": 0.052193562189737974, "tuned_delta": 0.060765354220316224}, {"byte_start": 6192, "byte_end": 6195, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 1039, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.49% 0.49% 0.49%", "qwen": "0.67% 0.67% 0.67%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9207640290260315]], "qwen": [[315, " of", "normal", 0.8948466181755066]]}, "loss": {"rwkv": 0.49310865655384484, "qwen": 0.6678653786176408}, "topk": {"rwkv": [4706, 1, 0.9207640290260315, [[4706, 0.920764, " of", false], [47, 0.030662, ".", false], [45, 0.017317, ",", false], [21265, 0.012963, " and", false], [4596, 0.003097, " in", false], [32227, 0.002232, " that", false], [60, 0.001965, ";", false], [275, 0.001528, " (", false], [4715, 0.001405, " or", false], [5346, 0.001029, "---", false]]], "qwen": [315, 1, 0.8948466181755066, [[315, 0.894847, " of", false], [13, 0.047853, ".", false], [11, 0.01782, ",", false], [323, 0.01475, " and", false], [382, 0.004503, ".\n\n", false], [4421, 0.00264, "---", false], [429, 0.002627, " that", false], [320, 0.001751, " (", false], [304, 0.001715, " in", false], [476, 0.00163, " or", false]]]}, "raw_delta": -0.009690570334593453, "tuned_delta": -0.0011187783040152045}, {"byte_start": 6195, "byte_end": 6201, "display": {"text": " minds", "kind": "normal"}, "is_word": true, "word_id": 1040, "word_key": " minds", "bytes_hex": "20 6d 69 6e 64 73", "compression": {"rwkv": "0.36% 0.36% 0.36% 0.36% 0.36% 0.36%", "qwen": "0.79% 0.79% 0.79% 0.79% 0.79% 0.79%"}, "model_tokens": {"rwkv": [[39026, " minds", "normal", 0.888293981552124]], "qwen": [[20062, " minds", "normal", 0.7699849605560303]]}, "loss": {"rwkv": 0.3580908101164826, "qwen": 0.7856205112617974}, "topk": {"rwkv": [39026, 1, 0.888293981552124, [[39026, 0.888294, " minds", false], [22248, 0.031547, " our", false], [22590, 0.020458, " the", false], [38720, 0.011497, " human", false], [332, 0.010313, " a", false], [39193, 0.004367, " other", false], [31427, 0.002685, " mind", false], [39944, 0.002133, " those", false], [39931, 0.001903, " their", false], [45124, 0.001894, " agents", false]]], "qwen": [20062, 1, 0.7699849605560303, [[20062, 0.769985, " minds", false], [1039, 0.059714, " our", false], [279, 0.039389, " the", false], [3738, 0.021807, " human", false], [264, 0.0203, " a", false], [1846, 0.007593, " those", false], [3971, 0.007428, " mind", false], [1493, 0.006947, " these", false], [1008, 0.006242, " other", false], [1251, 0.004898, " people", false]]]}, "raw_delta": -0.02370728055636088, "tuned_delta": -0.015135488525782633}, {"byte_start": 6201, "byte_end": 6202, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "25.36%", "qwen": "27.39%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.24629829823970795]], "qwen": [[11, ",", "normal", 0.21901921927928925]]}, "loss": {"rwkv": 25.359873765626308, "qwen": 27.385883137368587}, "topk": {"rwkv": [45, 2, 0.24629829823970795, [[47, 0.460899, ".", false], [45, 0.246298, ",", false], [21265, 0.113674, " and", false], [32227, 0.028732, " that", false], [60, 0.024096, ";", false], [4596, 0.021667, " in", false], [275, 0.01893, " (", false], [5346, 0.013782, "---", false], [4423, 0.011644, " as", false], [4450, 0.006186, " by", false]]], "qwen": [11, 2, 0.21901921927928925, [[13, 0.494029, ".", false], [11, 0.219019, ",", false], [323, 0.098597, " and", false], [382, 0.051394, ".\n\n", false], [4421, 0.019468, "---", false], [429, 0.017928, " that", false], [320, 0.014993, " (", false], [26, 0.014264, ";", false], [304, 0.013559, " in", false], [476, 0.010207, " or", false]]]}, "raw_delta": -0.11234581470489502, "tuned_delta": -0.10377402267431678}, {"byte_start": 6202, "byte_end": 6207, "display": {"text": " such", "kind": "normal"}, "is_word": true, "word_id": 1041, "word_key": " such", "bytes_hex": "20 73 75 63 68", "compression": {"rwkv": "16.46% 16.46% 16.46% 16.46% 16.46%", "qwen": "14.75% 14.75% 14.75% 14.75% 14.75%"}, "model_tokens": {"rwkv": [[32139, " such", "normal", 0.010573497042059898]], "qwen": [[1741, " such", "normal", 0.016764383763074875]]}, "loss": {"rwkv": 16.45574031013974, "qwen": 14.746141609758464}, "topk": {"rwkv": [32139, 11, 0.010573497042059898, [[21265, 0.57877, " and", false], [51018, 0.057204, " because", false], [4715, 0.055497, " or", false], [4423, 0.024738, " as", false], [21400, 0.022354, " but", false], [40186, 0.015172, " which", false], [4596, 0.015118, " in", false], [4811, 0.015016, " to", false], [4858, 0.014407, " we", false], [30788, 0.011805, " even", false]]], "qwen": [1741, 8, 0.016764383763074875, [[323, 0.5002, " and", false], [476, 0.087305, " or", false], [1576, 0.081886, " because", false], [438, 0.050973, " as", false], [892, 0.023271, " which", false], [2474, 0.018089, " since", false], [714, 0.017288, " but", false], [1741, 0.016764, " such", false], [1496, 0.015244, " even", false], [311, 0.015047, " to", false]]]}, "raw_delta": 0.09480028152465814, "tuned_delta": 0.10337207355523638}, {"byte_start": 6207, "byte_end": 6210, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 1042, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"rwkv": "0.15% 0.15% 0.15%", "qwen": "0.03% 0.03% 0.03%"}, "model_tokens": {"rwkv": [[4423, " as", "normal", 0.9750046133995056]], "qwen": [[438, " as", "normal", 0.9950841069221497]]}, "loss": {"rwkv": 0.15189507724203258, "qwen": 0.02962327542236265}, "topk": {"rwkv": [4423, 1, 0.9750046133995056, [[4423, 0.975005, " as", false], [32227, 0.018112, " that", false], [4450, 0.001033, " by", false], [332, 0.000722, " a", false], [32448, 0.000585, " ways", false], [52224, 0.000458, " methods", false], [47284, 0.000318, " simple", false], [4419, 0.00031, " an", false], [4600, 0.000204, " is", false], [57419, 0.000197, " thinking", false]]], "qwen": [438, 1, 0.9950841069221497, [[438, 0.995084, " as", false], [429, 0.00189, " that", false], [264, 0.000488, " a", false], [5510, 0.000193, " ways", false], [7274, 0.000175, " thinking", false], [5413, 0.000133, " methods", false], [374, 9.6e-05, " is", false], [553, 8.8e-05, " by", false], [4285, 8.8e-05, " simple", false], [4460, 8.3e-05, " trying", false]]]}, "raw_delta": 0.006780188375463088, "tuned_delta": 0.015351980406041337}, {"byte_start": 6210, "byte_end": 6217, "display": {"text": " simple", "kind": "normal"}, "is_word": true, "word_id": 1043, "word_key": " simple", "bytes_hex": "20 73 69 6d 70 6c 65", "compression": {"rwkv": "8.65% 8.65% 8.65% 8.65% 8.65% 8.65% 8.65%", "qwen": "14.47% 14.47% 14.47% 14.47% 14.47% 14.47% 14.47%"}, "model_tokens": {"rwkv": [[47284, " simple", "normal", 0.035057224333286285]], "qwen": [[4285, " simple", "normal", 0.003632637206465006]]}, "loss": {"rwkv": 8.654560094618503, "qwen": 14.472798281025144}, "topk": {"rwkv": [47284, 4, 0.035057224333286285, [[4450, 0.208841, " by", false], [4596, 0.087361, " in", false], [22590, 0.072713, " the", false], [47284, 0.035057, " simple", false], [53140, 0.033118, " through", false], [4404, 0.030458, " ``", false], [55666, 0.023463, " building", false], [40085, 0.020275, " using", false], [47629, 0.019979, " trying", false], [38720, 0.0189, " human", false]]], "qwen": [4285, 37, 0.003632637206465006, [[279, 0.133687, " the", false], [4460, 0.052323, " trying", false], [553, 0.03949, " by", false], [304, 0.03373, " in", false], [7274, 0.031925, " thinking", false], [9902, 0.026922, " ``", false], [6540, 0.024552, " knowledge", false], [15039, 0.02171, " searching", false], [4752, 0.017244, " building", false], [3738, 0.016192, " human", false]]]}, "raw_delta": -0.32263163157871794, "tuned_delta": -0.3140598395481397}, {"byte_start": 6217, "byte_end": 6222, "display": {"text": " ways", "kind": "normal"}, "is_word": true, "word_id": 1044, "word_key": " ways", "bytes_hex": "20 77 61 79 73", "compression": {"rwkv": "14.31% 14.31% 14.31% 14.31% 14.31%", "qwen": "19.04% 19.04% 19.04% 19.04% 19.04%"}, "model_tokens": {"rwkv": [[32448, " ways", "normal", 0.018915539607405663]], "qwen": [[5510, " ways", "normal", 0.005097561050206423]]}, "loss": {"rwkv": 14.314239858820182, "qwen": 19.039943022871757}, "topk": {"rwkv": [32448, 9, 0.018915539607405663, [[65275, 0.091285, " representations", false], [46587, 0.084383, " models", false], [39558, 0.03865, " rules", false], [57375, 0.034939, " symbolic", false], [59943, 0.031659, " knowledge", false], [46658, 0.030362, " neural", false], [45, 0.026188, ",", false], [38720, 0.020902, " human", false], [32448, 0.018916, " ways", false], [45432, 0.016186, " causal", false]]], "qwen": [5510, 30, 0.005097561050206423, [[43613, 0.065501, " representations", false], [6540, 0.05868, " knowledge", false], [5601, 0.054789, " rules", false], [4119, 0.040498, " models", false], [35296, 0.029279, " symbolic", false], [11, 0.024659, ",", false], [24970, 0.017899, " theories", false], [4419, 0.016319, " features", false], [10502, 0.014763, " mental", false], [29728, 0.01381, " neural", false]]]}, "raw_delta": -0.26204862594604506, "tuned_delta": -0.2534768339154668}, {"byte_start": 6222, "byte_end": 6225, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 1045, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "0.97% 0.97% 0.97%", "qwen": "1.92% 1.92% 1.92%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.8508548140525818]], "qwen": [[311, " to", "normal", 0.7263924479484558]]}, "loss": {"rwkv": 0.9686062896593381, "qwen": 1.921578818909463}, "topk": {"rwkv": [4811, 1, 0.8508548140525818, [[4811, 0.850855, " to", false], [4706, 0.124952, " of", false], [21700, 0.012865, " for", false], [32227, 0.004086, " that", false], [4596, 0.002308, " in", false], [37810, 0.000481, " based", false], [275, 0.000468, " (", false], [45, 0.000425, ",", false], [31296, 0.000404, " like", false], [4858, 0.000321, " we", false]]], "qwen": [311, 1, 0.7263924479484558, [[311, 0.726392, " to", false], [315, 0.224225, " of", false], [429, 0.014931, " that", false], [304, 0.011929, " in", false], [369, 0.005449, " for", false], [3118, 0.004559, " based", false], [1119, 0.001091, " into", false], [11, 0.000979, ",", false], [1075, 0.000975, " like", false], [320, 0.00066, " (", false]]]}, "raw_delta": -0.05284401774406433, "tuned_delta": -0.04427222571348608}, {"byte_start": 6225, "byte_end": 6231, "display": {"text": " think", "kind": "normal"}, "is_word": true, "word_id": 1046, "word_key": " think", "bytes_hex": "20 74 68 69 6e 6b", "compression": {"rwkv": "6.06% 6.06% 6.06% 6.06% 6.06% 6.06%", "qwen": "4.14% 4.14% 4.14% 4.14% 4.14% 4.14%"}, "model_tokens": {"rwkv": [[39942, " think", "normal", 0.13201920688152313]], "qwen": [[1744, " think", "normal", 0.2525695562362671]]}, "loss": {"rwkv": 6.058192066232952, "qwen": 4.135931945218039}, "topk": {"rwkv": [39942, 1, 0.13201920688152313, [[39942, 0.132019, " think", false], [60389, 0.107778, " represent", false], [37923, 0.069077, " build", false], [55961, 0.051718, " describe", false], [39043, 0.043258, " model", false], [22339, 0.038955, " put", false], [45688, 0.029868, " define", false], [62683, 0.022644, " understand", false], [45854, 0.020946, " encode", false], [30858, 0.01596, " find", false]]], "qwen": [1744, 1, 0.2525695562362671, [[1744, 0.25257, " think", false], [4009, 0.241383, " represent", false], [16164, 0.048848, " encode", false], [7512, 0.036788, " describe", false], [1614, 0.031156, " model", false], [1936, 0.020897, " build", false], [3535, 0.020736, " understand", false], [12322, 0.013109, " capture", false], [3158, 0.012055, " express", false], [2415, 0.010918, " map", false]]]}, "raw_delta": 0.10659273465474449, "tuned_delta": 0.11516452668532273}, {"byte_start": 6231, "byte_end": 6237, "display": {"text": " about", "kind": "normal"}, "is_word": true, "word_id": 1047, "word_key": " about", "bytes_hex": "20 61 62 6f 75 74", "compression": {"rwkv": "0.23% 0.23% 0.23% 0.23% 0.23% 0.23%", "qwen": "0.26% 0.26% 0.26% 0.26% 0.26% 0.26%"}, "model_tokens": {"rwkv": [[37598, " about", "normal", 0.9247358441352844]], "qwen": [[911, " about", "normal", 0.9184801578521729]]}, "loss": {"rwkv": 0.23334606069065872, "qwen": 0.25558232016207766}, "topk": {"rwkv": [37598, 1, 0.9247358441352844, [[37598, 0.924736, " about", false], [4706, 0.036857, " of", false], [4596, 0.010728, " in", false], [32227, 0.010199, " that", false], [31296, 0.002625, " like", false], [32464, 0.000647, " what", false], [21835, 0.000568, " how", false], [4423, 0.000511, " as", false], [21265, 0.000486, " and", false], [4450, 0.000474, " by", false]]], "qwen": [911, 1, 0.9184801578521729, [[911, 0.91848, " about", false], [315, 0.066512, " of", false], [304, 0.004573, " in", false], [429, 0.001382, " that", false], [1075, 0.000739, " like", false], [476, 0.000675, " or", false], [11, 0.00053, ",", false], [1246, 0.000372, " how", false], [279, 0.000333, " the", false], [323, 0.000302, " and", false]]]}, "raw_delta": -0.0012330400447050725, "tuned_delta": 0.007338751985873176}, {"byte_start": 6237, "byte_end": 6243, "display": {"text": " space", "kind": "normal"}, "is_word": true, "word_id": 1048, "word_key": " space", "bytes_hex": "20 73 70 61 63 65", "compression": {"rwkv": "22.17% 22.17% 22.17% 22.17% 22.17% 22.17%", "qwen": "23.57% 23.57% 23.57% 23.57% 23.57% 23.57%"}, "model_tokens": {"rwkv": [[39750, " space", "normal", 0.0006307411240413785]], "qwen": [[3550, " space", "normal", 0.00039288686821237206]]}, "loss": {"rwkv": 22.166408180325217, "qwen": 23.569997290113044}, "topk": {"rwkv": [39750, 139, 0.0006307411240413785, [[22590, 0.225832, " the", false], [21835, 0.108221, " how", false], [32464, 0.067001, " what", false], [38720, 0.056188, " human", false], [59943, 0.037485, " knowledge", false], [4404, 0.021567, " ``", false], [47732, 0.019219, " vision", false], [332, 0.013843, " a", false], [56529, 0.012784, " language", false], [47284, 0.009938, " simple", false]]], "qwen": [3550, 166, 0.00039288686821237206, [[279, 0.177559, " the", false], [1246, 0.083276, " how", false], [3738, 0.082368, " human", false], [6540, 0.076958, " knowledge", false], [11129, 0.057263, " vision", false], [1128, 0.055498, " what", false], [4244, 0.027448, " words", false], [4128, 0.024734, " language", false], [8806, 0.019701, " speech", false], [862, 0.016263, " their", false]]]}, "raw_delta": -0.07783150672912598, "tuned_delta": -0.06925971469854773}, {"byte_start": 6243, "byte_end": 6244, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "19.44%", "qwen": "16.97%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.34336769580841064]], "qwen": [[11, ",", "normal", 0.39013928174972534]]}, "loss": {"rwkv": 19.44256988698017, "qwen": 16.97423511080913}, "topk": {"rwkv": [45, 1, 0.34336769580841064, [[45, 0.343368, ",", false], [21265, 0.199534, " and", false], [4715, 0.192438, " or", false], [47, 0.139316, ".", false], [275, 0.023966, " (", false], [4423, 0.017262, " as", false], [4596, 0.015951, " in", false], [46, 0.008148, "-", false], [5346, 0.007209, "---", false], [27165, 0.006575, "time", false]]], "qwen": [11, 1, 0.39013928174972534, [[11, 0.390139, ",", false], [323, 0.262821, " and", false], [476, 0.154869, " or", false], [13, 0.087858, ".", false], [320, 0.025548, " (", false], [7246, 0.02115, "-time", false], [304, 0.019751, " in", false], [382, 0.007857, ".\n\n", false], [315, 0.003637, " of", false], [26, 0.003188, ";", false]]]}, "raw_delta": 0.1368735432624817, "tuned_delta": 0.14544533529305995}, {"byte_start": 6244, "byte_end": 6252, "display": {"text": " objects", "kind": "normal"}, "is_word": true, "word_id": 1049, "word_key": " objects", "bytes_hex": "20 6f 62 6a 65 63 74 73", "compression": {"rwkv": "10.00% 10.00% 10.00% 10.00% 10.00% 10.00% 10.00% 10.00%", "qwen": "11.01% 11.01% 11.01% 11.01% 11.01% 11.01% 11.01% 11.01%"}, "model_tokens": {"rwkv": [[52342, " objects", "normal", 0.011667819693684578]], "qwen": [[6171, " objects", "normal", 0.007564160972833633]]}, "loss": {"rwkv": 10.00306131866371, "qwen": 11.010318559321329}, "topk": {"rwkv": [52342, 9, 0.011667819693684578, [[4715, 0.350322, " or", false], [47284, 0.133252, " simple", false], [21265, 0.098674, " and", false], [32251, 0.069816, " time", false], [37598, 0.050554, " about", false], [32139, 0.026637, " such", false], [4811, 0.016945, " to", false], [4423, 0.015397, " as", false], [52342, 0.011668, " objects", false], [31296, 0.010183, " like", false]]], "qwen": [6171, 12, 0.007564160972833633, [[476, 0.347496, " or", false], [882, 0.303176, " time", false], [323, 0.0296, " and", false], [911, 0.027436, " about", false], [4128, 0.022497, " language", false], [438, 0.018997, " as", false], [1894, 0.018668, " color", false], [1741, 0.016463, " such", false], [311, 0.013976, " to", false], [4285, 0.012753, " simple", false]]]}, "raw_delta": -0.055854201316833496, "tuned_delta": -0.047282409286255246}, {"byte_start": 6252, "byte_end": 6253, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "1.02%", "qwen": "0.86%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.9446302056312561]], "qwen": [[11, ",", "normal", 0.9531685709953308]]}, "loss": {"rwkv": 1.021439360004393, "qwen": 0.8649585266108387}, "topk": {"rwkv": [45, 1, 0.9446302056312561, [[45, 0.94463, ",", false], [21265, 0.029621, " and", false], [4596, 0.009174, " in", false], [4715, 0.008865, " or", false], [275, 0.002056, " (", false], [4706, 0.000879, " of", false], [4423, 0.000522, " as", false], [32227, 0.000505, " that", false], [32487, 0.000495, " with", false], [21643, 0.000247, " etc", false]]], "qwen": [11, 1, 0.9531685709953308, [[11, 0.953169, ",", false], [323, 0.025544, " and", false], [476, 0.008522, " or", false], [304, 0.007181, " in", false], [320, 0.001544, " (", false], [315, 0.000549, " of", false], [429, 0.000304, " that", false], [4992, 0.000284, " etc", false], [438, 0.000209, " as", false], [13, 0.000204, ".", false]]]}, "raw_delta": 0.00867713987827301, "tuned_delta": 0.01724893190885126}, {"byte_start": 6253, "byte_end": 6262, "display": {"text": " multiple", "kind": "normal"}, "is_word": true, "word_id": 1050, "word_key": " multiple", "bytes_hex": "20 6d 75 6c 74 69 70 6c 65", "compression": {"rwkv": "21.29% 21.29% 21.29% 21.29% 21.29% 21.29% 21.29% 21.29% 21.29%", "qwen": "21.59% 21.59% 21.59% 21.59% 21.59% 21.59% 21.59% 21.59% 21.59%"}, "model_tokens": {"rwkv": [[56679, " multiple", "normal", 2.4625243895570748e-05]], "qwen": [[5248, " multiple", "normal", 2.091510032187216e-05]]}, "loss": {"rwkv": 21.289770568673937, "qwen": 21.590409618810526}, "topk": {"rwkv": [56679, 800, 2.4625243895570748e-05, [[21265, 0.170301, " and", false], [4715, 0.131235, " or", false], [50851, 0.091448, " actions", false], [45909, 0.031345, " events", false], [38604, 0.030503, " goals", false], [46606, 0.025559, " motion", false], [55816, 0.023921, " concepts", false], [47184, 0.02296, " scenes", false], [21643, 0.022612, " etc", false], [61661, 0.022446, " categories", false]]], "qwen": [5248, 1010, 2.091510032187216e-05, [[476, 0.146282, " or", false], [323, 0.125577, " and", false], [882, 0.073682, " time", false], [4992, 0.044693, " etc", false], [4244, 0.041437, " words", false], [4357, 0.028706, " events", false], [4128, 0.028093, " language", false], [6168, 0.020604, " actions", false], [11379, 0.01876, " motion", false], [279, 0.016326, " the", false]]]}, "raw_delta": -0.016670968797471764, "tuned_delta": -0.008099176766893515}, {"byte_start": 6262, "byte_end": 6269, "display": {"text": " agents", "kind": "normal"}, "is_word": true, "word_id": 1051, "word_key": " agents", "bytes_hex": "20 61 67 65 6e 74 73", "compression": {"rwkv": "10.47% 10.47% 10.47% 10.47% 10.47% 10.47% 10.47%", "qwen": "3.37% 3.37% 3.37% 3.37% 3.37% 3.37% 3.37%"}, "model_tokens": {"rwkv": [[45124, " agents", "normal", 0.017348535358905792]], "qwen": [[13009, " agents", "normal", 0.27024340629577637]]}, "loss": {"rwkv": 10.465979649306096, "qwen": 3.3708369235203084}, "topk": {"rwkv": [45124, 3, 0.017348535358905792, [[52342, 0.716978, " objects", false], [46691, 0.041405, " object", false], [45124, 0.017349, " agents", false], [47539, 0.016985, " things", false], [46, 0.011421, "-", false], [55816, 0.009144, " concepts", false], [38604, 0.009136, " goals", false], [9098, 0.005825, "xin", false], [56215, 0.005649, " features", false], [65275, 0.005428, " representations", false]]], "qwen": [13009, 1, 0.27024340629577637, [[13009, 0.270243, " agents", false], [6171, 0.051458, " objects", false], [43613, 0.049531, " representations", false], [15336, 0.044358, " dimensions", false], [38455, 0.029288, " perspectives", false], [20062, 0.022272, " minds", false], [1251, 0.020611, " people", false], [2513, 0.018062, " things", false], [37107, 0.016936, " senses", false], [6194, 0.015997, " views", false]]]}, "raw_delta": 0.39343825408390604, "tuned_delta": 0.40201004611448427}, {"byte_start": 6269, "byte_end": 6270, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "2.89%", "qwen": "2.10%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.8509618043899536]], "qwen": [[11, ",", "normal", 0.8899271488189697]]}, "loss": {"rwkv": 2.8882078455296627, "qwen": 2.103010975907061}, "topk": {"rwkv": [45, 1, 0.8509618043899536, [[45, 0.850962, ",", false], [21265, 0.02726, " and", false], [63662, 0.024319, " interacting", false], [4596, 0.018076, " in", false], [45094, 0.01261, " acting", false], [47, 0.01086, ".", false], [4715, 0.007671, " or", false], [45580, 0.005719, " cooper", false], [53362, 0.00465, " working", false], [275, 0.004206, " (", false]]], "qwen": [11, 1, 0.8899271488189697, [[11, 0.889927, ",", false], [323, 0.024245, " and", false], [13, 0.015877, ".", false], [44730, 0.011038, " interacting", false], [304, 0.00927, " in", false], [476, 0.009064, " or", false], [6, 0.005501, "'", false], [448, 0.005398, " with", false], [4992, 0.005097, " etc", false], [320, 0.003637, " (", false]]]}, "raw_delta": 0.04354055970907211, "tuned_delta": 0.05211235173965036}, {"byte_start": 6270, "byte_end": 6273, "display": {"text": " or", "kind": "normal"}, "is_word": true, "word_id": 1052, "word_key": " or", "bytes_hex": "20 6f 72", "compression": {"rwkv": "12.96% 12.96% 12.96%", "qwen": "16.14% 16.14% 16.14%"}, "model_tokens": {"rwkv": [[4715, " or", "normal", 0.11574005335569382]], "qwen": [[476, " or", "normal", 0.06827627867460251]]}, "loss": {"rwkv": 12.96171325798678, "qwen": 16.135299082036887}, "topk": {"rwkv": [4715, 3, 0.11574005335569382, [[21643, 0.148393, " etc", false], [21265, 0.147212, " and", false], [4715, 0.11574, " or", false], [38604, 0.038784, " goals", false], [50851, 0.031208, " actions", false], [45432, 0.023302, " causal", false], [32251, 0.017653, " time", false], [56529, 0.016348, " language", false], [22590, 0.012422, " the", false], [62143, 0.009965, " intentions", false]]], "qwen": [476, 3, 0.06827627867460251, [[4992, 0.362629, " etc", false], [323, 0.112262, " and", false], [476, 0.068276, " or", false], [882, 0.028907, " time", false], [5248, 0.022951, " multiple", false], [4128, 0.018681, " language", false], [279, 0.014417, " the", false], [6540, 0.013399, " knowledge", false], [8845, 0.012834, " goals", false], [3738, 0.009357, " human", false]]]}, "raw_delta": -0.17598096529642737, "tuned_delta": -0.16740917326584911}, {"byte_start": 6273, "byte_end": 6280, "display": {"text": " symmet", "kind": "normal"}, "is_word": true, "word_id": 1053, "word_key": " symmet", "bytes_hex": "20 73 79 6d 6d 65 74", "compression": {"rwkv": "24.31% 24.31% 24.31% 24.31% 24.31% 24.31% 24.31%", "qwen": "39.61% 39.61% 39.61% 39.61% 0.16% 0.16% 0.16%"}, "model_tokens": {"rwkv": [[47484, " symmet", "normal", 7.686301978537813e-05]], "qwen": [[7886, " sym", "normal", 0.00015302766405511647], [4059, "met", "normal", 0.9731724262237549]]}, "loss": {"rwkv": 24.313275800695703, "qwen": 22.702058773788}, "topk": {"rwkv": [47484, 763, 7.686301978537813e-05, [[30788, 0.082493, " even", false], [22590, 0.076892, " the", false], [45432, 0.03283, " causal", false], [38604, 0.027743, " goals", false], [47284, 0.024737, " simple", false], [39193, 0.023756, " other", false], [50851, 0.023154, " actions", false], [56529, 0.020575, " language", false], [38720, 0.017794, " human", false], [55816, 0.016268, " concepts", false]]], "qwen": [7886, 472, 0.00015302766405511647, [[279, 0.078277, " the", false], [1496, 0.069353, " even", false], [3738, 0.034636, " human", false], [1008, 0.032857, " other", false], [4128, 0.032166, " language", false], [5248, 0.025747, " multiple", false], [882, 0.020751, " time", false], [6540, 0.018177, " knowledge", false], [894, 0.017684, " any", false], [4113, 0.015942, " anything", false]]]}, "raw_delta": 0.08934484315770026, "tuned_delta": 0.0979166351882785}, {"byte_start": 6280, "byte_end": 6284, "display": {"text": "ries", "kind": "normal"}, "is_word": true, "word_id": 1054, "word_key": "ries", "bytes_hex": "72 69 65 73", "compression": {"rwkv": "0.00% 0.00% 0.00% 0.00%", "qwen": "0.00% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[26892, "ries", "normal", 0.9992349147796631]], "qwen": [[4019, "ries", "normal", 0.9997239708900452]]}, "loss": {"rwkv": 0.003456851282342453, "qwen": 0.0012445526786539558}, "topk": {"rwkv": [26892, 1, 0.9992349147796631, [[26892, 0.999235, "ries", false], [8623, 0.000359, "riz", false], [7789, 0.000162, "ies", false], [122, 3.4e-05, "y", false], [1939, 2.9e-05, "ic", false], [8608, 2.6e-05, "rie", false], [8619, 2e-05, "ris", false], [26910, 1.2e-05, "rise", false], [2159, 1e-05, "ri", false], [42193, 7e-06, "rising", false]]], "qwen": [4019, 1, 0.9997239708900452, [[4019, 0.999724, "ries", false], [81, 8.5e-05, "r", false], [7231, 2.8e-05, "rie", false], [4543, 2.7e-05, "tries", false], [550, 1.7e-05, "ies", false], [5963, 1.5e-05, "ris", false], [461, 1.3e-05, "ri", false], [1539, 7e-06, "try", false], [376, 6e-06, "tr", false], [25610, 5e-06, "rons", false]]]}, "raw_delta": 0.00012267588317627087, "tuned_delta": 0.008694467913754519}, {"byte_start": 6284, "byte_end": 6285, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "8.91%", "qwen": "12.28%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.6068022847175598]], "qwen": [[13, ".", "normal", 0.5062693953514099]]}, "loss": {"rwkv": 8.91117786486591, "qwen": 12.275286427839026}, "topk": {"rwkv": [47, 1, 0.6068022847175598, [[47, 0.606802, ".", false], [45, 0.272887, ",", false], [4706, 0.022284, " of", false], [4596, 0.019909, " in", false], [60, 0.0176, ";", false], [275, 0.013365, " (", false], [21265, 0.012714, " and", false], [4715, 0.011999, " or", false], [5346, 0.004998, "---", false], [32227, 0.002968, " that", false]]], "qwen": [13, 1, 0.5062693953514099, [[13, 0.506269, ".", false], [11, 0.235655, ",", false], [382, 0.050041, ".\n\n", false], [323, 0.049627, " and", false], [476, 0.036576, " or", false], [304, 0.02841, " in", false], [315, 0.025678, " of", false], [4421, 0.014913, "---", false], [26, 0.014688, ";", false], [320, 0.012269, " (", false]]]}, "raw_delta": -0.18654578924179077, "tuned_delta": -0.17797399721121251}, {"byte_start": 6285, "byte_end": 6289, "display": {"text": " All", "kind": "normal"}, "is_word": true, "word_id": 1055, "word_key": " all", "bytes_hex": "20 41 6c 6c", "compression": {"rwkv": "20.99% 20.99% 20.99% 20.99%", "qwen": "19.97% 19.97% 19.97% 19.97%"}, "model_tokens": {"rwkv": [[19407, " All", "normal", 0.009374026209115982]], "qwen": [[2009, " All", "normal", 0.011931069195270538]]}, "loss": {"rwkv": 20.99233995043511, "qwen": 19.966039930760708}, "topk": {"rwkv": [19407, 16, 0.009374026209115982, [[20996, 0.144864, " The", false], [4331, 0.105113, " We", false], [50342, 0.064783, " Instead", false], [29894, 0.05346, " This", false], [37453, 0.052519, " These", false], [261, 0.047597, "\n\n", false], [3913, 0.030471, " In", false], [37451, 0.029898, " There", false], [3918, 0.029551, " It", false], [29834, 0.018962, " Such", false]]], "qwen": [2009, 15, 0.011931069195270538, [[576, 0.137482, " The", false], [1205, 0.108703, " We", false], [12090, 0.078001, " Instead", false], [1096, 0.065582, " This", false], [4220, 0.051513, " These", false], [1084, 0.039099, " It", false], [758, 0.025056, " In", false], [2619, 0.024796, " There", false], [15132, 0.024106, " Such", false], [1416, 0.021449, " If", false]]]}, "raw_delta": 0.056910157203674316, "tuned_delta": 0.06548194923425256}, {"byte_start": 6289, "byte_end": 6295, "display": {"text": " these", "kind": "normal"}, "is_word": true, "word_id": 1056, "word_key": " these", "bytes_hex": "20 74 68 65 73 65", "compression": {"rwkv": "4.25% 4.25% 4.25% 4.25% 4.25% 4.25%", "qwen": "4.02% 4.02% 4.02% 4.02% 4.02% 4.02%"}, "model_tokens": {"rwkv": [[39936, " these", "normal", 0.24104814231395721]], "qwen": [[1493, " these", "normal", 0.26273828744888306]]}, "loss": {"rwkv": 4.250126992202187, "qwen": 4.0172950879781695}, "topk": {"rwkv": [39936, 2, 0.24104814231395721, [[4706, 0.345517, " of", false], [39936, 0.241048, " these", false], [32139, 0.116757, " such", false], [22590, 0.064086, " the", false], [32234, 0.035297, " this", false], [39944, 0.032699, " those", false], [32227, 0.021556, " that", false], [22248, 0.015256, " our", false], [4858, 0.014967, " we", false], [55572, 0.007599, " attempts", false]]], "qwen": [1493, 2, 0.26273828744888306, [[315, 0.365524, " of", false], [1493, 0.262738, " these", false], [1741, 0.059072, " such", false], [279, 0.050706, " the", false], [419, 0.038164, " this", false], [429, 0.035941, " that", false], [582, 0.032031, " we", false], [1846, 0.029898, " those", false], [1039, 0.023221, " our", false], [13553, 0.009483, " attempts", false]]]}, "raw_delta": 0.012910942236582457, "tuned_delta": 0.021482734267160707}, {"byte_start": 6295, "byte_end": 6299, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 1057, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"rwkv": "7.96% 7.96% 7.96% 7.96%", "qwen": "7.74% 7.74% 7.74% 7.74%"}, "model_tokens": {"rwkv": [[21286, " are", "normal", 0.17364351451396942]], "qwen": [[525, " are", "normal", 0.17949646711349487]]}, "loss": {"rwkv": 7.960182598654924, "qwen": 7.743664502905407}, "topk": {"rwkv": [21286, 1, 0.17364351451396942, [[21286, 0.173644, " are", false], [47539, 0.109253, " things", false], [47284, 0.097019, " simple", false], [32448, 0.038409, " ways", false], [61590, 0.034588, " approaches", false], [51566, 0.033651, " efforts", false], [55572, 0.031193, " attempts", false], [38735, 0.030757, " ideas", false], [55816, 0.027786, " concepts", false], [52326, 0.027406, " notions", false]]], "qwen": [525, 1, 0.17949646711349487, [[525, 0.179496, " are", false], [2513, 0.14278, " things", false], [4285, 0.083813, " simple", false], [614, 0.033614, " have", false], [18940, 0.026301, " concepts", false], [6708, 0.024537, " ideas", false], [58582, 0.022189, " notions", false], [5510, 0.021111, " ways", false], [2803, 0.020764, " seem", false], [13553, 0.019804, " attempts", false]]]}, "raw_delta": 0.012006312608718872, "tuned_delta": 0.020578104639297122}, {"byte_start": 6299, "byte_end": 6304, "display": {"text": " part", "kind": "normal"}, "is_word": true, "word_id": 1058, "word_key": " part", "bytes_hex": "20 70 61 72 74", "compression": {"rwkv": "20.18% 20.18% 20.18% 20.18% 20.18%", "qwen": "17.79% 17.79% 17.79% 17.79% 17.79%"}, "model_tokens": {"rwkv": [[31633, " part", "normal", 0.0036934264935553074]], "qwen": [[949, " part", "normal", 0.00720400782302022]]}, "loss": {"rwkv": 20.175188462431596, "qwen": 17.79246170535885}, "topk": {"rwkv": [31633, 47, 0.0036934264935553074, [[32386, 0.047963, " very", false], [22614, 0.043635, " too", false], [47284, 0.039228, " simple", false], [51258, 0.038984, " complex", false], [59829, 0.028351, " important", false], [32448, 0.026706, " ways", false], [59699, 0.016265, " extremely", false], [47539, 0.014897, " things", false], [63366, 0.014604, " complicated", false], [56162, 0.014202, " examples", false]]], "qwen": [949, 26, 0.00720400782302022, [[5390, 0.053922, " useful", false], [4285, 0.028505, " simple", false], [6351, 0.027971, " complex", false], [1602, 0.026334, " very", false], [2238, 0.025342, " too", false], [2989, 0.023064, " important", false], [1101, 0.019092, " just", false], [2244, 0.016302, " great", false], [9016, 0.016134, " extremely", false], [1661, 0.015528, " good", false]]]}, "raw_delta": 0.1321264266967772, "tuned_delta": 0.14069821872735547}, {"byte_start": 6304, "byte_end": 6307, "display": {"text": " of", "kind": "normal"}, "is_word": true, "word_id": 1059, "word_key": " of", "bytes_hex": "20 6f 66", "compression": {"rwkv": "0.06% 0.06% 0.06%", "qwen": "0.11% 0.11% 0.11%"}, "model_tokens": {"rwkv": [[4706, " of", "normal", 0.9901755452156067]], "qwen": [[315, " of", "normal", 0.9824559688568115]]}, "loss": {"rwkv": 0.05980410046002732, "qwen": 0.10639722371129687}, "topk": {"rwkv": [4706, 1, 0.9901755452156067, [[4706, 0.990176, " of", false], [21265, 0.007056, " and", false], [46, 0.000809, "-", false], [45, 0.000642, ",", false], [22590, 0.000218, " the", false], [275, 8.5e-05, " (", false], [4596, 7.1e-05, " in", false], [4715, 6.4e-05, " or", false], [38720, 3.4e-05, " human", false], [568, 3.3e-05, "--", false]]], "qwen": [315, 1, 0.9824559688568115, [[315, 0.982456, " of", false], [323, 0.012155, " and", false], [11, 0.002275, ",", false], [9777, 0.000429, "-and", false], [4421, 0.000221, "---", false], [6351, 0.000212, " complex", false], [320, 0.000203, " (", false], [714, 0.000132, " but", false], [279, 0.000132, " the", false], [476, 0.000102, " or", false]]]}, "raw_delta": -0.0025836713612079616, "tuned_delta": 0.005988120669370286}, {"byte_start": 6307, "byte_end": 6311, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1060, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "2.48% 2.48% 2.48% 2.48%", "qwen": "2.77% 2.77% 2.77% 2.77%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.5780766606330872]], "qwen": [[279, " the", "normal", 0.5408031344413757]]}, "loss": {"rwkv": 2.483154306217576, "qwen": 2.7713270923888382}, "topk": {"rwkv": [22590, 1, 0.5780766606330872, [[22590, 0.578077, " the", false], [32464, 0.069887, " what", false], [22248, 0.044835, " our", false], [38720, 0.038102, " human", false], [332, 0.037381, " a", false], [39026, 0.037153, " minds", false], [21835, 0.025059, " how", false], [52652, 0.020581, " reality", false], [51258, 0.012993, " complex", false], [57419, 0.012202, " thinking", false]]], "qwen": [279, 1, 0.5408031344413757, [[279, 0.540803, " the", false], [1039, 0.075508, " our", false], [1128, 0.062604, " what", false], [3738, 0.043597, " human", false], [20062, 0.042312, " minds", false], [264, 0.041211, " a", false], [3971, 0.020199, " mind", false], [6351, 0.016703, " complex", false], [1246, 0.009529, " how", false], [4586, 0.008416, " general", false]]]}, "raw_delta": -0.015979692339897156, "tuned_delta": -0.0074079003093189075}, {"byte_start": 6311, "byte_end": 6321, "display": {"text": " arbitrary", "kind": "normal"}, "is_word": true, "word_id": 1061, "word_key": " arbitrary", "bytes_hex": "20 61 72 62 69 74 72 61 72 79", "compression": {"rwkv": "18.15% 18.15% 18.15% 18.15% 18.15% 18.15% 18.15% 18.15% 18.15% 18.15%", "qwen": "18.48% 18.48% 18.48% 18.48% 18.48% 18.48% 18.48% 18.48% 18.48% 18.48%"}, "model_tokens": {"rwkv": [[59163, " arbitrary", "normal", 4.2606767237884924e-05]], "qwen": [[24168, " arbitrary", "normal", 3.55418051185552e-05]]}, "loss": {"rwkv": 18.14639856118149, "qwen": 18.475153717264796}, "topk": {"rwkv": [59163, 890, 4.2606767237884924e-05, [[61720, 0.181785, " complexity", false], [55847, 0.125567, " contents", false], [31427, 0.062453, " mind", false], [38720, 0.041804, " human", false], [51258, 0.037608, " complex", false], [51308, 0.031101, " content", false], [52569, 0.030807, " problem", false], [31835, 0.030627, " real", false], [45098, 0.02853, " actual", false], [22752, 0.020391, " way", false]]], "qwen": [24168, 1218, 3.55418051185552e-05, [[23094, 0.230235, " complexity", false], [3971, 0.082195, " mind", false], [6351, 0.044407, " complex", false], [3738, 0.025924, " human", false], [8794, 0.024136, " contents", false], [5042, 0.021258, " actual", false], [3491, 0.020376, " problem", false], [20062, 0.020193, " minds", false], [88930, 0.0185, " richness", false], [2213, 0.016962, " content", false]]]}, "raw_delta": -0.01823005676269518, "tuned_delta": -0.009658264732116931}, {"byte_start": 6321, "byte_end": 6322, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "41.98%", "qwen": "36.15%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.09706572443246841]], "qwen": [[11, ",", "normal", 0.13471338152885437]]}, "loss": {"rwkv": 41.98467990087022, "qwen": 36.15043504345827}, "topk": {"rwkv": [45, 2, 0.09706572443246841, [[61720, 0.483272, " complexity", false], [45, 0.097066, ",", false], [60572, 0.036714, " structure", false], [21265, 0.025786, " and", false], [55847, 0.017039, " contents", false], [64294, 0.016393, " complexities", false], [22752, 0.014772, " way", false], [51308, 0.013878, " content", false], [38720, 0.011606, " human", false], [46642, 0.01099, " nature", false]]], "qwen": [11, 2, 0.13471338152885437, [[23094, 0.148095, " complexity", false], [11, 0.134713, ",", false], [323, 0.055262, " and", false], [5944, 0.043879, " structure", false], [3738, 0.041658, " human", false], [15491, 0.030826, " simpl", false], [3565, 0.021551, " details", false], [10502, 0.014835, " mental", false], [2213, 0.014607, " content", false], [6993, 0.014223, " nature", false]]]}, "raw_delta": 0.323519229888916, "tuned_delta": 0.33209102191949424}, {"byte_start": 6322, "byte_end": 6336, "display": {"text": " intrinsically", "kind": "normal"}, "is_word": true, "word_id": 1062, "word_key": " intrinsically", "bytes_hex": "20 69 6e 74 72 69 6e 73 69 63 61 6c 6c 79", "compression": {"rwkv": "11.05% 11.05% 11.05% 11.05% 11.05% 11.05% 11.05% 11.05% 11.05% 11.05% 5.21% 5.21% 5.21% 5.21%", "qwen": "30.80% 30.80% 30.80% 30.80% 30.80% 0.10% 0.10% 0.10% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00%"}, "model_tokens": {"rwkv": [[59914, " intrinsic", "normal", 0.0021597729064524174], [24525, "ally", "normal", 0.31128764152526855]], "qwen": [[10582, " intr", "normal", 0.00019538900232873857], [1330, "ins", "normal", 0.9828972220420837], [2673, "ically", "normal", 0.9994437098503113]]}, "loss": {"rwkv": 9.37912791649354, "qwen": 11.024154460112934}, "topk": {"rwkv": [59914, 48, 0.0021597729064524174, [[51258, 0.14994, " complex", false], [38720, 0.13498, " human", false], [63366, 0.035795, " complicated", false], [39011, 0.035125, " messy", false], [21265, 0.025959, " and", false], [62590, 0.017408, " subjective", false], [47284, 0.015247, " simple", false], [21861, 0.010734, " idi", false], [21400, 0.010487, " but", false], [22184, 0.009928, " non", false]]], "qwen": [10582, 561, 0.00019538900232873857, [[24870, 0.118122, " irre", false], [6351, 0.08494, " complex", false], [3738, 0.072046, " human", false], [323, 0.033334, " and", false], [714, 0.015954, " but", false], [650, 0.015624, " un", false], [16965, 0.01198, " complicated", false], [877, 0.011912, " id", false], [45846, 0.010069, " messy", false], [24168, 0.009484, " arbitrary", false]]]}, "raw_delta": -0.09121964085248425, "tuned_delta": -0.08264784882190601}, {"byte_start": 6336, "byte_end": 6344, "display": {"text": "-complex", "kind": "normal"}, "is_word": true, "word_id": 1063, "word_key": "-complex", "bytes_hex": "2d 63 6f 6d 70 6c 65 78", "compression": {"rwkv": "75.52% 1.55% 1.55% 1.55% 1.55% 1.55% 1.55% 1.55%", "qwen": "21.28% 21.28% 21.28% 21.28% 0.08% 0.08% 0.08% 0.08%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.015309866517782211], [48997, "complex", "normal", 0.5483301281929016]], "qwen": [[11476, "-com", "normal", 0.008921952918171883], [9111, "plex", "normal", 0.9829851984977722]]}, "loss": {"rwkv": 10.795557373839532, "qwen": 10.676848137768228}, "topk": {"rwkv": [46, 8, 0.015309866517782211, [[51258, 0.472701, " complex", false], [63366, 0.071237, " complicated", false], [39011, 0.056884, " messy", false], [59516, 0.031709, " difficult", false], [31048, 0.025811, " hard", false], [38797, 0.016166, " intra", false], [38720, 0.015675, " human", false], [46, 0.01531, "-", false], [47284, 0.015209, " simple", false], [63682, 0.0082, " irreducible", false]]], "qwen": [11476, 9, 0.008921952918171883, [[6351, 0.474555, " complex", false], [16965, 0.050957, " complicated", false], [5000, 0.04705, " difficult", false], [83544, 0.027861, " unknow", false], [650, 0.021079, " un", false], [2588, 0.018002, " hard", false], [24870, 0.01069, " irre", false], [3738, 0.009019, " human", false], [11476, 0.008922, "-com", false], [55926, 0.007587, " meaningless", false]]]}, "raw_delta": 0.006582637783139944, "tuned_delta": 0.015154429813718192}, {"byte_start": 6344, "byte_end": 6345, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "44.80%", "qwen": "37.66%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.08270533382892609]], "qwen": [[11, ",", "normal", 0.12389146536588669]]}, "loss": {"rwkv": 44.80244365260648, "qwen": 37.66064049808222}, "topk": {"rwkv": [45, 4, 0.08270533382892609, [[55847, 0.305905, " contents", false], [46642, 0.132776, " nature", false], [60572, 0.132112, " structure", false], [45, 0.082705, ",", false], [51308, 0.0699, " content", false], [46, 0.012652, "-", false], [56480, 0.012218, " internal", false], [38720, 0.012206, " human", false], [61720, 0.011211, " complexity", false], [22752, 0.009044, " way", false]]], "qwen": [11, 1, 0.12389146536588669, [[11, 0.123891, ",", false], [8794, 0.092671, " contents", false], [6993, 0.071234, " nature", false], [5944, 0.060559, " structure", false], [1879, 0.058331, " world", false], [2213, 0.033085, " content", false], [3971, 0.03014, " mind", false], [10502, 0.023869, " mental", false], [323, 0.022605, " and", false], [20062, 0.01616, " minds", false]]]}, "raw_delta": 0.3960256576538086, "tuned_delta": 0.4045974496843868}, {"byte_start": 6345, "byte_end": 6353, "display": {"text": " outside", "kind": "normal"}, "is_word": true, "word_id": 1064, "word_key": " outside", "bytes_hex": "20 6f 75 74 73 69 64 65", "compression": {"rwkv": "23.95% 23.95% 23.95% 23.95% 23.95% 23.95% 23.95% 23.95%", "qwen": "21.42% 21.42% 21.42% 21.42% 21.42% 21.42% 21.42% 21.42%"}, "model_tokens": {"rwkv": [[52391, " outside", "normal", 2.3365817469311878e-05]], "qwen": [[4889, " outside", "normal", 7.482973160222173e-05]]}, "loss": {"rwkv": 23.95099188975818, "qwen": 21.41567094596764}, "topk": {"rwkv": [52391, 1867, 2.3365817469311878e-05, [[55847, 0.087454, " contents", false], [21265, 0.054203, " and", false], [60572, 0.047959, " structure", false], [38720, 0.045599, " human", false], [51308, 0.027095, " content", false], [46642, 0.026357, " nature", false], [39011, 0.023997, " messy", false], [56480, 0.021559, " internal", false], [31835, 0.020745, " real", false], [63682, 0.016748, " irreducible", false]]], "qwen": [4889, 960, 7.482973160222173e-05, [[24870, 0.181912, " irre", false], [323, 0.08592, " and", false], [3971, 0.045985, " mind", false], [3738, 0.029883, " human", false], [20062, 0.022767, " minds", false], [8794, 0.020036, " contents", false], [1931, 0.011558, " real", false], [2213, 0.010374, " content", false], [10502, 0.008828, " mental", false], [7548, 0.008385, " highly", false]]]}, "raw_delta": 0.14058804512023926, "tuned_delta": 0.14915983715081751}, {"byte_start": 6353, "byte_end": 6359, "display": {"text": " world", "kind": "normal"}, "is_word": true, "word_id": 1065, "word_key": " world", "bytes_hex": "20 77 6f 72 6c 64", "compression": {"rwkv": "6.72% 6.72% 6.72% 6.72% 6.72% 6.72%", "qwen": "3.07% 3.07% 3.07% 3.07% 3.07% 3.07%"}, "model_tokens": {"rwkv": [[40213, " world", "normal", 0.10787786543369293]], "qwen": [[1879, " world", "normal", 0.3606451451778412]]}, "loss": {"rwkv": 6.71567027497141, "qwen": 3.065308771741586}, "topk": {"rwkv": [40213, 2, 0.10787786543369293, [[46, 0.657547, "-", false], [40213, 0.107878, " world", false], [22590, 0.025483, " the", false], [4706, 0.024886, " of", false], [46642, 0.017877, " nature", false], [52652, 0.014205, " reality", false], [32398, 0.009414, " view", false], [60572, 0.007526, " structure", false], [63536, 0.006055, " environment", false], [63637, 0.00572, " information", false]]], "qwen": [1879, 1, 0.3606451451778412, [[1879, 0.360645, " world", false], [10603, 0.193052, "-the", false], [315, 0.051654, " of", false], [30084, 0.041532, "-world", false], [279, 0.03997, " the", false], [8729, 0.039052, " reality", false], [11, 0.023874, ",", false], [8668, 0.017669, "-of", false], [7947, 0.014426, " domain", false], [12, 0.006347, "-", false]]]}, "raw_delta": 0.20241902271906534, "tuned_delta": 0.2109908147496436}, {"byte_start": 6359, "byte_end": 6360, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "19.30%", "qwen": "32.75%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.3428715169429779]], "qwen": [[13, ".", "normal", 0.16265623271465302]]}, "loss": {"rwkv": 19.301681699393356, "qwen": 32.751273191564614}, "topk": {"rwkv": [47, 1, 0.3428715169429779, [[47, 0.342872, ".", false], [45, 0.246875, ",", false], [32227, 0.111944, " that", false], [4706, 0.060651, " of", false], [4858, 0.051275, " we", false], [60, 0.036922, ";", false], [5346, 0.034979, "---", false], [21265, 0.023958, " and", false], [4596, 0.020023, " in", false], [4811, 0.008261, " to", false]]], "qwen": [13, 3, 0.16265623271465302, [[11, 0.304169, ",", false], [429, 0.212047, " that", false], [13, 0.162656, ".", false], [315, 0.073421, " of", false], [582, 0.04008, " we", false], [323, 0.037262, " and", false], [304, 0.03095, " in", false], [26, 0.019891, ";", false], [382, 0.013724, ".\n\n", false], [4421, 0.011087, "---", false]]]}, "raw_delta": -0.745803713798523, "tuned_delta": -0.7372319217679447}, {"byte_start": 6360, "byte_end": 6365, "display": {"text": " They", "kind": "normal"}, "is_word": true, "word_id": 1066, "word_key": " they", "bytes_hex": "20 54 68 65 79", "compression": {"rwkv": "11.21% 11.21% 11.21% 11.21% 11.21%", "qwen": "11.05% 11.05% 11.05% 11.05% 11.05%"}, "model_tokens": {"rwkv": [[29893, " They", "normal", 0.04504038393497467]], "qwen": [[2379, " They", "normal", 0.046690043061971664]]}, "loss": {"rwkv": 11.214699731910299, "qwen": 11.051852799461324}, "topk": {"rwkv": [29893, 4, 0.04504038393497467, [[20996, 0.153233, " The", false], [4331, 0.128593, " We", false], [50342, 0.049215, " Instead", false], [29893, 0.04504, " They", false], [261, 0.042059, "\n\n", false], [30031, 0.036273, " What", false], [3918, 0.031607, " It", false], [19555, 0.030127, " But", false], [37451, 0.027606, " There", false], [20571, 0.027526, " Our", false]]], "qwen": [2379, 3, 0.046690043061971664, [[576, 0.16355, " The", false], [1205, 0.103303, " We", false], [2379, 0.04669, " They", false], [1084, 0.039729, " It", false], [12090, 0.027401, " Instead", false], [2619, 0.024403, " There", false], [2014, 0.023697, " To", false], [758, 0.022879, " In", false], [1416, 0.022751, " If", false], [1597, 0.022629, " And", false]]]}, "raw_delta": 0.009030151367187433, "tuned_delta": 0.017601943397765683}, {"byte_start": 6365, "byte_end": 6369, "display": {"text": " are", "kind": "normal"}, "is_word": true, "word_id": 1067, "word_key": " are", "bytes_hex": "20 61 72 65", "compression": {"rwkv": "3.29% 3.29% 3.29% 3.29%", "qwen": "2.57% 2.57% 2.57% 2.57%"}, "model_tokens": {"rwkv": [[21286, " are", "normal", 0.4786088466644287]], "qwen": [[525, " are", "normal", 0.5650731921195984]]}, "loss": {"rwkv": 3.29326138484175, "qwen": 2.5734070392698905}, "topk": {"rwkv": [21286, 1, 0.4786088466644287, [[21286, 0.478609, " are", false], [4491, 0.081424, " do", false], [47266, 0.067275, " should", false], [31059, 0.052875, " have", false], [45409, 0.041094, " cannot", false], [21413, 0.041028, " can", false], [22074, 0.019537, " may", false], [32475, 0.017421, " will", false], [31506, 0.015219, " need", false], [21256, 0.013112, " all", false]]], "qwen": [525, 1, 0.5650731921195984, [[525, 0.565073, " are", false], [653, 0.050742, " do", false], [614, 0.046284, " have", false], [646, 0.043862, " can", false], [1265, 0.041158, " should", false], [1231, 0.027971, " may", false], [4157, 0.024155, " cannot", false], [3000, 0.012619, " exist", false], [1969, 0.011286, " must", false], [1184, 0.011214, " need", false]]]}, "raw_delta": 0.039917200803756714, "tuned_delta": 0.048488992834334964}, {"byte_start": 6369, "byte_end": 6373, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 1068, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "5.11% 5.11% 5.11% 5.11%", "qwen": "5.43% 5.43% 5.43% 5.43%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.32195380330085754]], "qwen": [[537, " not", "normal", 0.29971134662628174]]}, "loss": {"rwkv": 5.107196800021964, "qwen": 5.4323574112130855}, "topk": {"rwkv": [22187, 1, 0.32195380330085754, [[22187, 0.321954, " not", false], [31633, 0.051663, " part", false], [22590, 0.04268, " the", false], [21256, 0.039106, " all", false], [332, 0.013656, " a", false], [31296, 0.012447, " like", false], [31198, 0.011998, " just", false], [45, 0.011522, ",", false], [32464, 0.011268, " what", false], [39934, 0.01115, " there", false]]], "qwen": [537, 1, 0.29971134662628174, [[537, 0.299711, " not", false], [949, 0.055794, " part", false], [279, 0.04706, " the", false], [678, 0.025093, " all", false], [1101, 0.018226, " just", false], [1128, 0.015271, " what", false], [1172, 0.014496, " only", false], [5390, 0.012231, " useful", false], [11, 0.010814, ",", false], [2513, 0.010723, " things", false]]]}, "raw_delta": -0.01803073287010193, "tuned_delta": -0.00945894083952368}, {"byte_start": 6373, "byte_end": 6378, "display": {"text": " what", "kind": "normal"}, "is_word": true, "word_id": 1069, "word_key": " what", "bytes_hex": "20 77 68 61 74", "compression": {"rwkv": "17.36% 17.36% 17.36% 17.36% 17.36%", "qwen": "13.71% 13.71% 13.71% 13.71% 13.71%"}, "model_tokens": {"rwkv": [[32464, " what", "normal", 0.00808615144342184]], "qwen": [[1128, " what", "normal", 0.022369293496012688]]}, "loss": {"rwkv": 17.35742471069534, "qwen": 13.705840912433946}, "topk": {"rwkv": [32464, 19, 0.00808615144342184, [[31633, 0.116338, " part", false], [59914, 0.103823, " intrinsic", false], [22590, 0.088474, " the", false], [47284, 0.050883, " simple", false], [45, 0.024164, ",", false], [4596, 0.022836, " in", false], [47539, 0.021188, " things", false], [63591, 0.016011, " fundamental", false], [4811, 0.01387, " to", false], [332, 0.012946, " a", false]]], "qwen": [1128, 5, 0.022369293496012688, [[949, 0.257528, " part", false], [279, 0.149537, " the", false], [304, 0.03459, " in", false], [4766, 0.029046, " inside", false], [1128, 0.022369, " what", false], [46601, 0.018088, " intrinsic", false], [11, 0.013909, ",", false], [4285, 0.012322, " simple", false], [264, 0.011966, " a", false], [9902, 0.011239, " ``", false]]]}, "raw_delta": 0.20248680114746098, "tuned_delta": 0.21105859317803924}, {"byte_start": 6378, "byte_end": 6385, "display": {"text": " should", "kind": "normal"}, "is_word": true, "word_id": 1070, "word_key": " should", "bytes_hex": "20 73 68 6f 75 6c 64", "compression": {"rwkv": "10.30% 10.30% 10.30% 10.30% 10.30% 10.30% 10.30%", "qwen": "16.70% 16.70% 16.70% 16.70% 16.70% 16.70% 16.70%"}, "model_tokens": {"rwkv": [[47266, " should", "normal", 0.018452977761626244]], "qwen": [[1265, " should", "normal", 0.0015293064061552286]]}, "loss": {"rwkv": 10.304964577778307, "qwen": 16.701618500909266}, "topk": {"rwkv": [47266, 7, 0.018452977761626244, [[4858, 0.266663, " we", false], [39026, 0.116671, " minds", false], [4600, 0.110939, " is", false], [22590, 0.081737, " the", false], [3609, 0.038492, " AI", false], [38964, 0.02024, " makes", false], [47266, 0.018453, " should", false], [21286, 0.018429, " are", false], [52201, 0.016266, " matters", false], [332, 0.01494, " a", false]]], "qwen": [1265, 39, 0.0015293064061552286, [[279, 0.238696, " the", false], [582, 0.149782, " we", false], [374, 0.120309, " is", false], [20062, 0.100219, " minds", false], [1039, 0.050444, " our", false], [3643, 0.0339, " makes", false], [432, 0.024385, " it", false], [5780, 0.018558, " goes", false], [12677, 0.015993, " humans", false], [264, 0.011859, " a", false]]]}, "raw_delta": -0.354705810546875, "tuned_delta": -0.34613401851629677}, {"byte_start": 6385, "byte_end": 6388, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 1071, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"rwkv": "0.68% 0.68% 0.68%", "qwen": "1.14% 1.14% 1.14%"}, "model_tokens": {"rwkv": [[4435, " be", "normal", 0.8929682374000549]], "qwen": [[387, " be", "normal", 0.8268448710441589]]}, "loss": {"rwkv": 0.6838947439109873, "qwen": 1.1429644508871892}, "topk": {"rwkv": [4435, 1, 0.8929682374000549, [[4435, 0.892968, " be", false], [46530, 0.010812, " matter", false], [38649, 0.010182, " guide", false], [38306, 0.009278, " drive", false], [51273, 0.005512, " concern", false], [38377, 0.004994, " enter", false], [4715, 0.004612, " or", false], [4559, 0.002851, " go", false], [31059, 0.002417, " have", false], [47008, 0.002415, " really", false]]], "qwen": [387, 1, 0.8268448710441589, [[387, 0.826845, " be", false], [8474, 0.029989, " guide", false], [6541, 0.017479, " drive", false], [6051, 0.009878, " inform", false], [728, 0.00861, " go", false], [4925, 0.007859, " matter", false], [8253, 0.007208, " determine", false], [61325, 0.005009, " motivate", false], [6979, 0.004122, " define", false], [1281, 0.003884, " make", false]]]}, "raw_delta": -0.02545622984568278, "tuned_delta": -0.016884437815104535}, {"byte_start": 6388, "byte_end": 6394, "display": {"text": " built", "kind": "normal"}, "is_word": true, "word_id": 1072, "word_key": " built", "bytes_hex": "20 62 75 69 6c 74", "compression": {"rwkv": "11.32% 11.32% 11.32% 11.32% 11.32% 11.32%", "qwen": "11.21% 11.21% 11.21% 11.21% 11.21% 11.21%"}, "model_tokens": {"rwkv": [[37924, " built", "normal", 0.02331293746829033]], "qwen": [[5798, " built", "normal", 0.023984147235751152]]}, "loss": {"rwkv": 11.318017736140629, "qwen": 11.212031277763288}, "topk": {"rwkv": [37924, 10, 0.02331293746829033, [[22339, 0.094739, " put", false], [22590, 0.071422, " the", false], [53137, 0.060476, " thought", false], [52249, 0.054899, " modeled", false], [53035, 0.049894, " studied", false], [4596, 0.044018, " in", false], [52112, 0.035605, " learned", false], [39887, 0.026018, " taken", false], [61755, 0.025804, " considered", false], [37924, 0.023313, " built", false]]], "qwen": [5798, 9, 0.023984147235751152, [[3381, 0.102225, " thought", false], [279, 0.082371, " the", false], [61553, 0.073139, " modeled", false], [304, 0.057516, " in", false], [4766, 0.056733, " inside", false], [15251, 0.036094, " represented", false], [9498, 0.034182, " learned", false], [518, 0.025864, " at", false], [5798, 0.023984, " built", false], [19476, 0.023806, " studied", false]]]}, "raw_delta": 0.005877137184143066, "tuned_delta": 0.014448929214721315}, {"byte_start": 6394, "byte_end": 6397, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 1073, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "14.46% 14.46% 14.46%", "qwen": "10.69% 10.69% 10.69%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.09114251285791397]], "qwen": [[304, " in", "normal", 0.16885791718959808]]}, "loss": {"rwkv": 14.464520592246117, "qwen": 10.692159254357676}, "topk": {"rwkv": [4596, 2, 0.09114251285791397, [[31162, 0.839627, " into", false], [4596, 0.091143, " in", false], [46, 0.010649, "-", false], [46301, 0.008812, " inside", false], [47, 0.006814, ".", false], [4450, 0.005827, " by", false], [45, 0.004704, ",", false], [21265, 0.002709, " and", false], [4423, 0.002373, " as", false], [4715, 0.002369, " or", false]]], "qwen": [304, 2, 0.16885791718959808, [[1119, 0.712143, " into", false], [304, 0.168858, " in", false], [4766, 0.053773, " inside", false], [11, 0.00777, ",", false], [2878, 0.006168, " within", false], [311, 0.005287, " to", false], [323, 0.004373, " and", false], [13, 0.004349, ".", false], [553, 0.004262, " by", false], [369, 0.003311, " for", false]]]}, "raw_delta": 0.2091841300328573, "tuned_delta": 0.21775592206343555}, {"byte_start": 6397, "byte_end": 6398, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "40.86%", "qwen": "48.25%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.10549722611904144]], "qwen": [[11, ",", "normal", 0.0688665434718132]]}, "loss": {"rwkv": 40.857574400175714, "qwen": 48.25066140587562}, "topk": {"rwkv": [45, 3, 0.10549722611904144, [[4811, 0.373112, " to", false], [47, 0.221567, ".", false], [45, 0.105497, ",", false], [4423, 0.03443, " as", false], [22590, 0.026247, " the", false], [22248, 0.023031, " our", false], [3609, 0.021817, " AI", false], [4450, 0.019882, " by", false], [60, 0.016826, ";", false], [21265, 0.01213, " and", false]]], "qwen": [11, 3, 0.0688665434718132, [[311, 0.609426, " to", false], [13, 0.07712, ".", false], [11, 0.068867, ",", false], [279, 0.042724, " the", false], [1039, 0.025157, " our", false], [264, 0.023088, " a", false], [382, 0.016726, ".\n\n", false], [476, 0.014431, " or", false], [458, 0.013104, " an", false], [20062, 0.009841, " minds", false]]]}, "raw_delta": -0.4099597930908203, "tuned_delta": -0.4013880010602421}, {"byte_start": 6398, "byte_end": 6401, "display": {"text": " as", "kind": "normal"}, "is_word": true, "word_id": 1074, "word_key": " as", "bytes_hex": "20 61 73", "compression": {"rwkv": "15.97% 15.97% 15.97%", "qwen": "20.21% 20.21% 20.21%"}, "model_tokens": {"rwkv": [[4423, " as", "normal", 0.07138797640800476]], "qwen": [[438, " as", "normal", 0.03467898070812225]]}, "loss": {"rwkv": 15.967327926505453, "qwen": 20.20747849176884}, "topk": {"rwkv": [4423, 4, 0.07138797640800476, [[21265, 0.209805, " and", false], [21400, 0.142508, " but", false], [4715, 0.100561, " or", false], [4423, 0.071388, " as", false], [32232, 0.054404, " they", false], [51018, 0.043878, " because", false], [4596, 0.038, " in", false], [22185, 0.03465, " nor", false], [4811, 0.014699, " to", false], [30788, 0.013509, " even", false]]], "qwen": [438, 7, 0.03467898070812225, [[323, 0.207156, " and", false], [476, 0.162336, " or", false], [6329, 0.139448, " nor", false], [714, 0.08335, " but", false], [1576, 0.046677, " because", false], [807, 0.039988, " they", false], [438, 0.034679, " as", false], [1496, 0.025316, " even", false], [311, 0.022693, " to", false], [304, 0.021659, " in", false]]]}, "raw_delta": -0.23512387275695812, "tuned_delta": -0.22655208072637986}, {"byte_start": 6401, "byte_end": 6407, "display": {"text": " their", "kind": "normal"}, "is_word": true, "word_id": 1075, "word_key": " their", "bytes_hex": "20 74 68 65 69 72", "compression": {"rwkv": "16.25% 16.25% 16.25% 16.25% 16.25% 16.25%", "qwen": "15.12% 15.12% 15.12% 15.12% 15.12% 15.12%"}, "model_tokens": {"rwkv": [[39931, " their", "normal", 0.004446817561984062]], "qwen": [[862, " their", "normal", 0.006524569820612669]]}, "loss": {"rwkv": 16.24910430167908, "qwen": 15.124794952249854}, "topk": {"rwkv": [39931, 34, 0.004446817561984062, [[32232, 0.149974, " they", false], [22590, 0.073455, " the", false], [31633, 0.059053, " part", false], [332, 0.055842, " a", false], [4858, 0.039236, " we", false], [55666, 0.032336, " building", false], [4601, 0.030379, " it", false], [4588, 0.020821, " if", false], [4596, 0.01615, " in", false], [47284, 0.014415, " simple", false]]], "qwen": [862, 25, 0.006524569820612669, [[807, 0.175156, " they", false], [279, 0.082138, " the", false], [264, 0.064957, " a", false], [582, 0.056716, " we", false], [421, 0.045218, " if", false], [419, 0.044418, " this", false], [429, 0.036722, " that", false], [949, 0.031809, " part", false], [432, 0.02626, " it", false], [1493, 0.02526, " these", false]]]}, "raw_delta": 0.06234494845072425, "tuned_delta": 0.07091674048130249}, {"byte_start": 6407, "byte_end": 6418, "display": {"text": " complexity", "kind": "normal"}, "is_word": true, "word_id": 1076, "word_key": " complexity", "bytes_hex": "20 63 6f 6d 70 6c 65 78 69 74 79", "compression": {"rwkv": "3.43% 3.43% 3.43% 3.43% 3.43% 3.43% 3.43% 3.43% 3.43% 3.43% 3.43%", "qwen": "4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88% 4.88%"}, "model_tokens": {"rwkv": [[61720, " complexity", "normal", 0.12213197350502014]], "qwen": [[23094, " complexity", "normal", 0.050824154168367386]]}, "loss": {"rwkv": 3.432548570296895, "qwen": 4.884479658024287}, "topk": {"rwkv": [61720, 1, 0.12213197350502014, [[61720, 0.122132, " complexity", false], [55847, 0.066168, " contents", false], [56916, 0.057216, " presence", false], [32386, 0.027796, " very", false], [22681, 0.027666, " use", false], [59677, 0.024985, " existence", false], [59914, 0.024313, " intrinsic", false], [51308, 0.017714, " content", false], [45098, 0.013721, " actual", false], [40093, 0.013424, " value", false]]], "qwen": [23094, 2, 0.050824154168367386, [[8794, 0.118183, " contents", false], [23094, 0.050824, " complexity", false], [13885, 0.036968, " existence", false], [9362, 0.031106, " presence", false], [2213, 0.029506, " content", false], [4752, 0.025276, " building", false], [13042, 0.022211, " representation", false], [6993, 0.015222, " nature", false], [990, 0.011962, " use", false], [54480, 0.011863, " computational", false]]]}, "raw_delta": -0.08051215518604625, "tuned_delta": -0.071940363155468}, {"byte_start": 6418, "byte_end": 6421, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 1077, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "7.51% 7.51% 7.51%", "qwen": "8.06% 8.06% 8.06%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.2833641767501831]], "qwen": [[374, " is", "normal", 0.2616298794746399]]}, "loss": {"rwkv": 7.514036671296684, "qwen": 8.060003478998834}, "topk": {"rwkv": [4600, 1, 0.2833641767501831, [[4600, 0.283364, " is", false], [38964, 0.068425, " makes", false], [40219, 0.049537, " would", false], [32475, 0.048743, " will", false], [21265, 0.043867, " and", false], [45409, 0.03087, " cannot", false], [21413, 0.028453, " can", false], [30659, 0.026134, " does", false], [47266, 0.023127, " should", false], [21800, 0.017332, " has", false]]], "qwen": [374, 1, 0.2616298794746399, [[374, 0.26163, " is", false], [3643, 0.093887, " makes", false], [323, 0.05325, " and", false], [686, 0.04864, " will", false], [1035, 0.031732, " would", false], [4157, 0.02455, " cannot", false], [646, 0.0233, " can", false], [3363, 0.018559, " means", false], [27715, 0.017811, " grows", false], [27934, 0.016117, " prevents", false]]]}, "raw_delta": -0.03027482827504474, "tuned_delta": -0.02170303624446649}, {"byte_start": 6421, "byte_end": 6429, "display": {"text": " endless", "kind": "normal"}, "is_word": true, "word_id": 1078, "word_key": " endless", "bytes_hex": "20 65 6e 64 6c 65 73 73", "compression": {"rwkv": "18.32% 18.32% 18.32% 18.32% 18.32% 18.32% 18.32% 18.32%", "qwen": "18.18% 18.18% 18.18% 18.18% 18.18% 18.18% 18.18% 18.18%"}, "model_tokens": {"rwkv": [[51607, " endless", "normal", 0.000289862509816885]], "qwen": [[25678, " endless", "normal", 0.00031490589026361704]]}, "loss": {"rwkv": 18.315464386285665, "qwen": 18.17623583127968}, "topk": {"rwkv": [51607, 273, 0.000289862509816885, [[22187, 0.170304, " not", false], [332, 0.078675, " a", false], [4419, 0.050049, " an", false], [22614, 0.042854, " too", false], [31633, 0.025791, " part", false], [45302, 0.024152, " beyond", false], [22590, 0.021548, " the", false], [31581, 0.020269, " only", false], [52391, 0.017648, " outside", false], [62161, 0.01734, " irrelevant", false]]], "qwen": [25678, 295, 0.00031490589026361704, [[537, 0.092246, " not", false], [264, 0.06122, " a", false], [7797, 0.059096, " beyond", false], [773, 0.041949, " so", false], [2238, 0.037008, " too", false], [24870, 0.025747, " irre", false], [458, 0.02232, " an", false], [279, 0.021553, " the", false], [39715, 0.019333, " irrelevant", false], [3041, 0.018743, " far", false]]]}, "raw_delta": 0.007720470428466797, "tuned_delta": 0.016292262459045047}, {"byte_start": 6429, "byte_end": 6430, "display": {"text": ";", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "3b", "compression": {"rwkv": "80.02%", "qwen": "71.32%"}, "model_tokens": {"rwkv": [[60, ";", "normal", 0.011825809255242348]], "qwen": [[26, ";", "normal", 0.0191591028124094]]}, "loss": {"rwkv": 80.02449054930968, "qwen": 71.32282624929111}, "topk": {"rwkv": [60, 5, 0.011825809255242348, [[2030, 0.495472, "ly", false], [47, 0.196249, ".", false], [21265, 0.134506, " and", false], [45, 0.127318, ",", false], [60, 0.011826, ";", false], [4596, 0.006734, " in", false], [5346, 0.004611, "---", false], [275, 0.003209, " (", false], [4811, 0.0014, " to", false], [21400, 0.00136, " but", false]]], "qwen": [26, 5, 0.0191591028124094, [[13, 0.294122, ".", false], [11, 0.279669, ",", false], [323, 0.27395, " and", false], [382, 0.055618, ".\n\n", false], [26, 0.019159, ";", false], [304, 0.016172, " in", false], [320, 0.012282, " (", false], [4421, 0.005053, "---", false], [311, 0.003033, " to", false], [1576, 0.002492, " because", false]]]}, "raw_delta": 0.48252272605895996, "tuned_delta": 0.4910945180895382}, {"byte_start": 6430, "byte_end": 6438, "display": {"text": " instead", "kind": "normal"}, "is_word": true, "word_id": 1079, "word_key": " instead", "bytes_hex": "20 69 6e 73 74 65 61 64", "compression": {"rwkv": "5.95% 5.95% 5.95% 5.95% 5.95% 5.95% 5.95% 5.95%", "qwen": "6.45% 6.45% 6.45% 6.45% 6.45% 6.45% 6.45% 6.45%"}, "model_tokens": {"rwkv": [[52028, " instead", "normal", 0.07251709699630737]], "qwen": [[4518, " instead", "normal", 0.05730580538511276]]}, "loss": {"rwkv": 5.952525925542842, "qwen": 6.445586211976131}, "topk": {"rwkv": [52028, 4, 0.07251709699630737, [[32232, 0.255238, " they", false], [4858, 0.121006, " we", false], [22590, 0.081521, " the", false], [52028, 0.072517, " instead", false], [4601, 0.057043, " it", false], [32464, 0.048157, " what", false], [21265, 0.034372, " and", false], [47001, 0.029379, " rather", false], [39934, 0.022412, " there", false], [21256, 0.019508, " all", false]]], "qwen": [4518, 4, 0.05730580538511276, [[807, 0.1876, " they", false], [432, 0.067963, " it", false], [582, 0.060777, " we", false], [4518, 0.057306, " instead", false], [323, 0.056879, " and", false], [279, 0.05503, " the", false], [4751, 0.035705, " rather", false], [1052, 0.030189, " there", false], [862, 0.030058, " their", false], [304, 0.020754, " in", false]]]}, "raw_delta": -0.027341067790985107, "tuned_delta": -0.018769275760406857}, {"byte_start": 6438, "byte_end": 6441, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 1080, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"rwkv": "9.25% 9.25% 9.25%", "qwen": "14.87% 14.87% 14.87%"}, "model_tokens": {"rwkv": [[4858, " we", "normal", 0.21421262621879578]], "qwen": [[582, " we", "normal", 0.0842391699552536]]}, "loss": {"rwkv": 9.251657651534043, "qwen": 14.872354517747151}, "topk": {"rwkv": [4858, 2, 0.21421262621879578, [[45, 0.604138, ",", false], [4858, 0.214213, " we", false], [32232, 0.065456, " they", false], [22590, 0.028203, " the", false], [32464, 0.019365, " what", false], [4706, 0.01548, " of", false], [4601, 0.00581, " it", false], [22226, 0.005753, " one", false], [21256, 0.003854, " all", false], [22248, 0.003193, " our", false]]], "qwen": [582, 3, 0.0842391699552536, [[11, 0.677031, ",", false], [807, 0.117721, " they", false], [582, 0.084239, " we", false], [279, 0.028229, " the", false], [1128, 0.014383, " what", false], [432, 0.01135, " it", false], [315, 0.010613, " of", false], [825, 0.005054, " one", false], [862, 0.004203, " their", false], [1052, 0.003506, " there", false]]]}, "raw_delta": -0.311677614847819, "tuned_delta": -0.30310582281724074}, {"byte_start": 6441, "byte_end": 6448, "display": {"text": " should", "kind": "normal"}, "is_word": true, "word_id": 1081, "word_key": " should", "bytes_hex": "20 73 68 6f 75 6c 64", "compression": {"rwkv": "0.25% 0.25% 0.25% 0.25% 0.25% 0.25% 0.25%", "qwen": "0.41% 0.41% 0.41% 0.41% 0.41% 0.41% 0.41%"}, "model_tokens": {"rwkv": [[47266, " should", "normal", 0.906289279460907]], "qwen": [[1265, " should", "normal", 0.8530765771865845]]}, "loss": {"rwkv": 0.2541019097547874, "qwen": 0.4093801314287926}, "topk": {"rwkv": [47266, 1, 0.906289279460907, [[47266, 0.906289, " should", false], [31475, 0.028844, " must", false], [31506, 0.016706, " need", false], [31059, 0.011331, " have", false], [21286, 0.006538, " are", false], [21413, 0.004479, " can", false], [39196, 0.004147, " ought", false], [37923, 0.002255, " build", false], [38530, 0.001249, " focus", false], [32435, 0.001146, " want", false]]], "qwen": [1265, 1, 0.8530765771865845, [[1265, 0.853077, " should", false], [1184, 0.034088, " need", false], [646, 0.024345, " can", false], [1969, 0.016667, " must", false], [614, 0.015318, " have", false], [1936, 0.009191, " build", false], [21776, 0.008415, " ought", false], [525, 0.006014, " are", false], [5931, 0.002937, " seek", false], [1366, 0.002463, " want", false]]]}, "raw_delta": -0.008610452924455914, "tuned_delta": -3.866089387766572e-05}, {"byte_start": 6448, "byte_end": 6454, "display": {"text": " build", "kind": "normal"}, "is_word": true, "word_id": 1082, "word_key": " build", "bytes_hex": "20 62 75 69 6c 64", "compression": {"rwkv": "5.24% 5.24% 5.24% 5.24% 5.24% 5.24%", "qwen": "4.60% 4.60% 4.60% 4.60% 4.60% 4.60%"}, "model_tokens": {"rwkv": [[37923, " build", "normal", 0.1764019876718521]], "qwen": [[1936, " build", "normal", 0.21648700535297394]]}, "loss": {"rwkv": 5.236344305309876, "qwen": 4.59926610534126}, "topk": {"rwkv": [37923, 1, 0.1764019876718521, [[37923, 0.176402, " build", false], [38530, 0.130243, " focus", false], [4435, 0.106596, " be", false], [22626, 0.042721, " try", false], [38877, 0.039922, " learn", false], [31966, 0.029626, " seek", false], [63373, 0.025807, " concentrate", false], [22681, 0.019599, " use", false], [32122, 0.01863, " stop", false], [32499, 0.017251, " work", false]]], "qwen": [1936, 1, 0.21648700535297394, [[1936, 0.216487, " build", false], [5244, 0.116851, " focus", false], [1430, 0.068962, " try", false], [5931, 0.06029, " seek", false], [387, 0.056968, " be", false], [1401, 0.031789, " look", false], [1744, 0.031542, " think", false], [36355, 0.024805, " concentrate", false], [990, 0.017762, " use", false], [1477, 0.016482, " find", false]]]}, "raw_delta": 0.03532711664835608, "tuned_delta": 0.04389890867893433}, {"byte_start": 6454, "byte_end": 6457, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 1083, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "8.59% 8.59% 8.59%", "qwen": "4.42% 4.42% 4.42%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.23957906663417816]], "qwen": [[304, " in", "normal", 0.479447603225708]]}, "loss": {"rwkv": 8.594179442795582, "qwen": 4.418978842224913}, "topk": {"rwkv": [4596, 1, 0.23957906663417816, [[4596, 0.239579, " in", false], [52224, 0.107285, " methods", false], [53087, 0.0647, " systems", false], [22590, 0.039648, " the", false], [45124, 0.035094, " agents", false], [56567, 0.026681, " machines", false], [22248, 0.026088, " our", false], [332, 0.02571, " a", false], [51258, 0.018846, " complex", false], [51832, 0.017426, " general", false]]], "qwen": [304, 1, 0.479447603225708, [[304, 0.479448, " in", false], [5413, 0.091186, " methods", false], [279, 0.037211, " the", false], [4586, 0.029043, " general", false], [34447, 0.024152, " computation", false], [389, 0.019459, " on", false], [1039, 0.019375, " our", false], [5942, 0.016499, " systems", false], [2513, 0.014034, " things", false], [25185, 0.011642, " algorithms", false]]]}, "raw_delta": 0.23152228196461996, "tuned_delta": 0.24009407399519822}, {"byte_start": 6457, "byte_end": 6462, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 1084, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"rwkv": "14.77% 14.77% 14.77% 14.77% 14.77%", "qwen": "12.35% 12.35% 12.35% 12.35% 12.35%"}, "model_tokens": {"rwkv": [[31581, " only", "normal", 0.016717543825507164]], "qwen": [[1172, " only", "normal", 0.03259682282805443]]}, "loss": {"rwkv": 14.765082059097983, "qwen": 12.347811726686185}, "topk": {"rwkv": [31581, 13, 0.016717543825507164, [[22590, 0.186146, " the", false], [52224, 0.08146, " methods", false], [63370, 0.050588, " computation", false], [332, 0.040078, " a", false], [51832, 0.035239, " general", false], [32464, 0.034387, " what", false], [64862, 0.024996, " computational", false], [61720, 0.021238, " complexity", false], [32448, 0.020215, " ways", false], [63293, 0.019996, " arbitrarily", false]]], "qwen": [1172, 8, 0.03259682282805443, [[279, 0.193697, " the", false], [5413, 0.111508, " methods", false], [4586, 0.074875, " general", false], [34447, 0.058896, " computation", false], [1246, 0.040794, " how", false], [1128, 0.035663, " what", false], [5510, 0.033375, " ways", false], [1172, 0.032597, " only", false], [264, 0.025612, " a", false], [4285, 0.015885, " simple", false]]]}, "raw_delta": 0.13404192924499514, "tuned_delta": 0.1426137212755734}, {"byte_start": 6462, "byte_end": 6466, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1085, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "4.28% 4.28% 4.28% 4.28%", "qwen": "4.33% 4.33% 4.33% 4.33%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.39054688811302185]], "qwen": [[279, " the", "normal", 0.3827328383922577]]}, "loss": {"rwkv": 4.27947869794944, "qwen": 4.32997011701384}, "topk": {"rwkv": [22590, 1, 0.39054688811302185, [[22590, 0.390547, " the", false], [32464, 0.233915, " what", false], [332, 0.038416, " a", false], [47284, 0.035673, " simple", false], [39944, 0.034469, " those", false], [32227, 0.025262, " that", false], [4423, 0.020501, " as", false], [39931, 0.012705, " their", false], [21835, 0.010207, " how", false], [32386, 0.008919, " very", false]]], "qwen": [279, 1, 0.3827328383922577, [[279, 0.382733, " the", false], [1128, 0.12453, " what", false], [4586, 0.05139, " general", false], [1846, 0.03903, " those", false], [264, 0.038345, " a", false], [5413, 0.026603, " methods", false], [34447, 0.024977, " computation", false], [4285, 0.024853, " simple", false], [1602, 0.019209, " very", false], [2513, 0.015342, " things", false]]]}, "raw_delta": -0.0027998387813568115, "tuned_delta": 0.005771953249221437}, {"byte_start": 6466, "byte_end": 6471, "display": {"text": " meta", "kind": "normal"}, "is_word": true, "word_id": 1086, "word_key": " meta", "bytes_hex": "20 6d 65 74 61", "compression": {"rwkv": "36.07% 36.07% 36.07% 36.07% 36.07%", "qwen": "31.24% 31.24% 31.24% 31.24% 31.24%"}, "model_tokens": {"rwkv": [[31416, " meta", "normal", 4.4256728870095685e-05]], "qwen": [[8823, " meta", "normal", 0.00017295297584496439]]}, "loss": {"rwkv": 36.06737602222408, "qwen": 31.243331458582645}, "topk": {"rwkv": [31416, 991, 4.4256728870095685e-05, [[47284, 0.065649, " simple", false], [57234, 0.046452, " simplest", false], [47539, 0.043642, " things", false], [52236, 0.040481, " minimal", false], [32386, 0.032835, " very", false], [61720, 0.030334, " complexity", false], [64862, 0.028558, " computational", false], [59644, 0.026121, " essential", false], [39239, 0.025282, " parts", false], [60050, 0.021958, " necessary", false]]], "qwen": [8823, 457, 0.00017295297584496439, [[4586, 0.075737, " general", false], [1429, 0.057345, " most", false], [4285, 0.04441, " simple", false], [44548, 0.040875, " simplest", false], [5413, 0.030342, " methods", false], [1602, 0.022685, " very", false], [54480, 0.020146, " computational", false], [6770, 0.018722, " basic", false], [12829, 0.018643, " kinds", false], [5871, 0.017594, " necessary", false]]]}, "raw_delta": 0.2675018310546875, "tuned_delta": 0.27607362308526573}, {"byte_start": 6471, "byte_end": 6479, "display": {"text": "-methods", "kind": "normal"}, "is_word": true, "word_id": 1087, "word_key": "-methods", "bytes_hex": "2d 6d 65 74 68 6f 64 73", "compression": {"rwkv": "4.14% 14.33% 14.33% 14.33% 14.33% 14.33% 14.33% 14.33%", "qwen": "12.34% 12.34% 12.34% 12.34% 12.34% 12.34% 12.34% 1.24%"}, "model_tokens": {"rwkv": [[46, "-", "normal", 0.7969080805778503], [49411, "methods", "normal", 0.003857108997181058]], "qwen": [[50297, "-method", "normal", 0.008322557434439659], [82, "s", "normal", 0.9337674379348755]]}, "loss": {"rwkv": 13.056372509021667, "qwen": 10.949410231711036}, "topk": {"rwkv": [46, 1, 0.7969080805778503, [[46, 0.796908, "-", false], [58313, 0.018115, "knowledge", false], [1798, 0.017464, "co", false], [63039, 0.01384, "computation", false], [38887, 0.010467, " level", false], [59943, 0.009418, " knowledge", false], [65275, 0.006507, " representations", false], [58449, 0.006226, "structure", false], [45, 0.005619, ",", false], [65062, 0.005469, "representation", false]]], "qwen": [50297, 18, 0.008322557434439659, [[11591, 0.193179, "-level", false], [12, 0.164031, "-", false], [12646, 0.135322, "-k", false], [46094, 0.033313, "structures", false], [80739, 0.026792, "-information", false], [7837, 0.024583, "structure", false], [1448, 0.024123, "-m", false], [6540, 0.019148, " knowledge", false], [14389, 0.014137, " structures", false], [5504, 0.011423, "-re", false]]]}, "raw_delta": 0.11683479696512215, "tuned_delta": 0.1254065889957004}, {"byte_start": 6479, "byte_end": 6484, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 1088, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "2.59% 2.59% 2.59% 2.59% 2.59%", "qwen": "3.78% 3.78% 3.78% 3.78% 3.78%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.4841887652873993]], "qwen": [[429, " that", "normal", 0.3503324091434479]]}, "loss": {"rwkv": 2.5923426515973556, "qwen": 3.7830090704411083}, "topk": {"rwkv": [32227, 1, 0.4841887652873993, [[32227, 0.484189, " that", false], [45, 0.140237, ",", false], [21700, 0.078195, " for", false], [4706, 0.052582, " of", false], [4811, 0.045515, " to", false], [46650, 0.034676, " needed", false], [21265, 0.030126, " and", false], [5346, 0.023119, "---", false], [4858, 0.018807, " we", false], [47, 0.011374, ".", false]]], "qwen": [429, 1, 0.3503324091434479, [[429, 0.350332, " that", false], [11, 0.172676, ",", false], [315, 0.140634, " of", false], [369, 0.101778, " for", false], [323, 0.035062, " and", false], [4421, 0.030228, "---", false], [311, 0.02602, " to", false], [320, 0.01569, " (", false], [13, 0.015441, ".", false], [25, 0.014572, ":", false]]]}, "raw_delta": -0.06602456569671633, "tuned_delta": -0.05745277366613808}, {"byte_start": 6484, "byte_end": 6488, "display": {"text": " can", "kind": "normal"}, "is_word": true, "word_id": 1089, "word_key": " can", "bytes_hex": "20 63 61 6e", "compression": {"rwkv": "10.85% 10.85% 10.85% 10.85%", "qwen": "8.84% 8.84% 8.84% 8.84%"}, "model_tokens": {"rwkv": [[21413, " can", "normal", 0.09099408984184265]], "qwen": [[646, " can", "normal", 0.14080820977687836]]}, "loss": {"rwkv": 10.848390444184586, "qwen": 8.83811426032155}, "topk": {"rwkv": [21413, 3, 0.09099408984184265, [[21286, 0.136156, " are", false], [45851, 0.123109, " enable", false], [21413, 0.090994, " can", false], [37675, 0.072854, " allow", false], [39590, 0.067388, " scale", false], [31358, 0.042277, " make", false], [4858, 0.038587, " we", false], [56540, 0.027955, " leverage", false], [32475, 0.023036, " will", false], [22001, 0.016404, " let", false]]], "qwen": [646, 1, 0.14080820977687836, [[646, 0.140808, " can", false], [525, 0.112271, " are", false], [7283, 0.094056, " enable", false], [2138, 0.087731, " allow", false], [5452, 0.065495, " scale", false], [1281, 0.041473, " make", false], [686, 0.038862, " will", false], [582, 0.032966, " we", false], [32064, 0.025115, " leverage", false], [1077, 0.013032, " let", false]]]}, "raw_delta": 0.11147338151931763, "tuned_delta": 0.12004517354989587}, {"byte_start": 6488, "byte_end": 6493, "display": {"text": " find", "kind": "normal"}, "is_word": true, "word_id": 1090, "word_key": " find", "bytes_hex": "20 66 69 6e 64", "compression": {"rwkv": "17.47% 17.47% 17.47% 17.47% 17.47%", "qwen": "18.87% 18.87% 18.87% 18.87% 18.87%"}, "model_tokens": {"rwkv": [[30858, " find", "normal", 0.007948637008666992]], "qwen": [[1477, " find", "normal", 0.0053453813306987286]]}, "loss": {"rwkv": 17.47013526076479, "qwen": 18.868729134458306}, "topk": {"rwkv": [30858, 21, 0.007948637008666992, [[39590, 0.169593, " scale", false], [4435, 0.10789, " be", false], [56540, 0.056821, " leverage", false], [32187, 0.045987, " take", false], [38877, 0.039794, " learn", false], [46158, 0.038689, " handle", false], [30587, 0.033412, " deal", false], [31358, 0.031685, " make", false], [22681, 0.029003, " use", false], [30498, 0.014938, " cope", false]]], "qwen": [1477, 23, 0.0053453813306987286, [[387, 0.225458, " be", false], [5452, 0.197008, " scale", false], [32064, 0.081598, " leverage", false], [1896, 0.052988, " take", false], [3705, 0.027218, " handle", false], [32194, 0.023882, " exploit", false], [1281, 0.020005, " make", false], [1492, 0.016496, " help", false], [3060, 0.0129, " continue", false], [13444, 0.012311, " effectively", false]]]}, "raw_delta": -0.07755451202392583, "tuned_delta": -0.06898271999334758}, {"byte_start": 6493, "byte_end": 6497, "display": {"text": " and", "kind": "normal"}, "is_word": true, "word_id": 1091, "word_key": " and", "bytes_hex": "20 61 6e 64", "compression": {"rwkv": "10.71% 10.71% 10.71% 10.71%", "qwen": "11.80% 11.80% 11.80% 11.80%"}, "model_tokens": {"rwkv": [[21265, " and", "normal", 0.09242917597293854]], "qwen": [[323, " and", "normal", 0.0730060413479805]]}, "loss": {"rwkv": 10.707502256597774, "qwen": 11.799500723793338}, "topk": {"rwkv": [21265, 2, 0.09242917597293854, [[22590, 0.143574, " the", false], [21265, 0.092429, " and", false], [32448, 0.066946, " ways", false], [47284, 0.051276, " simple", false], [332, 0.046749, " a", false], [60521, 0.039924, " solutions", false], [51832, 0.039444, " general", false], [45, 0.02658, ",", false], [39931, 0.021251, " their", false], [30992, 0.020643, " good", false]]], "qwen": [323, 2, 0.0730060413479805, [[279, 0.141221, " the", false], [323, 0.073006, " and", false], [1661, 0.060295, " good", false], [264, 0.054906, " a", false], [5510, 0.054743, " ways", false], [9904, 0.046261, " solutions", false], [1493, 0.041047, " these", false], [4285, 0.038317, " simple", false], [862, 0.029244, " their", false], [1105, 0.02607, " them", false]]]}, "raw_delta": -0.06055325269699097, "tuned_delta": -0.05198146066641272}, {"byte_start": 6497, "byte_end": 6505, "display": {"text": " capture", "kind": "normal"}, "is_word": true, "word_id": 1092, "word_key": " capture", "bytes_hex": "20 63 61 70 74 75 72 65", "compression": {"rwkv": "15.43% 15.43% 15.43% 15.43% 15.43% 15.43% 15.43% 15.43%", "qwen": "16.17% 16.17% 16.17% 16.17% 16.17% 16.17% 16.17% 16.17%"}, "model_tokens": {"rwkv": [[51133, " capture", "normal", 0.0010759427677839994]], "qwen": [[12322, " capture", "normal", 0.0007653105421923101]]}, "loss": {"rwkv": 15.427256540756003, "qwen": 16.17448031287533}, "topk": {"rwkv": [51133, 73, 0.0010759427677839994, [[22681, 0.197043, " use", false], [51690, 0.185724, " exploit", false], [38877, 0.064263, " learn", false], [53251, 0.042735, " utilize", false], [39590, 0.035183, " scale", false], [56540, 0.033831, " leverage", false], [31358, 0.023954, " make", false], [37923, 0.021228, " build", false], [32187, 0.019547, " take", false], [46158, 0.0159, " handle", false]]], "qwen": [12322, 91, 0.0007653105421923101, [[990, 0.19459, " use", false], [32194, 0.186764, " exploit", false], [32064, 0.077788, " leverage", false], [28066, 0.064644, " utilize", false], [3796, 0.036191, " apply", false], [1896, 0.028938, " take", false], [5452, 0.027852, " scale", false], [1281, 0.018812, " make", false], [3960, 0.017616, " learn", false], [10515, 0.012242, " adapt", false]]]}, "raw_delta": -0.0414348840713501, "tuned_delta": -0.03286309204077185}, {"byte_start": 6505, "byte_end": 6510, "display": {"text": " this", "kind": "normal"}, "is_word": true, "word_id": 1093, "word_key": " this", "bytes_hex": "20 74 68 69 73", "compression": {"rwkv": "15.44% 15.44% 15.44% 15.44% 15.44%", "qwen": "14.58% 14.58% 14.58% 14.58% 14.58%"}, "model_tokens": {"rwkv": [[32234, " this", "normal", 0.013306764885783195]], "qwen": [[419, " this", "normal", 0.0175336766988039]]}, "loss": {"rwkv": 15.441345359514685, "qwen": 14.584319693908627}, "topk": {"rwkv": [32234, 14, 0.013306764885783195, [[22590, 0.359031, " the", false], [39936, 0.073763, " these", false], [51832, 0.064023, " general", false], [39931, 0.036997, " their", false], [32139, 0.024921, " such", false], [32229, 0.021877, " them", false], [56832, 0.020125, " patterns", false], [61720, 0.019906, " complexity", false], [21256, 0.019791, " all", false], [39944, 0.017567, " those", false]]], "qwen": [419, 8, 0.0175336766988039, [[279, 0.280644, " the", false], [1493, 0.057801, " these", false], [4586, 0.045954, " general", false], [1128, 0.045642, " what", false], [5390, 0.039438, " useful", false], [12624, 0.029172, " patterns", false], [1846, 0.024341, " those", false], [419, 0.017534, " this", false], [6540, 0.017077, " knowledge", false], [5944, 0.015977, " structure", false]]]}, "raw_delta": 0.04752359390258787, "tuned_delta": 0.05609538593316612}, {"byte_start": 6510, "byte_end": 6520, "display": {"text": " arbitrary", "kind": "normal"}, "is_word": true, "word_id": 1094, "word_key": " arbitrary", "bytes_hex": "20 61 72 62 69 74 72 61 72 79", "compression": {"rwkv": "7.61% 7.61% 7.61% 7.61% 7.61% 7.61% 7.61% 7.61% 7.61% 7.61%", "qwen": "7.74% 7.74% 7.74% 7.74% 7.74% 7.74% 7.74% 7.74% 7.74% 7.74%"}, "model_tokens": {"rwkv": [[59163, " arbitrary", "normal", 0.014749602414667606]], "qwen": [[24168, " arbitrary", "normal", 0.013689912855625153]]}, "loss": {"rwkv": 7.607962129687892, "qwen": 7.738428168632419}, "topk": {"rwkv": [59163, 5, 0.014749602414667606, [[61720, 0.625683, " complexity", false], [51607, 0.073259, " endless", false], [59914, 0.039681, " intrinsic", false], [51258, 0.032856, " complex", false], [59163, 0.01475, " arbitrary", false], [56454, 0.012652, " inherent", false], [51832, 0.008986, " general", false], [62680, 0.008116, " underlying", false], [51970, 0.007768, " immense", false], [56125, 0.00605, " enormous", false]]], "qwen": [24168, 6, 0.013689912855625153, [[23094, 0.542489, " complexity", false], [6351, 0.061806, " complex", false], [1995, 0.052409, " information", false], [4889, 0.019668, " outside", false], [6540, 0.019221, " knowledge", false], [24168, 0.01369, " arbitrary", false], [5944, 0.013563, " structure", false], [2213, 0.012819, " content", false], [1879, 0.010544, " world", false], [3093, 0.009757, " kind", false]]]}, "raw_delta": -0.0072345733642578125, "tuned_delta": 0.0013372186663204357}, {"byte_start": 6520, "byte_end": 6531, "display": {"text": " complexity", "kind": "normal"}, "is_word": true, "word_id": 1095, "word_key": " complexity", "bytes_hex": "20 63 6f 6d 70 6c 65 78 69 74 79", "compression": {"rwkv": "0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50% 0.50%", "qwen": "0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83% 0.83%"}, "model_tokens": {"rwkv": [[61720, " complexity", "normal", 0.7334807515144348]], "qwen": [[23094, " complexity", "normal", 0.6040256023406982]]}, "loss": {"rwkv": 0.4995126650805183, "qwen": 0.8264981978603826}, "topk": {"rwkv": [61720, 1, 0.7334807515144348, [[61720, 0.733481, " complexity", false], [45, 0.195163, ",", false], [21265, 0.010069, " and", false], [59914, 0.006533, " intrinsic", false], [51258, 0.0063, " complex", false], [51308, 0.003801, " content", false], [52391, 0.003504, " outside", false], [60572, 0.00273, " structure", false], [57141, 0.002073, " richness", false], [46, 0.001871, "-", false]]], "qwen": [23094, 1, 0.6040256023406982, [[23094, 0.604026, " complexity", false], [11, 0.203697, ",", false], [1879, 0.040507, " world", false], [4889, 0.020384, " outside", false], [323, 0.017252, " and", false], [6351, 0.016169, " complex", false], [5944, 0.016046, " structure", false], [1995, 0.009967, " information", false], [2213, 0.006884, " content", false], [714, 0.004294, " but", false]]]}, "raw_delta": -0.01813192801042037, "tuned_delta": -0.009560135979842123}, {"byte_start": 6531, "byte_end": 6532, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "15.43%", "qwen": "26.58%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.4203220009803772]], "qwen": [[13, ".", "normal", 0.22900354862213135]]}, "loss": {"rwkv": 15.427256540756003, "qwen": 26.581978183091152}, "topk": {"rwkv": [47, 1, 0.4203220009803772, [[47, 0.420322, ".", false], [45, 0.279181, ",", false], [4596, 0.054462, " in", false], [21265, 0.044779, " and", false], [5346, 0.037457, "---", false], [4423, 0.016962, " as", false], [4706, 0.010517, " of", false], [275, 0.009552, " (", false], [53356, 0.008911, " without", false], [4450, 0.008732, " by", false]]], "qwen": [13, 2, 0.22900354862213135, [[11, 0.242662, ",", false], [13, 0.229004, ".", false], [304, 0.118386, " in", false], [382, 0.102984, ".\n\n", false], [323, 0.03766, " and", false], [4421, 0.033871, "---", false], [438, 0.019708, " as", false], [448, 0.014766, " with", false], [320, 0.011584, " (", false], [389, 0.011583, " on", false]]]}, "raw_delta": -0.618549108505249, "tuned_delta": -0.6099773164746708}, {"byte_start": 6532, "byte_end": 6542, "display": {"text": " Essential", "kind": "normal"}, "is_word": true, "word_id": 1096, "word_key": " essential", "bytes_hex": "20 45 73 73 65 6e 74 69 61 6c", "compression": {"rwkv": "53.54% 53.54% 53.54% 53.54% 0.12% 0.12% 0.12% 0.12% 0.12% 0.12%", "qwen": "20.26% 20.26% 20.26% 20.26% 20.26% 20.26% 20.26% 20.26% 20.26% 20.26%"}, "model_tokens": {"rwkv": [[19840, " Ess", "normal", 6.738956926710671e-06], [41342, "ential", "normal", 0.9601582884788513]], "qwen": [[47733, " Essential", "normal", 1.3228118405095302e-05]]}, "loss": {"rwkv": 21.4880902605062, "qwen": 20.25754063497075}, "topk": {"rwkv": [19840, 1310, 6.738956926710671e-06, [[261, 0.271875, "\n\n", false], [20996, 0.103626, " The", false], [29894, 0.061958, " This", false], [37453, 0.0587, " These", false], [3913, 0.046762, " In", false], [4331, 0.04389, " We", false], [19417, 0.019997, " And", false], [29889, 0.018439, " That", false], [44844, 0.018096, " Search", false], [3918, 0.015744, " It", false]]], "qwen": [47733, 1181, 1.3228118405095302e-05, [[576, 0.129797, " The", false], [1096, 0.08778, " This", false], [1205, 0.079979, " We", false], [4220, 0.061063, " These", false], [758, 0.048117, " In", false], [1752, 0.039487, " For", false], [1597, 0.029719, " And", false], [2938, 0.027698, " That", false], [1084, 0.023024, " It", false], [220, 0.01766, " ", false]]]}, "raw_delta": 0.06823616027832036, "tuned_delta": 0.0768079523088986}, {"byte_start": 6542, "byte_end": 6545, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 1097, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "5.52% 5.52% 5.52%", "qwen": "6.58% 6.58% 6.58%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.39990708231925964]], "qwen": [[311, " to", "normal", 0.33457592129707336]]}, "loss": {"rwkv": 5.518120680483502, "qwen": 6.581643478559646}, "topk": {"rwkv": [4811, 1, 0.39990708231925964, [[4811, 0.399907, " to", false], [37694, 0.15518, " among", false], [39239, 0.050831, " parts", false], [31416, 0.036344, " meta", false], [52224, 0.029773, " methods", false], [56089, 0.027284, " elements", false], [31077, 0.025508, " here", false], [4596, 0.022025, " in", false], [4600, 0.016106, " is", false], [61723, 0.015299, " components", false]]], "qwen": [311, 1, 0.33457592129707336, [[311, 0.334576, " to", false], [8823, 0.173613, " meta", false], [369, 0.105095, " for", false], [374, 0.036002, " is", false], [5413, 0.0318, " methods", false], [304, 0.027267, " in", false], [4221, 0.02533, " among", false], [11, 0.014456, ",", false], [1588, 0.012913, " here", false], [5479, 0.012706, " parts", false]]]}, "raw_delta": -0.05897422631581628, "tuned_delta": -0.05040243428523803}, {"byte_start": 6545, "byte_end": 6551, "display": {"text": " these", "kind": "normal"}, "is_word": true, "word_id": 1098, "word_key": " these", "bytes_hex": "20 74 68 65 73 65", "compression": {"rwkv": "8.08% 8.08% 8.08% 8.08% 8.08% 8.08%", "qwen": "6.54% 6.54% 6.54% 6.54% 6.54% 6.54%"}, "model_tokens": {"rwkv": [[39936, " these", "normal", 0.06746024638414383]], "qwen": [[1493, " these", "normal", 0.1133388951420784]]}, "loss": {"rwkv": 8.077589421643935, "qwen": 6.544344024559395}, "topk": {"rwkv": [39936, 3, 0.06746024638414383, [[32234, 0.572183, " this", false], [22590, 0.095323, " the", false], [39936, 0.06746, " these", false], [32227, 0.044333, " that", false], [55666, 0.027429, " building", false], [32139, 0.023214, " such", false], [38279, 0.017045, " doing", false], [21256, 0.013936, " all", false], [59258, 0.008388, " capturing", false], [22248, 0.008175, " our", false]]], "qwen": [1493, 2, 0.1133388951420784, [[419, 0.486482, " this", false], [1493, 0.113339, " these", false], [279, 0.090156, " the", false], [678, 0.039767, " all", false], [429, 0.034608, " that", false], [4752, 0.018017, " building", false], [1741, 0.016435, " such", false], [3730, 0.015154, " doing", false], [6832, 0.013901, " learning", false], [894, 0.009253, " any", false]]]}, "raw_delta": 0.08502117792765301, "tuned_delta": 0.09359296995823126}, {"byte_start": 6551, "byte_end": 6559, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 1099, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "2.76% 2.76% 2.76% 2.76% 2.76% 2.76% 2.76% 2.76%", "qwen": "4.78% 4.78% 4.78% 4.78% 4.78% 4.78% 4.78% 4.78%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.2920089364051819]], "qwen": [[5413, " methods", "normal", 0.11975329369306564]]}, "loss": {"rwkv": 2.7649306813912014, "qwen": 4.784160712014783}, "topk": {"rwkv": [52224, 2, 0.2920089364051819, [[31416, 0.408875, " meta", false], [52224, 0.292009, " methods", false], [21286, 0.170203, " are", false], [51832, 0.040912, " general", false], [4600, 0.013271, " is", false], [22638, 0.009858, " two", false], [51258, 0.004377, " complex", false], [45, 0.002604, ",", false], [61590, 0.002591, " approaches", false], [38841, 0.0024, " kinds", false]]], "qwen": [5413, 2, 0.11975329369306564, [[8823, 0.671973, " meta", false], [5413, 0.119753, " methods", false], [374, 0.077473, " is", false], [525, 0.054646, " are", false], [4586, 0.01824, " general", false], [19827, 0.003394, " approaches", false], [1378, 0.00277, " two", false], [11, 0.002668, ",", false], [12538, 0.002589, " techniques", false], [1714, 0.001728, " method", false]]]}, "raw_delta": -0.11196988821029663, "tuned_delta": -0.10339809617971839}, {"byte_start": 6559, "byte_end": 6562, "display": {"text": " is", "kind": "normal"}, "is_word": true, "word_id": 1100, "word_key": " is", "bytes_hex": "20 69 73", "compression": {"rwkv": "5.52% 5.52% 5.52%", "qwen": "2.68% 2.68% 2.68%"}, "model_tokens": {"rwkv": [[4600, " is", "normal", 0.399360716342926]], "qwen": [[374, " is", "normal", 0.6401692628860474]]}, "loss": {"rwkv": 5.518120680483502, "qwen": 2.6811448543085183}, "topk": {"rwkv": [4600, 2, 0.399360716342926, [[21286, 0.506034, " are", false], [4600, 0.399361, " is", false], [45, 0.030381, ",", false], [32475, 0.019346, " will", false], [4706, 0.008176, " of", false], [40219, 0.00761, " would", false], [21700, 0.00412, " for", false], [47266, 0.004055, " should", false], [4596, 0.002645, " in", false], [275, 0.00246, " (", false]]], "qwen": [374, 1, 0.6401692628860474, [[374, 0.640169, " is", false], [525, 0.278169, " are", false], [11, 0.031505, ",", false], [686, 0.009927, " will", false], [1265, 0.007983, " should", false], [369, 0.004219, " for", false], [1969, 0.003339, " must", false], [304, 0.003269, " in", false], [315, 0.003194, " of", false], [320, 0.003101, " (", false]]]}, "raw_delta": 0.15731534361839292, "tuned_delta": 0.16588713564897117}, {"byte_start": 6562, "byte_end": 6567, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 1101, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "10.14% 10.14% 10.14% 10.14% 10.14%", "qwen": "12.61% 12.61% 12.61% 12.61% 12.61%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.06073502078652382]], "qwen": [[429, " that", "normal", 0.03027326427400112]]}, "loss": {"rwkv": 10.143949506250523, "qwen": 12.61453016086352}, "topk": {"rwkv": [32227, 3, 0.06073502078652382, [[22590, 0.308303, " the", false], [56537, 0.130619, " learning", false], [32227, 0.060735, " that", false], [332, 0.056023, " a", false], [52195, 0.03967, " massive", false], [63370, 0.020971, " computation", false], [4811, 0.019743, " to", false], [47202, 0.018603, " search", false], [4419, 0.014295, " an", false], [51832, 0.012133, " general", false]]], "qwen": [429, 6, 0.03027326427400112, [[279, 0.385126, " the", false], [26943, 0.090273, " scaling", false], [264, 0.049859, " a", false], [34447, 0.0463, " computation", false], [6832, 0.037336, " learning", false], [429, 0.030273, " that", false], [2711, 0.029554, " search", false], [311, 0.018949, " to", false], [458, 0.013936, " an", false], [5452, 0.011061, " scale", false]]]}, "raw_delta": -0.1369980812072754, "tuned_delta": -0.12842628917669716}, {"byte_start": 6567, "byte_end": 6572, "display": {"text": " they", "kind": "normal"}, "is_word": true, "word_id": 1102, "word_key": " they", "bytes_hex": "20 74 68 65 79", "compression": {"rwkv": "0.92% 0.92% 0.92% 0.92% 0.92%", "qwen": "1.10% 1.10% 1.10% 1.10% 1.10%"}, "model_tokens": {"rwkv": [[32232, " they", "normal", 0.7772095799446106]], "qwen": [[807, " they", "normal", 0.7365784645080566]]}, "loss": {"rwkv": 0.9157732193142833, "qwen": 1.1027221229226438}, "topk": {"rwkv": [32232, 1, 0.7772095799446106, [[32232, 0.77721, " they", false], [4858, 0.062873, " we", false], [22590, 0.038953, " the", false], [39931, 0.016339, " their", false], [45, 0.014259, ",", false], [39934, 0.013089, " there", false], [4706, 0.00529, " of", false], [63370, 0.003693, " computation", false], [21256, 0.003647, " all", false], [22226, 0.002853, " one", false]]], "qwen": [807, 1, 0.7365784645080566, [[807, 0.736578, " they", false], [582, 0.065723, " we", false], [279, 0.056088, " the", false], [11, 0.016532, ",", false], [34447, 0.012233, " computation", false], [1052, 0.010324, " there", false], [862, 0.010036, " their", false], [315, 0.005888, " of", false], [432, 0.004903, " it", false], [264, 0.004412, " a", false]]]}, "raw_delta": -0.010366648435592651, "tuned_delta": -0.0017948564050144031}, {"byte_start": 6572, "byte_end": 6576, "display": {"text": " can", "kind": "normal"}, "is_word": true, "word_id": 1103, "word_key": " can", "bytes_hex": "20 63 61 6e", "compression": {"rwkv": "10.92% 10.92% 10.92% 10.92%", "qwen": "11.62% 11.62% 11.62% 11.62%"}, "model_tokens": {"rwkv": [[21413, " can", "normal", 0.08924920856952667]], "qwen": [[646, " can", "normal", 0.07595773786306381]]}, "loss": {"rwkv": 10.918834537977993, "qwen": 11.62081074954688}, "topk": {"rwkv": [21413, 4, 0.08924920856952667, [[39590, 0.152068, " scale", false], [21286, 0.13008, " are", false], [4435, 0.102596, " be", false], [21413, 0.089249, " can", false], [47266, 0.029672, " should", false], [22681, 0.026512, " use", false], [31059, 0.026283, " have", false], [4491, 0.025239, " do", false], [31475, 0.022251, " must", false], [38877, 0.018636, " learn", false]]], "qwen": [646, 4, 0.07595773786306381, [[387, 0.126536, " be", false], [525, 0.094305, " are", false], [5452, 0.082216, " scale", false], [646, 0.075958, " can", false], [1265, 0.054224, " should", false], [1969, 0.0487, " must", false], [32064, 0.036971, " leverage", false], [614, 0.023595, " have", false], [1896, 0.021734, " take", false], [990, 0.019605, " use", false]]]}, "raw_delta": -0.03892582654953003, "tuned_delta": -0.03035403451895178}, {"byte_start": 6576, "byte_end": 6581, "display": {"text": " find", "kind": "normal"}, "is_word": true, "word_id": 1104, "word_key": " find", "bytes_hex": "20 66 69 6e 64", "compression": {"rwkv": "11.95% 11.95% 11.95% 11.95% 11.95%", "qwen": "10.19% 10.19% 10.19% 10.19% 10.19%"}, "model_tokens": {"rwkv": [[30858, " find", "normal", 0.03652869537472725]], "qwen": [[1477, " find", "normal", 0.059287264943122864]]}, "loss": {"rwkv": 11.947318307361726, "qwen": 10.190334947014732}, "topk": {"rwkv": [30858, 5, 0.03652869537472725, [[39590, 0.266831, " scale", false], [4435, 0.13724, " be", false], [38877, 0.076261, " learn", false], [56540, 0.03888, " leverage", false], [30858, 0.036529, " find", false], [22681, 0.022034, " use", false], [32187, 0.021203, " take", false], [51133, 0.020645, " capture", false], [31358, 0.015494, " make", false], [46158, 0.01403, " handle", false]]], "qwen": [1477, 4, 0.059287264943122864, [[5452, 0.217553, " scale", false], [387, 0.111124, " be", false], [32064, 0.070474, " leverage", false], [1477, 0.059287, " find", false], [1896, 0.033056, " take", false], [3960, 0.031697, " learn", false], [32194, 0.022243, " exploit", false], [12322, 0.019151, " capture", false], [3705, 0.016545, " handle", false], [990, 0.016301, " use", false]]]}, "raw_delta": 0.0974278450012207, "tuned_delta": 0.10599963703179895}, {"byte_start": 6581, "byte_end": 6586, "display": {"text": " good", "kind": "normal"}, "is_word": true, "word_id": 1105, "word_key": " good", "bytes_hex": "20 67 6f 6f 64", "compression": {"rwkv": "21.87% 21.87% 21.87% 21.87% 21.87%", "qwen": "20.73% 20.73% 20.73% 20.73% 20.73%"}, "model_tokens": {"rwkv": [[30992, " good", "normal", 0.002304589608684182]], "qwen": [[1661, " good", "normal", 0.003192703705281019]]}, "loss": {"rwkv": 21.86584671347335, "qwen": 20.727514185330524}, "topk": {"rwkv": [30992, 41, 0.002304589608684182, [[21265, 0.329588, " and", false], [59163, 0.074517, " arbitrary", false], [22590, 0.0678, " the", false], [63293, 0.052614, " arbitrarily", false], [45, 0.03914, ",", false], [32448, 0.020771, " ways", false], [332, 0.019164, " a", false], [60572, 0.014226, " structure", false], [22168, 0.012742, " new", false], [56832, 0.012013, " patterns", false]]], "qwen": [1661, 35, 0.003192703705281019, [[323, 0.373493, " and", false], [279, 0.122858, " the", false], [11, 0.049253, ",", false], [264, 0.021193, " a", false], [419, 0.019855, " this", false], [1128, 0.018387, " what", false], [12624, 0.01774, " patterns", false], [24168, 0.017142, " arbitrary", false], [23094, 0.014599, " complexity", false], [862, 0.014111, " their", false]]]}, "raw_delta": 0.06312255859374982, "tuned_delta": 0.07169435062432807}, {"byte_start": 6586, "byte_end": 6601, "display": {"text": " approximations", "kind": "normal"}, "is_word": true, "word_id": 1106, "word_key": " approximations", "bytes_hex": "20 61 70 70 72 6f 78 69 6d 61 74 69 6f 6e 73", "compression": {"rwkv": "2.70% 2.70% 2.70% 2.70% 2.70% 2.70% 2.70% 2.70% 2.70% 2.70% 2.70% 2.70% 2.70% 2.70% 0.16%", "qwen": "6.57% 6.57% 6.57% 6.57% 6.57% 6.57% 6.57% 0.01% 0.01% 0.01% 0.01% 0.01% 0.01% 0.01% 0.01%"}, "model_tokens": {"rwkv": [[64831, " approximation", "normal", 0.12326377630233765], [116, "s", "normal", 0.9911762475967407]], "qwen": [[9848, " approx", "normal", 0.07817225903272629], [96376, "imations", "normal", 0.9960803389549255]]}, "loss": {"rwkv": 2.527915657482136, "qwen": 3.06905465744766}, "topk": {"rwkv": [64831, 1, 0.12326377630233765, [[64831, 0.123264, " approximation", false], [32448, 0.108896, " ways", false], [65275, 0.081583, " representations", false], [60521, 0.070758, " solutions", false], [45, 0.067439, ",", false], [63245, 0.06578, " abstraction", false], [65135, 0.033084, " generalization", false], [45865, 0.014931, " enough", false], [63292, 0.014699, " approximate", false], [51832, 0.013353, " general", false]]], "qwen": [9848, 2, 0.07817225903272629, [[43613, 0.137482, " representations", false], [9848, 0.078172, " approx", false], [9904, 0.074397, " solutions", false], [5510, 0.067546, " ways", false], [11, 0.048612, ",", false], [44868, 0.030861, " approximate", false], [4586, 0.027049, " general", false], [2750, 0.026102, " values", false], [3322, 0.019664, " enough", false], [4119, 0.017806, " models", false]]]}, "raw_delta": -0.03000711776937049, "tuned_delta": -0.02143532573879224}, {"byte_start": 6601, "byte_end": 6602, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "41.42%", "qwen": "43.14%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.10104823857545853]], "qwen": [[11, ",", "normal", 0.09145106375217438]]}, "loss": {"rwkv": 41.42112715052297, "qwen": 43.13570388873347}, "topk": {"rwkv": [45, 2, 0.10104823857545853, [[4811, 0.558979, " to", false], [45, 0.101048, ",", false], [4706, 0.070776, " of", false], [4596, 0.035331, " in", false], [32227, 0.032384, " that", false], [21265, 0.02019, " and", false], [21700, 0.019779, " for", false], [47, 0.018619, ".", false], [5346, 0.011841, "---", false], [52628, 0.011646, " quickly", false]]], "qwen": [11, 3, 0.09145106375217438, [[311, 0.526465, " to", false], [315, 0.162268, " of", false], [11, 0.091451, ",", false], [369, 0.029232, " for", false], [304, 0.021169, " in", false], [13, 0.020419, ".", false], [429, 0.019746, " that", false], [323, 0.018833, " and", false], [4421, 0.011141, "---", false], [448, 0.008905, " with", false]]]}, "raw_delta": -0.09507632255554199, "tuned_delta": -0.08650453052496375}, {"byte_start": 6602, "byte_end": 6606, "display": {"text": " but", "kind": "normal"}, "is_word": true, "word_id": 1107, "word_key": " but", "bytes_hex": "20 62 75 74", "compression": {"rwkv": "19.87% 19.87% 19.87% 19.87%", "qwen": "18.68% 18.68% 18.68% 18.68%"}, "model_tokens": {"rwkv": [[21400, " but", "normal", 0.012224591337144375]], "qwen": [[714, " but", "normal", 0.01588658057153225]]}, "loss": {"rwkv": 19.86523444974061, "qwen": 18.675148902300144}, "topk": {"rwkv": [21400, 15, 0.012224591337144375, [[21265, 0.19839, " and", false], [4715, 0.069173, " or", false], [4596, 0.059257, " in", false], [30788, 0.057941, " even", false], [22187, 0.051335, " not", false], [32227, 0.044996, " that", false], [4788, 0.028376, " so", false], [32487, 0.025229, " with", false], [47001, 0.021421, " rather", false], [4423, 0.018659, " as", false]]], "qwen": [714, 10, 0.01588658057153225, [[323, 0.225587, " and", false], [1496, 0.073592, " even", false], [476, 0.052948, " or", false], [892, 0.049974, " which", false], [304, 0.047493, " in", false], [537, 0.041677, " not", false], [448, 0.031349, " with", false], [438, 0.027299, " as", false], [429, 0.023634, " that", false], [714, 0.015887, " but", false]]]}, "raw_delta": 0.06599235534667969, "tuned_delta": 0.07456414737725793}, {"byte_start": 6606, "byte_end": 6610, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1108, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "16.98% 16.98% 16.98% 16.98%", "qwen": "14.26% 14.26% 14.26% 14.26%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.02291511557996273]], "qwen": [[279, " the", "normal", 0.042297009378671646]]}, "loss": {"rwkv": 16.977026604210945, "qwen": 14.260313408772268}, "topk": {"rwkv": [22590, 10, 0.02291511557996273, [[22187, 0.216743, " not", false], [32232, 0.156106, " they", false], [32227, 0.085494, " that", false], [4692, 0.044768, " no", false], [39115, 0.041982, " never", false], [45409, 0.033733, " cannot", false], [30135, 0.033562, " also", false], [21413, 0.030949, " can", false], [4491, 0.02292, " do", false], [22590, 0.022915, " the", false]]], "qwen": [279, 5, 0.042297009378671646, [[537, 0.165363, " not", false], [807, 0.163116, " they", false], [429, 0.05804, " that", false], [2581, 0.044574, " never", false], [279, 0.042297, " the", false], [653, 0.026959, " do", false], [419, 0.025683, " this", false], [1172, 0.023613, " only", false], [646, 0.023518, " can", false], [304, 0.021847, " in", false]]]}, "raw_delta": 0.15064656734466553, "tuned_delta": 0.15921835937524378}, {"byte_start": 6610, "byte_end": 6617, "display": {"text": " search", "kind": "normal"}, "is_word": true, "word_id": 1109, "word_key": " search", "bytes_hex": "20 73 65 61 72 63 68", "compression": {"rwkv": "12.00% 12.00% 12.00% 12.00% 12.00% 12.00% 12.00%", "qwen": "10.83% 10.83% 10.83% 10.83% 10.83% 10.83% 10.83%"}, "model_tokens": {"rwkv": [[47202, " search", "normal", 0.009381993673741817]], "qwen": [[2711, " search", "normal", 0.014953196048736572]]}, "loss": {"rwkv": 11.99562282882006, "qwen": 10.827504379684806}, "topk": {"rwkv": [47202, 10, 0.009381993673741817, [[64831, 0.394329, " approximation", false], [30992, 0.052952, " good", false], [52224, 0.051282, " methods", false], [30273, 0.027662, " best", false], [31458, 0.017874, " more", false], [21952, 0.016672, " key", false], [52621, 0.011775, " quality", false], [61720, 0.011335, " complexity", false], [31581, 0.011079, " only", false], [47202, 0.009382, " search", false]]], "qwen": [2711, 11, 0.014953196048736572, [[9848, 0.096294, " approx", false], [23094, 0.055132, " complexity", false], [3565, 0.054822, " details", false], [5042, 0.035948, " actual", false], [56204, 0.035316, " approximation", false], [5413, 0.02631, " methods", false], [1850, 0.022449, " best", false], [4271, 0.016598, " quality", false], [44868, 0.015384, " approximate", false], [4734, 0.014968, " exact", false]]]}, "raw_delta": 0.06477424076625271, "tuned_delta": 0.07334603279683095}, {"byte_start": 6617, "byte_end": 6621, "display": {"text": " for", "kind": "normal"}, "is_word": true, "word_id": 1110, "word_key": " for", "bytes_hex": "20 66 6f 72", "compression": {"rwkv": "7.54% 7.54% 7.54% 7.54%", "qwen": "7.36% 7.36% 7.36% 7.36%"}, "model_tokens": {"rwkv": [[21700, " for", "normal", 0.18933232128620148]], "qwen": [[369, " for", "normal", 0.19535474479198456]]}, "loss": {"rwkv": 7.537518035894486, "qwen": 7.361974269267249}, "topk": {"rwkv": [21700, 1, 0.18933232128620148, [[21700, 0.189332, " for", false], [21265, 0.129636, " and", false], [39750, 0.097165, " space", false], [4600, 0.083052, " is", false], [31475, 0.05847, " must", false], [4715, 0.041544, " or", false], [52224, 0.033567, " methods", false], [47266, 0.02919, " should", false], [46, 0.02581, "-", false], [21413, 0.023306, " can", false]]], "qwen": [369, 2, 0.19535474479198456, [[323, 0.248778, " and", false], [369, 0.195355, " for", false], [3550, 0.060089, " space", false], [374, 0.051573, " is", false], [476, 0.047005, " or", false], [5413, 0.034343, " methods", false], [646, 0.031523, " can", false], [1969, 0.021933, " must", false], [1184, 0.019861, " need", false], [9777, 0.016862, "-and", false]]]}, "raw_delta": 0.00973421335220337, "tuned_delta": 0.01830600538278162}, {"byte_start": 6621, "byte_end": 6626, "display": {"text": " them", "kind": "normal"}, "is_word": true, "word_id": 1111, "word_key": " them", "bytes_hex": "20 74 68 65 6d", "compression": {"rwkv": "12.62% 12.62% 12.62% 12.62% 12.62%", "qwen": "22.09% 22.09% 22.09% 22.09% 22.09%"}, "model_tokens": {"rwkv": [[32229, " them", "normal", 0.030142957344651222]], "qwen": [[1105, " them", "normal", 0.002185772405937314]]}, "loss": {"rwkv": 12.623581607778428, "qwen": 22.094102087698467}, "topk": {"rwkv": [32229, 8, 0.030142957344651222, [[30992, 0.348829, " good", false], [39936, 0.10654, " these", false], [64831, 0.106388, " approximation", false], [32139, 0.081604, " such", false], [22590, 0.078889, " the", false], [45301, 0.035198, " better", false], [332, 0.034523, " a", false], [32229, 0.030143, " them", false], [39944, 0.026664, " those", false], [4419, 0.014202, " an", false]]], "qwen": [1105, 47, 0.002185772405937314, [[1661, 0.158216, " good", false], [279, 0.120957, " the", false], [264, 0.08415, " a", false], [4734, 0.061812, " exact", false], [1493, 0.041712, " these", false], [458, 0.038725, " an", false], [9848, 0.032758, " approx", false], [1741, 0.028929, " such", false], [4285, 0.027181, " simple", false], [4727, 0.019721, " perfect", false]]]}, "raw_delta": -0.5251571655273437, "tuned_delta": -0.5165853734967655}, {"byte_start": 6626, "byte_end": 6633, "display": {"text": " should", "kind": "normal"}, "is_word": true, "word_id": 1112, "word_key": " should", "bytes_hex": "20 73 68 6f 75 6c 64", "compression": {"rwkv": "5.80% 5.80% 5.80% 5.80% 5.80% 5.80% 5.80%", "qwen": "5.68% 5.68% 5.68% 5.68% 5.68% 5.68% 5.68%"}, "model_tokens": {"rwkv": [[47266, " should", "normal", 0.10533887892961502]], "qwen": [[1265, " should", "normal", 0.11030002683401108]]}, "loss": {"rwkv": 5.7965425750002995, "qwen": 5.679455557845392}, "topk": {"rwkv": [47266, 3, 0.10533887892961502, [[4600, 0.299148, " is", false], [31475, 0.192366, " must", false], [47266, 0.105339, " should", false], [21800, 0.055008, " has", false], [21413, 0.050542, " can", false], [32475, 0.035463, " will", false], [45409, 0.03245, " cannot", false], [39105, 0.022745, " needs", false], [45, 0.021985, ",", false], [22074, 0.020177, " may", false]]], "qwen": [1265, 2, 0.11030002683401108, [[374, 0.354648, " is", false], [1265, 0.1103, " should", false], [1969, 0.082882, " must", false], [646, 0.063995, " can", false], [1558, 0.034168, " does", false], [4157, 0.033618, " cannot", false], [702, 0.031089, " has", false], [686, 0.029944, " will", false], [11, 0.025467, ",", false], [1231, 0.025081, " may", false]]]}, "raw_delta": 0.006492682865687827, "tuned_delta": 0.015064474896266075}, {"byte_start": 6633, "byte_end": 6636, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 1113, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"rwkv": "6.11% 6.11% 6.11%", "qwen": "5.80% 5.80% 5.80%"}, "model_tokens": {"rwkv": [[4435, " be", "normal", 0.3649194836616516]], "qwen": [[387, " be", "normal", 0.38093888759613037]]}, "loss": {"rwkv": 6.105154795428556, "qwen": 5.801535190406596}, "topk": {"rwkv": [4435, 1, 0.3649194836616516, [[4435, 0.364919, " be", false], [22187, 0.33217, " not", false], [39115, 0.05579, " never", false], [45150, 0.028503, " always", false], [55851, 0.022339, " continue", false], [52570, 0.013133, " proceed", false], [32122, 0.01283, " stop", false], [31581, 0.012715, " only", false], [52051, 0.009601, " involve", false], [31059, 0.008831, " have", false]]], "qwen": [387, 2, 0.38093888759613037, [[537, 0.406596, " not", false], [387, 0.380939, " be", false], [2581, 0.03639, " never", false], [2936, 0.018259, " stop", false], [2677, 0.017082, " always", false], [7146, 0.012229, " remain", false], [3060, 0.009484, " continue", false], [10354, 0.009378, " proceed", false], [1172, 0.006784, " only", false], [835, 0.00434, " end", false]]]}, "raw_delta": 0.016836245854695675, "tuned_delta": 0.025408037885273925}, {"byte_start": 6636, "byte_end": 6639, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 1114, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "29.49% 29.49% 29.49%", "qwen": "32.12% 32.12% 32.12%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.007502478547394276]], "qwen": [[553, " by", "normal", 0.004782747942954302]]}, "loss": {"rwkv": 29.492593934839483, "qwen": 32.11643578221786}, "topk": {"rwkv": [4450, 21, 0.007502478547394276, [[37810, 0.06737, " based", false], [46141, 0.062068, " guided", false], [30666, 0.044607, " done", false], [37862, 0.038172, " blind", false], [332, 0.025393, " a", false], [45796, 0.022783, " driven", false], [64862, 0.015573, " computational", false], [31269, 0.014314, " left", false], [4423, 0.013196, " as", false], [4596, 0.012941, " in", false]]], "qwen": [553, 33, 0.004782747942954302, [[2814, 0.098134, " done", false], [2115, 0.091625, " left", false], [3118, 0.038297, " based", false], [32587, 0.033109, " guided", false], [264, 0.02995, " a", false], [27498, 0.019021, " automated", false], [7199, 0.018033, " limited", false], [22978, 0.012739, " abandoned", false], [16227, 0.011882, " driven", false], [13075, 0.010533, " conducted", false]]]}, "raw_delta": -0.14549668629964185, "tuned_delta": -0.1369248942690636}, {"byte_start": 6639, "byte_end": 6643, "display": {"text": " our", "kind": "normal"}, "is_word": true, "word_id": 1115, "word_key": " our", "bytes_hex": "20 6f 75 72", "compression": {"rwkv": "40.01% 40.01% 40.01% 40.01%", "qwen": "34.49% 34.49% 34.49% 34.49%"}, "model_tokens": {"rwkv": [[22248, " our", "normal", 0.0001352092222077772]], "qwen": [[1039, " our", "normal", 0.0004757429996971041]]}, "loss": {"rwkv": 40.01224527465484, "qwen": 34.49228151342959}, "topk": {"rwkv": [22248, 451, 0.0001352092222077772, [[37920, 0.195743, " brute", false], [38989, 0.049722, " means", false], [332, 0.043044, " a", false], [52195, 0.039637, " massive", false], [52224, 0.034644, " methods", false], [56537, 0.030646, " learning", false], [47202, 0.028058, " search", false], [22590, 0.027791, " the", false], [31978, 0.022344, " self", false], [63370, 0.018677, " computation", false]]], "qwen": [1039, 235, 0.0004757429996971041, [[264, 0.064584, " a", false], [26943, 0.05475, " scaling", false], [4586, 0.048367, " general", false], [5413, 0.040268, " methods", false], [279, 0.036895, " the", false], [34447, 0.029067, " computation", false], [458, 0.028545, " an", false], [64098, 0.026486, " brute", false], [2711, 0.018504, " search", false], [8823, 0.01828, " meta", false]]]}, "raw_delta": 0.3060917854309082, "tuned_delta": 0.31466357746148643}, {"byte_start": 6643, "byte_end": 6651, "display": {"text": " methods", "kind": "normal"}, "is_word": true, "word_id": 1116, "word_key": " methods", "bytes_hex": "20 6d 65 74 68 6f 64 73", "compression": {"rwkv": "8.21% 8.21% 8.21% 8.21% 8.21% 8.21% 8.21% 8.21%", "qwen": "7.91% 7.91% 7.91% 7.91% 7.91% 7.91% 7.91% 7.91%"}, "model_tokens": {"rwkv": [[52224, " methods", "normal", 0.02609674073755741]], "qwen": [[5413, " methods", "normal", 0.029909150674939156]]}, "loss": {"rwkv": 8.206736926931846, "qwen": 7.9113583364123246}, "topk": {"rwkv": [52224, 6, 0.02609674073755741, [[22251, 0.204277, " own", false], [30273, 0.091332, " best", false], [39026, 0.059926, " minds", false], [31461, 0.036086, " most", false], [45124, 0.027058, " agents", false], [52224, 0.026097, " methods", false], [56567, 0.017254, " machines", false], [51832, 0.012683, " general", false], [37636, 0.009412, " agent", false], [59345, 0.008894, " computers", false]]], "qwen": [5413, 6, 0.029909150674939156, [[1828, 0.28534, " own", false], [54480, 0.03619, " computational", false], [3738, 0.03306, " human", false], [4586, 0.032884, " general", false], [20062, 0.03041, " minds", false], [5413, 0.029909, " methods", false], [8823, 0.01548, " meta", false], [1850, 0.013422, " best", false], [13009, 0.012272, " agents", false], [34447, 0.011803, " computation", false]]]}, "raw_delta": 0.01637926697731018, "tuned_delta": 0.02495105900788843}, {"byte_start": 6651, "byte_end": 6652, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "16.41%", "qwen": "10.56%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.405602365732193]], "qwen": [[11, ",", "normal", 0.5567399263381958]]}, "loss": {"rwkv": 16.413473853863692, "qwen": 10.561556704184026}, "topk": {"rwkv": [45, 1, 0.405602365732193, [[45, 0.405602, ",", false], [4706, 0.148247, " of", false], [21265, 0.041474, " and", false], [47, 0.041302, ".", false], [40, 0.040812, "'", false], [32227, 0.031499, " that", false], [22187, 0.028501, " not", false], [5346, 0.026753, "---", false], [47001, 0.02564, " rather", false], [21700, 0.024731, " for", false]]], "qwen": [11, 1, 0.5567399263381958, [[11, 0.55674, ",", false], [323, 0.076192, " and", false], [315, 0.048468, " of", false], [4751, 0.040143, " rather", false], [13, 0.03996, ".", false], [4421, 0.037418, "---", false], [429, 0.032771, " that", false], [369, 0.02546, " for", false], [320, 0.018558, " (", false], [382, 0.016291, ".\n\n", false]]]}, "raw_delta": 0.3244991898536682, "tuned_delta": 0.33307098188424644}, {"byte_start": 6652, "byte_end": 6656, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 1117, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "2.02% 2.02% 2.02% 2.02%", "qwen": "2.91% 2.91% 2.91% 2.91%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.6416407227516174]], "qwen": [[537, " not", "normal", 0.5248613357543945]]}, "loss": {"rwkv": 2.0164621848362585, "qwen": 2.906224371822002}, "topk": {"rwkv": [22187, 1, 0.6416407227516174, [[22187, 0.641641, " not", false], [21265, 0.117235, " and", false], [47001, 0.027668, " rather", false], [40186, 0.022936, " which", false], [4450, 0.020288, " by", false], [4423, 0.011753, " as", false], [4596, 0.008012, " in", false], [53356, 0.00778, " without", false], [40085, 0.007262, " using", false], [32487, 0.007185, " with", false]]], "qwen": [537, 1, 0.5248613357543945, [[537, 0.524861, " not", false], [323, 0.174363, " and", false], [892, 0.037924, " which", false], [4751, 0.031897, " rather", false], [553, 0.022549, " by", false], [438, 0.017158, " as", false], [773, 0.01376, " so", false], [1667, 0.012388, " using", false], [429, 0.010594, " that", false], [448, 0.009621, " with", false]]]}, "raw_delta": -0.049338892102241516, "tuned_delta": -0.040767100071663266}, {"byte_start": 6656, "byte_end": 6659, "display": {"text": " by", "kind": "normal"}, "is_word": true, "word_id": 1118, "word_key": " by", "bytes_hex": "20 62 79", "compression": {"rwkv": "1.90% 1.90% 1.90%", "qwen": "1.98% 1.98% 1.98%"}, "model_tokens": {"rwkv": [[4450, " by", "normal", 0.7286056876182556]], "qwen": [[553, " by", "normal", 0.7199219465255737]]}, "loss": {"rwkv": 1.901990532421973, "qwen": 1.9753651389266438}, "topk": {"rwkv": [4450, 1, 0.7286056876182556, [[4450, 0.728606, " by", false], [22590, 0.084609, " the", false], [22248, 0.033014, " our", false], [31597, 0.014343, " ours", false], [4596, 0.009855, " in", false], [39944, 0.007908, " those", false], [38720, 0.007643, " human", false], [53140, 0.007051, " through", false], [332, 0.004437, " a", false], [21700, 0.004273, " for", false]]], "qwen": [553, 1, 0.7199219465255737, [[553, 0.719922, " by", false], [1039, 0.078851, " our", false], [279, 0.035263, " the", false], [11350, 0.023112, " ours", false], [304, 0.01811, " in", false], [3738, 0.007074, " human", false], [504, 0.00552, " from", false], [1128, 0.005099, " what", false], [1846, 0.00484, " those", false], [264, 0.004775, " a", false]]]}, "raw_delta": -0.004068752129872635, "tuned_delta": 0.004503039900705613}, {"byte_start": 6659, "byte_end": 6662, "display": {"text": " us", "kind": "normal"}, "is_word": true, "word_id": 1119, "word_key": " us", "bytes_hex": "20 75 73", "compression": {"rwkv": "34.19% 34.19% 34.19%", "qwen": "28.03% 28.03% 28.03%"}, "model_tokens": {"rwkv": [[4835, " us", "normal", 0.0033956430852413177]], "qwen": [[601, " us", "normal", 0.009435177780687809]]}, "loss": {"rwkv": 34.18886685439991, "qwen": 28.032226186058057}, "topk": {"rwkv": [4835, 30, 0.0033956430852413177, [[22590, 0.292774, " the", false], [38720, 0.098065, " human", false], [22248, 0.091586, " our", false], [31044, 0.032349, " hand", false], [52224, 0.028213, " methods", false], [21273, 0.026857, " any", false], [31597, 0.025495, " ours", false], [39944, 0.023, " those", false], [32074, 0.019273, " some", false], [332, 0.016666, " a", false]]], "qwen": [601, 16, 0.009435177780687809, [[1039, 0.258688, " our", false], [279, 0.135349, " the", false], [3738, 0.051711, " human", false], [1128, 0.040592, " what", false], [1246, 0.030586, " how", false], [894, 0.029897, " any", false], [11350, 0.029029, " ours", false], [1045, 0.022115, " some", false], [4460, 0.01838, " trying", false], [264, 0.016735, " a", false]]]}, "raw_delta": 0.3413966496785481, "tuned_delta": 0.34996844170912633}, {"byte_start": 6662, "byte_end": 6663, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "16.70%", "qwen": "17.46%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.39389297366142273]], "qwen": [[13, ".", "normal", 0.3797611594200134]]}, "loss": {"rwkv": 16.69525022903732, "qwen": 17.460447263063372}, "topk": {"rwkv": [47, 1, 0.39389297366142273, [[47, 0.393893, ".", false], [45, 0.128652, ",", false], [47629, 0.049454, " trying", false], [57419, 0.036062, " thinking", false], [55666, 0.018745, " building", false], [52157, 0.017178, " looking", false], [60, 0.012904, ";", false], [52614, 0.011, " putting", false], [52087, 0.010164, " knowing", false], [46227, 0.010145, " humans", false]]], "qwen": [13, 1, 0.3797611594200134, [[13, 0.379761, ".", false], [382, 0.197382, ".\n\n", false], [11, 0.133295, ",", false], [4460, 0.027582, " trying", false], [4421, 0.02084, "---", false], [13217, 0.019914, " ourselves", false], [26, 0.01801, ";", false], [4752, 0.015604, " building", false], [304, 0.013535, " in", false], [624, 0.012272, ".\n", false]]]}, "raw_delta": -0.042431533336639404, "tuned_delta": -0.033859741306061154}, {"byte_start": 6663, "byte_end": 6666, "display": {"text": " We", "kind": "normal"}, "is_word": true, "word_id": 1120, "word_key": " we", "bytes_hex": "20 57 65", "compression": {"rwkv": "15.59% 15.59% 15.59%", "qwen": "12.74% 12.74% 12.74%"}, "model_tokens": {"rwkv": [[4331, " We", "normal", 0.07419870793819427]], "qwen": [[1205, " We", "normal", 0.12015379965305328]]}, "loss": {"rwkv": 15.591626092940619, "qwen": 12.7376915233504}, "topk": {"rwkv": [4331, 3, 0.07419870793819427, [[261, 0.339053, "\n\n", false], [20996, 0.092401, " The", false], [4331, 0.074199, " We", false], [29894, 0.062721, " This", false], [3913, 0.032627, " In", false], [20571, 0.022018, " Our", false], [37453, 0.020734, " These", false], [3918, 0.01711, " It", false], [19417, 0.014782, " And", false], [44844, 0.013491, " Search", false]]], "qwen": [1205, 2, 0.12015379965305328, [[576, 0.124349, " The", false], [1205, 0.120154, " We", false], [1096, 0.100161, " This", false], [758, 0.045278, " In", false], [1084, 0.03561, " It", false], [4220, 0.029118, " These", false], [1597, 0.026011, " And", false], [2938, 0.025488, " That", false], [2379, 0.023709, " They", false], [1416, 0.022571, " If", false]]]}, "raw_delta": 0.15825573603312182, "tuned_delta": 0.16682752806370008}, {"byte_start": 6666, "byte_end": 6671, "display": {"text": " want", "kind": "normal"}, "is_word": true, "word_id": 1121, "word_key": " want", "bytes_hex": "20 77 61 6e 74", "compression": {"rwkv": "17.02% 17.02% 17.02% 17.02% 17.02%", "qwen": "16.53% 16.53% 16.53% 16.53% 16.53%"}, "model_tokens": {"rwkv": [[32435, " want", "normal", 0.008886758238077164]], "qwen": [[1366, " want", "normal", 0.01023530401289463]]}, "loss": {"rwkv": 17.019293060486987, "qwen": 16.525756167132496}, "topk": {"rwkv": [32435, 10, 0.008886758238077164, [[47266, 0.570663, " should", false], [21286, 0.064686, " are", false], [21413, 0.054047, " can", false], [31059, 0.046024, " have", false], [4491, 0.032473, " do", false], [31475, 0.03148, " must", false], [31506, 0.028998, " need", false], [45409, 0.025182, " cannot", false], [32475, 0.018433, " will", false], [32435, 0.008887, " want", false]]], "qwen": [1366, 11, 0.01023530401289463, [[1265, 0.475429, " should", false], [646, 0.080123, " can", false], [525, 0.070954, " are", false], [653, 0.048946, " do", false], [614, 0.043774, " have", false], [1184, 0.03069, " need", false], [4157, 0.023288, " cannot", false], [1969, 0.021519, " must", false], [686, 0.020723, " will", false], [1936, 0.014334, " build", false]]]}, "raw_delta": 0.027367496490478538, "tuned_delta": 0.03593928852105679}, {"byte_start": 6671, "byte_end": 6674, "display": {"text": " AI", "kind": "normal"}, "is_word": true, "word_id": 1122, "word_key": " ai", "bytes_hex": "20 41 49", "compression": {"rwkv": "34.19% 34.19% 34.19%", "qwen": "33.82% 33.82% 33.82%"}, "model_tokens": {"rwkv": [[3609, " AI", "normal", 0.003392708720639348]], "qwen": [[15235, " AI", "normal", 0.003602352924644947]]}, "loss": {"rwkv": 34.18886685439991, "qwen": 33.82018764574531}, "topk": {"rwkv": [3609, 20, 0.003392708720639348, [[4811, 0.401271, " to", false], [22248, 0.151508, " our", false], [52224, 0.088485, " methods", false], [22590, 0.065865, " the", false], [332, 0.043564, " a", false], [30992, 0.025533, " good", false], [39936, 0.018421, " these", false], [32229, 0.014171, " them", false], [4419, 0.009503, " an", false], [47202, 0.009064, " search", false]]], "qwen": [15235, 19, 0.003602352924644947, [[311, 0.431843, " to", false], [1039, 0.151343, " our", false], [279, 0.06933, " the", false], [5413, 0.062271, " methods", false], [1105, 0.055695, " them", false], [264, 0.020451, " a", false], [1493, 0.020378, " these", false], [13009, 0.007229, " agents", false], [458, 0.006334, " an", false], [18495, 0.00584, " computers", false]]]}, "raw_delta": 0.02044391632080078, "tuned_delta": 0.02901570835137903}, {"byte_start": 6674, "byte_end": 6681, "display": {"text": " agents", "kind": "normal"}, "is_word": true, "word_id": 1123, "word_key": " agents", "bytes_hex": "20 61 67 65 6e 74 73", "compression": {"rwkv": "4.49% 4.49% 4.49% 4.49% 4.49% 4.49% 4.49%", "qwen": "4.27% 4.27% 4.27% 4.27% 4.27% 4.27% 4.27%"}, "model_tokens": {"rwkv": [[45124, " agents", "normal", 0.17387990653514862]], "qwen": [[13009, " agents", "normal", 0.19034291803836823]]}, "loss": {"rwkv": 4.488295118837037, "qwen": 4.273798663792818}, "topk": {"rwkv": [45124, 3, 0.17387990653514862, [[53087, 0.249089, " systems", false], [4811, 0.187299, " to", false], [45124, 0.17388, " agents", false], [52224, 0.147139, " methods", false], [63843, 0.054576, " researchers", false], [57103, 0.040544, " research", false], [32227, 0.031342, " that", false], [116, 0.0199, "s", false], [56949, 0.015795, " programs", false], [45, 0.011397, ",", false]]], "qwen": [13009, 3, 0.19034291803836823, [[5942, 0.341456, " systems", false], [311, 0.200749, " to", false], [13009, 0.190343, " agents", false], [5413, 0.066325, " methods", false], [429, 0.04606, " that", false], [11811, 0.04474, " researchers", false], [3412, 0.025602, " research", false], [7468, 0.008014, " programs", false], [11, 0.006924, ",", false], [537, 0.003817, " not", false]]]}, "raw_delta": 0.011894209044320259, "tuned_delta": 0.02046600107489851}, {"byte_start": 6681, "byte_end": 6686, "display": {"text": " that", "kind": "normal"}, "is_word": true, "word_id": 1124, "word_key": " that", "bytes_hex": "20 74 68 61 74", "compression": {"rwkv": "3.32% 3.32% 3.32% 3.32% 3.32%", "qwen": "3.77% 3.77% 3.77% 3.77% 3.77%"}, "model_tokens": {"rwkv": [[32227, " that", "normal", 0.40044909715652466]], "qwen": [[429, " that", "normal", 0.35199281573295593]]}, "loss": {"rwkv": 3.324961227048783, "qwen": 3.7659552707815522}, "topk": {"rwkv": [32227, 2, 0.40044909715652466, [[4811, 0.464835, " to", false], [32227, 0.400449, " that", false], [45, 0.031049, ",", false], [22762, 0.028127, " who", false], [32487, 0.013456, " with", false], [40191, 0.010205, " whose", false], [21265, 0.004849, " and", false], [275, 0.004232, " (", false], [4596, 0.004068, " in", false], [51127, 0.003754, " capable", false]]], "qwen": [429, 2, 0.35199281573295593, [[311, 0.565987, " to", false], [429, 0.351993, " that", false], [448, 0.011837, " with", false], [11, 0.010759, ",", false], [6693, 0.005431, " whose", false], [879, 0.005186, " who", false], [2952, 0.004026, " able", false], [537, 0.003776, " not", false], [12875, 0.003059, " capable", false], [5798, 0.002581, " built", false]]]}, "raw_delta": -0.024453902244567866, "tuned_delta": -0.015882110213989616}, {"byte_start": 6686, "byte_end": 6690, "display": {"text": " can", "kind": "normal"}, "is_word": true, "word_id": 1125, "word_key": " can", "bytes_hex": "20 63 61 6e", "compression": {"rwkv": "4.54% 4.54% 4.54% 4.54%", "qwen": "4.18% 4.18% 4.18% 4.18%"}, "model_tokens": {"rwkv": [[21413, " can", "normal", 0.36886271834373474]], "qwen": [[646, " can", "normal", 0.3953403830528259]]}, "loss": {"rwkv": 4.543644049674714, "qwen": 4.18385258194923}, "topk": {"rwkv": [21413, 1, 0.36886271834373474, [[21413, 0.368863, " can", false], [21286, 0.16787, " are", false], [30858, 0.046551, " find", false], [31059, 0.036646, " have", false], [4491, 0.033468, " do", false], [38877, 0.027849, " learn", false], [32475, 0.021242, " will", false], [47202, 0.018657, " search", false], [39942, 0.018343, " think", false], [4858, 0.015148, " we", false]]], "qwen": [646, 1, 0.3953403830528259, [[646, 0.39534, " can", false], [525, 0.170227, " are", false], [3960, 0.036257, " learn", false], [614, 0.029221, " have", false], [653, 0.026931, " do", false], [686, 0.022574, " will", false], [1477, 0.018476, " find", false], [975, 0.015161, " work", false], [1744, 0.014971, " think", false], [11, 0.010416, ",", false]]]}, "raw_delta": 0.019951075315475464, "tuned_delta": 0.028522867346053714}, {"byte_start": 6690, "byte_end": 6699, "display": {"text": " discover", "kind": "normal"}, "is_word": true, "word_id": 1126, "word_key": " discover", "bytes_hex": "20 64 69 73 63 6f 76 65 72", "compression": {"rwkv": "7.83% 7.83% 7.83% 7.83% 7.83% 7.83% 7.83% 7.83% 7.83%", "qwen": "8.66% 8.66% 8.66% 8.66% 8.66% 8.66% 8.66% 8.66% 8.66%"}, "model_tokens": {"rwkv": [[56010, " discover", "normal", 0.020210230723023415]], "qwen": [[6997, " discover", "normal", 0.013267488218843937]]}, "loss": {"rwkv": 7.827121532600711, "qwen": 8.661056807501929}, "topk": {"rwkv": [56010, 8, 0.020210230723023415, [[30858, 0.271751, " find", false], [38877, 0.074894, " learn", false], [47202, 0.05126, " search", false], [4491, 0.046526, " do", false], [39942, 0.033556, " think", false], [4435, 0.030315, " be", false], [37923, 0.023489, " build", false], [56010, 0.02021, " discover", false], [63292, 0.018048, " approximate", false], [22681, 0.015947, " use", false]]], "qwen": [6997, 13, 0.013267488218843937, [[1477, 0.163343, " find", false], [3960, 0.0668, " learn", false], [653, 0.063917, " do", false], [1744, 0.040563, " think", false], [11625, 0.026984, " solve", false], [2711, 0.02423, " search", false], [387, 0.022677, " be", false], [1936, 0.019734, " build", false], [1281, 0.018899, " make", false], [2874, 0.017637, " reason", false]]]}, "raw_delta": -0.04624319076538086, "tuned_delta": -0.03767139873480261}, {"byte_start": 6699, "byte_end": 6704, "display": {"text": " like", "kind": "normal"}, "is_word": true, "word_id": 1127, "word_key": " like", "bytes_hex": "20 6c 69 6b 65", "compression": {"rwkv": "36.29% 36.29% 36.29% 36.29% 36.29%", "qwen": "32.17% 32.17% 32.17% 32.17% 32.17%"}, "model_tokens": {"rwkv": [[31296, " like", "normal", 4.271131911082193e-05]], "qwen": [[1075, " like", "normal", 0.00013390577805694193]]}, "loss": {"rwkv": 36.292797122362984, "qwen": 32.1662350786017}, "topk": {"rwkv": [31296, 531, 4.271131911082193e-05, [[22590, 0.153616, " the", false], [21265, 0.079406, " and", false], [30992, 0.072583, " good", false], [45, 0.061582, ",", false], [39936, 0.05371, " these", false], [39931, 0.053492, " their", false], [22168, 0.034159, " new", false], [52224, 0.032527, " methods", false], [32464, 0.032322, " what", false], [21835, 0.031038, " how", false]]], "qwen": [1075, 249, 0.00013390577805694193, [[279, 0.162703, " the", false], [323, 0.109268, " and", false], [369, 0.064706, " for", false], [862, 0.062624, " their", false], [1128, 0.058175, " what", false], [1661, 0.057383, " good", false], [11, 0.041455, ",", false], [1493, 0.039444, " these", false], [1246, 0.029323, " how", false], [2513, 0.02278, " things", false]]]}, "raw_delta": 0.22882518768310556, "tuned_delta": 0.23739697971368381}, {"byte_start": 6704, "byte_end": 6707, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 1128, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"rwkv": "15.31% 15.31% 15.31%", "qwen": "11.68% 11.68% 11.68%"}, "model_tokens": {"rwkv": [[4858, " we", "normal", 0.07806975394487381]], "qwen": [[582, " we", "normal", 0.14333263039588928]]}, "loss": {"rwkv": 15.309849717766994, "qwen": 11.677338222210782}, "topk": {"rwkv": [4858, 3, 0.07806975394487381, [[4835, 0.405959, " us", false], [32234, 0.104065, " this", false], [4858, 0.07807, " we", false], [46227, 0.065164, " humans", false], [46, 0.050487, "-", false], [26307, 0.028313, "ness", false], [22590, 0.02622, " the", false], [52224, 0.024994, " methods", false], [38720, 0.024662, " human", false], [22248, 0.015617, " our", false]]], "qwen": [582, 3, 0.14333263039588928, [[601, 0.288519, " us", false], [33323, 0.180082, "-minded", false], [582, 0.143333, " we", false], [12677, 0.092214, " humans", false], [13217, 0.027994, " ourselves", false], [3738, 0.027534, " human", false], [264, 0.024417, " a", false], [5577, 0.018602, " themselves", false], [279, 0.018061, " the", false], [20062, 0.014807, " minds", false]]]}, "raw_delta": 0.20142920811971032, "tuned_delta": 0.21000100015028858}, {"byte_start": 6707, "byte_end": 6711, "display": {"text": " can", "kind": "normal"}, "is_word": true, "word_id": 1129, "word_key": " can", "bytes_hex": "20 63 61 6e", "compression": {"rwkv": "14.02% 14.02% 14.02% 14.02%", "qwen": "8.59% 8.59% 8.59% 8.59%"}, "model_tokens": {"rwkv": [[21413, " can", "normal", 0.04430075362324715]], "qwen": [[646, " can", "normal", 0.14863568544387817]]}, "loss": {"rwkv": 14.018374664887876, "qwen": 8.594211152096834}, "topk": {"rwkv": [21413, 3, 0.04430075362324715, [[4491, 0.835724, " do", false], [56010, 0.045945, " discover", false], [21413, 0.044301, " can", false], [31059, 0.014708, " have", false], [21532, 0.010558, " did", false], [46227, 0.009851, " humans", false], [40219, 0.005348, " would", false], [60112, 0.002919, " ourselves", false], [39021, 0.002612, " might", false], [61885, 0.002538, " discovered", false]]], "qwen": [646, 3, 0.14863568544387817, [[653, 0.568086, " do", false], [6997, 0.174734, " discover", false], [646, 0.148636, " can", false], [1521, 0.021359, " did", false], [11105, 0.010338, " discovered", false], [1410, 0.007818, " could", false], [1035, 0.007264, " would", false], [1477, 0.007214, " find", false], [11, 0.006526, ",", false], [1744, 0.006406, " think", false]]]}, "raw_delta": 0.3007794916629791, "tuned_delta": 0.30935128369355736}, {"byte_start": 6711, "byte_end": 6712, "display": {"text": ",", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2c", "compression": {"rwkv": "11.27%", "qwen": "13.22%"}, "model_tokens": {"rwkv": [[45, ",", "normal", 0.5405202507972717]], "qwen": [[11, ",", "normal", 0.48036783933639526]]}, "loss": {"rwkv": 11.271055006945026, "qwen": 13.222356190044069}, "topk": {"rwkv": [45, 1, 0.5405202507972717, [[45, 0.54052, ",", false], [47, 0.162355, ".", false], [56010, 0.068789, " discover", false], [5346, 0.058311, "---", false], [60, 0.035383, ";", false], [21265, 0.019231, " and", false], [59, 0.016769, ":", false], [4596, 0.013378, " in", false], [275, 0.007809, " (", false], [22590, 0.005136, " the", false]]], "qwen": [11, 1, 0.48036783933639526, [[11, 0.480368, ",", false], [6997, 0.207943, " discover", false], [13, 0.099656, ".", false], [4421, 0.064796, "---", false], [382, 0.043028, ".\n\n", false], [26, 0.024823, ";", false], [320, 0.007874, " (", false], [323, 0.007799, " and", false], [25, 0.007231, ":", false], [1477, 0.004184, " find", false]]]}, "raw_delta": -0.10820311307907104, "tuned_delta": -0.0996313210484928}, {"byte_start": 6712, "byte_end": 6716, "display": {"text": " not", "kind": "normal"}, "is_word": true, "word_id": 1130, "word_key": " not", "bytes_hex": "20 6e 6f 74", "compression": {"rwkv": "7.82% 7.82% 7.82% 7.82%", "qwen": "7.45% 7.45% 7.45% 7.45%"}, "model_tokens": {"rwkv": [[22187, " not", "normal", 0.17512939870357513]], "qwen": [[537, " not", "normal", 0.19144868850708008]]}, "loss": {"rwkv": 7.819294411068111, "qwen": 7.453032633549699}, "topk": {"rwkv": [22187, 2, 0.17512939870357513, [[21265, 0.190424, " and", false], [22187, 0.175129, " not", false], [21400, 0.152519, " but", false], [47001, 0.042702, " rather", false], [32227, 0.042439, " that", false], [4450, 0.039707, " by", false], [4596, 0.027738, " in", false], [4788, 0.02235, " so", false], [4715, 0.021353, " or", false], [53356, 0.020909, " without", false]]], "qwen": [537, 2, 0.19144868850708008, [[323, 0.224467, " and", false], [537, 0.191449, " not", false], [714, 0.158138, " but", false], [553, 0.039503, " by", false], [429, 0.02697, " that", false], [2041, 0.026324, " without", false], [476, 0.023965, " or", false], [4751, 0.023311, " rather", false], [448, 0.023124, " with", false], [773, 0.020411, " so", false]]]}, "raw_delta": 0.020309865474700928, "tuned_delta": 0.028881657505279178}, {"byte_start": 6716, "byte_end": 6722, "display": {"text": " which", "kind": "normal"}, "is_word": true, "word_id": 1131, "word_key": " which", "bytes_hex": "20 77 68 69 63 68", "compression": {"rwkv": "21.23% 21.23% 21.23% 21.23% 21.23% 21.23%", "qwen": "26.25% 26.25% 26.25% 26.25% 26.25% 26.25%"}, "model_tokens": {"rwkv": [[40186, " which", "normal", 0.0008482365519739687]], "qwen": [[892, " which", "normal", 0.0001608761231182143]]}, "loss": {"rwkv": 21.22715359641313, "qwen": 26.25367046853784}, "topk": {"rwkv": [40186, 52, 0.0008482365519739687, [[31296, 0.336947, " like", false], [32227, 0.20722, " that", false], [31198, 0.044844, " just", false], [3609, 0.043916, " AI", false], [56010, 0.042039, " discover", false], [45124, 0.040443, " agents", false], [31580, 0.035014, " ones", false], [4450, 0.019381, " by", false], [22590, 0.014692, " the", false], [4835, 0.014163, " us", false]]], "qwen": [892, 153, 0.0001608761231182143, [[1075, 0.258698, " like", false], [429, 0.23203, " that", false], [6997, 0.062718, " discover", false], [1101, 0.053694, " just", false], [6174, 0.038152, " ones", false], [279, 0.03279, " the", false], [825, 0.025358, " one", false], [13009, 0.025107, " agents", false], [15235, 0.02273, " AI", false], [553, 0.022475, " by", false]]]}, "raw_delta": -0.27872927983601903, "tuned_delta": -0.2701574878054408}, {"byte_start": 6722, "byte_end": 6730, "display": {"text": " contain", "kind": "normal"}, "is_word": true, "word_id": 1132, "word_key": " contain", "bytes_hex": "20 63 6f 6e 74 61 69 6e", "compression": {"rwkv": "19.58% 19.58% 19.58% 19.58% 19.58% 19.58% 19.58% 19.58%", "qwen": "19.92% 19.92% 19.92% 19.92% 19.92% 19.92% 19.92% 19.92%"}, "model_tokens": {"rwkv": [[51306, " contain", "normal", 0.00016801267338450998]], "qwen": [[6644, " contain", "normal", 0.00014512930647470057]]}, "loss": {"rwkv": 19.58345807456698, "qwen": 19.922457377248936}, "topk": {"rwkv": [51306, 162, 0.00016801267338450998, [[4858, 0.439659, " we", false], [21413, 0.177438, " can", false], [4706, 0.039156, " of", false], [22752, 0.037556, " way", false], [31580, 0.020576, " ones", false], [31296, 0.018933, " like", false], [39239, 0.016602, " parts", false], [21286, 0.016067, " are", false], [32448, 0.01186, " ways", false], [47539, 0.008937, " things", false]]], "qwen": [6644, 286, 0.00014512930647470057, [[582, 0.509987, " we", false], [315, 0.054849, " of", false], [646, 0.046551, " can", false], [374, 0.044929, " is", false], [525, 0.02955, " are", false], [1075, 0.015272, " like", false], [1616, 0.011093, " way", false], [5510, 0.009118, " ways", false], [5413, 0.008642, " methods", false], [11, 0.008383, ",", false]]]}, "raw_delta": -0.018798112869262695, "tuned_delta": -0.010226320838684447}, {"byte_start": 6730, "byte_end": 6735, "display": {"text": " what", "kind": "normal"}, "is_word": true, "word_id": 1133, "word_key": " what", "bytes_hex": "20 77 68 61 74", "compression": {"rwkv": "10.82% 10.82% 10.82% 10.82% 10.82%", "qwen": "11.11% 11.11% 11.11% 11.11% 11.11%"}, "model_tokens": {"rwkv": [[32464, " what", "normal", 0.04939144477248192]], "qwen": [[1128, " what", "normal", 0.045924846082925797]]}, "loss": {"rwkv": 10.820212806667223, "qwen": 11.11145338711783}, "topk": {"rwkv": [32464, 5, 0.04939144477248192, [[31296, 0.520295, " like", false], [22248, 0.096427, " our", false], [22590, 0.063157, " the", false], [59943, 0.05299, " knowledge", false], [32464, 0.049391, " what", false], [4596, 0.01953, " in", false], [38720, 0.015024, " human", false], [4835, 0.014422, " us", false], [32227, 0.011941, " that", false], [4601, 0.011006, " it", false]]], "qwen": [1128, 4, 0.045924846082925797, [[1039, 0.192355, " our", false], [601, 0.074176, " us", false], [279, 0.071885, " the", false], [1128, 0.045925, " what", false], [678, 0.043658, " all", false], [304, 0.040075, " in", false], [264, 0.038176, " a", false], [1075, 0.030652, " like", false], [2878, 0.026761, " within", false], [43613, 0.026124, " representations", false]]]}, "raw_delta": -0.016149806976318404, "tuned_delta": -0.0075780149457401556}, {"byte_start": 6735, "byte_end": 6738, "display": {"text": " we", "kind": "normal"}, "is_word": true, "word_id": 1134, "word_key": " we", "bytes_hex": "20 77 65", "compression": {"rwkv": "1.03% 1.03% 1.03%", "qwen": "0.56% 0.56% 0.56%"}, "model_tokens": {"rwkv": [[4858, " we", "normal", 0.8416891098022461]], "qwen": [[582, " we", "normal", 0.9115656614303589]]}, "loss": {"rwkv": 1.033180042303294, "qwen": 0.5565898267061866}, "topk": {"rwkv": [4858, 1, 0.8416891098022461, [[4858, 0.841689, " we", false], [31296, 0.051954, " like", false], [47, 0.012044, ".", false], [4600, 0.009299, " is", false], [22248, 0.007853, " our", false], [21413, 0.006039, " can", false], [22590, 0.004134, " the", false], [46227, 0.004081, " humans", false], [45, 0.003882, ",", false], [32232, 0.003829, " they", false]]], "qwen": [582, 1, 0.9115656614303589, [[582, 0.911566, " we", false], [374, 0.010946, " is", false], [1039, 0.007368, " our", false], [7952, 0.003925, " appears", false], [304, 0.002683, " in", false], [5868, 0.002403, " looks", false], [807, 0.002394, " they", false], [4977, 0.002156, " seems", false], [3643, 0.002092, " makes", false], [12677, 0.002075, " humans", false]]]}, "raw_delta": 0.026427773137887318, "tuned_delta": 0.034999565168465564}, {"byte_start": 6738, "byte_end": 6743, "display": {"text": " have", "kind": "normal"}, "is_word": true, "word_id": 1135, "word_key": " have", "bytes_hex": "20 68 61 76 65", "compression": {"rwkv": "9.75% 9.75% 9.75% 9.75% 9.75%", "qwen": "15.79% 15.79% 15.79% 15.79% 15.79%"}, "model_tokens": {"rwkv": [[31059, " have", "normal", 0.06702268868684769]], "qwen": [[614, " have", "normal", 0.012539910152554512]]}, "loss": {"rwkv": 9.749462581007448, "qwen": 15.793323332944}, "topk": {"rwkv": [31059, 5, 0.06702268868684769, [[21413, 0.199723, " can", false], [39942, 0.152266, " think", false], [31223, 0.147158, " know", false], [4491, 0.07182, " do", false], [31059, 0.067023, " have", false], [31296, 0.04986, " like", false], [32435, 0.029523, " want", false], [50888, 0.022951, " already", false], [51025, 0.018259, " believe", false], [39021, 0.017775, " might", false]]], "qwen": [614, 9, 0.012539910152554512, [[1744, 0.472448, " think", false], [1414, 0.110558, " know", false], [1366, 0.071092, " want", false], [646, 0.048242, " can", false], [4411, 0.046941, " believe", false], [2669, 0.041109, " already", false], [653, 0.021499, " do", false], [1035, 0.015672, " would", false], [614, 0.01254, " have", false], [1477, 0.010907, " find", false]]]}, "raw_delta": -0.3351428031921386, "tuned_delta": -0.3265710111615604}, {"byte_start": 6743, "byte_end": 6754, "display": {"text": " discovered", "kind": "normal"}, "is_word": true, "word_id": 1136, "word_key": " discovered", "bytes_hex": "20 64 69 73 63 6f 76 65 72 65 64", "compression": {"rwkv": "2.83% 2.83% 2.83% 2.83% 2.83% 2.83% 2.83% 2.83% 2.83% 2.83% 2.83%", "qwen": "3.06% 3.06% 3.06% 3.06% 3.06% 3.06% 3.06% 3.06% 3.06% 3.06% 3.06%"}, "model_tokens": {"rwkv": [[61885, " discovered", "normal", 0.17997170984745026]], "qwen": [[11105, " discovered", "normal", 0.15453387796878815]]}, "loss": {"rwkv": 2.830571768789603, "qwen": 3.061369163855374}, "topk": {"rwkv": [61885, 1, 0.17997170984745026, [[61885, 0.179972, " discovered", false], [47, 0.132954, ".", false], [4596, 0.084884, " in", false], [52112, 0.081874, " learned", false], [50888, 0.064199, " already", false], [53137, 0.047147, " thought", false], [4811, 0.032717, " to", false], [38547, 0.031827, " found", false], [22339, 0.029411, " put", false], [45, 0.02099, ",", false]]], "qwen": [11105, 2, 0.15453387796878815, [[304, 0.207364, " in", false], [11105, 0.154534, " discovered", false], [4766, 0.066517, " inside", false], [2669, 0.053761, " already", false], [1730, 0.043844, " found", false], [5798, 0.040682, " built", false], [9498, 0.036944, " learned", false], [3381, 0.029962, " thought", false], [13, 0.023349, ".", false], [382, 0.016495, ".\n\n", false]]]}, "raw_delta": -0.012798125093633483, "tuned_delta": -0.004226333063055235}, {"byte_start": 6754, "byte_end": 6755, "display": {"text": ".", "kind": "normal"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e", "compression": {"rwkv": "5.64%", "qwen": "17.17%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.730880081653595]], "qwen": [[13, ".", "normal", 0.38600796461105347]]}, "loss": {"rwkv": 5.635527503472513, "qwen": 17.166218269075713}, "topk": {"rwkv": [47, 1, 0.730880081653595, [[47, 0.73088, ".", false], [45, 0.069008, ",", false], [31296, 0.032315, " like", false], [4596, 0.023469, " in", false], [21700, 0.018851, " for", false], [21265, 0.017739, " and", false], [50888, 0.011498, " already", false], [60, 0.010665, ";", false], [5346, 0.00961, "---", false], [60112, 0.009043, " ourselves", false]]], "qwen": [13, 1, 0.38600796461105347, [[13, 0.386008, ".", false], [382, 0.231522, ".\n\n", false], [304, 0.072136, " in", false], [11, 0.053785, ",", false], [911, 0.05076, " about", false], [323, 0.018208, " and", false], [13217, 0.017798, " ourselves", false], [2669, 0.015759, " already", false], [4766, 0.013275, " inside", false], [624, 0.012202, ".\n", false]]]}, "raw_delta": -0.6393972635269165, "tuned_delta": -0.6308254714963383}, {"byte_start": 6755, "byte_end": 6764, "display": {"text": " Building", "kind": "normal"}, "is_word": true, "word_id": 1137, "word_key": " building", "bytes_hex": "20 42 75 69 6c 64 69 6e 67", "compression": {"rwkv": "13.40% 13.40% 13.40% 13.40% 13.40% 13.40% 13.40% 13.40% 13.40%", "qwen": "12.49% 12.49% 12.49% 12.49% 12.49% 12.49% 12.49% 12.49% 12.49%"}, "model_tokens": {"rwkv": [[54879, " Building", "normal", 0.0012474644463509321]], "qwen": [[16858, " Building", "normal", 0.0019598412327468395]]}, "loss": {"rwkv": 13.400032063812418, "qwen": 12.493121683772598}, "topk": {"rwkv": [54879, 47, 0.0012474644463509321, [[261, 0.495125, "\n\n", false], [4331, 0.064093, " We", false], [20996, 0.062812, " The", false], [29894, 0.053125, " This", false], [19417, 0.017577, " And", false], [3913, 0.017541, " In", false], [0, 0.016396, "[0]", false], [20571, 0.013531, " Our", false], [3918, 0.012535, " It", false], [37453, 0.012277, " These", false]]], "qwen": [16858, 56, 0.0019598412327468395, [[1205, 0.156684, " We", false], [576, 0.135697, " The", false], [1096, 0.0787, " This", false], [758, 0.036291, " In", false], [220, 0.035951, " ", false], [1084, 0.029062, " It", false], [1597, 0.029, " And", false], [4220, 0.020506, " These", false], [1416, 0.019435, " If", false], [2014, 0.017807, " To", false]]]}, "raw_delta": 0.05028978983561205, "tuned_delta": 0.0588615818661903}, {"byte_start": 6764, "byte_end": 6767, "display": {"text": " in", "kind": "normal"}, "is_word": true, "word_id": 1138, "word_key": " in", "bytes_hex": "20 69 6e", "compression": {"rwkv": "4.72% 4.72% 4.72%", "qwen": "3.09% 3.09% 3.09%"}, "model_tokens": {"rwkv": [[4596, " in", "normal", 0.45493388175964355]], "qwen": [[304, " in", "normal", 0.5984180569648743]]}, "loss": {"rwkv": 4.719754284158229, "qwen": 3.086560094633201}, "topk": {"rwkv": [4596, 1, 0.45493388175964355, [[4596, 0.454934, " in", false], [3609, 0.060028, " AI", false], [52224, 0.053594, " methods", false], [39936, 0.043946, " these", false], [32139, 0.038988, " such", false], [32234, 0.031919, " this", false], [22248, 0.029905, " our", false], [31162, 0.018893, " into", false], [22590, 0.018609, " the", false], [332, 0.016126, " a", false]]], "qwen": [304, 1, 0.5984180569648743, [[304, 0.598418, " in", false], [6540, 0.031385, " knowledge", false], [5413, 0.03018, " methods", false], [279, 0.027624, " the", false], [264, 0.025223, " a", false], [1039, 0.02026, " our", false], [389, 0.017346, " on", false], [1493, 0.014468, " these", false], [1741, 0.013214, " such", false], [419, 0.011646, " this", false]]]}, "raw_delta": 0.0905635158220927, "tuned_delta": 0.09913530785267094}, {"byte_start": 6767, "byte_end": 6771, "display": {"text": " our", "kind": "normal"}, "is_word": true, "word_id": 1139, "word_key": " our", "bytes_hex": "20 6f 75 72", "compression": {"rwkv": "7.36% 7.36% 7.36% 7.36%", "qwen": "8.73% 8.73% 8.73% 8.73%"}, "model_tokens": {"rwkv": [[22248, " our", "normal", 0.19305700063705444]], "qwen": [[1039, " our", "normal", 0.14410899579524994]]}, "loss": {"rwkv": 7.361407801410969, "qwen": 8.733648773512776}, "topk": {"rwkv": [22248, 1, 0.19305700063705444, [[22248, 0.193057, " our", false], [38720, 0.152005, " human", false], [32464, 0.10019, " what", false], [22590, 0.094854, " the", false], [59943, 0.08423, " knowledge", false], [21835, 0.052755, " how", false], [332, 0.029623, " a", false], [32234, 0.019984, " this", false], [39936, 0.017865, " these", false], [32139, 0.011579, " such", false]]], "qwen": [1039, 2, 0.14410899579524994, [[1128, 0.150954, " what", false], [1039, 0.144109, " our", false], [279, 0.11937, " the", false], [1246, 0.075014, " how", false], [3738, 0.067958, " human", false], [6540, 0.057701, " knowledge", false], [264, 0.026214, " a", false], [1741, 0.020343, " such", false], [894, 0.016577, " any", false], [419, 0.014827, " this", false]]]}, "raw_delta": -0.07609319686889648, "tuned_delta": -0.06752140483831824}, {"byte_start": 6771, "byte_end": 6783, "display": {"text": " discoveries", "kind": "normal"}, "is_word": true, "word_id": 1140, "word_key": " discoveries", "bytes_hex": "20 64 69 73 63 6f 76 65 72 69 65 73", "compression": {"rwkv": "7.75% 7.75% 7.75% 7.75% 7.75% 7.75% 7.75% 7.75% 7.75% 7.75% 7.75% 7.75%", "qwen": "9.32% 9.32% 9.32% 9.32% 9.32% 9.32% 9.32% 9.32% 9.32% 9.32% 9.32% 9.32%"}, "model_tokens": {"rwkv": [[63484, " discoveries", "normal", 0.0057210191152989864]], "qwen": [[52998, " discoveries", "normal", 0.002021820517256856]]}, "loss": {"rwkv": 7.748850317274705, "qwen": 9.323051232879088}, "topk": {"rwkv": [63484, 20, 0.0057210191152989864, [[59943, 0.27628, " knowledge", false], [22251, 0.116928, " own", false], [65034, 0.054143, " understanding", false], [38720, 0.05239, " human", false], [52224, 0.035159, " methods", false], [39026, 0.02814, " minds", false], [38735, 0.025784, " ideas", false], [32448, 0.021135, " ways", false], [57422, 0.015526, " thoughts", false], [57419, 0.014949, " thinking", false]]], "qwen": [52998, 43, 0.002021820517256856, [[1828, 0.254991, " own", false], [6540, 0.135437, " knowledge", false], [6708, 0.045557, " ideas", false], [8660, 0.039746, " understanding", false], [3738, 0.035428, " human", false], [5510, 0.035331, " ways", false], [11303, 0.032556, " thoughts", false], [1616, 0.026011, " way", false], [10502, 0.023597, " mental", false], [20062, 0.022822, " minds", false]]]}, "raw_delta": -0.08729223410288489, "tuned_delta": -0.07872044207230665}, {"byte_start": 6783, "byte_end": 6788, "display": {"text": " only", "kind": "normal"}, "is_word": true, "word_id": 1141, "word_key": " only", "bytes_hex": "20 6f 6e 6c 79", "compression": {"rwkv": "19.16% 19.16% 19.16% 19.16% 19.16%", "qwen": "16.08% 16.08% 16.08% 16.08% 16.08%"}, "model_tokens": {"rwkv": [[31581, " only", "normal", 0.0048307329416275024]], "qwen": [[1172, " only", "normal", 0.01158465538173914]]}, "loss": {"rwkv": 19.160793511806542, "qwen": 16.079101744403204}, "topk": {"rwkv": [31581, 26, 0.0048307329416275024, [[4600, 0.244198, " is", false], [4706, 0.158148, " of", false], [45, 0.077005, ",", false], [37598, 0.063804, " about", false], [30659, 0.038105, " does", false], [21265, 0.033634, " and", false], [32475, 0.032491, " will", false], [4811, 0.024898, " to", false], [4596, 0.017436, " in", false], [4423, 0.016009, " as", false]]], "qwen": [1172, 16, 0.01158465538173914, [[374, 0.245717, " is", false], [11, 0.078962, ",", false], [686, 0.051181, " will", false], [1558, 0.046048, " does", false], [323, 0.039916, " and", false], [315, 0.031096, " of", false], [1035, 0.030783, " would", false], [911, 0.028587, " about", false], [3643, 0.028279, " makes", false], [311, 0.022778, " to", false]]]}, "raw_delta": 0.17088527679443355, "tuned_delta": 0.1794570688250118}, {"byte_start": 6788, "byte_end": 6794, "display": {"text": " makes", "kind": "normal"}, "is_word": true, "word_id": 1142, "word_key": " makes", "bytes_hex": "20 6d 61 6b 65 73", "compression": {"rwkv": "6.15% 6.15% 6.15% 6.15% 6.15% 6.15%", "qwen": "6.56% 6.56% 6.56% 6.56% 6.56% 6.56%"}, "model_tokens": {"rwkv": [[38964, " makes", "normal", 0.12994173169136047]], "qwen": [[3643, " makes", "normal", 0.11284811794757843]]}, "loss": {"rwkv": 6.15211752462416, "qwen": 6.557386758844204}, "topk": {"rwkv": [38964, 1, 0.12994173169136047, [[38964, 0.129942, " makes", false], [38875, 0.107182, " leads", false], [40212, 0.035878, " works", false], [30965, 0.026222, " gets", false], [39719, 0.025822, " slows", false], [46441, 0.025509, " limits", false], [30109, 0.022043, " adds", false], [47237, 0.019422, " serves", false], [45691, 0.018412, " delays", false], [38989, 0.017752, " means", false]]], "qwen": [3643, 1, 0.11284811794757843, [[3643, 0.112848, " makes", false], [69170, 0.060295, " slows", false], [11508, 0.059239, " leads", false], [81220, 0.028288, " wastes", false], [17045, 0.026327, " serves", false], [27236, 0.024041, " tends", false], [13388, 0.023396, " limits", false], [31074, 0.022752, " delays", false], [9044, 0.020737, " becomes", false], [305, 0.02037, " h", false]]]}, "raw_delta": -0.022472898165384947, "tuned_delta": -0.013901106134806699}, {"byte_start": 6794, "byte_end": 6797, "display": {"text": " it", "kind": "normal"}, "is_word": true, "word_id": 1143, "word_key": " it", "bytes_hex": "20 69 74", "compression": {"rwkv": "11.04% 11.04% 11.04%", "qwen": "15.04% 15.04% 15.04%"}, "model_tokens": {"rwkv": [[4601, " it", "normal", 0.15805332362651825]], "qwen": [[432, " it", "normal", 0.0819397121667862]]}, "loss": {"rwkv": 11.036241360967004, "qwen": 15.03872193505929}, "topk": {"rwkv": [4601, 2, 0.15805332362651825, [[22590, 0.195645, " the", false], [4601, 0.158053, " it", false], [32229, 0.110917, " them", false], [47539, 0.109523, " things", false], [4835, 0.099885, " us", false], [22248, 0.060683, " our", false], [21700, 0.051691, " for", false], [32234, 0.032858, " this", false], [39936, 0.014263, " these", false], [39931, 0.013189, " their", false]]], "qwen": [432, 4, 0.0819397121667862, [[279, 0.208293, " the", false], [1105, 0.119184, " them", false], [601, 0.115135, " us", false], [432, 0.08194, " it", false], [1039, 0.061006, " our", false], [2513, 0.045762, " things", false], [5530, 0.041568, " sense", false], [369, 0.036062, " for", false], [1493, 0.033041, " these", false], [15235, 0.028617, " AI", false]]]}, "raw_delta": -0.22194465001424157, "tuned_delta": -0.21337285798366332}, {"byte_start": 6797, "byte_end": 6804, "display": {"text": " harder", "kind": "normal"}, "is_word": true, "word_id": 1144, "word_key": " harder", "bytes_hex": "20 68 61 72 64 65 72", "compression": {"rwkv": "1.46% 1.46% 1.46% 1.46% 1.46% 1.46% 1.46%", "qwen": "1.70% 1.70% 1.70% 1.70% 1.70% 1.70% 1.70%"}, "model_tokens": {"rwkv": [[46162, " harder", "normal", 0.5653967261314392]], "qwen": [[15750, " harder", "normal", 0.5171852707862854]]}, "loss": {"rwkv": 1.4591990857205617, "qwen": 1.6986549836390592}, "topk": {"rwkv": [46162, 1, 0.5653967261314392, [[46162, 0.565397, " harder", false], [31458, 0.125876, " more", false], [45819, 0.054833, " easier", false], [31048, 0.044501, " hard", false], [59516, 0.027494, " difficult", false], [62082, 0.024767, " impossible", false], [40216, 0.015173, " worse", false], [31277, 0.013237, " less", false], [56895, 0.01245, " possible", false], [30788, 0.010421, " even", false]]], "qwen": [15750, 1, 0.5171852707862854, [[15750, 0.517185, " harder", false], [803, 0.171217, " more", false], [5000, 0.047931, " difficult", false], [2588, 0.045289, " hard", false], [8661, 0.030418, " easier", false], [11997, 0.028264, " impossible", false], [1753, 0.02736, " much", false], [2686, 0.022846, " less", false], [10960, 0.009127, " worse", false], [1602, 0.008539, " very", false]]]}, "raw_delta": -0.013278254440852566, "tuned_delta": -0.004706462410274318}, {"byte_start": 6804, "byte_end": 6807, "display": {"text": " to", "kind": "normal"}, "is_word": true, "word_id": 1145, "word_key": " to", "bytes_hex": "20 74 6f", "compression": {"rwkv": "3.10% 3.10% 3.10%", "qwen": "4.58% 4.58% 4.58%"}, "model_tokens": {"rwkv": [[4811, " to", "normal", 0.5958136320114136]], "qwen": [[311, " to", "normal", 0.46676692366600037]]}, "loss": {"rwkv": 3.099540126909882, "qwen": 4.5801072380351435}, "topk": {"rwkv": [4811, 1, 0.5958136320114136, [[4811, 0.595814, " to", false], [21700, 0.310559, " for", false], [21265, 0.029345, " and", false], [45, 0.026034, ",", false], [47, 0.012896, ".", false], [38869, 0.005779, " later", false], [4596, 0.005435, " in", false], [4712, 0.001629, " on", false], [22187, 0.001515, " not", false], [275, 0.000943, " (", false]]], "qwen": [311, 2, 0.46676692366600037, [[369, 0.474168, " for", false], [311, 0.466767, " to", false], [11, 0.020797, ",", false], [323, 0.014098, " and", false], [304, 0.003788, " in", false], [382, 0.002963, ".\n\n", false], [13, 0.00262, ".", false], [2937, 0.002214, " later", false], [320, 0.001455, " (", false], [1091, 0.000865, " than", false]]]}, "raw_delta": -0.08210007349650067, "tuned_delta": -0.07352828146592243}, {"byte_start": 6807, "byte_end": 6811, "display": {"text": " see", "kind": "normal"}, "is_word": true, "word_id": 1146, "word_key": " see", "bytes_hex": "20 73 65 65", "compression": {"rwkv": "20.99% 20.99% 20.99% 20.99%", "qwen": "23.37% 23.37% 23.37% 23.37%"}, "model_tokens": {"rwkv": [[22449, " see", "normal", 0.009379914030432701]], "qwen": [[1490, " see", "normal", 0.005611109547317028]]}, "loss": {"rwkv": 20.99233995043511, "qwen": 23.367181732922425}, "topk": {"rwkv": [22449, 11, 0.009379914030432701, [[30858, 0.344819, " find", false], [56010, 0.330564, " discover", false], [31358, 0.039878, " make", false], [37923, 0.038278, " build", false], [4491, 0.02211, " do", false], [38877, 0.017383, " learn", false], [55851, 0.013285, " continue", false], [21751, 0.012672, " get", false], [31205, 0.011139, " keep", false], [39590, 0.01102, " scale", false]]], "qwen": [1490, 20, 0.005611109547317028, [[6997, 0.197757, " discover", false], [1477, 0.197086, " find", false], [1936, 0.079119, " build", false], [1281, 0.06395, " make", false], [653, 0.033076, " do", false], [5452, 0.029453, " scale", false], [633, 0.026675, " get", false], [7269, 0.024902, " improve", false], [3960, 0.022128, " learn", false], [11075, 0.018933, " achieve", false]]]}, "raw_delta": -0.131689190864563, "tuned_delta": -0.12311739883398475}, {"byte_start": 6811, "byte_end": 6815, "display": {"text": " how", "kind": "normal"}, "is_word": true, "word_id": 1147, "word_key": " how", "bytes_hex": "20 68 6f 77", "compression": {"rwkv": "10.99% 10.99% 10.99% 10.99%", "qwen": "7.47% 7.47% 7.47% 7.47%"}, "model_tokens": {"rwkv": [[21835, " how", "normal", 0.0870790183544159]], "qwen": [[1246, " how", "normal", 0.19070583581924438]]}, "loss": {"rwkv": 10.9892786317714, "qwen": 7.470559278009971}, "topk": {"rwkv": [21835, 4, 0.0870790183544159, [[22590, 0.220887, " the", false], [32464, 0.159291, " what", false], [32229, 0.122784, " them", false], [21835, 0.087079, " how", false], [22168, 0.050593, " new", false], [32227, 0.028315, " that", false], [21265, 0.024995, " and", false], [22248, 0.022659, " our", false], [51816, 0.019781, " further", false], [39936, 0.018033, " these", false]]], "qwen": [1246, 3, 0.19070583581924438, [[1128, 0.219279, " what", false], [279, 0.196197, " the", false], [1246, 0.190706, " how", false], [429, 0.055472, " that", false], [1380, 0.043963, " where", false], [1039, 0.03091, " our", false], [1105, 0.026745, " them", false], [501, 0.020996, " new", false], [323, 0.014204, " and", false], [979, 0.012656, " when", false]]]}, "raw_delta": 0.1951192319393158, "tuned_delta": 0.20369102396989405}, {"byte_start": 6815, "byte_end": 6819, "display": {"text": " the", "kind": "normal"}, "is_word": true, "word_id": 1148, "word_key": " the", "bytes_hex": "20 74 68 65", "compression": {"rwkv": "11.27% 11.27% 11.27% 11.27%", "qwen": "10.42% 10.42% 10.42% 10.42%"}, "model_tokens": {"rwkv": [[22590, " the", "normal", 0.08182871341705322]], "qwen": [[279, " the", "normal", 0.0990520566701889]]}, "loss": {"rwkv": 11.271055006945026, "qwen": 10.423967358819077}, "topk": {"rwkv": [22590, 2, 0.08182871341705322, [[4811, 0.492341, " to", false], [22590, 0.081829, " the", false], [32232, 0.076447, " they", false], [4858, 0.075743, " we", false], [22248, 0.049603, " our", false], [31466, 0.032162, " much", false], [39936, 0.016714, " these", false], [3609, 0.011668, " AI", false], [39944, 0.011616, " those", false], [21660, 0.00751, " far", false]]], "qwen": [279, 3, 0.0990520566701889, [[311, 0.27446, " to", false], [582, 0.129452, " we", false], [279, 0.099052, " the", false], [807, 0.088681, " they", false], [1039, 0.063842, " our", false], [1753, 0.028114, " much", false], [1493, 0.026621, " these", false], [15235, 0.02435, " AI", false], [3041, 0.021774, " far", false], [2513, 0.01097, " things", false]]]}, "raw_delta": 0.04697251319885254, "tuned_delta": 0.05554430522943079}, {"byte_start": 6819, "byte_end": 6831, "display": {"text": " discovering", "kind": "normal"}, "is_word": true, "word_id": 1149, "word_key": " discovering", "bytes_hex": "20 64 69 73 63 6f 76 65 72 69 6e 67", "compression": {"rwkv": "11.18% 11.18% 11.18% 11.18% 11.18% 11.18% 11.18% 11.18% 11.18% 11.18% 11.18% 11.18%", "qwen": "11.51% 11.51% 11.51% 11.51% 11.51% 11.51% 11.51% 11.51% 11.51% 11.51% 11.51% 11.51%"}, "model_tokens": {"rwkv": [[63485, " discovering", "normal", 0.0005939074908383191]], "qwen": [[41587, " discovering", "normal", 0.00047218933468684554]]}, "loss": {"rwkv": 11.177129548553818, "qwen": 11.508694901152227}, "topk": {"rwkv": [63485, 113, 0.0005939074908383191, [[37636, 0.196601, " agent", false], [40213, 0.071975, " world", false], [45124, 0.064665, " agents", false], [3609, 0.052615, " AI", false], [52224, 0.049005, " methods", false], [63484, 0.043441, " discoveries", false], [59544, 0.038573, " discovery", false], [31427, 0.034552, " mind", false], [52391, 0.024791, " outside", false], [31835, 0.018326, " real", false]]], "qwen": [41587, 131, 0.00047218933468684554, [[1879, 0.122462, " world", false], [8315, 0.114564, " agent", false], [15235, 0.097821, " AI", false], [13009, 0.080342, " agents", false], [52998, 0.069388, " discoveries", false], [18335, 0.04886, " discovery", false], [5413, 0.035019, " methods", false], [1849, 0.023291, " system", false], [11105, 0.023193, " discovered", false], [1931, 0.017734, " real", false]]]}, "raw_delta": -0.018385887145996094, "tuned_delta": -0.009814095115417846}, {"byte_start": 6831, "byte_end": 6839, "display": {"text": " process", "kind": "normal"}, "is_word": true, "word_id": 1150, "word_key": " process", "bytes_hex": "20 70 72 6f 63 65 73 73", "compression": {"rwkv": "7.01% 7.01% 7.01% 7.01% 7.01% 7.01% 7.01% 7.01%", "qwen": "6.32% 6.32% 6.32% 6.32% 6.32% 6.32% 6.32% 6.32%"}, "model_tokens": {"rwkv": [[52571, " process", "normal", 0.04456682130694389]], "qwen": [[1882, " process", "normal", 0.06064356863498688]]}, "loss": {"rwkv": 7.009187332443938, "qwen": 6.317970785469655}, "topk": {"rwkv": [52571, 4, 0.04456682130694389, [[37636, 0.17422, " agent", false], [4600, 0.127275, " is", false], [21413, 0.088979, " can", false], [52571, 0.044567, " process", false], [22748, 0.034697, " was", false], [51896, 0.031748, " happens", false], [45124, 0.030507, " agents", false], [52224, 0.027709, " methods", false], [40212, 0.026038, " works", false], [38128, 0.024057, " could", false]]], "qwen": [1882, 7, 0.06064356863498688, [[646, 0.159018, " can", false], [1410, 0.095712, " could", false], [8315, 0.08047, " agent", false], [4278, 0.076773, " works", false], [374, 0.075503, " is", false], [1265, 0.065869, " should", false], [1882, 0.060644, " process", false], [3520, 0.036977, " actually", false], [5413, 0.026838, " methods", false], [572, 0.026468, " was", false]]]}, "raw_delta": 0.03832918405532837, "tuned_delta": 0.04690097608590662}, {"byte_start": 6839, "byte_end": 6843, "display": {"text": " can", "kind": "normal"}, "is_word": true, "word_id": 1151, "word_key": " can", "bytes_hex": "20 63 61 6e", "compression": {"rwkv": "8.38% 8.38% 8.38% 8.38%", "qwen": "9.65% 9.65% 9.65% 9.65%"}, "model_tokens": {"rwkv": [[21413, " can", "normal", 0.15695399045944214]], "qwen": [[646, " can", "normal", 0.11752419918775558]]}, "loss": {"rwkv": 8.382847161415363, "qwen": 9.653031478712043}, "topk": {"rwkv": [21413, 2, 0.15695399045944214, [[40212, 0.273946, " works", false], [21413, 0.156954, " can", false], [46342, 0.129513, " itself", false], [38128, 0.071819, " could", false], [39021, 0.063477, " might", false], [4600, 0.050706, " is", false], [47266, 0.02204, " should", false], [22074, 0.016739, " may", false], [55448, 0.014839, " actually", false], [40219, 0.013969, " would", false]]], "qwen": [646, 2, 0.11752419918775558, [[4278, 0.37059, " works", false], [646, 0.117524, " can", false], [5086, 0.064597, " itself", false], [1410, 0.063524, " could", false], [1265, 0.060406, " should", false], [3520, 0.059734, " actually", false], [2578, 0.044, " might", false], [374, 0.037924, " is", false], [2167, 0.033396, " really", false], [1035, 0.018969, " would", false]]]}, "raw_delta": -0.07043397426605225, "tuned_delta": -0.061862182235473996}, {"byte_start": 6843, "byte_end": 6846, "display": {"text": " be", "kind": "normal"}, "is_word": true, "word_id": 1152, "word_key": " be", "bytes_hex": "20 62 65", "compression": {"rwkv": "4.72% 4.72% 4.72%", "qwen": "5.28% 5.28% 5.28%"}, "model_tokens": {"rwkv": [[4435, " be", "normal", 0.45496514439582825]], "qwen": [[387, " be", "normal", 0.4152001440525055]]}, "loss": {"rwkv": 4.719754284158229, "qwen": 5.283838389237209}, "topk": {"rwkv": [4435, 1, 0.45496514439582825, [[4435, 0.454965, " be", false], [32499, 0.110847, " work", false], [55851, 0.059037, " continue", false], [52570, 0.054745, " proceed", false], [39590, 0.034829, " scale", false], [4559, 0.034412, " go", false], [46342, 0.020426, " itself", false], [46159, 0.015287, " happen", false], [30858, 0.013899, " find", false], [39166, 0.010863, " occur", false]]], "qwen": [387, 1, 0.4152001440525055, [[387, 0.4152, " be", false], [975, 0.147852, " work", false], [10354, 0.076191, " proceed", false], [3060, 0.061021, " continue", false], [5452, 0.036785, " scale", false], [728, 0.034755, " go", false], [5086, 0.013146, " itself", false], [11996, 0.013124, " succeed", false], [1477, 0.012888, " find", false], [3537, 0.01178, " happen", false]]]}, "raw_delta": -0.03127946456273395, "tuned_delta": -0.0227076725321557}, {"byte_start": 6846, "byte_end": 6851, "display": {"text": " done", "kind": "normal"}, "is_word": true, "word_id": 1153, "word_key": " done", "bytes_hex": "20 64 6f 6e 65", "compression": {"rwkv": "11.83% 11.83% 11.83% 11.83% 11.83%", "qwen": "11.39% 11.39% 11.39% 11.39% 11.39%"}, "model_tokens": {"rwkv": [[30666, " done", "normal", 0.03751043975353241]], "qwen": [[2814, " done", "normal", 0.04250689595937729]]}, "loss": {"rwkv": 11.834607757292277, "qwen": 11.390398067945}, "topk": {"rwkv": [30666, 4, 0.03751043975353241, [[59203, 0.222051, " automated", false], [31351, 0.096987, " made", false], [56418, 0.079672, " improved", false], [30666, 0.03751, " done", false], [63594, 0.037476, " generalized", false], [56189, 0.027683, " extended", false], [38547, 0.027383, " found", false], [55689, 0.023901, " captured", false], [47180, 0.017846, " scaled", false], [61885, 0.017119, " discovered", false]]], "qwen": [2814, 5, 0.04250689595937729, [[27498, 0.193687, " automated", false], [1865, 0.114809, " made", false], [12944, 0.06158, " improved", false], [30690, 0.057649, " scaled", false], [2814, 0.042507, " done", false], [66117, 0.037587, " generalized", false], [11577, 0.030584, " extended", false], [8570, 0.022971, " continued", false], [85610, 0.02253, " sped", false], [11691, 0.020541, " carried", false]]]}, "raw_delta": 0.02463221549987793, "tuned_delta": 0.03320400753045618}, {"byte_start": 6851, "byte_end": 6853, "display": {"text": ".\n", "kind": "control"}, "is_word": false, "word_id": null, "word_key": null, "bytes_hex": "2e 0a", "compression": {"rwkv": "31.56% 98.06%", "qwen": "45.90% 45.90%"}, "model_tokens": {"rwkv": [[47, ".", "normal", 0.17631813883781433], [11, "\n", "control", 0.0042694928124547005]], "qwen": [[624, ".\n", "control", 0.006153350230306387]]}, "loss": {"rwkv": 64.80856628993389, "qwen": 45.90257367451315}, "topk": {"rwkv": [47, 1, 0.17631813883781433, [[47, 0.176318, ".", false], [4450, 0.157159, " by", false], [4596, 0.101813, " in", false], [45, 0.079992, ",", false], [45301, 0.074809, " better", false], [31458, 0.039277, " more", false], [64839, 0.029597, " automatically", false], [32458, 0.027295, " well", false], [4424, 0.026983, " at", false], [53356, 0.01883, " without", false]]], "qwen": [624, 20, 0.006153350230306387, [[553, 0.132295, " by", false], [13, 0.127566, ".", false], [304, 0.122575, " in", false], [382, 0.113753, ".\n\n", false], [11, 0.091856, ",", false], [2664, 0.084548, " better", false], [803, 0.043739, " more", false], [9463, 0.017869, " automatically", false], [29720, 0.016849, " efficiently", false], [1632, 0.016194, " well", false]]]}, "raw_delta": 1.0483708381652832, "tuned_delta": 1.0569426301958615}], "meta": {"model_a": "RWKV7-G1F-1.5B", "model_b": "Qwen3-1.7B-Base", "avg_compression": {"rwkv": 9.315505162073826, "qwen": 9.47008618524935}, "avg_delta": -0.008571792030578248, "avg_delta_compression": -0.1545810231755847}}</script>
     <script>
         const svgOverlay = document.getElementById('svg-overlay');
         const content = document.querySelector('.content');