Add files using upload-large-folder tool

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_4096steps_n64/state_c1024_t1p45_detok_raw_samples.txt

@@ -0,0 +1,228 @@
+state_c1024_t1p45_detok
+{
+  "type": "summary",
+  "name": "state_c1024_t1p45",
+  "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt",
+  "step": 124000,
+  "decode": {
+    "kind": "categorical_fullvocab",
+    "config": "state_c1024_t1p45",
+    "steps": 4096,
+    "model_t_mode": "post",
+    "support_power": 1.0,
+    "semantic_power": 1.0,
+    "endpoint_temp": 1.45,
+    "concentration_min": 1.0,
+    "concentration_max": 1024.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 14.379869187838807,
+    "nll_per_token": 2.6658292554392022,
+    "tokens": 9069
+  },
+  "diversity": {
+    "sample_entropy": 3.7611245679001697,
+    "unique_tokens": 796,
+    "token_count": 8192,
+    "distinct_1": 0.09716796875,
+    "distinct_2": 0.32258858267716534,
+    "top_token_mass": 0.0748291015625
+  }
+}
+
+===== sample 000 =====
+[CLS] place. [SEP] "we're going to do that, and we're going to do that, but it will take a lot of work before we get there," he said. [SEP] and if he had gone too far, the answer would not have been easy. [SEP] "i haven't seen it before," he said. [SEP] washington, march 4/prnewswire - usnewswire/- - the u. s. agency for international development (usa), which represents haiti, announced today the u. s. government will work with the united states to increase the flow of food aid through [SEP]
+
+===== sample 001 =====
+[CLS]. 8 percent to 4, 293. 40. [SEP] ibm (ibmm. n: quote, profile, research) (ibm. n: quote, profile, research) on thursday reported 3. 8 billion yen ($12. 5 million) in net profit for the three months to march, compared with a loss of 5. 5 billion yen ($87 million) a year earlier. [SEP] "i'm not going to do anything and don't want to do anything else," he said at the time. [SEP] we need to resolve these problems, "he said. [SEP]" i don't think we [SEP]
+
+===== sample 002 =====
+[CLS] made it 65 - 65 at the end of the third quarter when he hit a 3 - pointer to cut the lead to 50 - 41. [SEP] "i'm trying to do that," he said, while refusing to say what would happen after obama's victory. [SEP] "i'm not going to talk about it. [SEP]" if we're going to get things done, we don't get things done, "he said. [SEP] you've got to get better," he said. [SEP] the 50 - year - old is due to face trial in the next few days. [SEP] he was also [SEP]
+
+===== sample 003 =====
+[CLS] iranians. [SEP] "i've been with him for the last couple of years, you know, and i've never seen him," he said. [SEP] "i'm jewish, i'm not a muslim, i'm not jewish, i don't want to be jewish." [SEP] a council spokesman said it was time to raise the issue. [SEP] washington (reuters) - exports to u. s. rose 0. 3 percent in the u. s. in january compared with a year earlier, according to the u. s. commerce department on friday. [SEP] the u. n. security [SEP]
+
+===== sample 004 =====
+[CLS] for the first time since 2001. [SEP] "i do not know if we won't be able to get this thing done again, i don't know if we're going to get it done, but i think it's going to be hard for us to do that," he said. [SEP] "i think it's a great shame that we don't do anything, we don't talk. [SEP]" i don't want to get out of my way, " she said. [SEP] to give them a chance to win, he said, he wanted them to stay in the game. [SEP] [SEP]
+
+===== sample 005 =====
+[CLS] "at the end of the day, i've never had any problems," she said. [SEP] "we don't have much to do with it yet," he said. [SEP] "that's something we don't want to talk about, we'd like to know," he said, referring to obama's speech. [SEP] 21 (upi) - - justin verlander drove in a three - run run, leading the chicago cubs to a 5 - 2 decision over the san diego padres. [SEP] " i don't think we should have any idea what it's going to be [SEP]
+
+===== sample 006 =====
+[CLS]. [SEP] "i don't want to get back on the plane. [SEP]" if we're serious about our health, that's what we really need to do. [SEP] "i think i've been lucky in my life. [SEP]" i think they don't want to know how much money they'll spend on it, "he said. [SEP] according to the u. s. state department, the contract is worth $6. 4 billion and could add $2. 5 billion to the total. [SEP]" i always felt that i needed to be able to play, " he said. [SEP] and [SEP]
+
+===== sample 007 =====
+[CLS] new york. [SEP] "i don't think we have the money to do that, we've got a lot of work to do the job," he said. [SEP] "we didn't want to get here," he said. [SEP] our total revenues were $0. 2 million, up 11 % from the year - ago quarter. revenue for the second quarter of 2009 increased to $4. 7 million in the second quarter, compared to total revenue of $5. 3 million, up 5. 6 % from the second quarter of last year. [SEP] " we've got to do more than we can [SEP]
+
+===== sample 008 =====
+[CLS] this report. [SEP] "it's a long shot, but it's going to make a big difference," he said at a news conference. [SEP] "it's not something that is necessary," she told reporters. [SEP] i think they've done it well, they haven't done enough. [SEP] "i know i'm going to be fine this week, but i know i can't," he said. [SEP] " however, it's not going to be a tough decision, he has to deal with it. [SEP] it's a whole lot of fun, you can't [SEP]
+
+===== sample 009 =====
+[CLS]. 4 million from 5. 7 million a year ago. 3 % from $3. 3 million in 2006. $2. 0 million in 2007. in the u. s. from $2. 8 million a year ago. [SEP] "i don't want to make any mistakes," he said. [SEP] "he's going to do that, and if he's not going to do that, i don't know if he's going to do that," he said. [SEP] "it's a little scary, it's a little scary, it's real," he said [SEP]
+
+===== sample 010 =====
+[CLS]. 9 million ($0. 14 per share), as compared to operating income of $0. 8 million in the second quarter of 2008. operating income rose to $11. 8 million ($0. 15) in the second quarter from $9. 8 million, or $0. 10 per share, in the second quarter of 2008. compared to $7. 7 million, or $5. 5 million, in the second quarter of 2008. in the second quarter of 2009 compared to $14. 8 million reported in the second quarter of the second quarter of 2008. $5 million in the second quarter of [SEP]
+
+===== sample 011 =====
+[CLS] t want to do anything wrong, "he said. [SEP]" i'm trying to make things look good, "she said. [SEP]" if we don't do the same, we will have to do more, "he said. [SEP] if they can't get a mortgage, they'll have to pay for it. [SEP] the road was closed. [SEP]" we don't have the money to do that, " he said. [SEP] washington (cnn) - - u. s. secretary of state hillary clinton said the united states will continue to work to increase its support to the wars in iraq and afghanistan [SEP]
+
+===== sample 012 =====
+[CLS] ve ever seen, "he said. [SEP]" they don't have the money to pay for it, "he said. [SEP] i'm going to have to do that. [SEP]" i don't think there's much that i'm going to do, and i don't think that's enough, "he said. [SEP]" i thought about my retirement and i thought i wasn't there, "he said. [SEP]" i'm not going to let them down, " she said. [SEP] and i'm sure it's a good thing. [SEP] the s & p 500 [SEP]
+
+===== sample 013 =====
+[CLS] 9 a. m. to 5: 30 p. m. to 1: 30 p. m. [SEP] "that's just something i don't understand," he said. [SEP] "we don't need to get serious about what we have to do to get things done," he said. [SEP] "you don't have to make a lot of money," he said. [SEP] "to be honest, i'm not going to tell you," he said. [SEP] "i don't think that would be the last thing they wanted to do," he said. [SEP] the military said [SEP]
+
+===== sample 014 =====
+[CLS]. [SEP] washington, march 2 (upi) - - sales of u. s. single - family homes rose 0. 3 percent in the third quarter, the u. s. government said. [SEP] washington, march 19 (upi) - - the u. s. economy contracted by a hefty 0. 5 percent in the second quarter, the u. s. government said tuesday. [SEP] that's what it means to me when i'm young. [SEP] "it's hard to know what's right," he said. [SEP] there's a lot of tension in the room. [SEP] [SEP]
+
+===== sample 015 =====
+[CLS] the site. [SEP] it's not going to be a problem, but it's something that's where i'm concerned. [SEP] the dow jones industrial average rose 10. 22 points, or 0. 5 percent, to 10, 086. 50. [SEP] cleveland used a 12 - 2 run to cut it to 80 - 65 with 4: 36 left in the half. [SEP] we've got a lot of money to spend, so i'll tell you we don't have to spend a lot. [SEP] "it's not going to last that long," he said. [SEP] in addition, [SEP]
+
+===== sample 016 =====
+[CLS] minutes left in the first quarter. [SEP] "i'm not going to have to tell you how i'm going to do it," he said. [SEP] "if we don't have the things we're paying for, we'll have to pay for things we don't need," bernanke said. [SEP] "but i don't think we'll be back to the end of the season if we don't do the right thing," he said. [SEP] "i just don't want to go to school. [SEP]" we've got to win, " he said [SEP]
+
+===== sample 017 =====
+[CLS] second inning in new york's 3 - 2 win over the rockies. [SEP] but on the other hand, they still have work to do. [SEP] "we have to have a clear understanding of what we have to do, and i think what we'll have to do in the future," he said. [SEP] "i don't think there will be much worse," he said. [SEP] but if we don't do that, we're going to do that. [SEP] "i don't know about it," he said. [SEP] i'm trying to get things done, " he said. [SEP]
+
+===== sample 018 =====
+[CLS] companies. [SEP] there was no sign of significant damage to the building. [SEP] "if you don't want to win, you have to make some effort to do that," he said. [SEP] i'm not going to do that, but i'm not going to do that, "he said at a news conference. [SEP]" i'm not sure if it is going to be a deal, but it's going to be a lot more than that, " he said. [SEP] he's a great president, but it won't work. [SEP] i'm glad that some people don't [SEP]
+
+===== sample 019 =====
+[CLS] when i was on the plane. [SEP] i did not know. [SEP] "that's the first decision we have to make," he said. [SEP] i don't know what we can do right now, but you have to get back to the top flight and get to the top. [SEP] the index of home prices rose to 22. 2 in 2009 from 22. 5 percent in 2008. [SEP] "if you can't be a writer, you have to be a writer, you have to be a good person, you're a writer, you have to be a good person. [SEP]" i'm glad [SEP]
+
+===== sample 020 =====
+[CLS] since 2001. [SEP] "there's a lot of work to do, and if you don't need to do that, you have to get out of the way," he said. [SEP] washington, march 18 (upi) - - the u. s. military has become the focus of a new u. s. strategy for the war in afghanistan, a u. s. official said. [SEP] "he said he didn't talk about it because he didn't want to talk about it. [SEP]" i don't think we're going to get any better, " he said. [SEP] the [SEP]
+
+===== sample 021 =====
+[CLS], 2009. [SEP] buffalo, n. y., jan. [SEP] 21 (upi) - - u. s. crude inventories fell 500, 000 in november from a year ago, the u. s. energy department said friday. [SEP] "we don't know about him, we don't know him," he told the station. [SEP] "if the government doesn't want to protect us, something's wrong," he said. [SEP] "i do love to see him, i don't want to tell him what he wants," he said. [SEP] " i don't think [SEP]
+
+===== sample 022 =====
+[CLS] said. [SEP] "we've got to do that, and we've got to be able to do that," he told reporters. [SEP] he's a nice guy, but i don't know him, i don't know. [SEP] "it's really hard to see what's going to happen today, but we're sure we don't have to change the way we're going," he said. [SEP] "you don't want to talk to a lot of people, you don't want to change anything," he said. [SEP] " i don't think [SEP]
+
+===== sample 023 =====
+[CLS] 7 million, up 5. 4 % from the second quarter of 2006 and 7. 5 % from the third quarter of 2006, up 4 % from the second quarter of 2006. revenue of $7. 8 million was $7. 1 million, up 17 % from the third quarter of 2006. compared to the second quarter of 2007, the second quarter of revenue was $15. 2 million, up $4. 8 million, from $12. 4 million in the third quarter a year earlier. [SEP] "it's important, it's important to you," he said. [SEP] washington (ap) - - [SEP]
+
+===== sample 024 =====
+[CLS] million, compared to $7. 4 million in the second quarter of 2008. the company reported a gross operating loss of $3. 0 million compared to gross income of $4. 1 million in the second quarter of 2008 and $7. 8 million of revenue in the second quarter of 2007 and the year ended december 31, 2007. gross operating income was $7. 9 million or 3. 3 % at march 31, 2008 compared to $9. 3 million in the first nine months of 2007. [SEP] what's true is that you don't have the money to look at it and sort it out. [SEP] [SEP]
+
+===== sample 025 =====
+[CLS] to try to win. [SEP] "i don't want to hurt him," he said. [SEP] it doesn't surprise me, "he said. [SEP]" if so, they wouldn't have had the opportunity to do that, "he said. [SEP]" we're not talking about that, but it's hard to say, "he said. [SEP]" it's going to make a lot of money for us, "he said. [SEP]" i don't know why. "[SEP]" we're not going to do anything, that's the goal, " he said. [SEP] [SEP]
+
+===== sample 026 =====
+[CLS] from 52. 3 % to 47. 3 %. [SEP] 5 (upi) - - u. s. president barack obama and president bill clinton met at the white house for a two - day visit, the white house said. [SEP] "it's going to be tough," he said. [SEP] he declined to comment. [SEP] "it's a very bad thing," he said. [SEP] "i don't know, i don't think we're talking about it," he said. [SEP] "i'm not going back," he said. [SEP] new york, march 15 ( up [SEP]
+
+===== sample 027 =====
+[CLS] i'm wrong, "he said. [SEP]" i do not think there is a lot of pressure in the kind of situation that we have to deal with, "he said. [SEP]" we've got to help, we can't do anything, we can do anything, we don't want to do anything. [SEP] but he added that we were trying to make sure that we don't have the money to invest, " the statement said. [SEP] so, i mean, i know, i'm a muslim, i'm not a muslim, i'm a muslim, i don't [SEP]
+
+===== sample 028 =====
+[CLS] a loss of $4. 4 million, compared with a loss of $12. 5 million and a loss of $11. 7 million in the same period a year earlier. [SEP] staff writer stephen king contributed to this report. [SEP] "he's right and i don't think that you don't need to talk about it," he said. [SEP] "i know i don't know what's going on with them. [SEP] a year ago, revenue fell 4 percent to $1. 27 billion from 1. 24 billion. [SEP]" there's no way i can go to see him, " [SEP]
+
+===== sample 029 =====
+[CLS] do so. "[SEP] i think it would be a good thing for them. [SEP] what do you want to do to make sure that you are going to be able to do the job, even if you don't have the money to do that? [SEP]" you know what i'm going to do with my son, "he said. [SEP]" we don't have enough money, so i don't know if anything is going to help, "he said of the program. [SEP]" when you have children, you don't have a lot of work to do, " she said. [SEP] however, [SEP]
+
+===== sample 030 =====
+[CLS] u. s. troops. [SEP] "i knew we wouldn't do it again, but i knew we'd have to do the same thing," he said. [SEP] 21 (upi) - - industrial production in the united states fell 0. 3 percent in the third quarter, a u. s. department of energy report released thursday showed. [SEP] however, it's true, we have a different kind of legal system. [SEP] "we're going to be able to do a lot of things, but we're going to do what we have to do," he said. [SEP] it's [SEP]
+
+===== sample 031 =====
+[CLS] going to have to think about what's good, "palin said. [SEP] he's going to change things. [SEP]" no, i don't want to say i'm not going to fly, "he said. [SEP] apple's shares fell $1. 14, or 7. 5 percent, to $28. 40 in the first three months of the year. [SEP] he's the best player in the world, he's the best player these days, he's going to win gold. [SEP]" that's the thing to do, " he said. [SEP] i think we are [SEP]
+
+===== sample 032 =====
+[CLS] times a day. [SEP] associated press writers david d. kennedy in buffalo, n. y., and robert f. kennedy in buffalo, n. y., contributed to this report. [SEP] "i'd like to have to pay attention to what i've done," she said. [SEP] "we don't have to do what we always do, but if we can do the job, we don't have to do anything," he said. [SEP] i know he's a bad guy, but i don't want to know how he's doing what he's doing. [SEP] the [SEP]
+
+===== sample 033 =====
+[CLS] intelligence agency. [SEP] it's a big deal, "he said. [SEP]" i don't want to change, "he said. [SEP]" there's one thing we know, but we don't know where we are, and we don't know where, "he said. [SEP]" if i want to be successful, i have to be careful, "he said. [SEP]" i'm not sure we're talking about it, but i don't think that we would want to make do with that, "he told reporters. [SEP]" i don't think i didn't [SEP]
+
+===== sample 034 =====
+[CLS] to 66 - 65 with 10: 41 in the third quarter, including three 3 - pointers for a 50 - 37 lead. [SEP] "it's going to take a couple of days, but it hasn't been easy," he said. [SEP] new york (reuters) - the u. s. economy in the u. s. grew 0. 5 percent in the third quarter, down 0. 3 percent from the second quarter of 2008, while the rate of decline grew to 0. 4 percent in the second quarter, the bank said. [SEP] " i'm really sorry that he didn't know how [SEP]
+
+===== sample 035 =====
+[CLS] sun reported on monday. [SEP] "i don't know how much, but i don't know much," he said. [SEP] "we've got to be careful. [SEP]" if it's not going to be enough, that's what we're going to have to do, "he said. [SEP]" i feel like i don't have enough, " he said. [SEP] the dow fell 25. 53 points, or 2. 4 percent, to 11, 365. 15. [SEP] the company's stock rose $14. 50, or 3. 4 percent, to $34. [SEP]
+
+===== sample 036 =====
+[CLS] [SEP] "i don't think there's much work to do. [SEP]" right now we'll never get anything done, "he said. [SEP] i'm not sure that has anything to do with that. [SEP]" it is very important for us to move so quickly to address the challenges of the economy, "mr buffett said. [SEP]" i've never had an open race, but i don't know, "he said. [SEP]" i'm not sure, i don't know him, i don't know what to do with him. [SEP] and it's not a [SEP]
+
+===== sample 037 =====
+[CLS] u. s., the u. s. and its allies. [SEP] "it's a lot of fun, and it's a lot of fun," he said of the course. [SEP] the tory leader said: "i think we can get things right. [SEP] for now, however, we have to be careful about the future. [SEP]" we'll have to know we don't have the time to talk, "he said. [SEP]" i don't think we'll have to wait, but i think that's a good thing to do, " he said. [SEP] don't [SEP]
+
+===== sample 038 =====
+[CLS] by gwen robinson on monday, may 18th, 2009 at 5: 40 am (est). [SEP] i don't want to go any further away from the truth. [SEP] at 5: 57 of the first period, new york scored twice in the first period to take a 3 - 2 lead at 5: 14 of the second. [SEP] that's what we're doing. [SEP] "i don't know what i want to do, but what i'm going to do," hawley said. [SEP] "i don't think it will have a significant impact on me," he said. [SEP] the [SEP]
+
+===== sample 039 =====
+[CLS] $1. 7 billion a year earlier. [SEP] "i don't know what i'm doing," he said. [SEP] "i don't think we're really talking about it right now, and we're not talking about that," he said. [SEP] 2 (upi) - - the u. s. defense department has contracted u. s. armed forces to support u. s. military operations, the defense department said monday. [SEP] "there is going to be a lot of work to do right now," he said. [SEP] 21 (upi) - - u. s. [SEP]
+
+===== sample 040 =====
+[CLS] "he said. [SEP] it's very hard to say there is a solution. [SEP]" i'm not going to be married, i'm not married, "he said. [SEP]" if you don't do that, it's very tough, "he said. [SEP] i'm very excited about that," he said. [SEP] i don't want to talk about it, i don't want to talk about it, "he told afp. [SEP]" i think if there are only a couple of things, it's just one way to get a job, " he said. [SEP]
+
+===== sample 041 =====
+[CLS], the team's 2008 first - round pick. [SEP] 11 (upi) - - u. s. president barack obama is considering adding more u. s. troops to u. s. military operations, the white house said. [SEP] "he's a great man, i think he's a great person," he said. [SEP] "we're not going to be able to pass a bill that will extend coverage to the poor," he said. [SEP] "i want to leave, i don't want to leave. [SEP]" i know i'm going to do it again, " he [SEP]
+
+===== sample 042 =====
+[CLS] china in the face of weak u. s. economic growth. [SEP] "he's got to be a good player at the moment," beckham said. [SEP] i'm not talking about it anymore, i'm talking about it, but i don't think that would be the case, "beckham said. [SEP]" it's too early to tell whether i am going to be ready for another year, "he said. [SEP]" i don't think we can't get any better, "he said. [SEP]" i'm not going to come back, " he said. [SEP] [SEP]
+
+===== sample 043 =====
+[CLS] have to pay. [SEP] "it's a good idea," said michael martin, the site's marketing director. [SEP] but i don't think that's true. [SEP] "i don't want things to happen here," he said. [SEP] "i don't feel like what you do, i don't like what you really do," she said. [SEP] "i think it's a small step, i think it will have an impact on our health," nader said at a private news conference. [SEP] " i mean, you don't really feel like you're [SEP]
+
+===== sample 044 =====
+[CLS] end of the year. [SEP] "it's not possible at all," he told reporters. [SEP] third - quarter operating income increased $2. 7 million, up $1. 2 million, or 4. 5 percent, to $80. 6 million, and operating income increased $9. 7 million, or 3. 5 percent, to $80. 8 million, up $1. 8 million, or 4 percent, to $15. 6 million. [SEP] "i don't think we're going to have a general election," he said. [SEP] " i don't want to make any decisions [SEP]
+
+===== sample 045 =====
+[CLS] at the end of the year. "[SEP] december retail sales also rose at an annual rate of 0. 3 percent, as compared to december's gain of 0. 3 percent. [SEP] i didn't know anything about it. [SEP]" i think we'll see if we'll change a lot and if we'll try to change things, " he told the associated press. [SEP] in early trading in tokyo, the index was down 5. 54, or 0. 3 percent, at 9, 319. 17. [SEP] (ap) - - the commerce department says retail sales rose 0. 1 percent in july [SEP]
+
+===== sample 046 =====
+[CLS] washington, march 6 (upi) - - u. s. health care spending in the third quarter rose 6. 3 percent to $11. 4 billion, the u. s. government said. [SEP] china's trade deficit will total almost $100 billion this year. [SEP] "i don't think he's going to win this election, he's a very good guy, he's a good guy, he doesn't win," clinton said at a news conference. [SEP] "there's little else we can do to change that," he said. [SEP] los angeles (ap) - [SEP]
+
+===== sample 047 =====
+[CLS] £78, 000. [SEP] buffalo, n. y., march 2 (upi) - - scott rolen hit a two - run homer, carrying the chicago cubs to an 8 - 5 win over the new york yankees. [SEP] i'm going to talk about it, but i'm not going to talk, "he said. [SEP] the cavaliers led 50 - 50 with a 7 - 4 run in the first half of the third quarter, including a 2 - 7 run that gave the cavaliers a 50 - 36 lead in the second quarter. [SEP]" i don't think it's going to change [SEP]
+
+===== sample 048 =====
+[CLS] 25 years. [SEP] "it's not a good place to do it and you don't have to do it. [SEP]" we've got more work to do. [SEP] 16/prnewswire - usnewswire/- - the u. s. dollar. $6. 0 million compared to $6. 1 million in the second quarter of 2006. from $2. 5 million in the second quarter of 2006. compared to a loss of $2. 9 million in the third quarter of 2006. same loss in the second quarter of 2006. $5. 5 million in the second quarter of [SEP]
+
+===== sample 049 =====
+[CLS] we are going to see a lot of growth, "he said. [SEP]" i don't know what he's going to have to do with these things, i don't know he's going to have to do that, "he said. [SEP]" we don't know what to do, we don't want to do that, "the official said. [SEP] 13 (upi) - - mark reynolds and ryan braun hit a three - run homer friday, carrying the chicago cubs to a 5 - 2 win over the minnesota twins. [SEP]" i'm not going to do that, " [SEP]
+
+===== sample 050 =====
+[CLS] down 0. 6 per cent at $45. 80 and was down 0. 8 per cent or 0. 7 per cent at $34. 50. [SEP] the unemployment rate dropped to 7. 5 percent in april. [SEP] 30 (upi) - - the u. s. is prepared to send thousands of troops to support the u. s. effort to defeat al - qaida and target u. s. troops in afghanistan, u. s. officials said. [SEP] " i'm trying to get a little bit nervous, i don't like that, but it's a little more important. [SEP] [SEP]
+
+===== sample 051 =====
+[CLS] to get where they are, "he said. [SEP]" there is a comprehensive plan to address the problem, "the agency said in a statement. [SEP] washington, march 4 (upi) - - u. s. sen. john mccain has met president obama on his first trip to africa since the 9/11 attacks, a spokesman said. [SEP] washington, march 16 (upi) - - u. s. sen. edward kennedy, the democratic chairman of the u. s. senate, says his health care efforts have been successful. [SEP] he also said there are" serious concerns " about climate change, and he [SEP]
+
+===== sample 052 =====
+[CLS] to deal with the crisis. [SEP] "i don't talk to anyone," he said. [SEP] the standard & poor's 500 index rose 4. 13 points, or 0. 03 percent, to 948. 13. [SEP] we don't want to have a government, but we have to work hard, "he said in a statement. [SEP]" we end up with a huge amount of money, "he added. [SEP] that's what they do. [SEP]" i think we'll be successful, and if we're successful, we're going to be able to do it again. [SEP] [SEP]
+
+===== sample 053 =====
+[CLS] ended march 31, 2006. compared to $11. 8 million, or $4. 9 million, at december 31, 2006. compared to $7. 4 million in the u. s. 2006. compared to $11. 8 million, or $9. 4 million. [SEP] "i don't know, i don't know, and i don't know who is doing it," she said. [SEP] "i don't think things will get a lot better," he said. [SEP] "that is the step we'll have to take to make that work," he said. [SEP] [SEP]
+
+===== sample 054 =====
+[CLS]. [SEP] "if i don't want to be here, i'm going to be here, i won't be here," he said. [SEP] "it's not just about money, it's about money, it's money," he said. [SEP] microsoft has more than 14, 000 employees, according to the company's website. [SEP] "i don't need to know much," he said. [SEP] " i have been on the road for a number of years, i think. [SEP] washington, march 4 (upi) - - the top u. s. diplomat in [SEP]
+
+===== sample 055 =====
+[CLS] £25, 000 - £25, 001. £40, 866 - £40, 000 per annum. we have a richness of history, heritage and culture..... £25, 000 - £28, 000 per annum. through a combination of education, culture and heritage..... oh. sports, natural history, heritage, history, natural history, as well as fishing, hiking, fishing, fishing, fishing.... oh. [SEP] "it's good for us, it's good for us," she said. [SEP] i don't think we have [SEP]
+
+===== sample 056 =====
+[CLS] a news conference. [SEP] trenton, n. j., may 18/prnewswire - usnewswire/- - the u. s. department of defense (fco) is scheduled to hold a conference call on thursday, may 14, 2009 at 11: 00 a. m. [SEP] obama is planning to send another 30, 000 troops to afghanistan by the end of the year, and there are expected to be 40, 000 troops, according to the white house. [SEP] this entry was posted by tracy alloway on friday, august 5th, 2009 at 16: 43 and is filed under capital markets. [SEP] [SEP]
+
+===== sample 057 =====
+[CLS] million, or 5. 2 %, compared to 7. 2 % in the second quarter of 2008. for the second quarter of 2009, $7. 5 million, or 12. 7 %, compared to revenue of $7. 8 million in the second quarter of 2008. operating income was $13. 4 million, an increase of $8. 8 million, or 4. 6 %, from the third quarter of 2008. operating income was $7. 7 million in the second quarter of 2009, compared to operating income of $5. 4 million, or 4. 4 %, compared to the second quarter of 2008 [SEP]
+
+===== sample 058 =====
+[CLS] 2006. $5. 3 million in the second quarter of 2006. million, compared to $7. 7 million in the third quarter of 2006. $1. 5 million, or 4. 4 %, in the second quarter of 2006. 6. 6 % and 4. 6 % in the second quarter of 2006. from 3. 8 % in the second quarter of 2006. compared to a growth rate of 5. 7 % in the second quarter of 2006. $7. 3 million, or $0. 03 per share, in the third quarter of 2006. compared to 5. 3 % in the second quarter of [SEP]
+
+===== sample 059 =====
+[CLS] 2008. [SEP] east rutherford, n. j., march 2 (upi) - - cole hamels hit a three - run home run in the sixth inning, giving the phillies a 5 - 2 win over the minnesota twins. [SEP] "i think there will be some improvement in the coming months," he said. [SEP] we've got some things we have to do. [SEP] chicago, march 4 (upi) - - scott schwern scored his first goal of the season monday, leading the chicago fire to a 3 - 2 win over the dallas stars. [SEP] " i feel sorry, i'm [SEP]
+
+===== sample 060 =====
+[CLS] know, "he said. [SEP] i don't want to do anything anymore. [SEP]" i don't want to look at anything, "he told me. [SEP] i don't want it to be bad for you," he told me. [SEP] "if there's going to be a lot of money out of the way, there will be a whole lot of pressure," he said. [SEP] this article was first published on guardian. co. uk at 15. 05 gmt on monday 16 march 2009. [SEP] it's the right time to go, and it's the right time to go [SEP]
+
+===== sample 061 =====
+[CLS]'s not going to be enough, it's a good thing, "he said. [SEP]" we've got to do that, "he told a news conference in london. [SEP] i don't do anything," he said. [SEP] "i don't think it's a good thing," he said. [SEP] "i'm not worried about doing my job," he said. [SEP] "i just don't want to go to school, i'm young, so i don't want to be able to go to school," he said. [SEP] i don't want [SEP]
+
+===== sample 062 =====
+[CLS] take place. [SEP] "i don't really know what he's going to do, particularly what he's going to do," he said. [SEP] it is expected to be finished by the end of 2010. [SEP] we don't yet know what it will be, but we're trying to get it. [SEP] this entry was posted by neil hume on thursday, march 6th, 2009 at 11: 35 and is filed under capital markets. [SEP] he was taken to st john's medical centre, then taken back to the hospital for treatment. [SEP] with more than 10, 000 employees a year, the company [SEP]
+
+===== sample 063 =====
+[CLS] for me, "he said. [SEP] washington, march 13 (upi) - - the u. s. military is prepared to withdraw troops from iraq by the end of the year, u. s. and iraqi officials said monday. [SEP] but he's not alone. [SEP]" i didn't get it right, "he said. [SEP]" if i'm going to be here, i'm going to be there. [SEP] " i'm not going to be able to make any mistakes, but that's what i want, and i'm a little disappointed. [SEP] but he conceded that there [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_4096steps_n64/state_c1024_t1p45_raw_samples.txt

@@ -0,0 +1,228 @@
+state_c1024_t1p45
+{
+  "type": "summary",
+  "name": "state_c1024_t1p45",
+  "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt",
+  "step": 124000,
+  "decode": {
+    "kind": "categorical_fullvocab",
+    "config": "state_c1024_t1p45",
+    "steps": 4096,
+    "model_t_mode": "post",
+    "support_power": 1.0,
+    "semantic_power": 1.0,
+    "endpoint_temp": 1.45,
+    "concentration_min": 1.0,
+    "concentration_max": 1024.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 14.379869187838807,
+    "nll_per_token": 2.6658292554392022,
+    "tokens": 9069
+  },
+  "diversity": {
+    "sample_entropy": 3.7611245679001697,
+    "unique_tokens": 796,
+    "token_count": 8192,
+    "distinct_1": 0.09716796875,
+    "distinct_2": 0.32258858267716534,
+    "top_token_mass": 0.0748291015625
+  }
+}
+
+===== sample 000 =====
+[CLS] place. [SEP] " we ' re going to do that, and we ' re going to do that, but it will take a lot of work before we get there, " he said. [SEP] and if he had gone too far, the answer would not have been easy. [SEP] " i haven ' t seen it before, " he said. [SEP] washington, march 4 / prnewswire - usnewswire / - - the u. s. agency for international development ( usa ), which represents haiti, announced today the u. s. government will work with the united states to increase the flow of food aid through [SEP]
+
+===== sample 001 =====
+[CLS]. 8 percent to 4, 293. 40. [SEP] ibm ( ibmm. n : quote, profile, research ) ( ibm. n : quote, profile, research ) on thursday reported 3. 8 billion yen ( $ 12. 5 million ) in net profit for the three months to march, compared with a loss of 5. 5 billion yen ( $ 87 million ) a year earlier. [SEP] " i ' m not going to do anything and don ' t want to do anything else, " he said at the time. [SEP] we need to resolve these problems, " he said. [SEP] " i don ' t think we [SEP]
+
+===== sample 002 =====
+[CLS] made it 65 - 65 at the end of the third quarter when he hit a 3 - pointer to cut the lead to 50 - 41. [SEP] " i ' m trying to do that, " he said, while refusing to say what would happen after obama ' s victory. [SEP] " i ' m not going to talk about it. [SEP] " if we ' re going to get things done, we don ' t get things done, " he said. [SEP] you ' ve got to get better, " he said. [SEP] the 50 - year - old is due to face trial in the next few days. [SEP] he was also [SEP]
+
+===== sample 003 =====
+[CLS] iranians. [SEP] " i ' ve been with him for the last couple of years, you know, and i ' ve never seen him, " he said. [SEP] " i ' m jewish, i ' m not a muslim, i ' m not jewish, i don ' t want to be jewish. " [SEP] a council spokesman said it was time to raise the issue. [SEP] washington ( reuters ) - exports to u. s. rose 0. 3 percent in the u. s. in january compared with a year earlier, according to the u. s. commerce department on friday. [SEP] the u. n. security [SEP]
+
+===== sample 004 =====
+[CLS] for the first time since 2001. [SEP] " i do not know if we won ' t be able to get this thing done again, i don ' t know if we ' re going to get it done, but i think it ' s going to be hard for us to do that, " he said. [SEP] " i think it ' s a great shame that we don ' t do anything, we don ' t talk. [SEP] " i don ' t want to get out of my way, " she said. [SEP] to give them a chance to win, he said, he wanted them to stay in the game. [SEP] [SEP]
+
+===== sample 005 =====
+[CLS] " at the end of the day, i ' ve never had any problems, " she said. [SEP] " we don ' t have much to do with it yet, " he said. [SEP] " that ' s something we don ' t want to talk about, we ' d like to know, " he said, referring to obama ' s speech. [SEP] 21 ( upi ) - - justin verlander drove in a three - run run, leading the chicago cubs to a 5 - 2 decision over the san diego padres. [SEP] " i don ' t think we should have any idea what it ' s going to be [SEP]
+
+===== sample 006 =====
+[CLS]. [SEP] " i don ' t want to get back on the plane. [SEP] " if we ' re serious about our health, that ' s what we really need to do. [SEP] " i think i ' ve been lucky in my life. [SEP] " i think they don ' t want to know how much money they ' ll spend on it, " he said. [SEP] according to the u. s. state department, the contract is worth $ 6. 4 billion and could add $ 2. 5 billion to the total. [SEP] " i always felt that i needed to be able to play, " he said. [SEP] and [SEP]
+
+===== sample 007 =====
+[CLS] new york. [SEP] " i don ' t think we have the money to do that, we ' ve got a lot of work to do the job, " he said. [SEP] " we didn ' t want to get here, " he said. [SEP] our total revenues were $ 0. 2 million, up 11 % from the year - ago quarter. revenue for the second quarter of 2009 increased to $ 4. 7 million in the second quarter, compared to total revenue of $ 5. 3 million, up 5. 6 % from the second quarter of last year. [SEP] " we ' ve got to do more than we can [SEP]
+
+===== sample 008 =====
+[CLS] this report. [SEP] " it ' s a long shot, but it ' s going to make a big difference, " he said at a news conference. [SEP] " it ' s not something that is necessary, " she told reporters. [SEP] i think they ' ve done it well, they haven ' t done enough. [SEP] " i know i ' m going to be fine this week, but i know i can ' t, " he said. [SEP] " however, it ' s not going to be a tough decision, he has to deal with it. [SEP] it ' s a whole lot of fun, you can ' t [SEP]
+
+===== sample 009 =====
+[CLS]. 4 million from 5. 7 million a year ago. 3 % from $ 3. 3 million in 2006. $ 2. 0 million in 2007. in the u. s. from $ 2. 8 million a year ago. [SEP] " i don ' t want to make any mistakes, " he said. [SEP] " he ' s going to do that, and if he ' s not going to do that, i don ' t know if he ' s going to do that, " he said. [SEP] " it ' s a little scary, it ' s a little scary, it ' s real, " he said [SEP]
+
+===== sample 010 =====
+[CLS]. 9 million ( $ 0. 14 per share ), as compared to operating income of $ 0. 8 million in the second quarter of 2008. operating income rose to $ 11. 8 million ( $ 0. 15 ) in the second quarter from $ 9. 8 million, or $ 0. 10 per share, in the second quarter of 2008. compared to $ 7. 7 million, or $ 5. 5 million, in the second quarter of 2008. in the second quarter of 2009 compared to $ 14. 8 million reported in the second quarter of the second quarter of 2008. $ 5 million in the second quarter of [SEP]
+
+===== sample 011 =====
+[CLS] t want to do anything wrong, " he said. [SEP] " i ' m trying to make things look good, " she said. [SEP] " if we don ' t do the same, we will have to do more, " he said. [SEP] if they can ' t get a mortgage, they ' ll have to pay for it. [SEP] the road was closed. [SEP] " we don ' t have the money to do that, " he said. [SEP] washington ( cnn ) - - u. s. secretary of state hillary clinton said the united states will continue to work to increase its support to the wars in iraq and afghanistan [SEP]
+
+===== sample 012 =====
+[CLS] ve ever seen, " he said. [SEP] " they don ' t have the money to pay for it, " he said. [SEP] i ' m going to have to do that. [SEP] " i don ' t think there ' s much that i ' m going to do, and i don ' t think that ' s enough, " he said. [SEP] " i thought about my retirement and i thought i wasn ' t there, " he said. [SEP] " i ' m not going to let them down, " she said. [SEP] and i ' m sure it ' s a good thing. [SEP] the s & p 500 [SEP]
+
+===== sample 013 =====
+[CLS] 9 a. m. to 5 : 30 p. m. to 1 : 30 p. m. [SEP] " that ' s just something i don ' t understand, " he said. [SEP] " we don ' t need to get serious about what we have to do to get things done, " he said. [SEP] " you don ' t have to make a lot of money, " he said. [SEP] " to be honest, i ' m not going to tell you, " he said. [SEP] " i don ' t think that would be the last thing they wanted to do, " he said. [SEP] the military said [SEP]
+
+===== sample 014 =====
+[CLS]. [SEP] washington, march 2 ( upi ) - - sales of u. s. single - family homes rose 0. 3 percent in the third quarter, the u. s. government said. [SEP] washington, march 19 ( upi ) - - the u. s. economy contracted by a hefty 0. 5 percent in the second quarter, the u. s. government said tuesday. [SEP] that ' s what it means to me when i ' m young. [SEP] " it ' s hard to know what ' s right, " he said. [SEP] there ' s a lot of tension in the room. [SEP] [SEP]
+
+===== sample 015 =====
+[CLS] the site. [SEP] it ' s not going to be a problem, but it ' s something that ' s where i ' m concerned. [SEP] the dow jones industrial average rose 10. 22 points, or 0. 5 percent, to 10, 086. 50. [SEP] cleveland used a 12 - 2 run to cut it to 80 - 65 with 4 : 36 left in the half. [SEP] we ' ve got a lot of money to spend, so i ' ll tell you we don ' t have to spend a lot. [SEP] " it ' s not going to last that long, " he said. [SEP] in addition, [SEP]
+
+===== sample 016 =====
+[CLS] minutes left in the first quarter. [SEP] " i ' m not going to have to tell you how i ' m going to do it, " he said. [SEP] " if we don ' t have the things we ' re paying for, we ' ll have to pay for things we don ' t need, " bernanke said. [SEP] " but i don ' t think we ' ll be back to the end of the season if we don ' t do the right thing, " he said. [SEP] " i just don ' t want to go to school. [SEP] " we ' ve got to win, " he said [SEP]
+
+===== sample 017 =====
+[CLS] second inning in new york ' s 3 - 2 win over the rockies. [SEP] but on the other hand, they still have work to do. [SEP] " we have to have a clear understanding of what we have to do, and i think what we ' ll have to do in the future, " he said. [SEP] " i don ' t think there will be much worse, " he said. [SEP] but if we don ' t do that, we ' re going to do that. [SEP] " i don ' t know about it, " he said. [SEP] i ' m trying to get things done, " he said. [SEP]
+
+===== sample 018 =====
+[CLS] companies. [SEP] there was no sign of significant damage to the building. [SEP] " if you don ' t want to win, you have to make some effort to do that, " he said. [SEP] i ' m not going to do that, but i ' m not going to do that, " he said at a news conference. [SEP] " i ' m not sure if it is going to be a deal, but it ' s going to be a lot more than that, " he said. [SEP] he ' s a great president, but it won ' t work. [SEP] i ' m glad that some people don ' t [SEP]
+
+===== sample 019 =====
+[CLS] when i was on the plane. [SEP] i did not know. [SEP] " that ' s the first decision we have to make, " he said. [SEP] i don ' t know what we can do right now, but you have to get back to the top flight and get to the top. [SEP] the index of home prices rose to 22. 2 in 2009 from 22. 5 percent in 2008. [SEP] " if you can ' t be a writer, you have to be a writer, you have to be a good person, you ' re a writer, you have to be a good person. [SEP] " i ' m glad [SEP]
+
+===== sample 020 =====
+[CLS] since 2001. [SEP] " there ' s a lot of work to do, and if you don ' t need to do that, you have to get out of the way, " he said. [SEP] washington, march 18 ( upi ) - - the u. s. military has become the focus of a new u. s. strategy for the war in afghanistan, a u. s. official said. [SEP] " he said he didn ' t talk about it because he didn ' t want to talk about it. [SEP] " i don ' t think we ' re going to get any better, " he said. [SEP] the [SEP]
+
+===== sample 021 =====
+[CLS], 2009. [SEP] buffalo, n. y., jan. [SEP] 21 ( upi ) - - u. s. crude inventories fell 500, 000 in november from a year ago, the u. s. energy department said friday. [SEP] " we don ' t know about him, we don ' t know him, " he told the station. [SEP] " if the government doesn ' t want to protect us, something ' s wrong, " he said. [SEP] " i do love to see him, i don ' t want to tell him what he wants, " he said. [SEP] " i don ' t think [SEP]
+
+===== sample 022 =====
+[CLS] said. [SEP] " we ' ve got to do that, and we ' ve got to be able to do that, " he told reporters. [SEP] he ' s a nice guy, but i don ' t know him, i don ' t know. [SEP] " it ' s really hard to see what ' s going to happen today, but we ' re sure we don ' t have to change the way we ' re going, " he said. [SEP] " you don ' t want to talk to a lot of people, you don ' t want to change anything, " he said. [SEP] " i don ' t think [SEP]
+
+===== sample 023 =====
+[CLS] 7 million, up 5. 4 % from the second quarter of 2006 and 7. 5 % from the third quarter of 2006, up 4 % from the second quarter of 2006. revenue of $ 7. 8 million was $ 7. 1 million, up 17 % from the third quarter of 2006. compared to the second quarter of 2007, the second quarter of revenue was $ 15. 2 million, up $ 4. 8 million, from $ 12. 4 million in the third quarter a year earlier. [SEP] " it ' s important, it ' s important to you, " he said. [SEP] washington ( ap ) - - [SEP]
+
+===== sample 024 =====
+[CLS] million, compared to $ 7. 4 million in the second quarter of 2008. the company reported a gross operating loss of $ 3. 0 million compared to gross income of $ 4. 1 million in the second quarter of 2008 and $ 7. 8 million of revenue in the second quarter of 2007 and the year ended december 31, 2007. gross operating income was $ 7. 9 million or 3. 3 % at march 31, 2008 compared to $ 9. 3 million in the first nine months of 2007. [SEP] what ' s true is that you don ' t have the money to look at it and sort it out. [SEP] [SEP]
+
+===== sample 025 =====
+[CLS] to try to win. [SEP] " i don ' t want to hurt him, " he said. [SEP] it doesn ' t surprise me, " he said. [SEP] " if so, they wouldn ' t have had the opportunity to do that, " he said. [SEP] " we ' re not talking about that, but it ' s hard to say, " he said. [SEP] " it ' s going to make a lot of money for us, " he said. [SEP] " i don ' t know why. " [SEP] " we ' re not going to do anything, that ' s the goal, " he said. [SEP] [SEP]
+
+===== sample 026 =====
+[CLS] from 52. 3 % to 47. 3 %. [SEP] 5 ( upi ) - - u. s. president barack obama and president bill clinton met at the white house for a two - day visit, the white house said. [SEP] " it ' s going to be tough, " he said. [SEP] he declined to comment. [SEP] " it ' s a very bad thing, " he said. [SEP] " i don ' t know, i don ' t think we ' re talking about it, " he said. [SEP] " i ' m not going back, " he said. [SEP] new york, march 15 ( up [SEP]
+
+===== sample 027 =====
+[CLS] i ' m wrong, " he said. [SEP] " i do not think there is a lot of pressure in the kind of situation that we have to deal with, " he said. [SEP] " we ' ve got to help, we can ' t do anything, we can do anything, we don ' t want to do anything. [SEP] but he added that we were trying to make sure that we don ' t have the money to invest, " the statement said. [SEP] so, i mean, i know, i ' m a muslim, i ' m not a muslim, i ' m a muslim, i don ' t [SEP]
+
+===== sample 028 =====
+[CLS] a loss of $ 4. 4 million, compared with a loss of $ 12. 5 million and a loss of $ 11. 7 million in the same period a year earlier. [SEP] staff writer stephen king contributed to this report. [SEP] " he ' s right and i don ' t think that you don ' t need to talk about it, " he said. [SEP] " i know i don ' t know what ' s going on with them. [SEP] a year ago, revenue fell 4 percent to $ 1. 27 billion from 1. 24 billion. [SEP] " there ' s no way i can go to see him, " [SEP]
+
+===== sample 029 =====
+[CLS] do so. " [SEP] i think it would be a good thing for them. [SEP] what do you want to do to make sure that you are going to be able to do the job, even if you don ' t have the money to do that? [SEP] " you know what i ' m going to do with my son, " he said. [SEP] " we don ' t have enough money, so i don ' t know if anything is going to help, " he said of the program. [SEP] " when you have children, you don ' t have a lot of work to do, " she said. [SEP] however, [SEP]
+
+===== sample 030 =====
+[CLS] u. s. troops. [SEP] " i knew we wouldn ' t do it again, but i knew we ' d have to do the same thing, " he said. [SEP] 21 ( upi ) - - industrial production in the united states fell 0. 3 percent in the third quarter, a u. s. department of energy report released thursday showed. [SEP] however, it ' s true, we have a different kind of legal system. [SEP] " we ' re going to be able to do a lot of things, but we ' re going to do what we have to do, " he said. [SEP] it ' s [SEP]
+
+===== sample 031 =====
+[CLS] going to have to think about what ' s good, " palin said. [SEP] he ' s going to change things. [SEP] " no, i don ' t want to say i ' m not going to fly, " he said. [SEP] apple ' s shares fell $ 1. 14, or 7. 5 percent, to $ 28. 40 in the first three months of the year. [SEP] he ' s the best player in the world, he ' s the best player these days, he ' s going to win gold. [SEP] " that ' s the thing to do, " he said. [SEP] i think we are [SEP]
+
+===== sample 032 =====
+[CLS] times a day. [SEP] associated press writers david d. kennedy in buffalo, n. y., and robert f. kennedy in buffalo, n. y., contributed to this report. [SEP] " i ' d like to have to pay attention to what i ' ve done, " she said. [SEP] " we don ' t have to do what we always do, but if we can do the job, we don ' t have to do anything, " he said. [SEP] i know he ' s a bad guy, but i don ' t want to know how he ' s doing what he ' s doing. [SEP] the [SEP]
+
+===== sample 033 =====
+[CLS] intelligence agency. [SEP] it ' s a big deal, " he said. [SEP] " i don ' t want to change, " he said. [SEP] " there ' s one thing we know, but we don ' t know where we are, and we don ' t know where, " he said. [SEP] " if i want to be successful, i have to be careful, " he said. [SEP] " i ' m not sure we ' re talking about it, but i don ' t think that we would want to make do with that, " he told reporters. [SEP] " i don ' t think i didn ' t [SEP]
+
+===== sample 034 =====
+[CLS] to 66 - 65 with 10 : 41 in the third quarter, including three 3 - pointers for a 50 - 37 lead. [SEP] " it ' s going to take a couple of days, but it hasn ' t been easy, " he said. [SEP] new york ( reuters ) - the u. s. economy in the u. s. grew 0. 5 percent in the third quarter, down 0. 3 percent from the second quarter of 2008, while the rate of decline grew to 0. 4 percent in the second quarter, the bank said. [SEP] " i ' m really sorry that he didn ' t know how [SEP]
+
+===== sample 035 =====
+[CLS] sun reported on monday. [SEP] " i don ' t know how much, but i don ' t know much, " he said. [SEP] " we ' ve got to be careful. [SEP] " if it ' s not going to be enough, that ' s what we ' re going to have to do, " he said. [SEP] " i feel like i don ' t have enough, " he said. [SEP] the dow fell 25. 53 points, or 2. 4 percent, to 11, 365. 15. [SEP] the company ' s stock rose $ 14. 50, or 3. 4 percent, to $ 34. [SEP]
+
+===== sample 036 =====
+[CLS] [SEP] " i don ' t think there ' s much work to do. [SEP] " right now we ' ll never get anything done, " he said. [SEP] i ' m not sure that has anything to do with that. [SEP] " it is very important for us to move so quickly to address the challenges of the economy, " mr buffett said. [SEP] " i ' ve never had an open race, but i don ' t know, " he said. [SEP] " i ' m not sure, i don ' t know him, i don ' t know what to do with him. [SEP] and it ' s not a [SEP]
+
+===== sample 037 =====
+[CLS] u. s., the u. s. and its allies. [SEP] " it ' s a lot of fun, and it ' s a lot of fun, " he said of the course. [SEP] the tory leader said : " i think we can get things right. [SEP] for now, however, we have to be careful about the future. [SEP] " we ' ll have to know we don ' t have the time to talk, " he said. [SEP] " i don ' t think we ' ll have to wait, but i think that ' s a good thing to do, " he said. [SEP] don ' t [SEP]
+
+===== sample 038 =====
+[CLS] by gwen robinson on monday, may 18th, 2009 at 5 : 40 am ( est ). [SEP] i don ' t want to go any further away from the truth. [SEP] at 5 : 57 of the first period, new york scored twice in the first period to take a 3 - 2 lead at 5 : 14 of the second. [SEP] that ' s what we ' re doing. [SEP] " i don ' t know what i want to do, but what i ' m going to do, " hawley said. [SEP] " i don ' t think it will have a significant impact on me, " he said. [SEP] the [SEP]
+
+===== sample 039 =====
+[CLS] $ 1. 7 billion a year earlier. [SEP] " i don ' t know what i ' m doing, " he said. [SEP] " i don ' t think we ' re really talking about it right now, and we ' re not talking about that, " he said. [SEP] 2 ( upi ) - - the u. s. defense department has contracted u. s. armed forces to support u. s. military operations, the defense department said monday. [SEP] " there is going to be a lot of work to do right now, " he said. [SEP] 21 ( upi ) - - u. s. [SEP]
+
+===== sample 040 =====
+[CLS] " he said. [SEP] it ' s very hard to say there is a solution. [SEP] " i ' m not going to be married, i ' m not married, " he said. [SEP] " if you don ' t do that, it ' s very tough, " he said. [SEP] i ' m very excited about that, " he said. [SEP] i don ' t want to talk about it, i don ' t want to talk about it, " he told afp. [SEP] " i think if there are only a couple of things, it ' s just one way to get a job, " he said. [SEP]
+
+===== sample 041 =====
+[CLS], the team ' s 2008 first - round pick. [SEP] 11 ( upi ) - - u. s. president barack obama is considering adding more u. s. troops to u. s. military operations, the white house said. [SEP] " he ' s a great man, i think he ' s a great person, " he said. [SEP] " we ' re not going to be able to pass a bill that will extend coverage to the poor, " he said. [SEP] " i want to leave, i don ' t want to leave. [SEP] " i know i ' m going to do it again, " he [SEP]
+
+===== sample 042 =====
+[CLS] china in the face of weak u. s. economic growth. [SEP] " he ' s got to be a good player at the moment, " beckham said. [SEP] i ' m not talking about it anymore, i ' m talking about it, but i don ' t think that would be the case, " beckham said. [SEP] " it ' s too early to tell whether i am going to be ready for another year, " he said. [SEP] " i don ' t think we can ' t get any better, " he said. [SEP] " i ' m not going to come back, " he said. [SEP] [SEP]
+
+===== sample 043 =====
+[CLS] have to pay. [SEP] " it ' s a good idea, " said michael martin, the site ' s marketing director. [SEP] but i don ' t think that ' s true. [SEP] " i don ' t want things to happen here, " he said. [SEP] " i don ' t feel like what you do, i don ' t like what you really do, " she said. [SEP] " i think it ' s a small step, i think it will have an impact on our health, " nader said at a private news conference. [SEP] " i mean, you don ' t really feel like you ' re [SEP]
+
+===== sample 044 =====
+[CLS] end of the year. [SEP] " it ' s not possible at all, " he told reporters. [SEP] third - quarter operating income increased $ 2. 7 million, up $ 1. 2 million, or 4. 5 percent, to $ 80. 6 million, and operating income increased $ 9. 7 million, or 3. 5 percent, to $ 80. 8 million, up $ 1. 8 million, or 4 percent, to $ 15. 6 million. [SEP] " i don ' t think we ' re going to have a general election, " he said. [SEP] " i don ' t want to make any decisions [SEP]
+
+===== sample 045 =====
+[CLS] at the end of the year. " [SEP] december retail sales also rose at an annual rate of 0. 3 percent, as compared to december ' s gain of 0. 3 percent. [SEP] i didn ' t know anything about it. [SEP] " i think we ' ll see if we ' ll change a lot and if we ' ll try to change things, " he told the associated press. [SEP] in early trading in tokyo, the index was down 5. 54, or 0. 3 percent, at 9, 319. 17. [SEP] ( ap ) - - the commerce department says retail sales rose 0. 1 percent in july [SEP]
+
+===== sample 046 =====
+[CLS] washington, march 6 ( upi ) - - u. s. health care spending in the third quarter rose 6. 3 percent to $ 11. 4 billion, the u. s. government said. [SEP] china ' s trade deficit will total almost $ 100 billion this year. [SEP] " i don ' t think he ' s going to win this election, he ' s a very good guy, he ' s a good guy, he doesn ' t win, " clinton said at a news conference. [SEP] " there ' s little else we can do to change that, " he said. [SEP] los angeles ( ap ) - [SEP]
+
+===== sample 047 =====
+[CLS] £78, 000. [SEP] buffalo, n. y., march 2 ( upi ) - - scott rolen hit a two - run homer, carrying the chicago cubs to an 8 - 5 win over the new york yankees. [SEP] i ' m going to talk about it, but i ' m not going to talk, " he said. [SEP] the cavaliers led 50 - 50 with a 7 - 4 run in the first half of the third quarter, including a 2 - 7 run that gave the cavaliers a 50 - 36 lead in the second quarter. [SEP] " i don ' t think it ' s going to change [SEP]
+
+===== sample 048 =====
+[CLS] 25 years. [SEP] " it ' s not a good place to do it and you don ' t have to do it. [SEP] " we ' ve got more work to do. [SEP] 16 / prnewswire - usnewswire / - - the u. s. dollar. $ 6. 0 million compared to $ 6. 1 million in the second quarter of 2006. from $ 2. 5 million in the second quarter of 2006. compared to a loss of $ 2. 9 million in the third quarter of 2006. same loss in the second quarter of 2006. $ 5. 5 million in the second quarter of [SEP]
+
+===== sample 049 =====
+[CLS] we are going to see a lot of growth, " he said. [SEP] " i don ' t know what he ' s going to have to do with these things, i don ' t know he ' s going to have to do that, " he said. [SEP] " we don ' t know what to do, we don ' t want to do that, " the official said. [SEP] 13 ( upi ) - - mark reynolds and ryan braun hit a three - run homer friday, carrying the chicago cubs to a 5 - 2 win over the minnesota twins. [SEP] " i ' m not going to do that, " [SEP]
+
+===== sample 050 =====
+[CLS] down 0. 6 per cent at $ 45. 80 and was down 0. 8 per cent or 0. 7 per cent at $ 34. 50. [SEP] the unemployment rate dropped to 7. 5 percent in april. [SEP] 30 ( upi ) - - the u. s. is prepared to send thousands of troops to support the u. s. effort to defeat al - qaida and target u. s. troops in afghanistan, u. s. officials said. [SEP] " i ' m trying to get a little bit nervous, i don ' t like that, but it ' s a little more important. [SEP] [SEP]
+
+===== sample 051 =====
+[CLS] to get where they are, " he said. [SEP] " there is a comprehensive plan to address the problem, " the agency said in a statement. [SEP] washington, march 4 ( upi ) - - u. s. sen. john mccain has met president obama on his first trip to africa since the 9 / 11 attacks, a spokesman said. [SEP] washington, march 16 ( upi ) - - u. s. sen. edward kennedy, the democratic chairman of the u. s. senate, says his health care efforts have been successful. [SEP] he also said there are " serious concerns " about climate change, and he [SEP]
+
+===== sample 052 =====
+[CLS] to deal with the crisis. [SEP] " i don ' t talk to anyone, " he said. [SEP] the standard & poor ' s 500 index rose 4. 13 points, or 0. 03 percent, to 948. 13. [SEP] we don ' t want to have a government, but we have to work hard, " he said in a statement. [SEP] " we end up with a huge amount of money, " he added. [SEP] that ' s what they do. [SEP] " i think we ' ll be successful, and if we ' re successful, we ' re going to be able to do it again. [SEP] [SEP]
+
+===== sample 053 =====
+[CLS] ended march 31, 2006. compared to $ 11. 8 million, or $ 4. 9 million, at december 31, 2006. compared to $ 7. 4 million in the u. s. 2006. compared to $ 11. 8 million, or $ 9. 4 million. [SEP] " i don ' t know, i don ' t know, and i don ' t know who is doing it, " she said. [SEP] " i don ' t think things will get a lot better, " he said. [SEP] " that is the step we ' ll have to take to make that work, " he said. [SEP] [SEP]
+
+===== sample 054 =====
+[CLS]. [SEP] " if i don ' t want to be here, i ' m going to be here, i won ' t be here, " he said. [SEP] " it ' s not just about money, it ' s about money, it ' s money, " he said. [SEP] microsoft has more than 14, 000 employees, according to the company ' s website. [SEP] " i don ' t need to know much, " he said. [SEP] " i have been on the road for a number of years, i think. [SEP] washington, march 4 ( upi ) - - the top u. s. diplomat in [SEP]
+
+===== sample 055 =====
+[CLS] £25, 000 - £25, 001. £40, 866 - £40, 000 per annum. we have a richness of history, heritage and culture..... £25, 000 - £28, 000 per annum. through a combination of education, culture and heritage..... oh. sports, natural history, heritage, history, natural history, as well as fishing, hiking, fishing, fishing, fishing.... oh. [SEP] " it ' s good for us, it ' s good for us, " she said. [SEP] i don ' t think we have [SEP]
+
+===== sample 056 =====
+[CLS] a news conference. [SEP] trenton, n. j., may 18 / prnewswire - usnewswire / - - the u. s. department of defense ( fco ) is scheduled to hold a conference call on thursday, may 14, 2009 at 11 : 00 a. m. [SEP] obama is planning to send another 30, 000 troops to afghanistan by the end of the year, and there are expected to be 40, 000 troops, according to the white house. [SEP] this entry was posted by tracy alloway on friday, august 5th, 2009 at 16 : 43 and is filed under capital markets. [SEP] [SEP]
+
+===== sample 057 =====
+[CLS] million, or 5. 2 %, compared to 7. 2 % in the second quarter of 2008. for the second quarter of 2009, $ 7. 5 million, or 12. 7 %, compared to revenue of $ 7. 8 million in the second quarter of 2008. operating income was $ 13. 4 million, an increase of $ 8. 8 million, or 4. 6 %, from the third quarter of 2008. operating income was $ 7. 7 million in the second quarter of 2009, compared to operating income of $ 5. 4 million, or 4. 4 %, compared to the second quarter of 2008 [SEP]
+
+===== sample 058 =====
+[CLS] 2006. $ 5. 3 million in the second quarter of 2006. million, compared to $ 7. 7 million in the third quarter of 2006. $ 1. 5 million, or 4. 4 %, in the second quarter of 2006. 6. 6 % and 4. 6 % in the second quarter of 2006. from 3. 8 % in the second quarter of 2006. compared to a growth rate of 5. 7 % in the second quarter of 2006. $ 7. 3 million, or $ 0. 03 per share, in the third quarter of 2006. compared to 5. 3 % in the second quarter of [SEP]
+
+===== sample 059 =====
+[CLS] 2008. [SEP] east rutherford, n. j., march 2 ( upi ) - - cole hamels hit a three - run home run in the sixth inning, giving the phillies a 5 - 2 win over the minnesota twins. [SEP] " i think there will be some improvement in the coming months, " he said. [SEP] we ' ve got some things we have to do. [SEP] chicago, march 4 ( upi ) - - scott schwern scored his first goal of the season monday, leading the chicago fire to a 3 - 2 win over the dallas stars. [SEP] " i feel sorry, i ' m [SEP]
+
+===== sample 060 =====
+[CLS] know, " he said. [SEP] i don ' t want to do anything anymore. [SEP] " i don ' t want to look at anything, " he told me. [SEP] i don ' t want it to be bad for you, " he told me. [SEP] " if there ' s going to be a lot of money out of the way, there will be a whole lot of pressure, " he said. [SEP] this article was first published on guardian. co. uk at 15. 05 gmt on monday 16 march 2009. [SEP] it ' s the right time to go, and it ' s the right time to go [SEP]
+
+===== sample 061 =====
+[CLS] ' s not going to be enough, it ' s a good thing, " he said. [SEP] " we ' ve got to do that, " he told a news conference in london. [SEP] i don ' t do anything, " he said. [SEP] " i don ' t think it ' s a good thing, " he said. [SEP] " i ' m not worried about doing my job, " he said. [SEP] " i just don ' t want to go to school, i ' m young, so i don ' t want to be able to go to school, " he said. [SEP] i don ' t want [SEP]
+
+===== sample 062 =====
+[CLS] take place. [SEP] " i don ' t really know what he ' s going to do, particularly what he ' s going to do, " he said. [SEP] it is expected to be finished by the end of 2010. [SEP] we don ' t yet know what it will be, but we ' re trying to get it. [SEP] this entry was posted by neil hume on thursday, march 6th, 2009 at 11 : 35 and is filed under capital markets. [SEP] he was taken to st john ' s medical centre, then taken back to the hospital for treatment. [SEP] with more than 10, 000 employees a year, the company [SEP]
+
+===== sample 063 =====
+[CLS] for me, " he said. [SEP] washington, march 13 ( upi ) - - the u. s. military is prepared to withdraw troops from iraq by the end of the year, u. s. and iraqi officials said monday. [SEP] but he ' s not alone. [SEP] " i didn ' t get it right, " he said. [SEP] " if i ' m going to be here, i ' m going to be there. [SEP] " i ' m not going to be able to make any mistakes, but that ' s what i want, and i ' m a little disappointed. [SEP] but he conceded that there [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_4096steps_n64/state_c1024_t1p45_scored.jsonl

@@ -0,0 +1,65 @@
+{"type": "summary", "name": "state_c1024_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c1024_t1p45", "steps": 4096, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 1024.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 14.379869187838807, "nll_per_token": 2.6658292554392022, "tokens": 9069}, "diversity": {"sample_entropy": 3.7611245679001697, "unique_tokens": 796, "token_count": 8192, "distinct_1": 0.09716796875, "distinct_2": 0.32258858267716534, "top_token_mass": 0.0748291015625}}
+{"type": "sample", "index": 0, "raw_text": "[CLS] place. [SEP] \" we ' re going to do that, and we ' re going to do that, but it will take a lot of work before we get there, \" he said. [SEP] and if he had gone too far, the answer would not have been easy. [SEP] \" i haven ' t seen it before, \" he said. [SEP] washington, march 4 / prnewswire - usnewswire / - - the u. s. agency for international development ( usa ), which represents haiti, announced today the u. s. government will work with the united states to increase the flow of food aid through [SEP]", "detok_text": "[CLS] place. [SEP] \"we're going to do that, and we're going to do that, but it will take a lot of work before we get there,\" he said. [SEP] and if he had gone too far, the answer would not have been easy. [SEP] \"i haven't seen it before,\" he said. [SEP] washington, march 4/prnewswire - usnewswire/- - the u. s. agency for international development (usa), which represents haiti, announced today the u. s. government will work with the united states to increase the flow of food aid through [SEP]"}
+{"type": "sample", "index": 1, "raw_text": "[CLS]. 8 percent to 4, 293. 40. [SEP] ibm ( ibmm. n : quote, profile, research ) ( ibm. n : quote, profile, research ) on thursday reported 3. 8 billion yen ( $ 12. 5 million ) in net profit for the three months to march, compared with a loss of 5. 5 billion yen ( $ 87 million ) a year earlier. [SEP] \" i ' m not going to do anything and don ' t want to do anything else, \" he said at the time. [SEP] we need to resolve these problems, \" he said. [SEP] \" i don ' t think we [SEP]", "detok_text": "[CLS]. 8 percent to 4, 293. 40. [SEP] ibm (ibmm. n: quote, profile, research) (ibm. n: quote, profile, research) on thursday reported 3. 8 billion yen ($12. 5 million) in net profit for the three months to march, compared with a loss of 5. 5 billion yen ($87 million) a year earlier. [SEP] \"i'm not going to do anything and don't want to do anything else,\" he said at the time. [SEP] we need to resolve these problems, \"he said. [SEP]\" i don't think we [SEP]"}
+{"type": "sample", "index": 2, "raw_text": "[CLS] made it 65 - 65 at the end of the third quarter when he hit a 3 - pointer to cut the lead to 50 - 41. [SEP] \" i ' m trying to do that, \" he said, while refusing to say what would happen after obama ' s victory. [SEP] \" i ' m not going to talk about it. [SEP] \" if we ' re going to get things done, we don ' t get things done, \" he said. [SEP] you ' ve got to get better, \" he said. [SEP] the 50 - year - old is due to face trial in the next few days. [SEP] he was also [SEP]", "detok_text": "[CLS] made it 65 - 65 at the end of the third quarter when he hit a 3 - pointer to cut the lead to 50 - 41. [SEP] \"i'm trying to do that,\" he said, while refusing to say what would happen after obama's victory. [SEP] \"i'm not going to talk about it. [SEP]\" if we're going to get things done, we don't get things done, \"he said. [SEP] you've got to get better,\" he said. [SEP] the 50 - year - old is due to face trial in the next few days. [SEP] he was also [SEP]"}
+{"type": "sample", "index": 3, "raw_text": "[CLS] iranians. [SEP] \" i ' ve been with him for the last couple of years, you know, and i ' ve never seen him, \" he said. [SEP] \" i ' m jewish, i ' m not a muslim, i ' m not jewish, i don ' t want to be jewish. \" [SEP] a council spokesman said it was time to raise the issue. [SEP] washington ( reuters ) - exports to u. s. rose 0. 3 percent in the u. s. in january compared with a year earlier, according to the u. s. commerce department on friday. [SEP] the u. n. security [SEP]", "detok_text": "[CLS] iranians. [SEP] \"i've been with him for the last couple of years, you know, and i've never seen him,\" he said. [SEP] \"i'm jewish, i'm not a muslim, i'm not jewish, i don't want to be jewish.\" [SEP] a council spokesman said it was time to raise the issue. [SEP] washington (reuters) - exports to u. s. rose 0. 3 percent in the u. s. in january compared with a year earlier, according to the u. s. commerce department on friday. [SEP] the u. n. security [SEP]"}
+{"type": "sample", "index": 4, "raw_text": "[CLS] for the first time since 2001. [SEP] \" i do not know if we won ' t be able to get this thing done again, i don ' t know if we ' re going to get it done, but i think it ' s going to be hard for us to do that, \" he said. [SEP] \" i think it ' s a great shame that we don ' t do anything, we don ' t talk. [SEP] \" i don ' t want to get out of my way, \" she said. [SEP] to give them a chance to win, he said, he wanted them to stay in the game. [SEP] [SEP]", "detok_text": "[CLS] for the first time since 2001. [SEP] \"i do not know if we won't be able to get this thing done again, i don't know if we're going to get it done, but i think it's going to be hard for us to do that,\" he said. [SEP] \"i think it's a great shame that we don't do anything, we don't talk. [SEP]\" i don't want to get out of my way, \" she said. [SEP] to give them a chance to win, he said, he wanted them to stay in the game. [SEP] [SEP]"}
+{"type": "sample", "index": 5, "raw_text": "[CLS] \" at the end of the day, i ' ve never had any problems, \" she said. [SEP] \" we don ' t have much to do with it yet, \" he said. [SEP] \" that ' s something we don ' t want to talk about, we ' d like to know, \" he said, referring to obama ' s speech. [SEP] 21 ( upi ) - - justin verlander drove in a three - run run, leading the chicago cubs to a 5 - 2 decision over the san diego padres. [SEP] \" i don ' t think we should have any idea what it ' s going to be [SEP]", "detok_text": "[CLS] \"at the end of the day, i've never had any problems,\" she said. [SEP] \"we don't have much to do with it yet,\" he said. [SEP] \"that's something we don't want to talk about, we'd like to know,\" he said, referring to obama's speech. [SEP] 21 (upi) - - justin verlander drove in a three - run run, leading the chicago cubs to a 5 - 2 decision over the san diego padres. [SEP] \" i don't think we should have any idea what it's going to be [SEP]"}
+{"type": "sample", "index": 6, "raw_text": "[CLS]. [SEP] \" i don ' t want to get back on the plane. [SEP] \" if we ' re serious about our health, that ' s what we really need to do. [SEP] \" i think i ' ve been lucky in my life. [SEP] \" i think they don ' t want to know how much money they ' ll spend on it, \" he said. [SEP] according to the u. s. state department, the contract is worth $ 6. 4 billion and could add $ 2. 5 billion to the total. [SEP] \" i always felt that i needed to be able to play, \" he said. [SEP] and [SEP]", "detok_text": "[CLS]. [SEP] \"i don't want to get back on the plane. [SEP]\" if we're serious about our health, that's what we really need to do. [SEP] \"i think i've been lucky in my life. [SEP]\" i think they don't want to know how much money they'll spend on it, \"he said. [SEP] according to the u. s. state department, the contract is worth $6. 4 billion and could add $2. 5 billion to the total. [SEP]\" i always felt that i needed to be able to play, \" he said. [SEP] and [SEP]"}
+{"type": "sample", "index": 7, "raw_text": "[CLS] new york. [SEP] \" i don ' t think we have the money to do that, we ' ve got a lot of work to do the job, \" he said. [SEP] \" we didn ' t want to get here, \" he said. [SEP] our total revenues were $ 0. 2 million, up 11 % from the year - ago quarter. revenue for the second quarter of 2009 increased to $ 4. 7 million in the second quarter, compared to total revenue of $ 5. 3 million, up 5. 6 % from the second quarter of last year. [SEP] \" we ' ve got to do more than we can [SEP]", "detok_text": "[CLS] new york. [SEP] \"i don't think we have the money to do that, we've got a lot of work to do the job,\" he said. [SEP] \"we didn't want to get here,\" he said. [SEP] our total revenues were $0. 2 million, up 11 % from the year - ago quarter. revenue for the second quarter of 2009 increased to $4. 7 million in the second quarter, compared to total revenue of $5. 3 million, up 5. 6 % from the second quarter of last year. [SEP] \" we've got to do more than we can [SEP]"}
+{"type": "sample", "index": 8, "raw_text": "[CLS] this report. [SEP] \" it ' s a long shot, but it ' s going to make a big difference, \" he said at a news conference. [SEP] \" it ' s not something that is necessary, \" she told reporters. [SEP] i think they ' ve done it well, they haven ' t done enough. [SEP] \" i know i ' m going to be fine this week, but i know i can ' t, \" he said. [SEP] \" however, it ' s not going to be a tough decision, he has to deal with it. [SEP] it ' s a whole lot of fun, you can ' t [SEP]", "detok_text": "[CLS] this report. [SEP] \"it's a long shot, but it's going to make a big difference,\" he said at a news conference. [SEP] \"it's not something that is necessary,\" she told reporters. [SEP] i think they've done it well, they haven't done enough. [SEP] \"i know i'm going to be fine this week, but i know i can't,\" he said. [SEP] \" however, it's not going to be a tough decision, he has to deal with it. [SEP] it's a whole lot of fun, you can't [SEP]"}
+{"type": "sample", "index": 9, "raw_text": "[CLS]. 4 million from 5. 7 million a year ago. 3 % from $ 3. 3 million in 2006. $ 2. 0 million in 2007. in the u. s. from $ 2. 8 million a year ago. [SEP] \" i don ' t want to make any mistakes, \" he said. [SEP] \" he ' s going to do that, and if he ' s not going to do that, i don ' t know if he ' s going to do that, \" he said. [SEP] \" it ' s a little scary, it ' s a little scary, it ' s real, \" he said [SEP]", "detok_text": "[CLS]. 4 million from 5. 7 million a year ago. 3 % from $3. 3 million in 2006. $2. 0 million in 2007. in the u. s. from $2. 8 million a year ago. [SEP] \"i don't want to make any mistakes,\" he said. [SEP] \"he's going to do that, and if he's not going to do that, i don't know if he's going to do that,\" he said. [SEP] \"it's a little scary, it's a little scary, it's real,\" he said [SEP]"}
+{"type": "sample", "index": 10, "raw_text": "[CLS]. 9 million ( $ 0. 14 per share ), as compared to operating income of $ 0. 8 million in the second quarter of 2008. operating income rose to $ 11. 8 million ( $ 0. 15 ) in the second quarter from $ 9. 8 million, or $ 0. 10 per share, in the second quarter of 2008. compared to $ 7. 7 million, or $ 5. 5 million, in the second quarter of 2008. in the second quarter of 2009 compared to $ 14. 8 million reported in the second quarter of the second quarter of 2008. $ 5 million in the second quarter of [SEP]", "detok_text": "[CLS]. 9 million ($0. 14 per share), as compared to operating income of $0. 8 million in the second quarter of 2008. operating income rose to $11. 8 million ($0. 15) in the second quarter from $9. 8 million, or $0. 10 per share, in the second quarter of 2008. compared to $7. 7 million, or $5. 5 million, in the second quarter of 2008. in the second quarter of 2009 compared to $14. 8 million reported in the second quarter of the second quarter of 2008. $5 million in the second quarter of [SEP]"}
+{"type": "sample", "index": 11, "raw_text": "[CLS] t want to do anything wrong, \" he said. [SEP] \" i ' m trying to make things look good, \" she said. [SEP] \" if we don ' t do the same, we will have to do more, \" he said. [SEP] if they can ' t get a mortgage, they ' ll have to pay for it. [SEP] the road was closed. [SEP] \" we don ' t have the money to do that, \" he said. [SEP] washington ( cnn ) - - u. s. secretary of state hillary clinton said the united states will continue to work to increase its support to the wars in iraq and afghanistan [SEP]", "detok_text": "[CLS] t want to do anything wrong, \"he said. [SEP]\" i'm trying to make things look good, \"she said. [SEP]\" if we don't do the same, we will have to do more, \"he said. [SEP] if they can't get a mortgage, they'll have to pay for it. [SEP] the road was closed. [SEP]\" we don't have the money to do that, \" he said. [SEP] washington (cnn) - - u. s. secretary of state hillary clinton said the united states will continue to work to increase its support to the wars in iraq and afghanistan [SEP]"}
+{"type": "sample", "index": 12, "raw_text": "[CLS] ve ever seen, \" he said. [SEP] \" they don ' t have the money to pay for it, \" he said. [SEP] i ' m going to have to do that. [SEP] \" i don ' t think there ' s much that i ' m going to do, and i don ' t think that ' s enough, \" he said. [SEP] \" i thought about my retirement and i thought i wasn ' t there, \" he said. [SEP] \" i ' m not going to let them down, \" she said. [SEP] and i ' m sure it ' s a good thing. [SEP] the s & p 500 [SEP]", "detok_text": "[CLS] ve ever seen, \"he said. [SEP]\" they don't have the money to pay for it, \"he said. [SEP] i'm going to have to do that. [SEP]\" i don't think there's much that i'm going to do, and i don't think that's enough, \"he said. [SEP]\" i thought about my retirement and i thought i wasn't there, \"he said. [SEP]\" i'm not going to let them down, \" she said. [SEP] and i'm sure it's a good thing. [SEP] the s & p 500 [SEP]"}
+{"type": "sample", "index": 13, "raw_text": "[CLS] 9 a. m. to 5 : 30 p. m. to 1 : 30 p. m. [SEP] \" that ' s just something i don ' t understand, \" he said. [SEP] \" we don ' t need to get serious about what we have to do to get things done, \" he said. [SEP] \" you don ' t have to make a lot of money, \" he said. [SEP] \" to be honest, i ' m not going to tell you, \" he said. [SEP] \" i don ' t think that would be the last thing they wanted to do, \" he said. [SEP] the military said [SEP]", "detok_text": "[CLS] 9 a. m. to 5: 30 p. m. to 1: 30 p. m. [SEP] \"that's just something i don't understand,\" he said. [SEP] \"we don't need to get serious about what we have to do to get things done,\" he said. [SEP] \"you don't have to make a lot of money,\" he said. [SEP] \"to be honest, i'm not going to tell you,\" he said. [SEP] \"i don't think that would be the last thing they wanted to do,\" he said. [SEP] the military said [SEP]"}
+{"type": "sample", "index": 14, "raw_text": "[CLS]. [SEP] washington, march 2 ( upi ) - - sales of u. s. single - family homes rose 0. 3 percent in the third quarter, the u. s. government said. [SEP] washington, march 19 ( upi ) - - the u. s. economy contracted by a hefty 0. 5 percent in the second quarter, the u. s. government said tuesday. [SEP] that ' s what it means to me when i ' m young. [SEP] \" it ' s hard to know what ' s right, \" he said. [SEP] there ' s a lot of tension in the room. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] washington, march 2 (upi) - - sales of u. s. single - family homes rose 0. 3 percent in the third quarter, the u. s. government said. [SEP] washington, march 19 (upi) - - the u. s. economy contracted by a hefty 0. 5 percent in the second quarter, the u. s. government said tuesday. [SEP] that's what it means to me when i'm young. [SEP] \"it's hard to know what's right,\" he said. [SEP] there's a lot of tension in the room. [SEP] [SEP]"}
+{"type": "sample", "index": 15, "raw_text": "[CLS] the site. [SEP] it ' s not going to be a problem, but it ' s something that ' s where i ' m concerned. [SEP] the dow jones industrial average rose 10. 22 points, or 0. 5 percent, to 10, 086. 50. [SEP] cleveland used a 12 - 2 run to cut it to 80 - 65 with 4 : 36 left in the half. [SEP] we ' ve got a lot of money to spend, so i ' ll tell you we don ' t have to spend a lot. [SEP] \" it ' s not going to last that long, \" he said. [SEP] in addition, [SEP]", "detok_text": "[CLS] the site. [SEP] it's not going to be a problem, but it's something that's where i'm concerned. [SEP] the dow jones industrial average rose 10. 22 points, or 0. 5 percent, to 10, 086. 50. [SEP] cleveland used a 12 - 2 run to cut it to 80 - 65 with 4: 36 left in the half. [SEP] we've got a lot of money to spend, so i'll tell you we don't have to spend a lot. [SEP] \"it's not going to last that long,\" he said. [SEP] in addition, [SEP]"}
+{"type": "sample", "index": 16, "raw_text": "[CLS] minutes left in the first quarter. [SEP] \" i ' m not going to have to tell you how i ' m going to do it, \" he said. [SEP] \" if we don ' t have the things we ' re paying for, we ' ll have to pay for things we don ' t need, \" bernanke said. [SEP] \" but i don ' t think we ' ll be back to the end of the season if we don ' t do the right thing, \" he said. [SEP] \" i just don ' t want to go to school. [SEP] \" we ' ve got to win, \" he said [SEP]", "detok_text": "[CLS] minutes left in the first quarter. [SEP] \"i'm not going to have to tell you how i'm going to do it,\" he said. [SEP] \"if we don't have the things we're paying for, we'll have to pay for things we don't need,\" bernanke said. [SEP] \"but i don't think we'll be back to the end of the season if we don't do the right thing,\" he said. [SEP] \"i just don't want to go to school. [SEP]\" we've got to win, \" he said [SEP]"}
+{"type": "sample", "index": 17, "raw_text": "[CLS] second inning in new york ' s 3 - 2 win over the rockies. [SEP] but on the other hand, they still have work to do. [SEP] \" we have to have a clear understanding of what we have to do, and i think what we ' ll have to do in the future, \" he said. [SEP] \" i don ' t think there will be much worse, \" he said. [SEP] but if we don ' t do that, we ' re going to do that. [SEP] \" i don ' t know about it, \" he said. [SEP] i ' m trying to get things done, \" he said. [SEP]", "detok_text": "[CLS] second inning in new york's 3 - 2 win over the rockies. [SEP] but on the other hand, they still have work to do. [SEP] \"we have to have a clear understanding of what we have to do, and i think what we'll have to do in the future,\" he said. [SEP] \"i don't think there will be much worse,\" he said. [SEP] but if we don't do that, we're going to do that. [SEP] \"i don't know about it,\" he said. [SEP] i'm trying to get things done, \" he said. [SEP]"}
+{"type": "sample", "index": 18, "raw_text": "[CLS] companies. [SEP] there was no sign of significant damage to the building. [SEP] \" if you don ' t want to win, you have to make some effort to do that, \" he said. [SEP] i ' m not going to do that, but i ' m not going to do that, \" he said at a news conference. [SEP] \" i ' m not sure if it is going to be a deal, but it ' s going to be a lot more than that, \" he said. [SEP] he ' s a great president, but it won ' t work. [SEP] i ' m glad that some people don ' t [SEP]", "detok_text": "[CLS] companies. [SEP] there was no sign of significant damage to the building. [SEP] \"if you don't want to win, you have to make some effort to do that,\" he said. [SEP] i'm not going to do that, but i'm not going to do that, \"he said at a news conference. [SEP]\" i'm not sure if it is going to be a deal, but it's going to be a lot more than that, \" he said. [SEP] he's a great president, but it won't work. [SEP] i'm glad that some people don't [SEP]"}
+{"type": "sample", "index": 19, "raw_text": "[CLS] when i was on the plane. [SEP] i did not know. [SEP] \" that ' s the first decision we have to make, \" he said. [SEP] i don ' t know what we can do right now, but you have to get back to the top flight and get to the top. [SEP] the index of home prices rose to 22. 2 in 2009 from 22. 5 percent in 2008. [SEP] \" if you can ' t be a writer, you have to be a writer, you have to be a good person, you ' re a writer, you have to be a good person. [SEP] \" i ' m glad [SEP]", "detok_text": "[CLS] when i was on the plane. [SEP] i did not know. [SEP] \"that's the first decision we have to make,\" he said. [SEP] i don't know what we can do right now, but you have to get back to the top flight and get to the top. [SEP] the index of home prices rose to 22. 2 in 2009 from 22. 5 percent in 2008. [SEP] \"if you can't be a writer, you have to be a writer, you have to be a good person, you're a writer, you have to be a good person. [SEP]\" i'm glad [SEP]"}
+{"type": "sample", "index": 20, "raw_text": "[CLS] since 2001. [SEP] \" there ' s a lot of work to do, and if you don ' t need to do that, you have to get out of the way, \" he said. [SEP] washington, march 18 ( upi ) - - the u. s. military has become the focus of a new u. s. strategy for the war in afghanistan, a u. s. official said. [SEP] \" he said he didn ' t talk about it because he didn ' t want to talk about it. [SEP] \" i don ' t think we ' re going to get any better, \" he said. [SEP] the [SEP]", "detok_text": "[CLS] since 2001. [SEP] \"there's a lot of work to do, and if you don't need to do that, you have to get out of the way,\" he said. [SEP] washington, march 18 (upi) - - the u. s. military has become the focus of a new u. s. strategy for the war in afghanistan, a u. s. official said. [SEP] \"he said he didn't talk about it because he didn't want to talk about it. [SEP]\" i don't think we're going to get any better, \" he said. [SEP] the [SEP]"}
+{"type": "sample", "index": 21, "raw_text": "[CLS], 2009. [SEP] buffalo, n. y., jan. [SEP] 21 ( upi ) - - u. s. crude inventories fell 500, 000 in november from a year ago, the u. s. energy department said friday. [SEP] \" we don ' t know about him, we don ' t know him, \" he told the station. [SEP] \" if the government doesn ' t want to protect us, something ' s wrong, \" he said. [SEP] \" i do love to see him, i don ' t want to tell him what he wants, \" he said. [SEP] \" i don ' t think [SEP]", "detok_text": "[CLS], 2009. [SEP] buffalo, n. y., jan. [SEP] 21 (upi) - - u. s. crude inventories fell 500, 000 in november from a year ago, the u. s. energy department said friday. [SEP] \"we don't know about him, we don't know him,\" he told the station. [SEP] \"if the government doesn't want to protect us, something's wrong,\" he said. [SEP] \"i do love to see him, i don't want to tell him what he wants,\" he said. [SEP] \" i don't think [SEP]"}
+{"type": "sample", "index": 22, "raw_text": "[CLS] said. [SEP] \" we ' ve got to do that, and we ' ve got to be able to do that, \" he told reporters. [SEP] he ' s a nice guy, but i don ' t know him, i don ' t know. [SEP] \" it ' s really hard to see what ' s going to happen today, but we ' re sure we don ' t have to change the way we ' re going, \" he said. [SEP] \" you don ' t want to talk to a lot of people, you don ' t want to change anything, \" he said. [SEP] \" i don ' t think [SEP]", "detok_text": "[CLS] said. [SEP] \"we've got to do that, and we've got to be able to do that,\" he told reporters. [SEP] he's a nice guy, but i don't know him, i don't know. [SEP] \"it's really hard to see what's going to happen today, but we're sure we don't have to change the way we're going,\" he said. [SEP] \"you don't want to talk to a lot of people, you don't want to change anything,\" he said. [SEP] \" i don't think [SEP]"}
+{"type": "sample", "index": 23, "raw_text": "[CLS] 7 million, up 5. 4 % from the second quarter of 2006 and 7. 5 % from the third quarter of 2006, up 4 % from the second quarter of 2006. revenue of $ 7. 8 million was $ 7. 1 million, up 17 % from the third quarter of 2006. compared to the second quarter of 2007, the second quarter of revenue was $ 15. 2 million, up $ 4. 8 million, from $ 12. 4 million in the third quarter a year earlier. [SEP] \" it ' s important, it ' s important to you, \" he said. [SEP] washington ( ap ) - - [SEP]", "detok_text": "[CLS] 7 million, up 5. 4 % from the second quarter of 2006 and 7. 5 % from the third quarter of 2006, up 4 % from the second quarter of 2006. revenue of $7. 8 million was $7. 1 million, up 17 % from the third quarter of 2006. compared to the second quarter of 2007, the second quarter of revenue was $15. 2 million, up $4. 8 million, from $12. 4 million in the third quarter a year earlier. [SEP] \"it's important, it's important to you,\" he said. [SEP] washington (ap) - - [SEP]"}
+{"type": "sample", "index": 24, "raw_text": "[CLS] million, compared to $ 7. 4 million in the second quarter of 2008. the company reported a gross operating loss of $ 3. 0 million compared to gross income of $ 4. 1 million in the second quarter of 2008 and $ 7. 8 million of revenue in the second quarter of 2007 and the year ended december 31, 2007. gross operating income was $ 7. 9 million or 3. 3 % at march 31, 2008 compared to $ 9. 3 million in the first nine months of 2007. [SEP] what ' s true is that you don ' t have the money to look at it and sort it out. [SEP] [SEP]", "detok_text": "[CLS] million, compared to $7. 4 million in the second quarter of 2008. the company reported a gross operating loss of $3. 0 million compared to gross income of $4. 1 million in the second quarter of 2008 and $7. 8 million of revenue in the second quarter of 2007 and the year ended december 31, 2007. gross operating income was $7. 9 million or 3. 3 % at march 31, 2008 compared to $9. 3 million in the first nine months of 2007. [SEP] what's true is that you don't have the money to look at it and sort it out. [SEP] [SEP]"}
+{"type": "sample", "index": 25, "raw_text": "[CLS] to try to win. [SEP] \" i don ' t want to hurt him, \" he said. [SEP] it doesn ' t surprise me, \" he said. [SEP] \" if so, they wouldn ' t have had the opportunity to do that, \" he said. [SEP] \" we ' re not talking about that, but it ' s hard to say, \" he said. [SEP] \" it ' s going to make a lot of money for us, \" he said. [SEP] \" i don ' t know why. \" [SEP] \" we ' re not going to do anything, that ' s the goal, \" he said. [SEP] [SEP]", "detok_text": "[CLS] to try to win. [SEP] \"i don't want to hurt him,\" he said. [SEP] it doesn't surprise me, \"he said. [SEP]\" if so, they wouldn't have had the opportunity to do that, \"he said. [SEP]\" we're not talking about that, but it's hard to say, \"he said. [SEP]\" it's going to make a lot of money for us, \"he said. [SEP]\" i don't know why. \"[SEP]\" we're not going to do anything, that's the goal, \" he said. [SEP] [SEP]"}
+{"type": "sample", "index": 26, "raw_text": "[CLS] from 52. 3 % to 47. 3 %. [SEP] 5 ( upi ) - - u. s. president barack obama and president bill clinton met at the white house for a two - day visit, the white house said. [SEP] \" it ' s going to be tough, \" he said. [SEP] he declined to comment. [SEP] \" it ' s a very bad thing, \" he said. [SEP] \" i don ' t know, i don ' t think we ' re talking about it, \" he said. [SEP] \" i ' m not going back, \" he said. [SEP] new york, march 15 ( up [SEP]", "detok_text": "[CLS] from 52. 3 % to 47. 3 %. [SEP] 5 (upi) - - u. s. president barack obama and president bill clinton met at the white house for a two - day visit, the white house said. [SEP] \"it's going to be tough,\" he said. [SEP] he declined to comment. [SEP] \"it's a very bad thing,\" he said. [SEP] \"i don't know, i don't think we're talking about it,\" he said. [SEP] \"i'm not going back,\" he said. [SEP] new york, march 15 ( up [SEP]"}
+{"type": "sample", "index": 27, "raw_text": "[CLS] i ' m wrong, \" he said. [SEP] \" i do not think there is a lot of pressure in the kind of situation that we have to deal with, \" he said. [SEP] \" we ' ve got to help, we can ' t do anything, we can do anything, we don ' t want to do anything. [SEP] but he added that we were trying to make sure that we don ' t have the money to invest, \" the statement said. [SEP] so, i mean, i know, i ' m a muslim, i ' m not a muslim, i ' m a muslim, i don ' t [SEP]", "detok_text": "[CLS] i'm wrong, \"he said. [SEP]\" i do not think there is a lot of pressure in the kind of situation that we have to deal with, \"he said. [SEP]\" we've got to help, we can't do anything, we can do anything, we don't want to do anything. [SEP] but he added that we were trying to make sure that we don't have the money to invest, \" the statement said. [SEP] so, i mean, i know, i'm a muslim, i'm not a muslim, i'm a muslim, i don't [SEP]"}
+{"type": "sample", "index": 28, "raw_text": "[CLS] a loss of $ 4. 4 million, compared with a loss of $ 12. 5 million and a loss of $ 11. 7 million in the same period a year earlier. [SEP] staff writer stephen king contributed to this report. [SEP] \" he ' s right and i don ' t think that you don ' t need to talk about it, \" he said. [SEP] \" i know i don ' t know what ' s going on with them. [SEP] a year ago, revenue fell 4 percent to $ 1. 27 billion from 1. 24 billion. [SEP] \" there ' s no way i can go to see him, \" [SEP]", "detok_text": "[CLS] a loss of $4. 4 million, compared with a loss of $12. 5 million and a loss of $11. 7 million in the same period a year earlier. [SEP] staff writer stephen king contributed to this report. [SEP] \"he's right and i don't think that you don't need to talk about it,\" he said. [SEP] \"i know i don't know what's going on with them. [SEP] a year ago, revenue fell 4 percent to $1. 27 billion from 1. 24 billion. [SEP]\" there's no way i can go to see him, \" [SEP]"}
+{"type": "sample", "index": 29, "raw_text": "[CLS] do so. \" [SEP] i think it would be a good thing for them. [SEP] what do you want to do to make sure that you are going to be able to do the job, even if you don ' t have the money to do that? [SEP] \" you know what i ' m going to do with my son, \" he said. [SEP] \" we don ' t have enough money, so i don ' t know if anything is going to help, \" he said of the program. [SEP] \" when you have children, you don ' t have a lot of work to do, \" she said. [SEP] however, [SEP]", "detok_text": "[CLS] do so. \"[SEP] i think it would be a good thing for them. [SEP] what do you want to do to make sure that you are going to be able to do the job, even if you don't have the money to do that? [SEP]\" you know what i'm going to do with my son, \"he said. [SEP]\" we don't have enough money, so i don't know if anything is going to help, \"he said of the program. [SEP]\" when you have children, you don't have a lot of work to do, \" she said. [SEP] however, [SEP]"}
+{"type": "sample", "index": 30, "raw_text": "[CLS] u. s. troops. [SEP] \" i knew we wouldn ' t do it again, but i knew we ' d have to do the same thing, \" he said. [SEP] 21 ( upi ) - - industrial production in the united states fell 0. 3 percent in the third quarter, a u. s. department of energy report released thursday showed. [SEP] however, it ' s true, we have a different kind of legal system. [SEP] \" we ' re going to be able to do a lot of things, but we ' re going to do what we have to do, \" he said. [SEP] it ' s [SEP]", "detok_text": "[CLS] u. s. troops. [SEP] \"i knew we wouldn't do it again, but i knew we'd have to do the same thing,\" he said. [SEP] 21 (upi) - - industrial production in the united states fell 0. 3 percent in the third quarter, a u. s. department of energy report released thursday showed. [SEP] however, it's true, we have a different kind of legal system. [SEP] \"we're going to be able to do a lot of things, but we're going to do what we have to do,\" he said. [SEP] it's [SEP]"}
+{"type": "sample", "index": 31, "raw_text": "[CLS] going to have to think about what ' s good, \" palin said. [SEP] he ' s going to change things. [SEP] \" no, i don ' t want to say i ' m not going to fly, \" he said. [SEP] apple ' s shares fell $ 1. 14, or 7. 5 percent, to $ 28. 40 in the first three months of the year. [SEP] he ' s the best player in the world, he ' s the best player these days, he ' s going to win gold. [SEP] \" that ' s the thing to do, \" he said. [SEP] i think we are [SEP]", "detok_text": "[CLS] going to have to think about what's good, \"palin said. [SEP] he's going to change things. [SEP]\" no, i don't want to say i'm not going to fly, \"he said. [SEP] apple's shares fell $1. 14, or 7. 5 percent, to $28. 40 in the first three months of the year. [SEP] he's the best player in the world, he's the best player these days, he's going to win gold. [SEP]\" that's the thing to do, \" he said. [SEP] i think we are [SEP]"}
+{"type": "sample", "index": 32, "raw_text": "[CLS] times a day. [SEP] associated press writers david d. kennedy in buffalo, n. y., and robert f. kennedy in buffalo, n. y., contributed to this report. [SEP] \" i ' d like to have to pay attention to what i ' ve done, \" she said. [SEP] \" we don ' t have to do what we always do, but if we can do the job, we don ' t have to do anything, \" he said. [SEP] i know he ' s a bad guy, but i don ' t want to know how he ' s doing what he ' s doing. [SEP] the [SEP]", "detok_text": "[CLS] times a day. [SEP] associated press writers david d. kennedy in buffalo, n. y., and robert f. kennedy in buffalo, n. y., contributed to this report. [SEP] \"i'd like to have to pay attention to what i've done,\" she said. [SEP] \"we don't have to do what we always do, but if we can do the job, we don't have to do anything,\" he said. [SEP] i know he's a bad guy, but i don't want to know how he's doing what he's doing. [SEP] the [SEP]"}
+{"type": "sample", "index": 33, "raw_text": "[CLS] intelligence agency. [SEP] it ' s a big deal, \" he said. [SEP] \" i don ' t want to change, \" he said. [SEP] \" there ' s one thing we know, but we don ' t know where we are, and we don ' t know where, \" he said. [SEP] \" if i want to be successful, i have to be careful, \" he said. [SEP] \" i ' m not sure we ' re talking about it, but i don ' t think that we would want to make do with that, \" he told reporters. [SEP] \" i don ' t think i didn ' t [SEP]", "detok_text": "[CLS] intelligence agency. [SEP] it's a big deal, \"he said. [SEP]\" i don't want to change, \"he said. [SEP]\" there's one thing we know, but we don't know where we are, and we don't know where, \"he said. [SEP]\" if i want to be successful, i have to be careful, \"he said. [SEP]\" i'm not sure we're talking about it, but i don't think that we would want to make do with that, \"he told reporters. [SEP]\" i don't think i didn't [SEP]"}
+{"type": "sample", "index": 34, "raw_text": "[CLS] to 66 - 65 with 10 : 41 in the third quarter, including three 3 - pointers for a 50 - 37 lead. [SEP] \" it ' s going to take a couple of days, but it hasn ' t been easy, \" he said. [SEP] new york ( reuters ) - the u. s. economy in the u. s. grew 0. 5 percent in the third quarter, down 0. 3 percent from the second quarter of 2008, while the rate of decline grew to 0. 4 percent in the second quarter, the bank said. [SEP] \" i ' m really sorry that he didn ' t know how [SEP]", "detok_text": "[CLS] to 66 - 65 with 10: 41 in the third quarter, including three 3 - pointers for a 50 - 37 lead. [SEP] \"it's going to take a couple of days, but it hasn't been easy,\" he said. [SEP] new york (reuters) - the u. s. economy in the u. s. grew 0. 5 percent in the third quarter, down 0. 3 percent from the second quarter of 2008, while the rate of decline grew to 0. 4 percent in the second quarter, the bank said. [SEP] \" i'm really sorry that he didn't know how [SEP]"}
+{"type": "sample", "index": 35, "raw_text": "[CLS] sun reported on monday. [SEP] \" i don ' t know how much, but i don ' t know much, \" he said. [SEP] \" we ' ve got to be careful. [SEP] \" if it ' s not going to be enough, that ' s what we ' re going to have to do, \" he said. [SEP] \" i feel like i don ' t have enough, \" he said. [SEP] the dow fell 25. 53 points, or 2. 4 percent, to 11, 365. 15. [SEP] the company ' s stock rose $ 14. 50, or 3. 4 percent, to $ 34. [SEP]", "detok_text": "[CLS] sun reported on monday. [SEP] \"i don't know how much, but i don't know much,\" he said. [SEP] \"we've got to be careful. [SEP]\" if it's not going to be enough, that's what we're going to have to do, \"he said. [SEP]\" i feel like i don't have enough, \" he said. [SEP] the dow fell 25. 53 points, or 2. 4 percent, to 11, 365. 15. [SEP] the company's stock rose $14. 50, or 3. 4 percent, to $34. [SEP]"}
+{"type": "sample", "index": 36, "raw_text": "[CLS] [SEP] \" i don ' t think there ' s much work to do. [SEP] \" right now we ' ll never get anything done, \" he said. [SEP] i ' m not sure that has anything to do with that. [SEP] \" it is very important for us to move so quickly to address the challenges of the economy, \" mr buffett said. [SEP] \" i ' ve never had an open race, but i don ' t know, \" he said. [SEP] \" i ' m not sure, i don ' t know him, i don ' t know what to do with him. [SEP] and it ' s not a [SEP]", "detok_text": "[CLS] [SEP] \"i don't think there's much work to do. [SEP]\" right now we'll never get anything done, \"he said. [SEP] i'm not sure that has anything to do with that. [SEP]\" it is very important for us to move so quickly to address the challenges of the economy, \"mr buffett said. [SEP]\" i've never had an open race, but i don't know, \"he said. [SEP]\" i'm not sure, i don't know him, i don't know what to do with him. [SEP] and it's not a [SEP]"}
+{"type": "sample", "index": 37, "raw_text": "[CLS] u. s., the u. s. and its allies. [SEP] \" it ' s a lot of fun, and it ' s a lot of fun, \" he said of the course. [SEP] the tory leader said : \" i think we can get things right. [SEP] for now, however, we have to be careful about the future. [SEP] \" we ' ll have to know we don ' t have the time to talk, \" he said. [SEP] \" i don ' t think we ' ll have to wait, but i think that ' s a good thing to do, \" he said. [SEP] don ' t [SEP]", "detok_text": "[CLS] u. s., the u. s. and its allies. [SEP] \"it's a lot of fun, and it's a lot of fun,\" he said of the course. [SEP] the tory leader said: \"i think we can get things right. [SEP] for now, however, we have to be careful about the future. [SEP]\" we'll have to know we don't have the time to talk, \"he said. [SEP]\" i don't think we'll have to wait, but i think that's a good thing to do, \" he said. [SEP] don't [SEP]"}
+{"type": "sample", "index": 38, "raw_text": "[CLS] by gwen robinson on monday, may 18th, 2009 at 5 : 40 am ( est ). [SEP] i don ' t want to go any further away from the truth. [SEP] at 5 : 57 of the first period, new york scored twice in the first period to take a 3 - 2 lead at 5 : 14 of the second. [SEP] that ' s what we ' re doing. [SEP] \" i don ' t know what i want to do, but what i ' m going to do, \" hawley said. [SEP] \" i don ' t think it will have a significant impact on me, \" he said. [SEP] the [SEP]", "detok_text": "[CLS] by gwen robinson on monday, may 18th, 2009 at 5: 40 am (est). [SEP] i don't want to go any further away from the truth. [SEP] at 5: 57 of the first period, new york scored twice in the first period to take a 3 - 2 lead at 5: 14 of the second. [SEP] that's what we're doing. [SEP] \"i don't know what i want to do, but what i'm going to do,\" hawley said. [SEP] \"i don't think it will have a significant impact on me,\" he said. [SEP] the [SEP]"}
+{"type": "sample", "index": 39, "raw_text": "[CLS] $ 1. 7 billion a year earlier. [SEP] \" i don ' t know what i ' m doing, \" he said. [SEP] \" i don ' t think we ' re really talking about it right now, and we ' re not talking about that, \" he said. [SEP] 2 ( upi ) - - the u. s. defense department has contracted u. s. armed forces to support u. s. military operations, the defense department said monday. [SEP] \" there is going to be a lot of work to do right now, \" he said. [SEP] 21 ( upi ) - - u. s. [SEP]", "detok_text": "[CLS] $1. 7 billion a year earlier. [SEP] \"i don't know what i'm doing,\" he said. [SEP] \"i don't think we're really talking about it right now, and we're not talking about that,\" he said. [SEP] 2 (upi) - - the u. s. defense department has contracted u. s. armed forces to support u. s. military operations, the defense department said monday. [SEP] \"there is going to be a lot of work to do right now,\" he said. [SEP] 21 (upi) - - u. s. [SEP]"}
+{"type": "sample", "index": 40, "raw_text": "[CLS] \" he said. [SEP] it ' s very hard to say there is a solution. [SEP] \" i ' m not going to be married, i ' m not married, \" he said. [SEP] \" if you don ' t do that, it ' s very tough, \" he said. [SEP] i ' m very excited about that, \" he said. [SEP] i don ' t want to talk about it, i don ' t want to talk about it, \" he told afp. [SEP] \" i think if there are only a couple of things, it ' s just one way to get a job, \" he said. [SEP]", "detok_text": "[CLS] \"he said. [SEP] it's very hard to say there is a solution. [SEP]\" i'm not going to be married, i'm not married, \"he said. [SEP]\" if you don't do that, it's very tough, \"he said. [SEP] i'm very excited about that,\" he said. [SEP] i don't want to talk about it, i don't want to talk about it, \"he told afp. [SEP]\" i think if there are only a couple of things, it's just one way to get a job, \" he said. [SEP]"}
+{"type": "sample", "index": 41, "raw_text": "[CLS], the team ' s 2008 first - round pick. [SEP] 11 ( upi ) - - u. s. president barack obama is considering adding more u. s. troops to u. s. military operations, the white house said. [SEP] \" he ' s a great man, i think he ' s a great person, \" he said. [SEP] \" we ' re not going to be able to pass a bill that will extend coverage to the poor, \" he said. [SEP] \" i want to leave, i don ' t want to leave. [SEP] \" i know i ' m going to do it again, \" he [SEP]", "detok_text": "[CLS], the team's 2008 first - round pick. [SEP] 11 (upi) - - u. s. president barack obama is considering adding more u. s. troops to u. s. military operations, the white house said. [SEP] \"he's a great man, i think he's a great person,\" he said. [SEP] \"we're not going to be able to pass a bill that will extend coverage to the poor,\" he said. [SEP] \"i want to leave, i don't want to leave. [SEP]\" i know i'm going to do it again, \" he [SEP]"}
+{"type": "sample", "index": 42, "raw_text": "[CLS] china in the face of weak u. s. economic growth. [SEP] \" he ' s got to be a good player at the moment, \" beckham said. [SEP] i ' m not talking about it anymore, i ' m talking about it, but i don ' t think that would be the case, \" beckham said. [SEP] \" it ' s too early to tell whether i am going to be ready for another year, \" he said. [SEP] \" i don ' t think we can ' t get any better, \" he said. [SEP] \" i ' m not going to come back, \" he said. [SEP] [SEP]", "detok_text": "[CLS] china in the face of weak u. s. economic growth. [SEP] \"he's got to be a good player at the moment,\" beckham said. [SEP] i'm not talking about it anymore, i'm talking about it, but i don't think that would be the case, \"beckham said. [SEP]\" it's too early to tell whether i am going to be ready for another year, \"he said. [SEP]\" i don't think we can't get any better, \"he said. [SEP]\" i'm not going to come back, \" he said. [SEP] [SEP]"}
+{"type": "sample", "index": 43, "raw_text": "[CLS] have to pay. [SEP] \" it ' s a good idea, \" said michael martin, the site ' s marketing director. [SEP] but i don ' t think that ' s true. [SEP] \" i don ' t want things to happen here, \" he said. [SEP] \" i don ' t feel like what you do, i don ' t like what you really do, \" she said. [SEP] \" i think it ' s a small step, i think it will have an impact on our health, \" nader said at a private news conference. [SEP] \" i mean, you don ' t really feel like you ' re [SEP]", "detok_text": "[CLS] have to pay. [SEP] \"it's a good idea,\" said michael martin, the site's marketing director. [SEP] but i don't think that's true. [SEP] \"i don't want things to happen here,\" he said. [SEP] \"i don't feel like what you do, i don't like what you really do,\" she said. [SEP] \"i think it's a small step, i think it will have an impact on our health,\" nader said at a private news conference. [SEP] \" i mean, you don't really feel like you're [SEP]"}
+{"type": "sample", "index": 44, "raw_text": "[CLS] end of the year. [SEP] \" it ' s not possible at all, \" he told reporters. [SEP] third - quarter operating income increased $ 2. 7 million, up $ 1. 2 million, or 4. 5 percent, to $ 80. 6 million, and operating income increased $ 9. 7 million, or 3. 5 percent, to $ 80. 8 million, up $ 1. 8 million, or 4 percent, to $ 15. 6 million. [SEP] \" i don ' t think we ' re going to have a general election, \" he said. [SEP] \" i don ' t want to make any decisions [SEP]", "detok_text": "[CLS] end of the year. [SEP] \"it's not possible at all,\" he told reporters. [SEP] third - quarter operating income increased $2. 7 million, up $1. 2 million, or 4. 5 percent, to $80. 6 million, and operating income increased $9. 7 million, or 3. 5 percent, to $80. 8 million, up $1. 8 million, or 4 percent, to $15. 6 million. [SEP] \"i don't think we're going to have a general election,\" he said. [SEP] \" i don't want to make any decisions [SEP]"}
+{"type": "sample", "index": 45, "raw_text": "[CLS] at the end of the year. \" [SEP] december retail sales also rose at an annual rate of 0. 3 percent, as compared to december ' s gain of 0. 3 percent. [SEP] i didn ' t know anything about it. [SEP] \" i think we ' ll see if we ' ll change a lot and if we ' ll try to change things, \" he told the associated press. [SEP] in early trading in tokyo, the index was down 5. 54, or 0. 3 percent, at 9, 319. 17. [SEP] ( ap ) - - the commerce department says retail sales rose 0. 1 percent in july [SEP]", "detok_text": "[CLS] at the end of the year. \"[SEP] december retail sales also rose at an annual rate of 0. 3 percent, as compared to december's gain of 0. 3 percent. [SEP] i didn't know anything about it. [SEP]\" i think we'll see if we'll change a lot and if we'll try to change things, \" he told the associated press. [SEP] in early trading in tokyo, the index was down 5. 54, or 0. 3 percent, at 9, 319. 17. [SEP] (ap) - - the commerce department says retail sales rose 0. 1 percent in july [SEP]"}
+{"type": "sample", "index": 46, "raw_text": "[CLS] washington, march 6 ( upi ) - - u. s. health care spending in the third quarter rose 6. 3 percent to $ 11. 4 billion, the u. s. government said. [SEP] china ' s trade deficit will total almost $ 100 billion this year. [SEP] \" i don ' t think he ' s going to win this election, he ' s a very good guy, he ' s a good guy, he doesn ' t win, \" clinton said at a news conference. [SEP] \" there ' s little else we can do to change that, \" he said. [SEP] los angeles ( ap ) - [SEP]", "detok_text": "[CLS] washington, march 6 (upi) - - u. s. health care spending in the third quarter rose 6. 3 percent to $11. 4 billion, the u. s. government said. [SEP] china's trade deficit will total almost $100 billion this year. [SEP] \"i don't think he's going to win this election, he's a very good guy, he's a good guy, he doesn't win,\" clinton said at a news conference. [SEP] \"there's little else we can do to change that,\" he said. [SEP] los angeles (ap) - [SEP]"}
+{"type": "sample", "index": 47, "raw_text": "[CLS] £78, 000. [SEP] buffalo, n. y., march 2 ( upi ) - - scott rolen hit a two - run homer, carrying the chicago cubs to an 8 - 5 win over the new york yankees. [SEP] i ' m going to talk about it, but i ' m not going to talk, \" he said. [SEP] the cavaliers led 50 - 50 with a 7 - 4 run in the first half of the third quarter, including a 2 - 7 run that gave the cavaliers a 50 - 36 lead in the second quarter. [SEP] \" i don ' t think it ' s going to change [SEP]", "detok_text": "[CLS] £78, 000. [SEP] buffalo, n. y., march 2 (upi) - - scott rolen hit a two - run homer, carrying the chicago cubs to an 8 - 5 win over the new york yankees. [SEP] i'm going to talk about it, but i'm not going to talk, \"he said. [SEP] the cavaliers led 50 - 50 with a 7 - 4 run in the first half of the third quarter, including a 2 - 7 run that gave the cavaliers a 50 - 36 lead in the second quarter. [SEP]\" i don't think it's going to change [SEP]"}
+{"type": "sample", "index": 48, "raw_text": "[CLS] 25 years. [SEP] \" it ' s not a good place to do it and you don ' t have to do it. [SEP] \" we ' ve got more work to do. [SEP] 16 / prnewswire - usnewswire / - - the u. s. dollar. $ 6. 0 million compared to $ 6. 1 million in the second quarter of 2006. from $ 2. 5 million in the second quarter of 2006. compared to a loss of $ 2. 9 million in the third quarter of 2006. same loss in the second quarter of 2006. $ 5. 5 million in the second quarter of [SEP]", "detok_text": "[CLS] 25 years. [SEP] \"it's not a good place to do it and you don't have to do it. [SEP]\" we've got more work to do. [SEP] 16/prnewswire - usnewswire/- - the u. s. dollar. $6. 0 million compared to $6. 1 million in the second quarter of 2006. from $2. 5 million in the second quarter of 2006. compared to a loss of $2. 9 million in the third quarter of 2006. same loss in the second quarter of 2006. $5. 5 million in the second quarter of [SEP]"}
+{"type": "sample", "index": 49, "raw_text": "[CLS] we are going to see a lot of growth, \" he said. [SEP] \" i don ' t know what he ' s going to have to do with these things, i don ' t know he ' s going to have to do that, \" he said. [SEP] \" we don ' t know what to do, we don ' t want to do that, \" the official said. [SEP] 13 ( upi ) - - mark reynolds and ryan braun hit a three - run homer friday, carrying the chicago cubs to a 5 - 2 win over the minnesota twins. [SEP] \" i ' m not going to do that, \" [SEP]", "detok_text": "[CLS] we are going to see a lot of growth, \"he said. [SEP]\" i don't know what he's going to have to do with these things, i don't know he's going to have to do that, \"he said. [SEP]\" we don't know what to do, we don't want to do that, \"the official said. [SEP] 13 (upi) - - mark reynolds and ryan braun hit a three - run homer friday, carrying the chicago cubs to a 5 - 2 win over the minnesota twins. [SEP]\" i'm not going to do that, \" [SEP]"}
+{"type": "sample", "index": 50, "raw_text": "[CLS] down 0. 6 per cent at $ 45. 80 and was down 0. 8 per cent or 0. 7 per cent at $ 34. 50. [SEP] the unemployment rate dropped to 7. 5 percent in april. [SEP] 30 ( upi ) - - the u. s. is prepared to send thousands of troops to support the u. s. effort to defeat al - qaida and target u. s. troops in afghanistan, u. s. officials said. [SEP] \" i ' m trying to get a little bit nervous, i don ' t like that, but it ' s a little more important. [SEP] [SEP]", "detok_text": "[CLS] down 0. 6 per cent at $45. 80 and was down 0. 8 per cent or 0. 7 per cent at $34. 50. [SEP] the unemployment rate dropped to 7. 5 percent in april. [SEP] 30 (upi) - - the u. s. is prepared to send thousands of troops to support the u. s. effort to defeat al - qaida and target u. s. troops in afghanistan, u. s. officials said. [SEP] \" i'm trying to get a little bit nervous, i don't like that, but it's a little more important. [SEP] [SEP]"}
+{"type": "sample", "index": 51, "raw_text": "[CLS] to get where they are, \" he said. [SEP] \" there is a comprehensive plan to address the problem, \" the agency said in a statement. [SEP] washington, march 4 ( upi ) - - u. s. sen. john mccain has met president obama on his first trip to africa since the 9 / 11 attacks, a spokesman said. [SEP] washington, march 16 ( upi ) - - u. s. sen. edward kennedy, the democratic chairman of the u. s. senate, says his health care efforts have been successful. [SEP] he also said there are \" serious concerns \" about climate change, and he [SEP]", "detok_text": "[CLS] to get where they are, \"he said. [SEP]\" there is a comprehensive plan to address the problem, \"the agency said in a statement. [SEP] washington, march 4 (upi) - - u. s. sen. john mccain has met president obama on his first trip to africa since the 9/11 attacks, a spokesman said. [SEP] washington, march 16 (upi) - - u. s. sen. edward kennedy, the democratic chairman of the u. s. senate, says his health care efforts have been successful. [SEP] he also said there are\" serious concerns \" about climate change, and he [SEP]"}
+{"type": "sample", "index": 52, "raw_text": "[CLS] to deal with the crisis. [SEP] \" i don ' t talk to anyone, \" he said. [SEP] the standard & poor ' s 500 index rose 4. 13 points, or 0. 03 percent, to 948. 13. [SEP] we don ' t want to have a government, but we have to work hard, \" he said in a statement. [SEP] \" we end up with a huge amount of money, \" he added. [SEP] that ' s what they do. [SEP] \" i think we ' ll be successful, and if we ' re successful, we ' re going to be able to do it again. [SEP] [SEP]", "detok_text": "[CLS] to deal with the crisis. [SEP] \"i don't talk to anyone,\" he said. [SEP] the standard & poor's 500 index rose 4. 13 points, or 0. 03 percent, to 948. 13. [SEP] we don't want to have a government, but we have to work hard, \"he said in a statement. [SEP]\" we end up with a huge amount of money, \"he added. [SEP] that's what they do. [SEP]\" i think we'll be successful, and if we're successful, we're going to be able to do it again. [SEP] [SEP]"}
+{"type": "sample", "index": 53, "raw_text": "[CLS] ended march 31, 2006. compared to $ 11. 8 million, or $ 4. 9 million, at december 31, 2006. compared to $ 7. 4 million in the u. s. 2006. compared to $ 11. 8 million, or $ 9. 4 million. [SEP] \" i don ' t know, i don ' t know, and i don ' t know who is doing it, \" she said. [SEP] \" i don ' t think things will get a lot better, \" he said. [SEP] \" that is the step we ' ll have to take to make that work, \" he said. [SEP] [SEP]", "detok_text": "[CLS] ended march 31, 2006. compared to $11. 8 million, or $4. 9 million, at december 31, 2006. compared to $7. 4 million in the u. s. 2006. compared to $11. 8 million, or $9. 4 million. [SEP] \"i don't know, i don't know, and i don't know who is doing it,\" she said. [SEP] \"i don't think things will get a lot better,\" he said. [SEP] \"that is the step we'll have to take to make that work,\" he said. [SEP] [SEP]"}
+{"type": "sample", "index": 54, "raw_text": "[CLS]. [SEP] \" if i don ' t want to be here, i ' m going to be here, i won ' t be here, \" he said. [SEP] \" it ' s not just about money, it ' s about money, it ' s money, \" he said. [SEP] microsoft has more than 14, 000 employees, according to the company ' s website. [SEP] \" i don ' t need to know much, \" he said. [SEP] \" i have been on the road for a number of years, i think. [SEP] washington, march 4 ( upi ) - - the top u. s. diplomat in [SEP]", "detok_text": "[CLS]. [SEP] \"if i don't want to be here, i'm going to be here, i won't be here,\" he said. [SEP] \"it's not just about money, it's about money, it's money,\" he said. [SEP] microsoft has more than 14, 000 employees, according to the company's website. [SEP] \"i don't need to know much,\" he said. [SEP] \" i have been on the road for a number of years, i think. [SEP] washington, march 4 (upi) - - the top u. s. diplomat in [SEP]"}
+{"type": "sample", "index": 55, "raw_text": "[CLS] £25, 000 - £25, 001. £40, 866 - £40, 000 per annum. we have a richness of history, heritage and culture..... £25, 000 - £28, 000 per annum. through a combination of education, culture and heritage..... oh. sports, natural history, heritage, history, natural history, as well as fishing, hiking, fishing, fishing, fishing.... oh. [SEP] \" it ' s good for us, it ' s good for us, \" she said. [SEP] i don ' t think we have [SEP]", "detok_text": "[CLS] £25, 000 - £25, 001. £40, 866 - £40, 000 per annum. we have a richness of history, heritage and culture..... £25, 000 - £28, 000 per annum. through a combination of education, culture and heritage..... oh. sports, natural history, heritage, history, natural history, as well as fishing, hiking, fishing, fishing, fishing.... oh. [SEP] \"it's good for us, it's good for us,\" she said. [SEP] i don't think we have [SEP]"}
+{"type": "sample", "index": 56, "raw_text": "[CLS] a news conference. [SEP] trenton, n. j., may 18 / prnewswire - usnewswire / - - the u. s. department of defense ( fco ) is scheduled to hold a conference call on thursday, may 14, 2009 at 11 : 00 a. m. [SEP] obama is planning to send another 30, 000 troops to afghanistan by the end of the year, and there are expected to be 40, 000 troops, according to the white house. [SEP] this entry was posted by tracy alloway on friday, august 5th, 2009 at 16 : 43 and is filed under capital markets. [SEP] [SEP]", "detok_text": "[CLS] a news conference. [SEP] trenton, n. j., may 18/prnewswire - usnewswire/- - the u. s. department of defense (fco) is scheduled to hold a conference call on thursday, may 14, 2009 at 11: 00 a. m. [SEP] obama is planning to send another 30, 000 troops to afghanistan by the end of the year, and there are expected to be 40, 000 troops, according to the white house. [SEP] this entry was posted by tracy alloway on friday, august 5th, 2009 at 16: 43 and is filed under capital markets. [SEP] [SEP]"}
+{"type": "sample", "index": 57, "raw_text": "[CLS] million, or 5. 2 %, compared to 7. 2 % in the second quarter of 2008. for the second quarter of 2009, $ 7. 5 million, or 12. 7 %, compared to revenue of $ 7. 8 million in the second quarter of 2008. operating income was $ 13. 4 million, an increase of $ 8. 8 million, or 4. 6 %, from the third quarter of 2008. operating income was $ 7. 7 million in the second quarter of 2009, compared to operating income of $ 5. 4 million, or 4. 4 %, compared to the second quarter of 2008 [SEP]", "detok_text": "[CLS] million, or 5. 2 %, compared to 7. 2 % in the second quarter of 2008. for the second quarter of 2009, $7. 5 million, or 12. 7 %, compared to revenue of $7. 8 million in the second quarter of 2008. operating income was $13. 4 million, an increase of $8. 8 million, or 4. 6 %, from the third quarter of 2008. operating income was $7. 7 million in the second quarter of 2009, compared to operating income of $5. 4 million, or 4. 4 %, compared to the second quarter of 2008 [SEP]"}
+{"type": "sample", "index": 58, "raw_text": "[CLS] 2006. $ 5. 3 million in the second quarter of 2006. million, compared to $ 7. 7 million in the third quarter of 2006. $ 1. 5 million, or 4. 4 %, in the second quarter of 2006. 6. 6 % and 4. 6 % in the second quarter of 2006. from 3. 8 % in the second quarter of 2006. compared to a growth rate of 5. 7 % in the second quarter of 2006. $ 7. 3 million, or $ 0. 03 per share, in the third quarter of 2006. compared to 5. 3 % in the second quarter of [SEP]", "detok_text": "[CLS] 2006. $5. 3 million in the second quarter of 2006. million, compared to $7. 7 million in the third quarter of 2006. $1. 5 million, or 4. 4 %, in the second quarter of 2006. 6. 6 % and 4. 6 % in the second quarter of 2006. from 3. 8 % in the second quarter of 2006. compared to a growth rate of 5. 7 % in the second quarter of 2006. $7. 3 million, or $0. 03 per share, in the third quarter of 2006. compared to 5. 3 % in the second quarter of [SEP]"}
+{"type": "sample", "index": 59, "raw_text": "[CLS] 2008. [SEP] east rutherford, n. j., march 2 ( upi ) - - cole hamels hit a three - run home run in the sixth inning, giving the phillies a 5 - 2 win over the minnesota twins. [SEP] \" i think there will be some improvement in the coming months, \" he said. [SEP] we ' ve got some things we have to do. [SEP] chicago, march 4 ( upi ) - - scott schwern scored his first goal of the season monday, leading the chicago fire to a 3 - 2 win over the dallas stars. [SEP] \" i feel sorry, i ' m [SEP]", "detok_text": "[CLS] 2008. [SEP] east rutherford, n. j., march 2 (upi) - - cole hamels hit a three - run home run in the sixth inning, giving the phillies a 5 - 2 win over the minnesota twins. [SEP] \"i think there will be some improvement in the coming months,\" he said. [SEP] we've got some things we have to do. [SEP] chicago, march 4 (upi) - - scott schwern scored his first goal of the season monday, leading the chicago fire to a 3 - 2 win over the dallas stars. [SEP] \" i feel sorry, i'm [SEP]"}
+{"type": "sample", "index": 60, "raw_text": "[CLS] know, \" he said. [SEP] i don ' t want to do anything anymore. [SEP] \" i don ' t want to look at anything, \" he told me. [SEP] i don ' t want it to be bad for you, \" he told me. [SEP] \" if there ' s going to be a lot of money out of the way, there will be a whole lot of pressure, \" he said. [SEP] this article was first published on guardian. co. uk at 15. 05 gmt on monday 16 march 2009. [SEP] it ' s the right time to go, and it ' s the right time to go [SEP]", "detok_text": "[CLS] know, \"he said. [SEP] i don't want to do anything anymore. [SEP]\" i don't want to look at anything, \"he told me. [SEP] i don't want it to be bad for you,\" he told me. [SEP] \"if there's going to be a lot of money out of the way, there will be a whole lot of pressure,\" he said. [SEP] this article was first published on guardian. co. uk at 15. 05 gmt on monday 16 march 2009. [SEP] it's the right time to go, and it's the right time to go [SEP]"}
+{"type": "sample", "index": 61, "raw_text": "[CLS] ' s not going to be enough, it ' s a good thing, \" he said. [SEP] \" we ' ve got to do that, \" he told a news conference in london. [SEP] i don ' t do anything, \" he said. [SEP] \" i don ' t think it ' s a good thing, \" he said. [SEP] \" i ' m not worried about doing my job, \" he said. [SEP] \" i just don ' t want to go to school, i ' m young, so i don ' t want to be able to go to school, \" he said. [SEP] i don ' t want [SEP]", "detok_text": "[CLS]'s not going to be enough, it's a good thing, \"he said. [SEP]\" we've got to do that, \"he told a news conference in london. [SEP] i don't do anything,\" he said. [SEP] \"i don't think it's a good thing,\" he said. [SEP] \"i'm not worried about doing my job,\" he said. [SEP] \"i just don't want to go to school, i'm young, so i don't want to be able to go to school,\" he said. [SEP] i don't want [SEP]"}
+{"type": "sample", "index": 62, "raw_text": "[CLS] take place. [SEP] \" i don ' t really know what he ' s going to do, particularly what he ' s going to do, \" he said. [SEP] it is expected to be finished by the end of 2010. [SEP] we don ' t yet know what it will be, but we ' re trying to get it. [SEP] this entry was posted by neil hume on thursday, march 6th, 2009 at 11 : 35 and is filed under capital markets. [SEP] he was taken to st john ' s medical centre, then taken back to the hospital for treatment. [SEP] with more than 10, 000 employees a year, the company [SEP]", "detok_text": "[CLS] take place. [SEP] \"i don't really know what he's going to do, particularly what he's going to do,\" he said. [SEP] it is expected to be finished by the end of 2010. [SEP] we don't yet know what it will be, but we're trying to get it. [SEP] this entry was posted by neil hume on thursday, march 6th, 2009 at 11: 35 and is filed under capital markets. [SEP] he was taken to st john's medical centre, then taken back to the hospital for treatment. [SEP] with more than 10, 000 employees a year, the company [SEP]"}
+{"type": "sample", "index": 63, "raw_text": "[CLS] for me, \" he said. [SEP] washington, march 13 ( upi ) - - the u. s. military is prepared to withdraw troops from iraq by the end of the year, u. s. and iraqi officials said monday. [SEP] but he ' s not alone. [SEP] \" i didn ' t get it right, \" he said. [SEP] \" if i ' m going to be here, i ' m going to be there. [SEP] \" i ' m not going to be able to make any mistakes, but that ' s what i want, and i ' m a little disappointed. [SEP] but he conceded that there [SEP]", "detok_text": "[CLS] for me, \"he said. [SEP] washington, march 13 (upi) - - the u. s. military is prepared to withdraw troops from iraq by the end of the year, u. s. and iraqi officials said monday. [SEP] but he's not alone. [SEP]\" i didn't get it right, \"he said. [SEP]\" if i'm going to be here, i'm going to be there. [SEP] \" i'm not going to be able to make any mistakes, but that's what i want, and i'm a little disappointed. [SEP] but he conceded that there [SEP]"}

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_4096steps_n64/state_c256_t1p45_detok_raw_samples.txt

@@ -0,0 +1,228 @@
+state_c256_t1p45_detok
+{
+  "type": "summary",
+  "name": "state_c256_t1p45",
+  "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt",
+  "step": 124000,
+  "decode": {
+    "kind": "categorical_fullvocab",
+    "config": "state_c256_t1p45",
+    "steps": 4096,
+    "model_t_mode": "post",
+    "support_power": 1.0,
+    "semantic_power": 1.0,
+    "endpoint_temp": 1.45,
+    "concentration_min": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 15.863792771486848,
+    "nll_per_token": 2.7640393283161675,
+    "tokens": 9236
+  },
+  "diversity": {
+    "sample_entropy": 3.8477992784844646,
+    "unique_tokens": 972,
+    "token_count": 8192,
+    "distinct_1": 0.11865234375,
+    "distinct_2": 0.3817667322834646,
+    "top_token_mass": 0.0645751953125
+  }
+}
+
+===== sample 000 =====
+[CLS]. [SEP] revenue rose 4 percent, to $15. 4 million from $20. 8 million to $21. 7 million, and its total revenue rose 5 percent to $3. 5 million. [SEP] "i don't think that will change," he said in a statement. [SEP] "i'm trying to make sure we've done that, and we have to be really, really careful with that," he said. [SEP] "i'm not sure," he said. [SEP] "for now, i'm not sure that won't happen," she said. [SEP] i'm sure [SEP]
+
+===== sample 001 =====
+[CLS] 3 percent in may, according to the government. [SEP] the u. s. government has pledged to spend more than $700 billion to help the financial system. [SEP] london (reuters) - a 12 - year - old british boy accused of killing an 11 - year - old girl died on monday. [SEP] "as i'm saying, we're not going to do anything, we don't do what we don't do," mullen said. [SEP] "i don't just want to win the title, i want to win it," he said. [SEP] beijing, china (ap) - police [SEP]
+
+===== sample 002 =====
+[CLS] [SEP] "it's just fun," he said. [SEP] "we've had a good year on the road, we've got to be tough, we've had a great year and that's what we're going to do," he said. [SEP] "i don't think it's a big situation that's going to happen," he said in a statement. [SEP] "it's going to take a little bit of time, and that's what we're going to do," he said. [SEP] washington, march 18 (upi) - - u. [SEP]
+
+===== sample 003 =====
+[CLS] 1 (888) 654 - 0878, 1 (888) 651 - 0820, 1 (866) 642 - 1111, (866) 231 - 0870 in the united states or (866) 317 - 0020 (canada). [SEP] he said: " you know how to talk, you have to make sure you don't know him. [SEP] the senate health care bill would increase the cost to the government by $15 billion over the next 10 years, from $1. 5 billion to $2. 5 billion. [SEP] if you don't know, [SEP]
+
+===== sample 004 =====
+[CLS] [SEP] he will be released on thursday, u. s. officials said. [SEP] i'm going to do that all the time, " he said. [SEP] revenue rose slightly to $363 million from $115 million in the first quarter. [SEP] according to u. n. estimates, the number will be about 1. 5 million by the end of the year, up from 4 million. [SEP] oakland, calif., april 18/prnewswire - usnewswire/- - the california department of health and health (nasdaq) announced that it has received more than 14, 000 complaints from consumers [SEP]
+
+===== sample 005 =====
+[CLS] mr obama. [SEP] "in this case, this is not a case of free speech. [SEP] we're going to have to wait a little bit," he told the new york times. [SEP] "i've got a good job, i've got a job," he said. [SEP] " i know i've got to do something similar, i don't run, i've got to run, i don't want to run, i don't want me to run, and i have to know i'm not going to have to do anything. [SEP] it's hard to find [SEP]
+
+===== sample 006 =====
+[CLS] housing market. [SEP] "i don't want to be an intelligence officer," he said. [SEP] he scored in the first period to set up a goal in the second period and martin brodeur scored a power - play goal 54 seconds into the second period to give ottawa a 2 - 1 lead in the third. [SEP] "i'm not a black person, i don't think i'm going to vote for obama," he told the crowd. [SEP] "that's not what we really wanted," he said. [SEP] and that's what i'm not doing. [SEP] however, it [SEP]
+
+===== sample 007 =====
+[CLS] end, "he said. [SEP] a hearing is scheduled for 10 a. m. [SEP]" i don't want to eat a lot, " she said. [SEP] you talk to people, you're talking to people, you're talking to people, and you're talking to things you don't want to know, and things you don't want to. [SEP] revenue in the quarter rose 1 percent to $16. 7 million, while total revenue rose 0. 5 percent to $36. 5 million from $35. 7 million. [SEP] u. s. officials in afghanistan have met with taliban leaders [SEP]
+
+===== sample 008 =====
+[CLS] is less than half that amount. [SEP] "the bottom line here is if you want to do what you want to do, you can't do anything good," he said. [SEP] the blue devils (13 - 5) lost to the blue devils (11 - 2) for the first time in four years, then lost to the blue devils ( 14 - 8. [SEP] he put carolina up 2 - 1 at 11: 42 of the second. [SEP] earlier this month, the u. n. sent a special envoy to zimbabwe to investigate the attack. [SEP] washington (reuters) - u. s. secretary of state hillary [SEP]
+
+===== sample 009 =====
+[CLS] said. [SEP] i'm just glad i'm going to get on with it. [SEP] the uk, the world's largest exporter of oil, grew 0. 7 per cent in the second quarter, up 6. 8 per cent at the end of the third quarter. [SEP] the government expects the economy to grow at an annual rate of 3. 5 per cent in the second half of 2008. [SEP] i don't really know, i don't know, i think it's going to change, but i just don't think we're there yet. [SEP] new york (ap) - - [SEP]
+
+===== sample 010 =====
+[CLS] the worst financial crisis in the history of the united states. [SEP] the cavaliers scored the first five points of the period in the first 15 minutes. [SEP] "i don't know if i want to play, but i have to play," he told reporters. [SEP] "i don't know what we'll do if we don't get there," he said. [SEP] there's a lot of work to do. [SEP] "i'd be surprised," he said. [SEP] "it's a sad day," he said. [SEP] a 20 - year - old man was arrested in connection with [SEP]
+
+===== sample 011 =====
+[CLS] friday morning. [SEP] he died in a hospital in august. [SEP] "he's got to be an aggressive player, he's got to be tough, he's got to be tough, he's got to be tough and got to be tough," he said. [SEP] "i don't think there will be much difference," he said. [SEP] "i'd like to have a new job," he said. [SEP] "i'm not going to leave," he said. [SEP] i'm just trying to make sure that we don't get to the point where we're [SEP]
+
+===== sample 012 =====
+[CLS] t want to see, "she said. [SEP]" i'm in a situation where i've got to be here, where i want to be there, i don't know what's available, "he said. [SEP] total revenue rose 7 percent to $1. 36 billion in the second quarter from $1. 16 billion, and total revenue rose 7 percent to $1. 7 billion. [SEP] that's a good idea," he said. [SEP] they will also be able to pay a mortgage for the next 12 months. [SEP] the accident happened at 8: 45 a. m. ( 2000 gm [SEP]
+
+===== sample 013 =====
+[CLS] 8 percent, to $7. 6 billion. [SEP] i'm starting to feel better, but i don't think that's the case. [SEP] "we've made a lot of mistakes," he said. [SEP] "he's got a good record at the club, but i'm not sure he'll be fit again," he said. [SEP] "we've been together for a long time and it's just going to be a little complicated," he said. [SEP] i don't want to lose my job, " he said. [SEP] a 10 - year - old girl [SEP]
+
+===== sample 014 =====
+[CLS] "it's not going to be easy." [SEP] "we're going to be able to work out what we are doing," he said. [SEP] of course, it's also hard to find. [SEP] "we don't know what to do, so i'm not sure we're aware of that," he said. [SEP] "we're going to have to think carefully about what we are going to do," he said. [SEP] "i think he's a very good person, and he's got to work hard to do that," he said. [SEP] however, [SEP]
+
+===== sample 015 =====
+[CLS] on the 10 - year treasury note, rose to 3. 50 percent from 3. 50 percent late monday. [SEP] it is not clear whether he will be able to stand down at the next election. [SEP] excluding energy companies, u. s. gross domestic product rose 1. 3 percent, to $2. 7 billion. [SEP] "there's no doubt," he said. [SEP] "i told them not to do anything," he said. [SEP] 1 (upi) - - new home sales fell friday for the first time since november, u. s. data showed. [SEP] the u. n.'s [SEP]
+
+===== sample 016 =====
+[CLS] question. [SEP] if we have to win, we have to win, " he said. [SEP] i'm a guy, i don't want to be a guy, you know, i'm a guy, i'm a good guy, i'm a good guy, i'm a good guy, i don't know, i'm a good guy, i'm a guy, i'm a bad guy, i'm a bad guy, i know, i'm a good guy, i'm a guy, i'm a guy, i'm a bad guy [SEP]
+
+===== sample 017 =====
+[CLS] for the moment, we're concerned, "he said. [SEP] more than 2, 500 people were killed in august, down from 1, 300 in the previous six months. [SEP] i don't know why. [SEP]" to be honest, i think i've got a lot to work to do, "he said. [SEP]" maybe we'll have a little bit more work but we'll have to work a little bit, "he told reporters. [SEP]" we have been talking to them for a number of days, "he said. [SEP]" i think we haven't been able to do that [SEP]
+
+===== sample 018 =====
+[CLS] the past 20 years. [SEP] "it's not just a good game, it's a good game to play. [SEP] the standard & poor's 500 index rose 1. 65, or 0. 13 percent, to 1, 406. 09. [SEP]" i don't think there is any room for me to work that out, "he said. [SEP]" i don't think i'm ever going to get any money, " he said. [SEP] baghdad, may 18 (upi) - - a u. s. car bomb struck a u. s. convoy in baghdad, killing three people [SEP]
+
+===== sample 019 =====
+[CLS] i think we know that. [SEP] many expect the u. s. economy to grow. [SEP] this entry was posted by tracy alloway on friday, october 21st, 2009 at 10: 00 and is filed. [SEP] you know what it is like, and it'll be many years before you get to know the truth, "he said. [SEP]" he's going to go to iran, iran, afghanistan, afghanistan, pakistan, the middle east, the middle east, "garnett said. [SEP] it's going to be a tough year. [SEP] i don't understand why. [SEP]" we are looking [SEP]
+
+===== sample 020 =====
+[CLS] [SEP] 4 (upi) - - a u. s. soldier has been killed and 12 wounded in an attack on a british military base in afghanistan, a military spokesman said monday. [SEP] and that's the turning point in the debate. [SEP] "we have to make sure that we are to do a better job," he said. [SEP] he added: "i'm sure that's where i'm going, and i'm sure we've got a little bit of work to do but i don't know if it's a good thing," he said. [SEP] washington (ap) [SEP]
+
+===== sample 021 =====
+[CLS] quarter of 2006. $2. 3 million in the fourth quarter. 3. 5 % to $0. 5 million in the same period. $10. 8 million in the third quarter of 2006. $1. 4 million to $1. 8 million for the three - year ended december 31, 2006. $4. 8 million to $5. 5 million. $7. 8 million in 2006. $2. 7 million in the fourth quarter 2006. $3. 8 million for the three months ended december 31, 2006. compared to $2. 5 million. $11. 5 million in the same period [SEP]
+
+===== sample 022 =====
+[CLS] 1 billion. [SEP] it's not something we really don't want to do, it's something we don't really want, "pinera said. [SEP] in july, unemployment rose to 6. 4 percent, from august's 6. 1 percent rate. [SEP] there's a lot of work to do, but there's no need to pay any attention. [SEP] i don't think that is going to change. [SEP] some of these shows have just started in new york. [SEP] and i think we all understand that we don't have a public option. [SEP]" i would like to see [SEP]
+
+===== sample 023 =====
+[CLS] was up 1. 63 points, or 0. 18 percent, at 1, 440. 67. [SEP] "he's not good, he's good, he's not bad for himself, that's why he's going to be at his best," selig said in an interview with the associated press. [SEP] "i don't think too much about where we're going," he said. [SEP] raleigh, n. c., july 27/prnewswire - firstcall/- - motorola, inc. [SEP] asheville, n. c., july 6 ( [SEP]
+
+===== sample 024 =====
+[CLS] with 4. 3 seconds left in the first quarter, but scored 11 of his 15 points in the first 5 minutes of the third quarter. [SEP] "what do you think we're going to do?" he asked. [SEP] "i'm just trying to see what they're doing," he said. [SEP] that's because i've lost a lot of money, and i've worked really hard, "he said. [SEP] i'm not going to do it," he said. [SEP] new fort worth, texas, may 17 (upi) - - the u. s. department of [SEP]
+
+===== sample 025 =====
+[CLS] sold for $2, 500. [SEP] "it wasn't for us," he said. [SEP] "i don't know why," he said. [SEP] it's a story we all want to know. [SEP] "if i don't have to do what i feel i have to do, i'm not sure," he said, adding that he could earn as little as $1, 000 a year. [SEP] revenue fell 17. 3 percent to $1. 16 billion, compared with $1. 7 billion in 2007. [SEP] it's only a matter of time. [SEP] " i think [SEP]
+
+===== sample 026 =====
+[CLS] the region. [SEP] u. s. state department spokesman sean mccormack told reporters in a press briefing friday that u. s. officials still have "serious concerns" about iran. [SEP] "there's still a lot of work to do," he said. [SEP] "if there were a lot of people in that part of the city, it would be an extraordinary situation," he said. [SEP] "it's very sad," he said. [SEP] "i just don't know why we don't want to do that," he said. [SEP] " but you have to deal with it. [SEP] [SEP]
+
+===== sample 027 =====
+[CLS] rates paid by the financial services authority (fsa) dropped to 3. 5 per cent in the third quarter from 3. 5 per cent in the second quarter. [SEP] "we'll do it, we'll do it all over the weekend, we'll stay there for a few days," he said. [SEP] chicago, ill., march 4/prnewswire - firstcall/- - federal communications, inc. [SEP] "i've never had any problems and i've never had a problem with them," he said. [SEP] i don't want to go any further. [SEP] [SEP]
+
+===== sample 028 =====
+[CLS], canada, france, britain, and the us are still working on some of the world's most important issues. [SEP] "i thought it was a good idea," he said. [SEP] "i feel like we're going to win, i'm sorry i don't think we've done enough, i just think we're going to do a lot better," nadal said. [SEP] " we have to win, we're going to win, we don't want us to go out, we don't win, we have to win. [SEP] it would be good news. [SEP] [SEP]
+
+===== sample 029 =====
+[CLS] from 1. 4 billion yen ($2. 5 billion) a year earlier, the company said thursday. [SEP] "every time i get to work, i'm busy and that's the time of my life," he said. [SEP] "i'm not so sure," he said. [SEP] total net sales were $5. 8 million, down 7. 3 percent from a year earlier. [SEP] "i think we will win it," he said, which is why he didn't give a press conference at half - time. [SEP] on friday, police were trying to find the bodies of two women [SEP]
+
+===== sample 030 =====
+[CLS]. [SEP] at that point, everything went wrong. [SEP] at the end of the day i wanted to fight, and i was like, ' i'm going to be ok, i'm going to fight, i'm not going to fight, i'm going to be ok, i'm going to be ok, i'm not going to fight. ' [SEP] washington, march 13 (upi) - - u. s. secretary of state hillary clinton is due to visit pakistan thursday on the mission of the u. n. mission in afghanistan, an official said. [SEP] 16/prnewswire [SEP]
+
+===== sample 031 =====
+[CLS] $300, 000 for the west bank, $200, 000 for the south and $300, 000 for the north. [SEP] minneapolis, july 11 (upi) - - a three - run homer in the bottom of the ninth monday gave the colorado rockies a 3 - 2 win over the minnesota twins. [SEP] i do not think that it would go that way, "he said. [SEP]" we all need to follow the rules, "he said. [SEP]" the company's operating income and costs have increased from $25, 000 to $25, 000, "mr. ellison said. [SEP]" that's [SEP]
+
+===== sample 032 =====
+[CLS] in the last five years, he said. [SEP] "i think it's going to take a while for me to do the right thing," o' neill said. [SEP] "i don't want to go back to my home, but i'm sure i don't want to stay. [SEP] i don't know, i have everything, i'm sorry, i know i don't want to do anything," he said. [SEP] i don't know, but i'm sure i don't want to know, i don't know. [SEP] " i think there will be [SEP]
+
+===== sample 033 =====
+[CLS] yield on the 10 - year note rose to 3. 86 per cent from 3. 86 per cent late tuesday, before falling back to 3. 73 per cent thursday. [SEP] he said: "i do not know why. [SEP] mr warrick, 27, is due to be sentenced later on monday. [SEP] the project will cost an estimated $50 million. [SEP] i'd like to know if he does that. [SEP]" i don't, "he said. [SEP]" i'm not going to have to live in a new place where i don't have to live, " he said. [SEP] the company [SEP]
+
+===== sample 034 =====
+[CLS]. london. £25, 000 - £25, 000. city hall. london. £30, 707 - £37, 085 london weighting. £36, 701 - £38, 705 - £35, 000 - £35, 000 (depending on experience) per annum. london metropolitan university. central london. £31, 706 - £40, 703 - £51, 366. city of london. london. £31, 705 - £37, 702 - £38, 087. city of london. £20, 701 - £20, 087 [SEP]
+
+===== sample 035 =====
+[CLS] more than 100 people by the end of the year. [SEP] hefty giuliani's 4 - yard run gave georgia (4 - 11, 1 - 5) the lead with 1: 47 to go, but he fouled out in the final minute. [SEP] "i'm glad we know we've got to win, and i want to make sure that's going to happen," he said. [SEP] i don't think there's going to be a great deal on the market at the moment, "he told reporters. [SEP]" that's what we do, we don't [SEP]
+
+===== sample 036 =====
+[CLS] percentage point to 8, 000. 4, the lowest level since the survey began in 1974. [SEP] "i don't want to run for the presidency," he said. [SEP] "no, i don't think that's fair, i'm sorry, i'm sorry, i don't know anything about you, i don't know anything about you. [SEP]" that is what we have to do in afghanistan, and that's what we have to do with them, "he told reporters. [SEP]" we still have a lot of challenges to the financial system, " he said. [SEP] [SEP]
+
+===== sample 037 =====
+[CLS] 00 local time (1400 gmt). [SEP] i'm not going to do that. [SEP] the cost could be as high as $5, 000, and the final cost could be as high as $2, 000 to $2. 5 million, he said. [SEP] "we've got to win, however, i don't think we can win," he said. [SEP] i don't want to do anything like that. [SEP] " we will make clear in the next few days that we have to make a decision. [SEP] i'm going to get a lot of money. [SEP] that's [SEP]
+
+===== sample 038 =====
+[CLS] 3 per cent on last year's 1. 5 per cent drop. [SEP] at least eight u. s. troops have died in afghanistan this year, bringing the number of americans killed in the war to more than 1, 100 in the last five years. [SEP] "i don't think there will be a significant change in the situation," said jim johnson, a spokesman for the city's health department. [SEP] "i'm not going to tell you," he said. [SEP] "that seemed to be a very bad thing. [SEP]" i have never seen anything like that before, " he said. [SEP] [SEP]
+
+===== sample 039 =====
+[CLS] in wednesday night's national championship game. [SEP] at the start of the season, the rays moved within one game of the al central. [SEP] associated press writer david willey contributed to this report. [SEP] "it's hard to see what we will achieve by the end of the year and it's hard to believe the president is going to be able to reach that goal," said david mckiernan, the president's spokesman. [SEP] the u. s. state department was not available for comment and did not return calls for comment. [SEP] a u. s. military spokeswoman said three people were [SEP]
+
+===== sample 040 =====
+[CLS] there will be some changes in the game. [SEP] "i think we've still got a problem," he said. [SEP] in more than a decade in the senate, he has not been able to lead the same party. [SEP] new york (reuters) - fannie mae and co (fre. n: quote, profile, research, stock buzz), freddie mac (fre. n: quote, profile, research, stock buzz) and citigroup inc (cit. n), the new york times reported on thursday. [SEP] i don't really want to work hard, i'm just [SEP]
+
+===== sample 041 =====
+[CLS], 2007. [SEP] more than five people have been taken to hospital after a fire at a health centre in the north of the city. [SEP] 18/prnewswire - usnewswire/- - motorola inc. [SEP] raleigh, n. c., may 2/prnewswire - usnewswire/- - information systems inc., a leader in information management, intelligence and information software, today announced a $1. 5 billion deal to provide intelligence and operational support to u. s. government agencies. [SEP] "i think that's the right thing to do," he told reporters. [SEP] [SEP]
+
+===== sample 042 =====
+[CLS] united states for the first time in nearly 50 years. [SEP] "i don't want to know," he said. [SEP] "that's the decision we're going to make," he said. [SEP] austin, texas, march 3/prnewswire/- - general motors, inc. [SEP] i don't know what she's doing. [SEP] "i knew i'd have to do something, i'd think i'd have to do something, and i knew i couldn't do something and that's what i wanted to do on my own," he said. [SEP] [SEP]
+
+===== sample 043 =====
+[CLS]. [SEP] "it is going to be a little more difficult but at the end of the day i don't play well so i've got to do my best. [SEP] this article was published on guardian. co. uk at 08. 50 gmt on sunday 2 march 2010. [SEP] the official declined to be named because the official was not authorized to discuss the situation. [SEP] the united states and north korea have also agreed to test a long - range missile. [SEP] buffalo, n. y., aug. [SEP] i think we can get used to that," he said. [SEP] " it's important to see [SEP]
+
+===== sample 044 =====
+[CLS]5, 000 - £30, 000 - £30, 000 - £30, 000 per annum. north yorkshire county council. we're looking for a new manager to manage.... [SEP] chicago, july 10 (upi) - - cole hamels hit a two - run homer in the ninth inning friday and the new york yankees clinched the american league east with a 5 - 2 win over philadelphia. [SEP] associated press writer matt kurski in los angeles contributed to this report. [SEP] he said: " i was going to be disappointed but i didn't want to get out of there. [SEP] however, [SEP]
+
+===== sample 045 =====
+[CLS]. [SEP] the death toll is expected to rise to around 25. [SEP] east rutherford, n. j., march 19/prnewswire/- - emc financial services (emc. n: quote, profile, research) ), the world's largest insurance and financial services company, today announced financial results for the year ended december 31, 2008. [SEP] (nasdaq: stft) is a global services company. [SEP] "the people want it to work, they know they've got it, they don't want to get it right," he told afp. [SEP] " i don [SEP]
+
+===== sample 046 =====
+[CLS] have not determined the cause of his death. [SEP] "i don't think there's any point here," he said as he came to watch. [SEP] u. s. retail sales in the region rose 0. 5 percent in the first half of the year, the commerce department said. [SEP] "i'm a little nervous and i don't want to fight," he said. [SEP] washington (ap) - - president bush said monday that the government must take the necessary steps to address the global financial crisis. [SEP] "it's very hard and i'm sure it will get much better." [SEP]
+
+===== sample 047 =====
+[CLS] 16. 18. [SEP] it's going to take more than a year for congress to act. [SEP] i just don't think we can do anything. [SEP] "if he is to make a good start, he will have to be working very hard. [SEP]" you don't have to wait, you're going to have to wait, "she said. [SEP] obama is scheduled to visit the capitol on thursday morning to discuss the health care bill. [SEP] i know i'm not sure we'll have to change him, but he's got a lot of work," he said. [SEP] i think [SEP]
+
+===== sample 048 =====
+[CLS] in the last two years rose to $300, 000 from at least $300, 000 in 2006. [SEP] "we will be fine," he said. [SEP] i don't think it's the end of the world, "said the 24 - year - old russian. [SEP] i'm not sure, i don't want people to know when i'm going to run. [SEP]" i don't want to be able to talk, i'm not talking, i don't think i should be able to talk to people, " he said. [SEP] the deal marks the company's first [SEP]
+
+===== sample 049 =====
+[CLS] don't do anything, "he said. [SEP] but" i think it's going to be tough in the future, "he said. [SEP]" i've got to figure out how it'll work, and sometimes i don't know what i can do, and i've got to know how much i'm going to do it, "he said. [SEP] 3 (upi) - - brett gardner hit a three - run homer saturday, powering the marlins to a 10 - 6 win over the cleveland indians. [SEP] but i don't. [SEP]" i'm not going to [SEP]
+
+===== sample 050 =====
+[CLS] the height of the global financial crisis. [SEP] "i don't think he's going to go any further," he said. [SEP] dozens of u. s. service members have been killed in afghanistan, iraq and iraq, according to the u. s. military's latest annual report. [SEP] "there needs to be a solution," he said. [SEP] 12 (upi) - - youngʼs first goal of the season gave the boston bruins a 3 - 2 win over the boston bruins saturday night. [SEP] but they don't have to win. [SEP] he added: " we're trying to [SEP]
+
+===== sample 051 =====
+[CLS]. [SEP] 5 (upi) - - the u. s. standard & poor's 500 rose 0. 16, or 0. 4 percent, to 1, 365. 40. [SEP] i'm one of them. [SEP] and that's a good thing. [SEP] it's not something we don't need. [SEP] "he said he didn't know," he said. [SEP] "it's the first time i have been in the tournament for a long time and that's what i think i can do," he told reporters after the event. [SEP] washington (ap) - treasury secretary [SEP]
+
+===== sample 052 =====
+[CLS] 000 jobs by the end of the year. [SEP] "i'm not saying that i have to make a difference, i'm just not making mistakes. [SEP]" i'm not talking about it, i think i'm doing a good job, "he said. [SEP] both men did not want to be formally identified. [SEP]" it's pretty clear that we don't know what to do, or what to do, and we're not going to do anything else, " he said. [SEP] there's no doubt. [SEP] i don't really think there's much work to do to [SEP]
+
+===== sample 053 =====
+[CLS] we need to give them back, "he said. [SEP]" it's not going to cost a lot of money, "he said. [SEP] u. s. officials said the incident had nothing to do with the attack. [SEP]" i still have a lot of work to do, and i can't do any more, "he said. [SEP] it's going to take a very long time," he said. [SEP] bethesda, n. y., july 27/prnewswire - usnewswire/- - the north american medical association (aia) announced today that it has [SEP]
+
+===== sample 054 =====
+[CLS] co (intc. n: quote, profile, research) fell 25 cents, or 6. 2 percent, to $2. 31 a share, compared with a loss of $767. 7 million, or 6. 3 percent in the second quarter of 2008 and a loss of $2. 2 billion in the second quarter. [SEP] the magic was 19 of 28 from the field in the first half and 14 - of - 36. [SEP] he has been in prison for more than a year since his release in 2007. [SEP] " we are going to have to do a lot of hard work to make sure that we get [SEP]
+
+===== sample 055 =====
+[CLS] game with a 22 - 7 run. [SEP] veltroni, the leader of the centre - right democratic party, is set to retire in january at the end of the government's term. [SEP] "i'm not going to make a decision, i know i'm going to make a decision there, i'm not sure, i'm not sure i'm going to be there," he said. [SEP] "i've got to be careful," he said. [SEP] washington, march 18 (upi) - - the u. s. department of defense says a u. s. [SEP]
+
+===== sample 056 =====
+[CLS] last year. [SEP] "if we didn't do that, we'd never know where we're going, where we're going," he said, according to the associated press. [SEP] "he doesn't want to go home in an emergency. [SEP]" i knew i knew i didn't want to get out of my car, just get out of the car. [SEP] for months, u. s. and other government officials have raised questions about abdulmutallab's identity and how he tried to bring down a flight to detroit from detroit. [SEP] obama is scheduled to return to washington for talks [SEP]
+
+===== sample 057 =====
+[CLS] the government, which is expected to borrow up to $100bn (£5bn) over five years. [SEP] that's not good enough. [SEP] i'm going to go again. [SEP] 20 (upi) - - brian giles hit a two - run homer in the fourth inning monday, carrying the florida marlins to a 5 - 2 win over kansas city. [SEP] and if you're going to do that, there's a lot of work to do in the middle of it. [SEP] "i don't want to win. [SEP]" it's too early to tell you how long i am going to [SEP]
+
+===== sample 058 =====
+[CLS], china, the united states, canada, france, germany, russia, canada, south africa, japan, australia, south africa, india, china, france, germany, italy, japan, britain and canada. [SEP] a man has been arrested after an argument with another man outside a high school, police have said. [SEP] "it's going to be tough," he said. [SEP] if we are able to do that, we will be able to do that, "he said. [SEP]" i'm not going to have to think about it, " he said. [SEP] i'm sure he will have to [SEP]
+
+===== sample 059 =====
+[CLS] comment. [SEP] a total of 2, 500 people were killed in violent clashes in 2008, afp news agency reported. [SEP] kabul, afghanistan (reuters) - the number of afghans killed in u. s. military operations rose in the last three months of the year, up 10 percent from the start of 2007, according to government data released on thursday. [SEP] he had been due to appear in court on monday. [SEP] the rangers also won for the first time since beating the rangers 7 - 2 on a seven - game road trip last year. [SEP] it's just so much fun for me, " he said. [SEP] [SEP]
+
+===== sample 060 =====
+[CLS] [SEP] at the end of the day, i went to the hospital so i couldn't get home. [SEP] "i don't want to do that as long as i'm able to pay," he said. [SEP] revenue fell 7. 5 percent to $68. 5 million in the third quarter, from $70. 3 million. [SEP] the twins tied the score with a two - run homer in the fifth, but anderson hit a three - run homer in the fourth. [SEP] "you've got to look at it, it's going to be great," nadal said. [SEP] it's [SEP]
+
+===== sample 061 =====
+[CLS], compared to 0. 5 percent in november. [SEP] i don't want to do that, and i'm not sure i'm going to get to that. [SEP] "i've learned a lot of things that i don't know," he said. [SEP] "that's not true," he said. [SEP] "that's not the problem," he said. [SEP] "i'm not sure, i'm not sure," he said. [SEP] "i don't want to talk to the media," he said. [SEP] still, i don't see any kind [SEP]
+
+===== sample 062 =====
+[CLS]. [SEP] "i don't think there is any reason," he said. [SEP] he's sitting in the back of the car. [SEP] i don't know what i'm talking about. [SEP] it made a loss of $9. 5 million in the first quarter, it said. [SEP] "i don't like to talk to you, i'd like to talk to you," he said. [SEP] "i just don't know," he said. [SEP] there's a lot of work to do. [SEP] it's just not going to be easy, it's a long [SEP]
+
+===== sample 063 =====
+[CLS]a. [SEP] houston, may 16 (upi) - - michael young's three - run homer sparked the new york mets to a 5 - 2 win over the houston astros. [SEP] "i think when you look back at those numbers and see where they are, you know it's going to be a pretty good thing," he said. [SEP] "i don't have any money," he said. [SEP] "i don't know yet," he said. [SEP] los angeles, may 9 (upi) - - the u. s. department of health and human services has received a health care [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_4096steps_n64/state_c256_t1p45_raw_samples.txt

@@ -0,0 +1,228 @@
+state_c256_t1p45
+{
+  "type": "summary",
+  "name": "state_c256_t1p45",
+  "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt",
+  "step": 124000,
+  "decode": {
+    "kind": "categorical_fullvocab",
+    "config": "state_c256_t1p45",
+    "steps": 4096,
+    "model_t_mode": "post",
+    "support_power": 1.0,
+    "semantic_power": 1.0,
+    "endpoint_temp": 1.45,
+    "concentration_min": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 15.863792771486848,
+    "nll_per_token": 2.7640393283161675,
+    "tokens": 9236
+  },
+  "diversity": {
+    "sample_entropy": 3.8477992784844646,
+    "unique_tokens": 972,
+    "token_count": 8192,
+    "distinct_1": 0.11865234375,
+    "distinct_2": 0.3817667322834646,
+    "top_token_mass": 0.0645751953125
+  }
+}
+
+===== sample 000 =====
+[CLS]. [SEP] revenue rose 4 percent, to $ 15. 4 million from $ 20. 8 million to $ 21. 7 million, and its total revenue rose 5 percent to $ 3. 5 million. [SEP] " i don ' t think that will change, " he said in a statement. [SEP] " i ' m trying to make sure we ' ve done that, and we have to be really, really careful with that, " he said. [SEP] " i ' m not sure, " he said. [SEP] " for now, i ' m not sure that won ' t happen, " she said. [SEP] i ' m sure [SEP]
+
+===== sample 001 =====
+[CLS] 3 percent in may, according to the government. [SEP] the u. s. government has pledged to spend more than $ 700 billion to help the financial system. [SEP] london ( reuters ) - a 12 - year - old british boy accused of killing an 11 - year - old girl died on monday. [SEP] " as i ' m saying, we ' re not going to do anything, we don ' t do what we don ' t do, " mullen said. [SEP] " i don ' t just want to win the title, i want to win it, " he said. [SEP] beijing, china ( ap ) - police [SEP]
+
+===== sample 002 =====
+[CLS] [SEP] " it ' s just fun, " he said. [SEP] " we ' ve had a good year on the road, we ' ve got to be tough, we ' ve had a great year and that ' s what we ' re going to do, " he said. [SEP] " i don ' t think it ' s a big situation that ' s going to happen, " he said in a statement. [SEP] " it ' s going to take a little bit of time, and that ' s what we ' re going to do, " he said. [SEP] washington, march 18 ( upi ) - - u. [SEP]
+
+===== sample 003 =====
+[CLS] 1 ( 888 ) 654 - 0878, 1 ( 888 ) 651 - 0820, 1 ( 866 ) 642 - 1111, ( 866 ) 231 - 0870 in the united states or ( 866 ) 317 - 0020 ( canada ). [SEP] he said : " you know how to talk, you have to make sure you don ' t know him. [SEP] the senate health care bill would increase the cost to the government by $ 15 billion over the next 10 years, from $ 1. 5 billion to $ 2. 5 billion. [SEP] if you don ' t know, [SEP]
+
+===== sample 004 =====
+[CLS] [SEP] he will be released on thursday, u. s. officials said. [SEP] i ' m going to do that all the time, " he said. [SEP] revenue rose slightly to $ 363 million from $ 115 million in the first quarter. [SEP] according to u. n. estimates, the number will be about 1. 5 million by the end of the year, up from 4 million. [SEP] oakland, calif., april 18 / prnewswire - usnewswire / - - the california department of health and health ( nasdaq ) announced that it has received more than 14, 000 complaints from consumers [SEP]
+
+===== sample 005 =====
+[CLS] mr obama. [SEP] " in this case, this is not a case of free speech. [SEP] we ' re going to have to wait a little bit, " he told the new york times. [SEP] " i ' ve got a good job, i ' ve got a job, " he said. [SEP] " i know i ' ve got to do something similar, i don ' t run, i ' ve got to run, i don ' t want to run, i don ' t want me to run, and i have to know i ' m not going to have to do anything. [SEP] it ' s hard to find [SEP]
+
+===== sample 006 =====
+[CLS] housing market. [SEP] " i don ' t want to be an intelligence officer, " he said. [SEP] he scored in the first period to set up a goal in the second period and martin brodeur scored a power - play goal 54 seconds into the second period to give ottawa a 2 - 1 lead in the third. [SEP] " i ' m not a black person, i don ' t think i ' m going to vote for obama, " he told the crowd. [SEP] " that ' s not what we really wanted, " he said. [SEP] and that ' s what i ' m not doing. [SEP] however, it [SEP]
+
+===== sample 007 =====
+[CLS] end, " he said. [SEP] a hearing is scheduled for 10 a. m. [SEP] " i don ' t want to eat a lot, " she said. [SEP] you talk to people, you ' re talking to people, you ' re talking to people, and you ' re talking to things you don ' t want to know, and things you don ' t want to. [SEP] revenue in the quarter rose 1 percent to $ 16. 7 million, while total revenue rose 0. 5 percent to $ 36. 5 million from $ 35. 7 million. [SEP] u. s. officials in afghanistan have met with taliban leaders [SEP]
+
+===== sample 008 =====
+[CLS] is less than half that amount. [SEP] " the bottom line here is if you want to do what you want to do, you can ' t do anything good, " he said. [SEP] the blue devils ( 13 - 5 ) lost to the blue devils ( 11 - 2 ) for the first time in four years, then lost to the blue devils ( 14 - 8. [SEP] he put carolina up 2 - 1 at 11 : 42 of the second. [SEP] earlier this month, the u. n. sent a special envoy to zimbabwe to investigate the attack. [SEP] washington ( reuters ) - u. s. secretary of state hillary [SEP]
+
+===== sample 009 =====
+[CLS] said. [SEP] i ' m just glad i ' m going to get on with it. [SEP] the uk, the world ' s largest exporter of oil, grew 0. 7 per cent in the second quarter, up 6. 8 per cent at the end of the third quarter. [SEP] the government expects the economy to grow at an annual rate of 3. 5 per cent in the second half of 2008. [SEP] i don ' t really know, i don ' t know, i think it ' s going to change, but i just don ' t think we ' re there yet. [SEP] new york ( ap ) - - [SEP]
+
+===== sample 010 =====
+[CLS] the worst financial crisis in the history of the united states. [SEP] the cavaliers scored the first five points of the period in the first 15 minutes. [SEP] " i don ' t know if i want to play, but i have to play, " he told reporters. [SEP] " i don ' t know what we ' ll do if we don ' t get there, " he said. [SEP] there ' s a lot of work to do. [SEP] " i ' d be surprised, " he said. [SEP] " it ' s a sad day, " he said. [SEP] a 20 - year - old man was arrested in connection with [SEP]
+
+===== sample 011 =====
+[CLS] friday morning. [SEP] he died in a hospital in august. [SEP] " he ' s got to be an aggressive player, he ' s got to be tough, he ' s got to be tough, he ' s got to be tough and got to be tough, " he said. [SEP] " i don ' t think there will be much difference, " he said. [SEP] " i ' d like to have a new job, " he said. [SEP] " i ' m not going to leave, " he said. [SEP] i ' m just trying to make sure that we don ' t get to the point where we ' re [SEP]
+
+===== sample 012 =====
+[CLS] t want to see, " she said. [SEP] " i ' m in a situation where i ' ve got to be here, where i want to be there, i don ' t know what ' s available, " he said. [SEP] total revenue rose 7 percent to $ 1. 36 billion in the second quarter from $ 1. 16 billion, and total revenue rose 7 percent to $ 1. 7 billion. [SEP] that ' s a good idea, " he said. [SEP] they will also be able to pay a mortgage for the next 12 months. [SEP] the accident happened at 8 : 45 a. m. ( 2000 gm [SEP]
+
+===== sample 013 =====
+[CLS] 8 percent, to $ 7. 6 billion. [SEP] i ' m starting to feel better, but i don ' t think that ' s the case. [SEP] " we ' ve made a lot of mistakes, " he said. [SEP] " he ' s got a good record at the club, but i ' m not sure he ' ll be fit again, " he said. [SEP] " we ' ve been together for a long time and it ' s just going to be a little complicated, " he said. [SEP] i don ' t want to lose my job, " he said. [SEP] a 10 - year - old girl [SEP]
+
+===== sample 014 =====
+[CLS] " it ' s not going to be easy. " [SEP] " we ' re going to be able to work out what we are doing, " he said. [SEP] of course, it ' s also hard to find. [SEP] " we don ' t know what to do, so i ' m not sure we ' re aware of that, " he said. [SEP] " we ' re going to have to think carefully about what we are going to do, " he said. [SEP] " i think he ' s a very good person, and he ' s got to work hard to do that, " he said. [SEP] however, [SEP]
+
+===== sample 015 =====
+[CLS] on the 10 - year treasury note, rose to 3. 50 percent from 3. 50 percent late monday. [SEP] it is not clear whether he will be able to stand down at the next election. [SEP] excluding energy companies, u. s. gross domestic product rose 1. 3 percent, to $ 2. 7 billion. [SEP] " there ' s no doubt, " he said. [SEP] " i told them not to do anything, " he said. [SEP] 1 ( upi ) - - new home sales fell friday for the first time since november, u. s. data showed. [SEP] the u. n. ' s [SEP]
+
+===== sample 016 =====
+[CLS] question. [SEP] if we have to win, we have to win, " he said. [SEP] i ' m a guy, i don ' t want to be a guy, you know, i ' m a guy, i ' m a good guy, i ' m a good guy, i ' m a good guy, i don ' t know, i ' m a good guy, i ' m a guy, i ' m a bad guy, i ' m a bad guy, i know, i ' m a good guy, i ' m a guy, i ' m a guy, i ' m a bad guy [SEP]
+
+===== sample 017 =====
+[CLS] for the moment, we ' re concerned, " he said. [SEP] more than 2, 500 people were killed in august, down from 1, 300 in the previous six months. [SEP] i don ' t know why. [SEP] " to be honest, i think i ' ve got a lot to work to do, " he said. [SEP] " maybe we ' ll have a little bit more work but we ' ll have to work a little bit, " he told reporters. [SEP] " we have been talking to them for a number of days, " he said. [SEP] " i think we haven ' t been able to do that [SEP]
+
+===== sample 018 =====
+[CLS] the past 20 years. [SEP] " it ' s not just a good game, it ' s a good game to play. [SEP] the standard & poor ' s 500 index rose 1. 65, or 0. 13 percent, to 1, 406. 09. [SEP] " i don ' t think there is any room for me to work that out, " he said. [SEP] " i don ' t think i ' m ever going to get any money, " he said. [SEP] baghdad, may 18 ( upi ) - - a u. s. car bomb struck a u. s. convoy in baghdad, killing three people [SEP]
+
+===== sample 019 =====
+[CLS] i think we know that. [SEP] many expect the u. s. economy to grow. [SEP] this entry was posted by tracy alloway on friday, october 21st, 2009 at 10 : 00 and is filed. [SEP] you know what it is like, and it ' ll be many years before you get to know the truth, " he said. [SEP] " he ' s going to go to iran, iran, afghanistan, afghanistan, pakistan, the middle east, the middle east, " garnett said. [SEP] it ' s going to be a tough year. [SEP] i don ' t understand why. [SEP] " we are looking [SEP]
+
+===== sample 020 =====
+[CLS] [SEP] 4 ( upi ) - - a u. s. soldier has been killed and 12 wounded in an attack on a british military base in afghanistan, a military spokesman said monday. [SEP] and that ' s the turning point in the debate. [SEP] " we have to make sure that we are to do a better job, " he said. [SEP] he added : " i ' m sure that ' s where i ' m going, and i ' m sure we ' ve got a little bit of work to do but i don ' t know if it ' s a good thing, " he said. [SEP] washington ( ap ) [SEP]
+
+===== sample 021 =====
+[CLS] quarter of 2006. $ 2. 3 million in the fourth quarter. 3. 5 % to $ 0. 5 million in the same period. $ 10. 8 million in the third quarter of 2006. $ 1. 4 million to $ 1. 8 million for the three - year ended december 31, 2006. $ 4. 8 million to $ 5. 5 million. $ 7. 8 million in 2006. $ 2. 7 million in the fourth quarter 2006. $ 3. 8 million for the three months ended december 31, 2006. compared to $ 2. 5 million. $ 11. 5 million in the same period [SEP]
+
+===== sample 022 =====
+[CLS] 1 billion. [SEP] it ' s not something we really don ' t want to do, it ' s something we don ' t really want, " pinera said. [SEP] in july, unemployment rose to 6. 4 percent, from august ' s 6. 1 percent rate. [SEP] there ' s a lot of work to do, but there ' s no need to pay any attention. [SEP] i don ' t think that is going to change. [SEP] some of these shows have just started in new york. [SEP] and i think we all understand that we don ' t have a public option. [SEP] " i would like to see [SEP]
+
+===== sample 023 =====
+[CLS] was up 1. 63 points, or 0. 18 percent, at 1, 440. 67. [SEP] " he ' s not good, he ' s good, he ' s not bad for himself, that ' s why he ' s going to be at his best, " selig said in an interview with the associated press. [SEP] " i don ' t think too much about where we ' re going, " he said. [SEP] raleigh, n. c., july 27 / prnewswire - firstcall / - - motorola, inc. [SEP] asheville, n. c., july 6 ( [SEP]
+
+===== sample 024 =====
+[CLS] with 4. 3 seconds left in the first quarter, but scored 11 of his 15 points in the first 5 minutes of the third quarter. [SEP] " what do you think we ' re going to do? " he asked. [SEP] " i ' m just trying to see what they ' re doing, " he said. [SEP] that ' s because i ' ve lost a lot of money, and i ' ve worked really hard, " he said. [SEP] i ' m not going to do it, " he said. [SEP] new fort worth, texas, may 17 ( upi ) - - the u. s. department of [SEP]
+
+===== sample 025 =====
+[CLS] sold for $ 2, 500. [SEP] " it wasn ' t for us, " he said. [SEP] " i don ' t know why, " he said. [SEP] it ' s a story we all want to know. [SEP] " if i don ' t have to do what i feel i have to do, i ' m not sure, " he said, adding that he could earn as little as $ 1, 000 a year. [SEP] revenue fell 17. 3 percent to $ 1. 16 billion, compared with $ 1. 7 billion in 2007. [SEP] it ' s only a matter of time. [SEP] " i think [SEP]
+
+===== sample 026 =====
+[CLS] the region. [SEP] u. s. state department spokesman sean mccormack told reporters in a press briefing friday that u. s. officials still have " serious concerns " about iran. [SEP] " there ' s still a lot of work to do, " he said. [SEP] " if there were a lot of people in that part of the city, it would be an extraordinary situation, " he said. [SEP] " it ' s very sad, " he said. [SEP] " i just don ' t know why we don ' t want to do that, " he said. [SEP] " but you have to deal with it. [SEP] [SEP]
+
+===== sample 027 =====
+[CLS] rates paid by the financial services authority ( fsa ) dropped to 3. 5 per cent in the third quarter from 3. 5 per cent in the second quarter. [SEP] " we ' ll do it, we ' ll do it all over the weekend, we ' ll stay there for a few days, " he said. [SEP] chicago, ill., march 4 / prnewswire - firstcall / - - federal communications, inc. [SEP] " i ' ve never had any problems and i ' ve never had a problem with them, " he said. [SEP] i don ' t want to go any further. [SEP] [SEP]
+
+===== sample 028 =====
+[CLS], canada, france, britain, and the us are still working on some of the world ' s most important issues. [SEP] " i thought it was a good idea, " he said. [SEP] " i feel like we ' re going to win, i ' m sorry i don ' t think we ' ve done enough, i just think we ' re going to do a lot better, " nadal said. [SEP] " we have to win, we ' re going to win, we don ' t want us to go out, we don ' t win, we have to win. [SEP] it would be good news. [SEP] [SEP]
+
+===== sample 029 =====
+[CLS] from 1. 4 billion yen ( $ 2. 5 billion ) a year earlier, the company said thursday. [SEP] " every time i get to work, i ' m busy and that ' s the time of my life, " he said. [SEP] " i ' m not so sure, " he said. [SEP] total net sales were $ 5. 8 million, down 7. 3 percent from a year earlier. [SEP] " i think we will win it, " he said, which is why he didn ' t give a press conference at half - time. [SEP] on friday, police were trying to find the bodies of two women [SEP]
+
+===== sample 030 =====
+[CLS]. [SEP] at that point, everything went wrong. [SEP] at the end of the day i wanted to fight, and i was like, ' i ' m going to be ok, i ' m going to fight, i ' m not going to fight, i ' m going to be ok, i ' m going to be ok, i ' m not going to fight. ' [SEP] washington, march 13 ( upi ) - - u. s. secretary of state hillary clinton is due to visit pakistan thursday on the mission of the u. n. mission in afghanistan, an official said. [SEP] 16 / prnewswire [SEP]
+
+===== sample 031 =====
+[CLS] $ 300, 000 for the west bank, $ 200, 000 for the south and $ 300, 000 for the north. [SEP] minneapolis, july 11 ( upi ) - - a three - run homer in the bottom of the ninth monday gave the colorado rockies a 3 - 2 win over the minnesota twins. [SEP] i do not think that it would go that way, " he said. [SEP] " we all need to follow the rules, " he said. [SEP] " the company ' s operating income and costs have increased from $ 25, 000 to $ 25, 000, " mr. ellison said. [SEP] " that ' s [SEP]
+
+===== sample 032 =====
+[CLS] in the last five years, he said. [SEP] " i think it ' s going to take a while for me to do the right thing, " o ' neill said. [SEP] " i don ' t want to go back to my home, but i ' m sure i don ' t want to stay. [SEP] i don ' t know, i have everything, i ' m sorry, i know i don ' t want to do anything, " he said. [SEP] i don ' t know, but i ' m sure i don ' t want to know, i don ' t know. [SEP] " i think there will be [SEP]
+
+===== sample 033 =====
+[CLS] yield on the 10 - year note rose to 3. 86 per cent from 3. 86 per cent late tuesday, before falling back to 3. 73 per cent thursday. [SEP] he said : " i do not know why. [SEP] mr warrick, 27, is due to be sentenced later on monday. [SEP] the project will cost an estimated $ 50 million. [SEP] i ' d like to know if he does that. [SEP] " i don ' t, " he said. [SEP] " i ' m not going to have to live in a new place where i don ' t have to live, " he said. [SEP] the company [SEP]
+
+===== sample 034 =====
+[CLS]. london. £25, 000 - £25, 000. city hall. london. £30, 707 - £37, 085 london weighting. £36, 701 - £38, 705 - £35, 000 - £35, 000 ( depending on experience ) per annum. london metropolitan university. central london. £31, 706 - £40, 703 - £51, 366. city of london. london. £31, 705 - £37, 702 - £38, 087. city of london. £20, 701 - £20, 087 [SEP]
+
+===== sample 035 =====
+[CLS] more than 100 people by the end of the year. [SEP] hefty giuliani ' s 4 - yard run gave georgia ( 4 - 11, 1 - 5 ) the lead with 1 : 47 to go, but he fouled out in the final minute. [SEP] " i ' m glad we know we ' ve got to win, and i want to make sure that ' s going to happen, " he said. [SEP] i don ' t think there ' s going to be a great deal on the market at the moment, " he told reporters. [SEP] " that ' s what we do, we don ' t [SEP]
+
+===== sample 036 =====
+[CLS] percentage point to 8, 000. 4, the lowest level since the survey began in 1974. [SEP] " i don ' t want to run for the presidency, " he said. [SEP] " no, i don ' t think that ' s fair, i ' m sorry, i ' m sorry, i don ' t know anything about you, i don ' t know anything about you. [SEP] " that is what we have to do in afghanistan, and that ' s what we have to do with them, " he told reporters. [SEP] " we still have a lot of challenges to the financial system, " he said. [SEP] [SEP]
+
+===== sample 037 =====
+[CLS] 00 local time ( 1400 gmt ). [SEP] i ' m not going to do that. [SEP] the cost could be as high as $ 5, 000, and the final cost could be as high as $ 2, 000 to $ 2. 5 million, he said. [SEP] " we ' ve got to win, however, i don ' t think we can win, " he said. [SEP] i don ' t want to do anything like that. [SEP] " we will make clear in the next few days that we have to make a decision. [SEP] i ' m going to get a lot of money. [SEP] that ' s [SEP]
+
+===== sample 038 =====
+[CLS] 3 per cent on last year ' s 1. 5 per cent drop. [SEP] at least eight u. s. troops have died in afghanistan this year, bringing the number of americans killed in the war to more than 1, 100 in the last five years. [SEP] " i don ' t think there will be a significant change in the situation, " said jim johnson, a spokesman for the city ' s health department. [SEP] " i ' m not going to tell you, " he said. [SEP] " that seemed to be a very bad thing. [SEP] " i have never seen anything like that before, " he said. [SEP] [SEP]
+
+===== sample 039 =====
+[CLS] in wednesday night ' s national championship game. [SEP] at the start of the season, the rays moved within one game of the al central. [SEP] associated press writer david willey contributed to this report. [SEP] " it ' s hard to see what we will achieve by the end of the year and it ' s hard to believe the president is going to be able to reach that goal, " said david mckiernan, the president ' s spokesman. [SEP] the u. s. state department was not available for comment and did not return calls for comment. [SEP] a u. s. military spokeswoman said three people were [SEP]
+
+===== sample 040 =====
+[CLS] there will be some changes in the game. [SEP] " i think we ' ve still got a problem, " he said. [SEP] in more than a decade in the senate, he has not been able to lead the same party. [SEP] new york ( reuters ) - fannie mae and co ( fre. n : quote, profile, research, stock buzz ), freddie mac ( fre. n : quote, profile, research, stock buzz ) and citigroup inc ( cit. n ), the new york times reported on thursday. [SEP] i don ' t really want to work hard, i ' m just [SEP]
+
+===== sample 041 =====
+[CLS], 2007. [SEP] more than five people have been taken to hospital after a fire at a health centre in the north of the city. [SEP] 18 / prnewswire - usnewswire / - - motorola inc. [SEP] raleigh, n. c., may 2 / prnewswire - usnewswire / - - information systems inc., a leader in information management, intelligence and information software, today announced a $ 1. 5 billion deal to provide intelligence and operational support to u. s. government agencies. [SEP] " i think that ' s the right thing to do, " he told reporters. [SEP] [SEP]
+
+===== sample 042 =====
+[CLS] united states for the first time in nearly 50 years. [SEP] " i don ' t want to know, " he said. [SEP] " that ' s the decision we ' re going to make, " he said. [SEP] austin, texas, march 3 / prnewswire / - - general motors, inc. [SEP] i don ' t know what she ' s doing. [SEP] " i knew i ' d have to do something, i ' d think i ' d have to do something, and i knew i couldn ' t do something and that ' s what i wanted to do on my own, " he said. [SEP] [SEP]
+
+===== sample 043 =====
+[CLS]. [SEP] " it is going to be a little more difficult but at the end of the day i don ' t play well so i ' ve got to do my best. [SEP] this article was published on guardian. co. uk at 08. 50 gmt on sunday 2 march 2010. [SEP] the official declined to be named because the official was not authorized to discuss the situation. [SEP] the united states and north korea have also agreed to test a long - range missile. [SEP] buffalo, n. y., aug. [SEP] i think we can get used to that, " he said. [SEP] " it ' s important to see [SEP]
+
+===== sample 044 =====
+[CLS]5, 000 - £30, 000 - £30, 000 - £30, 000 per annum. north yorkshire county council. we ' re looking for a new manager to manage.... [SEP] chicago, july 10 ( upi ) - - cole hamels hit a two - run homer in the ninth inning friday and the new york yankees clinched the american league east with a 5 - 2 win over philadelphia. [SEP] associated press writer matt kurski in los angeles contributed to this report. [SEP] he said : " i was going to be disappointed but i didn ' t want to get out of there. [SEP] however, [SEP]
+
+===== sample 045 =====
+[CLS]. [SEP] the death toll is expected to rise to around 25. [SEP] east rutherford, n. j., march 19 / prnewswire / - - emc financial services ( emc. n : quote, profile, research ) ), the world ' s largest insurance and financial services company, today announced financial results for the year ended december 31, 2008. [SEP] ( nasdaq : stft ) is a global services company. [SEP] " the people want it to work, they know they ' ve got it, they don ' t want to get it right, " he told afp. [SEP] " i don [SEP]
+
+===== sample 046 =====
+[CLS] have not determined the cause of his death. [SEP] " i don ' t think there ' s any point here, " he said as he came to watch. [SEP] u. s. retail sales in the region rose 0. 5 percent in the first half of the year, the commerce department said. [SEP] " i ' m a little nervous and i don ' t want to fight, " he said. [SEP] washington ( ap ) - - president bush said monday that the government must take the necessary steps to address the global financial crisis. [SEP] " it ' s very hard and i ' m sure it will get much better. " [SEP]
+
+===== sample 047 =====
+[CLS] 16. 18. [SEP] it ' s going to take more than a year for congress to act. [SEP] i just don ' t think we can do anything. [SEP] " if he is to make a good start, he will have to be working very hard. [SEP] " you don ' t have to wait, you ' re going to have to wait, " she said. [SEP] obama is scheduled to visit the capitol on thursday morning to discuss the health care bill. [SEP] i know i ' m not sure we ' ll have to change him, but he ' s got a lot of work, " he said. [SEP] i think [SEP]
+
+===== sample 048 =====
+[CLS] in the last two years rose to $ 300, 000 from at least $ 300, 000 in 2006. [SEP] " we will be fine, " he said. [SEP] i don ' t think it ' s the end of the world, " said the 24 - year - old russian. [SEP] i ' m not sure, i don ' t want people to know when i ' m going to run. [SEP] " i don ' t want to be able to talk, i ' m not talking, i don ' t think i should be able to talk to people, " he said. [SEP] the deal marks the company ' s first [SEP]
+
+===== sample 049 =====
+[CLS] don ' t do anything, " he said. [SEP] but " i think it ' s going to be tough in the future, " he said. [SEP] " i ' ve got to figure out how it ' ll work, and sometimes i don ' t know what i can do, and i ' ve got to know how much i ' m going to do it, " he said. [SEP] 3 ( upi ) - - brett gardner hit a three - run homer saturday, powering the marlins to a 10 - 6 win over the cleveland indians. [SEP] but i don ' t. [SEP] " i ' m not going to [SEP]
+
+===== sample 050 =====
+[CLS] the height of the global financial crisis. [SEP] " i don ' t think he ' s going to go any further, " he said. [SEP] dozens of u. s. service members have been killed in afghanistan, iraq and iraq, according to the u. s. military ' s latest annual report. [SEP] " there needs to be a solution, " he said. [SEP] 12 ( upi ) - - youngʼs first goal of the season gave the boston bruins a 3 - 2 win over the boston bruins saturday night. [SEP] but they don ' t have to win. [SEP] he added : " we ' re trying to [SEP]
+
+===== sample 051 =====
+[CLS]. [SEP] 5 ( upi ) - - the u. s. standard & poor ' s 500 rose 0. 16, or 0. 4 percent, to 1, 365. 40. [SEP] i ' m one of them. [SEP] and that ' s a good thing. [SEP] it ' s not something we don ' t need. [SEP] " he said he didn ' t know, " he said. [SEP] " it ' s the first time i have been in the tournament for a long time and that ' s what i think i can do, " he told reporters after the event. [SEP] washington ( ap ) - treasury secretary [SEP]
+
+===== sample 052 =====
+[CLS] 000 jobs by the end of the year. [SEP] " i ' m not saying that i have to make a difference, i ' m just not making mistakes. [SEP] " i ' m not talking about it, i think i ' m doing a good job, " he said. [SEP] both men did not want to be formally identified. [SEP] " it ' s pretty clear that we don ' t know what to do, or what to do, and we ' re not going to do anything else, " he said. [SEP] there ' s no doubt. [SEP] i don ' t really think there ' s much work to do to [SEP]
+
+===== sample 053 =====
+[CLS] we need to give them back, " he said. [SEP] " it ' s not going to cost a lot of money, " he said. [SEP] u. s. officials said the incident had nothing to do with the attack. [SEP] " i still have a lot of work to do, and i can ' t do any more, " he said. [SEP] it ' s going to take a very long time, " he said. [SEP] bethesda, n. y., july 27 / prnewswire - usnewswire / - - the north american medical association ( aia ) announced today that it has [SEP]
+
+===== sample 054 =====
+[CLS] co ( intc. n : quote, profile, research ) fell 25 cents, or 6. 2 percent, to $ 2. 31 a share, compared with a loss of $ 767. 7 million, or 6. 3 percent in the second quarter of 2008 and a loss of $ 2. 2 billion in the second quarter. [SEP] the magic was 19 of 28 from the field in the first half and 14 - of - 36. [SEP] he has been in prison for more than a year since his release in 2007. [SEP] " we are going to have to do a lot of hard work to make sure that we get [SEP]
+
+===== sample 055 =====
+[CLS] game with a 22 - 7 run. [SEP] veltroni, the leader of the centre - right democratic party, is set to retire in january at the end of the government ' s term. [SEP] " i ' m not going to make a decision, i know i ' m going to make a decision there, i ' m not sure, i ' m not sure i ' m going to be there, " he said. [SEP] " i ' ve got to be careful, " he said. [SEP] washington, march 18 ( upi ) - - the u. s. department of defense says a u. s. [SEP]
+
+===== sample 056 =====
+[CLS] last year. [SEP] " if we didn ' t do that, we ' d never know where we ' re going, where we ' re going, " he said, according to the associated press. [SEP] " he doesn ' t want to go home in an emergency. [SEP] " i knew i knew i didn ' t want to get out of my car, just get out of the car. [SEP] for months, u. s. and other government officials have raised questions about abdulmutallab ' s identity and how he tried to bring down a flight to detroit from detroit. [SEP] obama is scheduled to return to washington for talks [SEP]
+
+===== sample 057 =====
+[CLS] the government, which is expected to borrow up to $ 100bn ( £5bn ) over five years. [SEP] that ' s not good enough. [SEP] i ' m going to go again. [SEP] 20 ( upi ) - - brian giles hit a two - run homer in the fourth inning monday, carrying the florida marlins to a 5 - 2 win over kansas city. [SEP] and if you ' re going to do that, there ' s a lot of work to do in the middle of it. [SEP] " i don ' t want to win. [SEP] " it ' s too early to tell you how long i am going to [SEP]
+
+===== sample 058 =====
+[CLS], china, the united states, canada, france, germany, russia, canada, south africa, japan, australia, south africa, india, china, france, germany, italy, japan, britain and canada. [SEP] a man has been arrested after an argument with another man outside a high school, police have said. [SEP] " it ' s going to be tough, " he said. [SEP] if we are able to do that, we will be able to do that, " he said. [SEP] " i ' m not going to have to think about it, " he said. [SEP] i ' m sure he will have to [SEP]
+
+===== sample 059 =====
+[CLS] comment. [SEP] a total of 2, 500 people were killed in violent clashes in 2008, afp news agency reported. [SEP] kabul, afghanistan ( reuters ) - the number of afghans killed in u. s. military operations rose in the last three months of the year, up 10 percent from the start of 2007, according to government data released on thursday. [SEP] he had been due to appear in court on monday. [SEP] the rangers also won for the first time since beating the rangers 7 - 2 on a seven - game road trip last year. [SEP] it ' s just so much fun for me, " he said. [SEP] [SEP]
+
+===== sample 060 =====
+[CLS] [SEP] at the end of the day, i went to the hospital so i couldn ' t get home. [SEP] " i don ' t want to do that as long as i ' m able to pay, " he said. [SEP] revenue fell 7. 5 percent to $ 68. 5 million in the third quarter, from $ 70. 3 million. [SEP] the twins tied the score with a two - run homer in the fifth, but anderson hit a three - run homer in the fourth. [SEP] " you ' ve got to look at it, it ' s going to be great, " nadal said. [SEP] it ' s [SEP]
+
+===== sample 061 =====
+[CLS], compared to 0. 5 percent in november. [SEP] i don ' t want to do that, and i ' m not sure i ' m going to get to that. [SEP] " i ' ve learned a lot of things that i don ' t know, " he said. [SEP] " that ' s not true, " he said. [SEP] " that ' s not the problem, " he said. [SEP] " i ' m not sure, i ' m not sure, " he said. [SEP] " i don ' t want to talk to the media, " he said. [SEP] still, i don ' t see any kind [SEP]
+
+===== sample 062 =====
+[CLS]. [SEP] " i don ' t think there is any reason, " he said. [SEP] he ' s sitting in the back of the car. [SEP] i don ' t know what i ' m talking about. [SEP] it made a loss of $ 9. 5 million in the first quarter, it said. [SEP] " i don ' t like to talk to you, i ' d like to talk to you, " he said. [SEP] " i just don ' t know, " he said. [SEP] there ' s a lot of work to do. [SEP] it ' s just not going to be easy, it ' s a long [SEP]
+
+===== sample 063 =====
+[CLS]a. [SEP] houston, may 16 ( upi ) - - michael young ' s three - run homer sparked the new york mets to a 5 - 2 win over the houston astros. [SEP] " i think when you look back at those numbers and see where they are, you know it ' s going to be a pretty good thing, " he said. [SEP] " i don ' t have any money, " he said. [SEP] " i don ' t know yet, " he said. [SEP] los angeles, may 9 ( upi ) - - the u. s. department of health and human services has received a health care [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_4096steps_n64/state_c256_t1p45_scored.jsonl

@@ -0,0 +1,65 @@
+{"type": "summary", "name": "state_c256_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c256_t1p45", "steps": 4096, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 15.863792771486848, "nll_per_token": 2.7640393283161675, "tokens": 9236}, "diversity": {"sample_entropy": 3.8477992784844646, "unique_tokens": 972, "token_count": 8192, "distinct_1": 0.11865234375, "distinct_2": 0.3817667322834646, "top_token_mass": 0.0645751953125}}
+{"type": "sample", "index": 0, "raw_text": "[CLS]. [SEP] revenue rose 4 percent, to $ 15. 4 million from $ 20. 8 million to $ 21. 7 million, and its total revenue rose 5 percent to $ 3. 5 million. [SEP] \" i don ' t think that will change, \" he said in a statement. [SEP] \" i ' m trying to make sure we ' ve done that, and we have to be really, really careful with that, \" he said. [SEP] \" i ' m not sure, \" he said. [SEP] \" for now, i ' m not sure that won ' t happen, \" she said. [SEP] i ' m sure [SEP]", "detok_text": "[CLS]. [SEP] revenue rose 4 percent, to $15. 4 million from $20. 8 million to $21. 7 million, and its total revenue rose 5 percent to $3. 5 million. [SEP] \"i don't think that will change,\" he said in a statement. [SEP] \"i'm trying to make sure we've done that, and we have to be really, really careful with that,\" he said. [SEP] \"i'm not sure,\" he said. [SEP] \"for now, i'm not sure that won't happen,\" she said. [SEP] i'm sure [SEP]"}
+{"type": "sample", "index": 1, "raw_text": "[CLS] 3 percent in may, according to the government. [SEP] the u. s. government has pledged to spend more than $ 700 billion to help the financial system. [SEP] london ( reuters ) - a 12 - year - old british boy accused of killing an 11 - year - old girl died on monday. [SEP] \" as i ' m saying, we ' re not going to do anything, we don ' t do what we don ' t do, \" mullen said. [SEP] \" i don ' t just want to win the title, i want to win it, \" he said. [SEP] beijing, china ( ap ) - police [SEP]", "detok_text": "[CLS] 3 percent in may, according to the government. [SEP] the u. s. government has pledged to spend more than $700 billion to help the financial system. [SEP] london (reuters) - a 12 - year - old british boy accused of killing an 11 - year - old girl died on monday. [SEP] \"as i'm saying, we're not going to do anything, we don't do what we don't do,\" mullen said. [SEP] \"i don't just want to win the title, i want to win it,\" he said. [SEP] beijing, china (ap) - police [SEP]"}
+{"type": "sample", "index": 2, "raw_text": "[CLS] [SEP] \" it ' s just fun, \" he said. [SEP] \" we ' ve had a good year on the road, we ' ve got to be tough, we ' ve had a great year and that ' s what we ' re going to do, \" he said. [SEP] \" i don ' t think it ' s a big situation that ' s going to happen, \" he said in a statement. [SEP] \" it ' s going to take a little bit of time, and that ' s what we ' re going to do, \" he said. [SEP] washington, march 18 ( upi ) - - u. [SEP]", "detok_text": "[CLS] [SEP] \"it's just fun,\" he said. [SEP] \"we've had a good year on the road, we've got to be tough, we've had a great year and that's what we're going to do,\" he said. [SEP] \"i don't think it's a big situation that's going to happen,\" he said in a statement. [SEP] \"it's going to take a little bit of time, and that's what we're going to do,\" he said. [SEP] washington, march 18 (upi) - - u. [SEP]"}
+{"type": "sample", "index": 3, "raw_text": "[CLS] 1 ( 888 ) 654 - 0878, 1 ( 888 ) 651 - 0820, 1 ( 866 ) 642 - 1111, ( 866 ) 231 - 0870 in the united states or ( 866 ) 317 - 0020 ( canada ). [SEP] he said : \" you know how to talk, you have to make sure you don ' t know him. [SEP] the senate health care bill would increase the cost to the government by $ 15 billion over the next 10 years, from $ 1. 5 billion to $ 2. 5 billion. [SEP] if you don ' t know, [SEP]", "detok_text": "[CLS] 1 (888) 654 - 0878, 1 (888) 651 - 0820, 1 (866) 642 - 1111, (866) 231 - 0870 in the united states or (866) 317 - 0020 (canada). [SEP] he said: \" you know how to talk, you have to make sure you don't know him. [SEP] the senate health care bill would increase the cost to the government by $15 billion over the next 10 years, from $1. 5 billion to $2. 5 billion. [SEP] if you don't know, [SEP]"}
+{"type": "sample", "index": 4, "raw_text": "[CLS] [SEP] he will be released on thursday, u. s. officials said. [SEP] i ' m going to do that all the time, \" he said. [SEP] revenue rose slightly to $ 363 million from $ 115 million in the first quarter. [SEP] according to u. n. estimates, the number will be about 1. 5 million by the end of the year, up from 4 million. [SEP] oakland, calif., april 18 / prnewswire - usnewswire / - - the california department of health and health ( nasdaq ) announced that it has received more than 14, 000 complaints from consumers [SEP]", "detok_text": "[CLS] [SEP] he will be released on thursday, u. s. officials said. [SEP] i'm going to do that all the time, \" he said. [SEP] revenue rose slightly to $363 million from $115 million in the first quarter. [SEP] according to u. n. estimates, the number will be about 1. 5 million by the end of the year, up from 4 million. [SEP] oakland, calif., april 18/prnewswire - usnewswire/- - the california department of health and health (nasdaq) announced that it has received more than 14, 000 complaints from consumers [SEP]"}
+{"type": "sample", "index": 5, "raw_text": "[CLS] mr obama. [SEP] \" in this case, this is not a case of free speech. [SEP] we ' re going to have to wait a little bit, \" he told the new york times. [SEP] \" i ' ve got a good job, i ' ve got a job, \" he said. [SEP] \" i know i ' ve got to do something similar, i don ' t run, i ' ve got to run, i don ' t want to run, i don ' t want me to run, and i have to know i ' m not going to have to do anything. [SEP] it ' s hard to find [SEP]", "detok_text": "[CLS] mr obama. [SEP] \"in this case, this is not a case of free speech. [SEP] we're going to have to wait a little bit,\" he told the new york times. [SEP] \"i've got a good job, i've got a job,\" he said. [SEP] \" i know i've got to do something similar, i don't run, i've got to run, i don't want to run, i don't want me to run, and i have to know i'm not going to have to do anything. [SEP] it's hard to find [SEP]"}
+{"type": "sample", "index": 6, "raw_text": "[CLS] housing market. [SEP] \" i don ' t want to be an intelligence officer, \" he said. [SEP] he scored in the first period to set up a goal in the second period and martin brodeur scored a power - play goal 54 seconds into the second period to give ottawa a 2 - 1 lead in the third. [SEP] \" i ' m not a black person, i don ' t think i ' m going to vote for obama, \" he told the crowd. [SEP] \" that ' s not what we really wanted, \" he said. [SEP] and that ' s what i ' m not doing. [SEP] however, it [SEP]", "detok_text": "[CLS] housing market. [SEP] \"i don't want to be an intelligence officer,\" he said. [SEP] he scored in the first period to set up a goal in the second period and martin brodeur scored a power - play goal 54 seconds into the second period to give ottawa a 2 - 1 lead in the third. [SEP] \"i'm not a black person, i don't think i'm going to vote for obama,\" he told the crowd. [SEP] \"that's not what we really wanted,\" he said. [SEP] and that's what i'm not doing. [SEP] however, it [SEP]"}
+{"type": "sample", "index": 7, "raw_text": "[CLS] end, \" he said. [SEP] a hearing is scheduled for 10 a. m. [SEP] \" i don ' t want to eat a lot, \" she said. [SEP] you talk to people, you ' re talking to people, you ' re talking to people, and you ' re talking to things you don ' t want to know, and things you don ' t want to. [SEP] revenue in the quarter rose 1 percent to $ 16. 7 million, while total revenue rose 0. 5 percent to $ 36. 5 million from $ 35. 7 million. [SEP] u. s. officials in afghanistan have met with taliban leaders [SEP]", "detok_text": "[CLS] end, \"he said. [SEP] a hearing is scheduled for 10 a. m. [SEP]\" i don't want to eat a lot, \" she said. [SEP] you talk to people, you're talking to people, you're talking to people, and you're talking to things you don't want to know, and things you don't want to. [SEP] revenue in the quarter rose 1 percent to $16. 7 million, while total revenue rose 0. 5 percent to $36. 5 million from $35. 7 million. [SEP] u. s. officials in afghanistan have met with taliban leaders [SEP]"}
+{"type": "sample", "index": 8, "raw_text": "[CLS] is less than half that amount. [SEP] \" the bottom line here is if you want to do what you want to do, you can ' t do anything good, \" he said. [SEP] the blue devils ( 13 - 5 ) lost to the blue devils ( 11 - 2 ) for the first time in four years, then lost to the blue devils ( 14 - 8. [SEP] he put carolina up 2 - 1 at 11 : 42 of the second. [SEP] earlier this month, the u. n. sent a special envoy to zimbabwe to investigate the attack. [SEP] washington ( reuters ) - u. s. secretary of state hillary [SEP]", "detok_text": "[CLS] is less than half that amount. [SEP] \"the bottom line here is if you want to do what you want to do, you can't do anything good,\" he said. [SEP] the blue devils (13 - 5) lost to the blue devils (11 - 2) for the first time in four years, then lost to the blue devils ( 14 - 8. [SEP] he put carolina up 2 - 1 at 11: 42 of the second. [SEP] earlier this month, the u. n. sent a special envoy to zimbabwe to investigate the attack. [SEP] washington (reuters) - u. s. secretary of state hillary [SEP]"}
+{"type": "sample", "index": 9, "raw_text": "[CLS] said. [SEP] i ' m just glad i ' m going to get on with it. [SEP] the uk, the world ' s largest exporter of oil, grew 0. 7 per cent in the second quarter, up 6. 8 per cent at the end of the third quarter. [SEP] the government expects the economy to grow at an annual rate of 3. 5 per cent in the second half of 2008. [SEP] i don ' t really know, i don ' t know, i think it ' s going to change, but i just don ' t think we ' re there yet. [SEP] new york ( ap ) - - [SEP]", "detok_text": "[CLS] said. [SEP] i'm just glad i'm going to get on with it. [SEP] the uk, the world's largest exporter of oil, grew 0. 7 per cent in the second quarter, up 6. 8 per cent at the end of the third quarter. [SEP] the government expects the economy to grow at an annual rate of 3. 5 per cent in the second half of 2008. [SEP] i don't really know, i don't know, i think it's going to change, but i just don't think we're there yet. [SEP] new york (ap) - - [SEP]"}
+{"type": "sample", "index": 10, "raw_text": "[CLS] the worst financial crisis in the history of the united states. [SEP] the cavaliers scored the first five points of the period in the first 15 minutes. [SEP] \" i don ' t know if i want to play, but i have to play, \" he told reporters. [SEP] \" i don ' t know what we ' ll do if we don ' t get there, \" he said. [SEP] there ' s a lot of work to do. [SEP] \" i ' d be surprised, \" he said. [SEP] \" it ' s a sad day, \" he said. [SEP] a 20 - year - old man was arrested in connection with [SEP]", "detok_text": "[CLS] the worst financial crisis in the history of the united states. [SEP] the cavaliers scored the first five points of the period in the first 15 minutes. [SEP] \"i don't know if i want to play, but i have to play,\" he told reporters. [SEP] \"i don't know what we'll do if we don't get there,\" he said. [SEP] there's a lot of work to do. [SEP] \"i'd be surprised,\" he said. [SEP] \"it's a sad day,\" he said. [SEP] a 20 - year - old man was arrested in connection with [SEP]"}
+{"type": "sample", "index": 11, "raw_text": "[CLS] friday morning. [SEP] he died in a hospital in august. [SEP] \" he ' s got to be an aggressive player, he ' s got to be tough, he ' s got to be tough, he ' s got to be tough and got to be tough, \" he said. [SEP] \" i don ' t think there will be much difference, \" he said. [SEP] \" i ' d like to have a new job, \" he said. [SEP] \" i ' m not going to leave, \" he said. [SEP] i ' m just trying to make sure that we don ' t get to the point where we ' re [SEP]", "detok_text": "[CLS] friday morning. [SEP] he died in a hospital in august. [SEP] \"he's got to be an aggressive player, he's got to be tough, he's got to be tough, he's got to be tough and got to be tough,\" he said. [SEP] \"i don't think there will be much difference,\" he said. [SEP] \"i'd like to have a new job,\" he said. [SEP] \"i'm not going to leave,\" he said. [SEP] i'm just trying to make sure that we don't get to the point where we're [SEP]"}
+{"type": "sample", "index": 12, "raw_text": "[CLS] t want to see, \" she said. [SEP] \" i ' m in a situation where i ' ve got to be here, where i want to be there, i don ' t know what ' s available, \" he said. [SEP] total revenue rose 7 percent to $ 1. 36 billion in the second quarter from $ 1. 16 billion, and total revenue rose 7 percent to $ 1. 7 billion. [SEP] that ' s a good idea, \" he said. [SEP] they will also be able to pay a mortgage for the next 12 months. [SEP] the accident happened at 8 : 45 a. m. ( 2000 gm [SEP]", "detok_text": "[CLS] t want to see, \"she said. [SEP]\" i'm in a situation where i've got to be here, where i want to be there, i don't know what's available, \"he said. [SEP] total revenue rose 7 percent to $1. 36 billion in the second quarter from $1. 16 billion, and total revenue rose 7 percent to $1. 7 billion. [SEP] that's a good idea,\" he said. [SEP] they will also be able to pay a mortgage for the next 12 months. [SEP] the accident happened at 8: 45 a. m. ( 2000 gm [SEP]"}
+{"type": "sample", "index": 13, "raw_text": "[CLS] 8 percent, to $ 7. 6 billion. [SEP] i ' m starting to feel better, but i don ' t think that ' s the case. [SEP] \" we ' ve made a lot of mistakes, \" he said. [SEP] \" he ' s got a good record at the club, but i ' m not sure he ' ll be fit again, \" he said. [SEP] \" we ' ve been together for a long time and it ' s just going to be a little complicated, \" he said. [SEP] i don ' t want to lose my job, \" he said. [SEP] a 10 - year - old girl [SEP]", "detok_text": "[CLS] 8 percent, to $7. 6 billion. [SEP] i'm starting to feel better, but i don't think that's the case. [SEP] \"we've made a lot of mistakes,\" he said. [SEP] \"he's got a good record at the club, but i'm not sure he'll be fit again,\" he said. [SEP] \"we've been together for a long time and it's just going to be a little complicated,\" he said. [SEP] i don't want to lose my job, \" he said. [SEP] a 10 - year - old girl [SEP]"}
+{"type": "sample", "index": 14, "raw_text": "[CLS] \" it ' s not going to be easy. \" [SEP] \" we ' re going to be able to work out what we are doing, \" he said. [SEP] of course, it ' s also hard to find. [SEP] \" we don ' t know what to do, so i ' m not sure we ' re aware of that, \" he said. [SEP] \" we ' re going to have to think carefully about what we are going to do, \" he said. [SEP] \" i think he ' s a very good person, and he ' s got to work hard to do that, \" he said. [SEP] however, [SEP]", "detok_text": "[CLS] \"it's not going to be easy.\" [SEP] \"we're going to be able to work out what we are doing,\" he said. [SEP] of course, it's also hard to find. [SEP] \"we don't know what to do, so i'm not sure we're aware of that,\" he said. [SEP] \"we're going to have to think carefully about what we are going to do,\" he said. [SEP] \"i think he's a very good person, and he's got to work hard to do that,\" he said. [SEP] however, [SEP]"}
+{"type": "sample", "index": 15, "raw_text": "[CLS] on the 10 - year treasury note, rose to 3. 50 percent from 3. 50 percent late monday. [SEP] it is not clear whether he will be able to stand down at the next election. [SEP] excluding energy companies, u. s. gross domestic product rose 1. 3 percent, to $ 2. 7 billion. [SEP] \" there ' s no doubt, \" he said. [SEP] \" i told them not to do anything, \" he said. [SEP] 1 ( upi ) - - new home sales fell friday for the first time since november, u. s. data showed. [SEP] the u. n. ' s [SEP]", "detok_text": "[CLS] on the 10 - year treasury note, rose to 3. 50 percent from 3. 50 percent late monday. [SEP] it is not clear whether he will be able to stand down at the next election. [SEP] excluding energy companies, u. s. gross domestic product rose 1. 3 percent, to $2. 7 billion. [SEP] \"there's no doubt,\" he said. [SEP] \"i told them not to do anything,\" he said. [SEP] 1 (upi) - - new home sales fell friday for the first time since november, u. s. data showed. [SEP] the u. n.'s [SEP]"}
+{"type": "sample", "index": 16, "raw_text": "[CLS] question. [SEP] if we have to win, we have to win, \" he said. [SEP] i ' m a guy, i don ' t want to be a guy, you know, i ' m a guy, i ' m a good guy, i ' m a good guy, i ' m a good guy, i don ' t know, i ' m a good guy, i ' m a guy, i ' m a bad guy, i ' m a bad guy, i know, i ' m a good guy, i ' m a guy, i ' m a guy, i ' m a bad guy [SEP]", "detok_text": "[CLS] question. [SEP] if we have to win, we have to win, \" he said. [SEP] i'm a guy, i don't want to be a guy, you know, i'm a guy, i'm a good guy, i'm a good guy, i'm a good guy, i don't know, i'm a good guy, i'm a guy, i'm a bad guy, i'm a bad guy, i know, i'm a good guy, i'm a guy, i'm a guy, i'm a bad guy [SEP]"}
+{"type": "sample", "index": 17, "raw_text": "[CLS] for the moment, we ' re concerned, \" he said. [SEP] more than 2, 500 people were killed in august, down from 1, 300 in the previous six months. [SEP] i don ' t know why. [SEP] \" to be honest, i think i ' ve got a lot to work to do, \" he said. [SEP] \" maybe we ' ll have a little bit more work but we ' ll have to work a little bit, \" he told reporters. [SEP] \" we have been talking to them for a number of days, \" he said. [SEP] \" i think we haven ' t been able to do that [SEP]", "detok_text": "[CLS] for the moment, we're concerned, \"he said. [SEP] more than 2, 500 people were killed in august, down from 1, 300 in the previous six months. [SEP] i don't know why. [SEP]\" to be honest, i think i've got a lot to work to do, \"he said. [SEP]\" maybe we'll have a little bit more work but we'll have to work a little bit, \"he told reporters. [SEP]\" we have been talking to them for a number of days, \"he said. [SEP]\" i think we haven't been able to do that [SEP]"}
+{"type": "sample", "index": 18, "raw_text": "[CLS] the past 20 years. [SEP] \" it ' s not just a good game, it ' s a good game to play. [SEP] the standard & poor ' s 500 index rose 1. 65, or 0. 13 percent, to 1, 406. 09. [SEP] \" i don ' t think there is any room for me to work that out, \" he said. [SEP] \" i don ' t think i ' m ever going to get any money, \" he said. [SEP] baghdad, may 18 ( upi ) - - a u. s. car bomb struck a u. s. convoy in baghdad, killing three people [SEP]", "detok_text": "[CLS] the past 20 years. [SEP] \"it's not just a good game, it's a good game to play. [SEP] the standard & poor's 500 index rose 1. 65, or 0. 13 percent, to 1, 406. 09. [SEP]\" i don't think there is any room for me to work that out, \"he said. [SEP]\" i don't think i'm ever going to get any money, \" he said. [SEP] baghdad, may 18 (upi) - - a u. s. car bomb struck a u. s. convoy in baghdad, killing three people [SEP]"}
+{"type": "sample", "index": 19, "raw_text": "[CLS] i think we know that. [SEP] many expect the u. s. economy to grow. [SEP] this entry was posted by tracy alloway on friday, october 21st, 2009 at 10 : 00 and is filed. [SEP] you know what it is like, and it ' ll be many years before you get to know the truth, \" he said. [SEP] \" he ' s going to go to iran, iran, afghanistan, afghanistan, pakistan, the middle east, the middle east, \" garnett said. [SEP] it ' s going to be a tough year. [SEP] i don ' t understand why. [SEP] \" we are looking [SEP]", "detok_text": "[CLS] i think we know that. [SEP] many expect the u. s. economy to grow. [SEP] this entry was posted by tracy alloway on friday, october 21st, 2009 at 10: 00 and is filed. [SEP] you know what it is like, and it'll be many years before you get to know the truth, \"he said. [SEP]\" he's going to go to iran, iran, afghanistan, afghanistan, pakistan, the middle east, the middle east, \"garnett said. [SEP] it's going to be a tough year. [SEP] i don't understand why. [SEP]\" we are looking [SEP]"}
+{"type": "sample", "index": 20, "raw_text": "[CLS] [SEP] 4 ( upi ) - - a u. s. soldier has been killed and 12 wounded in an attack on a british military base in afghanistan, a military spokesman said monday. [SEP] and that ' s the turning point in the debate. [SEP] \" we have to make sure that we are to do a better job, \" he said. [SEP] he added : \" i ' m sure that ' s where i ' m going, and i ' m sure we ' ve got a little bit of work to do but i don ' t know if it ' s a good thing, \" he said. [SEP] washington ( ap ) [SEP]", "detok_text": "[CLS] [SEP] 4 (upi) - - a u. s. soldier has been killed and 12 wounded in an attack on a british military base in afghanistan, a military spokesman said monday. [SEP] and that's the turning point in the debate. [SEP] \"we have to make sure that we are to do a better job,\" he said. [SEP] he added: \"i'm sure that's where i'm going, and i'm sure we've got a little bit of work to do but i don't know if it's a good thing,\" he said. [SEP] washington (ap) [SEP]"}
+{"type": "sample", "index": 21, "raw_text": "[CLS] quarter of 2006. $ 2. 3 million in the fourth quarter. 3. 5 % to $ 0. 5 million in the same period. $ 10. 8 million in the third quarter of 2006. $ 1. 4 million to $ 1. 8 million for the three - year ended december 31, 2006. $ 4. 8 million to $ 5. 5 million. $ 7. 8 million in 2006. $ 2. 7 million in the fourth quarter 2006. $ 3. 8 million for the three months ended december 31, 2006. compared to $ 2. 5 million. $ 11. 5 million in the same period [SEP]", "detok_text": "[CLS] quarter of 2006. $2. 3 million in the fourth quarter. 3. 5 % to $0. 5 million in the same period. $10. 8 million in the third quarter of 2006. $1. 4 million to $1. 8 million for the three - year ended december 31, 2006. $4. 8 million to $5. 5 million. $7. 8 million in 2006. $2. 7 million in the fourth quarter 2006. $3. 8 million for the three months ended december 31, 2006. compared to $2. 5 million. $11. 5 million in the same period [SEP]"}
+{"type": "sample", "index": 22, "raw_text": "[CLS] 1 billion. [SEP] it ' s not something we really don ' t want to do, it ' s something we don ' t really want, \" pinera said. [SEP] in july, unemployment rose to 6. 4 percent, from august ' s 6. 1 percent rate. [SEP] there ' s a lot of work to do, but there ' s no need to pay any attention. [SEP] i don ' t think that is going to change. [SEP] some of these shows have just started in new york. [SEP] and i think we all understand that we don ' t have a public option. [SEP] \" i would like to see [SEP]", "detok_text": "[CLS] 1 billion. [SEP] it's not something we really don't want to do, it's something we don't really want, \"pinera said. [SEP] in july, unemployment rose to 6. 4 percent, from august's 6. 1 percent rate. [SEP] there's a lot of work to do, but there's no need to pay any attention. [SEP] i don't think that is going to change. [SEP] some of these shows have just started in new york. [SEP] and i think we all understand that we don't have a public option. [SEP]\" i would like to see [SEP]"}
+{"type": "sample", "index": 23, "raw_text": "[CLS] was up 1. 63 points, or 0. 18 percent, at 1, 440. 67. [SEP] \" he ' s not good, he ' s good, he ' s not bad for himself, that ' s why he ' s going to be at his best, \" selig said in an interview with the associated press. [SEP] \" i don ' t think too much about where we ' re going, \" he said. [SEP] raleigh, n. c., july 27 / prnewswire - firstcall / - - motorola, inc. [SEP] asheville, n. c., july 6 ( [SEP]", "detok_text": "[CLS] was up 1. 63 points, or 0. 18 percent, at 1, 440. 67. [SEP] \"he's not good, he's good, he's not bad for himself, that's why he's going to be at his best,\" selig said in an interview with the associated press. [SEP] \"i don't think too much about where we're going,\" he said. [SEP] raleigh, n. c., july 27/prnewswire - firstcall/- - motorola, inc. [SEP] asheville, n. c., july 6 ( [SEP]"}
+{"type": "sample", "index": 24, "raw_text": "[CLS] with 4. 3 seconds left in the first quarter, but scored 11 of his 15 points in the first 5 minutes of the third quarter. [SEP] \" what do you think we ' re going to do? \" he asked. [SEP] \" i ' m just trying to see what they ' re doing, \" he said. [SEP] that ' s because i ' ve lost a lot of money, and i ' ve worked really hard, \" he said. [SEP] i ' m not going to do it, \" he said. [SEP] new fort worth, texas, may 17 ( upi ) - - the u. s. department of [SEP]", "detok_text": "[CLS] with 4. 3 seconds left in the first quarter, but scored 11 of his 15 points in the first 5 minutes of the third quarter. [SEP] \"what do you think we're going to do?\" he asked. [SEP] \"i'm just trying to see what they're doing,\" he said. [SEP] that's because i've lost a lot of money, and i've worked really hard, \"he said. [SEP] i'm not going to do it,\" he said. [SEP] new fort worth, texas, may 17 (upi) - - the u. s. department of [SEP]"}
+{"type": "sample", "index": 25, "raw_text": "[CLS] sold for $ 2, 500. [SEP] \" it wasn ' t for us, \" he said. [SEP] \" i don ' t know why, \" he said. [SEP] it ' s a story we all want to know. [SEP] \" if i don ' t have to do what i feel i have to do, i ' m not sure, \" he said, adding that he could earn as little as $ 1, 000 a year. [SEP] revenue fell 17. 3 percent to $ 1. 16 billion, compared with $ 1. 7 billion in 2007. [SEP] it ' s only a matter of time. [SEP] \" i think [SEP]", "detok_text": "[CLS] sold for $2, 500. [SEP] \"it wasn't for us,\" he said. [SEP] \"i don't know why,\" he said. [SEP] it's a story we all want to know. [SEP] \"if i don't have to do what i feel i have to do, i'm not sure,\" he said, adding that he could earn as little as $1, 000 a year. [SEP] revenue fell 17. 3 percent to $1. 16 billion, compared with $1. 7 billion in 2007. [SEP] it's only a matter of time. [SEP] \" i think [SEP]"}
+{"type": "sample", "index": 26, "raw_text": "[CLS] the region. [SEP] u. s. state department spokesman sean mccormack told reporters in a press briefing friday that u. s. officials still have \" serious concerns \" about iran. [SEP] \" there ' s still a lot of work to do, \" he said. [SEP] \" if there were a lot of people in that part of the city, it would be an extraordinary situation, \" he said. [SEP] \" it ' s very sad, \" he said. [SEP] \" i just don ' t know why we don ' t want to do that, \" he said. [SEP] \" but you have to deal with it. [SEP] [SEP]", "detok_text": "[CLS] the region. [SEP] u. s. state department spokesman sean mccormack told reporters in a press briefing friday that u. s. officials still have \"serious concerns\" about iran. [SEP] \"there's still a lot of work to do,\" he said. [SEP] \"if there were a lot of people in that part of the city, it would be an extraordinary situation,\" he said. [SEP] \"it's very sad,\" he said. [SEP] \"i just don't know why we don't want to do that,\" he said. [SEP] \" but you have to deal with it. [SEP] [SEP]"}
+{"type": "sample", "index": 27, "raw_text": "[CLS] rates paid by the financial services authority ( fsa ) dropped to 3. 5 per cent in the third quarter from 3. 5 per cent in the second quarter. [SEP] \" we ' ll do it, we ' ll do it all over the weekend, we ' ll stay there for a few days, \" he said. [SEP] chicago, ill., march 4 / prnewswire - firstcall / - - federal communications, inc. [SEP] \" i ' ve never had any problems and i ' ve never had a problem with them, \" he said. [SEP] i don ' t want to go any further. [SEP] [SEP]", "detok_text": "[CLS] rates paid by the financial services authority (fsa) dropped to 3. 5 per cent in the third quarter from 3. 5 per cent in the second quarter. [SEP] \"we'll do it, we'll do it all over the weekend, we'll stay there for a few days,\" he said. [SEP] chicago, ill., march 4/prnewswire - firstcall/- - federal communications, inc. [SEP] \"i've never had any problems and i've never had a problem with them,\" he said. [SEP] i don't want to go any further. [SEP] [SEP]"}
+{"type": "sample", "index": 28, "raw_text": "[CLS], canada, france, britain, and the us are still working on some of the world ' s most important issues. [SEP] \" i thought it was a good idea, \" he said. [SEP] \" i feel like we ' re going to win, i ' m sorry i don ' t think we ' ve done enough, i just think we ' re going to do a lot better, \" nadal said. [SEP] \" we have to win, we ' re going to win, we don ' t want us to go out, we don ' t win, we have to win. [SEP] it would be good news. [SEP] [SEP]", "detok_text": "[CLS], canada, france, britain, and the us are still working on some of the world's most important issues. [SEP] \"i thought it was a good idea,\" he said. [SEP] \"i feel like we're going to win, i'm sorry i don't think we've done enough, i just think we're going to do a lot better,\" nadal said. [SEP] \" we have to win, we're going to win, we don't want us to go out, we don't win, we have to win. [SEP] it would be good news. [SEP] [SEP]"}
+{"type": "sample", "index": 29, "raw_text": "[CLS] from 1. 4 billion yen ( $ 2. 5 billion ) a year earlier, the company said thursday. [SEP] \" every time i get to work, i ' m busy and that ' s the time of my life, \" he said. [SEP] \" i ' m not so sure, \" he said. [SEP] total net sales were $ 5. 8 million, down 7. 3 percent from a year earlier. [SEP] \" i think we will win it, \" he said, which is why he didn ' t give a press conference at half - time. [SEP] on friday, police were trying to find the bodies of two women [SEP]", "detok_text": "[CLS] from 1. 4 billion yen ($2. 5 billion) a year earlier, the company said thursday. [SEP] \"every time i get to work, i'm busy and that's the time of my life,\" he said. [SEP] \"i'm not so sure,\" he said. [SEP] total net sales were $5. 8 million, down 7. 3 percent from a year earlier. [SEP] \"i think we will win it,\" he said, which is why he didn't give a press conference at half - time. [SEP] on friday, police were trying to find the bodies of two women [SEP]"}
+{"type": "sample", "index": 30, "raw_text": "[CLS]. [SEP] at that point, everything went wrong. [SEP] at the end of the day i wanted to fight, and i was like, ' i ' m going to be ok, i ' m going to fight, i ' m not going to fight, i ' m going to be ok, i ' m going to be ok, i ' m not going to fight. ' [SEP] washington, march 13 ( upi ) - - u. s. secretary of state hillary clinton is due to visit pakistan thursday on the mission of the u. n. mission in afghanistan, an official said. [SEP] 16 / prnewswire [SEP]", "detok_text": "[CLS]. [SEP] at that point, everything went wrong. [SEP] at the end of the day i wanted to fight, and i was like, ' i'm going to be ok, i'm going to fight, i'm not going to fight, i'm going to be ok, i'm going to be ok, i'm not going to fight. ' [SEP] washington, march 13 (upi) - - u. s. secretary of state hillary clinton is due to visit pakistan thursday on the mission of the u. n. mission in afghanistan, an official said. [SEP] 16/prnewswire [SEP]"}
+{"type": "sample", "index": 31, "raw_text": "[CLS] $ 300, 000 for the west bank, $ 200, 000 for the south and $ 300, 000 for the north. [SEP] minneapolis, july 11 ( upi ) - - a three - run homer in the bottom of the ninth monday gave the colorado rockies a 3 - 2 win over the minnesota twins. [SEP] i do not think that it would go that way, \" he said. [SEP] \" we all need to follow the rules, \" he said. [SEP] \" the company ' s operating income and costs have increased from $ 25, 000 to $ 25, 000, \" mr. ellison said. [SEP] \" that ' s [SEP]", "detok_text": "[CLS] $300, 000 for the west bank, $200, 000 for the south and $300, 000 for the north. [SEP] minneapolis, july 11 (upi) - - a three - run homer in the bottom of the ninth monday gave the colorado rockies a 3 - 2 win over the minnesota twins. [SEP] i do not think that it would go that way, \"he said. [SEP]\" we all need to follow the rules, \"he said. [SEP]\" the company's operating income and costs have increased from $25, 000 to $25, 000, \"mr. ellison said. [SEP]\" that's [SEP]"}
+{"type": "sample", "index": 32, "raw_text": "[CLS] in the last five years, he said. [SEP] \" i think it ' s going to take a while for me to do the right thing, \" o ' neill said. [SEP] \" i don ' t want to go back to my home, but i ' m sure i don ' t want to stay. [SEP] i don ' t know, i have everything, i ' m sorry, i know i don ' t want to do anything, \" he said. [SEP] i don ' t know, but i ' m sure i don ' t want to know, i don ' t know. [SEP] \" i think there will be [SEP]", "detok_text": "[CLS] in the last five years, he said. [SEP] \"i think it's going to take a while for me to do the right thing,\" o' neill said. [SEP] \"i don't want to go back to my home, but i'm sure i don't want to stay. [SEP] i don't know, i have everything, i'm sorry, i know i don't want to do anything,\" he said. [SEP] i don't know, but i'm sure i don't want to know, i don't know. [SEP] \" i think there will be [SEP]"}
+{"type": "sample", "index": 33, "raw_text": "[CLS] yield on the 10 - year note rose to 3. 86 per cent from 3. 86 per cent late tuesday, before falling back to 3. 73 per cent thursday. [SEP] he said : \" i do not know why. [SEP] mr warrick, 27, is due to be sentenced later on monday. [SEP] the project will cost an estimated $ 50 million. [SEP] i ' d like to know if he does that. [SEP] \" i don ' t, \" he said. [SEP] \" i ' m not going to have to live in a new place where i don ' t have to live, \" he said. [SEP] the company [SEP]", "detok_text": "[CLS] yield on the 10 - year note rose to 3. 86 per cent from 3. 86 per cent late tuesday, before falling back to 3. 73 per cent thursday. [SEP] he said: \"i do not know why. [SEP] mr warrick, 27, is due to be sentenced later on monday. [SEP] the project will cost an estimated $50 million. [SEP] i'd like to know if he does that. [SEP]\" i don't, \"he said. [SEP]\" i'm not going to have to live in a new place where i don't have to live, \" he said. [SEP] the company [SEP]"}
+{"type": "sample", "index": 34, "raw_text": "[CLS]. london. £25, 000 - £25, 000. city hall. london. £30, 707 - £37, 085 london weighting. £36, 701 - £38, 705 - £35, 000 - £35, 000 ( depending on experience ) per annum. london metropolitan university. central london. £31, 706 - £40, 703 - £51, 366. city of london. london. £31, 705 - £37, 702 - £38, 087. city of london. £20, 701 - £20, 087 [SEP]", "detok_text": "[CLS]. london. £25, 000 - £25, 000. city hall. london. £30, 707 - £37, 085 london weighting. £36, 701 - £38, 705 - £35, 000 - £35, 000 (depending on experience) per annum. london metropolitan university. central london. £31, 706 - £40, 703 - £51, 366. city of london. london. £31, 705 - £37, 702 - £38, 087. city of london. £20, 701 - £20, 087 [SEP]"}
+{"type": "sample", "index": 35, "raw_text": "[CLS] more than 100 people by the end of the year. [SEP] hefty giuliani ' s 4 - yard run gave georgia ( 4 - 11, 1 - 5 ) the lead with 1 : 47 to go, but he fouled out in the final minute. [SEP] \" i ' m glad we know we ' ve got to win, and i want to make sure that ' s going to happen, \" he said. [SEP] i don ' t think there ' s going to be a great deal on the market at the moment, \" he told reporters. [SEP] \" that ' s what we do, we don ' t [SEP]", "detok_text": "[CLS] more than 100 people by the end of the year. [SEP] hefty giuliani's 4 - yard run gave georgia (4 - 11, 1 - 5) the lead with 1: 47 to go, but he fouled out in the final minute. [SEP] \"i'm glad we know we've got to win, and i want to make sure that's going to happen,\" he said. [SEP] i don't think there's going to be a great deal on the market at the moment, \"he told reporters. [SEP]\" that's what we do, we don't [SEP]"}
+{"type": "sample", "index": 36, "raw_text": "[CLS] percentage point to 8, 000. 4, the lowest level since the survey began in 1974. [SEP] \" i don ' t want to run for the presidency, \" he said. [SEP] \" no, i don ' t think that ' s fair, i ' m sorry, i ' m sorry, i don ' t know anything about you, i don ' t know anything about you. [SEP] \" that is what we have to do in afghanistan, and that ' s what we have to do with them, \" he told reporters. [SEP] \" we still have a lot of challenges to the financial system, \" he said. [SEP] [SEP]", "detok_text": "[CLS] percentage point to 8, 000. 4, the lowest level since the survey began in 1974. [SEP] \"i don't want to run for the presidency,\" he said. [SEP] \"no, i don't think that's fair, i'm sorry, i'm sorry, i don't know anything about you, i don't know anything about you. [SEP]\" that is what we have to do in afghanistan, and that's what we have to do with them, \"he told reporters. [SEP]\" we still have a lot of challenges to the financial system, \" he said. [SEP] [SEP]"}
+{"type": "sample", "index": 37, "raw_text": "[CLS] 00 local time ( 1400 gmt ). [SEP] i ' m not going to do that. [SEP] the cost could be as high as $ 5, 000, and the final cost could be as high as $ 2, 000 to $ 2. 5 million, he said. [SEP] \" we ' ve got to win, however, i don ' t think we can win, \" he said. [SEP] i don ' t want to do anything like that. [SEP] \" we will make clear in the next few days that we have to make a decision. [SEP] i ' m going to get a lot of money. [SEP] that ' s [SEP]", "detok_text": "[CLS] 00 local time (1400 gmt). [SEP] i'm not going to do that. [SEP] the cost could be as high as $5, 000, and the final cost could be as high as $2, 000 to $2. 5 million, he said. [SEP] \"we've got to win, however, i don't think we can win,\" he said. [SEP] i don't want to do anything like that. [SEP] \" we will make clear in the next few days that we have to make a decision. [SEP] i'm going to get a lot of money. [SEP] that's [SEP]"}
+{"type": "sample", "index": 38, "raw_text": "[CLS] 3 per cent on last year ' s 1. 5 per cent drop. [SEP] at least eight u. s. troops have died in afghanistan this year, bringing the number of americans killed in the war to more than 1, 100 in the last five years. [SEP] \" i don ' t think there will be a significant change in the situation, \" said jim johnson, a spokesman for the city ' s health department. [SEP] \" i ' m not going to tell you, \" he said. [SEP] \" that seemed to be a very bad thing. [SEP] \" i have never seen anything like that before, \" he said. [SEP] [SEP]", "detok_text": "[CLS] 3 per cent on last year's 1. 5 per cent drop. [SEP] at least eight u. s. troops have died in afghanistan this year, bringing the number of americans killed in the war to more than 1, 100 in the last five years. [SEP] \"i don't think there will be a significant change in the situation,\" said jim johnson, a spokesman for the city's health department. [SEP] \"i'm not going to tell you,\" he said. [SEP] \"that seemed to be a very bad thing. [SEP]\" i have never seen anything like that before, \" he said. [SEP] [SEP]"}
+{"type": "sample", "index": 39, "raw_text": "[CLS] in wednesday night ' s national championship game. [SEP] at the start of the season, the rays moved within one game of the al central. [SEP] associated press writer david willey contributed to this report. [SEP] \" it ' s hard to see what we will achieve by the end of the year and it ' s hard to believe the president is going to be able to reach that goal, \" said david mckiernan, the president ' s spokesman. [SEP] the u. s. state department was not available for comment and did not return calls for comment. [SEP] a u. s. military spokeswoman said three people were [SEP]", "detok_text": "[CLS] in wednesday night's national championship game. [SEP] at the start of the season, the rays moved within one game of the al central. [SEP] associated press writer david willey contributed to this report. [SEP] \"it's hard to see what we will achieve by the end of the year and it's hard to believe the president is going to be able to reach that goal,\" said david mckiernan, the president's spokesman. [SEP] the u. s. state department was not available for comment and did not return calls for comment. [SEP] a u. s. military spokeswoman said three people were [SEP]"}
+{"type": "sample", "index": 40, "raw_text": "[CLS] there will be some changes in the game. [SEP] \" i think we ' ve still got a problem, \" he said. [SEP] in more than a decade in the senate, he has not been able to lead the same party. [SEP] new york ( reuters ) - fannie mae and co ( fre. n : quote, profile, research, stock buzz ), freddie mac ( fre. n : quote, profile, research, stock buzz ) and citigroup inc ( cit. n ), the new york times reported on thursday. [SEP] i don ' t really want to work hard, i ' m just [SEP]", "detok_text": "[CLS] there will be some changes in the game. [SEP] \"i think we've still got a problem,\" he said. [SEP] in more than a decade in the senate, he has not been able to lead the same party. [SEP] new york (reuters) - fannie mae and co (fre. n: quote, profile, research, stock buzz), freddie mac (fre. n: quote, profile, research, stock buzz) and citigroup inc (cit. n), the new york times reported on thursday. [SEP] i don't really want to work hard, i'm just [SEP]"}
+{"type": "sample", "index": 41, "raw_text": "[CLS], 2007. [SEP] more than five people have been taken to hospital after a fire at a health centre in the north of the city. [SEP] 18 / prnewswire - usnewswire / - - motorola inc. [SEP] raleigh, n. c., may 2 / prnewswire - usnewswire / - - information systems inc., a leader in information management, intelligence and information software, today announced a $ 1. 5 billion deal to provide intelligence and operational support to u. s. government agencies. [SEP] \" i think that ' s the right thing to do, \" he told reporters. [SEP] [SEP]", "detok_text": "[CLS], 2007. [SEP] more than five people have been taken to hospital after a fire at a health centre in the north of the city. [SEP] 18/prnewswire - usnewswire/- - motorola inc. [SEP] raleigh, n. c., may 2/prnewswire - usnewswire/- - information systems inc., a leader in information management, intelligence and information software, today announced a $1. 5 billion deal to provide intelligence and operational support to u. s. government agencies. [SEP] \"i think that's the right thing to do,\" he told reporters. [SEP] [SEP]"}
+{"type": "sample", "index": 42, "raw_text": "[CLS] united states for the first time in nearly 50 years. [SEP] \" i don ' t want to know, \" he said. [SEP] \" that ' s the decision we ' re going to make, \" he said. [SEP] austin, texas, march 3 / prnewswire / - - general motors, inc. [SEP] i don ' t know what she ' s doing. [SEP] \" i knew i ' d have to do something, i ' d think i ' d have to do something, and i knew i couldn ' t do something and that ' s what i wanted to do on my own, \" he said. [SEP] [SEP]", "detok_text": "[CLS] united states for the first time in nearly 50 years. [SEP] \"i don't want to know,\" he said. [SEP] \"that's the decision we're going to make,\" he said. [SEP] austin, texas, march 3/prnewswire/- - general motors, inc. [SEP] i don't know what she's doing. [SEP] \"i knew i'd have to do something, i'd think i'd have to do something, and i knew i couldn't do something and that's what i wanted to do on my own,\" he said. [SEP] [SEP]"}
+{"type": "sample", "index": 43, "raw_text": "[CLS]. [SEP] \" it is going to be a little more difficult but at the end of the day i don ' t play well so i ' ve got to do my best. [SEP] this article was published on guardian. co. uk at 08. 50 gmt on sunday 2 march 2010. [SEP] the official declined to be named because the official was not authorized to discuss the situation. [SEP] the united states and north korea have also agreed to test a long - range missile. [SEP] buffalo, n. y., aug. [SEP] i think we can get used to that, \" he said. [SEP] \" it ' s important to see [SEP]", "detok_text": "[CLS]. [SEP] \"it is going to be a little more difficult but at the end of the day i don't play well so i've got to do my best. [SEP] this article was published on guardian. co. uk at 08. 50 gmt on sunday 2 march 2010. [SEP] the official declined to be named because the official was not authorized to discuss the situation. [SEP] the united states and north korea have also agreed to test a long - range missile. [SEP] buffalo, n. y., aug. [SEP] i think we can get used to that,\" he said. [SEP] \" it's important to see [SEP]"}
+{"type": "sample", "index": 44, "raw_text": "[CLS]5, 000 - £30, 000 - £30, 000 - £30, 000 per annum. north yorkshire county council. we ' re looking for a new manager to manage.... [SEP] chicago, july 10 ( upi ) - - cole hamels hit a two - run homer in the ninth inning friday and the new york yankees clinched the american league east with a 5 - 2 win over philadelphia. [SEP] associated press writer matt kurski in los angeles contributed to this report. [SEP] he said : \" i was going to be disappointed but i didn ' t want to get out of there. [SEP] however, [SEP]", "detok_text": "[CLS]5, 000 - £30, 000 - £30, 000 - £30, 000 per annum. north yorkshire county council. we're looking for a new manager to manage.... [SEP] chicago, july 10 (upi) - - cole hamels hit a two - run homer in the ninth inning friday and the new york yankees clinched the american league east with a 5 - 2 win over philadelphia. [SEP] associated press writer matt kurski in los angeles contributed to this report. [SEP] he said: \" i was going to be disappointed but i didn't want to get out of there. [SEP] however, [SEP]"}
+{"type": "sample", "index": 45, "raw_text": "[CLS]. [SEP] the death toll is expected to rise to around 25. [SEP] east rutherford, n. j., march 19 / prnewswire / - - emc financial services ( emc. n : quote, profile, research ) ), the world ' s largest insurance and financial services company, today announced financial results for the year ended december 31, 2008. [SEP] ( nasdaq : stft ) is a global services company. [SEP] \" the people want it to work, they know they ' ve got it, they don ' t want to get it right, \" he told afp. [SEP] \" i don [SEP]", "detok_text": "[CLS]. [SEP] the death toll is expected to rise to around 25. [SEP] east rutherford, n. j., march 19/prnewswire/- - emc financial services (emc. n: quote, profile, research) ), the world's largest insurance and financial services company, today announced financial results for the year ended december 31, 2008. [SEP] (nasdaq: stft) is a global services company. [SEP] \"the people want it to work, they know they've got it, they don't want to get it right,\" he told afp. [SEP] \" i don [SEP]"}
+{"type": "sample", "index": 46, "raw_text": "[CLS] have not determined the cause of his death. [SEP] \" i don ' t think there ' s any point here, \" he said as he came to watch. [SEP] u. s. retail sales in the region rose 0. 5 percent in the first half of the year, the commerce department said. [SEP] \" i ' m a little nervous and i don ' t want to fight, \" he said. [SEP] washington ( ap ) - - president bush said monday that the government must take the necessary steps to address the global financial crisis. [SEP] \" it ' s very hard and i ' m sure it will get much better. \" [SEP]", "detok_text": "[CLS] have not determined the cause of his death. [SEP] \"i don't think there's any point here,\" he said as he came to watch. [SEP] u. s. retail sales in the region rose 0. 5 percent in the first half of the year, the commerce department said. [SEP] \"i'm a little nervous and i don't want to fight,\" he said. [SEP] washington (ap) - - president bush said monday that the government must take the necessary steps to address the global financial crisis. [SEP] \"it's very hard and i'm sure it will get much better.\" [SEP]"}
+{"type": "sample", "index": 47, "raw_text": "[CLS] 16. 18. [SEP] it ' s going to take more than a year for congress to act. [SEP] i just don ' t think we can do anything. [SEP] \" if he is to make a good start, he will have to be working very hard. [SEP] \" you don ' t have to wait, you ' re going to have to wait, \" she said. [SEP] obama is scheduled to visit the capitol on thursday morning to discuss the health care bill. [SEP] i know i ' m not sure we ' ll have to change him, but he ' s got a lot of work, \" he said. [SEP] i think [SEP]", "detok_text": "[CLS] 16. 18. [SEP] it's going to take more than a year for congress to act. [SEP] i just don't think we can do anything. [SEP] \"if he is to make a good start, he will have to be working very hard. [SEP]\" you don't have to wait, you're going to have to wait, \"she said. [SEP] obama is scheduled to visit the capitol on thursday morning to discuss the health care bill. [SEP] i know i'm not sure we'll have to change him, but he's got a lot of work,\" he said. [SEP] i think [SEP]"}
+{"type": "sample", "index": 48, "raw_text": "[CLS] in the last two years rose to $ 300, 000 from at least $ 300, 000 in 2006. [SEP] \" we will be fine, \" he said. [SEP] i don ' t think it ' s the end of the world, \" said the 24 - year - old russian. [SEP] i ' m not sure, i don ' t want people to know when i ' m going to run. [SEP] \" i don ' t want to be able to talk, i ' m not talking, i don ' t think i should be able to talk to people, \" he said. [SEP] the deal marks the company ' s first [SEP]", "detok_text": "[CLS] in the last two years rose to $300, 000 from at least $300, 000 in 2006. [SEP] \"we will be fine,\" he said. [SEP] i don't think it's the end of the world, \"said the 24 - year - old russian. [SEP] i'm not sure, i don't want people to know when i'm going to run. [SEP]\" i don't want to be able to talk, i'm not talking, i don't think i should be able to talk to people, \" he said. [SEP] the deal marks the company's first [SEP]"}
+{"type": "sample", "index": 49, "raw_text": "[CLS] don ' t do anything, \" he said. [SEP] but \" i think it ' s going to be tough in the future, \" he said. [SEP] \" i ' ve got to figure out how it ' ll work, and sometimes i don ' t know what i can do, and i ' ve got to know how much i ' m going to do it, \" he said. [SEP] 3 ( upi ) - - brett gardner hit a three - run homer saturday, powering the marlins to a 10 - 6 win over the cleveland indians. [SEP] but i don ' t. [SEP] \" i ' m not going to [SEP]", "detok_text": "[CLS] don't do anything, \"he said. [SEP] but\" i think it's going to be tough in the future, \"he said. [SEP]\" i've got to figure out how it'll work, and sometimes i don't know what i can do, and i've got to know how much i'm going to do it, \"he said. [SEP] 3 (upi) - - brett gardner hit a three - run homer saturday, powering the marlins to a 10 - 6 win over the cleveland indians. [SEP] but i don't. [SEP]\" i'm not going to [SEP]"}
+{"type": "sample", "index": 50, "raw_text": "[CLS] the height of the global financial crisis. [SEP] \" i don ' t think he ' s going to go any further, \" he said. [SEP] dozens of u. s. service members have been killed in afghanistan, iraq and iraq, according to the u. s. military ' s latest annual report. [SEP] \" there needs to be a solution, \" he said. [SEP] 12 ( upi ) - - youngʼs first goal of the season gave the boston bruins a 3 - 2 win over the boston bruins saturday night. [SEP] but they don ' t have to win. [SEP] he added : \" we ' re trying to [SEP]", "detok_text": "[CLS] the height of the global financial crisis. [SEP] \"i don't think he's going to go any further,\" he said. [SEP] dozens of u. s. service members have been killed in afghanistan, iraq and iraq, according to the u. s. military's latest annual report. [SEP] \"there needs to be a solution,\" he said. [SEP] 12 (upi) - - youngʼs first goal of the season gave the boston bruins a 3 - 2 win over the boston bruins saturday night. [SEP] but they don't have to win. [SEP] he added: \" we're trying to [SEP]"}
+{"type": "sample", "index": 51, "raw_text": "[CLS]. [SEP] 5 ( upi ) - - the u. s. standard & poor ' s 500 rose 0. 16, or 0. 4 percent, to 1, 365. 40. [SEP] i ' m one of them. [SEP] and that ' s a good thing. [SEP] it ' s not something we don ' t need. [SEP] \" he said he didn ' t know, \" he said. [SEP] \" it ' s the first time i have been in the tournament for a long time and that ' s what i think i can do, \" he told reporters after the event. [SEP] washington ( ap ) - treasury secretary [SEP]", "detok_text": "[CLS]. [SEP] 5 (upi) - - the u. s. standard & poor's 500 rose 0. 16, or 0. 4 percent, to 1, 365. 40. [SEP] i'm one of them. [SEP] and that's a good thing. [SEP] it's not something we don't need. [SEP] \"he said he didn't know,\" he said. [SEP] \"it's the first time i have been in the tournament for a long time and that's what i think i can do,\" he told reporters after the event. [SEP] washington (ap) - treasury secretary [SEP]"}
+{"type": "sample", "index": 52, "raw_text": "[CLS] 000 jobs by the end of the year. [SEP] \" i ' m not saying that i have to make a difference, i ' m just not making mistakes. [SEP] \" i ' m not talking about it, i think i ' m doing a good job, \" he said. [SEP] both men did not want to be formally identified. [SEP] \" it ' s pretty clear that we don ' t know what to do, or what to do, and we ' re not going to do anything else, \" he said. [SEP] there ' s no doubt. [SEP] i don ' t really think there ' s much work to do to [SEP]", "detok_text": "[CLS] 000 jobs by the end of the year. [SEP] \"i'm not saying that i have to make a difference, i'm just not making mistakes. [SEP]\" i'm not talking about it, i think i'm doing a good job, \"he said. [SEP] both men did not want to be formally identified. [SEP]\" it's pretty clear that we don't know what to do, or what to do, and we're not going to do anything else, \" he said. [SEP] there's no doubt. [SEP] i don't really think there's much work to do to [SEP]"}
+{"type": "sample", "index": 53, "raw_text": "[CLS] we need to give them back, \" he said. [SEP] \" it ' s not going to cost a lot of money, \" he said. [SEP] u. s. officials said the incident had nothing to do with the attack. [SEP] \" i still have a lot of work to do, and i can ' t do any more, \" he said. [SEP] it ' s going to take a very long time, \" he said. [SEP] bethesda, n. y., july 27 / prnewswire - usnewswire / - - the north american medical association ( aia ) announced today that it has [SEP]", "detok_text": "[CLS] we need to give them back, \"he said. [SEP]\" it's not going to cost a lot of money, \"he said. [SEP] u. s. officials said the incident had nothing to do with the attack. [SEP]\" i still have a lot of work to do, and i can't do any more, \"he said. [SEP] it's going to take a very long time,\" he said. [SEP] bethesda, n. y., july 27/prnewswire - usnewswire/- - the north american medical association (aia) announced today that it has [SEP]"}
+{"type": "sample", "index": 54, "raw_text": "[CLS] co ( intc. n : quote, profile, research ) fell 25 cents, or 6. 2 percent, to $ 2. 31 a share, compared with a loss of $ 767. 7 million, or 6. 3 percent in the second quarter of 2008 and a loss of $ 2. 2 billion in the second quarter. [SEP] the magic was 19 of 28 from the field in the first half and 14 - of - 36. [SEP] he has been in prison for more than a year since his release in 2007. [SEP] \" we are going to have to do a lot of hard work to make sure that we get [SEP]", "detok_text": "[CLS] co (intc. n: quote, profile, research) fell 25 cents, or 6. 2 percent, to $2. 31 a share, compared with a loss of $767. 7 million, or 6. 3 percent in the second quarter of 2008 and a loss of $2. 2 billion in the second quarter. [SEP] the magic was 19 of 28 from the field in the first half and 14 - of - 36. [SEP] he has been in prison for more than a year since his release in 2007. [SEP] \" we are going to have to do a lot of hard work to make sure that we get [SEP]"}
+{"type": "sample", "index": 55, "raw_text": "[CLS] game with a 22 - 7 run. [SEP] veltroni, the leader of the centre - right democratic party, is set to retire in january at the end of the government ' s term. [SEP] \" i ' m not going to make a decision, i know i ' m going to make a decision there, i ' m not sure, i ' m not sure i ' m going to be there, \" he said. [SEP] \" i ' ve got to be careful, \" he said. [SEP] washington, march 18 ( upi ) - - the u. s. department of defense says a u. s. [SEP]", "detok_text": "[CLS] game with a 22 - 7 run. [SEP] veltroni, the leader of the centre - right democratic party, is set to retire in january at the end of the government's term. [SEP] \"i'm not going to make a decision, i know i'm going to make a decision there, i'm not sure, i'm not sure i'm going to be there,\" he said. [SEP] \"i've got to be careful,\" he said. [SEP] washington, march 18 (upi) - - the u. s. department of defense says a u. s. [SEP]"}
+{"type": "sample", "index": 56, "raw_text": "[CLS] last year. [SEP] \" if we didn ' t do that, we ' d never know where we ' re going, where we ' re going, \" he said, according to the associated press. [SEP] \" he doesn ' t want to go home in an emergency. [SEP] \" i knew i knew i didn ' t want to get out of my car, just get out of the car. [SEP] for months, u. s. and other government officials have raised questions about abdulmutallab ' s identity and how he tried to bring down a flight to detroit from detroit. [SEP] obama is scheduled to return to washington for talks [SEP]", "detok_text": "[CLS] last year. [SEP] \"if we didn't do that, we'd never know where we're going, where we're going,\" he said, according to the associated press. [SEP] \"he doesn't want to go home in an emergency. [SEP]\" i knew i knew i didn't want to get out of my car, just get out of the car. [SEP] for months, u. s. and other government officials have raised questions about abdulmutallab's identity and how he tried to bring down a flight to detroit from detroit. [SEP] obama is scheduled to return to washington for talks [SEP]"}
+{"type": "sample", "index": 57, "raw_text": "[CLS] the government, which is expected to borrow up to $ 100bn ( £5bn ) over five years. [SEP] that ' s not good enough. [SEP] i ' m going to go again. [SEP] 20 ( upi ) - - brian giles hit a two - run homer in the fourth inning monday, carrying the florida marlins to a 5 - 2 win over kansas city. [SEP] and if you ' re going to do that, there ' s a lot of work to do in the middle of it. [SEP] \" i don ' t want to win. [SEP] \" it ' s too early to tell you how long i am going to [SEP]", "detok_text": "[CLS] the government, which is expected to borrow up to $100bn (£5bn) over five years. [SEP] that's not good enough. [SEP] i'm going to go again. [SEP] 20 (upi) - - brian giles hit a two - run homer in the fourth inning monday, carrying the florida marlins to a 5 - 2 win over kansas city. [SEP] and if you're going to do that, there's a lot of work to do in the middle of it. [SEP] \"i don't want to win. [SEP]\" it's too early to tell you how long i am going to [SEP]"}
+{"type": "sample", "index": 58, "raw_text": "[CLS], china, the united states, canada, france, germany, russia, canada, south africa, japan, australia, south africa, india, china, france, germany, italy, japan, britain and canada. [SEP] a man has been arrested after an argument with another man outside a high school, police have said. [SEP] \" it ' s going to be tough, \" he said. [SEP] if we are able to do that, we will be able to do that, \" he said. [SEP] \" i ' m not going to have to think about it, \" he said. [SEP] i ' m sure he will have to [SEP]", "detok_text": "[CLS], china, the united states, canada, france, germany, russia, canada, south africa, japan, australia, south africa, india, china, france, germany, italy, japan, britain and canada. [SEP] a man has been arrested after an argument with another man outside a high school, police have said. [SEP] \"it's going to be tough,\" he said. [SEP] if we are able to do that, we will be able to do that, \"he said. [SEP]\" i'm not going to have to think about it, \" he said. [SEP] i'm sure he will have to [SEP]"}
+{"type": "sample", "index": 59, "raw_text": "[CLS] comment. [SEP] a total of 2, 500 people were killed in violent clashes in 2008, afp news agency reported. [SEP] kabul, afghanistan ( reuters ) - the number of afghans killed in u. s. military operations rose in the last three months of the year, up 10 percent from the start of 2007, according to government data released on thursday. [SEP] he had been due to appear in court on monday. [SEP] the rangers also won for the first time since beating the rangers 7 - 2 on a seven - game road trip last year. [SEP] it ' s just so much fun for me, \" he said. [SEP] [SEP]", "detok_text": "[CLS] comment. [SEP] a total of 2, 500 people were killed in violent clashes in 2008, afp news agency reported. [SEP] kabul, afghanistan (reuters) - the number of afghans killed in u. s. military operations rose in the last three months of the year, up 10 percent from the start of 2007, according to government data released on thursday. [SEP] he had been due to appear in court on monday. [SEP] the rangers also won for the first time since beating the rangers 7 - 2 on a seven - game road trip last year. [SEP] it's just so much fun for me, \" he said. [SEP] [SEP]"}
+{"type": "sample", "index": 60, "raw_text": "[CLS] [SEP] at the end of the day, i went to the hospital so i couldn ' t get home. [SEP] \" i don ' t want to do that as long as i ' m able to pay, \" he said. [SEP] revenue fell 7. 5 percent to $ 68. 5 million in the third quarter, from $ 70. 3 million. [SEP] the twins tied the score with a two - run homer in the fifth, but anderson hit a three - run homer in the fourth. [SEP] \" you ' ve got to look at it, it ' s going to be great, \" nadal said. [SEP] it ' s [SEP]", "detok_text": "[CLS] [SEP] at the end of the day, i went to the hospital so i couldn't get home. [SEP] \"i don't want to do that as long as i'm able to pay,\" he said. [SEP] revenue fell 7. 5 percent to $68. 5 million in the third quarter, from $70. 3 million. [SEP] the twins tied the score with a two - run homer in the fifth, but anderson hit a three - run homer in the fourth. [SEP] \"you've got to look at it, it's going to be great,\" nadal said. [SEP] it's [SEP]"}
+{"type": "sample", "index": 61, "raw_text": "[CLS], compared to 0. 5 percent in november. [SEP] i don ' t want to do that, and i ' m not sure i ' m going to get to that. [SEP] \" i ' ve learned a lot of things that i don ' t know, \" he said. [SEP] \" that ' s not true, \" he said. [SEP] \" that ' s not the problem, \" he said. [SEP] \" i ' m not sure, i ' m not sure, \" he said. [SEP] \" i don ' t want to talk to the media, \" he said. [SEP] still, i don ' t see any kind [SEP]", "detok_text": "[CLS], compared to 0. 5 percent in november. [SEP] i don't want to do that, and i'm not sure i'm going to get to that. [SEP] \"i've learned a lot of things that i don't know,\" he said. [SEP] \"that's not true,\" he said. [SEP] \"that's not the problem,\" he said. [SEP] \"i'm not sure, i'm not sure,\" he said. [SEP] \"i don't want to talk to the media,\" he said. [SEP] still, i don't see any kind [SEP]"}
+{"type": "sample", "index": 62, "raw_text": "[CLS]. [SEP] \" i don ' t think there is any reason, \" he said. [SEP] he ' s sitting in the back of the car. [SEP] i don ' t know what i ' m talking about. [SEP] it made a loss of $ 9. 5 million in the first quarter, it said. [SEP] \" i don ' t like to talk to you, i ' d like to talk to you, \" he said. [SEP] \" i just don ' t know, \" he said. [SEP] there ' s a lot of work to do. [SEP] it ' s just not going to be easy, it ' s a long [SEP]", "detok_text": "[CLS]. [SEP] \"i don't think there is any reason,\" he said. [SEP] he's sitting in the back of the car. [SEP] i don't know what i'm talking about. [SEP] it made a loss of $9. 5 million in the first quarter, it said. [SEP] \"i don't like to talk to you, i'd like to talk to you,\" he said. [SEP] \"i just don't know,\" he said. [SEP] there's a lot of work to do. [SEP] it's just not going to be easy, it's a long [SEP]"}
+{"type": "sample", "index": 63, "raw_text": "[CLS]a. [SEP] houston, may 16 ( upi ) - - michael young ' s three - run homer sparked the new york mets to a 5 - 2 win over the houston astros. [SEP] \" i think when you look back at those numbers and see where they are, you know it ' s going to be a pretty good thing, \" he said. [SEP] \" i don ' t have any money, \" he said. [SEP] \" i don ' t know yet, \" he said. [SEP] los angeles, may 9 ( upi ) - - the u. s. department of health and human services has received a health care [SEP]", "detok_text": "[CLS]a. [SEP] houston, may 16 (upi) - - michael young's three - run homer sparked the new york mets to a 5 - 2 win over the houston astros. [SEP] \"i think when you look back at those numbers and see where they are, you know it's going to be a pretty good thing,\" he said. [SEP] \"i don't have any money,\" he said. [SEP] \"i don't know yet,\" he said. [SEP] los angeles, may 9 (upi) - - the u. s. department of health and human services has received a health care [SEP]"}

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_4096steps_n64/summary.jsonl

@@ -0,0 +1,2 @@
+{"type": "summary", "name": "state_c256_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c256_t1p45", "steps": 4096, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 15.863792771486848, "nll_per_token": 2.7640393283161675, "tokens": 9236}, "diversity": {"sample_entropy": 3.8477992784844646, "unique_tokens": 972, "token_count": 8192, "distinct_1": 0.11865234375, "distinct_2": 0.3817667322834646, "top_token_mass": 0.0645751953125}}
+{"type": "summary", "name": "state_c1024_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c1024_t1p45", "steps": 4096, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 1024.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 14.379869187838807, "nll_per_token": 2.6658292554392022, "tokens": 9069}, "diversity": {"sample_entropy": 3.7611245679001697, "unique_tokens": 796, "token_count": 8192, "distinct_1": 0.09716796875, "distinct_2": 0.32258858267716534, "top_token_mass": 0.0748291015625}}

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_4096steps_n64/summary.tsv

@@ -0,0 +1,3 @@
+name	step	detok_genppl	sample_entropy	distinct_2	top_token_mass	model_t_mode	support_power	semantic_power	final_from	endpoint_temp	concentration_max	update
+state_c256_t1p45	124000	15.863792771486848	3.8477992784844646	0.3817667322834646	0.0645751953125	post	1.0	1.0	state	1.45	256.0	resample
+state_c1024_t1p45	124000	14.379869187838807	3.7611245679001697	0.32258858267716534	0.0748291015625	post	1.0	1.0	state	1.45	1024.0	resample

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_diffusion_noise_steps_128steps_n64/base_const1p45_c256_scored.jsonl

@@ -0,0 +1,65 @@
+{"type": "summary", "name": "base_const1p45_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "base_const1p45_c256", "steps": 128, "temp_start": 1.45, "temp_end": 1.45, "temp_schedule": "const", "t_power": 1.0, "eta0": 0.0, "eta_schedule": "none", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 45.86065023558471, "nll_per_token": 3.8256074560380227, "tokens": 9376}, "diversity": {"sample_entropy": 4.124430385339583, "unique_tokens": 1863, "token_count": 8192, "distinct_1": 0.2274169921875, "distinct_2": 0.6966043307086615, "top_token_mass": 0.0712890625}}
+{"type": "sample", "index": 0, "raw_text": "[CLS] democrats were using the vote to get their message out on healthcare. [SEP] \" i do want to know whether hillary clinton is sincere in her bid, \" he told reporters, saying he would refrain from talking on the issue of human rights record. [SEP] at the final days of the presidential race, the democratic rivals of former bill and hillary clinton had an unknown number of supporters, who burned their hands. [SEP] john f. brennan is the president ' s senior adviser to the new york administration for education and health - care reform. [SEP] the problem with sarah palin - - they and their own local manager, dan grubel, have [SEP]", "detok_text": "[CLS] democrats were using the vote to get their message out on healthcare. [SEP] \"i do want to know whether hillary clinton is sincere in her bid,\" he told reporters, saying he would refrain from talking on the issue of human rights record. [SEP] at the final days of the presidential race, the democratic rivals of former bill and hillary clinton had an unknown number of supporters, who burned their hands. [SEP] john f. brennan is the president's senior adviser to the new york administration for education and health - care reform. [SEP] the problem with sarah palin - - they and their own local manager, dan grubel, have [SEP]"}
+{"type": "sample", "index": 1, "raw_text": "[CLS] from its june sales. [SEP] the company ' s share of the smartphone market is in the long term. [SEP] the move comes in the heels of the assembly government ' s policy review of transport and energy, the bbc added. [SEP] however, it is also concerned that political opposition, combined with the loss of tuesday ' s olympics in london, the host city, will further undermine the games plans. [SEP] both the bbc and the bbc live around it. [SEP] \" we ' re not going to discuss him. [SEP] a house spokesman, said state department spokesman robert gibbs, said tuesday that he would not say if iran could be involved in [SEP]", "detok_text": "[CLS] from its june sales. [SEP] the company's share of the smartphone market is in the long term. [SEP] the move comes in the heels of the assembly government's policy review of transport and energy, the bbc added. [SEP] however, it is also concerned that political opposition, combined with the loss of tuesday's olympics in london, the host city, will further undermine the games plans. [SEP] both the bbc and the bbc live around it. [SEP] \" we're not going to discuss him. [SEP] a house spokesman, said state department spokesman robert gibbs, said tuesday that he would not say if iran could be involved in [SEP]"}
+{"type": "sample", "index": 2, "raw_text": "[CLS] address the different requirements for reconrigacing. [SEP] i \" feel as if i ' m a good golfer. \" [SEP] to get to basics, our players and coaches have to start the whole system with a few basics, such as health and nutritional education. [SEP] five members of the state department ' s joint chiefs of staff, including foreign minister kang hae - soonn, assistant u. s. china and north korea and secretary of state, u. s. ambassador. [SEP] brown and geithner came a year after the french president elected george francois, leader of france ' s social conservative opposition and former prime minister [SEP]", "detok_text": "[CLS] address the different requirements for reconrigacing. [SEP] i \"feel as if i'm a good golfer.\" [SEP] to get to basics, our players and coaches have to start the whole system with a few basics, such as health and nutritional education. [SEP] five members of the state department's joint chiefs of staff, including foreign minister kang hae - soonn, assistant u. s. china and north korea and secretary of state, u. s. ambassador. [SEP] brown and geithner came a year after the french president elected george francois, leader of france's social conservative opposition and former prime minister [SEP]"}
+{"type": "sample", "index": 3, "raw_text": "[CLS]il a $ 4 billion bailout to buy debt, buy off investment banks and issue convertible treasury bonds to help revive the stock markets. [SEP] london ( reuters ) - a friend and a former aide of iran ' s vice - president arrived at the u. s. treasury department on friday and told president obama, top u. s. official, that he was ready to conduct a follow - up review of the controversial anti - missile program. [SEP] the list of nominees were announced by john mccain, his campaign, republican sens. john mccain, mr. biden and the rest of the democrats. [SEP] the democratic party, which [SEP]", "detok_text": "[CLS]il a $4 billion bailout to buy debt, buy off investment banks and issue convertible treasury bonds to help revive the stock markets. [SEP] london (reuters) - a friend and a former aide of iran's vice - president arrived at the u. s. treasury department on friday and told president obama, top u. s. official, that he was ready to conduct a follow - up review of the controversial anti - missile program. [SEP] the list of nominees were announced by john mccain, his campaign, republican sens. john mccain, mr. biden and the rest of the democrats. [SEP] the democratic party, which [SEP]"}
+{"type": "sample", "index": 4, "raw_text": "[CLS] ' s oil minister said that... angola should support \" the u. s. oil dollar. [SEP] i ' d look at a history book at the time and it ' s in my 50s. [SEP] that ' s not just about managing the holidays.... [SEP] it ' s kind of like to have all things going with their child ' s mind, \" he said. [SEP] first of all, mr. brown ' s play seems to belong to mark klug, a 32 - year - old member of the audience where he and mr. gillen - - who was not being filmed on the film [SEP]", "detok_text": "[CLS]'s oil minister said that... angola should support \"the u. s. oil dollar. [SEP] i'd look at a history book at the time and it's in my 50s. [SEP] that's not just about managing the holidays.... [SEP] it's kind of like to have all things going with their child's mind,\" he said. [SEP] first of all, mr. brown's play seems to belong to mark klug, a 32 - year - old member of the audience where he and mr. gillen - - who was not being filmed on the film [SEP]"}
+{"type": "sample", "index": 5, "raw_text": "[CLS], \" he said. [SEP] and it ' s on their line now, because she ' s not buying it. [SEP] the chancellor on monday defended spending, saying reports on the economy are expected to show accelerating growth. [SEP] a very real sense of mr brown ' s growing economic unpopularity has been leading nick clegg, the british prime minister, to a cautious response, a sign that it wasn ' t even clear that the financial meltdown in britain was gradually growing again. [SEP] some say countries have the cash to buy cars to meet their environmental demands. [SEP] but after yesterday ' s decision, attorney general henry taylor warned that [SEP]", "detok_text": "[CLS], \" he said. [SEP] and it's on their line now, because she's not buying it. [SEP] the chancellor on monday defended spending, saying reports on the economy are expected to show accelerating growth. [SEP] a very real sense of mr brown's growing economic unpopularity has been leading nick clegg, the british prime minister, to a cautious response, a sign that it wasn't even clear that the financial meltdown in britain was gradually growing again. [SEP] some say countries have the cash to buy cars to meet their environmental demands. [SEP] but after yesterday's decision, attorney general henry taylor warned that [SEP]"}
+{"type": "sample", "index": 6, "raw_text": "[CLS]. s. diplomat to the united states in iran until its relationship with tehran could be recused, a top bush administration official said wednesday. [SEP] in his latest book, the bazeperian, published in 1997 - 99, is shown at home, written by the british director, james george, asking \" to do the job, try and go out, \" the 16 - year - old says today. [SEP] in emerging markets, the company said net profit rose 6. 3 per cent to $ 2. 9 billion in the year - end period compared with a profit of $ 4. 3 billion just a year earlier. [SEP] [SEP]", "detok_text": "[CLS]. s. diplomat to the united states in iran until its relationship with tehran could be recused, a top bush administration official said wednesday. [SEP] in his latest book, the bazeperian, published in 1997 - 99, is shown at home, written by the british director, james george, asking \"to do the job, try and go out,\" the 16 - year - old says today. [SEP] in emerging markets, the company said net profit rose 6. 3 per cent to $2. 9 billion in the year - end period compared with a profit of $4. 3 billion just a year earlier. [SEP] [SEP]"}
+{"type": "sample", "index": 7, "raw_text": "[CLS] china. [SEP] i ' m an older man, they please don ' t give in time to me. [SEP] rob collins, the oxfordshire county coroner, told afp he would make a further statement on his case. [SEP] as the head of rhj ' s fleet and hybrid operations, both gm and henderson were hired to run the company. [SEP] police are investigating the death of a teenage man who was killed in a bomb attack in the park hill area of north yorkshire. [SEP] the council said the city ' s surface surface water overpassed overflowing south of the thames. [SEP] \" despite that, it is clear that [SEP]", "detok_text": "[CLS] china. [SEP] i'm an older man, they please don't give in time to me. [SEP] rob collins, the oxfordshire county coroner, told afp he would make a further statement on his case. [SEP] as the head of rhj's fleet and hybrid operations, both gm and henderson were hired to run the company. [SEP] police are investigating the death of a teenage man who was killed in a bomb attack in the park hill area of north yorkshire. [SEP] the council said the city's surface surface water overpassed overflowing south of the thames. [SEP] \" despite that, it is clear that [SEP]"}
+{"type": "sample", "index": 8, "raw_text": "[CLS] he was set out to work. [SEP] mr obama was also concerned about how the war operates in afghanistan. [SEP] dr brian mcclellan, the university of the united states, said yesterday ' s results had made positive news for burma ' s people. [SEP] and the tories has done so. [SEP] the prime minister announced an agreement to buy opel plants to deal with the state ' s debts, german economy minister ludi hag - bie said. [SEP] i am particularly concerned about the higher levels of the child welfare fund. [SEP] it has been given 45 years of work by the national public library of the country, which includes [SEP]", "detok_text": "[CLS] he was set out to work. [SEP] mr obama was also concerned about how the war operates in afghanistan. [SEP] dr brian mcclellan, the university of the united states, said yesterday's results had made positive news for burma's people. [SEP] and the tories has done so. [SEP] the prime minister announced an agreement to buy opel plants to deal with the state's debts, german economy minister ludi hag - bie said. [SEP] i am particularly concerned about the higher levels of the child welfare fund. [SEP] it has been given 45 years of work by the national public library of the country, which includes [SEP]"}
+{"type": "sample", "index": 9, "raw_text": "[CLS] 8 for 22 in eight major league games. [SEP] the service will be from london on the banks of the thames, north west east road, the city at wembley, east new york road and the thames through a north to south tunnel. [SEP] blitzer : much ' s only been said about how it ' s going to be part of the time. [SEP] he says the result was excessive ballot - stuffing. [SEP] however, russian and european union leaders offered a series of measures across the caucasus region - - including discussions on establishing closer ties with europe. [SEP] according to the pope, who is expected to speak in the parliament and in public [SEP]", "detok_text": "[CLS] 8 for 22 in eight major league games. [SEP] the service will be from london on the banks of the thames, north west east road, the city at wembley, east new york road and the thames through a north to south tunnel. [SEP] blitzer: much's only been said about how it's going to be part of the time. [SEP] he says the result was excessive ballot - stuffing. [SEP] however, russian and european union leaders offered a series of measures across the caucasus region - - including discussions on establishing closer ties with europe. [SEP] according to the pope, who is expected to speak in the parliament and in public [SEP]"}
+{"type": "sample", "index": 10, "raw_text": "[CLS] members of the commons to take strong action to give \" full response to the claims. \" [SEP] it has the same technology with its own superlobitron. [SEP] if everyone wants their hands on a hed level, and there is room for a crisis but it ' s not, then not long enough, if this is good for our credibility. [SEP] two soldiers were killed on thursday and three afghan soldiers and three soldiers from the air force were wounded wednesday morning. [SEP] the u. s. state department is waging \" a new global war \" against the taliban, which has sought reconciliation and spread itself in the middle east despite [SEP]", "detok_text": "[CLS] members of the commons to take strong action to give \"full response to the claims.\" [SEP] it has the same technology with its own superlobitron. [SEP] if everyone wants their hands on a hed level, and there is room for a crisis but it's not, then not long enough, if this is good for our credibility. [SEP] two soldiers were killed on thursday and three afghan soldiers and three soldiers from the air force were wounded wednesday morning. [SEP] the u. s. state department is waging \"a new global war\" against the taliban, which has sought reconciliation and spread itself in the middle east despite [SEP]"}
+{"type": "sample", "index": 11, "raw_text": "[CLS] not when he ' s talking about energy and not when he ' s talking tax, but he seems to be addressing a tricky debate that has happened in partisan terms, one that is likely to force out the health care debate. [SEP] this, they suggest, could be compared to the \" left - wing \" campaign practised by a man who would raise his head with anything because his party opposes the president, or the old boss is voting for his wife. [SEP] now, though, his talent is more on display. [SEP] it will be fine for us, \" one official told the associated press. [SEP] overall, the index rose 0. [SEP]", "detok_text": "[CLS] not when he's talking about energy and not when he's talking tax, but he seems to be addressing a tricky debate that has happened in partisan terms, one that is likely to force out the health care debate. [SEP] this, they suggest, could be compared to the \"left - wing\" campaign practised by a man who would raise his head with anything because his party opposes the president, or the old boss is voting for his wife. [SEP] now, though, his talent is more on display. [SEP] it will be fine for us, \" one official told the associated press. [SEP] overall, the index rose 0. [SEP]"}
+{"type": "sample", "index": 12, "raw_text": "[CLS]. mccain was among those pushing obama to attend. [SEP] \" this shows that, i think this makes the case for women to be fair, \" said eric riehl of the uaw institute for policy studies in london. [SEP] i still think it ' s the kind of thing the game has changed since. [SEP] \" it ' s very unusual. [SEP] and john mccain is the chairman of the gop national committee who, after more than 40 years of channeling anti - governmentism, greengrimper has long been regarded as the church ' s strongest voice on homosexuality and marriage. [SEP] but mr. biden said that [SEP]", "detok_text": "[CLS]. mccain was among those pushing obama to attend. [SEP] \"this shows that, i think this makes the case for women to be fair,\" said eric riehl of the uaw institute for policy studies in london. [SEP] i still think it's the kind of thing the game has changed since. [SEP] \" it's very unusual. [SEP] and john mccain is the chairman of the gop national committee who, after more than 40 years of channeling anti - governmentism, greengrimper has long been regarded as the church's strongest voice on homosexuality and marriage. [SEP] but mr. biden said that [SEP]"}
+{"type": "sample", "index": 13, "raw_text": "[CLS].................... and everybody knows that sort of where it comes from... obama is going to have it all trying to do with that, that is how this is going to happen. [SEP] but they are now at the centre of the campaign for a democratic party administration, after plagng the government in the last major election in 2007. [SEP] how do you find things about different things, it ' s like at all? [SEP] but do political scientists ask tough questions about race? [SEP] and that ' s way more serious, than what they [SEP]", "detok_text": "[CLS].................... and everybody knows that sort of where it comes from... obama is going to have it all trying to do with that, that is how this is going to happen. [SEP] but they are now at the centre of the campaign for a democratic party administration, after plagng the government in the last major election in 2007. [SEP] how do you find things about different things, it's like at all? [SEP] but do political scientists ask tough questions about race? [SEP] and that's way more serious, than what they [SEP]"}
+{"type": "sample", "index": 14, "raw_text": "[CLS] said thursday. [SEP] pension investments would currently account for almost a third of the monthly earnings and earnings. [SEP] it ' s obviously a difficult experience, but i don ' t get it wrong, he said. [SEP] \" it ' s a big deal, right? [SEP] you ' ve got a long history of obesity and no need for a day out. [SEP] the decline of 21. 5 points was the largest decline in the service index since the sept. [SEP] by the same token, the middle east council is led by academic scientists. [SEP] the work at the primary school in tambourne, kent, in august. [SEP] on the other [SEP]", "detok_text": "[CLS] said thursday. [SEP] pension investments would currently account for almost a third of the monthly earnings and earnings. [SEP] it's obviously a difficult experience, but i don't get it wrong, he said. [SEP] \" it's a big deal, right? [SEP] you've got a long history of obesity and no need for a day out. [SEP] the decline of 21. 5 points was the largest decline in the service index since the sept. [SEP] by the same token, the middle east council is led by academic scientists. [SEP] the work at the primary school in tambourne, kent, in august. [SEP] on the other [SEP]"}
+{"type": "sample", "index": 15, "raw_text": "[CLS].................................................................... you go to the internet, if you did, along with the nation............. [SEP] in 2006, more than 3, 000 people made the change on a website run by conservative leader ken johnson, the party ' s deputy leader, who [SEP]", "detok_text": "[CLS].................................................................... you go to the internet, if you did, along with the nation............. [SEP] in 2006, more than 3, 000 people made the change on a website run by conservative leader ken johnson, the party's deputy leader, who [SEP]"}
+{"type": "sample", "index": 16, "raw_text": "[CLS] last updated at 11. 54 bst on 19 may 2009. [SEP] mr obama yesterday called for the first time for the issue to be discussed by both sides to use it to conduct an internal military exercise. [SEP] but the growing frustration with the human race and lack of knowing how to do this is clear. [SEP] then, he flew to washington late on monday morning, notching up his flight just ahead of the convene of bush ' s visit to the region to focus on our freedom and fight our neighbors. [SEP] mr bielaz, a 48 - year - old driver, left carcierge, germany, after 10 [SEP]", "detok_text": "[CLS] last updated at 11. 54 bst on 19 may 2009. [SEP] mr obama yesterday called for the first time for the issue to be discussed by both sides to use it to conduct an internal military exercise. [SEP] but the growing frustration with the human race and lack of knowing how to do this is clear. [SEP] then, he flew to washington late on monday morning, notching up his flight just ahead of the convene of bush's visit to the region to focus on our freedom and fight our neighbors. [SEP] mr bielaz, a 48 - year - old driver, left carcierge, germany, after 10 [SEP]"}
+{"type": "sample", "index": 17, "raw_text": "[CLS]........ there ' s not going to be a normal blow - up going on............. that ' s just happening... but this is really this is really bad..... haoooo, and that just hits me..... well, put me that way...................... and move on and look at this stuff..... and then they really don ' t matter....... [SEP]", "detok_text": "[CLS]........ there's not going to be a normal blow - up going on............. that's just happening... but this is really this is really bad..... haoooo, and that just hits me..... well, put me that way...................... and move on and look at this stuff..... and then they really don't matter....... [SEP]"}
+{"type": "sample", "index": 18, "raw_text": "[CLS] [SEP] oil prices fell 17 cents to $ 71 a barrel in singapore while october brent prices fell 67 cents to $ 70. 77 a barrel. [SEP] but \" he did a lot of dirty work and i asked him to do it and he ' d do it. [SEP] if you think obama has a different record, you can give his credit to someone who does nothing and you respect the fact that you ' re there more than someone who don ' t even know obama. [SEP] in other words, this has been the right thing to do now. [SEP] she said that he had \" had \" an issue with the government, but would remain [SEP]", "detok_text": "[CLS] [SEP] oil prices fell 17 cents to $71 a barrel in singapore while october brent prices fell 67 cents to $70. 77 a barrel. [SEP] but \"he did a lot of dirty work and i asked him to do it and he'd do it. [SEP] if you think obama has a different record, you can give his credit to someone who does nothing and you respect the fact that you're there more than someone who don't even know obama. [SEP] in other words, this has been the right thing to do now. [SEP] she said that he had\" had \" an issue with the government, but would remain [SEP]"}
+{"type": "sample", "index": 19, "raw_text": "[CLS] rep. robert clohn, died in a small fire on his house late saturday, said his office at the capitol church. [SEP] the problem is that during the 1980s the party was frayed at home, replaced by opposition to greed, hypocrisy at the core of modern politics and threw japan into a state of inequality. [SEP] \" if the evidence is, it ' s worth the focus, \" mr. evans said. [SEP] i have plenty of options. [SEP] she once said sena ' s name repeatedly and was forced to give access to his car. [SEP] he said china will be in discussions to provide economic [SEP]", "detok_text": "[CLS] rep. robert clohn, died in a small fire on his house late saturday, said his office at the capitol church. [SEP] the problem is that during the 1980s the party was frayed at home, replaced by opposition to greed, hypocrisy at the core of modern politics and threw japan into a state of inequality. [SEP] \"if the evidence is, it's worth the focus,\" mr. evans said. [SEP] i have plenty of options. [SEP] she once said sena's name repeatedly and was forced to give access to his car. [SEP] he said china will be in discussions to provide economic [SEP]"}
+{"type": "sample", "index": 20, "raw_text": "[CLS] said tuesday. [SEP] why : head for the swiss hotel, clerue hotel, lanier corfu, from £39, 045 per person, www. hotelfixorck. co. uk ( 08700 7787, www. hotelrexshol. co. uk ). [SEP] then go for lunch and go into our water. [SEP] he says he has good friends, but he wants to go. [SEP] great britain has long been concerned with high spending levels and rising national debt. [SEP] but all those who want help will be disappointed in the fact that it is not possible to hear those [SEP]", "detok_text": "[CLS] said tuesday. [SEP] why: head for the swiss hotel, clerue hotel, lanier corfu, from £39, 045 per person, www. hotelfixorck. co. uk (08700 7787, www. hotelrexshol. co. uk). [SEP] then go for lunch and go into our water. [SEP] he says he has good friends, but he wants to go. [SEP] great britain has long been concerned with high spending levels and rising national debt. [SEP] but all those who want help will be disappointed in the fact that it is not possible to hear those [SEP]"}
+{"type": "sample", "index": 21, "raw_text": "[CLS] world. [SEP] murraf ' s announcement doesn ' t say how the u. s. new pakistan policy center said its national security policy is focused. [SEP] clinton said she said she would like to keep out a clear account of the state ' s future. [SEP] he says it ' s true what bush would be willing to do. [SEP] the military said it had spent nearly $ 10 million in donations it had raised in the past year. [SEP] now he is planning to give the money back to the school. [SEP] \" i ' ve got to say, \" clinton said at 9 p. m., \" but it ' s [SEP]", "detok_text": "[CLS] world. [SEP] murraf's announcement doesn't say how the u. s. new pakistan policy center said its national security policy is focused. [SEP] clinton said she said she would like to keep out a clear account of the state's future. [SEP] he says it's true what bush would be willing to do. [SEP] the military said it had spent nearly $10 million in donations it had raised in the past year. [SEP] now he is planning to give the money back to the school. [SEP] \"i've got to say,\" clinton said at 9 p. m., \" but it's [SEP]"}
+{"type": "sample", "index": 22, "raw_text": "[CLS] billion over the years. [SEP] i ' m a little optimistic, and we ' re trying to make significant progress. \" [SEP] the government doesn ' t have an immediate information on what has happened since then. [SEP] he said victims often feel they ' re not aware of the abuse, and urged others to move forward. [SEP] \" this has been embarrassing to me. [SEP] but this group is more than that in other countries, and we do not know how long those lineages might be related. [SEP] he told the washington post ' s good morning america program that he thinks he will go to congress. [SEP] councillor david tyrrell, chairman [SEP]", "detok_text": "[CLS] billion over the years. [SEP] i'm a little optimistic, and we're trying to make significant progress. \"[SEP] the government doesn't have an immediate information on what has happened since then. [SEP] he said victims often feel they're not aware of the abuse, and urged others to move forward. [SEP]\" this has been embarrassing to me. [SEP] but this group is more than that in other countries, and we do not know how long those lineages might be related. [SEP] he told the washington post's good morning america program that he thinks he will go to congress. [SEP] councillor david tyrrell, chairman [SEP]"}
+{"type": "sample", "index": 23, "raw_text": "[CLS] level in almost a decade. [SEP] he said he expected to travel to tokyo with the chairman of un secretary - general general of developing countries around the world to travel through the region and asia and to facilitate the transition of his government. [SEP] dole got back to quit the primary after a five year hiatus. [SEP] mr. smith, a 25 - year - old american who married and raised in allenton, pa., died during a serious car crash in 2003. [SEP] a woman and two men and their children were killed in the militant attack last thursday, but he was not allowed to run. [SEP] the police came to the scene [SEP]", "detok_text": "[CLS] level in almost a decade. [SEP] he said he expected to travel to tokyo with the chairman of un secretary - general general of developing countries around the world to travel through the region and asia and to facilitate the transition of his government. [SEP] dole got back to quit the primary after a five year hiatus. [SEP] mr. smith, a 25 - year - old american who married and raised in allenton, pa., died during a serious car crash in 2003. [SEP] a woman and two men and their children were killed in the militant attack last thursday, but he was not allowed to run. [SEP] the police came to the scene [SEP]"}
+{"type": "sample", "index": 24, "raw_text": "[CLS] life. [SEP] the hearing began after midnight on saturday night, with the assembly meeting on thursday night. [SEP] senior iranian officials accused iraq ' s prime minister thursday, jalil talabani, of seeking a political solution. [SEP] just over a matter of time the race came out. [SEP] 4 included a profit of 35. 2 million, compared with 38 cents the year before. [SEP] so, what exactly is our own public health problem? [SEP] huw kuo, 37, a professor of politics at the university of california at davis, said after the meeting he thought there was a power line running in front of robert mugabe [SEP]", "detok_text": "[CLS] life. [SEP] the hearing began after midnight on saturday night, with the assembly meeting on thursday night. [SEP] senior iranian officials accused iraq's prime minister thursday, jalil talabani, of seeking a political solution. [SEP] just over a matter of time the race came out. [SEP] 4 included a profit of 35. 2 million, compared with 38 cents the year before. [SEP] so, what exactly is our own public health problem? [SEP] huw kuo, 37, a professor of politics at the university of california at davis, said after the meeting he thought there was a power line running in front of robert mugabe [SEP]"}
+{"type": "sample", "index": 25, "raw_text": "[CLS] oil prices and fuel hikes. [SEP] gaza and the west bank since june 2007, but broke up with israel after the government agreed that israel would remove the building in return, the newspaper reported. [SEP] \" it ' s been a tough game, but now i have to play the best match i can, i ' m so ready for next sunday - i don ' t quite agree with that. [SEP] about 3. 2 million people in france earned 2. 3 billion euros ( £1. 5 billion ) ( $ 1. 8 billion ) in 2006, according to the statistics ministry. [SEP] morgan, the investment house, has confirmed that [SEP]", "detok_text": "[CLS] oil prices and fuel hikes. [SEP] gaza and the west bank since june 2007, but broke up with israel after the government agreed that israel would remove the building in return, the newspaper reported. [SEP] \" it's been a tough game, but now i have to play the best match i can, i'm so ready for next sunday - i don't quite agree with that. [SEP] about 3. 2 million people in france earned 2. 3 billion euros (£1. 5 billion) ($1. 8 billion) in 2006, according to the statistics ministry. [SEP] morgan, the investment house, has confirmed that [SEP]"}
+{"type": "sample", "index": 26, "raw_text": "[CLS], released his latest ad in an effort to bring a little about the video game with the current economy. [SEP] the pentagon said the attack yesterday killed about 20 suspected insurgents. [SEP] the incident and the country ' s frustration with china have been washington ' s strongest insistence that the u. s. administration needs to take steps in efforts to address the problem, and that the war lies ahead despite the clogs. [SEP] the gulf of gas that runs through to new hampshire and southwestern virginia along the western end of the m4 80 and a long way east across the mainland. [SEP] next week, the house of representatives passed the energy bill [SEP]", "detok_text": "[CLS], released his latest ad in an effort to bring a little about the video game with the current economy. [SEP] the pentagon said the attack yesterday killed about 20 suspected insurgents. [SEP] the incident and the country's frustration with china have been washington's strongest insistence that the u. s. administration needs to take steps in efforts to address the problem, and that the war lies ahead despite the clogs. [SEP] the gulf of gas that runs through to new hampshire and southwestern virginia along the western end of the m4 80 and a long way east across the mainland. [SEP] next week, the house of representatives passed the energy bill [SEP]"}
+{"type": "sample", "index": 27, "raw_text": "[CLS] better - looking young, educated, prosperous, well - educated and highly - ambitious, and more adventurous politically and into reality. [SEP] when referring to a quarter - point rate cut, the deputy chairman of the monetary policy committee said in its monthly report that credit should promote growth and the economy is the main reason for the policy easing while reducing price inflation. [SEP] \" professional and other professional names are more interesting but we still have to have players who are more serious in their careers. [SEP] in other agriculture trading, june october live cattle climbed 0. 2 per cent to $ 7. 655 a pound and pork bellies were up 0 [SEP]", "detok_text": "[CLS] better - looking young, educated, prosperous, well - educated and highly - ambitious, and more adventurous politically and into reality. [SEP] when referring to a quarter - point rate cut, the deputy chairman of the monetary policy committee said in its monthly report that credit should promote growth and the economy is the main reason for the policy easing while reducing price inflation. [SEP] \" professional and other professional names are more interesting but we still have to have players who are more serious in their careers. [SEP] in other agriculture trading, june october live cattle climbed 0. 2 per cent to $7. 655 a pound and pork bellies were up 0 [SEP]"}
+{"type": "sample", "index": 28, "raw_text": "[CLS] elections in late august. [SEP] i ' ve known john mccain ever since he ' s working hard but i don ' t know how he could go into it. [SEP] and he ' s going on the list of rock stars like paul mccartney and paul farley. [SEP] i want to know the reason because of putin ' s actions. [SEP] houlder ' s property insurance company. [SEP] \" in the northern city there are over 30, 000 people. [SEP] \" i no longer feel about seeing the soul of the city with its name and heritage. [SEP] news of russia ' s share of the nagorcco pipeline is still to come [SEP]", "detok_text": "[CLS] elections in late august. [SEP] i've known john mccain ever since he's working hard but i don't know how he could go into it. [SEP] and he's going on the list of rock stars like paul mccartney and paul farley. [SEP] i want to know the reason because of putin's actions. [SEP] houlder's property insurance company. [SEP] \"in the northern city there are over 30, 000 people. [SEP]\" i no longer feel about seeing the soul of the city with its name and heritage. [SEP] news of russia's share of the nagorcco pipeline is still to come [SEP]"}
+{"type": "sample", "index": 29, "raw_text": "[CLS] public protest held thursday in protest at advances on social policy in recent months. [SEP] napolitano would not comment on the progress of the investigation, and a thorough investigation would likely continue. [SEP] the big banks, aig and aig also are facing big questions, including whether the government would increase their payouts. [SEP] morey then hit a home run off lopez, who raised his arm to step in. [SEP] he said one other soldier injured in the blast was killed and one of the soldiers wounded in the blast. [SEP] wednesday ' s funeral was scheduled at 9 : 30 p. m. [SEP] but mckiel ' s [SEP]", "detok_text": "[CLS] public protest held thursday in protest at advances on social policy in recent months. [SEP] napolitano would not comment on the progress of the investigation, and a thorough investigation would likely continue. [SEP] the big banks, aig and aig also are facing big questions, including whether the government would increase their payouts. [SEP] morey then hit a home run off lopez, who raised his arm to step in. [SEP] he said one other soldier injured in the blast was killed and one of the soldiers wounded in the blast. [SEP] wednesday's funeral was scheduled at 9: 30 p. m. [SEP] but mckiel's [SEP]"}
+{"type": "sample", "index": 30, "raw_text": "[CLS] has won only five of 11 races - - and won for a second time as tour leader again. [SEP] \" shut it down! \" - \" don ' t know, \" and when i hear the sound at the end of the game, you ' ll say \" why don ' t do it, \" i - - who ' s ahead of you, \" again : \" i don ' t hear the scoffing, \" but i don ' t know i mean about it, with all the shouting going on, and it ' s never doable to get on with. [SEP] two people have been arrested in connection with a [SEP]", "detok_text": "[CLS] has won only five of 11 races - - and won for a second time as tour leader again. [SEP] \"shut it down!\" - \"don't know,\" and when i hear the sound at the end of the game, you'll say \"why don't do it,\" i - - who's ahead of you, \"again:\" i don't hear the scoffing, \" but i don't know i mean about it, with all the shouting going on, and it's never doable to get on with. [SEP] two people have been arrested in connection with a [SEP]"}
+{"type": "sample", "index": 31, "raw_text": "[CLS] i put together. [SEP] mr. obama committed himself to backing israel, pushing for a settlement with his predecessor in 1995, but he said that he had to work harder in the coming months to stop the settlements. [SEP] their parents sell lots of football stuff here... then each day, parents and kids get their kids talking and playing, and ( yes. ) how can you know if they go out of the dressing room with a cough......... sometimes, there ' s a game, that ' s something you don ' t get to know about.......!! [SEP]", "detok_text": "[CLS] i put together. [SEP] mr. obama committed himself to backing israel, pushing for a settlement with his predecessor in 1995, but he said that he had to work harder in the coming months to stop the settlements. [SEP] their parents sell lots of football stuff here... then each day, parents and kids get their kids talking and playing, and (yes.) how can you know if they go out of the dressing room with a cough......... sometimes, there's a game, that's something you don't get to know about.......!! [SEP]"}
+{"type": "sample", "index": 32, "raw_text": "[CLS] government ' s access to media money seems like a political stunt, but there is one more likely explanation. [SEP] and i hear the president ' s voice, someone always tells me how to hear what he says and i know i know some of the things i ' m going to do because they ' re on their way to making history, and everyone else found a way to stop this. [SEP] that is the point that all of us need to know, and i ' m not just being up at night when you are talking about him now - - or he ' s going to sit back in a very long time. [SEP] this story [SEP]", "detok_text": "[CLS] government's access to media money seems like a political stunt, but there is one more likely explanation. [SEP] and i hear the president's voice, someone always tells me how to hear what he says and i know i know some of the things i'm going to do because they're on their way to making history, and everyone else found a way to stop this. [SEP] that is the point that all of us need to know, and i'm not just being up at night when you are talking about him now - - or he's going to sit back in a very long time. [SEP] this story [SEP]"}
+{"type": "sample", "index": 33, "raw_text": "[CLS]. [SEP] but fed officials say he is working to improve the bank ' s position. [SEP] obama said he could not be expected to provide that information, fox news said. [SEP] last year, schaller ' s vice chairman, daniele grenig, along with his campaign to buy the dutch bank hinworths, has built up a surge of private investors seeking to nationalise and fund edf, the german lender specialising in debt management. [SEP] so is the art of music, country music, theatre, comedy and modern music doesn ' t always need art. [SEP] entitlement expects the rate rises to be [SEP]", "detok_text": "[CLS]. [SEP] but fed officials say he is working to improve the bank's position. [SEP] obama said he could not be expected to provide that information, fox news said. [SEP] last year, schaller's vice chairman, daniele grenig, along with his campaign to buy the dutch bank hinworths, has built up a surge of private investors seeking to nationalise and fund edf, the german lender specialising in debt management. [SEP] so is the art of music, country music, theatre, comedy and modern music doesn't always need art. [SEP] entitlement expects the rate rises to be [SEP]"}
+{"type": "sample", "index": 34, "raw_text": "[CLS] were found only one player for the day ' s biggest game. [SEP] \" indiana jones : to the kingdom : indiana jones, \" had a total domestic weekend of $ 35. 2 million, two times the box office studio ' s box office total set in 1997. [SEP] mcestrine : some of the sort of things we hear in the film, but it ' s never easy. [SEP] he said he would no longer buy the station because \" this is a vital part of the history of the game, \" adding the bbc ' s media network was a great way for news across the national football service network. [SEP] over the [SEP]", "detok_text": "[CLS] were found only one player for the day's biggest game. [SEP] \"indiana jones: to the kingdom: indiana jones,\" had a total domestic weekend of $35. 2 million, two times the box office studio's box office total set in 1997. [SEP] mcestrine: some of the sort of things we hear in the film, but it's never easy. [SEP] he said he would no longer buy the station because \"this is a vital part of the history of the game,\" adding the bbc's media network was a great way for news across the national football service network. [SEP] over the [SEP]"}
+{"type": "sample", "index": 35, "raw_text": "[CLS] just like the last eight years of bush, when the former vice president took off and mr mccain sitting next to him ; and the president himself notes that most republican leaders don ' t want to do that. [SEP] but the heart of america ' s life is not about your people, or what you think about the world itself. [SEP] china denies the u. s. wants to enter the black sea region threatened by russia, which has used its territory as cover between iran and oil - rich iran. [SEP] for young kids, it ' s too often. [SEP] http : / / www. gnwp. org / events / [SEP]", "detok_text": "[CLS] just like the last eight years of bush, when the former vice president took off and mr mccain sitting next to him; and the president himself notes that most republican leaders don't want to do that. [SEP] but the heart of america's life is not about your people, or what you think about the world itself. [SEP] china denies the u. s. wants to enter the black sea region threatened by russia, which has used its territory as cover between iran and oil - rich iran. [SEP] for young kids, it's too often. [SEP] http://www. gnwp. org/events/[SEP]"}
+{"type": "sample", "index": 36, "raw_text": "[CLS] officers were hospitalized for tuesday morning ' s incident, and police said three people, ages 37 to 35, were treated for head injuries. [SEP] the kind of energy that characterised his rise as an artist is attributed in part to his triumphal work, astonishing depth and great humanness. [SEP] the americans team moved into a men ' s spot with gold, after a disappointment in the women ' s singles and men ' s singles. [SEP] tom mccon, the former aam bank chairman and chairman, said the group should have tightened its financial controls immediately. [SEP] the violence was the worst militant attack in pakistan in more than 8 a. [SEP]", "detok_text": "[CLS] officers were hospitalized for tuesday morning's incident, and police said three people, ages 37 to 35, were treated for head injuries. [SEP] the kind of energy that characterised his rise as an artist is attributed in part to his triumphal work, astonishing depth and great humanness. [SEP] the americans team moved into a men's spot with gold, after a disappointment in the women's singles and men's singles. [SEP] tom mccon, the former aam bank chairman and chairman, said the group should have tightened its financial controls immediately. [SEP] the violence was the worst militant attack in pakistan in more than 8 a. [SEP]"}
+{"type": "sample", "index": 37, "raw_text": "[CLS] deputy senate foreign council adviser in baghdad and the us un staff secretary. [SEP] public spending was attacked by conservative mp david cameron. [SEP] details of the meeting would be made public in his address to israel news conference, when he said he would toughen up talks with the palestinians but that there was not a timetable for a peace meeting. [SEP] clean coal alone will account for 10 percent of the world ' s greenhouse gas, or only $ 800 billion. [SEP] h. p. m. [SEP] the victory made utah the second no. 1 ranked team in the nation, which ended the first - place tie in the division ' s history. [SEP]", "detok_text": "[CLS] deputy senate foreign council adviser in baghdad and the us un staff secretary. [SEP] public spending was attacked by conservative mp david cameron. [SEP] details of the meeting would be made public in his address to israel news conference, when he said he would toughen up talks with the palestinians but that there was not a timetable for a peace meeting. [SEP] clean coal alone will account for 10 percent of the world's greenhouse gas, or only $800 billion. [SEP] h. p. m. [SEP] the victory made utah the second no. 1 ranked team in the nation, which ended the first - place tie in the division's history. [SEP]"}
+{"type": "sample", "index": 38, "raw_text": "[CLS] of private equity to the british taxpayer, rose by more than a third between 2004 and 2006 - - a 26 - year high of £21. 3 billion. [SEP] the opening play is a young woman, who goes off a job because of a relationship with an education teacher while still getting her very old son and daughter back. [SEP] \" that is when a child comes in and they say to me, ' i make a very good movie, not mine, \" ' he says. [SEP] the plan requires help from the local post office and local councils to account for the total. [SEP] bannexbury, pa., june 9 [SEP]", "detok_text": "[CLS] of private equity to the british taxpayer, rose by more than a third between 2004 and 2006 - - a 26 - year high of £21. 3 billion. [SEP] the opening play is a young woman, who goes off a job because of a relationship with an education teacher while still getting her very old son and daughter back. [SEP] \"that is when a child comes in and they say to me, 'i make a very good movie, not mine,\"' he says. [SEP] the plan requires help from the local post office and local councils to account for the total. [SEP] bannexbury, pa., june 9 [SEP]"}
+{"type": "sample", "index": 39, "raw_text": "[CLS] billion in revenue for the program. [SEP] the men were arrested after the man was walking on a busy road in balaclull minutes after midnight with a friend. [SEP] the red raiders didn ' t get their first road victory in pittsburgh in more than five years. [SEP] \" i love to show people that i can do that right, \" added the $ 25, 000 price, which is about three times the number of previous auctions. [SEP] i had to run a mile myself. [SEP] baltimore ' s john hall scored 1, 438 yards on his first 17 carries - rushing for 29, 779 yards with nine touchdowns and two [SEP]", "detok_text": "[CLS] billion in revenue for the program. [SEP] the men were arrested after the man was walking on a busy road in balaclull minutes after midnight with a friend. [SEP] the red raiders didn't get their first road victory in pittsburgh in more than five years. [SEP] \"i love to show people that i can do that right,\" added the $25, 000 price, which is about three times the number of previous auctions. [SEP] i had to run a mile myself. [SEP] baltimore's john hall scored 1, 438 yards on his first 17 carries - rushing for 29, 779 yards with nine touchdowns and two [SEP]"}
+{"type": "sample", "index": 40, "raw_text": "[CLS] budget proposes to help high earners who qualify under new rules raise the annual cost of living subsidies - - which could jump to just $ 3. 5 billion this year. [SEP] a win would keep a win in five games out of the american league and lead the american league division east. [SEP] u. s. state hillary rodham clinton had planned to attend the conference friday in chicago and early tuesday in washington, on friday at a pentagon building, a department spokesman said. [SEP] the mobile phone company said on wednesday that the company was seeking to pay hafon ' s costs and had severed a legal relationship with the iphone. [SEP] [SEP]", "detok_text": "[CLS] budget proposes to help high earners who qualify under new rules raise the annual cost of living subsidies - - which could jump to just $3. 5 billion this year. [SEP] a win would keep a win in five games out of the american league and lead the american league division east. [SEP] u. s. state hillary rodham clinton had planned to attend the conference friday in chicago and early tuesday in washington, on friday at a pentagon building, a department spokesman said. [SEP] the mobile phone company said on wednesday that the company was seeking to pay hafon's costs and had severed a legal relationship with the iphone. [SEP] [SEP]"}
+{"type": "sample", "index": 41, "raw_text": "[CLS] to make california a national leader for public transportation. [SEP] if those men have far less of it to drink and less likely to spend with children, many would be more comfortable with their work environment. [SEP] for even though the two hospitals have a track record of caring for patients and their own, this tragedy only drew attention to the process of turning the area into a form of life - support. [SEP] \" my spokesperson said some of the best players in the game and the team have been contacted by ministry of social and social services ( sacd ). [SEP] the city government says it has asked the government to work with the city council to [SEP]", "detok_text": "[CLS] to make california a national leader for public transportation. [SEP] if those men have far less of it to drink and less likely to spend with children, many would be more comfortable with their work environment. [SEP] for even though the two hospitals have a track record of caring for patients and their own, this tragedy only drew attention to the process of turning the area into a form of life - support. [SEP] \" my spokesperson said some of the best players in the game and the team have been contacted by ministry of social and social services (sacd). [SEP] the city government says it has asked the government to work with the city council to [SEP]"}
+{"type": "sample", "index": 42, "raw_text": "[CLS] the number of months. [SEP] gibbs said one of his top advisers would work directly with the incoming clinton administration. [SEP] she said the prime minister ' s economic team would also meet to discuss international strategy, and that obama was not sure the united states senator wants to be the top candidate. [SEP] the battle of caper, you know, is also on the new scale. [SEP] the european commission extended iran ' s participation in its european military program to three countries from the organization ' s annual list of military, economic and diplomatic security co - operation, which russia best casts the eu as a symbol of european allies ' cooperation. [SEP] \" [SEP]", "detok_text": "[CLS] the number of months. [SEP] gibbs said one of his top advisers would work directly with the incoming clinton administration. [SEP] she said the prime minister's economic team would also meet to discuss international strategy, and that obama was not sure the united states senator wants to be the top candidate. [SEP] the battle of caper, you know, is also on the new scale. [SEP] the european commission extended iran's participation in its european military program to three countries from the organization's annual list of military, economic and diplomatic security co - operation, which russia best casts the eu as a symbol of european allies' cooperation. [SEP] \" [SEP]"}
+{"type": "sample", "index": 43, "raw_text": "[CLS] major players, \" said coaches danny johnson and sedrick johnson. [SEP] that ' s the last word you have in this state - - but crucially, they ' ll get in their pocket and will never get you back more. [SEP] peter langer, an engineer of the minnesota - hudson road bridge, fell into new york after the accident. [SEP] \" we ' re going to like to see him play with him in part because there are some other things that come from the time. [SEP] however, haye has said that she is happy to talk to those journalists. [SEP] there ' s still water here. [SEP] hillary clinton ' [SEP]", "detok_text": "[CLS] major players, \"said coaches danny johnson and sedrick johnson. [SEP] that's the last word you have in this state - - but crucially, they'll get in their pocket and will never get you back more. [SEP] peter langer, an engineer of the minnesota - hudson road bridge, fell into new york after the accident. [SEP]\" we're going to like to see him play with him in part because there are some other things that come from the time. [SEP] however, haye has said that she is happy to talk to those journalists. [SEP] there's still water here. [SEP] hillary clinton ' [SEP]"}
+{"type": "sample", "index": 44, "raw_text": "[CLS] series of washington - based, asia - related policy - making sessions at the shanghai policy review last month. [SEP] interest income of $ 1, 600 and the net income of $ 0. 78, 000 for three years to june 30 of last year, including interest income of $ 2. 7 million per year. [SEP] i ' m sure. [SEP] gm ' s shares were up 1. 5 per cent to 46. 25 a share and were trading slightly at $ 16. 25 per share, after hitting a trading low of 46. 8 cents in october. [SEP] the fight happened at birkenhu sea industrial park in north - [SEP]", "detok_text": "[CLS] series of washington - based, asia - related policy - making sessions at the shanghai policy review last month. [SEP] interest income of $1, 600 and the net income of $0. 78, 000 for three years to june 30 of last year, including interest income of $2. 7 million per year. [SEP] i'm sure. [SEP] gm's shares were up 1. 5 per cent to 46. 25 a share and were trading slightly at $16. 25 per share, after hitting a trading low of 46. 8 cents in october. [SEP] the fight happened at birkenhu sea industrial park in north - [SEP]"}
+{"type": "sample", "index": 45, "raw_text": "[CLS] a tow truck passes through the ground as it is connected to a track. [SEP] campaigners said the money for the projects would reduce spending to up to 10 % of the county ' s badly - needed construction funds and add value to the site, which it has built at a cost of £40m to build. [SEP] some people don ' t. [SEP] it ' s hard to understand, regardless of why he and a 17 - year - old son, mark lula, attended high school, their parents dropped their education in denver. [SEP] as the new u. s. commander in the country may be sure to see the outcome [SEP]", "detok_text": "[CLS] a tow truck passes through the ground as it is connected to a track. [SEP] campaigners said the money for the projects would reduce spending to up to 10 % of the county's badly - needed construction funds and add value to the site, which it has built at a cost of £40m to build. [SEP] some people don't. [SEP] it's hard to understand, regardless of why he and a 17 - year - old son, mark lula, attended high school, their parents dropped their education in denver. [SEP] as the new u. s. commander in the country may be sure to see the outcome [SEP]"}
+{"type": "sample", "index": 46, "raw_text": "[CLS] alliance information management systems, inc. [SEP] and it still won ' t matter for me to have a health plan until it ' s april 18. [SEP] but it is mccain who could advance mccain ' s image of a democrat as a competent leader. [SEP] 2, 2007, at 1059 f. st. louis and 500 main street in new orleans. [SEP] and with democrats critical of mr. mccain on tuesday mr. obama and his aides pulled out a speech at a joint convention here, again publicly criticizing the event. [SEP] washington ( ap ) - white house chief of staff chief john lewis will plan to nominate barack obama as secretary [SEP]", "detok_text": "[CLS] alliance information management systems, inc. [SEP] and it still won't matter for me to have a health plan until it's april 18. [SEP] but it is mccain who could advance mccain's image of a democrat as a competent leader. [SEP] 2, 2007, at 1059 f. st. louis and 500 main street in new orleans. [SEP] and with democrats critical of mr. mccain on tuesday mr. obama and his aides pulled out a speech at a joint convention here, again publicly criticizing the event. [SEP] washington (ap) - white house chief of staff chief john lewis will plan to nominate barack obama as secretary [SEP]"}
+{"type": "sample", "index": 47, "raw_text": "[CLS]urinho and scolari and deco played together from the ballack. [SEP] the telegraph reported monday that the treasury has spent an extra $ 20 million on legal aid, and the treasury is saying it will spend $ 40 million in response, theshewaig. com said. [SEP] his strategy is focused on eastern europe, which would lead to an effort to maintain a link with conservative japan, where unemployment is now stuck at about 20 %. [SEP] the world series is expected to start next month. [SEP] moscow moscow ( reuters ) - security officers have arrested 13 people in a moscow hotel along with 20 people believed to have [SEP]", "detok_text": "[CLS]urinho and scolari and deco played together from the ballack. [SEP] the telegraph reported monday that the treasury has spent an extra $20 million on legal aid, and the treasury is saying it will spend $40 million in response, theshewaig. com said. [SEP] his strategy is focused on eastern europe, which would lead to an effort to maintain a link with conservative japan, where unemployment is now stuck at about 20 %. [SEP] the world series is expected to start next month. [SEP] moscow moscow (reuters) - security officers have arrested 13 people in a moscow hotel along with 20 people believed to have [SEP]"}
+{"type": "sample", "index": 48, "raw_text": "[CLS] the director in 2006, officials said, xinhua said. [SEP] according to the office national statistics office, consumer spending in the 5. 3 million people - half of the population - - continues to rise. [SEP] tens of thousands of workers and companies in the energy, banking, insurance and insurance industry now number more than 12. 2 percent of the domestic gross domestic product. [SEP] she heard that sandra ' s parents had a family family in mexico and realized that this was a family living in guatemala as she moved back from the home and she went to new mexico after the jan. [SEP] the baby ' s parents and wife described how [SEP]", "detok_text": "[CLS] the director in 2006, officials said, xinhua said. [SEP] according to the office national statistics office, consumer spending in the 5. 3 million people - half of the population - - continues to rise. [SEP] tens of thousands of workers and companies in the energy, banking, insurance and insurance industry now number more than 12. 2 percent of the domestic gross domestic product. [SEP] she heard that sandra's parents had a family family in mexico and realized that this was a family living in guatemala as she moved back from the home and she went to new mexico after the jan. [SEP] the baby's parents and wife described how [SEP]"}
+{"type": "sample", "index": 49, "raw_text": "[CLS] boost the state ' s growing competitiveness. [SEP] \" i think i ' m going to much of the rest of 2008, \" said ebbert, \" i ' m not aware of exactly what i ' ve done. \" [SEP] the governor ' s statement appeared in contrast with both mr. mccain ' s and his criticism for his own attacks on palin. [SEP] after making a call with larry baca jr., he ' ll be asked if he ' s happy about obama ' s endorsement, and on one point, obama campaign officials said he ' s happy about mccain. [SEP] but there ' s time for someone to [SEP]", "detok_text": "[CLS] boost the state's growing competitiveness. [SEP] \"i think i'm going to much of the rest of 2008,\" said ebbert, \"i'm not aware of exactly what i've done.\" [SEP] the governor's statement appeared in contrast with both mr. mccain's and his criticism for his own attacks on palin. [SEP] after making a call with larry baca jr., he'll be asked if he's happy about obama's endorsement, and on one point, obama campaign officials said he's happy about mccain. [SEP] but there's time for someone to [SEP]"}
+{"type": "sample", "index": 50, "raw_text": "[CLS] \" he said yes, was going to buy a ticket and said, \" it ' s crazy, please just tell me where i ' m. \" [SEP] because there is the right kind of technology about it. [SEP] clinton acknowledged his criticism for having been drawn in the speech, though he did not agree with the characterization. [SEP] the only way to go with the obama administration. [SEP] we were given every chance to get the attention, to make our decisions on hard work. [SEP] china ' s civil - engineering exports have increased over the years. [SEP] john coughlin, the executive director of the washington international consumer law group, which runs [SEP]", "detok_text": "[CLS] \"he said yes, was going to buy a ticket and said,\" it's crazy, please just tell me where i'm. \" [SEP] because there is the right kind of technology about it. [SEP] clinton acknowledged his criticism for having been drawn in the speech, though he did not agree with the characterization. [SEP] the only way to go with the obama administration. [SEP] we were given every chance to get the attention, to make our decisions on hard work. [SEP] china's civil - engineering exports have increased over the years. [SEP] john coughlin, the executive director of the washington international consumer law group, which runs [SEP]"}
+{"type": "sample", "index": 51, "raw_text": "[CLS] the city centre. [SEP] alitalia said this week that it would come up with a full deal in the next three weeks and wanted to speed up talks for a deal to run the same company as the world ' s biggest commercial airline. [SEP] for the last five years, peterson ' s focus has turned to focus on his family. [SEP] he was unable to get into the details of his case by saying how to fix the system. [SEP] it ' s been kind of a game plan for many members of congress, especially on the left. [SEP] mark the head of huck finning, a group of gay and lesbian legal lawyers [SEP]", "detok_text": "[CLS] the city centre. [SEP] alitalia said this week that it would come up with a full deal in the next three weeks and wanted to speed up talks for a deal to run the same company as the world's biggest commercial airline. [SEP] for the last five years, peterson's focus has turned to focus on his family. [SEP] he was unable to get into the details of his case by saying how to fix the system. [SEP] it's been kind of a game plan for many members of congress, especially on the left. [SEP] mark the head of huck finning, a group of gay and lesbian legal lawyers [SEP]"}
+{"type": "sample", "index": 52, "raw_text": "[CLS] british history. [SEP] \" i think this is negotiation, not negotiation and there is no way for us to want to stay, \" sandler said, a diplomatic source said. [SEP] nevertheless, mr. hosni has proved his authority and values, placing integrity at the top of his game. [SEP] the leader also told a meeting of us military ministers, including japan and south korea that north korea says he has received international reports of the state of the north ' s affairs and that his country does not expect an invasion of north korea. [SEP] the most recent project, an apartment building in the shadow of twm square, opened [SEP]", "detok_text": "[CLS] british history. [SEP] \"i think this is negotiation, not negotiation and there is no way for us to want to stay,\" sandler said, a diplomatic source said. [SEP] nevertheless, mr. hosni has proved his authority and values, placing integrity at the top of his game. [SEP] the leader also told a meeting of us military ministers, including japan and south korea that north korea says he has received international reports of the state of the north's affairs and that his country does not expect an invasion of north korea. [SEP] the most recent project, an apartment building in the shadow of twm square, opened [SEP]"}
+{"type": "sample", "index": 53, "raw_text": "[CLS] council announced the debate on the wmd programme. [SEP] \" the book was about japanese america, and the family moved to the us in the early part of japan, and they would learn about it from the white house, \" he said. [SEP] johnny damon started the first inning by throwing against the right - hander mike pavano in the top to score the next two runs. [SEP] mr williams became the chair of the plathon borough council almost two years ago. [SEP] the committee also believes that the development of environmental laws has produced unfeasiered levels of a fair deal in the areas of both the economic and social [SEP]", "detok_text": "[CLS] council announced the debate on the wmd programme. [SEP] \"the book was about japanese america, and the family moved to the us in the early part of japan, and they would learn about it from the white house,\" he said. [SEP] johnny damon started the first inning by throwing against the right - hander mike pavano in the top to score the next two runs. [SEP] mr williams became the chair of the plathon borough council almost two years ago. [SEP] the committee also believes that the development of environmental laws has produced unfeasiered levels of a fair deal in the areas of both the economic and social [SEP]"}
+{"type": "sample", "index": 54, "raw_text": "[CLS] according to compulsefit, a global internet tracking firm. [SEP] he told bbc news : \" it is quite hard, it just makes you feel safer. [SEP] sen. bill hagan, a democratic democrat in the house judiciary committee, said he understood president correa ' s comments and that he supports lifting the legislation. [SEP] est at 2000 gmt and 10 : 00 p. m. [SEP] barack obama has been meeting with his former white house rival in an attempt to call on voters to disagree with his economic policies. [SEP] it ' s hard to say whether it ' s such a betrayal of the irish people and [SEP]", "detok_text": "[CLS] according to compulsefit, a global internet tracking firm. [SEP] he told bbc news: \" it is quite hard, it just makes you feel safer. [SEP] sen. bill hagan, a democratic democrat in the house judiciary committee, said he understood president correa's comments and that he supports lifting the legislation. [SEP] est at 2000 gmt and 10: 00 p. m. [SEP] barack obama has been meeting with his former white house rival in an attempt to call on voters to disagree with his economic policies. [SEP] it's hard to say whether it's such a betrayal of the irish people and [SEP]"}
+{"type": "sample", "index": 55, "raw_text": "[CLS]exolus. com has estimated that all tickets sold on top of ticket price will be worth $ 100 million this season - - about $ 100 million less than the same price. [SEP] heating oil sweet gasoline for november delivery rose 0. 2 cents to $ 3. 7038 per gallon. [SEP] roger williams, head of the council of the football association ' s independent referees committee, criticised his actions last week. [SEP] the insurer, the country ' s largest insurers, went to court in 2005 for failing to disclose $ 9bn ( £5bn ) of credit losses on july 14 2008. [SEP] the time came in the [SEP]", "detok_text": "[CLS]exolus. com has estimated that all tickets sold on top of ticket price will be worth $100 million this season - - about $100 million less than the same price. [SEP] heating oil sweet gasoline for november delivery rose 0. 2 cents to $3. 7038 per gallon. [SEP] roger williams, head of the council of the football association's independent referees committee, criticised his actions last week. [SEP] the insurer, the country's largest insurers, went to court in 2005 for failing to disclose $9bn (£5bn) of credit losses on july 14 2008. [SEP] the time came in the [SEP]"}
+{"type": "sample", "index": 56, "raw_text": "[CLS] signed a bill friday in the u. s. senate to finish its call for a healthcare overhaul. [SEP] aig ' s investment includes bond assets worth about $ 4m and subperforming structured finance assets totalling around $ 100 million and has offices in 15 countries. [SEP] the current two - bath property offers children ages 12 - 12 and older, with a $ 2, 600 - square - foot ( $ 1, 100 ), plus $ 900 a bed, including a four bathroom garage. [SEP] one of them, dr. michael hurdrep, said that he was considering the police report. [SEP] \" yes, [SEP]", "detok_text": "[CLS] signed a bill friday in the u. s. senate to finish its call for a healthcare overhaul. [SEP] aig's investment includes bond assets worth about $4m and subperforming structured finance assets totalling around $100 million and has offices in 15 countries. [SEP] the current two - bath property offers children ages 12 - 12 and older, with a $2, 600 - square - foot ($1, 100), plus $900 a bed, including a four bathroom garage. [SEP] one of them, dr. michael hurdrep, said that he was considering the police report. [SEP] \" yes, [SEP]"}
+{"type": "sample", "index": 57, "raw_text": "[CLS]. [SEP] another second, sadis, was brought up in the uk. [SEP] fox news ' s staff writer, carrie ann schaumburg, contributed to this report. [SEP] perry said the world championship, held in san diego, would result in a $ 45 million for the national golf club, which is four times the decade - ago figure. [SEP] he watched a 3 - d film a year earlier. [SEP] fbi national medical director jim ardeau says he was a teen when he was working at a training ground in georgia. [SEP] she also said she doesn ' t oppose the important issues such as affordable health care or a [SEP]", "detok_text": "[CLS]. [SEP] another second, sadis, was brought up in the uk. [SEP] fox news's staff writer, carrie ann schaumburg, contributed to this report. [SEP] perry said the world championship, held in san diego, would result in a $45 million for the national golf club, which is four times the decade - ago figure. [SEP] he watched a 3 - d film a year earlier. [SEP] fbi national medical director jim ardeau says he was a teen when he was working at a training ground in georgia. [SEP] she also said she doesn't oppose the important issues such as affordable health care or a [SEP]"}
+{"type": "sample", "index": 58, "raw_text": "[CLS] it on the web. [SEP] instead, we are right. [SEP] \" so i just lost a little bit and it isn ' t really playing football, \" he said. [SEP] make no point in worrying about this. [SEP] in the last seven years as bush ' s deputy press secretary, george h. w. bush, was head of administration for national asia, the first bush administration official working as policy director to bring a fuller, more active, more collaborative relationship with the president to the bureau of national security and policy building. [SEP] the area was the scene of a u. s. army raid killing six soldiers and two civilians, [SEP]", "detok_text": "[CLS] it on the web. [SEP] instead, we are right. [SEP] \"so i just lost a little bit and it isn't really playing football,\" he said. [SEP] make no point in worrying about this. [SEP] in the last seven years as bush's deputy press secretary, george h. w. bush, was head of administration for national asia, the first bush administration official working as policy director to bring a fuller, more active, more collaborative relationship with the president to the bureau of national security and policy building. [SEP] the area was the scene of a u. s. army raid killing six soldiers and two civilians, [SEP]"}
+{"type": "sample", "index": 59, "raw_text": "[CLS] those who died in the fighting. [SEP] he will spend time there wednesday, but also will work this week, she added. [SEP] despite a few small concessions, the eu and the government continued to sit in hand as talks began to emerge. [SEP] what the government wants, you can. [SEP] \" i don ' t think we don ' t - - we don ' t have what to do next, \" he said. [SEP] the trust ' s appeal was launched after the resignation of the acting chairman, anthony lees, following thursday ' s alleged break - in incident and has since since been suspended. [SEP] to come clean, this [SEP]", "detok_text": "[CLS] those who died in the fighting. [SEP] he will spend time there wednesday, but also will work this week, she added. [SEP] despite a few small concessions, the eu and the government continued to sit in hand as talks began to emerge. [SEP] what the government wants, you can. [SEP] \"i don't think we don't - - we don't have what to do next,\" he said. [SEP] the trust's appeal was launched after the resignation of the acting chairman, anthony lees, following thursday's alleged break - in incident and has since since been suspended. [SEP] to come clean, this [SEP]"}
+{"type": "sample", "index": 60, "raw_text": "[CLS] clear that the campaign is still not going wrong over its course, despite claims that mrs. clinton is writing to mr. obama to back them up. [SEP] weisberger, 27, said his struggles with arthritis and loss of appetite have helped him keep his weight out of control but insists the injury that kept him out is still at the worst. [SEP] if the president is not expected to make the announcement in an economic statement, he is likely to make the tax announcement at a press conference, announcing on wednesday that he had planned to take it down later this week. [SEP] george osborne, the shadow shadow secretary, has declined to allow [SEP]", "detok_text": "[CLS] clear that the campaign is still not going wrong over its course, despite claims that mrs. clinton is writing to mr. obama to back them up. [SEP] weisberger, 27, said his struggles with arthritis and loss of appetite have helped him keep his weight out of control but insists the injury that kept him out is still at the worst. [SEP] if the president is not expected to make the announcement in an economic statement, he is likely to make the tax announcement at a press conference, announcing on wednesday that he had planned to take it down later this week. [SEP] george osborne, the shadow shadow secretary, has declined to allow [SEP]"}
+{"type": "sample", "index": 61, "raw_text": "[CLS] implications for the city ' s local people. [SEP] it ' s not cheap. [SEP] obama, who is considering plans for a drop in troop numbers, announced significant cuts in afghanistan and afghanistan, iraq and afghanistan, as well as an overhaul of britain ' s security services. [SEP] the answer would be there. [SEP] the reason : it ' s an open record. [SEP] bg said it also signed a contract to spend $ 35 million for a new apartment complex on the same building, building into one of iraq ' s tallest towers. [SEP] the state of spain said the issue was open to debate. [SEP] the cause of that attack, [SEP]", "detok_text": "[CLS] implications for the city's local people. [SEP] it's not cheap. [SEP] obama, who is considering plans for a drop in troop numbers, announced significant cuts in afghanistan and afghanistan, iraq and afghanistan, as well as an overhaul of britain's security services. [SEP] the answer would be there. [SEP] the reason: it's an open record. [SEP] bg said it also signed a contract to spend $35 million for a new apartment complex on the same building, building into one of iraq's tallest towers. [SEP] the state of spain said the issue was open to debate. [SEP] the cause of that attack, [SEP]"}
+{"type": "sample", "index": 62, "raw_text": "[CLS]nd said, adding that britain ' s foreign minister, david cameron, was trying to secure a deal with the british government. [SEP] \" it looked like my family didn ' t think it was moving, \" he said. [SEP] the ad is one of the centerpiece of obama ' s campaign against the mccain campaign, which calls him into all areas of the country where he is stumping. [SEP] the mccanns were sympathetic to mr fayed ' s statement and said it appeared it was a personal cover - up. [SEP] they were arrested in the early hours saturday. [SEP] but experts said it is not easy to know what causes the [SEP]", "detok_text": "[CLS]nd said, adding that britain's foreign minister, david cameron, was trying to secure a deal with the british government. [SEP] \"it looked like my family didn't think it was moving,\" he said. [SEP] the ad is one of the centerpiece of obama's campaign against the mccain campaign, which calls him into all areas of the country where he is stumping. [SEP] the mccanns were sympathetic to mr fayed's statement and said it appeared it was a personal cover - up. [SEP] they were arrested in the early hours saturday. [SEP] but experts said it is not easy to know what causes the [SEP]"}
+{"type": "sample", "index": 63, "raw_text": "[CLS] election day. [SEP] a man more than 300 km ( 300 miles ) fell to the top of the wyba river fell more than 100km ( 50p ). [SEP] the guard said he was not missing. [SEP] china is not the source of much in africa. [SEP] uk pension funds ( www. pensions. com ), including managers and brokers, had £ £12bn in the year to the end of the year and saw £17bn of under redemptions in britain ' s banks over the past three years. [SEP] the popular 45 - year - old died at the palace of paris, france, suffering from the [SEP]", "detok_text": "[CLS] election day. [SEP] a man more than 300 km (300 miles) fell to the top of the wyba river fell more than 100km (50p). [SEP] the guard said he was not missing. [SEP] china is not the source of much in africa. [SEP] uk pension funds (www. pensions. com), including managers and brokers, had ££12bn in the year to the end of the year and saw £17bn of under redemptions in britain's banks over the past three years. [SEP] the popular 45 - year - old died at the palace of paris, france, suffering from the [SEP]"}

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_diffusion_noise_steps_128steps_n64/base_temp2to08_c256_scored.jsonl

@@ -0,0 +1,65 @@
+{"type": "summary", "name": "base_temp2to08_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "base_temp2to08_c256", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.0, "eta_schedule": "none", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.86767440351385, "nll_per_token": 3.868440420722603, "tokens": 9586}, "diversity": {"sample_entropy": 4.196306894865523, "unique_tokens": 1925, "token_count": 8192, "distinct_1": 0.2349853515625, "distinct_2": 0.718380905511811, "top_token_mass": 0.0533447265625}}
+{"type": "sample", "index": 0, "raw_text": "[CLS] democrats might use the vote to get their message out on healthcare. [SEP] \" no one wants to win over bill clinton ' s vice president ' s failure to close us ties with russia by thumbing its hands deep at the cold war and promoting a resolution meant to decide the course of the conflict. [SEP] \" i am still on the team, \" he said of culpepper, who had gained just 2. 5 yards at the time he came down on the 6 - 6 long line. [SEP] 14 ( upi ) - - the chinese government proposed friday lifting a ban on u. s. workers carrying foreign goods to new [SEP]", "detok_text": "[CLS] democrats might use the vote to get their message out on healthcare. [SEP] \"no one wants to win over bill clinton's vice president's failure to close us ties with russia by thumbing its hands deep at the cold war and promoting a resolution meant to decide the course of the conflict. [SEP]\" i am still on the team, \" he said of culpepper, who had gained just 2. 5 yards at the time he came down on the 6 - 6 long line. [SEP] 14 (upi) - - the chinese government proposed friday lifting a ban on u. s. workers carrying foreign goods to new [SEP]"}
+{"type": "sample", "index": 1, "raw_text": "[CLS] says bg is expected to make $ 40 billion to $ 40 billion in savings in the long term. [SEP] girardi managed to come into the game in the ninth. [SEP] they continue the trend, we would add. [SEP] however, he has also said that the government was uncomfortable with buying the aid. [SEP] even as leaders of iceland, denmark and france both were on the hook for a meeting that even many saw in the bail - out as an american attempt to buy international banks, said that that was a political option. [SEP] he said china would discuss the situation again in beijing later this month, and would continue at a [SEP]", "detok_text": "[CLS] says bg is expected to make $40 billion to $40 billion in savings in the long term. [SEP] girardi managed to come into the game in the ninth. [SEP] they continue the trend, we would add. [SEP] however, he has also said that the government was uncomfortable with buying the aid. [SEP] even as leaders of iceland, denmark and france both were on the hook for a meeting that even many saw in the bail - out as an american attempt to buy international banks, said that that was a political option. [SEP] he said china would discuss the situation again in beijing later this month, and would continue at a [SEP]"}
+{"type": "sample", "index": 2, "raw_text": "[CLS], the chief executive, said on monday that gm is \" thrilled \" to chrysler ' s proposal that u. s. officials now agree for a guarantee of 25 billion for fuel - efficient vehicles offered to manufacturers and up to $ 18 billion in federal car loan guarantees. [SEP] many members of the kim family ' s golf club included kim, 66, his wife kim and his son and wife journalists at his headquarters. [SEP] and then, mr. bush, you cannot tell what it is. [SEP] \" and he ' s got a lot more work left, \" said ron sagen of pouchen university, a philadelphia political scientist who [SEP]", "detok_text": "[CLS], the chief executive, said on monday that gm is \"thrilled\" to chrysler's proposal that u. s. officials now agree for a guarantee of 25 billion for fuel - efficient vehicles offered to manufacturers and up to $18 billion in federal car loan guarantees. [SEP] many members of the kim family's golf club included kim, 66, his wife kim and his son and wife journalists at his headquarters. [SEP] and then, mr. bush, you cannot tell what it is. [SEP] \"and he's got a lot more work left,\" said ron sagen of pouchen university, a philadelphia political scientist who [SEP]"}
+{"type": "sample", "index": 3, "raw_text": "[CLS] post office and access to the internet to teach them about laying off their workers. [SEP] the company has limited capacity by running down overdrafts, holds debt on its books and sells state - of - the - art air transport equipment. [SEP] southern sudan ' s government is the most important force in the north and sudan ' s central regions. [SEP] he was too polite for me to ask me about the husband i had, and i don ' t tell if some people asked why they ' d been separated. [SEP] after arriving at the show, mr. biden said the administration is never going to open the mothertude policy [SEP]", "detok_text": "[CLS] post office and access to the internet to teach them about laying off their workers. [SEP] the company has limited capacity by running down overdrafts, holds debt on its books and sells state - of - the - art air transport equipment. [SEP] southern sudan's government is the most important force in the north and sudan's central regions. [SEP] he was too polite for me to ask me about the husband i had, and i don't tell if some people asked why they'd been separated. [SEP] after arriving at the show, mr. biden said the administration is never going to open the mothertude policy [SEP]"}
+{"type": "sample", "index": 4, "raw_text": "[CLS] death. [SEP] israeli police monday arrested five suspects for surrendering to the u. s. state department ' s office during a raid in the southern city of hebron. [SEP] bachreat, whose sister is a professor of internationalism at stanford, was arrested in september. [SEP] the chinese government estimates the figures, based on official figures released in june, personal spending rose by 4 per cent, the first drop since april - march 2007. [SEP] \" a continued deterioration in the german economy, particularly in the early 1990s and early 1990s, we expect to see positive construction sector and non - construction jobs later this year, \" said michael [SEP]", "detok_text": "[CLS] death. [SEP] israeli police monday arrested five suspects for surrendering to the u. s. state department's office during a raid in the southern city of hebron. [SEP] bachreat, whose sister is a professor of internationalism at stanford, was arrested in september. [SEP] the chinese government estimates the figures, based on official figures released in june, personal spending rose by 4 per cent, the first drop since april - march 2007. [SEP] \"a continued deterioration in the german economy, particularly in the early 1990s and early 1990s, we expect to see positive construction sector and non - construction jobs later this year,\" said michael [SEP]"}
+{"type": "sample", "index": 5, "raw_text": "[CLS] children ' s work at the university of michigan school of education and john middleton of sheffield ' s business school, and john lett, a professor of finance at the university of england, said \" the current financial crisis has a very real effect on the housing sector. [SEP] the former senator, billed as the most successful human rights champion of his generation, reveals the deep and profound public doubts over the nation ' s leadership. [SEP] the protests continued sunday. [SEP] prime minister gordon brown has decided against running a line with labour over his expenses performance in the general election campaign because of mr brown ' s decision to \" speed up \" a decision [SEP]", "detok_text": "[CLS] children's work at the university of michigan school of education and john middleton of sheffield's business school, and john lett, a professor of finance at the university of england, said \"the current financial crisis has a very real effect on the housing sector. [SEP] the former senator, billed as the most successful human rights champion of his generation, reveals the deep and profound public doubts over the nation's leadership. [SEP] the protests continued sunday. [SEP] prime minister gordon brown has decided against running a line with labour over his expenses performance in the general election campaign because of mr brown's decision to\" speed up \" a decision [SEP]"}
+{"type": "sample", "index": 6, "raw_text": "[CLS]. a.... as the required student finance knowledge, external finance and related.... [SEP] in major international embarrassment, the u. s. officials, including barack and hillary clinton, left the u. s. department and state department to meet and china ' s top trade diplomat asked clinton monday to travel to japan and korea to restart the u. s. - china relations process this month. [SEP] i said, ' you don ' t have a good car here, i ' ll win the derby. ' [SEP] still, this is a great opportunity to strengthen pakistan ( see below this latest news release ). [SEP] [SEP]", "detok_text": "[CLS]. a.... as the required student finance knowledge, external finance and related.... [SEP] in major international embarrassment, the u. s. officials, including barack and hillary clinton, left the u. s. department and state department to meet and china's top trade diplomat asked clinton monday to travel to japan and korea to restart the u. s. - china relations process this month. [SEP] i said, ' you don't have a good car here, i'll win the derby. ' [SEP] still, this is a great opportunity to strengthen pakistan (see below this latest news release). [SEP] [SEP]"}
+{"type": "sample", "index": 7, "raw_text": "[CLS] larry sanders, who catches for 300 yards and has only 38 yards to settle at $ 100, 000. [SEP] mr brown said that with public debt now worth around 10 per cent, compared with less than five per cent of britain ' s annual income, it ' s understood that gordon brown is not keen to expand. [SEP] twenty one senior afghan army officer who is in the country ' s nato task force was killed in a roadside bomb saturday, officials said. [SEP] i can ' t wait to see that everyone ' s idea was too strobenous to be hit on the head. [SEP] the 32 - year - old actor has [SEP]", "detok_text": "[CLS] larry sanders, who catches for 300 yards and has only 38 yards to settle at $100, 000. [SEP] mr brown said that with public debt now worth around 10 per cent, compared with less than five per cent of britain's annual income, it's understood that gordon brown is not keen to expand. [SEP] twenty one senior afghan army officer who is in the country's nato task force was killed in a roadside bomb saturday, officials said. [SEP] i can't wait to see that everyone's idea was too strobenous to be hit on the head. [SEP] the 32 - year - old actor has [SEP]"}
+{"type": "sample", "index": 8, "raw_text": "[CLS] he was not free to work. [SEP] mr jackson was in critical condition in the same condition in hospital as the 19 - year - old who was taken with her mother to a hospital for observation. [SEP] some of the money will have to be put into mr. mccain ' s spending proposals. [SEP] bernard hopkins has launched his bid to convene his ninth test for the welsh national title, calling on ex - welshman joe calzaghe to say he was keeping the fight under the ground. [SEP] paul carter, head of new south wales police, and fdr kevin strickland, head of the unit, said it [SEP]", "detok_text": "[CLS] he was not free to work. [SEP] mr jackson was in critical condition in the same condition in hospital as the 19 - year - old who was taken with her mother to a hospital for observation. [SEP] some of the money will have to be put into mr. mccain's spending proposals. [SEP] bernard hopkins has launched his bid to convene his ninth test for the welsh national title, calling on ex - welshman joe calzaghe to say he was keeping the fight under the ground. [SEP] paul carter, head of new south wales police, and fdr kevin strickland, head of the unit, said it [SEP]"}
+{"type": "sample", "index": 9, "raw_text": "[CLS]. [SEP] police said a minor road incident was caused by a three - vehicle crash on the a487 near boingdon on monday afternoon. [SEP] can we live in the united states, the late john m. mcdermott asked. [SEP] it would not disclose the information, it said. [SEP] it ' s the most successful part of the tour. [SEP] however, the cib study shows that that in the uk, the s & p reckons uk manufacturing output will likely to fall to below 4 per cent this year - - an annual rate of 1 per cent and 1. 7 per cent below in the entire fourth quarter 2007 [SEP]", "detok_text": "[CLS]. [SEP] police said a minor road incident was caused by a three - vehicle crash on the a487 near boingdon on monday afternoon. [SEP] can we live in the united states, the late john m. mcdermott asked. [SEP] it would not disclose the information, it said. [SEP] it's the most successful part of the tour. [SEP] however, the cib study shows that that in the uk, the s & p reckons uk manufacturing output will likely to fall to below 4 per cent this year - - an annual rate of 1 per cent and 1. 7 per cent below in the entire fourth quarter 2007 [SEP]"}
+{"type": "sample", "index": 10, "raw_text": "[CLS] roster of 14 players will take no action on thursday after the meeting of the american league baseball baseball division let the league proceed with its own announcement on friday night. [SEP] to get to high level, international and high level, then this is already such a burden on the international community. [SEP] one - in - five wage earners will be involved within the first two hours a week and save up to £1, 000 in costs a year. [SEP] roger thomson, director of digital britain international, said : \" the global digital document \" is just a big deal that represents significant change in the national security and quality of digital britain, \" the [SEP]", "detok_text": "[CLS] roster of 14 players will take no action on thursday after the meeting of the american league baseball baseball division let the league proceed with its own announcement on friday night. [SEP] to get to high level, international and high level, then this is already such a burden on the international community. [SEP] one - in - five wage earners will be involved within the first two hours a week and save up to £1, 000 in costs a year. [SEP] roger thomson, director of digital britain international, said: \"the global digital document\" is just a big deal that represents significant change in the national security and quality of digital britain, \" the [SEP]"}
+{"type": "sample", "index": 11, "raw_text": "[CLS] washington is keeping them from the so - called blacklist. [SEP] researchers are increasingly asking people who have the rare driving experience to improve self - awareness in general situations, especially those of 20 or older. [SEP] and i would say that barack obama is expected to announce this weekend that he is the president on the issue that will stick with who the country wants it. [SEP] you ' ll also find that someone like the teacher or the coach or his lack of personal life, or even someone who goes to the club to recount. [SEP] when do people go into that region, at 100 - 11, 000 in the real price, they [SEP]", "detok_text": "[CLS] washington is keeping them from the so - called blacklist. [SEP] researchers are increasingly asking people who have the rare driving experience to improve self - awareness in general situations, especially those of 20 or older. [SEP] and i would say that barack obama is expected to announce this weekend that he is the president on the issue that will stick with who the country wants it. [SEP] you'll also find that someone like the teacher or the coach or his lack of personal life, or even someone who goes to the club to recount. [SEP] when do people go into that region, at 100 - 11, 000 in the real price, they [SEP]"}
+{"type": "sample", "index": 12, "raw_text": "[CLS] said he was among those only allowed to the scene. [SEP] the unnamed 23 - year - old west yorkshire man has declined to be named. [SEP] it has been available since 2001, now housed in a historic center around the town ' s former care home. [SEP] the rise of violence in afghanistan has led both to al - qaeda ' s \" theocrism \" and tactics and the use of women violence. [SEP] and that person or someone may not know them as human - - you do know how much others know how to do. [SEP] travelport ( r ) california ( t ), among the largest full - service companies in the [SEP]", "detok_text": "[CLS] said he was among those only allowed to the scene. [SEP] the unnamed 23 - year - old west yorkshire man has declined to be named. [SEP] it has been available since 2001, now housed in a historic center around the town's former care home. [SEP] the rise of violence in afghanistan has led both to al - qaeda's \"theocrism\" and tactics and the use of women violence. [SEP] and that person or someone may not know them as human - - you do know how much others know how to do. [SEP] travelport (r) california (t), among the largest full - service companies in the [SEP]"}
+{"type": "sample", "index": 13, "raw_text": "[CLS] critical condition but the number was not released. [SEP] a five - year - old girl who died in a fire in a city centre has been living alone with her parents for eight months. [SEP] she and the victim did their best to save her, a court heard last night. [SEP] with the current global financial crisis and the credit crisis, americans might well have paid back where they were - - $ 24. 5 billion to go. [SEP] then, he says, \" i want plenty of time before you get along \" and do something else, and he talks about giving you his favorite personal word. [SEP] about 3, 100 people were [SEP]", "detok_text": "[CLS] critical condition but the number was not released. [SEP] a five - year - old girl who died in a fire in a city centre has been living alone with her parents for eight months. [SEP] she and the victim did their best to save her, a court heard last night. [SEP] with the current global financial crisis and the credit crisis, americans might well have paid back where they were - - $24. 5 billion to go. [SEP] then, he says, \"i want plenty of time before you get along\" and do something else, and he talks about giving you his favorite personal word. [SEP] about 3, 100 people were [SEP]"}
+{"type": "sample", "index": 14, "raw_text": "[CLS] behind their doors to help businesses cut costs, and become a leader in the fight against global warming. [SEP] it ' s an emotionalized experience, but if you see a player, and a friend, talk and if there ' s nothing to come, you might have a hard time in a football game. [SEP] of course, just a few years ago, the show was a hundred days back. [SEP] what happens at this point is not clear. [SEP] and it is in a better position. [SEP] the haberdon bridge, built in september, will cost two years, £9, 058m construction costs and cost £12 [SEP]", "detok_text": "[CLS] behind their doors to help businesses cut costs, and become a leader in the fight against global warming. [SEP] it's an emotionalized experience, but if you see a player, and a friend, talk and if there's nothing to come, you might have a hard time in a football game. [SEP] of course, just a few years ago, the show was a hundred days back. [SEP] what happens at this point is not clear. [SEP] and it is in a better position. [SEP] the haberdon bridge, built in september, will cost two years, £9, 058m construction costs and cost £12 [SEP]"}
+{"type": "sample", "index": 15, "raw_text": "[CLS] china and taiwan, the mission will help japan ' s relationship with the united states, \" said hiroshi kadama, chief economist at primo financial services co. [SEP] he said he and the suspect ' s younger son will not discuss the incident publicly. [SEP] officials from california are headed to new york city police general michael gaffney, director of america ' s police and park service, to become central america ' s director of public health and health services in the summer. [SEP] china foreign affairs premier wen jiabao emphasized that the meeting \" will meet the people ' s concerns on a first step basis, \" she said. [SEP]", "detok_text": "[CLS] china and taiwan, the mission will help japan's relationship with the united states, \"said hiroshi kadama, chief economist at primo financial services co. [SEP] he said he and the suspect's younger son will not discuss the incident publicly. [SEP] officials from california are headed to new york city police general michael gaffney, director of america's police and park service, to become central america's director of public health and health services in the summer. [SEP] china foreign affairs premier wen jiabao emphasized that the meeting\" will meet the people's concerns on a first step basis, \" she said. [SEP]"}
+{"type": "sample", "index": 16, "raw_text": "[CLS] communist guerrillas in the 1980s, and then head of the army. [SEP] today, ticket prices start at 6 : 24 a. m. [SEP] lloyds is due to pay back the £1bn at the same rate as the treasury, so the government doesn ' t have to pay the price alone. [SEP] mcneil also said he will explore two options. [SEP] money, too, aren ' t the sort of things that get out of you. [SEP] many of the schools were set up in philadelphia and opened in 1972. [SEP] mr follett, a 24 - year - old schoolworker, was with friends in the end of [SEP]", "detok_text": "[CLS] communist guerrillas in the 1980s, and then head of the army. [SEP] today, ticket prices start at 6: 24 a. m. [SEP] lloyds is due to pay back the £1bn at the same rate as the treasury, so the government doesn't have to pay the price alone. [SEP] mcneil also said he will explore two options. [SEP] money, too, aren't the sort of things that get out of you. [SEP] many of the schools were set up in philadelphia and opened in 1972. [SEP] mr follett, a 24 - year - old schoolworker, was with friends in the end of [SEP]"}
+{"type": "sample", "index": 17, "raw_text": "[CLS] that he could barely walk at the top. [SEP] the council, which is fighting a year - long battle over it, wants a hearing on the report, late on monday night. [SEP] the officials said south korea and north korea met in the capitals last week, but failed to elaborate on the date, saying they wanted an access to the nuclear issue. [SEP] political sources claim that the job of support for leader seng - seng is seen as the weakest of his democratic party - - the organisation that recognises him has a record of intimidation and violence. [SEP] associated press writers mark fodder in atlanta and ryan cordes [SEP]", "detok_text": "[CLS] that he could barely walk at the top. [SEP] the council, which is fighting a year - long battle over it, wants a hearing on the report, late on monday night. [SEP] the officials said south korea and north korea met in the capitals last week, but failed to elaborate on the date, saying they wanted an access to the nuclear issue. [SEP] political sources claim that the job of support for leader seng - seng is seen as the weakest of his democratic party - - the organisation that recognises him has a record of intimidation and violence. [SEP] associated press writers mark fodder in atlanta and ryan cordes [SEP]"}
+{"type": "sample", "index": 18, "raw_text": "[CLS] prison years for assaulting on the child of a woman and assault on a man while holding his head during an argument. [SEP] a club spokesman said woods fell ill on friday afternoon. [SEP] the convention begins its 2010 season on tuesday and is expected to become the first major convention in 2010. [SEP] \" there ' s a question of the president and i think it ' s up to the fact that the people in his party will be going to do, \" she said. [SEP] last year, safin moved to the right side. [SEP] oher, he said, \" every team goes as well in an individual ' s interest. [SEP] [SEP]", "detok_text": "[CLS] prison years for assaulting on the child of a woman and assault on a man while holding his head during an argument. [SEP] a club spokesman said woods fell ill on friday afternoon. [SEP] the convention begins its 2010 season on tuesday and is expected to become the first major convention in 2010. [SEP] \"there's a question of the president and i think it's up to the fact that the people in his party will be going to do,\" she said. [SEP] last year, safin moved to the right side. [SEP] oher, he said, \" every team goes as well in an individual's interest. [SEP] [SEP]"}
+{"type": "sample", "index": 19, "raw_text": "[CLS] olympic games. [SEP] the man who died in a house fire was been dead for 15 months, a jury at the town heard. [SEP] he said : \" there is a big deal of pressure at the top, and it ' s tough, but a lot of different people think you need to do the things and improve the playing level. [SEP] the best thing you can do is get back to the park today, \" mr. bryant said. [SEP] after seven years of fighting by his side, in fb ' s name, he was forced to return to the top post. [SEP] cowboys owner jeff gewker promised to provide details [SEP]", "detok_text": "[CLS] olympic games. [SEP] the man who died in a house fire was been dead for 15 months, a jury at the town heard. [SEP] he said: \"there is a big deal of pressure at the top, and it's tough, but a lot of different people think you need to do the things and improve the playing level. [SEP] the best thing you can do is get back to the park today,\" mr. bryant said. [SEP] after seven years of fighting by his side, in fb's name, he was forced to return to the top post. [SEP] cowboys owner jeff gewker promised to provide details [SEP]"}
+{"type": "sample", "index": 20, "raw_text": "[CLS] said tuesday. [SEP] north korea has already warned off south korea, china, india, japan and eight other nations and could be seen as evidence of a limited - - and the first - - development of north korea ' s long - range missile test since launch in early 2009. [SEP] i was right, after all. [SEP] \" then go for food and fish, \" he added. [SEP] what ' s good about football : winning is always winning. [SEP] great britain has long been affected by the mortgage crisis and the credit crisis. [SEP] but opposition figures do not want to be out of business now that it is over. [SEP] the last [SEP]", "detok_text": "[CLS] said tuesday. [SEP] north korea has already warned off south korea, china, india, japan and eight other nations and could be seen as evidence of a limited - - and the first - - development of north korea's long - range missile test since launch in early 2009. [SEP] i was right, after all. [SEP] \"then go for food and fish,\" he added. [SEP] what's good about football: winning is always winning. [SEP] great britain has long been affected by the mortgage crisis and the credit crisis. [SEP] but opposition figures do not want to be out of business now that it is over. [SEP] the last [SEP]"}
+{"type": "sample", "index": 21, "raw_text": "[CLS] party formed by blaser ' s announcement. [SEP] it ' s the administration ' s second new political policy in two weeks, urging president bush to take a firm decision before former u. s. president george w. bush leaves office, while the aides say he would continue his position. [SEP] c. j. f. k., oct. [SEP] he was really happy. [SEP] on monday he broke mr. henin ' s serve, 10 - 7, in the second round of the 50 - meter tournament. [SEP] and the 67 - year - old shareholder, the former bank accounts chairman, is over - achievers [SEP]", "detok_text": "[CLS] party formed by blaser's announcement. [SEP] it's the administration's second new political policy in two weeks, urging president bush to take a firm decision before former u. s. president george w. bush leaves office, while the aides say he would continue his position. [SEP] c. j. f. k., oct. [SEP] he was really happy. [SEP] on monday he broke mr. henin's serve, 10 - 7, in the second round of the 50 - meter tournament. [SEP] and the 67 - year - old shareholder, the former bank accounts chairman, is over - achievers [SEP]"}
+{"type": "sample", "index": 22, "raw_text": "[CLS] just under three hours and all of whom were held there. [SEP] \" we ' re trying to find other families, \" he said. [SEP] the teams operate in the town of st helens, in north cumbria and north cumbria and north shaftesbury in cumbria. [SEP] i ' m sure i don ' t know, but i ' m sure he told me that, but our job is to do that in any way, and i do not think what is important about how i get here. [SEP] he told the washington post, in a few questions, that he and he had urged president obama to quickly iron out their differences to avoid [SEP]", "detok_text": "[CLS] just under three hours and all of whom were held there. [SEP] \"we're trying to find other families,\" he said. [SEP] the teams operate in the town of st helens, in north cumbria and north cumbria and north shaftesbury in cumbria. [SEP] i'm sure i don't know, but i'm sure he told me that, but our job is to do that in any way, and i do not think what is important about how i get here. [SEP] he told the washington post, in a few questions, that he and he had urged president obama to quickly iron out their differences to avoid [SEP]"}
+{"type": "sample", "index": 23, "raw_text": "[CLS] statement. [SEP] in april and june it reported a deficit of £6. 6 billion ( £34 million - - $ 19. 15 billion - $ 19. 4bn ). [SEP] his five - point plan offers little change. [SEP] \" obama will return to the white house for a trip that will include talks to the white house on both israel and the palestinians, \" white house spokesman john b. kelly said. [SEP] if convicted, alan hanley, the former head of the national rugby league, and the son of a retired teacher at sheffield hallam school could face up to five years. [SEP] the patriots hope to win a [SEP]", "detok_text": "[CLS] statement. [SEP] in april and june it reported a deficit of £6. 6 billion (£34 million - - $19. 15 billion - $19. 4bn). [SEP] his five - point plan offers little change. [SEP] \"obama will return to the white house for a trip that will include talks to the white house on both israel and the palestinians,\" white house spokesman john b. kelly said. [SEP] if convicted, alan hanley, the former head of the national rugby league, and the son of a retired teacher at sheffield hallam school could face up to five years. [SEP] the patriots hope to win a [SEP]"}
+{"type": "sample", "index": 24, "raw_text": "[CLS] country. [SEP] this figure includes also the data, the value of the dollar and a big yen. [SEP] \" i was pretty much wrong in style and commitment. [SEP] no one was seriously injured. [SEP] despite the close relationship of the new manchester united, mourinho ronaldo may want to build up his reputation in the premier league to break the portuguese ' s habit of publicly assaulting authority. [SEP] co - orientist andrew lee is emeritus professor of the university of oxford and professor of law at the university of liverpool. [SEP] three years ago, the largest shareholder in the u. s. power industry and its u. [SEP]", "detok_text": "[CLS] country. [SEP] this figure includes also the data, the value of the dollar and a big yen. [SEP] \" i was pretty much wrong in style and commitment. [SEP] no one was seriously injured. [SEP] despite the close relationship of the new manchester united, mourinho ronaldo may want to build up his reputation in the premier league to break the portuguese's habit of publicly assaulting authority. [SEP] co - orientist andrew lee is emeritus professor of the university of oxford and professor of law at the university of liverpool. [SEP] three years ago, the largest shareholder in the u. s. power industry and its u. [SEP]"}
+{"type": "sample", "index": 25, "raw_text": "[CLS] our agreement and from our members and representatives in the last couple of years, we can show to them that we are not involved, \" hun seng - bili told a press conference. [SEP] \" it ' s been a long day, i put my hand around it enough, but i can ' t get it right. [SEP] we can ' t tell anyone what to do like now, \" said ferguson. [SEP] societe generale ' s revenues for all markets increased by 8. 5 per cent to 426. 8 billion ruas ( 940 million euros, 880, 000 dollars ) - - the biggest ever increase in [SEP]", "detok_text": "[CLS] our agreement and from our members and representatives in the last couple of years, we can show to them that we are not involved, \"hun seng - bili told a press conference. [SEP]\" it's been a long day, i put my hand around it enough, but i can't get it right. [SEP] we can't tell anyone what to do like now, \" said ferguson. [SEP] societe generale's revenues for all markets increased by 8. 5 per cent to 426. 8 billion ruas (940 million euros, 880, 000 dollars) - - the biggest ever increase in [SEP]"}
+{"type": "sample", "index": 26, "raw_text": "[CLS] should be selected. [SEP] they didn ' t bring the table to the site. [SEP] but i would never buy this upper - class tint at that time. [SEP] at least 90 percent of our tax system is not about housing. [SEP] obama ' s first major meeting with the koreas on monday, two days after a landmark visit to the island, from where the forum is taken, is the latest sign in sino - chinese relations, and some are concerned china might use his visit to use its criticism of the nuclear gun fire as a gesture of reconciliation. [SEP] a study from cardiff university found a range of language seen during the 1970s [SEP]", "detok_text": "[CLS] should be selected. [SEP] they didn't bring the table to the site. [SEP] but i would never buy this upper - class tint at that time. [SEP] at least 90 percent of our tax system is not about housing. [SEP] obama's first major meeting with the koreas on monday, two days after a landmark visit to the island, from where the forum is taken, is the latest sign in sino - chinese relations, and some are concerned china might use his visit to use its criticism of the nuclear gun fire as a gesture of reconciliation. [SEP] a study from cardiff university found a range of language seen during the 1970s [SEP]"}
+{"type": "sample", "index": 27, "raw_text": "[CLS] ( aged three and four ), rich, well - known women, and commissioner bud bud selig. [SEP] \" losses and losses moved to a short - term record low, \" said richard ellis, senior strategy director at credit rating agency fitch. [SEP] the nfl owners and the players continue to push forward for the franchise, while the nfl league of major league baseball officials and the patriots are meeting in may with the team ' s owners for the first time in 14 years. [SEP] the agency estimates that water falls from the pipeline to 22. 5 million cubic feet a day. [SEP] he added that \" the surge \" was on the [SEP]", "detok_text": "[CLS] (aged three and four), rich, well - known women, and commissioner bud bud selig. [SEP] \"losses and losses moved to a short - term record low,\" said richard ellis, senior strategy director at credit rating agency fitch. [SEP] the nfl owners and the players continue to push forward for the franchise, while the nfl league of major league baseball officials and the patriots are meeting in may with the team's owners for the first time in 14 years. [SEP] the agency estimates that water falls from the pipeline to 22. 5 million cubic feet a day. [SEP] he added that \"the surge\" was on the [SEP]"}
+{"type": "sample", "index": 28, "raw_text": "[CLS] so much resources that you need to be a teacher, not to be lectured. \" [SEP] looks like i didn ' t have to take this kind of action before, and given that i ' m not my own self - serving self - helper even now, i would think that will put on a good path. [SEP] washington ( ap ) - u. s. national security officials said wednesday that the united states faces a significant challenge to the region. [SEP] \" i think it ' s in the conscience of the people in ohio, \" said davis. [SEP] before russia ' s presidential election, the leaders made a joint call to the [SEP]", "detok_text": "[CLS] so much resources that you need to be a teacher, not to be lectured. \"[SEP] looks like i didn't have to take this kind of action before, and given that i'm not my own self - serving self - helper even now, i would think that will put on a good path. [SEP] washington (ap) - u. s. national security officials said wednesday that the united states faces a significant challenge to the region. [SEP]\" i think it's in the conscience of the people in ohio, \" said davis. [SEP] before russia's presidential election, the leaders made a joint call to the [SEP]"}
+{"type": "sample", "index": 29, "raw_text": "[CLS] ' s run of our history, \" tolan said in the clubhouse. [SEP] john young, mosley ' s publicist, told the associated press thursday that he had no immediate comment and was hearing on the son ' s death. [SEP] if he were president, though, the government would give greater authority to mr ahmadinejad and create a common political policy. [SEP] the company had announced further stores would be closed only four days later. [SEP] in european morning trading, germany ' s dax index fell 8. 4 percent and france ' s cac 40 ended 2. 69 points lower at 5. 53 euros. [SEP] just like [SEP]", "detok_text": "[CLS]'s run of our history, \" tolan said in the clubhouse. [SEP] john young, mosley's publicist, told the associated press thursday that he had no immediate comment and was hearing on the son's death. [SEP] if he were president, though, the government would give greater authority to mr ahmadinejad and create a common political policy. [SEP] the company had announced further stores would be closed only four days later. [SEP] in european morning trading, germany's dax index fell 8. 4 percent and france's cac 40 ended 2. 69 points lower at 5. 53 euros. [SEP] just like [SEP]"}
+{"type": "sample", "index": 30, "raw_text": "[CLS] short films, jack eastwood as a worker, and john mccain wields as a market fighter. [SEP] you put yourself down to 40 or 40 years ' age, because if i don ' t need to be kicked out of the game, and let ' s start, i ' m not going to play. [SEP] he hadn ' t lost his job in years before he could. [SEP] in the meeting, david howells, the shadow chief secretary, will meet with steve clarke, the bnp head of communications and former cabinet ministers, who will urge them to have joint discussions. [SEP] beijing says deep rate cuts will be taken less [SEP]", "detok_text": "[CLS] short films, jack eastwood as a worker, and john mccain wields as a market fighter. [SEP] you put yourself down to 40 or 40 years' age, because if i don't need to be kicked out of the game, and let's start, i'm not going to play. [SEP] he hadn't lost his job in years before he could. [SEP] in the meeting, david howells, the shadow chief secretary, will meet with steve clarke, the bnp head of communications and former cabinet ministers, who will urge them to have joint discussions. [SEP] beijing says deep rate cuts will be taken less [SEP]"}
+{"type": "sample", "index": 31, "raw_text": "[CLS] i put together. [SEP] senator barack obama wasn ' t elected today. [SEP] the brewing group has achieved net revenues of between £2. 1 million and £6. 5 million in 12 months to 30 june 2010. [SEP] what ' s next, say.... [SEP] travel? [SEP] \" i ' m going to be playing hard for everyone, \" said pavin. [SEP] mark sanford : what do you think? [SEP] she was a woman, according to her father, peter fox. [SEP] \" i only see a little bit of it and it ' s not. [SEP] the critics have said china needs to take on more risks in [SEP]", "detok_text": "[CLS] i put together. [SEP] senator barack obama wasn't elected today. [SEP] the brewing group has achieved net revenues of between £2. 1 million and £6. 5 million in 12 months to 30 june 2010. [SEP] what's next, say.... [SEP] travel? [SEP] \"i'm going to be playing hard for everyone,\" said pavin. [SEP] mark sanford: what do you think? [SEP] she was a woman, according to her father, peter fox. [SEP] \" i only see a little bit of it and it's not. [SEP] the critics have said china needs to take on more risks in [SEP]"}
+{"type": "sample", "index": 32, "raw_text": "[CLS] mccain ' s concession speech. [SEP] on the scene thursday morning, edwards said he doesn ' t care to watch elections. [SEP] the party ' s deputy chief john howard, defended the government spending package last week and urged the tories to take up the controversial child poverty bill to preserve the government ' s economic recovery. [SEP] we should have the government and the government, to stop this. [SEP] that is the stance that all serious women like to take, and i ' m not surprised by suing her when they ' re wearing heavy, knee - length shoes. [SEP] \" we went back after a very long time. [SEP] it was [SEP]", "detok_text": "[CLS] mccain's concession speech. [SEP] on the scene thursday morning, edwards said he doesn't care to watch elections. [SEP] the party's deputy chief john howard, defended the government spending package last week and urged the tories to take up the controversial child poverty bill to preserve the government's economic recovery. [SEP] we should have the government and the government, to stop this. [SEP] that is the stance that all serious women like to take, and i'm not surprised by suing her when they're wearing heavy, knee - length shoes. [SEP] \" we went back after a very long time. [SEP] it was [SEP]"}
+{"type": "sample", "index": 33, "raw_text": "[CLS] it ' s hard to say this is true, \" the country ' s senior planning official, ayub ahmed, said. [SEP] so we want to show that everyone has died the same week ; that ' s pretty much about every day. [SEP] indeed, only a generation after the people of wales were really successful golfers, there is still a lot of argument on how to get in the way of golf, but something about this way of golfing. [SEP] turn to the art of music to avoid something else, and most people in music don ' t. [SEP] and there ' s a message to the irish economy to make [SEP]", "detok_text": "[CLS] it's hard to say this is true, \" the country's senior planning official, ayub ahmed, said. [SEP] so we want to show that everyone has died the same week; that's pretty much about every day. [SEP] indeed, only a generation after the people of wales were really successful golfers, there is still a lot of argument on how to get in the way of golf, but something about this way of golfing. [SEP] turn to the art of music to avoid something else, and most people in music don't. [SEP] and there's a message to the irish economy to make [SEP]"}
+{"type": "sample", "index": 34, "raw_text": "[CLS] u. s. economic process. [SEP] however, the world health organisation said data released yesterday showed the number of people the age of 18 is likely to be down at 4. 3 per cent overall in the three months to november 30 this year, 3. 4 per cent lower than the first quarter. [SEP] the lawsuit also claims from sources that the transcripts were actually obtained from brotzky ' s office. [SEP] the first time the british government has announced that it is offering as the first of the cog projects is announced. [SEP] he allowed himself to skid open the building with a rope and a pushchair from the [SEP]", "detok_text": "[CLS] u. s. economic process. [SEP] however, the world health organisation said data released yesterday showed the number of people the age of 18 is likely to be down at 4. 3 per cent overall in the three months to november 30 this year, 3. 4 per cent lower than the first quarter. [SEP] the lawsuit also claims from sources that the transcripts were actually obtained from brotzky's office. [SEP] the first time the british government has announced that it is offering as the first of the cog projects is announced. [SEP] he allowed himself to skid open the building with a rope and a pushchair from the [SEP]"}
+{"type": "sample", "index": 35, "raw_text": "[CLS] added. [SEP] the average cost of borrowing on the 3 - month euro rose 4. 25 percent thursday afternoon to $ 1. 8096 per dollar. [SEP] some u. s. companies do that. [SEP] but mr arnez ' s fate was not much of a straightforward one. [SEP] i was focused on the same thing. [SEP] \" it ' s just a big joke. [SEP] in the case of russia, russia has used its position as a leader in the oil of south america. [SEP] without that war, it ' s too late. [SEP] 5. 42pm : the scotland ' s ian robinson, head coach and [SEP]", "detok_text": "[CLS] added. [SEP] the average cost of borrowing on the 3 - month euro rose 4. 25 percent thursday afternoon to $1. 8096 per dollar. [SEP] some u. s. companies do that. [SEP] but mr arnez's fate was not much of a straightforward one. [SEP] i was focused on the same thing. [SEP] \" it's just a big joke. [SEP] in the case of russia, russia has used its position as a leader in the oil of south america. [SEP] without that war, it's too late. [SEP] 5. 42pm: the scotland's ian robinson, head coach and [SEP]"}
+{"type": "sample", "index": 36, "raw_text": "[CLS] record. [SEP] verizon ' s forecast is also largely unchanged this year. [SEP] maddow said he decided to fly out of the two states earlier this month. [SEP] he holds an art professor, a public policy law professor at emory, georgia, and a public law school in denver, colorado, and a master ' s degree in english, as a consultant for the u. s. mission in afghanistan. [SEP] angry residents have also taken to the streets of the capital, where southerners have declined to vote in the poll. [SEP] israel and its allies should have to cooperate with hamas, said mohammed naimi, a spokesman [SEP]", "detok_text": "[CLS] record. [SEP] verizon's forecast is also largely unchanged this year. [SEP] maddow said he decided to fly out of the two states earlier this month. [SEP] he holds an art professor, a public policy law professor at emory, georgia, and a public law school in denver, colorado, and a master's degree in english, as a consultant for the u. s. mission in afghanistan. [SEP] angry residents have also taken to the streets of the capital, where southerners have declined to vote in the poll. [SEP] israel and its allies should have to cooperate with hamas, said mohammed naimi, a spokesman [SEP]"}
+{"type": "sample", "index": 37, "raw_text": "[CLS] business. [SEP] the foreign minister has three years to complete those demands. [SEP] on china yesterday, british prime minister gordon brown announced his support for the country ' s top foreign minister, calling for the two nations to join in with iran, to respect the security accords outlined by china ' s economic envoy and for tehran to give in to stalled international talks over its nuclear programme. [SEP] the lowest prices were in spain, paying between $ 0. 65 and £1. 36. 27. [SEP] washington state has the second - highest field - goal rate in the nation, which has the last in rushing yards, and delaware, 10 points below [SEP]", "detok_text": "[CLS] business. [SEP] the foreign minister has three years to complete those demands. [SEP] on china yesterday, british prime minister gordon brown announced his support for the country's top foreign minister, calling for the two nations to join in with iran, to respect the security accords outlined by china's economic envoy and for tehran to give in to stalled international talks over its nuclear programme. [SEP] the lowest prices were in spain, paying between $0. 65 and £1. 36. 27. [SEP] washington state has the second - highest field - goal rate in the nation, which has the last in rushing yards, and delaware, 10 points below [SEP]"}
+{"type": "sample", "index": 38, "raw_text": "[CLS] to make it easier. [SEP] i would point out to myself that while the government and some people are fighting this, they not just talk about china - - they represent the particular nature of their culture. [SEP] mr. johnson, a georgetown university international law student, is a friend and best friend of public law and civil service. [SEP] i ' m not a tall, intelligent person who enjoys her showering life, but not her hair, looking like a sex - tape woman and decentified by sitting alone in the shower and unwittingly snoring. [SEP] the problem of the tories, he said, was that [SEP]", "detok_text": "[CLS] to make it easier. [SEP] i would point out to myself that while the government and some people are fighting this, they not just talk about china - - they represent the particular nature of their culture. [SEP] mr. johnson, a georgetown university international law student, is a friend and best friend of public law and civil service. [SEP] i'm not a tall, intelligent person who enjoys her showering life, but not her hair, looking like a sex - tape woman and decentified by sitting alone in the shower and unwittingly snoring. [SEP] the problem of the tories, he said, was that [SEP]"}
+{"type": "sample", "index": 39, "raw_text": "[CLS] his father ' s murder trial. [SEP] if the man who said that wants to get over it, the court has now the right to deal with it..., and i couldn ' t have further details, \" she said. [SEP] the government agreed on changes to the new laws to allow the transition to a new order of parliament. [SEP] by contrast, the north east region is about three times the size of london, with northern ireland, glasgow in scotland, cardiff in wales, scotland, and scotland about 3 per cent. [SEP] though he ' s still a junior, at least three times and four times - - and 20 [SEP]", "detok_text": "[CLS] his father's murder trial. [SEP] if the man who said that wants to get over it, the court has now the right to deal with it..., and i couldn't have further details, \" she said. [SEP] the government agreed on changes to the new laws to allow the transition to a new order of parliament. [SEP] by contrast, the north east region is about three times the size of london, with northern ireland, glasgow in scotland, cardiff in wales, scotland, and scotland about 3 per cent. [SEP] though he's still a junior, at least three times and four times - - and 20 [SEP]"}
+{"type": "sample", "index": 40, "raw_text": "[CLS]su - lee hosanbae, whose parties are trying to form a government, according to the poll released wednesday. [SEP] in the buggy ' s case, there was a need to keep a driver ' s attention out of the human eye and minimize the damage. [SEP] senate democratic leader, cheeks kilpatrick of hoeaton, who heads the senate ' s financial and reform committee, was asked if the president was right. [SEP] world no. 1 roger federer, seeking their 10th consecutive title at a level, needs three wins to no. 1 rival rafael nadal, leaving a strong tie with top - seeded je [SEP]", "detok_text": "[CLS]su - lee hosanbae, whose parties are trying to form a government, according to the poll released wednesday. [SEP] in the buggy's case, there was a need to keep a driver's attention out of the human eye and minimize the damage. [SEP] senate democratic leader, cheeks kilpatrick of hoeaton, who heads the senate's financial and reform committee, was asked if the president was right. [SEP] world no. 1 roger federer, seeking their 10th consecutive title at a level, needs three wins to no. 1 rival rafael nadal, leaving a strong tie with top - seeded je [SEP]"}
+{"type": "sample", "index": 41, "raw_text": "[CLS] said : \" from the beginning, i agree. [SEP] the republican line means that more is good than good, but that it will also appear ideologically appealing to a military leader who has become much more patient. [SEP] \" he hasn ' t played much. [SEP] \" many of our people want this country to contribute much to the goal of turning the world into the capital of nuclear energy, \" he said. [SEP] it is clear to their views on what matters what happens to us - - a question of responsibility and responsibility for the people to accept. [SEP] the cowboys, the worst this season, fell to a second - quarter loss to [SEP]", "detok_text": "[CLS] said: \"from the beginning, i agree. [SEP] the republican line means that more is good than good, but that it will also appear ideologically appealing to a military leader who has become much more patient. [SEP]\" he hasn't played much. [SEP] \"many of our people want this country to contribute much to the goal of turning the world into the capital of nuclear energy,\" he said. [SEP] it is clear to their views on what matters what happens to us - - a question of responsibility and responsibility for the people to accept. [SEP] the cowboys, the worst this season, fell to a second - quarter loss to [SEP]"}
+{"type": "sample", "index": 42, "raw_text": "[CLS] so he will not have to accept that as a matter of urgency, \" said david rohork, the director of the white house institute for international economic policy. [SEP] 6 ( upi ) - - california officials said the u. s. state needs to keep the state going and expected it to make more than $ 4 billion in 2008. [SEP] the gop is expected to support civil rights, justice, ethics, employment reform, housing, national control and prevention and prescription drug pricing. [SEP] scottsdale, ariz. - - s. gov. evan bayh said during a preview of mccain ' s us presidential primary campaign [SEP]", "detok_text": "[CLS] so he will not have to accept that as a matter of urgency, \" said david rohork, the director of the white house institute for international economic policy. [SEP] 6 (upi) - - california officials said the u. s. state needs to keep the state going and expected it to make more than $4 billion in 2008. [SEP] the gop is expected to support civil rights, justice, ethics, employment reform, housing, national control and prevention and prescription drug pricing. [SEP] scottsdale, ariz. - - s. gov. evan bayh said during a preview of mccain's us presidential primary campaign [SEP]"}
+{"type": "sample", "index": 43, "raw_text": "[CLS] office estimates that its average power output would be about 25 per cent. [SEP] one of the man ' s parents, mr al - hosnib, said he died. [SEP] more information and information is available on the web at http : / /. com / investor / ccg. asp2009, and call ccg at ( 0 ) - 553 - 9764. [SEP] yes, yes, yes, because we ' re sorry, but we ' re wrong. [SEP] in june 2008, jassia pledged for the first memorial of those who died at the highest point from the disaster. [SEP] mr clinton said [SEP]", "detok_text": "[CLS] office estimates that its average power output would be about 25 per cent. [SEP] one of the man's parents, mr al - hosnib, said he died. [SEP] more information and information is available on the web at http://. com/investor/ccg. asp2009, and call ccg at (0) - 553 - 9764. [SEP] yes, yes, yes, because we're sorry, but we're wrong. [SEP] in june 2008, jassia pledged for the first memorial of those who died at the highest point from the disaster. [SEP] mr clinton said [SEP]"}
+{"type": "sample", "index": 44, "raw_text": "[CLS] per cent, far below the output estimate of about 1. 7 million cent a year ago. [SEP] the new york times said friday that administration officials and the treasury hoped the administration would take some of the force that had to go through in the wake of the crisis and would likely come to accept that the housing and economic crisis would go away. [SEP] it ' s very improbable considering what we have to do to look back. [SEP] \" obviously, it ' s not long since the first place when i was here that day, \" he said. [SEP] the services would include access to st. george business park and green - [SEP]", "detok_text": "[CLS] per cent, far below the output estimate of about 1. 7 million cent a year ago. [SEP] the new york times said friday that administration officials and the treasury hoped the administration would take some of the force that had to go through in the wake of the crisis and would likely come to accept that the housing and economic crisis would go away. [SEP] it's very improbable considering what we have to do to look back. [SEP] \"obviously, it's not long since the first place when i was here that day,\" he said. [SEP] the services would include access to st. george business park and green - [SEP]"}
+{"type": "sample", "index": 45, "raw_text": "[CLS]e said. [SEP] speaking on the main floor of the israeli ministry of justice in london, the prime minister rejected the accusation and said it was motivated by concerns within the intelligence community. [SEP] the investigation into the sudden death of a young man lying in a road has been called a victim of crime, police said. [SEP] \" i thought it was awesome. [SEP] it ' s going very close, \" said allen king, a 45 - year - old retired construction worker. [SEP] do you feel guilty of buying your tuppert, or don ' t forget seeing your take - - a racket of pints? [SEP] however the times [SEP]", "detok_text": "[CLS]e said. [SEP] speaking on the main floor of the israeli ministry of justice in london, the prime minister rejected the accusation and said it was motivated by concerns within the intelligence community. [SEP] the investigation into the sudden death of a young man lying in a road has been called a victim of crime, police said. [SEP] \"i thought it was awesome. [SEP] it's going very close,\" said allen king, a 45 - year - old retired construction worker. [SEP] do you feel guilty of buying your tuppert, or don't forget seeing your take - - a racket of pints? [SEP] however the times [SEP]"}
+{"type": "sample", "index": 46, "raw_text": "[CLS] their bid thursday to force the white house to send a request to congress for comment on human rights policy allowing the use of torture to be used. [SEP] 10 a. m. at new york ' s university of management and medical center, brooklyn, a 2. 3 - mile road to new york city. [SEP] but it isn ' t for our child ' s needs - - at least if you ' re a middle - class, at - home teacher. [SEP] at a school in birmingham, la., the congregation was told mr obama was used to \" change and construction. [SEP] the coach will know what he was [SEP]", "detok_text": "[CLS] their bid thursday to force the white house to send a request to congress for comment on human rights policy allowing the use of torture to be used. [SEP] 10 a. m. at new york's university of management and medical center, brooklyn, a 2. 3 - mile road to new york city. [SEP] but it isn't for our child's needs - - at least if you're a middle - class, at - home teacher. [SEP] at a school in birmingham, la., the congregation was told mr obama was used to \" change and construction. [SEP] the coach will know what he was [SEP]"}
+{"type": "sample", "index": 47, "raw_text": "[CLS] ' s pretty obvious... as well as his lack of ballack. he ' s not correct in any way. but he ' s got his own point of view and am not sure if it ' s true. he ' s very good at stagging through with that.. she ' s got toyed with this guy and refuses to let her decide about their longstanding lack of integrity. nobody is going to talk about this man. [SEP] harrod has gone into politics for a career with an italian school, and law is also searching for a job, although a source familiar with the negotiations said thursday that [SEP]", "detok_text": "[CLS]'s pretty obvious... as well as his lack of ballack. he's not correct in any way. but he's got his own point of view and am not sure if it's true. he's very good at stagging through with that.. she's got toyed with this guy and refuses to let her decide about their longstanding lack of integrity. nobody is going to talk about this man. [SEP] harrod has gone into politics for a career with an italian school, and law is also searching for a job, although a source familiar with the negotiations said thursday that [SEP]"}
+{"type": "sample", "index": 48, "raw_text": "[CLS] \" entertainment \" ( feg ) \" is a good one to make a person live very, very well, \" nbc and the hollywood star reported sunday. [SEP] still, north korea is pursuing a nuclear program. [SEP] \" of course there will be problems in tibet, \" the deputy finance minister, tommasa puno, told head of the commerce ministry. [SEP] unlike the hoosiers, they ' d never had a look at the tournament and now new york was a great team in the round of its first two playoff games. [SEP] it ' s only a short distance. [SEP] the use of the planes during the nuclear war [SEP]", "detok_text": "[CLS] \"entertainment\" (feg) \"is a good one to make a person live very, very well,\" nbc and the hollywood star reported sunday. [SEP] still, north korea is pursuing a nuclear program. [SEP] \"of course there will be problems in tibet,\" the deputy finance minister, tommasa puno, told head of the commerce ministry. [SEP] unlike the hoosiers, they'd never had a look at the tournament and now new york was a great team in the round of its first two playoff games. [SEP] it's only a short distance. [SEP] the use of the planes during the nuclear war [SEP]"}
+{"type": "sample", "index": 49, "raw_text": "[CLS] boost the nation ' s growing competitiveness. [SEP] \" i ' m not playing one of the best games of the game, \" durant said. [SEP] it also means that investors will fall to today ' s trading standards. [SEP] she ' s had an idea that she starts having several times - - when i work with her, but when i end up going to it was always a big problem. [SEP] with the razorbacks ' lead at nine, the philadelphia lions and buffalo bills are only 15 - 3 since their very first season in 2001. [SEP] i ' m worried about it. [SEP] but there ' s a key element in [SEP]", "detok_text": "[CLS] boost the nation's growing competitiveness. [SEP] \"i'm not playing one of the best games of the game,\" durant said. [SEP] it also means that investors will fall to today's trading standards. [SEP] she's had an idea that she starts having several times - - when i work with her, but when i end up going to it was always a big problem. [SEP] with the razorbacks' lead at nine, the philadelphia lions and buffalo bills are only 15 - 3 since their very first season in 2001. [SEP] i'm worried about it. [SEP] but there's a key element in [SEP]"}
+{"type": "sample", "index": 50, "raw_text": "[CLS] and nine years in prison. [SEP] i think that my own partner will work through this complexity of my career, the way you ' re probably going to do it is actually the kind of immorality, as well as an instinct to put in the way of, rather than children. [SEP] that doesn ' t have much to do with the experience. [SEP] that would cost about $ 3 billion on average income in the amount of £42, 087, which is key to mr cameron ' s government ' s record over the years. [SEP] stephen conlin, an executive director of the center for national policy center, which runs [SEP]", "detok_text": "[CLS] and nine years in prison. [SEP] i think that my own partner will work through this complexity of my career, the way you're probably going to do it is actually the kind of immorality, as well as an instinct to put in the way of, rather than children. [SEP] that doesn't have much to do with the experience. [SEP] that would cost about $3 billion on average income in the amount of £42, 087, which is key to mr cameron's government's record over the years. [SEP] stephen conlin, an executive director of the center for national policy center, which runs [SEP]"}
+{"type": "sample", "index": 51, "raw_text": "[CLS], and luke stuy, jr. [SEP] this article was published on guardian. co. uk at 16. 23 bst on thursday 4 october 2010. [SEP] this is not too bad news. [SEP] the world ' s biggest bank, china financial group, has said it will continue to enter talks with the german government and its banks, but would discuss how to secure the deal. [SEP] his approach seems unusual. [SEP] drisy, based in san jose, calif., expects as many as 20 million phone calls in the week. [SEP] bush will return to his ranch in colorado on sunday morning, taking their first state meeting [SEP]", "detok_text": "[CLS], and luke stuy, jr. [SEP] this article was published on guardian. co. uk at 16. 23 bst on thursday 4 october 2010. [SEP] this is not too bad news. [SEP] the world's biggest bank, china financial group, has said it will continue to enter talks with the german government and its banks, but would discuss how to secure the deal. [SEP] his approach seems unusual. [SEP] drisy, based in san jose, calif., expects as many as 20 million phone calls in the week. [SEP] bush will return to his ranch in colorado on sunday morning, taking their first state meeting [SEP]"}
+{"type": "sample", "index": 52, "raw_text": "[CLS] his food. [SEP] when we now look to short - term funding, it is that the legislation will always have to be tough and flexible, in order to keep the stability of the economy, by definition, so more perilously less sustainable. [SEP] 2008 sales start at 3 million dollars, or more than $ 200, and in 2007 prices start at just under $ 100, 000. [SEP] that means he has expressed international concerns over the state of the country ' s politics and that his record does not constitute an act of mass democracy. [SEP] the most recent winner is country singer ian king. [SEP] the judge told the court, \" [SEP]", "detok_text": "[CLS] his food. [SEP] when we now look to short - term funding, it is that the legislation will always have to be tough and flexible, in order to keep the stability of the economy, by definition, so more perilously less sustainable. [SEP] 2008 sales start at 3 million dollars, or more than $200, and in 2007 prices start at just under $100, 000. [SEP] that means he has expressed international concerns over the state of the country's politics and that his record does not constitute an act of mass democracy. [SEP] the most recent winner is country singer ian king. [SEP] the judge told the court, \" [SEP]"}
+{"type": "sample", "index": 53, "raw_text": "[CLS] brown said the inquiry into the wmd programme with mr singh was \" impregnable \" because it contained data on the extent of the weapons programme. [SEP] elsewhere in tokyo, the nikkei 225 index rose 0. 9 percent to 13, 207. [SEP] mr littleer said that mr jog and friends ask his mother to help in the name of their son, jolie. [SEP] spokesman kori bok said the federal deposit insurance corp. was aware of the issue, following an announcement in september 2009. [SEP] the high court agreed. [SEP] airport authorities say the crane was stolen in the construction of a building near orlando. [SEP]", "detok_text": "[CLS] brown said the inquiry into the wmd programme with mr singh was \"impregnable\" because it contained data on the extent of the weapons programme. [SEP] elsewhere in tokyo, the nikkei 225 index rose 0. 9 percent to 13, 207. [SEP] mr littleer said that mr jog and friends ask his mother to help in the name of their son, jolie. [SEP] spokesman kori bok said the federal deposit insurance corp. was aware of the issue, following an announcement in september 2009. [SEP] the high court agreed. [SEP] airport authorities say the crane was stolen in the construction of a building near orlando. [SEP]"}
+{"type": "sample", "index": 54, "raw_text": "[CLS] 1 million to dubai global investment group, its money - management subsidiary. [SEP] the d. r. a committee of public affairs, with members of the r. i. a. ' s office, is the agency ' s executive director with responsibility to report and review the fec ' s safety and economic policy. [SEP] it was updated at 09. 15 bst on saturday 28 may 2009. [SEP] who are the main presidential candidates? [SEP] but the third time, the only player to watch bryant slam on him with his pusher, that wasn ' t quite visible. [SEP] it ' s also a place of labour and government control [SEP]", "detok_text": "[CLS] 1 million to dubai global investment group, its money - management subsidiary. [SEP] the d. r. a committee of public affairs, with members of the r. i. a.'s office, is the agency's executive director with responsibility to report and review the fec's safety and economic policy. [SEP] it was updated at 09. 15 bst on saturday 28 may 2009. [SEP] who are the main presidential candidates? [SEP] but the third time, the only player to watch bryant slam on him with his pusher, that wasn't quite visible. [SEP] it's also a place of labour and government control [SEP]"}
+{"type": "sample", "index": 55, "raw_text": "[CLS] rejected a call by french french president nicolas sarkozy on friday to meet with european leaders, saying that mr brown was \" out of patience until an agreement was made \". [SEP] the meeting was held during talks of authority president mahmoud ahmad fayud, president king assad and vice president harmudin museivi, held at the gaza news centre on wednesday, august 23. [SEP] she enrolled as a professor in international education at new york university, then b. b. school of administration in whiteville, n. j. [SEP] michael grasso, president of clean realty advisors, a group of real estate professionals of [SEP]", "detok_text": "[CLS] rejected a call by french french president nicolas sarkozy on friday to meet with european leaders, saying that mr brown was \"out of patience until an agreement was made\". [SEP] the meeting was held during talks of authority president mahmoud ahmad fayud, president king assad and vice president harmudin museivi, held at the gaza news centre on wednesday, august 23. [SEP] she enrolled as a professor in international education at new york university, then b. b. school of administration in whiteville, n. j. [SEP] michael grasso, president of clean realty advisors, a group of real estate professionals of [SEP]"}
+{"type": "sample", "index": 56, "raw_text": "[CLS] much research and information it need to develop itself, how will china go on its own policy? \" said retired adm. craig preselar of memphis, tenn., who heads naval policy. [SEP] with favre and the packers gone, they will have to have a chance to meet both owner jim babbock and coach bob hendon. [SEP] rbs ( citypaunday. com ), which owns 49 per cent of british insurers, valued its debt at 19. 9 times earnings at $ 1. 16. 2bp following a merger of two large european finance groups. [SEP] \" she is [SEP]", "detok_text": "[CLS] much research and information it need to develop itself, how will china go on its own policy? \"said retired adm. craig preselar of memphis, tenn., who heads naval policy. [SEP] with favre and the packers gone, they will have to have a chance to meet both owner jim babbock and coach bob hendon. [SEP] rbs (citypaunday. com), which owns 49 per cent of british insurers, valued its debt at 19. 9 times earnings at $1. 16. 2bp following a merger of two large european finance groups. [SEP]\" she is [SEP]"}
+{"type": "sample", "index": 57, "raw_text": "[CLS]. [SEP] the ministers welcomed the comments, made in tehran at the launch of the international conference, which was asked by leaders to say whether a weapons test needed to be followed. [SEP] sam graham, the labour peer, has fought a long - running battle with the state government for an age group. [SEP] hildich says she never wanted to see ms moore... [SEP] sht : nothing but as if it is a b. a. t...... [SEP] the white house officials said the original bailout plan didn ' t work well enough, even if it included provisions of an federal health care overhaul law [SEP]", "detok_text": "[CLS]. [SEP] the ministers welcomed the comments, made in tehran at the launch of the international conference, which was asked by leaders to say whether a weapons test needed to be followed. [SEP] sam graham, the labour peer, has fought a long - running battle with the state government for an age group. [SEP] hildich says she never wanted to see ms moore... [SEP] sht: nothing but as if it is a b. a. t...... [SEP] the white house officials said the original bailout plan didn't work well enough, even if it included provisions of an federal health care overhaul law [SEP]"}
+{"type": "sample", "index": 58, "raw_text": "[CLS] make a big push. [SEP] and he doesn ' t make it that way. [SEP] dr. david wilson and mark roth, now at the center for international statistics, found that the deficit dropped slightly, about 1, 000 billion, in the beginning of bush ' s presidency, the first time since president reagan took office - - 1977 - 78 and a decade ' s ago. [SEP] \" plus : we ' ve had more than a dozen, \" says the founder, mark young, who founded pop metrics a decade ago. [SEP] the woman is being held at a u. s. prison near paris. [SEP] the latest study, [SEP]", "detok_text": "[CLS] make a big push. [SEP] and he doesn't make it that way. [SEP] dr. david wilson and mark roth, now at the center for international statistics, found that the deficit dropped slightly, about 1, 000 billion, in the beginning of bush's presidency, the first time since president reagan took office - - 1977 - 78 and a decade's ago. [SEP] \"plus: we've had more than a dozen,\" says the founder, mark young, who founded pop metrics a decade ago. [SEP] the woman is being held at a u. s. prison near paris. [SEP] the latest study, [SEP]"}
+{"type": "sample", "index": 59, "raw_text": "[CLS] his family since he was released. [SEP] insp kevin spel, 45, from glenpamley, said at the time : \" this happened in a shocking and difficult way and i am aware that it is not going to go here. [SEP] the commission wants it to resolve the issue on tuesday. [SEP] he returned to the opera house in england for a decade, making 40 appearances before returning to germany. [SEP] on thursday, britain ' s international olympic committee announced its own list of more than 2, 000 athletes. [SEP] there ' s no one in this case and many others have been charged. [SEP] this summer, a peace [SEP]", "detok_text": "[CLS] his family since he was released. [SEP] insp kevin spel, 45, from glenpamley, said at the time: \" this happened in a shocking and difficult way and i am aware that it is not going to go here. [SEP] the commission wants it to resolve the issue on tuesday. [SEP] he returned to the opera house in england for a decade, making 40 appearances before returning to germany. [SEP] on thursday, britain's international olympic committee announced its own list of more than 2, 000 athletes. [SEP] there's no one in this case and many others have been charged. [SEP] this summer, a peace [SEP]"}
+{"type": "sample", "index": 60, "raw_text": "[CLS] north carolina, the state university of louisville, considering its course, and following its message. [SEP] they need to know what happens to change their behavior. [SEP] derek jeter, 27, won his first title and was full of surprises, and he lost a reputation for his fans. [SEP] the group that keeps him out is looking at the future. [SEP] however, she was not able to help the girl, who would be only eight weeks old on monday. [SEP] and then a slightly overdue way to keep the family car to the front shows you are a bit more prepared. [SEP] a recent study by the independent consumer research institute found [SEP]", "detok_text": "[CLS] north carolina, the state university of louisville, considering its course, and following its message. [SEP] they need to know what happens to change their behavior. [SEP] derek jeter, 27, won his first title and was full of surprises, and he lost a reputation for his fans. [SEP] the group that keeps him out is looking at the future. [SEP] however, she was not able to help the girl, who would be only eight weeks old on monday. [SEP] and then a slightly overdue way to keep the family car to the front shows you are a bit more prepared. [SEP] a recent study by the independent consumer research institute found [SEP]"}
+{"type": "sample", "index": 61, "raw_text": "[CLS] force. [SEP] this series will start jan. [SEP] the squeeze is likely to force labour ' s government to publish plans for a decline in the numbers this week. [SEP] in 1979, when yahio yama was known as an acting teacher, gwu was appointed first minister of history. [SEP] there was no mention of the administration ' s policy since the war took place. [SEP] it ' s a little tough to be able to get drunk over the weekend in the park with the children in one of iraq ' s darkest mountains. [SEP] the western conference would be the division ' s third postseason. [SEP] mr kington said he believed [SEP]", "detok_text": "[CLS] force. [SEP] this series will start jan. [SEP] the squeeze is likely to force labour's government to publish plans for a decline in the numbers this week. [SEP] in 1979, when yahio yama was known as an acting teacher, gwu was appointed first minister of history. [SEP] there was no mention of the administration's policy since the war took place. [SEP] it's a little tough to be able to get drunk over the weekend in the park with the children in one of iraq's darkest mountains. [SEP] the western conference would be the division's third postseason. [SEP] mr kington said he believed [SEP]"}
+{"type": "sample", "index": 62, "raw_text": "[CLS] - election committee. [SEP] britain ' s conservative leader, david cameron, said the move would shake confidence in the british government. [SEP] \" it ' s daily, so there ' s no problem here, \" he said. [SEP] \" we ' re still going to look at losses enough to have in the whole campaign, and that has to be consistent with the way mccain has used his campaign resources and coffers, \" wallace said. [SEP] but as congress faces its deadline, it ' s hard to begin to predict whether this is addressing issues related to the budget deficit. [SEP] the psg is not expected to have the quality or [SEP]", "detok_text": "[CLS] - election committee. [SEP] britain's conservative leader, david cameron, said the move would shake confidence in the british government. [SEP] \"it's daily, so there's no problem here,\" he said. [SEP] \"we're still going to look at losses enough to have in the whole campaign, and that has to be consistent with the way mccain has used his campaign resources and coffers,\" wallace said. [SEP] but as congress faces its deadline, it's hard to begin to predict whether this is addressing issues related to the budget deficit. [SEP] the psg is not expected to have the quality or [SEP]"}
+{"type": "sample", "index": 63, "raw_text": "[CLS] - hour range of 60 miles to 87 square kilometers ( 386 yards ) along the waters of the china sea. [SEP] venloce www. faug. co. uk. br / en / g2 & spredsboce. co. uk / newcroapert. br / g72, www. excp, www. en co. uk / stdidbriquila. co. il. [SEP] the report, detailing the names of those who were not in the room, was published yesterday. [SEP] i want to take the importance of working to the afghan people and the [SEP]", "detok_text": "[CLS] - hour range of 60 miles to 87 square kilometers (386 yards) along the waters of the china sea. [SEP] venloce www. faug. co. uk. br/en/g2 & spredsboce. co. uk/newcroapert. br/g72, www. excp, www. en co. uk/stdidbriquila. co. il. [SEP] the report, detailing the names of those who were not in the room, was published yesterday. [SEP] i want to take the importance of working to the afghan people and the [SEP]"}

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_diffusion_noise_steps_128steps_n64/noise_const1p45_early_cosine_eta0p05_c256_raw_samples.txt

@@ -0,0 +1,230 @@
+noise_const1p45_early_cosine_eta0p05_c256
+{
+  "type": "summary",
+  "name": "noise_const1p45_early_cosine_eta0p05_c256",
+  "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt",
+  "step": 187000,
+  "decode": {
+    "kind": "categorical_fullvocab_diffusion_state_noise",
+    "config": "noise_const1p45_early_cosine_eta0p05_c256",
+    "steps": 128,
+    "temp_start": 1.45,
+    "temp_end": 1.45,
+    "temp_schedule": "const",
+    "t_power": 1.0,
+    "eta0": 0.05,
+    "eta_schedule": "early_cosine",
+    "noise_conc": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 46.75523684526139,
+    "nll_per_token": 3.844926267541597,
+    "tokens": 9571
+  },
+  "diversity": {
+    "sample_entropy": 4.197912062162802,
+    "unique_tokens": 1922,
+    "token_count": 8192,
+    "distinct_1": 0.234619140625,
+    "distinct_2": 0.7121062992125984,
+    "top_token_mass": 0.0545654296875
+  }
+}
+
+===== sample 000 =====
+[CLS] but she will continue to hold it on her head. [SEP] the market began the week after bank of new york ' s lender dropped despite weaker economic conditions following last month ' s 3 - 4 percent rally. [SEP] paris says it aims to encourage energy consumption, and create a green economy based on fighting climate change and economic development. [SEP] the white house says several russian and european leaders are working on the u. s. plan, and will attend the next u. n. climate change summit, the senior white house said friday. [SEP] it found that 15 percent of students were in independent schools, compared with 18 percent of students in [SEP]
+
+===== sample 001 =====
+[CLS] moved from the fire station at bodne hall, kent, outside london. [SEP] bamako, indonesia, jan. [SEP] he gave me his job to talk to, then it was time to get out and get out. [SEP] the boy wasn ' t sure of what he meant, he was just, well, really, a sort of guy playing.... la. mississippi ' s heritage of sports and the present in the museums and galleries, the... in sports, the arts and sciences, its arts, and the.... ar. for more information about iras please visit www. iras [SEP]
+
+===== sample 002 =====
+[CLS] wouldn ' t expect him to go through with the rules. [SEP] u. s. president barack obama and the premier ' s office both said iran ' s foreign minister is urging the president to hold talks on the issue, currently on a trip to russia after two months of nuclear talks. [SEP] maybe you just don ' t know what an article is. [SEP] today, there are 13 league clubs in the state of minnesota, minnesota. [SEP] it is unclear both sides will ultimately work on an overall peace framework. [SEP] with a annual budget of $ 5m ( £8, 000 ), boa has spent the next four years in [SEP]
+
+===== sample 003 =====
+[CLS] brought to british justice... " a loss of professionalism, and a growing sense of social failure, " the jac report added. [SEP] meanwhile, clegg claims that the party ' s policy is to keep contact with mr mcelroy while the government attempts to work out on its form of youth policy. [SEP] two men, aged 18, 17, 15 and 20, have been arrested. [SEP] oklahoma state police chief george garrillo named four other people as 1st sgt. wayne davis, matt spalding, george clark, eric haugham and chris flowers. [SEP] he said the uk ' s power could [SEP]
+
+===== sample 004 =====
+[CLS] security agencies to coordinate with their authorities and provide more comprehensive surveillance of their operations. [SEP] chinese deputy foreign ministry official yulin hong told the beijing times on monday that his ministry would like to see china gain access to its no. 1 at the week ' s annual nuclear security meeting. [SEP] " i ' m out out there watching it, " brisco said. [SEP] if speaker nancy pelosi ' s position to put a deal to a new agreement on the climate treaty is known, obama ' s democratic foes will have to agree on important provisions to prove their support in the negotiations, she said. [SEP] and what [SEP]
+
+===== sample 005 =====
+[CLS], but the damage to the environment is minimal. [SEP] but what must be said, historians of politics - as well as the fears of political disruptions - dont seem to care. [SEP] the big question is that the owner will have to take an offer and the opportunity to be committed to our team. [SEP] " i hope to be the same golfer every day, " said woods in his defense of the game. [SEP] many afghans, who move into the country on friday of july 16, criticized the idea for moving in with the number of u. s. troops in the country. [SEP] mr. kedrosky said his [SEP]
+
+===== sample 006 =====
+[CLS] this will change, there ' s a resolution for north korea, " said jeffrey lerner, director of national policy at the national foreign policy center. [SEP] but i think there ' s a lot of pressure of time getting up with it, and if i ' m going home living in china, there is a limit to what i do. [SEP] the title now goes to the english national rugby league board ' s china - australia national championship. [SEP] the spat also happened in seoul on friday, after vice foreign minister stephen bosworth, china ' s defence minister, and his defense secretary urged their korean counterpart to attend the joint korea defence [SEP]
+
+===== sample 007 =====
+[CLS] mr bres, of the left, wants to run his people ' s party instead, and even redefine french politics by liberalizing policies and erewing fiscal reform - - a " liberal " talking point that he has never gotten away from that far. [SEP] the agreement between cricket and fa and england demands england host the world cup in 2013, creating england ' s premier football league. [SEP] london commuters are waking up to being told to live their own life. [SEP] moscow ( ap ) - russian prime minister vladimir putin said saturday he is " concerned at the prospect " of russia ' s claim to the post - war [SEP]
+
+===== sample 008 =====
+[CLS] last month, one day to get each side on track in the keystone state. [SEP] china represents 40 percent of the world ' s wine - producing population and only 4 million people in china. [SEP] new york ( ap ) - - the least enjoyable thing you will be able to use is a video game. [SEP] cleveland police has arrested a 38 - year - old man from telford after being charged with offences of sexual assault. [SEP] at least 18 years later, nick brydon, the chancellor, was named to the general election as the new leader in the new labour party, who won a whitewash general election victory when he [SEP]
+
+===== sample 009 =====
+[CLS] to 1 percent from 2007 levels. [SEP] he also said that britain would take its own appalling cost of oil - - almost to make it out of british politics into the wrong hands in europe. [SEP] " now the president says we ' re going to take all of this stuff out of it, all that stuff, " he said, apparently adding that mr. obama will just go up the road anyway. [SEP] yesterday, the bank said that the commercial property was drawn into the market price when the 2007 period ended with it with an estimated price in excess of £2. 6m in estimated value. [SEP] according to the 2003 study [SEP]
+
+===== sample 010 =====
+[CLS] of british monarchism at the prime minister ' s meeting, drew direct criticism from the public. [SEP] james is yet to get fit and should be in the squad for at least 10 days. [SEP] obama ' s campaign manager chris billington says the democrats have the experience and leadership credentials to build one that would not undermine compromise with washington. [SEP] japan said the jobless rate slipped 9. 5 percent to 10. 0 percent, the second straight decline from 9. 7 percent in july. [SEP] they learn about the election. [SEP] several did but they did not attend. [SEP] this is perhaps the first time mr cameron called for a national [SEP]
+
+===== sample 011 =====
+[CLS] that he and mr. edwards also spoke of his concern about health care, particularly its role in the obama administration, a point mr. clinton made to mr. ferrell on friday. [SEP] the lib leader admitted the government has failed to maintain its fiscal policies without hampering the national security of brits during gordon brown ' s 10 years. [SEP] hotel rates start at $ 2, and service costs are $ 25 to $ 40, with gas at $ 50 each. [SEP] the candidates say that experience, knowledge, experience and experience, education and knowledge are important. [SEP] that comes as investigators say the commission ' s lawyers, [SEP]
+
+===== sample 012 =====
+[CLS] on the second day wednesday. [SEP] the two nations have expressed efforts to stop the nuclear nuclear issue with iran using military force. [SEP] the park is open to the 250 gardeners living on public gardens. [SEP] cleveland, ohio ( ap ) - democrat barack obama is away from opting out of the party ' s politics - - and stepping down as a rival to be a republican president if she completes the democrat ' s health care plan, the obama campaign said. [SEP] john mccabe, national manager for the rac, said the data showed there were 3, 080 homes in the west coast region two years ago. [SEP] the [SEP]
+
+===== sample 013 =====
+[CLS] 30 four - party days since the 2001 address and includes more than two dozen party leaders. [SEP] mrs king, who works as an oilineries company, gas pipelines and chert power, had run seven pub companies in the last year but has now done more than a dozen legal jobs. [SEP] the administration has approved a plan that would would save about $ 30 billion annually over the next two years. [SEP] one member of the council was in iran ' s nuclear position at the time of the vote, but was now a high - level human rights envoy. [SEP] the finance ministry said the growth in u. s. private employment [SEP]
+
+===== sample 014 =====
+[CLS] as the man who has led india over the past four years, and now to roll out the cricket pitch. [SEP] " i hope we get him out, we can continue to do all we can to get in the game first. [SEP] that month, a head of the company ' s staff pushed back by saying that its site contained no news sources. [SEP] the other is anti - intellectual, anti - religious, and free - to - government. [SEP] revenue to give more members ' money to financial - services companies is worth about $ 1. 4 million annually, he said. [SEP] the volume of imports from iran, especially those of [SEP]
+
+===== sample 015 =====
+[CLS], russia ' s new minister of state, to discuss the policy of boosting investment by caspian countries over the caspian sea. [SEP] in 1997, the irish government published 17 pages of documents, including a public profile of joris viriss, the irish catholic leader in spain when the web site was declared illegal. [SEP] the pro - government demonstration is expected to last for most of the week, he said. [SEP] there was no indication that the meeting would have a clear leader at the top. [SEP] however, the company still is likely keen to secure significant sales support in the near term. [SEP] pakistan, which also acts as a [SEP]
+
+===== sample 016 =====
+[CLS]............. [SEP] we ' ll ask about climate change. [SEP] it also creates a new reputation for freedom. [SEP] my mother started my life, whipping through the back of her arm to her head and my body and feet fell into my head, ribs and my hands. [SEP] israeli officials said the movement focused on obama ' s policy goals as the new administration continues to focus on overhauling israeli policy before the next administration. [SEP] mrs. clinton said he wants to establish a strong clean energy policy, calling for growing renewable energy by the 21st century and using 40 percent, including energy [SEP]
+
+===== sample 017 =====
+[CLS] opened to the public in 1997. [SEP] the survey also showed young people becoming used to both sex and drugs, not education, not sex. [SEP] still, this means that though you may think he has to be talking about some people - - he would have known other people - - who don ' t really remember his mind, because he ' s black. [SEP] " obviously, i don ' t want to do this to get down on doing what he ' s doing. [SEP] do the same thing i say, because he has more money. [SEP] " we will stick to a very short timetable, " said fed chairman ben bernan [SEP]
+
+===== sample 018 =====
+[CLS] [SEP] ( cbs ) - a small cargo plane that crashed into crashed wednesday morning trying to touch down, killing an emergency landing in south africa. [SEP] he will bring real serious challenges to the team. [SEP] redknapp is the club ' s first - choice manager for five years, and venables has been named as first - team coach for next week ' s final. [SEP] the site of the project on fire is brown deer farm, one of the few undeveloped pennsylvania and largest of about 600 farms across the state. [SEP] in its name, the american culture now maintains its own sense of civility, excess, power and [SEP]
+
+===== sample 019 =====
+[CLS] with u. s. law enforcement agencies, field office and fbi and the fbi joint national security agency office of director of investigations. [SEP] the town put £2. 1m into the project to build the first ever river crossing, the bbc said. [SEP] use the device now and go to apple ' s smart website for $ 359 per month. [SEP] the prime minister also said china was willing to engage the north leader on its focus on non - proliferation, a move more than a commitment to give the new administration new impetus. [SEP] millennium park, orlando, tampa, 3 p. p. a. a., tampa fla [SEP]
+
+===== sample 020 =====
+[CLS] after a week... " on sunday. [SEP] and, of course there is also the number of people who have asked him to take that - - period of time - - george cleiss, george h. els, president george bush and robert gates, and anyone who, i don ' t know, say he ' s going to be asked. [SEP] tokyo, japan ( cnn ) - - john kudamo, who was born in japan and japan and lives in a japanese community in northern japan, is first formally elected as top leader of the country since he took office in april 2006, according to the japanese [SEP]
+
+===== sample 021 =====
+[CLS] health spokesman for cletts has said that he is under threat. [SEP] would mcnak ' s players care about him if he thought he could bring along his program? [SEP] china ' s premier experts forecast the economy to remain relatively robust and warn that china still maintains the goal of developing markets with the united states, provided the world could be prepared to develop a new global market to reduce emissions and spread innovative environmental technologies. [SEP] but economic growth probably will be more modest, helped by a rebound in a net netfall in the overall u. s. trade deficit, the report said. [SEP] but it was her mother, who [SEP]
+
+===== sample 022 =====
+[CLS] was expected to bring the school down to the university of miami. [SEP] but i want to know at least about palin. [SEP] he stars like sir chris nolan and british director john dae, the film ' s producing director, and matt dreuel in a new production of the cult film " living " ( don ' t be surprised ). [SEP] barack obama ' s plan to improve healthcare by cutting some workers ' benefits in january, which came with his announcement on nov. [SEP] he will be speaking at a meeting of the national museum of national and american history in the dc on wednesday night evening. [SEP] i think this [SEP]
+
+===== sample 023 =====
+[CLS] south africa in 2004. [SEP] but pavano is also the yankees ' star. [SEP] the bank is thought to have been forced to use the government money to support its finances during the credit crisis. [SEP] during the speech to give an update to the chinese government, the president held several discussions on how to calculate the status of the diplomatic effort, said david vidros, the spokesman. [SEP] the u. s. drug administration ' s office has said in the report, issued on september 13, 2006, that to the u. s. food and drug administration. [SEP] still, it ' s also likely to get warmer and [SEP]
+
+===== sample 024 =====
+[CLS]s. [SEP] one is now known as ho chi bouguza syndrome. [SEP] ha hak, hak, hak and ha hak report. [SEP] mr. hamm and carl icahn, two former executives at jp morgan and at jpmorgan and now chairman of u. s. truckmaker hyundai, were one of the first legal victims of venture capitalists. [SEP] general brumet said he expects the us will take two days to have a clear assurance that iraq will make progress to pull the deal back down. [SEP] i ' ve spent hours of time talking about those things. [SEP] the country could [SEP]
+
+===== sample 025 =====
+[CLS]. [SEP] islamabad, pakistan ( ap ) - - the white house said friday secretary of state hillary clinton was right to call for an international effort into global security and economic growth and to create a coalition of u. s. president barack obama and hillary clinton to barack obama. [SEP] these players do not wish to repeat their mistakes, particularly since they already have punishable number of players, but they do not have the time in the game to do the rest of the game. [SEP] the margin at the end of that age bracket - - 38 percent to 47 percent, 47. 2 percent - - indicates a decline in his chances of winning [SEP]
+
+===== sample 026 =====
+[CLS] budget deficit in the 2009 fiscal year. [SEP] the bank said that it would be able to increase its loan to € 18. 5 billion by the end of its € 40. 4 billion ( £250 billion ) fund to irish banks this year - - 11. 7 per cent more than a year because of bankruptcy. [SEP] the characters are small children, stuffed animals. [SEP] it wants to see more evidence. [SEP] this week, horreier published a new look at the cost of mexico : a 12, meter - long sculpture that was the first remnant of the museum, a 350 - foot statue in american vogue. [SEP] run by [SEP]
+
+===== sample 027 =====
+[CLS] high at $ 1, 676 dollars a gallon. [SEP] " the rest of the company is gone, " says the times co - founder. [SEP] but it ' s still raining and it ' s still not clear whether this will likely happen at the other end of the tunnel. [SEP] tuc general secretary andrew coates said it was important that older people should be aware of the risks of not screening children early and increase the amount of children involved in care. [SEP] but that success produced a few surprises for the hall of fame. [SEP] " i think in the end, in her own mind and mind, that he said, that [SEP]
+
+===== sample 028 =====
+[CLS] - moon. [SEP] and when he was injured, he made some great saves, " said assistant les quins. [SEP] 19 ( upi ) - - u. s. national security officials announced wednesday they had detained the leader of north korea and threatened to water down the country abroad over his actions. [SEP] " the problem is that western countries have been playing competitive with russia, " said john morici, an analyst at one of the nation ' s largest gas companies in georgia. [SEP] " one of the reasons for the survey is concerns about relationship opportunities, " said john gerber, ford senior vice president of international affairs and marketing [SEP]
+
+===== sample 029 =====
+[CLS] ruled in his favor. [SEP] it ' s an imitre to the game. [SEP] gasoline touched $ 1. 6192 a gallon while gasoline prices added 0. 3 per cent to $ 1. 8340 a gallon. [SEP] the 11 - year u. s. military tour program began in 1976. [SEP] in all areas, sales were 0. 7 % of sales and 5. 3 % of the 1. 1 million reported in the first three weeks of 2008. [SEP] according to u. s. data, the value of total assets dropped to be $ 40. 9 billion, compared to 40. 3 billion in february [SEP]
+
+===== sample 030 =====
+[CLS], however, were angry when they protested against the government ' s announcement. [SEP] hong kong ( reuters ) - sumitomo trust corp ( 28830. t ), the biggest south korean bank yet to seek hong kong government funds in 2008, may spend $ 15bn, according to media reported on friday. [SEP] two years after the westfield high school opened, the griffins plan to build a school school to expand and redesign its high school system. [SEP] " like someone who has started running, i ' ve just got to work hard the other time, " she said. [SEP] the administration ' s financial rescue plan, the treasury [SEP]
+
+===== sample 031 =====
+[CLS] says its rafah militant commander confirmed the israeli military wing had been killed in another attack on israel ' s gaza border. [SEP] the vice president ' s speech this week turned out to be a campaign first, " we thought it was the end and in mind, that was just starting to happen, " said mullen, co - chairman of the national republican party committee. [SEP] the development includes the kida project, a children ' s library development adjacent to the city of long beach, los angeles, just the second year of a five - year project in the outside world. [SEP] the move would also increase the company ' s ability [SEP]
+
+===== sample 032 =====
+[CLS] the current head of the terror organisation. [SEP] kibaki should use his election christmas day to reach out to support his cause. [SEP] like the rest of the world, the obama administration has given up the government of iraq over the hamas - led lebanon crisis, working on a strategic relationship with its neighbors and working with the american forces. [SEP] to date, net hedge funds for the year ending june 2008, however, show the amount of assets on the nation ' s main stock market falling to $ 3 billion, from $ 1 billion - - with just a year ' s worth of growth. [SEP] i am not bound for this, [SEP]
+
+===== sample 033 =====
+[CLS], mr. hagan served as a state senator, as well as the clinton campaign ' s secretary of civil rights and labor issues and was a central figure in mrs clinton ' s campaign that mrs clinton was repeatedly forced to resign. [SEP] and just like his mums back in the afternoon, he just started to look back, overstating the fact that nothing is there, the kind of thing that runs over the top. [SEP] u. s. air forces were moving deep into iraq ' s capital to conduct new ground operations on sunday. [SEP] the poll also found the difference between mr obama ' s conservative win over the mccain team [SEP]
+
+===== sample 034 =====
+[CLS]. [SEP] it ' s like a waste of two days spent doing a boston marathon. [SEP] according to the institute of personnel and management, it hit 357. 1m in december, construction dropped to 470. 1 in december and employment was 0. 6 to 363. 7 in december. [SEP] the move came on the first day of suspended new nuclear talks with the united states, putting pressure on the north to have it give up its nuclear test. [SEP] mr martin is widely expected to resign after he comes to a second election as first minister. [SEP] the region ' s most prominent news group, russian news, is threatening the [SEP]
+
+===== sample 035 =====
+[CLS] the captain. [SEP] this may also show that the state - sponsored program should reform the country ' s juvenile court system. [SEP] marsden, a 24 - year - old station manager from england, could be fined nearly 100, 000 pounds ( £145, 000 ) after he stole more than 15 pounds from police in just a few days, reports said. [SEP] u. s. officials have urged beijing ' s assertive leadership to send military action to japan ' s neighbors, saying they have used their last visit to asia to dismantle tense ties after the end of the country ' s first visit to the un. [SEP] aig [SEP]
+
+===== sample 036 =====
+[CLS]. foreign ministry spokesman james foxx said he does not agree with the offer mr netanyahu made after a trip recently to east jerusalem. [SEP] " if i can get back back to the last year, we can ' t go out there and get back - we can ' t go another day in april, " he said. [SEP] it all got moot as the model was speaking yesterday, making her way through an obstacle course that aims to break the conversation between sport and modern sport. [SEP] the british race for the world ' s biggest medal of the games is scheduled to begin on thursday. [SEP] he has a criminal record. [SEP]
+
+===== sample 037 =====
+[CLS] ' t make the playoffs, " new england general manager mark childress said later on wednesday after a meeting with england coach bill belichick. [SEP] in kenya ' s calumum county, almost all parts of the city, including kadishela, are still empty. [SEP] they came shortly after two were killed and nine others wounded in the western darzi valley, a small, mountainous tribal area of the shinkang river region, east of peshawar in northern pakistan. [SEP] why don ' t do both. [SEP] that, no better than the country ' s 7, 000 teachers, makes england a challenging and dangerous school [SEP]
+
+===== sample 038 =====
+[CLS] education. [SEP] the government insists the children should get done in school, but parents say they will be punished if they fail to give their children enough to succeed at school. [SEP] yesterday, while addressing the asia trade group, a leader ' s forum in washington to promote trade deals from asia and europe, mr. mccain also called on the president to sign " a good policy of engagement " with foreign trade, and his willingness to try to resolve the dispute. [SEP] smith said he learned that police had busted the case friday but gave only a comment for the ap. [SEP] " i do not know how i did. [SEP] obama and hillary [SEP]
+
+===== sample 039 =====
+[CLS] form the new government, mr cowen said. [SEP] they suggested that the first debate in the senate has been turned into a balance between a woman and the young woman who is more likely to be cast as a man, too, a member of the nation ' s political elite. [SEP] " it ' s a little too high, " obama said. [SEP] a u. s. navy pilot attempting to take off somalia jumped off his boat friday after a u. s. captain hit the ship. [SEP] after the film ' s premiere, aig took time to co - fug with the film ' s appealing mix of genres and [SEP]
+
+===== sample 040 =====
+[CLS] - en - jweg, the president of his hoatha party, post he has held for about 20 years. [SEP] osterer peromer exo leche, 67 - 4 d ' ente 4, 02 - 39 - 47669998. 50. [SEP] look for a news reporter in this remote area of the world. [SEP] the injured kerry collins, who caught up injuries in the first half of his six - year career with the broncos, and the atlanta defense didn ' t get into trouble in the final two weeks. [SEP] the plight of his best friends was compounded in january [SEP]
+
+===== sample 041 =====
+[CLS] gas stations. [SEP] the imf says its own trade deficit has " increased, " but calls for it to lower the current level level when it presents a monthly growth forecast this month. [SEP] in the mccain camp, however, that won ' t change the way he tackles the party ' s social issues. [SEP] " they call for help, so i think it got a bit out of line, " said john grassley, a former massachusetts democrat and the u. s. treasury secretary on health reform. [SEP] and they said, ' what ' s up at their feet, i don ' t know if it goes any farther, [SEP]
+
+===== sample 042 =====
+[CLS] across the border from the region. [SEP] mr. mccain said that he spoke to hillary clinton during a debate in tennessee on april 5, four weeks before the state of pennsylvania, and that she wanted to draw on her experience of the mccain campaign when she was with senator fred thompson of new york during the clinton administration. [SEP] don ' t let some people know they are better than they are......... and your haters..... tell them to get them. [SEP] " american gangster " opened officially on broadway saturday night at the manhattan theater, a small - screen show featuring william de la [SEP]
+
+===== sample 043 =====
+[CLS] demand. [SEP] without cleveland ' s j. d., the left - hander threw 47 balls and hit three runs before retiring three straight. [SEP] with four - half - dozen students, it is usually just a moment to talk to a young woman in the morning glare of the sun. [SEP] there has never been debate on a version of a budget. [SEP] mr. bush also has suggested that russia can still take a larger stake in iran. [SEP] and, while analysts said, the us authorities still did not seem to intervene, mr zhou cautioned it may be far more about simply printing money than telling the economy that it would [SEP]
+
+===== sample 044 =====
+[CLS] david birrell says there ' s doubt the victim ' s life is secure. [SEP] what ' s known about president obama ' s new strategy - - that his transition will change, perhaps not change, an intriguing, clear - cut argument for his personal standout on the iraq strategy is about to be made. [SEP] i ' m sure to even know well and go to my friends and maybe i ' ll start doing it when the train really gets on. [SEP] in his first meeting in downing street, paulson will offer how much britain can only support its central bank, but also the national bank. [SEP] it ' s hard to [SEP]
+
+===== sample 045 =====
+[CLS] severe respiratory problems, ansa reported. [SEP] " now, it ' s been tough at the top end of the game. [SEP] the government and the other parties signed the terms to be signed in 2010. [SEP] that ' s written in the right word of " the culture of market control, " the meaning of " wealth management " or how the globalized world recalifies them. [SEP] in the last two days, steven rawlinson, 18, and chris simons, 40, from lynham, manchester, appeared and ian holloway, 26, of brockwood, charged with their murder. [SEP] u. n. diplomats [SEP]
+
+===== sample 046 =====
+[CLS] the league ' s first national conference tournament. [SEP] the prime minister ' s foreign minister helen clark and mr lee met saturday at the dpk in tokyo. [SEP] his son spoke of the son, michael, who then stepped down as prime minister on september 12. [SEP] the government calls an election to allow early voting in the island ' s legislature. [SEP] it ' s built for a peak race, but there are 11, 000 during the first day of the race. [SEP] reporting from raleigh, n. c. - only 10 minutes later, obama was asked in a news conference whether he could have sen. hillary rodham clinton [SEP]
+
+===== sample 047 =====
+[CLS] the first time former president bush voiced his position last week after meeting with senator john warner ii of virginia to discuss the situation. [SEP] that ' s what we want to do, and know, what our allies are doing, but the problem now ' s not where it began today. [SEP] i ' ve been here for 40 years, " he said. [SEP] the company announced the loss of 2m jobs in january 2009 to finish its construction phase, with most of the work to take place in the autumn. [SEP] the announcement will not even prepare mr brown for a break from politics, and says that he does not expect him to remain [SEP]
+
+===== sample 048 =====
+[CLS] russian military says most of its soldiers. [SEP] i also know dozens of children from low - income families who would help to help me or help me. [SEP] maybe it ' s just just for the future. " [SEP] new york ( ap ) - - britain ' s economy plummeted in january and february while the global economy declined at a nearly 2 - percent pace over the previous quarter, the national conference of economic executives, reported tuesday. [SEP] meanwhile, the international finance committee forecast economic growth to drop to 4. 5 percent in the next three months on growing expectations that global demand will recover. [SEP] in a traditional way, china [SEP]
+
+===== sample 049 =====
+[CLS] to a few days of peace talks with the two news agencies. [SEP] i hit him in the officers ' head when i heard mr o ' brien ' s call. [SEP] he was 17 when he was accepted at the medical school of cambridge, before winning his english studies in the west midlands. [SEP] as it happened last night, there ' s almost nobody to be wanted to move around. [SEP] and the prime minister, who is attending the summit, will announce an increase in foreign investment and said america was building security. [SEP] in friday ' s statement to discuss the current situation, correa said he would authorize the meeting in [SEP]
+
+===== sample 050 =====
+[CLS] than in any of the world ' s economies, " he said. [SEP] the benchmark ipc - china index lost 5 % friday as investors questioned whether it was between the chinese government and beijing cic, which indicated they could not reach a deal. [SEP] retail spending in september shrank by at least 2 %, government data showed. [SEP] stanley ' s father, william clagne, left the then 17 - year old to new zealand, where he moved to stay with his wife. [SEP] and, with the help of most scientists, it ' s clear to many experts that the answer is a mystery. [SEP] however, [SEP]
+
+===== sample 051 =====
+[CLS] for the stock market and it ' s tough for the second quarter, " said paul ellis, world bank chief economist at rbs. [SEP] it ' s just a thin line of their blond hair that make the picture seem more comfortable and blue. [SEP] the awards ceremony will be held in the london venue at midnight on saturday. [SEP] don ' t forget that, you people should appreciate it. [SEP] the national guard says no one died on durango county ' s north side. [SEP] he lives with his wife, family and several young children and wants to work with the job protection and human rights issues at our service. [SEP] the same [SEP]
+
+===== sample 052 =====
+[CLS] said. [SEP] with the help of augusta, ga.,, she wants to show the way she lives, with her golf, and talk about sex addictions and family. [SEP] still, it ' s difficult to draw any conclusions from cnn ' s own film department. [SEP] and that was really, really worse. [SEP] israel ' s foreign minister yishem dabbagh said in geneva on tuesday israel is concerned about iran ' s ability to produce missile and missile technology to secure vital oil supplies. [SEP] 090bst : who is best man on the fa side? [SEP] at the super bowl at wembley later in the day [SEP]
+
+===== sample 053 =====
+[CLS] was run by his mother, laneh breah, the former landscape architect, who he and his father james smith have built the park since 1997. [SEP] tiger woods got a win to win on his final day, and the last year there ' d likely be no follow - up - - 14 days after tiger woods withdrew with a wrist injury. [SEP] but the socialist party has shown growing frustration with the government ' s mission. [SEP] you see, i think i will tell you the thing about money. [SEP] the federal government is under increasing pressure to show exactly how much of that is needed. [SEP] after six months, he was [SEP]
+
+===== sample 054 =====
+[CLS] the way. [SEP] obama has made a television effort to moderate the speech, the paper said. [SEP] the report shows that only 2. 3 % of the children are recsupervising by choosing to start a baby with a boyfriend, or to pay for their child to be part of a more comfortable life. [SEP] " you can ' t tell if there ' s much of this, it ' s such a secret, " hayter said. [SEP] " people tend to think you don ' t have to cut back or get back together. [SEP] of course he would lose one of those delegates for obama. [SEP] john edwards, [SEP]
+
+===== sample 055 =====
+[CLS] it. [SEP] mr obama said congressional democrats needed to rethinkse their support to the bill. [SEP] i ' m excited about it, though, " he said. [SEP] author will smith has cited his work in the field of sexual problems and drugs in his thoughts on younger children. [SEP] now that he ' s the last man to stand on his heels, he is using the argument that this is america ' s key to the party ' s success. [SEP] economist alan packer has noted that the scope of this struggling economy is much broader than california, and that large areas of lending to private equity and debt - - private equity [SEP]
+
+===== sample 056 =====
+[CLS] korea, and china and india. " [SEP] " in the end, i thought john mccain and i couldn ' t agree, and the way they have all been displeaded to have put their feet down in real time, " mccain said later, asked about the candidate ' s experience with running for president. [SEP] washington ( ap ) - halliburton corp., the world ' s largest independent oil services group, controls oil production in the u. s. midwest and is the one - fifth - largest operator of the domestic natural gas sector. [SEP] palin ' s publicist, rebecca ceveller, has [SEP]
+
+===== sample 057 =====
+[CLS] reagan national center, the international space center and the world trade center. [SEP] the u. s. state department said it came during an important meeting with china, india, brazil, south korea, singapore and korea, after a high - level visit led by china ' s foreign minister hideki sengou to press us sanctions against china. [SEP] it ' s an interesting point, " he says. [SEP] it ' s not a sign of iran ' s hope for an end. [SEP] " the number of homebuyers in the u. s. housing market has fallen, but it ' s not clear whether, beyond the [SEP]
+
+===== sample 058 =====
+[CLS] care of the house bill and focus on health care reform, mr. mcmaster said. [SEP] " everyone knows this, and it ' s the same thing as the party, and there ' s a minister ' s call to make people feel safer.... [SEP] " you know, ' it may take more than a few months, and you don ' t get much back '. [SEP] " we ' re still below the level it was five years ago, " he said. [SEP] awb bank has a total balance of $ 10bn in short - term debt. [SEP] " i saw him and was very aggressive and was [SEP]
+
+===== sample 059 =====
+[CLS] the origins of the financial crisis, and offering financial advice for officials from the european union to re - establish contacts and find a clearer understanding of the crisis within the organization. [SEP] he says that in the future it will be impossible to resolve the greek crisis and renegotiate its own debts, as in future, it could face foreign intervention. [SEP] the other defendants were cleared of the charge in 2 months to 10 years. [SEP] only the last election i have heard of any such thing. [SEP] this is the latest outbreak of a large - scale outbreak of the disease that killed tens of thousands of people. [SEP] but he suggested that [SEP]
+
+===== sample 060 =====
+[CLS] " and it has been a lag at the moment. [SEP] the league says the faith schools ' actions in this case are clear. [SEP] almost all of children aged 18 - 5 are over the age of primary school. [SEP] what i will call " balance, " which is given great respect, something that even a fan of the game could not pay attention to, makes it sound more relevant. [SEP] and, after law school, he had lived in southeast london for more than 40 years. [SEP] thankfully, that doesn ' t work. [SEP] but the logic of spain ' s decision to build a proposed human rights commission is still thought [SEP]
+
+===== sample 061 =====
+[CLS] of trying to get a government bailout. [SEP] the truth is that, while the chinese government has almost chosen not to provide its own emergency fund, the local economy has suffered in its own way. [SEP] 28 ( upi ) - - a 64 - year - old man was shot to death when his mother left a car outside of baltimore on monday, police said. [SEP] though he had been only scheduled to release his party ' s budget plans earlier this month, he announced that winning the general election would be the result of " a long and determined policy and public sector effort " led by his government. [SEP] in the meantime, [SEP]
+
+===== sample 062 =====
+[CLS] the military ' s chief envoy for iraq, gen. gen david petraeus, was holding an internal iraq war discussion with a senior military commander in baghdad. [SEP] the chief said he doesn ' t plan to file a lawsuit. [SEP] she turned away from politics. [SEP] dr lipsey, the children ' s development secretary, said the tory government was right to be drawn away from the link projects because the decision of the central government to build a network of motorway services is controversial. [SEP] the car ' s design is designed by japanese designer yakita hagi - - inspired by panurino ' s sister kazuchichi. [SEP]
+
+===== sample 063 =====
+[CLS] s. box office film industry is expected to reach $ 14 billion in revenue over the next three years. [SEP] intelligence is now a critical part of the national intelligence effort, but much modern technology cannot be trusted. [SEP] last year he spent more than $ 3 million on his own foundation, according to the state attorney general ' s office. [SEP] the car driver was not pronounced dead. [SEP] the number means mr brown is set to spend a lot, but mr cameron will not. [SEP] " hopefully this will be the closest national election that will happen to the iraqi parliament this year, especially elections for june elections, " sana said. [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_diffusion_noise_steps_128steps_n64/noise_const1p45_early_linear_eta0p02_c256_scored.jsonl

@@ -0,0 +1,65 @@
+{"type": "summary", "name": "noise_const1p45_early_linear_eta0p02_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "noise_const1p45_early_linear_eta0p02_c256", "steps": 128, "temp_start": 1.45, "temp_end": 1.45, "temp_schedule": "const", "t_power": 1.0, "eta0": 0.02, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 44.65909863566894, "nll_per_token": 3.7990580633975197, "tokens": 9575}, "diversity": {"sample_entropy": 4.198494329382783, "unique_tokens": 1963, "token_count": 8192, "distinct_1": 0.2396240234375, "distinct_2": 0.7079232283464567, "top_token_mass": 0.05419921875}}
+{"type": "sample", "index": 0, "raw_text": "[CLS] barack obama will continue to face in america. [SEP] during an american conference with iraqi leaders starting next month, obama focused on rebuilding u. s. relations as a means of working on other issues on how it will build in the next decade. [SEP] pakistani security forces at least 16 people, including at least eight people, have died and left seven wounded, while several civilians have been killed in the violence, killing 13 people. [SEP] nagin also asked that the u. s. government make an announcement on the status of his case. [SEP] washington - only 15 percent of democratic voters will say yes, compared with 25 percent of independent - [SEP]", "detok_text": "[CLS] barack obama will continue to face in america. [SEP] during an american conference with iraqi leaders starting next month, obama focused on rebuilding u. s. relations as a means of working on other issues on how it will build in the next decade. [SEP] pakistani security forces at least 16 people, including at least eight people, have died and left seven wounded, while several civilians have been killed in the violence, killing 13 people. [SEP] nagin also asked that the u. s. government make an announcement on the status of his case. [SEP] washington - only 15 percent of democratic voters will say yes, compared with 25 percent of independent - [SEP]"}
+{"type": "sample", "index": 1, "raw_text": "[CLS] matter, or whatever. [SEP] boehmam vandemamam bodemam, germany, jan. [SEP] now, in his job as a journalist, he found himself with both legal problems and other problems. [SEP] but i don ' t have the mental experience to do it. [SEP] time for the news and media.... dc. professional sports or business media. their school of sports. the expertise in pro sports, writing, the... in the arts, education, science, visual arts, and the.... vi. education and arts. [SEP] at other times, michiganʼs [SEP]", "detok_text": "[CLS] matter, or whatever. [SEP] boehmam vandemamam bodemam, germany, jan. [SEP] now, in his job as a journalist, he found himself with both legal problems and other problems. [SEP] but i don't have the mental experience to do it. [SEP] time for the news and media.... dc. professional sports or business media. their school of sports. the expertise in pro sports, writing, the... in the arts, education, science, visual arts, and the.... vi. education and arts. [SEP] at other times, michiganʼs [SEP]"}
+{"type": "sample", "index": 2, "raw_text": "[CLS] don ' t expect sales to keep up with its customers. [SEP] u. s. immigration spokesman crayin venkas said quiroe was traveling in nashville, tenn., when he received a call tuesday morning on a north alabama interstate about two miles north of houston. [SEP] \" i just don ' t know what the president says. [SEP] we would strive for fairness and reconciliation within the state, \" said ms. bibb. [SEP] rather, she treated it as an appendion. [SEP] the other 19 victims were all aged between 16 and 26, between 15 and 17. [SEP] after the announcement last month, [SEP]", "detok_text": "[CLS] don't expect sales to keep up with its customers. [SEP] u. s. immigration spokesman crayin venkas said quiroe was traveling in nashville, tenn., when he received a call tuesday morning on a north alabama interstate about two miles north of houston. [SEP] \"i just don't know what the president says. [SEP] we would strive for fairness and reconciliation within the state,\" said ms. bibb. [SEP] rather, she treated it as an appendion. [SEP] the other 19 victims were all aged between 16 and 26, between 15 and 17. [SEP] after the announcement last month, [SEP]"}
+{"type": "sample", "index": 3, "raw_text": "[CLS] westvell, the legislature ' s former director of public safety, says the bill will save $ 500, 000 during the next five years. [SEP] \" i feel like a hard decision but it ' s a big hard decision, \" he added. [SEP] ( ap ) - state officials in the eastern state of georgia, where a suspected car collision left 14 people dead and 15 injured in a double wreck, say it is too early to determine why the suspect is responsible. [SEP] in 1999, the county built about 545 schools, and 1, 000 acres of land in 15 states. [SEP] he said the uk ' s chief economist [SEP]", "detok_text": "[CLS] westvell, the legislature's former director of public safety, says the bill will save $500, 000 during the next five years. [SEP] \"i feel like a hard decision but it's a big hard decision,\" he added. [SEP] (ap) - state officials in the eastern state of georgia, where a suspected car collision left 14 people dead and 15 injured in a double wreck, say it is too early to determine why the suspect is responsible. [SEP] in 1999, the county built about 545 schools, and 1, 000 acres of land in 15 states. [SEP] he said the uk's chief economist [SEP]"}
+{"type": "sample", "index": 4, "raw_text": "[CLS] improve language instruction, with more opportunities and help students develop and develop critical skills. [SEP] it could be better with government controls on investments such as carbon trading. [SEP] \" the problem with the numbers is for this guy to be no. 1 overall, we ' re happy to see that. [SEP] \" i am not out of there watching people, \" gillispie said. [SEP] senate leader harry reid called wednesday ' s senate meeting to be limited to a vote by his side, who is expected to attach the provision to the care bill later this week. [SEP] and while still a confectioner, mr. ackerman found [SEP]", "detok_text": "[CLS] improve language instruction, with more opportunities and help students develop and develop critical skills. [SEP] it could be better with government controls on investments such as carbon trading. [SEP] \"the problem with the numbers is for this guy to be no. 1 overall, we're happy to see that. [SEP]\" i am not out of there watching people, \" gillispie said. [SEP] senate leader harry reid called wednesday's senate meeting to be limited to a vote by his side, who is expected to attach the provision to the care bill later this week. [SEP] and while still a confectioner, mr. ackerman found [SEP]"}
+{"type": "sample", "index": 5, "raw_text": "[CLS], but the damage to the property is minimal. [SEP] \" they should be sitting on the brink of doing very well in the minds of the world, we will be lost to those scorched people and jihadists, and, crucially, the most middle - aged, disengaged people. [SEP] that ' s probably workable and will probably be less complex than what you would expect during the recession. [SEP] \" we are going to move into the country at a critical time, \" said gen. jim mcginn, head of u. s. air force command, which announced the plan. [SEP] government officials said [SEP]", "detok_text": "[CLS], but the damage to the property is minimal. [SEP] \"they should be sitting on the brink of doing very well in the minds of the world, we will be lost to those scorched people and jihadists, and, crucially, the most middle - aged, disengaged people. [SEP] that's probably workable and will probably be less complex than what you would expect during the recession. [SEP]\" we are going to move into the country at a critical time, \" said gen. jim mcginn, head of u. s. air force command, which announced the plan. [SEP] government officials said [SEP]"}
+{"type": "sample", "index": 6, "raw_text": "[CLS] suggesting that agreement should be reached before working on the issue, the newspaper said. [SEP] mr lubna is hugely active in kenya, trying to build business for the government in the heart of africa ' s big oil industry and establishing trade as a way of growing national wealth. [SEP] in 1953, stubbs went to a business school, played football and private sports programs in the country and eventually won 34 medals, including the english national title. [SEP] the campaign also made a more prominent case for the abuse of the church, including its meeting with a broader group, including latin american conservatives. [SEP] j. p. morgan and goldman sachs [SEP]", "detok_text": "[CLS] suggesting that agreement should be reached before working on the issue, the newspaper said. [SEP] mr lubna is hugely active in kenya, trying to build business for the government in the heart of africa's big oil industry and establishing trade as a way of growing national wealth. [SEP] in 1953, stubbs went to a business school, played football and private sports programs in the country and eventually won 34 medals, including the english national title. [SEP] the campaign also made a more prominent case for the abuse of the church, including its meeting with a broader group, including latin american conservatives. [SEP] j. p. morgan and goldman sachs [SEP]"}
+{"type": "sample", "index": 7, "raw_text": "[CLS], \" said mark l. west, a senior director of national defense council in washington, echoing f. c. a. president george w. bush ' s call for a mid - term military strategy meant to prevent a crisis of violence on the ground in afghanistan. [SEP] associated press writers jay hughes, pat sullivan in phoenix and greg lederer in san diego county also contributed to this report. [SEP] the proposed network has been seen as a way to prejuvene the east coast of the capital by speeding the network of rail and rail traffic to the 2, 000 - seat main shopping center serving south baltimore and st. [SEP]", "detok_text": "[CLS], \" said mark l. west, a senior director of national defense council in washington, echoing f. c. a. president george w. bush's call for a mid - term military strategy meant to prevent a crisis of violence on the ground in afghanistan. [SEP] associated press writers jay hughes, pat sullivan in phoenix and greg lederer in san diego county also contributed to this report. [SEP] the proposed network has been seen as a way to prejuvene the east coast of the capital by speeding the network of rail and rail traffic to the 2, 000 - seat main shopping center serving south baltimore and st. [SEP]"}
+{"type": "sample", "index": 8, "raw_text": "[CLS] last month, one day to mark mccain as vice president for the united states. [SEP] in addition, eight of the nation ' s top financial services banks received about £3 billion more from the deal, compared with the third - largest in barclays capital history that will be able to repay the £20 billion the government has needed. [SEP] a 38 - year - old man who hit and fired a gun at a teenage boy in cheshire has been formally accused of assault a man and beating and killing the boy, whom he paid for sex. [SEP] she will take over as finance minister for what could become a critical time at the bank of england [SEP]", "detok_text": "[CLS] last month, one day to mark mccain as vice president for the united states. [SEP] in addition, eight of the nation's top financial services banks received about £3 billion more from the deal, compared with the third - largest in barclays capital history that will be able to repay the £20 billion the government has needed. [SEP] a 38 - year - old man who hit and fired a gun at a teenage boy in cheshire has been formally accused of assault a man and beating and killing the boy, whom he paid for sex. [SEP] she will take over as finance minister for what could become a critical time at the bank of england [SEP]"}
+{"type": "sample", "index": 9, "raw_text": "[CLS] and antinial projector. [SEP] he is also chairman of the barclays football league and the house of sport committee, where it is the subject of a report on the new format in football. [SEP] if you want to change you ' re going to start and talk about the cause of it and then do it, \" he said. [SEP] it is clear this year that investors held up a higher offer for dubai world, which they had never expected to do much earlier. [SEP] he and israel ' s prime minister, george w. bush, met here ahead of a series of military meetings in the mediterranean region during the next three [SEP]", "detok_text": "[CLS] and antinial projector. [SEP] he is also chairman of the barclays football league and the house of sport committee, where it is the subject of a report on the new format in football. [SEP] if you want to change you're going to start and talk about the cause of it and then do it, \" he said. [SEP] it is clear this year that investors held up a higher offer for dubai world, which they had never expected to do much earlier. [SEP] he and israel's prime minister, george w. bush, met here ahead of a series of military meetings in the mediterranean region during the next three [SEP]"}
+{"type": "sample", "index": 10, "raw_text": "[CLS] if we get to this point we will see that they are distractions than in the past. [SEP] i really hope to get there, i can return to my pent of affection for the music. [SEP] mr mullen also said it was not about a coalition war because he believed that our troops were working effectively against the taliban insurgency. [SEP] mr paul is a leader of the city ' s political class. [SEP] you know, they ' d probably prefer the type of having a car. [SEP] they promised about $ 3. 25 billion, but they did not elaborate. [SEP] this is rare. [SEP] rosnek, a computer [SEP]", "detok_text": "[CLS] if we get to this point we will see that they are distractions than in the past. [SEP] i really hope to get there, i can return to my pent of affection for the music. [SEP] mr mullen also said it was not about a coalition war because he believed that our troops were working effectively against the taliban insurgency. [SEP] mr paul is a leader of the city's political class. [SEP] you know, they'd probably prefer the type of having a car. [SEP] they promised about $3. 25 billion, but they did not elaborate. [SEP] this is rare. [SEP] rosnek, a computer [SEP]"}
+{"type": "sample", "index": 11, "raw_text": "[CLS], he said mr. slomman asked his family about her son, and his mother, the two men who were dead. [SEP] mr mccain said this question need not be ignored. [SEP] over the last year, the government has been asked to spend about 75 billion euros on green technologies while its major partners spend 47 billion on central bank guarantee systems. [SEP] \" this is the first time in this season that we brought this season to the end, \" garriton said. [SEP] the conservatives say the system gives them a chance to challenge the national identity of the people. [SEP] mccain ' s camp said that as a matter of months [SEP]", "detok_text": "[CLS], he said mr. slomman asked his family about her son, and his mother, the two men who were dead. [SEP] mr mccain said this question need not be ignored. [SEP] over the last year, the government has been asked to spend about 75 billion euros on green technologies while its major partners spend 47 billion on central bank guarantee systems. [SEP] \"this is the first time in this season that we brought this season to the end,\" garriton said. [SEP] the conservatives say the system gives them a chance to challenge the national identity of the people. [SEP] mccain's camp said that as a matter of months [SEP]"}
+{"type": "sample", "index": 12, "raw_text": "[CLS] \" you ' ll see what ' s happening, people just have to stop turning to the outside world, \" he said. [SEP] saturday was the second night of their tour, in the second half. [SEP] columbus, ohio ( ap ) - president barack obama - - a political figure out of the president ' s hands - - has stepped down as a national security adviser after nine days of televised talks over washington ' s health care system, the obama campaign said. [SEP] little more than two years later, chinese researchers have identified china ' s booming international heroin trade, and studies in the east andean region confirm that remains. [SEP] the [SEP]", "detok_text": "[CLS] \"you'll see what's happening, people just have to stop turning to the outside world,\" he said. [SEP] saturday was the second night of their tour, in the second half. [SEP] columbus, ohio (ap) - president barack obama - - a political figure out of the president's hands - - has stepped down as a national security adviser after nine days of televised talks over washington's health care system, the obama campaign said. [SEP] little more than two years later, chinese researchers have identified china's booming international heroin trade, and studies in the east andean region confirm that remains. [SEP] the [SEP]"}
+{"type": "sample", "index": 13, "raw_text": "[CLS] first four - party conference since the november address and includes more than two dozen party leaders. [SEP] mrs bosworth also criticised the government ' s failure to achieve a long - term plan. [SEP] \" i think we ' ve seen a lot of progress in the last few days, not just the level of voter registration, \" republican national election committee chairman tom grassley said in a statement sent to the committee. [SEP] the members of the national maritime patrol union, the air force, the national coastguard service, will join the royal navy royal navy team in support. [SEP] the bank also said the growth in u. s. growth and [SEP]", "detok_text": "[CLS] first four - party conference since the november address and includes more than two dozen party leaders. [SEP] mrs bosworth also criticised the government's failure to achieve a long - term plan. [SEP] \"i think we've seen a lot of progress in the last few days, not just the level of voter registration,\" republican national election committee chairman tom grassley said in a statement sent to the committee. [SEP] the members of the national maritime patrol union, the air force, the national coastguard service, will join the royal navy royal navy team in support. [SEP] the bank also said the growth in u. s. growth and [SEP]"}
+{"type": "sample", "index": 14, "raw_text": "[CLS] what work can be done over the current crisis in coming years, and also to figure out the best ways its members should address their needs. [SEP] i don ' t know as to why you can just pay your mortgage back. [SEP] alison ringer, the head of birmingham children ' s hospital, said she has been told to take all medical drugs. [SEP] the series ended with the game in a news conference, and fans wanted to hear more. [SEP] but to make books more accessible, the reader will be able to upgrade to $ 1. 50, according to the release. [SEP] meanwhile, the california democrat is seeking to make similar [SEP]", "detok_text": "[CLS] what work can be done over the current crisis in coming years, and also to figure out the best ways its members should address their needs. [SEP] i don't know as to why you can just pay your mortgage back. [SEP] alison ringer, the head of birmingham children's hospital, said she has been told to take all medical drugs. [SEP] the series ended with the game in a news conference, and fans wanted to hear more. [SEP] but to make books more accessible, the reader will be able to upgrade to $1. 50, according to the release. [SEP] meanwhile, the california democrat is seeking to make similar [SEP]"}
+{"type": "sample", "index": 15, "raw_text": "[CLS], russia ' s new minister of state, will meet putin and his prime minister counterpart at a meeting in moscow on thursday. [SEP] education results were the main reason for the rise in children, including the study that 71 % said that mums were more concerned about a level of race than someone else was ageing. [SEP] the way the job goes, i feel more focused, more personal, \" he said. [SEP] obama is pretty clear in his statement that he seems to have got the full bill. [SEP] he ' s still trying to appeal to his members and support during the election day. [SEP] sedona, known as \" [SEP]", "detok_text": "[CLS], russia's new minister of state, will meet putin and his prime minister counterpart at a meeting in moscow on thursday. [SEP] education results were the main reason for the rise in children, including the study that 71 % said that mums were more concerned about a level of race than someone else was ageing. [SEP] the way the job goes, i feel more focused, more personal, \"he said. [SEP] obama is pretty clear in his statement that he seems to have got the full bill. [SEP] he's still trying to appeal to his members and support during the election day. [SEP] sedona, known as\" [SEP]"}
+{"type": "sample", "index": 16, "raw_text": "[CLS] to bailout.... [SEP] the atmosphere was tense. [SEP] the council will ask for a new children ' s school to develop plans for the property. [SEP] in the later years, the haitians made the region better - known as cabrios, congregateers, tourists, local residents and local residents. [SEP] board members said tuesday they disagreed with obama ' s decision to scrap the \" best - to - do list \" of candidates in the statehouse. [SEP] mrs. clinton said he wants to establish a \" national security spirit \" in order to get america to the 21st century. [SEP] a large - screen television [SEP]", "detok_text": "[CLS] to bailout.... [SEP] the atmosphere was tense. [SEP] the council will ask for a new children's school to develop plans for the property. [SEP] in the later years, the haitians made the region better - known as cabrios, congregateers, tourists, local residents and local residents. [SEP] board members said tuesday they disagreed with obama's decision to scrap the \"best - to - do list\" of candidates in the statehouse. [SEP] mrs. clinton said he wants to establish a \"national security spirit\" in order to get america to the 21st century. [SEP] a large - screen television [SEP]"}
+{"type": "sample", "index": 17, "raw_text": "[CLS] opened to the public in 1997. [SEP] i thought he was fine, being able to play his game, hit the ball, but to live with me, and as a manager, i want to know what he did about this guy - - i ' d say just that - - i don ' t think how this guy could get in to this when the same team comes off and say ' don ' t sit and gist down ' and try to deal with him. [SEP] \" the big task is secure, \" he told radio liberty. [SEP] \" we will stick to a very different approach to what we need now to re - [SEP]", "detok_text": "[CLS] opened to the public in 1997. [SEP] i thought he was fine, being able to play his game, hit the ball, but to live with me, and as a manager, i want to know what he did about this guy - - i'd say just that - - i don't think how this guy could get in to this when the same team comes off and say' don't sit and gist down' and try to deal with him. [SEP] \"the big task is secure,\" he told radio liberty. [SEP] \" we will stick to a very different approach to what we need now to re - [SEP]"}
+{"type": "sample", "index": 18, "raw_text": "[CLS] a deal reached with the south african government just days after president mw ki kibaki indicated his willingness to push for negotiations with south africa. [SEP] the arsenal manager gets a good look here, and harry redknapp is the spurs manager. [SEP] the premier league journal reported on tuesday morning that german sports has formally submitted a season - sales plan to the european court. [SEP] but increasing the number of reactors at current levels will raise concerns about the level of work the nuclear programme works to cut carbon dioxide emissions over the next three - year period. [SEP] it ' s unique in its own way, he said. [SEP] the british newspaper [SEP]", "detok_text": "[CLS] a deal reached with the south african government just days after president mw ki kibaki indicated his willingness to push for negotiations with south africa. [SEP] the arsenal manager gets a good look here, and harry redknapp is the spurs manager. [SEP] the premier league journal reported on tuesday morning that german sports has formally submitted a season - sales plan to the european court. [SEP] but increasing the number of reactors at current levels will raise concerns about the level of work the nuclear programme works to cut carbon dioxide emissions over the next three - year period. [SEP] it's unique in its own way, he said. [SEP] the british newspaper [SEP]"}
+{"type": "sample", "index": 19, "raw_text": "[CLS] falosing speeches, clinton went away at huckabee and the republican national convention, said bruce alderson, a senior research and policy director at the national policy institute and director of the conservancy center in san francisco. [SEP] the professor, a fellow of the university ' s engineering department, said it was not unusual. [SEP] the house passed the measure to vote thursday so we ' re working on any health care package in any way. [SEP] house armed services chairman john kerry, d - - s. d., a democrat in committee, defended the white house ' s healthcare bill to the house of representatives [SEP]", "detok_text": "[CLS] falosing speeches, clinton went away at huckabee and the republican national convention, said bruce alderson, a senior research and policy director at the national policy institute and director of the conservancy center in san francisco. [SEP] the professor, a fellow of the university's engineering department, said it was not unusual. [SEP] the house passed the measure to vote thursday so we're working on any health care package in any way. [SEP] house armed services chairman john kerry, d - - s. d., a democrat in committee, defended the white house's healthcare bill to the house of representatives [SEP]"}
+{"type": "sample", "index": 20, "raw_text": "[CLS] people ) was pretty good. \" said david greenman, founder of appliance. [SEP] you can find a pr man, here in that middle - seat of a car with eyecracks, bonnets, hoods, turtlenecks and golf clubs, who has a chance to show the public eye, but he is just about to get there. [SEP] tokyo, japan ( cnn ) - - - president barack obama named clinton his ambassador to japan after a seoul visit on saturday and the white house said he wants to establish the trade relationship of the united states and the japanese government in exchange for foreign aid to the north [SEP]", "detok_text": "[CLS] people ) was pretty good. \" said david greenman, founder of appliance. [SEP] you can find a pr man, here in that middle - seat of a car with eyecracks, bonnets, hoods, turtlenecks and golf clubs, who has a chance to show the public eye, but he is just about to get there. [SEP] tokyo, japan (cnn) - - - president barack obama named clinton his ambassador to japan after a seoul visit on saturday and the white house said he wants to establish the trade relationship of the united states and the japanese government in exchange for foreign aid to the north [SEP]"}
+{"type": "sample", "index": 21, "raw_text": "[CLS] colonel mark perry, who was also a military employee at the time. [SEP] dysshank ' s teenage father had asked if he thought he could bring home the bird. [SEP] gm ' s majority owner, american international group group, has not said that it still wants to use the international lender ' s hand in acquiring the foreign assets. [SEP] as he speaks about president barack obama ' s desire to fight terrorism in the hands of his democratic predecessors, he also will not support his repeated call for a mortgage meltdown in the entire u. s. financial system, his office said. [SEP] but mcquaidt, who [SEP]", "detok_text": "[CLS] colonel mark perry, who was also a military employee at the time. [SEP] dysshank's teenage father had asked if he thought he could bring home the bird. [SEP] gm's majority owner, american international group group, has not said that it still wants to use the international lender's hand in acquiring the foreign assets. [SEP] as he speaks about president barack obama's desire to fight terrorism in the hands of his democratic predecessors, he also will not support his repeated call for a mortgage meltdown in the entire u. s. financial system, his office said. [SEP] but mcquaidt, who [SEP]"}
+{"type": "sample", "index": 22, "raw_text": "[CLS] schaeffer, director and director of the office of media affairs, shari canter, npr program director ; nabar parr, director of communications ; and susan yarrow, general, the agency ' s group director for public and human relations. [SEP] washington, d. c. : don ' t expect to hear this from president, g. g. obama ' s call for ambitious efforts to reduce healthcare costs, republicans said on monday. [SEP] he does not have to. [SEP] he refused to talk about the financial crisis, which he said he could not handle without the war in iraq or afghanistan. [SEP] i always do [SEP]", "detok_text": "[CLS] schaeffer, director and director of the office of media affairs, shari canter, npr program director; nabar parr, director of communications; and susan yarrow, general, the agency's group director for public and human relations. [SEP] washington, d. c.: don't expect to hear this from president, g. g. obama's call for ambitious efforts to reduce healthcare costs, republicans said on monday. [SEP] he does not have to. [SEP] he refused to talk about the financial crisis, which he said he could not handle without the war in iraq or afghanistan. [SEP] i always do [SEP]"}
+{"type": "sample", "index": 23, "raw_text": "[CLS] $ 5 per person. [SEP] a short time later. [SEP] the news channel, a british and established uk news channel, is offering educational services aimed at boosting learning and knowledge throughout the school year, while using twitter technology to give pupils time to apply themselves to the classroom. [SEP] the local cornish culture council has failed, says mr wilson, who said he wanted to help with the site. [SEP] the u. u. n. ' s conference on the reduction of nuclear armed states took place on july 4, the day after german foreign minister cede jung. [SEP] the u. s. department of homeland security department will be investigating [SEP]", "detok_text": "[CLS] $5 per person. [SEP] a short time later. [SEP] the news channel, a british and established uk news channel, is offering educational services aimed at boosting learning and knowledge throughout the school year, while using twitter technology to give pupils time to apply themselves to the classroom. [SEP] the local cornish culture council has failed, says mr wilson, who said he wanted to help with the site. [SEP] the u. u. n.'s conference on the reduction of nuclear armed states took place on july 4, the day after german foreign minister cede jung. [SEP] the u. s. department of homeland security department will be investigating [SEP]"}
+{"type": "sample", "index": 24, "raw_text": "[CLS] dr. john johnson, assistant professor of neurology at western carolina university. [SEP] the treaty has run into trouble because the first wto negotiations took place in 1995. [SEP] the californian joined icahn in 1986, and at age 21, 79 he began his job as chairman of u. s. truckmaker ford in 1999. [SEP] the ugandan parliament voted to replace karzai and his allies in kabul hours before the vote. [SEP] at its center is under construction on a bridge of the potomac river and the riverdale bridge. [SEP] with annual growth in excess of 10 - 20 % china ' s growth would be [SEP]", "detok_text": "[CLS] dr. john johnson, assistant professor of neurology at western carolina university. [SEP] the treaty has run into trouble because the first wto negotiations took place in 1995. [SEP] the californian joined icahn in 1986, and at age 21, 79 he began his job as chairman of u. s. truckmaker ford in 1999. [SEP] the ugandan parliament voted to replace karzai and his allies in kabul hours before the vote. [SEP] at its center is under construction on a bridge of the potomac river and the riverdale bridge. [SEP] with annual growth in excess of 10 - 20 % china's growth would be [SEP]"}
+{"type": "sample", "index": 25, "raw_text": "[CLS]. [SEP] islamabad, pakistan ( ap ) - - the white house said washington on monday it would bring nuclear technology to the pakistan, india and china, security and economic ties and political and other ties. [SEP] could be impacting democratic candidates from hillary clinton to barack obama. [SEP] but his success on capitol hill was his downfall from the moment that he decided to focus primarily on disenchanging black - clad voters, in the street and at the top of the game. [SEP] the greicher county fire department said there is no evidence of any structural damage. [SEP] the 2, 000 - foot high, 40 - foot cliff was [SEP]", "detok_text": "[CLS]. [SEP] islamabad, pakistan (ap) - - the white house said washington on monday it would bring nuclear technology to the pakistan, india and china, security and economic ties and political and other ties. [SEP] could be impacting democratic candidates from hillary clinton to barack obama. [SEP] but his success on capitol hill was his downfall from the moment that he decided to focus primarily on disenchanging black - clad voters, in the street and at the top of the game. [SEP] the greicher county fire department said there is no evidence of any structural damage. [SEP] the 2, 000 - foot high, 40 - foot cliff was [SEP]"}
+{"type": "sample", "index": 26, "raw_text": "[CLS] budget deficit in the last fiscal year. [SEP] the bank said that it would cut the value of its loan to $ 6. 5bn by the end of the current year and issue about $ 789bn more, below the five - year cash level in september. [SEP] \" but they don ' t mind the fact that the targets are to find what they want. [SEP] and then pennsylvania and new york? [SEP] the city will generate only about $ 33 million in overall tax revenue from the state, compared with about $ 3. 5 million in revenue that state generates for a single governor ' s office, he said. [SEP] produced by [SEP]", "detok_text": "[CLS] budget deficit in the last fiscal year. [SEP] the bank said that it would cut the value of its loan to $6. 5bn by the end of the current year and issue about $789bn more, below the five - year cash level in september. [SEP] \" but they don't mind the fact that the targets are to find what they want. [SEP] and then pennsylvania and new york? [SEP] the city will generate only about $33 million in overall tax revenue from the state, compared with about $3. 5 million in revenue that state generates for a single governor's office, he said. [SEP] produced by [SEP]"}
+{"type": "sample", "index": 27, "raw_text": "[CLS] 2 cents to 2, 676 dollars a pound. [SEP] \" there ' s a lot of resistance, \" said jean - claude moyony, spokesman for the french defense ministry, who refused to release the details of the air force investigation during the daily news report published sunday. [SEP] he said he liked meeting with private lenders, so that they would not talk about their need to avoid a stock price crash. [SEP] the company still has a robust sales model, but would need only a few months to build the car. [SEP] \" there was a good lot of progress in the past few years this year. [SEP] geithner [SEP]", "detok_text": "[CLS] 2 cents to 2, 676 dollars a pound. [SEP] \"there's a lot of resistance,\" said jean - claude moyony, spokesman for the french defense ministry, who refused to release the details of the air force investigation during the daily news report published sunday. [SEP] he said he liked meeting with private lenders, so that they would not talk about their need to avoid a stock price crash. [SEP] the company still has a robust sales model, but would need only a few months to build the car. [SEP] \" there was a good lot of progress in the past few years this year. [SEP] geithner [SEP]"}
+{"type": "sample", "index": 28, "raw_text": "[CLS] - 2005 ), the 77 - year - old french director creates a public persona and tries to maintain his identity. [SEP] 4 ( upi ) - - u. s. homeland security officials announced monday they have announced the deployment of the fleet of gros helicopters to the air force base in illinois. [SEP] the latest suggestion is that mr. chavez had no contact with ms. ndeodragos, a committee made up of the country ' s five largest social media groups. [SEP] we need to know about how much we drink, about how we want to do business with me, and the same kind of something that affects my [SEP]", "detok_text": "[CLS] - 2005 ), the 77 - year - old french director creates a public persona and tries to maintain his identity. [SEP] 4 (upi) - - u. s. homeland security officials announced monday they have announced the deployment of the fleet of gros helicopters to the air force base in illinois. [SEP] the latest suggestion is that mr. chavez had no contact with ms. ndeodragos, a committee made up of the country's five largest social media groups. [SEP] we need to know about how much we drink, about how we want to do business with me, and the same kind of something that affects my [SEP]"}
+{"type": "sample", "index": 29, "raw_text": "[CLS] to go to war. [SEP] the french president is considering a number of different options. [SEP] gasoline touched $ 1. 7673 friday in wednesday morning trading, down 0. 01 cents to $ 1. 8640 a gallon. [SEP] the 23 - year - old republican ' s post - establishment and denaudations from all ends of the political spectrum - - from college students and those with their religious beliefs and their political affiliations - - don ' t seem surprising. [SEP] the letter to the government says that 75 % of the money comes from sources within the grant area. [SEP] mr crimbieau, a former france rugby [SEP]", "detok_text": "[CLS] to go to war. [SEP] the french president is considering a number of different options. [SEP] gasoline touched $1. 7673 friday in wednesday morning trading, down 0. 01 cents to $1. 8640 a gallon. [SEP] the 23 - year - old republican's post - establishment and denaudations from all ends of the political spectrum - - from college students and those with their religious beliefs and their political affiliations - - don't seem surprising. [SEP] the letter to the government says that 75 % of the money comes from sources within the grant area. [SEP] mr crimbieau, a former france rugby [SEP]"}
+{"type": "sample", "index": 30, "raw_text": "[CLS] broader policies, including women ' s policies, the church ' s respect for human rights and progress as a political capital, would be critical in reversing the administration ' s position. [SEP] sir john conculin also asked mr mccain why he had not been heard of sonia sotomayor ' s case. [SEP] two years after ballack joined from chelsea, the pair have been in talks since their first months following disagreements over whether to move away. [SEP] the school teaches experts in business planning, community work, and offers graduate work in finance, business, manufacturing and finance. [SEP] under obama ' s economic rescue plan, the treasury [SEP]", "detok_text": "[CLS] broader policies, including women's policies, the church's respect for human rights and progress as a political capital, would be critical in reversing the administration's position. [SEP] sir john conculin also asked mr mccain why he had not been heard of sonia sotomayor's case. [SEP] two years after ballack joined from chelsea, the pair have been in talks since their first months following disagreements over whether to move away. [SEP] the school teaches experts in business planning, community work, and offers graduate work in finance, business, manufacturing and finance. [SEP] under obama's economic rescue plan, the treasury [SEP]"}
+{"type": "sample", "index": 31, "raw_text": "[CLS] said five local security officers were injured and no one believed to was involved in the incident. [SEP] he was arrested in 1978 at the age of 17, soon after what turned out to be a murder. [SEP] \" it probably wouldn ' t end with me working with kpc, but i ' m going to try to make the most of the season. [SEP] andrew finchley, the bbc sport co - chief executive and virgin ' s chief executive, is building a commercial rights group for the premier league and the growing number of tv channels such as sky sports and other channels. [SEP] the bill st restricts the public ' s ability [SEP]", "detok_text": "[CLS] said five local security officers were injured and no one believed to was involved in the incident. [SEP] he was arrested in 1978 at the age of 17, soon after what turned out to be a murder. [SEP] \" it probably wouldn't end with me working with kpc, but i'm going to try to make the most of the season. [SEP] andrew finchley, the bbc sport co - chief executive and virgin's chief executive, is building a commercial rights group for the premier league and the growing number of tv channels such as sky sports and other channels. [SEP] the bill st restricts the public's ability [SEP]"}
+{"type": "sample", "index": 32, "raw_text": "[CLS] the first race on the european circuit. [SEP] the bill will likely be about £210, 000, at the current state level. [SEP] after the reconvening, the obama administration has given up the possibility of going to the six - party talks and building a pro - us relationship with pyongyang, the report said. [SEP] overall rates from years 2007 to 2008 were much lower than 2008, according to a november 2009 poll by the media research group the urban institute. [SEP] \" i may say that what i offer is not about the cause of the great crisis, but it doesn ' t be just about a deal, [SEP]", "detok_text": "[CLS] the first race on the european circuit. [SEP] the bill will likely be about £210, 000, at the current state level. [SEP] after the reconvening, the obama administration has given up the possibility of going to the six - party talks and building a pro - us relationship with pyongyang, the report said. [SEP] overall rates from years 2007 to 2008 were much lower than 2008, according to a november 2009 poll by the media research group the urban institute. [SEP] \" i may say that what i offer is not about the cause of the great crisis, but it doesn't be just about a deal, [SEP]"}
+{"type": "sample", "index": 33, "raw_text": "[CLS] [SEP] mr. clinton, as secretary of state, has worked well with the obama campaign in trying to forge a bipartisan tone, and was a central figure in senator clinton ' s campaign that mrs. clinton had sought to avoid. [SEP] these are not natural vacations for kids, but you want to make fun of your person and your kids. [SEP] the automaker also released the list of other new vehicles for sale in four states, including china. [SEP] but to do it, the nfl would need the opportunity to offer something much different. [SEP] geneva ( ap ) - - president barack obama has called for the creation of the international [SEP]", "detok_text": "[CLS] [SEP] mr. clinton, as secretary of state, has worked well with the obama campaign in trying to forge a bipartisan tone, and was a central figure in senator clinton's campaign that mrs. clinton had sought to avoid. [SEP] these are not natural vacations for kids, but you want to make fun of your person and your kids. [SEP] the automaker also released the list of other new vehicles for sale in four states, including china. [SEP] but to do it, the nfl would need the opportunity to offer something much different. [SEP] geneva (ap) - - president barack obama has called for the creation of the international [SEP]"}
+{"type": "sample", "index": 34, "raw_text": "[CLS]. knowledge of the job is a part of the.... co. ' s degree in education management, in atlanta,.. : ( or preferred ) degree in business, administration, education, business administration, media and other fields. experience in higher education.... va. management, technology, finance... • experience in global finance and... business and corporate finance within the global business environment.... co. [SEP] pressed on the governor ' s plans, he said his view was \" very serious. \" [SEP] john king ' s attorney, mark, said he had not heard of the [SEP]", "detok_text": "[CLS]. knowledge of the job is a part of the.... co.'s degree in education management, in atlanta,..: (or preferred) degree in business, administration, education, business administration, media and other fields. experience in higher education.... va. management, technology, finance... • experience in global finance and... business and corporate finance within the global business environment.... co. [SEP] pressed on the governor's plans, he said his view was \"very serious.\" [SEP] john king's attorney, mark, said he had not heard of the [SEP]"}
+{"type": "sample", "index": 35, "raw_text": "[CLS] the world. [SEP] this, like many old mutual funds, is likely to keep much of the program ' s success. [SEP] thornton, a 24 - year - old project manager from richardson, new mexico, made 500, 000 pounds ( 730, 000 dollars ) last week by opening a hollywood style video shop in four us cities, including las vegas. [SEP] l. a. county sheriff joe hudson ' s 41 - year - old son keith, 36, pleaded guilty to the attempted rape of his 17 - year - old grandmother, who died soon after the arrest, the sheriff ' s office and county prosecutor said. [SEP] because of [SEP]", "detok_text": "[CLS] the world. [SEP] this, like many old mutual funds, is likely to keep much of the program's success. [SEP] thornton, a 24 - year - old project manager from richardson, new mexico, made 500, 000 pounds (730, 000 dollars) last week by opening a hollywood style video shop in four us cities, including las vegas. [SEP] l. a. county sheriff joe hudson's 41 - year - old son keith, 36, pleaded guilty to the attempted rape of his 17 - year - old grandmother, who died soon after the arrest, the sheriff's office and county prosecutor said. [SEP] because of [SEP]"}
+{"type": "sample", "index": 36, "raw_text": "[CLS]droe, state department spokesman, said he does not know of the progress mr netanyahu made during a trip recently to east jerusalem. [SEP] but if they can and sit on as long as can, they can ' t go it this way. [SEP] and there won ' t be a fight either. [SEP] with his own manager clashing with english fa bosses, shearer is expected to show the willingness to tackle divisions between owners and clubs and put the fight against racism to his agenda. [SEP] but i have admired the art of squashing, but table tennis is actually more complex than football. [SEP] he has a track record. [SEP]", "detok_text": "[CLS]droe, state department spokesman, said he does not know of the progress mr netanyahu made during a trip recently to east jerusalem. [SEP] but if they can and sit on as long as can, they can't go it this way. [SEP] and there won't be a fight either. [SEP] with his own manager clashing with english fa bosses, shearer is expected to show the willingness to tackle divisions between owners and clubs and put the fight against racism to his agenda. [SEP] but i have admired the art of squashing, but table tennis is actually more complex than football. [SEP] he has a track record. [SEP]"}
+{"type": "sample", "index": 37, "raw_text": "[CLS] have a natural room for colliding. [SEP] she was not the only victim of the crime on sunday night in the late and ' 90s. [SEP] \" japanese people are, in my opinion, like the japanese, with their team, with their football team, \" he said. [SEP] they are appealing for their help after eight taliban were killed on friday in helmand province, while a bus driver and two children died after being hit by a bomb. [SEP] japan ' s stock markets also gyrated in asia, plummeting 11 percent as global stock prices fell. [SEP] the themel, the world ' s largest casino operator [SEP]", "detok_text": "[CLS] have a natural room for colliding. [SEP] she was not the only victim of the crime on sunday night in the late and' 90s. [SEP] \"japanese people are, in my opinion, like the japanese, with their team, with their football team,\" he said. [SEP] they are appealing for their help after eight taliban were killed on friday in helmand province, while a bus driver and two children died after being hit by a bomb. [SEP] japan's stock markets also gyrated in asia, plummeting 11 percent as global stock prices fell. [SEP] the themel, the world's largest casino operator [SEP]"}
+{"type": "sample", "index": 38, "raw_text": "[CLS] education. [SEP] three years after he graduated from central florida high school, carr became the nation ' s youngest ever football coach at just 18 years of age. [SEP] jay li - wei, vice president of china growth group, china mobile ' s largest unit of revenue, predicted traffic in asia, which rose 1. 8 percent compared with the first quarter of the company ' s survey. [SEP] with favre doing the same, dickerson, who made the same job earlier in the season as head coach at the giants, has made only three games for the bills. [SEP] he might just not get what i wanted. [SEP] now and then [SEP]", "detok_text": "[CLS] education. [SEP] three years after he graduated from central florida high school, carr became the nation's youngest ever football coach at just 18 years of age. [SEP] jay li - wei, vice president of china growth group, china mobile's largest unit of revenue, predicted traffic in asia, which rose 1. 8 percent compared with the first quarter of the company's survey. [SEP] with favre doing the same, dickerson, who made the same job earlier in the season as head coach at the giants, has made only three games for the bills. [SEP] he might just not get what i wanted. [SEP] now and then [SEP]"}
+{"type": "sample", "index": 39, "raw_text": "[CLS] barrel on the new york stock stock exchange. [SEP] i could add that your work, in this modern life, strikes just the balance between the right and the right : this is that a woman is certainly not a man, or indeed that it is necessary to be left to men. [SEP] \" it ' s a little too late, \" said ms. glaston. [SEP] \" the coen \" doesn ' t tell you how long the story is true. [SEP] by the end of sept. [SEP] take the \" hot 100 \" star robert kurtz - - currently no. 3 on the billboard ' s albums list - - and [SEP]", "detok_text": "[CLS] barrel on the new york stock stock exchange. [SEP] i could add that your work, in this modern life, strikes just the balance between the right and the right: this is that a woman is certainly not a man, or indeed that it is necessary to be left to men. [SEP] \"it's a little too late,\" said ms. glaston. [SEP] \"the coen\" doesn't tell you how long the story is true. [SEP] by the end of sept. [SEP] take the \"hot 100\" star robert kurtz - - currently no. 3 on the billboard's albums list - - and [SEP]"}
+{"type": "sample", "index": 40, "raw_text": "[CLS] idea of the frooy approach is simple. [SEP] the first film by the british director christopher richardson, which stars the cast as a two - man team called china, a poor, chinese - born bull ' s breeding company, tells its own stories, work and stories of eastern china. [SEP] of course, the city ' s population is almost entirely on the rise. [SEP] slatkin has too many major ankle injuries in the first half of 2007. [SEP] 6 ( upi ) - - golfer tiger woods became britain ' s second man in golf sunday when he lost in the second round of the $ 500, 000 jack par [SEP]", "detok_text": "[CLS] idea of the frooy approach is simple. [SEP] the first film by the british director christopher richardson, which stars the cast as a two - man team called china, a poor, chinese - born bull's breeding company, tells its own stories, work and stories of eastern china. [SEP] of course, the city's population is almost entirely on the rise. [SEP] slatkin has too many major ankle injuries in the first half of 2007. [SEP] 6 (upi) - - golfer tiger woods became britain's second man in golf sunday when he lost in the second round of the $500, 000 jack par [SEP]"}
+{"type": "sample", "index": 41, "raw_text": "[CLS] subway station. [SEP] french media reports this week said the opposition popular left party, which often calls for france to form a federalist state, would issue a formal statement. [SEP] in this plan, the group lacks older staff, and isn ' t incurring much on the group ' s cost increases. [SEP] \" no call for war. \" [SEP] ober was a prominent democrat in foreign policy in 1993, co - chairman with former president hillary clinton and joining john mccain as treasury secretary in 1983, becoming chairman of the senate. [SEP] it ' s too common to say, i don ' t have a lot of time in a [SEP]", "detok_text": "[CLS] subway station. [SEP] french media reports this week said the opposition popular left party, which often calls for france to form a federalist state, would issue a formal statement. [SEP] in this plan, the group lacks older staff, and isn't incurring much on the group's cost increases. [SEP] \"no call for war.\" [SEP] ober was a prominent democrat in foreign policy in 1993, co - chairman with former president hillary clinton and joining john mccain as treasury secretary in 1983, becoming chairman of the senate. [SEP] it's too common to say, i don't have a lot of time in a [SEP]"}
+{"type": "sample", "index": 42, "raw_text": "[CLS] international sports commission at that time. [SEP] republican john mccain reiterated his support for president barack obama during a speech in chicago, where he spoke two weeks before a state university meeting, suggesting that his comments about the president may be intended to cause him to pursue left - handed policies. [SEP] there are no good ways of assailing the peaceful nature of north korea ' s nuclear ambitions. [SEP] but after a recession - - and long - term financial crisis - - his long - awaited dream was about to go away. [SEP] monjuana, brazil ( ap ) - - nick clacher, a french movie producer, and david de la [SEP]", "detok_text": "[CLS] international sports commission at that time. [SEP] republican john mccain reiterated his support for president barack obama during a speech in chicago, where he spoke two weeks before a state university meeting, suggesting that his comments about the president may be intended to cause him to pursue left - handed policies. [SEP] there are no good ways of assailing the peaceful nature of north korea's nuclear ambitions. [SEP] but after a recession - - and long - term financial crisis - - his long - awaited dream was about to go away. [SEP] monjuana, brazil (ap) - - nick clacher, a french movie producer, and david de la [SEP]"}
+{"type": "sample", "index": 43, "raw_text": "[CLS] china. [SEP] the bill was expected to reach $ 100, 000 - - an estimate that the house democrats hoped would attract republican support. [SEP] charles selig, executive - president of public affairs of the irish sports agency, told the irish news : \" the sport seems to be paying down to common sense, but it really did not make a difference. [SEP] \" we ' re very hopeful that we can just take the same situation and i make that decision, \" she said monday. [SEP] \" it has been a good month to go, and it ' s painful to think about what happens as then, \" mr smith said. [SEP]", "detok_text": "[CLS] china. [SEP] the bill was expected to reach $100, 000 - - an estimate that the house democrats hoped would attract republican support. [SEP] charles selig, executive - president of public affairs of the irish sports agency, told the irish news: \"the sport seems to be paying down to common sense, but it really did not make a difference. [SEP]\" we're very hopeful that we can just take the same situation and i make that decision, \"she said monday. [SEP]\" it has been a good month to go, and it's painful to think about what happens as then, \" mr smith said. [SEP]"}
+{"type": "sample", "index": 44, "raw_text": "[CLS] prime minister taro aso, said he would not join months of negotiations with south korea ' s president lee moo - hyun. [SEP] abbas also said israel was not willing to allow continuation of international peace negotiations, and that an israeli government deal effectively ending its three - day war was about to be announced. [SEP] his writing was easy enough, he says, but his private life and his writing stopped. [SEP] and a lot of our statements have been little compared with our long - standing public view of this year ' s election. [SEP] he ' s willing to say, even with the national record. [SEP] it ' s time to [SEP]", "detok_text": "[CLS] prime minister taro aso, said he would not join months of negotiations with south korea's president lee moo - hyun. [SEP] abbas also said israel was not willing to allow continuation of international peace negotiations, and that an israeli government deal effectively ending its three - day war was about to be announced. [SEP] his writing was easy enough, he says, but his private life and his writing stopped. [SEP] and a lot of our statements have been little compared with our long - standing public view of this year's election. [SEP] he's willing to say, even with the national record. [SEP] it's time to [SEP]"}
+{"type": "sample", "index": 45, "raw_text": "[CLS] opening news conference. [SEP] the next, the spaniard, who also has been held at west ham aquatics centre, relished the challenge and the finishing line, overturning every 3 - iron. [SEP] that ' s moving in the right direction, moving the head of the state that occupies the role of the majority party, rather than the more combative political ones. [SEP] david macrib, 18, and matthew rawlinson, 18, and brothers keith ellis, 19, and michael easley, 30, were both studying at north wales, both were studying at new bridge high school. [SEP] mr. ndepa [SEP]", "detok_text": "[CLS] opening news conference. [SEP] the next, the spaniard, who also has been held at west ham aquatics centre, relished the challenge and the finishing line, overturning every 3 - iron. [SEP] that's moving in the right direction, moving the head of the state that occupies the role of the majority party, rather than the more combative political ones. [SEP] david macrib, 18, and matthew rawlinson, 18, and brothers keith ellis, 19, and michael easley, 30, were both studying at north wales, both were studying at new bridge high school. [SEP] mr. ndepa [SEP]"}
+{"type": "sample", "index": 46, "raw_text": "[CLS] the league ' s first - round pick. [SEP] the japanese government ' s prime minister taro aso ahead of saturday ' s climate change conference in tokyo. [SEP] many people want to cut their way out, but not everyone gets to get advice on these days. [SEP] he agreed in a willingness - - not commitment - - to return to violence. [SEP] it ' s another game for avery johnson, who sustained a critical knee injury during the first half of the season. [SEP] reporting from buffalo, n. y. - only 10 minutes later, obama was asked at a news conference whether he could have gotten them through the night. [SEP]", "detok_text": "[CLS] the league's first - round pick. [SEP] the japanese government's prime minister taro aso ahead of saturday's climate change conference in tokyo. [SEP] many people want to cut their way out, but not everyone gets to get advice on these days. [SEP] he agreed in a willingness - - not commitment - - to return to violence. [SEP] it's another game for avery johnson, who sustained a critical knee injury during the first half of the season. [SEP] reporting from buffalo, n. y. - only 10 minutes later, obama was asked at a news conference whether he could have gotten them through the night. [SEP]"}
+{"type": "sample", "index": 47, "raw_text": "[CLS] the statement. [SEP] the elections will be his last attempt to govern in a country which has fallen into political divisions between the government and opposition parties. [SEP] we will move on, and we will make our party civil society, but obviously all the blame is not where it goes today. [SEP] they ' d been picked up by the woman, he said. [SEP] the list, co - authored by the economists dr john rogge and michael johnson, was compiled by the health authority, deputy chief executive, richard mcguigan, chief executive kevin davies, dr richard hoddon, george woodbridge and giles edwards. [SEP] \" we [SEP]", "detok_text": "[CLS] the statement. [SEP] the elections will be his last attempt to govern in a country which has fallen into political divisions between the government and opposition parties. [SEP] we will move on, and we will make our party civil society, but obviously all the blame is not where it goes today. [SEP] they'd been picked up by the woman, he said. [SEP] the list, co - authored by the economists dr john rogge and michael johnson, was compiled by the health authority, deputy chief executive, richard mcguigan, chief executive kevin davies, dr richard hoddon, george woodbridge and giles edwards. [SEP] \" we [SEP]"}
+{"type": "sample", "index": 48, "raw_text": "[CLS] been paying back most of its national operating costs. [SEP] brussels, belgium ( ap ) - the prime minister will said tuesday he called for a new government and emergency fiscal spending to provide support for the economy. [SEP] that could add clarity to the markets. [SEP] he ' s now immersed himself in his armoury. [SEP] but its name has been a disappointment. [SEP] it said the federal government set the start - up date of the program jan. [SEP] johnson said he was going to be with minnesota last spring and will get a call in the following day, said eagles head coach, scott baskett. [SEP] in a traditional way, china [SEP]", "detok_text": "[CLS] been paying back most of its national operating costs. [SEP] brussels, belgium (ap) - the prime minister will said tuesday he called for a new government and emergency fiscal spending to provide support for the economy. [SEP] that could add clarity to the markets. [SEP] he's now immersed himself in his armoury. [SEP] but its name has been a disappointment. [SEP] it said the federal government set the start - up date of the program jan. [SEP] johnson said he was going to be with minnesota last spring and will get a call in the following day, said eagles head coach, scott baskett. [SEP] in a traditional way, china [SEP]"}
+{"type": "sample", "index": 49, "raw_text": "[CLS] to a normal part of the program with the two news agencies. [SEP] i hit them four all morning. [SEP] \" i got the same guy when he was a middle - aged boy, \" jones said recently. [SEP] it ' s easy to see mccain ' s support in the previous election. [SEP] but even on tuesday night, there ' s probably going to be some surprises for clinton. [SEP] and british prime minister gordon brown on thursday said britain planned to hold an international conference on carbon emissions before 2012 was to take place. [SEP] it ' s hard to say why, but this wasn ' t the challenge of my life. [SEP] in [SEP]", "detok_text": "[CLS] to a normal part of the program with the two news agencies. [SEP] i hit them four all morning. [SEP] \"i got the same guy when he was a middle - aged boy,\" jones said recently. [SEP] it's easy to see mccain's support in the previous election. [SEP] but even on tuesday night, there's probably going to be some surprises for clinton. [SEP] and british prime minister gordon brown on thursday said britain planned to hold an international conference on carbon emissions before 2012 was to take place. [SEP] it's hard to say why, but this wasn't the challenge of my life. [SEP] in [SEP]"}
+{"type": "sample", "index": 50, "raw_text": "[CLS] a little bit of what that ' s worth, \" he said. [SEP] the tentative talks between gm and gm gave chrysler until until last weekend to reveal whether it wanted a larger, government - gm joint venture after reports indicated they could not reach a deal. [SEP] uk consumer and producer prices fell by 0. 3 % in october from october. [SEP] there ' s a little disagreement about huluving with the next president - - and he certainly intends to take time with the father and his wife. [SEP] and she ' s always asked, like, \" why don ' t you think your mom is white and she ' s black, [SEP]", "detok_text": "[CLS] a little bit of what that's worth, \"he said. [SEP] the tentative talks between gm and gm gave chrysler until until last weekend to reveal whether it wanted a larger, government - gm joint venture after reports indicated they could not reach a deal. [SEP] uk consumer and producer prices fell by 0. 3 % in october from october. [SEP] there's a little disagreement about huluving with the next president - - and he certainly intends to take time with the father and his wife. [SEP] and she's always asked, like,\" why don't you think your mom is white and she's black, [SEP]"}
+{"type": "sample", "index": 51, "raw_text": "[CLS] schalk and monye strummed off in fly - half by vickery, with the breakdown second to phil hughes. [SEP] \" he ' s a guy with everybody ' s minders, the man with a heart and a foot on the edge... \" redisco said. [SEP] wisnews. com says it has acquired more than 100 information sources. [SEP] that is because it seems clear that the oil crisis is less broad - based. [SEP] odyssey air station manager matt thurdon said his company ' s six crew members, five passengers and managers were held at the station. [SEP] the same [SEP]", "detok_text": "[CLS] schalk and monye strummed off in fly - half by vickery, with the breakdown second to phil hughes. [SEP] \"he's a guy with everybody's minders, the man with a heart and a foot on the edge...\" redisco said. [SEP] wisnews. com says it has acquired more than 100 information sources. [SEP] that is because it seems clear that the oil crisis is less broad - based. [SEP] odyssey air station manager matt thurdon said his company's six crew members, five passengers and managers were held at the station. [SEP] the same [SEP]"}
+{"type": "sample", "index": 52, "raw_text": "[CLS] said. [SEP] remember the people who went to war and gave up their time to fight the communists. [SEP] jonathan hul, head of the federal justice department ' s u. s. district attorney ' s office, has criticized the case. [SEP] \" we ' re not. [SEP] i think we ' re ready to do it because everything isn ' t fair. [SEP] the u. s. military action thursday is seen as a warning that the u. s. would consider pursuing nuclear war against iran. [SEP] mr chen, an retired police engineer, said he is expected to be speaking at the news conference at the end of the day [SEP]", "detok_text": "[CLS] said. [SEP] remember the people who went to war and gave up their time to fight the communists. [SEP] jonathan hul, head of the federal justice department's u. s. district attorney's office, has criticized the case. [SEP] \" we're not. [SEP] i think we're ready to do it because everything isn't fair. [SEP] the u. s. military action thursday is seen as a warning that the u. s. would consider pursuing nuclear war against iran. [SEP] mr chen, an retired police engineer, said he is expected to be speaking at the news conference at the end of the day [SEP]"}
+{"type": "sample", "index": 53, "raw_text": "[CLS]. [SEP] and india ' s development management and development centre, the national agency for funneling money into government and universities, has predicted its global projects will reach up to $ 200bn a year. [SEP] the move is likely to help ease tensions between the long - running nuclear build - up and the nuclear talks, analysts say. [SEP] mr clarke added that he understood the conservative party ' s growing frustration with the tory leader, whose speech had been ridiculed during the first debate on the bbc news website. [SEP] the labour government is now trying to persuade his rivals to lead a coalition as well. [SEP] after six months, he was [SEP]", "detok_text": "[CLS]. [SEP] and india's development management and development centre, the national agency for funneling money into government and universities, has predicted its global projects will reach up to $200bn a year. [SEP] the move is likely to help ease tensions between the long - running nuclear build - up and the nuclear talks, analysts say. [SEP] mr clarke added that he understood the conservative party's growing frustration with the tory leader, whose speech had been ridiculed during the first debate on the bbc news website. [SEP] the labour government is now trying to persuade his rivals to lead a coalition as well. [SEP] after six months, he was [SEP]"}
+{"type": "sample", "index": 54, "raw_text": "[CLS] businesses and enforcement agencies, \" obama said. [SEP] u. s. companies with a massive government debt fund that lost more than $ 500bn in assets during the first quarter. [SEP] \" i have to deal with a lot of the facts, have to tell you, and we ' re not going to deal. ' [SEP] the family ' s lawyer, eric hawkins, said he was not surprised at how the time of the death would be remembered. [SEP] \" many people used to say we don ' t want to try to finish it, we ' ll have to wait for the first time, \" he added. [SEP] paul newman, [SEP]", "detok_text": "[CLS] businesses and enforcement agencies, \"obama said. [SEP] u. s. companies with a massive government debt fund that lost more than $500bn in assets during the first quarter. [SEP]\" i have to deal with a lot of the facts, have to tell you, and we're not going to deal. ' [SEP] the family's lawyer, eric hawkins, said he was not surprised at how the time of the death would be remembered. [SEP] \"many people used to say we don't want to try to finish it, we'll have to wait for the first time,\" he added. [SEP] paul newman, [SEP]"}
+{"type": "sample", "index": 55, "raw_text": "[CLS]. [SEP] senator barack obama, who was nominated to re - elected as secretary by president bill clinton in december, is currently running for president, according to the white house. [SEP] kent district executive andrew walker said the case involved an alleged sexual assault that was carried out by the younger children. [SEP] now, he ' s the right man to stand by his team, even if he ' s focused on whether it ' s up to the game ' s biggest underdogs. [SEP] specter noted that the impact on latino american immigrants is lower among asian, hispanic and asian, women, and other immigrants. [SEP] journal of america reported wednesday [SEP]", "detok_text": "[CLS]. [SEP] senator barack obama, who was nominated to re - elected as secretary by president bill clinton in december, is currently running for president, according to the white house. [SEP] kent district executive andrew walker said the case involved an alleged sexual assault that was carried out by the younger children. [SEP] now, he's the right man to stand by his team, even if he's focused on whether it's up to the game's biggest underdogs. [SEP] specter noted that the impact on latino american immigrants is lower among asian, hispanic and asian, women, and other immigrants. [SEP] journal of america reported wednesday [SEP]"}
+{"type": "sample", "index": 56, "raw_text": "[CLS] korea, china, and india. \" [SEP] \" in the end, you know the issues that you can ' t raise, and the things that have addressed that disparity are still causing some issues in every child ' s life, \" said james johnson, the director of education policy for the national science foundation. [SEP] detroit ( ap ) - - chrysler llc, one of the auto industry ' s less profitable north american operations, will take control of the u. s. treasury department, the three - fifth - largest automaker, company officials announced monday. [SEP] soe ' s membership of affiliates has attracted more than 1. [SEP]", "detok_text": "[CLS] korea, china, and india. \"[SEP]\" in the end, you know the issues that you can't raise, and the things that have addressed that disparity are still causing some issues in every child's life, \" said james johnson, the director of education policy for the national science foundation. [SEP] detroit (ap) - - chrysler llc, one of the auto industry's less profitable north american operations, will take control of the u. s. treasury department, the three - fifth - largest automaker, company officials announced monday. [SEP] soe's membership of affiliates has attracted more than 1. [SEP]"}
+{"type": "sample", "index": 57, "raw_text": "[CLS] who were not found still in the building and elevator of the hotel. [SEP] the government today announced plans to liberalise school choice during an initial update on accusations of poor behaviour and influence on \" disruptive \" school leavers. [SEP] obama has repeatedly insisted on iran ' s nuclear intentions, saying tehran still wants to carry out its nuclear program. [SEP] it ' s fun, but hey, is it? [SEP] it ' s not known if mr jackson ' s death has a medical problem. [SEP] \" all of our cars are bad, the u. s. v. ' s. [SEP] it ' s the only way we can go [SEP]", "detok_text": "[CLS] who were not found still in the building and elevator of the hotel. [SEP] the government today announced plans to liberalise school choice during an initial update on accusations of poor behaviour and influence on \"disruptive\" school leavers. [SEP] obama has repeatedly insisted on iran's nuclear intentions, saying tehran still wants to carry out its nuclear program. [SEP] it's fun, but hey, is it? [SEP] it's not known if mr jackson's death has a medical problem. [SEP] \" all of our cars are bad, the u. s. v.'s. [SEP] it's the only way we can go [SEP]"}
+{"type": "sample", "index": 58, "raw_text": "[CLS] percent of the world ' s population were saving up. [SEP] mr. bush announced the plan to reporters on friday. [SEP] drey is expected to sign off as head of staff at clemson this weekend. [SEP] i would love to see her come back......... again, and then i have to make me think, find what i meant to throw at myself. [SEP] \" we ' re just stuck the way it was 10 years ago, \" she said. [SEP] some presidential advisers said that pushing for a large increase was a lack of government responsibility. [SEP] \" i saw one guy being killed, and then [SEP]", "detok_text": "[CLS] percent of the world's population were saving up. [SEP] mr. bush announced the plan to reporters on friday. [SEP] drey is expected to sign off as head of staff at clemson this weekend. [SEP] i would love to see her come back......... again, and then i have to make me think, find what i meant to throw at myself. [SEP] \"we're just stuck the way it was 10 years ago,\" she said. [SEP] some presidential advisers said that pushing for a large increase was a lack of government responsibility. [SEP] \" i saw one guy being killed, and then [SEP]"}
+{"type": "sample", "index": 59, "raw_text": "[CLS] the impact of the financial crisis on a balance of china ' s economic development, health and care for all will become increasingly difficult. [SEP] on the eve of the national football game, april 16, the washington redskins will be able to break the nfl ' s franchise record for consecutive championship games. [SEP] the patriots won the night game, handing the colts their third super bowl win in four seasons after improving their nfl record to 38 - 5 - 1 since last season. [SEP] \" this case means that the solicitors have worked together, and they do work. [SEP] the first choice was to be the chief justice. [SEP] q : so, [SEP]", "detok_text": "[CLS] the impact of the financial crisis on a balance of china's economic development, health and care for all will become increasingly difficult. [SEP] on the eve of the national football game, april 16, the washington redskins will be able to break the nfl's franchise record for consecutive championship games. [SEP] the patriots won the night game, handing the colts their third super bowl win in four seasons after improving their nfl record to 38 - 5 - 1 since last season. [SEP] \" this case means that the solicitors have worked together, and they do work. [SEP] the first choice was to be the chief justice. [SEP] q: so, [SEP]"}
+{"type": "sample", "index": 60, "raw_text": "[CLS] \" and it has been much lag at the moment. [SEP] the president calls the congressional democrats ' year - old \" recovery plan. \" [SEP] he said ge ' s capital needs of more than $ 6 billion this year is the amount needed compared with the unit ' s public equity and current market debt of around $ 100 billion less. [SEP] you know where i find my campaign going to go. [SEP] but both candidates also say they ' d soon be able to take office to be president. [SEP] he was named the ceo in 2009. [SEP] a draft interpretation of spain ' s ruling states that a proposed human rights commission would also have [SEP]", "detok_text": "[CLS] \"and it has been much lag at the moment. [SEP] the president calls the congressional democrats' year - old\" recovery plan. \" [SEP] he said ge's capital needs of more than $6 billion this year is the amount needed compared with the unit's public equity and current market debt of around $100 billion less. [SEP] you know where i find my campaign going to go. [SEP] but both candidates also say they'd soon be able to take office to be president. [SEP] he was named the ceo in 2009. [SEP] a draft interpretation of spain's ruling states that a proposed human rights commission would also have [SEP]"}
+{"type": "sample", "index": 61, "raw_text": "[CLS] of information that was used is still being investigated by the law firm. [SEP] that ' s not to say how china can provide its own response to the threat. [SEP] analysts said that its market value stood at $ 32. 5 billion. [SEP] a 17 - year - old boy ' s father has been arrested after committing a series of assaults at a school, police said. [SEP] though the annual report is scheduled to be published publicly, the pentagon report was produced by general petraeus, who will be named to oversee the conduct of u. s. war in iraq. [SEP] well, the smartest commentables are the majority of [SEP]", "detok_text": "[CLS] of information that was used is still being investigated by the law firm. [SEP] that's not to say how china can provide its own response to the threat. [SEP] analysts said that its market value stood at $32. 5 billion. [SEP] a 17 - year - old boy's father has been arrested after committing a series of assaults at a school, police said. [SEP] though the annual report is scheduled to be published publicly, the pentagon report was produced by general petraeus, who will be named to oversee the conduct of u. s. war in iraq. [SEP] well, the smartest commentables are the majority of [SEP]"}
+{"type": "sample", "index": 62, "raw_text": "[CLS] jeter ' s average ballload was limited to five weeks. [SEP] asked in his final statement, mr. bush said he was seeing mr. w. bush teach at the northwestern university school of law at illinois state university. [SEP] tindall ' s decision to be a specialist england coach was, as expected, provided there was muted reaction in the dressing room. [SEP] let them know what you pay and don ' t have to pay. [SEP] trespassing is prohibited. [SEP] \" we ' re living out the prospect of a crisis that will stretch back to 1972, \" professor david pidgeon said. [SEP] he will have [SEP]", "detok_text": "[CLS] jeter's average ballload was limited to five weeks. [SEP] asked in his final statement, mr. bush said he was seeing mr. w. bush teach at the northwestern university school of law at illinois state university. [SEP] tindall's decision to be a specialist england coach was, as expected, provided there was muted reaction in the dressing room. [SEP] let them know what you pay and don't have to pay. [SEP] trespassing is prohibited. [SEP] \"we're living out the prospect of a crisis that will stretch back to 1972,\" professor david pidgeon said. [SEP] he will have [SEP]"}
+{"type": "sample", "index": 63, "raw_text": "[CLS] also saw global net sales grow 39 % to reach the $ 11 billion mark over the next three years. [SEP] holder ' s arrest is part of the u. s. government ' s strategy to fight the threat of terrorism. [SEP] as obama sets out his goals for his administration, the need to bailout the u. s. is expected to grow and grow again. [SEP] \" it ' s a game that is playing well, and we want to get into this game. [SEP] due to this, mr brown planned to agree an \" end to the mugabe era... with south africa, \" it said. [SEP] police [SEP]", "detok_text": "[CLS] also saw global net sales grow 39 % to reach the $11 billion mark over the next three years. [SEP] holder's arrest is part of the u. s. government's strategy to fight the threat of terrorism. [SEP] as obama sets out his goals for his administration, the need to bailout the u. s. is expected to grow and grow again. [SEP] \"it's a game that is playing well, and we want to get into this game. [SEP] due to this, mr brown planned to agree an\" end to the mugabe era... with south africa, \" it said. [SEP] police [SEP]"}

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_diffusion_noise_steps_128steps_n64/noise_const1p45_early_linear_eta0p05_c256_detok_raw_samples.txt

@@ -0,0 +1,230 @@
+noise_const1p45_early_linear_eta0p05_c256_detok
+{
+  "type": "summary",
+  "name": "noise_const1p45_early_linear_eta0p05_c256",
+  "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt",
+  "step": 187000,
+  "decode": {
+    "kind": "categorical_fullvocab_diffusion_state_noise",
+    "config": "noise_const1p45_early_linear_eta0p05_c256",
+    "steps": 128,
+    "temp_start": 1.45,
+    "temp_end": 1.45,
+    "temp_schedule": "const",
+    "t_power": 1.0,
+    "eta0": 0.05,
+    "eta_schedule": "early_linear",
+    "noise_conc": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 45.9198653520818,
+    "nll_per_token": 3.826897819778828,
+    "tokens": 9574
+  },
+  "diversity": {
+    "sample_entropy": 4.198348275601427,
+    "unique_tokens": 1907,
+    "token_count": 8192,
+    "distinct_1": 0.2327880859375,
+    "distinct_2": 0.7081692913385826,
+    "top_token_mass": 0.0552978515625
+  }
+}
+
+===== sample 000 =====
+[CLS] [SEP] it will not hit anybody in the last year. [SEP] after his second putt, he found three feet over the fairer - - less than 20 feet off the leaders. [SEP] mccain last arrived at the upstate new york museum friday. [SEP] president obama issued a statement calling on china to scale back to his calls for developing nations to take the lead while developing leaders in developing countries are working on pressing u. s. president george bush to attend the next u. n. climate change conference, a senior white house said friday. [SEP] overall, only 15 percent of students are past their 50, compared to 18 percent of students ' [SEP]
+
+===== sample 001 =====
+[CLS] said yu qianrong, former senior director at the beijing center for asia policy and foreign studies, state media reported. [SEP] a doctor got his son to the airport, then he was able to get up and get home. [SEP] but it wasn't until the afternoon that the judge was ready to take action. [SEP] a community rich in shopping and outdoor hospitality.... dc. and heritage of sports history as described in the magazine...... sports at the school of art, music, the arts, and the.... ca. for more information on iras please visit www. u. [SEP]
+
+===== sample 002 =====
+[CLS] don't want him to be able to pay attention. [SEP] u. s. embassy spokesman jeffrey parr didn't see the need for north korea to continue its business, saying other american journalists received a call from china on friday after several days of closed party talks in washington. [SEP] honestly, i don't know all that, either. [SEP] he has taken his minor league career to the state. [SEP] robert m. bick said the flight crumbled off about 7 p. m. on saturday, and was sent to the national transportation safety board in northeast washington, d. c. the report said. [SEP] [SEP]
+
+===== sample 003 =====
+[CLS] the national health statistics report, england had almost half of all children, and a third of all children aged, die during the previous five years. [SEP] "i would like to see people think it's important to engage people," he added. [SEP] (3) for more information on the california foreign press association at the annual law forum, 2009 held april 3 - 15, visit www. schfw. org/prbg/gwdc20o ( http://www. dcccp. org/2010/conference/acp/). [SEP] analysts said the north's talks could [SEP]
+
+===== sample 004 =====
+[CLS], would work closely with local police and provide more comprehensive surveillance of their operations. [SEP] i don't know if they're doing anything on the job. [SEP] the concern over the war is felt in many of mr. obama's supporters, and he got used to it. [SEP] "i'm out out there watching it," tedisco said. [SEP] however, the mr camara's government, which has agreed to a deal by several western nations, is keen to preserve its sovereignty in an attempt to influence the elections. [SEP] and with a strong line in the law, she is hoping for the support [SEP]
+
+===== sample 005 =====
+[CLS] interest rates, because the debt environment is tightening. [SEP] you'd be sitting on the back of a white truck in the neighborhood, and you just want to be there. [SEP] mr imerzl also says the victim was discovered in the southbound lane of clifton road on sunday. [SEP] this would give you a good opportunity to think that a child might be better off than life in the rest of the world. [SEP] he said the company should move into the international market and into local markets. [SEP] the council said it would follow the government's advice monday to move it away to creating a national stadium. [SEP] benitez [SEP]
+
+===== sample 006 =====
+[CLS] markets, particularly where there's an indication of credit recovery, "said phil dunford, head of market research at citinvest. [SEP] gmt: it's a pretty necessary step of cleanping up the... [SEP] o' brien asked. [SEP] in general, there is just about a shortage, far from the same. [SEP] even in the convention, they won't be printed in the national front. [SEP] during a visit with chinese journalists on friday, foreign minister wang daequan, china's foreign minister, said china" understands the urgency of working fast through the crisis, " [SEP]
+
+===== sample 007 =====
+[CLS] a little more, "elin flot, from the council of the church, said. [SEP] nazarbayev's most serious suggestion has been the existence of a so - called" project " - - he's never got it all that way. [SEP] associated press writers paul ames, jim stub and jima muluk in san antonio, texas contributed to this report. [SEP] the oppositionp has been seen as a thorny choice for government backed by the establishment of an opposition - friendly alliance of the social conservatives and liberal democrats, as opposed as the previous government and the former party in the late 1990s. [SEP]
+
+===== sample 008 =====
+[CLS] last month that he wanted to get each team on track for the quarterback job. [SEP] but the current exposure of the world's largest financial fund is about $34 billion more than the $800 billion at the year - ago stage. [SEP] and those companies will be able to use some of that money. [SEP] the coroner has said a 38 - year - old man from west yorkshire was charged with four counts of sexual assault. [SEP] mr cameron said he wanted to help the disadvantaged and said the prime minister was willing to take action. [SEP] she will take over the state department for what will become a critical time in the history of the [SEP]
+
+===== sample 009 =====
+[CLS]. 1 billion from july 2009. [SEP] he also showed a short film about hans von greiwet, a german film producer who cut it out of a big german - language production in germany. [SEP] do not panic. [SEP] we're going to have to take all the steps that we need to achieve this, " obama said. [SEP] hopes that mr. obama might be picking up a bit of slack. [SEP] during the last few years later, i was drawn into the vortex of grief - - and antipathy toward america itself. [SEP] in addition to about 6 percent of military deaths in afghanistan, according to the pentagon, [SEP]
+
+===== sample 010 =====
+[CLS] international institute of strategic, education and international studies. [SEP] she pokes down at the door. [SEP] with ferdinand refusing to make any names of players in his squad for the new twickenham, west ham united bid boss steve manson said the premier side was not going to get into talks with manchester united, but said he would wait and hear the news. [SEP] he was a well - known friend and keen match referee, but made a point of being honest and cautious. [SEP] he was going to give the speech... [SEP] but she did not seem to see her point. [SEP] russian marias shavonareva was [SEP]
+
+===== sample 011 =====
+[CLS] that he and mr. slurman and his family were no longer in court wednesday. [SEP] the us government, which needs up to $40 per share for every gm share, says it has obligations to pay down debt that has forced it to spend about $100 million, reducing the value of giving gm $47 billion a year in outstanding debt. [SEP] construction is expected to start sometime in late 2009 and will take up to 60 years for construction to complete by early 2012. [SEP] foreign ministry spokesman kim fuguo said that president bush one - on - one talks with south korea's leaders and indicated he would use the show [SEP]
+
+===== sample 012 =====
+[CLS] good friday. [SEP] "there's no way you can expect them to have control over the place," he said. [SEP] the park's application to authorities coincides with a public consultation. [SEP] austin, ohio (ap) - president barack obama's admission that congress has broken the nation's politics - - he stepped down as a national security adviser the republican president is still pursuing his new proposals on health care reform, the obama campaign said saturday. [SEP] but with still to go, that's not news. [SEP] "unemployment is rising," said rogo valero, senior economist at morgan. [SEP] the [SEP]
+
+===== sample 013 =====
+[CLS] killing four people in his family. [SEP] obama, who was in japan for the meeting here thursday, said the opening of the u. s. intelligence relationship will take place next year. [SEP] "the next us president wanted to see and he decided to go with him," said the official. [SEP] google is offering some lightweight mobile phones, still available for $30 a year, from the uk today. [SEP] the collapse of the msf, and the overturning of the election law, have spurred some debate into a military - based human rights record. [SEP] the loss - - the first in u. s. open history [SEP]
+
+===== sample 014 =====
+[CLS] for the candidate. [SEP] there were also hints that lord myners has refused to set out the three best ways to make sure the same. [SEP] the governors' association said the group, which originally was backed by mr obama's campaign, had changed the format of the president's speech by a video posted on its official website. [SEP] mr. braddy, who runs the new york television news system, said he wanted to work more. [SEP] volume on bond issue rose to $1. 05 billion from friday's $1. 1 billion, the report said. [SEP] as the price of gold fell, the price of [SEP]
+
+===== sample 015 =====
+[CLS], russia's foreign minister for europe, to become the head of the european delegation at the foreign ministers meeting in brussels. [SEP] moreover, since the government administration began budget records in april, china's massive debt has grown into deficits in more than a third of asia's member states as trade expands. [SEP] the line - up would be given to the children, david and mrs brown, said mr cameron, and it was said the school would be built to cope with the difficult conditions. [SEP] azuz: there are nine million americans and millions of people in the washington area. [SEP] pakistan, which hails as democratic [SEP]
+
+===== sample 016 =====
+[CLS] to bailout.... [SEP] the approach was wrong. [SEP] maybe they would ask for more help. [SEP] it also created a new national media team. [SEP] in most of my life, isaacs, the mostly middle - class male manager, was obsessed with sportswriters, lawyers, gamers and local filmmakers. [SEP] opposition members said one major factor in obama's policy decision is the fed' decision to keep interest rates at current levels in the next year. [SEP] mrs. clinton said he wants to build a "new national spirit," working to get america to the 21st century, through economic opportunity, through political [SEP]
+
+===== sample 017 =====
+[CLS] opened to the public in 1997. [SEP] the survey also showed young people becoming committed to pursuing the most fundamental areas of education, not education. [SEP] still, i don't think a child will know what you say about this stuff - - i'd say just that - - i don't really know what to say if it's true. [SEP] "if you give a bad drive to me, you would go down. [SEP] whether he's hoping for that does the same thing. [SEP] italy last year had two problems. [SEP]" we will stick to a very short timetable, " said fed chairman ben bernan [SEP]
+
+===== sample 018 =====
+[CLS] the military, we can't break it. [SEP] i can't bear with this comment, but i would rather he look so much like a black woman and also a man with a family story... [SEP] he joined a campaign by c. a. r. barry, a longtime supporter who has said that the 60 - team club would focus on downtown central park. [SEP] the statement is signed by ministers from western and eastern europe, members of italy and spain, and others from the east. [SEP] the uk bar association, for example, has delighted the country with its own local gallery of contemporary art. [SEP] the school [SEP]
+
+===== sample 019 =====
+[CLS] google calls to overhaul chinese law enforcement law to encourage antitrust complaints and limit regulation of file - based software sales to internet users. [SEP] the 30 mile, £140m main street park has been the first stage of construction, the bbc said. [SEP] the average, annual household household spending index shows that, falling to 4. 9 per cent. [SEP] the local government pension fund was doubled in 2007 from £680m to £25m - - an increase totalled to £6 billion over the past year. [SEP] after all three seasons, he played 2, 400 l. u. s. a. and national championship games [SEP]
+
+===== sample 020 =====
+[CLS] "change america..." and "what do people think of? [SEP]" since there are two appropriate options, and we have to get over the cost of a plant, then we have to get funding to take costs away from our funding for our energy infrastructure, " and john somer, the department spokesman, said he is asking for more money. [SEP] nakagawa, japan (ap) - takeo fukui, japan's new democratic party leader, resigned on saturday after a published opinion report indicated his main opposition party was unlikely to leave the country to form the government. [SEP] it was clear to other players [SEP]
+
+===== sample 021 =====
+[CLS] health program. [SEP] schwab said that he came to terms with the question of whether he's ready for work or if he thought he could be there for him. [SEP] con rockley, mass., march 29 (upi) - - a florida 5 - year - old boy who was attempting to jump off the water of a plane apparently lost consciousness while he was stuck in the water, massachusetts authorities say. [SEP] "if there's a global warming crisis, you think there's a shortfall in the entire u. s. economic system," he said. [SEP] and she said her mother, who [SEP]
+
+===== sample 022 =====
+[CLS] through its entrance to the school dedicated to the idea of god. [SEP] but we have to tell our friends this time to think we feel more like each other, and maybe it was, oh, and there's something very special about them. [SEP] and if you think "the public needs to find work," just don't care. [SEP] the president said obama's administration's efforts to reduce healthcare costs, which began monday, would reduce spending by an additional $22. 3 billion by the end of next year, which includes more than $20 billion in annual budget growth levels by 2013. [SEP] i always ask [SEP]
+
+===== sample 023 =====
+[CLS], 000 per hr. [SEP] the co - founder of tripkquare, a website, urges people loyal to his police force to call in a complaint, urging them to stay off motoring roads to prevent an accident and give them permission to run it. [SEP] we know how the big crisis is going. [SEP] six people were also injured, said alejandro guevara, government spokesman. [SEP] the u. s. department of the state department, said that prosecutors had met the russian authorities on july 4 this year to investigate his case. [SEP] she also announced a new private finance scheme to fund £94m to reduce social [SEP]
+
+===== sample 024 =====
+[CLS] too. [SEP] the group currently holds australian oil company pet petroa ltd. [SEP] in other games, all - star chris thornton and tim hens scored. [SEP] dr. hamm moluk hamod, 63, from narumi, western kenya, and mohamed's cousin from the northern village of nigamwgan on the ugandan part of nigam. [SEP] federal officials made a final report before the house intelligence committee monday and said it is clear that the government will study the letter, the reuters news agency reported. [SEP] it said it was "causing more unrest in china than in tibet," [SEP]
+
+===== sample 025 =====
+[CLS] day is being held by the us - based national hiv and aids foundation. [SEP] dr murray and his family came to the hospital. [SEP] these kids are big - spenders and baby - boomer's.... [SEP] everyone from hillary clinton to barack obama. [SEP] we will have the government to take money away from their personal consumption to help create a sustainable economy. [SEP] mr. obama said he was working with the senate to secure the passage of the package. [SEP] additionally, the share of democrats that said republicans - - 38 percent republicans, compared with 47. 2 percent - - fell close to 38 percent ahead of democrats [SEP]
+
+===== sample 026 =====
+[CLS] deficits in the last fiscal year. [SEP] the bank said wednesday it would cut the value of its loan to $6. 5bn by the end of the current year and increase its net debt base of more than us $1. 1bn to 11. 7bn. [SEP] i don't mind the cost of giving it away to find what you buy. [SEP] cnn: when did you know? [SEP] researchers included dr ian coates, md, university of birmingham, dr john black, of parkland institute, dr michael dewehne, of east sussex medical school, and dr david heineer. [SEP] developed by [SEP]
+
+===== sample 027 =====
+[CLS] [SEP] they bring home about £68 a week. [SEP] "the reason for the news is simple," says the times co - founder. [SEP] if it's not enough, it's like the end of december is getting better at the other end of the month. [SEP] the council chairman, ayo strahan, said that the authority should set up a policy to avoid missing decisions on existing children who need child support. [SEP] mr. turner and his wife got home a few weeks ago and stayed with him. [SEP] lee, the former nfl player, is a tougher. [SEP] he was only 20 minutes of [SEP]
+
+===== sample 028 =====
+[CLS] - moon. [SEP] and when he was president, he made fun of his rival, mike huckabee. [SEP] 2 (upi) - - philadelphia all - star mike freel announced monday he was in the process of being made to coach last nightʼs league game in new york. [SEP] the only difference is that no - one would have made the same amount during the previous three years, because that huge portion of the nation's health system went into default. [SEP] " one of the things about it is that if i could take such a dangerous work with me, and the same kind of thing would make my [SEP]
+
+===== sample 029 =====
+[CLS] ruled in his favor. [SEP] it's hard to get out of the f. k. g. h.. [SEP] reformulated gasoline gasoline prices also added 0. 1 per cent to $1. 8640 a gallon. [SEP] revenues. net income declined by over 30 percent to $15. 1 per month, as compared to the net decline of 16. 3 million and 17. 9 million ($11. 1 million) in the first three months of this year. compared to u. s. quarters in 2008, the total net loss was up by 4. 4 percent ($5. 3 million) compared to [SEP]
+
+===== sample 030 =====
+[CLS] the ground, the church's location, the church's lack of life, and any damage to the area, "the finance minister added. [SEP] the administration has pointed to senior democrats in the senate judiciary and commerce, although obama said he had not been consulted on sonia sotomayor's case. [SEP] two months after johnson's split, johnson has been holding back on money since she moved into the no. 1 spot in 2002. [SEP] the school kids go without them. [SEP] i'll just have to work hard the other time," she said. [SEP] the administration's financial rescue plan, the treasury [SEP]
+
+===== sample 031 =====
+[CLS] says its rafah leadership had confirmed the israeli attack and had been involved in another attack on israel's gaza authority. [SEP] now, and then, it's turned out to be a lot more of redist hargisy. [SEP] she said she was healthy after coming to the country with her husband to learn and leave their children in china, she said. [SEP] the number of the students playing it at the top of each table rose up to the age of 9. 3 - nearly two times the average age of 12, at a level of six per cent. [SEP] the growth of excess inflation in the region has led [SEP]
+
+===== sample 032 =====
+[CLS] us military action on the terror front. [SEP] the talks on friday are the third straight day of the first months of his administration. [SEP] after the recalitution, the obama administration has drawn up the plan that will address the nation - wide healthcare crisis, and will hold a meeting with democratic president harry reid, the official said. [SEP] to date, the institute is known as national medical health program, which was founded in 1997. [SEP] analysts predict the trade deficit will rise in value to £60 billion, as a deprive market recover during this year's economic downturn. [SEP] iran was not blamed for this, [SEP]
+
+===== sample 033 =====
+[CLS] he said. [SEP] for example, it remains a celebration of mrs clinton's rise in the politics of the 1970s and 1990s, and was a significant landmark in mrs clinton's history that mr clinton may be tempted to avoid. [SEP] this leaves the simple fundamentals where the game, golf and golf life should be considered as enticing as professional golf. [SEP] yesterday, the list of 18 dead was being compiled in support of u. s. security forces, afghan defense, and the u. s. department of defense. [SEP] while there is some criticism of the extent of u. s. influence, think of it as [SEP]
+
+===== sample 034 =====
+[CLS] los angeles. [SEP] it's one of two events celebrating the stars of today's sports, the men's tournament, skateboarding, the women's professional ski teams, the 2010 n. h. a. olympic ski teams. [SEP] the a. s. p. c. t. iran's foreign relations office in the new york region is a close friend of the iaea, and iran was first president from 1979 until 2000. [SEP] mr kibaki has been president since his father, john moi, was prime minister. [SEP] new york's ryan gomes hit a long, free - kick, [SEP]
+
+===== sample 035 =====
+[CLS] the world. [SEP] " i was going to have to say that wasn't true, so that's exactly what happened. [SEP] a 24 - year - old university teacher from england received a tax bill of 25, 000 pounds (28, 000 dollars) after a budget of hundreds of thousands of pounds in the last few months in the city. [SEP] u. s. officials have dismissed obama's visit as a political give - in to iranian democracies, saying they had used their unprecedented lobbying power to press china for stagnation ties with iran, the country's most important domestic trading partner. [SEP] jeter [SEP]
+
+===== sample 036 =====
+[CLS] ltte ) spokesman james fairey said he does not agree with the progress netanyahu has made on a trip recently to east jerusalem. [SEP] "if players want to get back in this big tournament, you can't go out there and get off on thursday day and saturday day to day off just because they have to focus on playing with it," he said. [SEP] but to bring down her opponents, mr. obama and others have dropped their rhetoric and victories over those issues. [SEP] but i have stopped the price of budgeting, but i have to get in a good time. [SEP] he has a track record. [SEP]
+
+===== sample 037 =====
+[CLS] [SEP] coach tomlin said this week hoernicker was not "a victim of the situation" sunday night in the new england patriots arena. [SEP] mr brown is not known to win votes, with sources saying he is following his example and is seen as a great public figure. [SEP] mr. molobras said yesterday that the company sold $400 million in worth of shares mr. deem bought last month, 30 percent more than his father's buyout stock. [SEP] kivt worker alan goodington, who had been out of the city for the weekend, was taken to find madeleine's parents at home [SEP]
+
+===== sample 038 =====
+[CLS] education. [SEP] the parents were given permission and access to the school, but the state police have not allowed private orphanages to give their children access to primary school facilities. [SEP] while consumption also fell in the emerging group, consumption was 9 percent, and the commerce ministry said that in asia and africa, 1. 8 percent of the growth rate was 2007, a 28 percent drop decline compared with 2008 figures for the same period, according to the bureau data. [SEP] smith said he learned that miller was at the table friday but made only a comment on the difficult role of talking about the bill and what to do. [SEP] obama and hillary [SEP]
+
+===== sample 039 =====
+[CLS] filing with the new york securities and exchange commission. [SEP] but if the tories, as labour in power, must fail to reform the party, and the public, life is often tied to the death of a man, or that the role of government must be reduced to issues of freedom, freedom and moral liberty. [SEP] it's also generated a lot of energy. [SEP] "pats," don't say, no matter what he wants to say every time he hit the post. [SEP] but a spokesperson told the new york times last month that the studio was still working on the company's official line of 3d and [SEP]
+
+===== sample 040 =====
+[CLS] if we can't have another team playing the game, then, ok, i'm hoping for another 20 years. [SEP] two civilians were killed and three people were shot in combat in central baghdad. [SEP] the catastrophic loss could choke government earnings if the financial system does not exist, creating further liquidity problems for other governments. [SEP] this is right up the road. [SEP] the unemployment rate dropped by 2. 4 percent in the first half of 2006. [SEP] friday night, romo said he was not happy with torre's decision to give him a chance to go to the start of his contract. [SEP] strech said [SEP]
+
+===== sample 041 =====
+[CLS] pande. [SEP] the u. s. officials said china has been a key middle partner of president barack obama's administration to take on iran, a political china that has long been hostile, and develop stronger ties with foreign nations. [SEP] he and his wife have been seeking a debate on the issue of the "forced marriage" system. [SEP] kevin garwick, the chairman of labour, points to kevin bowles, the former liberal democrat leader as he added: " they don't seem to want to take a look at what's up at their feet, they don't have a lot of time to look [SEP]
+
+===== sample 042 =====
+[CLS] across the border from the region. [SEP] black and african - americans seem to find out just just how many young people think being conscripted. [SEP] the demographics of the democratic party's base in the south carolina house give democrats more experienced leaders in their field and can earn more political experience than their cronies. [SEP] sir david zolag will have made more money twice this time. [SEP] (as soon as she is joining mr. clinton's team, she finds a young man who is willing to fight, and has support from young women like patricia beffler, a former french ambassador.) [SEP] what can [SEP]
+
+===== sample 043 =====
+[CLS] china. [SEP] it was a theory originally devised by peter schennez, the son of pope benedict, who became so distended by the vatican's middle - class elite, it is impossible to imagine that he would find himself in a "private world." [SEP] the paper denies there has ever been debate between a man and a woman. [SEP] lee said he was prepared to ask north korea to make additional demands at a summit in beijing today, although he said south korea's government would engage in the issue. [SEP] there's nothing to be said more about spending less money than jet skimps, but [SEP]
+
+===== sample 044 =====
+[CLS] played by oo oo ha fung, who, lyrically true to the movie's text message, represents american violence. [SEP] a press conference? [SEP] mr jackson is yet to make an official announcement, although the exact amount of his personal assets based on his uk history is thought to be modest. [SEP] this is, of course, the great example of both mr cameron and mr brown's frustration about having to deal with the political crisis. [SEP] with few short episodes left, the limits of comedy has become clear. [SEP] gov. mit romney, meanwhile, appeared on fox news sunday. [SEP] while the fdic may [SEP]
+
+===== sample 045 =====
+[CLS] in the race, but it may be the last year, the irish independent reported sunday. [SEP] it was unclear whether the spending will be forthcoming and the initiative could create a ballooning budget deficit in 2010. [SEP] that's because "the wire" also tells the story of mcnaik, a president of the baltimore ravens. [SEP] she said: " the whole year was fantastic. [SEP] for the last two days, steven rawlinson, 30, and sam simons, 40, of lynham, attend a private school in storrs, west hams, complete with different faces. [SEP] mr. ndepa [SEP]
+
+===== sample 046 =====
+[CLS] sri lanka's armed forces killed 18 tiger soldiers in the country's war northern region early on wednesday. [SEP] thanks... [SEP] the bank has £91m and € 500m of debt, following its long - term exposure to the banking business. [SEP] the government is now expected to devalve away the company's budget. [SEP] it's a daunting race, but only a few short minutes into the first leg of the tour. [SEP] but the n. h. l. action got a little late, with the feeling that football on the giants stadium could have taken more than five hours. [SEP]
+
+===== sample 047 =====
+[CLS] the company made major private investments in saab last week, along with amd group and equity - owned lancom & sac. [SEP] "the inquiry is still on, and examining, what happened to michael jackson, but then by now it wasn't an easy decision. [SEP] i've been here for 40 years," he said. [SEP] the report, co - written by two expert experts from britain's uk border agency, was submitted to the information authority by its director general sir richard danbury and will help the state department to assess the future of its role in the war on terror. [SEP] attorney general ban [SEP]
+
+===== sample 048 =====
+[CLS] russian military and most of its american military forces as a main partner in the greatest high - security military conflict in american history. [SEP] "women were perceived to be taller and more likely to die than men." [SEP] new york (reuters life!) - men with a salary of $40, 000 are ready to make its own decisions on sex, money and health, according to research in the new england's journal of public health. [SEP] woods said he was happy to be back on the tour and will spend a decade in the united states, said his former boss, scott hendry. [SEP] in a similar way, china [SEP]
+
+===== sample 049 =====
+[CLS] following a few days of verbal negotiations with the two news agencies. [SEP] and the space committee (hae - hohn ' - o) (va) says it would enact legislation on missile issues. [SEP] the son of russian - born petrov was the hero of the game, still milking the ball with his fists, but he was unable to get on the touchline. [SEP] deputy prime minister kevin aso was leading the talks, park said of the agreement, and hill said obama was present at the meeting late friday in tokyo, to follow a discussion organized by washington's national association of chinese human rights lawyers. [SEP]
+
+===== sample 050 =====
+[CLS] to get rid of what that's worth, " he said. [SEP] the rate of price growth was at 0. 2 % for september compared to august. [SEP] mental health officers have found two teenage men after the crash in a warwickshire road on monday. [SEP] sales of construction equipment shrank by at least 10 % from the year before. [SEP] clinton's campaign support team will give a preference for the next president - - probably less than 50 percent of the 2000 republican electorate, sources said. [SEP] and over the next three months, again, what's hard to see is that obama is a man who doesn't look [SEP]
+
+===== sample 051 =====
+[CLS] prices are so high that it's tough for the second quarter, " said paul magnus, world markets investment manager at merrill lynch. [SEP] it's just a mixture of life, excitement and heartbreak, the same kind of character and optimism. [SEP] the school has worked out a national plan to help help run the school. [SEP] don't let that kind of thing uncut you. [SEP] the national bank of singapore is also expected to defend japan's fiscal stance. [SEP] matt boumann, also high on mickelson's money list, will finish second at 15 - under at the masters. [SEP] the same [SEP]
+
+===== sample 052 =====
+[CLS] said. [SEP] o' brien says she would never know again if she wants to be the case. [SEP] at the moment, it seems that no one can do anything wrong. [SEP] however, southampton's chairman peter glascern insisted that trembling's decision was a threat to the club's standing. [SEP] u. s. trade representative christopher kirk, at the bali gathering, said he will continue to deliver world - wide legislation to fight against global warming despite the short - term benefits of sanctions. [SEP] president amr khelil told algerian reporters the side would hold six hours of talks at the end of the day [SEP]
+
+===== sample 053 =====
+[CLS]. [SEP] anthony swengler works as chief executive director at the national park center, where he met his father james, who built the park in 1980. [SEP] tiger woods had eight holes to go on his final day, and the number three couldn't have been a match - up woods the rest of the way in 2003, 2002 and 2003. [SEP] ms suharto's growing frustration with the government there comes after increasing criticism of reforms in the banking sector. [SEP] but the show went bad. [SEP] the federal government is working to find a figure on how much of it is spent. [SEP] after six months, he was [SEP]
+
+===== sample 054 =====
+[CLS] the authorities. [SEP] the commerce department said sales fell 0. 4 percent in september to show the total drop of 0. 1 percent. [SEP] by the way, it would take 15 i. m. to start a ball with the ball and start moving the ball in stride. [SEP] cleef said he would have said "you can't make these shows go." [SEP] chief david wood said the scale of damage was "quite deep." [SEP] " people used to say you don't have the wrong company to put in and you just have to wait for the first time to pay for it. [SEP] mr cameron, [SEP]
+
+===== sample 055 =====
+[CLS] tax credits would be about eur37bn to £100bn per year - or eur6. 50, 000, up to £1, 000bn over 10 years. [SEP] there has been high levels of violence over the range of sexual assault, and in sexual attacks against young children. [SEP] instead, it's the defense that plays well with the rebels, with defenders taking the field. [SEP] " i'd like to make sure i'll do that someday. [SEP] david hatcher, the playwright, and his girlfriend in new york died may 4 when they fell while in a manhattan apartment, the star - ledger reported wednesday [SEP]
+
+===== sample 056 =====
+[CLS] korea, and china and india. "[SEP]" in the end, i know that obama and hillary don't disagree, and the people that have taken his position are not going to have put their foot down on the issue, " mccain said later, asked about the candidate's use of his political base. [SEP] houston (ap) - exxon mobil corp., the world's second largest oil and production company, raised prices in the u. s. midwest saturday, making it the fifth - largest petroleum producer of oil in the nation. [SEP] palin's publicist, william m. thompson, has [SEP]
+
+===== sample 057 =====
+[CLS] a small return to the footpaths and urban sprawl. [SEP] the rise of austeritarianism sounds like a great idea. [SEP] "we have good quality and that does not lead us to our goal," fahriz said. [SEP] i'm not the person who wants palin to go on the big issue. [SEP] he's 25 - year - old who knows his grandness through his braids, his peclonics and big mouth. [SEP] " the number of homebuyers backed by u. s. housing has dropped slightly, but it's expected to be much lower over [SEP]
+
+===== sample 058 =====
+[CLS] to address the world's problems. [SEP] so far, mr. mcgovoy has been on the air, but it is expected to be thursday as well. [SEP] "there's a clear need for us to change it," said mr brown. [SEP] if you drive 80 miles, and use more than 40, 000 cars, you don't know why, why? [SEP] "we're far below the levels it was 30 years ago," she said. [SEP] the government is expected to spend about about $10bn for the existing construction programme. [SEP] " i saw him at 6 - 1 and was [SEP]
+
+===== sample 059 =====
+[CLS] the impact of the financial crisis, as rising consumer demand for healthcare, education, healthcare and middle - income businesses have contributed to further economic strains, the times said thursday. [SEP] he says later in the year he will make it to the masters. [SEP] el gatabasa safaris ( 0870 6067973; www. gabyresorts. com. [SEP] and it followed him for years, not only with anger but with his age and with his parents. [SEP] it is an important economic development and very important to fighting the disease that has infected hundreds of thousands of people. [SEP] cervix [SEP]
+
+===== sample 060 =====
+[CLS] "and it has been a jab at the pentagon. [SEP] the family wants the foreign ministry to reveal whether the case is dropped. [SEP] they all estimate the annual budget deficit will be $2. 8 billion. [SEP] and the art of brindness, earnestness - - fulfillment of an desire to start a political career - - is not, quite frankly, the art of english women. [SEP] it's thought the rapid rate of migration to london may take more than 40 years. [SEP]" i just don't call this guy a big one, " he said. [SEP] under a proposed human rights commission on human rights [SEP]
+
+===== sample 061 =====
+[CLS] of equipment to be used for the investigation. [SEP] the law states that the local and north london authority should have to comply of its own standards, but the local authority has been working its way through. [SEP] 28 (upi) - - a man who was shot at a middle school crowd about two miles south of chicago is still alive in the county, officials say. [SEP] roh said he is scheduled to release his memoir, book on jayhoo, but said he's looking to learn more with the words "making a book." [SEP] (ap) - mark walling is developing a map in the shape of [SEP]
+
+===== sample 062 =====
+[CLS], the level of total exports for the fourth quarter is likely to be the same as last year, "the office said in a statement late on wednesday. [SEP] the south korea newspaper said foreign minister kim yong - hyun would return on a saturday flight from seoul. [SEP] michael hoey, the uk's foreign secretary, said the report is a" first step. "[SEP] he did not know that drivers don't have to pay. [SEP]" everything else is safe. [SEP] the u. s. official said an israeli official has not yet come back to the israeli call. [SEP] obama's department of the energy and natural [SEP]
+
+===== sample 063 =====
+[CLS] deficit estimated in 2005, jumped 15 % to a $594 billion deficit over the past three years. [SEP] immigration is now a major part of the u. s. budget for new mexico. [SEP] but in this time, he said, they might feel comfortable about spending too much. [SEP] obama, who said u. s. sen. john mccain has "no official ideas" about the issue, said that iran was prepared to end its fight against the afghan taliban movement and its allies. [SEP] abbas said the post - election would be critical to the administration of president barack obama. [SEP] the only choice, they said, is to [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_diffusion_noise_steps_128steps_n64/noise_const1p45_early_linear_eta0p08_c256_detok_raw_samples.txt

@@ -0,0 +1,230 @@
+noise_const1p45_early_linear_eta0p08_c256_detok
+{
+  "type": "summary",
+  "name": "noise_const1p45_early_linear_eta0p08_c256",
+  "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt",
+  "step": 187000,
+  "decode": {
+    "kind": "categorical_fullvocab_diffusion_state_noise",
+    "config": "noise_const1p45_early_linear_eta0p08_c256",
+    "steps": 128,
+    "temp_start": 1.45,
+    "temp_end": 1.45,
+    "temp_schedule": "const",
+    "t_power": 1.0,
+    "eta0": 0.08,
+    "eta_schedule": "early_linear",
+    "noise_conc": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 44.54583377426971,
+    "nll_per_token": 3.796518631569996,
+    "tokens": 9463
+  },
+  "diversity": {
+    "sample_entropy": 4.1536400284735615,
+    "unique_tokens": 1882,
+    "token_count": 8192,
+    "distinct_1": 0.229736328125,
+    "distinct_2": 0.6952509842519685,
+    "top_token_mass": 0.0660400390625
+  }
+}
+
+===== sample 000 =====
+[CLS] "there's no solution in this very difficult situation. [SEP] john arnott, owner of petro's kitchen resort, which has a budget of nearly $75, 000. [SEP]" it is more of the same that these guys are paying attention and they don't have it here. [SEP] "we're hillary strategists, hillary and hillary are both men," u. s. strategist and a former ambassador to the u. s. secretary of state hillary clinton said on friday. [SEP] obama urged the pentagon to remain serious about iran and consider sharing it with the u. s. [SEP]
+
+===== sample 001 =====
+[CLS] technology, such as stephen wygier of bris university in london. [SEP] brownsville, ohio, jan. [SEP] then he took his son to the airport, then he was unable to get out. [SEP] gop also has a problem with president obama's decision to make policy...... the..... oh. of course. the nation's heritage of sports is the best in pro sports. sports, the world... sports, team sports, music, level sports, and....... for more information on sendas please visit www... [SEP]
+
+===== sample 002 =====
+[CLS] don't know the way we see people, " morphey: i'm going to go and i'll feel about it. [SEP] on october 11, he was admitted to seeing mrs walker, 55, whom the court sentenced to up to two years of supervised supervision. [SEP] the obama administration doesn't have all the extra resources, however, and there is little doubt she will once again need the extra money. [SEP] advocates say the law is important because it is funding for infrastructure spending. [SEP] the bank shares fell 1. 6 percent lower to 2, 500 yen in early trading, as the global banking crisis hit [SEP]
+
+===== sample 003 =====
+[CLS] economic and economic expansion, the result of the loss of commercial dollars, and a fall in south korean demand, marks the end of the crisis. [SEP] meanwhile, mcmanus claims that the party's policy is to keep contact with mr mcelroy under the agreement and must be based on its list of senior ministers. [SEP] the schools, aged 14, 13 and 15 september 2007, will be closed. [SEP] oklahoma city police said stephen garlin, 18, daniel brown, 36, of coldfield gas station, texas, and 19 - year - old ben brown, 19. [SEP] five days later obama's address comes [SEP]
+
+===== sample 004 =====
+.................................................... and and. and more and more and more..................................... and more and...........................
+
+===== sample 005 =====
+[CLS] $20 billion in auction of government debt, after suffering a 13 per cent drop to hk $17. 4 billion in the nine trading hours to friday. [SEP] he lost to martin schnreibel, soderling was dropped during the match and his partner withdrew due to back sickness. [SEP] ferguson, a former england assistant manager at west ham, has signed more than 100 since the start of the season. [SEP] he would have preferred to move into the local market. [SEP] the cbo said the rate on libor of treasury bills in u. s. dollars went down to 2. 39 percent. [SEP] eu officials said [SEP]
+
+===== sample 006 =====
+[CLS] team coach michael horrid what to say about scott driver's words and actions after the death of tom hargis isn't easy. [SEP] for me, there's a general lack of respect of one who wants to. [SEP] but, said james dobson, the independent consultant, there's unsettled need for jobs for young people who live in the country and who can't be taught about our national identity. [SEP] the campaign also prompted calls from democratic groups for clinton to take her attacks on not just the struggles of working americans but also his responses to the problems of working class and white voters, like [SEP]
+
+===== sample 007 =====
+[CLS] bst. [SEP] michael reinter, a political scientist with the national republican party club, said democrats believe congress need to give up the liberal power and restore some liberalism in washington. [SEP] " i know the one that's ever got away with that guy. [SEP] the company estimates the pot will be worth £20m - £325m annually, compared to last year's profits. [SEP] it still isn't known what that money will be at the bank. [SEP] yonhap said the president asked that the chinese government now try again to focus its efforts to overcome the crisis and return to normal relations and establish a [SEP]
+
+===== sample 008 =====
+[CLS] last month what is believed to be one of many problems for the united states. [SEP] this represents 38 percent of the nation's total food book sales ($300 billion in 2005). [SEP] new york (ap) - television news reports and twitter users will be able to share some of their stories online. [SEP] police have arrested a 38 - year - old man charged with a string of assaults at an ex - gift shop in northern new york city. [SEP] mr. gaz, the boy, left school a few months later and went to work to become a schoolteacher. [SEP] obama had promised to continue campaigning in the state [SEP]
+
+===== sample 009 =====
+[CLS]. 1 billion from july 2009. [SEP] banks have issued more than $2. 2 billion of bonds, with a total of about $9 billion net of debt issued through the new government bond offering. [SEP] police say a man charged with the murder of a colorado gunman was reported to dead at a women's center in dallas, texas. [SEP] cooper: this year, everyone showed up the road. [SEP] "in terms of the fact that we do want to work into the afghan investigation, the process and contacts with these individuals seems to be much clearer," mr. karzai said. [SEP] it compares with 5, [SEP]
+
+===== sample 010 =====
+[CLS] international group, one of the largest international companies. [SEP] she pokes fun at the house. [SEP] " we want to create order and modernity, to keep thinking about what to do. [SEP] they've got a team there, and as many of their players and coaches get hurt, i'm sure they'll do it. [SEP] the jobless rate of jobless benefits rose slightly to 10. 0 percent, up from 12. 1 percent to 10. 1 percent. [SEP] just forget about the election. [SEP] sorry, but it did come immediately. [SEP] this is why the government has come around to try to sort [SEP]
+
+===== sample 011 =====
+[CLS] [SEP] he said mr bush will hold an all day meeting of the international monetary fund governors in washington, dc., in april. [SEP] the post said the office also noted that mr. bush's spending on highway construction funds has forced him to spend $75 billion more, while the president plans to spend $40 billion on building and infrastructure projects. [SEP] the work is to start thursday at the long island recreation center, pier 60 in the long beach section of 2200. [SEP] the experts say that the information will show that china has foreign interests and its own economic problems, but do they say now that china's political leadership [SEP]
+
+===== sample 012 =====
+[CLS] in the following press release. [SEP] the two nations have also agreed to cut off joint industrial projects with military and military ties. [SEP] the uk's anti - tax behaviours were growing last year. [SEP] dayton, ohio (ap) - the obama campaign's admission that john mccain is the party's nominee - - despite stepping down as a rival to be a republican president - - threatens the campaign's health care plan, the obama campaign said saturday. [SEP] less than two hours later, the police tried to locate the woman in grasworth, 31 miles from the north east coast in the west midlands. [SEP] the [SEP]
+
+===== sample 013 =====
+[CLS] to come back to his team. [SEP] in 2005, more than a year after the collapse of hbos, the city lost £823. 7m on income tax tax (£61. 00 per employee) in the last year but has now lost more than almost £370m. [SEP] uaw has made mobile phones and wireless plans available for $30 per year instead of the current price. [SEP] the leaders of the two camps have been on the opposite end of the dividing line. [SEP] ray rice was handed a 25 - yard pass to jacobs. [SEP] the arrest - - the first time u. s. authorities have [SEP]
+
+===== sample 014 =====
+[CLS] throughout the race. [SEP] there are many ways that people can use their brains to carry out the three core principles that they claim to have. [SEP] nato and united states withdrew their forces in georgia's capital in october, after the moscow alliance had repeatedly declared its support of kosovo's then - backed deby government. [SEP] of course, people are unconvaled about the game themselves. [SEP] yes, we all wanted to do better. [SEP] the new bill includes health care by the public health insurance companies, worth about $1. 8 - billion a year annually. [SEP] the volume of imports from iran, the number of [SEP]
+
+===== sample 015 =====
+[CLS], russia's energy minister, has previously refused us charges, british prime minister van rom hoy said of his counterpart. [SEP] people tend to know more about the historical facts of life, including the fact that we are human primates. [SEP] the comments were published by the news and sunday times, concluding with a news conference at the london hotel. [SEP] he said he hated michigan's decision, his players said, because it was in florida and would make changes to do with the national title game. [SEP] all you do is find the technology and motivation to take what the players want. [SEP] pakistan, which is regarded as a [SEP]
+
+===== sample 016 =====
+[CLS]. [SEP] what your name... think the reps. [SEP] maybe i would ask for specifics. [SEP] china also has a reputation for military instability. [SEP] my vision of my life described her going through the painful process - - becoming a mother and having to take her husband, raise a loving family and enjoy herself. [SEP] house members said tuesday that president barack obama's policy request for the additional troops is clear, and that they would take that shift very quickly. [SEP] though clinton's decision was based on negotiations on the complex question of president bush's policies, the president still stands on a large - scale national [SEP]
+
+===== sample 017 =====
+[CLS] opened to the public in 1997. [SEP] the total level between english students and chinese people certainly depends on the quality of education, not funding. [SEP] still, while white has said he'd know obama's record in this economy - - i'd say just that - - he doesn't really remember hearing much about how he's doing. [SEP] "if you really don't like us, try to come down to understand what he's doing. [SEP] much the same as what was said last year about rafa. [SEP]" we will stick to a very tough position, " said japanese prime minister taro [SEP]
+
+===== sample 018 =====
+[CLS] [SEP] (cbs) - a small commercial plane that made a rough landing in florida has rolled over, killing 12 people in a forested region. [SEP] i will probably see a common sense shorthand. [SEP] redknapp, the club's england manager for four years before the 2006 defeat by birmingham, has already scored two second - half goals against manchester city's park. [SEP] the closure of the primary education level will raise questions about the level of public services people will need to keep school going. [SEP] the next generation of american football team, the american dream, has its own wish list of women of all ages. [SEP] [SEP]
+
+===== sample 019 =====
+[CLS] flounding success. [SEP] brad kotchman doubled and scored cano over the left - hand side of jason laksa field in the seventh, leaving the ball on the left side of the line with the left foot.... [SEP] the three, a student in the university's psychology department, arrested six of their students. [SEP] the national journalists' group was formed in 2007 with two of mr. bush's advisers - - former national security national security counsel michael hayden, the retired deputy cia director for intelligence and terrorism, and daniel gibson, the retired deputy ambassador to mr. bush, and his wife, [SEP]
+
+===== sample 020 =====
+[CLS] anti - terrorism operation. [SEP] "i think something that people are talking out about is i've got the options, and i need to get to it ahead of time, to find a way to play, to take some action," chopra said. [SEP] woods, who will start his season at the masters sunday, said he is also going to keep working. [SEP] tokyo, japan (cnn) - - wen jiabao, who will head to tokyo thursday to become head of the ruling democratic party of japan, opened the first conference on saturday and said the country would do more to boost japan's ties to the region [SEP]
+
+===== sample 021 =====
+[CLS]ing at the end of 2008. [SEP] the white house budget office said the scale of the administration's plan to deliver specific economic programs falls in the longer period of time. [SEP] it's been said that the market wants to buy more equity and that is because the long - term credit market distress is starting to surpass the credit crisis. [SEP] toyota is hoping its first electric - car plant in the new mexico will create hundreds of thousands of jobs across the area. [SEP] the government said friday showed a 3 percent decline in imports from u. s. trade in june. [SEP] it's clear that they want teams to be [SEP]
+
+===== sample 022 =====
+[CLS] declaration of war issued last monday. [SEP] the company, based in silicon valley, said sales grew by 45 percent in the u. s., france, china and britain. [SEP] like many people, he's like a lot of them. [SEP] many people who have been interviewed about the activities don't make much mention of the former prison camp. [SEP] president obama's plans for ambitious efforts to cut healthcare costs were announced in january, but have not been enacted. [SEP] he will be leaving the white house with deputy national director of national security, michael mullen, on tuesday night for a three - minute " [SEP]
+
+===== sample 023 =====
+[CLS] year - old woman and her boyfriend, 21 - year - old john haywood. [SEP] they stressed that the north was not willing to hold talks at all to end its differences with the chinese government, while using talks only to give those concessions to the koreas, who will turn the issue on their head. [SEP] israel, along with iran, said it is close to signing the accord. [SEP] the u. s. state department's office on monday said tuesday it doesn't expect of further activity with the iranian government. [SEP] the government will need to close the road network in the next £40m to help with transport [SEP]
+
+===== sample 024 =====
+[CLS] too. [SEP] "i just just got started," matsuza said. [SEP] jamison was joined all - star by smith and kevin allen on saturday. [SEP] moyes's owner peter mcpite, yesterday, revealed that he had abused the position of his former everton chairman sir john moyes recently by leaving the stadium with one of the premier away games of the season. [SEP] he does not have a similar relationship with the club at this time and it's almost expected that he will spend less time on a team - friendly basis. [SEP] it said scottish politicians were now thinking of "taking sides in politics," [SEP]
+
+===== sample 025 =====
+[CLS] first government office held by the chinese since 1997. [SEP] he also said he informed federal agents that the next day he saw was an fbi investigation into a church - run television and e - mail call about his wife allegedly assaulting a 17 year - old married ex - wife. [SEP] mr roube said the conference appeared to show personal support for the eu deal, and called for an open forum for countries to play a major role in restoring the credibility of the eu. [SEP] worldwide, the unemployment rate increased the same year - - 14 percent in march 2007 to 9. 2 percent - - also the highest in a year - - [SEP]
+
+===== sample 026 =====
+[CLS] deficits in the previous fiscal year. [SEP] the bank said recently it would seek to buy $800m of government debt to help reduce the total amount of us treasury debt and make it available to congress for public funds. [SEP] at one point, mr obama was defiant. [SEP] the faa won't release the name of the plane crasher who died in 2006. [SEP] hamilton was born in new york. [SEP] last week, deadly skirmishes with a californian court and national park ranger over a 12, meter - long fence that stretched over 40 feet of sand and sand and cut off several streets in this county. [SEP] produced by [SEP]
+
+===== sample 027 =====
+[CLS], they can still get loans to make mortgage payments. [SEP] "the rest of the family is gone," says the letter to dillin. [SEP] "it's still there," said john smith, one of the scientists who formerly led the pilot phase of the project. [SEP] he said that he did not approve rethinking that young people should be aware of their rights concerns, particularly children, teachers and those children in general. [SEP] he told court he had shot her a few times before the guards punched him. [SEP] there is already seven golf courses, including the british open and pga champion bob hodgman tour [SEP]
+
+===== sample 028 =====
+[CLS] - moon. [SEP] the 35 - year - old has made most of his international appearances prior to the new season. [SEP] 9 (upi) - - the two u. s. national army officers died thursday at the age of 31 as they gromed during a short program in new york. [SEP] mccain said this night that senator barack obama had "made the greatest choice" on the country's security in the context of the president's first 100 years in office. [SEP] "one of the major problems with the money that i get going, people do business with me, and the same kind of stuff," said [SEP]
+
+===== sample 029 =====
+[CLS] their administration to hand over a special review to allow its regulator to continue its mission. [SEP] it isn't limited to the presence of a football match and, naturally, the manager is particularly concerned of whether you have time off. [SEP] the 11 - year - old last played at verizon in 1976. [SEP] total sales were us $21. 1 million of net sales and sales total. decrease of $19. 1 million reported in the first nine months of 2008. 3 % to us $7. 6 million reported. period. expected to decline us $4. 2 million by close to the current quarter. [SEP] mr [SEP]
+
+===== sample 030 =====
+[CLS] about 27. 5 million passengers and three times the uk's total capacity. [SEP] tokyo (reuters) - sumitomo group corp (01302. t), the largest energy company linked to a growing chinese demand crunch despite a global oil shutdown in oil and gas consumption, said on friday. [SEP] two passengers were taken to hospital after the accident. [SEP] that plan you think would have helped us make the transition into a school system. [SEP] "like someone of an old age, i always wanted to go to work in a clothing business," she says. [SEP] under obama's economic rescue plan, the president [SEP]
+
+===== sample 031 =====
+[CLS] looks like a good day. [SEP] the cause of the expected sharp fall in earnings created from the price being paid for the state's public bad debt is what could turn out to be a 3 per cent surge in output growth. [SEP] and if you've seen the weekend holiday to florida, you might consider crossing the sun - drenched atlantic coast at oceana beach. [SEP] the one thing about tiger woods woods is that he's had a crisis to the public over the course of eight months, although his high - level pattenitions have come under outside scrutiny. [SEP] the move was the product of an end of tension [SEP]
+
+===== sample 032 =====
+[CLS] say when he has the time to take the course. [SEP] she said they had four hours to make the final of their race. [SEP] like the rest of the world, the obama administration has stepped up the pressure on syria over the iran - led iraq crisis and decided on a possible meeting with iraqi president barack bush, the report said. [SEP] domestic violence in the united states has risen sharply since june 2007, according to the report. [SEP] the cost of the proposed new site will cost up to £4. 5m to deprive the town for next year's water park tournament. [SEP] in emerging countries, for example, [SEP]
+
+===== sample 033 =====
+[CLS] experts agree. [SEP] he spent much of his time in the hands of the barclays in the middle of the season and he was a great manager. [SEP] it is the largest amount of debt for the united football franchise to date. [SEP] answer: you now have your full knowledge of what it takes and what they want to know. [SEP] " the united states confirms that there was support for terrorism... attacks by the mexican (u. s. government), mexican government, and the u. s. department of health... there is no telling of the difference between u. s. and local versions of the report [SEP]
+
+===== sample 034 =====
+[CLS] he said. [SEP] i see a lot of wear here on the outside of obama's white house town hall. [SEP] gasoline futures rose to $3 cents to $2. 56 a gallon, from nearly $4 in october and still above a historic high of $2. 21 in february. [SEP] the news report was the first confirmation of the new nuclear activities by the united states, and accuses the iranian government of sticking to its recent nuclear test. [SEP] mr brown is in talks with opposition labour leader stephen johnson to push for shadow foreign secretary david miliband's most prominent party group to issue guidelines for handling of foreign [SEP]
+
+===== sample 035 =====
+[CLS] the world. [SEP] during the olympics, organizers tried to use the stadium as a symbol of the sport's survival. [SEP] steve, a 24 - year - old station manager from hackney, east london, raised 20, 000 pounds (£18, 000) per week by opening a pet style pet shop in sanday, near new york city. [SEP] u. s. officials also criticized beijing's approach, refusing to send a delegation to mediation to find solution to the dispute. [SEP] during a recent meeting with foreign trade minister lee hag - hak, the country's negotiator said. [SEP] jeter [SEP]
+
+===== sample 036 =====
+[CLS] according to the paper. [SEP] the jewish group does not agree with how israel and mr netanyahu's proposals operate in east jerusalem. [SEP] "if i can get out of the house next year, i don't have that kind of support to go down," he said. [SEP] sir michael was joined on the global radio agreement with media group co - chairman andy burnham and james johnson, the bbc's commercial director for media coverage, after voting against the move in 2006. [SEP] all that means that the world's biggest carmaker may need to stop growing inventory of cars. [SEP] the automaker's annual [SEP]
+
+===== sample 037 =====
+[CLS] liverpool coach bruce collins said: " the thing i know is the most remarkable aspect of the scottish football league history that it has proved super rich. [SEP] mr bush is still trying to win votes, with critics saying he should have been president when he tried to fight a general election. [SEP] mr. sarkozy's proposals were followed by a national - level agreement, under which mr. sarkozy's administration, weak since then, could proceed with more serious negotiations. [SEP] wvt - tv has had similar coverages on the enforcement front. [SEP] the case, which is under the bureau of investigation and review, [SEP]
+
+===== sample 038 =====
+[CLS] education. [SEP] i'm doing college and studying level at school, but i just get into education, i can get into languages and start learning their skills at cambridge. [SEP] while major opponents including the civil rights group, a women's network and one prominent business group joined more than 30 groups, mr. mccain renewed attacks on the president. [SEP] the 19 - year - old man shot four teenagers dead the same morning along with his father, he said, and said he was shot to death at the school, but it was too late in the day there was no way the boy decided what to do. [SEP] " and then [SEP]
+
+===== sample 039 =====
+[CLS] of the clinton administration urged both countries to ratify laws dealing on human rights issues, saying administration officials have been pressured into breaking with the law. [SEP] the candidates are terrific and some of them have said both about the good times. [SEP] "we do not always need a single type of education," she says. [SEP] it's that relationship that makes you uneasy. [SEP] "black people," don't say the word put on pelosi. [SEP] now the field is clear. [SEP] but a spokesman for the new york times on wednesday said the report was an interpretation of the state's own policy, saying the [SEP]
+
+===== sample 040 =====
+[CLS] strength of the frolog approach is remarkable. [SEP] i would never agree to stand beyond the end of their school years. [SEP] two people were rescued from the revers platform on the cross - clyde river by the coastguard agency (0871 97687. uk). [SEP] but england manager brian ashton has announced his players will not take the decision. [SEP] the former carolina quarterback, who posted a 13. 8 yards per game and 6. 7 average, also had four points. [SEP] and this year's second test for the health minister, gordon brown, who is expected to discuss health education and access to [SEP]
+
+===== sample 041 =====
+[CLS] pande. [SEP] the 27 - year - old spaniard had already been replaced by team - mate gareth bale, who has surgery on his left side due to the injury. [SEP] however, the group refused to commit to a proposed eu form of international action, citing french president nicolas sarkozy. [SEP] "it's changing. [SEP] james milner made a bit out of newcastle's game at kilmarno and former bath and england coach john cudde said after being playing against a string of international players, he went on to play at the end, and didn't have the down side. [SEP]" [SEP]
+
+===== sample 042 =====
+[CLS] international trading commission at the time. [SEP] however, he said that he wanted president barack obama's focus on clean energy and climate change to create support for global climate change, and that he wanted to push forward a range of international issues including climate change emissions and address the impact of climate change. [SEP] the country has issued four formal objections to the u. n. security council, african and south african governments. [SEP] he wanted to study finance at capitol hill high school in the early 1960s. [SEP] yes, it is stupid! [SEP] i think it was an unmirable television commentary: a wiser of thought to know what the [SEP]
+
+===== sample 043 =====
+[CLS] movie. [SEP] it is the value of working three lines of work - - such as getting the information needed for watching sports before moving on a particular job - - that often is based on history. [SEP] the spokeswoman said the state's interest in the market would "be to bring it together," but said it did not have a buyer. [SEP] this is the most difficult decision that we can ever take, " mr obama added. [SEP] now, if you are willing to do the same, saying that it might be a good bet, you might be much more confident about spending money than you are, so i think [SEP]
+
+===== sample 044 =====
+[CLS] daniel v. vickery, who died as a senator in 1995. [SEP] "there's nothing about russia that we want to talk about in the past... it really makes you think about russia," said mr chervkin. [SEP] "i know i would never try to help myself from what i said to myself," he says, " because i never wanted to know what was happening and had to deal with what was happening. [SEP] speaking in a meeting with treasury officials, paulson said that treasury secretary timothy f. ge geithner, would head the federal delegation. [SEP] it's hard to [SEP]
+
+===== sample 045 =====
+[CLS]. 2bn, leaving government borrowings in november at £3. 1bn, while borrowing rose in december at £11. 3bn, and the total net for the deficit will be £57bn. [SEP] that's why in the end, he tells the story of mr conkie, a story of an oxford university professor exploring how the whole world is compared with our ancestors. [SEP] for the last two days, the military had captured three combat helicopters, one a rescuer, and rescued three captives, including a 20 - year - old afghan, who was on a life - saving mission. [SEP] mr. ndepa [SEP]
+
+===== sample 046 =====
+[CLS] the league's first big east tournament. [SEP] the nie's children's policy and education data was published by the dfsa in november. [SEP] you don't know whom, actually, really. [SEP] it will be closed on september 6. [SEP] he says he is ready to lead climate change whatever he wants to talk about. [SEP] it's built on a new 40 - ton platform that will take about 3, 000 feet. [SEP] get the gambler to work through as many holes. [SEP] during this previous debate, obama focused his campaign campaign on claiming that he could have stopped voting for clinton. [SEP] [SEP]
+
+===== sample 047 =====
+[CLS] the street. [SEP] "it's a waste of time to see the person who has stood in front of our home that night, and i hope it is not his wife, sharon, and our daughter, francesca, but the fact that's not where it goes. [SEP]" i've been here for 20 years, " he said. [SEP] the change will follow the approach that has brought criticism from leaders of all areas of government, not all private institutions. [SEP] the national debt level stood at $1. 3 trillion from $1 billion at may 31, of which $1 billion. [SEP] bachman said he has [SEP]
+
+===== sample 048 =====
+[CLS] moscow to end most of its missile defense. [SEP] he made mention of the issue yesterday - saying, "there wasn't anything you could possibly do with one or any other on the line of succession." " [SEP] 13 (upi) - - u. s. coach jim gaithenville was suspended as a senior college player after suffering serious head injuries while playing professional football, the national football league west virginian said tuesday. [SEP] when the senate senate finance committee meets next week, the committee will get a report in the same day monday on the impact of the legislation on emissions. [SEP] in a separate way, china [SEP]
+
+===== sample 049 =====
+[CLS] to a fresh round of diplomatic negotiations with other foreign news agencies. [SEP] the initiative is being run by the charity and government agency for northern ireland (aig). [SEP] mr folley went to study at the university school in north wales. [SEP] " i still have to point out that i'm doing my job a whole year long and then people are really out of work. [SEP] i tried to imagine if obama was doing himself the same thing, but i always tried to explain what obama is not doing. [SEP] after friday's day to get his message, gibbs wasn't sure much time. [SEP] half a dozen [SEP]
+
+===== sample 050 =====
+[CLS] post reported friday. [SEP] that's important, "he said. [SEP] the tentative talks ended on monday at 24 hours and robert gibbs declined to say whether it was between the obama administration and treasury officials, who had indicated they could not reach a deal. [SEP] retail sales in the uk fell by 0. 7 % in october compared to august 2007, the lowest data released on the continent since october 1998. [SEP]" when i do what i do, then he will come back and get into that car and try and tell me and i like, ' why don't you run down this road - - and don't know [SEP]
+
+===== sample 051 =====
+[CLS] had four fumbles over his career, including another outstanding second - half leader at florida state, donte sheridan. [SEP] australia's prime minister kevin rudd won a meeting with china's negotiator, reassuring japanese leaders and china that their commitment is a long - term political agreement to help china's currency. [SEP] he'll need to do more work on his own. [SEP] that is because it now accounts for more than 50 per cent of the population. [SEP] british air station manager matt speig said his company's six world cup 35w park circuit races are held at the weekend. [SEP] the same [SEP]
+
+===== sample 052 =====
+[CLS] said. [SEP] o' brien said he'll know more if he wants to show it up. [SEP] jim lentz, chairman of the house foreign relations committee here, asked the california attorney general's office to step up the investigation. [SEP] that's why countries are not investing in carbon, he says. [SEP] you're kind at times being wrong, " he said. [SEP] in 1954 it was seen as an uncontrolled communications centre and is becoming a stand - alone center of communications in the 21st century. [SEP] the rest were poor people in europe. [SEP] if some people want to buy food in a day [SEP]
+
+===== sample 053 =====
+[CLS] m glad that we've talked about the labour party, the next election conference, the liberal coalition government meeting tomorrow - - a promise that we're going to give this to the electorate. [SEP] the bank could raise up to £56 billion of new capital in debt markets by placing a guarantee on borrowing from european sovereign countries, spain and greece. [SEP] mr morris brought his case after receiving contact with the singer, whose pre - school age included, three years ago. [SEP] the good thing is money. [SEP] washington - barack obama's campaign has long used the state of florida as an example of party politics, but he is [SEP]
+
+===== sample 054 =====
+[CLS] me because it really looked like it was close, "she said. [SEP] the military said four soldiers of a local group of international forces were arrested after pulling children out of the area in an apparent effort to avoid a confrontation with the rebels. [SEP] he was the first quarterback of 32 years at wrigley field. [SEP]" you can't tell if there's much overlap, but it's still a challenge, "holb said. [SEP]" people used to say that it's complicated and artful, " she said. [SEP] i know he will have one day to show for it. [SEP] mr osborne, [SEP]
+
+===== sample 055 =====
+[CLS] interview. [SEP] barbour said he was going to meet - press with biden over questions about returning the governor's nomination to the bush administration, the post said. [SEP] david white, executive director of the national grasslands trust, said that lewis was considering his position as an outsider. [SEP] i think it's probably going to sit well with consumer prices, but if there's that chance, it's going to happen, " mr fresman said. [SEP] it's not clear whether any of the money is coming from foreign countries. [SEP] in a separate story published tuesday, the pittsburgh union - gazette reported wednesday [SEP]
+
+===== sample 056 =====
+[CLS] europe, and russia and india. "[SEP]" in the end, i know that obama and hillary don't agree, and the things that have taken him to right are going to say that his guy's the same, " mccain said later on saturday, suggesting that the obama camp kept his mind out. [SEP] washington (ap) - - president barack obama is ending the bush administration's plan to give the bank of new york control of the u. s. housing market to deal with the u. s. housing crisis, officials said monday. [SEP] palin's publicist, rebecca brennel, has [SEP]
+
+===== sample 057 =====
+[CLS] kaocha in the north - east and pechica in the east, the kiponi and pale - coloured saughs. [SEP] the players were asked to visit high schools three months ago in the school year. [SEP] obama has renewed sanctions on iran's nuclear program, saying tehran still needs to carry on its nuclear program. [SEP] he's good, but he's gone. [SEP] the conservatives have also highlighted mr clegg's fiscal discipline as the reason for the threat of budget cuts. [SEP] in the u. s. and china's view, it's the only way china can go [SEP]
+
+===== sample 058 =====
+[CLS] paint, sunbeds and piping. [SEP] nevertheless, mr. vander beek has taken on some responsibility recently: she's beginning her career as a judge. [SEP] there's nothing that's going to change it, "said mr brown. [SEP] friday night, england's leaders from the irish republic, ireland and france host the international meeting of leading finance at the wembley stadium. [SEP]" this is the decision i made five years ago, "he said. [SEP] the deal also has a total amount of $10bn, including existing government bonds. [SEP]" i know my mom, my father and my [SEP]
+
+===== sample 059 =====
+[CLS] biggest impact of the financial crisis, reaching 2. 4 million people aged 50, older and working - age people aged from 13 to 45 years, according to the survey. [SEP] he says that in the year it will be hard to expect economies to lose more than 50 per cent of global output, however many observers might expect a similar slowdown, with much to be expected in 2011. [SEP] my wife married him 10 years ago not only with my son's father and other former relatives. [SEP] there is a long list of criminal cases including the deaths of the climbers, a man and a woman. [SEP] korez believes [SEP]
+
+===== sample 060 =====
+[CLS] " and it has been a gung at the moment. [SEP] the family wants the high court to consider whether the case was dropped. [SEP] they sell home worth and have net assets of more than $100, 000. [SEP] the company will not give details, the unidentified source said. [SEP] staff writers john grubelbach, jim doughton and john doughman contributed to this report. [SEP] wells fargo spokesman tim mclaughlin said they'd like to contact the lenders via web site. [SEP] mediaclus plans to create a web advertising company. [SEP] north korea's decision to build a human human rights commission is the latest [SEP]
+
+===== sample 061 =====
+[CLS] of companies to get a government bailout. [SEP] the department of co - operation also said the uk would have to set up its own standards for the investigation. [SEP] defense spending for the year is estimated at $32. 4 billion. [SEP] a 67 - year - old woman's partner has been arrested in connection with a sex attack on her off - duty boyfriend. [SEP] though it's too easy to give his team's title along with the welsh game, he has continued to be actively involved in the touring team, the wales and england lions and has announced no intention to build a national team. [SEP] mr smith, [SEP]
+
+===== sample 062 =====
+[CLS] chairman joe mcgan and his staff know what he wants them to hear from our washington state president, "lawton said in a statement issued late saturday. [SEP] gurgouro couldn't get at the sound of the movie and looked back at me. [SEP] robert hoey, the u. s. ambassador, said the effort is a significant step forward. [SEP] there's no question that they don't know to understand what kind of things he is doing. [SEP] he said the administration" may be ready " but has not yet put back a final conference call on mr obama's choice and that he would have [SEP]
+
+===== sample 063 =====
+[CLS] s. box office industry is on track to reach $1 billion in revenue over the next three years. [SEP] consumer loans provided about 13 percent of the national average economy in 2008, totalling $4 billion in the quarter. [SEP] (cbs) the house financial services committee on friday recommended sending its ideas on president obama's reform proposal to congress, but it had no plan. [SEP] mr cameron has said he is prepared to file a complaint, but mr wilson will not want to say how this will be worked out. [SEP] and while he said the second movie this year, "good for the city," the director added that [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_diffusion_noise_steps_128steps_n64/noise_const1p45_early_linear_eta0p08_c256_scored.jsonl

@@ -0,0 +1,65 @@
+{"type": "summary", "name": "noise_const1p45_early_linear_eta0p08_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "noise_const1p45_early_linear_eta0p08_c256", "steps": 128, "temp_start": 1.45, "temp_end": 1.45, "temp_schedule": "const", "t_power": 1.0, "eta0": 0.08, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 44.54583377426971, "nll_per_token": 3.796518631569996, "tokens": 9463}, "diversity": {"sample_entropy": 4.1536400284735615, "unique_tokens": 1882, "token_count": 8192, "distinct_1": 0.229736328125, "distinct_2": 0.6952509842519685, "top_token_mass": 0.0660400390625}}
+{"type": "sample", "index": 0, "raw_text": "[CLS] \" there ' s no solution in this very difficult situation. [SEP] john arnott, owner of petro ' s kitchen resort, which has a budget of nearly $ 75, 000. [SEP] \" it is more of the same that these guys are paying attention and they don ' t have it here. [SEP] \" we ' re hillary strategists, hillary and hillary are both men, \" u. s. strategist and a former ambassador to the u. s. secretary of state hillary clinton said on friday. [SEP] obama urged the pentagon to remain serious about iran and consider sharing it with the u. s. [SEP]", "detok_text": "[CLS] \"there's no solution in this very difficult situation. [SEP] john arnott, owner of petro's kitchen resort, which has a budget of nearly $75, 000. [SEP]\" it is more of the same that these guys are paying attention and they don't have it here. [SEP] \"we're hillary strategists, hillary and hillary are both men,\" u. s. strategist and a former ambassador to the u. s. secretary of state hillary clinton said on friday. [SEP] obama urged the pentagon to remain serious about iran and consider sharing it with the u. s. [SEP]"}
+{"type": "sample", "index": 1, "raw_text": "[CLS] technology, such as stephen wygier of bris university in london. [SEP] brownsville, ohio, jan. [SEP] then he took his son to the airport, then he was unable to get out. [SEP] gop also has a problem with president obama ' s decision to make policy...... the..... oh. of course. the nation ' s heritage of sports is the best in pro sports. sports, the world... sports, team sports, music, level sports, and....... for more information on sendas please visit www... [SEP]", "detok_text": "[CLS] technology, such as stephen wygier of bris university in london. [SEP] brownsville, ohio, jan. [SEP] then he took his son to the airport, then he was unable to get out. [SEP] gop also has a problem with president obama's decision to make policy...... the..... oh. of course. the nation's heritage of sports is the best in pro sports. sports, the world... sports, team sports, music, level sports, and....... for more information on sendas please visit www... [SEP]"}
+{"type": "sample", "index": 2, "raw_text": "[CLS] don ' t know the way we see people, \" morphey : i ' m going to go and i ' ll feel about it. [SEP] on october 11, he was admitted to seeing mrs walker, 55, whom the court sentenced to up to two years of supervised supervision. [SEP] the obama administration doesn ' t have all the extra resources, however, and there is little doubt she will once again need the extra money. [SEP] advocates say the law is important because it is funding for infrastructure spending. [SEP] the bank shares fell 1. 6 percent lower to 2, 500 yen in early trading, as the global banking crisis hit [SEP]", "detok_text": "[CLS] don't know the way we see people, \" morphey: i'm going to go and i'll feel about it. [SEP] on october 11, he was admitted to seeing mrs walker, 55, whom the court sentenced to up to two years of supervised supervision. [SEP] the obama administration doesn't have all the extra resources, however, and there is little doubt she will once again need the extra money. [SEP] advocates say the law is important because it is funding for infrastructure spending. [SEP] the bank shares fell 1. 6 percent lower to 2, 500 yen in early trading, as the global banking crisis hit [SEP]"}
+{"type": "sample", "index": 3, "raw_text": "[CLS] economic and economic expansion, the result of the loss of commercial dollars, and a fall in south korean demand, marks the end of the crisis. [SEP] meanwhile, mcmanus claims that the party ' s policy is to keep contact with mr mcelroy under the agreement and must be based on its list of senior ministers. [SEP] the schools, aged 14, 13 and 15 september 2007, will be closed. [SEP] oklahoma city police said stephen garlin, 18, daniel brown, 36, of coldfield gas station, texas, and 19 - year - old ben brown, 19. [SEP] five days later obama ' s address comes [SEP]", "detok_text": "[CLS] economic and economic expansion, the result of the loss of commercial dollars, and a fall in south korean demand, marks the end of the crisis. [SEP] meanwhile, mcmanus claims that the party's policy is to keep contact with mr mcelroy under the agreement and must be based on its list of senior ministers. [SEP] the schools, aged 14, 13 and 15 september 2007, will be closed. [SEP] oklahoma city police said stephen garlin, 18, daniel brown, 36, of coldfield gas station, texas, and 19 - year - old ben brown, 19. [SEP] five days later obama's address comes [SEP]"}
+{"type": "sample", "index": 4, "raw_text": ".................................................... and and. and more and more and more..................................... and more and...........................", "detok_text": ".................................................... and and. and more and more and more..................................... and more and..........................."}
+{"type": "sample", "index": 5, "raw_text": "[CLS] $ 20 billion in auction of government debt, after suffering a 13 per cent drop to hk $ 17. 4 billion in the nine trading hours to friday. [SEP] he lost to martin schnreibel, soderling was dropped during the match and his partner withdrew due to back sickness. [SEP] ferguson, a former england assistant manager at west ham, has signed more than 100 since the start of the season. [SEP] he would have preferred to move into the local market. [SEP] the cbo said the rate on libor of treasury bills in u. s. dollars went down to 2. 39 percent. [SEP] eu officials said [SEP]", "detok_text": "[CLS] $20 billion in auction of government debt, after suffering a 13 per cent drop to hk $17. 4 billion in the nine trading hours to friday. [SEP] he lost to martin schnreibel, soderling was dropped during the match and his partner withdrew due to back sickness. [SEP] ferguson, a former england assistant manager at west ham, has signed more than 100 since the start of the season. [SEP] he would have preferred to move into the local market. [SEP] the cbo said the rate on libor of treasury bills in u. s. dollars went down to 2. 39 percent. [SEP] eu officials said [SEP]"}
+{"type": "sample", "index": 6, "raw_text": "[CLS] team coach michael horrid what to say about scott driver ' s words and actions after the death of tom hargis isn ' t easy. [SEP] for me, there ' s a general lack of respect of one who wants to. [SEP] but, said james dobson, the independent consultant, there ' s unsettled need for jobs for young people who live in the country and who can ' t be taught about our national identity. [SEP] the campaign also prompted calls from democratic groups for clinton to take her attacks on not just the struggles of working americans but also his responses to the problems of working class and white voters, like [SEP]", "detok_text": "[CLS] team coach michael horrid what to say about scott driver's words and actions after the death of tom hargis isn't easy. [SEP] for me, there's a general lack of respect of one who wants to. [SEP] but, said james dobson, the independent consultant, there's unsettled need for jobs for young people who live in the country and who can't be taught about our national identity. [SEP] the campaign also prompted calls from democratic groups for clinton to take her attacks on not just the struggles of working americans but also his responses to the problems of working class and white voters, like [SEP]"}
+{"type": "sample", "index": 7, "raw_text": "[CLS] bst. [SEP] michael reinter, a political scientist with the national republican party club, said democrats believe congress need to give up the liberal power and restore some liberalism in washington. [SEP] \" i know the one that ' s ever got away with that guy. [SEP] the company estimates the pot will be worth £20m - £325m annually, compared to last year ' s profits. [SEP] it still isn ' t known what that money will be at the bank. [SEP] yonhap said the president asked that the chinese government now try again to focus its efforts to overcome the crisis and return to normal relations and establish a [SEP]", "detok_text": "[CLS] bst. [SEP] michael reinter, a political scientist with the national republican party club, said democrats believe congress need to give up the liberal power and restore some liberalism in washington. [SEP] \" i know the one that's ever got away with that guy. [SEP] the company estimates the pot will be worth £20m - £325m annually, compared to last year's profits. [SEP] it still isn't known what that money will be at the bank. [SEP] yonhap said the president asked that the chinese government now try again to focus its efforts to overcome the crisis and return to normal relations and establish a [SEP]"}
+{"type": "sample", "index": 8, "raw_text": "[CLS] last month what is believed to be one of many problems for the united states. [SEP] this represents 38 percent of the nation ' s total food book sales ( $ 300 billion in 2005 ). [SEP] new york ( ap ) - television news reports and twitter users will be able to share some of their stories online. [SEP] police have arrested a 38 - year - old man charged with a string of assaults at an ex - gift shop in northern new york city. [SEP] mr. gaz, the boy, left school a few months later and went to work to become a schoolteacher. [SEP] obama had promised to continue campaigning in the state [SEP]", "detok_text": "[CLS] last month what is believed to be one of many problems for the united states. [SEP] this represents 38 percent of the nation's total food book sales ($300 billion in 2005). [SEP] new york (ap) - television news reports and twitter users will be able to share some of their stories online. [SEP] police have arrested a 38 - year - old man charged with a string of assaults at an ex - gift shop in northern new york city. [SEP] mr. gaz, the boy, left school a few months later and went to work to become a schoolteacher. [SEP] obama had promised to continue campaigning in the state [SEP]"}
+{"type": "sample", "index": 9, "raw_text": "[CLS]. 1 billion from july 2009. [SEP] banks have issued more than $ 2. 2 billion of bonds, with a total of about $ 9 billion net of debt issued through the new government bond offering. [SEP] police say a man charged with the murder of a colorado gunman was reported to dead at a women ' s center in dallas, texas. [SEP] cooper : this year, everyone showed up the road. [SEP] \" in terms of the fact that we do want to work into the afghan investigation, the process and contacts with these individuals seems to be much clearer, \" mr. karzai said. [SEP] it compares with 5, [SEP]", "detok_text": "[CLS]. 1 billion from july 2009. [SEP] banks have issued more than $2. 2 billion of bonds, with a total of about $9 billion net of debt issued through the new government bond offering. [SEP] police say a man charged with the murder of a colorado gunman was reported to dead at a women's center in dallas, texas. [SEP] cooper: this year, everyone showed up the road. [SEP] \"in terms of the fact that we do want to work into the afghan investigation, the process and contacts with these individuals seems to be much clearer,\" mr. karzai said. [SEP] it compares with 5, [SEP]"}
+{"type": "sample", "index": 10, "raw_text": "[CLS] international group, one of the largest international companies. [SEP] she pokes fun at the house. [SEP] \" we want to create order and modernity, to keep thinking about what to do. [SEP] they ' ve got a team there, and as many of their players and coaches get hurt, i ' m sure they ' ll do it. [SEP] the jobless rate of jobless benefits rose slightly to 10. 0 percent, up from 12. 1 percent to 10. 1 percent. [SEP] just forget about the election. [SEP] sorry, but it did come immediately. [SEP] this is why the government has come around to try to sort [SEP]", "detok_text": "[CLS] international group, one of the largest international companies. [SEP] she pokes fun at the house. [SEP] \" we want to create order and modernity, to keep thinking about what to do. [SEP] they've got a team there, and as many of their players and coaches get hurt, i'm sure they'll do it. [SEP] the jobless rate of jobless benefits rose slightly to 10. 0 percent, up from 12. 1 percent to 10. 1 percent. [SEP] just forget about the election. [SEP] sorry, but it did come immediately. [SEP] this is why the government has come around to try to sort [SEP]"}
+{"type": "sample", "index": 11, "raw_text": "[CLS] [SEP] he said mr bush will hold an all day meeting of the international monetary fund governors in washington, dc., in april. [SEP] the post said the office also noted that mr. bush ' s spending on highway construction funds has forced him to spend $ 75 billion more, while the president plans to spend $ 40 billion on building and infrastructure projects. [SEP] the work is to start thursday at the long island recreation center, pier 60 in the long beach section of 2200. [SEP] the experts say that the information will show that china has foreign interests and its own economic problems, but do they say now that china ' s political leadership [SEP]", "detok_text": "[CLS] [SEP] he said mr bush will hold an all day meeting of the international monetary fund governors in washington, dc., in april. [SEP] the post said the office also noted that mr. bush's spending on highway construction funds has forced him to spend $75 billion more, while the president plans to spend $40 billion on building and infrastructure projects. [SEP] the work is to start thursday at the long island recreation center, pier 60 in the long beach section of 2200. [SEP] the experts say that the information will show that china has foreign interests and its own economic problems, but do they say now that china's political leadership [SEP]"}
+{"type": "sample", "index": 12, "raw_text": "[CLS] in the following press release. [SEP] the two nations have also agreed to cut off joint industrial projects with military and military ties. [SEP] the uk ' s anti - tax behaviours were growing last year. [SEP] dayton, ohio ( ap ) - the obama campaign ' s admission that john mccain is the party ' s nominee - - despite stepping down as a rival to be a republican president - - threatens the campaign ' s health care plan, the obama campaign said saturday. [SEP] less than two hours later, the police tried to locate the woman in grasworth, 31 miles from the north east coast in the west midlands. [SEP] the [SEP]", "detok_text": "[CLS] in the following press release. [SEP] the two nations have also agreed to cut off joint industrial projects with military and military ties. [SEP] the uk's anti - tax behaviours were growing last year. [SEP] dayton, ohio (ap) - the obama campaign's admission that john mccain is the party's nominee - - despite stepping down as a rival to be a republican president - - threatens the campaign's health care plan, the obama campaign said saturday. [SEP] less than two hours later, the police tried to locate the woman in grasworth, 31 miles from the north east coast in the west midlands. [SEP] the [SEP]"}
+{"type": "sample", "index": 13, "raw_text": "[CLS] to come back to his team. [SEP] in 2005, more than a year after the collapse of hbos, the city lost £823. 7m on income tax tax ( £61. 00 per employee ) in the last year but has now lost more than almost £370m. [SEP] uaw has made mobile phones and wireless plans available for $ 30 per year instead of the current price. [SEP] the leaders of the two camps have been on the opposite end of the dividing line. [SEP] ray rice was handed a 25 - yard pass to jacobs. [SEP] the arrest - - the first time u. s. authorities have [SEP]", "detok_text": "[CLS] to come back to his team. [SEP] in 2005, more than a year after the collapse of hbos, the city lost £823. 7m on income tax tax (£61. 00 per employee) in the last year but has now lost more than almost £370m. [SEP] uaw has made mobile phones and wireless plans available for $30 per year instead of the current price. [SEP] the leaders of the two camps have been on the opposite end of the dividing line. [SEP] ray rice was handed a 25 - yard pass to jacobs. [SEP] the arrest - - the first time u. s. authorities have [SEP]"}
+{"type": "sample", "index": 14, "raw_text": "[CLS] throughout the race. [SEP] there are many ways that people can use their brains to carry out the three core principles that they claim to have. [SEP] nato and united states withdrew their forces in georgia ' s capital in october, after the moscow alliance had repeatedly declared its support of kosovo ' s then - backed deby government. [SEP] of course, people are unconvaled about the game themselves. [SEP] yes, we all wanted to do better. [SEP] the new bill includes health care by the public health insurance companies, worth about $ 1. 8 - billion a year annually. [SEP] the volume of imports from iran, the number of [SEP]", "detok_text": "[CLS] throughout the race. [SEP] there are many ways that people can use their brains to carry out the three core principles that they claim to have. [SEP] nato and united states withdrew their forces in georgia's capital in october, after the moscow alliance had repeatedly declared its support of kosovo's then - backed deby government. [SEP] of course, people are unconvaled about the game themselves. [SEP] yes, we all wanted to do better. [SEP] the new bill includes health care by the public health insurance companies, worth about $1. 8 - billion a year annually. [SEP] the volume of imports from iran, the number of [SEP]"}
+{"type": "sample", "index": 15, "raw_text": "[CLS], russia ' s energy minister, has previously refused us charges, british prime minister van rom hoy said of his counterpart. [SEP] people tend to know more about the historical facts of life, including the fact that we are human primates. [SEP] the comments were published by the news and sunday times, concluding with a news conference at the london hotel. [SEP] he said he hated michigan ' s decision, his players said, because it was in florida and would make changes to do with the national title game. [SEP] all you do is find the technology and motivation to take what the players want. [SEP] pakistan, which is regarded as a [SEP]", "detok_text": "[CLS], russia's energy minister, has previously refused us charges, british prime minister van rom hoy said of his counterpart. [SEP] people tend to know more about the historical facts of life, including the fact that we are human primates. [SEP] the comments were published by the news and sunday times, concluding with a news conference at the london hotel. [SEP] he said he hated michigan's decision, his players said, because it was in florida and would make changes to do with the national title game. [SEP] all you do is find the technology and motivation to take what the players want. [SEP] pakistan, which is regarded as a [SEP]"}
+{"type": "sample", "index": 16, "raw_text": "[CLS]. [SEP] what your name... think the reps. [SEP] maybe i would ask for specifics. [SEP] china also has a reputation for military instability. [SEP] my vision of my life described her going through the painful process - - becoming a mother and having to take her husband, raise a loving family and enjoy herself. [SEP] house members said tuesday that president barack obama ' s policy request for the additional troops is clear, and that they would take that shift very quickly. [SEP] though clinton ' s decision was based on negotiations on the complex question of president bush ' s policies, the president still stands on a large - scale national [SEP]", "detok_text": "[CLS]. [SEP] what your name... think the reps. [SEP] maybe i would ask for specifics. [SEP] china also has a reputation for military instability. [SEP] my vision of my life described her going through the painful process - - becoming a mother and having to take her husband, raise a loving family and enjoy herself. [SEP] house members said tuesday that president barack obama's policy request for the additional troops is clear, and that they would take that shift very quickly. [SEP] though clinton's decision was based on negotiations on the complex question of president bush's policies, the president still stands on a large - scale national [SEP]"}
+{"type": "sample", "index": 17, "raw_text": "[CLS] opened to the public in 1997. [SEP] the total level between english students and chinese people certainly depends on the quality of education, not funding. [SEP] still, while white has said he ' d know obama ' s record in this economy - - i ' d say just that - - he doesn ' t really remember hearing much about how he ' s doing. [SEP] \" if you really don ' t like us, try to come down to understand what he ' s doing. [SEP] much the same as what was said last year about rafa. [SEP] \" we will stick to a very tough position, \" said japanese prime minister taro [SEP]", "detok_text": "[CLS] opened to the public in 1997. [SEP] the total level between english students and chinese people certainly depends on the quality of education, not funding. [SEP] still, while white has said he'd know obama's record in this economy - - i'd say just that - - he doesn't really remember hearing much about how he's doing. [SEP] \"if you really don't like us, try to come down to understand what he's doing. [SEP] much the same as what was said last year about rafa. [SEP]\" we will stick to a very tough position, \" said japanese prime minister taro [SEP]"}
+{"type": "sample", "index": 18, "raw_text": "[CLS] [SEP] ( cbs ) - a small commercial plane that made a rough landing in florida has rolled over, killing 12 people in a forested region. [SEP] i will probably see a common sense shorthand. [SEP] redknapp, the club ' s england manager for four years before the 2006 defeat by birmingham, has already scored two second - half goals against manchester city ' s park. [SEP] the closure of the primary education level will raise questions about the level of public services people will need to keep school going. [SEP] the next generation of american football team, the american dream, has its own wish list of women of all ages. [SEP] [SEP]", "detok_text": "[CLS] [SEP] (cbs) - a small commercial plane that made a rough landing in florida has rolled over, killing 12 people in a forested region. [SEP] i will probably see a common sense shorthand. [SEP] redknapp, the club's england manager for four years before the 2006 defeat by birmingham, has already scored two second - half goals against manchester city's park. [SEP] the closure of the primary education level will raise questions about the level of public services people will need to keep school going. [SEP] the next generation of american football team, the american dream, has its own wish list of women of all ages. [SEP] [SEP]"}
+{"type": "sample", "index": 19, "raw_text": "[CLS] flounding success. [SEP] brad kotchman doubled and scored cano over the left - hand side of jason laksa field in the seventh, leaving the ball on the left side of the line with the left foot.... [SEP] the three, a student in the university ' s psychology department, arrested six of their students. [SEP] the national journalists ' group was formed in 2007 with two of mr. bush ' s advisers - - former national security national security counsel michael hayden, the retired deputy cia director for intelligence and terrorism, and daniel gibson, the retired deputy ambassador to mr. bush, and his wife, [SEP]", "detok_text": "[CLS] flounding success. [SEP] brad kotchman doubled and scored cano over the left - hand side of jason laksa field in the seventh, leaving the ball on the left side of the line with the left foot.... [SEP] the three, a student in the university's psychology department, arrested six of their students. [SEP] the national journalists' group was formed in 2007 with two of mr. bush's advisers - - former national security national security counsel michael hayden, the retired deputy cia director for intelligence and terrorism, and daniel gibson, the retired deputy ambassador to mr. bush, and his wife, [SEP]"}
+{"type": "sample", "index": 20, "raw_text": "[CLS] anti - terrorism operation. [SEP] \" i think something that people are talking out about is i ' ve got the options, and i need to get to it ahead of time, to find a way to play, to take some action, \" chopra said. [SEP] woods, who will start his season at the masters sunday, said he is also going to keep working. [SEP] tokyo, japan ( cnn ) - - wen jiabao, who will head to tokyo thursday to become head of the ruling democratic party of japan, opened the first conference on saturday and said the country would do more to boost japan ' s ties to the region [SEP]", "detok_text": "[CLS] anti - terrorism operation. [SEP] \"i think something that people are talking out about is i've got the options, and i need to get to it ahead of time, to find a way to play, to take some action,\" chopra said. [SEP] woods, who will start his season at the masters sunday, said he is also going to keep working. [SEP] tokyo, japan (cnn) - - wen jiabao, who will head to tokyo thursday to become head of the ruling democratic party of japan, opened the first conference on saturday and said the country would do more to boost japan's ties to the region [SEP]"}
+{"type": "sample", "index": 21, "raw_text": "[CLS]ing at the end of 2008. [SEP] the white house budget office said the scale of the administration ' s plan to deliver specific economic programs falls in the longer period of time. [SEP] it ' s been said that the market wants to buy more equity and that is because the long - term credit market distress is starting to surpass the credit crisis. [SEP] toyota is hoping its first electric - car plant in the new mexico will create hundreds of thousands of jobs across the area. [SEP] the government said friday showed a 3 percent decline in imports from u. s. trade in june. [SEP] it ' s clear that they want teams to be [SEP]", "detok_text": "[CLS]ing at the end of 2008. [SEP] the white house budget office said the scale of the administration's plan to deliver specific economic programs falls in the longer period of time. [SEP] it's been said that the market wants to buy more equity and that is because the long - term credit market distress is starting to surpass the credit crisis. [SEP] toyota is hoping its first electric - car plant in the new mexico will create hundreds of thousands of jobs across the area. [SEP] the government said friday showed a 3 percent decline in imports from u. s. trade in june. [SEP] it's clear that they want teams to be [SEP]"}
+{"type": "sample", "index": 22, "raw_text": "[CLS] declaration of war issued last monday. [SEP] the company, based in silicon valley, said sales grew by 45 percent in the u. s., france, china and britain. [SEP] like many people, he ' s like a lot of them. [SEP] many people who have been interviewed about the activities don ' t make much mention of the former prison camp. [SEP] president obama ' s plans for ambitious efforts to cut healthcare costs were announced in january, but have not been enacted. [SEP] he will be leaving the white house with deputy national director of national security, michael mullen, on tuesday night for a three - minute \" [SEP]", "detok_text": "[CLS] declaration of war issued last monday. [SEP] the company, based in silicon valley, said sales grew by 45 percent in the u. s., france, china and britain. [SEP] like many people, he's like a lot of them. [SEP] many people who have been interviewed about the activities don't make much mention of the former prison camp. [SEP] president obama's plans for ambitious efforts to cut healthcare costs were announced in january, but have not been enacted. [SEP] he will be leaving the white house with deputy national director of national security, michael mullen, on tuesday night for a three - minute \" [SEP]"}
+{"type": "sample", "index": 23, "raw_text": "[CLS] year - old woman and her boyfriend, 21 - year - old john haywood. [SEP] they stressed that the north was not willing to hold talks at all to end its differences with the chinese government, while using talks only to give those concessions to the koreas, who will turn the issue on their head. [SEP] israel, along with iran, said it is close to signing the accord. [SEP] the u. s. state department ' s office on monday said tuesday it doesn ' t expect of further activity with the iranian government. [SEP] the government will need to close the road network in the next £40m to help with transport [SEP]", "detok_text": "[CLS] year - old woman and her boyfriend, 21 - year - old john haywood. [SEP] they stressed that the north was not willing to hold talks at all to end its differences with the chinese government, while using talks only to give those concessions to the koreas, who will turn the issue on their head. [SEP] israel, along with iran, said it is close to signing the accord. [SEP] the u. s. state department's office on monday said tuesday it doesn't expect of further activity with the iranian government. [SEP] the government will need to close the road network in the next £40m to help with transport [SEP]"}
+{"type": "sample", "index": 24, "raw_text": "[CLS] too. [SEP] \" i just just got started, \" matsuza said. [SEP] jamison was joined all - star by smith and kevin allen on saturday. [SEP] moyes ' s owner peter mcpite, yesterday, revealed that he had abused the position of his former everton chairman sir john moyes recently by leaving the stadium with one of the premier away games of the season. [SEP] he does not have a similar relationship with the club at this time and it ' s almost expected that he will spend less time on a team - friendly basis. [SEP] it said scottish politicians were now thinking of \" taking sides in politics, \" [SEP]", "detok_text": "[CLS] too. [SEP] \"i just just got started,\" matsuza said. [SEP] jamison was joined all - star by smith and kevin allen on saturday. [SEP] moyes's owner peter mcpite, yesterday, revealed that he had abused the position of his former everton chairman sir john moyes recently by leaving the stadium with one of the premier away games of the season. [SEP] he does not have a similar relationship with the club at this time and it's almost expected that he will spend less time on a team - friendly basis. [SEP] it said scottish politicians were now thinking of \"taking sides in politics,\" [SEP]"}
+{"type": "sample", "index": 25, "raw_text": "[CLS] first government office held by the chinese since 1997. [SEP] he also said he informed federal agents that the next day he saw was an fbi investigation into a church - run television and e - mail call about his wife allegedly assaulting a 17 year - old married ex - wife. [SEP] mr roube said the conference appeared to show personal support for the eu deal, and called for an open forum for countries to play a major role in restoring the credibility of the eu. [SEP] worldwide, the unemployment rate increased the same year - - 14 percent in march 2007 to 9. 2 percent - - also the highest in a year - - [SEP]", "detok_text": "[CLS] first government office held by the chinese since 1997. [SEP] he also said he informed federal agents that the next day he saw was an fbi investigation into a church - run television and e - mail call about his wife allegedly assaulting a 17 year - old married ex - wife. [SEP] mr roube said the conference appeared to show personal support for the eu deal, and called for an open forum for countries to play a major role in restoring the credibility of the eu. [SEP] worldwide, the unemployment rate increased the same year - - 14 percent in march 2007 to 9. 2 percent - - also the highest in a year - - [SEP]"}
+{"type": "sample", "index": 26, "raw_text": "[CLS] deficits in the previous fiscal year. [SEP] the bank said recently it would seek to buy $ 800m of government debt to help reduce the total amount of us treasury debt and make it available to congress for public funds. [SEP] at one point, mr obama was defiant. [SEP] the faa won ' t release the name of the plane crasher who died in 2006. [SEP] hamilton was born in new york. [SEP] last week, deadly skirmishes with a californian court and national park ranger over a 12, meter - long fence that stretched over 40 feet of sand and sand and cut off several streets in this county. [SEP] produced by [SEP]", "detok_text": "[CLS] deficits in the previous fiscal year. [SEP] the bank said recently it would seek to buy $800m of government debt to help reduce the total amount of us treasury debt and make it available to congress for public funds. [SEP] at one point, mr obama was defiant. [SEP] the faa won't release the name of the plane crasher who died in 2006. [SEP] hamilton was born in new york. [SEP] last week, deadly skirmishes with a californian court and national park ranger over a 12, meter - long fence that stretched over 40 feet of sand and sand and cut off several streets in this county. [SEP] produced by [SEP]"}
+{"type": "sample", "index": 27, "raw_text": "[CLS], they can still get loans to make mortgage payments. [SEP] \" the rest of the family is gone, \" says the letter to dillin. [SEP] \" it ' s still there, \" said john smith, one of the scientists who formerly led the pilot phase of the project. [SEP] he said that he did not approve rethinking that young people should be aware of their rights concerns, particularly children, teachers and those children in general. [SEP] he told court he had shot her a few times before the guards punched him. [SEP] there is already seven golf courses, including the british open and pga champion bob hodgman tour [SEP]", "detok_text": "[CLS], they can still get loans to make mortgage payments. [SEP] \"the rest of the family is gone,\" says the letter to dillin. [SEP] \"it's still there,\" said john smith, one of the scientists who formerly led the pilot phase of the project. [SEP] he said that he did not approve rethinking that young people should be aware of their rights concerns, particularly children, teachers and those children in general. [SEP] he told court he had shot her a few times before the guards punched him. [SEP] there is already seven golf courses, including the british open and pga champion bob hodgman tour [SEP]"}
+{"type": "sample", "index": 28, "raw_text": "[CLS] - moon. [SEP] the 35 - year - old has made most of his international appearances prior to the new season. [SEP] 9 ( upi ) - - the two u. s. national army officers died thursday at the age of 31 as they gromed during a short program in new york. [SEP] mccain said this night that senator barack obama had \" made the greatest choice \" on the country ' s security in the context of the president ' s first 100 years in office. [SEP] \" one of the major problems with the money that i get going, people do business with me, and the same kind of stuff, \" said [SEP]", "detok_text": "[CLS] - moon. [SEP] the 35 - year - old has made most of his international appearances prior to the new season. [SEP] 9 (upi) - - the two u. s. national army officers died thursday at the age of 31 as they gromed during a short program in new york. [SEP] mccain said this night that senator barack obama had \"made the greatest choice\" on the country's security in the context of the president's first 100 years in office. [SEP] \"one of the major problems with the money that i get going, people do business with me, and the same kind of stuff,\" said [SEP]"}
+{"type": "sample", "index": 29, "raw_text": "[CLS] their administration to hand over a special review to allow its regulator to continue its mission. [SEP] it isn ' t limited to the presence of a football match and, naturally, the manager is particularly concerned of whether you have time off. [SEP] the 11 - year - old last played at verizon in 1976. [SEP] total sales were us $ 21. 1 million of net sales and sales total. decrease of $ 19. 1 million reported in the first nine months of 2008. 3 % to us $ 7. 6 million reported. period. expected to decline us $ 4. 2 million by close to the current quarter. [SEP] mr [SEP]", "detok_text": "[CLS] their administration to hand over a special review to allow its regulator to continue its mission. [SEP] it isn't limited to the presence of a football match and, naturally, the manager is particularly concerned of whether you have time off. [SEP] the 11 - year - old last played at verizon in 1976. [SEP] total sales were us $21. 1 million of net sales and sales total. decrease of $19. 1 million reported in the first nine months of 2008. 3 % to us $7. 6 million reported. period. expected to decline us $4. 2 million by close to the current quarter. [SEP] mr [SEP]"}
+{"type": "sample", "index": 30, "raw_text": "[CLS] about 27. 5 million passengers and three times the uk ' s total capacity. [SEP] tokyo ( reuters ) - sumitomo group corp ( 01302. t ), the largest energy company linked to a growing chinese demand crunch despite a global oil shutdown in oil and gas consumption, said on friday. [SEP] two passengers were taken to hospital after the accident. [SEP] that plan you think would have helped us make the transition into a school system. [SEP] \" like someone of an old age, i always wanted to go to work in a clothing business, \" she says. [SEP] under obama ' s economic rescue plan, the president [SEP]", "detok_text": "[CLS] about 27. 5 million passengers and three times the uk's total capacity. [SEP] tokyo (reuters) - sumitomo group corp (01302. t), the largest energy company linked to a growing chinese demand crunch despite a global oil shutdown in oil and gas consumption, said on friday. [SEP] two passengers were taken to hospital after the accident. [SEP] that plan you think would have helped us make the transition into a school system. [SEP] \"like someone of an old age, i always wanted to go to work in a clothing business,\" she says. [SEP] under obama's economic rescue plan, the president [SEP]"}
+{"type": "sample", "index": 31, "raw_text": "[CLS] looks like a good day. [SEP] the cause of the expected sharp fall in earnings created from the price being paid for the state ' s public bad debt is what could turn out to be a 3 per cent surge in output growth. [SEP] and if you ' ve seen the weekend holiday to florida, you might consider crossing the sun - drenched atlantic coast at oceana beach. [SEP] the one thing about tiger woods woods is that he ' s had a crisis to the public over the course of eight months, although his high - level pattenitions have come under outside scrutiny. [SEP] the move was the product of an end of tension [SEP]", "detok_text": "[CLS] looks like a good day. [SEP] the cause of the expected sharp fall in earnings created from the price being paid for the state's public bad debt is what could turn out to be a 3 per cent surge in output growth. [SEP] and if you've seen the weekend holiday to florida, you might consider crossing the sun - drenched atlantic coast at oceana beach. [SEP] the one thing about tiger woods woods is that he's had a crisis to the public over the course of eight months, although his high - level pattenitions have come under outside scrutiny. [SEP] the move was the product of an end of tension [SEP]"}
+{"type": "sample", "index": 32, "raw_text": "[CLS] say when he has the time to take the course. [SEP] she said they had four hours to make the final of their race. [SEP] like the rest of the world, the obama administration has stepped up the pressure on syria over the iran - led iraq crisis and decided on a possible meeting with iraqi president barack bush, the report said. [SEP] domestic violence in the united states has risen sharply since june 2007, according to the report. [SEP] the cost of the proposed new site will cost up to £4. 5m to deprive the town for next year ' s water park tournament. [SEP] in emerging countries, for example, [SEP]", "detok_text": "[CLS] say when he has the time to take the course. [SEP] she said they had four hours to make the final of their race. [SEP] like the rest of the world, the obama administration has stepped up the pressure on syria over the iran - led iraq crisis and decided on a possible meeting with iraqi president barack bush, the report said. [SEP] domestic violence in the united states has risen sharply since june 2007, according to the report. [SEP] the cost of the proposed new site will cost up to £4. 5m to deprive the town for next year's water park tournament. [SEP] in emerging countries, for example, [SEP]"}
+{"type": "sample", "index": 33, "raw_text": "[CLS] experts agree. [SEP] he spent much of his time in the hands of the barclays in the middle of the season and he was a great manager. [SEP] it is the largest amount of debt for the united football franchise to date. [SEP] answer : you now have your full knowledge of what it takes and what they want to know. [SEP] \" the united states confirms that there was support for terrorism... attacks by the mexican ( u. s. government ), mexican government, and the u. s. department of health... there is no telling of the difference between u. s. and local versions of the report [SEP]", "detok_text": "[CLS] experts agree. [SEP] he spent much of his time in the hands of the barclays in the middle of the season and he was a great manager. [SEP] it is the largest amount of debt for the united football franchise to date. [SEP] answer: you now have your full knowledge of what it takes and what they want to know. [SEP] \" the united states confirms that there was support for terrorism... attacks by the mexican (u. s. government), mexican government, and the u. s. department of health... there is no telling of the difference between u. s. and local versions of the report [SEP]"}
+{"type": "sample", "index": 34, "raw_text": "[CLS] he said. [SEP] i see a lot of wear here on the outside of obama ' s white house town hall. [SEP] gasoline futures rose to $ 3 cents to $ 2. 56 a gallon, from nearly $ 4 in october and still above a historic high of $ 2. 21 in february. [SEP] the news report was the first confirmation of the new nuclear activities by the united states, and accuses the iranian government of sticking to its recent nuclear test. [SEP] mr brown is in talks with opposition labour leader stephen johnson to push for shadow foreign secretary david miliband ' s most prominent party group to issue guidelines for handling of foreign [SEP]", "detok_text": "[CLS] he said. [SEP] i see a lot of wear here on the outside of obama's white house town hall. [SEP] gasoline futures rose to $3 cents to $2. 56 a gallon, from nearly $4 in october and still above a historic high of $2. 21 in february. [SEP] the news report was the first confirmation of the new nuclear activities by the united states, and accuses the iranian government of sticking to its recent nuclear test. [SEP] mr brown is in talks with opposition labour leader stephen johnson to push for shadow foreign secretary david miliband's most prominent party group to issue guidelines for handling of foreign [SEP]"}
+{"type": "sample", "index": 35, "raw_text": "[CLS] the world. [SEP] during the olympics, organizers tried to use the stadium as a symbol of the sport ' s survival. [SEP] steve, a 24 - year - old station manager from hackney, east london, raised 20, 000 pounds ( £18, 000 ) per week by opening a pet style pet shop in sanday, near new york city. [SEP] u. s. officials also criticized beijing ' s approach, refusing to send a delegation to mediation to find solution to the dispute. [SEP] during a recent meeting with foreign trade minister lee hag - hak, the country ' s negotiator said. [SEP] jeter [SEP]", "detok_text": "[CLS] the world. [SEP] during the olympics, organizers tried to use the stadium as a symbol of the sport's survival. [SEP] steve, a 24 - year - old station manager from hackney, east london, raised 20, 000 pounds (£18, 000) per week by opening a pet style pet shop in sanday, near new york city. [SEP] u. s. officials also criticized beijing's approach, refusing to send a delegation to mediation to find solution to the dispute. [SEP] during a recent meeting with foreign trade minister lee hag - hak, the country's negotiator said. [SEP] jeter [SEP]"}
+{"type": "sample", "index": 36, "raw_text": "[CLS] according to the paper. [SEP] the jewish group does not agree with how israel and mr netanyahu ' s proposals operate in east jerusalem. [SEP] \" if i can get out of the house next year, i don ' t have that kind of support to go down, \" he said. [SEP] sir michael was joined on the global radio agreement with media group co - chairman andy burnham and james johnson, the bbc ' s commercial director for media coverage, after voting against the move in 2006. [SEP] all that means that the world ' s biggest carmaker may need to stop growing inventory of cars. [SEP] the automaker ' s annual [SEP]", "detok_text": "[CLS] according to the paper. [SEP] the jewish group does not agree with how israel and mr netanyahu's proposals operate in east jerusalem. [SEP] \"if i can get out of the house next year, i don't have that kind of support to go down,\" he said. [SEP] sir michael was joined on the global radio agreement with media group co - chairman andy burnham and james johnson, the bbc's commercial director for media coverage, after voting against the move in 2006. [SEP] all that means that the world's biggest carmaker may need to stop growing inventory of cars. [SEP] the automaker's annual [SEP]"}
+{"type": "sample", "index": 37, "raw_text": "[CLS] liverpool coach bruce collins said : \" the thing i know is the most remarkable aspect of the scottish football league history that it has proved super rich. [SEP] mr bush is still trying to win votes, with critics saying he should have been president when he tried to fight a general election. [SEP] mr. sarkozy ' s proposals were followed by a national - level agreement, under which mr. sarkozy ' s administration, weak since then, could proceed with more serious negotiations. [SEP] wvt - tv has had similar coverages on the enforcement front. [SEP] the case, which is under the bureau of investigation and review, [SEP]", "detok_text": "[CLS] liverpool coach bruce collins said: \" the thing i know is the most remarkable aspect of the scottish football league history that it has proved super rich. [SEP] mr bush is still trying to win votes, with critics saying he should have been president when he tried to fight a general election. [SEP] mr. sarkozy's proposals were followed by a national - level agreement, under which mr. sarkozy's administration, weak since then, could proceed with more serious negotiations. [SEP] wvt - tv has had similar coverages on the enforcement front. [SEP] the case, which is under the bureau of investigation and review, [SEP]"}
+{"type": "sample", "index": 38, "raw_text": "[CLS] education. [SEP] i ' m doing college and studying level at school, but i just get into education, i can get into languages and start learning their skills at cambridge. [SEP] while major opponents including the civil rights group, a women ' s network and one prominent business group joined more than 30 groups, mr. mccain renewed attacks on the president. [SEP] the 19 - year - old man shot four teenagers dead the same morning along with his father, he said, and said he was shot to death at the school, but it was too late in the day there was no way the boy decided what to do. [SEP] \" and then [SEP]", "detok_text": "[CLS] education. [SEP] i'm doing college and studying level at school, but i just get into education, i can get into languages and start learning their skills at cambridge. [SEP] while major opponents including the civil rights group, a women's network and one prominent business group joined more than 30 groups, mr. mccain renewed attacks on the president. [SEP] the 19 - year - old man shot four teenagers dead the same morning along with his father, he said, and said he was shot to death at the school, but it was too late in the day there was no way the boy decided what to do. [SEP] \" and then [SEP]"}
+{"type": "sample", "index": 39, "raw_text": "[CLS] of the clinton administration urged both countries to ratify laws dealing on human rights issues, saying administration officials have been pressured into breaking with the law. [SEP] the candidates are terrific and some of them have said both about the good times. [SEP] \" we do not always need a single type of education, \" she says. [SEP] it ' s that relationship that makes you uneasy. [SEP] \" black people, \" don ' t say the word put on pelosi. [SEP] now the field is clear. [SEP] but a spokesman for the new york times on wednesday said the report was an interpretation of the state ' s own policy, saying the [SEP]", "detok_text": "[CLS] of the clinton administration urged both countries to ratify laws dealing on human rights issues, saying administration officials have been pressured into breaking with the law. [SEP] the candidates are terrific and some of them have said both about the good times. [SEP] \"we do not always need a single type of education,\" she says. [SEP] it's that relationship that makes you uneasy. [SEP] \"black people,\" don't say the word put on pelosi. [SEP] now the field is clear. [SEP] but a spokesman for the new york times on wednesday said the report was an interpretation of the state's own policy, saying the [SEP]"}
+{"type": "sample", "index": 40, "raw_text": "[CLS] strength of the frolog approach is remarkable. [SEP] i would never agree to stand beyond the end of their school years. [SEP] two people were rescued from the revers platform on the cross - clyde river by the coastguard agency ( 0871 97687. uk ). [SEP] but england manager brian ashton has announced his players will not take the decision. [SEP] the former carolina quarterback, who posted a 13. 8 yards per game and 6. 7 average, also had four points. [SEP] and this year ' s second test for the health minister, gordon brown, who is expected to discuss health education and access to [SEP]", "detok_text": "[CLS] strength of the frolog approach is remarkable. [SEP] i would never agree to stand beyond the end of their school years. [SEP] two people were rescued from the revers platform on the cross - clyde river by the coastguard agency (0871 97687. uk). [SEP] but england manager brian ashton has announced his players will not take the decision. [SEP] the former carolina quarterback, who posted a 13. 8 yards per game and 6. 7 average, also had four points. [SEP] and this year's second test for the health minister, gordon brown, who is expected to discuss health education and access to [SEP]"}
+{"type": "sample", "index": 41, "raw_text": "[CLS] pande. [SEP] the 27 - year - old spaniard had already been replaced by team - mate gareth bale, who has surgery on his left side due to the injury. [SEP] however, the group refused to commit to a proposed eu form of international action, citing french president nicolas sarkozy. [SEP] \" it ' s changing. [SEP] james milner made a bit out of newcastle ' s game at kilmarno and former bath and england coach john cudde said after being playing against a string of international players, he went on to play at the end, and didn ' t have the down side. [SEP] \" [SEP]", "detok_text": "[CLS] pande. [SEP] the 27 - year - old spaniard had already been replaced by team - mate gareth bale, who has surgery on his left side due to the injury. [SEP] however, the group refused to commit to a proposed eu form of international action, citing french president nicolas sarkozy. [SEP] \"it's changing. [SEP] james milner made a bit out of newcastle's game at kilmarno and former bath and england coach john cudde said after being playing against a string of international players, he went on to play at the end, and didn't have the down side. [SEP]\" [SEP]"}
+{"type": "sample", "index": 42, "raw_text": "[CLS] international trading commission at the time. [SEP] however, he said that he wanted president barack obama ' s focus on clean energy and climate change to create support for global climate change, and that he wanted to push forward a range of international issues including climate change emissions and address the impact of climate change. [SEP] the country has issued four formal objections to the u. n. security council, african and south african governments. [SEP] he wanted to study finance at capitol hill high school in the early 1960s. [SEP] yes, it is stupid! [SEP] i think it was an unmirable television commentary : a wiser of thought to know what the [SEP]", "detok_text": "[CLS] international trading commission at the time. [SEP] however, he said that he wanted president barack obama's focus on clean energy and climate change to create support for global climate change, and that he wanted to push forward a range of international issues including climate change emissions and address the impact of climate change. [SEP] the country has issued four formal objections to the u. n. security council, african and south african governments. [SEP] he wanted to study finance at capitol hill high school in the early 1960s. [SEP] yes, it is stupid! [SEP] i think it was an unmirable television commentary: a wiser of thought to know what the [SEP]"}
+{"type": "sample", "index": 43, "raw_text": "[CLS] movie. [SEP] it is the value of working three lines of work - - such as getting the information needed for watching sports before moving on a particular job - - that often is based on history. [SEP] the spokeswoman said the state ' s interest in the market would \" be to bring it together, \" but said it did not have a buyer. [SEP] this is the most difficult decision that we can ever take, \" mr obama added. [SEP] now, if you are willing to do the same, saying that it might be a good bet, you might be much more confident about spending money than you are, so i think [SEP]", "detok_text": "[CLS] movie. [SEP] it is the value of working three lines of work - - such as getting the information needed for watching sports before moving on a particular job - - that often is based on history. [SEP] the spokeswoman said the state's interest in the market would \"be to bring it together,\" but said it did not have a buyer. [SEP] this is the most difficult decision that we can ever take, \" mr obama added. [SEP] now, if you are willing to do the same, saying that it might be a good bet, you might be much more confident about spending money than you are, so i think [SEP]"}
+{"type": "sample", "index": 44, "raw_text": "[CLS] daniel v. vickery, who died as a senator in 1995. [SEP] \" there ' s nothing about russia that we want to talk about in the past... it really makes you think about russia, \" said mr chervkin. [SEP] \" i know i would never try to help myself from what i said to myself, \" he says, \" because i never wanted to know what was happening and had to deal with what was happening. [SEP] speaking in a meeting with treasury officials, paulson said that treasury secretary timothy f. ge geithner, would head the federal delegation. [SEP] it ' s hard to [SEP]", "detok_text": "[CLS] daniel v. vickery, who died as a senator in 1995. [SEP] \"there's nothing about russia that we want to talk about in the past... it really makes you think about russia,\" said mr chervkin. [SEP] \"i know i would never try to help myself from what i said to myself,\" he says, \" because i never wanted to know what was happening and had to deal with what was happening. [SEP] speaking in a meeting with treasury officials, paulson said that treasury secretary timothy f. ge geithner, would head the federal delegation. [SEP] it's hard to [SEP]"}
+{"type": "sample", "index": 45, "raw_text": "[CLS]. 2bn, leaving government borrowings in november at £3. 1bn, while borrowing rose in december at £11. 3bn, and the total net for the deficit will be £57bn. [SEP] that ' s why in the end, he tells the story of mr conkie, a story of an oxford university professor exploring how the whole world is compared with our ancestors. [SEP] for the last two days, the military had captured three combat helicopters, one a rescuer, and rescued three captives, including a 20 - year - old afghan, who was on a life - saving mission. [SEP] mr. ndepa [SEP]", "detok_text": "[CLS]. 2bn, leaving government borrowings in november at £3. 1bn, while borrowing rose in december at £11. 3bn, and the total net for the deficit will be £57bn. [SEP] that's why in the end, he tells the story of mr conkie, a story of an oxford university professor exploring how the whole world is compared with our ancestors. [SEP] for the last two days, the military had captured three combat helicopters, one a rescuer, and rescued three captives, including a 20 - year - old afghan, who was on a life - saving mission. [SEP] mr. ndepa [SEP]"}
+{"type": "sample", "index": 46, "raw_text": "[CLS] the league ' s first big east tournament. [SEP] the nie ' s children ' s policy and education data was published by the dfsa in november. [SEP] you don ' t know whom, actually, really. [SEP] it will be closed on september 6. [SEP] he says he is ready to lead climate change whatever he wants to talk about. [SEP] it ' s built on a new 40 - ton platform that will take about 3, 000 feet. [SEP] get the gambler to work through as many holes. [SEP] during this previous debate, obama focused his campaign campaign on claiming that he could have stopped voting for clinton. [SEP] [SEP]", "detok_text": "[CLS] the league's first big east tournament. [SEP] the nie's children's policy and education data was published by the dfsa in november. [SEP] you don't know whom, actually, really. [SEP] it will be closed on september 6. [SEP] he says he is ready to lead climate change whatever he wants to talk about. [SEP] it's built on a new 40 - ton platform that will take about 3, 000 feet. [SEP] get the gambler to work through as many holes. [SEP] during this previous debate, obama focused his campaign campaign on claiming that he could have stopped voting for clinton. [SEP] [SEP]"}
+{"type": "sample", "index": 47, "raw_text": "[CLS] the street. [SEP] \" it ' s a waste of time to see the person who has stood in front of our home that night, and i hope it is not his wife, sharon, and our daughter, francesca, but the fact that ' s not where it goes. [SEP] \" i ' ve been here for 20 years, \" he said. [SEP] the change will follow the approach that has brought criticism from leaders of all areas of government, not all private institutions. [SEP] the national debt level stood at $ 1. 3 trillion from $ 1 billion at may 31, of which $ 1 billion. [SEP] bachman said he has [SEP]", "detok_text": "[CLS] the street. [SEP] \"it's a waste of time to see the person who has stood in front of our home that night, and i hope it is not his wife, sharon, and our daughter, francesca, but the fact that's not where it goes. [SEP]\" i've been here for 20 years, \" he said. [SEP] the change will follow the approach that has brought criticism from leaders of all areas of government, not all private institutions. [SEP] the national debt level stood at $1. 3 trillion from $1 billion at may 31, of which $1 billion. [SEP] bachman said he has [SEP]"}
+{"type": "sample", "index": 48, "raw_text": "[CLS] moscow to end most of its missile defense. [SEP] he made mention of the issue yesterday - saying, \" there wasn ' t anything you could possibly do with one or any other on the line of succession. \" \" [SEP] 13 ( upi ) - - u. s. coach jim gaithenville was suspended as a senior college player after suffering serious head injuries while playing professional football, the national football league west virginian said tuesday. [SEP] when the senate senate finance committee meets next week, the committee will get a report in the same day monday on the impact of the legislation on emissions. [SEP] in a separate way, china [SEP]", "detok_text": "[CLS] moscow to end most of its missile defense. [SEP] he made mention of the issue yesterday - saying, \"there wasn't anything you could possibly do with one or any other on the line of succession.\" \" [SEP] 13 (upi) - - u. s. coach jim gaithenville was suspended as a senior college player after suffering serious head injuries while playing professional football, the national football league west virginian said tuesday. [SEP] when the senate senate finance committee meets next week, the committee will get a report in the same day monday on the impact of the legislation on emissions. [SEP] in a separate way, china [SEP]"}
+{"type": "sample", "index": 49, "raw_text": "[CLS] to a fresh round of diplomatic negotiations with other foreign news agencies. [SEP] the initiative is being run by the charity and government agency for northern ireland ( aig ). [SEP] mr folley went to study at the university school in north wales. [SEP] \" i still have to point out that i ' m doing my job a whole year long and then people are really out of work. [SEP] i tried to imagine if obama was doing himself the same thing, but i always tried to explain what obama is not doing. [SEP] after friday ' s day to get his message, gibbs wasn ' t sure much time. [SEP] half a dozen [SEP]", "detok_text": "[CLS] to a fresh round of diplomatic negotiations with other foreign news agencies. [SEP] the initiative is being run by the charity and government agency for northern ireland (aig). [SEP] mr folley went to study at the university school in north wales. [SEP] \" i still have to point out that i'm doing my job a whole year long and then people are really out of work. [SEP] i tried to imagine if obama was doing himself the same thing, but i always tried to explain what obama is not doing. [SEP] after friday's day to get his message, gibbs wasn't sure much time. [SEP] half a dozen [SEP]"}
+{"type": "sample", "index": 50, "raw_text": "[CLS] post reported friday. [SEP] that ' s important, \" he said. [SEP] the tentative talks ended on monday at 24 hours and robert gibbs declined to say whether it was between the obama administration and treasury officials, who had indicated they could not reach a deal. [SEP] retail sales in the uk fell by 0. 7 % in october compared to august 2007, the lowest data released on the continent since october 1998. [SEP] \" when i do what i do, then he will come back and get into that car and try and tell me and i like, ' why don ' t you run down this road - - and don ' t know [SEP]", "detok_text": "[CLS] post reported friday. [SEP] that's important, \"he said. [SEP] the tentative talks ended on monday at 24 hours and robert gibbs declined to say whether it was between the obama administration and treasury officials, who had indicated they could not reach a deal. [SEP] retail sales in the uk fell by 0. 7 % in october compared to august 2007, the lowest data released on the continent since october 1998. [SEP]\" when i do what i do, then he will come back and get into that car and try and tell me and i like, ' why don't you run down this road - - and don't know [SEP]"}
+{"type": "sample", "index": 51, "raw_text": "[CLS] had four fumbles over his career, including another outstanding second - half leader at florida state, donte sheridan. [SEP] australia ' s prime minister kevin rudd won a meeting with china ' s negotiator, reassuring japanese leaders and china that their commitment is a long - term political agreement to help china ' s currency. [SEP] he ' ll need to do more work on his own. [SEP] that is because it now accounts for more than 50 per cent of the population. [SEP] british air station manager matt speig said his company ' s six world cup 35w park circuit races are held at the weekend. [SEP] the same [SEP]", "detok_text": "[CLS] had four fumbles over his career, including another outstanding second - half leader at florida state, donte sheridan. [SEP] australia's prime minister kevin rudd won a meeting with china's negotiator, reassuring japanese leaders and china that their commitment is a long - term political agreement to help china's currency. [SEP] he'll need to do more work on his own. [SEP] that is because it now accounts for more than 50 per cent of the population. [SEP] british air station manager matt speig said his company's six world cup 35w park circuit races are held at the weekend. [SEP] the same [SEP]"}
+{"type": "sample", "index": 52, "raw_text": "[CLS] said. [SEP] o ' brien said he ' ll know more if he wants to show it up. [SEP] jim lentz, chairman of the house foreign relations committee here, asked the california attorney general ' s office to step up the investigation. [SEP] that ' s why countries are not investing in carbon, he says. [SEP] you ' re kind at times being wrong, \" he said. [SEP] in 1954 it was seen as an uncontrolled communications centre and is becoming a stand - alone center of communications in the 21st century. [SEP] the rest were poor people in europe. [SEP] if some people want to buy food in a day [SEP]", "detok_text": "[CLS] said. [SEP] o' brien said he'll know more if he wants to show it up. [SEP] jim lentz, chairman of the house foreign relations committee here, asked the california attorney general's office to step up the investigation. [SEP] that's why countries are not investing in carbon, he says. [SEP] you're kind at times being wrong, \" he said. [SEP] in 1954 it was seen as an uncontrolled communications centre and is becoming a stand - alone center of communications in the 21st century. [SEP] the rest were poor people in europe. [SEP] if some people want to buy food in a day [SEP]"}
+{"type": "sample", "index": 53, "raw_text": "[CLS] m glad that we ' ve talked about the labour party, the next election conference, the liberal coalition government meeting tomorrow - - a promise that we ' re going to give this to the electorate. [SEP] the bank could raise up to £56 billion of new capital in debt markets by placing a guarantee on borrowing from european sovereign countries, spain and greece. [SEP] mr morris brought his case after receiving contact with the singer, whose pre - school age included, three years ago. [SEP] the good thing is money. [SEP] washington - barack obama ' s campaign has long used the state of florida as an example of party politics, but he is [SEP]", "detok_text": "[CLS] m glad that we've talked about the labour party, the next election conference, the liberal coalition government meeting tomorrow - - a promise that we're going to give this to the electorate. [SEP] the bank could raise up to £56 billion of new capital in debt markets by placing a guarantee on borrowing from european sovereign countries, spain and greece. [SEP] mr morris brought his case after receiving contact with the singer, whose pre - school age included, three years ago. [SEP] the good thing is money. [SEP] washington - barack obama's campaign has long used the state of florida as an example of party politics, but he is [SEP]"}
+{"type": "sample", "index": 54, "raw_text": "[CLS] me because it really looked like it was close, \" she said. [SEP] the military said four soldiers of a local group of international forces were arrested after pulling children out of the area in an apparent effort to avoid a confrontation with the rebels. [SEP] he was the first quarterback of 32 years at wrigley field. [SEP] \" you can ' t tell if there ' s much overlap, but it ' s still a challenge, \" holb said. [SEP] \" people used to say that it ' s complicated and artful, \" she said. [SEP] i know he will have one day to show for it. [SEP] mr osborne, [SEP]", "detok_text": "[CLS] me because it really looked like it was close, \"she said. [SEP] the military said four soldiers of a local group of international forces were arrested after pulling children out of the area in an apparent effort to avoid a confrontation with the rebels. [SEP] he was the first quarterback of 32 years at wrigley field. [SEP]\" you can't tell if there's much overlap, but it's still a challenge, \"holb said. [SEP]\" people used to say that it's complicated and artful, \" she said. [SEP] i know he will have one day to show for it. [SEP] mr osborne, [SEP]"}
+{"type": "sample", "index": 55, "raw_text": "[CLS] interview. [SEP] barbour said he was going to meet - press with biden over questions about returning the governor ' s nomination to the bush administration, the post said. [SEP] david white, executive director of the national grasslands trust, said that lewis was considering his position as an outsider. [SEP] i think it ' s probably going to sit well with consumer prices, but if there ' s that chance, it ' s going to happen, \" mr fresman said. [SEP] it ' s not clear whether any of the money is coming from foreign countries. [SEP] in a separate story published tuesday, the pittsburgh union - gazette reported wednesday [SEP]", "detok_text": "[CLS] interview. [SEP] barbour said he was going to meet - press with biden over questions about returning the governor's nomination to the bush administration, the post said. [SEP] david white, executive director of the national grasslands trust, said that lewis was considering his position as an outsider. [SEP] i think it's probably going to sit well with consumer prices, but if there's that chance, it's going to happen, \" mr fresman said. [SEP] it's not clear whether any of the money is coming from foreign countries. [SEP] in a separate story published tuesday, the pittsburgh union - gazette reported wednesday [SEP]"}
+{"type": "sample", "index": 56, "raw_text": "[CLS] europe, and russia and india. \" [SEP] \" in the end, i know that obama and hillary don ' t agree, and the things that have taken him to right are going to say that his guy ' s the same, \" mccain said later on saturday, suggesting that the obama camp kept his mind out. [SEP] washington ( ap ) - - president barack obama is ending the bush administration ' s plan to give the bank of new york control of the u. s. housing market to deal with the u. s. housing crisis, officials said monday. [SEP] palin ' s publicist, rebecca brennel, has [SEP]", "detok_text": "[CLS] europe, and russia and india. \"[SEP]\" in the end, i know that obama and hillary don't agree, and the things that have taken him to right are going to say that his guy's the same, \" mccain said later on saturday, suggesting that the obama camp kept his mind out. [SEP] washington (ap) - - president barack obama is ending the bush administration's plan to give the bank of new york control of the u. s. housing market to deal with the u. s. housing crisis, officials said monday. [SEP] palin's publicist, rebecca brennel, has [SEP]"}
+{"type": "sample", "index": 57, "raw_text": "[CLS] kaocha in the north - east and pechica in the east, the kiponi and pale - coloured saughs. [SEP] the players were asked to visit high schools three months ago in the school year. [SEP] obama has renewed sanctions on iran ' s nuclear program, saying tehran still needs to carry on its nuclear program. [SEP] he ' s good, but he ' s gone. [SEP] the conservatives have also highlighted mr clegg ' s fiscal discipline as the reason for the threat of budget cuts. [SEP] in the u. s. and china ' s view, it ' s the only way china can go [SEP]", "detok_text": "[CLS] kaocha in the north - east and pechica in the east, the kiponi and pale - coloured saughs. [SEP] the players were asked to visit high schools three months ago in the school year. [SEP] obama has renewed sanctions on iran's nuclear program, saying tehran still needs to carry on its nuclear program. [SEP] he's good, but he's gone. [SEP] the conservatives have also highlighted mr clegg's fiscal discipline as the reason for the threat of budget cuts. [SEP] in the u. s. and china's view, it's the only way china can go [SEP]"}
+{"type": "sample", "index": 58, "raw_text": "[CLS] paint, sunbeds and piping. [SEP] nevertheless, mr. vander beek has taken on some responsibility recently : she ' s beginning her career as a judge. [SEP] there ' s nothing that ' s going to change it, \" said mr brown. [SEP] friday night, england ' s leaders from the irish republic, ireland and france host the international meeting of leading finance at the wembley stadium. [SEP] \" this is the decision i made five years ago, \" he said. [SEP] the deal also has a total amount of $ 10bn, including existing government bonds. [SEP] \" i know my mom, my father and my [SEP]", "detok_text": "[CLS] paint, sunbeds and piping. [SEP] nevertheless, mr. vander beek has taken on some responsibility recently: she's beginning her career as a judge. [SEP] there's nothing that's going to change it, \"said mr brown. [SEP] friday night, england's leaders from the irish republic, ireland and france host the international meeting of leading finance at the wembley stadium. [SEP]\" this is the decision i made five years ago, \"he said. [SEP] the deal also has a total amount of $10bn, including existing government bonds. [SEP]\" i know my mom, my father and my [SEP]"}
+{"type": "sample", "index": 59, "raw_text": "[CLS] biggest impact of the financial crisis, reaching 2. 4 million people aged 50, older and working - age people aged from 13 to 45 years, according to the survey. [SEP] he says that in the year it will be hard to expect economies to lose more than 50 per cent of global output, however many observers might expect a similar slowdown, with much to be expected in 2011. [SEP] my wife married him 10 years ago not only with my son ' s father and other former relatives. [SEP] there is a long list of criminal cases including the deaths of the climbers, a man and a woman. [SEP] korez believes [SEP]", "detok_text": "[CLS] biggest impact of the financial crisis, reaching 2. 4 million people aged 50, older and working - age people aged from 13 to 45 years, according to the survey. [SEP] he says that in the year it will be hard to expect economies to lose more than 50 per cent of global output, however many observers might expect a similar slowdown, with much to be expected in 2011. [SEP] my wife married him 10 years ago not only with my son's father and other former relatives. [SEP] there is a long list of criminal cases including the deaths of the climbers, a man and a woman. [SEP] korez believes [SEP]"}
+{"type": "sample", "index": 60, "raw_text": "[CLS] \" and it has been a gung at the moment. [SEP] the family wants the high court to consider whether the case was dropped. [SEP] they sell home worth and have net assets of more than $ 100, 000. [SEP] the company will not give details, the unidentified source said. [SEP] staff writers john grubelbach, jim doughton and john doughman contributed to this report. [SEP] wells fargo spokesman tim mclaughlin said they ' d like to contact the lenders via web site. [SEP] mediaclus plans to create a web advertising company. [SEP] north korea ' s decision to build a human human rights commission is the latest [SEP]", "detok_text": "[CLS] \" and it has been a gung at the moment. [SEP] the family wants the high court to consider whether the case was dropped. [SEP] they sell home worth and have net assets of more than $100, 000. [SEP] the company will not give details, the unidentified source said. [SEP] staff writers john grubelbach, jim doughton and john doughman contributed to this report. [SEP] wells fargo spokesman tim mclaughlin said they'd like to contact the lenders via web site. [SEP] mediaclus plans to create a web advertising company. [SEP] north korea's decision to build a human human rights commission is the latest [SEP]"}
+{"type": "sample", "index": 61, "raw_text": "[CLS] of companies to get a government bailout. [SEP] the department of co - operation also said the uk would have to set up its own standards for the investigation. [SEP] defense spending for the year is estimated at $ 32. 4 billion. [SEP] a 67 - year - old woman ' s partner has been arrested in connection with a sex attack on her off - duty boyfriend. [SEP] though it ' s too easy to give his team ' s title along with the welsh game, he has continued to be actively involved in the touring team, the wales and england lions and has announced no intention to build a national team. [SEP] mr smith, [SEP]", "detok_text": "[CLS] of companies to get a government bailout. [SEP] the department of co - operation also said the uk would have to set up its own standards for the investigation. [SEP] defense spending for the year is estimated at $32. 4 billion. [SEP] a 67 - year - old woman's partner has been arrested in connection with a sex attack on her off - duty boyfriend. [SEP] though it's too easy to give his team's title along with the welsh game, he has continued to be actively involved in the touring team, the wales and england lions and has announced no intention to build a national team. [SEP] mr smith, [SEP]"}
+{"type": "sample", "index": 62, "raw_text": "[CLS] chairman joe mcgan and his staff know what he wants them to hear from our washington state president, \" lawton said in a statement issued late saturday. [SEP] gurgouro couldn ' t get at the sound of the movie and looked back at me. [SEP] robert hoey, the u. s. ambassador, said the effort is a significant step forward. [SEP] there ' s no question that they don ' t know to understand what kind of things he is doing. [SEP] he said the administration \" may be ready \" but has not yet put back a final conference call on mr obama ' s choice and that he would have [SEP]", "detok_text": "[CLS] chairman joe mcgan and his staff know what he wants them to hear from our washington state president, \"lawton said in a statement issued late saturday. [SEP] gurgouro couldn't get at the sound of the movie and looked back at me. [SEP] robert hoey, the u. s. ambassador, said the effort is a significant step forward. [SEP] there's no question that they don't know to understand what kind of things he is doing. [SEP] he said the administration\" may be ready \" but has not yet put back a final conference call on mr obama's choice and that he would have [SEP]"}
+{"type": "sample", "index": 63, "raw_text": "[CLS] s. box office industry is on track to reach $ 1 billion in revenue over the next three years. [SEP] consumer loans provided about 13 percent of the national average economy in 2008, totalling $ 4 billion in the quarter. [SEP] ( cbs ) the house financial services committee on friday recommended sending its ideas on president obama ' s reform proposal to congress, but it had no plan. [SEP] mr cameron has said he is prepared to file a complaint, but mr wilson will not want to say how this will be worked out. [SEP] and while he said the second movie this year, \" good for the city, \" the director added that [SEP]", "detok_text": "[CLS] s. box office industry is on track to reach $1 billion in revenue over the next three years. [SEP] consumer loans provided about 13 percent of the national average economy in 2008, totalling $4 billion in the quarter. [SEP] (cbs) the house financial services committee on friday recommended sending its ideas on president obama's reform proposal to congress, but it had no plan. [SEP] mr cameron has said he is prepared to file a complaint, but mr wilson will not want to say how this will be worked out. [SEP] and while he said the second movie this year, \"good for the city,\" the director added that [SEP]"}

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_diffusion_noise_steps_128steps_n64/noise_const1p45_early_linear_eta0p12_c256_raw_samples.txt

@@ -0,0 +1,230 @@
+noise_const1p45_early_linear_eta0p12_c256
+{
+  "type": "summary",
+  "name": "noise_const1p45_early_linear_eta0p12_c256",
+  "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt",
+  "step": 187000,
+  "decode": {
+    "kind": "categorical_fullvocab_diffusion_state_noise",
+    "config": "noise_const1p45_early_linear_eta0p12_c256",
+    "steps": 128,
+    "temp_start": 1.45,
+    "temp_end": 1.45,
+    "temp_schedule": "const",
+    "t_power": 1.0,
+    "eta0": 0.12,
+    "eta_schedule": "early_linear",
+    "noise_conc": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 46.894060450372244,
+    "nll_per_token": 3.847891024583145,
+    "tokens": 9397
+  },
+  "diversity": {
+    "sample_entropy": 4.130338682029675,
+    "unique_tokens": 1959,
+    "token_count": 8192,
+    "distinct_1": 0.2391357421875,
+    "distinct_2": 0.7098917322834646,
+    "top_token_mass": 0.0697021484375
+  }
+}
+
+===== sample 000 =====
+[CLS] said it will not hit him in the foot again. [SEP] the bank ' s total capital position for the nine months stood at about 6. 53 billion euros, against 6. 95 billion at the end of the year, the statement said. [SEP] somali security forces mogadishu is the somali capital. [SEP] " i ' d spent most of the last several months just trying to see how such a u. s. administration policy could jeopardize u. s. policy on iran, " a clinton aide said friday. [SEP] mexican authorities said 14 u. s. citizens were missing, along with 16 u. s. [SEP]
+
+===== sample 001 =====
+[CLS] city.... £27 - £50 per week. greater london authority. institute of education. central london. [SEP] he has lost his wife ' s license, then got it.... and....... and barack obama takes the decision to make it.................. someone ' s dream of living off the oil in iran............................... [SEP] he disagrees though. [SEP] the [SEP]
+
+===== sample 002 =====
+[CLS] don ' t know and i think he ' ll be back in there, she ' s married, now, i ' ll feel very happy because i don ' t think i ever met him. [SEP] lloyds banking group lost £160m in the past two months - with £2. 84bn of last year ' s coming in working capital deposits. [SEP] analysts and legislators have questioned the nature of the state ' s education program. [SEP] analysts say the figures will show that the official exports in north america are expected to fall to $ 19, 000bn ( £8, 000 ) in 2009 - - - the highest drop of this [SEP]
+
+===== sample 003 =====
+[CLS] political analysts said the legislation would act as a waste of public money, and the bill would increase regulation of tax and insurance laws, and give the global banking system needed regulation to prolong the country ' s economic growth. [SEP] the opposition said it will hold a free vote in march after calling off its boycott of the election. [SEP] the lodge, open at eagle lake, 15 minutes from the southside recreation center, is the closest recreation center at nestle st. cloud manor ( 0898 5565 ), which also includes the forest, a school of trees and wild flowers. [SEP] analysts said the president ' s address could [SEP]
+
+===== sample 004 =====
+[CLS]................................................................................................... what ' s next....................... [SEP]
+
+===== sample 005 =====
+[CLS] to the point of access and what is required. [SEP] obama on friday began urging house lawmakers to put the crisis in the health care system on the floor. [SEP] there ' s a growing trend of adoptions with the most recent administration. [SEP] instead the president has had to disloyal himself from politics, trying to find how to lead in the world, leaving him with the savagery to hold responsible, unequiescally. [SEP] " the loss was mainly in a reflection of the weak overall housing and credit markets, " the group ' s chairman, jim austin, told afp. [SEP] the bank ' s [SEP]
+
+===== sample 006 =====
+[CLS] conference. [SEP] ian dowd, head of the irish journalists association said the incident was " the end of the era of war. " [SEP] i cannot say that the writer would not write a century ' s worth of work without its original permission. [SEP] but mayor michael r. bloomberg said on tuesday that his plan needs to be put away. [SEP] but when the colts won the national football conference title last month, they lost the national championship. [SEP] for the first two years of her life, she moved into one more modest house, the albico park, which is far from the edge of oberveeam, where [SEP]
+
+===== sample 007 =====
+[CLS] said. [SEP] mark mcallister, the liberal democrat spokesman, said : " this morning i still think gordon brown should pick up his political rhetoric and televise the questions - - the " questions " - - that might help him get him to that task. [SEP] the deal with virgin media will be worth £25m - £36m each, compared to 3g ' s profits. [SEP] the 28 - year - old former wigan player and premier league assistant have signed a contract with cardiff city management. [SEP] the property came down and a gun was discovered at 08. 20am and the suspect was walking down a road at [SEP]
+
+===== sample 008 =====
+[CLS] last month - - the date of the supreme court ruling for the united states. [SEP] with maradono holding real madrid ' s top five player worth at least £3 million more than the english club were willing to accept a free agent, how much money he will be able to spend is a sticking point. [SEP] a police has arrested a 38 - year - old man who admitted assaulting a woman at a mall in western north london, police said tuesday. [SEP] but as sanchez struggled in the game, tom mcneile came to the redskins to take over the philadelphia secondary job. [SEP] as a white house, a black president of [SEP]
+
+===== sample 009 =====
+[CLS]. 1 billion from july 2009. [SEP] it is the first time french troops have been brought to the end of iraq ' s decades - long civil war. [SEP] the state - owned agency said tuesday that china would not accept the demand made by north korea, china, japan and russia to implement the international resolutions on disabling its nuclear activities. [SEP] that mr. obama has been giving up his math education and better access to computer technology prompted his decision to suspend his work in the campaign. [SEP] the space shuttle endeavour launched from the international space station made its last spacewalk in the space station sunday. [SEP] it compared with the overall [SEP]
+
+===== sample 010 =====
+[CLS] his future. [SEP] police were searching for witnesses and using rubber batons and bottles with water. [SEP] " i want to stand up and say not to get too aware of what i have to do here. [SEP] muthana said another eight soldiers died in an explosion and two killed monday as they were conducting fire against the iraqi forces. [SEP] canada said its annual rate of jobless claims rose slightly to 2. 0 percent, following an increase of 1. 6 percent recorded in april. [SEP] just forget about the election. [SEP] they do everything they can to help. [SEP] this is probably the best way for us to try to sort [SEP]
+
+===== sample 011 =====
+[CLS], he and mr. sloot spoke to his mother about war ii, and its president, john howard johnson, in philadelphia. [SEP] he also said the president planned to start his flight to afghanistan in the early morning today. [SEP] president george w bush also denied he was canceling the trip and said he would not be attending a conference in tokyo. [SEP] " i want to get into my little league game and sit down, because i will not be able to walk my horse, " she said. [SEP] tom haughey, the chief secretary, began to press on the move in the kent county information commissioner ' s office, [SEP]
+
+===== sample 012 =====
+[CLS] the pacific economic group, japan ' s two nations, have agreed to stop cooperating in sino - us relations over whaling. [SEP] mr lee is the first japanese leader to face a public public apology. [SEP] miami, ohio ( ap ) - president barack obama ' s chief adviser - - and the president ' s sister - - will step down as a national security adviser if the president shows that he can to pass a health care overhaul, the obama campaign said saturday. [SEP] but a few years later, i can ' t even figure out where they were going, " said gwenda jones, 66, a college student. [SEP] the [SEP]
+
+===== sample 013 =====
+[CLS] to come back to his team. [SEP] in 2006, more than a dozen children across the country were rescued, mostly from the homes of the williamses, on the far north eastern coast. [SEP] the letter, written by mr milby and former chairman john kingman, said brown was a man of " exceptionality and charisma " who shaped his politics, " while others said the british government was not prepared to lead the region. [SEP] horford was forwarded to the area high school in december but was made a one - star starter in august. [SEP] in a letter to the committee, u. s. open champion [SEP]
+
+===== sample 014 =====
+[CLS] for the candidate. [SEP] there were plenty of reasons for why england were prepared to sit out the three five - time premier league medalists. [SEP] also, the state department said the american women ' s rights institute in seoul confirmed that mrs clinton had resumed personal contacts with north korea ' s then - dear leader, lee kim jong - il. [SEP] mr eady, who quit the game in protest of disappointment, is now committed to a deal. [SEP] revenue and income tax income were $ 1. 059 billion, compared with $ 1. 064 billion the year before. [SEP] the experience of richard rant, the chief of [SEP]
+
+===== sample 015 =====
+[CLS], russia ' s prime minister for europe, said he was disappointed by the latest investigation. [SEP] fec also said that the proposed deal would set the price standard for coal production in india, including commercial power, commercial utilities and telecoms. [SEP] or is he arrogant, or more than someone else? [SEP] without a political support, the jobs policy will not be easy, " spokesman lou basick said. [SEP] there was no indication how the meeting would affect negotiations, according to the report. [SEP] however, ministers say it is more difficult to act on the support of the scottish government. [SEP] ben gordon added 18 points as atlanta [SEP]
+
+===== sample 016 =====
+[CLS] to the office of private enterprise. [SEP] but he was wary. [SEP] " you would ask for celsius, but probably not, " says mr jones. [SEP] in october 2007, he announced the opening of the eden project - known as urban cubes, which were designed by a community group of residents and local residents. [SEP] opposition members said tuesday that they backed obama ' s policy agenda after the central bank moved to keep interest rates at a record record level next year. [SEP] " she ' s very happy to see herself as an average teacher, and it ' s not that the older women were on a self - education course [SEP]
+
+===== sample 017 =====
+[CLS] t have the economic structure needed to keep flying. [SEP] but technology has now given us much information about our methods of education, and funding. [SEP] " but i don ' t think it ' s true how you feel about your team - - you just have to just be professional and you don ' t really like his team, if it ' s for the leadership and the respect and stature of both coach tony romo and the cowboys - - and he ' s playing. [SEP] sometimes the same thing can happen, " he told radio liberty. [SEP] " we will stick to a very short plan, " he said. [SEP] nevertheless, [SEP]
+
+===== sample 018 =====
+[CLS] [SEP] ( cbs ) - a small commercial plane that seems to be flying in kenya has rolled over after killing a local man in east africa. [SEP] let ' s try to call this a joke. [SEP] redknapp led the spurs ' team to a record home performance in march, and van persie has been named as first - team coach for next season ' s final. [SEP] the delegation of the israeli delegation included five congressmen and two members of the parliament of iran and representatives of several nationalities. [SEP] the next generation of self - globalization, the modern world that has its own sense of civility of mass market power, [SEP]
+
+===== sample 019 =====
+[CLS] three detectives and about 20 law enforcement officers and one agency that was investigating the case, police lt. steve alderson said. [SEP] i tell you to ignore the facts and tell you, because the question is : how to do... [SEP] £32, 085. london university london. of camden, city of london, nottingham,.... £63, 000 rising ( £16. 5 million ) per annum - £1, 000 pro - rata... british education association. london. £296, 000. international children authority.... £378, 000 pa. + [SEP]
+
+===== sample 020 =====
+[CLS] after a week... [SEP] i think for most people who work, it is for the majority of people who find it laughable to make a living out of. " [SEP] john clossus, who was deputy director at the department of public, communication and global media under john felton in the clinton administration, said he is not going to be asked. [SEP] tokyo, japan ( cnn ) - - fu kumao, who was born in japan in 1987 after a young age, is living in japan with his first wife, the former wife of the former leader of kao koo, his visit to the ki [SEP]
+
+===== sample 021 =====
+[CLS] health care for children and seniors and federal government spending on government programs. [SEP] q6 : wasn ' t the f - 22e going on sale at the end of business? [SEP] baksville, mass., march 4 / prnewswire / - - the national society of motor engineers of the united states has presented the grand national sponsor at a national conference in capitol hill, illinois. [SEP] itp continues to create all these exciting driving opportunities across the country. [SEP] the group said it has plans to bring international leaders in the city on sept. [SEP] police said that mr brydon ' s co - accused, who [SEP]
+
+===== sample 022 =====
+[CLS] conditions of the credit facility agreement relating to the company ' s amended joint venture, or lp, which was filed with the u. s. government on february 5, 2008. [SEP] after all, america ' s problems are not just about them. [SEP] less than a day later he met here with john mccormick, the assistant secretary of state for african affairs. [SEP] police said two motorists had died from his injuries following the incident on 18 january, following a serious police enquiry. [SEP] he told cnn that he was informed nearly five years ago by a close friend that " his death was a result of a sexual relationship, " [SEP]
+
+===== sample 023 =====
+[CLS] year - old woman and her boyfriend, 22 - year - old john haywood. [SEP] mr cameron said : " many parents refuse to go to a school, they should go to their own schools. [SEP] graham watson has been appointed to help to run the north eastern national trust, the east england heritage fund. [SEP] he said the main primary cause was losing thousands of people each year. [SEP] he has lived through the turmoil of the 1999 and 2004, when he was first elected president of the house of commons, now governed by his mps. [SEP] the un warned for the first time in a decade that global gas prices will rise and [SEP]
+
+===== sample 024 =====
+[CLS] to see one of his close friends as he began his trial for prostate cancer. [SEP] ben howph, lauren johnson, brian johnson and bill baum report. [SEP] in the nimfrs town of sweden, 15, 000 live and 21, 000 live, about 1. 3 million people from northern europe, about 4, 000 living on the ugandan equivalent of kobam. [SEP] but even during a difficult campaign, the differences between the two and obama made it clear that both senators will be willing to take the united states with clinton. [SEP] but after a series of anti - government protests china announced new plans to stop [SEP]
+
+===== sample 025 =====
+[CLS] [SEP] the county council rejected the application and wants to finalise. [SEP] he told reporters he and the national security council agreed on climate change, china, military and economic ties and political differences over global environmental policy. [SEP] under intense political pressure, moscow has sought to rethink its role in the 4 - year - old cold war in the military arena. [SEP] despite the lack of an open front, the united nations must do no damage in the course of the negotiations. [SEP] the national percentage of blacks and african - americans - - 14 percent of the population, 47. 2 percent - - rose 32 percent in a quarter of 2008 [SEP]
+
+===== sample 026 =====
+[CLS] budget deficit in the 2009 fiscal year. [SEP] the treasury secretary said it would cut its net deficit by just £63. 5bn by the end of the financial crisis and increase by about £19bn. [SEP] los angeles at seattle 1, 1 p. m. [SEP] the family doesn ' t want violence. [SEP] the plan is to take what you want. [SEP] how is that an economic recovery? [SEP] the yield on the 10 - year 10 - year note and treasury note dropped 0. 95 points to $ 1. 5905 and the price on 10 - year treasury fell 1 to 605. 54. [SEP] produced by [SEP]
+
+===== sample 027 =====
+[CLS] said john snowdon, a retired air force officer. [SEP] the un general secretary - general told the foreign ministers that the ministers would " " resume the talks that will start on thursday and that efforts to develop the nuclear weapons industry will also continue during the last months of the year. [SEP] peter heywell, deputy chief executive of unicef, said that older people should pay 20 per cent to attend a screening, while children should receive only 17, 000 adverts taken during the campaign. [SEP] the nation ' s national film balpaga, which was the first film selection, came on board earlier this year. [SEP] he is not [SEP]
+
+===== sample 028 =====
+[CLS] - moon. [SEP] the 23 - year - old has made much of his own debut prior to the summer move. [SEP] 9 ( upi ) - - u. s. national security agency says it has " entered the field of digital intelligence " with a so - called digital understanding of digital information technology. [SEP] the move comes as coroni begins formal talks with the leader of the ump party, which is made up of the country ' s two main opposition party groups. [SEP] " one of the major problems with this is that i have asked people to do something with me, " the 61 - year - old woman said [SEP]
+
+===== sample 029 =====
+[CLS] their chinese counterparts stressed china ' s commitment to allow the foreign occupation of its territory. [SEP] sterling bought $ 1. 36688 on wednesday, but lost 0. 9 per cent to $ 1. 0340 a pound. [SEP] the 11 - year low may be a key post - election target. [SEP] nonetheless, it seems that the new author will soon be given ideas and hopes of start penning and writing for the book that makes it up. [SEP] a security official directly connected to the group says that the video is not regarded as coming to people ' s attention. [SEP] mr huckabee has won the republican presidential [SEP]
+
+===== sample 030 =====
+[CLS], clam hill, in north london, on friday. [SEP] ranong, hong kong ( ap ) - sumitomo petroleum corp ( cok2. ax ) has announced its plans to start to double production of southern malaysia ' s state oil fields and develop oil and gas fields, officials said friday. [SEP] " it doesn ' t just matter, " wenger said. [SEP] the administration ' s stimulus efforts have led to bad news. [SEP] on a school road in an old northern california village, 300 friends of manuela maradona ' s school group had a speech on peace. [SEP] a month ago, the president [SEP]
+
+===== sample 031 =====
+[CLS] career as a research executive in london and many of the products were moved from money management to the high levels of the market. [SEP] " i ' m sure that there is going to be a big storm this year, and it ' ll end up coming off completely, " said fredi petroda of the u. s. petrobras center in houston. [SEP] the survey results published on sunday show that wall street ' s big banks fell to the ground over the last couple of months, and come after the stearns collapse struck a huge blow with new investors. [SEP] the drive storts the speaker ' s vehicle [SEP]
+
+===== sample 032 =====
+[CLS] 1, 500 elephants at the african national national park. [SEP] it would take us one day to reach out to the local community. [SEP] like the rest of the world, the g7 would hold up the economy as they do now, managing a $ 19. 2 trillion economic loss ( $ 27 billion ) loss for the entire decade. [SEP] steven johnson, 44, from foyle in june 2008, remains on appeal in court. [SEP] liverpool city council said the site has the current planning consent of the international development agency and would not be used during next year ' s london football games. [SEP] in emerging countries, for example, [SEP]
+
+===== sample 033 =====
+[CLS] schools need to be put in place of higher education in the context of the game which represents the future of the game and for all of its people, children to make it to the school and to know what the need to do. [SEP] answer : just because you know where you ' re going, don ' t what to do when you ' re actually gone. [SEP] there was the lack of a 24 - over - par round, but his main campaign manager, terry gilley, agreed on mccain ' s decision to skip the saturday event. [SEP] geneva ( reuters ) - france has issued a provisional verdict in the case of a swiss [SEP]
+
+===== sample 034 =====
+[CLS]. [SEP] it ' s like a tour of a rolling stone village in st martin ' s park, a town in wales that is full of what the whole country is about. [SEP] i was suckered by mr. cheney thinking before you was calling me to say no or nothing to this situation. [SEP] china has been reluctant to resume talk of its new nuclear power with the united states, and impeached north korea has wanted to abandon its atomic programs. [SEP] mr brown is also running against opposition labour leader stephen johnson, currently the shadow foreign minister. [SEP] mr hu ' s attorney, mark brown, qc, said mr. hu [SEP]
+
+===== sample 035 =====
+[CLS]ar, a member of the house homeland security committee that includes the state department and the u. s. department of commerce. [SEP] with the 34 - year - old now only three months into his contract, the 25 - year - old is looking to replace juan martin jol as the liverpool manager since anfield ' s liverpool arrival in december 2006. [SEP] u. s. officials also have been working on new ideas among negotiators to boost economic openness to the region. [SEP] at a recent meeting with the china state university, wen jiabao, the junta ' s spiritual leader, warned that the specifics of [SEP]
+
+===== sample 036 =====
+[CLS] retiree conservationist james anderson said she was hoping to use her inspiration for the future work of the £1m - £20m project. [SEP] that is what they were saying back in congress last year. [SEP] judith smith, 19, who works at londonderry, has a lot of friends and will have the chance to focus on local issues. [SEP] abbas said the group wants efforts to bring down the islamic leader fatah movement and fatah over the hamas - run authority of gaza. [SEP] all that indicates that the world ' s biggest holder of gold reserves is rethinking itself. [SEP] i have a complete answer. [SEP]
+
+===== sample 037 =====
+[CLS] " no excuses " for tedisco. [SEP] " he is certainly the best father - of - two in europe, " the spokesman said. [SEP] the house is located at louimao, about seven miles from its birthplace, in poinsettia, south of naples. [SEP] as of yesterday, just weeks after aig lost more than $ 1 billion in a controversial stock offering, aig lost $ 4. 5 billion in september and $ 2 billion in september 2008. [SEP] why don ' t you think you ' re making this kind of money? [SEP] the taliban asked for its survival. [SEP] the study found high school [SEP]
+
+===== sample 038 =====
+[CLS] education. [SEP] the arrest of mr lee and the easing of anti - taiwan relations comes amid public debate over china ' s move to improve relations between the two in asia. [SEP] he said the driver suffered the severe impact when a lay - by hit the front seat and left the driver, the woman, the 16 - year - old busmaster, and the 19 - year - old man with injuries. [SEP] the czech president and putin, who made the announcement in paris this month, agreed to go into the talks friday but eu leaders will decide whether the french team should apply for the title. [SEP] i remember it was friday and we [SEP]
+
+===== sample 039 =====
+[CLS] on the field. [SEP] mr corbin was killed when a house went on fire in the village of egbrooke, gloucestershire, on wednesday night. [SEP] this is probably the best golf round i ever faced, and that ' s not all i know about. [SEP] plenty of brews have proved tough and difficult to drink, and you could always beat them. [SEP] " the coens " don ' t say you no longer want sex, it ' s recounting their love. [SEP] while the foreign office has declined to comment, the home office gave no further update on the investigation ' s findings. [SEP] if the [SEP]
+
+===== sample 040 =====
+[CLS] wave of an earthquake, international media said sunday. [SEP] i have always liked the failure of our governments and their message. [SEP] about 50 people were injured and four more were injured, and tractor - trailer vehicles fled the scene. [SEP] boss keith brooking has said he is not interested in obsesting a replacement for the wales welshman, stepping down after the tournament. [SEP] the west virginia freshman chris stewart picked up 13. 8 points per game in second - half offense and also had four interceptions. [SEP] " this week ' s visit will give obama a chance to talk to the world about his war in iraq, " he said [SEP]
+
+===== sample 041 =====
+[CLS] gas stations. [SEP] french public transport group generale nv has said gm, the us parent company which will run its financial services operations, will send a strong management team monday. [SEP] however, the eu wants to improve security and the eu governments defend the action, saying they can ' t do more. [SEP] " that ' s changing. [SEP] mcmorri, a democratic member of the committee close to john kiehner and former massachusetts democrat, said he said he is angry because it ' s " unfair and shameful " to encourage people to stay with their parents, and doesn ' t know the truth of it until he [SEP]
+
+===== sample 042 =====
+[CLS] near the border with the region. [SEP] jerusalem ( ap ) - secretary of state hillary clinton used a speech in israel sunday to redouine words with benjamin netanyahu, saying that she wanted to give home the idea of a peace process and a chance to address the plight of middle east peace and the palestinians. [SEP] head coach brian zola was announced earlier wednesday that former england head coach andy johnson has missed the game after pulling out of next saturday ' s game because of scott brown ' s injury. [SEP] he now wants his separation from his young daughter rafa clout to establish a relationship with his father. [SEP] what can [SEP]
+
+===== sample 043 =====
+[CLS] china. [SEP] but it may be more hard to ignore political advice - - such as getting the raw results of the war in iraq. [SEP] charles holig, executive vice president of industrial affairs at the institute of virginia, told the bbc news : " the world is still looking very closely to america, one in which we seem to see a lot. [SEP] mr. bush has personally suggested that he wants to take part, a u. s. official said, but said he was doing the same time to help relations with russia - - which could be viewed as talking more about pursuing military policy than telling russia to withdraw. [SEP] [SEP]
+
+===== sample 044 =====
+[CLS] don ' t know much longer, but the question is three years ago. [SEP] now it ' s true that president obama might try to hold off on a vote on a healthcare reform bill to get through the senate, although there is no legislation to work to work on if this thing is about to go away. [SEP] but it will be enough, he said, to protect his heart and to keep to his feet and its normal strength while others fall apart. [SEP] with no policy meeting left for tuesday, paulson will lead the c. i. f. central bank, followed by the federal reserve. [SEP] it ' s hard to [SEP]
+
+===== sample 045 =====
+[CLS] good life and, with his knowledge, knowledge and experience, he has a hard look at life and is delphint about the future, and he ' s not recounting every stage of life. [SEP] that ' s because there is growing evidence that the financial crisis is over and that nationalisation of wall street banks is triggering an excessive public sector push by the government. [SEP] subs ( sub : taylor, taylor, walker, goody, goode, huddler, gillett, mannion. [SEP] it was long enough for phelps, who was struggling to make up the mind. [SEP] mr. n. w [SEP]
+
+===== sample 046 =====
+[CLS], china ' s military rulers said saturday that elections scrap the country ' s old national security policy, and give freedom to free speech. [SEP] the bank, 3, 200 people and about £100m of debt, said that would now want to buy a banking business. [SEP] if this is a clean document - - that ' s what it ' s not, it ' s built into a document - - it contains a full set of proposals, making it easier to get the deal moving. [SEP] now, am i married because of a marriage situation? [SEP] when asked if a single member of congress could have gotten them better? [SEP] " [SEP]
+
+===== sample 047 =====
+[CLS] the street. [SEP] " it ' s the real cost of dealing with the whole spectrum of responsibility for all of our country. [SEP] " we were told us, " they said, that it was our duty to accept, but now and now we may not get the answer they do. [SEP] conservative party party members are being targeted by labour mps who claim that mr brown is abandoning the approach that has saved the party. [SEP] the united states has more agency debt than the palestinian authority ' s bonds alone, at nearly $ 3. 3 billion. [SEP] is he still really talking much about the iraq war in iraq? [SEP] she was caught [SEP]
+
+===== sample 048 =====
+[CLS]. military agreement to include the missile defense system as a main component of its new national - security talks with russia and iran, the pentagon said thursday. [SEP] " it ' s a whole lot of stuff. " [SEP] new york ( reuters life! ) - south korean coal and private - equity group ro nrg has extended its $ 20bn commitment to buy its state - cost nuclear power plant by the end of the year, sources said. [SEP] " the decline of chinese inflation has been caused by a significant amount of infrastructure spending in the us free - market and private sectors, " it says. [SEP] in a separate way, china [SEP]
+
+===== sample 049 =====
+[CLS]799pp ; £93pp ; £769pp or the royal air marshals service ( 0195 838995 ; £69. 95 ). [SEP] and when she hit the woman ' s cab door, she left in the form of a sawing box ; about four hours later, she was unable to get out of her car. [SEP] i tried to imagine if i was fitting into a small city in a building that might help build a school in northern ireland. [SEP] on friday, he refused to condition anonymity, however, because he spoke about iran ' s nuclear program [SEP]
+
+===== sample 050 =====
+[CLS] the average school level had dropped 5 point in just a few months. [SEP] the figure for population growth is at 0. 5 % of 2005 levels, but officials in both the assembly government and the government have said they do not have the numbers of levels. [SEP] new york ' s population expanded by at least 60 % from 17, 000. [SEP] but there is no evidence that republicans played a role in the story. [SEP] they also have their children, five - year - old and his wife. [SEP] a liar and an receivership, and this is true, and if you know that this is true, you don ' t need [SEP]
+
+===== sample 051 =====
+[CLS] damage access to the web. [SEP] separately, another national security official, john muskins, told the post the agency named a top senior state department official in a joint statement. [SEP] " i know that the young players were disappointed and there ' s the best chance of it working, so it could take a long time but we didn ' t have to do better than i did do. [SEP] that is because it has a big impact on the u. s. economy. [SEP] he lives with his wife, family and a publicist. [SEP] he said : " we were just wide - ranging at our start. [SEP] the same [SEP]
+
+===== sample 052 =====
+[CLS] said. [SEP] with the people who turn their backs on a ship ' s car next to the bay bridge, they couldnʼt even talk about sex crimes. [SEP] the bank is citigroup ' s position as the domestic european investment bank of ireland ' s biggest economy. [SEP] mr. ford, are you kidding? [SEP] the golsar driver arrived in liverpool at around 7am thursday, shortly after being confronted by a unconfolded car, and followed by a broad clumpge of vehicle activity on the a3976 london ' s north west side. [SEP] senator obama told me at the end of the day [SEP]
+
+===== sample 053 =====
+[CLS] being attacked by chelsea ' s staff in their garden yesterday. [SEP] biden said he will hold face - to - face meetings with iraq ' s political leaders to take part in american efforts to bring about reduced violence in iraq and afghanistan next year. [SEP] there has been no let - up in activity. [SEP] liverpool chairman tom crombie says his reaction to the club making his case for an agreement with the player was revealed after widespread criticism of the club ' s management. [SEP] but the bbc ' s nick morris, sport journalists mark davies and david mcilroy and university of ulster ' s professor sir ian gibson. [SEP] he is [SEP]
+
+===== sample 054 =====
+[CLS] the kerb never found such evidence of ste use, according to the affidavit. [SEP] the report shows that while 2. 3 % of people who are less than six - 25 do have enough time for work, only 13 % want to pay their child tax. [SEP] at $ $ 4 a week! [SEP] " you can ' t run in practice, " he said, after saying that, " i ' m not in training. " [SEP] " i do not think we are going to allow the new regime being brought back quickly. [SEP] of course he would know it would be easier for obama in washington today. [SEP] [SEP]
+
+===== sample 055 =====
+[CLS] it will be forced to lobby state and states to retool their economy. [SEP] the goal of the long - term free trade scheme, unique to the european union, russia and europe, is to support agriculture in the parts of east and eastern africa, the russian media reported monday. [SEP] i think it ' s the right way to go with this tournament, " valarita said. [SEP] " it ' s easy to say, i would never do that job. [SEP] it ' s not just that some top u. s. officials say iraq ' s political leaders are making a great effort to get an international agreement on oil [SEP]
+
+===== sample 056 =====
+[CLS] russia, and china and japan followed. [SEP] " in the end, there are lots of people who can ' t stand, and the people that have all been dispensed to raise some issues in a period ' time, " mccain said later, describing the nation ' s failure to take up the issue. [SEP] washington ( ap ) - - president barack obama on saturday announced that he ' s staying away from the democratic presidential primary in michigan. [SEP] but it is also a case of pronotation and a wake - up call in the international community. [SEP] " it ' s a season, a world cup, a big [SEP]
+
+===== sample 057 =====
+[CLS] time, with other parts of the city and social sprawl. [SEP] " for the electronics, it is much like bigger than an apple mobile phone, " company chief executive moo - hyslop told a conference. [SEP] president barack obama made the announcement in a meeting with israeli, israeli and regional leaders on the gaza issue. [SEP] i ' m only a 24 year old but at the moment i try to make hard choices in order to take care of my children. [SEP] " the heart of this financial crisis is in the u. s. housing market, obviously, but it ' s not a chance this is going [SEP]
+
+===== sample 058 =====
+[CLS]ing, sunbeds and piping. [SEP] ironically, mr. mckinknon has taken a shine off recently ; there ' s the important thing in his recent success : it ' s a politician ' s job to make people feel comfortable. [SEP] palin has been fired at former president bush. [SEP] von wie ' s wife remained close to the u. s. police, although the report did not give details on the case, which likely included nazi - era cases. [SEP] mr. kennedy was a president of the independent institute for political studies in london in 2001. [SEP] it ' s a five - minute fight that [SEP]
+
+===== sample 059 =====
+[CLS] negative effects of the financial crisis, by expending government money to improve public health and re - creating health programs. [SEP] brian weiner, director of the national association of teachers, says that young people and young children can grasp the importance of a good education in the whole family. [SEP] the crash happened at 8am on thursday morning along the promenade off latigate pier, which was covered in water at 10ft. [SEP] about 80, 000 people found themselves homeless after the earthquake. [SEP] marino is 26 feet tall, and is already no. 9 overall, and proved to be a long shot. [SEP] as tiger woods says [SEP]
+
+===== sample 060 =====
+[CLS]. [SEP] this has been the first one since the election. [SEP] the family wants the foreign ministry to take up the case on wednesday. [SEP] but in 1984, after the deadly h5n1 virus hit the high end of the game about 13 years later, " it is important to make sure something significant is worth it, " said paul thomas, the professor who has authored the book. [SEP] his campaign also thinks that hillary clinton ' s timing of her nomination will change to some point. [SEP] there has been debate about the impact. [SEP] the defense secretary of spain ' s proposal to build a proposed human rights commission for the european [SEP]
+
+===== sample 061 =====
+[CLS] of equipment to be used for the project. [SEP] the department added that the state department had been doled enough to set up its own review of the cases. [SEP] the department estimated wednesday ' s deficit at $ 32. 5 billion. [SEP] a 17 - year - old boy ' s father has been arrested on wednesday on suspicion of assaulting two students, police said. [SEP] al - taie is expected to announce his decision on monday, although he said that he has no intention of making the same decision as long as any u. s. post in iraq. [SEP] his focus was mostly on fashion. [SEP] in the past, [SEP]
+
+===== sample 062 =====
+[CLS] jeter ' s career career record is coming to five games. [SEP] mr brown called the election in may, and said he will not run for election. [SEP] she graduated from northwestern university and law school at illinois state university. [SEP] bernanke said that there must be a clear shortening of the buying program, provided there is stability close to the situation room. [SEP] that ' s right. [SEP] you don ' t have to take a sense of what else is happening. [SEP] the girl ' s father has said he believes he has not heard a back - up phone call about his mother ' s life and that he would have [SEP]
+
+===== sample 063 =====
+[CLS] s estimated 1. 500 healthcare companies earned $ 1. 5 billion in revenue in the past three years. [SEP] focusing on iraq and the state of the economy, the theme at the same day will be a joint statement from george w. bush, the white house and other democratic leaders to outline their ideas for the u. s. economy. [SEP] the same government welcomed mr clegg ' s health conference with the message : keep a diary, never forget for the year. [SEP] " we are hoping that the housing market ' s continued strength at the start of this year could be good for the winter, " baa said in [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_diffusion_noise_steps_128steps_n64/noise_const1p45_mid_sine_eta0p02_c256_raw_samples.txt

@@ -0,0 +1,230 @@
+noise_const1p45_mid_sine_eta0p02_c256
+{
+  "type": "summary",
+  "name": "noise_const1p45_mid_sine_eta0p02_c256",
+  "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt",
+  "step": 187000,
+  "decode": {
+    "kind": "categorical_fullvocab_diffusion_state_noise",
+    "config": "noise_const1p45_mid_sine_eta0p02_c256",
+    "steps": 128,
+    "temp_start": 1.45,
+    "temp_end": 1.45,
+    "temp_schedule": "const",
+    "t_power": 1.0,
+    "eta0": 0.02,
+    "eta_schedule": "mid_sine",
+    "noise_conc": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 46.05345631456055,
+    "nll_per_token": 3.8298028155755612,
+    "tokens": 9513
+  },
+  "diversity": {
+    "sample_entropy": 4.179009616612305,
+    "unique_tokens": 1874,
+    "token_count": 8192,
+    "distinct_1": 0.228759765625,
+    "distinct_2": 0.6916830708661418,
+    "top_token_mass": 0.05712890625
+  }
+}
+
+===== sample 000 =====
+[CLS] tees at the par of the second round and trying to stop his second putt, norman joined goosen on the tougher - - with a 72 in an incredible round. [SEP] museum officials are available to say how the strike ended. [SEP] pakistani officials say at least three pakistani officials have been released. [SEP] " we ' d not take a chance at a meeting of russian leaders, especially the next u. s. ambassador, since he is the senior u. s. official on the issue, " lavrov said. [SEP] 11 - to 15 - year - olds have religious support, compared with 18 percent of u. [SEP]
+
+===== sample 001 =====
+[CLS] state department spokesman hwang joong yuphe said monday, published in the state - run korean central news agency. [SEP] the man got his son to the airport, then he was able to get away and get stuck. [SEP] but i don ' t have the mental experience to make it. [SEP] " we need to get something out as quickly as possible. [SEP] nevf offers a diverse range of sports around the world in the region, u. s. cities and regions... its unique heritage, its heritage, the people.... ca. for more information about sendas please visit the washington area. [SEP]
+
+===== sample 002 =====
+[CLS] don ' t expect them to be honest with your customers. [SEP] u. s. embassy spokesman john oas haven ' t confirmed details. [SEP] north east council leader michael gove and liberal democrat leader peter stam ' s brian clie are also the two ex - ministers candidates. [SEP] " you just don ' t know what the government says. [SEP] we will strive to attract younger people to the theater, " said mr. weisner. [SEP] rather, he treated it as an act of arrogance. [SEP] with a predicted drop of about 6, 000 to 6, 000, 000 by next year, the outlook remained challenging. [SEP]
+
+===== sample 003 =====
+[CLS] yang hilg, china ' s first minister of agricultural affairs, and the country ' s second home secretary, during the last five years. [SEP] " i ' m sitting here now because he ' s more successful than me, " she added. [SEP] ( ap ) - a truck fell off the side of a highway, killing nine thursday, killing five people and injuring 15 others in a new york suburb. [SEP] over the years, these parks have covered 3, 000 square yards, 4, 500 feet, 30 feet deep, and 1, 000 acres of national and national forest. [SEP] analysts said the north ' s power could [SEP]
+
+===== sample 004 =====
+[CLS] government on saturday, with riot police and soldiers patrolling red - line shopping buildings. [SEP] i don ' t talk of this race. [SEP] today, nearly six months before the election, mr. mccain said like many of mr. obama ' s supporters, mr. bush had mixed feelings. [SEP] the truth is that he is making his co - worker part of his life. [SEP] after that, carragher ' s england side have been turned to a strength of speed and strength by the combination of talent, the work of united manager and sir alex ferguson - who is playing for the england and european cup champions. [SEP] he was even [SEP]
+
+===== sample 005 =====
+[CLS], but the rest of the message is small. [SEP] the nation ' s confidence index reached its highest ever level in june to 39. 4 percent, up from 39. 9 to 36. 2 in october ' s previous survey, an 18 - month span from the high same period of 2007. [SEP] i ' m told that maybe i ' ve had more of extra energy than sitting in the rv during the morning. [SEP] foreign companies are expected to move into the production of about $ 904 billion of food oil a year, more than half of u. s. exports, and around 2 percent of imports. [SEP] eu officials said [SEP]
+
+===== sample 006 =====
+[CLS] highest levels of premier league, and the importance for manchester united ' s players and players at the end of saturday ' s premier league final season has become more important. [SEP] there ' s a connection between the creation of someone who loves meeting people and being more responsible in life, no matter. [SEP] there ' s almost no reason to give up my job. [SEP] events in the past couple of months have included ethnic, political and religious clashes. [SEP] we would certainly try to get to china, try to talk to china, and make sure we understand our conditions, to discuss what to ask our leaders. [SEP] the kindle, the [SEP]
+
+===== sample 007 =====
+[CLS]healthy habits. [SEP] meanwhile, un secretary secretary - general ban ki - moon, who went to the administration of us president george w. bush wednesday, outlined some ideas - - " some proposals " - - that might be considered in the future trade negotiations. [SEP] associated press writers paul ames and dana bash in washington and liz pechini in san francisco, california contributed to this report. [SEP] london commuters are waking up after being forced to buy their cars and slog back into their home cities. [SEP] hamas, however, insists the israeli militant group must now focus on the group ' s activities in the middle east. [SEP]
+
+===== sample 008 =====
+[CLS] be signed as a trade extension with the us and european union. [SEP] they have to be better dressed, but why should they? [SEP] he can ' t get any answers for us anymore, and you did not tell him anything. [SEP] it is why much of fiscal policy is really wrong after thousands of years of handjoddling and bank handouts. [SEP] however the federal reserve has said it doesn ' t expect rate rises until early summer, meaning the unemployment rate likely will be about 7 percent in its second quarter. [SEP] i know that msnbc. com generates hundreds of thousands and hundreds of 30 - second ad impressions in the day [SEP]
+
+===== sample 009 =====
+[CLS]. [SEP] at that point last week he rolled out his career - - starting work as a college teacher - - working as a teacher in the country, and he promised to help those in need in his role. [SEP] " i think i ' d like to keep working today and playing tomorrow because i like to win here. [SEP] council tax income of £183. 7 per cent fell from an average salary of £26, 088, 000 to a figure worth £1. 3bn. [SEP] the company plans to buy 15 air force training planes over 14 years, the las vegas sun reported. [SEP] i was in japan. [SEP] [SEP]
+
+===== sample 010 =====
+[CLS] of about $ 30, 000, compared with a small amount a year in 2007. [SEP] when drawing on the idea of the national children ' s health care law that opened when the school left here in 2006, the governor certainly should sign it. [SEP] very little can be found under common policy law. [SEP] iraq ' s sunni minority now fear the biggest threat of their country. [SEP] mr. fargan, a second generation flight engineer with british, russian and soviet origins, was born on tuesday morning. [SEP] white, with a digital camera. [SEP] president barack obama has reiterated his commitment to the combat troops to return to the ground. [SEP]
+
+===== sample 011 =====
+[CLS] said michael j mckinney, director of the secus center for business management and management in whiteville, n. va. [SEP] sue smith, the author of this book, said if she were to make me listen to ben ' s, i ' d probably be looking for it much more. [SEP] despite the fact that democrats remain largely underivileged in the country ' s history, many democrats turned to the drucking politics largely to their advantage. [SEP] mr mccain, speaking, said two days earlier that president hu jintao of china, who had visited china, met with the chinese, while stressing they would [SEP]
+
+===== sample 012 =====
+[CLS] [SEP] david streeting, the minister for financial affairs, said he was seeking more government support for the banking sector for mr. mczaghe and said his main goal is to become involved. [SEP] he said the government wanted to create more jobs to boost the u. s. economy, including private export and trade, but the question of jobs and the question whether he could go to congress as a way of focusing on the details of the stimulus is unclear. [SEP] it ' s better to measure the size and scope of the union ' s problems. [SEP] in october 2007 peter ecclestone, my predecessor and deputy development secretary, [SEP]
+
+===== sample 013 =====
+[CLS] nuri al - maliki during his visit. [SEP] whiteville, ill., sept. [SEP] " at the end, you ' ll get the hangers to say that ' s what one should say - - the fact, most of us are born here and aren ' t born here, " he said. [SEP] neither would go away with that. [SEP] the north, whose goal was to take over the sudan in the 1994 civil war, became a moroni government after the region gained independence in 1994, ending a civil conflict that killed more than 70, 000 people since 1997. [SEP] while there is the good news, there [SEP]
+
+===== sample 014 =====
+[CLS] by 1 percentage points to 5. 1 per cent, the government said in a monthly survey. [SEP] and this is that life saturday night. [SEP] until the private investors come out, they need something to show. [SEP] while the new eg engine is a big investment, it is an extension of the ambition that vw, the leader of a company in the heart of the car industry, has on its feet. [SEP] i don ' t think that anybody is doing this film, but it ' s always legitimate for people to think they ' re looking at something more exciting. [SEP] while ambassador to the u. s., the [SEP]
+
+===== sample 015 =====
+[CLS], " the former democratic majority leader ben nelson said when he talked about the recent endorsement of the senate bill by representative max baucus. [SEP] mr parramar, who was now a trader and global credit manager working for bank of new america, said yesterday : " this strong weakness in the economy would allow the fed to cut interest rates. [SEP] the first lady of obama will be a christian, but the president insists he will probably not know any great american. [SEP] bond insiders could argue that a short run on california ' s treasury bonds could be accompanied by a fiscal easing rather than expectations of higher interest costs. [SEP] the [SEP]
+
+===== sample 016 =====
+[CLS] to media reports about the existence of the pro sports web site. [SEP] we ' ll ask about climate change. [SEP] no one has ever run for this and is now in control of my life. [SEP] 26 ( upi ) - - washington state roadways will soon be covered by record weather, and residents and local residents have urged them to do more with water. [SEP] washington, april 10 ( upi ) - - a $ 2. 7 trillion bank and industry group bailout will generate an additional package of about $ 30 billion in federal borrowing, administration officials said. [SEP] at a similar meeting last month in chicago, many democrats [SEP]
+
+===== sample 017 =====
+[CLS] elected to the team in 1997. [SEP] the north east housing council has been given over £60m to support £15, 000 homes. [SEP] still, mr. immelt will not have to work with his five board members - - two top executives, one two - - who won ' t take up his job on the company ' s board. [SEP] " if you have one thing to say about it, maybe $ 50 billion is what he ' s doing. [SEP] at the same time, however, a man who has made a mark with his career may find a way to make it up to the national level by throwing [SEP]
+
+===== sample 018 =====
+[CLS] east west national project manager jim claig. [SEP] abbas met in geneva last week after negotiations found an agreement for them to calm down. [SEP] and california has a record of hotel occupancy... [SEP] it ' s hard to remember. [SEP] at the same time, petherbras has spoken of a long - term view on the team ' s future and believes the sport is operating at current levels. [SEP] in addition, the charity said many people would prefer to keep children involved. [SEP] the uk retail association, for example, has decided to ramp up its plans for nationalisation ahead of us bad debt levels [SEP]
+
+===== sample 019 =====
+[CLS] men trying to bribe federal law enforcement officers, state agents said. [SEP] the government and national park authority have announced funding £1m for liverpool and london roads, £240m for the rail network at the pilingham station and east manchester park. [SEP] mccain the pair agreed to travel to tuesday ' s meeting ahead of the g - 8 meeting. [SEP] the prime minister said the government is willing to pursue a new form of government, with non - eu countries to be ready to give their entry to the eu government. [SEP] tampa bay ( 13 - 8 - 1, 3 p. p. a. a. and verida [SEP]
+
+===== sample 020 =====
+[CLS] fund - raising operation. [SEP] " and a lot of people are talking here about how you could be two guys making big shots, able to have a great deal of time, and the only way to play is to take it away from our ability to play big shots, " woods said. [SEP] don ' t say, " he ' s going to be very tough on other issues, but if you don ' t play with him, it ' s going to have to help him, " bush said. [SEP] she had been tipped off by her attempts to enter the country and leave the government in july 2006, according to the paper [SEP]
+
+===== sample 021 =====
+[CLS] health benefits for families, but he said more work was not needed. [SEP] head of the organisation ' s africa - india region, david grant of the london school of economics. [SEP] ra pleasanton, massa., april 13 ( upi ) - - a 4 - year - old massachusetts girl abducted by a teenage passenger at a massachusetts bus stop died when her father was was stopped by the law, authorities there say. [SEP] the books will be published on thursday. [SEP] the uk defence budget is expected to rise by about 90 % in the decade to 2008 - 09. [SEP] the prime minister has always published a study on the [SEP]
+
+===== sample 022 =====
+[CLS] a positive atmosphere on this trip. [SEP] the company, with headquarters in michigan, also said the cuts will continue at its u. s. plants of around 4, 000. [SEP] such is the government ' s reputation as a balance of power. [SEP] he has a day - to day relationship with john woodward, the lions ' coach and former lions manager. [SEP] " my dad, i took my high school on a train, " he said, patting a mother giving birth to me. [SEP] he noted the mine ' s history but said the local government had not heard the case. [SEP] we ' re seeing a sad situation, " [SEP]
+
+===== sample 023 =====
+[CLS] year - old woman from bristol and a 21 - year - old man from birmingham. [SEP] critics say that the israelis are more likely to block iran than it because of its differences with the iranian regime. [SEP] israel was the first arab authority authority to share half of the west bank before the israeli - gaza war with the west bank hamas - controlled territory. [SEP] about 100 happen every year. [SEP] he started with his masters at st george ' s university, where he was first elected chairman of the house of parliament, then followed by his mother. [SEP] mr brown said that her first day in government will be a global effort to reduce unemployment [SEP]
+
+===== sample 024 =====
+[CLS] funded " healthcare. [SEP] it ' s difficult, his wife says, and he can just tell it now. [SEP] the constitution gives at least the right to talk about the nation ' s most contentious issue in this u. s. state. [SEP] mr. salam left school in washington and went to study english in america. [SEP] the site also features many foreign reporters, including former giuliang viviano vengladi, the italy ' s media minister and openly critical of berlusconi ' s government. [SEP] kent police are hunting down the murder of a mother of six and three children in a surrey street. [SEP]
+
+===== sample 025 =====
+[CLS] of open - play. [SEP] it ' s like late in the summer when six college players spend six years building runs in the winter. [SEP] the overall inflation rate in the consumer price price index, calculated up by the federal reserve bank, rose to 4. 7 per cent, the highest level in 15 months, and only the country ' s biggest price decline, and the most 12 - month price growth recorded since 1983. [SEP] " we ' ve been through many times, " he said. [SEP] but the white house on wednesday said he was not ready to reach agreement with the palestinians, which he said could happen before the elections. [SEP]
+
+===== sample 026 =====
+[CLS]........... n1 : n7877b : h. i1 : n1.. f4 and th : n1 : fb : f. n............. i do not know if this stuff is true, i don ' t know what ' s wrong, but how it ' s not that this is going to happen.................. i ' m not going to repeat.... all this has to happen... [SEP]
+
+===== sample 027 =====
+[CLS] campus thursday, bringing their first commencement ceremonies at a north carolina high school in 2010, officials said. [SEP] that was compatible with the rules, but if the same nations had some common ground with iraqis, we would never be allowed to take the taliban. [SEP] when you ask the status of those two people, they draw different problems from each other, and the damage it ' s doing, " just trying to get them to the point, " she says. [SEP] bush sees all this as a legacy of western military history. [SEP] new york ( reuters ) - goldman group has asked for $ 25 billion from the federal government, while [SEP]
+
+===== sample 028 =====
+[CLS] to make a run for the old - timers. [SEP] 22, at 4 : 30 p. m. [SEP] despite fear of capital losses, the speculators are attracted by market markets. [SEP] on inflation expectations, the reserve bank of england forecast it will be between 3 per cent and 2. 3 per cent in the second quarter, up from 2. 1 per cent in april, during the last quarter of the previous recession. [SEP] we ' ve been with him several times since he told us that he ' d never bought a job. [SEP] apple shares rose 4. 2 percent, to a $ 26. 97. [SEP] [SEP]
+
+===== sample 029 =====
+[CLS], bush, bush, " w bush said. [SEP] the china population count was taken from 26 cities in china for five years between july 2008 and june 2009. [SEP] the nation ' s economic health has spiraled back decades before to the 20, 000 - plus years, a pace never expected to be a recession. [SEP] now he ' s trying to get back to law school, which is a way to feel the fallout from the war. [SEP] overo qoura, 50, who had just lived in lebanon, said he did not know what money would be saved. [SEP] consys, the finnish construction company, [SEP]
+
+===== sample 030 =====
+[CLS] europe ' s conference on nuclear security, russia and attempts to forge a new treaty, one of which has found regular high - level talks about solving a number of disputes. [SEP] about 13 % of students in britain were misled as a result of playground bullying by teachers. [SEP] mrs matthews told police she had arrived at the pub to find around 1, 000 litres of water and her daughter had run away. [SEP] 18 ( upi ) - - more than 90 percent of children, 7 to 2 years, with asthma have asthma, u. s. researchers say. [SEP] " to see what we do, you have to do that [SEP]
+
+===== sample 031 =====
+[CLS] if the country ' s political crisis lapses on saturday, his leaders will sign legislation changing the constitution. [SEP] livni refused to say what she plans to take part during that day ' s visit. [SEP] the prime minister said the plans could create up to 4, 000 new jobs. [SEP] what i continue to see over and over is that more than a day, someone should become frightened, eye to eye. [SEP] he said that the plan has international confidence in iran ' s government and its own energy economy. [SEP] nin ameneh, the chair of the agency ' s environmental watch committee, said it would ask for immediate [SEP]
+
+===== sample 032 =====
+[CLS] highest ranked level on the tour circuit. [SEP] it ' s going to take a lot of money, " mr eick said. [SEP] this was more than four times the total recorded by 4m on the year - - the highest monthly figure since april 2003, when britain ' s gross domestic product deficit fell to a deficit of 5. 3 per cent, but still some two - times the long - term peak reached before the financial market crisis and up sharply since the same quarter in 2008. [SEP] it ' s good to read these stories at times during this year ' s favorite tv shows. [SEP] her husband is known for this, [SEP]
+
+===== sample 033 =====
+[CLS] they need to go right away to get back to their feet. [SEP] the obama campaign has wanted to change the choice and chose a former senator hillary clinton, while hillary clinton ' s campaign has asserted that the democrat democratic candidate would make him a senator. [SEP] if obama didn ' t buy the idea, he would see his vision of countering the united states. [SEP] moktar reinforces its rich pretensions in its individualism. [SEP] ( cnn ) - - the leader of the scottish parliament has agreed to pay £36, 000 compensation to two former soldiers after admitting sexual abuse charges. [SEP] mr brown was forced to hand [SEP]
+
+===== sample 034 =====
+[CLS], " said susan krimatow, executive director of the national association of american hispanic leaders. [SEP] jeffrey f. wilson, a professor of the school of law at the university of st. louis, mo. [SEP] tampa bay vs st.. louis, 7 : 30 p. m., 9 p. m. [SEP] los angeles lakers coach roy williams said jackson, who has no background to the nba, has tried to help him every day. [SEP] they can reach the phone and view news, and to establish a news outlet at home. [SEP] the region ' s most watched news station and air news channels will air at [SEP]
+
+===== sample 035 =====
+[CLS] the party, and indeed the consequential state of the party that controls much of the party ' s success. [SEP] " but people are watching this video and there is no action at this point, " mr smith said. [SEP] new york ( cnn ) - - the largest u. n. force in iraq has been named to the new post of u. n. secretary - general powell ' s chief of staff following bush ' s trip to the country, an administration official said, adding that democrats are still trying to draft additional legislation to make the overhaul of the nation ' s health care system more open to specifics of [SEP]
+
+===== sample 036 =====
+[CLS] wants to fix itself, " said tim heene, a program director with the center for johnson space & technology research center in east chicago. [SEP] " if i can get him back to his position and don ' t take longer, i ' ll take the field, " he said on a day when he went to practice to play before the afc nfl division game to the broncos, general coach jake delhomme said. [SEP] beijing - japanese sports minister kozumang is rallying chinese players to take part in the world ' s biggest and most successful game. [SEP] " i ' m always ready to be a football player. [SEP]
+
+===== sample 037 =====
+[CLS] s a big problem for this area. " [SEP] it is probably the biggest race of the year of sunday night ' s horse of the year. [SEP] mr davies, 46, of bath county, south wales, became chairman after his daughter, jadona, died in april. [SEP] mortgage loan seller countrywide inc. says it lost more than $ 1 billion in a bank run in september and then lost $ 4. 2 billion in september. [SEP] more than £56bn was raised into the scheme in the form of the mortgage insurance scheme in march. [SEP] it said the request was made in the countries of poland and austria after [SEP]
+
+===== sample 038 =====
+[CLS] concerns to india and china could heighten social security in the china - centristan region and signal of china ' s inability to deal with iran over its nuclear program. [SEP] " what we don ' t know is that tibet is our name, " said a senior beijing government official, wang wei, the 46 - year - old vice president, as the 19 - year - old pleaded with china. [SEP] williams, who signed the england lions for the university of wales in 2005, was head coach at the club and has made only one appearance in the french capital of 2003. [SEP] " that ' s not so a way of saying [SEP]
+
+===== sample 039 =====
+[CLS] of the afghan government. [SEP] and it ' s a limitless move to some, as local officials have been looking into ways to find alternatives. [SEP] it ' s just that, the economy has just not been entirely good. [SEP] " but we have no information about the cost. [SEP] " it ' s a pretty difficult place, " said mr. haroger. [SEP] the announcement of pfizer ' s kishore power plant is expected on thursday. [SEP] after opting for the now self - authored " chicago, " mcmurdon recently published two co - authored tours of the author ' s world - - the old [SEP]
+
+===== sample 040 =====
+[CLS] good player and would do some degree of sport first, but trust yourself the people like you know you get angry and do the thing you can ' t do, until you reach that point. [SEP] i am very angry about the g. schweitzk story in the 1970s and ' 90s, when the company and other big workers don ' t get enough of g. m. they think, ' well you can ' t talk about what happens here! ' [SEP] mr pierson said the details of the incident, including any of the violence, are not currently under investigation. [SEP] the home office also found that the number of [SEP]
+
+===== sample 041 =====
+[CLS] services sector. [SEP] david wright added 16 points and five rebounds. [SEP] it is still unclear whether the president ' s proposals " have had a significant impact. " [SEP] about 1. 3 million people live in mauritius, or about $ 1 million a year, and up to $ 4, 000 a month, but many chinese and cabdrivers have paid about $ 10, 000 ( euro3, 000 ) - - and maybe as much as $ 30, 000 ( euro4, 000 ) - to protect the ship ' s owner. [SEP] hoff, who is the secretary of state for state affairs, said he believed the government [SEP]
+
+===== sample 042 =====
+[CLS] " i didn ' t want to give up politics by finding out whether it ' s business or politics. [SEP] then there is the accused jane cook, the duke of york, who for whom mr corby worked, of saying he was not being at the " glam " level. [SEP] he did not say it would bring the greek economy back to health. [SEP] ms smith, who went to the region earlier this morning, said yesterday : " i am absolutely delighted with this. [SEP] reid, d - nevada, was committed to promoting obama ' s health care policy but that he might pass a health insurance law for those with [SEP]
+
+===== sample 043 =====
+[CLS] ' s death. [SEP] may 20, 2009 | 4 : 30 p. m. [SEP] iran has said it will negotiate with the united states, and said it hoped to be able to extract aid from the international energy cooperation deal. [SEP] the disney company said profit rose $ 1. 9 to $ 2. 12 for the quarter. [SEP] all i can do is to say that he ' s part of a story that is quite simply human, and with a kind of enthusity. [SEP] he ' s hoping to end this as the year he wants to take office in april. [SEP] leno : if you ' re really really [SEP]
+
+===== sample 044 =====
+[CLS]ble. [SEP] " i think it ' s all still open, and if you have a strong reason to go into the process, it ' s too early, " tsang told the bbc news agency adding north korea was still awaiting a final response. [SEP] the debate seemed lost on not the issue of the legal battle over who to want to win, but what it ' s like to lose an over - leveraged country. [SEP] mr. obama became the first leader in the nation to join his party tonight when he urged the nation to take over the stimulus program. [SEP] " i think it ' s really a big boost to our [SEP]
+
+===== sample 045 =====
+[CLS] said they would support a ban on youth crime. [SEP] for now, it will take two years to estimate and match the average job rate compared with the u. s. for that decade, which fell 0. 32 percent while fixed - rate home prices fell a bit less than expected. [SEP] within days later the communist government of china issued its own call for congress to pass the constitution. [SEP] it has entered talks to buy lehman ' s assets to raise $ 2. 5bn ( $ 5bnbn ). [SEP] we ' re concerned about a country that has been most affected by the economic crisis, so it is part of this [SEP]
+
+===== sample 046 =====
+[CLS], she said. [SEP] the italian government estimated that the government ' s deficit will be up to 1. 3 percent in the five - year period, up from 14 percent last year, but net debt will drop to 38 percent in the same period, according to rome ' s economic newspaper published thursday. [SEP] sir, chris, and i ' m just a fan of much - hyped - meets - celebrity -... the public perception of individuality. [SEP] the council had recently been working on a development plan for chapel hill park, near the entrance to the university of glamorgan, by november 2008. [SEP] jackson and other [SEP]
+
+===== sample 047 =====
+[CLS] greater priority on the long - term health of the car - based system, " wagoner said. [SEP] what happened to the man to ask him to explain, not to mention the truth is being told. [SEP] the former washington coach had put several extra touches on the program in recent days, but the redskins said he would likely make that job easier if edwards ' tenure continues. [SEP] " at that point, we understand the extent of this news and why, " said stephen d. haffert, the director of harvard medical school ' s school of medicine. [SEP] the analyst, jeffrey piffler, gave a wide - ranging [SEP]
+
+===== sample 048 =====
+[CLS] pakistani military says most of its supply support would cover over three percent of the afghan government ' s fuel or military fuel needs. [SEP] for a while, i had to go back on my feet, relax. " [SEP] new york ( ap ) - the government ' s top financial officer plans to ask the government to buy up its holding rights to $ 2. 5 billion as the federal government completes moves to shore up gm ' s strained finances. [SEP] mr saville, 31, moved to bishop inn church in oxford, england as a teenager, and has lived in wales for 18 years. [SEP] edwards : in a big way, actually [SEP]
+
+===== sample 049 =====
+[CLS] to a normal pace of decline and to be reversed by 2010. [SEP] people don ' t know what to do with their money - - in this case you have to sit around talking, to talk about each other ' s long - term finances. [SEP] the care industry is the primary health industry. [SEP] this is an easy way of getting on with your job, so it ' s hard not to try to think about how lucky you are. [SEP] edwards said wednesday that the americans must show that america is winning in the war. [SEP] as he came up for the debate : " he ' s not a good guy. [SEP] morgan said [SEP]
+
+===== sample 050 =====
+[CLS] anthony kim and chris davis coming on after the match for the lead. [SEP] they also even announced this year that they would make tv appearances. [SEP] white house officials involved with the senate trade and agriculture co - proliferation negotiations say they could not reach a deal. [SEP] the german professional league is led by the slautmann brothers, who is the sport ' s first professional team, while northern rugby is the only first - class of nations. [SEP] he said he expected much more from his mother. [SEP] as during the deep recession of the ' 80m - 75m, the company ' s decline is far short of its scope. [SEP]
+
+===== sample 051 =====
+[CLS]. [SEP] " it ' s now getting tough for the lenders, " said ed reed, the apparantor who has been fielding calls from people for their deposits. [SEP] the loss of two men, the children of a pilot and his crewmen, was one of the problems in the rescue of the vessel on saturday. [SEP] don ' t let guns rise in people ' s lives. [SEP] this is just the latest woe for richard davies, the buckinghamshire - based business lawyer now living with his wife, children and two of britain ' s most taxing billionaires, his high - profile friend and education minister anthony keene [SEP]
+
+===== sample 052 =====
+[CLS] said. [SEP] he ' s cut out a bit about the government ' s performance weeks before the next election, with students being invited to talk about sex crimes. [SEP] rather than the politics, she ' s had only the best few moments. [SEP] that ' s a shame. [SEP] the associated press, citing the u. s. treasury, business groups said monday. [SEP] the largest studies, they note, were funded by the university of north carolina in atlanta and colleagues at the cdcps national center of pharmacology section of the national archives of national human genome review. [SEP] senator obama has also voted for me nine times. [SEP]
+
+===== sample 053 =====
+[CLS] to the european court. [SEP] last month, the federal police arrested 22 people in the western city of beit natanz. [SEP] a total of 50 children who had been using drugs were arrested at the time of the study, representing about 25 per cent of all levels of crime by 2003. [SEP] the u. s. army says it launched its assault in january, but the status of the border with the group has become clear. [SEP] but at one point of the train stop, the driver ran away. [SEP] richard smith, 44, and dean wilson were both dumped out of f1 as part of an fia investigation to try to establish [SEP]
+
+===== sample 054 =====
+[CLS] in north and west iran, it said. [SEP] that ' s what fred perry means to the game. [SEP] the situation at this point, by the way, is fair. [SEP] the decision was initially followed by a 2007 report in the times, published in washington, d. c., by william m. gates, the u. s. secretary of state security. [SEP] even then, the economy still remains about where the housing problems started. [SEP] but his office insisted on the principle of democracy and a strong leadership in the country ' s ruling party, and he said congress was ready to push for reforms. [SEP] mr osborne, [SEP]
+
+===== sample 055 =====
+[CLS] it was up to the government and borrowers to re - pay the debt. [SEP] peer ' s win was the first for her country in the tournament in 10 years. [SEP] mr brown ' s decision to end the plan is unneistiated. [SEP] the details of st. george ' s trip emerged at the very start of her tour to the united states where he is based. [SEP] " it ' s easy to see, guys, " he said. [SEP] they didn ' t know if he would get the job. [SEP] the deal is based largely on signing a non arms control treaty, the journal - times reported wednesday [SEP]
+
+===== sample 056 =====
+[CLS] asia and foreign policy and the israel news international foreign policy adviser. [SEP] look at the world, 25 may 2008. [SEP] the turkish military has insisted on contacts between northern cyprus, northern ireland, the rest of the west bank and the rest of the muslim minority by kurdish peacemakers. [SEP] " when i did get to him what i was told wasn ' t working. [SEP] schumer said in an executive announcement issued on april 16 that the cuts in jobs would come after a major upturn in initial losses of about 25, 000 from 56, 000 in the previous two years. [SEP] " the academy ' s best friends are seeing [SEP]
+
+===== sample 057 =====
+[CLS] experience in such areas as energy and the environment including energy development, green and renewable energy and infrastructure. [SEP] the old man should be in a drawn - out after his long career with the chinese club. [SEP] i had an idea to say : " don ' t you care about the person on the track, the drinker, anything else that you have to do, " murgis asked. [SEP] but, he said, the public really would always have a sense of urgency and concern. [SEP] washington state at pittsburgh at n. st. army, 4 : 35 p. m. [SEP] austin, texas, april 6 / pr [SEP]
+
+===== sample 058 =====
+[CLS] to make all of the voters see that this is a way to be a political process than a military victory. [SEP] toyo, japan ( cnn ) - - japan ' s opposition party is poised to win the nation ' s prime minister ' s by - election, the first election of 2009 of a new president. [SEP] crude oil fell 1. 9 cents to $ 64. 17. [SEP] " i think it ' s probably higher this year, but i think it ' s a real possibility, " she said. [SEP] prison officials had said the case was scheduled for a hearing in u. s. c. court thursday, citing [SEP]
+
+===== sample 059 =====
+[CLS], including a video game, called click action, that can be played with fun in the form of some of the game ' s best game simulators. [SEP] we ' ll also get news of the largest global trade swindle in history since the end of communism. [SEP] it ' s not as if the market is using it on the way. [SEP] playing on the ball : " he came too high, so i just think he will be pretty intense in the end, " said falg. [SEP] the former ecb chief executive, tom hooper said that was a good start to go for. [SEP] david cameron, the [SEP]
+
+===== sample 060 =====
+[CLS] and i don ' t want to do much more. [SEP] as they repeatedly pitch his question with her face, i ' m at the one time that she has begun to make sense that that bill is taken, at the same time, as a medical issue, as a policy. [SEP] he wanted to be the general club boss after torre was president. [SEP] he added that the rise in oil prices was caused by the effects of the last post - war ii recession. [SEP] she also advised a federal judge in the case with the national center for human rights, law and foreign relations, arguing that immigration officials in some states have an obligation [SEP]
+
+===== sample 061 =====
+[CLS] north korea ' s navy, u. s. navy ' s vast foreign fleet and even push the obama administration for greater access to the national intelligence service known as internet - - the central agency to monitor terrorism in north korea when it ' s necessary to get out of the united states - - as she did for the program. [SEP] fourth quarter, january 2007 and december 30, 2007. common stock earnings of $ 1. 1 billion, and average share price price in the first quarter of the year ended in september, 2006 was 44 %. [SEP] david walker, who works for the park service, said he thought one of those [SEP]
+
+===== sample 062 =====
+[CLS] years and he ' d be ready to patch it up, " washington defender jason carter said. [SEP] the officials said on friday that u. s. forces would have headquarters there but had no firm decision to support the request from the u. s. military, the largest force of about 100, 000 turkish troops operating in iraq. [SEP] the couple had expected to pay about $ 80, 000 a year, $ 100, 000 per month. [SEP] obama ' s campaign, senator hillary rodham clinton, called his campaign a big campaign failure. [SEP] they had said the government would find a candidate. [SEP] " it pains me to understand [SEP]
+
+===== sample 063 =====
+[CLS] make his big league debut for the club ' s leaders in a press meeting saturday night. [SEP] the statement comes days after iraq ' s central government rejected the pact ' s sunni economic and political demands. [SEP] the indian government on saturday repeated the ultimatum that the deal will be delayed before a final decision. [SEP] each event often comes into its own, sometimes with the wind. [SEP] mccain ' s aides - - including democrats former president clinton and bill clinton - - have apparently been willing to work together. [SEP] obama said he had not heard of gore ' s proposal. [SEP] all the while, a clutch of british calibres, [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_diffusion_noise_steps_128steps_n64/noise_const1p45_mid_sine_eta0p08_c256_detok_raw_samples.txt

@@ -0,0 +1,230 @@
+noise_const1p45_mid_sine_eta0p08_c256_detok
+{
+  "type": "summary",
+  "name": "noise_const1p45_mid_sine_eta0p08_c256",
+  "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt",
+  "step": 187000,
+  "decode": {
+    "kind": "categorical_fullvocab_diffusion_state_noise",
+    "config": "noise_const1p45_mid_sine_eta0p08_c256",
+    "steps": 128,
+    "temp_start": 1.45,
+    "temp_end": 1.45,
+    "temp_schedule": "const",
+    "t_power": 1.0,
+    "eta0": 0.08,
+    "eta_schedule": "mid_sine",
+    "noise_conc": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 44.612465411027486,
+    "nll_per_token": 3.798013313495776,
+    "tokens": 9352
+  },
+  "diversity": {
+    "sample_entropy": 4.105863199315936,
+    "unique_tokens": 1820,
+    "token_count": 8192,
+    "distinct_1": 0.22216796875,
+    "distinct_2": 0.6919291338582677,
+    "top_token_mass": 0.0728759765625
+  }
+}
+
+===== sample 000 =====
+[CLS] putt on the par hole of the tournament then blasted away with a par putt, but his good turn over the sander nearly took it about 20 feet off the leaders. [SEP] they are also at odds over how to be related to the political crisis, and the impact of china on global economy. [SEP] "i've known strategists several times and it's been criticism of u. s. policy, such as the direction of u. s. policy on iran," bush said. [SEP] russia's overall index was 15 u. s. members in 2008, compared with 16 u. s. [SEP]
+
+===== sample 001 =====
+[CLS] everton head assistant tony quin has been linked with succeeding jack mungle as the manager of the premier league club. [SEP] instead they lost his son, john simpson, whom he described as both an alcoholic and his late own father. [SEP] senior officials said obama defended the decision, saying he wanted to take more attacks from the liberal democrats as part of his campaign strategy. [SEP] airon's asia travel program includes key destinations in 35 countries and u. s. cities and 23 cities, including international destinations from argentina, brazil, peru, china, france, australia, korea and singapore. through may, visit japan, france, [SEP]
+
+===== sample 002 =====
+[CLS] wouldn't know for sure we'd need a president. [SEP] "i'm going so hard, i'll feel like i was here," woods told a rally in paris. [SEP] lloyds banking group fell by 2. 5 % over two months, to 25. 84 %. [SEP] don't know if this is a football tournament as the three major premier league clubs will not be being played this season. [SEP] " although the squad is strong, it is a very dangerous situation. [SEP] it would raise between 1, 000 billion dollars and 2, 300, 000 dollars annually, with the tax exemption of some [SEP]
+
+===== sample 003 =====
+[CLS] negotiations with south korea, "britain had a lot of north koreas and a lot of south korean entities," the aso report read. [SEP] meanwhile, the london trade newspaper reported the group's biggest reported takeover of german rival de opel comes as the german group focused on selling off its portfolio of investments including the retail, mortgage, property and credit management and construction. [SEP] "i don't know is what i would do," said han tsing, general secretary of japan's ruling communist party, after the 2, 000 - strong rally took place sunday. [SEP] analysts said the uk's bank said [SEP]
+
+===== sample 004 =====
+.. and that is............................. and that is..... and that is............. and that is.............. and that is,.......... and that is....................................
+
+===== sample 005 =====
+[CLS] tskwea, harare, jan. [SEP] you seem to be sitting on the couch and focusing very well on what each of you can walk to. [SEP] there's a few words of good news about the most recent storm. [SEP] among women were three to 3 to 27 - 29 years and men 12 to 16 and 18 to 25 years old. [SEP] more than 20 other south koreans from the hwangg park were expected to move into the country, where the border border is located, hu binge minn, the assistant u. s. spokeswoman, was quoted as saying. [SEP] eu officials said [SEP]
+
+===== sample 006 =====
+[CLS]t, mrs livni's chief spokesman for her party's election. [SEP] authorities reported monday dozens more suicide attacks in nigeria, trying to fend off renewed pressure on the center of africa's big oil industry. [SEP] his son was killed when his vehicle struck a tree in baghdad, killing his father and his bodyguards, officials said. [SEP] i think people in the north of england can have a good relationship with the national government. [SEP] in the first 14 years of service she has often developed into one of the best in football. [SEP] abu dhabi, which was launched under the ownership of mumira gul, the [SEP]
+
+===== sample 007 =====
+[CLS] los angeles. [SEP] david satter, state department spokesman for national security council, disputed this. [SEP] but ahmadinejad's letter to journalists and reporters offers only some language - - like "congratulations" - - that appears to have got it out that way. [SEP] the total price for gas will be worth $15bn - $20bn each, compared to the current budget of 2007. [SEP] the opposition leader has been seen as a source of strength for japan with his long line of focus and pedilection on tax rises and spending policies, but must now find a way to prolong his career down the road. [SEP]
+
+===== sample 008 =====
+[CLS] cost about £15m. [SEP] the development of formal trade ties between the eu and the united states has not been enough for most of europe. [SEP] the group of 19 chinese and south koreas were on a boat trip to northern pyongyang on china's east coast, near the capital city of hangzhou, when a coach crashed. [SEP] however, olmert said he can't tell how congress will repeal the law even though it isn't complete because the president himself has no difficulty with doing it. [SEP] msnbc. com reported that mccain was spending hundreds of thousand - worth of dollars on the campaign [SEP]
+
+===== sample 009 =====
+[CLS] in iowa, iowa, clinton's wife - and - in - law worked as a scacting teacher, as a single mother in germany, and then wrote about her ordeal in the next few years. [SEP] but if they were dead, it would not be enough for them to be given the right to negotiate. [SEP] a group of 20 korean men crossed into north korea illegally over the weekend in one of the most dramatic rescues in north korea's history. [SEP] " i was really frustrated last year, i couldn't get a run over three days, but i thought i would improve when i came back here. [SEP] [SEP]
+
+===== sample 010 =====
+[CLS] at about $500, 000, compared with $1 million a year in february 2004, it is hardly ever predicted that the national average annual average income will decline. [SEP] when she was last seen in 2006, she was a young girl. [SEP] the losing team has never been to the world series. [SEP] china's president - elect, wen wen, could say that his country needs a long - established model of leader to deal with important national social issues. [SEP] sales in january reached $7. 4, compared with $7. 5 in 2007. [SEP] the 17 - year - old hfw leader said the teenager had [SEP]
+
+===== sample 011 =====
+[CLS] construction of the main high rise rail tunnel built near london will peak at about 650 feet, the company said, probably in 2009. [SEP] sue smalling, author of the book club, says one of the most difficult things to tell. [SEP] (11 pm eastern time) at tuesday's briefing in washington, the officials said. [SEP] so far, it has raised more than $30 billion. [SEP] don't hate chris, boys, talk about... [SEP] many analysts predict the job losses would be no more than double the 1, 000 rate economists had expected, and the national unemployment rate and unemployment insurance reading of 49 [SEP]
+
+===== sample 012 =====
+[CLS] northern gaza on sunday and broke again over a four - hour standoff. [SEP] medvedev said he was expected to make an announcement on gas prices in his address to russia's parliament, which moscow says will be ready by december. [SEP] she's looking at the possibility of 10 applications this year. [SEP] he also played at texas, where it started 11 - 15 in july 2006..... [SEP] the labour department said the number of new jobless claims had risen to 4, 000, 000 in february - - the highest level since february 2005 and from more than 2, 800 in the first six months of [SEP]
+
+===== sample 013 =====
+[CLS] nouri al - maliki came into office. [SEP] the internet, of course, is full of news briefings. [SEP] "you must get the cubans to go home - - keep fighting - - look like the fighting is over," and he has pressed the u. s. president on a number of public issues. [SEP] foreign minister sergei lavrov was expected in moscow friday to take part in a european foreign conference in moscow, the russian ria news agency reported. [SEP] he said unemployment, or net unemployment, slipped to 13. 6 million from 12. 2 million, adding the biggest job performance in europe would [SEP]
+
+===== sample 014 =====
+[CLS] 1993 and san diego in 2000. [SEP] in 2005, the prime minister began a series of protests that resulted in thousands of activists trying to form a government being arrested at his father's house in the capital. [SEP] but it is clear that there will be a backlash if it is not considered a problem in sex education. [SEP] and this should be put in the hands of all parties, "tembura said. [SEP] i don't want a lot of cash. [SEP]" i don't think anybody at the club think they're right, " he said. [SEP] conservative party director - general sir david macdonald said the [SEP]
+
+===== sample 015 =====
+[CLS] head coach, but he has a plan: by then he will have a team of assistants that don't know what he is doing. [SEP] the project includes parts of new york, a large and vibrant new city, historic buildings, wind power and other development that now lead to the city of the city and its influence over bridges, rail routes, airports, transportation and infrastructure. [SEP] speaking at the news conference, bush said some other major countries were watching developments. [SEP] snowdrops flew along the russian - controlled eastern sea mountains area near the border with poland while it was taken over from the erevil mountains. [SEP] the [SEP]
+
+===== sample 016 =====
+[CLS]. [SEP] what makes me... think of john mccain. [SEP] maybe they would ask for more. [SEP] some they might find things interesting in the spring. [SEP] in his earlier appearance, he'd heard the child's voice and said: " let him do this, and let him know, and he's asking him to do the same thing. [SEP] london, july 8 (upi) - - a european fund, a small bank and a european government bank will provide britain with guarantees of about $30 billion in new capital, british officials said. [SEP] speaking at a meeting last year in chicago, the us [SEP]
+
+===== sample 017 =====
+[CLS] took to the conference in 1997. [SEP] it's all about not being able to explain the race, because of that, it's about me, it's not about his identity, it's all about his character - - not about making people out of politics - - it's not about his mind, his true identity, it's about the style and politics of a man who loves his own life going on and what he's doing. [SEP] the "rest of your family," someone who has a personal background, would be a happy choice - - not someone like you, but your friends, [SEP]
+
+===== sample 018 =====
+[CLS] [SEP] mr. mugabe had been winning just over two percent of the presidential vote in south africa, but he has campaigned in south africa. [SEP] let you be clear, all i want you to think... [SEP] the discussions, led by t. s. alcred, the white house deputy under - secretary, appeared to hammer out a comprehensive new policy, in which a new leader was elected at regional level. [SEP] general motors, one of gm's biggest customers and the major u. s. automaker gm's bankruptcy, has issued broad criticism of its own plans ahead of details of its new car program [SEP]
+
+===== sample 019 =====
+[CLS] a u. s. drug enforcement administration spokeswoman. [SEP] mr johnson said: " i think it is time for people to concede that i should take the time to sit down and make the first decision about my position after next summer. [SEP] the weather is fair and the weather rough. [SEP] i like mr clegegg to take their lives. [SEP] beijing (ap) - chinese officials believe the government plans to launch the inter - korean railway, pro - china sources said tuesday, the first step in sino - chinese relations between the government, xinhua news agency. [SEP] she told abc she and gesela [SEP]
+
+===== sample 020 =====
+[CLS] over a week ago. [SEP] "i think i think people are talking [about it] the right time, but it is not worth doing that over a period of time," carles said. [SEP] mr. nickerson, the president of the atomic energy corporation, which heads the oversight committee for the public administration, said he is asking for more money. [SEP] seoul, south korea (ap) - south korean leader hyeunn chun, the late north korean founding father and their 18 - year - old son, flew to their car saturday and left the country to end the first three - day state visit to the north [SEP]
+
+===== sample 021 =====
+[CLS] health care for india's health care markets. [SEP] the national bank of china, hong kong's largest bank, and china life investment group in singapore remain. [SEP] bush said he was speaking saturday after meeting with foreign leaders in japan. [SEP] saudi officials said wednesday that israel would send its ambassador to the united arab emirates to the arab foreign ministry at a news conference later this month, israeli news agency anfaq reported. [SEP] it's been good for me. [SEP] the company said it would look to 100, 000 chinese nanos within 10 years for four years. [SEP] it's something you ask her about - - [SEP]
+
+===== sample 022 =====
+[CLS] should use the olympics to bring technology to the games, said itf president ron smith. [SEP] i think you could just put me off with something like any other, and maybe i was just frustrated, i was just talking about the top of them. [SEP] 11, a day after the democratic president's speech, when he met him in the white house. [SEP] the jeffs left high school, joining his mother, his father. [SEP] mccain, like most republicans, will be cautious. [SEP] he told reporters that it was now time to change his policy, only to give it more details within a year of a launch. [SEP] " [SEP]
+
+===== sample 023 =====
+[CLS] year - old woman from bristol and a 21 - year - old man from birmingham. [SEP] the project was funded by assembly government and educational services aimed at improving local services in wales and increasing economic development. [SEP] president obama declared himself ready to campaign to change president bush's administration with the economic policies and policies of the previous administration, without any opposition. [SEP] his career was never ended. [SEP] he said he was still at st george's school and he was no longer burdening on the number of lessons to be given by his son. [SEP] but zhou warned that he must agree with government leaders to address global account deficits. [SEP]
+
+===== sample 024 =====
+[CLS] the new year. [SEP] that's 7, 000 u. s. a. workers make up 16. 5 percent of of mexico's farm income, and nearly three quarters as many people living in the u. s. state department now earn federal subsidies that start at more than $500, 000 annually. [SEP] this will include a group of hud experts and experts, and the game commission will investigate and investigate some of the service's activities. [SEP] "the failure of al - maliki's government and the kurds will only define the government's side of the war," he said. [SEP] but [SEP]
+
+===== sample 025 =====
+[CLS] - for - 17 since last season in arizona, shortly before he missed a game. [SEP] the national statistics office, based on the chartered institute of trade and development, now expects a 9. 7 per cent slump in house prices, compared with a 6. 5 per cent drop in house prices over the previous 12 months. [SEP] it's late this night, friday, and it will be almost perfect for each family. [SEP] "there's no reason to why," he said. [SEP] but he acknowledged that the current economic policy was tied to the public money left by the conservatives, and said the chancellor was clear that people [SEP]
+
+===== sample 026 =====
+[CLS] returning from a previous trip to the uk who has been fighting legal independence, said that he would sign up to the talks. [SEP] i have been to the playoffs and i will tell players this season, how to let them go, so, hey, i'll be out this season for three weeks and it will be painful. [SEP] i haven't had many things going wrong, but how it will change is that i have to try to run this season. [SEP] it's important that consumers get to know about'small business,' and it's a lot to do with all this growth. [SEP] the size of [SEP]
+
+===== sample 027 =====
+[CLS] them eight minutes away their first division victory, would never mind manager james bowden's mind. [SEP] recent figures show a huge majority disapprove of the rise of criminal crime among middle - class countries that might be tempted to exaggerate. [SEP] if you have to buy it, you have to set up parking space in each area, and keep the vehicle's design with the roof. [SEP] the agency was encouraged by the change, however. [SEP] professor robert kirfwean is a professor at the new york school of health and management. [SEP] the ftc said in a press release that it was investigating whether [SEP]
+
+===== sample 028 =====
+[CLS]'s first meeting with the president - elect in april 2008 described china's pro - growth approach as "a complex model of fiscal sustainableness." [SEP] but a survey published by the national union of the royal medical college physicians (ucc) showed that 53 % of people show "exceptional" working in the public sector. [SEP] he said that the mother's father, the son of his brother, father father, father, and mother always had the same choice. [SEP] amr inc., the majority of the company's second quarter revenue, rose 4. 2 percent, to nearly $1. 5 billion, [SEP]
+
+===== sample 029 =====
+[CLS], and 27 - year - old fiance c. w. johnson. [SEP] more than two dozen experts from china to china will travel the country in an effort to restore the nation's level of democracy after agreement was worked out around the clock, officials said monday in beijing. [SEP] i want to get a chance from her playing in the u. s.. [SEP] it also is under pressure to care about the financial aspects of the recession. [SEP] the topic is likely to be how to show mr obama's direction and direction as he spoke at a beijing conference earlier this year. [SEP] it's not even fair that the truth [SEP]
+
+===== sample 030 =====
+[CLS] conference/news conference with the federal reserve. [SEP] over the two days, former vice president dick cheney has offered some hard - running talk about solving a set of problems. [SEP] the figures show the numbers were higher than average to reach the peak of the h1 peak. [SEP] when mary whitfield had arrived at the 10ft, she heard a small amount of water and her children had run off. [SEP] 11 (upi) - - more than 30, 000 teenage children in private reading groups in europe were surveyed monday, u. s. data show. [SEP] " for the next several weeks, it will be clear to [SEP]
+
+===== sample 031 =====
+[CLS]. [SEP] biden said it would be for obama and foreign policy experts to travel to beijing with a joint statement from the two under president bill clinton. [SEP] he predicts that mr johnson will be able to take a leadership position at the election. [SEP] washington - - 13 percent of those surveyed indicated their opposition to the idea. [SEP] on friday morning, a day earlier, north korean deputy foreign minister jangl sung said he was negotiating with north korea not to use seoul's waters as its own borderline. [SEP] with britain expecting around 30, 000 net visitors in 2012, forecasts project up to three - year growth for the [SEP]
+
+===== sample 032 =====
+[CLS]ico burress during the pre - season training camp. [SEP] woods has won eight straight playoff games, the last at his final event. [SEP] the american jobless rate was at 3. 7 percent for the year after peaking at 175, 000 in april, when the two - month span was 3. 2 percent, the survey said. [SEP] andy johnson, the un secretary of health health, referred to the swine flu campaign friday during a recent visit to the new york state medical council. [SEP] it's hard to call those elections weeks ahead of next year's elections in washington. [SEP] he was filmed filming for his film [SEP]
+
+===== sample 033 =====
+[CLS]bernation " - - a story of courageous interventions in the hands of the british government in the days of the democratic and republican administrations of the 1960s. [SEP] for hillary clinton's campaign, hillary clinton is expected to announce today she would deliver a speech to the national convention. [SEP] mr cameron told the bbc radio 4 today programme that ministers would be prepared to hold an extension on the number of children 24 hours to five in half an hour. [SEP] british police have helped find the killer of a foreign terrorist in order to create a terror threat. [SEP] however, he has not been asked for a full year in the history of the tour [SEP]
+
+===== sample 034 =====
+[CLS]. and it's just a matter of time...................................................................................................... that's the fox news network, abc, www, [SEP]
+
+===== sample 035 =====
+[CLS] the u. s. secretary of state's office. [SEP] although there is little of david cameron's credentials as the eu's minister for european affairs, there are many differences to the fact that it is the european union - elected president and the role of the less respected national party leader. [SEP] in a response to ban, the secretary of the u. n. general assembly, ban ki - moon,, also due to travel to tokyo later on wednesday, said they would meet on tuesday next week, including japanese foreign minister yasuo hottini and russia's foreign minister, egyptian - president hosni [SEP]
+
+===== sample 036 =====
+[CLS] ask about us: we're living in this age as to how we live what we are doing at best, ' "murray said. [SEP]" if i can win, that would be a problem. [SEP] gm has conned that he will take the company private, and observers say they hope it will enhance his effort to focus on quality cars and consumers. [SEP] the company had been holding informal talks with carmaker cerberus to support chrysler llc after talks with german automaker sag on terms that could give the world's biggest automaker greater access to market interest in its cars. [SEP] mr smith said his father, [SEP]
+
+===== sample 037 =====
+[CLS] have been big enough for good reason, but surely it is not worth putting much effort into the game in c. r. a. tournaments. [SEP] juriza poh wiyao, his brother and his wife mah tskgi tsa, died in 2004. [SEP] mr doumba, now lecturer at sheffield university, is now due to pursue a full english degree at master's. [SEP] martin gullity, of arranva council community transport manager, welcomed the project in the area. [SEP] "i'll know if we're on the same level," he said. [SEP] looking at [SEP]
+
+===== sample 038 =====
+[CLS] chance to talk to china about its economic and military ties, however, since the obama administration is wary of china's move to improve ties with its allies in asia. [SEP] he said the leaders of the muslim group, including five other muslim women in denmark, had been arrested including the danish woman, the 23 - year - old danish man, and the 19 - year - old man from denmark. [SEP] the same thing that edwards, who scored every goal against liverpool in 1992 when he was 19 at the time, was the only one to make the difference there was no question of what he has to do. [SEP] that will probably [SEP]
+
+===== sample 039 =====
+[CLS] dropped the missile after iran was talking to him. [SEP] they stopped about 4 p. m. thursday near the east river, between rookes road and the molico road bridge. [SEP] it's been a good week today, but we will not be able to continue. [SEP] "it's still an acceptable option," said mr. larigan. [SEP] so is god: "there's plenty of effort," robert gibbs said. [SEP] while hawking the latest film, director robert fox's "star trek," which has co - produced 20 of the studio's 18 movie series, mr [SEP]
+
+===== sample 040 =====
+[CLS] [SEP] "i wanted to have the money back first, but i always said things like, i'm just saying it's you can't do this, so i came out. [SEP] i am very smart, intelligent and balanced and prate. [SEP] he left the farm in january aged just 14. [SEP]" he would not confirm the full name of george j. mitchell, " clinton said, adding he hadn't known about the story before, deputy press secretary robert gibbs said. [SEP] delauro's success gives the company more scope and space for expansion. [SEP] the post office study found that the rate of [SEP]
+
+===== sample 041 =====
+[CLS] 18 points, and david foster added 16 points and 13 rebounds. [SEP] it is inter's third win since mourinho's first club start following the defeat at liverpool last month. [SEP] i won't know that until he is 30, and after a $4, 000 salary rise and the job of a professor at his private school, management, in spring college, pennsylvania, it took his father robert johnson several years to look at what his football team did for him. [SEP] mr todd said that colleagues advised him to be careful and not to leave him at night after his death. [SEP] former secretary - general john [SEP]
+
+===== sample 042 =====
+[CLS] "it doesn't take much to know," he said. [SEP] "i have no idea what he's talking about. [SEP] it's like he's the first host and co - co - host of the late - night - talk" good morning america " show. [SEP] she did not say what would be the most likely course of action. [SEP] this legislation will help to protect the ruling party's dominance of parliament and its foreign policy. [SEP] washington - a former senior white house official said thursday night with president barack obama's new foreign policy adviser that mr mccain will continue to build closer military ties with [SEP]
+
+===== sample 043 =====
+[CLS] wanted to take a long - term job and seemed loyal to him, not least when he won a major pga play championship at the at & t club last week. [SEP] the officials said they come from the department of national security and health administration, part of the president's national emergency management board. [SEP] as usual these days, i'm sure it is enough to score lots of hits and goals. [SEP] this is an effort that has finally turned a public perception into a reality. [SEP] he's now trying to focus on the way he speaks, his father's upbringing, and his upbringing. [SEP] the i. t [SEP]
+
+===== sample 044 =====
+[CLS]ble. [SEP] i have worked hard to get points for this, but if you want to wake up to go into the final, it's too late to get attention - - often along with a couple of younger players getting to the final ball. [SEP] if the central bank continues with the growth of the big developing economies such as india and china, much of china's economy will be wrecked over a period of time. [SEP] dr stocker is the first person in the uk to receive the new post, the first welsh woman to take charge of health care. [SEP] " i think it's best for a board to discuss [SEP]
+
+===== sample 045 =====
+[CLS] guys, you've got 2 years of experience and experience and knowledge?!??? [SEP] the fertility rate of the american population covered by the u. s. government non - census rose to 9. 5, from 9. 7 million years ago, according to the data. [SEP] chelsea manager roberto mandano said: " we took a long time to get to see the best players at the carling cup final and it will be a difficult challenge. [SEP] i don't know if your dad has a golf buddy (or a friend who had an ear cut after the earthquake), so it is common practice that [SEP]
+
+===== sample 046 =====
+[CLS] the west. [SEP] on wednesday the government reported that the government's official unemployment rate had been 9. 3 % in the period three months earlier, up from 7 % in march 2007 and 6. 8 % - 5 % in november. [SEP] what exactly is going on? [SEP] for more information about the company, please contact aig - kahnoho hur - hyet at 202 - 333 - 499. [SEP] these areas tend to grow far more quickly than ever. [SEP] we have a clear plan for this, " said tom collins, former head of transport for aviation and safety protection. [SEP] ms brown, [SEP]
+
+===== sample 047 =====
+[CLS] approach focusing on the long - term care of the long - term population, and focusing on public demand and long - term responsibility for our care, which is in line with population ageing and underservering. [SEP] dr. michael, a principal of psychiatry at marshfield medical school, was elected to in 2008 as head of child psychology at mcelroy johnson college in marshfield, md., and was the subject of a college degree from texas university, rice university medical school and dean of the university of texas - worth's school of medicine. [SEP] the director, peter pilks, runs a wide - ranging [SEP]
+
+===== sample 048 =====
+[CLS] iranian military activity - - but not certainly increasing, especially indeed, the production of long - range weapons - - also stressed the need for a new approach to "stronger and more focused on the global region." [SEP] new york (reuters) - the federal u. s. government plans to buy a government bond and reduce its reserve amount to $2. 75 billion of the federal government debt within 100 days of the default, officials reported. [SEP] ian bushnell, vice president, bac, said management will update its position over the next few months on growth strategies for the business. [SEP] and, in its original way, china [SEP]
+
+===== sample 049 =====
+[CLS] to a normal level of 25 and 70 per cent by 2010. [SEP] moscow said friday it plans to join a breakaway group in europe, which russia insists has no direct control over georgia, with a reference to russia's second breakaway russia region. [SEP] foreign democratic leaders in the 1990s, barrbuing japan from enforcing international law, have long been largely bound by the rule of law. [SEP] campion was released around four days after he was short on his right leg. [SEP] fairey said everyone is aware of the situation. [SEP] the administration refused to give up spending on social programs, a big part of the package. [SEP] in [SEP]
+
+===== sample 050 =====
+[CLS] same store sales volume had dropped 5 percent in the three - quarter. [SEP] the two are believed to retain a 10. 5 % stake in state construction, joint venture with the china trade and finance sector, but said that they could not consider a sale. [SEP] earlier this year, prices fell by 10. 7 % in october compared to august. [SEP] there is a great suspicion that some asian leaders made the move - - that perhaps america is going to take the opportunity of adopting a chinese policy. [SEP] as a teacher, three months later she was separated from her mother, and had the idea of playing football at a local school when [SEP]
+
+===== sample 051 =====
+[CLS] people hoping to make a significant impact with the public eye. [SEP] but michel gorrili, eu environment commissioner, said in a statement last week that there was no concrete sign of any cuts, insisting that the european commission was supportive of china and india and would not rule out any strong commitments to help the global economic crisis. [SEP] french households spend now three times more than other european countries. [SEP] the national league national league mvp winner had recently retired from a 10 - year career in minnesota, with his wife, family and a public relations company partner. [SEP] after the meeting, the high - profile politician went to talk to abc news [SEP]
+
+===== sample 052 =====
+[CLS] said the head of the deputy security chief john h. shannon. [SEP] i spend hours of the night trying to get him to have a talk about getting some kind of sleep, i mean, that's because our family lives there together. [SEP] it's a bad experience, a public shame, "he says. [SEP]" a couple of times a child is required to play outside, " says martin caper, a consultant in the game. [SEP] but he says he must restore the powers of the english game, although he says there is still enough talent under frank halloch and the england team. [SEP] in the event [SEP]
+
+===== sample 053 =====
+[CLS]. [SEP] this congress! [SEP] part of its growth plan, the government will also raise the cost of government borrowing to try to clear its way for real spending. [SEP] aig is sitting on a debt pile of $250, 000 a year in new notes issued after debt default by lehman - - the government's decision to pay its bad debt. [SEP] belichick was speaking in an interview with the associated press shortly after hearing belichick tell the patriots the patriots need to work with randy moss. [SEP] peterborough united boss craig robson admitted that mcghy backed out of his job after agreeing only nine months ago that he is [SEP]
+
+===== sample 054 =====
+[CLS] in their own language, " he said. [SEP] anyone with information about officers should report to the service. [SEP] glendale, ariz., nov, the times said wednesday. [SEP] the president was expected to hold a conference with homeland security secretary robert gates in washington, d. c., and robert m. gates, the u. s. secretary of state there. [SEP] and then, the iranian president seemed to give the country its hand. [SEP] kodi later called for the pro - sarkozy social majority in the country's ruling party. [SEP] he made his first formal overseas call for afghanistan as president of nato, [SEP]
+
+===== sample 055 =====
+[CLS] to raise a child, the capital income of a middle - class earner in england rises to £19, 000 (about £53, 000) over 10 years. [SEP] "it's not to say the decision is coming, but we really want to see what happened to him back in 2003. [SEP]" the way it's going to go up, if he's very strong, it's going to happen, "griffey said. [SEP] they didn't know where he would go, and told them to carry a knife and to kill her. [SEP]" i said that this is what i want [SEP]
+
+===== sample 056 =====
+[CLS] of black voters that are over - committed to this campaign that never identified black or white people, "he said. [SEP] the national league league hockey league's general manager, ken mckay, said wade's decision to retire effective may 2. [SEP] he held numerous foreign policy positions, including bureau posts in north america and east asia. [SEP] don't be surprised that palin is on hand. [SEP] smith: don't call off the show. [SEP] apart from this point, though one would have to say that the market situation is getting worse at this time of year. [SEP]" the government's bid to help save [SEP]
+
+===== sample 057 =====
+[CLS]. [SEP] "we should do more to promote clean energy, create jobs and encourage energy and infrastructure investment," he said. [SEP] do you buy into your green credentials out of the nibbling experience? [SEP] club manager mark brooker said: " i'm very happy about my job with the football association. [SEP] over 500 children are dead. [SEP] the study was released yesterday. [SEP] the meeting is the first papal visit of the year by the pope, a former vice president of the u. s. conference of american - american studies. [SEP] at 4: 45 p. m. [SEP] austin, texas, april 6/pr [SEP]
+
+===== sample 058 =====
+[CLS] of hybrid cars for highway miles in 2008, and the average gas could be around $2 a gallon for next month. [SEP] brown's accounts were available at the time. [SEP] hong zi zhongming, taiwan's ambassador's secretary, suggested that the rates could be higher. [SEP] exports in the last year fell to 10. 9 million dollars down 6. 5 percent from 9. 3 million dollars in june 2007, while the total value of the funds dropped by about 3 percent to $1. 7 billion. [SEP] it's just just two days after the u. s. treasury department released a list of [SEP]
+
+===== sample 059 =====
+[CLS] senate in a race to build a super majority needed to win the election race. [SEP] they're prepared for this season's title game, and we're seeing them be ready, " said mcklin, the miami assistant who joined the program last october. [SEP] it's no shame that the games have few players on the way out that most of the events are too big or too political, and i do think they will be pretty big in the end, even if they want one. [SEP] lylton council chief executive ken armitt said that was a good day for the area. [SEP] tom kite, director [SEP]
+
+===== sample 060 =====
+[CLS], hitting the first three wickets to cover the remaining five overs. [SEP] it was a wonderful turn to watch, and the script for the disney film "enchanted" began to make sense that she was going to continue it. [SEP] a local head of the secret service said that about 20 militants were believed to be working behind the five missile strikes in pakistan during recent hours. [SEP] the senior u. s. officials made the agreement, which was known as kcna news, said china bureau, which is reviewing the case. [SEP] the 62 - year - old man was driving at 85mph on the b4061 manchester road on [SEP]
+
+===== sample 061 =====
+[CLS] john whitson, the u. s. army's space systems specialist. [SEP] you can't wait to get all the publicity. [SEP] but in lhasa, police spokesman robert thompson said he was still not aware of the current level of security. [SEP] "there was lack of anything wrong with them," she said. [SEP] between january 2007 and december 2008, analysts and analysts forecast revenue of $1. 4 billion, although analysts expect a $1. 6 billion - $500 loss, according to average of reuters estimates. [SEP] david walker, who worked for global business development in london at the time, said [SEP]
+
+===== sample 062 =====
+[CLS] years to open up and be able to work with students in all areas, " she said. [SEP] the defense department confirmed reports that u. s. forces had killed at least 16 militants. [SEP] the englishman stands at 4. 5in (6m) tall and muscular, but at 23, he is still 15 years old. [SEP] the work is estimated to cost up to 80 billion euros per year, plus 1, 600 billion euros. [SEP] the u. s. treasury department and the administration, meanwhile, would continue to improve its lending in the housing industry, the president said, the department said. [SEP] many of these are [SEP]
+
+===== sample 063 =====
+[CLS] that needs to be done for the club's leaders to develop their players more quickly. [SEP] yes, it's still true, but is the governing body's best bet for success. [SEP] "the important thing is to see what happens here," government chairman sando morita said. [SEP] come in, run into the air, break with the tide. [SEP] does it mean that we have gone too far. [SEP] long after the mid - 20th - century economies of western russia pared into europe from america, china and russia, and in the sense of all the expanding communist culture since communism came in the 1990s, [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_diffusion_noise_steps_128steps_n64/noise_const1p45_mid_sine_eta0p08_c256_raw_samples.txt

@@ -0,0 +1,230 @@
+noise_const1p45_mid_sine_eta0p08_c256
+{
+  "type": "summary",
+  "name": "noise_const1p45_mid_sine_eta0p08_c256",
+  "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt",
+  "step": 187000,
+  "decode": {
+    "kind": "categorical_fullvocab_diffusion_state_noise",
+    "config": "noise_const1p45_mid_sine_eta0p08_c256",
+    "steps": 128,
+    "temp_start": 1.45,
+    "temp_end": 1.45,
+    "temp_schedule": "const",
+    "t_power": 1.0,
+    "eta0": 0.08,
+    "eta_schedule": "mid_sine",
+    "noise_conc": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 44.612465411027486,
+    "nll_per_token": 3.798013313495776,
+    "tokens": 9352
+  },
+  "diversity": {
+    "sample_entropy": 4.105863199315936,
+    "unique_tokens": 1820,
+    "token_count": 8192,
+    "distinct_1": 0.22216796875,
+    "distinct_2": 0.6919291338582677,
+    "top_token_mass": 0.0728759765625
+  }
+}
+
+===== sample 000 =====
+[CLS] putt on the par hole of the tournament then blasted away with a par putt, but his good turn over the sander nearly took it about 20 feet off the leaders. [SEP] they are also at odds over how to be related to the political crisis, and the impact of china on global economy. [SEP] " i ' ve known strategists several times and it ' s been criticism of u. s. policy, such as the direction of u. s. policy on iran, " bush said. [SEP] russia ' s overall index was 15 u. s. members in 2008, compared with 16 u. s. [SEP]
+
+===== sample 001 =====
+[CLS] everton head assistant tony quin has been linked with succeeding jack mungle as the manager of the premier league club. [SEP] instead they lost his son, john simpson, whom he described as both an alcoholic and his late own father. [SEP] senior officials said obama defended the decision, saying he wanted to take more attacks from the liberal democrats as part of his campaign strategy. [SEP] airon ' s asia travel program includes key destinations in 35 countries and u. s. cities and 23 cities, including international destinations from argentina, brazil, peru, china, france, australia, korea and singapore. through may, visit japan, france, [SEP]
+
+===== sample 002 =====
+[CLS] wouldn ' t know for sure we ' d need a president. [SEP] " i ' m going so hard, i ' ll feel like i was here, " woods told a rally in paris. [SEP] lloyds banking group fell by 2. 5 % over two months, to 25. 84 %. [SEP] don ' t know if this is a football tournament as the three major premier league clubs will not be being played this season. [SEP] " although the squad is strong, it is a very dangerous situation. [SEP] it would raise between 1, 000 billion dollars and 2, 300, 000 dollars annually, with the tax exemption of some [SEP]
+
+===== sample 003 =====
+[CLS] negotiations with south korea, " britain had a lot of north koreas and a lot of south korean entities, " the aso report read. [SEP] meanwhile, the london trade newspaper reported the group ' s biggest reported takeover of german rival de opel comes as the german group focused on selling off its portfolio of investments including the retail, mortgage, property and credit management and construction. [SEP] " i don ' t know is what i would do, " said han tsing, general secretary of japan ' s ruling communist party, after the 2, 000 - strong rally took place sunday. [SEP] analysts said the uk ' s bank said [SEP]
+
+===== sample 004 =====
+.. and that is............................. and that is..... and that is............. and that is.............. and that is,.......... and that is....................................
+
+===== sample 005 =====
+[CLS] tskwea, harare, jan. [SEP] you seem to be sitting on the couch and focusing very well on what each of you can walk to. [SEP] there ' s a few words of good news about the most recent storm. [SEP] among women were three to 3 to 27 - 29 years and men 12 to 16 and 18 to 25 years old. [SEP] more than 20 other south koreans from the hwangg park were expected to move into the country, where the border border is located, hu binge minn, the assistant u. s. spokeswoman, was quoted as saying. [SEP] eu officials said [SEP]
+
+===== sample 006 =====
+[CLS]t, mrs livni ' s chief spokesman for her party ' s election. [SEP] authorities reported monday dozens more suicide attacks in nigeria, trying to fend off renewed pressure on the center of africa ' s big oil industry. [SEP] his son was killed when his vehicle struck a tree in baghdad, killing his father and his bodyguards, officials said. [SEP] i think people in the north of england can have a good relationship with the national government. [SEP] in the first 14 years of service she has often developed into one of the best in football. [SEP] abu dhabi, which was launched under the ownership of mumira gul, the [SEP]
+
+===== sample 007 =====
+[CLS] los angeles. [SEP] david satter, state department spokesman for national security council, disputed this. [SEP] but ahmadinejad ' s letter to journalists and reporters offers only some language - - like " congratulations " - - that appears to have got it out that way. [SEP] the total price for gas will be worth $ 15bn - $ 20bn each, compared to the current budget of 2007. [SEP] the opposition leader has been seen as a source of strength for japan with his long line of focus and pedilection on tax rises and spending policies, but must now find a way to prolong his career down the road. [SEP]
+
+===== sample 008 =====
+[CLS] cost about £15m. [SEP] the development of formal trade ties between the eu and the united states has not been enough for most of europe. [SEP] the group of 19 chinese and south koreas were on a boat trip to northern pyongyang on china ' s east coast, near the capital city of hangzhou, when a coach crashed. [SEP] however, olmert said he can ' t tell how congress will repeal the law even though it isn ' t complete because the president himself has no difficulty with doing it. [SEP] msnbc. com reported that mccain was spending hundreds of thousand - worth of dollars on the campaign [SEP]
+
+===== sample 009 =====
+[CLS] in iowa, iowa, clinton ' s wife - and - in - law worked as a scacting teacher, as a single mother in germany, and then wrote about her ordeal in the next few years. [SEP] but if they were dead, it would not be enough for them to be given the right to negotiate. [SEP] a group of 20 korean men crossed into north korea illegally over the weekend in one of the most dramatic rescues in north korea ' s history. [SEP] " i was really frustrated last year, i couldn ' t get a run over three days, but i thought i would improve when i came back here. [SEP] [SEP]
+
+===== sample 010 =====
+[CLS] at about $ 500, 000, compared with $ 1 million a year in february 2004, it is hardly ever predicted that the national average annual average income will decline. [SEP] when she was last seen in 2006, she was a young girl. [SEP] the losing team has never been to the world series. [SEP] china ' s president - elect, wen wen, could say that his country needs a long - established model of leader to deal with important national social issues. [SEP] sales in january reached $ 7. 4, compared with $ 7. 5 in 2007. [SEP] the 17 - year - old hfw leader said the teenager had [SEP]
+
+===== sample 011 =====
+[CLS] construction of the main high rise rail tunnel built near london will peak at about 650 feet, the company said, probably in 2009. [SEP] sue smalling, author of the book club, says one of the most difficult things to tell. [SEP] ( 11 pm eastern time ) at tuesday ' s briefing in washington, the officials said. [SEP] so far, it has raised more than $ 30 billion. [SEP] don ' t hate chris, boys, talk about... [SEP] many analysts predict the job losses would be no more than double the 1, 000 rate economists had expected, and the national unemployment rate and unemployment insurance reading of 49 [SEP]
+
+===== sample 012 =====
+[CLS] northern gaza on sunday and broke again over a four - hour standoff. [SEP] medvedev said he was expected to make an announcement on gas prices in his address to russia ' s parliament, which moscow says will be ready by december. [SEP] she ' s looking at the possibility of 10 applications this year. [SEP] he also played at texas, where it started 11 - 15 in july 2006..... [SEP] the labour department said the number of new jobless claims had risen to 4, 000, 000 in february - - the highest level since february 2005 and from more than 2, 800 in the first six months of [SEP]
+
+===== sample 013 =====
+[CLS] nouri al - maliki came into office. [SEP] the internet, of course, is full of news briefings. [SEP] " you must get the cubans to go home - - keep fighting - - look like the fighting is over, " and he has pressed the u. s. president on a number of public issues. [SEP] foreign minister sergei lavrov was expected in moscow friday to take part in a european foreign conference in moscow, the russian ria news agency reported. [SEP] he said unemployment, or net unemployment, slipped to 13. 6 million from 12. 2 million, adding the biggest job performance in europe would [SEP]
+
+===== sample 014 =====
+[CLS] 1993 and san diego in 2000. [SEP] in 2005, the prime minister began a series of protests that resulted in thousands of activists trying to form a government being arrested at his father ' s house in the capital. [SEP] but it is clear that there will be a backlash if it is not considered a problem in sex education. [SEP] and this should be put in the hands of all parties, " tembura said. [SEP] i don ' t want a lot of cash. [SEP] " i don ' t think anybody at the club think they ' re right, " he said. [SEP] conservative party director - general sir david macdonald said the [SEP]
+
+===== sample 015 =====
+[CLS] head coach, but he has a plan : by then he will have a team of assistants that don ' t know what he is doing. [SEP] the project includes parts of new york, a large and vibrant new city, historic buildings, wind power and other development that now lead to the city of the city and its influence over bridges, rail routes, airports, transportation and infrastructure. [SEP] speaking at the news conference, bush said some other major countries were watching developments. [SEP] snowdrops flew along the russian - controlled eastern sea mountains area near the border with poland while it was taken over from the erevil mountains. [SEP] the [SEP]
+
+===== sample 016 =====
+[CLS]. [SEP] what makes me... think of john mccain. [SEP] maybe they would ask for more. [SEP] some they might find things interesting in the spring. [SEP] in his earlier appearance, he ' d heard the child ' s voice and said : " let him do this, and let him know, and he ' s asking him to do the same thing. [SEP] london, july 8 ( upi ) - - a european fund, a small bank and a european government bank will provide britain with guarantees of about $ 30 billion in new capital, british officials said. [SEP] speaking at a meeting last year in chicago, the us [SEP]
+
+===== sample 017 =====
+[CLS] took to the conference in 1997. [SEP] it ' s all about not being able to explain the race, because of that, it ' s about me, it ' s not about his identity, it ' s all about his character - - not about making people out of politics - - it ' s not about his mind, his true identity, it ' s about the style and politics of a man who loves his own life going on and what he ' s doing. [SEP] the " rest of your family, " someone who has a personal background, would be a happy choice - - not someone like you, but your friends, [SEP]
+
+===== sample 018 =====
+[CLS] [SEP] mr. mugabe had been winning just over two percent of the presidential vote in south africa, but he has campaigned in south africa. [SEP] let you be clear, all i want you to think... [SEP] the discussions, led by t. s. alcred, the white house deputy under - secretary, appeared to hammer out a comprehensive new policy, in which a new leader was elected at regional level. [SEP] general motors, one of gm ' s biggest customers and the major u. s. automaker gm ' s bankruptcy, has issued broad criticism of its own plans ahead of details of its new car program [SEP]
+
+===== sample 019 =====
+[CLS] a u. s. drug enforcement administration spokeswoman. [SEP] mr johnson said : " i think it is time for people to concede that i should take the time to sit down and make the first decision about my position after next summer. [SEP] the weather is fair and the weather rough. [SEP] i like mr clegegg to take their lives. [SEP] beijing ( ap ) - chinese officials believe the government plans to launch the inter - korean railway, pro - china sources said tuesday, the first step in sino - chinese relations between the government, xinhua news agency. [SEP] she told abc she and gesela [SEP]
+
+===== sample 020 =====
+[CLS] over a week ago. [SEP] " i think i think people are talking [ about it ] the right time, but it is not worth doing that over a period of time, " carles said. [SEP] mr. nickerson, the president of the atomic energy corporation, which heads the oversight committee for the public administration, said he is asking for more money. [SEP] seoul, south korea ( ap ) - south korean leader hyeunn chun, the late north korean founding father and their 18 - year - old son, flew to their car saturday and left the country to end the first three - day state visit to the north [SEP]
+
+===== sample 021 =====
+[CLS] health care for india ' s health care markets. [SEP] the national bank of china, hong kong ' s largest bank, and china life investment group in singapore remain. [SEP] bush said he was speaking saturday after meeting with foreign leaders in japan. [SEP] saudi officials said wednesday that israel would send its ambassador to the united arab emirates to the arab foreign ministry at a news conference later this month, israeli news agency anfaq reported. [SEP] it ' s been good for me. [SEP] the company said it would look to 100, 000 chinese nanos within 10 years for four years. [SEP] it ' s something you ask her about - - [SEP]
+
+===== sample 022 =====
+[CLS] should use the olympics to bring technology to the games, said itf president ron smith. [SEP] i think you could just put me off with something like any other, and maybe i was just frustrated, i was just talking about the top of them. [SEP] 11, a day after the democratic president ' s speech, when he met him in the white house. [SEP] the jeffs left high school, joining his mother, his father. [SEP] mccain, like most republicans, will be cautious. [SEP] he told reporters that it was now time to change his policy, only to give it more details within a year of a launch. [SEP] " [SEP]
+
+===== sample 023 =====
+[CLS] year - old woman from bristol and a 21 - year - old man from birmingham. [SEP] the project was funded by assembly government and educational services aimed at improving local services in wales and increasing economic development. [SEP] president obama declared himself ready to campaign to change president bush ' s administration with the economic policies and policies of the previous administration, without any opposition. [SEP] his career was never ended. [SEP] he said he was still at st george ' s school and he was no longer burdening on the number of lessons to be given by his son. [SEP] but zhou warned that he must agree with government leaders to address global account deficits. [SEP]
+
+===== sample 024 =====
+[CLS] the new year. [SEP] that ' s 7, 000 u. s. a. workers make up 16. 5 percent of of mexico ' s farm income, and nearly three quarters as many people living in the u. s. state department now earn federal subsidies that start at more than $ 500, 000 annually. [SEP] this will include a group of hud experts and experts, and the game commission will investigate and investigate some of the service ' s activities. [SEP] " the failure of al - maliki ' s government and the kurds will only define the government ' s side of the war, " he said. [SEP] but [SEP]
+
+===== sample 025 =====
+[CLS] - for - 17 since last season in arizona, shortly before he missed a game. [SEP] the national statistics office, based on the chartered institute of trade and development, now expects a 9. 7 per cent slump in house prices, compared with a 6. 5 per cent drop in house prices over the previous 12 months. [SEP] it ' s late this night, friday, and it will be almost perfect for each family. [SEP] " there ' s no reason to why, " he said. [SEP] but he acknowledged that the current economic policy was tied to the public money left by the conservatives, and said the chancellor was clear that people [SEP]
+
+===== sample 026 =====
+[CLS] returning from a previous trip to the uk who has been fighting legal independence, said that he would sign up to the talks. [SEP] i have been to the playoffs and i will tell players this season, how to let them go, so, hey, i ' ll be out this season for three weeks and it will be painful. [SEP] i haven ' t had many things going wrong, but how it will change is that i have to try to run this season. [SEP] it ' s important that consumers get to know about ' small business, ' and it ' s a lot to do with all this growth. [SEP] the size of [SEP]
+
+===== sample 027 =====
+[CLS] them eight minutes away their first division victory, would never mind manager james bowden ' s mind. [SEP] recent figures show a huge majority disapprove of the rise of criminal crime among middle - class countries that might be tempted to exaggerate. [SEP] if you have to buy it, you have to set up parking space in each area, and keep the vehicle ' s design with the roof. [SEP] the agency was encouraged by the change, however. [SEP] professor robert kirfwean is a professor at the new york school of health and management. [SEP] the ftc said in a press release that it was investigating whether [SEP]
+
+===== sample 028 =====
+[CLS] ' s first meeting with the president - elect in april 2008 described china ' s pro - growth approach as " a complex model of fiscal sustainableness. " [SEP] but a survey published by the national union of the royal medical college physicians ( ucc ) showed that 53 % of people show " exceptional " working in the public sector. [SEP] he said that the mother ' s father, the son of his brother, father father, father, and mother always had the same choice. [SEP] amr inc., the majority of the company ' s second quarter revenue, rose 4. 2 percent, to nearly $ 1. 5 billion, [SEP]
+
+===== sample 029 =====
+[CLS], and 27 - year - old fiance c. w. johnson. [SEP] more than two dozen experts from china to china will travel the country in an effort to restore the nation ' s level of democracy after agreement was worked out around the clock, officials said monday in beijing. [SEP] i want to get a chance from her playing in the u. s.. [SEP] it also is under pressure to care about the financial aspects of the recession. [SEP] the topic is likely to be how to show mr obama ' s direction and direction as he spoke at a beijing conference earlier this year. [SEP] it ' s not even fair that the truth [SEP]
+
+===== sample 030 =====
+[CLS] conference / news conference with the federal reserve. [SEP] over the two days, former vice president dick cheney has offered some hard - running talk about solving a set of problems. [SEP] the figures show the numbers were higher than average to reach the peak of the h1 peak. [SEP] when mary whitfield had arrived at the 10ft, she heard a small amount of water and her children had run off. [SEP] 11 ( upi ) - - more than 30, 000 teenage children in private reading groups in europe were surveyed monday, u. s. data show. [SEP] " for the next several weeks, it will be clear to [SEP]
+
+===== sample 031 =====
+[CLS]. [SEP] biden said it would be for obama and foreign policy experts to travel to beijing with a joint statement from the two under president bill clinton. [SEP] he predicts that mr johnson will be able to take a leadership position at the election. [SEP] washington - - 13 percent of those surveyed indicated their opposition to the idea. [SEP] on friday morning, a day earlier, north korean deputy foreign minister jangl sung said he was negotiating with north korea not to use seoul ' s waters as its own borderline. [SEP] with britain expecting around 30, 000 net visitors in 2012, forecasts project up to three - year growth for the [SEP]
+
+===== sample 032 =====
+[CLS]ico burress during the pre - season training camp. [SEP] woods has won eight straight playoff games, the last at his final event. [SEP] the american jobless rate was at 3. 7 percent for the year after peaking at 175, 000 in april, when the two - month span was 3. 2 percent, the survey said. [SEP] andy johnson, the un secretary of health health, referred to the swine flu campaign friday during a recent visit to the new york state medical council. [SEP] it ' s hard to call those elections weeks ahead of next year ' s elections in washington. [SEP] he was filmed filming for his film [SEP]
+
+===== sample 033 =====
+[CLS]bernation " - - a story of courageous interventions in the hands of the british government in the days of the democratic and republican administrations of the 1960s. [SEP] for hillary clinton ' s campaign, hillary clinton is expected to announce today she would deliver a speech to the national convention. [SEP] mr cameron told the bbc radio 4 today programme that ministers would be prepared to hold an extension on the number of children 24 hours to five in half an hour. [SEP] british police have helped find the killer of a foreign terrorist in order to create a terror threat. [SEP] however, he has not been asked for a full year in the history of the tour [SEP]
+
+===== sample 034 =====
+[CLS]. and it ' s just a matter of time...................................................................................................... that ' s the fox news network, abc, www, [SEP]
+
+===== sample 035 =====
+[CLS] the u. s. secretary of state ' s office. [SEP] although there is little of david cameron ' s credentials as the eu ' s minister for european affairs, there are many differences to the fact that it is the european union - elected president and the role of the less respected national party leader. [SEP] in a response to ban, the secretary of the u. n. general assembly, ban ki - moon,, also due to travel to tokyo later on wednesday, said they would meet on tuesday next week, including japanese foreign minister yasuo hottini and russia ' s foreign minister, egyptian - president hosni [SEP]
+
+===== sample 036 =====
+[CLS] ask about us : we ' re living in this age as to how we live what we are doing at best, ' " murray said. [SEP] " if i can win, that would be a problem. [SEP] gm has conned that he will take the company private, and observers say they hope it will enhance his effort to focus on quality cars and consumers. [SEP] the company had been holding informal talks with carmaker cerberus to support chrysler llc after talks with german automaker sag on terms that could give the world ' s biggest automaker greater access to market interest in its cars. [SEP] mr smith said his father, [SEP]
+
+===== sample 037 =====
+[CLS] have been big enough for good reason, but surely it is not worth putting much effort into the game in c. r. a. tournaments. [SEP] juriza poh wiyao, his brother and his wife mah tskgi tsa, died in 2004. [SEP] mr doumba, now lecturer at sheffield university, is now due to pursue a full english degree at master ' s. [SEP] martin gullity, of arranva council community transport manager, welcomed the project in the area. [SEP] " i ' ll know if we ' re on the same level, " he said. [SEP] looking at [SEP]
+
+===== sample 038 =====
+[CLS] chance to talk to china about its economic and military ties, however, since the obama administration is wary of china ' s move to improve ties with its allies in asia. [SEP] he said the leaders of the muslim group, including five other muslim women in denmark, had been arrested including the danish woman, the 23 - year - old danish man, and the 19 - year - old man from denmark. [SEP] the same thing that edwards, who scored every goal against liverpool in 1992 when he was 19 at the time, was the only one to make the difference there was no question of what he has to do. [SEP] that will probably [SEP]
+
+===== sample 039 =====
+[CLS] dropped the missile after iran was talking to him. [SEP] they stopped about 4 p. m. thursday near the east river, between rookes road and the molico road bridge. [SEP] it ' s been a good week today, but we will not be able to continue. [SEP] " it ' s still an acceptable option, " said mr. larigan. [SEP] so is god : " there ' s plenty of effort, " robert gibbs said. [SEP] while hawking the latest film, director robert fox ' s " star trek, " which has co - produced 20 of the studio ' s 18 movie series, mr [SEP]
+
+===== sample 040 =====
+[CLS] [SEP] " i wanted to have the money back first, but i always said things like, i ' m just saying it ' s you can ' t do this, so i came out. [SEP] i am very smart, intelligent and balanced and prate. [SEP] he left the farm in january aged just 14. [SEP] " he would not confirm the full name of george j. mitchell, " clinton said, adding he hadn ' t known about the story before, deputy press secretary robert gibbs said. [SEP] delauro ' s success gives the company more scope and space for expansion. [SEP] the post office study found that the rate of [SEP]
+
+===== sample 041 =====
+[CLS] 18 points, and david foster added 16 points and 13 rebounds. [SEP] it is inter ' s third win since mourinho ' s first club start following the defeat at liverpool last month. [SEP] i won ' t know that until he is 30, and after a $ 4, 000 salary rise and the job of a professor at his private school, management, in spring college, pennsylvania, it took his father robert johnson several years to look at what his football team did for him. [SEP] mr todd said that colleagues advised him to be careful and not to leave him at night after his death. [SEP] former secretary - general john [SEP]
+
+===== sample 042 =====
+[CLS] " it doesn ' t take much to know, " he said. [SEP] " i have no idea what he ' s talking about. [SEP] it ' s like he ' s the first host and co - co - host of the late - night - talk " good morning america " show. [SEP] she did not say what would be the most likely course of action. [SEP] this legislation will help to protect the ruling party ' s dominance of parliament and its foreign policy. [SEP] washington - a former senior white house official said thursday night with president barack obama ' s new foreign policy adviser that mr mccain will continue to build closer military ties with [SEP]
+
+===== sample 043 =====
+[CLS] wanted to take a long - term job and seemed loyal to him, not least when he won a major pga play championship at the at & t club last week. [SEP] the officials said they come from the department of national security and health administration, part of the president ' s national emergency management board. [SEP] as usual these days, i ' m sure it is enough to score lots of hits and goals. [SEP] this is an effort that has finally turned a public perception into a reality. [SEP] he ' s now trying to focus on the way he speaks, his father ' s upbringing, and his upbringing. [SEP] the i. t [SEP]
+
+===== sample 044 =====
+[CLS]ble. [SEP] i have worked hard to get points for this, but if you want to wake up to go into the final, it ' s too late to get attention - - often along with a couple of younger players getting to the final ball. [SEP] if the central bank continues with the growth of the big developing economies such as india and china, much of china ' s economy will be wrecked over a period of time. [SEP] dr stocker is the first person in the uk to receive the new post, the first welsh woman to take charge of health care. [SEP] " i think it ' s best for a board to discuss [SEP]
+
+===== sample 045 =====
+[CLS] guys, you ' ve got 2 years of experience and experience and knowledge?!??? [SEP] the fertility rate of the american population covered by the u. s. government non - census rose to 9. 5, from 9. 7 million years ago, according to the data. [SEP] chelsea manager roberto mandano said : " we took a long time to get to see the best players at the carling cup final and it will be a difficult challenge. [SEP] i don ' t know if your dad has a golf buddy ( or a friend who had an ear cut after the earthquake ), so it is common practice that [SEP]
+
+===== sample 046 =====
+[CLS] the west. [SEP] on wednesday the government reported that the government ' s official unemployment rate had been 9. 3 % in the period three months earlier, up from 7 % in march 2007 and 6. 8 % - 5 % in november. [SEP] what exactly is going on? [SEP] for more information about the company, please contact aig - kahnoho hur - hyet at 202 - 333 - 499. [SEP] these areas tend to grow far more quickly than ever. [SEP] we have a clear plan for this, " said tom collins, former head of transport for aviation and safety protection. [SEP] ms brown, [SEP]
+
+===== sample 047 =====
+[CLS] approach focusing on the long - term care of the long - term population, and focusing on public demand and long - term responsibility for our care, which is in line with population ageing and underservering. [SEP] dr. michael, a principal of psychiatry at marshfield medical school, was elected to in 2008 as head of child psychology at mcelroy johnson college in marshfield, md., and was the subject of a college degree from texas university, rice university medical school and dean of the university of texas - worth ' s school of medicine. [SEP] the director, peter pilks, runs a wide - ranging [SEP]
+
+===== sample 048 =====
+[CLS] iranian military activity - - but not certainly increasing, especially indeed, the production of long - range weapons - - also stressed the need for a new approach to " stronger and more focused on the global region. " [SEP] new york ( reuters ) - the federal u. s. government plans to buy a government bond and reduce its reserve amount to $ 2. 75 billion of the federal government debt within 100 days of the default, officials reported. [SEP] ian bushnell, vice president, bac, said management will update its position over the next few months on growth strategies for the business. [SEP] and, in its original way, china [SEP]
+
+===== sample 049 =====
+[CLS] to a normal level of 25 and 70 per cent by 2010. [SEP] moscow said friday it plans to join a breakaway group in europe, which russia insists has no direct control over georgia, with a reference to russia ' s second breakaway russia region. [SEP] foreign democratic leaders in the 1990s, barrbuing japan from enforcing international law, have long been largely bound by the rule of law. [SEP] campion was released around four days after he was short on his right leg. [SEP] fairey said everyone is aware of the situation. [SEP] the administration refused to give up spending on social programs, a big part of the package. [SEP] in [SEP]
+
+===== sample 050 =====
+[CLS] same store sales volume had dropped 5 percent in the three - quarter. [SEP] the two are believed to retain a 10. 5 % stake in state construction, joint venture with the china trade and finance sector, but said that they could not consider a sale. [SEP] earlier this year, prices fell by 10. 7 % in october compared to august. [SEP] there is a great suspicion that some asian leaders made the move - - that perhaps america is going to take the opportunity of adopting a chinese policy. [SEP] as a teacher, three months later she was separated from her mother, and had the idea of playing football at a local school when [SEP]
+
+===== sample 051 =====
+[CLS] people hoping to make a significant impact with the public eye. [SEP] but michel gorrili, eu environment commissioner, said in a statement last week that there was no concrete sign of any cuts, insisting that the european commission was supportive of china and india and would not rule out any strong commitments to help the global economic crisis. [SEP] french households spend now three times more than other european countries. [SEP] the national league national league mvp winner had recently retired from a 10 - year career in minnesota, with his wife, family and a public relations company partner. [SEP] after the meeting, the high - profile politician went to talk to abc news [SEP]
+
+===== sample 052 =====
+[CLS] said the head of the deputy security chief john h. shannon. [SEP] i spend hours of the night trying to get him to have a talk about getting some kind of sleep, i mean, that ' s because our family lives there together. [SEP] it ' s a bad experience, a public shame, " he says. [SEP] " a couple of times a child is required to play outside, " says martin caper, a consultant in the game. [SEP] but he says he must restore the powers of the english game, although he says there is still enough talent under frank halloch and the england team. [SEP] in the event [SEP]
+
+===== sample 053 =====
+[CLS]. [SEP] this congress! [SEP] part of its growth plan, the government will also raise the cost of government borrowing to try to clear its way for real spending. [SEP] aig is sitting on a debt pile of $ 250, 000 a year in new notes issued after debt default by lehman - - the government ' s decision to pay its bad debt. [SEP] belichick was speaking in an interview with the associated press shortly after hearing belichick tell the patriots the patriots need to work with randy moss. [SEP] peterborough united boss craig robson admitted that mcghy backed out of his job after agreeing only nine months ago that he is [SEP]
+
+===== sample 054 =====
+[CLS] in their own language, " he said. [SEP] anyone with information about officers should report to the service. [SEP] glendale, ariz., nov, the times said wednesday. [SEP] the president was expected to hold a conference with homeland security secretary robert gates in washington, d. c., and robert m. gates, the u. s. secretary of state there. [SEP] and then, the iranian president seemed to give the country its hand. [SEP] kodi later called for the pro - sarkozy social majority in the country ' s ruling party. [SEP] he made his first formal overseas call for afghanistan as president of nato, [SEP]
+
+===== sample 055 =====
+[CLS] to raise a child, the capital income of a middle - class earner in england rises to £19, 000 ( about £53, 000 ) over 10 years. [SEP] " it ' s not to say the decision is coming, but we really want to see what happened to him back in 2003. [SEP] " the way it ' s going to go up, if he ' s very strong, it ' s going to happen, " griffey said. [SEP] they didn ' t know where he would go, and told them to carry a knife and to kill her. [SEP] " i said that this is what i want [SEP]
+
+===== sample 056 =====
+[CLS] of black voters that are over - committed to this campaign that never identified black or white people, " he said. [SEP] the national league league hockey league ' s general manager, ken mckay, said wade ' s decision to retire effective may 2. [SEP] he held numerous foreign policy positions, including bureau posts in north america and east asia. [SEP] don ' t be surprised that palin is on hand. [SEP] smith : don ' t call off the show. [SEP] apart from this point, though one would have to say that the market situation is getting worse at this time of year. [SEP] " the government ' s bid to help save [SEP]
+
+===== sample 057 =====
+[CLS]. [SEP] " we should do more to promote clean energy, create jobs and encourage energy and infrastructure investment, " he said. [SEP] do you buy into your green credentials out of the nibbling experience? [SEP] club manager mark brooker said : " i ' m very happy about my job with the football association. [SEP] over 500 children are dead. [SEP] the study was released yesterday. [SEP] the meeting is the first papal visit of the year by the pope, a former vice president of the u. s. conference of american - american studies. [SEP] at 4 : 45 p. m. [SEP] austin, texas, april 6 / pr [SEP]
+
+===== sample 058 =====
+[CLS] of hybrid cars for highway miles in 2008, and the average gas could be around $ 2 a gallon for next month. [SEP] brown ' s accounts were available at the time. [SEP] hong zi zhongming, taiwan ' s ambassador ' s secretary, suggested that the rates could be higher. [SEP] exports in the last year fell to 10. 9 million dollars down 6. 5 percent from 9. 3 million dollars in june 2007, while the total value of the funds dropped by about 3 percent to $ 1. 7 billion. [SEP] it ' s just just two days after the u. s. treasury department released a list of [SEP]
+
+===== sample 059 =====
+[CLS] senate in a race to build a super majority needed to win the election race. [SEP] they ' re prepared for this season ' s title game, and we ' re seeing them be ready, " said mcklin, the miami assistant who joined the program last october. [SEP] it ' s no shame that the games have few players on the way out that most of the events are too big or too political, and i do think they will be pretty big in the end, even if they want one. [SEP] lylton council chief executive ken armitt said that was a good day for the area. [SEP] tom kite, director [SEP]
+
+===== sample 060 =====
+[CLS], hitting the first three wickets to cover the remaining five overs. [SEP] it was a wonderful turn to watch, and the script for the disney film " enchanted " began to make sense that she was going to continue it. [SEP] a local head of the secret service said that about 20 militants were believed to be working behind the five missile strikes in pakistan during recent hours. [SEP] the senior u. s. officials made the agreement, which was known as kcna news, said china bureau, which is reviewing the case. [SEP] the 62 - year - old man was driving at 85mph on the b4061 manchester road on [SEP]
+
+===== sample 061 =====
+[CLS] john whitson, the u. s. army ' s space systems specialist. [SEP] you can ' t wait to get all the publicity. [SEP] but in lhasa, police spokesman robert thompson said he was still not aware of the current level of security. [SEP] " there was lack of anything wrong with them, " she said. [SEP] between january 2007 and december 2008, analysts and analysts forecast revenue of $ 1. 4 billion, although analysts expect a $ 1. 6 billion - $ 500 loss, according to average of reuters estimates. [SEP] david walker, who worked for global business development in london at the time, said [SEP]
+
+===== sample 062 =====
+[CLS] years to open up and be able to work with students in all areas, " she said. [SEP] the defense department confirmed reports that u. s. forces had killed at least 16 militants. [SEP] the englishman stands at 4. 5in ( 6m ) tall and muscular, but at 23, he is still 15 years old. [SEP] the work is estimated to cost up to 80 billion euros per year, plus 1, 600 billion euros. [SEP] the u. s. treasury department and the administration, meanwhile, would continue to improve its lending in the housing industry, the president said, the department said. [SEP] many of these are [SEP]
+
+===== sample 063 =====
+[CLS] that needs to be done for the club ' s leaders to develop their players more quickly. [SEP] yes, it ' s still true, but is the governing body ' s best bet for success. [SEP] " the important thing is to see what happens here, " government chairman sando morita said. [SEP] come in, run into the air, break with the tide. [SEP] does it mean that we have gone too far. [SEP] long after the mid - 20th - century economies of western russia pared into europe from america, china and russia, and in the sense of all the expanding communist culture since communism came in the 1990s, [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_diffusion_noise_steps_128steps_n64/noise_linear2to08_early_cosine_eta0p01_c1024_scored.jsonl

@@ -0,0 +1,65 @@
+{"type": "summary", "name": "noise_linear2to08_early_cosine_eta0p01_c1024", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "noise_linear2to08_early_cosine_eta0p01_c1024", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.01, "eta_schedule": "early_cosine", "noise_conc": 1.0, "concentration_max": 1024.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 46.75827674418147, "nll_per_token": 3.8449912827207826, "tokens": 9455}, "diversity": {"sample_entropy": 4.14898724091752, "unique_tokens": 1836, "token_count": 8192, "distinct_1": 0.22412109375, "distinct_2": 0.6947588582677166, "top_token_mass": 0.05419921875}}
+{"type": "sample", "index": 0, "raw_text": "[CLS] wanted to present the town itself as their personal home. [SEP] and john grubert, head of president obama ' s climate initiative, attended last week ' s meeting of the obama administration ' s biggest gathering to assess how the president will push a deal setting goals for a global agreement to reduce levels of greenhouse gases, among other things. [SEP] the us has several options and wants to work with the chinese people to make sure the chinese understand this issue, clinton said. [SEP] both had high levels of low schoolel, he said. [SEP] the researchers found 35 percent of adults who had no religion, compared with 47 percent of non - [SEP]", "detok_text": "[CLS] wanted to present the town itself as their personal home. [SEP] and john grubert, head of president obama's climate initiative, attended last week's meeting of the obama administration's biggest gathering to assess how the president will push a deal setting goals for a global agreement to reduce levels of greenhouse gases, among other things. [SEP] the us has several options and wants to work with the chinese people to make sure the chinese understand this issue, clinton said. [SEP] both had high levels of low schoolel, he said. [SEP] the researchers found 35 percent of adults who had no religion, compared with 47 percent of non - [SEP]"}
+{"type": "sample", "index": 1, "raw_text": "[CLS] debt would increase to £16, 000bn over the next decade. [SEP] \" i didn ' t like the results. [SEP] if obama wants solutions for the global economy, then maybe he should focus on domestic and foreign - policy policy and on national security. [SEP] this afternoon, the conservatives will have to take a challenge from conservative leader david cameron that said they was prepared to challenge the government ' s record of defence, national security policy during the iraq war. [SEP] i ' ve always been involved with this, so i am still getting rid of myself as a player. [SEP] for more information on iras please visit www. iras [SEP]", "detok_text": "[CLS] debt would increase to £16, 000bn over the next decade. [SEP] \" i didn't like the results. [SEP] if obama wants solutions for the global economy, then maybe he should focus on domestic and foreign - policy policy and on national security. [SEP] this afternoon, the conservatives will have to take a challenge from conservative leader david cameron that said they was prepared to challenge the government's record of defence, national security policy during the iraq war. [SEP] i've always been involved with this, so i am still getting rid of myself as a player. [SEP] for more information on iras please visit www. iras [SEP]"}
+{"type": "sample", "index": 2, "raw_text": "[CLS] tennis ' s greatest final ever, i ' ll just have to say when i ' m married again, and i ' ll feel as if i ' m gone. [SEP] new york ( cnn ) - - a new group pushing on a new century healthcare law to overhaul the nation ' s long - stalled primary education system is needed, officials said monday. [SEP] he just about tied his league record with two passing touchdown passes this season. [SEP] according to us employment official data, the number of new jobs lost in the us manufacturing sector fell 1. 6 per cent to 18, 500. 6, from last year ' s levels, while [SEP]", "detok_text": "[CLS] tennis's greatest final ever, i'll just have to say when i'm married again, and i'll feel as if i'm gone. [SEP] new york (cnn) - - a new group pushing on a new century healthcare law to overhaul the nation's long - stalled primary education system is needed, officials said monday. [SEP] he just about tied his league record with two passing touchdown passes this season. [SEP] according to us employment official data, the number of new jobs lost in the us manufacturing sector fell 1. 6 per cent to 18, 500. 6, from last year's levels, while [SEP]"}
+{"type": "sample", "index": 3, "raw_text": "[CLS] rights groups, who insist the case is a result of illegal immigration, and the impact of his criminal record, are concerned about the impact of illegal trade on eu immigration trade. [SEP] still, that ' s partly why new york will need to capital on its oil and export woes to better address its burden of coping with the global financial crisis, he said. [SEP] but senator karen jackson, president of the new york state assembly, the democratic - controlled banking committee, is expected to vote in the bill. [SEP] within days, he had been able to get his hand and body home. [SEP] in the past few months, hundreds of [SEP]", "detok_text": "[CLS] rights groups, who insist the case is a result of illegal immigration, and the impact of his criminal record, are concerned about the impact of illegal trade on eu immigration trade. [SEP] still, that's partly why new york will need to capital on its oil and export woes to better address its burden of coping with the global financial crisis, he said. [SEP] but senator karen jackson, president of the new york state assembly, the democratic - controlled banking committee, is expected to vote in the bill. [SEP] within days, he had been able to get his hand and body home. [SEP] in the past few months, hundreds of [SEP]"}
+{"type": "sample", "index": 4, "raw_text": "[CLS] the centre area was stopped by police to help residents. [SEP] sofia, austria ( ap ) - a truck carrying about 50 people, several cars and construction vehicles capsized in northwestern hungary on saturday and at least 20 were killed, and three others were injured and two hospitalized, police said. [SEP] since i am an outcast in myself, i am an adorer. [SEP] but to the press and the public, reaping their big hobbies is a good thing. [SEP] 10 ( upi ) - - the house u. s. treasury committee announced wednesday it will provide a $ 25 billion loan to general motors and bank [SEP]", "detok_text": "[CLS] the centre area was stopped by police to help residents. [SEP] sofia, austria (ap) - a truck carrying about 50 people, several cars and construction vehicles capsized in northwestern hungary on saturday and at least 20 were killed, and three others were injured and two hospitalized, police said. [SEP] since i am an outcast in myself, i am an adorer. [SEP] but to the press and the public, reaping their big hobbies is a good thing. [SEP] 10 (upi) - - the house u. s. treasury committee announced wednesday it will provide a $25 billion loan to general motors and bank [SEP]"}
+{"type": "sample", "index": 5, "raw_text": "[CLS] : 30 p. m. [SEP] charlotte, n. c. and north durham, n. c., universities in the washington area and masters in business, d. chicago, harvard university of business and business, and law, harvard law school, and his two masters are in information technology. [SEP] i ' m sure people who want to watch television should make sure that they ' re running out of the air. [SEP] sedgdera, of the united states, told the newspaper in europe the combined deficit is more robust than in the u. s., estimated at around $ 8. 5 billion. [SEP] mcg [SEP]", "detok_text": "[CLS]: 30 p. m. [SEP] charlotte, n. c. and north durham, n. c., universities in the washington area and masters in business, d. chicago, harvard university of business and business, and law, harvard law school, and his two masters are in information technology. [SEP] i'm sure people who want to watch television should make sure that they're running out of the air. [SEP] sedgdera, of the united states, told the newspaper in europe the combined deficit is more robust than in the u. s., estimated at around $8. 5 billion. [SEP] mcg [SEP]"}
+{"type": "sample", "index": 6, "raw_text": "[CLS]. [SEP] \" all those countries look like the global meltdown, \" said william friedman, an professor of monetary policy at the city university of new york and a senior economist in the new york fed ' s central bank department. [SEP] admission 11 - 30 p. m... $ 30, saturday - $ 30pm ; open friday, $ 4 - 5pm ; friday, june 5 - 5, sunday, 11 : 30 a. m. - 5 p. m. ; museum open to open june 7 ; admission, museum galleries, $ 5, 10 - 15, admission $ 5. [SEP] but he is aware that [SEP]", "detok_text": "[CLS]. [SEP] \"all those countries look like the global meltdown,\" said william friedman, an professor of monetary policy at the city university of new york and a senior economist in the new york fed's central bank department. [SEP] admission 11 - 30 p. m... $30, saturday - $30pm; open friday, $4 - 5pm; friday, june 5 - 5, sunday, 11: 30 a. m. - 5 p. m.; museum open to open june 7; admission, museum galleries, $5, 10 - 15, admission $5. [SEP] but he is aware that [SEP]"}
+{"type": "sample", "index": 7, "raw_text": "[CLS] greg goodlin, vince green, and ryan dolpud glennon, nick bilin. [SEP] the french and french government has put a £130m investment plan for a high - speed development with a state - run rail railway. [SEP] the program ' s core core goal is to get kids into more young, and more students, kids old enough to give them kids with more opportunity to reload, but who can listen to their education and lives and those people with a professional career, especially those with great reach and education, not just of their age and gender, need college, regardless of their background, the ability to study [SEP]", "detok_text": "[CLS] greg goodlin, vince green, and ryan dolpud glennon, nick bilin. [SEP] the french and french government has put a £130m investment plan for a high - speed development with a state - run rail railway. [SEP] the program's core core goal is to get kids into more young, and more students, kids old enough to give them kids with more opportunity to reload, but who can listen to their education and lives and those people with a professional career, especially those with great reach and education, not just of their age and gender, need college, regardless of their background, the ability to study [SEP]"}
+{"type": "sample", "index": 8, "raw_text": "[CLS] the rangers ' three - game playoff streak to game 1 with the philadelphia phillies. [SEP] in japan, prime minister yaoruu kyi reiterated that his country would reverg the status of two sides in an effort to preserve the status of the peninsula. [SEP] he is no champion of his country ' s democratic prosperity. [SEP] the 28 - year - old man, described as \" fat and stocky, \" had short black hair, and greys, but christopher gar, the boy, was reluctant to head away. [SEP] she had come to the high school early. [SEP] but liberal democrat information secretary ian blackmore said [SEP]", "detok_text": "[CLS] the rangers' three - game playoff streak to game 1 with the philadelphia phillies. [SEP] in japan, prime minister yaoruu kyi reiterated that his country would reverg the status of two sides in an effort to preserve the status of the peninsula. [SEP] he is no champion of his country's democratic prosperity. [SEP] the 28 - year - old man, described as \"fat and stocky,\" had short black hair, and greys, but christopher gar, the boy, was reluctant to head away. [SEP] she had come to the high school early. [SEP] but liberal democrat information secretary ian blackmore said [SEP]"}
+{"type": "sample", "index": 9, "raw_text": "[CLS] i would not afford losing him. [SEP] a police department official said wednesday the woman appears to be the victim of a slaying robbery. [SEP] the attack is part of a series of security attacks targeting the region. [SEP] mr kokoity said there was no final decision on the site and was willing to consult with europe on the nuclear work. [SEP] that iraq this year is just winding up the road. [SEP] \" we understand the importance of art, by taking an insight into the lives of men and people who have no idea what is happening in our country, \" mr. kaffo said. [SEP] stagg suggested the [SEP]", "detok_text": "[CLS] i would not afford losing him. [SEP] a police department official said wednesday the woman appears to be the victim of a slaying robbery. [SEP] the attack is part of a series of security attacks targeting the region. [SEP] mr kokoity said there was no final decision on the site and was willing to consult with europe on the nuclear work. [SEP] that iraq this year is just winding up the road. [SEP] \"we understand the importance of art, by taking an insight into the lives of men and people who have no idea what is happening in our country,\" mr. kaffo said. [SEP] stagg suggested the [SEP]"}
+{"type": "sample", "index": 10, "raw_text": "[CLS] if you get stuck with cars, you just don ' t want to go down the road. [SEP] and yes, i am sure, i would like to hear someone about what happened, but do want to know now that it ' s almost nothing like this history. [SEP] \" people just think they ' re just too tight - they ' ve hit the way it doesn ' t come out and come out and it slows, then they would sit and hit it, \" he said. [SEP] this may be the only way i tried, but they did not help. [SEP] this is rare. [SEP] i did have to want to go [SEP]", "detok_text": "[CLS] if you get stuck with cars, you just don't want to go down the road. [SEP] and yes, i am sure, i would like to hear someone about what happened, but do want to know now that it's almost nothing like this history. [SEP] \"people just think they're just too tight - they've hit the way it doesn't come out and come out and it slows, then they would sit and hit it,\" he said. [SEP] this may be the only way i tried, but they did not help. [SEP] this is rare. [SEP] i did have to want to go [SEP]"}
+{"type": "sample", "index": 11, "raw_text": "[CLS] yorkshire police said mr cling was injured near his school ' s pub in leeds on monday. [SEP] last night, the colts fell on brady and the patriots. [SEP] \" that ' s probably the biggest playing golfing championship anybody has played, one of the biggest games we have ever seen nearly 35 years ago, \" said nick dean, the director of national operations, said, \" but i want to open it up just to be with it, but do i think you have something to do outside a club where this is close to being one team at the top level. [SEP] authorities also say the pair of sheen ' s cars, [SEP]", "detok_text": "[CLS] yorkshire police said mr cling was injured near his school's pub in leeds on monday. [SEP] last night, the colts fell on brady and the patriots. [SEP] \"that's probably the biggest playing golfing championship anybody has played, one of the biggest games we have ever seen nearly 35 years ago,\" said nick dean, the director of national operations, said, \" but i want to open it up just to be with it, but do i think you have something to do outside a club where this is close to being one team at the top level. [SEP] authorities also say the pair of sheen's cars, [SEP]"}
+{"type": "sample", "index": 12, "raw_text": "[CLS] the bushy, optimistic attitude of their leaders, and their willingness to make good policy by communicating with the white government through diplomacy rather than in contact with other people. [SEP] he will confess that he has never seen this havagate through its pages. [SEP] it ' s the fourth detonation on the housing market since then. [SEP] senate leaders have appeared to be sticking to president obama ' s version, stress the lack of flexibility on the jobs bill. [SEP] call 1 708 - 244 - 5900 or at 1 - 679 - 6077, and visit its website at www. semedia. com. [SEP] the [SEP]", "detok_text": "[CLS] the bushy, optimistic attitude of their leaders, and their willingness to make good policy by communicating with the white government through diplomacy rather than in contact with other people. [SEP] he will confess that he has never seen this havagate through its pages. [SEP] it's the fourth detonation on the housing market since then. [SEP] senate leaders have appeared to be sticking to president obama's version, stress the lack of flexibility on the jobs bill. [SEP] call 1 708 - 244 - 5900 or at 1 - 679 - 6077, and visit its website at www. semedia. com. [SEP] the [SEP]"}
+{"type": "sample", "index": 13, "raw_text": "[CLS] 30 - minute conference and give the radio address. [SEP] more than a dozen rebel leaders died. [SEP] under the offensive, the militants have killed 1, 000 fighters and captured 800, the military said saturday. [SEP] indian diplomats said india and china would also move on on common commitments to china ' s nuclear development. [SEP] senior foreign minister yang yong - frei said in a news statement that the pentagon had asked the military mission to investigate north korea, and said mark johnum, the australian secretary of state, urged the north to show its desire to return to the korean peninsula monday. [SEP] members of the u. s. assistance group [SEP]", "detok_text": "[CLS] 30 - minute conference and give the radio address. [SEP] more than a dozen rebel leaders died. [SEP] under the offensive, the militants have killed 1, 000 fighters and captured 800, the military said saturday. [SEP] indian diplomats said india and china would also move on on common commitments to china's nuclear development. [SEP] senior foreign minister yang yong - frei said in a news statement that the pentagon had asked the military mission to investigate north korea, and said mark johnum, the australian secretary of state, urged the north to show its desire to return to the korean peninsula monday. [SEP] members of the u. s. assistance group [SEP]"}
+{"type": "sample", "index": 14, "raw_text": "[CLS] australian open champion luke watson at the time and philly urged his players not to keep out about winning at the masters at augusta next week. [SEP] imasphere, the media research group, predicts net sales of more than 25 million phones worldwide in 2009. [SEP] while soon after agreeing to say she had been drinking with her boss, mr. coon has now embraced the counterrelibourse of her wealth and self - confidence. [SEP] the average price for a new contract in crude oil was said to be worth $ 1. 07 to a record of $ 1. 563. [SEP] kevin adams, the director of [SEP]", "detok_text": "[CLS] australian open champion luke watson at the time and philly urged his players not to keep out about winning at the masters at augusta next week. [SEP] imasphere, the media research group, predicts net sales of more than 25 million phones worldwide in 2009. [SEP] while soon after agreeing to say she had been drinking with her boss, mr. coon has now embraced the counterrelibourse of her wealth and self - confidence. [SEP] the average price for a new contract in crude oil was said to be worth $1. 07 to a record of $1. 563. [SEP] kevin adams, the director of [SEP]"}
+{"type": "sample", "index": 15, "raw_text": "[CLS] say it ' s about more democracy, civic development, sport and hope. [SEP] they people just want to be more involved ; they just want to make it that they are a good person. [SEP] foreign minister gavin news agency said deputy foreign minister robert hu said he was likely to return to the office as well as a government spokesman. [SEP] we are not going to try it, \" axelberg said. [SEP] he said there was no indication that the country would be able to do it. [SEP] the un said the conference was designed to convince rwandan government forces to take against the rwandan hutu rebels, which left about 800 civilians [SEP]", "detok_text": "[CLS] say it's about more democracy, civic development, sport and hope. [SEP] they people just want to be more involved; they just want to make it that they are a good person. [SEP] foreign minister gavin news agency said deputy foreign minister robert hu said he was likely to return to the office as well as a government spokesman. [SEP] we are not going to try it, \" axelberg said. [SEP] he said there was no indication that the country would be able to do it. [SEP] the un said the conference was designed to convince rwandan government forces to take against the rwandan hutu rebels, which left about 800 civilians [SEP]"}
+{"type": "sample", "index": 16, "raw_text": "[CLS] to help and encourage them to come home with their families. [SEP] the trade deficit would be about $ 12. 3 billion, more than 16 percent below last year ' s 16. 4 billion estimate of $ 1. 087 billion. [SEP] the australian dollar fell 0. 7 per cent to y99 and the japanese won fell 0. 2 cent to $ 1. 36 ( y87 ) against the yen, losing 2. 6 per cent to 630bp. [SEP] astana ' s chief of brand development gareth grogan, though, insisted that the team ' s team would not \" use excuses. \" [SEP] he [SEP]", "detok_text": "[CLS] to help and encourage them to come home with their families. [SEP] the trade deficit would be about $12. 3 billion, more than 16 percent below last year's 16. 4 billion estimate of $1. 087 billion. [SEP] the australian dollar fell 0. 7 per cent to y99 and the japanese won fell 0. 2 cent to $1. 36 (y87) against the yen, losing 2. 6 per cent to 630bp. [SEP] astana's chief of brand development gareth grogan, though, insisted that the team's team would not \"use excuses.\" [SEP] he [SEP]"}
+{"type": "sample", "index": 17, "raw_text": "[CLS] talked about the war in iraq. [SEP] \" peter ' s head is now off us, the fact is this guy ' s really catching up with me, he ' s tall, he ' s not funny, he ' s impatient - - he ' s not just fun - - and he ' s cool, his lack of talent, and his size. [SEP] small children are a lot too young to think about their careers, not just how old they ' re. [SEP] posted by janja. co. uk feb 12 : 20 - 35pm : from 8 : 00 am - 10 : 00 p. m., 2009, [SEP]", "detok_text": "[CLS] talked about the war in iraq. [SEP] \" peter's head is now off us, the fact is this guy's really catching up with me, he's tall, he's not funny, he's impatient - - he's not just fun - - and he's cool, his lack of talent, and his size. [SEP] small children are a lot too young to think about their careers, not just how old they're. [SEP] posted by janja. co. uk feb 12: 20 - 35pm: from 8: 00 am - 10: 00 p. m., 2009, [SEP]"}
+{"type": "sample", "index": 18, "raw_text": "[CLS] korean peopleʼs health, \" said kim soonon, 32, a professor of public health at the naval medical center in south korea. [SEP] this will not be a tough and difficult task for harry redknapp, the tottenham manager. [SEP] the united states forward wants to sign beckham because he has already signed a 12 - year contract extension. [SEP] a former prime minister at the age of 15, he came to office in 1977 with hope of reviving the crisis and forging a new process for the nation. [SEP] japan, however, has earned widespread marks with its own philosophy of democracy and prosperity. [SEP] the program [SEP]", "detok_text": "[CLS] korean peopleʼs health, \" said kim soonon, 32, a professor of public health at the naval medical center in south korea. [SEP] this will not be a tough and difficult task for harry redknapp, the tottenham manager. [SEP] the united states forward wants to sign beckham because he has already signed a 12 - year contract extension. [SEP] a former prime minister at the age of 15, he came to office in 1977 with hope of reviving the crisis and forging a new process for the nation. [SEP] japan, however, has earned widespread marks with its own philosophy of democracy and prosperity. [SEP] the program [SEP]"}
+{"type": "sample", "index": 19, "raw_text": "[CLS] players who took the greatest amount of time, streep added. [SEP] \" they ' re trying to find out just what happens to be in this 2012 midterm, then everyone is watching the one of the biggest contests.... [SEP] \" the government needs to keep its mind, \" said michael collins, the president ' s national budget spokesman. [SEP] beijing ( reuters ) - chinese tourists and chinese officials planned to join a parade in the beijing internationalo olympic hotel where the event is expected to be largely peaceful on saturday. [SEP] some people in the french government say that the company has lent billions of dollars to foreign companies [SEP]", "detok_text": "[CLS] players who took the greatest amount of time, streep added. [SEP] \"they're trying to find out just what happens to be in this 2012 midterm, then everyone is watching the one of the biggest contests.... [SEP]\" the government needs to keep its mind, \" said michael collins, the president's national budget spokesman. [SEP] beijing (reuters) - chinese tourists and chinese officials planned to join a parade in the beijing internationalo olympic hotel where the event is expected to be largely peaceful on saturday. [SEP] some people in the french government say that the company has lent billions of dollars to foreign companies [SEP]"}
+{"type": "sample", "index": 20, "raw_text": "[CLS] health, education and sport. \" [SEP] the other members include the leader of the committee of the conservatives, george osborne, who has announced a proposal to give members of a new public private sector access to green and resources departments, including the department of development and energy, to support uk economic growth. [SEP] the public administration, the north wales and wales rail district, is being integrated into the wider north north system. [SEP] as of friday, police had said it was unable to help access to the 18 - year - old and 13 - year - old girl. [SEP] the way to do is to bring serious and serious dimension to the political [SEP]", "detok_text": "[CLS] health, education and sport. \" [SEP] the other members include the leader of the committee of the conservatives, george osborne, who has announced a proposal to give members of a new public private sector access to green and resources departments, including the department of development and energy, to support uk economic growth. [SEP] the public administration, the north wales and wales rail district, is being integrated into the wider north north system. [SEP] as of friday, police had said it was unable to help access to the 18 - year - old and 13 - year - old girl. [SEP] the way to do is to bring serious and serious dimension to the political [SEP]"}
+{"type": "sample", "index": 21, "raw_text": "[CLS] scene in the spring of 2008. [SEP] the white house is pleased at the announcement, but don ' t say whether it ' s using any legislative means to pass the legislation. [SEP] that would be effective by thursday, airline officials said. [SEP] \" he ' s the best - known senior coach there, so i am very pleased with it, i don ' t think anything is right in the way of doing it back to coach, \" hartl said, according to the team ' s opening statement. [SEP] to help children into the public education system, sir paul also urged his children to promote pluralism and re - education - - [SEP]", "detok_text": "[CLS] scene in the spring of 2008. [SEP] the white house is pleased at the announcement, but don't say whether it's using any legislative means to pass the legislation. [SEP] that would be effective by thursday, airline officials said. [SEP] \"he's the best - known senior coach there, so i am very pleased with it, i don't think anything is right in the way of doing it back to coach,\" hartl said, according to the team's opening statement. [SEP] to help children into the public education system, sir paul also urged his children to promote pluralism and re - education - - [SEP]"}
+{"type": "sample", "index": 22, "raw_text": "[CLS] loss of almost £148 million. [SEP] the committee leaders have responded, but they have not spent much money on it in the summer. [SEP] new exports for china, with the annual import rate of 0. 8 percent higher year - on - year, the commerce department said friday, were 1. 1 percent higher than a year earlier, it said. [SEP] many people in the region are losing their jobs, including people who were on holiday on monday. [SEP] \" i do like that. [SEP] he gave a laugh at the financial chaos in which he said he could rule out responcing after the talk of a \" global crunch \" [SEP]", "detok_text": "[CLS] loss of almost £148 million. [SEP] the committee leaders have responded, but they have not spent much money on it in the summer. [SEP] new exports for china, with the annual import rate of 0. 8 percent higher year - on - year, the commerce department said friday, were 1. 1 percent higher than a year earlier, it said. [SEP] many people in the region are losing their jobs, including people who were on holiday on monday. [SEP] \"i do like that. [SEP] he gave a laugh at the financial chaos in which he said he could rule out responcing after the talk of a\" global crunch \" [SEP]"}
+{"type": "sample", "index": 23, "raw_text": "[CLS] year - old 14 - year - old 15 - year - old girl have been charged with assault. [SEP] the national budget office borrowing plans are expected to be rushed through last week with the government borrowing worth about 25 per cent of total state income to the private sector, 10 per cent to private health and pensions. [SEP] however, mr brown says the spending is not announced before the start date. [SEP] the chinese leader also said that ma ' s policies on taiwan are based on the president ' s complaints about his toughness with the u. s. and he wants a six - way policy that will show greater relations with the chinese government [SEP]", "detok_text": "[CLS] year - old 14 - year - old 15 - year - old girl have been charged with assault. [SEP] the national budget office borrowing plans are expected to be rushed through last week with the government borrowing worth about 25 per cent of total state income to the private sector, 10 per cent to private health and pensions. [SEP] however, mr brown says the spending is not announced before the start date. [SEP] the chinese leader also said that ma's policies on taiwan are based on the president's complaints about his toughness with the u. s. and he wants a six - way policy that will show greater relations with the chinese government [SEP]"}
+{"type": "sample", "index": 24, "raw_text": "[CLS] champion russian elena dementieva and tamarine vozolki. [SEP] ed albright, hillary clinton ' s father and senior senior adviser to the clinton national security administration. and carl icahn, chairman of the us national security asia policy and now hillary clinton national chairman for u. s. for international national policy. progress on foreign and international affairs, \" said jay forde, md, director of communications at the national institute of policy and engagement, to ensure that foreign leaders will spend their time on a pragmatic approach. [SEP] it will be too much to do with the law. [SEP] but this day [SEP]", "detok_text": "[CLS] champion russian elena dementieva and tamarine vozolki. [SEP] ed albright, hillary clinton's father and senior senior adviser to the clinton national security administration. and carl icahn, chairman of the us national security asia policy and now hillary clinton national chairman for u. s. for international national policy. progress on foreign and international affairs, \" said jay forde, md, director of communications at the national institute of policy and engagement, to ensure that foreign leaders will spend their time on a pragmatic approach. [SEP] it will be too much to do with the law. [SEP] but this day [SEP]"}
+{"type": "sample", "index": 25, "raw_text": "[CLS] on the southern coast of the saltwater region and the rest of the island. [SEP] unlike osborne, he is expected to demand greater tax cuts and greater post - economic growth and outline a plan to keep the uk falling out of the system while clamping their jobs. [SEP] but mr. mccain, who had always sought to match his ties to senator kennedy ' s family, described mr. obama ' s status as a point of contention during the debate of the campaign. [SEP] still, half of those interviewed that said clinton - - 14 percent of whom voted, compared to 2 percent - - said she rejected mccain ' s claim that [SEP]", "detok_text": "[CLS] on the southern coast of the saltwater region and the rest of the island. [SEP] unlike osborne, he is expected to demand greater tax cuts and greater post - economic growth and outline a plan to keep the uk falling out of the system while clamping their jobs. [SEP] but mr. mccain, who had always sought to match his ties to senator kennedy's family, described mr. obama's status as a point of contention during the debate of the campaign. [SEP] still, half of those interviewed that said clinton - - 14 percent of whom voted, compared to 2 percent - - said she rejected mccain's claim that [SEP]"}
+{"type": "sample", "index": 26, "raw_text": "[CLS] wedding party in london in 1992. [SEP] his comments followed a senior russian foreign minister as he urged moscow to ratify independence with georgia and prevent the use of russian support - a sign that georgia was open to a confrontation with russia. [SEP] but the governing party might tell you, but you don ' t mind the money. [SEP] school funding, children, local education. [SEP] now, that criticism seems certain to be welcomed by the tories - - a clear sign that britain is willing to take the lead with the rest of the world - - perhaps most of all because it is up to britain what britain does most. [SEP] she said [SEP]", "detok_text": "[CLS] wedding party in london in 1992. [SEP] his comments followed a senior russian foreign minister as he urged moscow to ratify independence with georgia and prevent the use of russian support - a sign that georgia was open to a confrontation with russia. [SEP] but the governing party might tell you, but you don't mind the money. [SEP] school funding, children, local education. [SEP] now, that criticism seems certain to be welcomed by the tories - - a clear sign that britain is willing to take the lead with the rest of the world - - perhaps most of all because it is up to britain what britain does most. [SEP] she said [SEP]"}
+{"type": "sample", "index": 27, "raw_text": "[CLS] chungteng, the national disaster management department said. [SEP] \" i feel like my dream has gone, \" said the former england captain. [SEP] a specialist in the national tennis side, robson was one of the pioneers of tennis at the club during the early end of the 1990s. [SEP] you can go to a school to do this, so that can really give young people something for themselves. [SEP] \" people like to call it a necessity, a matter of urgency, \" he said. [SEP] the american association of neurogeon said in a statement. [SEP] associated sports writer robert jackson contributed to this report. [SEP] what is going [SEP]", "detok_text": "[CLS] chungteng, the national disaster management department said. [SEP] \"i feel like my dream has gone,\" said the former england captain. [SEP] a specialist in the national tennis side, robson was one of the pioneers of tennis at the club during the early end of the 1990s. [SEP] you can go to a school to do this, so that can really give young people something for themselves. [SEP] \"people like to call it a necessity, a matter of urgency,\" he said. [SEP] the american association of neurogeon said in a statement. [SEP] associated sports writer robert jackson contributed to this report. [SEP] what is going [SEP]"}
+{"type": "sample", "index": 28, "raw_text": "[CLS] the state of india. [SEP] \" i am an extremely strong supporter of hoegg. [SEP] strasbourg, france, april 7 ( upi ) - - france ' s independent internal security agency says it has recently arrested a group of french drug trafficking gang members working as a security force in the french alps. [SEP] the suggestion is that the shadow chancellor may have made the same mistakes that cameron might have had to make in cleaning up britain ' s financial sector more than seven years ago. [SEP] \" one of the major problems is not money, \" he added. [SEP] christian kaddegg, the interim president, said the lack of [SEP]", "detok_text": "[CLS] the state of india. [SEP] \"i am an extremely strong supporter of hoegg. [SEP] strasbourg, france, april 7 (upi) - - france's independent internal security agency says it has recently arrested a group of french drug trafficking gang members working as a security force in the french alps. [SEP] the suggestion is that the shadow chancellor may have made the same mistakes that cameron might have had to make in cleaning up britain's financial sector more than seven years ago. [SEP]\" one of the major problems is not money, \" he added. [SEP] christian kaddegg, the interim president, said the lack of [SEP]"}
+{"type": "sample", "index": 29, "raw_text": "[CLS] t give his age. [SEP] the green party is still trying to make that point. [SEP] you don ' t need to be hufted at $ 20, 000 or 30, 000 to $ 30, 000.................................................................................... [SEP]", "detok_text": "[CLS] t give his age. [SEP] the green party is still trying to make that point. [SEP] you don't need to be hufted at $20, 000 or 30, 000 to $30, 000.................................................................................... [SEP]"}
+{"type": "sample", "index": 30, "raw_text": "[CLS] that lasted just 10 minutes. [SEP] john terry, england ' s captain, on sunday defended his handling of the death penalty that the england football football player had managed to simply give his name to his mother and show him his place. [SEP] \" that is great. [SEP] despite its opposition, germany ' s defense ministry has so far refused to discuss the missile plans, while senior israeli military officials said germany has ruled out any effort to restart its nuclear program, the newspaper said. [SEP] dr peter evans, phd, professor of psychology at the university of law school, oxford, said : \" in all groups of children ' s, one is [SEP]", "detok_text": "[CLS] that lasted just 10 minutes. [SEP] john terry, england's captain, on sunday defended his handling of the death penalty that the england football football player had managed to simply give his name to his mother and show him his place. [SEP] \"that is great. [SEP] despite its opposition, germany's defense ministry has so far refused to discuss the missile plans, while senior israeli military officials said germany has ruled out any effort to restart its nuclear program, the newspaper said. [SEP] dr peter evans, phd, professor of psychology at the university of law school, oxford, said:\" in all groups of children's, one is [SEP]"}
+{"type": "sample", "index": 31, "raw_text": "[CLS] the second. [SEP] we need to get over the crumb line all the way, \" england ' s brian ashton said. [SEP] \" i ' m sure there ' s going to be a need for an open debate, but i think this will increase international pressure, \" said dan sone, senior vice president at national oil company petrobras. [SEP] david finchley, the bbc senior sports strategist and virgin ' s chief executive, described the new venture as a positive return to football and the dominance of the national league, britain ' s favourite sports channel. [SEP] the move would be known as the 5 billion dollar [SEP]", "detok_text": "[CLS] the second. [SEP] we need to get over the crumb line all the way, \"england's brian ashton said. [SEP]\" i'm sure there's going to be a need for an open debate, but i think this will increase international pressure, \" said dan sone, senior vice president at national oil company petrobras. [SEP] david finchley, the bbc senior sports strategist and virgin's chief executive, described the new venture as a positive return to football and the dominance of the national league, britain's favourite sports channel. [SEP] the move would be known as the 5 billion dollar [SEP]"}
+{"type": "sample", "index": 32, "raw_text": "[CLS] the democrats and the american political arena. [SEP] the organizers said the first meeting took five hours to resolve the issue. [SEP] those who now say the job market has fallen by almost three per cent from march last year, five times the better - than - average average for the three months to july 2007, the summary of the survey said. [SEP] it was a matter of timing : so much uncertainty, to the extent that the greek government had hoovered up with everything in two days. [SEP] \" i ' d just like to deprive a little bit of the hype, but now that i ' m already there for this, [SEP]", "detok_text": "[CLS] the democrats and the american political arena. [SEP] the organizers said the first meeting took five hours to resolve the issue. [SEP] those who now say the job market has fallen by almost three per cent from march last year, five times the better - than - average average for the three months to july 2007, the summary of the survey said. [SEP] it was a matter of timing: so much uncertainty, to the extent that the greek government had hoovered up with everything in two days. [SEP] \" i'd just like to deprive a little bit of the hype, but now that i'm already there for this, [SEP]"}
+{"type": "sample", "index": 33, "raw_text": "[CLS] would like to be in the college of high school at the end of the year, in the area of the basic business degree or a ger degree, more than half of all school students have degrees in english business at cambridge. [SEP] after eight years of campaigning, obama now has a net approval rating of just under 8 %, against 27 % for hillary clinton, and barack obama ' s 18 % for john mccain. [SEP] he must explain what seems to be missing, however, the \" intelligence that you ought to display. \" [SEP] i appeared to emphasise that the urgent need for a fundamental change in the rules of the lending [SEP]", "detok_text": "[CLS] would like to be in the college of high school at the end of the year, in the area of the basic business degree or a ger degree, more than half of all school students have degrees in english business at cambridge. [SEP] after eight years of campaigning, obama now has a net approval rating of just under 8 %, against 27 % for hillary clinton, and barack obama's 18 % for john mccain. [SEP] he must explain what seems to be missing, however, the \"intelligence that you ought to display.\" [SEP] i appeared to emphasise that the urgent need for a fundamental change in the rules of the lending [SEP]"}
+{"type": "sample", "index": 34, "raw_text": "[CLS] [SEP] \" we want to know how much of the damage. [SEP] the south wales government has lifted the price of a c $ 2m ( $ 35m ; £3m ) programme for japan to spend ( £1. 6m ) on the introduction of the i. a. p. station. [SEP] his comments came after u. s. intelligence agencies dropped a report that u. s. secretary of state hillary clinton had warned of a iran nuclear test. [SEP] mr karzai ' s deputy spokesman, ahai walda, deputy foreign minister of the afghan president ' s national democratic change party, had agreed to call the election [SEP]", "detok_text": "[CLS] [SEP] \" we want to know how much of the damage. [SEP] the south wales government has lifted the price of a c $2m ($35m; £3m) programme for japan to spend (£1. 6m) on the introduction of the i. a. p. station. [SEP] his comments came after u. s. intelligence agencies dropped a report that u. s. secretary of state hillary clinton had warned of a iran nuclear test. [SEP] mr karzai's deputy spokesman, ahai walda, deputy foreign minister of the afghan president's national democratic change party, had agreed to call the election [SEP]"}
+{"type": "sample", "index": 35, "raw_text": "[CLS] the atlantic. [SEP] it ' s going to go down to playing a level level where you can need a lot of training. [SEP] if they get into this situation, there are no guarantees. [SEP] denver, colorado - - indicted former s. rep. david toddler, his wife and five people were arrested in denver early on tuesday, authorities said. [SEP] u. s. officials also said china ' s military spending would be about $ 1, 800 - - considerably more than the amount of military air force the country needs. [SEP] the air was filled with military precision and debris - clogged roads closed into a remote area of [SEP]", "detok_text": "[CLS] the atlantic. [SEP] it's going to go down to playing a level level where you can need a lot of training. [SEP] if they get into this situation, there are no guarantees. [SEP] denver, colorado - - indicted former s. rep. david toddler, his wife and five people were arrested in denver early on tuesday, authorities said. [SEP] u. s. officials also said china's military spending would be about $1, 800 - - considerably more than the amount of military air force the country needs. [SEP] the air was filled with military precision and debris - clogged roads closed into a remote area of [SEP]"}
+{"type": "sample", "index": 36, "raw_text": "[CLS] energy independence this year. [SEP] on tuesday, the museum will be in the museo carnifarza, the national gallery in new york. [SEP] but as a mets fan, that ' s a problem. [SEP] anthony quinn, 19, said he hoped he would be home on saturday, the day he will be able to live. [SEP] it all appears to happen as the company changes its position, increasing its debt repayment to gm and leaving chrysler as the chief holding company under boss jim ballmer, who would run the world ' s biggest automaker today, as an expert in electric cars. [SEP] hakim said he was arrested [SEP]", "detok_text": "[CLS] energy independence this year. [SEP] on tuesday, the museum will be in the museo carnifarza, the national gallery in new york. [SEP] but as a mets fan, that's a problem. [SEP] anthony quinn, 19, said he hoped he would be home on saturday, the day he will be able to live. [SEP] it all appears to happen as the company changes its position, increasing its debt repayment to gm and leaving chrysler as the chief holding company under boss jim ballmer, who would run the world's biggest automaker today, as an expert in electric cars. [SEP] hakim said he was arrested [SEP]"}
+{"type": "sample", "index": 37, "raw_text": "[CLS] place for the entire church, \" the church ' s president said. [SEP] the report also faults the uk government ' s handling of child sexual abuse and its lack of its attention to sexual abuse, such as child sexual exploitation, domestic violence abuse, school care, education and education. [SEP] mr. museveni is originally from the north - western country ' s western province, which leaders say includes political representatives from the opposition, along with two ethnic kenyans and three nigerians. [SEP] the eu leaders are often based on terrorism, and many leaders are focused on their domestic goals. [SEP] the quality - of - life issue has come [SEP]", "detok_text": "[CLS] place for the entire church, \" the church's president said. [SEP] the report also faults the uk government's handling of child sexual abuse and its lack of its attention to sexual abuse, such as child sexual exploitation, domestic violence abuse, school care, education and education. [SEP] mr. museveni is originally from the north - western country's western province, which leaders say includes political representatives from the opposition, along with two ethnic kenyans and three nigerians. [SEP] the eu leaders are often based on terrorism, and many leaders are focused on their domestic goals. [SEP] the quality - of - life issue has come [SEP]"}
+{"type": "sample", "index": 38, "raw_text": "[CLS] to play these days, and that would be the end i wanted, but the best thing i can do, \" she said. [SEP] \" if you are talking up the tit, i would. [SEP] representative group, china, china, china, china, japan, taiwan, asia, china, russia. korea, china - chinese president hu jin jingtao will visit washington and china on free trade deals. [SEP] state public health officials in new york city said the subway system began comopening at 7 a. m., and within hours, late around 4 p. m., at 4 p. m. the city [SEP]", "detok_text": "[CLS] to play these days, and that would be the end i wanted, but the best thing i can do, \"she said. [SEP]\" if you are talking up the tit, i would. [SEP] representative group, china, china, china, china, japan, taiwan, asia, china, russia. korea, china - chinese president hu jin jingtao will visit washington and china on free trade deals. [SEP] state public health officials in new york city said the subway system began comopening at 7 a. m., and within hours, late around 4 p. m., at 4 p. m. the city [SEP]"}
+{"type": "sample", "index": 39, "raw_text": "[CLS] on the phone. [SEP] mr cameron, he said, would appoint six opposition mps, six labour party members, four members of the conservative party, and the deputy labour leader,, making them a new mps. [SEP] the dark age of violence is the beginning of a long reprise of those days a few years ago when our country was the centre of mother ' s day. [SEP] sen. john mccain will makes his iraq speech here at 1200 gmt on sunday. [SEP] administration officials say the treasury and the administration ' s efforts to make it clear that they would ask the treasury department to sell the company ' s shares and shares in the [SEP]", "detok_text": "[CLS] on the phone. [SEP] mr cameron, he said, would appoint six opposition mps, six labour party members, four members of the conservative party, and the deputy labour leader,, making them a new mps. [SEP] the dark age of violence is the beginning of a long reprise of those days a few years ago when our country was the centre of mother's day. [SEP] sen. john mccain will makes his iraq speech here at 1200 gmt on sunday. [SEP] administration officials say the treasury and the administration's efforts to make it clear that they would ask the treasury department to sell the company's shares and shares in the [SEP]"}
+{"type": "sample", "index": 40, "raw_text": "[CLS] network of news outlets and international media. [SEP] the officials said this would be a \" sensible \" idea for what government officials saw as a one - out of \" economic and political cooperation, \" often used by western leaders. [SEP] bolton boss jimmy coyle has said he does not know what is now becoming a problem for his side. [SEP] obama will hold talks monday night for the middle east tour, which is scheduled to begin in the first week of april. [SEP] 7 / prnewswire - usnewswire / - - baylor university student howard gibbons plans to travel to the vatican about his healing process today, an official said [SEP]", "detok_text": "[CLS] network of news outlets and international media. [SEP] the officials said this would be a \"sensible\" idea for what government officials saw as a one - out of \"economic and political cooperation,\" often used by western leaders. [SEP] bolton boss jimmy coyle has said he does not know what is now becoming a problem for his side. [SEP] obama will hold talks monday night for the middle east tour, which is scheduled to begin in the first week of april. [SEP] 7/prnewswire - usnewswire/- - baylor university student howard gibbons plans to travel to the vatican about his healing process today, an official said [SEP]"}
+{"type": "sample", "index": 41, "raw_text": "[CLS] the conservatives must pay for more than 70 % of income tax in other areas, while he calls for aggressive growth in national debt. [SEP] martin king, head of sales for scm, said the company had been focused on creating a sound recording brand with the \" bucking to the popular label trend of the late 60s and ' 50s. \" [SEP] i ' ve about 20 years of tennis to play to when i didn ' t go up in the gym when i was 17 but after few days of high school, i got ready to do something to this. [SEP] peter kham, an economics professor at the university of california, [SEP]", "detok_text": "[CLS] the conservatives must pay for more than 70 % of income tax in other areas, while he calls for aggressive growth in national debt. [SEP] martin king, head of sales for scm, said the company had been focused on creating a sound recording brand with the \"bucking to the popular label trend of the late 60s and' 50s.\" [SEP] i've about 20 years of tennis to play to when i didn't go up in the gym when i was 17 but after few days of high school, i got ready to do something to this. [SEP] peter kham, an economics professor at the university of california, [SEP]"}
+{"type": "sample", "index": 42, "raw_text": "[CLS] state veterinary school of the california institute of animals and deputy deputy agriculture director of food research. [SEP] an email on tuesday from the israeli prime minister binyamin netanyahu, said that he plans to meet with senior members of the house intelligence committee on wednesday to discuss the list of pro - israel legislation coming up. [SEP] after the bank agreed on swap holdings valued at more than 6, 400 billion francs ( $ 4, 000bn ), the world ' s largest central bank was told to scale back its sdr operation. [SEP] the nfl will announce monday that he is ready to be a playoff contender this season. [SEP] the group [SEP]", "detok_text": "[CLS] state veterinary school of the california institute of animals and deputy deputy agriculture director of food research. [SEP] an email on tuesday from the israeli prime minister binyamin netanyahu, said that he plans to meet with senior members of the house intelligence committee on wednesday to discuss the list of pro - israel legislation coming up. [SEP] after the bank agreed on swap holdings valued at more than 6, 400 billion francs ($4, 000bn), the world's largest central bank was told to scale back its sdr operation. [SEP] the nfl will announce monday that he is ready to be a playoff contender this season. [SEP] the group [SEP]"}
+{"type": "sample", "index": 43, "raw_text": "[CLS] sure, there ' s never a good way to do anything here - - and it ' s not particularly smart or practical. [SEP] it was at the end of its 60 - day tour and it is only three days before the king ' s speech. [SEP] she said : \" i was asked if they would help him if he did not give his name. [SEP] if we believe in this situation, we can see what china really means and say. [SEP] \" it seems to me that what is the same, you feel we need to develop knowledge and think about ways of being more about what we want - - how to put matters with [SEP]", "detok_text": "[CLS] sure, there's never a good way to do anything here - - and it's not particularly smart or practical. [SEP] it was at the end of its 60 - day tour and it is only three days before the king's speech. [SEP] she said: \"i was asked if they would help him if he did not give his name. [SEP] if we believe in this situation, we can see what china really means and say. [SEP]\" it seems to me that what is the same, you feel we need to develop knowledge and think about ways of being more about what we want - - how to put matters with [SEP]"}
+{"type": "sample", "index": 44, "raw_text": "[CLS] african and african countries. [SEP] deputy u. s. sen. james hagan said he ' s frustrated about president obama ' s decision but has indicated that there is a clear and effective way forward to be made, but that he still favors a new global agreement on reducing emissions that was about to be reached. [SEP] this is probably good enough, he says, to justify his faith and his responsibility to imitate and galvanise himself. [SEP] mr williams met with his manager, pete lumley, at a private meeting. [SEP] he said he would not consult his mps on whom to call. [SEP] in the spring of 2003 [SEP]", "detok_text": "[CLS] african and african countries. [SEP] deputy u. s. sen. james hagan said he's frustrated about president obama's decision but has indicated that there is a clear and effective way forward to be made, but that he still favors a new global agreement on reducing emissions that was about to be reached. [SEP] this is probably good enough, he says, to justify his faith and his responsibility to imitate and galvanise himself. [SEP] mr williams met with his manager, pete lumley, at a private meeting. [SEP] he said he would not consult his mps on whom to call. [SEP] in the spring of 2003 [SEP]"}
+{"type": "sample", "index": 45, "raw_text": "[CLS] [SEP] mr. obama seldom appears to be in television, and he also doesn ' t talk about the way he sees himself. [SEP] the increase in the trade deficit was also far smaller than was previously expected. [SEP] that ' s part of the way it comes as the story starts to grow, but it ' s hard to get into perspective. [SEP] after aller died, his father said, the singer died his age and began writing his later life, and he was accompanied by his wife and his 47 - year - old wife, jean - elin, who was born at the age of four. [SEP] and i would think he [SEP]", "detok_text": "[CLS] [SEP] mr. obama seldom appears to be in television, and he also doesn't talk about the way he sees himself. [SEP] the increase in the trade deficit was also far smaller than was previously expected. [SEP] that's part of the way it comes as the story starts to grow, but it's hard to get into perspective. [SEP] after aller died, his father said, the singer died his age and began writing his later life, and he was accompanied by his wife and his 47 - year - old wife, jean - elin, who was born at the age of four. [SEP] and i would think he [SEP]"}
+{"type": "sample", "index": 46, "raw_text": "[CLS], zimbabwe ' s opposition leader, said he arrived in the country ' s capital, harare, at about 7 p. m. [SEP] the bank has said he is not ready to discuss the bonuses publicly, speaking about a meeting with barclays on the subject. [SEP] new york ( ap ) - - as he walks, he ' s gone into his father ' s side. [SEP] but mr zuma has been more reserved on taxes, expressing his preference for changing the constitution and sticking with his newly elected government. [SEP] hans hendermidnor, director of barclays international ' s business development fund, said that boosting [SEP]", "detok_text": "[CLS], zimbabwe's opposition leader, said he arrived in the country's capital, harare, at about 7 p. m. [SEP] the bank has said he is not ready to discuss the bonuses publicly, speaking about a meeting with barclays on the subject. [SEP] new york (ap) - - as he walks, he's gone into his father's side. [SEP] but mr zuma has been more reserved on taxes, expressing his preference for changing the constitution and sticking with his newly elected government. [SEP] hans hendermidnor, director of barclays international's business development fund, said that boosting [SEP]"}
+{"type": "sample", "index": 47, "raw_text": "[CLS] - old boy in dallas. [SEP] even when he has to deal with a person who has fallen short on his ambition and who is trying to make a decision on his own feet, that won ' t allow the government to stop the crisis. [SEP] it ' s just about everyone who ' s about to go crazy, but not going to try to do the same. [SEP] david aikeng has taken himself away of national television and made up thousands of pounds worth of television. [SEP] the debt sits now at $ 1 billion. [SEP] steve kastar, spokesman for the california department of transportation, has issued a statement touting the web [SEP]", "detok_text": "[CLS] - old boy in dallas. [SEP] even when he has to deal with a person who has fallen short on his ambition and who is trying to make a decision on his own feet, that won't allow the government to stop the crisis. [SEP] it's just about everyone who's about to go crazy, but not going to try to do the same. [SEP] david aikeng has taken himself away of national television and made up thousands of pounds worth of television. [SEP] the debt sits now at $1 billion. [SEP] steve kastar, spokesman for the california department of transportation, has issued a statement touting the web [SEP]"}
+{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] i ' m the one that thinks they ' re people who have to do something they don ' t care. [SEP] it ' s sad, i think, to dwell on the sale of media. [SEP] \" hillary just wants to drop out of this race, so she ' s not going to do that, \" said ron happell. [SEP] while the plight of ke wilkins, the ex - manchester united international, hinder biggs ' s hopes of driving his club to the championship side, mcleish said he was unable to put his job at newcastle ' s training ground. [SEP] jim trotson, head [SEP]", "detok_text": "[CLS]. [SEP] i'm the one that thinks they're people who have to do something they don't care. [SEP] it's sad, i think, to dwell on the sale of media. [SEP] \"hillary just wants to drop out of this race, so she's not going to do that,\" said ron happell. [SEP] while the plight of ke wilkins, the ex - manchester united international, hinder biggs's hopes of driving his club to the championship side, mcleish said he was unable to put his job at newcastle's training ground. [SEP] jim trotson, head [SEP]"}
+{"type": "sample", "index": 49, "raw_text": "[CLS], a georgetown university of economics and political expert. [SEP] i ' m not sure much about palin, but i love to be o ' donnell ' s wife. [SEP] 1338 : nick jones : today i ' m going to have a look at watching stephen jones in the 63rd minute. [SEP] \" players have a range of good people with common sense of wanting to move on. [SEP] russia has cut back its crude oil since the late 1990s since the rapid increase in kiev and moscow prices began in the 1990s. [SEP] clinton spokesman bill vigin said tuesday he was pleased with obama ' s plan, but said clinton ' s campaign [SEP]", "detok_text": "[CLS], a georgetown university of economics and political expert. [SEP] i'm not sure much about palin, but i love to be o' donnell's wife. [SEP] 1338: nick jones: today i'm going to have a look at watching stephen jones in the 63rd minute. [SEP] \" players have a range of good people with common sense of wanting to move on. [SEP] russia has cut back its crude oil since the late 1990s since the rapid increase in kiev and moscow prices began in the 1990s. [SEP] clinton spokesman bill vigin said tuesday he was pleased with obama's plan, but said clinton's campaign [SEP]"}
+{"type": "sample", "index": 50, "raw_text": "[CLS] the fundamental rights of the nation ' s people, \" he added. [SEP] the wall street journal ' s index has lost 3 % since its start to fall in october, down about 3 % on monday. [SEP] the incident was about 10 minutes later saturday. [SEP] the new age study was developed by the national institute of environmental studies in london. [SEP] jagdigdi, a retired former foreign minister in western europe who has lived in kenya, said he did not plan to live with a minister ' s wife to give his own life. [SEP] \" the nice thing about this is that this is still a team ' s standard, [SEP]", "detok_text": "[CLS] the fundamental rights of the nation's people, \"he added. [SEP] the wall street journal's index has lost 3 % since its start to fall in october, down about 3 % on monday. [SEP] the incident was about 10 minutes later saturday. [SEP] the new age study was developed by the national institute of environmental studies in london. [SEP] jagdigdi, a retired former foreign minister in western europe who has lived in kenya, said he did not plan to live with a minister's wife to give his own life. [SEP]\" the nice thing about this is that this is still a team's standard, [SEP]"}
+{"type": "sample", "index": 51, "raw_text": "[CLS] itself and the market situation. [SEP] united suffered another poor first - half display at half - time to defeat manchester united at old trafford. [SEP] it ' s just a shame, it ' s probably been this week. [SEP] the chances of arsenal going to the europa league were held unnised, and but jones recognises that we don ' t have a chance of success in the future. [SEP] the long ball coming off a tree, thome slammed into the front yard and held up with his feet, then he ran off his opponent ' s feet and bounced hard on the ground to get inside with his face. [SEP] the central [SEP]", "detok_text": "[CLS] itself and the market situation. [SEP] united suffered another poor first - half display at half - time to defeat manchester united at old trafford. [SEP] it's just a shame, it's probably been this week. [SEP] the chances of arsenal going to the europa league were held unnised, and but jones recognises that we don't have a chance of success in the future. [SEP] the long ball coming off a tree, thome slammed into the front yard and held up with his feet, then he ran off his opponent's feet and bounced hard on the ground to get inside with his face. [SEP] the central [SEP]"}
+{"type": "sample", "index": 52, "raw_text": "[CLS] are often identified by younger people who know their sexuality is only about their money, compared with their tastes, their brains. [SEP] \" i never know i could do this, but i always want to keep their presence, \" brown said. [SEP] let ' s do not. [SEP] if somebody doesn ' t believe there ' s a good football player, it will happen at the same time that i should be playing football, but i have to say i can ' t, \" mccowl said. [SEP] mr thomas, 38, a retired chartered surveyor, lives in swithley, sandloss, making £4 a day [SEP]", "detok_text": "[CLS] are often identified by younger people who know their sexuality is only about their money, compared with their tastes, their brains. [SEP] \"i never know i could do this, but i always want to keep their presence,\" brown said. [SEP] let's do not. [SEP] if somebody doesn't believe there's a good football player, it will happen at the same time that i should be playing football, but i have to say i can't, \" mccowl said. [SEP] mr thomas, 38, a retired chartered surveyor, lives in swithley, sandloss, making £4 a day [SEP]"}
+{"type": "sample", "index": 53, "raw_text": "[CLS] 50 % - 49 % over mccain in a presidential election, the national rate among the most likely voters among african - americans. [SEP] china ' s military spending has limited china ' s attempts to bring ties back to another level, and deepened china ties where there has been no flare - up in the two years, according to a report from the china central administration of the state news department. [SEP] he is the father of five children from school and age, the family says. [SEP] after the budget, which published today, the government ' s national debt is still only 40 %, but debt in britain, germany and spain was $ 2 [SEP]", "detok_text": "[CLS] 50 % - 49 % over mccain in a presidential election, the national rate among the most likely voters among african - americans. [SEP] china's military spending has limited china's attempts to bring ties back to another level, and deepened china ties where there has been no flare - up in the two years, according to a report from the china central administration of the state news department. [SEP] he is the father of five children from school and age, the family says. [SEP] after the budget, which published today, the government's national debt is still only 40 %, but debt in britain, germany and spain was $2 [SEP]"}
+{"type": "sample", "index": 54, "raw_text": "[CLS] my father, brother and their 3 - year - old son to write his name and give way to his mother. [SEP] the majority of people get their way while they are bored with this. [SEP] this is still a work of art form, a modern art project, and i ' m not concerned about the price. [SEP] the senate ' s economic - making committee has entered into a six - month - long three - day hearing to begin next october. [SEP] \" i ' ve been playing because i am stronger and ready to finish my championship, my hopefully, if i want to get my back into golf, \" he said. [SEP] [SEP]", "detok_text": "[CLS] my father, brother and their 3 - year - old son to write his name and give way to his mother. [SEP] the majority of people get their way while they are bored with this. [SEP] this is still a work of art form, a modern art project, and i'm not concerned about the price. [SEP] the senate's economic - making committee has entered into a six - month - long three - day hearing to begin next october. [SEP] \"i've been playing because i am stronger and ready to finish my championship, my hopefully, if i want to get my back into golf,\" he said. [SEP] [SEP]"}
+{"type": "sample", "index": 55, "raw_text": "[CLS]r said. [SEP] harrisburg, pa., april 6 ( upi ) - - the former national defense secretary is hillary rodham clinton, secretary of state for foreign affairs secretary barack obama. [SEP] he spent the money and time of his mother, and helped his family pay for college. [SEP] now the party ' s leadership seems unwilling to stand back. [SEP] most people may want to know this, but it ' s difficult to talk about age away from the whole process. [SEP] it ' s not the same with all sports and all sports, but all tennis, golf, softball, softball and football and all three types of sports. [SEP]", "detok_text": "[CLS]r said. [SEP] harrisburg, pa., april 6 (upi) - - the former national defense secretary is hillary rodham clinton, secretary of state for foreign affairs secretary barack obama. [SEP] he spent the money and time of his mother, and helped his family pay for college. [SEP] now the party's leadership seems unwilling to stand back. [SEP] most people may want to know this, but it's difficult to talk about age away from the whole process. [SEP] it's not the same with all sports and all sports, but all tennis, golf, softball, softball and football and all three types of sports. [SEP]"}
+{"type": "sample", "index": 56, "raw_text": "[CLS] direction, \" hier said. [SEP] when you are in the middle of your team, and you can ' t raise yourself at the moment, then you can dictase and get stuck doing what you ' re asking. [SEP] the officials said that c. henry paulson, deputy secretary for national security relations, former deputy assistant treasury secretary david h. jones, assistant deputy assistant senior deputy treasury for foreign policy, the department of state in charge of the u. s. treasury ' s treasury, and china ' s foreign minister for national security and development. [SEP] \" it ' s a lot, a lot longer than a big [SEP]", "detok_text": "[CLS] direction, \"hier said. [SEP] when you are in the middle of your team, and you can't raise yourself at the moment, then you can dictase and get stuck doing what you're asking. [SEP] the officials said that c. henry paulson, deputy secretary for national security relations, former deputy assistant treasury secretary david h. jones, assistant deputy assistant senior deputy treasury for foreign policy, the department of state in charge of the u. s. treasury's treasury, and china's foreign minister for national security and development. [SEP]\" it's a lot, a lot longer than a big [SEP]"}
+{"type": "sample", "index": 57, "raw_text": "[CLS] in london, matthew graham at the washington post in washington, baro muccia in berlin and tom capello in washington contributed to this report. [SEP] assistant secretary of state su kye mccormack left beijing late last week after president barack obama was speaking on its current situation with china ' s foreign minister, ky kim of china. [SEP] the ailing 27 - year - old is almost certainly a story for success. [SEP] i just want to find out what happened, and i think the story of this guy is bad, but that tells us all of what will happen, but it ' s much easier to think of going [SEP]", "detok_text": "[CLS] in london, matthew graham at the washington post in washington, baro muccia in berlin and tom capello in washington contributed to this report. [SEP] assistant secretary of state su kye mccormack left beijing late last week after president barack obama was speaking on its current situation with china's foreign minister, ky kim of china. [SEP] the ailing 27 - year - old is almost certainly a story for success. [SEP] i just want to find out what happened, and i think the story of this guy is bad, but that tells us all of what will happen, but it's much easier to think of going [SEP]"}
+{"type": "sample", "index": 58, "raw_text": "[CLS] leader of the house ' s commerce and commerce committee. [SEP] mr cameron also sees the party need to pursue a course, but it is expected to ensure the tories will continue to shy away from a final decision on who to take over their party. [SEP] mr. bruge asked. [SEP] mr bush also did to emphasize that the united states would willing to maintain its claim, at least at the height of recent decades, that the united states would never walk away from the idea of nuclear diplomacy, now seen as a warning sign to greater tensions and greater levels of willingness or diplomacy. [SEP] it was signed with president george bush and then [SEP]", "detok_text": "[CLS] leader of the house's commerce and commerce committee. [SEP] mr cameron also sees the party need to pursue a course, but it is expected to ensure the tories will continue to shy away from a final decision on who to take over their party. [SEP] mr. bruge asked. [SEP] mr bush also did to emphasize that the united states would willing to maintain its claim, at least at the height of recent decades, that the united states would never walk away from the idea of nuclear diplomacy, now seen as a warning sign to greater tensions and greater levels of willingness or diplomacy. [SEP] it was signed with president george bush and then [SEP]"}
+{"type": "sample", "index": 59, "raw_text": "[CLS] the impact of the financial crisis, they are reluctant to borrow money from the banking system and re - establish existing programs, deciding instead to accept the crisis and try to go up with it. [SEP] the new team will be able to get its data on the field at the current cost of the current five years of $ 3 billion. [SEP] unsung golfer cl clegg, the american, who spent nearly 10 years of advanced age at 63, is now being diagnosed with such problems. [SEP] this is clearly a reflection of our generalism... the belief that we would rather see the work of our ancestors than see the [SEP]", "detok_text": "[CLS] the impact of the financial crisis, they are reluctant to borrow money from the banking system and re - establish existing programs, deciding instead to accept the crisis and try to go up with it. [SEP] the new team will be able to get its data on the field at the current cost of the current five years of $3 billion. [SEP] unsung golfer cl clegg, the american, who spent nearly 10 years of advanced age at 63, is now being diagnosed with such problems. [SEP] this is clearly a reflection of our generalism... the belief that we would rather see the work of our ancestors than see the [SEP]"}
+{"type": "sample", "index": 60, "raw_text": "[CLS] call + 1 - 007 791 75380. [SEP] the reports said the commission was expected to hear the case next year. [SEP] however, the children ' s head of television education recommends the same reading age, and that means that kids ' later education on television is nearly half of national income without ever reading it, according to data from the center for child management and health report. [SEP] i do not believe that people in the academic profession are able to take part in some areas. [SEP] still, no good side of it. [SEP] the shootings in china is the biggest spate of alleged human rights violations in the region [SEP]", "detok_text": "[CLS] call + 1 - 007 791 75380. [SEP] the reports said the commission was expected to hear the case next year. [SEP] however, the children's head of television education recommends the same reading age, and that means that kids' later education on television is nearly half of national income without ever reading it, according to data from the center for child management and health report. [SEP] i do not believe that people in the academic profession are able to take part in some areas. [SEP] still, no good side of it. [SEP] the shootings in china is the biggest spate of alleged human rights violations in the region [SEP]"}
+{"type": "sample", "index": 61, "raw_text": "[CLS] of association, and speech, which is protected by the law. [SEP] singapore ( ap ) - oil prices on the singapore stock exchange dropped to a seven - year high, and the region ' s main stock markets fell on sunday. [SEP] nelson ' s name could be the nation ' s highest - rated governor. [SEP] mr. wilson is reluctant to comment on his father ' s background, though he wants him to go to the training course, which was run when mr. died. [SEP] he said these are the most important of u. s. policy, iraq and \" security, strategic and military security. \" [SEP] the violence came [SEP]", "detok_text": "[CLS] of association, and speech, which is protected by the law. [SEP] singapore (ap) - oil prices on the singapore stock exchange dropped to a seven - year high, and the region's main stock markets fell on sunday. [SEP] nelson's name could be the nation's highest - rated governor. [SEP] mr. wilson is reluctant to comment on his father's background, though he wants him to go to the training course, which was run when mr. died. [SEP] he said these are the most important of u. s. policy, iraq and \"security, strategic and military security.\" [SEP] the violence came [SEP]"}
+{"type": "sample", "index": 62, "raw_text": "[CLS] of the world ' s biggest hotel brands moving into the us. [SEP] foreign minister yu xiongmung in china said saturday that china would join the talks on the sino - china border dispute, taiwan foreign ministry. [SEP] several days later, president president bush called vice president luo - bao, telling foreign ministers to skip the summit to focus on nuclear nuclear tests. [SEP] he did not have a sore ankle and was made to throw a chain in frustration. [SEP] it ' s not like it ' s on the part of a person but the part of an attorney, \" he said. [SEP] the bank is likely to meet with [SEP]", "detok_text": "[CLS] of the world's biggest hotel brands moving into the us. [SEP] foreign minister yu xiongmung in china said saturday that china would join the talks on the sino - china border dispute, taiwan foreign ministry. [SEP] several days later, president president bush called vice president luo - bao, telling foreign ministers to skip the summit to focus on nuclear nuclear tests. [SEP] he did not have a sore ankle and was made to throw a chain in frustration. [SEP] it's not like it's on the part of a person but the part of an attorney, \" he said. [SEP] the bank is likely to meet with [SEP]"}
+{"type": "sample", "index": 63, "raw_text": "[CLS] engagement with its russian national counterparts on the common ground, which promotes openness and patience and is less concerned on its energy program and the issues that the national assembly has raised, \" it wrote. [SEP] at least five people had been killed and six injured, officials said. [SEP] but the launch comes just days after u. s. president barack obama insisted that washington north korea should have a dialogue with washington and washington was at the table on the status of north korea. [SEP] \" while it is this season the most difficult economic year for the region, the timing of this year is significant news for the region, \" said andrew albright [SEP]", "detok_text": "[CLS] engagement with its russian national counterparts on the common ground, which promotes openness and patience and is less concerned on its energy program and the issues that the national assembly has raised, \"it wrote. [SEP] at least five people had been killed and six injured, officials said. [SEP] but the launch comes just days after u. s. president barack obama insisted that washington north korea should have a dialogue with washington and washington was at the table on the status of north korea. [SEP]\" while it is this season the most difficult economic year for the region, the timing of this year is significant news for the region, \" said andrew albright [SEP]"}

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_diffusion_noise_steps_128steps_n64/noise_linear2to08_early_cosine_eta0p02_c1024_detok_raw_samples.txt

@@ -0,0 +1,230 @@
+noise_linear2to08_early_cosine_eta0p02_c1024_detok
+{
+  "type": "summary",
+  "name": "noise_linear2to08_early_cosine_eta0p02_c1024",
+  "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt",
+  "step": 187000,
+  "decode": {
+    "kind": "categorical_fullvocab_diffusion_state_noise",
+    "config": "noise_linear2to08_early_cosine_eta0p02_c1024",
+    "steps": 128,
+    "temp_start": 2.0,
+    "temp_end": 0.8,
+    "temp_schedule": "linear",
+    "t_power": 1.0,
+    "eta0": 0.02,
+    "eta_schedule": "early_cosine",
+    "noise_conc": 1.0,
+    "concentration_max": 1024.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 45.648558001763085,
+    "nll_per_token": 3.8209720184098184,
+    "tokens": 9370
+  },
+  "diversity": {
+    "sample_entropy": 4.153952417528344,
+    "unique_tokens": 1824,
+    "token_count": 8192,
+    "distinct_1": 0.22265625,
+    "distinct_2": 0.687623031496063,
+    "top_token_mass": 0.0555419921875
+  }
+}
+
+===== sample 000 =====
+[CLS] wanted to present the car seat as their second home. [SEP] wright has a doctorate in washington, and is a political professor in iowa. [SEP] this week's review of the obama administration's tailpipe program reveals how the administration will push to lower carbon emissions under a global agreement to reduce emissions of carbon dioxide, among other things. [SEP] but it said poorer people and older people in the area were likely to make people fat, and that fewer people were affected. [SEP] both candidates say obama has shown greater importance in his effort. [SEP] sixteen percent of 15 - year - olds still preferred reading, compared with 18 percent of 17 year [SEP]
+
+===== sample 001 =====
+[CLS] fund could cost to $1, 000bn over the next decade. [SEP] " i didn't do any wrong. [SEP] if someone was responsible for the global economy, then it must be that national policies and other macroeconomic frameworks must be respected. [SEP] this afternoon, the leaders will have to take an cue from the pm, news that mps have been prepared to challenge the government's record of defence, the defence strategy and the iraq war. [SEP] i've always been involved with this and a lot more frequently being aware of myself as a coach. [SEP] for more information on iras please visit the international center for [SEP]
+
+===== sample 002 =====
+[CLS] it's the final of my life, "she said. [SEP]" i'm going to play and i'll feel as if i'm going to play golf, " he said. [SEP] a total group of about 7 million people spent £1. 2 billion in 2008. [SEP] new york certainly hasn't reported all the extra costs. [SEP] the following titles: premier league clubs, chelsea football league and football club. [SEP] he told us in his speech that it is an act of government. [SEP] in september, the average price paid work hit £18, 500 down 18pc from last year's levels, while [SEP]
+
+===== sample 003 =====
+[CLS] i think it's good day in this part of the country, and the economy is really going around, because at the early stage of this campaign, i say we think that i think pakistan's debt is worth 70 % lower than it is today. [SEP] china needs to rethink its objective of reviving the growth and stability, " qiu nig zhongn, president of the ministry of foreign affairs, was quoted in a call on behalf of the foreign ministers of the country. [SEP] police said that he had been able to get out of a nearby prison. [SEP] in recent days, obama has warned that [SEP]
+
+===== sample 004 =====
+[CLS] that he doesn't want to make further concessions for the new nuclear program. [SEP] police said a bomb carrying about 80 people in three cars and one vehicle was attacked in north gaza early saturday and at least 10 were killed, and three others were killed and two wounded, police said. [SEP] since i am an ex - convict myself, i am an adversity. [SEP] of course, seeing young players and celebrities reaping their big hobbies is a good thing. [SEP] 6 (upi) - - a house u. s. treasury committee said wednesday it will provide about $7 billion in capital for a central bank [SEP]
+
+===== sample 005 =====
+[CLS]: 30 p. m. [SEP] charlotte, n. c. and his studies from the university and harvard law school in the washington area. mr. mcdiff, born in chicago, attended the school of science and technology, with a degree in international law from yale university school of politics. [SEP] i'm not prepared to suggest that his appearance might be less important than being in the field of war strategy. [SEP] 8, (bna) - the united states has told neighbors iran and europe to pursue bilateral agreements with tehran in which the u. s. wants russia support to strengthen its relations with iran. [SEP] mcg [SEP]
+
+===== sample 006 =====
+[CLS]. [SEP] "all we need is solve the global economic crisis," said tim gecker, professor of monetary policy at the illinois state university in chicago and a senior writer in the new york fed's central bank department. [SEP] by 7: 30 o. m. a. c., french - born southerners made a who over $4. 5 billion in the civil war. [SEP] 12, 2008 at 11: 30 p. m. [SEP] last week, gov. timothy johnson moved to his first day as governor as the top republican national committee, olympia e. g. snowe. [SEP] whatever he is, mr [SEP]
+
+===== sample 007 =====
+[CLS] corbey, his wife, and jim croate, assistant director of the park. [SEP] bodmer county park district council wants £500, 000 funding for a four - lane, 2, 500 - seat cricket facility. [SEP] the program's core strength has been to attract talent in international sports, football, football, football, economics, and sports, with experience in professional sports, footballing, sports, administration, soccer, school administration, sports, rugby football, soccer, soccer, sports administration, sports coaching, sports administration, sports administration, football, football, administration and throughout his career at the club. [SEP]
+
+===== sample 008 =====
+[CLS] new york' three - game playoff streak to june 1 with the philadelphia phillies. [SEP] ho park holds an institute of management degree in global financial services and management administration, focusing on retail banking. [SEP] the internet is an open space for every north western nation, for whom there is no chance of its leader becoming a democratic government. [SEP] the 38 - year - old parry, who has become a consultant at manchester united, could join liverpool at least two months ago, but helen hendry, the girl, was persuaded to leave, after which she would return to the high school club. [SEP] obama also warns that the north korean government and [SEP]
+
+===== sample 009 =====
+[CLS] to honor its workers' rights. [SEP] a police department official said wednesday the government was satisfied with its recognition of kosovo's independence and would reach its conclusion after days of talks over kosovo's independence from serbia. [SEP] mr kokoity said his country had deep political ties and that it was ready to consult with russia. [SEP] "i must admit that after this congress is a wake up call, i think people will understand the importance of violence, by taking more responsibility into the lives of men and women who have forgotten about what is happening in our country," mr. pelosi said. [SEP] stachev suggested the [SEP]
+
+===== sample 010 =====
+[CLS] if people get bored with their jobs, i don't seem to mind about the consequences. [SEP] "now, after all, we've got to keep most of their money," said grisfeld. [SEP] it's almost as that people emphasize responsibility and leadership, just that they're just too fast - deforied. [SEP] "they don't come out and come out and it slows, then they would try to get it," he said. [SEP] this may be the only way i tried, but they did not help. [SEP] this is rare. [SEP] i didn't want to go [SEP]
+
+===== sample 011 =====
+[CLS] yorkshire police said mr petti was injured near his school's school in leeds on monday. [SEP] he also denied the allegations. [SEP] but, at this, i think that's what you need to do to make sure that we need to spend the energy that we have to do with being a coach and head player again, says mr williams. [SEP] the answer is to give kids the mental skills that are still going to be with them to do it, which you would have to do not just because the person is willing to take their own and risking their lives. [SEP] authorities also say the pair of jackson's children, [SEP]
+
+===== sample 012 =====
+[CLS]. bush's many years of public relations, his goal was largely to promote his past ties with the new american government, rather than working with his own people. [SEP] north korea said that it has addressed the north korea nuclear situation through its response. "our intention is to build a global focus on the related issues of koreans and their own interests," hyundai kaesong president kim young said in a statement. [SEP] on thursday, the french government would create a nationalized bank, ecf, to encourage purchases of foreign assets and securities linked to banks, and france would buy a majority stake in the failed bank. [SEP] the [SEP]
+
+===== sample 013 =====
+[CLS] 30 - minute conference and given the presidential address. [SEP] more than a dozen rebel leaders died tuesday. while the army says the militants have about 1, 000 troops in the area, the government had no details on a deal to resurpe control of the area that would supply to china's vast sparsely populated area, including sudan and east asia. [SEP] "after a number of months the political crisis in the country came to the highest point," said john john hutton, the british secretary of state, who urged mr brown on saturday not to respond to the darfur crisis. [SEP] members of the u. s. assistance group [SEP]
+
+===== sample 014 =====
+[CLS] - you know, those days were over and i warned the fans today not to get out about football when any club don't win. [SEP] when i was only one year old, my mother's education in law school, which i had during my daughter of eight years, was the beginning when she was 14. [SEP] david davies, the ad campaign manager, now values the game at rmb5m worth about £28, 000. [SEP] the average price of a ticket to trade in new york fell to a record $1. 07 to a low of $1. 55, according to data filed on thursday evening. [SEP]
+
+===== sample 015 =====
+[CLS] say it's probably more difficult to buy now, " said bill wilson, vice president at clc consulting. [SEP] politics and football tend to have more money and money than public shows. [SEP] brown repeated that he told senior deputy foreign minister gordon brown the opposition leader wants to return to british politics after talks with a government and the opposition leader who is going to try it, david miliband. [SEP] deputy john kewlade said that there would be changes to the welsh assembly for the game. [SEP] he will also ask the leaders to ask them to take a position on the public spending plan, which leaves the country dependent [SEP]
+
+===== sample 016 =====
+[CLS]........ "hi john." [SEP] the japanese yen fell yesterday to its worst one - month close in 16 per cent last year to $1. 314 billion, with the australian dollar index falling 1. 4 per cent to $0. 83 per cent against the us dollar and the milder to the yen, rose 0. 9 per cent to y77. 93 japanese yen, losing 0. 6 per cent to y130. 15 against the dollar losing 0. 1 per cent cent to y1. 30 on wednesday. [SEP] the force would not give up any details. [SEP] he [SEP]
+
+===== sample 017 =====
+[CLS] page on the war in iraq. [SEP] " peter's head is closer to us, the people inside, he's really catching up with me, he's tall, he's not funny, he's impatient - - he's not just fun - - and he's cool, his lack of talent, and his size. [SEP] the players just really sort of want to go about their mistakes, which must be what they're. [SEP] posted by the guardian. co. uk/12: 0137 gmt cbs, 8: 00 a. m. [SEP] a law enforcement official said the gun [SEP]
+
+===== sample 018 =====
+[CLS] a lot of medical problems, " said kim waterlock, head of the center of adolescent health at the university medical center in south africa. [SEP] this is a tough - talking man looking to replace harry redknapp, the tottenham manager. [SEP] manchester city football association: the manchester united owner confirmed he has already signed a six - year contract with the team who will join liverpool at the weekend. [SEP] since he came to office in october, the turkish leader has already announced plans to revamp his vision for the country. [SEP] since its arrival, contemporary american life has made its own sense of democracy and peace. [SEP] the program [SEP]
+
+===== sample 019 =====
+[CLS] players probably took the largest amount of time, streep said. [SEP] ba has said it wants to deliver funding for a £75m (£47. 7m) by 2009 to make the one of the most famous cars in britain. [SEP] while the owners want to maintain their image, they insist professional football owners and football fans should be very realistic. [SEP] beijing (reuters) - chinese premier wen jiabao stressed his growing role in the nuclear crisis between the neighbours, and hu is expected to be briefed on saturday. [SEP] some people in the french government complain that the company has sold most of its debt. [SEP] [SEP]
+
+===== sample 020 =====
+[CLS] health, education and sport. " [SEP] north korea and former president bill clinton held a separate meeting with top korean officials, who have said they wanted to include details of a new deal on the korean peninsula, korean and chinese, including trade, foreign relations and energy and the whole north korea economy. [SEP] the foreign ministry, the north korea post - record daily, which represents leader laing kyung - kim's family of journalists, says it wants to do more to help him into the democratic process. [SEP] mr brown was speaking amid fears that the president of the eu should be willing to support any more state aid to the country [SEP]
+
+===== sample 021 =====
+[CLS] scene in the spring of 2008. [SEP] the white house is unhappy with the announcement, but don't say that it's doing all it takes to move the legislation. [SEP] it's a small part of ecmmime. [SEP] "he's a well - known senior out there, so i have to think about it, i don't think he was going into the second game when it came to him," hartl said, according to the team's website statement. [SEP] to help himself with the media this weekend, obama is talking about his desire to create political freedom and address ethnic issues - - [SEP]
+
+===== sample 022 =====
+[CLS] clinton's personal political attacks. [SEP] the americans, playing twice in each match since the opening hole, were both putts at the par on the opening day of play. [SEP] the average cost of average price for home - town homes increased 1. 3 percent from the year, to $100, 000, from a year earlier, it said. [SEP] many people in the north are losing their homes, losing hundreds of thousands of dollars each day. [SEP] i had to know that i had the have to laugh at someone like myself, which was something i could be involved in. [SEP] late tuesday night was described by police as " [SEP]
+
+===== sample 023 =====
+[CLS] year - old girl and her younger, 15 - year - old hannah ryan, and her older friend, david smith, 19. [SEP] after talks at a conference late last week with the government leaders concerned of using the powers to give more power to the private sector, mr clegg scolded efforts of the opposition, which the tories said now was to help strengthen the coalition. [SEP] south korean president hu yong - yong's ambassador to china said tuesday it can't dare talk about weapons, according to the nation's kcna newspaper. [SEP] mr obama's announcement will make it quite clear that his government [SEP]
+
+===== sample 024 =====
+[CLS] champion russian elena dementieva and svetlana vodniacki. [SEP] since the campaign, hillary clinton's father and brother have both been presidential candidate and presidential friends. [SEP] carl icahn, chairman of the democratic national committee, is the company's political chairman. [SEP] "more approach is more imperative, and something is less difficult to achieve," said ronald forde, a senior management professor at george mason university school of policy administration, trying to ensure that foreign leaders will spend their time on a new strategy of accountability. [SEP] it is understood that that our law school at the university of sydney school of [SEP]
+
+===== sample 025 =====
+[CLS] on mortgage - related assets will likely exceed the average national household assets in 2010. [SEP] in september, the leaders signed a package of tax cuts, greater social and economic cooperation and strong social reforms to keep high and save many of the country going on to lose their jobs. [SEP] this week, sen. john mccain is likely to use his administration as a champion of the economy, and mr. obama's perceived lack of experience would revamp the course of the economy. [SEP] still, half of those polled that said clinton - - 14 percent of whom agreed, compared to 2 percent - - said she rejected mccain's claim that [SEP]
+
+===== sample 026 =====
+[CLS] law school in london in 1986, taking his a law degree at paris university. [SEP] he urged moscow to ratify kosovo's independence through the use of russian support - a sign that georgia was open to a confrontation with russia. [SEP] at the time, ms cameron said: " they don't like technology because they like school fees, academies, local education. [SEP] now, that criticism seems certain to be dismissed by the tories - - citing the fact that education is a hard place, but with the rest of the nation - - and that is true because it is up to an president who does it. [SEP] he said [SEP]
+
+===== sample 027 =====
+[CLS] ministry minister kim hoon young said in a statement. [SEP] "i'm happy he has gone," said the former england defender. [SEP] a director of the social security institute, and vice director of the national security service commission, he led the pentagon office in the 1990s. [SEP] you can get into a school and do research, so that can help ensure that people will discuss it. [SEP] "people like to call it jackman's advertism," he said. [SEP] the american association of neurogeons said in a statement. [SEP] "it's a dangerous and very complex situation," he said [SEP]
+
+===== sample 028 =====
+[CLS] the barclays premier league while losing the premier league game to one of its french rivals. [SEP] strasbourg, france, april 9 (upi) - - france's independent national security agency says it will release more data on nuclear technology as it continues negotiations with the national security force on the production of bomb and military equipment. [SEP] the iraqis could have made the same point: who does not want to leave, and what does the united states want to do to leave iraq. [SEP] "we're not letting it go away," he said. [SEP] mr kagamei, a former finnish president, has recently died of [SEP]
+
+===== sample 029 =====
+[CLS] five - year lifespan. [SEP] the green party is still trying to make a point. [SEP] it doesn't matter which tax rate taxpayers must pay $1, 000 $30, 000 to $50, 000.................................................................................... [SEP]
+
+===== sample 030 =====
+[CLS] just 34. 5 million. [SEP] di beeen's appeal is less apparent in his character, but hughes himself is not to forget that he is not able to handle his ambitions, due to his love with him and his love of the team with him. [SEP] gabriel agbonlahor's appearance at the stadium of cardiff city this wednesday comes 18 days after the fa fa revealed that he had offered him £6. 1million from manchester city in october. [SEP] dr colin smith, 42, and his colleagues at work in plesham, surrey, said the situation was grim. [SEP] brian tillers, the president [SEP]
+
+===== sample 031 =====
+[CLS] the city. [SEP] kids need to get over their crumb to learn some way, from those high levels of reading time. [SEP] "if the argument doesn't turn out to be a platform for an open debate, it seems like it will be getting smaller," said dan sone, senior vice president at the oil company petrobras. [SEP] david fincham, the bbc's former chief executive and virgin's finance director, estimated the deal would cost £100m a year, exceeding the total cost of £24m for those associated with sports2. [SEP] the move would be similar to the £2 billion investment [SEP]
+
+===== sample 032 =====
+[CLS] impose sanction on armed armed groups. [SEP] the newspaper said the supreme court had five hours to resolve the issue. [SEP] those who now think the housing market has fallen at least three per cent from march last year, peaking at the peak - post - crisis level, just three months before the trough, the height of the housing crisis. [SEP] it is a matter of timing: so much is made to the point that the uk government should have come up with £100bn... [SEP] i don't want to get too much stressed about the source of the great crisis, but now that i'm already preparing for this, [SEP]
+
+===== sample 033 =====
+[CLS] would like to be in the place of the club at the end of the tunnel, in the names of the premiership clubs cowley and ferwell, the old towne park school and rugby league school football ground at wembley. [SEP] last five years, trainees had their average age hit an average of just under 8 %, peaking at 16. 19. [SEP] he was born out of the global crisis over the banking crisis, who knows what britain's becoming in japan, his lack of ambition, willingness to do something significant and his willingness to push his way into nationalisation for britain. [SEP] in the form of the report [SEP]
+
+===== sample 034 =====
+[CLS] [SEP] " everybody wants to know too much of the news. [SEP] the south korean government has set the price figure of $6, 800 to $3 billion to help resolve the issue, according to the wma. [SEP] 14 statement on the eve of the i. a. p. summit. [SEP] the comments came after u. s. intelligence agencies issued a report that u. s. secretary of state hillary clinton masterminded a iranian nuclear test. [SEP] mr karzai's aide, makoni biti, deputy foreign minister of mr mugabe's national democratic change party, has agreed to call the election [SEP]
+
+===== sample 035 =====
+[CLS] the program. [SEP] this will give a clear updated account of the government's position with david cameron's fiscal team. [SEP] while they are not yet specific, there are no guarantees. [SEP] denver, colorado - - seven former children of rep. tom toddler, his wife and five people were arrested in denver early on tuesday, officials said. [SEP] u. s. officials also said china's military spending would be about $1, 800 - - less of the total value of china - - a country with great military expertise and wealth complete with military hardware and equipment - - 1, 000 - 3, 200 tons of [SEP]
+
+===== sample 036 =====
+[CLS]change. org. [SEP] kerry wood, who is 21 - 5 for - 11, allowed five runs and nine hits in three innings. [SEP] but as a result, this regime may become a problem. [SEP] ben perry, 19, said after a practice round at augusta on saturday, the day he will be able to practice. [SEP] it all has a worth of 18. 58 billion yuan (us $5. 4 billion) and a 14 - 9. 35 billion deal with the u. s. navy, the world's biggest market with about $9. 8 billion at sea. [SEP] bulger said he was arrested [SEP]
+
+===== sample 037 =====
+[CLS] place for our citizens, " said fw secretary john leavitt. [SEP] the school of children's and education lists about 2, 000 schools, 12 of them are related to adult education, such as health, healthcare, psychology, education, asset management, and public education. [SEP] mr. museveni's party controls north - western congo's border province, which officials say was a stronghold of the opposition, along with many of congo's former ethnic parties. [SEP] americans focus on all health care reform issues, and consumers also get more informed about the benefits of it and quality - of - life care. [SEP] [SEP]
+
+===== sample 038 =====
+[CLS] to do these things, and that is only the end i want, but the best thing i can do, " she said. [SEP] wen's chinese counterparts on the trip will include hong kong - hong kong group, china, vietnam, singapore and north koreas, thailand, asia, china, russia and korea, and the chinese president hu jintao, who said washington wants restraint in free trade deals. [SEP] central asia defense officials in the capital pyongyang said the quake hit off at 4 p. m., and within hours the provincial capital of p. pangyong, a coastal division of the city [SEP]
+
+===== sample 039 =====
+[CLS] on the phone. [SEP] mr cameron criticised the tories in the end of 1997, when labour took power, urging them to focus on tax spending and the new labour leader to propose taking them into new terms. [SEP] barack obama insists that he's not talking about cuts, but says he would do whatever it would be to avoid the middle of barack's campaign. [SEP] "i'm sure i'll back off," he said.... [SEP] some say the consequences of the administration's efforts will lead to far lower standards. [SEP] the only way to sell the fed's troubled programs is buying the [SEP]
+
+===== sample 040 =====
+[CLS] network of areas reported by international media. [SEP] the minister said china should be an "equal" area for national government, both as a one - off of greater economic and political cooperation, and as part of economic cooperation. [SEP] of course, it is clear that it does not mean that is not necessarily a problem for many governments. [SEP] obama will hold a saturday session for the east asia tour, which is scheduled to begin in the first week of april. [SEP] 7/prnewswire - usnewswire/- - the university of south carolina plans to speak to president obama about his healthcare efforts today, a source said [SEP]
+
+===== sample 041 =====
+[CLS] % higher average payers will pay 80 % of their tax income than most, while he calls for 25 % to increase public sector sector salaries. [SEP] imbree, zumno said, " will be the most new - age athlete in football and professional field seen during the nfl's era in the 1930s and' 50s. [SEP] yes, i got a little out of it last few weeks when i didn't go up in the shower when i was sitting but i'm much more active on my feet. [SEP] in the early golden years of the last century, he was active in the international language as a [SEP]
+
+===== sample 042 =====
+[CLS] state university school head of agricultural supervision of animals and the deputy agriculture director of food research said in an email on the programme. [SEP] the prime minister, benjamin netanyahu, said that the president and the prime minister, benjamin netanyahu, agreed to talk whenever the issue of middle east peace was coming up. [SEP] after auctioning off private equity holdings valued at more than 6, 400bn euros ($4, 000bn), the world's largest investment bank was told to sell off its issuer funds. [SEP] the funding system wants these students and their families to create a decent amount of money. [SEP] this week [SEP]
+
+===== sample 043 =====
+[CLS]. [SEP] there's never any good way to do anything wrong - - and it's not either smart or necessary. [SEP] then, at the end of a two - minute speech, obama asked him to explain what he was doing, john mccain called the candidate unrealable and asked if she would ever be elected president if she was a conservative. [SEP] if we are in this situation, we can see what people need to be saying. [SEP] nevertheless, british prime minister john howard told the bbc that his country was ready to develop transparency and said the coalition government was open about what needed money - saving measures to help deal with [SEP]
+
+===== sample 044 =====
+[CLS] the news from u. s. president george w. bush: donald hagan said he's frustrated about president obama's decision today, saying that there is a clear and honest way to deal with iran, and if the president wants to work, he's going to be able to convince the world that we should get involved, " he says. [SEP] despite his charm and courage, he was calm and unable to impose himself. [SEP] mr williams met with his father, pete lumley, at a private reception. [SEP] he said he would not consult his mps on whom to call. [SEP] in the spring of 2003 [SEP]
+
+===== sample 045 =====
+[CLS] know that only tiger woods wants to be in television, and he's been very hesitant about what to talk about himself. [SEP] the aftermath of the financial crisis was so faring no one had expected. [SEP] that's part of the reason: that as the story starts to material itself, it's going to get into play. [SEP] after his father died, his family marvelled for the last few days at rumors about his private life, and he was surrounded by his wife and a pharmlogist. [SEP] america is re - establishing itself, waiting for us to make our own choices. [SEP] mr. ndepa [SEP]
+
+===== sample 046 =====
+[CLS], zimbabwe's opposition leader, said after meeting in the country's capital hararepan, at about 11 p. m. [SEP] the bank has said there is no reason to raise the price level, following the independent budget committee level meeting on the subject. [SEP] (cnn) - - when she's 17, she's 18. [SEP] it's fair for a child - - someone with a budget of around 3, 000 - - to reach the first four - school level in april 2010. [SEP] david hendermidnor, director of cim international's business strategy fund, said he believes the [SEP]
+
+===== sample 047 =====
+[CLS] - old boy in shropshire. [SEP] and when he has to deal with a person who has fallen behind on it and somebody who is trying to make some decisions on the current path, that won't take the time to stop. [SEP] but it wasn't enough to say that clooney has given his support in the last 18 months to bring that here. [SEP] the aigg has taken responsibility out of the law and made all major financial statements free of charge. [SEP] the debt sits now at $14 billion. [SEP] steve tharp, spokesman for the california nuclear regulatory commission, said he believed nothing could be wrong with [SEP]
+
+===== sample 048 =====
+[CLS]. [SEP] i know from my years that when i was married, i almost never know my partner would lose his job or my wife's life. [SEP] "it's next year, if she told me she is just going to be out, i'd think she's in a gloomy position," said steve schwab. [SEP] while the youngest is robbie keane, the manchester - born liverpool manager, westernak's dream of leading his club to european championship finals began in 1992, when he was made famous by his head coach, bill adams. [SEP] " it was a bad friday, i [SEP]
+
+===== sample 049 =====
+[CLS] to the people saying this is a problem... we don't do anything about them what people do... i just can't be talking about their own.... i don't do that....... these are the american people that want to give them so much money that the president probably doesn't even care of him. [SEP] he has cut the chances of france's largest progressive party, an party that lost the balance of power in parliament, the scandalous election in which sarkozy was left to become france's only member of the country's presidency [SEP]
+
+===== sample 050 =====
+[CLS], human rights and the nation's elections, "he added. [SEP] the wall street journal has seen its shares drop 3 % since december and finish at $54, down about 3 % on monday. [SEP] the incident was about 10 minutes per hour. [SEP] the climate change committee was headed by the former prime minister nick clegg. [SEP] adm mark sayed, a former former army general in western iraq and now a military veteran, said he did not expect to work with maliki's government to give his military support. [SEP]" we don't have much in way of interviewing a team's players, [SEP]
+
+===== sample 051 =====
+[CLS]. [SEP] hosniff said she had been watching a weekly stream of video at a time when police chief robert m. a. fisher was trying to build a new line of detective work. [SEP] but the man in the car said he was dead. [SEP] university professor professor mark pilaskiuby concedes that people don't have their promise of life in the future. [SEP] that process takes more than two years. [SEP] "it's not as good that he'll get, then it's going to be tough to get out and we all have to fight," he said. [SEP] the central [SEP]
+
+===== sample 052 =====
+[CLS] and often identified by young people who know about their friends, children's worth compared to their peers and their natural experience. [SEP] "i never know i would do this myself but it has always been very difficult," britton said. [SEP] it's a democracy. [SEP] "i don't believe the whole thing, but you'd have to look at the players on thursday and they are going to be in a professional nfl team like denver's," mccariff said. [SEP] mr thomas, 38, a bridge repair engineer, lives near swithbourne, woloss, makes £4 a day [SEP]
+
+===== sample 053 =====
+[CLS] before implosing. [SEP] those in the washington area, the national affluent are the most affluent group of african - americans. [SEP] that's all about knowing if i'm going to win the champions league and having to win next year because there's been a mix - up and stuff out there, and we'll put the game behind us now and on the ground. [SEP] this is the first major sale of british hedge funds in more than 40 years. [SEP] after the election, the party left the labour government over the area on public policy and the leader of the tuc group, david cameron, became the leader [SEP]
+
+===== sample 054 =====
+[CLS] killed by his brother and their 3 - year - old companion, jason breslin told the times of america. [SEP] "i am not the president," she said. [SEP] the new york biennale is becoming a new reality to living america and the art world, and i'm not concerned about public perception. [SEP] sowell's two - year career has been extended by six weeks since finishing her three - week degree at new york university. [SEP] "i've been frustrated because i'm never going to lose much time at the job, but he has to build up some big players," he said. [SEP] [SEP]
+
+===== sample 055 =====
+[CLS] it said. [SEP] sacramento, san francisco, april 16 (upi) - - the victim of a marijuana store owner died saturday night in his home state of san francisco, officials said. [SEP] he spent the money and help on his father, and helped his family, and now himself. [SEP] now it's the right way to stand up. [SEP] " we're all aware that is what they're doing, and they're doing it that way. [SEP] it's not the first time a sports school is involved in a minor league field involving global sports, soccer, professional baseball and sport - - while baseball [SEP]
+
+===== sample 056 =====
+[CLS] direction, "koran said. [SEP] when you are at the top of your team, and you don't try to do the same thing, you can dictate and get into doing something," jackson said. [SEP] state officials said james c. berenson, timothy j. seismith, deputy secretary for defense and david h. jones and james smith, the senior senior deputy defense secretary, had planned to testify in support of the u. s. - russia defense deal, called russia's missile space program, military officials said. [SEP] " it's a lot, a lot longer than 15 days [SEP]
+
+===== sample 057 =====
+[CLS] in vienna, matthew graham at the washington post in washington, michael verucchia in berlin and tom capello in washington contributed to this report. [SEP] last week, brown, the british stratulator to beijing, also cautioned against mr obama against commenting on its current position with china's foreign minister, wen jiechi. [SEP] the ailing 23 - year - old is almost certainly a story for success. [SEP] " you have to find out what is happening and i know the story of this situation. [SEP] he's a fast - money man, too, and it's much easier to think of going [SEP]
+
+===== sample 058 =====
+[CLS] front of the house. [SEP] you'd have to have mr. obama and the team need to make a lot more; there's a ball going over the fence, and there's a team that is trying to take a big lead. [SEP] mr brown has been fired. [SEP] mr. rapp, a former royal united singer, had to withdraw his name from his post at princeton university during his earliest days in the united states, one of the most influential voices of democracy, and now spent the decade in washington with many of his colleagues at the new york times. [SEP] it will cost £250, 000 and will [SEP]
+
+===== sample 059 =====
+[CLS] the impact of the financial crisis, they chose not to withdraw money from the banking system and re - establish failed programs, choosing instead to accept the crisis and try to go up with it. [SEP] the new team will be able to get its data on the field at the current cost of probably nearly five years ($3 billion), or over 100 billion years. [SEP] indeed, the charge in politics went nearly 10 years, not only with failure, but with a impatience with practicality. [SEP] it is not a manifestation of his professionalism, but rather a belief that he would rather study the work of people who had been able [SEP]
+
+===== sample 060 =====
+[CLS] police and military officials said semenya, a member of sri lanka's party, was a member of the french satellite television channel. [SEP] "but it's incredible that some kind of love thing happened and you think that i was going to get, and this is the issue of national security without ever doing it," he said of the washington post's stephen colbert report. [SEP] i do not believe that those in terms of education are inherently faltier than those elsewhere. [SEP] there is no good point of view. [SEP] the move comes after mounting efforts by china to crack down alleged human rights violations in the country [SEP]
+
+===== sample 061 =====
+[CLS] korea insists that its use of force is protected by international law. [SEP] 17 (ap) - - a teenager suspected of stealing body parts of a vietnam - era bird killed a pregnant dinosaur curator at a state university museum on monday. [SEP] there's clear differences in the nation's relationship with europe and the increasingly limited size of its economy. [SEP] in his campaign message, mr obama said he would like to talk to iran about its "strategic intentions," but declined to say he would try to build on his level of experience, experience and ambition "and urge them to" talk to the people. " [SEP] the proposal came [SEP]
+
+===== sample 062 =====
+[CLS] of the area's population. [SEP] "we are going to get through some sales this year," sharia said. [SEP] gordon jeffrey, senior director in the us department of national affairs and resources at the institute for international defense studies, will be asked about us policy on the north korea issues and us foreign policy policy on the nuclear and non - nuclear missile programs. [SEP] he had not had a public education and was made to take a degree in biology. [SEP] it's not fair to play biffin because he's "not talking about being an attorney," davis said. [SEP] the bank is likely to meet with [SEP]
+
+===== sample 063 =====
+[CLS] s estimated annual capital and stock price valued at between $150 and $120 a share. [SEP] less than half of the population and other members of the population have many friends, so it'll be a long time to get involved in the older population, experts said. [SEP] but the comments stemmed from comments by u. s. president barack obama that rice was a key point in a regional summit that said washington is concerned about iran and the status of north korea. [SEP] "what's right now is they're trying to move forward, the timing of this year is very important for the region," said david albright [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_diffusion_noise_steps_128steps_n64/noise_linear2to08_early_cosine_eta0p02_c256_detok_raw_samples.txt

@@ -0,0 +1,230 @@
+noise_linear2to08_early_cosine_eta0p02_c256_detok
+{
+  "type": "summary",
+  "name": "noise_linear2to08_early_cosine_eta0p02_c256",
+  "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt",
+  "step": 187000,
+  "decode": {
+    "kind": "categorical_fullvocab_diffusion_state_noise",
+    "config": "noise_linear2to08_early_cosine_eta0p02_c256",
+    "steps": 128,
+    "temp_start": 2.0,
+    "temp_end": 0.8,
+    "temp_schedule": "linear",
+    "t_power": 1.0,
+    "eta0": 0.02,
+    "eta_schedule": "early_cosine",
+    "noise_conc": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 49.24717321473146,
+    "nll_per_token": 3.896851969315648,
+    "tokens": 9530
+  },
+  "diversity": {
+    "sample_entropy": 4.190932299534418,
+    "unique_tokens": 1918,
+    "token_count": 8192,
+    "distinct_1": 0.234130859375,
+    "distinct_2": 0.7204724409448819,
+    "top_token_mass": 0.0516357421875
+  }
+}
+
+===== sample 000 =====
+[CLS] his car and a car seat in april last year. [SEP] with his second putt, he found 10 feet over the fairway and went for a par 5 to 12 feet. [SEP] in his time at the university of york law school, he had studied law and the art of film at nottingham medical school and never advised himself on philosophy with others, while several studies at city university in london saw him. [SEP] sekol added that his country is not specific. [SEP] the department is still working on his investigation, he said. [SEP] this is the music that i think about, and that makes it look like it. [SEP] mr [SEP]
+
+===== sample 001 =====
+[CLS]n sok and kim h - yuk, according to documents filed by the veteran media news site si. com. [SEP] dr jon collins and james anderson of the open source institute are collaborating in hybrid technology. [SEP] both mccain and obama campaign for mccain said obama made the decision to do it. [SEP] china and us ally the beijing government, involved in a row over the policy of britain's ministry of defence on the island in august 2009, insists that the two countries remain at their border over the nuclear issue, a foreign ministry reported thursday, according to reuters. [SEP] for more information on saas, visit the data center. [SEP]
+
+===== sample 002 =====
+[CLS] wouldn't do it if we once stood for a candidate to say: she's black - - i don't feel it right. [SEP] wayne mcneeley, the director of mississippi's health and human affairs and health, along with his two former clinton administration health officials, spoke at the state's annual health information technology conference, which was hosted by william johnson, head of the state's health administration. [SEP] it is understood it would also focus on other local issues - - including local housing, universities, the department of national park safety, language, language and education - - including the county council report. [SEP]
+
+===== sample 003 =====
+[CLS] t want anyone to make any case of massive waste of public money, and the matter has never been solved. [SEP] at least in the troubled trading year since lehman brothers began collapsing that year, shares have jumped more than 10 percent. [SEP] mr gueant made the call in the eu's first state of the union. [SEP] the measures, projected at between 2 to 15 feet long, will do it: there is no external pressure to watch. [SEP] but the other people refused the request. [SEP] there are 396 minerals, including 1, 000 tonnes of gold, approximately 19 gold, 75 golds and approximately 1. 8 [SEP]
+
+===== sample 004 =====
+[CLS] $200 million, with school grants to help poor people. [SEP] 8 (upi) - - florida school officials are weighing whether to launch a search for u. s. students to find a man who began returning home two weeks ago after last week's west coast train wreck. [SEP] "i am not disagreeing with the claim," brispie said. [SEP] without that, mr samara's position will not be put to a vote by his party. [SEP] next week, israel's foreign affairs ministry will use the annapolis conference on sunday to end the war in the 3, 500 - strong region, which [SEP]
+
+===== sample 005 =====
+[CLS]: 30 p. m. [SEP] 6, at 8 a. m. and ( 7: 15 p. m. [SEP] banna haetts, a 28 - year - old former construction worker and mother of four, was found with five childrens, two adults, and an elderly boy missing from a backwater in the town after a call about 1900 gmt. [SEP] in the case of sa' sau, owners rejected plans to move into the local hands of the local government. [SEP] the census bureau released wednesday showed the share of u. s. voters shot down to 36. 3 percent. [SEP] eu officials should [SEP]
+
+===== sample 006 =====
+[CLS] hillary clinton, bill clinton's chief of of staff, charles rangel, a former republican member of staff, criticized japan during her campaign against president bush. [SEP] the center's last century covered all areas of northern europe, asia and europe. [SEP] she comes from a home in paris, france, and is a trained, environmental education activist, working on channeling the knowledge and influence of local media, winning national and national recognition. [SEP] the campaign's spending more than she has with members of her own, and if she goes up the ranks, she can work with her on those issues. [SEP] general costello, the [SEP]
+
+===== sample 007 =====
+[CLS] of leyton, west london, and william mcfarland, 24, of richmond park. [SEP] teams from phnom and the university hospital will mark the start of a two - year development programme at longton vale hospital trust. [SEP] the program's losses range to be 500 skilled workers in over 30, 30, 000 jobs and retirement age, compared to those with more than 1, 000, 000 - year - old employees who likely still lose their jobs. [SEP] a coast rail spokesman said: the man was rescued from a metal rail at the rail terminal in douglas as he was driving with his children down the road at [SEP]
+
+===== sample 008 =====
+[CLS] last month, was unable to finish getting past the group for the first round. [SEP] at joint meetings of the us finance committee, he also announced that he was ready to talk about the deal and reportedly appealed to the americans for support. [SEP] one way people will be able to learn is to take some courses, and then get people to try to work out how this works. [SEP] "i thought, as we tried to get ahead in college, my kids could be able to and do what i need to do that can do," she said. [SEP] mckwelle, who hosted a dinner at this week's games [SEP]
+
+===== sample 009 =====
+[CLS] to close its debt in 2009. [SEP] several homes in corsham, northampton, brimley and longston were evacuated after the flames burst out of several homes on the west coast, mr gillies said. [SEP] why was he urging congress to end this war, and going to keep working together on this long after this war goes on. [SEP] that night this year, they held up a road blockade to block access to the building, which is barely afford - - this year has received $300 - - compared with $6. 5 million in its last year. [SEP] the police station in the chinese capital, with 5, [SEP]
+
+===== sample 010 =====
+[CLS] about 17, 000 people were in the study. [SEP] she grunts and not even laughs. [SEP] we must not accept this aggression and inhumanity in our history, "he said. [SEP]" it's been a long day, i went off to practice and it's a reflection of that, " he said. [SEP] in spain, the jobless rate of jobless benefits rose slightly to 6. 0 percent, after an increase of 7. 6 percent a year earlier. [SEP] the uk government sold £480m worth of legal bills in june. [SEP] this is 28. 6 points for the b. a. [SEP]
+
+===== sample 011 =====
+[CLS] [SEP] he said mr cameron would quickly add to his concerns about national identity, and start a national response to the crisis. [SEP] details on how to get the job done at that point. [SEP] built in the early 1980s as a figurehead for poverty, the state's former mayor and the democratic governor of arkansas is a white house spokeswoman. [SEP] the findings pointed to an increase in visitors from several countries including in the u. s.. [SEP] the government hopes to move into the guangfudag river basin to the north - west of southern china. [SEP] he also noted strathahn's political skill [SEP]
+
+===== sample 012 =====
+[CLS] [SEP] the german's record of winning 1, 500 starts on sunday is twice the record of world number one stenson, who shot 70 during his first round. [SEP] he said france should be playing football sunday, and britain has made its progress. [SEP] the end of the civil war only emerged on friday. [SEP] this is not, this should have any value, of course, " said dera seong da khuk, president of china and south africa affairs for the china national affairs centre board, which conducts meetings with chinese and international officials to assess human migration from the east andean region to north africa. [SEP] the [SEP]
+
+===== sample 013 =====
+[CLS] that mr. obama will lead the talks on sunday with more than two dozen world leaders. [SEP] lawrence welch, the former us minister for east asia and president sarkozy's communications director, had led talk of discussions about resuming middle - east contacts with nouri al - maliki. [SEP] she is a professor of law, law and family history at yale's sloan school of law and has taught in areas of law, history, science, technology, law, science, history, politics, business and administration and cross - community and urbanism. [SEP] she was admitted to the hospital late on thursday, the french president [SEP]
+
+===== sample 014 =====
+[CLS] led the election campaign by 12 months over the past 11 years, and threatened to lay out a strategy that its members could claim to support. [SEP] also, no matter how popular the american political wind was created by mr obama's campaign last year, one of the party's potential financial woes has remained remarkable. [SEP] in addition, mr. zell, ceo of the plano, ark., auto company, was a trustee. [SEP] in 2009, the company's net forecast will range from a profit of $1. 20 to a loss of $2 billion this year, and analysts said its share will increase [SEP]
+
+===== sample 015 =====
+[CLS] "he's still at his best," he said, his mouth and hands at his feet on the front line. [SEP] her use will have numerous consequences for state education service programs, including prison spending reform and education retlements. [SEP] or is he just in the middle of this campaign? [SEP] at a news conference at the house of representatives meeting, his deputy, david strickland, was grateful for obama. [SEP] but he said it would take longer to deal with the spiraling political deficit. [SEP] while there is ample keenness and willingness to take against the united states on climate change, which hails as democratic [SEP]
+
+===== sample 016 =====
+[CLS] the highest standards in safety. [SEP] his local school, which has almost 3 miles of land, also has a boarding school, and three miles from the course. [SEP] in the latest study, a total of 21 women were interviewed - men in their 30s, women in the 70s, men in the 80s and over (men and women) in their 40, 50 and 50. [SEP] yields for 10 - year us treasury fell 4. 6 per cent to 13. 46 per cent as the price of 10 - year us treasury bonds jumped 0. 4 per cent to 2, 031. 75 last thursday. [SEP] but until 2000 [SEP]
+
+===== sample 017 =====
+[CLS] opened to the public in 1997. [SEP] " when i finally came away from the us, the time he asked me if i really did live with me, i told him to look at what he was, not a guy who was close to young children and has just come through his life in some way anyway, his mind is moving in this way way the way he could walk and doesn't get us over this, unless, at least, he's trying to keep living in the future. [SEP] new jersey's gov. david smith said saturday he would consider a similar proposal. [SEP] dr bill mclachley, [SEP]
+
+===== sample 018 =====
+[CLS] a british woman, a german director and an actor, was arrested friday in poland on the morning after 14 years for trafficking cocaine in africa. [SEP] lennon will likely to be a huge part in manager harry redknapp's coaching staff. [SEP] the united states department of commerce, an actuary, has already signed a 12 - year law reducing emissions on automobile trucks. [SEP] the spending gap close to the current level will raise concerns about the level of money the government program needs to keep growth going. [SEP] the landscape of russia, for example, has its own share of its own sense of of itself. [SEP] the party also [SEP]
+
+===== sample 019 =====
+[CLS] illegal trafficking and said government law enforcement agencies were trying to make illegal practices legal. [SEP] "i think it is time for people to concede that we're putting that on the floor, or the other things you would agree on... if we're going to change that way, you have to go to some of that level to get something," he said. [SEP] uk forecasters have now called on the european bank non - bank for a post - financial crisis study to monitor the uk situation. [SEP] d i. d. s, b, and p. t. f. - 17. [SEP] " it [SEP]
+
+===== sample 020 =====
+[CLS] know what it is..... what do you think of that? "?, you can be sure, if you start to get a little deal of time.. the only way to get, and the truth is, "if he means something, i would just say" you don't know, " he's going to be asked for obama. and if you're going to vote for barack obama, it's going to have to help him to go along, not just because it's not your choice. you were the man to do the job. that's going to get you [SEP]
+
+===== sample 021 =====
+[CLS] prison term for the shootings but said that he was under threat. [SEP] q: they don't work out. [SEP] hu rogge, a chinaterism expert at the presidential election, began meetings with chinese officials in january, and he had said his government would try to reach a deal on a carbon reduction package for china and be willing to develop trade controls on coal - trapping emissions. [SEP] he said the two men - - drivers mark kikes and robert howard - - was stopped by the police when the boy was spotted late on arrival. [SEP] four days later, brunton's interception in the first quarter [SEP]
+
+===== sample 022 =====
+[CLS] declaration of war on this morning. [SEP] the company's consumer lending arm extends primarily to its commercial lending businesses, including u. s. home equity and residential mortgage markets. [SEP] trade net exports totaled $543 billion compared to the previous year, a 33 percent jump from $627 billion in the same period a year earlier, it said. [SEP] he praised obama's plan, which adds up to $200 billion of dollars in tax revenue, but said he has not received any specific and detailed proposals. [SEP] china's national administration and national committee office said in a statement on tuesday night of a public offering as " [SEP]
+
+===== sample 023 =====
+[CLS] year - old woman and her boyfriend, 15 - year - old john lawton. [SEP] richard evans, the metropolitan police's director for law enforcement operations, said the aim of deporting those who use their information would give them reason to run out of the law. [SEP] the missions of the offices of the fbi and the office of the national security have also expanded this year. [SEP] he said he began speaking at the law school in 2004, when he was first elected president of the university of troy high school in canton. [SEP] the group has also announced a new agreement that would allow the two companies to sanction on long [SEP]
+
+===== sample 024 =====
+[CLS] i was one of my best friends and my mother was at a sports club. [SEP] " you have to go anyway because they aren't already in place. [SEP] according to adm naeb elahn, who is the israeli prime minister, mr olmer, the political chairman of the israel economic council of the time, was one of the greatest key players of world war ii. [SEP] it went through a difficult stage before the meeting between the two koreas leaders to ensure that neither side would make progress to resolving the broader nuclear issue. [SEP] it is also a case of similar ethnic unrest in china and in china, where [SEP]
+
+===== sample 025 =====
+[CLS] the national security council in the days after the leak was revealed, u. s. office of inspector general john cooper will conduct an fbi investigation into the "smears" and e - mails by u. s. state department officials, he said. [SEP] greece has rejected calls of reverting to its territorial stance, particularly amid calls for the eu's currency to give its support to the need to put a spending plan to encourage the development of the economy. [SEP] detroit, june 16 (upi) - - a new detroit free newsroom has completed a 2, 000 - square - foot ford auto center and a [SEP]
+
+===== sample 026 =====
+[CLS] november 2007, estimated to be just over 2 million. [SEP] professor stomart kaur, who is director of the study group at the social institute of sussex university, notes that schools are likely to be more likely to give preference to mass - use the english language. [SEP] but he can't be charged. [SEP] the private equity fund jumped 1. 2. 3 per cent to the new york stock market, while assets from small - cap funds jumped 5. 6pc from $15. 7bn to $13. 5bn. [SEP] this state's most republican senator - - john d. roberts, mayor of the [SEP]
+
+===== sample 027 =====
+[CLS] 500 (£11, 016) a week. [SEP] most of the time, he was the vice president of the washington city school of administration, joining the state commission on science and technology. he served as chairman of the air department and led the local board of high education. [SEP] in one example, a coalition of medical experts have argued that young people should be aware of the risks of hiv screening in childhood. [SEP] the government still has a robust fiscal plan, which is roughly equal to the compounded amount of imf - fiscal assets, less than the treasury did in the late 1990s. [SEP] he was only 20 minutes in [SEP]
+
+===== sample 028 =====
+[CLS] - u. s. president barack obama said after a two - hour private meeting that he discussed the recent crisis on the korean peninsula. [SEP] both the owners and their former owner simon reid put the club close to acquiring the club as early as september. [SEP] 26 (upi) - - a small u. s. military cargo plane crashed in the indian ocean, killing three pilots and one person saturday, an official said. [SEP] the nation's best chance will be to equalize south carolina's first playing time since 1976. [SEP] it was expected to bring to coastal areas, including the same area of south carolina and california [SEP]
+
+===== sample 029 =====
+[CLS] academic studies published in the field of sports management, at the school of education, the college of public private sport and the major college of sport education at manchester university. [SEP] this growth is also reason for women to spend time in the water sector. [SEP] the u. s. presidential campaign continued to show it is where it wants to be: in nashville, palin raised money and gave in several states, and campaigned in the southern half of the state. [SEP] that was slower than the sales growth last year. [SEP] since more than two decades ago, the us property market has been down 55pc in the past six years. [SEP] [SEP]
+
+===== sample 030 =====
+[CLS], winning in 4: 57. 17. [SEP] n' aquila, dominican republic (ap) - a contract at the world's largest u. s. oil refinery has produced the first constition of oil in mexico's estimated 70 billion feet of natural gas deposits, officials said monday. [SEP] two people were taken into custody, police said. [SEP] subsquins: s ward, t robinson, g w aggani, a jacobsen (subs), g storl, g w plinson, d jones, h lawes; t facil, j whiting [SEP]
+
+===== sample 031 =====
+[CLS] it took five months to get tennis, playing sports, or becoming involved in another sports activity, experts noted that activity levels at the time could be considered recreational and exercise was likely to be a key source of activity during their lifetime. [SEP] and if you'd like to see my dad die, i'd have a good time, " he said. [SEP] mr couche, 58, the former finance chairman of bg's board, returned to the company over the course of three months, with the collapse of the company marked by a bitter dispute with other shareholders. [SEP] china's currency strength marks the beginning of a [SEP]
+
+===== sample 032 =====
+[CLS], the head of the terror organisation. [SEP] he spoke on friday, his third straight day to break that record. [SEP] people who go into the "final vacation weeks of the year" may return during the year if they earn 2, 000 to $3, 000 in fluctuate for the next 12 weeks, the report said. [SEP] the ims identified them as high - profile banks linked to the european union's financial sector crisis and the region's credit crisis in 2008. [SEP] indeed, he is a deprive figure as a man. [SEP] staff writer jon manley contributed to this report. [SEP] this, [SEP]
+
+===== sample 033 =====
+[CLS]ached so often for its goal of trying to raise the standard of the game, in the hands of the media and supporters. [SEP] defensively, mcenklin is the first person to play in the national hockey league. [SEP] mccain has closed the gap in obama's popularity over mccain - - 18. 8 points and clinton at 16. 7 points to 41. 5 percent during a five - year span in july, cnn pew research found. [SEP] (cnn) - - a university's decision to pay a teenager $25 a year for drinking marijuana has been ignored for years. [SEP] in the winter of 2009, [SEP]
+
+===== sample 034 =====
+[CLS] born blogger who wanted to create a part of their own work because of his sometimes playing style has sparked a controversy. [SEP] kansas, mo. beat the nation's best division teams, texas, st. h. s. central, st. a. s. s. p. s. east, 2001 and 2004. [SEP] assistant high school coach roy williams is a close friend to the beavers, who also became head coach of the beavers. [SEP] mr devine said they were shocked after his death, but insisted it was never established. [SEP] new york's most romantic city, a long, sometimes slow road, [SEP]
+
+===== sample 035 =====
+[CLS] the u. s. immigration and homeland security administration. [SEP] "we're disappointed with the bbc's decision on bbc wales but we are working on it and there is no change," said magabe. [SEP] he said in 2000 that the white paper would provide good news for its members. [SEP] in just the last few weeks, china heads of foreign leaders have stepped down with the country's new president, wen jiabao, to bring the issue to the beijing olympics, scheduled to take place sunday in china. [SEP] paul hollande was one of the world's best known playwrights - a respected member of [SEP]
+
+===== sample 036 =====
+[CLS] cate deferra, said: " this is disappointing because to many people that if we didn't know with all that evidence, the total is looking up. [SEP] that's not working. [SEP] paul wilson, 63, said the floor floor broke down after school saturday. [SEP] mr darling will urge gordon brown to focus on the economy and says he would support a new political coalition. [SEP] the bbc's mark duffy in the city said the country's megawat nuclear power station would would have been the world's biggest power plant to protect its current domesticity of 385 billion euros. [SEP] he added: [SEP]
+
+===== sample 037 =====
+[CLS] have no excuses "for this job," adding that he was just a victim of the situation. [SEP] japan's approach to security is an "open approach," according to the ministry, which includes many areas in science, technology, technology, education, and public education. [SEP] mr. bourton said the bond fund had already bought $1. 85 billion in debt and preferred stocks, or $4. 2 billion in cash and $1 billion in preferred stock. [SEP] gvt communications inc. had indicated that the deal is probably dead. [SEP] the news asked for its privacy. [SEP] the study is taking on [SEP]
+
+===== sample 038 =====
+[CLS] north korean involvement of china's military and military in the region, but issued no official statement outlining china's intentions to cut regional ties with the communist government. [SEP] while she was pleased, the minsk group, a group mr. obama and others have done to europe and asia, said that mr. obama's position as president would be "a good way to normal relations with russia" at the same time as president. [SEP] the prime minister held talks with senior labour and liberal governments at the weekend, but made only a comment on the exact details of what was for the tories to do. [SEP] obama and hillary [SEP]
+
+===== sample 039 =====
+[CLS] on the phone call, mr munching was asleep when he heard two shots fired at the house in winwood green, thornhill, on wednesday night. [SEP] this time, the woman is to have had a good relationship. [SEP] they look to him for advice. [SEP] of course, it's tough. [SEP] it's an idea that everybody stands behind. [SEP] " but no, i don't say the same way we do in canada. [SEP] by the time the baby died. [SEP] the idea might seem a bit baffling. [SEP] the negative comments came as the president's official u. s. [SEP]
+
+===== sample 040 =====
+[CLS]. [SEP] israel's international media on sunday issued a long statement issued by the groups and called saturday for the establishment of an independent palestinian state in israel. [SEP] according to a report by chinese - run news, the bbc quoted head of the congress - - china's people's congress - who told the president that the chinese leader could not comment on the incident. [SEP] the fees are, too, prostring in the republican chambers of congress. [SEP] wenger has also confirmed that over the summer he would like to make a move for the st james's club, who confirmed his move from west ham united in 2007 [SEP]
+
+===== sample 041 =====
+[CLS] gas companies. [SEP] french media said g - general daniel sevignoni, the vice chair of the government's financial stability committee, would issue a report. [SEP] mainly, he said, the group made investments in foreign countries. [SEP] he said she wanted him, but couldn't understand why. [SEP] "no, she said. [SEP] mcneill is a former colleague of thompson, close friend john fossey and former massachusetts democrat campaign adviser john mccluck. [SEP] she is currently vice president of the national book institute and a former professor at the western university, promoting" what's down there " - a [SEP]
+
+===== sample 042 =====
+[CLS] that they're most likely to feel very close to their children. [SEP] he has been mounting an international campaign this year due to his limited state experience. [SEP] it has become clear that his attempts to establish his own political movement are not only absurd, but to make the process of political reforms in latin america impossible. [SEP] philadelphia coach brian zorn was listed in the no. 6 spot. [SEP] washington (cnn) - - senator barack obama will address delegates from 11 p. m. to 7 p. m. on saturday, during a presidential debate saturday night at the white house, a bush - mccain event. [SEP] and the [SEP]
+
+===== sample 043 =====
+[CLS], the company's executive director of corporate communications. more than 20 employees and clients. [SEP] the image of the event is released on a bbc 4 website june 2007 and is based on the series of the watergate films, in which a young woman in the world would cost $1, 000 a week, but it makes a heck of a difference. [SEP] "we're very hopeful that we can make up for a lot of money in one presidential debate," clinton said. [SEP] the researchers, led by henry ford, david fisher and russell shaw, will care more about power and money than do their own science. [SEP] [SEP]
+
+===== sample 044 =====
+[CLS] weekend will feature golf's most high - profile event. [SEP] o' brien said he doesn't think he will be paid before the end of 2009. [SEP] if he should try to bring him the message, and then go away still with a few posts on it, that is about to be politics. [SEP] the talks, however, has the biggest damage to both the world's talks on global warming and global warming that both leaders have failed to agree to in a meeting that set out ambitious levels to reduce global warming. [SEP] he said he would not make any decisions on whether to appeal. [SEP] it's hard to [SEP]
+
+===== sample 045 =====
+[CLS]. 6 billion, last year, came in higher than the second half of the year (10 million euros, at 12. 2 million dollars). [SEP] but that was far more than some thought of what his legacy might be. [SEP] the problem is that if another industry wants to downsize, the concept of "regulation," or just the way it never works out, will be that it's published somewhere in the books. [SEP] the state's pension system will need to keep up with increasing demand. [SEP] it is true that mr cameron, who is trying to make do with them for his wife sarah. [SEP] there [SEP]
+
+===== sample 046 =====
+[CLS], britain's armed forces announced a news conference in the country's capital, kabul. [SEP] school begins on feb. [SEP] edwards says the two f. i. f. could run out of cash, merging them would create problems and develop a regulatory system. [SEP] (ap) - a 19 - story house on long island's long island has broken into a small town of 40 million - 35 meters (11 square feet), making it easier for the two neighboring developers to work together, officials said. [SEP] after a brief discussion, obama was asked by a local reporter whether he could have any examples of clinton and edwards [SEP]
+
+===== sample 047 =====
+[CLS] - old employee has been offered six months after agreeing a pay deal with a company which has fallen short of key cash targets. [SEP] people think america can change history several times, and that it can elect a black president, but the current republican administration may not see an answer and plenty of prominent black senators and others are interested in reopening the role that the nation is the fad that has brought america together. [SEP] mr holod, who is living in the home of a science degree professor at strathmore school, oxford, has spoken for his wife, catherine, who says that he does not think she has the [SEP]
+
+===== sample 048 =====
+[CLS] ju mee - hag. [SEP] pyon muang, the chinese minister of state security, said: "china and we are partners in china's development and china is responsible for the future." [SEP] new york (ap) - wall street's economy plummeted in the first quarter but has raised its economic forecast to 9 percent. [SEP] the reserve bank of india and the bank of england announced rate plans on friday. [SEP] he said he was embarrassed by what he saw by police and will no doubt join in the case that brought on his former boss, scott conley. [SEP] in a similar way, china [SEP]
+
+===== sample 049 =====
+[CLS] after a few weeks of peace negotiations with the two news agencies. [SEP] travel abroad with royal british helicopter travel service (0870 803 43997; 0045 5083 60960). [SEP] the 26 - year - old was was found dead in the crash at 7. 30pm on saturday, 11 january after arguing with her partner steve mccraughne. [SEP] i tried to wonder that obama was taking the president, particularly in an audience that was the voice of america onstage. [SEP] the war to the bone is coming to an end. [SEP] he didn't say much of a reason. [SEP] in [SEP]
+
+===== sample 050 =====
+[CLS] collapse of several of the nation's insolvent firms. [SEP] " the democrats are going to have to do more before runing a campaign this november. [SEP] a healthier economy and green eco - economic development will make it more competitive and green. [SEP] the new points system was developed by the school's french president, david lamy, an under - 16 team who played a green card, a two - year old from britain and a two - year - old man from manchester. [SEP] today, james claxe, executive director of care, said their concerns, a result of the authority's industrial action, [SEP]
+
+===== sample 051 =====
+[CLS] florida, texas and california. [SEP] "they could have gone three different teams at the same time. [SEP]" they've been talking, " putin said at a news conference after meeting russian prime minister vladimir putin. [SEP] the list of information is on the bbc university panel show at website: www. bbcestimates. co. com, by contacting the bbc health information centre. [SEP] the national guard said late thursday no oil had been found in the gulf coast. [SEP] gail baffert, who works with auhella's school of professional health, says the history of what happened to zamora is now part [SEP]
+
+===== sample 052 =====
+[CLS] said. [SEP] by the end of the 19th century, the museum's biggest hall of the night - - with its glastonbury and sexton - - the public is realising that it's now only the best way here. [SEP] ireland's participation rates are high to match the levels of its players. [SEP] after finishing a printing job in chicago, at the age of 28, and ended up working in an unpatried factory, he developed a reputation that embodied the art of the famous television crave: a natural sense of humor on the side. [SEP] if your boyfriend wanted to buy food in exchange, [SEP]
+
+===== sample 053 =====
+[CLS] [SEP] not that we're talking about the tory party, the conservative tories, the previous conservative government, the war in iraq - irresponsible. [SEP] no - one wants to hide things. [SEP] but yesterday, the koo said that there had been no tie - up in the trade talks, despite a media report texting his wife in stockholm. [SEP] david brunchard of the local children's association said the hospital was closed two times a day after the school went bad. [SEP] acting as current thai president, kulsief moved out of politics as a standby two months ago but he is [SEP]
+
+===== sample 054 =====
+[CLS] the champions league of the 2001 - 1990s. [SEP] no need to deal with israel and to the palestinians. [SEP] staff writers paul f. gordon and curt o' toole contributed to this. [SEP] that's a true story set in the government's battle to bring to a country of all british citizens. [SEP] then eto' o's second pass, four yards after fagan, allowed lampard to find the spanish goal line. [SEP] the then - governor of the island, yu hao, leader of the country's ruling party, said he would not be prepared to run for election. [SEP] the car, [SEP]
+
+===== sample 055 =====
+[CLS]r ). [SEP] they'll then have to retool their property. [SEP] the bill also received strong support from michel cowen, ambassador to the european union, in a statement, citing "strong growth in the greek economy." [SEP] david govd, the uk's conservative leader, said: "the great deal of the time was to deal with john yettaw. [SEP]" it's nice to know, i think this as well. [SEP] they don't like the film, which already has earned him five years in prison and could make her look much more appealing, the union - times reported wednesday [SEP]
+
+===== sample 056 =====
+[CLS] korea, india, and india. "[SEP]" in the end, you have to go and you can't wait, do the talking, and then just dictate what we were doing at the last minute in time, "mccain said later on nbc. [SEP] president barack obama called tom boklin, north korea's u. s. spokesman, to hong kong monday, to discuss the details of a message of engagement in beijing. [SEP] johnson (r - wyo.), who served as the house appropriations committee chairman for eight years. [SEP]" it's a bit of a political thing, in fact [SEP]
+
+===== sample 057 =====
+[CLS] plans to move to the roxy music center and arts centre in east london. [SEP] its friends and schools increasingly popularise its traditional learning techniques. [SEP] mr. hu, who met japanese prime minister celso aso for a week, will be joined by japan's foreign minister saki hosakun, who is also to speak at the summit in china, but his chinese secretary dai thiwoo said the president's visit must be approved by other leaders. [SEP] in the terms of house price data, that's 82 per cent below february's figure; it's 70 per cent higher than the [SEP]
+
+===== sample 058 =====
+[CLS], french foreign ministry arpees said. [SEP] ironically, mr. mcsweek has taken a more aggressive approach: it's about as different as a party poll: there's a man's call to make people stand up. [SEP] palin spoke on jan. [SEP] it was also the subject of mccain's decision to close the guantanamo detention center. [SEP] obama said he still simply did not agree with the problem, and the one question that the majority of his supporters can address. [SEP] he said he also was disappointed to see the leaders discussing issues the talks had not reached - - north korea's continued [SEP]
+
+===== sample 059 =====
+[CLS] volunteers, the morgan family foundation serves as a free foundation for young, women, poor and working - class people throughout the state. [SEP] tickets £30. £29, £70087, www. travelnet. com; 0871977, £174 (0845267. com); £64, £696, 08450 9773 664; £970, 080 0863 717; ££20. 50, bigrow. com ). [SEP] the first round is out of the semi - finals. [SEP] he really worked [SEP]
+
+===== sample 060 =====
+[CLS] northeast and violence has spread to tallies in the north. [SEP] the triumph spoiled the tar heels' perfect run for super bowl xliv. [SEP] he knows gm's capital needs of more than $100 billion - - and the company doesn't know exactly how that is because he'll have to think about it any more. [SEP] the company said it would provide more details to shareholders. [SEP] but the nations that have continued to go by governments around the globe have taken huge risks. [SEP] but china and russia still have a great policy gap. [SEP] the u. s. insisted that a special human rights commission investigate the human [SEP]
+
+===== sample 061 =====
+[CLS] of training materials and funds for the school, devise to provide long - needed infrastructure, help hire school superintendents and provide its own funding for the schools. [SEP] the head of britain's national bar association, eric rostlert, has announced plans for a training competition to have around 2, 000 spectators set up their own for the games. [SEP] olmert has no experience and is free to stand down. [SEP] that was significant. [SEP] the committee report also asked secretary - general robert gates to call for a comprehensive review of the war in iraq. [SEP] his focus was always on the ability to protect the country, [SEP]
+
+===== sample 062 =====
+[CLS]. [SEP] it's not clear whether he will discuss that with doctors, said columbia university's professors, d. alan rorese and w. howard taylor of the northwestern university of chicago, as a medical adviser. [SEP] indeed, it's difficult to be a sort of pro - college football player, provided by the college and high - level league level. [SEP] he did not know about how it happened, the official said. [SEP] the truth is, the nation must not refer to the "bush politics" of government and we must stretch back - - except by our own gimmicks. [SEP] he is not [SEP]
+
+===== sample 063 =====
+[CLS] on a variety show. [SEP] then the president needs to improve his preparedness and get away from the details. [SEP] on sunday, the leader of the national union of students in north america region said her government had decided to continue its protest of the costs of the hospital. [SEP] but, according to analysts, a increase in bank income is expected to support dubai's growth plan. [SEP] what makes him a narcole: as a police officer, everyone who gets shot. [SEP] after playing for redknapp, southgate joined mck in portsmouth earlier this season before being signed for the club, but he was overlooked in [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_diffusion_noise_steps_128steps_n64/noise_linear2to08_early_cosine_eta0p02_c256_raw_samples.txt

@@ -0,0 +1,230 @@
+noise_linear2to08_early_cosine_eta0p02_c256
+{
+  "type": "summary",
+  "name": "noise_linear2to08_early_cosine_eta0p02_c256",
+  "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt",
+  "step": 187000,
+  "decode": {
+    "kind": "categorical_fullvocab_diffusion_state_noise",
+    "config": "noise_linear2to08_early_cosine_eta0p02_c256",
+    "steps": 128,
+    "temp_start": 2.0,
+    "temp_end": 0.8,
+    "temp_schedule": "linear",
+    "t_power": 1.0,
+    "eta0": 0.02,
+    "eta_schedule": "early_cosine",
+    "noise_conc": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 49.24717321473146,
+    "nll_per_token": 3.896851969315648,
+    "tokens": 9530
+  },
+  "diversity": {
+    "sample_entropy": 4.190932299534418,
+    "unique_tokens": 1918,
+    "token_count": 8192,
+    "distinct_1": 0.234130859375,
+    "distinct_2": 0.7204724409448819,
+    "top_token_mass": 0.0516357421875
+  }
+}
+
+===== sample 000 =====
+[CLS] his car and a car seat in april last year. [SEP] with his second putt, he found 10 feet over the fairway and went for a par 5 to 12 feet. [SEP] in his time at the university of york law school, he had studied law and the art of film at nottingham medical school and never advised himself on philosophy with others, while several studies at city university in london saw him. [SEP] sekol added that his country is not specific. [SEP] the department is still working on his investigation, he said. [SEP] this is the music that i think about, and that makes it look like it. [SEP] mr [SEP]
+
+===== sample 001 =====
+[CLS]n sok and kim h - yuk, according to documents filed by the veteran media news site si. com. [SEP] dr jon collins and james anderson of the open source institute are collaborating in hybrid technology. [SEP] both mccain and obama campaign for mccain said obama made the decision to do it. [SEP] china and us ally the beijing government, involved in a row over the policy of britain ' s ministry of defence on the island in august 2009, insists that the two countries remain at their border over the nuclear issue, a foreign ministry reported thursday, according to reuters. [SEP] for more information on saas, visit the data center. [SEP]
+
+===== sample 002 =====
+[CLS] wouldn ' t do it if we once stood for a candidate to say : she ' s black - - i don ' t feel it right. [SEP] wayne mcneeley, the director of mississippi ' s health and human affairs and health, along with his two former clinton administration health officials, spoke at the state ' s annual health information technology conference, which was hosted by william johnson, head of the state ' s health administration. [SEP] it is understood it would also focus on other local issues - - including local housing, universities, the department of national park safety, language, language and education - - including the county council report. [SEP]
+
+===== sample 003 =====
+[CLS] t want anyone to make any case of massive waste of public money, and the matter has never been solved. [SEP] at least in the troubled trading year since lehman brothers began collapsing that year, shares have jumped more than 10 percent. [SEP] mr gueant made the call in the eu ' s first state of the union. [SEP] the measures, projected at between 2 to 15 feet long, will do it : there is no external pressure to watch. [SEP] but the other people refused the request. [SEP] there are 396 minerals, including 1, 000 tonnes of gold, approximately 19 gold, 75 golds and approximately 1. 8 [SEP]
+
+===== sample 004 =====
+[CLS] $ 200 million, with school grants to help poor people. [SEP] 8 ( upi ) - - florida school officials are weighing whether to launch a search for u. s. students to find a man who began returning home two weeks ago after last week ' s west coast train wreck. [SEP] " i am not disagreeing with the claim, " brispie said. [SEP] without that, mr samara ' s position will not be put to a vote by his party. [SEP] next week, israel ' s foreign affairs ministry will use the annapolis conference on sunday to end the war in the 3, 500 - strong region, which [SEP]
+
+===== sample 005 =====
+[CLS] : 30 p. m. [SEP] 6, at 8 a. m. and ( 7 : 15 p. m. [SEP] banna haetts, a 28 - year - old former construction worker and mother of four, was found with five childrens, two adults, and an elderly boy missing from a backwater in the town after a call about 1900 gmt. [SEP] in the case of sa ' sau, owners rejected plans to move into the local hands of the local government. [SEP] the census bureau released wednesday showed the share of u. s. voters shot down to 36. 3 percent. [SEP] eu officials should [SEP]
+
+===== sample 006 =====
+[CLS] hillary clinton, bill clinton ' s chief of of staff, charles rangel, a former republican member of staff, criticized japan during her campaign against president bush. [SEP] the center ' s last century covered all areas of northern europe, asia and europe. [SEP] she comes from a home in paris, france, and is a trained, environmental education activist, working on channeling the knowledge and influence of local media, winning national and national recognition. [SEP] the campaign ' s spending more than she has with members of her own, and if she goes up the ranks, she can work with her on those issues. [SEP] general costello, the [SEP]
+
+===== sample 007 =====
+[CLS] of leyton, west london, and william mcfarland, 24, of richmond park. [SEP] teams from phnom and the university hospital will mark the start of a two - year development programme at longton vale hospital trust. [SEP] the program ' s losses range to be 500 skilled workers in over 30, 30, 000 jobs and retirement age, compared to those with more than 1, 000, 000 - year - old employees who likely still lose their jobs. [SEP] a coast rail spokesman said : the man was rescued from a metal rail at the rail terminal in douglas as he was driving with his children down the road at [SEP]
+
+===== sample 008 =====
+[CLS] last month, was unable to finish getting past the group for the first round. [SEP] at joint meetings of the us finance committee, he also announced that he was ready to talk about the deal and reportedly appealed to the americans for support. [SEP] one way people will be able to learn is to take some courses, and then get people to try to work out how this works. [SEP] " i thought, as we tried to get ahead in college, my kids could be able to and do what i need to do that can do, " she said. [SEP] mckwelle, who hosted a dinner at this week ' s games [SEP]
+
+===== sample 009 =====
+[CLS] to close its debt in 2009. [SEP] several homes in corsham, northampton, brimley and longston were evacuated after the flames burst out of several homes on the west coast, mr gillies said. [SEP] why was he urging congress to end this war, and going to keep working together on this long after this war goes on. [SEP] that night this year, they held up a road blockade to block access to the building, which is barely afford - - this year has received $ 300 - - compared with $ 6. 5 million in its last year. [SEP] the police station in the chinese capital, with 5, [SEP]
+
+===== sample 010 =====
+[CLS] about 17, 000 people were in the study. [SEP] she grunts and not even laughs. [SEP] we must not accept this aggression and inhumanity in our history, " he said. [SEP] " it ' s been a long day, i went off to practice and it ' s a reflection of that, " he said. [SEP] in spain, the jobless rate of jobless benefits rose slightly to 6. 0 percent, after an increase of 7. 6 percent a year earlier. [SEP] the uk government sold £480m worth of legal bills in june. [SEP] this is 28. 6 points for the b. a. [SEP]
+
+===== sample 011 =====
+[CLS] [SEP] he said mr cameron would quickly add to his concerns about national identity, and start a national response to the crisis. [SEP] details on how to get the job done at that point. [SEP] built in the early 1980s as a figurehead for poverty, the state ' s former mayor and the democratic governor of arkansas is a white house spokeswoman. [SEP] the findings pointed to an increase in visitors from several countries including in the u. s.. [SEP] the government hopes to move into the guangfudag river basin to the north - west of southern china. [SEP] he also noted strathahn ' s political skill [SEP]
+
+===== sample 012 =====
+[CLS] [SEP] the german ' s record of winning 1, 500 starts on sunday is twice the record of world number one stenson, who shot 70 during his first round. [SEP] he said france should be playing football sunday, and britain has made its progress. [SEP] the end of the civil war only emerged on friday. [SEP] this is not, this should have any value, of course, " said dera seong da khuk, president of china and south africa affairs for the china national affairs centre board, which conducts meetings with chinese and international officials to assess human migration from the east andean region to north africa. [SEP] the [SEP]
+
+===== sample 013 =====
+[CLS] that mr. obama will lead the talks on sunday with more than two dozen world leaders. [SEP] lawrence welch, the former us minister for east asia and president sarkozy ' s communications director, had led talk of discussions about resuming middle - east contacts with nouri al - maliki. [SEP] she is a professor of law, law and family history at yale ' s sloan school of law and has taught in areas of law, history, science, technology, law, science, history, politics, business and administration and cross - community and urbanism. [SEP] she was admitted to the hospital late on thursday, the french president [SEP]
+
+===== sample 014 =====
+[CLS] led the election campaign by 12 months over the past 11 years, and threatened to lay out a strategy that its members could claim to support. [SEP] also, no matter how popular the american political wind was created by mr obama ' s campaign last year, one of the party ' s potential financial woes has remained remarkable. [SEP] in addition, mr. zell, ceo of the plano, ark., auto company, was a trustee. [SEP] in 2009, the company ' s net forecast will range from a profit of $ 1. 20 to a loss of $ 2 billion this year, and analysts said its share will increase [SEP]
+
+===== sample 015 =====
+[CLS] " he ' s still at his best, " he said, his mouth and hands at his feet on the front line. [SEP] her use will have numerous consequences for state education service programs, including prison spending reform and education retlements. [SEP] or is he just in the middle of this campaign? [SEP] at a news conference at the house of representatives meeting, his deputy, david strickland, was grateful for obama. [SEP] but he said it would take longer to deal with the spiraling political deficit. [SEP] while there is ample keenness and willingness to take against the united states on climate change, which hails as democratic [SEP]
+
+===== sample 016 =====
+[CLS] the highest standards in safety. [SEP] his local school, which has almost 3 miles of land, also has a boarding school, and three miles from the course. [SEP] in the latest study, a total of 21 women were interviewed - men in their 30s, women in the 70s, men in the 80s and over ( men and women ) in their 40, 50 and 50. [SEP] yields for 10 - year us treasury fell 4. 6 per cent to 13. 46 per cent as the price of 10 - year us treasury bonds jumped 0. 4 per cent to 2, 031. 75 last thursday. [SEP] but until 2000 [SEP]
+
+===== sample 017 =====
+[CLS] opened to the public in 1997. [SEP] " when i finally came away from the us, the time he asked me if i really did live with me, i told him to look at what he was, not a guy who was close to young children and has just come through his life in some way anyway, his mind is moving in this way way the way he could walk and doesn ' t get us over this, unless, at least, he ' s trying to keep living in the future. [SEP] new jersey ' s gov. david smith said saturday he would consider a similar proposal. [SEP] dr bill mclachley, [SEP]
+
+===== sample 018 =====
+[CLS] a british woman, a german director and an actor, was arrested friday in poland on the morning after 14 years for trafficking cocaine in africa. [SEP] lennon will likely to be a huge part in manager harry redknapp ' s coaching staff. [SEP] the united states department of commerce, an actuary, has already signed a 12 - year law reducing emissions on automobile trucks. [SEP] the spending gap close to the current level will raise concerns about the level of money the government program needs to keep growth going. [SEP] the landscape of russia, for example, has its own share of its own sense of of itself. [SEP] the party also [SEP]
+
+===== sample 019 =====
+[CLS] illegal trafficking and said government law enforcement agencies were trying to make illegal practices legal. [SEP] " i think it is time for people to concede that we ' re putting that on the floor, or the other things you would agree on... if we ' re going to change that way, you have to go to some of that level to get something, " he said. [SEP] uk forecasters have now called on the european bank non - bank for a post - financial crisis study to monitor the uk situation. [SEP] d i. d. s, b, and p. t. f. - 17. [SEP] " it [SEP]
+
+===== sample 020 =====
+[CLS] know what it is..... what do you think of that? "?, you can be sure, if you start to get a little deal of time.. the only way to get, and the truth is, " if he means something, i would just say " you don ' t know, " he ' s going to be asked for obama. and if you ' re going to vote for barack obama, it ' s going to have to help him to go along, not just because it ' s not your choice. you were the man to do the job. that ' s going to get you [SEP]
+
+===== sample 021 =====
+[CLS] prison term for the shootings but said that he was under threat. [SEP] q : they don ' t work out. [SEP] hu rogge, a chinaterism expert at the presidential election, began meetings with chinese officials in january, and he had said his government would try to reach a deal on a carbon reduction package for china and be willing to develop trade controls on coal - trapping emissions. [SEP] he said the two men - - drivers mark kikes and robert howard - - was stopped by the police when the boy was spotted late on arrival. [SEP] four days later, brunton ' s interception in the first quarter [SEP]
+
+===== sample 022 =====
+[CLS] declaration of war on this morning. [SEP] the company ' s consumer lending arm extends primarily to its commercial lending businesses, including u. s. home equity and residential mortgage markets. [SEP] trade net exports totaled $ 543 billion compared to the previous year, a 33 percent jump from $ 627 billion in the same period a year earlier, it said. [SEP] he praised obama ' s plan, which adds up to $ 200 billion of dollars in tax revenue, but said he has not received any specific and detailed proposals. [SEP] china ' s national administration and national committee office said in a statement on tuesday night of a public offering as " [SEP]
+
+===== sample 023 =====
+[CLS] year - old woman and her boyfriend, 15 - year - old john lawton. [SEP] richard evans, the metropolitan police ' s director for law enforcement operations, said the aim of deporting those who use their information would give them reason to run out of the law. [SEP] the missions of the offices of the fbi and the office of the national security have also expanded this year. [SEP] he said he began speaking at the law school in 2004, when he was first elected president of the university of troy high school in canton. [SEP] the group has also announced a new agreement that would allow the two companies to sanction on long [SEP]
+
+===== sample 024 =====
+[CLS] i was one of my best friends and my mother was at a sports club. [SEP] " you have to go anyway because they aren ' t already in place. [SEP] according to adm naeb elahn, who is the israeli prime minister, mr olmer, the political chairman of the israel economic council of the time, was one of the greatest key players of world war ii. [SEP] it went through a difficult stage before the meeting between the two koreas leaders to ensure that neither side would make progress to resolving the broader nuclear issue. [SEP] it is also a case of similar ethnic unrest in china and in china, where [SEP]
+
+===== sample 025 =====
+[CLS] the national security council in the days after the leak was revealed, u. s. office of inspector general john cooper will conduct an fbi investigation into the " smears " and e - mails by u. s. state department officials, he said. [SEP] greece has rejected calls of reverting to its territorial stance, particularly amid calls for the eu ' s currency to give its support to the need to put a spending plan to encourage the development of the economy. [SEP] detroit, june 16 ( upi ) - - a new detroit free newsroom has completed a 2, 000 - square - foot ford auto center and a [SEP]
+
+===== sample 026 =====
+[CLS] november 2007, estimated to be just over 2 million. [SEP] professor stomart kaur, who is director of the study group at the social institute of sussex university, notes that schools are likely to be more likely to give preference to mass - use the english language. [SEP] but he can ' t be charged. [SEP] the private equity fund jumped 1. 2. 3 per cent to the new york stock market, while assets from small - cap funds jumped 5. 6pc from $ 15. 7bn to $ 13. 5bn. [SEP] this state ' s most republican senator - - john d. roberts, mayor of the [SEP]
+
+===== sample 027 =====
+[CLS] 500 ( £11, 016 ) a week. [SEP] most of the time, he was the vice president of the washington city school of administration, joining the state commission on science and technology. he served as chairman of the air department and led the local board of high education. [SEP] in one example, a coalition of medical experts have argued that young people should be aware of the risks of hiv screening in childhood. [SEP] the government still has a robust fiscal plan, which is roughly equal to the compounded amount of imf - fiscal assets, less than the treasury did in the late 1990s. [SEP] he was only 20 minutes in [SEP]
+
+===== sample 028 =====
+[CLS] - u. s. president barack obama said after a two - hour private meeting that he discussed the recent crisis on the korean peninsula. [SEP] both the owners and their former owner simon reid put the club close to acquiring the club as early as september. [SEP] 26 ( upi ) - - a small u. s. military cargo plane crashed in the indian ocean, killing three pilots and one person saturday, an official said. [SEP] the nation ' s best chance will be to equalize south carolina ' s first playing time since 1976. [SEP] it was expected to bring to coastal areas, including the same area of south carolina and california [SEP]
+
+===== sample 029 =====
+[CLS] academic studies published in the field of sports management, at the school of education, the college of public private sport and the major college of sport education at manchester university. [SEP] this growth is also reason for women to spend time in the water sector. [SEP] the u. s. presidential campaign continued to show it is where it wants to be : in nashville, palin raised money and gave in several states, and campaigned in the southern half of the state. [SEP] that was slower than the sales growth last year. [SEP] since more than two decades ago, the us property market has been down 55pc in the past six years. [SEP] [SEP]
+
+===== sample 030 =====
+[CLS], winning in 4 : 57. 17. [SEP] n ' aquila, dominican republic ( ap ) - a contract at the world ' s largest u. s. oil refinery has produced the first constition of oil in mexico ' s estimated 70 billion feet of natural gas deposits, officials said monday. [SEP] two people were taken into custody, police said. [SEP] subsquins : s ward, t robinson, g w aggani, a jacobsen ( subs ), g storl, g w plinson, d jones, h lawes ; t facil, j whiting [SEP]
+
+===== sample 031 =====
+[CLS] it took five months to get tennis, playing sports, or becoming involved in another sports activity, experts noted that activity levels at the time could be considered recreational and exercise was likely to be a key source of activity during their lifetime. [SEP] and if you ' d like to see my dad die, i ' d have a good time, " he said. [SEP] mr couche, 58, the former finance chairman of bg ' s board, returned to the company over the course of three months, with the collapse of the company marked by a bitter dispute with other shareholders. [SEP] china ' s currency strength marks the beginning of a [SEP]
+
+===== sample 032 =====
+[CLS], the head of the terror organisation. [SEP] he spoke on friday, his third straight day to break that record. [SEP] people who go into the " final vacation weeks of the year " may return during the year if they earn 2, 000 to $ 3, 000 in fluctuate for the next 12 weeks, the report said. [SEP] the ims identified them as high - profile banks linked to the european union ' s financial sector crisis and the region ' s credit crisis in 2008. [SEP] indeed, he is a deprive figure as a man. [SEP] staff writer jon manley contributed to this report. [SEP] this, [SEP]
+
+===== sample 033 =====
+[CLS]ached so often for its goal of trying to raise the standard of the game, in the hands of the media and supporters. [SEP] defensively, mcenklin is the first person to play in the national hockey league. [SEP] mccain has closed the gap in obama ' s popularity over mccain - - 18. 8 points and clinton at 16. 7 points to 41. 5 percent during a five - year span in july, cnn pew research found. [SEP] ( cnn ) - - a university ' s decision to pay a teenager $ 25 a year for drinking marijuana has been ignored for years. [SEP] in the winter of 2009, [SEP]
+
+===== sample 034 =====
+[CLS] born blogger who wanted to create a part of their own work because of his sometimes playing style has sparked a controversy. [SEP] kansas, mo. beat the nation ' s best division teams, texas, st. h. s. central, st. a. s. s. p. s. east, 2001 and 2004. [SEP] assistant high school coach roy williams is a close friend to the beavers, who also became head coach of the beavers. [SEP] mr devine said they were shocked after his death, but insisted it was never established. [SEP] new york ' s most romantic city, a long, sometimes slow road, [SEP]
+
+===== sample 035 =====
+[CLS] the u. s. immigration and homeland security administration. [SEP] " we ' re disappointed with the bbc ' s decision on bbc wales but we are working on it and there is no change, " said magabe. [SEP] he said in 2000 that the white paper would provide good news for its members. [SEP] in just the last few weeks, china heads of foreign leaders have stepped down with the country ' s new president, wen jiabao, to bring the issue to the beijing olympics, scheduled to take place sunday in china. [SEP] paul hollande was one of the world ' s best known playwrights - a respected member of [SEP]
+
+===== sample 036 =====
+[CLS] cate deferra, said : " this is disappointing because to many people that if we didn ' t know with all that evidence, the total is looking up. [SEP] that ' s not working. [SEP] paul wilson, 63, said the floor floor broke down after school saturday. [SEP] mr darling will urge gordon brown to focus on the economy and says he would support a new political coalition. [SEP] the bbc ' s mark duffy in the city said the country ' s megawat nuclear power station would would have been the world ' s biggest power plant to protect its current domesticity of 385 billion euros. [SEP] he added : [SEP]
+
+===== sample 037 =====
+[CLS] have no excuses " for this job, " adding that he was just a victim of the situation. [SEP] japan ' s approach to security is an " open approach, " according to the ministry, which includes many areas in science, technology, technology, education, and public education. [SEP] mr. bourton said the bond fund had already bought $ 1. 85 billion in debt and preferred stocks, or $ 4. 2 billion in cash and $ 1 billion in preferred stock. [SEP] gvt communications inc. had indicated that the deal is probably dead. [SEP] the news asked for its privacy. [SEP] the study is taking on [SEP]
+
+===== sample 038 =====
+[CLS] north korean involvement of china ' s military and military in the region, but issued no official statement outlining china ' s intentions to cut regional ties with the communist government. [SEP] while she was pleased, the minsk group, a group mr. obama and others have done to europe and asia, said that mr. obama ' s position as president would be " a good way to normal relations with russia " at the same time as president. [SEP] the prime minister held talks with senior labour and liberal governments at the weekend, but made only a comment on the exact details of what was for the tories to do. [SEP] obama and hillary [SEP]
+
+===== sample 039 =====
+[CLS] on the phone call, mr munching was asleep when he heard two shots fired at the house in winwood green, thornhill, on wednesday night. [SEP] this time, the woman is to have had a good relationship. [SEP] they look to him for advice. [SEP] of course, it ' s tough. [SEP] it ' s an idea that everybody stands behind. [SEP] " but no, i don ' t say the same way we do in canada. [SEP] by the time the baby died. [SEP] the idea might seem a bit baffling. [SEP] the negative comments came as the president ' s official u. s. [SEP]
+
+===== sample 040 =====
+[CLS]. [SEP] israel ' s international media on sunday issued a long statement issued by the groups and called saturday for the establishment of an independent palestinian state in israel. [SEP] according to a report by chinese - run news, the bbc quoted head of the congress - - china ' s people ' s congress - who told the president that the chinese leader could not comment on the incident. [SEP] the fees are, too, prostring in the republican chambers of congress. [SEP] wenger has also confirmed that over the summer he would like to make a move for the st james ' s club, who confirmed his move from west ham united in 2007 [SEP]
+
+===== sample 041 =====
+[CLS] gas companies. [SEP] french media said g - general daniel sevignoni, the vice chair of the government ' s financial stability committee, would issue a report. [SEP] mainly, he said, the group made investments in foreign countries. [SEP] he said she wanted him, but couldn ' t understand why. [SEP] " no, she said. [SEP] mcneill is a former colleague of thompson, close friend john fossey and former massachusetts democrat campaign adviser john mccluck. [SEP] she is currently vice president of the national book institute and a former professor at the western university, promoting " what ' s down there " - a [SEP]
+
+===== sample 042 =====
+[CLS] that they ' re most likely to feel very close to their children. [SEP] he has been mounting an international campaign this year due to his limited state experience. [SEP] it has become clear that his attempts to establish his own political movement are not only absurd, but to make the process of political reforms in latin america impossible. [SEP] philadelphia coach brian zorn was listed in the no. 6 spot. [SEP] washington ( cnn ) - - senator barack obama will address delegates from 11 p. m. to 7 p. m. on saturday, during a presidential debate saturday night at the white house, a bush - mccain event. [SEP] and the [SEP]
+
+===== sample 043 =====
+[CLS], the company ' s executive director of corporate communications. more than 20 employees and clients. [SEP] the image of the event is released on a bbc 4 website june 2007 and is based on the series of the watergate films, in which a young woman in the world would cost $ 1, 000 a week, but it makes a heck of a difference. [SEP] " we ' re very hopeful that we can make up for a lot of money in one presidential debate, " clinton said. [SEP] the researchers, led by henry ford, david fisher and russell shaw, will care more about power and money than do their own science. [SEP] [SEP]
+
+===== sample 044 =====
+[CLS] weekend will feature golf ' s most high - profile event. [SEP] o ' brien said he doesn ' t think he will be paid before the end of 2009. [SEP] if he should try to bring him the message, and then go away still with a few posts on it, that is about to be politics. [SEP] the talks, however, has the biggest damage to both the world ' s talks on global warming and global warming that both leaders have failed to agree to in a meeting that set out ambitious levels to reduce global warming. [SEP] he said he would not make any decisions on whether to appeal. [SEP] it ' s hard to [SEP]
+
+===== sample 045 =====
+[CLS]. 6 billion, last year, came in higher than the second half of the year ( 10 million euros, at 12. 2 million dollars ). [SEP] but that was far more than some thought of what his legacy might be. [SEP] the problem is that if another industry wants to downsize, the concept of " regulation, " or just the way it never works out, will be that it ' s published somewhere in the books. [SEP] the state ' s pension system will need to keep up with increasing demand. [SEP] it is true that mr cameron, who is trying to make do with them for his wife sarah. [SEP] there [SEP]
+
+===== sample 046 =====
+[CLS], britain ' s armed forces announced a news conference in the country ' s capital, kabul. [SEP] school begins on feb. [SEP] edwards says the two f. i. f. could run out of cash, merging them would create problems and develop a regulatory system. [SEP] ( ap ) - a 19 - story house on long island ' s long island has broken into a small town of 40 million - 35 meters ( 11 square feet ), making it easier for the two neighboring developers to work together, officials said. [SEP] after a brief discussion, obama was asked by a local reporter whether he could have any examples of clinton and edwards [SEP]
+
+===== sample 047 =====
+[CLS] - old employee has been offered six months after agreeing a pay deal with a company which has fallen short of key cash targets. [SEP] people think america can change history several times, and that it can elect a black president, but the current republican administration may not see an answer and plenty of prominent black senators and others are interested in reopening the role that the nation is the fad that has brought america together. [SEP] mr holod, who is living in the home of a science degree professor at strathmore school, oxford, has spoken for his wife, catherine, who says that he does not think she has the [SEP]
+
+===== sample 048 =====
+[CLS] ju mee - hag. [SEP] pyon muang, the chinese minister of state security, said : " china and we are partners in china ' s development and china is responsible for the future. " [SEP] new york ( ap ) - wall street ' s economy plummeted in the first quarter but has raised its economic forecast to 9 percent. [SEP] the reserve bank of india and the bank of england announced rate plans on friday. [SEP] he said he was embarrassed by what he saw by police and will no doubt join in the case that brought on his former boss, scott conley. [SEP] in a similar way, china [SEP]
+
+===== sample 049 =====
+[CLS] after a few weeks of peace negotiations with the two news agencies. [SEP] travel abroad with royal british helicopter travel service ( 0870 803 43997 ; 0045 5083 60960 ). [SEP] the 26 - year - old was was found dead in the crash at 7. 30pm on saturday, 11 january after arguing with her partner steve mccraughne. [SEP] i tried to wonder that obama was taking the president, particularly in an audience that was the voice of america onstage. [SEP] the war to the bone is coming to an end. [SEP] he didn ' t say much of a reason. [SEP] in [SEP]
+
+===== sample 050 =====
+[CLS] collapse of several of the nation ' s insolvent firms. [SEP] " the democrats are going to have to do more before runing a campaign this november. [SEP] a healthier economy and green eco - economic development will make it more competitive and green. [SEP] the new points system was developed by the school ' s french president, david lamy, an under - 16 team who played a green card, a two - year old from britain and a two - year - old man from manchester. [SEP] today, james claxe, executive director of care, said their concerns, a result of the authority ' s industrial action, [SEP]
+
+===== sample 051 =====
+[CLS] florida, texas and california. [SEP] " they could have gone three different teams at the same time. [SEP] " they ' ve been talking, " putin said at a news conference after meeting russian prime minister vladimir putin. [SEP] the list of information is on the bbc university panel show at website : www. bbcestimates. co. com, by contacting the bbc health information centre. [SEP] the national guard said late thursday no oil had been found in the gulf coast. [SEP] gail baffert, who works with auhella ' s school of professional health, says the history of what happened to zamora is now part [SEP]
+
+===== sample 052 =====
+[CLS] said. [SEP] by the end of the 19th century, the museum ' s biggest hall of the night - - with its glastonbury and sexton - - the public is realising that it ' s now only the best way here. [SEP] ireland ' s participation rates are high to match the levels of its players. [SEP] after finishing a printing job in chicago, at the age of 28, and ended up working in an unpatried factory, he developed a reputation that embodied the art of the famous television crave : a natural sense of humor on the side. [SEP] if your boyfriend wanted to buy food in exchange, [SEP]
+
+===== sample 053 =====
+[CLS] [SEP] not that we ' re talking about the tory party, the conservative tories, the previous conservative government, the war in iraq - irresponsible. [SEP] no - one wants to hide things. [SEP] but yesterday, the koo said that there had been no tie - up in the trade talks, despite a media report texting his wife in stockholm. [SEP] david brunchard of the local children ' s association said the hospital was closed two times a day after the school went bad. [SEP] acting as current thai president, kulsief moved out of politics as a standby two months ago but he is [SEP]
+
+===== sample 054 =====
+[CLS] the champions league of the 2001 - 1990s. [SEP] no need to deal with israel and to the palestinians. [SEP] staff writers paul f. gordon and curt o ' toole contributed to this. [SEP] that ' s a true story set in the government ' s battle to bring to a country of all british citizens. [SEP] then eto ' o ' s second pass, four yards after fagan, allowed lampard to find the spanish goal line. [SEP] the then - governor of the island, yu hao, leader of the country ' s ruling party, said he would not be prepared to run for election. [SEP] the car, [SEP]
+
+===== sample 055 =====
+[CLS]r ). [SEP] they ' ll then have to retool their property. [SEP] the bill also received strong support from michel cowen, ambassador to the european union, in a statement, citing " strong growth in the greek economy. " [SEP] david govd, the uk ' s conservative leader, said : " the great deal of the time was to deal with john yettaw. [SEP] " it ' s nice to know, i think this as well. [SEP] they don ' t like the film, which already has earned him five years in prison and could make her look much more appealing, the union - times reported wednesday [SEP]
+
+===== sample 056 =====
+[CLS] korea, india, and india. " [SEP] " in the end, you have to go and you can ' t wait, do the talking, and then just dictate what we were doing at the last minute in time, " mccain said later on nbc. [SEP] president barack obama called tom boklin, north korea ' s u. s. spokesman, to hong kong monday, to discuss the details of a message of engagement in beijing. [SEP] johnson ( r - wyo. ), who served as the house appropriations committee chairman for eight years. [SEP] " it ' s a bit of a political thing, in fact [SEP]
+
+===== sample 057 =====
+[CLS] plans to move to the roxy music center and arts centre in east london. [SEP] its friends and schools increasingly popularise its traditional learning techniques. [SEP] mr. hu, who met japanese prime minister celso aso for a week, will be joined by japan ' s foreign minister saki hosakun, who is also to speak at the summit in china, but his chinese secretary dai thiwoo said the president ' s visit must be approved by other leaders. [SEP] in the terms of house price data, that ' s 82 per cent below february ' s figure ; it ' s 70 per cent higher than the [SEP]
+
+===== sample 058 =====
+[CLS], french foreign ministry arpees said. [SEP] ironically, mr. mcsweek has taken a more aggressive approach : it ' s about as different as a party poll : there ' s a man ' s call to make people stand up. [SEP] palin spoke on jan. [SEP] it was also the subject of mccain ' s decision to close the guantanamo detention center. [SEP] obama said he still simply did not agree with the problem, and the one question that the majority of his supporters can address. [SEP] he said he also was disappointed to see the leaders discussing issues the talks had not reached - - north korea ' s continued [SEP]
+
+===== sample 059 =====
+[CLS] volunteers, the morgan family foundation serves as a free foundation for young, women, poor and working - class people throughout the state. [SEP] tickets £30. £29, £70087, www. travelnet. com ; 0871977, £174 ( 0845267. com ) ; £64, £696, 08450 9773 664 ; £970, 080 0863 717 ; £ £20. 50, bigrow. com ). [SEP] the first round is out of the semi - finals. [SEP] he really worked [SEP]
+
+===== sample 060 =====
+[CLS] northeast and violence has spread to tallies in the north. [SEP] the triumph spoiled the tar heels ' perfect run for super bowl xliv. [SEP] he knows gm ' s capital needs of more than $ 100 billion - - and the company doesn ' t know exactly how that is because he ' ll have to think about it any more. [SEP] the company said it would provide more details to shareholders. [SEP] but the nations that have continued to go by governments around the globe have taken huge risks. [SEP] but china and russia still have a great policy gap. [SEP] the u. s. insisted that a special human rights commission investigate the human [SEP]
+
+===== sample 061 =====
+[CLS] of training materials and funds for the school, devise to provide long - needed infrastructure, help hire school superintendents and provide its own funding for the schools. [SEP] the head of britain ' s national bar association, eric rostlert, has announced plans for a training competition to have around 2, 000 spectators set up their own for the games. [SEP] olmert has no experience and is free to stand down. [SEP] that was significant. [SEP] the committee report also asked secretary - general robert gates to call for a comprehensive review of the war in iraq. [SEP] his focus was always on the ability to protect the country, [SEP]
+
+===== sample 062 =====
+[CLS]. [SEP] it ' s not clear whether he will discuss that with doctors, said columbia university ' s professors, d. alan rorese and w. howard taylor of the northwestern university of chicago, as a medical adviser. [SEP] indeed, it ' s difficult to be a sort of pro - college football player, provided by the college and high - level league level. [SEP] he did not know about how it happened, the official said. [SEP] the truth is, the nation must not refer to the " bush politics " of government and we must stretch back - - except by our own gimmicks. [SEP] he is not [SEP]
+
+===== sample 063 =====
+[CLS] on a variety show. [SEP] then the president needs to improve his preparedness and get away from the details. [SEP] on sunday, the leader of the national union of students in north america region said her government had decided to continue its protest of the costs of the hospital. [SEP] but, according to analysts, a increase in bank income is expected to support dubai ' s growth plan. [SEP] what makes him a narcole : as a police officer, everyone who gets shot. [SEP] after playing for redknapp, southgate joined mck in portsmouth earlier this season before being signed for the club, but he was overlooked in [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_diffusion_noise_steps_128steps_n64/noise_linear2to08_early_cosine_eta0p08_c256_raw_samples.txt

@@ -0,0 +1,230 @@
+noise_linear2to08_early_cosine_eta0p08_c256
+{
+  "type": "summary",
+  "name": "noise_linear2to08_early_cosine_eta0p08_c256",
+  "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt",
+  "step": 187000,
+  "decode": {
+    "kind": "categorical_fullvocab_diffusion_state_noise",
+    "config": "noise_linear2to08_early_cosine_eta0p08_c256",
+    "steps": 128,
+    "temp_start": 2.0,
+    "temp_end": 0.8,
+    "temp_schedule": "linear",
+    "t_power": 1.0,
+    "eta0": 0.08,
+    "eta_schedule": "early_cosine",
+    "noise_conc": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 46.47073894768385,
+    "nll_per_token": 3.838822844577599,
+    "tokens": 9591
+  },
+  "diversity": {
+    "sample_entropy": 4.206427871276884,
+    "unique_tokens": 1922,
+    "token_count": 8192,
+    "distinct_1": 0.234619140625,
+    "distinct_2": 0.718873031496063,
+    "top_token_mass": 0.053466796875
+  }
+}
+
+===== sample 000 =====
+[CLS] road accidents and nine car deaths in march last year. [SEP] analysts at the paris - based bank estimates net profit will fall to 5. 547 billion euros ( $ 6. 7 billion ) from sales of around 5. 3 billion a year earlier. [SEP] i think the great tories have had a lot of bad success with our dealings with others, while the great majority of people in the british government would have preferred to go into such missions. [SEP] he said the state was " screwed up " and never mind what he wants. [SEP] we will be asked to be realistic about the way that makes it so difficult for us to send [SEP]
+
+===== sample 001 =====
+[CLS] national security aide to abbas, fatahi fatahi and sabil e - jawad in toktah. [SEP] mr lee hall and his driver are also charged with burglary and attempted murder. [SEP] mr mccain also indicated a concern about mr obama ' s decision to press on iran through tougher sanctions. [SEP] while mr brown on wednesday called for a review of the review of the ministry of defence ' s defence strategy, sir paul browne, the chief of staff at the defence department, wanted to review a strategic review and examine concerns about the war. [SEP] for more information on iridium, visit the web site. [SEP]
+
+===== sample 002 =====
+[CLS] wouldn ' t be the wise decision to call out a candidate and say : i ' m going to go and i ' ll feel okay... [SEP] it must be a tricky challenge to move. [SEP] the legislation, introduced wednesday, mandates monitoring children under two years of age supervision. [SEP] i said i didn ' t know what was wrong. [SEP] the federal government accounts for around a quarter of the state ' s infrastructure funding. [SEP] the spokesman said ba also met with the airline ' s chief executive and its union, willie baueg, in an offer, both late on wednesday morning. [SEP] britain ' s press department said [SEP]
+
+===== sample 003 =====
+[CLS] responsibility for the project, saying it was a waste of the money, and the incident was a complete failure. [SEP] i ' m not sure why i think she ' s going to make up this year ' s show, joined by sarah zuckerman. [SEP] the nation in president obama ' s first state of the u. s. congress, which has been held for 15 years now, will do what the country is now doing : do not. [SEP] larcher, jr. [SEP] several months ago, the company handed over the 1, 000 pages of documents, pictures and diaries, some of them in full compliance with the [SEP]
+
+===== sample 004 =====
+[CLS] said dan ellis, a kent fire and rescue service spokesman. [SEP] 8 ( upi ) - - los angeles officials said they want to agree on the legality of the scandal that mend five teenage children from their marriage. [SEP] but after last week ' s heart attacks, it was too much longer to figure out how to die or how to lay live their life. [SEP] us president george mitchell announced wednesday ' s cabinet meeting ahead of an earlier meeting in moscow. [SEP] the administration is expected to bring the proposal to the working group later this week. [SEP] but after fighting the line with the army, the paramilitary group known as the [SEP]
+
+===== sample 005 =====
+[CLS] : 30 p. m. [SEP] meanwhile, u. s. gov. sarah palin and the u. s. ambassador, dan harres, will be traveling to the governors island. [SEP] wenger, though, was one of the strong men of the high clubs in his days and played football at newcastle united while only only in a league - - but began his life in the middle of the league. [SEP] he would have expected to move into the local market from other russian supermarkets. [SEP] the interest rate announced wednesday marked the first time u. s. banks went back to commercial credit since february. [SEP] many disputes that [SEP]
+
+===== sample 006 =====
+[CLS] cities, and where there ' s an issue of violence, " she said, citing a rising number of youth suicide attacks, of her trying to ban gay marriage. [SEP] it ' s a celebration of the invention of gaza. [SEP] we ' re not going to talk all over there. [SEP] chicago - - chicago is getting its $ 16 billion contract for its first building in the city in three years as a staff office of the national newspaper. [SEP] ryan ' s stepfather kim fergis, the mother of her children, known as the boy ' s mother, also recoiled from the emotions of old friends. [SEP] one few days [SEP]
+
+===== sample 007 =====
+[CLS] of littleton, north carolina, and eddie mclure, assistant manager of lafayette park. [SEP] he was found monday humeting out of the water after falling off a mid - raft with students at the international college of management. [SEP] the mr. sun has more than 100 years of experience in finance. [SEP] it ' s not all this news, there ' s always people you ' re worried, but who don ' t get their money or lose their homes. [SEP] suharto, japan ' s health minister, called a " national emergency " in burma on thursday, saying that the food outbreak was the country ' s [SEP]
+
+===== sample 008 =====
+[CLS] last month, one day to unstpass vick for the quarterback job. [SEP] the joint school of sports and school management in south carolina found that the group experienced significantly more of the sexual activity associated with the end of a friendship. [SEP] " president obama will be able to use someone to take over the presidency so he can with someone who has been friends and associates since then, " said marc daley, a senior house spokesman in washington and dc who is the deputy president. [SEP] the israeli authority appointed frieh kashavari to take over the state government ' s office on a west bank settlement project. [SEP] and [SEP]
+
+===== sample 009 =====
+[CLS] to pay its workers ' bonuses. [SEP] he ' s blessed, but it ' s hard to go away with a long - term political moment at the end of my career, " berlusconi said. [SEP] " the president urged congress to end this war to reach out to the people, and that ' s why that goes on. [SEP] that ' s when my wife showed up on the phone. [SEP] yes, the end, well, the better - - this year has seen many upsets. [SEP] with her baby, smith worked in her mother ' s to hand out the check. [SEP] it compares with 5, [SEP]
+
+===== sample 010 =====
+[CLS] international relations, who is involved in china ' s ministry of environmentals and foreign affairs. [SEP] coach james collins has promised to have 10 players back in his squad for next weekend in australia. [SEP] mr brown also insisted that britain ' s demand for independence was " genuine and genuine. " [SEP] so, while the decline in unemployment held nearly flat in november, the rate of jobless benefits rose slightly to 10. 0 percent, representing an increase of 10. 6 percent from last year. [SEP] the total price for the indian team is valued at $ 4. 4 million, the times reported. [SEP] ros - tsv has said [SEP]
+
+===== sample 011 =====
+[CLS] [SEP] he said mr malik had given details on his family ' s case to court, but did not give any details. [SEP] depending on how you get off the ball at that point. [SEP] built in the early 1980s as a public building, it has the oldest high purpose building in the uk. [SEP] he said officers entered his house with no weapons. [SEP] it is expected to start production in 2015 at the middle of the year. [SEP] the shadow schools minister michael gove said : " the public sector needs to be opened up to protect one ' s best sex lives. [SEP] he also criticized suu kyi ' s lawyers, [SEP]
+
+===== sample 012 =====
+[CLS] crew and their friends. [SEP] of course, americans differ from other countries as the rest of the world, including the british, will struggle to deal with them properly. [SEP] he said the hearing would be held next sunday and it would take its decision. [SEP] the collapse of the talks over north korea and nuclear weapons prompted beijing ' s insistence that his boss wanted to see china ' s vice - premier wen jiabao reach a joint resolution for the north korean nuclear programme. [SEP] state military spokesman lt. david ockham said the maneuvering happened sunday during a water break from the western and central region to western england. [SEP] the [SEP]
+
+===== sample 013 =====
+[CLS] the vice president planned to deliver the keynote address. [SEP] more than a number of leaders including doctors, scientists, environmentalists and environmentalists have signed a pact on carbon emissions. [SEP] coach johnson has said england and wales have more to win, but england have done more than scotland today than england. [SEP] he is a senior distinguished fellow in english and european history at london ' s royal university, where he serves as an dean of the national institute of scotland ' s school of history, and three years as a visiting fellow at the washington - based human rights commission. [SEP] she was admitted to the hospital late on wednesday. [SEP] or to [SEP]
+
+===== sample 014 =====
+[CLS] sir richard hoenig, chairman of the national security council, did little to answer questions about the nature of the government ' s role. [SEP] us treasury secretary john locke said the national security council was created by mr obama ' s administration in 2004, but became operating eight years ago after the us first administration took office. [SEP] on wednesday, mr. liddy, who left the company in a news conference, said he wanted to work again. [SEP] to better meet the company ' s goals, the company aims to post a $ 1. 20 per share loss of $ 1 billion in earnings, and avoid selling it to an increase [SEP]
+
+===== sample 015 =====
+[CLS] " he ' s still at his best, " he said in his final round speech at the talladega golf center. [SEP] it plans to install more than 25 pieces of support staff, including an office that includes three more counselors. [SEP] the online gallup poll of 200 california adults showed the strong public rating of obama at the same level. [SEP] he was shot while she was away from her vehicle watching the attack. [SEP] los angeles - director robert downey is known for the film. [SEP] dr. david hazen is a president for health care and research at the columbia university medical research center, which administers the guidelines [SEP]
+
+===== sample 016 =====
+[CLS] the presidential office in georgia. [SEP] " they are the ones who can tell tell the truth about what i think women should always find, " says reinberg. [SEP] in this kind of life, people would treat things as if they were in their 30s, 40 year old man, 30 and 40, and were watching and asking them to do everything, ' talk to me. [SEP] benchmark 10 - year us treasury rose 0. 6 per cent to 4. 46 per cent. [SEP] against the board of trading, the dollar rose 0. 8 per cent to 2. 364. 75 dollars. [SEP] ms. kra [SEP]
+
+===== sample 017 =====
+[CLS] opened to the public in 1997. [SEP] " he ' s been coach of the course, the people are in the city, but to live with me, i ' d have to know what he ' s been saying about this, to know if he ' s just going to know who to break him down, his feet to get down, why he ' s a guy, and can ' t play for a period of time, no matter what he ' s doing. [SEP] at the same time, officials said last week, gov. dave schlener was discussing a budget increase of $ 100 million in aid for the state [SEP]
+
+===== sample 018 =====
+[CLS] a british man and a 21 - year - old woman who were arrested by police in south africa after 14 years has returned to south africa. [SEP] he seems to be a tough man, as manager harry redknapp ' s critics suggest. [SEP] the united states debt rating agency, or sia, has already signed a fast - track deal with the european court of justice to limit the size of the bond lenders owing to concerns about the size of greece ' s debt and terms of interest rates. [SEP] the violence, chronically in iraq, is overreamed in its own sense of civility, mass and ingro [SEP]
+
+===== sample 019 =====
+[CLS] police department, said all law enforcement agencies were in talks with police and the public. [SEP] i think it is time for politicians to acknowledge this because they, whatever the old evidence, want to see the first decision seems to have made it. [SEP] mr jones, from wales and the cardiff university ' s central school, covers education and economic policy and public education. [SEP] beijing ( reuters ) - south korea ' s foreign minister will resume talks on monday on improving ties between the north and china, said the u. s. - china negotiator, the official central news agency. [SEP] she told her husband, calling up her [SEP]
+
+===== sample 020 =====
+[CLS] after five years of the bush administration. [SEP] what do you think of that coach is, ' you ' d say, well, ' you know a long period of time, say one of these people, and you think to me, ' well you say, well, i thought, ' you don ' t know, ' he ' s going to be there? ', i don ' t think he ' s out of this, he ' s going to have to help him put their story together, just because he ' s going to be a coach in the same way you know he never thought he was going to be a [SEP]
+
+===== sample 021 =====
+[CLS] health program for terminal ills. [SEP] the white house has looked into the matter. [SEP] china ' s post - soviet ire is firmly at the american crossroads of democracy and democracy. [SEP] gates, after meeting with international officials in japan, said he had hoped to urge other parties in japan to support the united states in lifting the recent sanctions. [SEP] so chrysler also builds its electric - powered cars. [SEP] he said the boy was walking between the beach road area and the bus road which was used by the boys when the boy was about 5 years old. [SEP] it appears that mr brydon ' s son james keron, [SEP]
+
+===== sample 022 =====
+[CLS] during two congressional hearings last monday pointing to the state of the mortgage system, repressing whether other problems were behind the u. s. government ' s troubled mortgage program. [SEP] total net debt was $ 27. 9 billion at end - june, a 62 percent increase over $ 387 billion from the same period a year earlier, it said. [SEP] under mr obama ' s plan, banks need up to $ 200 billion of dollars of capital from private investors and an additional $ 200 billion in loan guarantees, but the financial regulator said which banks would not need for additional capital. [SEP] after a night of a sad silence, " [SEP]
+
+===== sample 023 =====
+[CLS] year - old woman and her boyfriend, 16 - year - old john haywood. [SEP] in contrast, the lender ' s mortgage is at a lower rate of its two years ago and is worth about 2. 9 per cent, equivalent to the national rate of 5 per cent for losses on bank deposits. [SEP] israel said it had reached with an gaza delegation to help bring the technology to the launching sites. [SEP] at the same time, the president said, no longer a representative in the house of representatives, would stand by his efforts. [SEP] but biaim ' s vision is more exceedingly complex. [SEP] the mexican government [SEP]
+
+===== sample 024 =====
+[CLS] too. [SEP] one of my friends say they expect his house to be damaged. [SEP] do you have to go back to the store and ask your son to take it? [SEP] j. r. weitmann, chairman of the german economic institute, said the national economic council, chairman of u. s. national finance association, was one of the first real architects of european economic dominance. [SEP] " but i believe that it shows the seriousness of this dispute and makes it quite clear that the president will use the beijing visit to provide a dialogue on relations with china and investigate the continuing event of unrest in china and in tibet, " [SEP]
+
+===== sample 025 =====
+[CLS] iraqi national security council in the days after the conflict ended in january 2002. [SEP] investigators have asked attorney general eric holder to launch an fbi investigation into alleged " smearing and e - mail " about his wife sexually assaulting a former 17 - year - old - age girl. [SEP] in march 4, hurricane ike developed over cuba and slammed into the city ' s no. 3 just east of the texas coast, a major levee in the heart of the city. [SEP] the rate of unemployment has increased slightly this year - - 38 percent in february 2007 to 47. 2 percent last year, the highest in his career - - [SEP]
+
+===== sample 026 =====
+[CLS] on how much they co - operate their data networks. [SEP] but stowart said managers, by contrast, should not dwell too much on the situation. [SEP] what has happened, we are, is a more complex picture. [SEP] north marion, ill., dec. [SEP] the family doesn ' t mind him. [SEP] the dollar stood at $ 1. 5105 by trading monday with its new york counterpart, and, at its eight - month low in europe, the euro dropped $ 3. 6138 to $ 3. 6245. [SEP] this year, the true story - - long and long. [SEP] the combination of running [SEP]
+
+===== sample 027 =====
+[CLS] cent to £11, 676 dollars a gallon. [SEP] " it ' s a distressing... but the time to get something back and do something will depend on me and me soon. [SEP] the end of the big game came during the last decade of the war. [SEP] she also discussed strong new ties between asian and african countries that both improved human rights and improved security to tackle the deadly aids crisis. [SEP] " bob kennedy was the admirable, modern leader in approach to the national scene, along with many distinguished entertainers, including bill, president kennedy, of his administration. [SEP] he is only 20 minutes from [SEP]
+
+===== sample 028 =====
+[CLS] - run investment bank. [SEP] his labour - led government was called to the summit in brussels, the british foreign office announced on monday. [SEP] yes, yes, and it is wise. [SEP] the former pitcher would make his first career start as coach. [SEP] 18 ( upi ) - - the bodies of six people were discovered after falling dead in the mountains of the negr river pass in western france, local officials said. [SEP] the boy ' s health is not in good. [SEP] it ' s not my first time with england, i ' m delighted to be working with me, and the same kind of focus comes with my [SEP]
+
+===== sample 029 =====
+[CLS] five americans remained outside the residence of the president, but a number of them remain. [SEP] it isn ' t always clear if there is anything to focus on, dr. holley noted. [SEP] if you should spend time in the eye the world - though it ' s better to get to know about it. [SEP] mr clegg is a 38 - year - old economist and right - wing activist, who estimates that just under half of the country ' s people who share power currently live below or below. [SEP] a huge power crunch has hobbled russia ' s booming electricity market, its long - term economic outlook and europe ' [SEP]
+
+===== sample 030 =====
+[CLS], rio tinto, china mining resources ltd, australia ' s total plc, chinalco ' s miner bhp billiton, china ' s baoliang co, and northern china ' s weigsheng cog. china faces a significant slowdown in offshore natural gas sales and emissions taxing national industry firms, according to chinese state media. [SEP] after 35 years at the well - respected anger management center of texas, pels was followed with a law degree and an private school in dallas, then went on to work in finance, administration, communications, science, finance and management. [SEP] a month ago, the president [SEP]
+
+===== sample 031 =====
+[CLS] to give a speech on saturday that no - one child will be involved in another team together, but being able to compete at the next level has added urgency and he wants children to be in a group of discussions about their careers. [SEP] and then i got my name, got my best shot, i went to work again. [SEP] the retired police officer, richard schaffer, 37, and co - presenter of peter ray ' s bulletin, came to the public over the course of three months, totalling the number of sightings to a maximum of six sightings. [SEP] china ' s foreign minister confirmed the start of a [SEP]
+
+===== sample 032 =====
+[CLS] speech that he condemned the terror attacks. [SEP] the meeting on friday was extended by four hours to reach that agreement. [SEP] the bill would cap the amount of money that would be about $ 100 million on the year ' s grosses, according to john wrigley, a texas university law professor, about half of the $ 5. 7 billion cost. [SEP] ge capital companies were the worst linked to the collapse of the global financial market crisis and the nation ' s credit markets in 2008. [SEP] obama also is trying to call a vote on the resolution of the gaza crisis, but refuses to discuss the goals of a new deal, [SEP]
+
+===== sample 033 =====
+[CLS] from yale university - - a master of law degree in philosophy and history at columbia university, the museum of the arts and sciences, a drama degree at the university of chicago art and school of public affairs in the arts at stanford. [SEP] over five years, education reading for heavy drinkers had an average of 36. 8 points for 18 - 16 years, compared with 41. 5 for girls aged 15 - 17. [SEP] the park authority in corbine ( slr ) east of the scottish borders has agreed to pay £1. 5million to develop a £1m national park for wildlife. [SEP] in the winter of 2009, [SEP]
+
+===== sample 034 =====
+[CLS] a professor who wants to create a kind of post - consumerism - - secularism - - with a different world view of authoritarianism. [SEP] the event ' s participants include burma, thailand, india, china, nigeria, mexico, st. lucia and i. s. p. c. t. in asia pacific. [SEP] pressed about its new nuclear activities, the united states and the european union continue their policy of continued discussions over its nuclear programs. [SEP] mr cameron said he was not talking about his father ' s reputation as a prime minister. [SEP] the state ' s attorney, mark brown, had agreed to hear mr. [SEP]
+
+===== sample 035 =====
+[CLS] 10 days. [SEP] let ' s hope it does not use the rights issue as much as david cameron ' s party did. [SEP] but as with nuclear safety policy, there are many differences between a sophisticated, wide - minded network of state politicians, scientists and private and public interests in america. [SEP] mr brown has been negotiating with several local election officials. [SEP] u. s. officials have said tokyo ' s new government plans to send a delegation to tokyo next month, and the u. s. ambassador to japan has said israeli foreign minister t tzipi livni and israel ' s foreign minister would likely agree to the issue of [SEP]
+
+===== sample 036 =====
+[CLS] aske, patricia hewitt, mr haig, the british defence minister, john cogge, and british home secretary bob ainsworth, a deputy national security adviser. [SEP] that may be the problem. [SEP] paul henderson, the chief executive of the detroit - based chrysler group gmc llc, also said gm would like to stay out the court. [SEP] cortez began his drive to bring down the u. s. automotive and auto parts giant after gm announced a deal in germany on wednesday morning that would create the world ' s biggest power company by market, a deal worth at least 25 billion dollars. [SEP] mr summers said [SEP]
+
+===== sample 037 =====
+[CLS] have criticized senator mccain for this, one thing i know is no basis for saying that - - except that she ' s out of her race. [SEP] the foundation is designed to support community policy, higher education and social development, environmental education, retail, education, and public education. [SEP] cit spokesman said cit said it has spent more than $ 1 billion in public debt in the united states, or $ 4, 800 billion in debt and 7 billion in general fund value. [SEP] what is interesting in the good article is that the deal is nearly dead. [SEP] the taliban asked for more money. [SEP] the study is taking on [SEP]
+
+===== sample 038 =====
+[CLS] the financial control of china ' s economy and shift the sector back to basics. [SEP] he will probably lose any of his responsibilities as vice president, " said michael d. blitzer, vice president of the environment group, a task force for obama and many campaigners. [SEP] after the conference call, mr. mccain repeatedly called on mr. bush to " join all american democraticism " with foreign policy, and with iraq and israel. [SEP] new zealand coach john smith said on friday that flood was at the hospital friday but said only he could complete the wait. [SEP] how does it have this thing to do? [SEP] obama and hillary [SEP]
+
+===== sample 039 =====
+[CLS] of the initial incident, mr munching was asleep when he heard three shots fired at the house in winwood green, thornhill, on wednesday night. [SEP] you and thielin as well do not look good... but we all go for advice. [SEP] of course, it ' s tough. [SEP] consumer energy prices fell nearly five percent last month. [SEP] " but no, i don ' t think the current level will affect me much. [SEP] by overhauling the way tax is treated, his top domestic opponents are baffling. [SEP] the announcement also came after the state ' s official two - day visit [SEP]
+
+===== sample 040 =====
+[CLS]. [SEP] israel ' s foreign media on sunday issued a long range attack on militant groups and called israel to defend its territory. [SEP] two people were targeted several days after a man shot twice in the head by police while partying on an oxford street. [SEP] mr johnson ' s election in november 2007 won a victory for city democracy. [SEP] bp is also on the hunt for the gulf ade, the largest offshore oil complex in the us gulf of mexico. [SEP] friday night ' s private ceremony at the hollywood golf tournament set a new course record for the st mary ' s winner, who made his 82nd major league start in 2007 [SEP]
+
+===== sample 041 =====
+[CLS] gas companies. [SEP] the eu ' s financial crisis commission, a political body created by the body, the government ' s financial stability committee, will issue a draft report to the board this weekend, the group said, to outline a proposed eu system and a re - evaluation of greece ' s banking operation. [SEP] " everyone is very upset. [SEP] just raising money is not an advantage of service, according to john franken, a former massachusetts democrat who ran the national committee on ethics and legality before becoming chairman of the senate. [SEP] the state plans to take the city out, spending $ 20 to $ 40 million - - a [SEP]
+
+===== sample 042 =====
+[CLS] rights commission, the campaign for fathers ' rights and protection of children. [SEP] as israeli foreign minister avigdor lieberman met yesterday with israeli prime minister benjamin netanyahu to explain that his administration gave israeli prime minister ehud netanyahu support his government would accept a vision of middle east peace with the palestinians. [SEP] don ' t set out the local authority ' s air travel rules. [SEP] washington ( cnn ) - - democrat barack obama will address the u. s. congress wednesday to address the international crisis on national security, a house adviser said saturday. [SEP] bodnar, a senior partner of leadership advisors, a group [SEP]
+
+===== sample 043 =====
+[CLS] of the company ' s senior staff, including policies that cut costs for employees and employees. [SEP] mr hughes was out with his friends on tuesday evening when a 19 - year - old boy was attacked by the two aged men, aged 18, who struck by the tree while going to a walk to old town ' s park, a prison in the village. [SEP] " we ' re very hopeful that we can make up this vital part of our work, " dr schipper said. [SEP] the former president first tried to do 10 years ago, but small donors are thinking more about just raising money than telling them to put up big [SEP]
+
+===== sample 044 =====
+[CLS] support of the government ' s role in the banking sector. [SEP] white house officials said the two sides have agreed to be a part of the peace process, and that the issue of jerusalem was expected to be discussed, although iran and the nuclear issue need to work on how the conference is about to be made. [SEP] this week, john mccain offered the best chance to predict his father ' s fate. [SEP] chinese and senior state department officials said they will meet friday with usc assistant coach pete carroll to help to resolve the chinese issue. [SEP] he cannot give his own life, but from the historical record. [SEP] it ' s hard to [SEP]
+
+===== sample 045 =====
+[CLS] under two per cent last year. [SEP] in other costs, the japanese company reported net income of 37 cents, or 20 cents per share, for the quarter that ended december 2008, roughly what the u. s. might be. [SEP] " i know that the sport is trying to control that but it ' s an issue, " says ben woz - hortis, director of this weekend ' s golf club in the small area of louisiana state park. [SEP] those efforts need to keep up in other states. [SEP] he is the only known british child who has died at the hands of a neurosurger. [SEP] there [SEP]
+
+===== sample 046 =====
+[CLS]u boi met with japanese business leaders on tuesday in the country ' s capital, kasibutau, before a major climate change summit in tokyo. [SEP] mr blimt ' s offer was immediately dismissed by mr johnson as an obstacle on september 20th. [SEP] ( ap ) - a 77 - foot house on long island ' s long island will be one foot taller than a historic second - home that reached 11 square feet saturday, making it home to a two - square - square - foot commercial building. [SEP] in a brief interview, obama was asked by a local reporter whether he could have placed himself under clinton vowing [SEP]
+
+===== sample 047 =====
+[CLS] - old woman he was suffering from a drug relationship and had sex with a second man has admitted that she failed to meet the woman. [SEP] but the government, he said, and the country ' s national reform commission, is concerned with that and may not see an answer to that question. [SEP] the tories are keen to hold out any tory claim that the economic pretency approach that has brought britain away from the globe and made uk money is largely free of debt. [SEP] the euro was trading at $ 1. 519 from $ 1. 5179 late new york. [SEP] political issues have not been solved " because [SEP]
+
+===== sample 048 =====
+[CLS] russian military, most of its neighbours and friends, dmitri ivanov, the former senior pro - kremlin, said it was the president ' s duty to " nonplacent protests in the region. " [SEP] new york ( ap ) - wall street ' s biggest banks rebounded in the third quarter as financial stocks plummeted another $ 2 billion on the first weekend, slumping amid the credit crisis and wrestling with bank losses. [SEP] however, he is unlikely to be back in his mind and will now be out in the game. [SEP] five years or less, " she added. [SEP] in a similar way, china [SEP]
+
+===== sample 049 =====
+[CLS] after a few days of verbal negotiations with the two news agencies. [SEP] ( reuters ) - aig insurance co ( aig. o : quote, profile, research, stock buzz ) inc posted a 5. 5 percent decline in first quarter, following a percent gain in the previous three months. [SEP] if you want a way of getting involved with your job, you should move on. [SEP] i need to know that obama was born into a small man, a man that needs to show what obama is being asked about. [SEP] friday ' s statement to formally end 100 days of america ' s first president of congress - - a highly [SEP]
+
+===== sample 050 =====
+[CLS] good week and a campaign with a much better edge in the lead. [SEP] i think many people might better understand this subject by suspending their campaign. [SEP] it was only the federal government and the farmers who insisted that they also wanted to strike a deal. [SEP] one recent study, carried out by the national institute of defense studies, found that 57 percent thought that the obama team had played a part of the story. [SEP] that is martyn williams, a scrum - half from new zealand. [SEP] today, the bbc was interviewing michael smith, the deputy news presenter for channel 4. [SEP] it is a year ' s time, [SEP]
+
+===== sample 051 =====
+[CLS] know how to make noise. [SEP] " now i have other things to do at the same time. [SEP] " i ' ve been following the growth. [SEP] in the industrial north of china it has been on the rise in the west of china. [SEP] the awards ceremony will be held in bridgwater park on saturday. [SEP] don ' t let you see, people are watching it. [SEP] the national guard says no passengers on the crew were hurt after the plane crash. [SEP] he survived this time by his family and went on a flight later. [SEP] several top government officials said thursday in what appeared to be a confidential conversation that [SEP]
+
+===== sample 052 =====
+[CLS] said. [SEP] by the same way as backers of the city ' s idea of placing the brooklyn bridge as the likely site of a new rail line, it ' s also been known that it ' s now only 30 miles from now. [SEP] that ' s a b. j. o., " he says. [SEP] the book says mr king arrived in mexico at the age of his father who ended up working by a car window at tesco, and developed the " west side " experience of his father ' s business : a six - year apprenticeship at the royal harlech school in north london. [SEP] in one day [SEP]
+
+===== sample 053 =====
+[CLS] great things that i ' d heard about my best friend during the last seven years, the - - my son - in - law was delighted to be with me - - and i wanted to meet him. [SEP] they married, and this year i knew there had been no cover - up. [SEP] on tuesday, the democratic leader of nevada announced his decision in ohio. [SEP] dave brunchard of the national children ' s association said it would be about two hours a day after the plane went down. [SEP] acting chief executive mark ritchie - eldrief moved out of swansea as a standby two years ago and he is [SEP]
+
+===== sample 054 =====
+[CLS] country and my choice, " obama said. [SEP] no need to sit on the sides of the building. [SEP] some didn ' t have to make their way around the place. [SEP] the federal immigration commission has announced a deal with the british legal authorities to pay its immigration guards to ensure identity of all british citizens. [SEP] the metic ' s agent, john cooper, released pictures of the killing after finishing the three - hour meeting late this morning. [SEP] less than three days after the court blocked a law before it passed, the country ' s attorney general said that he would be more prepared to appeal the ruling. [SEP] some analysts, [SEP]
+
+===== sample 055 =====
+[CLS] it had yet to say whether it would try to re - pay the debt. [SEP] the bill would then be likely to pass to the republican leadership if the senate fails to pass a compromise, but democratic leaders the president and house leaders say that there is hope that the legislation will move forward. [SEP] " it ' s the way to play well with the goaltender, " brodew said. [SEP] " it ' s difficult to say, get away from the people. [SEP] they don ' t have the balls to just put money at them, eh?? [SEP] peterson ' s request was then denied, the sun - times reported wednesday [SEP]
+
+===== sample 056 =====
+[CLS] conference, said, " thanks. " [SEP] " in the end, i know those who know him don ' t win, and i feel that there is real disquality to make up his mind and pass the time, " mccain said later on nbc. [SEP] the eu plan also calls for the part of the bank ' s £3. 9 billion scheme, the bank of europe, to be pulled out by the bank of england in july. [SEP] carved into the north of the country, the centre offers a small - scale greenness of the country. [SEP] " it ' s a bit of a shock that, in fact [SEP]
+
+===== sample 057 =====
+[CLS] all 13 shots, then hitting the boards and then the ball in the lane. [SEP] the aig bonus system sounds like a good start. [SEP] mr. ma, who is china ' s stylish foreign minister, joined the national cabinet, led by china ' s finance minister li mingzhe on friday, who resigned as the head of the bank. [SEP] the north stopped its 2006 weapons test, only a few months after the north announced it had conducted a nuclear test. [SEP] but the tide of housebuyers wasn ' t pushing us all above water, apparently, and it ' s more difficult for us to go [SEP]
+
+===== sample 058 =====
+[CLS] % of the house ' s members. [SEP] now, while mr. mcgovolan has the credentials to do so, there is another reason to come : ms. lowery is away from a master ' s degree to become a medical assistant. [SEP] bres botha, the england national coach, says he respects england ' s decision for coach fabio capello to take his post at wembley, but did not endorse his position or his reputation as a must - have choice for england captain and national rugby coach. [SEP] unfortunately, bill clinton, the new york senator, is not a happy leader, as he can make [SEP]
+
+===== sample 059 =====
+[CLS]8, for under, 25 and under and £3, for girls, boys, girls and 18 - to - 49 - olds. [SEP] for more information about the national association of mortgage product management, forecasting and real estate finance services, please go to debtline ( 0107 - 462 4976 x254 ) or www. creditionatecations. org. [SEP] in a generation, 54 years after not only winning, but also losing work and retirees, my team and fans have come together to prepare for their times. [SEP] the first test is to be called the death test. [SEP] he really is [SEP]
+
+===== sample 060 =====
+[CLS], and it has been receiving critical support from the pentagon. [SEP] the council said the scheme was expected to have the highest and highest level of access to national security. [SEP] he probably will stay free, his attorney said. [SEP] the game rested heavily with its focus, which is on sports managers, who are often focused on building sport integrity and independence. [SEP] however, the couple moved through the law school of the university law school, her son taught law law, and later the law university of chicago state ' s law school of st. john ' s university of law in chicago. [SEP] " a national human rights commission would investigate the [SEP]
+
+===== sample 061 =====
+[CLS] of information will be used to verify their own findings. [SEP] the long - run southern north west service is expected to shut down from 1900 gmt to 2230 gmt. [SEP] washington ' s proposal to hand back to pyongyang ' s name could help north korea and others have led china ' s ambassador to the us in urging the north to end syria ' s nuclear ambitions. [SEP] 29 ( upi ) - - leading republican presidential candidate john mccain, said u. s. senator john mccain has abandoned his presidential campaign to call for war in iraq, and his focus was mostly on the war, despite the question of [SEP]
+
+===== sample 062 =====
+[CLS] jeter ' s wife was allowed to come to the us. [SEP] " you expect to see more improvements at this point, " said j. j. samuelman, from northwestern university ' s school of medicine in chicago. [SEP] still, it ' s difficult to be a local golfer while seeing the " y " provided by the official golf department as a global experience. [SEP] he did not know us and don ' t have to pay. [SEP] in the most of the most contentious debate of the campaign, bush said he has the political experience to push back to austerism, iran and washington. [SEP] and the local public school [SEP]
+
+===== sample 063 =====
+[CLS] done a good job, " said steven longa, a professor of nutrition and health administration at the columbia university school of science and the director of the national institute of environmental health in new york, new york. [SEP] congress had said it intended to help support the budget. [SEP] but, according to sources, south korea ' s government is expected to choose to lay out the plan. [SEP] what makes this a social binge : keep a family that includes everyone who gets it. [SEP] they had forecast that the uk grew at an annual rate of 2 per cent cent, double the average seen in october 2007, but growth fell back in [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_diffusion_noise_steps_128steps_n64/noise_linear2to08_early_linear_eta0p01_c256_raw_samples.txt

@@ -0,0 +1,230 @@
+noise_linear2to08_early_linear_eta0p01_c256
+{
+  "type": "summary",
+  "name": "noise_linear2to08_early_linear_eta0p01_c256",
+  "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt",
+  "step": 187000,
+  "decode": {
+    "kind": "categorical_fullvocab_diffusion_state_noise",
+    "config": "noise_linear2to08_early_linear_eta0p01_c256",
+    "steps": 128,
+    "temp_start": 2.0,
+    "temp_end": 0.8,
+    "temp_schedule": "linear",
+    "t_power": 1.0,
+    "eta0": 0.01,
+    "eta_schedule": "early_linear",
+    "noise_conc": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 48.10164682261911,
+    "nll_per_token": 3.8733164140021152,
+    "tokens": 9574
+  },
+  "diversity": {
+    "sample_entropy": 4.200641298969796,
+    "unique_tokens": 1912,
+    "token_count": 8192,
+    "distinct_1": 0.2333984375,
+    "distinct_2": 0.7181348425196851,
+    "top_token_mass": 0.052978515625
+  }
+}
+
+===== sample 000 =====
+[CLS] haymarket and worthingford in march last year. [SEP] sales - - the widest measure of operating income - - rose 3. 1 percent - - to $ 6. 7 billion in the quarter from $ 6. 6 billion a year earlier. [SEP] i suspect that his boyhood would like to tell us how we gritters with others. [SEP] my parents and i often have to figure out the wrong things to do, such as leaving people to cheer. [SEP] i had no idea of what i was doing to make changes. [SEP] but the bush administration has voiced its active support for making it available from russia. [SEP] in [SEP]
+
+===== sample 001 =====
+[CLS] said, referring to issa boah mamenahis and kaleboz jawad muziganah. [SEP] pedillo and fisk are still open with their arm hair and right backs. [SEP] both mccain and his campaign for mccain said obama respected the decision to do so. [SEP] the london news said the report was the latest in a row over the role of britain ' s ministry of defence in afghanistan. [SEP] in tokyo, meanwhile, the prime minister arrived in japan to meet karzai, the japanese government reported by the reuters news agency. [SEP] for more information on long beach, visit the data center. [SEP]
+
+===== sample 002 =====
+[CLS] doesn ' t mean the party needs to know how a candidate has raised a person ' s message that is and hasn ' t made it. [SEP] dundee city council leader andy hughes and vice - deputy leader peter sellam said the centre had been there for over two years - no one in it, whom i didn ' t know, was involved. [SEP] mccain said spending accounts for around a quarter of the state ' s infrastructure funds. [SEP] it is understood it would also focus on encouraging millions of people from around the world to invest, in sports, work and sport, while boostling the free market. [SEP] the university of alabama health [SEP]
+
+===== sample 003 =====
+[CLS] brushed off critics who made the case of a waste of public money, and the government ' s track record. [SEP] in fact, more than a year since the poll began shows that the political standing is doing more or worse than that of mr mcelroy. [SEP] and given my last survey of the state of the u. s. economy, july 14 - 13 and 15, 2009, i don ' t think anyone puts that on one level of the economic data. [SEP] it was sunk several years ago and 100 miles deep, including 1, 000 tonnes of steel, 200 dinges, 75 rafts and three water clog [SEP]
+
+===== sample 004 =====
+[CLS], 100 years, with only coaching and help last week. [SEP] 8 ( upi ) - - michigan school officials say union leaders have charged an ohio teacher charged with sex - abuse charges against a man who was ranked alabama no. 1 in last week ' s big north division poll. [SEP] " i am running out where there is debate, " briscoe said. [SEP] in the senate debate on wednesday ' s presidential meeting, attention turned to a vote by president bush. [SEP] in turn, foreclosure watchers will use the money to help people to guide the country through the crisis, she said. [SEP] and what [SEP]
+
+===== sample 005 =====
+[CLS] home prices rose about 14 percent in washington, d. c. and totaled about 30 percent of all u. s. home sales through june 31. [SEP] a 28 - year - old woman was killed two days after her car was hit by two teenage children, two teenage girls and three teenage girl hurt. [SEP] this is not the time for this country to get extra roomy with the watchdogs of our own oil industry on how we should move into the corrupt hands of the saudis. [SEP] the case has raised anger at the lack of u. s. and international attention to the massacre of thousands of haj residents. [SEP]
+
+===== sample 006 =====
+[CLS] conference will bring down u. s. - russian relations, " she said, citing a news conference on saturday on the two countries ' s human rights issues. [SEP] the eu ' s last conference on the future of eastern europe, the main national leaders are still coming from a handful in europe, with different national debates on what to do about the five best known people in the eu and russia, a central source of history and national identity. [SEP] earlier, chinese spokesman dai guiliang, referring to his final day as chairman of china ' s olympic committee, also acknowledged differences and said there was " no reason to break out. [SEP]
+
+===== sample 007 =====
+[CLS], my friends, my wife, and a blessing from the top of the church... [SEP] mr ahmadinejad has also pulled out of the talks to condition for a western - backed peace accord before he became president in august. [SEP] the program ' s timing was unclear, the spokeswoman said. [SEP] this is currently worth 13m cars, compared to those with more than 100m cars, but when it looks they don ' t need 100 % of the fuel. [SEP] kan, japan ' s foreign minister, urged a " clear shift " in us financial policy and vowed to increase government ownership in the national bank. [SEP]
+
+===== sample 008 =====
+[CLS] last month, one day to help take the team name for the beijing olympics. [SEP] at the start of the talks, mashajeri said that at present it remained unclear whether the european union was willing to accept the iranian compromise. [SEP] one way you will be able to learn is to take all the things you can get into working and really work out with this life. [SEP] " then i looked up and started to get inside and he said i look, i said, ' hey, boy, you do the same, ' " she added. [SEP] the united states has agreed to make a decision on next week ' s agreement [SEP]
+
+===== sample 009 =====
+[CLS] market for its forecast in 2009. [SEP] at 19, viridda began his job career as a teacher with a son. [SEP] the sales are out of the auto industry. [SEP] berlusconi said : " the people always urging me to end this war are all going to keep working on how that happens if this crisis goes on. [SEP] that night, hundreds of people pulled up a road just to block access to the dolomite. [SEP] chicago - - this year has been since the regular season began with $ 13. 5 million in its last budget. [SEP] the police station says the largest number is about 5, [SEP]
+
+===== sample 010 =====
+[CLS] about 17, 000 people were in the study. [SEP] not smarts and not even supporters. [SEP] i would have to stop him and get back in his feet, " she said. [SEP] " it ' s just that it ' s going to light up, and it ' s a very bad environment, " he said. [SEP] in february, the average annual rate of mortgage loan approval rose slightly to 13. 0 percent, following an increase of 10. 7 percent, in november. [SEP] 7 conference hearing on jan. [SEP] several european markets closed for the day. [SEP] this is rare. [SEP] and mr babran has defended [SEP]
+
+===== sample 011 =====
+[CLS] [SEP] he said mr phillips had given evidence during his interview with mr jones in court, but did not give further details. [SEP] details on how you get the pass rate at that point. [SEP] officials announced last week that the government has announced plans to spend nearly 300 billion euros and reduce the value of bad treasurys by half a year buying bad assets. [SEP] the company is to open stores in u. s. using up to £50m of its it services, which the company launched just three years ago and will cost more than match the salaries of its top executives. [SEP] he also noted that mrs palin ' s lawyers, [SEP]
+
+===== sample 012 =====
+[CLS] [SEP] the hotel ' s collection of inns, along with other stores, also has become crowded with beach businesses, fishing, golf courses and courses with golf courses. [SEP] he claimed the tiger had milked the snake and denied that of its owner. [SEP] " you just want to make this community... a national treasure, " said his father, qoil d. s. derongru, the ceo of the demar group in israel. [SEP] information : 60 minner street, south west 45th street, ( 212 ) 629 - 7290 ; www. hulbea. org ). [SEP] the [SEP]
+
+===== sample 013 =====
+[CLS] that mr. thompson will lead the campaign on sunday with more than two dozen party leaders. [SEP] mr brown, however, did not offer a detail on mr sarkozy ' s position on immigration during a meeting held by mr cameron last week but mr sarkozy has said he was prepared. [SEP] she is a professor and professor in law and family law at ucla ' s school of criminal law and focuses on the areas of law, science, law, technology, law, science, politics, law, biology and philosophy and cross - community and urbanism. [SEP] the joint committee of the senate committee on climate change and human services [SEP]
+
+===== sample 014 =====
+[CLS] board, which held stock in place in the past four years, and threatened to break up microsoft and ask its members to claim the benefits. [SEP] us politicians ' vision of the " american dream " was released by mr obama ' s campaign, his supporters added. [SEP] she is less self - interested than she has been. [SEP] for weeks, mr. braddy, who addressed the campaign in a news conference, said he wanted to remain optimistic. [SEP] to worsen the situation, its average earnings would range from a profit of $ 1. 20 to a loss of $ 3 billion a share, far from expectations of more than $ [SEP]
+
+===== sample 015 =====
+[CLS] " he ' s still at his best, " scott said, after playing four rounds at the mayajunga challenge park. [SEP] " we saw the latest evidence for bias in college life, including the study that found that genes and temperaments were more important than study skills, " said david a. morris, a senior professor at the university of alabama health & science center, now a senior center for economics and policy education. [SEP] freeney said davis would be back to georgia with the miami dolphins in january. [SEP] the center is a live arts and entertainment centre, while the washington arts center at sedona, known as the [SEP]
+
+===== sample 016 =====
+[CLS] the highest standards in safety. [SEP] his big day out wednesday was hafty, but he also has a life - long illness, added houlder. [SEP] in the city, hundreds of commuters made the trip - - men in their 30s, a mix of children, current and former residents and local residents and included retirees from several major state and local communities. [SEP] yields on 30 - year us bonds fell 4. 6 per cent to 13. 4 per cent as the price of 10 - year government bond securities jumped 0. 4 per cent to 2. 011p late last week. [SEP] but until 2000 [SEP]
+
+===== sample 017 =====
+[CLS] opened to the public in 1997. [SEP] and mr. president today, mr. fish, the president, said, ' i really did agree with you, i ' m going well to let you know what you did in 2002, to explain if i ' ve just been through a career, for several months, and this is how you did this in the past, how you and some of my colleagues can do this same things, you know, he ' s going to keep saying the same thing. [SEP] many democrats, including gov. charles schumer, would approve a similar bill. [SEP] a pentagon spokesman, kevin mccarthy, [SEP]
+
+===== sample 018 =====
+[CLS] the tories and nick clegg. [SEP] he will be in training today in south africa, as he has been in south africa. [SEP] this will undoubtedly be a tough week, " said harry redknapp, the spurs manager. [SEP] the united states and south korea, along with china, has already signed a 20 - year military agreement plan on the issue. [SEP] " the closure of the secondary school level will raise concerns about the level of work the school provide and to keep children going. [SEP] the violence, which has shocked iraq, has its own share - its own potential, of course. [SEP] after the program [SEP]
+
+===== sample 019 =====
+[CLS] urging obama to help all law enforcement agencies better reduce penalties for illegal and dangerous immigrants. [SEP] i think it is time for people to concede that the 2010 midterm elections have yet to show the numbers of the left and the right. [SEP] mr jones, from wales and cardiff county council ' s deputy leader, said : " i want to go out. [SEP] the party will need to start getting around £1. 7bn deficit before 2011 - 10 and just over £390m in tax over the next election. [SEP] mississippi 6, 10, 7, 15, and s. c. c., 17. [SEP] some experts [SEP]
+
+===== sample 020 =====
+[CLS] cameron, the british chancellor of britain. [SEP] what do you think you could do is say there are two appropriate options, then you start to get the right out of time, and the right way to play, and take some action, so perhaps that means something at a different level? [SEP] i don ' t know, but he is also going to be asked by obama. [SEP] if you ' re going to be the next nominee, it ' s time for everyone to help you with their money, to know what it ' s like to be married. [SEP] the best way for the pirates to justify this is as to be known [SEP]
+
+===== sample 021 =====
+[CLS] health program for new yorkers. [SEP] the white house press secretary said obama would decide whether he ' d run for the second term, if necessary, before he could give that choice. [SEP] gates, after meeting with foreign officials in japan, said he would travel to washington and tokyo next friday to review the united states ' relationship with china. [SEP] new york times and new york metro reported. [SEP] a bmw car in the kingsdown section of the elmes street area of western road, was struck by a car on the m69 on saturday morning. [SEP] four years later, bresson ' s parents had five sons - [SEP]
+
+===== sample 022 =====
+[CLS]. [SEP] stvzpach said the company, while still profitable, faces tougher scrutiny over other risks in the u. s., european and global mortgage markets. [SEP] trade net debt totaled $ 22. 9 billion in the third quarter, an 11 percent jump from $ 477 billion in the same period a year earlier, it said. [SEP] republicans said obama ' s plan, which includes up to hundreds of billions of dollars in tax cuts, showed that obama has not focused on specific gop proposals. [SEP] the report said the local authorities had not reviewed the case. [SEP] we ' re seeing a strong taliban, " [SEP]
+
+===== sample 023 =====
+[CLS] year - old woman and her boyfriend, 15 - year - old man steven smith. [SEP] the report said : " while internet travel is more than a luxury, one in two out of three of those surveyed use the web and have more time to spend it during the summer. [SEP] the team includes the head of the national weather service dr phil riley. [SEP] she also was defending herself. [SEP] he said he had been at st george ' s on the street when a passenger train landed on the bank of england, being joined by his son. [SEP] they also said the new accounting rules would allow the bank to make payments to reduce long [SEP]
+
+===== sample 024 =====
+[CLS], becoming one of my best friends and playing the tournament at the golf club. [SEP] in the game, all - star chris ortiz went through a free agency. [SEP] its spokeswoman, angela merkel, said yesterday that the program does not provide legal details. [SEP] the political arena, of a western approach to the left, is one of the largest legal issues of europe. [SEP] the only people who have a child aged over the age of under two and children on 1. 3 per cent will spend the time on a number of pounds. [SEP] with 2. 3 hours of programming, it averaged 1. 2 million, down [SEP]
+
+===== sample 025 =====
+[CLS] the national security council in the days after the videos were broadcast, u. s. officials and the national security service have ordered an fbi investigation into the matter, including a decision to shut out the secret u. s. intelligence facility that conducts two - to - one investigations. [SEP] a statement by the eu ' s finance minister wednesday rejected calls for the eu ' s leaders to establish an international commission to help to find a better plan for reducing the size of the crisis. [SEP] chicago, june 16 ( upi ) - - the new york oil futures contract fell 3. 2 percent friday to $ 6, 090 a tonel [SEP]
+
+===== sample 026 =====
+[CLS] facebook users, estimated to total just over 2 million. [SEP] mr stoelodire, who is now an art watcher at the art institute of the university of cambridge, spent more time spent there studying russian art which has become more known in art and painting. [SEP] the cowboys don ' t mind him. [SEP] the european euro at $ 1. 5100 was in midday trading in new york monday, and while the us eight - month yield against the german euro was at $ 0. 95bn to $ 0. 13bn. [SEP] this is not a true record, " said john g. roberts, director of america [SEP]
+
+===== sample 027 =====
+[CLS], at £4, 0867 a week. [SEP] the italian federation and the british authorities have refused to give the hosts a personal choice over their participation for the tournament on saturday and that they would welcome the end of the injuries they suffered during the last tournament of the tournament. [SEP] andy lomax, a teacher, said the work demonstrated that older people should be punished for their behaviour. [SEP] but he wants to press the british government for a robust fiscal fiscal stimulus to " sidestep the back " of his old - style fiscal policy, cutting big social deficits in europe and europe. [SEP] he was only 20 minutes in [SEP]
+
+===== sample 028 =====
+[CLS] - down. [SEP] south korean shares rose yesterday after a two - day board meeting which saw the two sides meet on north korea ' s key nuclear issue to reach their joint nuclear declaration. [SEP] the former pitcher would make his first career start as starter. [SEP] 8 ( upi ) - - the royal navy ' s john paul ii capsized in the pacific ocean sunday when the pilotless jet was missing, navy officials said. [SEP] the storm ' s center is expected to be on the east coast of the carolina coast and in north carolina, it was expected to make its west carolina coast along the east coast of south carolina and indiana [SEP]
+
+===== sample 029 =====
+[CLS] number of cases, the size of the population, and the number of confirmed cases. [SEP] it isn ' t known whether kevin mccarron has been fired as coach, but johnson is under fire for moving former team chief george johnson. [SEP] it ' s obvious john mccain ' s postponementment might have stopped it all ; this is a time of hope and reckoning. [SEP] russia ' s infrastructure and investment accounts for nearly half of the european union ' s economy and will post strong growth next year. [SEP] instead the north currently has sanctions on its territory, including the management of its nuclear program. [SEP] " i didn ' [SEP]
+
+===== sample 030 =====
+[CLS], won in 4 : 57. 17. [SEP] canada ' snour, british columbia ( ap ) - a cargo ship with china ' s shen hgv made the best start of the year on friday as its six - mile long - haul container freighter made a stop thursday night, officials said monday. [SEP] two people were taken to hospital, police said. [SEP] the plan ' s proponents have faced spending efforts and political opposition at home. [SEP] bradford ( from 4 - 2 ) hart, robertson, tait, gwell, borue, davis, de vises, downey, barkley, whiting [SEP]
+
+===== sample 031 =====
+[CLS] it took five tests to determine whether familial drinks were involved in increased physical activity, stress, related health problems, education and cognitive problems among mothers and mothers who began to recomniae of alcohol during their teens. [SEP] " if you ' d wanted to get my best shot, i could get to the hospital, " jeter said. [SEP] the two companies, espn, and bbc radio 4, and virgin ' s sister stations came to the public over the course of eight months, but the scale of the change led to a separate arrangement with sky sports. [SEP] obama ' s overseas trip marks the beginning of a [SEP]
+
+===== sample 032 =====
+[CLS] the british authorities about the terror attacks. [SEP] the first group of experts met for five hours to make that statement. [SEP] those who reported spending the rest of their time at last year ' s start of the year spent about $ 2, 000 in the survey, while others said that average was about $ 2 million, the survey said. [SEP] many estonians see this as a political crisis, linked to the european union ' s financial sector crisis and the country ' s economic crisis in 2008. [SEP] indeed, he had a deprive mood as a man. [SEP] staff writer john bunkley contributed to this report. [SEP] this, [SEP]
+
+===== sample 033 =====
+[CLS] treasured so much for its place of academic conduct, particularly while playing at manchester university in the middle of the 1970s and he was a worldly player, contributing academically to his school team, particularly in the arts and media. [SEP] over 21 years now live in three areas of the gender range - - 77. 8 % of 18 - 24 - year olds and 80. 5 % of those aged well over 40, versus 25 - 19. 3 % post - 35 years. [SEP] the scottish government has decided to close its local youth action service to help " protect the national sector for scotland. " [SEP] the ministry of foreign affairs [SEP]
+
+===== sample 034 =====
+[CLS]. [SEP] it ' s with a rise of two per cent on an average of £10, 000 and a family of £30, 000. [SEP] the city ' s extensive travel budget, however, still needs approval. [SEP] brian collins, g. d. s. s. p. c. t. manager, chicago. [SEP] since 2006, moderates, republicans and house democrats have been impeating congress to avoid setting off some of other issues. [SEP] but knowing how many friends felt even after his death, he suggested, was never enough. [SEP] new york ' s school system would have to spend $ 200 million less than [SEP]
+
+===== sample 035 =====
+[CLS] the u. s. district of columbia ( va ) announced the release of a report by the attorney ' s office. [SEP] " but people are working hard, and there is no denying to the fact that us is going through this year. [SEP] the loan agreement would provide financial support for northern iraq. [SEP] in a speech to congress, the joint chiefs of u. s. forces, president bush ' s chief of staff - chiefs of staff ; gen odierno, the u. s. military joint staff chief for north asia ; the defense secretary robert gates, the president ' s chief staff and robert gates, the secretary of [SEP]
+
+===== sample 036 =====
+[CLS]bale, israel - an israeli missile fired from a small field in the gaza strip has landed near israel ' s gaza border with israel, the defense department officials said. [SEP] that may be another problem. [SEP] ed clark, shadow general secretary of the national audit office, said mr clegegg will ask gordon brown to focus on the economy and says he would support middle - class families. [SEP] the world ' s biggest nuclear and nuclear generator made a formal announcement today after a six - year campaign that has seen the world ' s biggest power station reduce its annual electricity bills by at least 30 million euros. [SEP] he added : [SEP]
+
+===== sample 037 =====
+[CLS] his speech, mccain said " a change to the country is not necessary for us. " [SEP] the sunday times ' s chris henker said : " a great overwhelming majority will support public confidence, almost of all things, to stop the government ' s work, " he said. [SEP] mr. crai, 60, has joined the company ' s beijing office after a career running ge aviation management, which provides aviation, air service, airline and internet service to companies in china. [SEP] kivt. com. com suggests that the deal is pretty close. [SEP] the taliban denied it all sunday. [SEP] the investigation is taking on [SEP]
+
+===== sample 038 =====
+[CLS] be heard at both queen ' s college and the premier league school, but the city council will not give up licences for the club that joined the club in 2000. [SEP] while russian officials denounced the separatism, a task mr. obama and others have played to europe and asia, they said mr. obama ' s position as president was " not a good way to normal relations with russia " at the same time. [SEP] however, the bbc said the officials would not discuss the wording at the talks, but made only a comment on the details. [SEP] how does do anybody ever want to try? [SEP] obama and hillary [SEP]
+
+===== sample 039 =====
+[CLS] of the action. [SEP] mr muncho was injured when he heard two shots fired at the house in winwood green, thornhill, on wednesday night. [SEP] mike and i were not asked if i had the good idea made, but we were asked for advice. [SEP] of course, it ' s tough. [SEP] china ' s central bank suspended rates last month. [SEP] " it happens, " don ' t say, but you want to know better. [SEP] the story is the key theme to " sleuth, " the baffling of its co - star title, the film ' s official vampire series, and [SEP]
+
+===== sample 040 =====
+[CLS]. [SEP] he has claimed international backing for remaining in a coalition, while some rights groups have called for less international involvement. [SEP] about 20 people were killed and dozens more were injured, and chinese - owned vehicles fled the 21 - story building, said qi yung tsg of lower jouang, a station for state television. [SEP] the authority is asking the government for help in bringing waste from scotland to a national park in the southern island of scotland. [SEP] last night ' s announcement, at the start of paul robinson ' s first season for the st james ' s club, has confirmed his involvement with west ham united in january [SEP]
+
+===== sample 041 =====
+[CLS] gas companies. [SEP] french public finance minister jean louis clegg said friday that the government called for the bank ' s financial support to help it become a " backbone " of the banking sector, along with bigger investments in foreign countries. [SEP] he said she called him, but couldn ' t see why. [SEP] " no call for help. [SEP] swensen is a former professor of law and close friend of the fellow senator and former massachusetts democrat, democrat john john maloney. [SEP] richard williams, former president of the national cancer institute and a former official at the university of michigan. [SEP] i ' m down to more than a [SEP]
+
+===== sample 042 =====
+[CLS] among america ' s most likely terrorists, leaders and extremist. [SEP] president sarkozy has said he would not foreve his support or timetable for netanyahu, saying that his attempts to become prime minister were likely to give him the british prime minister ' s endorsement of pro - rival sarkozy. [SEP] average cost : $ 2, 972 ; more than 6, 000pees ( $ 0. 759. 95 ; fees. $ 389. 95. [SEP] " yes, go ahead now! " came the advice of william r. clenneman, a senior director of campaign finance at the group [SEP]
+
+===== sample 043 =====
+[CLS], the company ' s leading network of corporate networks with more than 20 employees and clients. [SEP] but now, the event is still playing, and the course is still largely confined to the east. [SEP] the board of virginia, he said, was shocked by the way that mr obama had handled it for him, but that he did not have a clue. [SEP] " we ' re very hopeful that we can all make a big part of our operation, " mr. toyil said. [SEP] the former national union chairman and the former presidential candidate says the presidential campaigns are often more about power and money than about the kind of problems that [SEP]
+
+===== sample 044 =====
+[CLS] weekend will feature golf ' s most high - profile sporting event. [SEP] wenger said he doesn ' t think he will be paid before the end of october. [SEP] and you leave it to them to be honest, be polite and rational, to work hard work on issues, that is going to be difficult. [SEP] this week, eric allen and david van noten, the band ' s vice president of entertainment and events, announced the reunion that will work together with longtime beatles owners pete samm, paul mccartney and brian williams. [SEP] we can get our own leaders, but not our own president. [SEP] it ' s hard to [SEP]
+
+===== sample 045 =====
+[CLS]. 2 billion, last year, ba reported higher than expected first half profits and net income of 37p, or 20p per share. [SEP] the report says the price of oil in the growing area is 10 percent. [SEP] " there is very recognition that the music industry needs to go and do it out of its way, " says the aeg chairman, kevin folley. [SEP] over the last two days, the bank had received three state support for bailout to help to shore up its lending lending. [SEP] it is trickier to children, and young people, making up by buying chinese - made goods. [SEP] after [SEP]
+
+===== sample 046 =====
+[CLS] office of the group to more than 2, 000 temporary postings on its website each month. [SEP] and oooh... [SEP] the bank spent almost c600m to launch a global fund, sell its bad mortgage debt and build a banking fund. [SEP] ( ap ) - a law that means many of this island ' s vacations will be back in mexico city after a one - day without a full house on saturday, making it easier for the nation ' s to work with its hurricane crisis. [SEP] for a big deal? [SEP] scientists believe that a strong amount of snow could have had an environmental impact and caused [SEP]
+
+===== sample 047 =====
+[CLS] - old president has spent almost 24 months after agreeing a pay deal with a company which has fallen short of its cash targets. [SEP] people think america can change a few times, and that it can produce a black president, but even for those who may not see an answer and know the words, politicians and others are obsessed with disclosing the role that america faces in the fad that has brought america back. [SEP] kludaq, who is currently the chairwoman of the national security team at the high court, is also considered to run for musharraf, but says that he does not think she has the [SEP]
+
+===== sample 048 =====
+[CLS] on me, " he said. [SEP] p. tsang, the deputy secretary of foreign security, said in beijing today that his region ' s desire to build russia and china would " shape its future. " [SEP] new york ( ap ) - wall street ' s economy plummeted in the third quarter as the unemployment rate dropped to 0. 4 percent in the second quarter, upping the highest estimate of any contraction, data showed. [SEP] authorities said he was expected to be in court on friday and will not be charged in the case. [SEP] tewkes city, birmingham, sept. [SEP] in a traditional way, this [SEP]
+
+===== sample 049 =====
+[CLS] after a few weeks of peace negotiations with the two news agencies. [SEP] travel expert with royal british helicopter travel service ( 0870 30 777995 ; 0045 5083 6097 ). [SEP] south wales police said five of the people were killed in the blast at 7. 30pm. [SEP] about 4, 000 people were able to get out of the building. [SEP] i had to wonder that clinton was entering that rock, which drew an audience that lacks the kind of hype. [SEP] the reaction to the high school was caused by the republican party that wasn ' t expecting much of it either. [SEP] in [SEP]
+
+===== sample 050 =====
+[CLS] last week and clinton said it ' s time to review the offer. [SEP] the pictures are popular among republican voters and are now part of a tight losing race. [SEP] white house, trade and administration officials have said that they are yet to approve a deal. [SEP] the latest research will be led by the school ' s principal scientist, david anderson. [SEP] britain is also believed to have played a major role in the dispute over the nuclear trade. [SEP] he received an e - mail from his wife. [SEP] as a teacher, ms. davis announced that her daughter, david evers, a director of nearby glaston high school, [SEP]
+
+===== sample 051 =====
+[CLS] they were pretty well prepared. [SEP] " and i have no regrets. [SEP] for the first time this way, i ' ve been following the growth stories, watching a rough trail of some of my fellow beaters. [SEP] the opening of the race on the new track will be held in cranstony park on saturday. [SEP] the university also asked the university of texas for information law. [SEP] the national weather service said thursday that gusts were reported in the north coast. [SEP] julian baffert, who is close to the company ' s chief executive and chairman, recently earned a law degree at cal state university, where he [SEP]
+
+===== sample 052 =====
+[CLS] said, quoted by the official xinhua news agency. [SEP] he was the director of the national asia institute, and an expert in economics and national policy. [SEP] it was last updated at 10. 33 bs on tuesday 15 august 2009. [SEP] ireland ' s fa also are seeking to limit the hiring of injured players. [SEP] after school, mr. rigel is known as an importer, who ended up working in an unpatried factory, and developed a unique concept of the art of the united states auto industry : a cross - town car, living in a town, and auto tailoring. [SEP] in one day [SEP]
+
+===== sample 053 =====
+[CLS] m sure that we ' ve brought about the green revolution, the development of government, the growth of government, social change, even nuclear war. [SEP] the group said its members were keen to meet people of varying different ages, and a group of which remembered her as a stand - up computer game. [SEP] saemredes says he received his salary from the institute of investment management after growing frustrated with the group, including after high school and college, the two years he started after the company went public. [SEP] of course he ' s going to see his husband coming out of office as an example of obstructionism. [SEP] he was [SEP]
+
+===== sample 054 =====
+[CLS] lawyer, often puts his deep - and - deep statements out of an almost blind eye to the truth. [SEP] meanwhile, the u. s. pga committee added brian taylor and six players. [SEP] that ' s a true story told in great britain ' s battle to try to add more of their british citizens. [SEP] the g8 ' s $ 110bn cut, a third of £27bn announced, failed to boost the global economy last week. [SEP] his office suggested that the democrat would be willing to begin withdrawal of the u. s. military, and he would be more prepared to push for it as president. [SEP] the [SEP]
+
+===== sample 055 =====
+[CLS]r ). [SEP] new york ( ap ) - defense secretary robert gates was appointed as hillary clinton ' s senior ambassador to new york monday, likely to help president barack obama as a nominee, said senate insiders from the united states. [SEP] glumo ' s spokesman said, being quoted in the times : " the club are under his control after his spat with bill tollick. [SEP] " it ' s nice to know, i saw this story today. [SEP] they don ' t want the ball, but that ' s the three years now. [SEP] for investors, it could be enough for the state - run private market [SEP]
+
+===== sample 056 =====
+[CLS] afghanistan, pakistan, and india. " [SEP] " in the end, what ' s different and you can ' t win, all the things we have done, any one of us to be doing the job at the right time, " mccain said later on cnn. [SEP] and then sen. tom breslin, president clinton ' s deputy director for asia, met with georgia officials monday, to discuss the details of the status of fighting in georgia. [SEP] driving into the village of the black sea seemed like an abandoned small - town reprotorial dream. [SEP] " it ' s a celebration for a politician more than a candidate [SEP]
+
+===== sample 057 =====
+[CLS] all three players, the better the team and the players are in the game. [SEP] the police will increasingly popularise their own police patrols. [SEP] aso, head of the country ' s main opposition opposition democratic party, arrived days after a cabinet led by japan ' s prime minister thaki sosa on friday, who resigned in may, called the talks to devise a government. [SEP] he confirmed that the council had not expected mr page to join the case at this time. [SEP] " the beauty of this game is, he ' s the best tennis player he ' s got and it ' s 70 per cent fun in playing [SEP]
+
+===== sample 058 =====
+[CLS] percent of the world ' s population were giving up. [SEP] mr. obama meanwhile, who has been under some fire recently for his campaign team with john doyle as campaign manager, said there ' s a huge demand for people to know her campaign policies. [SEP] palin ' s spokesman reversed course wednesday night and said he believed mccain ' s strength and willingness to stand with critics and his stand on abortion was " very important to keep his eyes open and to anything like that conflict - of - interest level. " [SEP] he said it would be interesting to see the young athletes taking part in the event. [SEP] " the group is talking about [SEP]
+
+===== sample 059 =====
+[CLS]e, national health director for texas university and health advocates for young, hispanic, poor and middle - class housing throughout the state. [SEP] tour dates : £89666, £8777, £878, £677, £4707, ( 0845 6067666 ) ; £67 7488666, £7767, £6, £870, or £76 ( 0879 8369. 077 ; taxes and transfers available ). [SEP] the first film fell out in the mid - 1990s. [SEP] he really worked [SEP]
+
+===== sample 060 =====
+[CLS], and it has been a jab at the pentagon. [SEP] the border is the largest arms trade area in the oil - producing region. [SEP] he still hasn ' t allowed a lead more than three innings since the start of the season. [SEP] give it, and it is important to be realistic about where to spend it, if you do not. [SEP] however, the governor cited his own. [SEP] but it added that it expected to go up again on the same weekend of last year. [SEP] senate democrat and rep. john m. kirk jr., of nevada, asked. [SEP] " a proposed human rights commission limits the rights [SEP]
+
+===== sample 061 =====
+[CLS] of signs that the campaign is going to be turning up into a long - running battle. [SEP] there may still be many writing their own books in the future. [SEP] china, the city ' s first north chinese ambassador for human rights, says beijing has relatively little influence in china and there have been 4, 000 ministers taking up their duties for the games in conjunction with china ' s government on international law enforcement and criminal matters. - - the report states that the u. s. defense and military air force has only 4, 000 days of the war in iraq. [SEP] his focus was always on the job, on the phone, [SEP]
+
+===== sample 062 =====
+[CLS] the chinese government ' s plan for the tour was also likely to be announced monday, and a senior national security official said that will remain a routine issue. [SEP] " i guess i couldn ' t get at it myself yet. [SEP] she really knew it. [SEP] mike druido, 30, a new zealander living in a western village, has a good accent. [SEP] he said china ' s department of defense, agriculture and military programs and taiwan ' s long - range navy should move to the " best position " of a formal agreement with north korea - - but by trade, political incentives and restraint. [SEP] i am always [SEP]
+
+===== sample 063 =====
+[CLS] as a prime minister. [SEP] a few weeks ago, israel announced it would to back away from the talks. [SEP] patricia schwartz, the founder of the national school of nursing in north carolina, said her mother was stunned when she said she intended to move to the hospital. [SEP] but, according to sources, on monday the british government is expected to stick to the nationalisation plan. [SEP] the area in the area was the size of a road, mr. stanzer said. [SEP] he himself decided to do the same. [SEP] the index added 2. 3 per cent at the start of the previous session, but investors should factor in [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_diffusion_noise_steps_128steps_n64/noise_linear2to08_early_linear_eta0p12_c256_detok_raw_samples.txt

@@ -0,0 +1,230 @@
+noise_linear2to08_early_linear_eta0p12_c256_detok
+{
+  "type": "summary",
+  "name": "noise_linear2to08_early_linear_eta0p12_c256",
+  "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt",
+  "step": 187000,
+  "decode": {
+    "kind": "categorical_fullvocab_diffusion_state_noise",
+    "config": "noise_linear2to08_early_linear_eta0p12_c256",
+    "steps": 128,
+    "temp_start": 2.0,
+    "temp_end": 0.8,
+    "temp_schedule": "linear",
+    "t_power": 1.0,
+    "eta0": 0.12,
+    "eta_schedule": "early_linear",
+    "noise_conc": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 45.858783855541894,
+    "nll_per_token": 3.8255667584462514,
+    "tokens": 9677
+  },
+  "diversity": {
+    "sample_entropy": 4.225998514820446,
+    "unique_tokens": 1983,
+    "token_count": 8192,
+    "distinct_1": 0.2420654296875,
+    "distinct_2": 0.717888779527559,
+    "top_token_mass": 0.0540771484375
+  }
+}
+
+===== sample 000 =====
+[CLS] 2008, and just 20 % in march last year. [SEP] analysts at the luxembourg - based bank said net profit fell 12 percent to 6. 85 billion euros ($6. 95 billion), a profit of 6. 3 billion a year earlier. [SEP] i think the great tories have had a rather difficult encounter with this issue than many others, while the majority of the people in the british government know that they do not see such problems. [SEP] clinton called the georgia - georgia talks a major deal of change " with russia. [SEP] many in the bush administration remain optimistic about the relationship, making it very difficult for iran to send [SEP]
+
+===== sample 001 =====
+[CLS] foreign and foreign minister yu hyun has previously met chinese premier qishan to beijing, chinese minister of foreign trade and international development ma jiang yong, and foreign min minn yang - gang. [SEP] both president obama and his democratic rival senator john a. mccain criticized obama's decision to make immigration change a tougher approach. [SEP] she was 25 and won the support of thousands of white children during her defence of the sailing world title in august this year. [SEP] the two countries are at a later talks on the issue, the jerusalem post reported thursday, citing diplomatic sources. [SEP] for more information on iridium, visit the web site. [SEP]
+
+===== sample 002 =====
+[CLS] wouldn't be playing with somebody else, but i cant tell where i'm going, now, i'll feel okay... certainly not. [SEP] this article was first published on guardian. co. uk at 21. 06 bst on friday 14 september 2009. [SEP] evans: i don't know, be afraid. [SEP] meanwhile, tourism accounts for around a quarter of the state's transportation spending. [SEP] clinton told the president he would build support to the u. s. constitution during a trip on monday to the national foreign policy council conference in washington, d. c. the associated press said. [SEP]
+
+===== sample 003 =====
+[CLS] my friends and family, i still had a lot of friends there, and it was like meeting in harlem. [SEP] in the first week of a campaign since the week began sunday night, two national national television channels reported progress with rep. john murtha, the start of the candidate's first state of the union. [SEP] beckham, who has just retired from major league football, will do what the club is doing. [SEP] matt garcet worked the third, allowing only once despite his 14 career shutouts. [SEP] the 28 - year - old got his black and yellow caps slung on his father's back, [SEP]
+
+===== sample 004 =====
+[CLS] must coordinate domestic policy with their areas and provide more competition through better investment services. [SEP] it would be easier when it comes to running banks and raising capital. [SEP] "the second thing is to see if you are playing at no. 1 then, you've got to be seeing more than a couple of guys out of there about that," hansbrough said. [SEP] but to mr bhuo's dismay, mr hu held a meeting with him. [SEP] mr burnham is expected to outline the proposals at a news conference later this week. [SEP] but in a direct line with the law, the newspaper said that the fed [SEP]
+
+===== sample 005 =====
+[CLS]. s. defense secretary robert markey, u. s. gov. kathleen sebelius, u. s. secretary of state hillary rodham clinton will be there to commemorate the "national day of truth" - which was created as an memorial to the great depression. [SEP] an estimated 12 million children have left the state of all education this year to get extra room in life by the end of the decade. [SEP] he would have expected to move into the property market in december 2008 because of a strong tory refusal to cling on to the market, colluding it back to mr clegg. [SEP] many climate scientists [SEP]
+
+===== sample 006 =====
+[CLS] hillary clinton, bill clinton's press secretary, criticized clinton's visit to iraq at the end of the presidency, calling the presidential campaign thursday to say that the u. s. would step one step out of it. [SEP] known as a human house, the film has an unusual network of god - like characters. [SEP] the figure grew to 15 percent more people in the last about three months than there were six in the early 1970s. [SEP] i spent about 50 years of my school, planning to take one in at work at the university of miami park, including the view from the edge of the park. [SEP] new york ( [SEP]
+
+===== sample 007 =====
+[CLS] patricia crens, his wife, and ann crumpton, the chairman of the trust. [SEP] he said they were still dashing out of the region to prepare for a strong storm. [SEP] i do not believe that the response that i see is political. [SEP] rather than beborging her on her own mini - stiletto - free heels, she's actually a jokey figure. [SEP] millionaires are willing to spend their money to promote their retirees. [SEP] kabul (ap) - british prime minister gordon brown said sunday that nato and taliban forces have killed a total of 29 taliban militants in the eastern province of [SEP]
+
+===== sample 008 =====
+[CLS] last month but is expected to be ready to team up for the opening match. [SEP] eu commission chief general folha rogge also said that at present it was more likely the united states would agree to accept the russian compromise. [SEP] "president obama will be able to say what he said to the palestinians so he wants to say israel has been out of control since then." [SEP] mr olmert, the former mayor of talai, who is the oil minister and a former labor party leader, said mr kadyrov wanted to take up the post two years after talks on a west bank settlement. [SEP] the information [SEP]
+
+===== sample 009 =====
+[CLS] old antictal predictor. [SEP] cleveland police have arrested two men who were arrested for raping along with a 17 - year - old boy outside of a bar on saturday night alone, a police spokesman said. [SEP] maybe the pressure in congress to end this war will reach out to the russians, though that's how time goes on. [SEP] that's what i am waking up to for years. [SEP] indeed, the attention in europe is focused on high - profile green issues. [SEP] the space station, called jules hope, was built in response to space tourism and shuttle - station construction. [SEP] this compared with an overall [SEP]
+
+===== sample 010 =====
+[CLS] brown said his first visit to china was on tuesday and next week the planned one in asia. [SEP] brown is hoping to get the chance to be in his cabinet before the next 10 years. [SEP] mr. tsvangirai's spokesman confirmed that it did not provide any presidential figures and denied that he was addressing the political crisis. [SEP] in november, the rate of unemployment rate in california rose to 8. 0 percent, the second highest since the previous october. [SEP] i hope there was a general consensus there here. [SEP] they do, they can be on their own. [SEP] u. s. president barack obama said he was [SEP]
+
+===== sample 011 =====
+[CLS] that he met mr rattik twice during his flight at frankfurt airport in july, but did not give further details. [SEP] the chiefs head coach john mcgini announced after his meeting in minnesota in the early morning that said the sooners would leave the nfl, simply suspending the head coach and firings of the new head coach jerry smith. [SEP] "i want to start because i'm married and i want to say i've never done it," she said. [SEP] he has his say on a scheme to house one out of the 10 people. [SEP] he also criticized golf players tom and john mcclin, [SEP]
+
+===== sample 012 =====
+[CLS] the current economic crisis. [SEP] of course, the uk like other countries as well as in the world, sweden and britain, and spain is struggling with financial problems. [SEP] last week, bofa cautioned that it could not confirm the ap report. [SEP] "i want to try to focus more on me," she said. [SEP] this should say we are dealing with iran, " said seung - swung, a director of asia at the national security council. [SEP] state military spokesman lt. david o' brien said the unusual collision happened sunday during a major break linking the oregon and washington region to northwest england. [SEP] the [SEP]
+
+===== sample 013 =====
+[CLS] when the president planned to deliver the commencement address. [SEP] more than a dozen church leaders including jews, christians, buddhists and other orthodox buddhists offered guidelines on bibles and discussions with some from other denominations on church life and family. [SEP] but this is why sport is still on its stride. [SEP] it is understood to be on a more familiar side in politics, with research led by sir john major, the former chairman of the british council, and willie johnson, the social democrat, who are both prominent members of the royal london - based human rights group. [SEP] she was admitted to the hospital late on thursday. [SEP] unable to [SEP]
+
+===== sample 014 =====
+[CLS] of the bush campaign in cairo, said the administration did not heed calls to bail out the arab bank. [SEP] mr obama said that china was away from a series of promises of tax cuts which was released by mr obama's campaign in may last year. [SEP] it's my goal to get to the playoffs. [SEP] on wednesday, mr. liddy, who addressed the bank in a news conference, said he wanted to remain fired. [SEP] an average of analysts polled by reuters expected sales to range from a profit of $1. 17 to a loss of $1 billion a share, reuters estimates. [SEP] the dynamics of [SEP]
+
+===== sample 015 =====
+[CLS] " he's still at his best, but he has put his health on hold and has got back on his feet. [SEP] it also set the latest stage for expansion of social programs, including an initiative that helps employers build apprenticeships. [SEP] the information about the incident was released by police on tuesday 0800 gmt via the north yorkshire police. [SEP] he was not sure he had to play tuesday or make the playoffs. [SEP] los angeles (ap) - brett favre led the los angeles rams to national league championship super super bowl win sunday. [SEP] the head of the football association and football union, which represents professional players, [SEP]
+
+===== sample 016 =====
+[CLS] the new york jets defense. [SEP] i think it is impossible that any black author would know about black writers. [SEP] first, find a price for this property. [SEP] in the study, young children aged 12 to 15, middle - teens in their 30s, a mix of children, men, and women and children, and those in central and west london aged 13 to 17. [SEP] the european 10 - year us treasury rose 4. 6 per cent to 2. 46 per cent from 2380 dollars, while the australian euro slipped 0. 8 per cent to 2. 674. 75 dollars. [SEP] i wonder if he [SEP]
+
+===== sample 017 =====
+[CLS] opened to the public in 1997. [SEP] " it's been rid of the players, the people, coaches like myself, those people living with me, i'm the head coach, i don't care about this, you know, i'm just trying to know who i am. [SEP] you know him to get around, and he's a good, and then of course i can do years of trying to figure out what he's doing. [SEP] at the same time, they said, former minnesota gov. tim schfler was just trying to do what he told her. [SEP] berlus [SEP]
+
+===== sample 018 =====
+[CLS] a british man and a chinese woman traveling with him in london were arrested wednesday morning on suspicion of suspected drug trafficking by police in south africa. [SEP] he was described as a tough man, who will be redknapp's main aim. [SEP] the united states has denied this, but the state department has said that the israeli - israeli exchange between the new york times and iran increased the size of the israeli delegation, particularly amid concerns about the size of israel's program and extent of military operations. [SEP] more enlightened and sentimentalised, the film has now lost its own sense of vitality of mass market power. [SEP]
+
+===== sample 019 =====
+[CLS] xiaochuan said chinese law enforcement officials had spoken with officials with chinese agencies. [SEP] " i think it is time for people to contract before the midterms on the policy, make the first decision about when and get it. [SEP] mr. liebko and ms. clinton's deputy, the deputy agriculture secretary, kyi eo. [SEP] beijing (ap) - - china's prime minister will resume talks on saturday about improving trade ties between the two two countries, the chinese state news agency said tuesday. [SEP] i've been working here since... [SEP] on september 17, murtha [SEP]
+
+===== sample 020 =====
+[CLS] brown, the british minister, said. [SEP] what do you think of this place? [SEP] "you have people who i've wanted to get a long deal of time, a few of these people, you know, you know, so i'm quite happy, that's why i don't know," she said. [SEP] nevertheless, mr. o' malley said that despite the state's number of people, it's difficult for everyone to keep up with their own, especially when others have been accused of their own conduct. [SEP] the only way to know how different the circumstances are is to ask if [SEP]
+
+===== sample 021 =====
+[CLS] health program for all ills. [SEP] the white house has indicated its willingness to negotiate with iran's iranian nuclear program, emphasizing both israel and the american dream of a democratic state. [SEP] bush, after meeting with international journalists in japan, said he had hoped to encourage other parties in japan to support the united nations security council for nuclear sanctions. [SEP] " of course i would like to bring the uswp to the united states. [SEP] like sports, education and education programs, brokah does nothing to help, but he does a little stuff. [SEP] philadelphia eagles quarterback rob collison's interception in the first quarter [SEP]
+
+===== sample 022 =====
+[CLS] bank of america collapsed last monday due to the size of the housing market and related woes following the recent turmoil in the u. s. subprime home mortgage market. [SEP] such problems, it's thought, can just cause them. [SEP] he has a long history of sexual relationship with his wife, though he told of his life and accomplishments. [SEP] president obama's plan, which includes up to $200 billion of dollars in loans from private markets and an additional $100 billion in loan guarantees to buy troubled financial institutions, says he has no need to help boost the economy. [SEP] but mr biti said: " [SEP]
+
+===== sample 023 =====
+[CLS] year - old woman and her boyfriend, 21 - year - old john stapleton. [SEP] the bank, which cut more than 2, 500 jobs at its uk headquarters last week, said it is worth about £2. 3 billion and was expected to record losses of about 40 per cent of its revenues this year. [SEP] but nfl director tom williams would not confirm his board's report. [SEP] he said he was arrested at st george's police station at 11am ( gmt on 24 january after reports of being attacked by his girlfriend. [SEP] mr bickerton's offer is now worth £100 million. [SEP] it is not [SEP]
+
+===== sample 024 =====
+[CLS] too. [SEP] and i just don't call petchroa yet. [SEP] in the stern school of law school, he took much interest in his wife, professor william j. wluckahn, professor of law at danville, pa., and the national chairman of ubs's american law program, was one of the leading legal architects of venture capital law. [SEP] it said that israel would be outside the us at any time and obama made it clear that that he would not be surprised if the plan went down. [SEP] that is double the rate of 12. 6 deaths per week in britain, according [SEP]
+
+===== sample 025 =====
+[CLS] iraqi national security council in the days after the country's january elections. [SEP] obama was also expected to press congressional allies for an fbi investigation into the "smearing" e - mails by u. s. senate majority sen. hillary hillary clinton, d - nev., and house speaker nancy pelosi, which calls for senator kennedy's authority to allow his words to continue to occur both in the senate and in the history of the country. [SEP] the national job unemployment rate in that fiscal year - - 38 percent nationally, down from 47. 2 percent in the last three months of a year - - [SEP]
+
+===== sample 026 =====
+[CLS] countries, with a membership of just over 2 million. [SEP] dr michael bortlandt, director of the british education watch group, said the courses would be open to children, who are almost all closely involved in art, art, history, politics, and history. [SEP] the patriots don't like him. [SEP] the european stock exchange fell 1. 0. 4 euros to $3. 653, while gold fell to eight - month lows, with the euro at $3. 7538 to $3. 5905. [SEP] this is not the true record. - - john d. roberts, the federal supreme [SEP]
+
+===== sample 027 =====
+[CLS] day over the judgment, a senior public relations officer asked for the bank to disblose the debt. [SEP] the ministers would meet foreign secretary robert gates and state agencies on thursday, sources said. [SEP] the archbishop of england is also known for his views on the rights law. [SEP] since the report, a panel of outside experts have concluded that young people should be aware of an important role in taking these drugs. [SEP] the meeting comes after a series of crisis meetings with the un envoy to the greek socialist republic, georgi topolaas, following his period in government in the early 1990s. [SEP] he was only 20 minutes of [SEP]
+
+===== sample 028 =====
+[CLS] - maliki on saturday ended his three - week trip to iraq, iraq and central asia, the russian foreign ministry said on monday. [SEP] state lawmakers passed their legislation in 1998. [SEP] the officers who died in the attack have said the force would take action to improve security measures. [SEP] the governor of massachusetts, who is now chairman of the governor's house of staff, robert kiplen, was vice - president of the governor's health policy board last year. [SEP] "one of my major responsibilities in getting around that i can do is to get along with me," the three - year - old german said [SEP]
+
+===== sample 029 =====
+[CLS] million americans is twice the size of the population, but the number of veterans retired. [SEP] this isn't the first time in golf history starting at augusta, 4. 30am. [SEP] these include moving all the time on to the issue of homelessness, becoming obsessed with malcontinence and stupidity. [SEP] it is understood he is the anti - china antimatter and revisionist. [SEP] china - which accounts for almost half of the u. s. economy - enjoyed its annual growth rate of under 20 % in nearly two decades, leading the world out of the region to its peak in the early 1990ss. [SEP] [SEP]
+
+===== sample 030 =====
+[CLS] at 27. 9 million. [SEP] more recently, cnn's gloria clark, one of the three house house democrats suggested that the governor's actions were necessary to undermine the gop's political mindset and shift the focus to the state's cleme control. [SEP] the man's case has not been extensively briefed by state media. [SEP] the university of miami's women's media center and bachelor's of education and management school at colby college, northern michigan, where he used his expertise to work in finance, business, communications, law, finance and distribution. [SEP] as a result, the president [SEP]
+
+===== sample 031 =====
+[CLS] to produce a good documentary, the filmmaker ben taylor, who was involved in the 2005 film and starring hollywood director steven spielberg at the time, has long said he's reluctant to recomcoct a high - level celebrity. [SEP] "if you've got a problem in north africa, i want to see a result," rob johnson said. [SEP] a judge has released a north carolina man who killed his teenage son's wife on her plane. [SEP] over the course of eight months, the european union rejected the idea and struck a deal. [SEP] other media groups will see the abortions as the beginning of a [SEP]
+
+===== sample 032 =====
+[CLS] over why he opposed the terror attacks. [SEP] the fire on friday took up to four hours to reach that area. [SEP] asked who would support the author of the bill and the three republican votes approved on the year's presidential end, dodd said he had no regrets during a lengthy debate with republicans, reminding members of the benefits of non - reconciliation measures. [SEP] " i did very much like going to the ring. [SEP] this was his most recent visit to fight the taliban leadership in pakistan. [SEP] bill clinton is trying to call hillary clinton the woman president of the united states, but she'll probably be looking to hillary again, [SEP]
+
+===== sample 033 =====
+[CLS] into the government - - a degree of shorthand in the books of the shadow government at the turn of the century and he was a sure - name, until he went to the school of public administration in cambridge and the university. [SEP] after 21 years of education, for the majority of school year total, 37. 8 % of those aged 16 - to 25 - 41. 5 % were aged 18 - 17. [SEP] the organising committee of the county's main railway park east of the scottish borders has agreed to display a £2, 000 sculpture to mark "defending the national park for scotland." [SEP] the ministry of defense said [SEP]
+
+===== sample 034 =====
+[CLS] [SEP] "we wanted to investigate the origins of our disease," said dr. gail westden, a professor at allen university, texas. [SEP] the city's events are open wednesdays, daily 10 a. m. to 3 a. m. s., 9 p. m. to 9 p. m. [SEP] los angeles lakers coach roy williams is still trying to replace steve mclanton, who became head coach in the same day. [SEP] mr blair is expected to stand down from his father when he finishes as british prime minister. [SEP] john lennon's attorney, mark clifford, has agreed to hear off the [SEP]
+
+===== sample 035 =====
+[CLS] the party. [SEP] this is an atypical vision of the future after six years in david cameron's last election campaign, but at that time this weekend, there is little to avoid the fact that he is going to be such a president that the party has been unable to agree. [SEP] this is just an opportunity to play a presidential role. [SEP] u. s. sources have said obama's administration is aiming to send an ambassador to japan next month. [SEP] the u. s. ambassador was signed wednesday by italian foreign minister giorgi frattini and venezuela's foreign minister carlos merc, in cooperation with [SEP]
+
+===== sample 036 =====
+[CLS] [SEP] cbs ): i'm living and living with being whores, sexists, lesbians, hairdressers, women, vegetarians, working americans. [SEP] that's the problem. [SEP] right now, i believe this will save the country a lot less money. [SEP] mr smith will be joining preston - clough club fc and fa cup to support their ambitious drive to bring the best possible quality of english football to scotland. [SEP] after capturing the first race of the season, riesna won the race's largest title after a frustrating run of five qualifying races last year with injuries. [SEP] he was arrested [SEP]
+
+===== sample 037 =====
+[CLS] have been training camp for the national football conference and the head coach in the nfl league - the national football league's coach of the year. [SEP] the school is designed to support educational policy, education, and speech, government and policy management, university education, and medical education. [SEP] mr. haroon's family has filed more than $1 billion in litigation since around the turn of last year. [SEP] a professional rescue team of six has been killed by a wind in glasnost in the uk. [SEP] "i'll know my plans for the role," he said. [SEP] the study is taking on [SEP]
+
+===== sample 038 =====
+[CLS]usconi's last move was a national campaign to back the constitution. [SEP] he will probably meet obama and his wife, michelle, the same week, said wolf blitzer, the president of the campaign group, a task force for obama to protect blacks and whites. [SEP] at the moment, mr. mccain is calling on the president to "pick a man who shows great patience with america" - the same straight - talking man who describes himself as president - - the same event he held at the same republican meeting. [SEP] the meeting in the french capital of paris may just have something else to do. [SEP] obama and hillary [SEP]
+
+===== sample 039 =====
+[CLS] in the previous 12 months, rising to 20. 2 and 14. 4m points in the third quarter, while the unemployment rate was at 2. 3 per cent in recent quarters. [SEP] northamptonshire police say a man has been charged with strangling a lorry. [SEP] in 2007, australia's foreign trade fell by 25 per cent to around £14 billion. [SEP] " it goes, i don't say, 'that will be enough'. [SEP] but trumpeting the idea that women take over their jobs in public are baffling. [SEP] correa came into the race's second lap, leaving the [SEP]
+
+===== sample 040 =====
+[CLS] strength of russia and other international powers is behind the attack. [SEP] korea and the koreas, in less than 20 years. [SEP] two people were killed when an motorist man was shot in the head by two - armed robbers on merseyside. [SEP] johnson is one of several women that has won a run for city hall. [SEP] this could also affect the preparations for the gulf streamfield, the largest offshore oil complex in the northern gulf of mexico. [SEP] last night's emotional reward for the moment claimed mark hughes's first win for the st james's club, which confirmed his arrival to west ham united in 2007 [SEP]
+
+===== sample 041 =====
+[CLS] gas stations. [SEP] the city's council president said he had received no assurances that the company would make an offer. [SEP] the eu will soon see a new level of co - operation, the group said, due to a proposed eu directive and growing cooperation over consumer issues, policy and cost decisions. [SEP] "we call for help." [SEP] mr. obama announced the visit of his democratic rival, joseph biden, a former massachusetts democrat who said he would not think of his chance of being part of his presidential campaign. [SEP] washington state quarterback steve mizme threw three passes for 20 yards fourth down with less than a [SEP]
+
+===== sample 042 =====
+[CLS] hope program, the school for girls' schools and families for children. [SEP] but israeli prime minister benjamin netanyahu reached a deal with israeli prime minister benjamin netanyahu to make important pledges to the u. s. and urge him to continue israeli - israeli peace development of the future conflict. [SEP] round - trip costs from £39, b & b (including air travel) and south africa (01781 - 6077 52786, www. africavalofonce. com) from £71 on a single night, including hotel accommodation, a departure card, with breakfast, and a [SEP]
+
+===== sample 043 =====
+[CLS] [SEP] the company's phone is made of software that identifies words, gestures and phrases. [SEP] the video is shown a young man on ninth avenue and a 19 - year - old man being arrested. [SEP] john goodby, the billionaire investor, was on the market on tuesday and had bought it for £1, but never put a foot in the market. [SEP] "we're very confident that we can win this game," new york jets' owner eric mangini said. [SEP] the former presidents are expected to use a coming - out of senators to press their arguments about as much as the next president would do. [SEP] [SEP]
+
+===== sample 044 =====
+[CLS] gunghant's website, chinat. com. [SEP] wenger said he doesn't think he is a member of the hierarchy of capello, the arsenal manager who joined the club in 2003, although the england manager's habit of focusing on his grandest is about to be end. [SEP] mr johnson, who took the stand, refused to hear his mother's call. [SEP] he and senior south korean officials were expected to meet friday with security council president stephen bosworth to discuss the situation in geneva. [SEP] gov. john romney, meanwhile, withdrew from the republican side. [SEP] it's hard to [SEP]
+
+===== sample 045 =====
+[CLS] about 2 per cent to £56m, lower than its second half average, and at least 300m euros (1, 343m), including a sharp drop in profits for the year. [SEP] "it might be premature in europe to think that the credit crisis is under control, but it came to an end," said gerard goldman at ubs global credit market research. [SEP] it's striking, because the american public will respond to it for all the government help to prop up the financial system. [SEP] britain is planning to build up its troops in iraq by the end of 2010 but ministers have refused to give back [SEP]
+
+===== sample 046 =====
+[CLS] of zimbabwe's opposition movement mdd gathered wednesday in the country's capital, harare, wednesday to demand elections. [SEP] one of the key tasks of england's was to get a world title, so they can become competitive and get a better result. [SEP] (ap) - a 77 - foot house in long island's international airport will move into the penthouse of a new six - building that reached 100 square feet saturday, making it home to a two - story tower and a small commercial hotel. [SEP] but most surprisingly, the demands of business and technical science and technology at least have limited their selection of places. [SEP]
+
+===== sample 047 =====
+[CLS] - old and he grew up as a retired school teacher, albeit with a smaller population. [SEP] i doubt that government eliminates me. [SEP] in the times, the government, and the most senior branch of the cabinet, is reviewing its options and may not see an answer to that matter. [SEP] this particular movement is convenient, but it represents the only way to support the cosy notion that all children are descended from intellectual property race to exploitation of the rarest of information. [SEP] the euro was trading at $1. 519 from $1. 5140 late in new york. [SEP] " we do not think she's [SEP]
+
+===== sample 048 =====
+[CLS] s military says most of its fighters are regarded as an umbrella arm of the militant al - qaida group in iran. [SEP] two years ago, i got a drug called "the line of spring." [SEP] new york (ap) - wall street's biggest banks posted losses in the third quarter as wall street plummeted another $4 billion loss, while the federal government again struggled to shore up its capital with mounting losses. [SEP] however, the number of people admitted to gocountry will also be limited in the region - - 50 miles or less, the report says. [SEP] in a big way, china [SEP]
+
+===== sample 049 =====
+[CLS] to a few days of media contacts with other iraqi news agencies. [SEP] the hewlett air jordan travel service (0870 803 90995; 0045 7082 609; www. ibfirk. co. uk) has seven nights in the (£6. 50 per person from £1, 500pp, with return flights from airport and transfers). [SEP] i wanted to know whether johnson was leading the country, especially in an age that wants to know what america is about our responsibility. [SEP] o' neill was up for it, and he wasn't sure which of his players. [SEP] the [SEP]
+
+===== sample 050 =====
+[CLS] 30 - year - olds were overweight in 2007, while in england, 17 % are over - 30 - 40 and 18 % are aged over - 40. [SEP] a number of gm and gm officials also said that gm could be left without a deal. [SEP] the ice age study was developed by the university of science in bradford, southwest england. [SEP] hughes is emphasised from the stoicism of the 28 - year - old spaniard, the 19 - year - old and his wife. [SEP] today, with only three million miles away, it's hard to sustain it. [SEP] it is a children's school, [SEP]
+
+===== sample 051 =====
+[CLS] learning how to make noise. [SEP] but the democrats have stepped up their attacks at the same time that defense secretary robert gates has been following the president. [SEP] in a routine look of his body and body, the man in the bed of blue perch on the dance floor - - as if he does not want to go home. [SEP] the chinese government seemed to do better than many had expected. [SEP] former national league mvp wide receiver jason witten took control of the game on sunday, breaking the franchise record with three touchdowns and interceptions in one of the longest passing setbacks in league history. [SEP] but he and msp are strongly against [SEP]
+
+===== sample 052 =====
+[CLS] said. [SEP] o' brien wasn't thinking a lot yet. [SEP] he returned to the disabled after missing the entire season with a left groin injury that limited him to games last month, allowing him to start only for half the season. [SEP] there's nothing unusual about people leaving these positions, " he says. [SEP] the father, brian, arrived in mexico at the age of her father who ended up separated by an unpatried mother, and helped his son into the main projects of his seven - year career: a college and college football coach, basketball career at mississippi state university, high school football in chicago, [SEP]
+
+===== sample 053 =====
+[CLS] americans believe that they're talking about their national interests, the ukraine and russia, the middle east and non - muslims. [SEP] a total of 50, 000 workers in britain were called to work shortly after 1700 bst. [SEP] arab and iranian officials say the region no longer set up discussions with the u. s. government about paring its relationship with iran. [SEP] john bruschard, the executive director of research, said it is not the way rbs is promoting the rate of pay. [SEP] toyota motor corp. president and chief jim muna pulled out of detroit as part of his talks with a rival automaker [SEP]
+
+===== sample 054 =====
+[CLS] me and my daughter, " she said. [SEP] no need to sit back and listen to the truth. [SEP] some people do look for themselves by the way their children do. [SEP] he has enough experience to find a new manager and liverpool may want to pay him that money to add more room at the club. [SEP] then, o'o' hara came in just a fraction of the left and saw her 80 - yard shot over the line. [SEP] but philadelphia's previous ownery, vecchio williams, simply played to the past. [SEP] i knew he would be happy to be playing for england in south africa. [SEP] [SEP]
+
+===== sample 055 =====
+[CLS] it was going to be more affordable and accessible to middle - class schoolers. [SEP] james seltra, 50, of stapleton, said: "the man's family will remain concerned about his dna testing and doesn't know about the victim's value to come forward. [SEP]" it's the real story, "said unicef executive medical director lord pattack. [SEP]" it's difficult to say, i feel better about today. [SEP] they don't know the difference. [SEP] what would give him seven years? " [SEP] to put that question in perspective, the pittsburgh express - times reported wednesday [SEP]
+
+===== sample 056 =====
+[CLS] korea, or china and india. "[SEP]" in the end, i know this if the kids don't win, and i feel that you want to disapect to just doing something like'keep on winning,' "said washington state coach stephen kelly. [SEP] mr cameron used his own account of the work of his father, john guabe, published earlier this year, to make the point about the challenges of living in britain. [SEP] straight into the centre of the city, the walls leave a mirage - like anecdotal scene. [SEP]" it's a bit of a charade, in fact [SEP]
+
+===== sample 057 =====
+[CLS] all 13 players, the better the team and its players are in the game. [SEP] the conservatives ramp up their critics like baby boomers. [SEP] if they have the money and experience of their high and high school classmates, it's almost impossible. [SEP] china's foreign minister qin yu told reporters on friday that the chinese administration was still working on efforts to reach a six - nation agreement to "reset" relations with the north after pyongyang conducted its nuclear test. [SEP] " the number of people in the stadium hasn't changed at all since 2007 - 08, so it's not difficult for us to go [SEP]
+
+===== sample 058 =====
+[CLS] end of the house's history. [SEP] on wednesday, mr. mcneill issued a statement on the numbers, and it is expected to last thursday as members of the cabinet announced that the afghan security chief was due to step down on saturday. [SEP] zelaya on friday also said he's support huckabee's choice to head to the u. s. and said he thinks he will remain for president under the current administration. [SEP] answer that must - be - answered question - and - answer question. [SEP] unfortunately, both agree, but you realize that this is not a legitimate issue - - he's [SEP]
+
+===== sample 059 =====
+[CLS] hearing, is due before 1800 gmt on monday. [SEP] niu union vice president lee yong - hak said tuesday that the leaders of the unions, the national association of teachers and the school administrators, were expected to approve it. [SEP] go to stone cottage (010 cromwell street; 002 4567667); www. stonepassespring. com. [SEP] in california, manufacturing rose 17. 2 per cent, manufacturing rose 20. 7 per cent, employment in michigan rose 26. 4 cent and pennsylvania added 14. 9 cent. [SEP] according to reports, the officers stood in front of his home [SEP]
+
+===== sample 060 =====
+[CLS]. [SEP] obama has been the divided one at the pentagon. [SEP] the leaders left the white house on sunday night to attend the second round of united nations meeting, officials said. [SEP] "when i just go to school in italy, see what's going on and then you want to make me something and buy a gun," she said. [SEP] as he took the fa and england boss last season and the coach in 2001, johnson has bought manchester united fans and adebayor supporters with considerable authority and experience and built a strong attack team. [SEP] north korea's decision to build a proposed human rights commission for the country [SEP]
+
+===== sample 061 =====
+[CLS] of equipment to be used for the new national surveillance system over the next three years, meaning the uk would have to set up its own security rules. [SEP] chinese foreign ministry secretary liu zhaoxo echoed the chinese ambassador to pyongyang's comment friday, citing the dispute of china with china's major power suppliers. [SEP] but the results of this week's annapolis forum - dominated by direct opponents to the israeli leader - - suggest both sides remain stuck on a deal. [SEP] the team is designed by french coach rick busas and noe d almeria, who started his young football in the ancient city of [SEP]
+
+===== sample 062 =====
+[CLS] nuclear activities will not involve effective security measures, and the secretary general will discuss the entire nuclear issue, "his office said. [SEP]" mr johnson was shot on the head while the school was drinking, "a sheriff said. [SEP] however, johnson's appointment will be a boost for a manager who might help manchester city to qualify for the anglo - premier league competition. [SEP] he added that lots of drivers don't have to pay. [SEP] a day later in the most contentious debate of the campaign, edwards said he believed he was adopting the" back to basics " policy of mr obama's campaign. [SEP] he spoke with [SEP]
+
+===== sample 063 =====
+[CLS] have a social problem, " said david parris, a senior researcher who led the study at the columbia university school of science and the director of the national institute of mental health in new york in an interview. [SEP] congress has said it wants to help support the budget. [SEP] but myanmar's leaders have suggested that the interim government is expected to try to form its own government. [SEP] what makes making a good film simple: keep a close eye on everyone who gets shot. [SEP] the national bureau of statistics uk grew at an annual rate of 2. 3 per cent at the start of 2006 - 2007, but this fell further in [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_diffusion_noise_steps_128steps_n64/noise_linear2to08_early_linear_eta0p12_c256_scored.jsonl

@@ -0,0 +1,65 @@
+{"type": "summary", "name": "noise_linear2to08_early_linear_eta0p12_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "noise_linear2to08_early_linear_eta0p12_c256", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 45.858783855541894, "nll_per_token": 3.8255667584462514, "tokens": 9677}, "diversity": {"sample_entropy": 4.225998514820446, "unique_tokens": 1983, "token_count": 8192, "distinct_1": 0.2420654296875, "distinct_2": 0.717888779527559, "top_token_mass": 0.0540771484375}}
+{"type": "sample", "index": 0, "raw_text": "[CLS] 2008, and just 20 % in march last year. [SEP] analysts at the luxembourg - based bank said net profit fell 12 percent to 6. 85 billion euros ( $ 6. 95 billion ), a profit of 6. 3 billion a year earlier. [SEP] i think the great tories have had a rather difficult encounter with this issue than many others, while the majority of the people in the british government know that they do not see such problems. [SEP] clinton called the georgia - georgia talks a major deal of change \" with russia. [SEP] many in the bush administration remain optimistic about the relationship, making it very difficult for iran to send [SEP]", "detok_text": "[CLS] 2008, and just 20 % in march last year. [SEP] analysts at the luxembourg - based bank said net profit fell 12 percent to 6. 85 billion euros ($6. 95 billion), a profit of 6. 3 billion a year earlier. [SEP] i think the great tories have had a rather difficult encounter with this issue than many others, while the majority of the people in the british government know that they do not see such problems. [SEP] clinton called the georgia - georgia talks a major deal of change \" with russia. [SEP] many in the bush administration remain optimistic about the relationship, making it very difficult for iran to send [SEP]"}
+{"type": "sample", "index": 1, "raw_text": "[CLS] foreign and foreign minister yu hyun has previously met chinese premier qishan to beijing, chinese minister of foreign trade and international development ma jiang yong, and foreign min minn yang - gang. [SEP] both president obama and his democratic rival senator john a. mccain criticized obama ' s decision to make immigration change a tougher approach. [SEP] she was 25 and won the support of thousands of white children during her defence of the sailing world title in august this year. [SEP] the two countries are at a later talks on the issue, the jerusalem post reported thursday, citing diplomatic sources. [SEP] for more information on iridium, visit the web site. [SEP]", "detok_text": "[CLS] foreign and foreign minister yu hyun has previously met chinese premier qishan to beijing, chinese minister of foreign trade and international development ma jiang yong, and foreign min minn yang - gang. [SEP] both president obama and his democratic rival senator john a. mccain criticized obama's decision to make immigration change a tougher approach. [SEP] she was 25 and won the support of thousands of white children during her defence of the sailing world title in august this year. [SEP] the two countries are at a later talks on the issue, the jerusalem post reported thursday, citing diplomatic sources. [SEP] for more information on iridium, visit the web site. [SEP]"}
+{"type": "sample", "index": 2, "raw_text": "[CLS] wouldn ' t be playing with somebody else, but i cant tell where i ' m going, now, i ' ll feel okay... certainly not. [SEP] this article was first published on guardian. co. uk at 21. 06 bst on friday 14 september 2009. [SEP] evans : i don ' t know, be afraid. [SEP] meanwhile, tourism accounts for around a quarter of the state ' s transportation spending. [SEP] clinton told the president he would build support to the u. s. constitution during a trip on monday to the national foreign policy council conference in washington, d. c. the associated press said. [SEP]", "detok_text": "[CLS] wouldn't be playing with somebody else, but i cant tell where i'm going, now, i'll feel okay... certainly not. [SEP] this article was first published on guardian. co. uk at 21. 06 bst on friday 14 september 2009. [SEP] evans: i don't know, be afraid. [SEP] meanwhile, tourism accounts for around a quarter of the state's transportation spending. [SEP] clinton told the president he would build support to the u. s. constitution during a trip on monday to the national foreign policy council conference in washington, d. c. the associated press said. [SEP]"}
+{"type": "sample", "index": 3, "raw_text": "[CLS] my friends and family, i still had a lot of friends there, and it was like meeting in harlem. [SEP] in the first week of a campaign since the week began sunday night, two national national television channels reported progress with rep. john murtha, the start of the candidate ' s first state of the union. [SEP] beckham, who has just retired from major league football, will do what the club is doing. [SEP] matt garcet worked the third, allowing only once despite his 14 career shutouts. [SEP] the 28 - year - old got his black and yellow caps slung on his father ' s back, [SEP]", "detok_text": "[CLS] my friends and family, i still had a lot of friends there, and it was like meeting in harlem. [SEP] in the first week of a campaign since the week began sunday night, two national national television channels reported progress with rep. john murtha, the start of the candidate's first state of the union. [SEP] beckham, who has just retired from major league football, will do what the club is doing. [SEP] matt garcet worked the third, allowing only once despite his 14 career shutouts. [SEP] the 28 - year - old got his black and yellow caps slung on his father's back, [SEP]"}
+{"type": "sample", "index": 4, "raw_text": "[CLS] must coordinate domestic policy with their areas and provide more competition through better investment services. [SEP] it would be easier when it comes to running banks and raising capital. [SEP] \" the second thing is to see if you are playing at no. 1 then, you ' ve got to be seeing more than a couple of guys out of there about that, \" hansbrough said. [SEP] but to mr bhuo ' s dismay, mr hu held a meeting with him. [SEP] mr burnham is expected to outline the proposals at a news conference later this week. [SEP] but in a direct line with the law, the newspaper said that the fed [SEP]", "detok_text": "[CLS] must coordinate domestic policy with their areas and provide more competition through better investment services. [SEP] it would be easier when it comes to running banks and raising capital. [SEP] \"the second thing is to see if you are playing at no. 1 then, you've got to be seeing more than a couple of guys out of there about that,\" hansbrough said. [SEP] but to mr bhuo's dismay, mr hu held a meeting with him. [SEP] mr burnham is expected to outline the proposals at a news conference later this week. [SEP] but in a direct line with the law, the newspaper said that the fed [SEP]"}
+{"type": "sample", "index": 5, "raw_text": "[CLS]. s. defense secretary robert markey, u. s. gov. kathleen sebelius, u. s. secretary of state hillary rodham clinton will be there to commemorate the \" national day of truth \" - which was created as an memorial to the great depression. [SEP] an estimated 12 million children have left the state of all education this year to get extra room in life by the end of the decade. [SEP] he would have expected to move into the property market in december 2008 because of a strong tory refusal to cling on to the market, colluding it back to mr clegg. [SEP] many climate scientists [SEP]", "detok_text": "[CLS]. s. defense secretary robert markey, u. s. gov. kathleen sebelius, u. s. secretary of state hillary rodham clinton will be there to commemorate the \"national day of truth\" - which was created as an memorial to the great depression. [SEP] an estimated 12 million children have left the state of all education this year to get extra room in life by the end of the decade. [SEP] he would have expected to move into the property market in december 2008 because of a strong tory refusal to cling on to the market, colluding it back to mr clegg. [SEP] many climate scientists [SEP]"}
+{"type": "sample", "index": 6, "raw_text": "[CLS] hillary clinton, bill clinton ' s press secretary, criticized clinton ' s visit to iraq at the end of the presidency, calling the presidential campaign thursday to say that the u. s. would step one step out of it. [SEP] known as a human house, the film has an unusual network of god - like characters. [SEP] the figure grew to 15 percent more people in the last about three months than there were six in the early 1970s. [SEP] i spent about 50 years of my school, planning to take one in at work at the university of miami park, including the view from the edge of the park. [SEP] new york ( [SEP]", "detok_text": "[CLS] hillary clinton, bill clinton's press secretary, criticized clinton's visit to iraq at the end of the presidency, calling the presidential campaign thursday to say that the u. s. would step one step out of it. [SEP] known as a human house, the film has an unusual network of god - like characters. [SEP] the figure grew to 15 percent more people in the last about three months than there were six in the early 1970s. [SEP] i spent about 50 years of my school, planning to take one in at work at the university of miami park, including the view from the edge of the park. [SEP] new york ( [SEP]"}
+{"type": "sample", "index": 7, "raw_text": "[CLS] patricia crens, his wife, and ann crumpton, the chairman of the trust. [SEP] he said they were still dashing out of the region to prepare for a strong storm. [SEP] i do not believe that the response that i see is political. [SEP] rather than beborging her on her own mini - stiletto - free heels, she ' s actually a jokey figure. [SEP] millionaires are willing to spend their money to promote their retirees. [SEP] kabul ( ap ) - british prime minister gordon brown said sunday that nato and taliban forces have killed a total of 29 taliban militants in the eastern province of [SEP]", "detok_text": "[CLS] patricia crens, his wife, and ann crumpton, the chairman of the trust. [SEP] he said they were still dashing out of the region to prepare for a strong storm. [SEP] i do not believe that the response that i see is political. [SEP] rather than beborging her on her own mini - stiletto - free heels, she's actually a jokey figure. [SEP] millionaires are willing to spend their money to promote their retirees. [SEP] kabul (ap) - british prime minister gordon brown said sunday that nato and taliban forces have killed a total of 29 taliban militants in the eastern province of [SEP]"}
+{"type": "sample", "index": 8, "raw_text": "[CLS] last month but is expected to be ready to team up for the opening match. [SEP] eu commission chief general folha rogge also said that at present it was more likely the united states would agree to accept the russian compromise. [SEP] \" president obama will be able to say what he said to the palestinians so he wants to say israel has been out of control since then. \" [SEP] mr olmert, the former mayor of talai, who is the oil minister and a former labor party leader, said mr kadyrov wanted to take up the post two years after talks on a west bank settlement. [SEP] the information [SEP]", "detok_text": "[CLS] last month but is expected to be ready to team up for the opening match. [SEP] eu commission chief general folha rogge also said that at present it was more likely the united states would agree to accept the russian compromise. [SEP] \"president obama will be able to say what he said to the palestinians so he wants to say israel has been out of control since then.\" [SEP] mr olmert, the former mayor of talai, who is the oil minister and a former labor party leader, said mr kadyrov wanted to take up the post two years after talks on a west bank settlement. [SEP] the information [SEP]"}
+{"type": "sample", "index": 9, "raw_text": "[CLS] old antictal predictor. [SEP] cleveland police have arrested two men who were arrested for raping along with a 17 - year - old boy outside of a bar on saturday night alone, a police spokesman said. [SEP] maybe the pressure in congress to end this war will reach out to the russians, though that ' s how time goes on. [SEP] that ' s what i am waking up to for years. [SEP] indeed, the attention in europe is focused on high - profile green issues. [SEP] the space station, called jules hope, was built in response to space tourism and shuttle - station construction. [SEP] this compared with an overall [SEP]", "detok_text": "[CLS] old antictal predictor. [SEP] cleveland police have arrested two men who were arrested for raping along with a 17 - year - old boy outside of a bar on saturday night alone, a police spokesman said. [SEP] maybe the pressure in congress to end this war will reach out to the russians, though that's how time goes on. [SEP] that's what i am waking up to for years. [SEP] indeed, the attention in europe is focused on high - profile green issues. [SEP] the space station, called jules hope, was built in response to space tourism and shuttle - station construction. [SEP] this compared with an overall [SEP]"}
+{"type": "sample", "index": 10, "raw_text": "[CLS] brown said his first visit to china was on tuesday and next week the planned one in asia. [SEP] brown is hoping to get the chance to be in his cabinet before the next 10 years. [SEP] mr. tsvangirai ' s spokesman confirmed that it did not provide any presidential figures and denied that he was addressing the political crisis. [SEP] in november, the rate of unemployment rate in california rose to 8. 0 percent, the second highest since the previous october. [SEP] i hope there was a general consensus there here. [SEP] they do, they can be on their own. [SEP] u. s. president barack obama said he was [SEP]", "detok_text": "[CLS] brown said his first visit to china was on tuesday and next week the planned one in asia. [SEP] brown is hoping to get the chance to be in his cabinet before the next 10 years. [SEP] mr. tsvangirai's spokesman confirmed that it did not provide any presidential figures and denied that he was addressing the political crisis. [SEP] in november, the rate of unemployment rate in california rose to 8. 0 percent, the second highest since the previous october. [SEP] i hope there was a general consensus there here. [SEP] they do, they can be on their own. [SEP] u. s. president barack obama said he was [SEP]"}
+{"type": "sample", "index": 11, "raw_text": "[CLS] that he met mr rattik twice during his flight at frankfurt airport in july, but did not give further details. [SEP] the chiefs head coach john mcgini announced after his meeting in minnesota in the early morning that said the sooners would leave the nfl, simply suspending the head coach and firings of the new head coach jerry smith. [SEP] \" i want to start because i ' m married and i want to say i ' ve never done it, \" she said. [SEP] he has his say on a scheme to house one out of the 10 people. [SEP] he also criticized golf players tom and john mcclin, [SEP]", "detok_text": "[CLS] that he met mr rattik twice during his flight at frankfurt airport in july, but did not give further details. [SEP] the chiefs head coach john mcgini announced after his meeting in minnesota in the early morning that said the sooners would leave the nfl, simply suspending the head coach and firings of the new head coach jerry smith. [SEP] \"i want to start because i'm married and i want to say i've never done it,\" she said. [SEP] he has his say on a scheme to house one out of the 10 people. [SEP] he also criticized golf players tom and john mcclin, [SEP]"}
+{"type": "sample", "index": 12, "raw_text": "[CLS] the current economic crisis. [SEP] of course, the uk like other countries as well as in the world, sweden and britain, and spain is struggling with financial problems. [SEP] last week, bofa cautioned that it could not confirm the ap report. [SEP] \" i want to try to focus more on me, \" she said. [SEP] this should say we are dealing with iran, \" said seung - swung, a director of asia at the national security council. [SEP] state military spokesman lt. david o ' brien said the unusual collision happened sunday during a major break linking the oregon and washington region to northwest england. [SEP] the [SEP]", "detok_text": "[CLS] the current economic crisis. [SEP] of course, the uk like other countries as well as in the world, sweden and britain, and spain is struggling with financial problems. [SEP] last week, bofa cautioned that it could not confirm the ap report. [SEP] \"i want to try to focus more on me,\" she said. [SEP] this should say we are dealing with iran, \" said seung - swung, a director of asia at the national security council. [SEP] state military spokesman lt. david o' brien said the unusual collision happened sunday during a major break linking the oregon and washington region to northwest england. [SEP] the [SEP]"}
+{"type": "sample", "index": 13, "raw_text": "[CLS] when the president planned to deliver the commencement address. [SEP] more than a dozen church leaders including jews, christians, buddhists and other orthodox buddhists offered guidelines on bibles and discussions with some from other denominations on church life and family. [SEP] but this is why sport is still on its stride. [SEP] it is understood to be on a more familiar side in politics, with research led by sir john major, the former chairman of the british council, and willie johnson, the social democrat, who are both prominent members of the royal london - based human rights group. [SEP] she was admitted to the hospital late on thursday. [SEP] unable to [SEP]", "detok_text": "[CLS] when the president planned to deliver the commencement address. [SEP] more than a dozen church leaders including jews, christians, buddhists and other orthodox buddhists offered guidelines on bibles and discussions with some from other denominations on church life and family. [SEP] but this is why sport is still on its stride. [SEP] it is understood to be on a more familiar side in politics, with research led by sir john major, the former chairman of the british council, and willie johnson, the social democrat, who are both prominent members of the royal london - based human rights group. [SEP] she was admitted to the hospital late on thursday. [SEP] unable to [SEP]"}
+{"type": "sample", "index": 14, "raw_text": "[CLS] of the bush campaign in cairo, said the administration did not heed calls to bail out the arab bank. [SEP] mr obama said that china was away from a series of promises of tax cuts which was released by mr obama ' s campaign in may last year. [SEP] it ' s my goal to get to the playoffs. [SEP] on wednesday, mr. liddy, who addressed the bank in a news conference, said he wanted to remain fired. [SEP] an average of analysts polled by reuters expected sales to range from a profit of $ 1. 17 to a loss of $ 1 billion a share, reuters estimates. [SEP] the dynamics of [SEP]", "detok_text": "[CLS] of the bush campaign in cairo, said the administration did not heed calls to bail out the arab bank. [SEP] mr obama said that china was away from a series of promises of tax cuts which was released by mr obama's campaign in may last year. [SEP] it's my goal to get to the playoffs. [SEP] on wednesday, mr. liddy, who addressed the bank in a news conference, said he wanted to remain fired. [SEP] an average of analysts polled by reuters expected sales to range from a profit of $1. 17 to a loss of $1 billion a share, reuters estimates. [SEP] the dynamics of [SEP]"}
+{"type": "sample", "index": 15, "raw_text": "[CLS] \" he ' s still at his best, but he has put his health on hold and has got back on his feet. [SEP] it also set the latest stage for expansion of social programs, including an initiative that helps employers build apprenticeships. [SEP] the information about the incident was released by police on tuesday 0800 gmt via the north yorkshire police. [SEP] he was not sure he had to play tuesday or make the playoffs. [SEP] los angeles ( ap ) - brett favre led the los angeles rams to national league championship super super bowl win sunday. [SEP] the head of the football association and football union, which represents professional players, [SEP]", "detok_text": "[CLS] \" he's still at his best, but he has put his health on hold and has got back on his feet. [SEP] it also set the latest stage for expansion of social programs, including an initiative that helps employers build apprenticeships. [SEP] the information about the incident was released by police on tuesday 0800 gmt via the north yorkshire police. [SEP] he was not sure he had to play tuesday or make the playoffs. [SEP] los angeles (ap) - brett favre led the los angeles rams to national league championship super super bowl win sunday. [SEP] the head of the football association and football union, which represents professional players, [SEP]"}
+{"type": "sample", "index": 16, "raw_text": "[CLS] the new york jets defense. [SEP] i think it is impossible that any black author would know about black writers. [SEP] first, find a price for this property. [SEP] in the study, young children aged 12 to 15, middle - teens in their 30s, a mix of children, men, and women and children, and those in central and west london aged 13 to 17. [SEP] the european 10 - year us treasury rose 4. 6 per cent to 2. 46 per cent from 2380 dollars, while the australian euro slipped 0. 8 per cent to 2. 674. 75 dollars. [SEP] i wonder if he [SEP]", "detok_text": "[CLS] the new york jets defense. [SEP] i think it is impossible that any black author would know about black writers. [SEP] first, find a price for this property. [SEP] in the study, young children aged 12 to 15, middle - teens in their 30s, a mix of children, men, and women and children, and those in central and west london aged 13 to 17. [SEP] the european 10 - year us treasury rose 4. 6 per cent to 2. 46 per cent from 2380 dollars, while the australian euro slipped 0. 8 per cent to 2. 674. 75 dollars. [SEP] i wonder if he [SEP]"}
+{"type": "sample", "index": 17, "raw_text": "[CLS] opened to the public in 1997. [SEP] \" it ' s been rid of the players, the people, coaches like myself, those people living with me, i ' m the head coach, i don ' t care about this, you know, i ' m just trying to know who i am. [SEP] you know him to get around, and he ' s a good, and then of course i can do years of trying to figure out what he ' s doing. [SEP] at the same time, they said, former minnesota gov. tim schfler was just trying to do what he told her. [SEP] berlus [SEP]", "detok_text": "[CLS] opened to the public in 1997. [SEP] \" it's been rid of the players, the people, coaches like myself, those people living with me, i'm the head coach, i don't care about this, you know, i'm just trying to know who i am. [SEP] you know him to get around, and he's a good, and then of course i can do years of trying to figure out what he's doing. [SEP] at the same time, they said, former minnesota gov. tim schfler was just trying to do what he told her. [SEP] berlus [SEP]"}
+{"type": "sample", "index": 18, "raw_text": "[CLS] a british man and a chinese woman traveling with him in london were arrested wednesday morning on suspicion of suspected drug trafficking by police in south africa. [SEP] he was described as a tough man, who will be redknapp ' s main aim. [SEP] the united states has denied this, but the state department has said that the israeli - israeli exchange between the new york times and iran increased the size of the israeli delegation, particularly amid concerns about the size of israel ' s program and extent of military operations. [SEP] more enlightened and sentimentalised, the film has now lost its own sense of vitality of mass market power. [SEP]", "detok_text": "[CLS] a british man and a chinese woman traveling with him in london were arrested wednesday morning on suspicion of suspected drug trafficking by police in south africa. [SEP] he was described as a tough man, who will be redknapp's main aim. [SEP] the united states has denied this, but the state department has said that the israeli - israeli exchange between the new york times and iran increased the size of the israeli delegation, particularly amid concerns about the size of israel's program and extent of military operations. [SEP] more enlightened and sentimentalised, the film has now lost its own sense of vitality of mass market power. [SEP]"}
+{"type": "sample", "index": 19, "raw_text": "[CLS] xiaochuan said chinese law enforcement officials had spoken with officials with chinese agencies. [SEP] \" i think it is time for people to contract before the midterms on the policy, make the first decision about when and get it. [SEP] mr. liebko and ms. clinton ' s deputy, the deputy agriculture secretary, kyi eo. [SEP] beijing ( ap ) - - china ' s prime minister will resume talks on saturday about improving trade ties between the two two countries, the chinese state news agency said tuesday. [SEP] i ' ve been working here since... [SEP] on september 17, murtha [SEP]", "detok_text": "[CLS] xiaochuan said chinese law enforcement officials had spoken with officials with chinese agencies. [SEP] \" i think it is time for people to contract before the midterms on the policy, make the first decision about when and get it. [SEP] mr. liebko and ms. clinton's deputy, the deputy agriculture secretary, kyi eo. [SEP] beijing (ap) - - china's prime minister will resume talks on saturday about improving trade ties between the two two countries, the chinese state news agency said tuesday. [SEP] i've been working here since... [SEP] on september 17, murtha [SEP]"}
+{"type": "sample", "index": 20, "raw_text": "[CLS] brown, the british minister, said. [SEP] what do you think of this place? [SEP] \" you have people who i ' ve wanted to get a long deal of time, a few of these people, you know, you know, so i ' m quite happy, that ' s why i don ' t know, \" she said. [SEP] nevertheless, mr. o ' malley said that despite the state ' s number of people, it ' s difficult for everyone to keep up with their own, especially when others have been accused of their own conduct. [SEP] the only way to know how different the circumstances are is to ask if [SEP]", "detok_text": "[CLS] brown, the british minister, said. [SEP] what do you think of this place? [SEP] \"you have people who i've wanted to get a long deal of time, a few of these people, you know, you know, so i'm quite happy, that's why i don't know,\" she said. [SEP] nevertheless, mr. o' malley said that despite the state's number of people, it's difficult for everyone to keep up with their own, especially when others have been accused of their own conduct. [SEP] the only way to know how different the circumstances are is to ask if [SEP]"}
+{"type": "sample", "index": 21, "raw_text": "[CLS] health program for all ills. [SEP] the white house has indicated its willingness to negotiate with iran ' s iranian nuclear program, emphasizing both israel and the american dream of a democratic state. [SEP] bush, after meeting with international journalists in japan, said he had hoped to encourage other parties in japan to support the united nations security council for nuclear sanctions. [SEP] \" of course i would like to bring the uswp to the united states. [SEP] like sports, education and education programs, brokah does nothing to help, but he does a little stuff. [SEP] philadelphia eagles quarterback rob collison ' s interception in the first quarter [SEP]", "detok_text": "[CLS] health program for all ills. [SEP] the white house has indicated its willingness to negotiate with iran's iranian nuclear program, emphasizing both israel and the american dream of a democratic state. [SEP] bush, after meeting with international journalists in japan, said he had hoped to encourage other parties in japan to support the united nations security council for nuclear sanctions. [SEP] \" of course i would like to bring the uswp to the united states. [SEP] like sports, education and education programs, brokah does nothing to help, but he does a little stuff. [SEP] philadelphia eagles quarterback rob collison's interception in the first quarter [SEP]"}
+{"type": "sample", "index": 22, "raw_text": "[CLS] bank of america collapsed last monday due to the size of the housing market and related woes following the recent turmoil in the u. s. subprime home mortgage market. [SEP] such problems, it ' s thought, can just cause them. [SEP] he has a long history of sexual relationship with his wife, though he told of his life and accomplishments. [SEP] president obama ' s plan, which includes up to $ 200 billion of dollars in loans from private markets and an additional $ 100 billion in loan guarantees to buy troubled financial institutions, says he has no need to help boost the economy. [SEP] but mr biti said : \" [SEP]", "detok_text": "[CLS] bank of america collapsed last monday due to the size of the housing market and related woes following the recent turmoil in the u. s. subprime home mortgage market. [SEP] such problems, it's thought, can just cause them. [SEP] he has a long history of sexual relationship with his wife, though he told of his life and accomplishments. [SEP] president obama's plan, which includes up to $200 billion of dollars in loans from private markets and an additional $100 billion in loan guarantees to buy troubled financial institutions, says he has no need to help boost the economy. [SEP] but mr biti said: \" [SEP]"}
+{"type": "sample", "index": 23, "raw_text": "[CLS] year - old woman and her boyfriend, 21 - year - old john stapleton. [SEP] the bank, which cut more than 2, 500 jobs at its uk headquarters last week, said it is worth about £2. 3 billion and was expected to record losses of about 40 per cent of its revenues this year. [SEP] but nfl director tom williams would not confirm his board ' s report. [SEP] he said he was arrested at st george ' s police station at 11am ( gmt on 24 january after reports of being attacked by his girlfriend. [SEP] mr bickerton ' s offer is now worth £100 million. [SEP] it is not [SEP]", "detok_text": "[CLS] year - old woman and her boyfriend, 21 - year - old john stapleton. [SEP] the bank, which cut more than 2, 500 jobs at its uk headquarters last week, said it is worth about £2. 3 billion and was expected to record losses of about 40 per cent of its revenues this year. [SEP] but nfl director tom williams would not confirm his board's report. [SEP] he said he was arrested at st george's police station at 11am ( gmt on 24 january after reports of being attacked by his girlfriend. [SEP] mr bickerton's offer is now worth £100 million. [SEP] it is not [SEP]"}
+{"type": "sample", "index": 24, "raw_text": "[CLS] too. [SEP] and i just don ' t call petchroa yet. [SEP] in the stern school of law school, he took much interest in his wife, professor william j. wluckahn, professor of law at danville, pa., and the national chairman of ubs ' s american law program, was one of the leading legal architects of venture capital law. [SEP] it said that israel would be outside the us at any time and obama made it clear that that he would not be surprised if the plan went down. [SEP] that is double the rate of 12. 6 deaths per week in britain, according [SEP]", "detok_text": "[CLS] too. [SEP] and i just don't call petchroa yet. [SEP] in the stern school of law school, he took much interest in his wife, professor william j. wluckahn, professor of law at danville, pa., and the national chairman of ubs's american law program, was one of the leading legal architects of venture capital law. [SEP] it said that israel would be outside the us at any time and obama made it clear that that he would not be surprised if the plan went down. [SEP] that is double the rate of 12. 6 deaths per week in britain, according [SEP]"}
+{"type": "sample", "index": 25, "raw_text": "[CLS] iraqi national security council in the days after the country ' s january elections. [SEP] obama was also expected to press congressional allies for an fbi investigation into the \" smearing \" e - mails by u. s. senate majority sen. hillary hillary clinton, d - nev., and house speaker nancy pelosi, which calls for senator kennedy ' s authority to allow his words to continue to occur both in the senate and in the history of the country. [SEP] the national job unemployment rate in that fiscal year - - 38 percent nationally, down from 47. 2 percent in the last three months of a year - - [SEP]", "detok_text": "[CLS] iraqi national security council in the days after the country's january elections. [SEP] obama was also expected to press congressional allies for an fbi investigation into the \"smearing\" e - mails by u. s. senate majority sen. hillary hillary clinton, d - nev., and house speaker nancy pelosi, which calls for senator kennedy's authority to allow his words to continue to occur both in the senate and in the history of the country. [SEP] the national job unemployment rate in that fiscal year - - 38 percent nationally, down from 47. 2 percent in the last three months of a year - - [SEP]"}
+{"type": "sample", "index": 26, "raw_text": "[CLS] countries, with a membership of just over 2 million. [SEP] dr michael bortlandt, director of the british education watch group, said the courses would be open to children, who are almost all closely involved in art, art, history, politics, and history. [SEP] the patriots don ' t like him. [SEP] the european stock exchange fell 1. 0. 4 euros to $ 3. 653, while gold fell to eight - month lows, with the euro at $ 3. 7538 to $ 3. 5905. [SEP] this is not the true record. - - john d. roberts, the federal supreme [SEP]", "detok_text": "[CLS] countries, with a membership of just over 2 million. [SEP] dr michael bortlandt, director of the british education watch group, said the courses would be open to children, who are almost all closely involved in art, art, history, politics, and history. [SEP] the patriots don't like him. [SEP] the european stock exchange fell 1. 0. 4 euros to $3. 653, while gold fell to eight - month lows, with the euro at $3. 7538 to $3. 5905. [SEP] this is not the true record. - - john d. roberts, the federal supreme [SEP]"}
+{"type": "sample", "index": 27, "raw_text": "[CLS] day over the judgment, a senior public relations officer asked for the bank to disblose the debt. [SEP] the ministers would meet foreign secretary robert gates and state agencies on thursday, sources said. [SEP] the archbishop of england is also known for his views on the rights law. [SEP] since the report, a panel of outside experts have concluded that young people should be aware of an important role in taking these drugs. [SEP] the meeting comes after a series of crisis meetings with the un envoy to the greek socialist republic, georgi topolaas, following his period in government in the early 1990s. [SEP] he was only 20 minutes of [SEP]", "detok_text": "[CLS] day over the judgment, a senior public relations officer asked for the bank to disblose the debt. [SEP] the ministers would meet foreign secretary robert gates and state agencies on thursday, sources said. [SEP] the archbishop of england is also known for his views on the rights law. [SEP] since the report, a panel of outside experts have concluded that young people should be aware of an important role in taking these drugs. [SEP] the meeting comes after a series of crisis meetings with the un envoy to the greek socialist republic, georgi topolaas, following his period in government in the early 1990s. [SEP] he was only 20 minutes of [SEP]"}
+{"type": "sample", "index": 28, "raw_text": "[CLS] - maliki on saturday ended his three - week trip to iraq, iraq and central asia, the russian foreign ministry said on monday. [SEP] state lawmakers passed their legislation in 1998. [SEP] the officers who died in the attack have said the force would take action to improve security measures. [SEP] the governor of massachusetts, who is now chairman of the governor ' s house of staff, robert kiplen, was vice - president of the governor ' s health policy board last year. [SEP] \" one of my major responsibilities in getting around that i can do is to get along with me, \" the three - year - old german said [SEP]", "detok_text": "[CLS] - maliki on saturday ended his three - week trip to iraq, iraq and central asia, the russian foreign ministry said on monday. [SEP] state lawmakers passed their legislation in 1998. [SEP] the officers who died in the attack have said the force would take action to improve security measures. [SEP] the governor of massachusetts, who is now chairman of the governor's house of staff, robert kiplen, was vice - president of the governor's health policy board last year. [SEP] \"one of my major responsibilities in getting around that i can do is to get along with me,\" the three - year - old german said [SEP]"}
+{"type": "sample", "index": 29, "raw_text": "[CLS] million americans is twice the size of the population, but the number of veterans retired. [SEP] this isn ' t the first time in golf history starting at augusta, 4. 30am. [SEP] these include moving all the time on to the issue of homelessness, becoming obsessed with malcontinence and stupidity. [SEP] it is understood he is the anti - china antimatter and revisionist. [SEP] china - which accounts for almost half of the u. s. economy - enjoyed its annual growth rate of under 20 % in nearly two decades, leading the world out of the region to its peak in the early 1990ss. [SEP] [SEP]", "detok_text": "[CLS] million americans is twice the size of the population, but the number of veterans retired. [SEP] this isn't the first time in golf history starting at augusta, 4. 30am. [SEP] these include moving all the time on to the issue of homelessness, becoming obsessed with malcontinence and stupidity. [SEP] it is understood he is the anti - china antimatter and revisionist. [SEP] china - which accounts for almost half of the u. s. economy - enjoyed its annual growth rate of under 20 % in nearly two decades, leading the world out of the region to its peak in the early 1990ss. [SEP] [SEP]"}
+{"type": "sample", "index": 30, "raw_text": "[CLS] at 27. 9 million. [SEP] more recently, cnn ' s gloria clark, one of the three house house democrats suggested that the governor ' s actions were necessary to undermine the gop ' s political mindset and shift the focus to the state ' s cleme control. [SEP] the man ' s case has not been extensively briefed by state media. [SEP] the university of miami ' s women ' s media center and bachelor ' s of education and management school at colby college, northern michigan, where he used his expertise to work in finance, business, communications, law, finance and distribution. [SEP] as a result, the president [SEP]", "detok_text": "[CLS] at 27. 9 million. [SEP] more recently, cnn's gloria clark, one of the three house house democrats suggested that the governor's actions were necessary to undermine the gop's political mindset and shift the focus to the state's cleme control. [SEP] the man's case has not been extensively briefed by state media. [SEP] the university of miami's women's media center and bachelor's of education and management school at colby college, northern michigan, where he used his expertise to work in finance, business, communications, law, finance and distribution. [SEP] as a result, the president [SEP]"}
+{"type": "sample", "index": 31, "raw_text": "[CLS] to produce a good documentary, the filmmaker ben taylor, who was involved in the 2005 film and starring hollywood director steven spielberg at the time, has long said he ' s reluctant to recomcoct a high - level celebrity. [SEP] \" if you ' ve got a problem in north africa, i want to see a result, \" rob johnson said. [SEP] a judge has released a north carolina man who killed his teenage son ' s wife on her plane. [SEP] over the course of eight months, the european union rejected the idea and struck a deal. [SEP] other media groups will see the abortions as the beginning of a [SEP]", "detok_text": "[CLS] to produce a good documentary, the filmmaker ben taylor, who was involved in the 2005 film and starring hollywood director steven spielberg at the time, has long said he's reluctant to recomcoct a high - level celebrity. [SEP] \"if you've got a problem in north africa, i want to see a result,\" rob johnson said. [SEP] a judge has released a north carolina man who killed his teenage son's wife on her plane. [SEP] over the course of eight months, the european union rejected the idea and struck a deal. [SEP] other media groups will see the abortions as the beginning of a [SEP]"}
+{"type": "sample", "index": 32, "raw_text": "[CLS] over why he opposed the terror attacks. [SEP] the fire on friday took up to four hours to reach that area. [SEP] asked who would support the author of the bill and the three republican votes approved on the year ' s presidential end, dodd said he had no regrets during a lengthy debate with republicans, reminding members of the benefits of non - reconciliation measures. [SEP] \" i did very much like going to the ring. [SEP] this was his most recent visit to fight the taliban leadership in pakistan. [SEP] bill clinton is trying to call hillary clinton the woman president of the united states, but she ' ll probably be looking to hillary again, [SEP]", "detok_text": "[CLS] over why he opposed the terror attacks. [SEP] the fire on friday took up to four hours to reach that area. [SEP] asked who would support the author of the bill and the three republican votes approved on the year's presidential end, dodd said he had no regrets during a lengthy debate with republicans, reminding members of the benefits of non - reconciliation measures. [SEP] \" i did very much like going to the ring. [SEP] this was his most recent visit to fight the taliban leadership in pakistan. [SEP] bill clinton is trying to call hillary clinton the woman president of the united states, but she'll probably be looking to hillary again, [SEP]"}
+{"type": "sample", "index": 33, "raw_text": "[CLS] into the government - - a degree of shorthand in the books of the shadow government at the turn of the century and he was a sure - name, until he went to the school of public administration in cambridge and the university. [SEP] after 21 years of education, for the majority of school year total, 37. 8 % of those aged 16 - to 25 - 41. 5 % were aged 18 - 17. [SEP] the organising committee of the county ' s main railway park east of the scottish borders has agreed to display a £2, 000 sculpture to mark \" defending the national park for scotland. \" [SEP] the ministry of defense said [SEP]", "detok_text": "[CLS] into the government - - a degree of shorthand in the books of the shadow government at the turn of the century and he was a sure - name, until he went to the school of public administration in cambridge and the university. [SEP] after 21 years of education, for the majority of school year total, 37. 8 % of those aged 16 - to 25 - 41. 5 % were aged 18 - 17. [SEP] the organising committee of the county's main railway park east of the scottish borders has agreed to display a £2, 000 sculpture to mark \"defending the national park for scotland.\" [SEP] the ministry of defense said [SEP]"}
+{"type": "sample", "index": 34, "raw_text": "[CLS] [SEP] \" we wanted to investigate the origins of our disease, \" said dr. gail westden, a professor at allen university, texas. [SEP] the city ' s events are open wednesdays, daily 10 a. m. to 3 a. m. s., 9 p. m. to 9 p. m. [SEP] los angeles lakers coach roy williams is still trying to replace steve mclanton, who became head coach in the same day. [SEP] mr blair is expected to stand down from his father when he finishes as british prime minister. [SEP] john lennon ' s attorney, mark clifford, has agreed to hear off the [SEP]", "detok_text": "[CLS] [SEP] \"we wanted to investigate the origins of our disease,\" said dr. gail westden, a professor at allen university, texas. [SEP] the city's events are open wednesdays, daily 10 a. m. to 3 a. m. s., 9 p. m. to 9 p. m. [SEP] los angeles lakers coach roy williams is still trying to replace steve mclanton, who became head coach in the same day. [SEP] mr blair is expected to stand down from his father when he finishes as british prime minister. [SEP] john lennon's attorney, mark clifford, has agreed to hear off the [SEP]"}
+{"type": "sample", "index": 35, "raw_text": "[CLS] the party. [SEP] this is an atypical vision of the future after six years in david cameron ' s last election campaign, but at that time this weekend, there is little to avoid the fact that he is going to be such a president that the party has been unable to agree. [SEP] this is just an opportunity to play a presidential role. [SEP] u. s. sources have said obama ' s administration is aiming to send an ambassador to japan next month. [SEP] the u. s. ambassador was signed wednesday by italian foreign minister giorgi frattini and venezuela ' s foreign minister carlos merc, in cooperation with [SEP]", "detok_text": "[CLS] the party. [SEP] this is an atypical vision of the future after six years in david cameron's last election campaign, but at that time this weekend, there is little to avoid the fact that he is going to be such a president that the party has been unable to agree. [SEP] this is just an opportunity to play a presidential role. [SEP] u. s. sources have said obama's administration is aiming to send an ambassador to japan next month. [SEP] the u. s. ambassador was signed wednesday by italian foreign minister giorgi frattini and venezuela's foreign minister carlos merc, in cooperation with [SEP]"}
+{"type": "sample", "index": 36, "raw_text": "[CLS] [SEP] cbs ) : i ' m living and living with being whores, sexists, lesbians, hairdressers, women, vegetarians, working americans. [SEP] that ' s the problem. [SEP] right now, i believe this will save the country a lot less money. [SEP] mr smith will be joining preston - clough club fc and fa cup to support their ambitious drive to bring the best possible quality of english football to scotland. [SEP] after capturing the first race of the season, riesna won the race ' s largest title after a frustrating run of five qualifying races last year with injuries. [SEP] he was arrested [SEP]", "detok_text": "[CLS] [SEP] cbs ): i'm living and living with being whores, sexists, lesbians, hairdressers, women, vegetarians, working americans. [SEP] that's the problem. [SEP] right now, i believe this will save the country a lot less money. [SEP] mr smith will be joining preston - clough club fc and fa cup to support their ambitious drive to bring the best possible quality of english football to scotland. [SEP] after capturing the first race of the season, riesna won the race's largest title after a frustrating run of five qualifying races last year with injuries. [SEP] he was arrested [SEP]"}
+{"type": "sample", "index": 37, "raw_text": "[CLS] have been training camp for the national football conference and the head coach in the nfl league - the national football league ' s coach of the year. [SEP] the school is designed to support educational policy, education, and speech, government and policy management, university education, and medical education. [SEP] mr. haroon ' s family has filed more than $ 1 billion in litigation since around the turn of last year. [SEP] a professional rescue team of six has been killed by a wind in glasnost in the uk. [SEP] \" i ' ll know my plans for the role, \" he said. [SEP] the study is taking on [SEP]", "detok_text": "[CLS] have been training camp for the national football conference and the head coach in the nfl league - the national football league's coach of the year. [SEP] the school is designed to support educational policy, education, and speech, government and policy management, university education, and medical education. [SEP] mr. haroon's family has filed more than $1 billion in litigation since around the turn of last year. [SEP] a professional rescue team of six has been killed by a wind in glasnost in the uk. [SEP] \"i'll know my plans for the role,\" he said. [SEP] the study is taking on [SEP]"}
+{"type": "sample", "index": 38, "raw_text": "[CLS]usconi ' s last move was a national campaign to back the constitution. [SEP] he will probably meet obama and his wife, michelle, the same week, said wolf blitzer, the president of the campaign group, a task force for obama to protect blacks and whites. [SEP] at the moment, mr. mccain is calling on the president to \" pick a man who shows great patience with america \" - the same straight - talking man who describes himself as president - - the same event he held at the same republican meeting. [SEP] the meeting in the french capital of paris may just have something else to do. [SEP] obama and hillary [SEP]", "detok_text": "[CLS]usconi's last move was a national campaign to back the constitution. [SEP] he will probably meet obama and his wife, michelle, the same week, said wolf blitzer, the president of the campaign group, a task force for obama to protect blacks and whites. [SEP] at the moment, mr. mccain is calling on the president to \"pick a man who shows great patience with america\" - the same straight - talking man who describes himself as president - - the same event he held at the same republican meeting. [SEP] the meeting in the french capital of paris may just have something else to do. [SEP] obama and hillary [SEP]"}
+{"type": "sample", "index": 39, "raw_text": "[CLS] in the previous 12 months, rising to 20. 2 and 14. 4m points in the third quarter, while the unemployment rate was at 2. 3 per cent in recent quarters. [SEP] northamptonshire police say a man has been charged with strangling a lorry. [SEP] in 2007, australia ' s foreign trade fell by 25 per cent to around £14 billion. [SEP] \" it goes, i don ' t say, ' that will be enough '. [SEP] but trumpeting the idea that women take over their jobs in public are baffling. [SEP] correa came into the race ' s second lap, leaving the [SEP]", "detok_text": "[CLS] in the previous 12 months, rising to 20. 2 and 14. 4m points in the third quarter, while the unemployment rate was at 2. 3 per cent in recent quarters. [SEP] northamptonshire police say a man has been charged with strangling a lorry. [SEP] in 2007, australia's foreign trade fell by 25 per cent to around £14 billion. [SEP] \" it goes, i don't say, 'that will be enough'. [SEP] but trumpeting the idea that women take over their jobs in public are baffling. [SEP] correa came into the race's second lap, leaving the [SEP]"}
+{"type": "sample", "index": 40, "raw_text": "[CLS] strength of russia and other international powers is behind the attack. [SEP] korea and the koreas, in less than 20 years. [SEP] two people were killed when an motorist man was shot in the head by two - armed robbers on merseyside. [SEP] johnson is one of several women that has won a run for city hall. [SEP] this could also affect the preparations for the gulf streamfield, the largest offshore oil complex in the northern gulf of mexico. [SEP] last night ' s emotional reward for the moment claimed mark hughes ' s first win for the st james ' s club, which confirmed his arrival to west ham united in 2007 [SEP]", "detok_text": "[CLS] strength of russia and other international powers is behind the attack. [SEP] korea and the koreas, in less than 20 years. [SEP] two people were killed when an motorist man was shot in the head by two - armed robbers on merseyside. [SEP] johnson is one of several women that has won a run for city hall. [SEP] this could also affect the preparations for the gulf streamfield, the largest offshore oil complex in the northern gulf of mexico. [SEP] last night's emotional reward for the moment claimed mark hughes's first win for the st james's club, which confirmed his arrival to west ham united in 2007 [SEP]"}
+{"type": "sample", "index": 41, "raw_text": "[CLS] gas stations. [SEP] the city ' s council president said he had received no assurances that the company would make an offer. [SEP] the eu will soon see a new level of co - operation, the group said, due to a proposed eu directive and growing cooperation over consumer issues, policy and cost decisions. [SEP] \" we call for help. \" [SEP] mr. obama announced the visit of his democratic rival, joseph biden, a former massachusetts democrat who said he would not think of his chance of being part of his presidential campaign. [SEP] washington state quarterback steve mizme threw three passes for 20 yards fourth down with less than a [SEP]", "detok_text": "[CLS] gas stations. [SEP] the city's council president said he had received no assurances that the company would make an offer. [SEP] the eu will soon see a new level of co - operation, the group said, due to a proposed eu directive and growing cooperation over consumer issues, policy and cost decisions. [SEP] \"we call for help.\" [SEP] mr. obama announced the visit of his democratic rival, joseph biden, a former massachusetts democrat who said he would not think of his chance of being part of his presidential campaign. [SEP] washington state quarterback steve mizme threw three passes for 20 yards fourth down with less than a [SEP]"}
+{"type": "sample", "index": 42, "raw_text": "[CLS] hope program, the school for girls ' schools and families for children. [SEP] but israeli prime minister benjamin netanyahu reached a deal with israeli prime minister benjamin netanyahu to make important pledges to the u. s. and urge him to continue israeli - israeli peace development of the future conflict. [SEP] round - trip costs from £39, b & b ( including air travel ) and south africa ( 01781 - 6077 52786, www. africavalofonce. com ) from £71 on a single night, including hotel accommodation, a departure card, with breakfast, and a [SEP]", "detok_text": "[CLS] hope program, the school for girls' schools and families for children. [SEP] but israeli prime minister benjamin netanyahu reached a deal with israeli prime minister benjamin netanyahu to make important pledges to the u. s. and urge him to continue israeli - israeli peace development of the future conflict. [SEP] round - trip costs from £39, b & b (including air travel) and south africa (01781 - 6077 52786, www. africavalofonce. com) from £71 on a single night, including hotel accommodation, a departure card, with breakfast, and a [SEP]"}
+{"type": "sample", "index": 43, "raw_text": "[CLS] [SEP] the company ' s phone is made of software that identifies words, gestures and phrases. [SEP] the video is shown a young man on ninth avenue and a 19 - year - old man being arrested. [SEP] john goodby, the billionaire investor, was on the market on tuesday and had bought it for £1, but never put a foot in the market. [SEP] \" we ' re very confident that we can win this game, \" new york jets ' owner eric mangini said. [SEP] the former presidents are expected to use a coming - out of senators to press their arguments about as much as the next president would do. [SEP] [SEP]", "detok_text": "[CLS] [SEP] the company's phone is made of software that identifies words, gestures and phrases. [SEP] the video is shown a young man on ninth avenue and a 19 - year - old man being arrested. [SEP] john goodby, the billionaire investor, was on the market on tuesday and had bought it for £1, but never put a foot in the market. [SEP] \"we're very confident that we can win this game,\" new york jets' owner eric mangini said. [SEP] the former presidents are expected to use a coming - out of senators to press their arguments about as much as the next president would do. [SEP] [SEP]"}
+{"type": "sample", "index": 44, "raw_text": "[CLS] gunghant ' s website, chinat. com. [SEP] wenger said he doesn ' t think he is a member of the hierarchy of capello, the arsenal manager who joined the club in 2003, although the england manager ' s habit of focusing on his grandest is about to be end. [SEP] mr johnson, who took the stand, refused to hear his mother ' s call. [SEP] he and senior south korean officials were expected to meet friday with security council president stephen bosworth to discuss the situation in geneva. [SEP] gov. john romney, meanwhile, withdrew from the republican side. [SEP] it ' s hard to [SEP]", "detok_text": "[CLS] gunghant's website, chinat. com. [SEP] wenger said he doesn't think he is a member of the hierarchy of capello, the arsenal manager who joined the club in 2003, although the england manager's habit of focusing on his grandest is about to be end. [SEP] mr johnson, who took the stand, refused to hear his mother's call. [SEP] he and senior south korean officials were expected to meet friday with security council president stephen bosworth to discuss the situation in geneva. [SEP] gov. john romney, meanwhile, withdrew from the republican side. [SEP] it's hard to [SEP]"}
+{"type": "sample", "index": 45, "raw_text": "[CLS] about 2 per cent to £56m, lower than its second half average, and at least 300m euros ( 1, 343m ), including a sharp drop in profits for the year. [SEP] \" it might be premature in europe to think that the credit crisis is under control, but it came to an end, \" said gerard goldman at ubs global credit market research. [SEP] it ' s striking, because the american public will respond to it for all the government help to prop up the financial system. [SEP] britain is planning to build up its troops in iraq by the end of 2010 but ministers have refused to give back [SEP]", "detok_text": "[CLS] about 2 per cent to £56m, lower than its second half average, and at least 300m euros (1, 343m), including a sharp drop in profits for the year. [SEP] \"it might be premature in europe to think that the credit crisis is under control, but it came to an end,\" said gerard goldman at ubs global credit market research. [SEP] it's striking, because the american public will respond to it for all the government help to prop up the financial system. [SEP] britain is planning to build up its troops in iraq by the end of 2010 but ministers have refused to give back [SEP]"}
+{"type": "sample", "index": 46, "raw_text": "[CLS] of zimbabwe ' s opposition movement mdd gathered wednesday in the country ' s capital, harare, wednesday to demand elections. [SEP] one of the key tasks of england ' s was to get a world title, so they can become competitive and get a better result. [SEP] ( ap ) - a 77 - foot house in long island ' s international airport will move into the penthouse of a new six - building that reached 100 square feet saturday, making it home to a two - story tower and a small commercial hotel. [SEP] but most surprisingly, the demands of business and technical science and technology at least have limited their selection of places. [SEP]", "detok_text": "[CLS] of zimbabwe's opposition movement mdd gathered wednesday in the country's capital, harare, wednesday to demand elections. [SEP] one of the key tasks of england's was to get a world title, so they can become competitive and get a better result. [SEP] (ap) - a 77 - foot house in long island's international airport will move into the penthouse of a new six - building that reached 100 square feet saturday, making it home to a two - story tower and a small commercial hotel. [SEP] but most surprisingly, the demands of business and technical science and technology at least have limited their selection of places. [SEP]"}
+{"type": "sample", "index": 47, "raw_text": "[CLS] - old and he grew up as a retired school teacher, albeit with a smaller population. [SEP] i doubt that government eliminates me. [SEP] in the times, the government, and the most senior branch of the cabinet, is reviewing its options and may not see an answer to that matter. [SEP] this particular movement is convenient, but it represents the only way to support the cosy notion that all children are descended from intellectual property race to exploitation of the rarest of information. [SEP] the euro was trading at $ 1. 519 from $ 1. 5140 late in new york. [SEP] \" we do not think she ' s [SEP]", "detok_text": "[CLS] - old and he grew up as a retired school teacher, albeit with a smaller population. [SEP] i doubt that government eliminates me. [SEP] in the times, the government, and the most senior branch of the cabinet, is reviewing its options and may not see an answer to that matter. [SEP] this particular movement is convenient, but it represents the only way to support the cosy notion that all children are descended from intellectual property race to exploitation of the rarest of information. [SEP] the euro was trading at $1. 519 from $1. 5140 late in new york. [SEP] \" we do not think she's [SEP]"}
+{"type": "sample", "index": 48, "raw_text": "[CLS] s military says most of its fighters are regarded as an umbrella arm of the militant al - qaida group in iran. [SEP] two years ago, i got a drug called \" the line of spring. \" [SEP] new york ( ap ) - wall street ' s biggest banks posted losses in the third quarter as wall street plummeted another $ 4 billion loss, while the federal government again struggled to shore up its capital with mounting losses. [SEP] however, the number of people admitted to gocountry will also be limited in the region - - 50 miles or less, the report says. [SEP] in a big way, china [SEP]", "detok_text": "[CLS] s military says most of its fighters are regarded as an umbrella arm of the militant al - qaida group in iran. [SEP] two years ago, i got a drug called \"the line of spring.\" [SEP] new york (ap) - wall street's biggest banks posted losses in the third quarter as wall street plummeted another $4 billion loss, while the federal government again struggled to shore up its capital with mounting losses. [SEP] however, the number of people admitted to gocountry will also be limited in the region - - 50 miles or less, the report says. [SEP] in a big way, china [SEP]"}
+{"type": "sample", "index": 49, "raw_text": "[CLS] to a few days of media contacts with other iraqi news agencies. [SEP] the hewlett air jordan travel service ( 0870 803 90995 ; 0045 7082 609 ; www. ibfirk. co. uk ) has seven nights in the ( £6. 50 per person from £1, 500pp, with return flights from airport and transfers ). [SEP] i wanted to know whether johnson was leading the country, especially in an age that wants to know what america is about our responsibility. [SEP] o ' neill was up for it, and he wasn ' t sure which of his players. [SEP] the [SEP]", "detok_text": "[CLS] to a few days of media contacts with other iraqi news agencies. [SEP] the hewlett air jordan travel service (0870 803 90995; 0045 7082 609; www. ibfirk. co. uk) has seven nights in the (£6. 50 per person from £1, 500pp, with return flights from airport and transfers). [SEP] i wanted to know whether johnson was leading the country, especially in an age that wants to know what america is about our responsibility. [SEP] o' neill was up for it, and he wasn't sure which of his players. [SEP] the [SEP]"}
+{"type": "sample", "index": 50, "raw_text": "[CLS] 30 - year - olds were overweight in 2007, while in england, 17 % are over - 30 - 40 and 18 % are aged over - 40. [SEP] a number of gm and gm officials also said that gm could be left without a deal. [SEP] the ice age study was developed by the university of science in bradford, southwest england. [SEP] hughes is emphasised from the stoicism of the 28 - year - old spaniard, the 19 - year - old and his wife. [SEP] today, with only three million miles away, it ' s hard to sustain it. [SEP] it is a children ' s school, [SEP]", "detok_text": "[CLS] 30 - year - olds were overweight in 2007, while in england, 17 % are over - 30 - 40 and 18 % are aged over - 40. [SEP] a number of gm and gm officials also said that gm could be left without a deal. [SEP] the ice age study was developed by the university of science in bradford, southwest england. [SEP] hughes is emphasised from the stoicism of the 28 - year - old spaniard, the 19 - year - old and his wife. [SEP] today, with only three million miles away, it's hard to sustain it. [SEP] it is a children's school, [SEP]"}
+{"type": "sample", "index": 51, "raw_text": "[CLS] learning how to make noise. [SEP] but the democrats have stepped up their attacks at the same time that defense secretary robert gates has been following the president. [SEP] in a routine look of his body and body, the man in the bed of blue perch on the dance floor - - as if he does not want to go home. [SEP] the chinese government seemed to do better than many had expected. [SEP] former national league mvp wide receiver jason witten took control of the game on sunday, breaking the franchise record with three touchdowns and interceptions in one of the longest passing setbacks in league history. [SEP] but he and msp are strongly against [SEP]", "detok_text": "[CLS] learning how to make noise. [SEP] but the democrats have stepped up their attacks at the same time that defense secretary robert gates has been following the president. [SEP] in a routine look of his body and body, the man in the bed of blue perch on the dance floor - - as if he does not want to go home. [SEP] the chinese government seemed to do better than many had expected. [SEP] former national league mvp wide receiver jason witten took control of the game on sunday, breaking the franchise record with three touchdowns and interceptions in one of the longest passing setbacks in league history. [SEP] but he and msp are strongly against [SEP]"}
+{"type": "sample", "index": 52, "raw_text": "[CLS] said. [SEP] o ' brien wasn ' t thinking a lot yet. [SEP] he returned to the disabled after missing the entire season with a left groin injury that limited him to games last month, allowing him to start only for half the season. [SEP] there ' s nothing unusual about people leaving these positions, \" he says. [SEP] the father, brian, arrived in mexico at the age of her father who ended up separated by an unpatried mother, and helped his son into the main projects of his seven - year career : a college and college football coach, basketball career at mississippi state university, high school football in chicago, [SEP]", "detok_text": "[CLS] said. [SEP] o' brien wasn't thinking a lot yet. [SEP] he returned to the disabled after missing the entire season with a left groin injury that limited him to games last month, allowing him to start only for half the season. [SEP] there's nothing unusual about people leaving these positions, \" he says. [SEP] the father, brian, arrived in mexico at the age of her father who ended up separated by an unpatried mother, and helped his son into the main projects of his seven - year career: a college and college football coach, basketball career at mississippi state university, high school football in chicago, [SEP]"}
+{"type": "sample", "index": 53, "raw_text": "[CLS] americans believe that they ' re talking about their national interests, the ukraine and russia, the middle east and non - muslims. [SEP] a total of 50, 000 workers in britain were called to work shortly after 1700 bst. [SEP] arab and iranian officials say the region no longer set up discussions with the u. s. government about paring its relationship with iran. [SEP] john bruschard, the executive director of research, said it is not the way rbs is promoting the rate of pay. [SEP] toyota motor corp. president and chief jim muna pulled out of detroit as part of his talks with a rival automaker [SEP]", "detok_text": "[CLS] americans believe that they're talking about their national interests, the ukraine and russia, the middle east and non - muslims. [SEP] a total of 50, 000 workers in britain were called to work shortly after 1700 bst. [SEP] arab and iranian officials say the region no longer set up discussions with the u. s. government about paring its relationship with iran. [SEP] john bruschard, the executive director of research, said it is not the way rbs is promoting the rate of pay. [SEP] toyota motor corp. president and chief jim muna pulled out of detroit as part of his talks with a rival automaker [SEP]"}
+{"type": "sample", "index": 54, "raw_text": "[CLS] me and my daughter, \" she said. [SEP] no need to sit back and listen to the truth. [SEP] some people do look for themselves by the way their children do. [SEP] he has enough experience to find a new manager and liverpool may want to pay him that money to add more room at the club. [SEP] then, o ' o ' hara came in just a fraction of the left and saw her 80 - yard shot over the line. [SEP] but philadelphia ' s previous ownery, vecchio williams, simply played to the past. [SEP] i knew he would be happy to be playing for england in south africa. [SEP] [SEP]", "detok_text": "[CLS] me and my daughter, \" she said. [SEP] no need to sit back and listen to the truth. [SEP] some people do look for themselves by the way their children do. [SEP] he has enough experience to find a new manager and liverpool may want to pay him that money to add more room at the club. [SEP] then, o'o' hara came in just a fraction of the left and saw her 80 - yard shot over the line. [SEP] but philadelphia's previous ownery, vecchio williams, simply played to the past. [SEP] i knew he would be happy to be playing for england in south africa. [SEP] [SEP]"}
+{"type": "sample", "index": 55, "raw_text": "[CLS] it was going to be more affordable and accessible to middle - class schoolers. [SEP] james seltra, 50, of stapleton, said : \" the man ' s family will remain concerned about his dna testing and doesn ' t know about the victim ' s value to come forward. [SEP] \" it ' s the real story, \" said unicef executive medical director lord pattack. [SEP] \" it ' s difficult to say, i feel better about today. [SEP] they don ' t know the difference. [SEP] what would give him seven years? \" [SEP] to put that question in perspective, the pittsburgh express - times reported wednesday [SEP]", "detok_text": "[CLS] it was going to be more affordable and accessible to middle - class schoolers. [SEP] james seltra, 50, of stapleton, said: \"the man's family will remain concerned about his dna testing and doesn't know about the victim's value to come forward. [SEP]\" it's the real story, \"said unicef executive medical director lord pattack. [SEP]\" it's difficult to say, i feel better about today. [SEP] they don't know the difference. [SEP] what would give him seven years? \" [SEP] to put that question in perspective, the pittsburgh express - times reported wednesday [SEP]"}
+{"type": "sample", "index": 56, "raw_text": "[CLS] korea, or china and india. \" [SEP] \" in the end, i know this if the kids don ' t win, and i feel that you want to disapect to just doing something like ' keep on winning, ' \" said washington state coach stephen kelly. [SEP] mr cameron used his own account of the work of his father, john guabe, published earlier this year, to make the point about the challenges of living in britain. [SEP] straight into the centre of the city, the walls leave a mirage - like anecdotal scene. [SEP] \" it ' s a bit of a charade, in fact [SEP]", "detok_text": "[CLS] korea, or china and india. \"[SEP]\" in the end, i know this if the kids don't win, and i feel that you want to disapect to just doing something like'keep on winning,' \"said washington state coach stephen kelly. [SEP] mr cameron used his own account of the work of his father, john guabe, published earlier this year, to make the point about the challenges of living in britain. [SEP] straight into the centre of the city, the walls leave a mirage - like anecdotal scene. [SEP]\" it's a bit of a charade, in fact [SEP]"}
+{"type": "sample", "index": 57, "raw_text": "[CLS] all 13 players, the better the team and its players are in the game. [SEP] the conservatives ramp up their critics like baby boomers. [SEP] if they have the money and experience of their high and high school classmates, it ' s almost impossible. [SEP] china ' s foreign minister qin yu told reporters on friday that the chinese administration was still working on efforts to reach a six - nation agreement to \" reset \" relations with the north after pyongyang conducted its nuclear test. [SEP] \" the number of people in the stadium hasn ' t changed at all since 2007 - 08, so it ' s not difficult for us to go [SEP]", "detok_text": "[CLS] all 13 players, the better the team and its players are in the game. [SEP] the conservatives ramp up their critics like baby boomers. [SEP] if they have the money and experience of their high and high school classmates, it's almost impossible. [SEP] china's foreign minister qin yu told reporters on friday that the chinese administration was still working on efforts to reach a six - nation agreement to \"reset\" relations with the north after pyongyang conducted its nuclear test. [SEP] \" the number of people in the stadium hasn't changed at all since 2007 - 08, so it's not difficult for us to go [SEP]"}
+{"type": "sample", "index": 58, "raw_text": "[CLS] end of the house ' s history. [SEP] on wednesday, mr. mcneill issued a statement on the numbers, and it is expected to last thursday as members of the cabinet announced that the afghan security chief was due to step down on saturday. [SEP] zelaya on friday also said he ' s support huckabee ' s choice to head to the u. s. and said he thinks he will remain for president under the current administration. [SEP] answer that must - be - answered question - and - answer question. [SEP] unfortunately, both agree, but you realize that this is not a legitimate issue - - he ' s [SEP]", "detok_text": "[CLS] end of the house's history. [SEP] on wednesday, mr. mcneill issued a statement on the numbers, and it is expected to last thursday as members of the cabinet announced that the afghan security chief was due to step down on saturday. [SEP] zelaya on friday also said he's support huckabee's choice to head to the u. s. and said he thinks he will remain for president under the current administration. [SEP] answer that must - be - answered question - and - answer question. [SEP] unfortunately, both agree, but you realize that this is not a legitimate issue - - he's [SEP]"}
+{"type": "sample", "index": 59, "raw_text": "[CLS] hearing, is due before 1800 gmt on monday. [SEP] niu union vice president lee yong - hak said tuesday that the leaders of the unions, the national association of teachers and the school administrators, were expected to approve it. [SEP] go to stone cottage ( 010 cromwell street ; 002 4567667 ) ; www. stonepassespring. com. [SEP] in california, manufacturing rose 17. 2 per cent, manufacturing rose 20. 7 per cent, employment in michigan rose 26. 4 cent and pennsylvania added 14. 9 cent. [SEP] according to reports, the officers stood in front of his home [SEP]", "detok_text": "[CLS] hearing, is due before 1800 gmt on monday. [SEP] niu union vice president lee yong - hak said tuesday that the leaders of the unions, the national association of teachers and the school administrators, were expected to approve it. [SEP] go to stone cottage (010 cromwell street; 002 4567667); www. stonepassespring. com. [SEP] in california, manufacturing rose 17. 2 per cent, manufacturing rose 20. 7 per cent, employment in michigan rose 26. 4 cent and pennsylvania added 14. 9 cent. [SEP] according to reports, the officers stood in front of his home [SEP]"}
+{"type": "sample", "index": 60, "raw_text": "[CLS]. [SEP] obama has been the divided one at the pentagon. [SEP] the leaders left the white house on sunday night to attend the second round of united nations meeting, officials said. [SEP] \" when i just go to school in italy, see what ' s going on and then you want to make me something and buy a gun, \" she said. [SEP] as he took the fa and england boss last season and the coach in 2001, johnson has bought manchester united fans and adebayor supporters with considerable authority and experience and built a strong attack team. [SEP] north korea ' s decision to build a proposed human rights commission for the country [SEP]", "detok_text": "[CLS]. [SEP] obama has been the divided one at the pentagon. [SEP] the leaders left the white house on sunday night to attend the second round of united nations meeting, officials said. [SEP] \"when i just go to school in italy, see what's going on and then you want to make me something and buy a gun,\" she said. [SEP] as he took the fa and england boss last season and the coach in 2001, johnson has bought manchester united fans and adebayor supporters with considerable authority and experience and built a strong attack team. [SEP] north korea's decision to build a proposed human rights commission for the country [SEP]"}
+{"type": "sample", "index": 61, "raw_text": "[CLS] of equipment to be used for the new national surveillance system over the next three years, meaning the uk would have to set up its own security rules. [SEP] chinese foreign ministry secretary liu zhaoxo echoed the chinese ambassador to pyongyang ' s comment friday, citing the dispute of china with china ' s major power suppliers. [SEP] but the results of this week ' s annapolis forum - dominated by direct opponents to the israeli leader - - suggest both sides remain stuck on a deal. [SEP] the team is designed by french coach rick busas and noe d almeria, who started his young football in the ancient city of [SEP]", "detok_text": "[CLS] of equipment to be used for the new national surveillance system over the next three years, meaning the uk would have to set up its own security rules. [SEP] chinese foreign ministry secretary liu zhaoxo echoed the chinese ambassador to pyongyang's comment friday, citing the dispute of china with china's major power suppliers. [SEP] but the results of this week's annapolis forum - dominated by direct opponents to the israeli leader - - suggest both sides remain stuck on a deal. [SEP] the team is designed by french coach rick busas and noe d almeria, who started his young football in the ancient city of [SEP]"}
+{"type": "sample", "index": 62, "raw_text": "[CLS] nuclear activities will not involve effective security measures, and the secretary general will discuss the entire nuclear issue, \" his office said. [SEP] \" mr johnson was shot on the head while the school was drinking, \" a sheriff said. [SEP] however, johnson ' s appointment will be a boost for a manager who might help manchester city to qualify for the anglo - premier league competition. [SEP] he added that lots of drivers don ' t have to pay. [SEP] a day later in the most contentious debate of the campaign, edwards said he believed he was adopting the \" back to basics \" policy of mr obama ' s campaign. [SEP] he spoke with [SEP]", "detok_text": "[CLS] nuclear activities will not involve effective security measures, and the secretary general will discuss the entire nuclear issue, \"his office said. [SEP]\" mr johnson was shot on the head while the school was drinking, \"a sheriff said. [SEP] however, johnson's appointment will be a boost for a manager who might help manchester city to qualify for the anglo - premier league competition. [SEP] he added that lots of drivers don't have to pay. [SEP] a day later in the most contentious debate of the campaign, edwards said he believed he was adopting the\" back to basics \" policy of mr obama's campaign. [SEP] he spoke with [SEP]"}
+{"type": "sample", "index": 63, "raw_text": "[CLS] have a social problem, \" said david parris, a senior researcher who led the study at the columbia university school of science and the director of the national institute of mental health in new york in an interview. [SEP] congress has said it wants to help support the budget. [SEP] but myanmar ' s leaders have suggested that the interim government is expected to try to form its own government. [SEP] what makes making a good film simple : keep a close eye on everyone who gets shot. [SEP] the national bureau of statistics uk grew at an annual rate of 2. 3 per cent at the start of 2006 - 2007, but this fell further in [SEP]", "detok_text": "[CLS] have a social problem, \" said david parris, a senior researcher who led the study at the columbia university school of science and the director of the national institute of mental health in new york in an interview. [SEP] congress has said it wants to help support the budget. [SEP] but myanmar's leaders have suggested that the interim government is expected to try to form its own government. [SEP] what makes making a good film simple: keep a close eye on everyone who gets shot. [SEP] the national bureau of statistics uk grew at an annual rate of 2. 3 per cent at the start of 2006 - 2007, but this fell further in [SEP]"}

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_diffusion_noise_steps_128steps_n64/noise_linear2to08_mid_sine_eta0p01_c256_detok_raw_samples.txt

@@ -0,0 +1,230 @@
+noise_linear2to08_mid_sine_eta0p01_c256_detok
+{
+  "type": "summary",
+  "name": "noise_linear2to08_mid_sine_eta0p01_c256",
+  "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt",
+  "step": 187000,
+  "decode": {
+    "kind": "categorical_fullvocab_diffusion_state_noise",
+    "config": "noise_linear2to08_mid_sine_eta0p01_c256",
+    "steps": 128,
+    "temp_start": 2.0,
+    "temp_end": 0.8,
+    "temp_schedule": "linear",
+    "t_power": 1.0,
+    "eta0": 0.01,
+    "eta_schedule": "mid_sine",
+    "noise_conc": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 48.2817867052147,
+    "nll_per_token": 3.877054402694846,
+    "tokens": 9546
+  },
+  "diversity": {
+    "sample_entropy": 4.19866648234313,
+    "unique_tokens": 1907,
+    "token_count": 8192,
+    "distinct_1": 0.2327880859375,
+    "distinct_2": 0.7100147637795275,
+    "top_token_mass": 0.0546875
+  }
+}
+
+===== sample 000 =====
+[CLS] gas trader and totaling oil group total in march 2009, europe's second - largest company reported operating profit 28 percent to 3. 542 billion euros ($6. 7 billion) from sales of around 3. 3 billion a year earlier quarter. [SEP] all the former campaign officials have had a publicly heated encounter with the focus group with others, while several clinton and obama officials have denied such reports. [SEP] " we obviously think such an issue is too specific. [SEP] i had no idea about the cost of doing his business. [SEP] the eu may have to keep thinking about shifting all the gas it sells to russia. [SEP] this [SEP]
+
+===== sample 001 =====
+[CLS] between mr kim and lee hy - ba, according to documents filed by the veteran media news site time. com. [SEP] a male passenger and the driver of the open blue car are hospitalized with serious injuries. [SEP] john mccain running - mate john mccain said obama made the decision to do it. [SEP] ma told bbc news the us trip would have been a meeting of president hu jintao's secretary of state for asia. [SEP] park yongdoo, the chief of staff at japan's national nuclear agency, the news agency reported on its its web site. [SEP] for more information on saas, visit the data center. [SEP]
+
+===== sample 002 =====
+[CLS] doesn't mean the party chooses to force out a candidate because of a person's background, often they haven't made it. [SEP] sd city council leader nick clegg and assembly leader john balding, their deputy leader, met with the two ex - ministers from the area together at last year's invest in wales technology conference, which was hosted by the northern ireland chamber of commerce and the un development agency. [SEP] it is understood both sides also said on thursday that they would hold a chinese government next monday, in response to a sharp decline in arms trade with the korean peninsula, " the chinese state department said [SEP]
+
+===== sample 003 =====
+[CLS] drawn international criticism to make the case of massive waste of public money, and the government's criminal record. [SEP] at the first meeting of a year ago, senior bankers knew that the bailout would be more like this than anything else in the federal system. [SEP] but pollack is cautious about the state of the economy. [SEP] the suspects, arrested at between 17 and 15 years old, will remain deported though there is no police law in france. [SEP] since anchoring from british columbia began several years ago, 11 miles deep, the 1, 000 tonnes of gold, including 19 gold, 25 golds and 19 silver, have [SEP]
+
+===== sample 004 =====
+[CLS] government budget issue, a move that would help struggling americans. [SEP] 8 (upi) - - federal immigration officials are seeking an extradition trial in the u. s. supreme court for a man who was ranked enemy no. 1 after last month's sniper slayings. [SEP] "i am running out in there with jim," briscoe said. [SEP] but the senate debate on children's health - care reform turned to a vote by president bush. [SEP] in turn, foreclosure watchers will use the money to help efforts to guide the country through the crisis, she said. [SEP] mr cameron [SEP]
+
+===== sample 005 =====
+[CLS]: 30 p. m. [SEP] sunday, at 8 p. m. and between 2: 15 p. m. and 5 p. m., a 39 - year - old woman was killed and at least five children were killed, five young women, two family members and three young women. [SEP] wenger's departure comes as germany has completed an extra bumpy period in the wake of klinsmann's bundesliga victory. [SEP] authorities say the phone was found in a hotel room in the home. [SEP] standard hotel rooms in the u. s. from $1 to $2, 000. [SEP] government officials caution [SEP]
+
+===== sample 006 =====
+[CLS] circumstances will change unless there's a clear legal issue, "obama said, citing mccain's comments saturday of the mccain camp not trying to challenge bush. [SEP] the center's data centers cover all parts of eastern europe, africa and europe. [SEP] after graduating from a university in paris, france, he found a career, and a master of public knowledge, in the development and management of local media, winning national and national recognition. [SEP] the campaign also asked for more prominent and political figures to speak to them, and put the issue up for a debate. [SEP]" at the end of the day..., we [SEP]
+
+===== sample 007 =====
+[CLS] mrs cley, his wife, and ann mclure, the chairman of the trust. [SEP] clefflee park trust has been selected by the county council for a two - year development extension at longton academy in shropshire. [SEP] the program's financial strength, an agency spokeswoman said. [SEP] i'm at the gym today, there's some more time for now. [SEP] those who are used to spending their money to buy their own cars. [SEP] kevin kan, japan's prime minister, told a meeting of cabinet ministers from asia yesterday that his government did not reopen the two - mile border [SEP]
+
+===== sample 008 =====
+[CLS]. s. open champion tiger woods, who has just failed to win the previous six us open championship titles, has the chance of becoming the next major player to compete at the us open. [SEP] she is a privileged woman woman who believes in the moral value of a god's existence after thousands of years of war, lies and economic spouts. [SEP] however, kettle said he didn't see much rain during the day, because he had already started to think about the limited amount of time available to his job. [SEP] msnbc. com is the largest provider and source of non - news and information on the bbc [SEP]
+
+===== sample 009 =====
+[CLS] diplomats say, mr. bush's address to congress here on the first leg of the national security conference was seen as a promise between the white house and the west to help ensure the safety of the country. [SEP] but if it was successful, it would not be acceptable for senior courts in this country to pursue it. [SEP] take those of those who earn up to £40, 000 annually, earn more than £65, 000 a year, and all those worth £70, 000. [SEP] he said he believed 12 similar cards had been issued over 14 days, the experian reported. [SEP] as president, obama will be [SEP]
+
+===== sample 010 =====
+[CLS] victory. [SEP] "it's the same thing for woods," woods quid back from training on friday. [SEP] the national average age of health care for retiree jumped to lower than expected in 2007. [SEP] during the losing season, gov. timothy d. dale served as his education secretary. [SEP] china's economic growth rate in the first quarter is about the same as it was in 2007, according to the ifc. [SEP] the russian coast guard declared the ship dead on tuesday and said its crew was called off the ship. [SEP] president barack obama told cnn's "60 minutes," he said the administration ' [SEP]
+
+===== sample 011 =====
+[CLS] said the restructuring of britain's banking system and the big private fund would be needed to recoup the money being available. [SEP] sue keeling, author of her book the issues and power of hope, said she was planning to run against mr. smith. [SEP] today, at the university of washington, the fed chairman and a harvard university professor also spoke on the area of new growth strategy and instead of the economy. [SEP] the study was four years before this. [SEP] the euro closed at $1. 6037 on wednesday in new york. [SEP] in march last year, china national bank issued a stake in bank of china [SEP]
+
+===== sample 012 =====
+[CLS] oil, gas producers and consumers decide what the country needs from their governments and they must follow up with international climate change plans. [SEP] coghogis said his family had considered media reports on the project because of problems from the past. [SEP] parents who make money more than the children's income just don't know much. [SEP] tehran, iran (ap) - - the united states condemned the level of sanctions on the country saturday, quoting a western diplomat and urging it to join its ties with russia and respond to pressure. [SEP] she put out a tearful eodciant statement, including one her dismissal of mr powell [SEP]
+
+===== sample 013 =====
+[CLS] budget report is expected to be issued on monday. [SEP] you guys, the mums and dads, the old boys, and we should get the feeling. [SEP] today it's what one should say: in the senate, most of you are democrats. [SEP] the u - national study focuses on the number of children, up to 12 years of age, including workers, at high risk of job loss and children with disabilities and mental health problems caused by apa. [SEP] stevens, who won a u. s. senate seat in 1996, moved to charleston, s. c., where he is finishing his time in the [SEP]
+
+===== sample 014 =====
+[CLS]'s ford family in 2001. [SEP] in september, the japanese government said it had received reports that china and general motors were trying to buy a stake in south korea. [SEP] in san francisco, mr. brown asked an assembly of the urban institute about a proposed construction. [SEP] "to be a starting point, it's the time to debate something in the region, this is about what it's doing in terms of how it works," he says. secretary of state hillary clinton said she was disappointed at the strong us and chinese criticism of the administration's foreign policy. [SEP] but jonathan tooting, director of the [SEP]
+
+===== sample 015 =====
+[CLS] chairman of the ruling democratic party, its spokesman said wednesday. [SEP] at a recent meeting of the conservative party conference, mr cameron referred himself to fellow government leader sir john patrick bowles, a friend and the former adviser to david cameron, who had suggested to him that he asked the president of the church to form a government on sunday, but not, and, at 68, call an election. [SEP] his wife, carol, and his son robert were killed immediately. [SEP] moscow is seeking to use the f - 22 air - defense system near the border at an air base, in line with the country's rules. [SEP] the [SEP]
+
+===== sample 016 =====
+[CLS]. [SEP] bookings were obtained through espn's web site. [SEP] i'd lost a race in 2003, but i find it odd - - i was stuck in the fields, the snow whips through the freezers, mud, snowdrops, scrumpsnoring slides, iceing and skiing, like slushes and skiers - frighten me. [SEP] it is the 11th small bank to raise interest rates at a small bank and says that banks will face a £2bn loss of $600bn of assets and $400bn for the total market by the end of last year. [SEP] but until 2000 [SEP]
+
+===== sample 017 =====
+[CLS] opened to the public in 1997. [SEP] and it's been because of the fact, the fact, the kids, i really get on with me, i've got to learn that i don't care about this, that guy, i've just been getting back to work, my boyfriend has been going to get married, and dad's a guy, and don't tell me about what he's doing and what he's doing. [SEP] at the same time, he said, even though sen. charles schumer he would like to see her, he has declared him his wife - - [SEP]
+
+===== sample 018 =====
+[CLS] a french coach, joel smith, began just after 8 a. m. when their tour by helicopter was stopped after returning from south africa. [SEP] he seems to be a tough man too, but harry redknapp's opponents tough. [SEP] the united states has gone where it is, and there has been no real cost - cutting and we need to think to see if the consumption of food has decreased, " said patrick mooney, director of food policy at the harvard school of international studies. [SEP] the violence, chronically in somalia, is raising the nation in its own sense of of itself. [SEP] the st john [SEP]
+
+===== sample 019 =====
+[CLS] police station, said a law enforcement official. [SEP] and mr cameron told the bbc: " i think it is time for politicians to rethink from the midterms on the issue, with the first decision on the war in britain. [SEP] mr bradley graduated from wales and the county university's central school of business and services from the university of wales. [SEP] beijing (ap) - chinese president hu jintao plans to launch the six - party talks on sino - chinese relations tuesday, marking the end of his talks with chinese negotiators in beijing, the media said. [SEP] she felt it better, calling up her [SEP]
+
+===== sample 020 =====
+[CLS] after a private meeting with msp. [SEP] what do you think of that it is, if you find people who are legally knowledgeable about that - - at this time, no one of these people, who are conwriters, but who really do something at a commercial level? [SEP] i don't know, " he said. [SEP] the police asked an independent inquiry into the deaths of mr p's family and social services could ask them to give evidence to help them put their case to the first time in more than five years. [SEP] he said the only way to know how this is to allow customers to queue if [SEP]
+
+===== sample 021 =====
+[CLS] health care legislation, and obama is expected to look into the matter. [SEP] could the chinese don't help out? [SEP] jacques rogge, a china state program adviser in the clinton administration, began meetings with chinese officials in january, and he has said his administration will consult closely with chinese government policy experts to see how the dispute can be related to international trade. [SEP] the pope had planned to fly back to the united states from the north london airport on friday morning. [SEP] he was surrounded by three people when the boy was last seen on monday. [SEP] four days later, the prime minister's party splintered its coalition [SEP]
+
+===== sample 022 =====
+[CLS] declaration of war war in iraq, stressed the stance of the new president who is expected to act within 30 months of all u. s. troops deployed in iraq and afghanistan. [SEP] by contrast, the democrats will have had 30 % of them. [SEP] he runs a keen school of history, with his wife, and he is an distinguished biographer and historian. [SEP] barack obama's campaign said "the war is running out," mccain said monday in a statement that obama needs to raise taxes on iraq. [SEP] the council spokesman had said that he would not need an interim successor. [SEP] after tuesday night of a season - high road [SEP]
+
+===== sample 023 =====
+[CLS], 19, and her big - hearted 15 - year - old son, paul. [SEP] the bank is the swiss bank's biggest bank, with a capital value at $3. 8bn. [SEP] on sunday new mps will be asked to stand down while the minority government controls the local seats in belfast in the local elections open to the opposition. [SEP] another exception was this year. [SEP] the mayor of the city - - regarded as some of the region's biggest community centres - - has not been all but surprised by his efforts. [SEP] she also signed a new law that would allow insurers to pay more in government [SEP]
+
+===== sample 024 =====
+[CLS] speech all the way to bush's presidency, according to the post. [SEP] " the peak flu flu peak season will make texas at least two days before one of the nation's highest fatality levels in u. s. history. [SEP] in washington, the vice president dick cheney, gen. eric holder, the head of the american embassy, and other officials, including deputy director general, john h. paulson, secretary of washington's media relations department and general janet a. napolitano, director of national security, h.. h., nsc chairman of policy and military deputy attorney general john d. [SEP]
+
+===== sample 025 =====
+[CLS]'s - - i know it's very important - - the health care's work here. [SEP] mccain: well, it's been clear in this campaign, with hillary clinton and obama, that there is a corruption of the money. [SEP] she said the museum is still open for all purists. [SEP] tom palmeira was the 2007 manager of the new york yankees, who handed david beckham his first major league title. [SEP] the senior economy official at the al sag newspaper reported yesterday that the current budget deficit would be about € 13 million (£7. 5 million), a little less than what [SEP]
+
+===== sample 026 =====
+[CLS] titans from a victory in the afc 30 - 28. [SEP] adrab strategy director john davies said: "i would hope we've been able to attend the meeting and decide the long term. [SEP] opponents to mr obama's trade deal argue that free trade must make it easier for families and for workers. [SEP]" mr. halli's book, published only over 20 years after it was published in france, was quite a handful of good ones. [SEP] maybe, because many people think that change is the start of business. [SEP] i'm away from the music, but all this time i'm in the [SEP]
+
+===== sample 027 =====
+[CLS] many countries to raise their own financial charges, "said economist jonathan jafflin, of prudential financial group in new york city. [SEP] sir paul told the treasury committee that meeting with hank paulson, and treasury secretary paulson meant that the nature of the crisis and the financial impact of the situation" reflected the lack of coordination within the authority and that the bank's liquidity problems "contributed to the collapse of the mortgage market." [SEP] at the time of the killing, the motive was still well known. [SEP] new england boss steve storrie, england assistant paul whitehouse, assistant national team coach peter man [SEP]
+
+===== sample 028 =====
+[CLS]ism and his respect for the old - schooled china of our post - modern - day europe. "[SEP] the former party of bhutto has become his party's go - state. [SEP] in the british version of" compass, " the image of the world turns out into the predominant colour of the north - west eye, starting up a warm snow stream and running across the street, and then hitting your feet. [SEP] but his mother always had nothing to offer. [SEP] another campaign director, robert lugar of oil policy, said iraq was still grating with high oil prices, but said the oil policy would be an [SEP]
+
+===== sample 029 =====
+[CLS], a 27 - year - old german and 18 - year - old german, spent two days travelling from china to china. [SEP] the paygo has been tied to the nation's economic recovery plan since it was set up by the senate, which passed it in december. [SEP] the helicopter was one of the first by the uk government to return to the area and it will now continue its operation for the next six months. [SEP] although that is likely to improve year on year estimates and year estimates, aig will probably reach the average 5pc of earnings per share this year. [SEP] it's not even known what the governing [SEP]
+
+===== sample 030 =====
+[CLS] conference of technology conference in the chinese capital. [SEP] instead, seeking a new look at one of the world's cutting - edge debates about how to conduct a man's business decisions seems to be much less contentious today. [SEP] the number of bodies released by the count of human bodies remains at historical record lows. [SEP] i'm trying to get out of this and i'm staying here. [SEP] 27 (upi) - - more than 90 percent of the population of unregulated forests has been recovered, u. s. researchers found. [SEP] " to see what they do, and if you want to [SEP]
+
+===== sample 031 =====
+[CLS] a high speed and reliable energy infrastructure. [SEP] in addition, the president will sign legislation to a national budget that calls to reduce taxes on crippling work, promotes improvements to energy and encourages conservation. [SEP] this debate is, at least, not very public.... to do that people and talk... and this is the job just to pretend that they're making a living. their middle - class earners are not smokers. so it's not just to go back home... you want to know, know where you're creating a lot of jobs, right now, if it ' [SEP]
+
+===== sample 032 =====
+[CLS] highest disciplinary action on the county circuit. [SEP] kiesweck, who was born in kenya, remains true to his current post. [SEP] the average share price for chrysler rose 30 cents per share on the year before to $2, 800 to $3, 050 per share in earnings for the next 12 weeks, the report said. [SEP] tony johnson, 44, was an nba coach and coach with the chinese national team, the world basketball organization. [SEP] a rescue boat will be sent to gather information about the sightings and ocean sightings. [SEP] " that's fine, he doesn't care much about anything anymore, [SEP]
+
+===== sample 033 =====
+[CLS]cied the often - difficult times of her time in washington while being caught gamely in the hands of the president and his aunt margaret, 47, a former student at imperial grammar school in london. [SEP] the index will cover the next two consecutive years, second to labour's under - achieving average of 14. 8 % and labour at 16. 1. [SEP] tiger has worked as hard as his team handlers in order to take his life. [SEP] washington (reuters) - republicans said on thursday their decision to launch a national unity presidential effort to forge a middle ground immigration plan for obama was not in the works. [SEP] she [SEP]
+
+===== sample 034 =====
+[CLS]. " [SEP] could he be a director of their office, or a diplomat? [SEP] the center said a funeral would take place on monday. [SEP] the panel's decision was led by assistant - general william h. wallace, u. s. secretary of state, along with u. s. officials and the united nations. [SEP] los angeles defensive end roy williams is a close friend of the red team, and owner tom brady will help coach mike kelly. [SEP] you can reach 100 to 100 mph on your feline. [SEP] their sister... [SEP] new york's largest cable news group has claimed $200m in tax [SEP]
+
+===== sample 035 =====
+[CLS] the world. [SEP] this is the demoralising nature of the society that controls much of the nation's political system. [SEP] but you can't tell you're alone. [SEP] the fact that obama is a republican on his own terms, to his own, is not true. [SEP] the premier league and united football league held a special meeting on friday to discuss the debtor issues of debt and debt, but said they still wanted to bring some major issues to the board. [SEP] " we had neither. [SEP] china state coach li hae is one of the world's best high school sports teams. [SEP] analysts say [SEP]
+
+===== sample 036 =====
+[CLS] other thing ), i just don't know for looks at how many other people and still don't know, all that odd. [SEP] the government said he was set back in april last year. [SEP] paul smith, 63, said that the dauntry guitarist has died of a fight believed to be handed over by clough in his late 20s. [SEP] the company has warned of early talks with key bondholders, with the bidder present after gm is negotiating with its european rival to take up control over the world's biggest maker of its debt lender cars and german industrial group opel. [SEP] he was arrested [SEP]
+
+===== sample 037 =====
+[CLS] the lte platform. [SEP] new head coach brian coughlin is lining up a one - year contract for former head coach jim henkerman. [SEP] its primary activities are to support health treatment, prevent disease control, social communication and communication, human rights work, education and advocacy. [SEP] the police chief made the threats during a media conference, cbs news said, during a visit to the school. [SEP] richard goldin, the former director of the company representing ms. steel, is a glut in the steel industry and is currently on the value front. [SEP] police said the incident was an "matter of investigation." [SEP] [SEP]
+
+===== sample 038 =====
+[CLS]usconi's government. [SEP] social rights groups would back the bill. [SEP] i will almost never be plugged into anything, " added minty. [SEP] mr nader said he has the civil justice group, a non - profit group that represents blacks and democrats. [SEP] recently, however, mr. mccain rose in the current general election, high of 45 percent - - compared with just 17 percent for voters age 40 and older who chose the first president bush in 1992, and 17 percent at the time afterward, still only 24 percent for the conservatives. [SEP] how have the big mac got to do? [SEP] matthew and paul [SEP]
+
+===== sample 039 =====
+[CLS] of the leader of the party after the election when he came to office last may, the labour leader has been under strong pressure from his party on the issue. [SEP] ms. krombly has not been with mr. mcmurch. [SEP] he was later married to douglas gilbert, the ailing sports executive, who was separated from their five kids last year. [SEP] at least, garanca's campaign is no longer concerned with cold weather. [SEP] administration officials say the leaders have to take up their positions in the battle to get out. [SEP] correa came into the state's second weekend game in the [SEP]
+
+===== sample 040 =====
+[CLS] low level and it offers some degree of shared view, but it takes more of it than you'd just get, "said john cleese, chief executive of consumer reports direct. [SEP]" i think one time after mr. schroeder said this at the state of the union, i think he's clear to what we're going to do. [SEP] for good reason. [SEP] "i don't know how to do it," sen. fred thompson said. [SEP] this was the first official use of the limited size of the world's biggest car economy. [SEP] take it, and the economy [SEP]
+
+===== sample 041 =====
+[CLS] senior political correspondent in sky news, points out that fox, along with his brother richard, the chairman of the bnp, had done a more similar job than the rest in years. [SEP] the average total cost estimated to be $830 per year, and up to $4, 000 in tax credits for families and retirees, goes up to about $2, 000 (£26, 200 - to $3, 000 per) and up to $2 - 3, 000 per household in a multi - area household. [SEP] and all those words and reminders now. [SEP] " being a director with an unreal experience [SEP]
+
+===== sample 042 =====
+[CLS] "you don't need to think about it by millions of young people or young people, but seeing that he has seen the book and then think about what he's written is just a stunt; one day you realize that he is so funny," mr. dickey said. [SEP] among those less enthusiastic, they suggest the number is 50 or more. [SEP] kevin smith, who went before the faw this morning, said yesterday: "i am a little disappointed at the result. [SEP]" there's a lot of stuff about doing that, in the way you're supposed to say, ' well you know [SEP]
+
+===== sample 043 =====
+[CLS] seeking to take advantage of the previous longest win streak of three major league titles. [SEP] it is thought he has health problems with his two - year - old son. [SEP] i had to ask, and we should start a conversation. [SEP] the information released by the department is made available by mexico's office of illegal immigration policy. [SEP] "i think this is the time when we have to play, over and over, which is not driving this type of conflict," he said. [SEP] it's a chance to see what the best people do to try to focus on numbers, and eventually make money. [SEP] i.. [SEP]
+
+===== sample 044 =====
+[CLS] monday. [SEP] kim ha - ho seong - jin, a u. s. scientist at the korean national park service, said beijing's growing concern that the united states may not open the border to north korea. [SEP] clinton can change the rest of the debate. [SEP] the then republican governor of alaska and the campaign chairman, sarah palin, was the party's national campaign committee and national chairman during the bush administration before the presidential election became a national conversation in late 2008. [SEP] in a report, the fund's development minister said the figures, in a move that appeared to show the gulf economy is likely to remain [SEP]
+
+===== sample 045 =====
+[CLS] the kellogg school of business, the harvard business school and the university of new york state university. [SEP] it's still two years behind. [SEP] the u. s. government has pledged to support the international program, with a loan program worth $14. 7 billion, including $2. 5 billion in the current fiscal year. [SEP] certain countries have the capacity to pressure israel to impeat them, michael mudd, the chairman of the u. s. senate armed affairs committee, said during obama's press conference wednesday. [SEP] a similar measure had been introduced immediately after the 2000 elections in 2004. [SEP] instead of the [SEP]
+
+===== sample 046 =====
+[CLS] wrapped up the bill on friday when he met to meet leaders, republicans and analysts. [SEP] even if you did, the colts need to play indianapolis, indianapolis and denver, which makes this game sound like that. [SEP] "i wish him for all the last few years," said mr gordon, who would retain his permanent post until june. [SEP] the roughly 25, 000 - megawatt first pass public school, is racking about $20 million in damages. [SEP] maritime and coastguard agency spokeswoman sarah said people were living in a site in the norfolk coast, which was knocked down last month. [SEP] he and other [SEP]
+
+===== sample 047 =====
+[CLS] will make on its long - term debt. [SEP] those aged under 50, 000 have children - - 15 % of their income - - an average age of 12 % of children well below the poverty line. [SEP] the former washington coach announced his decision to take over the job in late 2007, second only to the former redskins head's job at mclin 13 years ago. [SEP] but in some ways, this was the kind of disease that was getting swept away, said dr. ron paullin, the director of the army corps' national division of medicine. [SEP] the bbc, like many other outlets, runs a wide - ranging [SEP]
+
+===== sample 048 =====
+[CLS] chinese military activity - - arguing that trade would be its main means of deterging iran - - that he would help iran. [SEP] for my career, i have to go back on my glut. " [SEP] new york (ap) - a man who claimed to have shot himself in his cell phone while a new york city tramp trying to lose his seat took the call off his cell phone, and was arrested, a police spokesman said. [SEP] and the columnist would rather to talk to him, who thinks his political speech will be free - - too easy, too risky. [SEP] and with so many art associated with china [SEP]
+
+===== sample 049 =====
+[CLS] with a large number of blacks and non republicans - - 36. 5 percent of them are democrats. [SEP] washington (ap) - former sen. john mccain is elected as republican party candidate to the arizona house of delegates. [SEP] the army air patrol found a vehicle damaged in the blast at 7. 00am and slammed into the air of a building near the road, pvt said. [SEP] scottish labour msp leader david dunhamp was busy on entering a london protest today. [SEP] as he was to leave the station late friday, he was headed for a 10 - day flight around the southwestern city of hangzhou. [SEP] in [SEP]
+
+===== sample 050 =====
+[CLS] seven - year - olds were also asked to take a breath test. [SEP] in 2008, the rate was at 10. 5 %. [SEP] senior white house officials involved with the senate trade and labor committee and democratic allies say they could not strike a deal. [SEP] sales by all department stores fell by 17. 3 % in october 2008 compared with september 2007. [SEP] the welsh club have played a cup game since 2001. [SEP] mcgot, however, said he has no comment on who will need to go, and spent three weeks in pain at the 2009 british open on june 4. [SEP] mr. hender said, however, [SEP]
+
+===== sample 051 =====
+[CLS] told by the prime minister's critics that will change, too. [SEP] at the time of war, "i've been following the pension age for a few years ahead of time, and that is the only thing most people will need to worry about now," says mark horwood, of mcginley water. [SEP] the us company now has sold more than two million copies. [SEP] reigning national league all - star shane victorino retired with a 13 - 2 record, entering the first game with seven strikeouts and five walks in six innings. [SEP] a former leader of the anti - israel militant mohammad khazali was [SEP]
+
+===== sample 052 =====
+[CLS] said. [SEP] by the end of 2010, one of the museum's largest buildings, the venerable halle building, will have become one of the oldest - - the revamp of its status at the end of a half - century. [SEP] that's a shame. [SEP] but, then, are you happy? [SEP] women are about three times more - more than half of the number of people who are employed by mothers. [SEP] gotdipedant. com has two single vacation packages, starting from £248 per person for a three - night stay, with two - night hotels and breakfasts from about £260 per day [SEP]
+
+===== sample 053 =====
+[CLS] others in that neighborhood. [SEP] even the majority of voters think the talks will be successful. [SEP] (ap) - - british open champion padraig harrington birdied the last two holes to win a first - round seven - under 70 and cap a difficult round with a five - under - par 72 saturday. [SEP] in 2006, walsh and his responsibilities as a team coach saw him as mike fox, the former coach of the nfl who was hired as the national league's top game official, and two general managers, ken zorn and jim mcgay, out of their coaching jobs. [SEP] " the government wants to lift [SEP]
+
+===== sample 054 =====
+[CLS] problems and the global population, it said. [SEP] no........................ [SEP] he's been out with a team with the ball he used to run home in 2003. [SEP] i know if i say i'm something i feel like i'm just making a living and i'm writing it out to go the upside - down. [SEP] "chaudnoy said i've never got it," mceste said. [SEP] clinton knew he would be more inclined to vote for obama in the senate. [SEP] [SEP]
+
+===== sample 055 =====
+[CLS] it will have to be more sensible for anyone to co - pay herself - - but it is a right, even to tell her husband, that, in 10 years to come, she's going to assume the country won't do. [SEP] ban's comments also underlined washington's increasing calls for the west to criticize mugabe's administration if he rejects legislation and rejects the south's right to vote, said the diplomat. [SEP] mr freier has argued that the current value of such bonds is twice the value of assets and that total is worth more than that national debt debt - - beyond certain [SEP]
+
+===== sample 056 =====
+[CLS] of alcohol and drugs increased over 20 years, the study said. [SEP] the potential market for all players is vast. [SEP] the player asked not to be sacked because the manager, alex ferguson, was concerned. [SEP] he will remove the need of extra public spending. [SEP] so, i'll be able to shop again and raise money. [SEP] don't be fooled either. [SEP] the budget also shows china projects a record $50 billion increase in foreign direct debt, will plunge to $80 billion next year and add $20 billion from about $150 billion this year to the deficit in 2008. [SEP] he said the summit was " [SEP]
+
+===== sample 057 =====
+[CLS] in areas such as university education, health and development, care, green security, energy and infrastructure. [SEP] mr cameron wants more independent schools for working - class children and long - term and early childhood. [SEP] a note on the paper read: " it's easy to slaig on the track, but at the time i feel as if i didn't stand out when the other u. k. players have found the stadium and will always have a team as well. [SEP] it brought him a director's worth of tv and a comic book, as well as the best film. [SEP] toronto/madrid ( reuters life [SEP]
+
+===== sample 058 =====
+[CLS] a good job for him, so the policy is good sense, says a senior official familiar with the negotiations. [SEP] los angeles, california (cnn) - - california gov. arnold schwarzenegger and virginia general secretary tim kaine announced tuesday they would seek to save the state's economy. [SEP] third quarter revenue and revenues of $1. 5 million will go to the third quarter of us $3 million in 2009 and net revenue for the first half 2009 will be approximately us $3 million. [SEP] worse, the biggest disappointment had been the child's mother. [SEP] the u. s. construction industry posted a net loss [SEP]
+
+===== sample 059 =====
+[CLS] emerged in a special on the tv network "accessing america" interview with obama in the middle of debate in the u. s. chamber of commerce on sunday. [SEP] he is the head of the un panel on climate change (unec) and chairs a conference on global climate change. [SEP] this is the first large british study on the legal state of death since the 1970s. [SEP] " i came here, and i was 16, finish school, swim, and end up as a high school player. [SEP] manchester city director richard scudamore also raised concerns that the takeover of the club was going to go away. [SEP] two [SEP]
+
+===== sample 060 =====
+[CLS] mile drive central to the city. [SEP] but i would never know if you asked this question. [SEP] yes, i have been given the freedom to make things, not to accept the fact that someone is going to die, but i want to start paying too soon for a girl. [SEP] "they may be using their location and in asia to promote their technologyization," said senior u. s. officials at the national intelligence center in seoul. [SEP] council chief chairman jack scallion, who works with the centre for health research, said that children with asthma and other health problems had their concerns and that the funds for the national [SEP]
+
+===== sample 061 =====
+[CLS] was mccain's wife. [SEP] this article was first published on guardian. co. uk at 10. 05 bst on wednesday 8 may 2009. [SEP] as u. s. president barack obama on friday rolled in a clear show of respect for iran, the president of the united states denied that iran is willing to start the war in iraq. [SEP] the london office said the british currency fell to a low of $1. 8745, although the british price rose to $6. 876, and the new york pound was trading at £85. 30, up from a new low of £0. 877. [SEP]
+
+===== sample 062 =====
+[CLS] years ago, your parents told you to allow your child to look after a particular child, something that you wanted to be able to buy after our 4 - year term. [SEP] pat austin resigned as the leader of golf, while steve appleby opted to take golf and the rest of the field after a first round last month. [SEP] the council estimates it needs to save about £2. 2m a year by 2017 over the next two years. [SEP] the teacher said that she told him and peter, a teacher, that he had moved his home and ordered his son stay at home, but the school insisted that he had to deal with [SEP]
+
+===== sample 063 =====
+[CLS] "zinnes said. [SEP]" we must accept that this was just an accounting game for politics in a very high - stakes private equity industry, " said robert johnson, a former chairman of the committee. [SEP] 20 trying to see how more than 100 clients will end up, a 50 percent drop compared with a year ago. [SEP] that's the point: many people don't sit in the sun. [SEP] as the government abandoned its buy - to - let - market power over banks and built into its own form of untening and overeachness, the growth generated long periods of market collapse. [SEP] in [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_diffusion_noise_steps_128steps_n64/noise_linear2to08_mid_sine_eta0p05_c256_detok_raw_samples.txt

@@ -0,0 +1,230 @@
+noise_linear2to08_mid_sine_eta0p05_c256_detok
+{
+  "type": "summary",
+  "name": "noise_linear2to08_mid_sine_eta0p05_c256",
+  "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt",
+  "step": 187000,
+  "decode": {
+    "kind": "categorical_fullvocab_diffusion_state_noise",
+    "config": "noise_linear2to08_mid_sine_eta0p05_c256",
+    "steps": 128,
+    "temp_start": 2.0,
+    "temp_end": 0.8,
+    "temp_schedule": "linear",
+    "t_power": 1.0,
+    "eta0": 0.05,
+    "eta_schedule": "mid_sine",
+    "noise_conc": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 49.82670395081913,
+    "nll_per_token": 3.90855106422597,
+    "tokens": 9587
+  },
+  "diversity": {
+    "sample_entropy": 4.223790486496133,
+    "unique_tokens": 1959,
+    "token_count": 8192,
+    "distinct_1": 0.2391357421875,
+    "distinct_2": 0.7219488188976378,
+    "top_token_mass": 0.051025390625
+  }
+}
+
+===== sample 000 =====
+[CLS] snowing and slashing incidents in march last year. [SEP] according to reuters estimates, reuters data showed net profit increased slightly to 5. 547 billion euros ($6. 9 billion) from 5. 27 billion in the period a year earlier. [SEP] police and search and rescue officials have found three bodies in china, nine killed and one missing, while several hundred others remained missing in southern china as the authorities continued to unload on sunday. [SEP] clinton called the post - start talks a major milestone for improved relations with russia. [SEP] new york's main crude oil futures fell 2. 4 percent to $1. 048 [SEP]
+
+===== sample 001 =====
+[CLS], " said istahiy ketamo, the main opposition leader and deputy minister of the opposition democratic league. [SEP] the leaders have said they wanted to reach the end of the current talks in geneva. [SEP] john mccain, his campaign adviser, said obama made the decision to do it. [SEP] clegg, the interior minister two years ago, was made head of the post at the ministry of defence. [SEP] but in august, obama said that the communist party is prepared to pursue such talks, and will hold high - level meetings, administration officials said. [SEP] for more information on iridium, visit the web site www [SEP]
+
+===== sample 002 =====
+[CLS] wouldn't do it if we went to half a mile and say: i'm on the road, i'll feel the pain. [SEP] its fate will be the final challenge to gm. [SEP] the sector is now averaging 2. 5 days per person - - £9, 842. [SEP] don't know what that means. [SEP] the federal government accounts for around a quarter of the state's infrastructure funding. [SEP] the ministry said in a statement that the country's central government and parliament had to convene to discuss national tax policy to investigate key causes and issues. [SEP] it's a long time [SEP]
+
+===== sample 003 =====
+[CLS] industry to go bust, foreign investors had to pay for that money, and the world was really stinking. [SEP] i've made friends and i think she'll be that close. [SEP] the liberals garnered more than 70 % of mr sverl's votes in the eu's only state of the union. [SEP] the measures, projected at ages 2 - 15 f tall, will do show that there is a political problem in france. [SEP] he spoke to the foreign office agency several months ago and held subsequent meetings with the president, the director of national intelligence, michael evans, chairman of the ukc, and tony [SEP]
+
+===== sample 004 =====
+[CLS] $200m, with government grants to help poor people. [SEP] 8 (upi) - - mexican immigration officials said they have reached a formal agreement with u. s. immigration authorities to block illegal immigrants from returning to china from mexico after last week's earthquake. [SEP] it seems like the problem is that the people - - like me - - lose my life. [SEP] us president george bush on wednesday's first meeting since resorting to a vote on the north korea treaty is expected to pass his proposal to the white house later this week. [SEP] but after years of negotiations with the army, the opposition group known as pro [SEP]
+
+===== sample 005 =====
+[CLS] automotive parts, electronics, and industrial products. approximately 877 countries and represented almost 60 percent of its u. s. retail sales since june 2008. [SEP] a 28 - year - old foreclosure expert charged in a heart attack killed two young children, two teenage, and three children were rescued from a car park in birmingham. [SEP] obama's 35 years younger than mccain in the presidency of clinton, but otherwise he would be trying to move into the old hands of the 2008 campaign. [SEP] the white house said wednesday that economic growth in u. s. dollars was down to 2. 3 percent. [SEP] eu officials blame [SEP]
+
+===== sample 006 =====
+[CLS] cities, and where there's an issue of violence, "she said, citing a rising number of youth suicide attacks, which was trying to prevent gay trafficking. [SEP] it's a call to the people of gaza. [SEP] i'd rather see the unknown joe guy sitting in a corner with his hands near the ball, sticking up his shirt. [SEP] people in the last couple of months have endured months of political and national conflict. [SEP] the campaign also said that more prominent republicans were likely to side with clinton, while making sure iowa voters make a choice. [SEP]" at the end of the course of the training, we [SEP]
+
+===== sample 007 =====
+[CLS] patricia cley, his wife, and eric mcmlin, assistant manager of the park. [SEP] police arrested a white man who pulled out of a vehicle after fatally shooting a gunman while his friend was out on his school trip. [SEP] the win paid off the second - ranked red wings (24 - 13) to finish seventh in western conference history, two points ahead of the red wings conference. [SEP] but consumers are saving up spending their money to buy their cars. [SEP] a police rail spokesman said the man was called to the school at about 2235 gmt thursday on a two - way road near south edgerton road. [SEP]
+
+===== sample 008 =====
+[CLS] be broadcast on sky sport wales on bbc1. [SEP] why don't you give your kids a full year before the holidays? [SEP] he said his country must seek political change and national reconciliation and his country that it is fighting a civil war before the end of a new era of democracy after thousands of years of war, economic and economic civil wars. [SEP] however, kemerle said he didn't see an end to the violence. [SEP] it's important to think about this important process. [SEP] those without the major knowledge in the course will have to attend a brief conference or a loose - ended strategy session with the chinese [SEP]
+
+===== sample 009 =====
+[CLS] local website, zk. com. [SEP] instead, they said, the news of the housing slump will be seen as a call on the white house and the public to help rescue the rest of the country. [SEP] but if markets do fall, it's probably time for local courts to take the decision to intervene. [SEP] the total balance of £18bn came from risk assets and neted an investment of £64bn in the bank's debt at the end of 2008. [SEP] the cleric was arrested in friday and had been held for 14 days, the central news agency reported. [SEP] as president george w. bush [SEP]
+
+===== sample 010 =====
+[CLS]g announced that he had wanted to help in the private sector, as labour's backben seized on the idea that the national government must provide health care and other financial services to keep in its annual budget. [SEP] during his political career, he attended the university of georgia, became an attorney and held a master's degree in marketing at the university of chicago, as well as a master's in law degree at indiana university. [SEP] the russian foreign ministry will visit moscow later on tuesday to discuss improving diplomatic relations with russia, which suspended the conflict since the end to the 4 - year august war in georgia, the eu said [SEP]
+
+===== sample 011 =====
+[CLS] said the us federal reserve's director of financial stability, lawrence yun, on how to recoup tarp funds. [SEP] and i just like this kind of film, knowing that the kind of thing that is going to has to be really worked out of. [SEP] the obama administration is expected to say that the timetable for negotiations is modest in its commitment to scrap the unilateral strategy already pushed by barack obama. [SEP] the study was completed years before this. [SEP] the bank sold on nearly £240 billion of losses in its £5 billion of assets in december last year, with a net sale and repricing of £1 [SEP]
+
+===== sample 012 =====
+[CLS] one - year high and still far bigger than it was in 2009, and amid the global availability of international collectibles. [SEP] bolsman has said his family won't be surprised. [SEP] because we're going to look at people who lack good medical knowledge, children's views just don't make them. [SEP] tehran, iran (ap) - a u. n. spokesman confirms iran worked on the nuclear program, but tehran insists it has told western countries not to discuss the issue. [SEP] the court heard admitted killing john hughes, of darley, on april 17, 2005, and mr moore, 17 [SEP]
+
+===== sample 013 =====
+[CLS] to be a target, "said adelman. [SEP] you can see the courtyards and driveways and fells of peaks and forests that get the feeling for you that it's all that bad and that you feel this is the best place. [SEP] muddisbe claims the player is on a salary of £1. 2 million per month, but says he was" at his best age, "and has stuck with his assertion that he is" the best player in class. " [SEP] the u. s. l. a. a. tournament was ranked no. 2 overall, and west virginia needed a win over another [SEP]
+
+===== sample 014 =====
+[CLS]'s owner and general manager. [SEP] robert kim, a senior chinese diplomat for asia, said that the north also would be trying to boost ties with the us and south korea. [SEP] however, mr. brown did declines to say how long it will be his administration. [SEP] he was also a leading officer in education policy at the centre of modern education in the 20th century. [SEP] dr garoff has also expressed fears that more people would go to the disease. [SEP] president carter asked clinton and others to meet at a regular level, including sir john michael benn, the defence secretary, and lieutenant general john hoon, the [SEP]
+
+===== sample 015 =====
+[CLS] chairman of the ruling democratic party and labor party said wednesday. [SEP] at a recent appearance of the joint chiefs of staff, he tried to pressure the nation into believing huckabee was a leader and wanted to change course. [SEP] the liberal leader nick clegg there is strong backing of the plans to allow the town to support football development for football pools. [SEP] however, van kroen and his wife, marina, would probably not want to join arsenal. [SEP] tibetan bloggers said friday heavy fighting this week in the tibetan area near the border with chinaah, in southern china with the group of chinese troops. [SEP] the [SEP]
+
+===== sample 016 =====
+[CLS] to new york in 1959. [SEP] his father, john duddier, had three touchdown receptions this season. [SEP] well, not saying that "lost" was the full story of my life in politics. [SEP] the conference also is likely to include environmental and urban intreification and advocacy workshops, where residents and local business leaders urge them to learn more about water conservation and sustainability. [SEP] yields on 10 - year us treasury rose 4. 6 per cent or 0. 4 per cent to 3. 452, while the british pound dropped 0. 6 per cent to 2. 0305 against the pound. [SEP] and the legal [SEP]
+
+===== sample 017 =====
+[CLS] open to the public in september. [SEP] "it's been part of the process, the people were saying it today, they did it with me and i thought, ' well, if you don't think about that, you know, you're just trying to look like the guys. ' [SEP] my mind is that you can think he's a messiah, and, of course, that is who he goes down on and what he's doing. [SEP] do the same for you? [SEP]" anybody who has made this movie will come out at the same time to join it. [SEP] the national film festival, [SEP]
+
+===== sample 018 =====
+[CLS], north london, and his p & c partner, spent 10 years in poland, poland and italy with a degree in finance in 2004. [SEP] in addition to being a common man, he will be redknapp's main concern. [SEP] the united states has gone to china since last month and has said its broader anti - china ties reflects a new level of engagement with the new leader of the european union, said mark pillion, director of the china development program at johns hopkins military college. [SEP] more important, ambition and superficiality, the g8 now maintains its own sense of civility of mass market power. [SEP]
+
+===== sample 019 =====
+[CLS] enforcement agency has said that law enforcement agencies are trying to reach agreement on the matter, though authorities say it is unusual for the federal state to spend $1. 4 million on the issue. [SEP] the final decision has been reached on the ballot. [SEP] use the universal system and connect to apple's smartphones - - any 3g is such important information. [SEP] beijing (reuters) - chinese troops fired riot gas on tibetan independence movement protesters in lhasa in western china on friday, in the height of a pro - chinese anti - government riots in lhasa on monday. [SEP] she would not like to save rafa [SEP]
+
+===== sample 020 =====
+[CLS] within a week...... what would you think of that? [SEP] i ask you those people who are legally knowledgeable to make a decision ahead of time to do business out of office, and need condits to huwbut media and social media supporters? [SEP] i don't know, but he's going to be asked about that. [SEP] the children's mother's family became children's attorney father jo john and her father, james paul james, when they lost an abuse case in 2001. [SEP] apparently, the only way to know how you feel as pain as possible is to [SEP]
+
+===== sample 021 =====
+[CLS] health service, said that mrs bush would not travel at the time. [SEP] the springbok's director of rugby, jay klagger, spoke at a news conference after the second match, after meeting with former players and managers, and said that it was more than good to start over. [SEP] but that short - term money is being needed to develop large hybrid and electric vehicles, commercial - scale projects that could create hundreds of millions of jobs. [SEP] as for gm, the union agreed last month to help, but the company has no details. [SEP] four days later mourinho's inter milan team were replaced [SEP]
+
+===== sample 022 =====
+[CLS] bank of america corp. executives wrote to the bank of america board wednesday as they tried to thrash out the details of the u. s. government's proposed financial regulation. [SEP] but today, haiti's people are sitting just behind them. [SEP] he has a long record of public service, his wife, father and wife of a marriage and children. [SEP] president obama's team said its efforts to rescue some banks were under way on monday after days of his days failed to convince countries to revamp their laws and financial regulation, although he said they need an international solution. [SEP] after a night of a heavy rain, their [SEP]
+
+===== sample 023 =====
+[CLS] year - old woman and her younger, 16 - year - old in south carolina. [SEP] the study found that older children opting to have children to play, both younger adults and children age 14, were using the web and were most likely to spend more time with partners. [SEP] the election complicates the role of the un, " said eric shinseki, the spokesman. [SEP] during the same period of 2007 last year, 15. 5 percent of total traffic online attracted a total of 4. 4 million subscribers. [SEP] the group has also announced a new rights issue to raise about £60 million to raise £4 [SEP]
+
+===== sample 024 =====
+[CLS] [SEP] obama has turned to democratic national co., who opposed the u. s. - china war, refusing to be part of clinton's claim that china should be blamed for the foreign policies of the former u. s. senator. [SEP] in an interview with vice president hu jin, chinese premier myung - bak urged the south and the communist state to coordinate closely. [SEP] michael brodeau, director of china policy at the national institute for near east policy and donald s. pilko, a professor in new brunswick, n. j., and the chairman of the national security administration's asia program. [SEP]
+
+===== sample 025 =====
+[CLS] of eye - watering. [SEP] it's not fair to hear about senator mccain's intellectual credentials. [SEP] " but no, there's no question of this law, and if bush and mccain claim that there is a kind of short - term policy, then the campaign is still waiting for all the kick - off that spews out. [SEP] one of the most important data is expected sales decline over the next three to 10 years. [SEP] a few people are still be dashing into the streets. [SEP] the local railway line was called to cardiff valley centre in gwyth, near wales, by south wales fire service [SEP]
+
+===== sample 026 =====
+[CLS] to earn a victory in the draft 40 - team draft. [SEP] white house press secretary robert gibbs said: "president barack obama has the go - ahead to attend the meeting as prime minister this morning. [SEP] finance secretary minister gordon brown rejected the idea saying that the government must provide financial support for companies with bad debts. [SEP]" you would think it's absolutely going to go wrong, but but it's clear that 2010 is going to be a good year. [SEP] she's a real person of mine, knows what to do that day and went on to see what music is like all this time. [SEP] although ferguson played [SEP]
+
+===== sample 027 =====
+[CLS] said committee chairman james hall. [SEP] (nasdaq: lwrc), a prudential advisory firm, is highly recognized and best known for its diverse investment analysis and expertise for investment, investment management and successful capital management. [SEP] on the scale of the lloyd's announcement, tsb chief executive charles mcginley said that the markets crisis saw the bank's liquidity position be dented "due to the financial crisis" in 2008. [SEP] and it's good sense of the real business again. [SEP] new york (ap) - - oil prices reached below $75 friday as the country continues to struggle [SEP]
+
+===== sample 028 =====
+[CLS] business and entrepreneurship. [SEP] many commentators - many in opposition to the bbc radio 4 controller, richard dagan, are calling it "misforte." [SEP] it is time for obama to sink deeper into the philesmonian politics of race, and that while america's focus is on the issue on the issues of race and free speech, mr obama will be forced to defend his claim. [SEP] "it was almost impossible, and i really had the right choice. [SEP]" what we've done is to increase demand, not to increase demand, not to cut oil prices, " said japanese oil minister jiabao [SEP]
+
+===== sample 029 =====
+[CLS], a 31 - year - old pregnant woman and a 50 - year - old man who also escaped from a road safety facility. [SEP] merkel has not returned to the nation's highest elected post after she was elected mayor of the 2, 500 member parliament in 1991. [SEP] in the days since usc coach john corrit officially announced plans to replace kiffin, however, barkley's tenure has drawn criticism. [SEP] analysts by reuters surveyed estimated 2009 earnings could be about $5. 4 billion, up from $6. 5 billion of earnings per share this year. [SEP] it's not a long time to get [SEP]
+
+===== sample 030 =====
+[CLS] annual farmers' conference in the uk have asked their clients to get the cards back on their return home. [SEP] operating income fell 4. 6 percent last year to around y4. 3 billion (1. 5 billion dollars), the sources said. [SEP] the dollar fell to 6. 10 (1 yen), while the british pound fell to 1. 2 per cent (2. 5207). [SEP] 18 (upi) - - more than 6, 000 adult u. s. teens died of related health injuries last year, according to data released. [SEP] " i sit forward and say, i've done so [SEP]
+
+===== sample 031 =====
+[CLS] sheffield area school nhs trust, ayreland foundation and sheffield primary school will sign up to a community mental safety bill on 12 january. [SEP] mr cleggcedes that mr cameron has been willing to consider a government - backed plan, having announced six months ago when mr brown said the financial markets were driving the government and government debt issing debt to historic levels with piles of publicly issued debt and that credit - rated lenders are paying more debt. [SEP] it's to create its own brand of entertainment - - its system, and they need to win this series, then they need those top three players, then they need [SEP]
+
+===== sample 032 =====
+[CLS] highest level action on the international circuit. [SEP] the agency's program director dan brown, 62, also says the average salary of workers stood at more than $8 billion last year and 30 percent on the year before to $2, 800 to $3, 000 billion this year, the report said thursday. [SEP] the percentage of non - african americans who start in at least one class, rising to about 250, 000, has been racked up by blacks, mostly because of racism. [SEP] " when the company tries to keep the company going during this year's holiday season, i'll see the best games going through [SEP]
+
+===== sample 033 =====
+[CLS] making her the highest - watched day of her time in the hospital. [SEP] security is in the hands of the democratic and republican presidents, senator clinton. [SEP] hun's lawyers have no significant interests in china, and his wife has over 30 years of experience in china's affairs. [SEP] for public support was 8 % of labour at 16 %, while support for public support was 5 %, to 17 %, 20 % and 19 %. [SEP] philadelphia (ap) - the nfl league defended its decision to open a new meadowlands stadium amid concerns about what the union says is a plan today for the site of a major [SEP]
+
+===== sample 034 =====
+[CLS]. [SEP] it's not a tale of two kids, one parent's family. [SEP] at a separate meeting in beijing, mr. gates, who will also head the national security council, and william h. welch, u. s. special western diplomat, met with u. s. officials and the chinese government. [SEP] los angeles defensive end corey williams is a close friend of the red raiders, and the seahawks have been silent on the move. [SEP] "there is a legal crisis," president president basilio rajapata told reporters. [SEP] the region's most prominent militant group has claimed $200m in israel [SEP]
+
+===== sample 035 =====
+[CLS] the virus. [SEP] this is also evidence that the state of the banks has hit much of the uk's banking system. [SEP] but people are worried. [SEP] now there are many countries and american countries that have been willing to pay taxes to work since the trade deficit crisis ended in 1990. [SEP] obama is also widely expected to forge a global role in global development, trade and fighting the global financial crisis and urge china to improve its economic ties to fight global change. [SEP] the violence has been seen as worsening repression in china since uighur leaders rejected an ultimatum from an angry official from beijing, following a protest in china at [SEP]
+
+===== sample 036 =====
+[CLS] members of the ethnic tamil minority, known in sri lanka as tamils and tamils, among them tamils and the ethnic kuks. [SEP] he reported his missing from local authorities in august last year. [SEP] ron smith, 60, said the body of emerson late saturday night and his two friends were to be handed over to family at the hotel late monday. [SEP] the company has assets of more than $60 billion and was sold to a second investor after its under debt collapsed in 2009. [SEP] the group has been the world's biggest and most profitable automaker with annual sales of nearly 30 billion euros. [SEP] he was arrested [SEP]
+
+===== sample 037 =====
+[CLS] s most valuable job for the national football conference and show he is playing with the 7 - 8 mark under former bills coach john henkerman. [SEP] arthur robinson, 29, picton county, was killed by a mine land mine in poinsettia, georgia in november. [SEP] the figure: the number of banks posted losses of more than $60 billion in a full year of september alone, reaching $4. 2 billion in september. [SEP] the initial buyout eventually prompted a glut in financing that had brought more bank debt on the market. [SEP] while he said the meeting was about his formality and faith, [SEP]
+
+===== sample 038 =====
+[CLS]usconi's insistence it was "wrong" to back the constitution. [SEP] i will almost never get the bill into law, " said anny schl ettinger, president of the global environment group, a non - profit group that studies environmental climate policy. [SEP] but, though, mr. mccain did not say what president bush said, and he said he would speak with him in saying the same thing. [SEP] those who believed he would beat mr clegg were also wrong at the polls yesterday, with only 24 % believing the tories would do better than the tories would do. [SEP] obama and hillary [SEP]
+
+===== sample 039 =====
+[CLS] of the north indian private gas development corporation. [SEP] at 6ft, 2 stone, mr baker might have been looking into the public eye, but mr clarkson's presence looked suspicious. [SEP] it just has to look good. [SEP] "today we must hope for better, and never better," says mr obama's national spokesman for china, dai yongbyon. [SEP] "it's like it's a closed door," she said monday. [SEP] but some say the americans have become under iranian pressure to encourage more dialogue with the west. [SEP] co - ed williams, the center's general manager, said the [SEP]
+
+===== sample 040 =====
+[CLS] [SEP] britain may have needed a degree of caution first, but the new mood of optimism "is almost going to increase," said john cleese, managing director of deloitte. [SEP] nevertheless, she railed at mrs. clinton's decision by nearly 1, 000 supporters yesterday, more than a week before victory, to raise the level of democratic support, drawing criticism from the clinton camp. [SEP] you don't know all this about america, " former senator fred thompson said, hoping to make obama's point. [SEP] g. m. fell nearly 7 per cent to $14. 30, the group reported [SEP]
+
+===== sample 041 =====
+[CLS] head coach john birkers will point out that howard, 14, and stuckey, both with the local english club, had an impact at a level in the local high school. [SEP] the average house price starts at about $30 dollars per month, and up to $200, the average price for a strolling from a typical town apartment ranges from $10, 000 (euro7, 200) to about $1, 000, and up to $600 - 5, 000 yuan (euro62, 400). [SEP] and, you will know, right now. [SEP] it was a tale of an afghan - man [SEP]
+
+===== sample 042 =====
+[CLS] "i don't want to do that work, i don't have the power to know what he's doing and the way to think about what he's doing is just a non - yardage job for the'dopey,'" korris said. [SEP] for more information, call (800) 333 - 4577. [SEP] the severe snow was reported over the region last weekend at brixton, south wales, brugn - briffon, north halbreane and coeurfa bay. [SEP] by the time you're done this will happen ( which goes with [SEP]
+
+===== sample 043 =====
+[CLS] struggled to make light of the poor selection problems while sitting with him at the club when he was involved in a running row with alonso at the penalty box last week. [SEP] what do you now make from the film and on tv? [SEP] the complete list of the cases is being released by the united states office of illegal immigration policy. [SEP] biden said it was unrealistically impossible to comment. [SEP] but this is the time that obama's campaign needs to be traveling well, and mccain's aides are mostly questioning the way he intended to promote mccain's campaign ad and his position on lifting the i. t [SEP]
+
+===== sample 044 =====
+[CLS] love. [SEP] obama has outlined plans to improve military ties with the u. s. department of defense and national security, and said obama's trip would highlight new efforts in japan to develop ties on north korea so the united states can change position on its nuclear issue. [SEP] "then the coach just waits until you know what to need to win, and maybe that's what matters for you," mccelson said. [SEP] at the matter of months, in the case mother and sister were arrested, the girl arrived by her father's grave, and i wondered what might happened to her at what is likely to be [SEP]
+
+===== sample 045 =====
+[CLS] the department of public office, capitol and capitol building and the capitol historichouse on pennsylvania avenue. [SEP] marc and i spent two days behind. [SEP] the u. s. government had pledged to support the international trade, along with former u. s. president bill clinton, and defense secretary. [SEP] clinton, the top diplomat for china, was holding a meeting tuesday with the two sides. [SEP] the biggest freezers were conan o' brien, 20 feet (9. 7 million) and 6 feet (10. 3 million pounds). [SEP] the obama administration has been more critical of the agency's role. [SEP] he said the [SEP]
+
+===== sample 046 =====
+[CLS] survey results are available on the internet at www. educationglobes. com. [SEP] despite losing the competition, the former all england star said, cricket in golf is becoming an attractive game for many people. [SEP] "i knew him for only the last few minutes," said nadal, who only gave his first name. [SEP] i have never seen it, al - hʼt reported. [SEP] merry - goers, the chancellor, is serving in the german national team under bush, the russian ambassador, and guede van grozier, the former head of central bank, the german bank. [SEP] perry and other [SEP]
+
+===== sample 047 =====
+[CLS] will make provisions for long - term rebuilding. [SEP] those younger than 47, 029 children - - 15 percent of under 30 - - reported no benefits of their relationship with a single parent. [SEP] tim johnson, the former rugby coach and the former principal of coaching at smithfield head school, is married to david davies, head of rugby rugby at hayes college, west london. [SEP] "as they thought, this was the kind of sporting news i wanted," said stephen stentiford, head of the university of queensland, australia's school of politics. [SEP] the governor, jeffrey piotr, made a wide - ranging [SEP]
+
+===== sample 048 =====
+[CLS] sending military anti - ship technology to iran would be its main means of averting long - term, nuclear conflict with iran. [SEP] investment banks and their capital have soared for more than twice that as new york investors who bought shares in the debt markets. [SEP] he's doing little work outside of his school. [SEP] the us prime minister urged china to make it harder for the chinese government to cancel the us trade talks. [SEP] "it is difficult for me to continue to expect america to use our territory to force its civil rights against china while free - speech is," rice said. [SEP] mired in its opening bowl season, [SEP]
+
+===== sample 049 =====
+[CLS] have a significant number of blacks and hispanics - - 12. 5 percent of them are democrats. [SEP] washington (ap) - republican sen. john mccain was elected in illinois thursday, saying he was bitter about the country's economic record and voting on climate change in the 2004 presidential primary. [SEP] she was hit into the air as she was attempting to get the car out inside. [SEP] urging the gop to abandon its bipartisan credentials, mccain said that now the country is changing, america is not changing the people. [SEP] the call was started by the local human services council, a group of local muslim councils. [SEP] in [SEP]
+
+===== sample 050 =====
+[CLS] senate decided friday to hold out for the full scope of the inquiry. [SEP] the previous meetings revolved around japan and china, patching 21st - century differences on trade, jobs, trade and jobs - - to which their leaders could not be a threat. [SEP] he is now working at the pacific primate research center in oakland. [SEP] this is the new - england - owned team that dates back to the early 1960s. [SEP] kostenko, however, said he had not been informed about the government's talks and the three men met russia's finance commissioner john cedera. [SEP] mr motts said it was " [SEP]
+
+===== sample 051 =====
+[CLS] be able to make that point and show the public that they can listen. [SEP] this is the deal. [SEP] i've been following the streets and canals for a long period of time, and parts of the street in the morning are used to snow people getting crowding the streets and getting people over the sand and water. [SEP] the rise of blairism was not reported by the times. [SEP] cnn's karen travers, who reported from hollywood, pa. [SEP] the times says jackson is spending time with his family and relaxing on his own feet. [SEP] several private and private day talks are held at airy university in birmingham, [SEP]
+
+===== sample 052 =====
+[CLS] said. [SEP] yesterday's way home, however, the president's biggest task of the night was to get him away with the talk of love and turn the process around coy. [SEP] this would be only the second time in this series they have lost a player. [SEP] 19 at the university of south carolina. [SEP] " we spend three times more time today than we have a year ago and a lot more time than ever. [SEP] space agency officials said engineers could do up to five hours of surveillance a day and see what happens what's done on the station. [SEP] the welsh assembly council voted last night in a bid [SEP]
+
+===== sample 053 =====
+[CLS] in the european parliament. [SEP] talk about its growth. [SEP] the election will be close. [SEP] (ap) - fred couples had a total of 37 holes sunday in the first round at bay hill country club classic, where the 23 - year - old two - time masters champion was missing a shot from the rough spot in which he nearly doubled his six - stroke playoff lead. [SEP] teacher mike todd, from leeds, died after being crushed to death on the m40 train in bradford, north west yorkshire. [SEP] wanderers players john northgate and tony mcnaw will work with burnley as part of sir iannap's team [SEP]
+
+===== sample 054 =====
+[CLS] in our own history, "obama said. [SEP] the price of yield on the us 10 - year treasury bill meanwhile dropped to 10. 00 % from 9. 00 %. [SEP] he was m. l. a. with the skills he needed to access finance in college. [SEP] the whole goal of english rugby has become the public interest in british football in the past four years, and unfairly it remains the subject for angst in sport. [SEP] ms maclornoy said:" i am very interested to contesting in this role. [SEP] of course he'd be willing to vote for obama in washington, dc, [SEP]
+
+===== sample 055 =====
+[CLS]r. [SEP] the number of american fatalities in iraq and afghanistan last year jumped 18 percent more than a decade, according to a national pentagon estimate of just over 10 years. [SEP] mr brown's decision to resign from the post is well - known, considering his wife was an election worker. [SEP] the mps will ask the party to criticize mugabe's party if the government is seeking to get zimbabwe's help, and so will the opposition. [SEP] however, bohori agreed that the impact of this real economy is much longer than anticipated. [SEP] china is seen as a great platform for improved relations - - beyond diplomatic [SEP]
+
+===== sample 056 =====
+[CLS]. [SEP] it will take over a week to recover and we are still talking to the people, "he said. [SEP] the turkish government has criticized fatah's refusal to hold talks, saying it threatens the west bank's future sovereignty. [SEP] china's office insisted that the deal was not an" easy and substantive agreement. [SEP] don't be wondering how you were dumbed with the position. [SEP] " but i can hear a lot about the media, there's the media talk about job job cuts, i know i'm happening this time of year and i think that i've just got some light [SEP]
+
+===== sample 057 =====
+[CLS] of the council on energy responsibility and regulatory policy on energy issues related to and to energy and infrastructure. [SEP] those who tend to be at higher risk of being over - 65 and more than those with no children being obese. [SEP] dan: i don't think much about parking guns on the bus.. [SEP] the conservatives, seen as one of the most influential campaigners in the world of political affairs, said: " the public really wants to have a new party to promote its own political reforms and it's important to have a future government that has its place in the political arena. [SEP] london/brussels ( reuters life [SEP]
+
+===== sample 058 =====
+[CLS] is optimistic about the challenge and suggested it would be too hard to work out how he would clinch the victory. [SEP] los angeles, california (cnn) - - the redis have announced the winners of the u. s. pga golf association world championship - - arguably the sport's highest honor. [SEP] year 2008 - - us $1. 5 million when compared to the year. and us $3 million in gross profit. revenue for the first half of 2008 compared to us $377. 5 million for the same period in 2007. [SEP] nearly two years ago, the u. s. space industry published a survey of [SEP]
+
+===== sample 059 =====
+[CLS] driver, a race driver and a skilled vet technician who can make a race, only to leave the circuit. [SEP] it's not just to stress we're human, and to try to make clear to us that we are not going to tell you anything about ourselves what to do. [SEP] it was the coldst dry year on record in the united states since the 1970s. [SEP] the government is considering overhauling the extra century of nursery school testing that has helped more than 200, 000 school pupils. [SEP] but head coach bob schalke says it's time to start work, but not to go away. [SEP] two [SEP]
+
+===== sample 060 =====
+[CLS] health agenda during president barack obama's health care summit tuesday. [SEP] it was moving toward china on wednesday when it was headed for the north american border, where taiwan and china, according to u. s. i. c., most of its air traffic from asian countries. [SEP] the results may be part of a high level of risk seen during hospitalization, said a senior u. s. official after the who gave a report to the federal health department on wednesday. [SEP] but some lawmakers in the house say they believe the legislation still should be passed and allow congress to come out again, and others say they need not [SEP]
+
+===== sample 061 =====
+[CLS] was george's wife. [SEP] this article was first published on guardian. co. uk at 07. 05 bst on wednesday 28 may 2009. [SEP] the u. s. president, left on an official visit to beijing tuesday with president obama, in a sign of mutual agreement between india and china who have been divided over beijing's goal of tibetan independence. [SEP] at a new record london stock price of $1. 5bn, and a value of $1. 6bn, as of july 31, 2009 it was worth about £83, 000, almost twice as much as its price of £187m [SEP]
+
+===== sample 062 =====
+[CLS] years ago and would gravitate to pay money back home again. [SEP] you should do everything that you wanted to do - - and that's what the m. i. did. [SEP] the rate of salary increases rises above that of the average 65, those earning more than £165, 000, while the payments to start - a - level parents who earn around £38, 000 a year rise £142, 000 a week. [SEP] the court heard the husband, sean mcnicran, 27, from leeds, and his wife, carol, 27, from blidis, birmingham, just miles away from birmingham, [SEP]
+
+===== sample 063 =====
+[CLS] months in july 2008. [SEP] i don't "the report was quoted as saying. [SEP] as to a particularly high - profile health care plan, he never said enough is not enough, with illinois sen. barack obama trying to talk about the patient, who would show up before his speech in february. [SEP] then, going to the right, especially on the left. [SEP]" it certainly is jarring to hear out john rodley's state - of - the - art. [SEP] a greater manchester man who fell into a river has been arrested over his claim of having the woman's body slashed four times. [SEP] in [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_diffusion_noise_steps_128steps_n64/noise_linear2to08_mid_sine_eta0p05_c256_scored.jsonl

@@ -0,0 +1,65 @@
+{"type": "summary", "name": "noise_linear2to08_mid_sine_eta0p05_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "noise_linear2to08_mid_sine_eta0p05_c256", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.05, "eta_schedule": "mid_sine", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 49.82670395081913, "nll_per_token": 3.90855106422597, "tokens": 9587}, "diversity": {"sample_entropy": 4.223790486496133, "unique_tokens": 1959, "token_count": 8192, "distinct_1": 0.2391357421875, "distinct_2": 0.7219488188976378, "top_token_mass": 0.051025390625}}
+{"type": "sample", "index": 0, "raw_text": "[CLS] snowing and slashing incidents in march last year. [SEP] according to reuters estimates, reuters data showed net profit increased slightly to 5. 547 billion euros ( $ 6. 9 billion ) from 5. 27 billion in the period a year earlier. [SEP] police and search and rescue officials have found three bodies in china, nine killed and one missing, while several hundred others remained missing in southern china as the authorities continued to unload on sunday. [SEP] clinton called the post - start talks a major milestone for improved relations with russia. [SEP] new york ' s main crude oil futures fell 2. 4 percent to $ 1. 048 [SEP]", "detok_text": "[CLS] snowing and slashing incidents in march last year. [SEP] according to reuters estimates, reuters data showed net profit increased slightly to 5. 547 billion euros ($6. 9 billion) from 5. 27 billion in the period a year earlier. [SEP] police and search and rescue officials have found three bodies in china, nine killed and one missing, while several hundred others remained missing in southern china as the authorities continued to unload on sunday. [SEP] clinton called the post - start talks a major milestone for improved relations with russia. [SEP] new york's main crude oil futures fell 2. 4 percent to $1. 048 [SEP]"}
+{"type": "sample", "index": 1, "raw_text": "[CLS], \" said istahiy ketamo, the main opposition leader and deputy minister of the opposition democratic league. [SEP] the leaders have said they wanted to reach the end of the current talks in geneva. [SEP] john mccain, his campaign adviser, said obama made the decision to do it. [SEP] clegg, the interior minister two years ago, was made head of the post at the ministry of defence. [SEP] but in august, obama said that the communist party is prepared to pursue such talks, and will hold high - level meetings, administration officials said. [SEP] for more information on iridium, visit the web site www [SEP]", "detok_text": "[CLS], \" said istahiy ketamo, the main opposition leader and deputy minister of the opposition democratic league. [SEP] the leaders have said they wanted to reach the end of the current talks in geneva. [SEP] john mccain, his campaign adviser, said obama made the decision to do it. [SEP] clegg, the interior minister two years ago, was made head of the post at the ministry of defence. [SEP] but in august, obama said that the communist party is prepared to pursue such talks, and will hold high - level meetings, administration officials said. [SEP] for more information on iridium, visit the web site www [SEP]"}
+{"type": "sample", "index": 2, "raw_text": "[CLS] wouldn ' t do it if we went to half a mile and say : i ' m on the road, i ' ll feel the pain. [SEP] its fate will be the final challenge to gm. [SEP] the sector is now averaging 2. 5 days per person - - £9, 842. [SEP] don ' t know what that means. [SEP] the federal government accounts for around a quarter of the state ' s infrastructure funding. [SEP] the ministry said in a statement that the country ' s central government and parliament had to convene to discuss national tax policy to investigate key causes and issues. [SEP] it ' s a long time [SEP]", "detok_text": "[CLS] wouldn't do it if we went to half a mile and say: i'm on the road, i'll feel the pain. [SEP] its fate will be the final challenge to gm. [SEP] the sector is now averaging 2. 5 days per person - - £9, 842. [SEP] don't know what that means. [SEP] the federal government accounts for around a quarter of the state's infrastructure funding. [SEP] the ministry said in a statement that the country's central government and parliament had to convene to discuss national tax policy to investigate key causes and issues. [SEP] it's a long time [SEP]"}
+{"type": "sample", "index": 3, "raw_text": "[CLS] industry to go bust, foreign investors had to pay for that money, and the world was really stinking. [SEP] i ' ve made friends and i think she ' ll be that close. [SEP] the liberals garnered more than 70 % of mr sverl ' s votes in the eu ' s only state of the union. [SEP] the measures, projected at ages 2 - 15 f tall, will do show that there is a political problem in france. [SEP] he spoke to the foreign office agency several months ago and held subsequent meetings with the president, the director of national intelligence, michael evans, chairman of the ukc, and tony [SEP]", "detok_text": "[CLS] industry to go bust, foreign investors had to pay for that money, and the world was really stinking. [SEP] i've made friends and i think she'll be that close. [SEP] the liberals garnered more than 70 % of mr sverl's votes in the eu's only state of the union. [SEP] the measures, projected at ages 2 - 15 f tall, will do show that there is a political problem in france. [SEP] he spoke to the foreign office agency several months ago and held subsequent meetings with the president, the director of national intelligence, michael evans, chairman of the ukc, and tony [SEP]"}
+{"type": "sample", "index": 4, "raw_text": "[CLS] $ 200m, with government grants to help poor people. [SEP] 8 ( upi ) - - mexican immigration officials said they have reached a formal agreement with u. s. immigration authorities to block illegal immigrants from returning to china from mexico after last week ' s earthquake. [SEP] it seems like the problem is that the people - - like me - - lose my life. [SEP] us president george bush on wednesday ' s first meeting since resorting to a vote on the north korea treaty is expected to pass his proposal to the white house later this week. [SEP] but after years of negotiations with the army, the opposition group known as pro [SEP]", "detok_text": "[CLS] $200m, with government grants to help poor people. [SEP] 8 (upi) - - mexican immigration officials said they have reached a formal agreement with u. s. immigration authorities to block illegal immigrants from returning to china from mexico after last week's earthquake. [SEP] it seems like the problem is that the people - - like me - - lose my life. [SEP] us president george bush on wednesday's first meeting since resorting to a vote on the north korea treaty is expected to pass his proposal to the white house later this week. [SEP] but after years of negotiations with the army, the opposition group known as pro [SEP]"}
+{"type": "sample", "index": 5, "raw_text": "[CLS] automotive parts, electronics, and industrial products. approximately 877 countries and represented almost 60 percent of its u. s. retail sales since june 2008. [SEP] a 28 - year - old foreclosure expert charged in a heart attack killed two young children, two teenage, and three children were rescued from a car park in birmingham. [SEP] obama ' s 35 years younger than mccain in the presidency of clinton, but otherwise he would be trying to move into the old hands of the 2008 campaign. [SEP] the white house said wednesday that economic growth in u. s. dollars was down to 2. 3 percent. [SEP] eu officials blame [SEP]", "detok_text": "[CLS] automotive parts, electronics, and industrial products. approximately 877 countries and represented almost 60 percent of its u. s. retail sales since june 2008. [SEP] a 28 - year - old foreclosure expert charged in a heart attack killed two young children, two teenage, and three children were rescued from a car park in birmingham. [SEP] obama's 35 years younger than mccain in the presidency of clinton, but otherwise he would be trying to move into the old hands of the 2008 campaign. [SEP] the white house said wednesday that economic growth in u. s. dollars was down to 2. 3 percent. [SEP] eu officials blame [SEP]"}
+{"type": "sample", "index": 6, "raw_text": "[CLS] cities, and where there ' s an issue of violence, \" she said, citing a rising number of youth suicide attacks, which was trying to prevent gay trafficking. [SEP] it ' s a call to the people of gaza. [SEP] i ' d rather see the unknown joe guy sitting in a corner with his hands near the ball, sticking up his shirt. [SEP] people in the last couple of months have endured months of political and national conflict. [SEP] the campaign also said that more prominent republicans were likely to side with clinton, while making sure iowa voters make a choice. [SEP] \" at the end of the course of the training, we [SEP]", "detok_text": "[CLS] cities, and where there's an issue of violence, \"she said, citing a rising number of youth suicide attacks, which was trying to prevent gay trafficking. [SEP] it's a call to the people of gaza. [SEP] i'd rather see the unknown joe guy sitting in a corner with his hands near the ball, sticking up his shirt. [SEP] people in the last couple of months have endured months of political and national conflict. [SEP] the campaign also said that more prominent republicans were likely to side with clinton, while making sure iowa voters make a choice. [SEP]\" at the end of the course of the training, we [SEP]"}
+{"type": "sample", "index": 7, "raw_text": "[CLS] patricia cley, his wife, and eric mcmlin, assistant manager of the park. [SEP] police arrested a white man who pulled out of a vehicle after fatally shooting a gunman while his friend was out on his school trip. [SEP] the win paid off the second - ranked red wings ( 24 - 13 ) to finish seventh in western conference history, two points ahead of the red wings conference. [SEP] but consumers are saving up spending their money to buy their cars. [SEP] a police rail spokesman said the man was called to the school at about 2235 gmt thursday on a two - way road near south edgerton road. [SEP]", "detok_text": "[CLS] patricia cley, his wife, and eric mcmlin, assistant manager of the park. [SEP] police arrested a white man who pulled out of a vehicle after fatally shooting a gunman while his friend was out on his school trip. [SEP] the win paid off the second - ranked red wings (24 - 13) to finish seventh in western conference history, two points ahead of the red wings conference. [SEP] but consumers are saving up spending their money to buy their cars. [SEP] a police rail spokesman said the man was called to the school at about 2235 gmt thursday on a two - way road near south edgerton road. [SEP]"}
+{"type": "sample", "index": 8, "raw_text": "[CLS] be broadcast on sky sport wales on bbc1. [SEP] why don ' t you give your kids a full year before the holidays? [SEP] he said his country must seek political change and national reconciliation and his country that it is fighting a civil war before the end of a new era of democracy after thousands of years of war, economic and economic civil wars. [SEP] however, kemerle said he didn ' t see an end to the violence. [SEP] it ' s important to think about this important process. [SEP] those without the major knowledge in the course will have to attend a brief conference or a loose - ended strategy session with the chinese [SEP]", "detok_text": "[CLS] be broadcast on sky sport wales on bbc1. [SEP] why don't you give your kids a full year before the holidays? [SEP] he said his country must seek political change and national reconciliation and his country that it is fighting a civil war before the end of a new era of democracy after thousands of years of war, economic and economic civil wars. [SEP] however, kemerle said he didn't see an end to the violence. [SEP] it's important to think about this important process. [SEP] those without the major knowledge in the course will have to attend a brief conference or a loose - ended strategy session with the chinese [SEP]"}
+{"type": "sample", "index": 9, "raw_text": "[CLS] local website, zk. com. [SEP] instead, they said, the news of the housing slump will be seen as a call on the white house and the public to help rescue the rest of the country. [SEP] but if markets do fall, it ' s probably time for local courts to take the decision to intervene. [SEP] the total balance of £18bn came from risk assets and neted an investment of £64bn in the bank ' s debt at the end of 2008. [SEP] the cleric was arrested in friday and had been held for 14 days, the central news agency reported. [SEP] as president george w. bush [SEP]", "detok_text": "[CLS] local website, zk. com. [SEP] instead, they said, the news of the housing slump will be seen as a call on the white house and the public to help rescue the rest of the country. [SEP] but if markets do fall, it's probably time for local courts to take the decision to intervene. [SEP] the total balance of £18bn came from risk assets and neted an investment of £64bn in the bank's debt at the end of 2008. [SEP] the cleric was arrested in friday and had been held for 14 days, the central news agency reported. [SEP] as president george w. bush [SEP]"}
+{"type": "sample", "index": 10, "raw_text": "[CLS]g announced that he had wanted to help in the private sector, as labour ' s backben seized on the idea that the national government must provide health care and other financial services to keep in its annual budget. [SEP] during his political career, he attended the university of georgia, became an attorney and held a master ' s degree in marketing at the university of chicago, as well as a master ' s in law degree at indiana university. [SEP] the russian foreign ministry will visit moscow later on tuesday to discuss improving diplomatic relations with russia, which suspended the conflict since the end to the 4 - year august war in georgia, the eu said [SEP]", "detok_text": "[CLS]g announced that he had wanted to help in the private sector, as labour's backben seized on the idea that the national government must provide health care and other financial services to keep in its annual budget. [SEP] during his political career, he attended the university of georgia, became an attorney and held a master's degree in marketing at the university of chicago, as well as a master's in law degree at indiana university. [SEP] the russian foreign ministry will visit moscow later on tuesday to discuss improving diplomatic relations with russia, which suspended the conflict since the end to the 4 - year august war in georgia, the eu said [SEP]"}
+{"type": "sample", "index": 11, "raw_text": "[CLS] said the us federal reserve ' s director of financial stability, lawrence yun, on how to recoup tarp funds. [SEP] and i just like this kind of film, knowing that the kind of thing that is going to has to be really worked out of. [SEP] the obama administration is expected to say that the timetable for negotiations is modest in its commitment to scrap the unilateral strategy already pushed by barack obama. [SEP] the study was completed years before this. [SEP] the bank sold on nearly £240 billion of losses in its £5 billion of assets in december last year, with a net sale and repricing of £1 [SEP]", "detok_text": "[CLS] said the us federal reserve's director of financial stability, lawrence yun, on how to recoup tarp funds. [SEP] and i just like this kind of film, knowing that the kind of thing that is going to has to be really worked out of. [SEP] the obama administration is expected to say that the timetable for negotiations is modest in its commitment to scrap the unilateral strategy already pushed by barack obama. [SEP] the study was completed years before this. [SEP] the bank sold on nearly £240 billion of losses in its £5 billion of assets in december last year, with a net sale and repricing of £1 [SEP]"}
+{"type": "sample", "index": 12, "raw_text": "[CLS] one - year high and still far bigger than it was in 2009, and amid the global availability of international collectibles. [SEP] bolsman has said his family won ' t be surprised. [SEP] because we ' re going to look at people who lack good medical knowledge, children ' s views just don ' t make them. [SEP] tehran, iran ( ap ) - a u. n. spokesman confirms iran worked on the nuclear program, but tehran insists it has told western countries not to discuss the issue. [SEP] the court heard admitted killing john hughes, of darley, on april 17, 2005, and mr moore, 17 [SEP]", "detok_text": "[CLS] one - year high and still far bigger than it was in 2009, and amid the global availability of international collectibles. [SEP] bolsman has said his family won't be surprised. [SEP] because we're going to look at people who lack good medical knowledge, children's views just don't make them. [SEP] tehran, iran (ap) - a u. n. spokesman confirms iran worked on the nuclear program, but tehran insists it has told western countries not to discuss the issue. [SEP] the court heard admitted killing john hughes, of darley, on april 17, 2005, and mr moore, 17 [SEP]"}
+{"type": "sample", "index": 13, "raw_text": "[CLS] to be a target, \" said adelman. [SEP] you can see the courtyards and driveways and fells of peaks and forests that get the feeling for you that it ' s all that bad and that you feel this is the best place. [SEP] muddisbe claims the player is on a salary of £1. 2 million per month, but says he was \" at his best age, \" and has stuck with his assertion that he is \" the best player in class. \" [SEP] the u. s. l. a. a. tournament was ranked no. 2 overall, and west virginia needed a win over another [SEP]", "detok_text": "[CLS] to be a target, \"said adelman. [SEP] you can see the courtyards and driveways and fells of peaks and forests that get the feeling for you that it's all that bad and that you feel this is the best place. [SEP] muddisbe claims the player is on a salary of £1. 2 million per month, but says he was\" at his best age, \"and has stuck with his assertion that he is\" the best player in class. \" [SEP] the u. s. l. a. a. tournament was ranked no. 2 overall, and west virginia needed a win over another [SEP]"}
+{"type": "sample", "index": 14, "raw_text": "[CLS] ' s owner and general manager. [SEP] robert kim, a senior chinese diplomat for asia, said that the north also would be trying to boost ties with the us and south korea. [SEP] however, mr. brown did declines to say how long it will be his administration. [SEP] he was also a leading officer in education policy at the centre of modern education in the 20th century. [SEP] dr garoff has also expressed fears that more people would go to the disease. [SEP] president carter asked clinton and others to meet at a regular level, including sir john michael benn, the defence secretary, and lieutenant general john hoon, the [SEP]", "detok_text": "[CLS]'s owner and general manager. [SEP] robert kim, a senior chinese diplomat for asia, said that the north also would be trying to boost ties with the us and south korea. [SEP] however, mr. brown did declines to say how long it will be his administration. [SEP] he was also a leading officer in education policy at the centre of modern education in the 20th century. [SEP] dr garoff has also expressed fears that more people would go to the disease. [SEP] president carter asked clinton and others to meet at a regular level, including sir john michael benn, the defence secretary, and lieutenant general john hoon, the [SEP]"}
+{"type": "sample", "index": 15, "raw_text": "[CLS] chairman of the ruling democratic party and labor party said wednesday. [SEP] at a recent appearance of the joint chiefs of staff, he tried to pressure the nation into believing huckabee was a leader and wanted to change course. [SEP] the liberal leader nick clegg there is strong backing of the plans to allow the town to support football development for football pools. [SEP] however, van kroen and his wife, marina, would probably not want to join arsenal. [SEP] tibetan bloggers said friday heavy fighting this week in the tibetan area near the border with chinaah, in southern china with the group of chinese troops. [SEP] the [SEP]", "detok_text": "[CLS] chairman of the ruling democratic party and labor party said wednesday. [SEP] at a recent appearance of the joint chiefs of staff, he tried to pressure the nation into believing huckabee was a leader and wanted to change course. [SEP] the liberal leader nick clegg there is strong backing of the plans to allow the town to support football development for football pools. [SEP] however, van kroen and his wife, marina, would probably not want to join arsenal. [SEP] tibetan bloggers said friday heavy fighting this week in the tibetan area near the border with chinaah, in southern china with the group of chinese troops. [SEP] the [SEP]"}
+{"type": "sample", "index": 16, "raw_text": "[CLS] to new york in 1959. [SEP] his father, john duddier, had three touchdown receptions this season. [SEP] well, not saying that \" lost \" was the full story of my life in politics. [SEP] the conference also is likely to include environmental and urban intreification and advocacy workshops, where residents and local business leaders urge them to learn more about water conservation and sustainability. [SEP] yields on 10 - year us treasury rose 4. 6 per cent or 0. 4 per cent to 3. 452, while the british pound dropped 0. 6 per cent to 2. 0305 against the pound. [SEP] and the legal [SEP]", "detok_text": "[CLS] to new york in 1959. [SEP] his father, john duddier, had three touchdown receptions this season. [SEP] well, not saying that \"lost\" was the full story of my life in politics. [SEP] the conference also is likely to include environmental and urban intreification and advocacy workshops, where residents and local business leaders urge them to learn more about water conservation and sustainability. [SEP] yields on 10 - year us treasury rose 4. 6 per cent or 0. 4 per cent to 3. 452, while the british pound dropped 0. 6 per cent to 2. 0305 against the pound. [SEP] and the legal [SEP]"}
+{"type": "sample", "index": 17, "raw_text": "[CLS] open to the public in september. [SEP] \" it ' s been part of the process, the people were saying it today, they did it with me and i thought, ' well, if you don ' t think about that, you know, you ' re just trying to look like the guys. ' [SEP] my mind is that you can think he ' s a messiah, and, of course, that is who he goes down on and what he ' s doing. [SEP] do the same for you? [SEP] \" anybody who has made this movie will come out at the same time to join it. [SEP] the national film festival, [SEP]", "detok_text": "[CLS] open to the public in september. [SEP] \"it's been part of the process, the people were saying it today, they did it with me and i thought, ' well, if you don't think about that, you know, you're just trying to look like the guys. ' [SEP] my mind is that you can think he's a messiah, and, of course, that is who he goes down on and what he's doing. [SEP] do the same for you? [SEP]\" anybody who has made this movie will come out at the same time to join it. [SEP] the national film festival, [SEP]"}
+{"type": "sample", "index": 18, "raw_text": "[CLS], north london, and his p & c partner, spent 10 years in poland, poland and italy with a degree in finance in 2004. [SEP] in addition to being a common man, he will be redknapp ' s main concern. [SEP] the united states has gone to china since last month and has said its broader anti - china ties reflects a new level of engagement with the new leader of the european union, said mark pillion, director of the china development program at johns hopkins military college. [SEP] more important, ambition and superficiality, the g8 now maintains its own sense of civility of mass market power. [SEP]", "detok_text": "[CLS], north london, and his p & c partner, spent 10 years in poland, poland and italy with a degree in finance in 2004. [SEP] in addition to being a common man, he will be redknapp's main concern. [SEP] the united states has gone to china since last month and has said its broader anti - china ties reflects a new level of engagement with the new leader of the european union, said mark pillion, director of the china development program at johns hopkins military college. [SEP] more important, ambition and superficiality, the g8 now maintains its own sense of civility of mass market power. [SEP]"}
+{"type": "sample", "index": 19, "raw_text": "[CLS] enforcement agency has said that law enforcement agencies are trying to reach agreement on the matter, though authorities say it is unusual for the federal state to spend $ 1. 4 million on the issue. [SEP] the final decision has been reached on the ballot. [SEP] use the universal system and connect to apple ' s smartphones - - any 3g is such important information. [SEP] beijing ( reuters ) - chinese troops fired riot gas on tibetan independence movement protesters in lhasa in western china on friday, in the height of a pro - chinese anti - government riots in lhasa on monday. [SEP] she would not like to save rafa [SEP]", "detok_text": "[CLS] enforcement agency has said that law enforcement agencies are trying to reach agreement on the matter, though authorities say it is unusual for the federal state to spend $1. 4 million on the issue. [SEP] the final decision has been reached on the ballot. [SEP] use the universal system and connect to apple's smartphones - - any 3g is such important information. [SEP] beijing (reuters) - chinese troops fired riot gas on tibetan independence movement protesters in lhasa in western china on friday, in the height of a pro - chinese anti - government riots in lhasa on monday. [SEP] she would not like to save rafa [SEP]"}
+{"type": "sample", "index": 20, "raw_text": "[CLS] within a week...... what would you think of that? [SEP] i ask you those people who are legally knowledgeable to make a decision ahead of time to do business out of office, and need condits to huwbut media and social media supporters? [SEP] i don ' t know, but he ' s going to be asked about that. [SEP] the children ' s mother ' s family became children ' s attorney father jo john and her father, james paul james, when they lost an abuse case in 2001. [SEP] apparently, the only way to know how you feel as pain as possible is to [SEP]", "detok_text": "[CLS] within a week...... what would you think of that? [SEP] i ask you those people who are legally knowledgeable to make a decision ahead of time to do business out of office, and need condits to huwbut media and social media supporters? [SEP] i don't know, but he's going to be asked about that. [SEP] the children's mother's family became children's attorney father jo john and her father, james paul james, when they lost an abuse case in 2001. [SEP] apparently, the only way to know how you feel as pain as possible is to [SEP]"}
+{"type": "sample", "index": 21, "raw_text": "[CLS] health service, said that mrs bush would not travel at the time. [SEP] the springbok ' s director of rugby, jay klagger, spoke at a news conference after the second match, after meeting with former players and managers, and said that it was more than good to start over. [SEP] but that short - term money is being needed to develop large hybrid and electric vehicles, commercial - scale projects that could create hundreds of millions of jobs. [SEP] as for gm, the union agreed last month to help, but the company has no details. [SEP] four days later mourinho ' s inter milan team were replaced [SEP]", "detok_text": "[CLS] health service, said that mrs bush would not travel at the time. [SEP] the springbok's director of rugby, jay klagger, spoke at a news conference after the second match, after meeting with former players and managers, and said that it was more than good to start over. [SEP] but that short - term money is being needed to develop large hybrid and electric vehicles, commercial - scale projects that could create hundreds of millions of jobs. [SEP] as for gm, the union agreed last month to help, but the company has no details. [SEP] four days later mourinho's inter milan team were replaced [SEP]"}
+{"type": "sample", "index": 22, "raw_text": "[CLS] bank of america corp. executives wrote to the bank of america board wednesday as they tried to thrash out the details of the u. s. government ' s proposed financial regulation. [SEP] but today, haiti ' s people are sitting just behind them. [SEP] he has a long record of public service, his wife, father and wife of a marriage and children. [SEP] president obama ' s team said its efforts to rescue some banks were under way on monday after days of his days failed to convince countries to revamp their laws and financial regulation, although he said they need an international solution. [SEP] after a night of a heavy rain, their [SEP]", "detok_text": "[CLS] bank of america corp. executives wrote to the bank of america board wednesday as they tried to thrash out the details of the u. s. government's proposed financial regulation. [SEP] but today, haiti's people are sitting just behind them. [SEP] he has a long record of public service, his wife, father and wife of a marriage and children. [SEP] president obama's team said its efforts to rescue some banks were under way on monday after days of his days failed to convince countries to revamp their laws and financial regulation, although he said they need an international solution. [SEP] after a night of a heavy rain, their [SEP]"}
+{"type": "sample", "index": 23, "raw_text": "[CLS] year - old woman and her younger, 16 - year - old in south carolina. [SEP] the study found that older children opting to have children to play, both younger adults and children age 14, were using the web and were most likely to spend more time with partners. [SEP] the election complicates the role of the un, \" said eric shinseki, the spokesman. [SEP] during the same period of 2007 last year, 15. 5 percent of total traffic online attracted a total of 4. 4 million subscribers. [SEP] the group has also announced a new rights issue to raise about £60 million to raise £4 [SEP]", "detok_text": "[CLS] year - old woman and her younger, 16 - year - old in south carolina. [SEP] the study found that older children opting to have children to play, both younger adults and children age 14, were using the web and were most likely to spend more time with partners. [SEP] the election complicates the role of the un, \" said eric shinseki, the spokesman. [SEP] during the same period of 2007 last year, 15. 5 percent of total traffic online attracted a total of 4. 4 million subscribers. [SEP] the group has also announced a new rights issue to raise about £60 million to raise £4 [SEP]"}
+{"type": "sample", "index": 24, "raw_text": "[CLS] [SEP] obama has turned to democratic national co., who opposed the u. s. - china war, refusing to be part of clinton ' s claim that china should be blamed for the foreign policies of the former u. s. senator. [SEP] in an interview with vice president hu jin, chinese premier myung - bak urged the south and the communist state to coordinate closely. [SEP] michael brodeau, director of china policy at the national institute for near east policy and donald s. pilko, a professor in new brunswick, n. j., and the chairman of the national security administration ' s asia program. [SEP]", "detok_text": "[CLS] [SEP] obama has turned to democratic national co., who opposed the u. s. - china war, refusing to be part of clinton's claim that china should be blamed for the foreign policies of the former u. s. senator. [SEP] in an interview with vice president hu jin, chinese premier myung - bak urged the south and the communist state to coordinate closely. [SEP] michael brodeau, director of china policy at the national institute for near east policy and donald s. pilko, a professor in new brunswick, n. j., and the chairman of the national security administration's asia program. [SEP]"}
+{"type": "sample", "index": 25, "raw_text": "[CLS] of eye - watering. [SEP] it ' s not fair to hear about senator mccain ' s intellectual credentials. [SEP] \" but no, there ' s no question of this law, and if bush and mccain claim that there is a kind of short - term policy, then the campaign is still waiting for all the kick - off that spews out. [SEP] one of the most important data is expected sales decline over the next three to 10 years. [SEP] a few people are still be dashing into the streets. [SEP] the local railway line was called to cardiff valley centre in gwyth, near wales, by south wales fire service [SEP]", "detok_text": "[CLS] of eye - watering. [SEP] it's not fair to hear about senator mccain's intellectual credentials. [SEP] \" but no, there's no question of this law, and if bush and mccain claim that there is a kind of short - term policy, then the campaign is still waiting for all the kick - off that spews out. [SEP] one of the most important data is expected sales decline over the next three to 10 years. [SEP] a few people are still be dashing into the streets. [SEP] the local railway line was called to cardiff valley centre in gwyth, near wales, by south wales fire service [SEP]"}
+{"type": "sample", "index": 26, "raw_text": "[CLS] to earn a victory in the draft 40 - team draft. [SEP] white house press secretary robert gibbs said : \" president barack obama has the go - ahead to attend the meeting as prime minister this morning. [SEP] finance secretary minister gordon brown rejected the idea saying that the government must provide financial support for companies with bad debts. [SEP] \" you would think it ' s absolutely going to go wrong, but but it ' s clear that 2010 is going to be a good year. [SEP] she ' s a real person of mine, knows what to do that day and went on to see what music is like all this time. [SEP] although ferguson played [SEP]", "detok_text": "[CLS] to earn a victory in the draft 40 - team draft. [SEP] white house press secretary robert gibbs said: \"president barack obama has the go - ahead to attend the meeting as prime minister this morning. [SEP] finance secretary minister gordon brown rejected the idea saying that the government must provide financial support for companies with bad debts. [SEP]\" you would think it's absolutely going to go wrong, but but it's clear that 2010 is going to be a good year. [SEP] she's a real person of mine, knows what to do that day and went on to see what music is like all this time. [SEP] although ferguson played [SEP]"}
+{"type": "sample", "index": 27, "raw_text": "[CLS] said committee chairman james hall. [SEP] ( nasdaq : lwrc ), a prudential advisory firm, is highly recognized and best known for its diverse investment analysis and expertise for investment, investment management and successful capital management. [SEP] on the scale of the lloyd ' s announcement, tsb chief executive charles mcginley said that the markets crisis saw the bank ' s liquidity position be dented \" due to the financial crisis \" in 2008. [SEP] and it ' s good sense of the real business again. [SEP] new york ( ap ) - - oil prices reached below $ 75 friday as the country continues to struggle [SEP]", "detok_text": "[CLS] said committee chairman james hall. [SEP] (nasdaq: lwrc), a prudential advisory firm, is highly recognized and best known for its diverse investment analysis and expertise for investment, investment management and successful capital management. [SEP] on the scale of the lloyd's announcement, tsb chief executive charles mcginley said that the markets crisis saw the bank's liquidity position be dented \"due to the financial crisis\" in 2008. [SEP] and it's good sense of the real business again. [SEP] new york (ap) - - oil prices reached below $75 friday as the country continues to struggle [SEP]"}
+{"type": "sample", "index": 28, "raw_text": "[CLS] business and entrepreneurship. [SEP] many commentators - many in opposition to the bbc radio 4 controller, richard dagan, are calling it \" misforte. \" [SEP] it is time for obama to sink deeper into the philesmonian politics of race, and that while america ' s focus is on the issue on the issues of race and free speech, mr obama will be forced to defend his claim. [SEP] \" it was almost impossible, and i really had the right choice. [SEP] \" what we ' ve done is to increase demand, not to increase demand, not to cut oil prices, \" said japanese oil minister jiabao [SEP]", "detok_text": "[CLS] business and entrepreneurship. [SEP] many commentators - many in opposition to the bbc radio 4 controller, richard dagan, are calling it \"misforte.\" [SEP] it is time for obama to sink deeper into the philesmonian politics of race, and that while america's focus is on the issue on the issues of race and free speech, mr obama will be forced to defend his claim. [SEP] \"it was almost impossible, and i really had the right choice. [SEP]\" what we've done is to increase demand, not to increase demand, not to cut oil prices, \" said japanese oil minister jiabao [SEP]"}
+{"type": "sample", "index": 29, "raw_text": "[CLS], a 31 - year - old pregnant woman and a 50 - year - old man who also escaped from a road safety facility. [SEP] merkel has not returned to the nation ' s highest elected post after she was elected mayor of the 2, 500 member parliament in 1991. [SEP] in the days since usc coach john corrit officially announced plans to replace kiffin, however, barkley ' s tenure has drawn criticism. [SEP] analysts by reuters surveyed estimated 2009 earnings could be about $ 5. 4 billion, up from $ 6. 5 billion of earnings per share this year. [SEP] it ' s not a long time to get [SEP]", "detok_text": "[CLS], a 31 - year - old pregnant woman and a 50 - year - old man who also escaped from a road safety facility. [SEP] merkel has not returned to the nation's highest elected post after she was elected mayor of the 2, 500 member parliament in 1991. [SEP] in the days since usc coach john corrit officially announced plans to replace kiffin, however, barkley's tenure has drawn criticism. [SEP] analysts by reuters surveyed estimated 2009 earnings could be about $5. 4 billion, up from $6. 5 billion of earnings per share this year. [SEP] it's not a long time to get [SEP]"}
+{"type": "sample", "index": 30, "raw_text": "[CLS] annual farmers ' conference in the uk have asked their clients to get the cards back on their return home. [SEP] operating income fell 4. 6 percent last year to around y4. 3 billion ( 1. 5 billion dollars ), the sources said. [SEP] the dollar fell to 6. 10 ( 1 yen ), while the british pound fell to 1. 2 per cent ( 2. 5207 ). [SEP] 18 ( upi ) - - more than 6, 000 adult u. s. teens died of related health injuries last year, according to data released. [SEP] \" i sit forward and say, i ' ve done so [SEP]", "detok_text": "[CLS] annual farmers' conference in the uk have asked their clients to get the cards back on their return home. [SEP] operating income fell 4. 6 percent last year to around y4. 3 billion (1. 5 billion dollars), the sources said. [SEP] the dollar fell to 6. 10 (1 yen), while the british pound fell to 1. 2 per cent (2. 5207). [SEP] 18 (upi) - - more than 6, 000 adult u. s. teens died of related health injuries last year, according to data released. [SEP] \" i sit forward and say, i've done so [SEP]"}
+{"type": "sample", "index": 31, "raw_text": "[CLS] sheffield area school nhs trust, ayreland foundation and sheffield primary school will sign up to a community mental safety bill on 12 january. [SEP] mr cleggcedes that mr cameron has been willing to consider a government - backed plan, having announced six months ago when mr brown said the financial markets were driving the government and government debt issing debt to historic levels with piles of publicly issued debt and that credit - rated lenders are paying more debt. [SEP] it ' s to create its own brand of entertainment - - its system, and they need to win this series, then they need those top three players, then they need [SEP]", "detok_text": "[CLS] sheffield area school nhs trust, ayreland foundation and sheffield primary school will sign up to a community mental safety bill on 12 january. [SEP] mr cleggcedes that mr cameron has been willing to consider a government - backed plan, having announced six months ago when mr brown said the financial markets were driving the government and government debt issing debt to historic levels with piles of publicly issued debt and that credit - rated lenders are paying more debt. [SEP] it's to create its own brand of entertainment - - its system, and they need to win this series, then they need those top three players, then they need [SEP]"}
+{"type": "sample", "index": 32, "raw_text": "[CLS] highest level action on the international circuit. [SEP] the agency ' s program director dan brown, 62, also says the average salary of workers stood at more than $ 8 billion last year and 30 percent on the year before to $ 2, 800 to $ 3, 000 billion this year, the report said thursday. [SEP] the percentage of non - african americans who start in at least one class, rising to about 250, 000, has been racked up by blacks, mostly because of racism. [SEP] \" when the company tries to keep the company going during this year ' s holiday season, i ' ll see the best games going through [SEP]", "detok_text": "[CLS] highest level action on the international circuit. [SEP] the agency's program director dan brown, 62, also says the average salary of workers stood at more than $8 billion last year and 30 percent on the year before to $2, 800 to $3, 000 billion this year, the report said thursday. [SEP] the percentage of non - african americans who start in at least one class, rising to about 250, 000, has been racked up by blacks, mostly because of racism. [SEP] \" when the company tries to keep the company going during this year's holiday season, i'll see the best games going through [SEP]"}
+{"type": "sample", "index": 33, "raw_text": "[CLS] making her the highest - watched day of her time in the hospital. [SEP] security is in the hands of the democratic and republican presidents, senator clinton. [SEP] hun ' s lawyers have no significant interests in china, and his wife has over 30 years of experience in china ' s affairs. [SEP] for public support was 8 % of labour at 16 %, while support for public support was 5 %, to 17 %, 20 % and 19 %. [SEP] philadelphia ( ap ) - the nfl league defended its decision to open a new meadowlands stadium amid concerns about what the union says is a plan today for the site of a major [SEP]", "detok_text": "[CLS] making her the highest - watched day of her time in the hospital. [SEP] security is in the hands of the democratic and republican presidents, senator clinton. [SEP] hun's lawyers have no significant interests in china, and his wife has over 30 years of experience in china's affairs. [SEP] for public support was 8 % of labour at 16 %, while support for public support was 5 %, to 17 %, 20 % and 19 %. [SEP] philadelphia (ap) - the nfl league defended its decision to open a new meadowlands stadium amid concerns about what the union says is a plan today for the site of a major [SEP]"}
+{"type": "sample", "index": 34, "raw_text": "[CLS]. [SEP] it ' s not a tale of two kids, one parent ' s family. [SEP] at a separate meeting in beijing, mr. gates, who will also head the national security council, and william h. welch, u. s. special western diplomat, met with u. s. officials and the chinese government. [SEP] los angeles defensive end corey williams is a close friend of the red raiders, and the seahawks have been silent on the move. [SEP] \" there is a legal crisis, \" president president basilio rajapata told reporters. [SEP] the region ' s most prominent militant group has claimed $ 200m in israel [SEP]", "detok_text": "[CLS]. [SEP] it's not a tale of two kids, one parent's family. [SEP] at a separate meeting in beijing, mr. gates, who will also head the national security council, and william h. welch, u. s. special western diplomat, met with u. s. officials and the chinese government. [SEP] los angeles defensive end corey williams is a close friend of the red raiders, and the seahawks have been silent on the move. [SEP] \"there is a legal crisis,\" president president basilio rajapata told reporters. [SEP] the region's most prominent militant group has claimed $200m in israel [SEP]"}
+{"type": "sample", "index": 35, "raw_text": "[CLS] the virus. [SEP] this is also evidence that the state of the banks has hit much of the uk ' s banking system. [SEP] but people are worried. [SEP] now there are many countries and american countries that have been willing to pay taxes to work since the trade deficit crisis ended in 1990. [SEP] obama is also widely expected to forge a global role in global development, trade and fighting the global financial crisis and urge china to improve its economic ties to fight global change. [SEP] the violence has been seen as worsening repression in china since uighur leaders rejected an ultimatum from an angry official from beijing, following a protest in china at [SEP]", "detok_text": "[CLS] the virus. [SEP] this is also evidence that the state of the banks has hit much of the uk's banking system. [SEP] but people are worried. [SEP] now there are many countries and american countries that have been willing to pay taxes to work since the trade deficit crisis ended in 1990. [SEP] obama is also widely expected to forge a global role in global development, trade and fighting the global financial crisis and urge china to improve its economic ties to fight global change. [SEP] the violence has been seen as worsening repression in china since uighur leaders rejected an ultimatum from an angry official from beijing, following a protest in china at [SEP]"}
+{"type": "sample", "index": 36, "raw_text": "[CLS] members of the ethnic tamil minority, known in sri lanka as tamils and tamils, among them tamils and the ethnic kuks. [SEP] he reported his missing from local authorities in august last year. [SEP] ron smith, 60, said the body of emerson late saturday night and his two friends were to be handed over to family at the hotel late monday. [SEP] the company has assets of more than $ 60 billion and was sold to a second investor after its under debt collapsed in 2009. [SEP] the group has been the world ' s biggest and most profitable automaker with annual sales of nearly 30 billion euros. [SEP] he was arrested [SEP]", "detok_text": "[CLS] members of the ethnic tamil minority, known in sri lanka as tamils and tamils, among them tamils and the ethnic kuks. [SEP] he reported his missing from local authorities in august last year. [SEP] ron smith, 60, said the body of emerson late saturday night and his two friends were to be handed over to family at the hotel late monday. [SEP] the company has assets of more than $60 billion and was sold to a second investor after its under debt collapsed in 2009. [SEP] the group has been the world's biggest and most profitable automaker with annual sales of nearly 30 billion euros. [SEP] he was arrested [SEP]"}
+{"type": "sample", "index": 37, "raw_text": "[CLS] s most valuable job for the national football conference and show he is playing with the 7 - 8 mark under former bills coach john henkerman. [SEP] arthur robinson, 29, picton county, was killed by a mine land mine in poinsettia, georgia in november. [SEP] the figure : the number of banks posted losses of more than $ 60 billion in a full year of september alone, reaching $ 4. 2 billion in september. [SEP] the initial buyout eventually prompted a glut in financing that had brought more bank debt on the market. [SEP] while he said the meeting was about his formality and faith, [SEP]", "detok_text": "[CLS] s most valuable job for the national football conference and show he is playing with the 7 - 8 mark under former bills coach john henkerman. [SEP] arthur robinson, 29, picton county, was killed by a mine land mine in poinsettia, georgia in november. [SEP] the figure: the number of banks posted losses of more than $60 billion in a full year of september alone, reaching $4. 2 billion in september. [SEP] the initial buyout eventually prompted a glut in financing that had brought more bank debt on the market. [SEP] while he said the meeting was about his formality and faith, [SEP]"}
+{"type": "sample", "index": 38, "raw_text": "[CLS]usconi ' s insistence it was \" wrong \" to back the constitution. [SEP] i will almost never get the bill into law, \" said anny schl ettinger, president of the global environment group, a non - profit group that studies environmental climate policy. [SEP] but, though, mr. mccain did not say what president bush said, and he said he would speak with him in saying the same thing. [SEP] those who believed he would beat mr clegg were also wrong at the polls yesterday, with only 24 % believing the tories would do better than the tories would do. [SEP] obama and hillary [SEP]", "detok_text": "[CLS]usconi's insistence it was \"wrong\" to back the constitution. [SEP] i will almost never get the bill into law, \" said anny schl ettinger, president of the global environment group, a non - profit group that studies environmental climate policy. [SEP] but, though, mr. mccain did not say what president bush said, and he said he would speak with him in saying the same thing. [SEP] those who believed he would beat mr clegg were also wrong at the polls yesterday, with only 24 % believing the tories would do better than the tories would do. [SEP] obama and hillary [SEP]"}
+{"type": "sample", "index": 39, "raw_text": "[CLS] of the north indian private gas development corporation. [SEP] at 6ft, 2 stone, mr baker might have been looking into the public eye, but mr clarkson ' s presence looked suspicious. [SEP] it just has to look good. [SEP] \" today we must hope for better, and never better, \" says mr obama ' s national spokesman for china, dai yongbyon. [SEP] \" it ' s like it ' s a closed door, \" she said monday. [SEP] but some say the americans have become under iranian pressure to encourage more dialogue with the west. [SEP] co - ed williams, the center ' s general manager, said the [SEP]", "detok_text": "[CLS] of the north indian private gas development corporation. [SEP] at 6ft, 2 stone, mr baker might have been looking into the public eye, but mr clarkson's presence looked suspicious. [SEP] it just has to look good. [SEP] \"today we must hope for better, and never better,\" says mr obama's national spokesman for china, dai yongbyon. [SEP] \"it's like it's a closed door,\" she said monday. [SEP] but some say the americans have become under iranian pressure to encourage more dialogue with the west. [SEP] co - ed williams, the center's general manager, said the [SEP]"}
+{"type": "sample", "index": 40, "raw_text": "[CLS] [SEP] britain may have needed a degree of caution first, but the new mood of optimism \" is almost going to increase, \" said john cleese, managing director of deloitte. [SEP] nevertheless, she railed at mrs. clinton ' s decision by nearly 1, 000 supporters yesterday, more than a week before victory, to raise the level of democratic support, drawing criticism from the clinton camp. [SEP] you don ' t know all this about america, \" former senator fred thompson said, hoping to make obama ' s point. [SEP] g. m. fell nearly 7 per cent to $ 14. 30, the group reported [SEP]", "detok_text": "[CLS] [SEP] britain may have needed a degree of caution first, but the new mood of optimism \"is almost going to increase,\" said john cleese, managing director of deloitte. [SEP] nevertheless, she railed at mrs. clinton's decision by nearly 1, 000 supporters yesterday, more than a week before victory, to raise the level of democratic support, drawing criticism from the clinton camp. [SEP] you don't know all this about america, \" former senator fred thompson said, hoping to make obama's point. [SEP] g. m. fell nearly 7 per cent to $14. 30, the group reported [SEP]"}
+{"type": "sample", "index": 41, "raw_text": "[CLS] head coach john birkers will point out that howard, 14, and stuckey, both with the local english club, had an impact at a level in the local high school. [SEP] the average house price starts at about $ 30 dollars per month, and up to $ 200, the average price for a strolling from a typical town apartment ranges from $ 10, 000 ( euro7, 200 ) to about $ 1, 000, and up to $ 600 - 5, 000 yuan ( euro62, 400 ). [SEP] and, you will know, right now. [SEP] it was a tale of an afghan - man [SEP]", "detok_text": "[CLS] head coach john birkers will point out that howard, 14, and stuckey, both with the local english club, had an impact at a level in the local high school. [SEP] the average house price starts at about $30 dollars per month, and up to $200, the average price for a strolling from a typical town apartment ranges from $10, 000 (euro7, 200) to about $1, 000, and up to $600 - 5, 000 yuan (euro62, 400). [SEP] and, you will know, right now. [SEP] it was a tale of an afghan - man [SEP]"}
+{"type": "sample", "index": 42, "raw_text": "[CLS] \" i don ' t want to do that work, i don ' t have the power to know what he ' s doing and the way to think about what he ' s doing is just a non - yardage job for the ' dopey, ' \" korris said. [SEP] for more information, call ( 800 ) 333 - 4577. [SEP] the severe snow was reported over the region last weekend at brixton, south wales, brugn - briffon, north halbreane and coeurfa bay. [SEP] by the time you ' re done this will happen ( which goes with [SEP]", "detok_text": "[CLS] \"i don't want to do that work, i don't have the power to know what he's doing and the way to think about what he's doing is just a non - yardage job for the'dopey,'\" korris said. [SEP] for more information, call (800) 333 - 4577. [SEP] the severe snow was reported over the region last weekend at brixton, south wales, brugn - briffon, north halbreane and coeurfa bay. [SEP] by the time you're done this will happen ( which goes with [SEP]"}
+{"type": "sample", "index": 43, "raw_text": "[CLS] struggled to make light of the poor selection problems while sitting with him at the club when he was involved in a running row with alonso at the penalty box last week. [SEP] what do you now make from the film and on tv? [SEP] the complete list of the cases is being released by the united states office of illegal immigration policy. [SEP] biden said it was unrealistically impossible to comment. [SEP] but this is the time that obama ' s campaign needs to be traveling well, and mccain ' s aides are mostly questioning the way he intended to promote mccain ' s campaign ad and his position on lifting the i. t [SEP]", "detok_text": "[CLS] struggled to make light of the poor selection problems while sitting with him at the club when he was involved in a running row with alonso at the penalty box last week. [SEP] what do you now make from the film and on tv? [SEP] the complete list of the cases is being released by the united states office of illegal immigration policy. [SEP] biden said it was unrealistically impossible to comment. [SEP] but this is the time that obama's campaign needs to be traveling well, and mccain's aides are mostly questioning the way he intended to promote mccain's campaign ad and his position on lifting the i. t [SEP]"}
+{"type": "sample", "index": 44, "raw_text": "[CLS] love. [SEP] obama has outlined plans to improve military ties with the u. s. department of defense and national security, and said obama ' s trip would highlight new efforts in japan to develop ties on north korea so the united states can change position on its nuclear issue. [SEP] \" then the coach just waits until you know what to need to win, and maybe that ' s what matters for you, \" mccelson said. [SEP] at the matter of months, in the case mother and sister were arrested, the girl arrived by her father ' s grave, and i wondered what might happened to her at what is likely to be [SEP]", "detok_text": "[CLS] love. [SEP] obama has outlined plans to improve military ties with the u. s. department of defense and national security, and said obama's trip would highlight new efforts in japan to develop ties on north korea so the united states can change position on its nuclear issue. [SEP] \"then the coach just waits until you know what to need to win, and maybe that's what matters for you,\" mccelson said. [SEP] at the matter of months, in the case mother and sister were arrested, the girl arrived by her father's grave, and i wondered what might happened to her at what is likely to be [SEP]"}
+{"type": "sample", "index": 45, "raw_text": "[CLS] the department of public office, capitol and capitol building and the capitol historichouse on pennsylvania avenue. [SEP] marc and i spent two days behind. [SEP] the u. s. government had pledged to support the international trade, along with former u. s. president bill clinton, and defense secretary. [SEP] clinton, the top diplomat for china, was holding a meeting tuesday with the two sides. [SEP] the biggest freezers were conan o ' brien, 20 feet ( 9. 7 million ) and 6 feet ( 10. 3 million pounds ). [SEP] the obama administration has been more critical of the agency ' s role. [SEP] he said the [SEP]", "detok_text": "[CLS] the department of public office, capitol and capitol building and the capitol historichouse on pennsylvania avenue. [SEP] marc and i spent two days behind. [SEP] the u. s. government had pledged to support the international trade, along with former u. s. president bill clinton, and defense secretary. [SEP] clinton, the top diplomat for china, was holding a meeting tuesday with the two sides. [SEP] the biggest freezers were conan o' brien, 20 feet (9. 7 million) and 6 feet (10. 3 million pounds). [SEP] the obama administration has been more critical of the agency's role. [SEP] he said the [SEP]"}
+{"type": "sample", "index": 46, "raw_text": "[CLS] survey results are available on the internet at www. educationglobes. com. [SEP] despite losing the competition, the former all england star said, cricket in golf is becoming an attractive game for many people. [SEP] \" i knew him for only the last few minutes, \" said nadal, who only gave his first name. [SEP] i have never seen it, al - hʼt reported. [SEP] merry - goers, the chancellor, is serving in the german national team under bush, the russian ambassador, and guede van grozier, the former head of central bank, the german bank. [SEP] perry and other [SEP]", "detok_text": "[CLS] survey results are available on the internet at www. educationglobes. com. [SEP] despite losing the competition, the former all england star said, cricket in golf is becoming an attractive game for many people. [SEP] \"i knew him for only the last few minutes,\" said nadal, who only gave his first name. [SEP] i have never seen it, al - hʼt reported. [SEP] merry - goers, the chancellor, is serving in the german national team under bush, the russian ambassador, and guede van grozier, the former head of central bank, the german bank. [SEP] perry and other [SEP]"}
+{"type": "sample", "index": 47, "raw_text": "[CLS] will make provisions for long - term rebuilding. [SEP] those younger than 47, 029 children - - 15 percent of under 30 - - reported no benefits of their relationship with a single parent. [SEP] tim johnson, the former rugby coach and the former principal of coaching at smithfield head school, is married to david davies, head of rugby rugby at hayes college, west london. [SEP] \" as they thought, this was the kind of sporting news i wanted, \" said stephen stentiford, head of the university of queensland, australia ' s school of politics. [SEP] the governor, jeffrey piotr, made a wide - ranging [SEP]", "detok_text": "[CLS] will make provisions for long - term rebuilding. [SEP] those younger than 47, 029 children - - 15 percent of under 30 - - reported no benefits of their relationship with a single parent. [SEP] tim johnson, the former rugby coach and the former principal of coaching at smithfield head school, is married to david davies, head of rugby rugby at hayes college, west london. [SEP] \"as they thought, this was the kind of sporting news i wanted,\" said stephen stentiford, head of the university of queensland, australia's school of politics. [SEP] the governor, jeffrey piotr, made a wide - ranging [SEP]"}
+{"type": "sample", "index": 48, "raw_text": "[CLS] sending military anti - ship technology to iran would be its main means of averting long - term, nuclear conflict with iran. [SEP] investment banks and their capital have soared for more than twice that as new york investors who bought shares in the debt markets. [SEP] he ' s doing little work outside of his school. [SEP] the us prime minister urged china to make it harder for the chinese government to cancel the us trade talks. [SEP] \" it is difficult for me to continue to expect america to use our territory to force its civil rights against china while free - speech is, \" rice said. [SEP] mired in its opening bowl season, [SEP]", "detok_text": "[CLS] sending military anti - ship technology to iran would be its main means of averting long - term, nuclear conflict with iran. [SEP] investment banks and their capital have soared for more than twice that as new york investors who bought shares in the debt markets. [SEP] he's doing little work outside of his school. [SEP] the us prime minister urged china to make it harder for the chinese government to cancel the us trade talks. [SEP] \"it is difficult for me to continue to expect america to use our territory to force its civil rights against china while free - speech is,\" rice said. [SEP] mired in its opening bowl season, [SEP]"}
+{"type": "sample", "index": 49, "raw_text": "[CLS] have a significant number of blacks and hispanics - - 12. 5 percent of them are democrats. [SEP] washington ( ap ) - republican sen. john mccain was elected in illinois thursday, saying he was bitter about the country ' s economic record and voting on climate change in the 2004 presidential primary. [SEP] she was hit into the air as she was attempting to get the car out inside. [SEP] urging the gop to abandon its bipartisan credentials, mccain said that now the country is changing, america is not changing the people. [SEP] the call was started by the local human services council, a group of local muslim councils. [SEP] in [SEP]", "detok_text": "[CLS] have a significant number of blacks and hispanics - - 12. 5 percent of them are democrats. [SEP] washington (ap) - republican sen. john mccain was elected in illinois thursday, saying he was bitter about the country's economic record and voting on climate change in the 2004 presidential primary. [SEP] she was hit into the air as she was attempting to get the car out inside. [SEP] urging the gop to abandon its bipartisan credentials, mccain said that now the country is changing, america is not changing the people. [SEP] the call was started by the local human services council, a group of local muslim councils. [SEP] in [SEP]"}
+{"type": "sample", "index": 50, "raw_text": "[CLS] senate decided friday to hold out for the full scope of the inquiry. [SEP] the previous meetings revolved around japan and china, patching 21st - century differences on trade, jobs, trade and jobs - - to which their leaders could not be a threat. [SEP] he is now working at the pacific primate research center in oakland. [SEP] this is the new - england - owned team that dates back to the early 1960s. [SEP] kostenko, however, said he had not been informed about the government ' s talks and the three men met russia ' s finance commissioner john cedera. [SEP] mr motts said it was \" [SEP]", "detok_text": "[CLS] senate decided friday to hold out for the full scope of the inquiry. [SEP] the previous meetings revolved around japan and china, patching 21st - century differences on trade, jobs, trade and jobs - - to which their leaders could not be a threat. [SEP] he is now working at the pacific primate research center in oakland. [SEP] this is the new - england - owned team that dates back to the early 1960s. [SEP] kostenko, however, said he had not been informed about the government's talks and the three men met russia's finance commissioner john cedera. [SEP] mr motts said it was \" [SEP]"}
+{"type": "sample", "index": 51, "raw_text": "[CLS] be able to make that point and show the public that they can listen. [SEP] this is the deal. [SEP] i ' ve been following the streets and canals for a long period of time, and parts of the street in the morning are used to snow people getting crowding the streets and getting people over the sand and water. [SEP] the rise of blairism was not reported by the times. [SEP] cnn ' s karen travers, who reported from hollywood, pa. [SEP] the times says jackson is spending time with his family and relaxing on his own feet. [SEP] several private and private day talks are held at airy university in birmingham, [SEP]", "detok_text": "[CLS] be able to make that point and show the public that they can listen. [SEP] this is the deal. [SEP] i've been following the streets and canals for a long period of time, and parts of the street in the morning are used to snow people getting crowding the streets and getting people over the sand and water. [SEP] the rise of blairism was not reported by the times. [SEP] cnn's karen travers, who reported from hollywood, pa. [SEP] the times says jackson is spending time with his family and relaxing on his own feet. [SEP] several private and private day talks are held at airy university in birmingham, [SEP]"}
+{"type": "sample", "index": 52, "raw_text": "[CLS] said. [SEP] yesterday ' s way home, however, the president ' s biggest task of the night was to get him away with the talk of love and turn the process around coy. [SEP] this would be only the second time in this series they have lost a player. [SEP] 19 at the university of south carolina. [SEP] \" we spend three times more time today than we have a year ago and a lot more time than ever. [SEP] space agency officials said engineers could do up to five hours of surveillance a day and see what happens what ' s done on the station. [SEP] the welsh assembly council voted last night in a bid [SEP]", "detok_text": "[CLS] said. [SEP] yesterday's way home, however, the president's biggest task of the night was to get him away with the talk of love and turn the process around coy. [SEP] this would be only the second time in this series they have lost a player. [SEP] 19 at the university of south carolina. [SEP] \" we spend three times more time today than we have a year ago and a lot more time than ever. [SEP] space agency officials said engineers could do up to five hours of surveillance a day and see what happens what's done on the station. [SEP] the welsh assembly council voted last night in a bid [SEP]"}
+{"type": "sample", "index": 53, "raw_text": "[CLS] in the european parliament. [SEP] talk about its growth. [SEP] the election will be close. [SEP] ( ap ) - fred couples had a total of 37 holes sunday in the first round at bay hill country club classic, where the 23 - year - old two - time masters champion was missing a shot from the rough spot in which he nearly doubled his six - stroke playoff lead. [SEP] teacher mike todd, from leeds, died after being crushed to death on the m40 train in bradford, north west yorkshire. [SEP] wanderers players john northgate and tony mcnaw will work with burnley as part of sir iannap ' s team [SEP]", "detok_text": "[CLS] in the european parliament. [SEP] talk about its growth. [SEP] the election will be close. [SEP] (ap) - fred couples had a total of 37 holes sunday in the first round at bay hill country club classic, where the 23 - year - old two - time masters champion was missing a shot from the rough spot in which he nearly doubled his six - stroke playoff lead. [SEP] teacher mike todd, from leeds, died after being crushed to death on the m40 train in bradford, north west yorkshire. [SEP] wanderers players john northgate and tony mcnaw will work with burnley as part of sir iannap's team [SEP]"}
+{"type": "sample", "index": 54, "raw_text": "[CLS] in our own history, \" obama said. [SEP] the price of yield on the us 10 - year treasury bill meanwhile dropped to 10. 00 % from 9. 00 %. [SEP] he was m. l. a. with the skills he needed to access finance in college. [SEP] the whole goal of english rugby has become the public interest in british football in the past four years, and unfairly it remains the subject for angst in sport. [SEP] ms maclornoy said : \" i am very interested to contesting in this role. [SEP] of course he ' d be willing to vote for obama in washington, dc, [SEP]", "detok_text": "[CLS] in our own history, \"obama said. [SEP] the price of yield on the us 10 - year treasury bill meanwhile dropped to 10. 00 % from 9. 00 %. [SEP] he was m. l. a. with the skills he needed to access finance in college. [SEP] the whole goal of english rugby has become the public interest in british football in the past four years, and unfairly it remains the subject for angst in sport. [SEP] ms maclornoy said:\" i am very interested to contesting in this role. [SEP] of course he'd be willing to vote for obama in washington, dc, [SEP]"}
+{"type": "sample", "index": 55, "raw_text": "[CLS]r. [SEP] the number of american fatalities in iraq and afghanistan last year jumped 18 percent more than a decade, according to a national pentagon estimate of just over 10 years. [SEP] mr brown ' s decision to resign from the post is well - known, considering his wife was an election worker. [SEP] the mps will ask the party to criticize mugabe ' s party if the government is seeking to get zimbabwe ' s help, and so will the opposition. [SEP] however, bohori agreed that the impact of this real economy is much longer than anticipated. [SEP] china is seen as a great platform for improved relations - - beyond diplomatic [SEP]", "detok_text": "[CLS]r. [SEP] the number of american fatalities in iraq and afghanistan last year jumped 18 percent more than a decade, according to a national pentagon estimate of just over 10 years. [SEP] mr brown's decision to resign from the post is well - known, considering his wife was an election worker. [SEP] the mps will ask the party to criticize mugabe's party if the government is seeking to get zimbabwe's help, and so will the opposition. [SEP] however, bohori agreed that the impact of this real economy is much longer than anticipated. [SEP] china is seen as a great platform for improved relations - - beyond diplomatic [SEP]"}
+{"type": "sample", "index": 56, "raw_text": "[CLS]. [SEP] it will take over a week to recover and we are still talking to the people, \" he said. [SEP] the turkish government has criticized fatah ' s refusal to hold talks, saying it threatens the west bank ' s future sovereignty. [SEP] china ' s office insisted that the deal was not an \" easy and substantive agreement. [SEP] don ' t be wondering how you were dumbed with the position. [SEP] \" but i can hear a lot about the media, there ' s the media talk about job job cuts, i know i ' m happening this time of year and i think that i ' ve just got some light [SEP]", "detok_text": "[CLS]. [SEP] it will take over a week to recover and we are still talking to the people, \"he said. [SEP] the turkish government has criticized fatah's refusal to hold talks, saying it threatens the west bank's future sovereignty. [SEP] china's office insisted that the deal was not an\" easy and substantive agreement. [SEP] don't be wondering how you were dumbed with the position. [SEP] \" but i can hear a lot about the media, there's the media talk about job job cuts, i know i'm happening this time of year and i think that i've just got some light [SEP]"}
+{"type": "sample", "index": 57, "raw_text": "[CLS] of the council on energy responsibility and regulatory policy on energy issues related to and to energy and infrastructure. [SEP] those who tend to be at higher risk of being over - 65 and more than those with no children being obese. [SEP] dan : i don ' t think much about parking guns on the bus.. [SEP] the conservatives, seen as one of the most influential campaigners in the world of political affairs, said : \" the public really wants to have a new party to promote its own political reforms and it ' s important to have a future government that has its place in the political arena. [SEP] london / brussels ( reuters life [SEP]", "detok_text": "[CLS] of the council on energy responsibility and regulatory policy on energy issues related to and to energy and infrastructure. [SEP] those who tend to be at higher risk of being over - 65 and more than those with no children being obese. [SEP] dan: i don't think much about parking guns on the bus.. [SEP] the conservatives, seen as one of the most influential campaigners in the world of political affairs, said: \" the public really wants to have a new party to promote its own political reforms and it's important to have a future government that has its place in the political arena. [SEP] london/brussels ( reuters life [SEP]"}
+{"type": "sample", "index": 58, "raw_text": "[CLS] is optimistic about the challenge and suggested it would be too hard to work out how he would clinch the victory. [SEP] los angeles, california ( cnn ) - - the redis have announced the winners of the u. s. pga golf association world championship - - arguably the sport ' s highest honor. [SEP] year 2008 - - us $ 1. 5 million when compared to the year. and us $ 3 million in gross profit. revenue for the first half of 2008 compared to us $ 377. 5 million for the same period in 2007. [SEP] nearly two years ago, the u. s. space industry published a survey of [SEP]", "detok_text": "[CLS] is optimistic about the challenge and suggested it would be too hard to work out how he would clinch the victory. [SEP] los angeles, california (cnn) - - the redis have announced the winners of the u. s. pga golf association world championship - - arguably the sport's highest honor. [SEP] year 2008 - - us $1. 5 million when compared to the year. and us $3 million in gross profit. revenue for the first half of 2008 compared to us $377. 5 million for the same period in 2007. [SEP] nearly two years ago, the u. s. space industry published a survey of [SEP]"}
+{"type": "sample", "index": 59, "raw_text": "[CLS] driver, a race driver and a skilled vet technician who can make a race, only to leave the circuit. [SEP] it ' s not just to stress we ' re human, and to try to make clear to us that we are not going to tell you anything about ourselves what to do. [SEP] it was the coldst dry year on record in the united states since the 1970s. [SEP] the government is considering overhauling the extra century of nursery school testing that has helped more than 200, 000 school pupils. [SEP] but head coach bob schalke says it ' s time to start work, but not to go away. [SEP] two [SEP]", "detok_text": "[CLS] driver, a race driver and a skilled vet technician who can make a race, only to leave the circuit. [SEP] it's not just to stress we're human, and to try to make clear to us that we are not going to tell you anything about ourselves what to do. [SEP] it was the coldst dry year on record in the united states since the 1970s. [SEP] the government is considering overhauling the extra century of nursery school testing that has helped more than 200, 000 school pupils. [SEP] but head coach bob schalke says it's time to start work, but not to go away. [SEP] two [SEP]"}
+{"type": "sample", "index": 60, "raw_text": "[CLS] health agenda during president barack obama ' s health care summit tuesday. [SEP] it was moving toward china on wednesday when it was headed for the north american border, where taiwan and china, according to u. s. i. c., most of its air traffic from asian countries. [SEP] the results may be part of a high level of risk seen during hospitalization, said a senior u. s. official after the who gave a report to the federal health department on wednesday. [SEP] but some lawmakers in the house say they believe the legislation still should be passed and allow congress to come out again, and others say they need not [SEP]", "detok_text": "[CLS] health agenda during president barack obama's health care summit tuesday. [SEP] it was moving toward china on wednesday when it was headed for the north american border, where taiwan and china, according to u. s. i. c., most of its air traffic from asian countries. [SEP] the results may be part of a high level of risk seen during hospitalization, said a senior u. s. official after the who gave a report to the federal health department on wednesday. [SEP] but some lawmakers in the house say they believe the legislation still should be passed and allow congress to come out again, and others say they need not [SEP]"}
+{"type": "sample", "index": 61, "raw_text": "[CLS] was george ' s wife. [SEP] this article was first published on guardian. co. uk at 07. 05 bst on wednesday 28 may 2009. [SEP] the u. s. president, left on an official visit to beijing tuesday with president obama, in a sign of mutual agreement between india and china who have been divided over beijing ' s goal of tibetan independence. [SEP] at a new record london stock price of $ 1. 5bn, and a value of $ 1. 6bn, as of july 31, 2009 it was worth about £83, 000, almost twice as much as its price of £187m [SEP]", "detok_text": "[CLS] was george's wife. [SEP] this article was first published on guardian. co. uk at 07. 05 bst on wednesday 28 may 2009. [SEP] the u. s. president, left on an official visit to beijing tuesday with president obama, in a sign of mutual agreement between india and china who have been divided over beijing's goal of tibetan independence. [SEP] at a new record london stock price of $1. 5bn, and a value of $1. 6bn, as of july 31, 2009 it was worth about £83, 000, almost twice as much as its price of £187m [SEP]"}
+{"type": "sample", "index": 62, "raw_text": "[CLS] years ago and would gravitate to pay money back home again. [SEP] you should do everything that you wanted to do - - and that ' s what the m. i. did. [SEP] the rate of salary increases rises above that of the average 65, those earning more than £165, 000, while the payments to start - a - level parents who earn around £38, 000 a year rise £142, 000 a week. [SEP] the court heard the husband, sean mcnicran, 27, from leeds, and his wife, carol, 27, from blidis, birmingham, just miles away from birmingham, [SEP]", "detok_text": "[CLS] years ago and would gravitate to pay money back home again. [SEP] you should do everything that you wanted to do - - and that's what the m. i. did. [SEP] the rate of salary increases rises above that of the average 65, those earning more than £165, 000, while the payments to start - a - level parents who earn around £38, 000 a year rise £142, 000 a week. [SEP] the court heard the husband, sean mcnicran, 27, from leeds, and his wife, carol, 27, from blidis, birmingham, just miles away from birmingham, [SEP]"}
+{"type": "sample", "index": 63, "raw_text": "[CLS] months in july 2008. [SEP] i don ' t \" the report was quoted as saying. [SEP] as to a particularly high - profile health care plan, he never said enough is not enough, with illinois sen. barack obama trying to talk about the patient, who would show up before his speech in february. [SEP] then, going to the right, especially on the left. [SEP] \" it certainly is jarring to hear out john rodley ' s state - of - the - art. [SEP] a greater manchester man who fell into a river has been arrested over his claim of having the woman ' s body slashed four times. [SEP] in [SEP]", "detok_text": "[CLS] months in july 2008. [SEP] i don't \"the report was quoted as saying. [SEP] as to a particularly high - profile health care plan, he never said enough is not enough, with illinois sen. barack obama trying to talk about the patient, who would show up before his speech in february. [SEP] then, going to the right, especially on the left. [SEP]\" it certainly is jarring to hear out john rodley's state - of - the - art. [SEP] a greater manchester man who fell into a river has been arrested over his claim of having the woman's body slashed four times. [SEP] in [SEP]"}

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_diffusion_noise_steps_128steps_n64/noise_linear2to08_mid_sine_eta0p08_c256_detok_raw_samples.txt

@@ -0,0 +1,230 @@
+noise_linear2to08_mid_sine_eta0p08_c256_detok
+{
+  "type": "summary",
+  "name": "noise_linear2to08_mid_sine_eta0p08_c256",
+  "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt",
+  "step": 187000,
+  "decode": {
+    "kind": "categorical_fullvocab_diffusion_state_noise",
+    "config": "noise_linear2to08_mid_sine_eta0p08_c256",
+    "steps": 128,
+    "temp_start": 2.0,
+    "temp_end": 0.8,
+    "temp_schedule": "linear",
+    "t_power": 1.0,
+    "eta0": 0.08,
+    "eta_schedule": "mid_sine",
+    "noise_conc": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 49.95328576578725,
+    "nll_per_token": 3.911088284027923,
+    "tokens": 9562
+  },
+  "diversity": {
+    "sample_entropy": 4.222333312252868,
+    "unique_tokens": 1974,
+    "token_count": 8192,
+    "distinct_1": 0.240966796875,
+    "distinct_2": 0.7234251968503937,
+    "top_token_mass": 0.0513916015625
+  }
+}
+
+===== sample 000 =====
+[CLS] vice president will be interviewed today in chicago on the saturday night news along with a science writer (joined with ed stoner, jerilyn collins and josh mcclellan, who have previously reported on both covers of the new york times). [SEP] pakistani officials insist that the bhues have had a rather contentious encounter with reporters, along with others, while several diplomats and government officials are in an angst over how to proceed with such talks. [SEP] however, the 21 - year - old has already put all of his players at risk, and the sixers remain serious about his future. [SEP] it was after he filed his petition [SEP]
+
+===== sample 001 =====
+[CLS] state department spokesman yu yong - boe soon told reporters monday at the tokyo international conference that the us administration on regional development, a regional research agency, aims to reach the region through tourism, trade, investment and trade. [SEP] also, mr. mccain criticized obama's decision to go on pressing for tougher sanctions. [SEP] earlier defence minister john hutton called for a meeting of defence ministers at the ministry of defence. [SEP] mr. gibbs and paul jones, the chief of staff, had met with obama on thursday, but he said he would be open to discuss. [SEP] for more information on panas, visit www. panas [SEP]
+
+===== sample 002 =====
+[CLS] wouldn't want the party here to know how a candidate would say: i'm going to lie, i'll feel about me. [SEP] but it must be the final challenge to move. [SEP] that sector is now getting 2. 15 dollars per mile - - £800... i don't know, this!. [SEP] the pension fund accounts for around a quarter of the state's infrastructure funds. [SEP] clinton told the conference he would start off criticizing the u. s. military during a trip on monday to the national military policy council meeting in washington, d. c. the senior state department spoke [SEP]
+
+===== sample 003 =====
+[CLS]. [SEP] but he says he has had no history of sexual abuse, and says he has never done so. [SEP] i've always liked what i want to say, except that people are the people i always connect them with. [SEP] mr baderl's speech will be germany's only state of the union. [SEP] beckham, who has represented liverpool for 15 seasons here, will do what the club is offering to encourage fans to move away from footballing. [SEP] more than 100 years ago, 600 years ago, the 1, 000 types of mammals, including birches, hippos, owls, and buffalo [SEP]
+
+===== sample 004 =====
+[CLS], 200 people, with the district's 1. 3 million square feet. [SEP] it could be heard when government ministers debate leaders about the public finances. [SEP] "the christmas sinners" is a new vampire debut at no. 1. [SEP] you've got to see some football and a bit of information working out there - it's not a playoff game. [SEP] the foreign minister kibao said the minister was preparing course for the meeting in singapore. [SEP] the company is due to carry out the work at the site later this week. [SEP] but while drawing a line with the law, the newspaper said that the fed [SEP]
+
+===== sample 005 =====
+[CLS] alaskan. mccain, robert markey, u. s. gov. kathleen sebelius, u. s. secretary of state hillary rodham clinton. [SEP] beijing's cross - national industrial and commercial power - terminal was launched in the long - run hebei in 1996. [SEP] young people of all ages were more likely to write a book about getting extra room than men at the middle of the day. [SEP] foreign companies are expected to move into the chinese market. [SEP] the euro rose to 93. 50 yen wednesday with the dollar and u. s. debt trading down to 2. 044 yen in new york dollars [SEP]
+
+===== sample 006 =====
+[CLS] hillary clinton, bill clinton's press secretary, and charles p rangel, a top republican congressman and the recently successful presidential candidate. [SEP] but four days before the launch they've missed the second phase of their mission. [SEP] they're just getting to do it. [SEP] the amount of money english premier league clubs have raised by expanding their league to premier league in the past couple of months have not been cut in the national league. [SEP] the campaign also notes that mrs palin has built much of her political social and economic credentials as a union politician, also drawing support from the ranks of working class. [SEP] moreover, the [SEP]
+
+===== sample 007 =====
+[CLS] couby, his wife, and ann mclure, assistant manager of the park. [SEP] he said crews are humeting out of the city to prepare for a strong storm. [SEP] i never have to say whether obama ever got a bank loan! [SEP] rather than trying to write that policy on monday, but rather than holding a free convention, he's keeping the touchy stance. [SEP] but patients should at least get their hands to buy their own vision. [SEP] kabul (ap) - afghan prime minister gordon brown said sunday that nato and foreign forces have launched a joint assault on taliban militants in the eastern province of [SEP]
+
+===== sample 008 =====
+[CLS]ble. [SEP] "we've started on the grounds that it is legal and then nobody asks why it should be the case," he said. [SEP] two weeks ago, us - russian ministers tabled a counter missile shield in western russia, stoking a us missile shield at the end of years of the russian conflict and renewed political ties. [SEP] however, kettg said he doesn't see the end to the negotiation until he can see obama's announcement about this deal. [SEP] lawmakers said friday it would cost to bring the program to about $30 billion in a year - end bill to cover the cost [SEP]
+
+===== sample 009 =====
+[CLS] was back, however, denver's spagnuoro showed the same maturity as the redskins' jim zorn, who came on the front bench and then won nearly every games in cleveland's history. [SEP] but if you go wrong, it's certainly enough for the polleers to be able to do. [SEP] over half of the population live in the countryside, mostly to the east and most of the west or southern areas draw immigrants from southern westerners drawn to their lands. [SEP] it said news agency konhei had been held for four days, the china daily news reported. [SEP] as president barack obama will be [SEP]
+
+===== sample 010 =====
+[CLS] of character that he so wanted to be, the man as important as obama's image. [SEP] john mccain. university college london. london. £44, 220 (£6, 730 annum). university college london. west london,1, 146. £29, 650 p. a. st john's, west london, l.... £32, 220 - £36, 451. a.. [SEP] the russian foreign ministry office visited the site on tuesday and said this week it has no immediate report. [SEP] president barack obama is america's longest - serving black president. [SEP] the city ' [SEP]
+
+===== sample 011 =====
+[CLS] said. [SEP] the film's director, sarah casey, said at the news conference that author katherine callas was being instructed on how to get the vital meaning of her book away, and it is a pleasure to see the film's title come out of one page. [SEP] postwar anglo - american relations were the centre for him, a small european country invaded in the second world war war, and a great forum for trade and trade under the the new european government. [SEP] the korean ministry of defense for trade and trade on wednesday announced details of a progress they had made, including contact with south korea and impessing of progress [SEP]
+
+===== sample 012 =====
+[CLS] radio broadcaster, agreed to pay on friday saying he would leave three days and hold a public meeting with radio chiefs on thursday. [SEP] mcghee has said his family won't be specific. [SEP] because if those people want to look at some people's financial statements, i'm sure they don't make them. [SEP] tehran, iran (ap) - a u. n. spokesman defended human rights in iran on friday, saying tehran continues to accept u. n. sanctions against the country. [SEP] but he's bawdy, artful thinking, tonal humour, good humour and mind - numbgling [SEP]
+
+===== sample 013 =====
+[CLS] up our world cup, "says adlington. [SEP] after all, the brazilians and chelsea captain mourinho, though, must get the process going. [SEP] that's the one bad thing that needs to get you out of it. [SEP] 2007 earnings were $2. 9 million on a basis of 5. 2 cents per share. [SEP]" the north has just reached a new record, and has been spending over 5 million dollars on a million ships to enter the region, " said u. s. gen. travis koehl of charlotte, n. c., the former national security adviser who helped bring [SEP]
+
+===== sample 014 =====
+[CLS]'s war with israel on nuclear weapons. [SEP] the us ministers said in pyongyang that the two koreas have helped to establish regional ties between north korea and washington in the last two coming decades, most recently by resolving the long - running nuclear war dispute. [SEP] he was born a decade ago, and worked at a museum of modern art in the late 1980s. [SEP] on friday, john powell, the secretary of state, hillary clinton, the us president, attorney general eric holder and prime minister gordon brown, the us council for europe and the white house office counsel. [SEP] defense secretary - general john mullen said the [SEP]
+
+===== sample 015 =====
+[CLS] leader of the social democratic party, his spokesman said today. [SEP] at a recent meeting of the joint economic council, mr cameron tried to break the silence - - naipende, a former pm, came across as one of the first - - but insisted that he had strong backing of the decision to allow the main new party to move forward, after the general election, without an election for the european party, which he would most likely call a tory government. [SEP] police patrol on friday along the lodig river, an area near the border with china, where chinese soldiers clash with the group of chinese tourists. [SEP] one [SEP]
+
+===== sample 016 =====
+[CLS] to get out of the mold of former republican candidate john mccain. [SEP] it's too early to change. [SEP] but do not want to do public relations without the full level of chinese gabbering. [SEP] the mccanns, eileen, 46, and jo gere, husband, mark, 41, and their son andrew, 30, made their statement on cnn. com. [SEP] what is the minimum capital added to the equity value for a small bank? [SEP] about two percent after lehman's losses of about $12 million earlier this year, and $12 million at the same stage of last year. [SEP] but until 2000 [SEP]
+
+===== sample 017 =====
+[CLS] open to the public in september. [SEP] and he's the coach of the team, and uh, but hey, i really did agree with me, i always do it because - - i don't care about that, i wonder if i'm just black, because of his lack of energy, his lack of words, his attitude and how i work hard, and lots of people to think about his own things - - and what he's doing - - do the same things that he said, he said - - and i just think that we just need to realize that he has always been - - - and [SEP]
+
+===== sample 018 =====
+[CLS] [SEP] open wednesday, 11 a. m. to 6 p. m., at the cognoscent theater, 520 east 14th st. [SEP] crouch could not be a common man, but manager harry redknapp's players have been frustrated by a poor performance of players, although benitez has said his club wanted to sign the spanish player. [SEP] the arsenal manager understands the effect of the game on the entire arsenal field and the fact that managers need the experience and wisdom of youngsters. [SEP] more formal rather than political sentimentality, the g8 now maintains its own sense of civility of excess with a new [SEP]
+
+===== sample 019 =====
+[CLS] menovan said federal law enforcement agencies were trying to all mediate the matter. [SEP] mr eavis is troubling the plans to spend $1. 5m on the project to build the first school of rock on stadium land. [SEP] mr. beckhamus and the county prosecutor's chief executive office said they did not consider such a rule. [SEP] beijing (reuters) - chinese soldiers and christians living in tibetan areas clashed briefly in china's northern shan areas on saturday, leaders of the communist party said on saturday. [SEP] i'm counting on my teeth... but you might have to give up and [SEP]
+
+===== sample 020 =====
+[CLS] once a week, he said. [SEP] "what most people think of this study is that the past three decades of it is preferable to happen over a period of time, with gaps on body language, religion, religious behaviours, sports, education, communication and socioeconomic level. [SEP] i don't know," she said before the panel, asked whether he's had some contact with smith's family. [SEP] woods had announced the retirement days after winning his masters open in january, the first time since his fall in 2001. [SEP] but the couple is unlikely to forget how different the circumstances were behind woods' death [SEP]
+
+===== sample 021 =====
+[CLS] health program for the high school students in 2005 when they went through the final group to the college's athletic program. [SEP] kevin bolenty, director for a new democratic, said the dnc will work with democratic leaders on north carolina, but progress is still ongoing. [SEP] the german government said the united states has suggested the money could be used to develop a new hybrid electric vehicle for cars when it comes to the united states. [SEP] both birmingham international airport and a bus from london were stopped by kent police when a passenger jet crashed early this morning. [SEP] mr thomas said mr brydon's family had taken " hard [SEP]
+
+===== sample 022 =====
+[CLS] bank of america corp. had plans to increase its own credit debt levels but would have to keep spiraling down ratings on u. s. residential subprime mortgages. [SEP] after all, haiti's main allies can sit beside them in power. [SEP] the forum's deputy president, derek scott, was a member of the un space agency. [SEP] barack obama's national security adviser sought a firm tone on the middle east on monday with a declaration that he would not be prepared to challenge hillary clinton. [SEP] the report said the local authorities would not discuss the case. [SEP] we're seeing a lot more women pro [SEP]
+
+===== sample 023 =====
+[CLS] year - old woman and another passenger, 16 - year - old john stapleton. [SEP] the bank valued citigroup's total balance sheet at £30 billion last week, with total loans worth about £2. 3 billion and national debt to around 12 per cent of its total capital 9 per cent, taking the total reserve bank reserves by more than 12 per cent. [SEP] a spokesman for the tories, who include mr salmond, said the party had no option but to say details of the proposals would go forward by friday afternoon. [SEP] she also announced a national first time programme, worth £94m to reduce staff [SEP]
+
+===== sample 024 =====
+[CLS] [SEP] general richard d. morrell jr., political director to u. s. gen. james w. conway, said of tuesday's election that he could expect more foreign security forces to build support among u. s. forces. [SEP] james winter, senior vice president in washington, and beth bahruschener, senior vice president, harland holstraitz and rohde, and john huston, director, share responsibility for the obama administration. [SEP] mr beusconi's wife, elia berlusconi, a former mayor of milan and former deputy prime minister, is accused [SEP]
+
+===== sample 025 =====
+[CLS] of self - esteem. [SEP] it's obvious mccain may not be palin's lackluster choice, but no, it's the case for this debate, with palin and obama arguing that there is a lot of unseemly heat for her. [SEP] in 2008, the government experienced 10 times smaller budget deficits since december 2007 because of the global economic crisis, high unemployment, rising government debt and the budget crisis. [SEP] the us under secretary of state hillary clinton, on its relations with israel and the united states, said it could be more sense to take iran to force the way to a settlement on [SEP]
+
+===== sample 026 =====
+[CLS] to his first victory in the draft round in nfl draft history. [SEP] rose park mayor andy davies said: "i would hope they've been able to attend the meeting and then hear this news very soon now. [SEP] mr brown certainly won't recognize it. [SEP] he did not immediately have reason for comment. [SEP]" many of us haven't known what's wrong, but now it will take us even longer for kids to get back to school. [SEP] he said: " if i know this is what i say, and what i say on this day, football is something all this important. [SEP] the head of [SEP]
+
+===== sample 027 =====
+[CLS] will not be raised at a real price, "said david streit, economist at prudential financial in singapore. [SEP] a spokesman for gordon brown and the bank of england, lord mandelson, mr brown, said he was discussing the scale of the crisis with the financial times because he did not need the funding to stop mortgage lending, and that the bank's liquidity problems" dented the balance of the fiscal position " in november. [SEP] and it's exactly what's become - known. [SEP] new york (ap) - goldman sachs has asked for $25 billion from the federal bailout package [SEP]
+
+===== sample 028 =====
+[CLS] china and india, with many top chinese officials in asia now leaving china with the real eye on their people, without the knowledge of their successors. [SEP] the republican party's popular 25 - year - old former new york governor has launched his national tv ad, criticizing obama's presidential campaign at the end of the debate on race and the candidate's lack of experience enough to raise government issues. [SEP] "it was almost impossible, and i really felt the wind coming. [SEP]" what we'll do is discuss a demand issue, more of it, leading to higher oil prices, " said iraqi oil minister ali jibba [SEP]
+
+===== sample 029 =====
+[CLS], a 17 - year - old, and 27 - year - old julian walker, 33, died after their car was swept into the sea friday night, according to the u. s. military. [SEP] it was only then that the friend, sarah calle, 35, from bradford, announced that a child from her local school would be returned to the area, after which, it was suspended until the next year. [SEP] sen. john mccain said tuesday that the u. s. supreme leader of the korean peninsula would be the basis for future military action on the white house. [SEP] it's not the end of the current [SEP]
+
+===== sample 030 =====
+[CLS] working on a settlement from the treasury department to force them to get the money back on monday. [SEP] vaux, britain's third - largest, reported a $371. 5 million annual profit as first - half after - tax income jumped 50 % by 25 % to £2. 3bn. [SEP] britain's previous government, however, showed no evidence of terrorism's potential in this country. [SEP] 18 (upi) - - more than 30, 000 young u. s. teens nationwide receive private health insurance each year, according to data released. [SEP] want to see what they say, ted: you're [SEP]
+
+===== sample 031 =====
+[CLS] owns the area, said it would be great if the council had authority to give land to the district. [SEP] while obama wants to stay cripped, he predicts that he'll be able to make a good job at the job in the coming months. [SEP] i will say that, i think it is over and this is the right thing to do. [SEP] but with lower customer interest rates, credit - card lenders are demanding more fees. [SEP] india's government expressed its opposition today to joint plans for a national park area, a network of walking borders and paths. [SEP] but the studio now is eager for political [SEP]
+
+===== sample 032 =====
+[CLS] highest political level during the election season. [SEP] sunil hao, vice deputy finance and finance, said the economic stimulus measures would work for the rest of the country. [SEP] in the first half of the year it dropped $250, 000 and the loss was up from a loss of $589 million. [SEP] the percentage of non - hispanic americans - - estimated at 25 - 48 percent - - is almost 30 percent lower than those racked up by blacks, ages 55 or older. [SEP] china cut the budget deficit to just around 20 percent during last year's credit crunch, but the bush administration soon struck a deal through [SEP]
+
+===== sample 033 =====
+[CLS] served as the bush - era secretary of state there in washington, was named secretary of the defense department of the administration and then was named as defense secretary in president bill clinton's first administration, seeking to re - establish her credentials as a leading secretary of state and international diplomacy. [SEP] london and scotland at 14. 8 % (wales at 16. 7 %) have average support rates of 6. 2 % and 3. 5 %, respectively. [SEP] philadelphia (ap) - philadelphia city said thursday its decision to pay a disabled man for a teenage gunman who had been attacked outside a subway station in the city. [SEP] then [SEP]
+
+===== sample 034 =====
+[CLS]. [SEP] it's just a case of bickering around and lack of opportunity, "said yosuo asada, of the imo handshake for the university of technology school in sydney, as she noted that japan was on a sharp downward path compared with japan's creationism and the obama administration. [SEP] los angeles defensive end roy williams is a close friend of the pro receiver, who missed last week with a sore left knee. [SEP]" there is a legal crisis, " president velsio rajapata told reporters. [SEP] david bentley's free - kick blocked a long, near field goal, [SEP]
+
+===== sample 035 =====
+[CLS] the actor. [SEP] this is likely to surprise many parts of the public in the years of david cameron's tenure as bbc one's chief executive. [SEP] but there are many signs that the job cuts represent only 15 per cent of the number of available jobs you're looking for. [SEP] john mcbraey, however, the us secretary for international security, said: " we want a comprehensive resolution on the election that should take more time to reach its commitments to the violence. [SEP] he first appeared in the new york times in 1987 after he signed an agreement to embargo with cuba, spending five days in prison for [SEP]
+
+===== sample 036 =====
+[CLS] [SEP] 20 ): i'm physically and mentally helpless as to how our relationship is, but that's causing me to tap into the belief that don't think about sex without going around working. [SEP] portugal international goes to the bench in the absence of cristianoo. [SEP] the title will be handed over in september at the grant hall foundation. [SEP] the company's decision to merge with car parts cerberus to form chrysler comes after gm is boosting its debt capital proposal to take it over the world's biggest and most profitable automaker with a debt of 385 billion euros. [SEP] he was arrested [SEP]
+
+===== sample 037 =====
+[CLS] and a proper platform for the 2010 world cup. [SEP] he is an 8, 000 - square - foot bike racer at around 2, 000 miles an hour. [SEP] elsewhere, probably about 30, 000 people were stuck in flooded homes in downtown lhasa, according to a government official quoted by the china news agency. [SEP] it had more than $1. 5 billion of secured debt as of july; $4. 2 billion at september 30. [SEP] the buyout proposal prompted a glut in funding for the federal mortgage bank and the federal reserve. [SEP] the newspaper said for its main two countries, poland and austria, [SEP]
+
+===== sample 038 =====
+[CLS]/www. mcgraw - hill. com. [SEP] in the next few weeks the state police will almost certainly search gays who report abuse in the same precinct, said rebecca enderbacher of the domestic violence group, a private organization for women and child - violence groups. [SEP] sometimes, though, mr. mccain questioned what the current president had, saying that he was "not a global leader" and the same criticism of bush, who was the vice president - elect the most senior administration official at the time, just as well as john mccain, also one of the most contentious us leaders in american politics. [SEP] obama and hillary [SEP]
+
+===== sample 039 =====
+[CLS] [SEP] the man, who was called to the park at st. paul county hospital, is said to have been forced to run from his home on saturday morning. [SEP] democrats and moderates were not in those positions, mr. nader said. [SEP] he was later married to scott gilbert, the iron man sports chairman, who was his son during that time with united. [SEP] "ready for hate" doesn't mean you no longer agree with a subject. [SEP] by overhauling the league's management, mccrew and mcnabb went under jim cortelanz, the team's general manager. [SEP] the [SEP]
+
+===== sample 040 =====
+[CLS] [SEP] "we wanted to make the trade more transparent, but it's definitely clear if that is going to increase," said john cleese, chief executive of deloitte. [SEP] meanwhile, when malik began a u. s. offensive against al qaeda in the city in january, provincial security minister and deputy leader salah daini said iraqi ministers had far greater responsibility for their political situation. [SEP] you don't get what you stand for, " former senator fred thompson said, hoping to make obama's point. [SEP] sixteen % of income children and 20 per cent of children have no teachers, and the spread [SEP]
+
+===== sample 041 =====
+[CLS] filers with an 18 - year income of $8, 000, or $2, 600 for individuals and $4, 500 for 25 - year old individuals and up to almost $4, 000 for family income up to $5, 000 for individuals and up to $4, 000 in income per family, ranging from $1, 200 - - $2, 500 to $1, 200 for family children and up to $3, 500 to $3, 000 for a three - and - a - year family. [SEP] and then you will know what he means. [SEP] he was a bit of an uncompromising [SEP]
+
+===== sample 042 =====
+[CLS] s friends don't make any comments about him by way of his politics or any business. [SEP] what he's talking about the way they think about everything he's written, not their mind; i get tired of the "dole rush." [SEP] he would say the autoworkers did that and does not indicate the union will go into action. [SEP] kevin kilgher, the fa director - general, said yesterday: " what i find wrong with ian hart is that, as manager, he is going to change what's really about policy, you're going to really try to come up with [SEP]
+
+===== sample 043 =====
+[CLS] donations to support them. [SEP] "the biggest part of losing him, always working in the country, you have to deal with some foreign players," he said. [SEP] "the money you have from the mortgage market is about $1 billion and at the local level is worth over $5 billion," nesterer said. [SEP] yellen says it is true that the agency reviewed the claim. [SEP] but this is the time that you've got to go. [SEP] japan, asia, china and koreas, with net sales of $14. 4 billion to $400 million and asia was $386 million. [SEP] [SEP]
+
+===== sample 044 =====
+[CLS] need. [SEP] the chinese urged mr. clinton to help free the u. s. government and its top level officials, and said beijing's reluctance to cooperate with the administration's investigation was because of north korea's reluctance to change positions on proliferation and democracy. [SEP] "then i've got to say how hard to need to win, or whether it's a strategy for winning and winning," he said. [SEP] she was 19, first adopted in her late thirties, and was raised in the dominican republic by her mother's father, roger. [SEP] the man, aged 14, was police called to the [SEP]
+
+===== sample 045 =====
+[CLS] harvard university school of medicine, the national cancer institute and the university of north carolina state university. [SEP] mr hogg's views helped. [SEP] the u. s. government also said in october that international trade would not do business with the government of former vice president jacques rogge. [SEP] bush officials said the official spoke to clinton after holding a meeting tuesday with senator george j. mitchell (nyse: wd. wmd), a george w. official who heads the united nations, who recently asked a very political question about a president who was embared after the terrorist attacks in 2001. [SEP] instead of forcing [SEP]
+
+===== sample 046 =====
+[CLS] the results are based on parent's weight to their child's birth weight. [SEP] even if i did play the final all - star game, then binghamton is becoming an embarrassment. [SEP] "i think i'll be out for over the next few days," said mcguigan. [SEP] tel aviv, israel, june 23 (bna) - - kevin muʼt nasser, the long - time israeli prime minister for information and foreign minister, met olmert party secretary general rama livni said wednesday. [SEP] the prices of products from the u. s., china, and russia continue to rise. [SEP]
+
+===== sample 047 =====
+[CLS] political focus on the long - term deficit, "said justin langer, macro - policy director at the state bank. [SEP] mancini also was critical of his involvement with mcnagh, former boss tony jones and former assistant coach steve mcclaren, who was sacked when he joined aig from sunderland in 2008. [SEP]" if you had any think about how people could say and what they thought, this was the sort of personal thing i came to face, " said kim hyun nye, executive director of the united states' national academy of korea. [SEP] the president, shimon peres, made a wide - ranging [SEP]
+
+===== sample 048 =====
+[CLS] iranian military activity - - a move often seen as a main means of broadening and energiver relations with iran. [SEP] major banks and their investors have put their hands on the sale's value, sparking uncertainty in the debt markets. [SEP] it's not their job, but their job. [SEP] the us prime minister urged china to be prepared to rejoin the chinese government, and the us congress in beijing is expected to focus mainly on military ties from north and america to china, human rights record, civil rights in africa and free - trade relations with russia, china, india and the european union. [SEP] there have [SEP]
+
+===== sample 049 =====
+[CLS] have a large amount of intelligence and civility, you better respond to any of them. [SEP] cambridge, massachusetts (ap) - republican sen. john mccain has accused the democrat of trying to destroy his campaign as a new york senator, failing to turn away the state's longtime senate seat. [SEP] the army group of 1, 000 individuals is affiliated with several areas of federal law. [SEP] "the president's speech was all the rage," said the spokesman. [SEP] the agency said everyone is involved in the investigation. [SEP] the study was conducted by the university of california foundation, a consortium of universities and organizations for biomedical research [SEP]
+
+===== sample 050 =====
+[CLS] last week and said staff were being asked not to accept the offer. [SEP] the government put the total price at around $5 billion, and also said that court talks with the federal government and creditors had been made so that gm could not strike a deal. [SEP] consumer spending: retail spending rose by 17. 3 % in october, compared with september 2007. [SEP] niels eide, a spokesman for the german state - run north american news network, said he expected to continue discussion of the government's nuclear program within three months, after holding a separate news conference over the weekend. [SEP] mr. bloch said the agreement represented [SEP]
+
+===== sample 051 =====
+[CLS] developing countries to make way. [SEP] mahan made the extra hole to finish at 14 - under 267. [SEP] "we have been with the national football league since the late start of 1999, and that is the change in the future of football," new york university school president mark macbray. [SEP] according to semenya. com, she has signed more than 100 different forms. [SEP] that is because the new drivers who range from poor americans to small - town moms used to spending time with their friends and staffs without texting. [SEP] a tennessee coach and the long - serving coach pete faorn are appealing against [SEP]
+
+===== sample 052 =====
+[CLS] said. [SEP] on the washington art mall, it was the museum's biggest event of the night. [SEP] szlank, who had lost woods twice in the masters final three years before, will be only the second player to win three major titles in four years. [SEP] born in cambridge, england, jan. [SEP] the number is three times higher - more than three times the number of cases that were recorded by county. [SEP] indeed, the experts and travel insiders say, the £4000 of 18 transfers per night, from £6998pp per person on december 27, from just £300 per day [SEP]
+
+===== sample 053 =====
+[CLS] in the european parliament. [SEP] shortly after the obama win, the church was declared bankrupt. [SEP] (ap) - chris stanford ran a total of 504 yards in the second half to secure a victory for the atlantic tide, and mark moore broke the 100 - yard rushing record by rushing 8 yards out of 40 yards in the 565th game. [SEP] ian walker, 36, and mike todd, from london, died after putting out a fire in the train company's offices in north west london. [SEP] newcastle united duo barry robson and tony mcnaw backed out of the meeting early friday after agreeing their team wants to join [SEP]
+
+===== sample 054 =====
+[CLS] in student loan legislation, the paper said. [SEP] the rate of students with higher and lower education needs in new york increased from 43. 3 % to 26. 6 %. [SEP] he's trying to find a team with the strength he needs to put on in college. [SEP] the minister said that the new programme would reduce nuclear supplies in the uk to just over four years, and it could account for the height of the boom to 2012. [SEP] vanderbilt picked wake forest's freshmen stacunto williams and renzo kaleski. [SEP] i knew it would be a day to see, even in washington, dc, [SEP]
+
+===== sample 055 =====
+[CLS] liverpool city council spent £140m over the average re - pay year, which is worth about £540, 000 to the £53, 000 budget over 10 years. [SEP] mr brown's position, far from the liberal understanding of such policy, reflects his belief that the government which should remain in power should force the party to remove mr mugabe from power particularly if the us is aware of the country's dire financial situation, says the paper. [SEP] economist mark scharti estimated that the total value of such bonds is likely to raise at least $100 billion from the amount of government investment in mortgage - backed securities. [SEP]
+
+===== sample 056 =====
+[CLS]. [SEP] mccarthy will take over as coach of the vikings, his second job since the end of the new year. [SEP] the job gave them critical support for rice and quarterback, tom young, for the job. [SEP] there is no need to limit the availability of some players, but they will be able to go early and play quickly. [SEP] the nation's violent death toll dwindled tuesday. [SEP] with an estimated $30 billion in market capital invested in 2007, india's infrastructure fund has about $120 billion, up from about $150 billion this year in 1993. [SEP] " so it's only a wee bit [SEP]
+
+===== sample 057 =====
+[CLS] experience on areas such as political and regulatory reform, energy development, national security, energy and infrastructure. [SEP] and the children should be barred from working with men during the long - running conflict, with domestic violence at its height. [SEP] an advocate and political consultant, who has tended his hand in public life, breuer was now seen as one who doesn't stand to see the money distributed to the groups. [SEP] " the public really would always have a sense of what else they were doing at a director's request to consider what it might be, he said. [SEP] seijira, japan, april 28/pr [SEP]
+
+===== sample 058 =====
+[CLS] of 1969, being named as one of the most black - eyed hip - pop artists in the country. [SEP] sedona, indonesia (cnn) - - a massive landslide shook indonesia early thursday, the ruins of indonesia's embassy and a remote mountain town in the country's capital. [SEP] the census bureau shows that more than 26. 5 million workers in u. s. and 17. 3 million workers in canada, according to the bureau of national statistics in october, were down 13. 5 percent over the same period in 2007, more than two - thirds before the u. s. economy began the annual rate of [SEP]
+
+===== sample 059 =====
+[CLS] was making his pittsburgh debut last season, is leveling the pittsburgh defense with tennessee in the playoff race to become the game's best team to win the tournament. [SEP] philip johnson, head of the private citizens' group, said: " we must understand that in this case policy is important and it is important that people know more about their local state. [SEP] but the fact is that woods has played here before since he was starting his senior season, and five months later, he is on this course. [SEP] city council leader richard schalkn has said that the community should have made the decision to buy land. [SEP] two [SEP]
+
+===== sample 060 =====
+[CLS] today during his first visit there as president - - five years. [SEP] olga was moving toward central america wednesday, and was headed for the east coast as early as friday. [SEP] in opec oil news report, the oil minister said the price of crude oil fell almost 2 percent. [SEP] "it may be too early to tell us what to call for nationalization," said david jackson, president of the ftd group. [SEP] it said that operating profits from its london arm were up 12 per cent to £13. 9 million from £14. 7 million in the three months earlier. [SEP] he added: " it happened. [SEP]
+
+===== sample 061 =====
+[CLS] early 2008 compared with less than 8 percent in the president's first year. [SEP] the government is also planning to launch a fully online national park service known as e & o, which offers lessons on conservation and conservation. [SEP] ubs now expects to report a loss of $17 billion - - about 80 percent below the insurer's estimate of january 2007 and down from a previous pre - tax profit of $1. 5 billion, although analysts expect a $1. 6 billion this year to december 30, 2009. [SEP] then, wouldn't it be the basis for everyone to say he thought he had one thing about [SEP]
+
+===== sample 062 =====
+[CLS] years, and would soon be willing to run into major leaguers. [SEP] the sales tax in scotland has more than doubled - from £18, 000 a year to £40, 000. [SEP] the debt slowdown, amid the state of the education sector, means the education sector will be saving more than £250, 000 per family, having been estimated to save £183, 000 a year for 90 per cent of household incomes. [SEP] the first suspect was ardu chief executive steven duffy, 30, of tottenham, in his 35 - year career. [SEP] biden said at the same time that he wanted the creation of [SEP]
+
+===== sample 063 =====
+[CLS] of its atomic enrichment programme for dior military activity, the paper was quoted as saying. [SEP] it was a "business - as - usual practice," kryzestka said. [SEP] illinois sen. barack obama said he has no clear plans about who would show up before his speech in february. [SEP] nevertheless, mccain manages the web, sometimes with limited experience. [SEP] but it wasn't hard to figure out fossico's throw - and - run - away. [SEP] a third nottinghamshire man who fell into a tree has been questioned over the possibility of stabbing the man's body number four times. [SEP] in [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_diffusion_noise_steps_128steps_n64/summary.jsonl

@@ -0,0 +1,44 @@
+{"type": "summary", "name": "base_const1p45_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "base_const1p45_c256", "steps": 128, "temp_start": 1.45, "temp_end": 1.45, "temp_schedule": "const", "t_power": 1.0, "eta0": 0.0, "eta_schedule": "none", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 45.86065023558471, "nll_per_token": 3.8256074560380227, "tokens": 9376}, "diversity": {"sample_entropy": 4.124430385339583, "unique_tokens": 1863, "token_count": 8192, "distinct_1": 0.2274169921875, "distinct_2": 0.6966043307086615, "top_token_mass": 0.0712890625}}
+{"type": "summary", "name": "base_temp2to08_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "base_temp2to08_c256", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.0, "eta_schedule": "none", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.86767440351385, "nll_per_token": 3.868440420722603, "tokens": 9586}, "diversity": {"sample_entropy": 4.196306894865523, "unique_tokens": 1925, "token_count": 8192, "distinct_1": 0.2349853515625, "distinct_2": 0.718380905511811, "top_token_mass": 0.0533447265625}}
+{"type": "summary", "name": "tpow1p5_const1p45_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "tpow1p5_const1p45_c256", "steps": 128, "temp_start": 1.45, "temp_end": 1.45, "temp_schedule": "const", "t_power": 1.5, "eta0": 0.0, "eta_schedule": "none", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.15461218178996, "nll_per_token": 3.853431823633536, "tokens": 9445}, "diversity": {"sample_entropy": 4.124970969360973, "unique_tokens": 1873, "token_count": 8192, "distinct_1": 0.2286376953125, "distinct_2": 0.7017716535433071, "top_token_mass": 0.067138671875}}
+{"type": "summary", "name": "tpow2p0_const1p45_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "tpow2p0_const1p45_c256", "steps": 128, "temp_start": 1.45, "temp_end": 1.45, "temp_schedule": "const", "t_power": 2.0, "eta0": 0.0, "eta_schedule": "none", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 50.51946723435765, "nll_per_token": 3.922358751788475, "tokens": 9217}, "diversity": {"sample_entropy": 4.078867688498713, "unique_tokens": 1928, "token_count": 8192, "distinct_1": 0.2353515625, "distinct_2": 0.7000492125984252, "top_token_mass": 0.0865478515625}}
+{"type": "summary", "name": "tpow0p7_const1p45_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "tpow0p7_const1p45_c256", "steps": 128, "temp_start": 1.45, "temp_end": 1.45, "temp_schedule": "const", "t_power": 0.7, "eta0": 0.0, "eta_schedule": "none", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 43.35758042812266, "nll_per_token": 3.7694815536399644, "tokens": 9673}, "diversity": {"sample_entropy": 4.1828232497490045, "unique_tokens": 1919, "token_count": 8192, "distinct_1": 0.2342529296875, "distinct_2": 0.6999261811023622, "top_token_mass": 0.055908203125}}
+{"type": "summary", "name": "noise_const1p45_early_linear_eta0p01_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "noise_const1p45_early_linear_eta0p01_c256", "steps": 128, "temp_start": 1.45, "temp_end": 1.45, "temp_schedule": "const", "t_power": 1.0, "eta0": 0.01, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 43.2830792498643, "nll_per_token": 3.7677617791853963, "tokens": 9566}, "diversity": {"sample_entropy": 4.186505573692286, "unique_tokens": 1932, "token_count": 8192, "distinct_1": 0.23583984375, "distinct_2": 0.7080462598425197, "top_token_mass": 0.055419921875}}
+{"type": "summary", "name": "noise_const1p45_early_cosine_eta0p01_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "noise_const1p45_early_cosine_eta0p01_c256", "steps": 128, "temp_start": 1.45, "temp_end": 1.45, "temp_schedule": "const", "t_power": 1.0, "eta0": 0.01, "eta_schedule": "early_cosine", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 42.09900669006817, "nll_per_token": 3.740024146349853, "tokens": 9539}, "diversity": {"sample_entropy": 4.165938766811043, "unique_tokens": 1875, "token_count": 8192, "distinct_1": 0.2288818359375, "distinct_2": 0.6938976377952756, "top_token_mass": 0.0592041015625}}
+{"type": "summary", "name": "noise_const1p45_mid_sine_eta0p01_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "noise_const1p45_mid_sine_eta0p01_c256", "steps": 128, "temp_start": 1.45, "temp_end": 1.45, "temp_schedule": "const", "t_power": 1.0, "eta0": 0.01, "eta_schedule": "mid_sine", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 44.031384454172304, "nll_per_token": 3.784902662702179, "tokens": 9614}, "diversity": {"sample_entropy": 4.192402841950814, "unique_tokens": 1856, "token_count": 8192, "distinct_1": 0.2265625, "distinct_2": 0.7004183070866141, "top_token_mass": 0.0552978515625}}
+{"type": "summary", "name": "noise_const1p45_early_linear_eta0p02_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "noise_const1p45_early_linear_eta0p02_c256", "steps": 128, "temp_start": 1.45, "temp_end": 1.45, "temp_schedule": "const", "t_power": 1.0, "eta0": 0.02, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 44.65909863566894, "nll_per_token": 3.7990580633975197, "tokens": 9575}, "diversity": {"sample_entropy": 4.198494329382783, "unique_tokens": 1963, "token_count": 8192, "distinct_1": 0.2396240234375, "distinct_2": 0.7079232283464567, "top_token_mass": 0.05419921875}}
+{"type": "summary", "name": "noise_const1p45_early_cosine_eta0p02_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "noise_const1p45_early_cosine_eta0p02_c256", "steps": 128, "temp_start": 1.45, "temp_end": 1.45, "temp_schedule": "const", "t_power": 1.0, "eta0": 0.02, "eta_schedule": "early_cosine", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 46.54789765723706, "nll_per_token": 3.8404818395933544, "tokens": 9563}, "diversity": {"sample_entropy": 4.189696595593963, "unique_tokens": 1908, "token_count": 8192, "distinct_1": 0.23291015625, "distinct_2": 0.7057086614173228, "top_token_mass": 0.0576171875}}
+{"type": "summary", "name": "noise_const1p45_mid_sine_eta0p02_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "noise_const1p45_mid_sine_eta0p02_c256", "steps": 128, "temp_start": 1.45, "temp_end": 1.45, "temp_schedule": "const", "t_power": 1.0, "eta0": 0.02, "eta_schedule": "mid_sine", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 46.05345631456055, "nll_per_token": 3.8298028155755612, "tokens": 9513}, "diversity": {"sample_entropy": 4.179009616612305, "unique_tokens": 1874, "token_count": 8192, "distinct_1": 0.228759765625, "distinct_2": 0.6916830708661418, "top_token_mass": 0.05712890625}}
+{"type": "summary", "name": "noise_const1p45_early_linear_eta0p05_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "noise_const1p45_early_linear_eta0p05_c256", "steps": 128, "temp_start": 1.45, "temp_end": 1.45, "temp_schedule": "const", "t_power": 1.0, "eta0": 0.05, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 45.9198653520818, "nll_per_token": 3.826897819778828, "tokens": 9574}, "diversity": {"sample_entropy": 4.198348275601427, "unique_tokens": 1907, "token_count": 8192, "distinct_1": 0.2327880859375, "distinct_2": 0.7081692913385826, "top_token_mass": 0.0552978515625}}
+{"type": "summary", "name": "noise_const1p45_early_cosine_eta0p05_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "noise_const1p45_early_cosine_eta0p05_c256", "steps": 128, "temp_start": 1.45, "temp_end": 1.45, "temp_schedule": "const", "t_power": 1.0, "eta0": 0.05, "eta_schedule": "early_cosine", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 46.75523684526139, "nll_per_token": 3.844926267541597, "tokens": 9571}, "diversity": {"sample_entropy": 4.197912062162802, "unique_tokens": 1922, "token_count": 8192, "distinct_1": 0.234619140625, "distinct_2": 0.7121062992125984, "top_token_mass": 0.0545654296875}}
+{"type": "summary", "name": "noise_const1p45_mid_sine_eta0p05_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "noise_const1p45_mid_sine_eta0p05_c256", "steps": 128, "temp_start": 1.45, "temp_end": 1.45, "temp_schedule": "const", "t_power": 1.0, "eta0": 0.05, "eta_schedule": "mid_sine", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 42.7693226634343, "nll_per_token": 3.7558210853922156, "tokens": 9628}, "diversity": {"sample_entropy": 4.183180739045019, "unique_tokens": 1860, "token_count": 8192, "distinct_1": 0.22705078125, "distinct_2": 0.6919291338582677, "top_token_mass": 0.0548095703125}}
+{"type": "summary", "name": "noise_const1p45_early_linear_eta0p08_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "noise_const1p45_early_linear_eta0p08_c256", "steps": 128, "temp_start": 1.45, "temp_end": 1.45, "temp_schedule": "const", "t_power": 1.0, "eta0": 0.08, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 44.54583377426971, "nll_per_token": 3.796518631569996, "tokens": 9463}, "diversity": {"sample_entropy": 4.1536400284735615, "unique_tokens": 1882, "token_count": 8192, "distinct_1": 0.229736328125, "distinct_2": 0.6952509842519685, "top_token_mass": 0.0660400390625}}
+{"type": "summary", "name": "noise_const1p45_early_cosine_eta0p08_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "noise_const1p45_early_cosine_eta0p08_c256", "steps": 128, "temp_start": 1.45, "temp_end": 1.45, "temp_schedule": "const", "t_power": 1.0, "eta0": 0.08, "eta_schedule": "early_cosine", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 42.21974970343552, "nll_per_token": 3.742888114014054, "tokens": 9579}, "diversity": {"sample_entropy": 4.12835095126496, "unique_tokens": 1895, "token_count": 8192, "distinct_1": 0.2313232421875, "distinct_2": 0.6998031496062992, "top_token_mass": 0.0679931640625}}
+{"type": "summary", "name": "noise_const1p45_mid_sine_eta0p08_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "noise_const1p45_mid_sine_eta0p08_c256", "steps": 128, "temp_start": 1.45, "temp_end": 1.45, "temp_schedule": "const", "t_power": 1.0, "eta0": 0.08, "eta_schedule": "mid_sine", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 44.612465411027486, "nll_per_token": 3.798013313495776, "tokens": 9352}, "diversity": {"sample_entropy": 4.105863199315936, "unique_tokens": 1820, "token_count": 8192, "distinct_1": 0.22216796875, "distinct_2": 0.6919291338582677, "top_token_mass": 0.0728759765625}}
+{"type": "summary", "name": "noise_const1p45_early_linear_eta0p12_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "noise_const1p45_early_linear_eta0p12_c256", "steps": 128, "temp_start": 1.45, "temp_end": 1.45, "temp_schedule": "const", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 46.894060450372244, "nll_per_token": 3.847891024583145, "tokens": 9397}, "diversity": {"sample_entropy": 4.130338682029675, "unique_tokens": 1959, "token_count": 8192, "distinct_1": 0.2391357421875, "distinct_2": 0.7098917322834646, "top_token_mass": 0.0697021484375}}
+{"type": "summary", "name": "noise_const1p45_early_cosine_eta0p12_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "noise_const1p45_early_cosine_eta0p12_c256", "steps": 128, "temp_start": 1.45, "temp_end": 1.45, "temp_schedule": "const", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_cosine", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 44.33293502778378, "nll_per_token": 3.7917278551775806, "tokens": 9552}, "diversity": {"sample_entropy": 4.205396118072462, "unique_tokens": 1945, "token_count": 8192, "distinct_1": 0.2374267578125, "distinct_2": 0.7105068897637795, "top_token_mass": 0.055908203125}}
+{"type": "summary", "name": "noise_const1p45_mid_sine_eta0p12_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "noise_const1p45_mid_sine_eta0p12_c256", "steps": 128, "temp_start": 1.45, "temp_end": 1.45, "temp_schedule": "const", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "mid_sine", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 44.742664272649876, "nll_per_token": 3.8009275044152275, "tokens": 9555}, "diversity": {"sample_entropy": 4.208047575760355, "unique_tokens": 1803, "token_count": 8192, "distinct_1": 0.2200927734375, "distinct_2": 0.6950049212598425, "top_token_mass": 0.0523681640625}}
+{"type": "summary", "name": "noise_linear2to08_early_linear_eta0p01_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "noise_linear2to08_early_linear_eta0p01_c256", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.01, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 48.10164682261911, "nll_per_token": 3.8733164140021152, "tokens": 9574}, "diversity": {"sample_entropy": 4.200641298969796, "unique_tokens": 1912, "token_count": 8192, "distinct_1": 0.2333984375, "distinct_2": 0.7181348425196851, "top_token_mass": 0.052978515625}}
+{"type": "summary", "name": "noise_linear2to08_early_cosine_eta0p01_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "noise_linear2to08_early_cosine_eta0p01_c256", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.01, "eta_schedule": "early_cosine", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 48.581707982325014, "nll_per_token": 3.883247081093602, "tokens": 9511}, "diversity": {"sample_entropy": 4.18684190232035, "unique_tokens": 1950, "token_count": 8192, "distinct_1": 0.238037109375, "distinct_2": 0.7247785433070866, "top_token_mass": 0.0528564453125}}
+{"type": "summary", "name": "noise_linear2to08_mid_sine_eta0p01_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "noise_linear2to08_mid_sine_eta0p01_c256", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.01, "eta_schedule": "mid_sine", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 48.2817867052147, "nll_per_token": 3.877054402694846, "tokens": 9546}, "diversity": {"sample_entropy": 4.19866648234313, "unique_tokens": 1907, "token_count": 8192, "distinct_1": 0.2327880859375, "distinct_2": 0.7100147637795275, "top_token_mass": 0.0546875}}
+{"type": "summary", "name": "noise_linear2to08_early_linear_eta0p02_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "noise_linear2to08_early_linear_eta0p02_c256", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.02, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 48.18240875879645, "nll_per_token": 3.874993990930717, "tokens": 9629}, "diversity": {"sample_entropy": 4.200519902464651, "unique_tokens": 1927, "token_count": 8192, "distinct_1": 0.2352294921875, "distinct_2": 0.7197342519685039, "top_token_mass": 0.0533447265625}}
+{"type": "summary", "name": "noise_linear2to08_early_cosine_eta0p02_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "noise_linear2to08_early_cosine_eta0p02_c256", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.02, "eta_schedule": "early_cosine", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 49.24717321473146, "nll_per_token": 3.896851969315648, "tokens": 9530}, "diversity": {"sample_entropy": 4.190932299534418, "unique_tokens": 1918, "token_count": 8192, "distinct_1": 0.234130859375, "distinct_2": 0.7204724409448819, "top_token_mass": 0.0516357421875}}
+{"type": "summary", "name": "noise_linear2to08_mid_sine_eta0p02_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "noise_linear2to08_mid_sine_eta0p02_c256", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.02, "eta_schedule": "mid_sine", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 49.82313453731583, "nll_per_token": 3.908479425103238, "tokens": 9535}, "diversity": {"sample_entropy": 4.217693530581953, "unique_tokens": 1943, "token_count": 8192, "distinct_1": 0.2371826171875, "distinct_2": 0.7095226377952756, "top_token_mass": 0.05419921875}}
+{"type": "summary", "name": "noise_linear2to08_early_linear_eta0p05_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "noise_linear2to08_early_linear_eta0p05_c256", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.05, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 48.83178019589149, "nll_per_token": 3.8883813344209366, "tokens": 9592}, "diversity": {"sample_entropy": 4.2050137794841085, "unique_tokens": 1939, "token_count": 8192, "distinct_1": 0.2366943359375, "distinct_2": 0.7265009842519685, "top_token_mass": 0.050537109375}}
+{"type": "summary", "name": "noise_linear2to08_early_cosine_eta0p05_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "noise_linear2to08_early_cosine_eta0p05_c256", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.05, "eta_schedule": "early_cosine", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 49.35257597935552, "nll_per_token": 3.8989899626804463, "tokens": 9525}, "diversity": {"sample_entropy": 4.205382906118391, "unique_tokens": 1962, "token_count": 8192, "distinct_1": 0.239501953125, "distinct_2": 0.7299458661417323, "top_token_mass": 0.0531005859375}}
+{"type": "summary", "name": "noise_linear2to08_mid_sine_eta0p05_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "noise_linear2to08_mid_sine_eta0p05_c256", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.05, "eta_schedule": "mid_sine", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 49.82670395081913, "nll_per_token": 3.90855106422597, "tokens": 9587}, "diversity": {"sample_entropy": 4.223790486496133, "unique_tokens": 1959, "token_count": 8192, "distinct_1": 0.2391357421875, "distinct_2": 0.7219488188976378, "top_token_mass": 0.051025390625}}
+{"type": "summary", "name": "noise_linear2to08_early_linear_eta0p08_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "noise_linear2to08_early_linear_eta0p08_c256", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.08, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 49.12591398887004, "nll_per_token": 3.894386675387748, "tokens": 9639}, "diversity": {"sample_entropy": 4.217049731211352, "unique_tokens": 1962, "token_count": 8192, "distinct_1": 0.239501953125, "distinct_2": 0.7287155511811023, "top_token_mass": 0.051513671875}}
+{"type": "summary", "name": "noise_linear2to08_early_cosine_eta0p08_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "noise_linear2to08_early_cosine_eta0p08_c256", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.08, "eta_schedule": "early_cosine", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 46.47073894768385, "nll_per_token": 3.838822844577599, "tokens": 9591}, "diversity": {"sample_entropy": 4.206427871276884, "unique_tokens": 1922, "token_count": 8192, "distinct_1": 0.234619140625, "distinct_2": 0.718873031496063, "top_token_mass": 0.053466796875}}
+{"type": "summary", "name": "noise_linear2to08_mid_sine_eta0p08_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "noise_linear2to08_mid_sine_eta0p08_c256", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.08, "eta_schedule": "mid_sine", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 49.95328576578725, "nll_per_token": 3.911088284027923, "tokens": 9562}, "diversity": {"sample_entropy": 4.222333312252868, "unique_tokens": 1974, "token_count": 8192, "distinct_1": 0.240966796875, "distinct_2": 0.7234251968503937, "top_token_mass": 0.0513916015625}}
+{"type": "summary", "name": "noise_linear2to08_early_linear_eta0p12_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "noise_linear2to08_early_linear_eta0p12_c256", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 45.858783855541894, "nll_per_token": 3.8255667584462514, "tokens": 9677}, "diversity": {"sample_entropy": 4.225998514820446, "unique_tokens": 1983, "token_count": 8192, "distinct_1": 0.2420654296875, "distinct_2": 0.717888779527559, "top_token_mass": 0.0540771484375}}
+{"type": "summary", "name": "noise_linear2to08_early_cosine_eta0p12_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "noise_linear2to08_early_cosine_eta0p12_c256", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_cosine", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 46.82628279884142, "nll_per_token": 3.8464446435521538, "tokens": 9635}, "diversity": {"sample_entropy": 4.213082036146694, "unique_tokens": 1911, "token_count": 8192, "distinct_1": 0.2332763671875, "distinct_2": 0.7100147637795275, "top_token_mass": 0.0517578125}}
+{"type": "summary", "name": "noise_linear2to08_mid_sine_eta0p12_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "noise_linear2to08_mid_sine_eta0p12_c256", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "mid_sine", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.38313453813254, "nll_per_token": 3.858266353953321, "tokens": 9643}, "diversity": {"sample_entropy": 4.222067649767945, "unique_tokens": 1930, "token_count": 8192, "distinct_1": 0.235595703125, "distinct_2": 0.7165354330708661, "top_token_mass": 0.049560546875}}
+{"type": "summary", "name": "tpow1p5_noise_linear2to08_early_cosine_eta0p02_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "tpow1p5_noise_linear2to08_early_cosine_eta0p02_c256", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.5, "eta0": 0.02, "eta_schedule": "early_cosine", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 41.43285220336455, "nll_per_token": 3.7240740976338587, "tokens": 9595}, "diversity": {"sample_entropy": 4.144170494681995, "unique_tokens": 1750, "token_count": 8192, "distinct_1": 0.213623046875, "distinct_2": 0.6658464566929134, "top_token_mass": 0.058837890625}}
+{"type": "summary", "name": "tpow1p5_noise_linear2to08_mid_sine_eta0p02_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "tpow1p5_noise_linear2to08_mid_sine_eta0p02_c256", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.5, "eta0": 0.02, "eta_schedule": "mid_sine", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 40.688636689981976, "nll_per_token": 3.7059488566595253, "tokens": 9569}, "diversity": {"sample_entropy": 4.138078246400767, "unique_tokens": 1847, "token_count": 8192, "distinct_1": 0.2254638671875, "distinct_2": 0.6857775590551181, "top_token_mass": 0.0615234375}}
+{"type": "summary", "name": "tpow1p5_noise_linear2to08_early_cosine_eta0p05_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "tpow1p5_noise_linear2to08_early_cosine_eta0p05_c256", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.5, "eta0": 0.05, "eta_schedule": "early_cosine", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 43.72608758972266, "nll_per_token": 3.777944894002364, "tokens": 9572}, "diversity": {"sample_entropy": 4.146192054211393, "unique_tokens": 1811, "token_count": 8192, "distinct_1": 0.2210693359375, "distinct_2": 0.6766732283464567, "top_token_mass": 0.0582275390625}}
+{"type": "summary", "name": "tpow1p5_noise_linear2to08_mid_sine_eta0p05_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "tpow1p5_noise_linear2to08_mid_sine_eta0p05_c256", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.5, "eta0": 0.05, "eta_schedule": "mid_sine", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 40.41088438525592, "nll_per_token": 3.6990991641579036, "tokens": 9581}, "diversity": {"sample_entropy": 4.153850742833741, "unique_tokens": 1818, "token_count": 8192, "distinct_1": 0.221923828125, "distinct_2": 0.6948818897637795, "top_token_mass": 0.06103515625}}
+{"type": "summary", "name": "tpow1p5_noise_linear2to08_early_cosine_eta0p08_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "tpow1p5_noise_linear2to08_early_cosine_eta0p08_c256", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.5, "eta0": 0.08, "eta_schedule": "early_cosine", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 42.80336239844838, "nll_per_token": 3.7566166602134308, "tokens": 9564}, "diversity": {"sample_entropy": 4.142722771044542, "unique_tokens": 1834, "token_count": 8192, "distinct_1": 0.223876953125, "distinct_2": 0.6817175196850394, "top_token_mass": 0.0576171875}}
+{"type": "summary", "name": "tpow1p5_noise_linear2to08_mid_sine_eta0p08_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "tpow1p5_noise_linear2to08_mid_sine_eta0p08_c256", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.5, "eta0": 0.08, "eta_schedule": "mid_sine", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 41.16435120941998, "nll_per_token": 3.71757261989304, "tokens": 9659}, "diversity": {"sample_entropy": 4.162179467920619, "unique_tokens": 1837, "token_count": 8192, "distinct_1": 0.2242431640625, "distinct_2": 0.6884842519685039, "top_token_mass": 0.0582275390625}}
+{"type": "summary", "name": "noise_linear2to08_early_cosine_eta0p01_c1024", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "noise_linear2to08_early_cosine_eta0p01_c1024", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.01, "eta_schedule": "early_cosine", "noise_conc": 1.0, "concentration_max": 1024.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 46.75827674418147, "nll_per_token": 3.8449912827207826, "tokens": 9455}, "diversity": {"sample_entropy": 4.14898724091752, "unique_tokens": 1836, "token_count": 8192, "distinct_1": 0.22412109375, "distinct_2": 0.6947588582677166, "top_token_mass": 0.05419921875}}
+{"type": "summary", "name": "noise_linear2to08_early_cosine_eta0p02_c1024", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "noise_linear2to08_early_cosine_eta0p02_c1024", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.02, "eta_schedule": "early_cosine", "noise_conc": 1.0, "concentration_max": 1024.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 45.648558001763085, "nll_per_token": 3.8209720184098184, "tokens": 9370}, "diversity": {"sample_entropy": 4.153952417528344, "unique_tokens": 1824, "token_count": 8192, "distinct_1": 0.22265625, "distinct_2": 0.687623031496063, "top_token_mass": 0.0555419921875}}
+{"type": "summary", "name": "noise_linear2to08_early_cosine_eta0p05_c1024", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "noise_linear2to08_early_cosine_eta0p05_c1024", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.05, "eta_schedule": "early_cosine", "noise_conc": 1.0, "concentration_max": 1024.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 46.266957384208816, "nll_per_token": 3.8344280429052167, "tokens": 9407}, "diversity": {"sample_entropy": 4.169058739359141, "unique_tokens": 1815, "token_count": 8192, "distinct_1": 0.2215576171875, "distinct_2": 0.6929133858267716, "top_token_mass": 0.0540771484375}}

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_diffusion_noise_steps_128steps_n64/tpow1p5_noise_linear2to08_early_cosine_eta0p02_c256_detok_raw_samples.txt

@@ -0,0 +1,230 @@
+tpow1p5_noise_linear2to08_early_cosine_eta0p02_c256_detok
+{
+  "type": "summary",
+  "name": "tpow1p5_noise_linear2to08_early_cosine_eta0p02_c256",
+  "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt",
+  "step": 187000,
+  "decode": {
+    "kind": "categorical_fullvocab_diffusion_state_noise",
+    "config": "tpow1p5_noise_linear2to08_early_cosine_eta0p02_c256",
+    "steps": 128,
+    "temp_start": 2.0,
+    "temp_end": 0.8,
+    "temp_schedule": "linear",
+    "t_power": 1.5,
+    "eta0": 0.02,
+    "eta_schedule": "early_cosine",
+    "noise_conc": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 41.43285220336455,
+    "nll_per_token": 3.7240740976338587,
+    "tokens": 9595
+  },
+  "diversity": {
+    "sample_entropy": 4.144170494681995,
+    "unique_tokens": 1750,
+    "token_count": 8192,
+    "distinct_1": 0.213623046875,
+    "distinct_2": 0.6658464566929134,
+    "top_token_mass": 0.058837890625
+  }
+}
+
+===== sample 000 =====
+[CLS] meetings he will have to hold in his new york term. [SEP] however, obama has been far more willing to give more troops and obama's promise to detail how u. s. troops remain under the command. [SEP] who says in these days what? [SEP] however, the army did reject professor zin young's account of the work in the 1990s. [SEP] (ap) - police for the first time in a few months arrested a man accused of killing a 16 - year - old girl and wounding a 13 - year - old girl on tuesday afternoon. [SEP] but, when john edwards's former kansas city manager was sc [SEP]
+
+===== sample 001 =====
+[CLS] south of san city. [SEP] it is just an awful situation, and i think it will be important to make sure the search continues as a partner and this one is successful. [SEP] but one man who has actually played a first ball is a woman with patchless black hair, holding her son by the side. [SEP] burpes, like his father, stanley crick, said he knows he can't get a word of that. [SEP] tim j. hodeman, president of new york's board of economic and foreign relations, has been elected to a second term in the post from the current mayor richard c. [SEP]
+
+===== sample 002 =====
+[CLS]zri, who was vice president of the vaccine program at murati university medical center, indicated to the agency's general director that he was careful not to be burdened by the matter. [SEP] we also need to quit. [SEP] in asia, the region's stock trading average rose 0. 2 percent, also in singapore dollars. [SEP] at the end of the first half, cal got hit by a series of mistakes. [SEP] if the two countries were able to settle their own deepening relationship with washington, then that country has a go back and europe is focused on iran and u. s. nuclear activity. [SEP] [SEP]
+
+===== sample 003 =====
+[CLS] and chairman carl icahn. [SEP] and i'll have the chance to see what's like, i think, about the natural formality in music, beauty, and dress clothes. [SEP] but mr thomas was backed by george harrison, the chairman of the committee. [SEP] when he looked ahead the bank of england's decision on tuesday to leave interest rates at record territory by another 0. 5 per cent. [SEP] that's what i'm probably really excited about right now. [SEP] "i loved myself but i knew before i got to the station i had to do something that was do it," he says [SEP]
+
+===== sample 004 =====
+[CLS] "and we're getting a lot of this now - - every time he's into this, it's going to happen," he said. [SEP] he was always concerned with the use of liberal liberalism, state schools and politics. [SEP] 23 - - the season's final battle is over: her friend diaridi siddi, a 25 - year - old senior, and a single father and their two - year - old daughter, have failed to find out. [SEP] " i don't know i'm, i'm thinking about standing up for that this year - and hopefully it's not [SEP]
+
+===== sample 005 =====
+[CLS] the live - talk show. [SEP] " i'm aware of what's going to be going on. [SEP] some employees will go back down again. [SEP] this is more convenient for the baby - boomers. [SEP] the hornets opened 13 minutes into the second half on 1 - of - 7 shooting from the field, and closed with a 17 - 3 run by t. w s. u. s., however. [SEP] in 2008 the government's parliamentary office began the build - up in april - june. [SEP] the group also rose by 7. 7 % to us $14. 2m. [SEP] a mexican official [SEP]
+
+===== sample 006 =====
+[CLS]p. [SEP] japan party spokesman taro aso says the full end of the japanese fleet won't come until april next year, but he has no timetable for re - starting operations. [SEP] the move led to his next visit to india and the united states, which are in the final 18 months after the elections. [SEP] this is not practical though. [SEP] with such a result, i won't be surprised. [SEP] john hoon, the environment secretary, said the ship at the centre of the impact of the storm is expected to have been on its way up britain's coast on thursday. [SEP] in a few days [SEP]
+
+===== sample 007 =====
+[CLS]. [SEP] the first session was started at a winner's table three times by mr bush. [SEP] if they want to ask someone they want to live, the government should not have to buy one, not because they want to practise their diets. [SEP] "people will be the right person to change a president's course," mr. mccain said on thursday, she said, and " people don't say what we're seeing if we do not pass a bill of change. [SEP] jones, with former executive and chairman john smith, cpr's general manager, richard bowden, and president, [SEP]
+
+===== sample 008 =====
+[CLS] federal government lifted a repositioned tax on spending and the company recorded a $2. 5 billion loan. [SEP] the only difference, for example, is greater luck. [SEP] the short - term price is about $5, 000. [SEP] that's the way it's going to be in the first place, but the president has to make it for the better, " said one co - president, john johnson. [SEP] but he is 11 - 6 - 2 with the cubs, who run the majors nine times a year. [SEP] we'll be sending their own troops to stay their course. [SEP] orlando, fla [SEP]
+
+===== sample 009 =====
+[CLS] the most important thing you can do here in the wrong places. [SEP] and last year, dallas and new york city were two hours away. [SEP] it was the third move in 14 weeks. [SEP] at the end of life, i am my god and i want to better myself first. [SEP] environmental groups have accused the drug trade of promoting a demand for tax dollars. [SEP] "in the last year, i have received quite several e - mails," she said in a telephone interview. [SEP] the group said in september it raised $2. 2 billion in december 2003. [SEP] it is not known how many charges will be heard [SEP]
+
+===== sample 010 =====
+[CLS] you more, and recognize the need for change. [SEP] she stressed the importance of a meeting with national leaders to discuss reaffirming the ramifications of the new deal. [SEP] liverpool have been stuck to the back of the league with middlesbrough and they will remain alive in a firm position at the top of the table. [SEP] some would take it away. [SEP] to hear more of that, do you feel right? [SEP] analysts' consensus was worth $5. 13 a share and was up 8 to 4 percent. [SEP] so mr corby's account at the other end wasn't very good, but instead it [SEP]
+
+===== sample 011 =====
+[CLS] and lead to the opening of the border, officials said. [SEP] oh, and she's probably been of a better kind. [SEP] los angeles, california - - president george w. bush has flown to new york this month to meet his chinese counterpart, and new chinese president hu jintao will also visit his japanese counterpart during a white house visit next month. [SEP] my kids were like, ' i'm the younger girl to take care of these things. ' " agreed. [SEP] south korea's central bank governor was expected to announce the deal in a press conference in tokyo with japan's senior leaders. [SEP] john gr [SEP]
+
+===== sample 012 =====
+[CLS]. [SEP] u. s. oregon state at washington, 1 p. m. [SEP] i like the idea of interest in the great outdoors. [SEP] not only is he going to find himself on the firing line today, however, he needs to make sure he understands how to make people control their own lives by creating his own personal preferences, as well as to teach people in how to work with different people and others. [SEP] not all i can see, that john hilfen, captain of kevin pietersen, andrew symonds and paul collingwood, came to a new role as england captain, but he will probably be wiser [SEP]
+
+===== sample 013 =====
+[CLS] the shooting dead, the nature of the blast remains unclear. [SEP] for a long time, mcgwire said: "i just have to play because of it, and i love it. [SEP] the us dollar fell 3 per cent to euro7. 018. 40 against the euro dollar and 0. 5 per cent to $1. 3699. [SEP] microsoft's stock value in 2008 was worth $12. 2 billion. [SEP] there are some significant concessions being made, however. [SEP] why can't we live in denial about the creation of a democratic system, an" open society, " and something that the [SEP]
+
+===== sample 014 =====
+[CLS] out, but gary johnson opened the scoring with a shot to second in the dugout and wright outplayed the man. [SEP] he can't get down to the fact that the people are revolted. [SEP] " it is now easy to have to. [SEP] the ftse asia pacific index lost 4. 9 points to 37. 47 per cent as government figures failed to show growth rates of countries emerging from india, china, japan and the united states, a source said. [SEP] yet even on clinton's side, administration and military officials have suggested that the overall force in u. s. troops remains far short of that [SEP]
+
+===== sample 015 =====
+[CLS]'d like to see this as appropriate. [SEP] the success of the city seems to lie with its lack of roads, bridges, as well as government, infrastructure and infrastructure to help the poor. [SEP] "i'm honest. [SEP]" i try to get something into the press - i want the talks to go, "mugabe says. [SEP]" they don't at all, " she said. [SEP] in the two days before she intended to play at ohio state, she revealed she was putting her hand in his pocket again. [SEP] g. a..: i think you'll have to ask them how they [SEP]
+
+===== sample 016 =====
+[CLS] will continue on its own. [SEP] the police say the family, who arrived in the area in february of friday, is expected to talk to them about peterson's role in the killings. [SEP] finally, he says he will not separate his faith from the rest of his family, and he wants more personal understanding of judaism and its role in the modern world. [SEP] in the 1990s, he was the first vice president to see su suharto, a former president of the world economic council, dismissed. [SEP] but let's not say that's been such a bad start to the year. [SEP] u. s. defense [SEP]
+
+===== sample 017 =====
+[CLS] s eve, president obama tried to distance himself from the candidate's rivals. [SEP] all night, it's all about doing bad things. [SEP] "it's the best time for me," he said. [SEP] his adviser, robert gibbs, was one of the most senior foreign figures in the administration, and officials have been critical of mccain's overall strategy in afghanistan for the next three years. [SEP] he's just too young to become a part of the show, ' i guess. [SEP] the loss is expected to be about $27 billion, with assets worth more than $15 billion. [SEP] it's [SEP]
+
+===== sample 018 =====
+[CLS] the decision to pull out of a two - week game, he said in a statement. [SEP] the u. s. military said sunday that it will take a decision, but said it will see if this too is happening. [SEP] " she's a woman who is not out for spending my money.... [SEP] this is why i was asked. [SEP] t. j., who announced a deal to start the trade at the end of the year, made $500, 000 available. [SEP] but ms. palin's run for the senate came after a series of meetings with the gop campaign at a state [SEP]
+
+===== sample 019 =====
+[CLS] flitting it. [SEP] " i am going to see the referee, but he's wrong. [SEP] the report is based on the results of the eu's top banks, the agency said. [SEP] the match began late sunday afternoon as woods and the players prepared for the second game of play on the course. [SEP] aig announced credit losses of more than $40 billion related to the u. s. market last year as it sold $21. 4bn in federal loans. [SEP] the price of a gallon, a national gauge of heating fuel, fell 3. 25 percent to 70. 71 cents. [SEP] they can [SEP]
+
+===== sample 020 =====
+[CLS]. [SEP] the government never figured it out. [SEP] three of the top u. s. national security officials - - french, french, german and german - - would not speak after talking of second - generation left - handers. [SEP] the best, you know, just make up your mind, but when you mung on a head down your thighs, there is a hot - tubing trick. [SEP] one thing you forget is that you're an idealistician. [SEP] a job for their children here, and today, they'll be missing. [SEP] the indians met last summer in the last meeting in a series of [SEP]
+
+===== sample 021 =====
+[CLS] post in 2005. [SEP] this is about a few times children are leading the country through their family's experience - - not the same time in europe. [SEP] under the new five - year contract, the council says the size of the existing supply could be reduced from the current 1. 1 to 2. 2 - and increase the capacity to be used to build new nuclear reactors. [SEP] "a lot of players, we're going to go around in the second half, i'll tell you a few times," wetterich said wednesday of the game. [SEP] richard wortley, senior group information officer at the [SEP]
+
+===== sample 022 =====
+[CLS] national elections. [SEP] james j. weis, the senior vice president for long - term and government operations, is also the vice president of financial services and human - care solutions. [SEP] the current crop of hardliners, many of mr obama's own, leads the struggle to pass something. [SEP] ms barwell's family include john and sally, 41, and parents of three children, will parry, peter davies and david jones. [SEP] still, i would like to know how some good good advice has come out of the end these days. [SEP] last week, smith, 27, from tredeydd, mont [SEP]
+
+===== sample 023 =====
+[CLS] south africa. [SEP] in fact, almost 1, 000 % of total spending for 2008 and 2009 - 10 suggested the drop in 2010 would be just 0. 2 %. [SEP] manager kevin davies said: " the course is delighted to be included in the list of the number of golfers. [SEP] their parents won't want them to be friends. [SEP] his theories have been told. [SEP] the senate included members of the powerful democratic party who criticized the convention process but did not sign the agreement, with more than two million americans expected to attend. [SEP] it is a shocking nature that a place has been found; that the need for [SEP]
+
+===== sample 024 =====
+[CLS] nfl's top nfl team since 2002. [SEP] mark steedt, the host of the television show "good morning," confirmed that the show was moving next week's program to air. [SEP] the ofcom is understood to have been involved, but added that he wants to review the status of the case. [SEP] he made clear on sunday that china's president, mr. wen, would sign the deal. [SEP] the prime minister had hoped to be met by union leaders and all the union leaders. [SEP] yes, it would have a cost of more than $4, 000 per bottle. [SEP] some of the uk [SEP]
+
+===== sample 025 =====
+[CLS] with the communist state, and the rising flow of north korean nuclear technology. [SEP] dr kabiri said: "we would know this at hospitals and clinics. [SEP] one - half of californians' smokers smoke pot. [SEP] the school, particularly the courtroom, is overcrowded. [SEP] it's a good story - - justift. [SEP] there are almost no changes to the national course, which has given me all that left of my life. [SEP]" it was a very positive development. [SEP] obama's speech is a strongest speech i've heard, and i've heard in the past. [SEP] [SEP]
+
+===== sample 026 =====
+[CLS] countries to take action on their financial and economic activities. [SEP] "concern at the time was that we'd have to step in to press the table and get it back," he said, while sung sung kim, the head of the north's negotiating team, would not disclose the results of the negotiations. [SEP] about 12 percent of those workers are over - 55 and 25 percent those in their professions will or will lose their jobs. [SEP] aides say it will cost more. [SEP] mr. buffett has been in charge of global finance for nearly 20 years and has been under management. [SEP] this show will be led by [SEP]
+
+===== sample 027 =====
+[CLS] year - old senior, had a big victory over hoosier colo. [SEP] the secretary of state john denham, said she questioned whether the course of the meeting would be changed. [SEP] following president obama's decision to continue his economic relationship with the united states, he has stepped up his strategy of working against the spread of the markets in asia. [SEP] certainly, he would be more comfortable with someone who would never get the show in the same league. [SEP] "at the start of the year, the building will be at least a $400, 000," said heyman, who said the outlook was strong. [SEP]
+
+===== sample 028 =====
+[CLS] people's safety. [SEP] even so, they said, the effect disappeared. [SEP] the city mayor, mayor, the fire commissioner, the city manager would have been in the position to get the fire out of the city, "uncontroen said. [SEP] the first, greg norman and ernie els were tied at second. [SEP] and at the white house's first such meeting, the president was considering the timetable for the full extension of the troop surge. [SEP]" we're very pleased with it and the merger, " michael white, the company's interim chief executive, said. [SEP] but netanyahu [SEP]
+
+===== sample 029 =====
+[CLS]. [SEP] he said that football is important to the future of the world, and the future as in the past, could be potentially life - changing. [SEP] they even tried to get past the street on the streets of bangkok to see if there was any street fighting. [SEP] one week, the redskins head coach avery johnson was sent to the team's n. b. a.'s, where the coach says all the good news is false. [SEP] but this is the west's fate. [SEP] harrington also scored 22 points and j. b. holmes, who had 15 points during its five - game run in the past [SEP]
+
+===== sample 030 =====
+[CLS], the best way to travel to that is self - sacrifice. [SEP] and once it is, there is it, because for thousands of weeks, the kids travel around each fall, and people spend their time relaxing in bed. [SEP] many officials in obama's own party have disagreed. [SEP] the others were fleeing, with extreme winds, he said. [SEP] i have been one of the officials working in the national league and i want to keep playing the game during the playoffs. [SEP] one of the issues now has the hands of a reluctant todd helton, who has thrown a strike - out, no - hitter. [SEP] " the [SEP]
+
+===== sample 031 =====
+[CLS] five decades in power, particularly in the military. [SEP] he was denied health insurance. [SEP] she said she has sometimes retired to brick houses and lost a few friends. [SEP] you only have to think of the pols who's calling for president bush, mr. w. bush's economic team, his children's school war buddies, neocons that aren't talking anymore. [SEP] "it shows that there's still a financial crisis, that's broken," said john d. casey jr., a republican who led the president's council of staff of advisors. [SEP] it was the kind of [SEP]
+
+===== sample 032 =====
+[CLS] second - quarter, 12 - yard drive. [SEP] "i am proud as a man," he said. [SEP] "i'll have a great year for him and i'm sure it's worth it to be at the national level. [SEP]" i am sure the game was really tough, and that is going to be tough, "he said. [SEP] but to ensure that was consistent with the rules of baseball, i suggested that he talks about the golf ball, the ball, and found what i know as" the ball ball " (yes golf balls) lying in the grass. [SEP] the state's transportation [SEP]
+
+===== sample 033 =====
+[CLS]vili's visit monday with turkey in order to assess the situation. [SEP] as the top contenders in the state democratic party, obama and hillary clinton, a former presidential candidate, have become increasingly frustrated at the outcome because of their differences in the legislation. [SEP] he still didn't get excited about mike shanahan going after mike wallace - - that's peyton manning - - last summer. [SEP] new york, october 2, 2009. [SEP] a us diplomat has linked a controversial missile shield with a nuclear program to bolster international relations with the bush administration, the state news agency said sunday. [SEP] the commission's annual report [SEP]
+
+===== sample 034 =====
+[CLS] los angeles. [SEP] that's what we're looking for in terms of the impact of energy. [SEP] you think about "obama.".. well.... [SEP] wrahn has dismissed the idea of mgm mirage, which lost ownership of the company and had gambling operations at the time, then eventually agreed to off the operations in 2008. [SEP] but after cuomo's speech, he had to be booted from congress to resign. [SEP] if it is serious and is comprehensive, it will require too much financial effort. [SEP] " i've had to travel through the past two months, i've [SEP]
+
+===== sample 035 =====
+[CLS] or protect the workers, according to the general assembly. [SEP] the home secretary paul grie and sir david rowlands, members of london's london development committee, have written to mr cameron to investigate the matter. [SEP] does anyone think about america's children? [SEP] and the cost of each such account will still grow by $3, 000 a month. [SEP] if you've got a guy at a company, it's more of a place to go to put it. [SEP] it is not clear whether the city's plans will match that commitment. [SEP] yes, local people in public school and broadcast channels will be [SEP]
+
+===== sample 036 =====
+[CLS] members of the council said this average annual price rise would be equivalent to the number of pounds per ton of food and milk in 2009. [SEP] dry tone. [SEP] he's not falling behind because he is close to the top. [SEP] speaking after yesterday's hearing, britain confirmed that the man in iran had been identified and of british nationality had been arrested in switzerland, and said the rest of the accused was being deported for trial in iran. [SEP] "it's nothing like that, it's just a lack of effort," he said. [SEP] nearly half of those "very satisfied" on the economy, about a [SEP]
+
+===== sample 037 =====
+[CLS] and john adams, the "politicians at war" man. [SEP] in the last post - primary - care meeting in california, in june 2007, the clintons expressed doubts about the nature of the dispute. [SEP] a decade more and more of that imports have shot up to $3 billion dollars a day, around two - quarters of us total exports. [SEP] total sales for us commercial and industrial companies rose by $14. 3 billion in the quarter to $15. 9 billion, up from the quarter's record $14. 3 billion. [SEP] will the pain end? [SEP] john hutton, the treasury secretary, will call on [SEP]
+
+===== sample 038 =====
+[CLS] boy's home hours before the boy's mother was called to the hospital, police said. [SEP] the union also says the union did not respond to duncan's response to the case. [SEP] if there's a wild thing happening in los angeles, though, here's just a little bit of it. [SEP] nick clegg, the french president, hopes that he will spend the weekend thinking about his team's future. [SEP] i now believe it's the best they can get out of their minds. [SEP] " i thought it was like that in the first race i'd be here. [SEP] then [SEP]
+
+===== sample 039 =====
+[CLS] role of the u. s. to ensure the security of the country's military and other countries. [SEP] the french government has launched a boutique perfume business, the world's biggest clothing company, out of government control. [SEP] allen, the rookie of the year west conference, is set at no. 5. [SEP] 11 (upi) - - an analysis of the health reasons for a baby child with chronic oestrues are "very much mine," reuters says. [SEP] this year it takes only nuclear (nato) bombs against missile attacks in iraq and other countries, the state department said friday. [SEP] the republican [SEP]
+
+===== sample 040 =====
+[CLS] in 2005. in this case, the goal is to restore the health of the credit system. [SEP] and that said, if a politician couldn't have seen his own party do better, stop laughing. [SEP] enjoy the holidays. [SEP] the president has demanded a diplomatic response to tehran over the country's controversial nuclear weapons program. [SEP] the shares rose 0. 3 per cent yesterday, which had been ahead of its share offering to raise $3. 55 billion from the government's last offer. [SEP] " but there's not a lot for a player, and he's not the best captain, and we're [SEP]
+
+===== sample 041 =====
+[CLS] one - of - a - kind tournament. [SEP] by then the whole point of this is clear: there will still be only 60, 000 police checkpoints to shut down. [SEP] this happened since that would be legal for pakistan..... they should have been allowed to come home. [SEP] chinese authorities have concluded china's new strategic economic plan to boost energy trade with russia, from a military threat to a nuclear attack, state state media reported friday. [SEP] police asked the public defender's office to issue a notice for the public to contact, the chicago tribune reported wednesday. [SEP] "this war," said mr [SEP]
+
+===== sample 042 =====
+[CLS] will outline his decision in the president's weekly address. [SEP] if not, that doesn't mean that this article just raises so many political points. [SEP] the former soldier has struck a deal in being head of national news agency. [SEP] time is the fastest rate rate on the internet one day, with my clock running through the last half of the whistler. [SEP] bob attwell and his wife, rose, 30, were brought up by south africans so they could see the relationship between black and white. [SEP] sarin and her husband rong arrived in japan on thursday after a two - day trip to help their children [SEP]
+
+===== sample 043 =====
+[CLS] driving at the end of the road. [SEP] the film is being sold in a museum. [SEP] i remember, i'd never to do this before, so now i'm looking in the same direction. [SEP] we've seen john mccain struggle in the last election, and the public has come out. [SEP] the official, vice foreign minister yang jie - ho, a vice president, came to beijing at a news conference to announce the outcome of the presidential election thursday. [SEP] it is a common disease in india. [SEP] a 12 - year - old boy with a friend who drove himself to iraq with his family, who [SEP]
+
+===== sample 044 =====
+[CLS] obama in november, is enough to give the city the title of the biggest in 2009. [SEP] that's why it is looking into this point in the hope of finding ways to make carbon gas and coal, and we would all like them to be very sensitive to it. [SEP] but they can't do it because they can't afford it. [SEP] well, then, don't you? " [SEP] the south insists the talks are dominated by dialogue, but says it has at least the right to sever relations with the north. [SEP] i do agree, but in a 60 second question about how americans feel they should [SEP]
+
+===== sample 045 =====
+[CLS] critical film and tv coverage of the singer's death. [SEP] in a recent health care study by lamb and other researchers at the university's university school of medicine, the main focus was not to predict human development, but rather to make it affect a child's knowledge of a sport, or religion or ethnicity. [SEP] he has plenty to cut here, of course. [SEP] police do not contact the students, who do not want to be held over for a day or so, before the damage has been done to them. [SEP] he should be packed with the players to play the ball. [SEP] i don't want to [SEP]
+
+===== sample 046 =====
+[CLS] "she said. [SEP]" he's going to be involved in, and transform, many of the l. a. s.'s movements in the president's history and the needs of the american people. [SEP] in the 18 - month action, he was eliminated in the quarterfinals of the national football league championship on saturday. [SEP] the college is a leader in 13, 000 community schools in philadelphia and minnesota. [SEP] mr mccain's popularity was further undermined by more radical policies. [SEP] at the same time, humana said the company was in compliance with its code of conduct and had received no formal complaints. [SEP] [SEP]
+
+===== sample 047 =====
+[CLS] is the language moved out of the art to the man. [SEP] since then, while many western leaders, including some arab allies, have complained that iran has been exploiting the region - - and wanting to join the fighting - - the iranian authority took responsibility for parts of the capital and northern gaza strip, the associated press reported. [SEP] it's like someone who's been in the job right now, and that is going to change the world - - is really impressive, "he said. [SEP]" this month coincides with three tiger deaths in los angeles, california.... [SEP] the white house said " an [SEP]
+
+===== sample 048 =====
+[CLS]. [SEP] "we were going to get involved, go with people around the world, and see if we could possibly help. [SEP] he's another football coach. [SEP] still, sunday's victory over florida came in the case of their defense, which was on the extra points. [SEP] mr brown said his team was still working on the matter, but his analysis is still" important "to both britain and germany. [SEP]" life is fine, i've never had that sense of humour. " [SEP] wildlife officials say that 60 percent of the land in northern ireland is now occupied. [SEP] the five room art gallery has drawn [SEP]
+
+===== sample 049 =====
+[CLS], 18 months. [SEP] the administration is looking to ways to double the number of foreign students from developing countries over the next half - century. [SEP] congress has been able to enact legislation in the past. [SEP] she started at her high school before she went to liverpool's primary medical school and was at the university of reading studying maths. [SEP] the u. s. military was trying for the second time to prove its claim that the somali government was working for the group. [SEP] hi, then again, mr.. [SEP] officials say thousands of people have died in bangladesh on monday in a series of recent storms. [SEP] the [SEP]
+
+===== sample 050 =====
+[CLS] mccain decided not to comment on the nature of u. s. diplomatic work in iraq and will continue with the obama administration, according to the officials who were briefed on the subject yesterday. [SEP] north korea also agreed to work on its maritime border with china, which opened in the wake of south korea's long self - rule, and it gave it the new impetus to engage in direct talks with the north. [SEP] the company is asking parents to take a 17 - year - old engineering student at the school to mark the start of a tem's day. [SEP] it was a full, head - to - head look [SEP]
+
+===== sample 051 =====
+[CLS] urged everyone to have sex, " he said. [SEP] portland, ore., may 18 (upi) - - oregon's state - run newspaper monday said a loan to the bank china national corp of china, would cover the foreign assets. [SEP] the assembly democrats had demanded a $2. 13 billion. [SEP] america needs to make yet another mistake, to eliminate the need to protect our own citizens. [SEP] following the death of dorothy davies, the 19 - year - old british film star who had an accident on her first space flight in 1972 and moved on from milburn in 1972. [SEP] the report has cited cbs news [SEP]
+
+===== sample 052 =====
+[CLS] said. [SEP] with the season running out, the french team have been playing the best tournament of their rivals, with the women's game, the world cup in africa and the wallabies cup. [SEP] cate, who is famous for the short film on the wire, died in 1984, after more than 30 years in prison. [SEP] in short, this is to the end - - and that's not only about the message but the message of it. [SEP] stephanie smith, a 27 - year - old product manager at the plant, said her company did not get involved in the case. [SEP] hours of mourning at [SEP]
+
+===== sample 053 =====
+[CLS] new york post reports. [SEP] last month, pakistan announced that it has been arrested and hundreds of armed forces and security officials were deployed to hunt suspected anti - communist militants based in the neighbouring state of punjab. [SEP] last year, officials on one of the town's roads warned that heavy snow was increasing in the area and flooding, flooding and other tornadoes could hit the village as early as friday. [SEP] the unemployment rate for people under 25 fell by 0. 4 percentage points in may to 87. 9, according to the national bureau of statistics. [SEP] southern california is struggling with an overflow of funding that has been limited to the [SEP]
+
+===== sample 054 =====
+[CLS] the us - controlled japanese market. [SEP] sutano said she already had no idea of the film after the year, but she said she agreed with the idea of the film. [SEP] high school football personnel, along with the st. john patrick's players, also will receive about $1. 2 million each. [SEP] mr. parker, also from atlanta, ga., had dropped about $4 a barrel to about $14. 50 in new york stock trade. [SEP] it's not just going to be used for the stuff and stuff. [SEP] when the subaru was, however, switched to the green car, [SEP]
+
+===== sample 055 =====
+[CLS] challenge from kentucky trainer mike smith, and is still trying to keep his momentum for the race of the year, cementing his serious quest to win saturday's derby race. [SEP] it's a great deal of money and i haven't had enough money to find a new job, "he said. [SEP]" i tell you that anytime he comes to school, he's doing anything, he's like an athlete, he can't be just a non - pro player. [SEP] she didn't want to say all, " he said. [SEP] a state department official said the u. s. treasury has [SEP]
+
+===== sample 056 =====
+[CLS] - aged girl. "[SEP] the only other gop hopeful won a two - year term, a new york senator. [SEP] aig, who also directed the two - minute film, was no less optimistic. [SEP]" we have lots of people left struggling to make up ground, "said david davies, head of england's director of economic and social development. [SEP] that was, in some ways, the national interest on national security. [SEP] the average loss is expected to be google's average earnings per share of $2. 7 million share. [SEP]" i've known this for anything more than 50 years, and [SEP]
+
+===== sample 057 =====
+[CLS]ha derahkaf contributed to this report. [SEP] "the internet and doctors can tell people it's easier to be a good doctor at any other time when they're really healthy," said senior physician dr. jia qingdoo of kyoto university. [SEP] russia is a world away from the united states, he says. [SEP] new research by the university of glasgow centre for reproductive health also revealed a drop in the number of teenage miscarriages a year to 34. [SEP] "at the same time, i'm right at the same time that i've all my career titles and my tournaments," murray [SEP]
+
+===== sample 058 =====
+[CLS] aga made a very stern call to a small group of campaigners to ask parents of all children in the province to learn and improve the quality of their lives. [SEP] i have always wondered about the power that is in the ground.... [SEP] brian davidson, of broomfield high school, said: "what has people still standing up for is the learning opportunities for eight - year students. [SEP]" it's sad to see someone like this, i don't really know what my children are doing..., " said paul koehl, a former ball instructor. [SEP] 26 (upi) - [SEP]
+
+===== sample 059 =====
+[CLS], at least for a few weeks of long haul. [SEP] "we're getting tough," said john heistler, a committee member at yale school of law who was a top clinton campaign official during the iran - iraq war. [SEP] they're about the exploration of human capital, human process and energy. [SEP] mr jones said: "it was a sad thing for the residents but it is becoming more difficult to go on. [SEP]" i found out that he had to say this last night - he should be talking.... [SEP] " yes, we're picking up on the ground all day, but [SEP]
+
+===== sample 060 =====
+[CLS]. [SEP] the race was sponsored by obama and sen. hillary clinton. [SEP] "but i don't get the amount of scrutiny i'm expecting from it and the way this process will be handled," but also the scale of the problems within it, " he said in an interview. [SEP] 11 (upi) - - a long weekend of swimming to a swedish ski resort ended after three hours in weather, the u. s. government said. [SEP] he said that the university of edinburgh, which is planning to be regarded as a top international university, has also heard of the past. [SEP] the uk company said it [SEP]
+
+===== sample 061 =====
+[CLS] the north asked washington to meet him, in a period of diplomatic tensions that have left north korea as a growing threat to western ties and the nation's economy. [SEP] " it was a long way to go on to be a good president. [SEP] he still wasn't playing. [SEP] the american airline program is a pilot program that pays the airline $100 million to meet a constant supply of u. s. airlines, an expensive but better than that. [SEP] it is different. [SEP] however, and a housing bill that included staying with her daughter, whose offers for the victorian home were rejected has been rejected. [SEP] the european [SEP]
+
+===== sample 062 =====
+[CLS] to a five - year contract on a potential market worth $5 million, and they won't play in the nfl until dec. [SEP] especially when i'm 18. [SEP] it's about focusing on the course when it is long and hard. [SEP] sen. ben nelson, d - neb., said he also would make the bill the first of its kind in a separate healthcare bill sponsored by the senator, d - va., the white house and officials said. [SEP] it has been announced that the hotel will be built by the national network for disadvantaged children, the children's department of school co - star [SEP]
+
+===== sample 063 =====
+[CLS] had to be in the hospital with the young 50 - year - old pop star. [SEP] last year, chinese farmers sold more than 100, 000 vehicles to suppliers in efd countries, down about 17 percent from their peak levels in the first half of 2006. [SEP] csos did not say what prompted the case. [SEP] argot was the regional chairman of the uk talent agency in 1993. [SEP] this kind of wait - and - break political crisis - - as it did in north korea - - has led to a new generation. [SEP] obama is also stepping up a radio campaign, calling that the former president, john mccain [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_diffusion_noise_steps_128steps_n64/tpow1p5_noise_linear2to08_early_cosine_eta0p08_c256_raw_samples.txt

@@ -0,0 +1,230 @@
+tpow1p5_noise_linear2to08_early_cosine_eta0p08_c256
+{
+  "type": "summary",
+  "name": "tpow1p5_noise_linear2to08_early_cosine_eta0p08_c256",
+  "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt",
+  "step": 187000,
+  "decode": {
+    "kind": "categorical_fullvocab_diffusion_state_noise",
+    "config": "tpow1p5_noise_linear2to08_early_cosine_eta0p08_c256",
+    "steps": 128,
+    "temp_start": 2.0,
+    "temp_end": 0.8,
+    "temp_schedule": "linear",
+    "t_power": 1.5,
+    "eta0": 0.08,
+    "eta_schedule": "early_cosine",
+    "noise_conc": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 42.80336239844838,
+    "nll_per_token": 3.7566166602134308,
+    "tokens": 9564
+  },
+  "diversity": {
+    "sample_entropy": 4.142722771044542,
+    "unique_tokens": 1834,
+    "token_count": 8192,
+    "distinct_1": 0.223876953125,
+    "distinct_2": 0.6817175196850394,
+    "top_token_mass": 0.0576171875
+  }
+}
+
+===== sample 000 =====
+[CLS] [SEP] iran will continue to put pressure on iran under control of foreign policy barack obama has said in his new book after being published earlier this week : " why do the u. s. really care for the iranian people with the help of the united states? [SEP] austin, texas ( ap ) - a & m ' s no. 1 player and five no. 1 players among the tournament ' s four first - round players behind tournament leader john charl. [SEP] a 16 - year - old boy, his wife and two children also died in a separate blast. [SEP] woods, who died of cancer on wednesday morning, was expected to [SEP]
+
+===== sample 001 =====
+[CLS] matter, after all. [SEP] it is just an opportunity to take. [SEP] " it will be important to get away with a new nuclear program, " said david tauscher of the security council in london. [SEP] the new president used a keynote address in the financial times yesterday to address questions about the substance of the government ' s proposals and his overall handling of the economy. [SEP] " i think it ' s something that... worth exploring, " said john ashman, president of the national foundation, one of the groups for americans, referring to the highest - known event in the history of the washington region. [SEP] the [SEP]
+
+===== sample 002 =====
+[CLS]dyev, who served as president of the military council in multan, north korea, quickly condemned the country ' s nuclear activity and warned that he could be over burdened with nuclear weapons. [SEP] london, england ( cnn ) - - the last books of marci corbus will be released online for the first time this season. [SEP] obama and mccain share the same, but they do it in a very different way. [SEP] two remaining cases have been allowed to settle in the area. [SEP] the military officials say that turnout has been too strong and there is still turmoil in the country ' s pacist process. [SEP] [SEP]
+
+===== sample 003 =====
+[CLS] of the world. [SEP] markets in germany and south - eastern france declined 6. 3 percent, in britain down 5. 0 percent and south - west in france was 6. 4 percent lower. [SEP] video : no. 3 - wise was the mark. [SEP] the united states central bank also looked ahead of the boj ' s rate decision today to say interest rates would rise. [SEP] " i would watch... [SEP] that ' s what they ' re supposed to do about the world. [SEP] " i would like to use one and i ' ll i ' ve got to do it anyway. [SEP] the issue is expected to [SEP]
+
+===== sample 004 =====
+[CLS] [SEP] " it will take a vote to pass this health - care reform and of course to win this, it ' s going to happen, " reid said. [SEP] he was always tough, grew increasingly authoritarian and came from politics. [SEP] meanwhile, you might have dropped the case. [SEP] he was joined by his wife, makri kadi, a 58 - year - old veteran, and a younger brother and their two young daughters. [SEP] if they want to do, let us say it. [SEP] i was making a speech when his party and his wife went behind the front door, and that ' s all because he was [SEP]
+
+===== sample 005 =====
+[CLS] - year - old son. [SEP] " i ' m aware of what ' s going to be happening now. [SEP] the committee will be studying the cases. [SEP] what else i can for? [SEP] pau gasol was able to reach the point midway through the second quarter with a shot 27. 7 percent from the line, giving the hornets the chance to lead. [SEP] on tuesday. [SEP] french president robert deby, who has succeeded in leading the government ' s efforts to prevent a deep recession, said that in may 2004, the country ' s trade rose by 16 % to reach 13. 7 billion euros. [SEP] a chinese official [SEP]
+
+===== sample 006 =====
+[CLS]p. [SEP] mr salmond ' s spokesman did not appear to take on specific questions about mr johnson ' s departure late last year, but he gave no indication if or when he would take up the role if sir ian was forced to quit. [SEP] but ultimately, all i could not say is why i did it. [SEP] this is not practical though. [SEP] " in a storm, i don ' t have the confidence that it can ' t get very cold. [SEP] a spokesman for the families of the dead has appealed for the military to go in on its way to ensure the safety of the hostages. [SEP] on a recent days [SEP]
+
+===== sample 007 =====
+[CLS]. [SEP] the israeli youth was arrested at the men ' s house tuesday, the report said. [SEP] but anthony mcmanus answered with a short field goal and pierre white ' s 1 - yard touchdown run over the middle on the 10 - yard goal line. [SEP] his comments were made during a visit to china by president hu jintao and, again, the presidents of russia, china, germany and france on october 5. [SEP] and we all know pupils who really do not pass a bad reading test, but leave in a less healthy view of their numbers. [SEP] what ' s needed, obama. [SEP] " in the debate, [SEP]
+
+===== sample 008 =====
+[CLS] at least keep a broader impedule on mccain and the personal security of president obama ' s backers. [SEP] the only thing is this will go our way out. [SEP] the short - term price is about $ 5, 000. [SEP] that ' s because the show ' s only major prize in china - - there are the reasons reasons to make it for the year, " said nbc co - president robert fagan. [SEP] moyer is 5 - 8 and signed with the cubs, who run the majors three times a year. [SEP] they ' ll be sending their own troops to fight the taliban. [SEP] orlando, fla [SEP]
+
+===== sample 009 =====
+[CLS] the most important thing you can do here in the first place. [SEP] to the northeast, maine and new york and the two carolinas. [SEP] it seems she has a different point now. [SEP] as the matter of fact, people want to be more aware of themselves and their relationships. [SEP] the groups need to cover up much of the increasing demand for tax credits. [SEP] lewis said that the bank would continue to focus on balancing its support for mortgage and mortgage rates, in a conference call. [SEP] " it is our view it is very clear to be responsible for his safety. [SEP] police want to know how the women got into the [SEP]
+
+===== sample 010 =====
+[CLS] a responsibility to their voters to prevent real change. [SEP] she is now coming down to atlanta for a reason to live here. [SEP] people read obama critiques of republican party policies. [SEP] the majority would like to take advantage of the term limits that allow the governor of the state to prosper and take control of the office. [SEP] you know, it ' s going to be a long process, do you feel that? [SEP] " that ' s pretty much of a mental blow. [SEP] i ' m talking about a guy who hasn ' t had a job growing up at school, and hasn ' t seen many people unemployed. [SEP] [SEP]
+
+===== sample 011 =====
+[CLS] 888 ; average prices, for example, rose slightly to $ 3, 860 ), easily more than double the average. [SEP] los angeles ( reuters ) - the mayor of new york has flown to los angeles this month to meet with city officials, one of several foreign staff from around the world, the mayor said in a press release issued on wednesday. [SEP] 18 hearing, but white ' s family said they expected him to take the job along with mike huckabee, university of north carolina chairman of the governor ' s, before his end. [SEP] according to james the president of zimmer. com, the [SEP]
+
+===== sample 012 =====
+[CLS] [SEP] the u. s. army dodgers at washington, 10 p. m. [SEP] " they are on the brink of a civil war. [SEP] not only did kroes bring himself to the front line, too. [SEP] he needs to work with the kids, to help people change their own lives by creating their own. [SEP] note that the government does not have the right to expect their families to help themselves. [SEP] it ' s understood however, that andrew lloyd - davies, with tommy corsley, steve davies, walker and kevin davies, will join the new boss as assistant manager for two years. [SEP] in the case [SEP]
+
+===== sample 013 =====
+[CLS] peter finchem, the chairman of the british press association. [SEP] on the world tour, cogham said : " i just want to take the same game, and i know it. [SEP] the pound fell nearly 4 basis points to £27. 018 versus the us dollar, and lost 2. 5 per cent to £12. 24 per pound. [SEP] spokesman bill chandler said the total recall was worth up to 30 million vehicles. [SEP] there ' s no word on this, however. [SEP] i don ' t remember talking in 1997 about the creation of a european agency with an " agricultural policy. " [SEP] " that kind [SEP]
+
+===== sample 014 =====
+[CLS] legislation would require congress to provide the country with a public health plan in exchange for a federal and state sponsored health insurance system. [SEP] we ' ve got that clear into the rest of his life and then we think about how he ' s going to be doing. [SEP] the school leaders will keep the school open to public by march 2010. [SEP] this week, he is expected to discuss golf with tiger woods, the influence of sport and iran, the issues of his own family and his political judgment. [SEP] abbas has called on fatahs in the past week to support the hamas - u. s. - backed government in gaza ' [SEP]
+
+===== sample 015 =====
+[CLS] might be able to run it as well. [SEP] japan has worked with u. s. department of energy and commerce, as well as the united states, mexico and colombia to help the government. [SEP] " i ' m happy. [SEP] " i want to get back into the business and i take the opportunity to find out what i am doing. [SEP] " they don ' t at all, " she said. [SEP] he also asked whether he was calling for his wife, telling him he said he would never be out of his job again. [SEP] g. a. m. entertainment ' s chief executive, john smell, said [SEP]
+
+===== sample 016 =====
+[CLS] no money on their own. [SEP] arizona sen. john mccain was campaigning hard in the state in new hampshire saturday and is expected to talk to voters about mccain ' s experience in the election. [SEP] however, halifax says it is " only about 1. 4 % of the housing market. " [SEP] 15 ( upi ) - - four navy aircraft fired warning shots thursday in off guam, which was the first vessel ever to increase the number of world war ii aircraft in the area, the coast guard said. [SEP] but that ' s the reason that ' s been such a successful start to the games. [SEP] within hours, thousands of [SEP]
+
+===== sample 017 =====
+[CLS] s eve, president obama tried to embrace change. [SEP] that ' s what i do, the way it ' s all about doing things. [SEP] " i want to work on getting the documents right, " he said. [SEP] even so, the chinese market was counting on the government ' s move to increase spending, to make up the majority of china ' s economy and boost exports over the next three years. [SEP] isn ' t it really fair to know that a book you think you are working on? [SEP] the report is likely to open up a long process of debate - - how to do it, especially when you know that [SEP]
+
+===== sample 018 =====
+[CLS] the need to change the country ' s culture and ideas, he said in a statement. [SEP] almost a third of city residents said they were spending more than three hours a day per month. [SEP] for a bit of fun, though, he ' s found himself in a run out for the dugout.... [SEP] a 14 - year - old girl and a man were attacked yesterday after they went off on a rural street and ran away in the busy long hills area of the nassau county. [SEP] as administration chief, he ' s looking for the time to have a general election plan to emerge, but also for a national [SEP]
+
+===== sample 019 =====
+[CLS] still know about it. [SEP] all i can try and, of course, says he ' s wrong. [SEP] the debt is among the primary cause of the company ' s biggest problem, financial experts say. [SEP] the democrats began to pick laghe as the state ' s choice of republican governor long before it was appointed. [SEP] illion, minn., set a 15 - year franchise franchise record. [SEP] in london, the value of the us dollar was flat at 703. 16 against the yen, while gold prices were steady at $ 1. 14 from wednesday ' s $ 1. 3431. [SEP] how can [SEP]
+
+===== sample 020 =====
+[CLS]. [SEP] some people never get it wrong. [SEP] three of the permanent u. s. supreme court justices - - connecticut, kansas, texas and vermont - - would not comment on whether they will appeal because of the temporary order. [SEP] the best we applaud is someone who makes him less angry, less complex and ever - expressive. [SEP] as a result, he began reversing the religious practices that led him to enroll in the high school of civil service management. [SEP] the philadelphia eagles have indicated that they will sign bally, who also have linebackers brandon jacobs and wes welker available to practice. [SEP] at [SEP]
+
+===== sample 021 =====
+[CLS] clark ' s close relationship with henry and a few other children - - mary, the wife of him with whom - - to the british throne in 1946. [SEP] in the case of the iranian program, the c. i. a. also was ready to go with the roughly 1, 600 ground - level high - value systems we need to be able to use in nuclear warfare. [SEP] i went to a friend and asked to say he ' d come in, he said, and i see, he ' s in, he ' s in, " stellen said. [SEP] he said members of the faculty group hope to apply for [SEP]
+
+===== sample 022 =====
+[CLS] had expected, " james j. filwich, senior vice president of portfolio management, said. [SEP] donald pacey, who heads of sales marketing for the disney company ' s children ' s online office, said the company would also seek ways to increase market access to the key online video markets. [SEP] and if it ' s down to luck and turbulence, you should try them. [SEP] smoking, drinking heavily, having sex and drinking are all all things that do you want to do as a person. [SEP] do you agree with the university of california? [SEP] the two have degrees in english and english. [SEP] if the national price [SEP]
+
+===== sample 023 =====
+[CLS] south africa. [SEP] in december, the university announced the idea of running a student command center, in a call to encourage students to track their computers and share practical information. [SEP] selig said he has not been surprised by reports from fans and the public about the number of golfers. [SEP] the 70 - year - old lawyer said corzine has no room to go further. [SEP] the current government of the ruling african democratic party has defended the peace process but will be in the hands of 14 of the 70 campaigners expected to attend. [SEP] the authors point to congress that a report has since found out about the need for [SEP]
+
+===== sample 024 =====
+[CLS] state ' s top football team since 2002. [SEP] bill credler, the author of the new book " shock morning, " said he has spoken repeatedly to the boy ' s father and called him " very grateful. " [SEP] i would have to start a company that is going to do this. [SEP] this is not a good idea - - and, he ' d say, really go back. [SEP] a government spokesman said that the prime minister had planned to meet with iraq ' s parliament and express his concern. [SEP] ellg, its largest individual shareholder in republicon corporation, agreed to buy $ 1. 2 million billion [SEP]
+
+===== sample 025 =====
+[CLS] response to rising demand in russia ' s consumer of electricity and nuclear technology. [SEP] dr michael nicol said : " the county council ' s call will ask us for a new approach which may lead to a national water policy. [SEP] overall, spending in the 16 - nation region fell 1. 3 per cent, the biggest drop - - just $ 22. 8 billion in february. [SEP] in the end, the dispatcher gave me up a bit of magic power. [SEP] " it was a very tough game. [SEP] obama ' s message is a strong one and a bad one, and you need to know more about that. [SEP] [SEP]
+
+===== sample 026 =====
+[CLS] countries to take part in their regional and sporting events. [SEP] " and at the time being, i ' d have to sit around to win the game and get it back, " he said. [SEP] they believe they can afford what they pay their children when they move to virginia, where the falls school was located. [SEP] only one percent of those surveyed are in their teens and 25 percent said they will rather things be better, while 13 percent of those say their lives will be worse. [SEP] the conflict has been among afghanistan ' s bloodest years, defining both civil war and central afghan poverty. [SEP] this show will be led by [SEP]
+
+===== sample 027 =====
+[CLS] 3. 68 percent, as of 2 : 30 a. m. [SEP] instead, the republicans may say something about him, when they ask whether the new president has done enough to give the economy more to help them and more to protect our health system. [SEP] he said he may want to be considered president of one of the house u. s. delegation and repeated his comments about his relationship with china, according to his book, " i. d. f.. " [SEP] republican senators to the bill, senator harkin ( d - vt. ), and nelson, d - n. pa., said he was not [SEP]
+
+===== sample 028 =====
+[CLS] it ' s easy. [SEP] it was two of mr hill ' s closest friends at the time, tony james, mark geggert and gordon grove. [SEP] " it was difficult, and the draw was for the team, " he said. [SEP] it will be the first president, and first lady, since president bush ' s presidency. [SEP] despite the white house ' s qualms, the white house faces a struggle to expand its political and trade in japan. [SEP] as the film ' s first season begins, the film interviews her 10 days before the actor ' s death - - saying that she wants something done in the [SEP]
+
+===== sample 029 =====
+[CLS] has decided to hand over the presidential powers to the pm, who is one of the country ' s political leaders, according to a report released tuesday. [SEP] anyone who tried to get past the stocuous point of their fetish against the world can see it. [SEP] that said, i would think an article like this... that ' s me... i don ' t know where the government says that the current administration is wrong. [SEP] but is it the democrat ' s...... two points....... [SEP] nearly an hour later, the players came to the stadium with [SEP]
+
+===== sample 030 =====
+[CLS], the fa needs to focus less on developing countries, such as israel. [SEP] it opened up to sir ian blair and two former cabinet ministers, patricia smith and john maude, who have spent their time working in politics. [SEP] many players are worried for the future of the tournament. [SEP] since the budget would save $ 16 billion, the proposed school cuts in the federal school system would result in record grants from government and private investors to support middle - income high school students. [SEP] while parker said police arrived the scene about 9 a. m. thursday, the system has been in effect since and it ' s believed the driver would [SEP]
+
+===== sample 031 =====
+[CLS]downs in china, particularly in the us. [SEP] if he gets that, then he can ' t go to denver in the next few days to elect his running - mate. [SEP] with all of the co - stocking, south america is in the lead. [SEP] although bush ' s decision to reach his administration ' s goals paid off by his end, this isn ' t all easy. [SEP] " it now appears it ' s probably the siesta that caused the problem, " said john pringle jr., an environmentalist at the university ' s florida school of environmental studies. [SEP] it was the kind of [SEP]
+
+===== sample 032 =====
+[CLS] second - quarter, 90 - yard drive. [SEP] " i am happy as a man, " he said. [SEP] " i know we were much better than in italy but i feel we think it was better for us to understand that we had got more players and that what they did was away and it ' s clear they were playing the game, " he said. [SEP] " to fund this plan, the government wants to educate the young people, improve the health and education, build new roads, build schools and develop infrastructure, " shun sen, 60, a member of the ruling opposition party, told the party ' s congress [SEP]
+
+===== sample 033 =====
+[CLS] [SEP] she ' s working with realty trust, the los angeles redevelopment agency that builds homes in the state. [SEP] hillary clinton and hillary clinton, both former democratic presidents, have been getting frustrated at the outcome because of poor security in the country. [SEP] if we don ' t like the idea, put their running shoes down and see it - like head - to - head on a show, which is pretty right when it was set. [SEP] mr brown ' s selection has been put forward, while he also confirmed that he will remain first and deputy chief ministers in 2010, they announced today. [SEP] the commission ' s findings of [SEP]
+
+===== sample 034 =====
+[CLS] los angeles. [SEP] lee dong - hyun, senior minister for the national institute of maritime analyses, said north korea ' s actions should be viewed " with extreme caution. " [SEP] tim gerkensa, director of the administration ' s foreign policy office, told the committee that it would not have happened if north korea had agreed to off nuclear operations in 2008. [SEP] thanks to simby ' s years of coaching trying to drop the shots at the top, the man with a great wit and hardiness, it seems like pretty much better. [SEP] " once you ' ve had to travel through them, you know, they need to [SEP]
+
+===== sample 035 =====
+[CLS] or visiting the facility, or get them through transportation. [SEP] the government needs to pay back and there will be demand again. [SEP] philadelphia ( ap ) - if you ' re a bickering fan, u. s. men ' s women ' s basketball men of philadelphia and women of new york get all three spots in college softball, volleyball and swimming. [SEP] " i ' m still a man and a player and it ' s never easy for me to want to do anything. [SEP] it was too far away from a member of the southern water action network. [SEP] yes, many people in our school and school systems should be [SEP]
+
+===== sample 036 =====
+[CLS] [SEP] the icf said the average building prices in the high growth areas were up by 10 per cent to rmb9 million during the period last year. [SEP] he told reporters he was going to be " ready to stand up. " [SEP] after tuesday ' s debate, the republicans said they are likely to be patient. [SEP] working for the office of drug enforcement administration in washington, the former police chief from a new york suburb has risen steadily to 11 members. [SEP] " after seeing the data i am concerned about the lack of confidence, " he said. [SEP] woods responded by being " very good " in the summer, and woods [SEP]
+
+===== sample 037 =====
+[CLS] and waste, despite the worst exposures in my life. [SEP] in the last time a post - season race in california came in february 2007, new york became the first major state to close the race. [SEP] and if you ' re looking for the job, he plays 80 to 90 minutes a week in a few games. [SEP] or maybe it ' s really good for you. [SEP] " it ' s the same, " wenger added. [SEP] and for many years they have been the preserve of the rural majority of the electorate : they ' re as successful as ever. [SEP] john pervay, 35, will stay on [SEP]
+
+===== sample 038 =====
+[CLS] bahnieh said monday. [SEP] it ' s the time when a pet gets its name. [SEP] when mr brown was chancellor, mark hughes was the treasury ' s secretary to the treasury team, and the first prime minister to leave office in 1997 in london. [SEP] let ' s say a little more of this. [SEP] at the last election, however, he was told that he was to start a newspaper job he had with his father. [SEP] i have long since thought of the best i could be doing - - politics. [SEP] " i thought i would start but in the first half i ' d be in anfield. [SEP]
+
+===== sample 039 =====
+[CLS] elected u. gov. john paul, the longtime governor of the country ' s economy. [SEP] japan will discuss a full ministerial meeting, which runs through monday, the source said, but did not describe the meeting as confidential. [SEP] now, the cost of the tory media conference, would be set at £3 billion. [SEP] 11 ( upi ) - - anthony kim has a strong appetite for golf. [SEP] a lot of middle - aged teenagers are under ageing, " said another. [SEP] the text, said galvisse ' s source, who could not be named, was significant as well. [SEP] michael and michael jackson have [SEP]
+
+===== sample 040 =====
+[CLS] in last year. [SEP] it was the first team to win the division of the city and the only record in its history. [SEP] the company ' s director of the open pool, stephen hawking, said he would take liverpool ' s chamber of commerce on a tour of events to see the city ' s world of natural history. [SEP] which set us back. [SEP] he is being investigated by several defense lawyers. [SEP] the continued nature of the launch threatened a review of the world ' s nuclear weapons programs, including the u. s., along with a key u. s. - china program, over how to build the nuclear [SEP]
+
+===== sample 041 =====
+[CLS] plan - - valued at $ 550 million and will help half the new york city ' s buildings - - will include about $ 60, 000 for skyscrapers built in the city by this spring, the dallas morning news reported sunday. [SEP] i mean, i heard this story from the kennedy family. [SEP] " on the contrary, there ' s no way it would affect a deal with russia ' s military action system, " according to what dumka was saying. [SEP] ditto - pare and bouscotti. [SEP] " the point of this, the reality is you can ' t do this business, " said mr [SEP]
+
+===== sample 042 =====
+[CLS]baki is chosen as south africa ' s next leader. [SEP] in america, the vikings were a potent force for mass mentality in the sport. [SEP] each year, two teams enter a meeting of the top three in this tournament. [SEP] growing up late for a night on the saturday night reminded me what has been done. [SEP] last month, ubs was downgraded with the drug firm. [SEP] germany and france have agreed to work on future relations in the effort to make the relationship more open and competitive. [SEP] before he was gone, before he arrived in afghanistan he arrived on a two - day trip to northern europe to [SEP]
+
+===== sample 043 =====
+[CLS] bst on monday, april 2009. [SEP] the funeral is being held in west belfast. [SEP] i say music is something you can do, but many of you know you ' re looking to make great music. [SEP] britain ' s prime minister gordon brown, the prime minister, and britain ' s gordon brown, the wife of gordon brown, are to issue a joint report today, the president, who pledged to provide the british with money for the white house, said on thursday. [SEP] it is now looking forward to independence. [SEP] a short list of the cases that are now to be made available by the care reform commission, the [SEP]
+
+===== sample 044 =====
+[CLS], in africa this week, to give further details of ms. gibbons ' s case. [SEP] that ' s why it will sell out this summer in the hope of the general election and corvous, and everybody wants the next team to be paying attention to it. [SEP] but they ' ve been living in ways that won ' t work out. [SEP] at present, a presidential election is not long. [SEP] china has insisted that talks continue on the claims, but insists that the communist state has yet to resolve the disputed issue. [SEP] it ' s not a long time yet. [SEP] the question is how americans feel about the [SEP]
+
+===== sample 045 =====
+[CLS] outdoor market and another part of the town ' s infrastructure. [SEP] if the republicans vote for this bill.... at least that ' s going to be a real senate bill. [SEP] " it ' s hard, and it ' s fun, but that ' s what ' s like, " beckham said. [SEP] he has yet to be reached by cell phone. [SEP] police said the high - time victim of a violent crime will be in jail for another four years, according to the report. [SEP] sen. sen. carl levin has joined forces with democratic colleagues to drop the issue. [SEP] i don ' t want to [SEP]
+
+===== sample 046 =====
+[CLS] global investors and prudential ' s plans for the british firm. [SEP] san francisco, 8 : 05 p. m. [SEP] how to get it in your head : a history of the lives of the american people. [SEP] i ' m going to look back at it like, well, that ' s not what i have seen. [SEP] his choice of a different republican commander in chief makes the election more difficult to conclude that mr mccain ' s popularity has been eclipsed by more experienced supporters. [SEP] john kelso, executive director of the national constitution center, and an advocate of marriage, said the move was one of the [SEP]
+
+===== sample 047 =====
+[CLS] " the view of much of the world, " drew much of its coverage. [SEP] he ' s become a unifying voice, playing open - minded coaches, high - minded nfl players and former non - strikeers - - none anywhere - - and he quickly turns him into bedfellow fighters. [SEP] the market is flush. [SEP] but mousavi is not a good candidate. [SEP] the bill appoints 40 members from most european countries, but the group is not on a shortlist here. [SEP] after the resumption of the un meeting in northern ireland, livni said the palestinians and the united states remained " committed [SEP]
+
+===== sample 048 =====
+[CLS] [SEP] but the conservatives were reluctant to get involved, despite assurances by the party ' s leadership, raising the prospect of a deal with the tories in may. [SEP] that included minnesota ' s victory over kansas tech in next week ' s game, which was sunday ' s game. [SEP] carling said his team must be ready by april 10, but his team spokesman would not give details on what dates he had. [SEP] " life is bad, i ' ve never had to sell my life. " [SEP] wildlife officials estimate that 60 percent of the island ' s population is now subsistence, leaving the five million square kilometers of life [SEP]
+
+===== sample 049 =====
+[CLS] down 18 %. [SEP] it was created for a young man at the age of 20 and he wrote a number of works of art there. [SEP] that has prompted the israeli political parties to resolve the crisis. [SEP] she went to her high school, a school of the old school, and began to study soccer and softball, video game and soccer. [SEP] the u. s. military has ruled out any attacks. [SEP] this was all the more embarrassing for tampa bay and the colts. [SEP] hi, " well, very often. [SEP] meanwhile, the government could guarantee guarantees of about $ 2. 5 billion in bank loans. [SEP] the [SEP]
+
+===== sample 050 =====
+[CLS] with a left knee. [SEP] the study, authored by dr. jordan gordon, a university of connecticut, says that the black man ' s success was largely measured statistically on racial factors. [SEP] the congress later agreed to work on its version of the national election law. [SEP] the timing of this would be a long one. [SEP] but president obama, a six - term president, will be pleased with the numbers. [SEP] the mother of james ' parents, a 17 - year - old girl in greater manchester who witnessed the sudden death of a teenage baby hit by a rock road, killing a child, was able to save the child [SEP]
+
+===== sample 051 =====
+[CLS] and everyone should have a reason, he said. [SEP] savannah, ga., may 18 / prnewswire - firstcall / - - denise robinson, the president of the north georgia national women football club, will attend the national pro football sports league tournament in miami beach, fla., tomorrow. [SEP] but the kingdom ' s oil trade, which covers two - thirds of the global economy, boasts an unprecedented level of oil production, it was reported. [SEP] you focus on the potential to be very successful here. [SEP] his daughter ' s solicitor, john cameron, made his decision, leading to the prime minister ' [SEP]
+
+===== sample 052 =====
+[CLS] said. [SEP] with the clock running out, the presidential candidates had been discussing how to deal with their issues compared with the president ' s rival, the relationship between the current and obama - biden forces. [SEP] congress may have paved the way for the united states government to buy its stake in india, but it was much less lawless. [SEP] in short, he decided to join the family, like kazemi ' s parents, friends and the in - laws. [SEP] it happened on thursday, about an hour after the shooting at a popular sports resort, reno, that was the site to nearly 3 million hours of mourning on [SEP]
+
+===== sample 053 =====
+[CLS] international and national governments. [SEP] the united states was initially seen as the largest share of western support to pakistan ' s efforts to stop its attacks on india and afghanistan and had become a close ally of india. [SEP] by 2015, unemployment in developing countries will grow to 4. 5 million or 5, 000 within the next three years, the ecb said, implying growth of as much as 4 percent. [SEP] with 70 percent of palin ' s time spending worth a total of $ 500 million in 2007, the time for christmas, for most americans, was probably about over. [SEP] in the midst of being granted in december to the [SEP]
+
+===== sample 054 =====
+[CLS] the us - controlled us congress. [SEP] suharto said she had no information but that the military said she was looking for a more objective view of the situation in the region. [SEP] also, it said some organisations, such as thaksin ' s political network, had a turnover of 14. 2 million euros. [SEP] kennedy, 44, was from atlanta, virginia. [SEP] they paid about $ 500 a month and about $ 1, 000 in rent over one year. [SEP] it ' s no wonder the swedish carmaker is a national car company owned by the british commercial lender gmac, home to the american car company [SEP]
+
+===== sample 055 =====
+[CLS] this year. [SEP] mike scott ( pictured ), 23, who made his debut before crossing into the heart of the valley a decade ago, knows it ' s about time. [SEP] it ' s just about some of the things that people tell you. [SEP] the figures show the number of people living in the town in 40 days from their start to 2005 in 2006. [SEP] she ' s doing well ; it ' s like the kitchen and we just don ' t have the carry - on thing. [SEP] she wasn ' t related to politics. [SEP] the trust ' s lawyers ' bitter argument is that the group ' s executive has failed [SEP]
+
+===== sample 056 =====
+[CLS] within 20 years. " [SEP] instead, the states hope to make a difference to their school staffing, and force people to use their laptops and access to athletic facilities. [SEP] a good betting line is that he still believes the tour has some good work to do. [SEP] seven british men were arrested friday for the alleged drug - sex murders of five women, seven men and five men in northern ireland, the metropolitan police said. [SEP] operating income, which, compared with year expectations, fell 2. 6 per cent to $ 2. 659bn. [SEP] " i used to know this for the first time, " said mr [SEP]
+
+===== sample 057 =====
+[CLS] mari qanbakay contributed to this report from atlanta, georgia. [SEP] i know many people around the world want to see change and change and it is time to go further. [SEP] she visited the house of representatives representatives in washington last week to discuss the issue with congress. [SEP] once again, for the famers, the excitement of a one - game series is arguably the best thing of the world. [SEP] harrer was awarded the gold, which apparently showed his own athletic build - - around 14 feet ( 7. 3 meters, 6 feet 8 inches ). [SEP] " he died, and his father was believed to [SEP]
+
+===== sample 058 =====
+[CLS] aga, a former aide to the army chief. [SEP] one ' s biographers, for example, might seem to believe it could be the inheritance of knowledge. [SEP] " i do not want the government to come into the ground.... [SEP] brian robertson, of heathrow airport airport, said : " we are pleased to make up for the difficulties we will face during the holiday time. [SEP] " it ' s good news for someone in america that just hasn ' t made any progress with my medical bill. [SEP] stevens, 27, who is retired, left for the station dec. [SEP] 7 ( upi ) - [SEP]
+
+===== sample 059 =====
+[CLS] decade, or even a few weeks of population growth. [SEP] " we ' re already here, " said john c. mcgovern, 18, a professor of law who helped guide the obama campaign, announcing his plans to fight marriage. [SEP] all this is about the great stewardship of the great bank of america. [SEP] the 50 - year - old american was about to address the reason why it is no more expensive....... wouldn ' t you do it............................. [SEP]
+
+===== sample 060 =====
+[CLS]. [SEP] the caseworker took me to the master ' s. [SEP] " if i can ' t get it back eight or 10 times in my life, and i know i will be here, it ' ll still be done a couple of years later, " he said in an interview. [SEP] 11 ( upi ) - - a long battle going on to a cargo ship barreled up three hours late friday, the u. s. navy said. [SEP] he said : " after hundred years working on the iraq war, this is a sad story that is bringing us out of the past. [SEP] washington ( cnn ) - [SEP]
+
+===== sample 061 =====
+[CLS] unwillingness of washington to meet china and other such concerns, " adding that china and north korea had already agreed not to intrude the north ' s missile defense programs. [SEP] they also said they ' d like to make it to christmas. [SEP] they still aren ' t sure of what happened today and are doing it to look as if the crisis has forced them to build planes. [SEP] the u. s. air union and blm, the president of the world association of air air travel, said a comprehensive agreement that included a joint board on traffic control arrangements for the flight attendants outside asia has been concluded. [SEP] the european [SEP]
+
+===== sample 062 =====
+[CLS] to buy newly acquired alibaco, which sold for $ 444 million in 2006. [SEP] " it ' s a long list, as well, this year and he ' s getting very excited about getting on the field, " coach greg wells said. [SEP] sen. ben nelson, d - neb., said legislation also includes tax dollars for the majority of immigrants included in the legislation, as advocated by the national campaign for civil rights reform, the the state gazette, reported. [SEP] it has been announced that no candidate will be running under its name - - officially named by the university ' s department of state - - and [SEP]
+
+===== sample 063 =====
+[CLS] to start working on the proposals with the stimulus funds that will begin this summer. [SEP] earlier last year, the ministers were expected to have backed out on keeping the farmers ' families free of care, citing the safety of their families living in the north east. [SEP] and it will need to get a taste of the law. [SEP] the project is led by the chairman of the uk border agency national borders. [SEP] this sort of over - the - top u. s. approach to trans - arab relations is generally carried out in different countries. [SEP] if brown is to take up an early motion to call for the election, he will propose [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_diffusion_noise_steps_128steps_n64/tpow1p5_noise_linear2to08_mid_sine_eta0p08_c256_detok_raw_samples.txt

@@ -0,0 +1,230 @@
+tpow1p5_noise_linear2to08_mid_sine_eta0p08_c256_detok
+{
+  "type": "summary",
+  "name": "tpow1p5_noise_linear2to08_mid_sine_eta0p08_c256",
+  "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt",
+  "step": 187000,
+  "decode": {
+    "kind": "categorical_fullvocab_diffusion_state_noise",
+    "config": "tpow1p5_noise_linear2to08_mid_sine_eta0p08_c256",
+    "steps": 128,
+    "temp_start": 2.0,
+    "temp_end": 0.8,
+    "temp_schedule": "linear",
+    "t_power": 1.5,
+    "eta0": 0.08,
+    "eta_schedule": "mid_sine",
+    "noise_conc": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 41.16435120941998,
+    "nll_per_token": 3.71757261989304,
+    "tokens": 9659
+  },
+  "diversity": {
+    "sample_entropy": 4.162179467920619,
+    "unique_tokens": 1837,
+    "token_count": 8192,
+    "distinct_1": 0.2242431640625,
+    "distinct_2": 0.6884842519685039,
+    "top_token_mass": 0.0582275390625
+  }
+}
+
+===== sample 000 =====
+[CLS] new talks is likely to put pressure on u. s. political analysts, who are seeking to reassure baghdad that washington wants talks and this week's talks to push the region back to the top of the crisis. [SEP] who cares about this alcohol product? [SEP] today, he is the star of ernst & young's national television network back in the 1960s. [SEP] the washington nationals have declined to send first - year players to training camp for the draft. [SEP] a 16 - year - old boy, a woman and two men, all from brixton, greater manchester, were arrested while james hill, of tilbury, in [SEP]
+
+===== sample 001 =====
+[CLS], most people said. [SEP] it is just an opportunity to lead. [SEP] "it will be important to make sure such programs are not overlooked," said david montserver of the national health policy center. [SEP] the government has launched a drive to overhaul the financial regulatory system, amid concerns about the state of the country's financial sector. [SEP] retired major general david john jones, the us military's chief of u. s. military operations, this month released a short list of a "board of one of five military intelligence agencies" that "went to war in 2003 in the aftermath of the war." [SEP] but [SEP]
+
+===== sample 002 =====
+[CLS] don't see the wrong side of the rest of the campaign. [SEP] but michael rancoden, the festival's general director, said it would be too early to produce any evidence of abuse. [SEP] 22 (upi) - - nasa will delay nasa's first human space flight, setting schedule for the year, officials say. [SEP] at the time of the conflict they said they did not have a reputation for discrimination. [SEP] but the two countries were able to settle their own differences. [SEP] they were also replaced by the housing department. [SEP] westbrook is still on the board with the washington redskins since 1985. [SEP] [SEP]
+
+===== sample 003 =====
+[CLS] flips, jumping, flips, and flip - flops. [SEP] it is a form of sport, a human race; and a totality that gives for beauty, and human sacrifice. [SEP] the system was set up by tony blair in 2006, despite the problems known as black holes. [SEP] the european central bank's earlier decision was to cut interest rates for fiscal 2009 by 1. 5 per cent. [SEP] "that's what it's going for," he said. [SEP] "i would like to talk up, i'm i've got to deal, but i do not," said g [SEP]
+
+===== sample 004 =====
+[CLS], and we're playing together. [SEP] sir richard - john wogan and tom haar are of britain's medical, medical and research council of ireland's national physical education institute. [SEP] 22, 2009, 11: 45 p. m., oct. [SEP] sir philip was given a two - hour conference in downing street, by both men, who gave their own evidence, followed by the government and the parliaments, and asked why they had come to the lords. [SEP] " i don't think i am going anywhere, but it doesn't come back in the same way. [SEP] he's expected [SEP]
+
+===== sample 005 =====
+[CLS] - year - old son. [SEP] " we're aware of what's going to be happening now. [SEP] i want to go back to bed. [SEP] last summer, as for mccain, mr edwards had been thinking about the war and went into the second week with a 1. 3 lead ahead of iowa's no. 2, former rie hunter, on tuesday. [SEP] he worked on £40, 000. [SEP] in 2008 the government's proposals to cut the deficit in national healthcare - - the measure of the overall national income - - by 16 % to £182bn this year. [SEP] a hamas official [SEP]
+
+===== sample 006 =====
+[CLS] afghanistan. [SEP] i've spent a lifetime trying to do on record since the age of 7, and i've considered the size of my body. [SEP] the following day he will take up the role of leader he had intended to become. [SEP] that summer, the couple gave up about two years after they married. [SEP] this is not practical though. [SEP] as the banks know, it won't be giving them a chance to get - - - - - just like most of the working - class americans who want the big banks to give in more federal money after the market turmoil is taking hold. [SEP] on a recent days [SEP]
+
+===== sample 007 =====
+[CLS]. [SEP] "such speculation was written at the president's table tuesday," mccain said. [SEP] new york's defense became the latest team to break its al record at 15 of 14 games, and the number of games to 10. [SEP] it sounds truly ridiculous. [SEP] 26 at the shea stadium in new york, chicago, and minneapolis, minnesota, june, june 17, june 14, and may 30, 2008. [SEP] the children's, who often do not follow a diet of exercise, often suffer from serious mental health problems, including hearing, obscling and behavioral problems that begin with disease, eating problems, [SEP]
+
+===== sample 008 =====
+[CLS] know how much work i'll do. [SEP] and the same thing happened in the first year of the presidency. [SEP] it is the second financial market loss of the year since the bank went unlisted. [SEP] the israeli parliament is investigating the political role of the u. s. embassy in its disputed capital. [SEP] it's a huge story. [SEP] local council leader van schweik, a veteran department engineer, described the idea as a tribute. [SEP] they both helped to form a post - season trade deal between the patriots and the giants who failed to get back in the playoffs. [SEP] yes, that's [SEP]
+
+===== sample 009 =====
+[CLS] an allotment at st john's hospital. [SEP] the premier league should be known as "europe," he added, referring to the final where clubs take place against everton at home and at home. [SEP] but the white house told capitol hill that china said it is ready to talk to a major player, a political rival, in the next term. [SEP] this time, mrs clinton will remain hopeful. [SEP] such bans, with calls for france and other leaders of the united states, have helped the diplomatic process in the dispute that is being billed as crucial at next summer's meeting. [SEP] no decision has been made [SEP]
+
+===== sample 010 =====
+[CLS] 40 years. [SEP] gen. govoud kheli denied the claim the majority of militants to have been killed by taliban militants in afghanistan were on the ground. [SEP] he sought the creation of the new coalition. [SEP] the president's china spokeswoman, jiang yu, said in a statement friday that concerns that the chinese may have been stealing american support for china's missile system. [SEP] a spokesman, however, said he was considering a speech aimed at improving the process of post - war. [SEP] july 26 (upi) - - senate leaders struggled to revive healthcare reform legislation saturday as democrats prepared to pass the senate health [SEP]
+
+===== sample 011 =====
+[CLS]s - - and, on his own terms - - instead of its ire, with his integrity, his own peril. [SEP] don't risk being rewarded by a way of knowing it's wrong. [SEP] this week's meeting in washington has helped prevent the rebounding of overfishing economies from recession in the united states. [SEP] it will discuss all the legal issues at the conference. [SEP] the union wants to see alcoa make an announcement at the annual meeting of its current board members, who have projected salaries of between $2. 20 and between $15 million for 2010 and $6. 15 for [SEP]
+
+===== sample 012 =====
+[CLS] at once and she had to leave again again after losing her job. [SEP] the korean - american leader took up his seat at the foot of the capitol, and the central american arrived in the capitol building, it was late that day. [SEP] the state statistics for the state of the county are unchanged from 2007. [SEP] "a year ago the air force... approved the request in july 2005," air force col. john b. siegal said. [SEP] " we got the ground up yesterday. [SEP] mr swinson, who signed a five - year international extension in 2005, and faces a penhirt in [SEP]
+
+===== sample 013 =====
+[CLS] trying to find measures in place for its funding program, which the report said was also a banking system to build on at least five years of investment in the country. [SEP] "it is something that would have been hard not to think about," said manager brian cashman. [SEP] " we probably get a little concerned about it and get some good reports, but at the end of it is a certainty that he will probably give us something. [SEP] the dispute also flared into congo's war between rebels, rebels and the government, and has fueled a conflict with government forces who have killed five members of a month of fighting since the [SEP]
+
+===== sample 014 =====
+[CLS], " he said. [SEP] their work is warm and structured. [SEP] and if it were confirmed to its 28 - year - old owner, abc, it would not be closed to the public. [SEP] if the show is set to make a digital debut it would generate significant fan interest. [SEP] the players moved into town for sunday's game, with the game with center kevin smith, new york's footballing staff, and hasn't been seen in the team's practice area since he arrived at the stadium last saturday. [SEP] i don't see anyone in the conservative movement making this point. [SEP] what's [SEP]
+
+===== sample 015 =====
+[CLS] by the national economic council. [SEP] over the weekend, i don't know how best to do the same. [SEP] the new minister, sir david mcfall, the former chief executive of the south west, defied the pressure on some parts of the health and housing market and on its existing status on the west coast. [SEP] south korea returned to the talks in april after years of war in the north, which the two rivals have fought since the 1950 - 1953 war. [SEP] coffeyville, wash. [SEP] they are able to produce the same life - changing, well respected persona. [SEP] all of it.... [SEP]
+
+===== sample 016 =====
+[CLS] james, 19, were killed in the separate blast at a school car park in the town in march. [SEP] russia is ready to stake its claim for georgia's security in the west? [SEP] similarly, what if the head of state there is so concerned that soaring military and public spending is prolonging this struggling city and its impoverished citizens. [SEP] gen. david petraeus's comments are the first public report to change the course of the war in iraq, which will be out next spring. [SEP] i was unable to understand the uncertainty that's caused such a bad start to these games. [SEP] last month, president bush [SEP]
+
+===== sample 017 =====
+[CLS] s speech, president obama sought to raise tensions in the u. s. - china, but said he's serious about doing the economic thing, given his ties to the nation's leaders and the chinese people. [SEP] former defense official ko yongng is one of the most senior korean figures in the north, seen as a threat to south korea's stability. [SEP] it happens to one person who takes the trip to meet the other and is appointed as a group - - meeting, a president - - a woman who wants to set up a swimming park, play a game of golf and tennis, a politician who can make [SEP]
+
+===== sample 018 =====
+[CLS] will continue to fill his new role as a head coach, he said in a statement. [SEP] fabio capello has named the first five players in his england national team next week, which will be available as part of his plan to be played in the next five nations to get under - aged players back to their original roots and create jobs by playing for clubs in countries such as asia. [SEP] then he took me to a new job as president of the international project, the exhibition team behind the project. [SEP] mr. rantzen's call for the prosecutor, anthony j. barondo, is widely described as a " [SEP]
+
+===== sample 019 =====
+[CLS] flitting it. [SEP] i live in the city, and she sounds nervous but grumpy. [SEP] the eu is under - fuelled by the world's biggest manufacturing sector, whose revenues are down by 15 per cent in recent months. [SEP] the japanese government had continued to show market improvement on friday, saying the economy had expanded less than 1. 5pc in 15 months before the real estate market resumed in november. [SEP] hong kong's benchmark hang seng index, which rose in chinese trading after its biggest decline in china, was down about 0. 4 percent to 20, 824. 97. [SEP] [SEP]
+
+===== sample 020 =====
+[CLS] in 2007. [SEP] even forecasts have that - - 15 to 30 inches. [SEP] (ap) - - washington state is already ranked as the fourth - highest state in virginia, ahead of florida state in the last five years. [SEP] what do, then, you be getting into your desk? [SEP] the 29 - year - old, a detroit native, was second in the eastern conference in the 2006 senators' race to earn a coaching job. [SEP] good news: mccain. [SEP] the president's first jail time in office left him more than 10 years in prison, but now that's still left to pass. [SEP] congress [SEP]
+
+===== sample 021 =====
+[CLS] government in 2005. [SEP] this film has a problem that children are encouraged to see through. [SEP] the police are also working to protect petitioners coming to the event. [SEP] according to the los angeles times' c. p. o, a buyer could put a price above $1, 600 - - $5, 000. [SEP] he was arrested by the time he had been arrested, and went to britain. [SEP] the euro was steady to $1. 3555. [SEP] after falling against the dollar's price in tuesday trading at $1. 5473. [SEP] i am...... [SEP] meanwhile, [SEP]
+
+===== sample 022 =====
+[CLS] are expected this year. [SEP] before that, she added more than £5, 000. [SEP] she will continue to live with the older children. [SEP] north charlotte, n. c. - - the future of the new york state patriots and the nfl's most valuable player was officially announced wednesday, the same day after a super bowl game between washington and the washington redskins was officially over. [SEP] mark, jamie jackson, tim miller and james boulding, say they would like to know how many joys they have with their family, friends and relatives. [SEP] last week in johannesburg, when three englishmen were massacred during the [SEP]
+
+===== sample 023 =====
+[CLS] the weekend. [SEP] officials don't give a detailed list of conditions for that weekend, but as a member of the national team he knows how he plays and how the team responds. [SEP] some parts of the law. [SEP] " the problem is the increase in the number of bikers and motorcycles used in the country, of some of the people who are on the edge of crime. [SEP] the situation has not changed since the democratic party declined to take a position last year. [SEP] the audience, with 1. 7 million americans, will follow. [SEP] looking at how quickly congress wants a climate deal in the years ahead, some senators [SEP]
+
+===== sample 024 =====
+[CLS] mexico, now in mexico.... [SEP] mr ndeo, who had led a campaign for a full version of the law, said: "he was greatly encouraging the nation, the nation, northern ireland and his family to participate in the open process of power." [SEP] the lack of a "proper" system is unworkable. [SEP] while it is hard to be sure "that" on this, the point, the americans know, is that there's the question of being out - of - touch to know this - - - - - - - it is still very important for us to be in [SEP]
+
+===== sample 025 =====
+[CLS] the obama administration has also announced a $550 million loan to build roads and airports, a program intended to address the government's $6 - billion deficit, which it is planned for next year. [SEP] in the second game, the 2 - 4 virginia game did not have much to do, but could cut it off. [SEP] but only a few seconds, the victim's hand - - with his noose behind his shoulder - - was also hit in the face. [SEP] growing hopes that the troubled u. s. economy could show "modest" economic growth this year as central bank banks again cut rates in hopes of bringing [SEP]
+
+===== sample 026 =====
+[CLS], missile and air systems and armaments. [SEP] so it's not just a tragedy. [SEP] 2007 november - clashes between china's communist rulers and north korea followed two days later by the anti - state regime's anti - china campaign, widely expected to claim that beijing has never held power. [SEP] compared with those surveyed wednesday, analysts expect earnings of 11 cents per share. [SEP] several networks already have decided to strip at least several hours of video content. [SEP] it was published on guardian. co. uk on friday 28 23 july 2009. [SEP] scientists working at glacier national park in montana say they have discovered long - range [SEP]
+
+===== sample 027 =====
+[CLS] the music of william foster, a film executive who runs the company. [SEP] i do not know it. [SEP] the agency is expected to respond to the launch in september, adding to questions over whether it fails to make progress with satellite technology from its anti - ballistic missile system, officials said on monday. [SEP] what's my take on where this strike ends? [SEP] what kind of country these kind of things need to be on the same golf course? [SEP] koseberg is estimated to be out - of - line 1, 200 meters (2, 045) in wales. [SEP] adeb hiddink has gone back to [SEP]
+
+===== sample 028 =====
+[CLS] said. [SEP] during his time in the army in the aftermath of japan's world war ii, he served as assistant chief of official service to the german army, serving in berlin, paris and paris in 1958. [SEP] in 2007, bank of canada (otc: slc) was one of the largest commercial banks in the united states. [SEP] it came from spain, britain, ireland, germany, singapore and italy. [SEP] but the russians don't let the russian cold get away - - the u. s., canada, britain and russia don't agree. [SEP] mrs clinton also got the memo, offering a [SEP]
+
+===== sample 029 =====
+[CLS] the financial times. [SEP] mr kofi annan, 66, is the son of mamle mungiu, a one - time left party leader who is seeking to become the leader of the party after years in corruption charges. [SEP] i think it's great to take all the questions to here, except by the means (and most certainly, it's for me, regardless of the rules). [SEP] members of the nation's largest state have found it difficult for schools to give them a taste of what they have done, but some are still wary about dealing with their own problems. [SEP] after a survey of [SEP]
+
+===== sample 030 =====
+[CLS] st paul's every day to discuss the findings. [SEP] kt: what i'm very concerned about is with the economic crisis, and i don't think, people are just looking at the top of the problem. [SEP] we still don't have easy access to credit for mortgages or mortgages. [SEP] the report is a recent suggestion by warren j. buffett, the chairman of goldman sachs management and now chairman of jpmorgan management. [SEP] the arrest was made after weeks of footage of their son being raped at a pub near the scene of the crash. [SEP] they also say he worked in congress to [SEP]
+
+===== sample 031 =====
+[CLS] p. m. [SEP] the problem was his wife, along with his co - workers. [SEP] everyone will spend the next few quarters watching our field work. [SEP] the deal would mark a return to the european union's role in africa. [SEP] retail sales, the weak annual growth rate since january, jumped to 10 - 15. 2 points, according to consumer confidence, with growth in december at 18. 4 points and growth in november at 14. 3 points. [SEP] in a statement from the hollywood website, the actress says: "i have been thinking of things with me in this show about this man." [SEP] but what [SEP]
+
+===== sample 032 =====
+[CLS]. [SEP] auburn, wash., nov. [SEP] "i am not an unusual person," said wilk, who i might have had a better idea. [SEP] "i'd think it's probably going up, but we haven't done the same in 20 years as we have now, and that's not the case," he said. [SEP] failure to raise investment prices for the gas project is expected to heighten some of the tension between the nigerians and saudis. [SEP] it's important to make a choice so you can stand back and tell them to do with your children: " you ' [SEP]
+
+===== sample 033 =====
+[CLS] [SEP] we enjoy our game with every noise we can hear. [SEP] turns out: this is obama's life. [SEP] mccormack, 38, a jobless co - worker from birmingham, expects to raise a lot of money in the bank. [SEP] he still didn't get the idea when he would meet the next coach ranked no. 1 in the nfl. [SEP] but last summer, he couldn't have changed his mind. [SEP] mr brown's lawyers urged the commons to make a final decision on mr johnson's re - election, due in november at the same time. [SEP] the u. s. mortgage [SEP]
+
+===== sample 034 =====
+[CLS] murder trial. [SEP] sergeant david pitts, senior commander of the army for europe in afghanistan, said there was a "lot of waste." [SEP] he repeated the post he "wasn't sure what he would do." [SEP] the pre - election attack was a fresh blow after the government warned that the uk could not launch major military operations in the country. [SEP] dan cuomo's head of science and trade services shuttered headquarters in hartford, conn., last year and lost nearly $5 million a year. [SEP] his goal will be impossible to meet. [SEP] i was not going to move there. [SEP] and [SEP]
+
+===== sample 035 =====
+[CLS]. [SEP] the opposition leader has yet to reach out. [SEP] that's fair to me. [SEP] he said two other members of durogo's congress who were testifying were not affiliated with the group. [SEP] the ap's ed taylor, the president of the national association of state black journalists, said he renewed his support for this military effort. [SEP] i've had this kind of stuff several times and it's more of a way to be a game, even if it's a real place by the time i have seen it all. [SEP] yes, many people say that my father is an american who [SEP]
+
+===== sample 036 =====
+[CLS] lack of income. [SEP] she isn't even surprised to find out all the same stuff, because she knows her daughter doesn't want to go. [SEP] it announced in august last year that ford and toyota would stop selling models. [SEP] mr holwelle, the education minister, is thought to be a key key figure for the house of commons's schools and services committee. [SEP] predictions of a 6. 3 rise in 2011 - 12 months after this year's trade increase, should suggest that the rate of decline is leveling out. [SEP] chicago's population increased by 10 percent in the summer, allowing a [SEP]
+
+===== sample 037 =====
+[CLS] has been a disaster, "moseley said. [SEP] 13 (upi) - - two small guns were found on the wall of a new york man as part of an investigation into sharing inside information from a gunman. [SEP] the major factor for the problem was logistics," said a spokesman for the russian military. " [SEP] my job is to get into politics or anything. [SEP] clinton's brief speech at 9: 35 p. m. came less than two hours after meeting with officials from several countries and the u. s. government from islamabad, pakistan. [SEP] in all of these news conferences, however, the [SEP]
+
+===== sample 038 =====
+[CLS] nathnieh said monday. [SEP] and the government seems to be keeping them open. [SEP] yes, just do. [SEP] the agency said tuesday the u. s. unemployment rate rose 2 percent in 2009 compared with those in the u. s. in 2008. [SEP] here's another theory. [SEP] the newspaper also accused woods attacking his father, kevin, when his father said he was severely bound and was not having sex with his wife. [SEP] i could only be one of the things i could do it - - therapy. [SEP] " i was sorry what happened there but the first thought i'd go was to win. [SEP]
+
+===== sample 039 =====
+[CLS] possible, "gov. john lynch said on the day of the summit's meeting. [SEP] bush invited hu and hun sen, then vice president of the united states national council for north asia, to attend the talks. [SEP] now, the number of the alleged escapees has been set at at least 200. [SEP] 3 (upi) - - u. s. military officials were holding talks with iraq on the middle - east peace process, hinting at more significant progress, officials said. [SEP] the new series on" mad men " (channel 7 at 8) and nbc (channel 7 at 9) have how to [SEP]
+
+===== sample 040 =====
+[CLS] out of something big. [SEP] the newspaper also had no immediate comment at the meeting, media outlets were reading its report. [SEP] he said there was no way to provide iranian security for iran since in 2001, the bomb was hit in the back of a convoy, and that one iranian employee was killed in a single air raid on tehran airport, the latest shooting of a private plane. [SEP] he found out his third wife, who - - when he was a teenager - - was going on a weekend having a son with regard to her own identity. [SEP] question: what would you like, b - word? [SEP] it is expected that [SEP]
+
+===== sample 041 =====
+[CLS] s aids relief project in africa. [SEP] in america's view, what is right at the heart of it is economic policy. [SEP] " there's going to be fighting in the road. [SEP] i don't want to say it was wrong. [SEP] the program will be ran on cable television at 7: 30 a. m. [SEP] two weeks later, mr brin went to the children's hospital in hamilton, birmingham, visiting for the first time in torssin. [SEP] mccain's campaign said there were no details of those plans and obama's advisers were not expected to announce the plan tuesday. [SEP] [SEP]
+
+===== sample 042 =====
+[CLS] police said. [SEP] here, congress, which has three million members, plans to use a resolution to try to keep the government on hold, and calls on the government to back the amended version of the law that followed, of course, the elections. [SEP] " the government is challenging the nation's economic and political interests. [SEP] the incriment - seeking secretary, who has an impressive array of young supporters, including his son and two daughters, is the ex - secretary of state to arrive to africa in recent days for monday night's game. [SEP] the cbi survey for manufacturing industries found that 43 percent of people said [SEP]
+
+===== sample 043 =====
+[CLS] slow and unsustaining. " [SEP] i try to think this year is a good time to raise money, but do we know they're even back in paris? [SEP] the government's plan to cut public borrowing costs by 5 % - - - double the size of the year - - until the end of june, says the prime minister, after talks to the uk banks on thursday to urge them to cut spending. [SEP] spain has also won the european champions tournament event this year with its country club tournament, and the tournament finals will take place in washington on sunday ahead of the n. b. a.'s [SEP]
+
+===== sample 044 =====
+[CLS] ncaa tournament for the second consecutive season. [SEP] in flint, a 12 - year - old boy was fatally shot, whose name has not been released. [SEP] he described the protests as a protest against economic corruption repackaged by the state media. [SEP] under the tories, due to the same concerns, the party will never be able to do that, both of which will be lost in the autumn. [SEP] airport engineers are also expected to resume their work in coming days. [SEP] 10 p. m. on espn, " said nfl president mike pereira. [SEP] don shenton, 377 washington avenue, 800 - 427 - [SEP]
+
+===== sample 045 =====
+[CLS] 35 billion next year is expected to increase to more than 14 billion to $14. 5 billion. [SEP] while i may prefer mr. bush to put his hands and hand on his chair, i was also drawn to the assumption that john mccain and his aides, a "skilled conservative," had suggested who was the best person to win the presidential nomination. [SEP] but what about the tone of the governor's comments, which he echoed with a smile on the subject. [SEP] he's currently a junior quarterback in the nfl and holds a national football league record. [SEP] a third costs no more than that, he said, [SEP]
+
+===== sample 046 =====
+[CLS] association. [SEP] the final phase of the funding budget for the new universities would have provided about 20 per cent of the total fee for the two years to be delivered at the same time this year. [SEP] it's one of my regrets in this sport. [SEP] "it's a long and difficult moment," said 51 - year - old komao of wchung international. [SEP] the deal would also make china japan's biggest military base in decades, with a union pushing a direct line with the united states. [SEP] sterling rose by 0. 5 per cent against the dollar to 0. 386 per cent. [SEP]
+
+===== sample 047 =====
+[CLS] 4. 3 billion. [SEP] a source in the house said wednesday that the conference would not show the support for the settlement, and said it would hold a full exchange of questions on israel policy to mark the end of the fight against the jewish state. [SEP] mr. haughey is a housing minister, and hegey's local manager, joe dulles, 22, said he had his son. [SEP] it has dropped to pre - 60 cents from $60. 35 to nearly $90 a barrel. [SEP] he said the request for another 1, 500 additional combat troops from afghanistan and iraq to join the nato - led [SEP]
+
+===== sample 048 =====
+[CLS]. [SEP] the parents of their loved ones remain unsurprised by the north's plight, comscore the south korean children's story on wednesday. [SEP] the eu institute, focusing on greenpeace in portugal, italy and spain, is owned by the national resource council. [SEP] the company's main rivals, uk and uk coal, said total sales were 2. 6 per cent lower than the year - on - year average in june, when analysts had been forecast of a further drop. [SEP] he will cruise through the dark, dark, and gloomy conditions of the tate gallery, an art gallery in london [SEP]
+
+===== sample 049 =====
+[CLS], but it's been made more attractive this year. [SEP] it's three weeks to work out, i'm still there but i am going to take it back soon. [SEP] liberal opposition leader george khama's party has been campaigning for the presidential election. [SEP] in may, the island's government proposed offering a reward of up to 586, 000, the cost of which would rise to around 22, 000 yuan ($14, 800). [SEP] boehner says he wants to hold a house vote on tax changes and plans to support the bill. [SEP] best time of the year. [SEP] [SEP]
+
+===== sample 050 =====
+[CLS] such a review, and said security procedures needed to be re tightened. [SEP] his center - right rival, myung - bak's party, refused to restart eight years of negotiations, saying it had been willing to settle talks with the north. [SEP] but that figure reflects the degree of links between the crisis and recession. [SEP] it borders israel and egypt since it fell to the gaza strip during the 1967 war. [SEP] police have made an attempt to trace a 17 - year - old who was seriously injured in a car crash on the m4 in hampshire on sunday, police have said. [SEP] aig's f & co [SEP]
+
+===== sample 051 =====
+[CLS] and never look at it, " he said. [SEP] everett, wash., may 13/prnewswire/- - the department of commerce and energy, the office of the bureau of national energy statistics, announced today that it plans to meet with the u. s. department of energy, formerly the executive arm of the u. s. treasury, to discuss its efforts to look at the carbon footprint of nuclear power and promote energy efficient technologies. the two are likely to meet on friday for the next meeting on sunday. [SEP] his father, jeff, a property economist, made the decision, according to his son, who [SEP]
+
+===== sample 052 =====
+[CLS]. [SEP] but before the president moves out, the cabinet will likely find out how to deal with their jobs, with democrats far ahead of the leaders. [SEP] cnn: i mean, senator - - you have to ask serious questions about how the 2008 situation might look like an election, really, because some of that can't be said. [SEP] "it was a call, and i didn't want it," he said. [SEP] there was no debate on his future. [SEP] the current government support for the new bank had previously called for shareholders to call for a two - month period to bolster the prospect of a takeover [SEP]
+
+===== sample 053 =====
+[CLS] few days, i couldn't get out about what i was doing. [SEP] and after the third hole of his rookie year at the golf course, woods, who had planned to run the course, said he hoped to break that. [SEP] "the television still goes on," he said. [SEP] what the government wants to do now, " said mark paulson of the guardian newspaper, 24. [SEP] they can also get the information, this time through their web site. [SEP] shares of google slipped 33 cent to $27. 12 each. [SEP] the official said the plan was based on the efforts of the bush administration to protect [SEP]
+
+===== sample 054 =====
+[CLS] had been in the hospital room. [SEP] napolitano said his agency had heard it from the government since the weekend, but added the decision was simply a matter of the law. [SEP] it was likely that some men, such as jason taylor, from camberfield, kent, and robert mullen, from cheetham, kent, had set a reputation for anti - inclusiveness. [SEP] i have a friend, an retired farmer, of pebbleton, california. [SEP] canada's government is expected to set the target for limiting carbon emissions trading by parliament from next october. [SEP] it is down to the environment and health [SEP]
+
+===== sample 055 =====
+[CLS] the southern european space agency (jaxa), and eventually the mars orbiter programme. [SEP] the news is another sign of the strain that runs pakistan's political system. [SEP] it's just another matter for a young guy who's what it's and that's life. [SEP] the president is expected to expand the effort to make sure he keeps information about the nation's military strategy. [SEP] new jersey and new york had the worst days of the post - war 1990s. [SEP] he was real. [SEP] cbs news - news reported. [SEP] murtha's office said the u. s. air patrol [SEP]
+
+===== sample 056 =====
+[CLS] took the idea of hillary clinton a long shot for the presidency. [SEP] he said there is a stronger case for the united states government, which has "responsibility for mediating" conditions in iraq. [SEP] know what it won't be here to think. [SEP] some of the world's biggest mobile brands have launched campaigns in japan this year, increasing turnover by more than an estimated 700 per cent. [SEP] mr brown began a visit to sri lanka with the prime minister, john john kivane, on thursday. [SEP] japan's public sector is being hit hard by a deep recession, and huge changes in the economy are expected [SEP]
+
+===== sample 057 =====
+[CLS] to be concerned about where such information passed. [SEP] the show is the second appearance of the year at the first us national congress, and it was the country's long - running public car show. [SEP] we have to learn how to be patient, " niedermat said in a press release. [SEP] washington (ap) - the u. s. military refused to give a senior u. s. military official visit to turkey on afghanistan and iraq tuesday, saying the iraqis were not connected to washington's efforts to push forward but instead asked on the pentagon leader to look at turkey's claims. [SEP] in spain [SEP]
+
+===== sample 058 =====
+[CLS]er and jose reina collided at the red line in the aftermath of the first half. [SEP] " in addition, george w. bush is considering changing his position on north korea's nuclear plans, said u. s. vice president george w. bush said in a statement that the us president would like to press the united states to bring north korea over to the two koreas as it moves into a war with washington. [SEP] there may be a gun in the house, but they need to be clear, both the male and female. [SEP] according to a review of high school results, the survey has found that fewer americans spend [SEP]
+
+===== sample 059 =====
+[CLS] was deferred at a local hospital for three months. [SEP] and seeing the world's best golfer sounds a lot like a good idea, she said. [SEP] the next day, clark was able to get home to his family in the morning when he was 6 months old. [SEP] i am happy to be playing for liverpool next season but i was lucky to get to it again. [SEP] jk to say that's correct: that's just so sad you're not surprised. [SEP] and that's an issue that we're talking about. [SEP] the operation was conducted at the royal national college of art, [SEP]
+
+===== sample 060 =====
+[CLS] would have put much pressure on the bank's board. [SEP] the agency said it would be a mistake if it were designated as a green haven - - and any details of how much would be known. [SEP] this movie's performance may diverge from what you think about those days. [SEP] he has been a partisan force for most of his political career. [SEP] on tuesday, clinton and obama's democratic rival hillary clinton also met with two board members, robert cohen, a law professor at the columbia school of science and technology, and the director of national security, robert white. [SEP] he said that the eu's decision [SEP]
+
+===== sample 061 =====
+[CLS] a senate race, what's behind it - - controlled by the democrat majority of two - thirds of the house, and the majority of the republican stratosphere - - was set by the republican party of new orleans. [SEP] some also want to find a place to go camping with their own families. [SEP] authorities in the u. s., france, england and denmark, new mexico, singapore, australia and australia have applied for a criminal hunt. [SEP] sen. john paulson, the former treasury secretary, has worked as a columnist for the new york times where he wrote columns for economists, foreign policy, political science, [SEP]
+
+===== sample 062 =====
+[CLS] is known for being in the dark, up - the - air and proclaiming victory over all the owners. [SEP] "that way, it's going to take a long time to understand and recover in this time, trying to get people to see the world of stand - up, comedy and originality," he said on cbs. [SEP] obama and democrats adjourned wednesday for a two - week session on a senate compromise on oil production. [SEP] "the biggest problem in the past week was their school costs. [SEP] this is the first big increase in china," said mr pedock, who has worked on the [SEP]
+
+===== sample 063 =====
+[CLS] the middle of the night. [SEP] president obama can do this now, and he also wants to stick with its caucus in the senate, by changing the cost of reform, giving democrats a chance to improve their position. [SEP] i thought that was the great thing, and then yes. [SEP] over that time, the a & t pays $150, 000 to $100, 000, and california's $60, 000 team will pay the state $10, 000 to promote this contract. [SEP] these are important in the president's judgment, since there is little evidence of the banks losing the majority of their losses, according to [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_diffusion_noise_steps_128steps_n64/tpow2p0_const1p45_c256_raw_samples.txt

@@ -0,0 +1,230 @@
+tpow2p0_const1p45_c256
+{
+  "type": "summary",
+  "name": "tpow2p0_const1p45_c256",
+  "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt",
+  "step": 187000,
+  "decode": {
+    "kind": "categorical_fullvocab_diffusion_state_noise",
+    "config": "tpow2p0_const1p45_c256",
+    "steps": 128,
+    "temp_start": 1.45,
+    "temp_end": 1.45,
+    "temp_schedule": "const",
+    "t_power": 2.0,
+    "eta0": 0.0,
+    "eta_schedule": "none",
+    "noise_conc": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 50.51946723435765,
+    "nll_per_token": 3.922358751788475,
+    "tokens": 9217
+  },
+  "diversity": {
+    "sample_entropy": 4.078867688498713,
+    "unique_tokens": 1928,
+    "token_count": 8192,
+    "distinct_1": 0.2353515625,
+    "distinct_2": 0.7000492125984252,
+    "top_token_mass": 0.0865478515625
+  }
+}
+
+===== sample 000 =====
+[CLS]8, 000 to £15 per year, would cost £40 per cent of the average nhs budget. [SEP] there was no word woods was on a strong par 72 in the third round, but the british pga leader was two shots off the lead after eight holes in front of him. [SEP] they seem like a long story line for an array of extraordinary jobs every year. [SEP] net debt stands at around $ 60. 5bn - nearly $ 100bn according to dp capital markets reported last month. [SEP] oil fell $ 2. 15 to $ 89. 09 a barrel while the euro rose to $. 542 [SEP]
+
+===== sample 001 =====
+[CLS] ' s acknowledged that he is just as an obstacle to change, but he ' s like it ' s up to figure out what he ' s doing. [SEP] and if the speech seems to lack a popular vote, how would you cope with mr. mccain? [SEP] " he wants to find out the details of america... and the obama administration wants to show that, " he said. [SEP] theodore alcora, mr. pickton ' s lawyer, could not provide much comment on mr. housberg. [SEP] they said none of mr. callier ' s accounts or contacts and contacts had gone to the company [SEP]
+
+===== sample 002 =====
+[CLS] two points. [SEP] pyongyang said tuesday that the envoy would not meet north korean officials this month with south korean unification minister kim sung - bak, a former leader in north korea ' s april 25 - 25 war and with ties to the united states. [SEP] foreign minister sun roh mok hyun defended the comments, saying the president refused to be contacted by senior officials. [SEP] she stood outside, the day off with her family. [SEP] " there is someone who needs to see through music, a person who wants something of the same it seems, and i ' m happy about it. [SEP] to that end, china [SEP]
+
+===== sample 003 =====
+[CLS] in the early morning, officials say it lights up on 8 to 10 hours per night, much longer than usual. [SEP] the drawback is simple : no one else has reached the summit. [SEP] iran is trying to team up with the united states to shore up its relations with " non - core countries. " [SEP] it was last updated at 14. 11 bst on monday 4 april 2009. cityjob. account manager is required to fur.... to £20k. london borough of eaf.... £26, 766 rising - £26, 038 pa.. bristol city council. [SEP]
+
+===== sample 004 =====
+[CLS] this past 2010 and will not require much springboard time. [SEP] the israeli party leader, avidar abbas, said the rebels would not come forward during the israeli - fire cease - fire. [SEP] if they are the same people, what are they saying when they ask??? how do ya use the word?????....... the same television news microphones don ' t.......................................... [SEP]
+
+===== sample 005 =====
+[CLS].............................................................................................................................. [SEP]
+
+===== sample 006 =====
+[CLS] megawatt called the u. s. department of water and interior to stay on the agency ' s decision after a federal commission had urged congress to approve the extension. [SEP] but if that happens in the course of season, they have no doubts about the team that ' s now playing. [SEP] " that ' s why i don ' t think the storm is coming out, " said bill sene. [SEP] 18 ( upi ) - - the cost of health care for american soldiers and families was asked whether washington would share more than 5 percent of nearly $ 3 billion under barack obama ' s war in iraq. [SEP] a japanese [SEP]
+
+===== sample 007 =====
+[CLS] supplier revised down estimates of just over $ 500m in the three months to 2008 and has forecast that its annual cost savings will fall from $ 1m ( £73m ) to $ 2. 8bn ( £30m ). [SEP] in beijing, high - level officials, official lawyers and chinese journalists have a near - universal concern of how difficult the situation is for now. [SEP] mj : " yeah... i can ' t remember anything from when i was watching this young man, i thought about the way, " koreu said of his daughter. [SEP] but p. t. c., " [SEP]
+
+===== sample 008 =====
+[CLS] and recognition of israel ' s human rights record. " [SEP] many of the companies, however, were directly frustrated with the market ' s largesse. [SEP] no central government is able to keep american foreign investment because there is not enough money. [SEP] he added that he and the family had wanted to remain as a part of the church ' s life. [SEP] obama has little else to offer in these disparate societies. [SEP] " that means the more young members know the tune to everyone ' s money, the better to pay them it, " said mr. carombe. [SEP] when she was just 15 years old, american [SEP]
+
+===== sample 009 =====
+[CLS] not aware of the commission, and he is not involved in the project and wants to find a list of the way to pay the costs, said dan todd, a spokesman for baltimore ' s finance agency. [SEP] he is to meet opposition party leaders who vote after a general election on tax rises and shadow education minister michael gov. [SEP] but you can ' t deal with it. [SEP] fox news. com knows the wisdom of the commenters at fox news - - tom coo, award - winning mike bierstein, bill jones. [SEP] what is called human behaviour? [SEP] paul mcfarland said last week ' s attempt at [SEP]
+
+===== sample 010 =====
+[CLS] obama, the rival mr. mccain, defended his new york words. [SEP] " if we could talk about what happened, we ' d be talking talking about the situation and just wondering if there was someone who ' s talking about football or going back into the country. [SEP] indeed, mccain is more honest than his super - licensors ' negotor... but it ' s just not up to a democratic politician ' s standard. [SEP] " we ' re having a lot of discussions... this morning, " palin said. [SEP] washington ( ap ) - nancy biden ' s husband, friend, brother [SEP]
+
+===== sample 011 =====
+[CLS] shot from the sky. [SEP] the court heard that the pair and the bbc ' s director sir richard walker, who had evidence of their families, called the head of the gmc to obtain calls for mi5 to conduct an information seeking investigation. [SEP] varitek is upset and excited about losing damon, but no one wants him to take him past his stall. [SEP] emmaus, a scottish, u. k. travel destination with its skiing services, attractions and private services, may have much more of a world - class character and tradition, but to the world of the very wealthy and far from famous. [SEP] " we have [SEP]
+
+===== sample 012 =====
+[CLS] to contact with iran in july 30, 2009, just 10 days after the missile landed in northeast qom, " the statement said. [SEP] teachers, you know, are not just the bush administration ' s policy advisers. [SEP] for a majority of americans..... do not.............. well, by the constitution ' s logic...................... [SEP] it ' s just look like he was getting on with it, and now......... [SEP]
+
+===== sample 013 =====
+[CLS] became clear that the prime minister was prepared to tell the truth on behalf of him, along with the newspaper ' s political editor, the parliamentary standards minister. [SEP] in the first place, however, people wanted to know certain things that would come across. [SEP] activity in the middle east is expected to slow down. [SEP] the governments of china and north korea defended the rights of the united states and russia, the paper said. [SEP] earlier this week david petraeus, the new u. s. general for afghanistan and pakistan, also said he was prepared to deal with the situation. [SEP] capello added : " the players are facing questions [SEP]
+
+===== sample 014 =====
+[CLS] the american economic finance committee will give the chinese government the united states as well as well as the resources for china and the united states, " sengg lee said last wednesday, after meeting with beijing communist committee president yu of a group of six leading countries. [SEP] it was the coldest reported death made by the junta since taking office in february - march. [SEP] she said she was abducted, but she was freed after her local police had arrived. [SEP] i had to do that, " he said. [SEP] i don ' t know if we just want obama to go this way, she is going to take the reins alone. [SEP]
+
+===== sample 015 =====
+[CLS] and f. d. i. rules. [SEP] but without the mention of israeli law, palestinian military outposts and arab foreign policy, bush described the israeli - palestinian peace process as one of the most contentious issues. [SEP] miami ( ap ) - two cubans charged with a massive plan to return to u. s. soil in cuba arrived friday at the airport. [SEP] but, they ' re doing that. [SEP] he ' s a good coach at the way this comes out, " wells said. [SEP] about 90 people have been released from iraq, rwanda, congo, ethiopia, burundi, kenya, north korea, ireland and egypt [SEP]
+
+===== sample 016 =====
+[CLS] talks. [SEP] north korea has taken a position to end all areas of friction with north korea on human rights, security and aid to achieve nuclear disarmament, gates said on tuesday in a rare statement on its nuclear policy. [SEP] huckabee ' s proposal at a meeting with fellow members of the republican and white houses of the senate. [SEP] the church - ulsteront committee to be unveiled on wednesday details of its main plan : drawing up a strategic plan to link the growth of the north of the irish peninsula and the use of public transport. [SEP] mr mcshane ' s claims that despite the circumstances around him, the [SEP]
+
+===== sample 017 =====
+[CLS] stop at this " nonsense " and create a new government. [SEP] he has decided on whether to give his speech to obama. [SEP] " the joint build - up is a significant part of the ongoing review of the defense system in europe aimed at preserving the shield under the security treaty, " the president ' s office said in a statement. [SEP] this isn ' t all about money and quality. [SEP] the spanish queen ' s birthday party was scheduled to be held in liverpool royal bank this morning. [SEP] mr obama ' s spokesman insisted that india had not been granted direct links to the united states and britain, and said he would ask the [SEP]
+
+===== sample 018 =====
+[CLS] would not want to live with him, but still would likely want to stay free for five years. [SEP] " if you say what you say it ' s harder, " he said. [SEP] farahi asked the group of islamic states saturday to begin the withdrawal of force troops from the south african states, a group that has about 40 taliban and al - qaeda leaders and members from central and west africa. [SEP] the newspaper said the prosecution lawyer said kercher kercher ' s wife and her boyfriend ' s wife, rudye guccio, and told her husband that contact between her and police was investigating, too. [SEP]
+
+===== sample 019 =====
+[CLS] points, and atlanta ' s carlos villanueva also also scored. [SEP] richard bonse, an international airport officer with the department of space travel, said there were 4, 500 people, with an average of 24 hours of 20 minutes, to put up a demonstration of the palm beach savoy lighthouse and florida ' s 12 - foot monster. [SEP] el - muallem rejected the un general ' s proposal to allow iraqi participation in a joint road into talks. [SEP] the experience of the former us secretary of civil service and resources will not be discussed in the g - nations meeting, said john edwards, former us secretary general [SEP]
+
+===== sample 020 =====
+[CLS] said the move was an important dramatic change to the nature of post - cold war era ties and exchanges between russia and japan after world war i with china and russia. [SEP] one would like to see what he finds in the line, then you stay with the team he owns in order to look after the bad side. [SEP] british prime minister gordon brown has gone ahead with his call for a new common currency of the euro. [SEP] meanwhile the number of men ' s homicides in britain and wales has fallen more than 20 percent since the start in 2003. [SEP] israel must be united in its efforts to tackle the price of electricity and energy [SEP]
+
+===== sample 021 =====
+[CLS] deal five years ago. [SEP] just the one thing to know : validation of our own policies. [SEP] they are aged over 10 years, with an average time of 19. 5 hours. central london. greater london. london city council. london, west midlands. c £28. 25 per hour. london metropolitan university. north london, birmingham, nottingham, london, leeds, leeds, north - west, newcastle, wokingham, east midlands, nottingham, north tees, nottingham, orpingtonshire, glasgow. [SEP] the result was a complete attack on george w annan ' s authority. [SEP] although the action includes [SEP]
+
+===== sample 022 =====
+[CLS] the first bank holding company of the federal deposit and insurance corporation - - the nation ' s largest bank - - and national bank of scotland. [SEP] after his death in 2008, mr obama had spent his time promoting public policy but abandoned his presidency in the 1990s, bankrolling his trip to afghanistan. [SEP] the leader of britain ' s tennis team discusses the key subjects in higher education, sex and sport. [SEP] one of the women was rescued by rescuers after it fell in the village of kotria qur on friday. [SEP] a spokesman for the scc said : " now it ' s time to stop, andy, [SEP]
+
+===== sample 023 =====
+[CLS] health insurance coverage will make a lot more than $ 300, people who will make more than $ 100, 000, those making an income of $ 35, 000. [SEP] on 16 december, paul kan, japan ' s foreign minister, visited hong kong after meeting with french opposition president jean president nicolas sarkozy, called on his foreign minister and government to intervene. [SEP] i think obama needs more. [SEP] the i. m. f. described the talks as " co - operation " and asked how much effort must be done to stabilise the market. [SEP] the department of health, clwyc and the duma government [SEP]
+
+===== sample 024 =====
+[CLS] 2008 general election campaign. [SEP] bob watson is a physician at the kennedy center. [SEP] rescue workers in the central region have found more than 50 people dead who were missing because of drug trafficking. [SEP] but with the votes to put up a bill in the new congress in the next week, president bush says they will be willing to remain on the agenda. [SEP] mr tobin was not involved with the sport until that time, in february 2003, when mr gardner had got into a period of violence and pregnancies with mr doran and ms hingdon. [SEP] firefighters have been at a house in shropshire to stop a series of wild [SEP]
+
+===== sample 025 =====
+[CLS] reserve and european fiscal policy and pledged to take " seriously additional " measures to help the economy. [SEP] as for doctors who report out a review of what ' s happening around abortion. [SEP] one needs to get that right. [SEP] " what green are you? " a friend asks impatiently. [SEP] the company is led by xue liqial, chief executive of the huazhou economic development co. [SEP] the franc ' s value rose faster against chinese currencies per month against other major currencies and has climbed 30pc to a record high. [SEP] in sydney, australia, while playing football at university. [SEP] tnk [SEP]
+
+===== sample 026 =====
+[CLS] would put an agreement on the gaza border and an israeli - palestinian peace treaty based on negotiations. [SEP] the obama white house and the senate have agreed agreement on states to hold its own early - voting polls at the weekend. [SEP] she is expected to get as much as 15 million of dollars. [SEP] it comes a month after she was confirmed as mayor of london and prime minister nick clegg to leave her post. [SEP] but this summer, he ' s facing a tough fight with chris boland, itv ' s chief executive, who believes brand should be strong in the run to european elections in 2008. [SEP] and since it has [SEP]
+
+===== sample 027 =====
+[CLS] support in some states and could trigger a difficult campaign for mccain. [SEP] police launched the investigation after concerns over allegations of sexual behaviour. [SEP] but he is not a big dropper for a team that was interested in playing the game, but he has the experience to be successful with the team ' s offense. [SEP] since the report, mr johnson ' s deputy peter msp has made a personal pledge to the council ' s chairman david johnson to be confident the council will investigate the matter. [SEP] " he was home at the same time - - i couldn ' t do it, " he said. [SEP] " some of these criteria are [SEP]
+
+===== sample 028 =====
+[CLS] while mr. obama ' s proposal included a $ 25 million end - of - the - year cost, the senate and democrats say that they ' re proposing a $ 5 - billion budget shortfall. [SEP] the commission was formed as part of a deal intended to replace the west bank - led regime, however, which has major traction with anti - western groups, further furtherraging russia ' s past demarning with the western osset region. [SEP] but he has the bulk of character, experience, a good attitude, with lots of money and a pair of handouts. [SEP] " i have been in the hospital for some [SEP]
+
+===== sample 029 =====
+[CLS] of the law should be protected by the law. [SEP] " and if no case has been made ", it will be a tough decision, said david hogg, a labour spokesman. [SEP] the next 20 years, anthony smith, mr williams ' s father, saved the lives of his three grandchildren, living a little more than living back from their loved parents. [SEP] not just like expensive tvs, old - world watches and expensive dsl cables. [SEP] during a nba coaching career, donaghy has gone ahead. [SEP] the person in the hospital staff was patricia martin, director of medical services at the department of veterans ' affairs [SEP]
+
+===== sample 030 =====
+[CLS] ' s painful management of the open. [SEP] but, this is something that gives the sense that the england team will live with it. [SEP] and even the african union has been described by many as the most corrupt countries in the world. [SEP] but he ' s popular with the program, which hasn ' t helped his football team. [SEP] " it was pretty rough - - we ' re in the middle of the park, " she said. [SEP] israel appears determined to put end to the violence. [SEP] and it has nothing to offer. [SEP] participants can call 301 - 630 - 3730 or toll - free code 8794 [SEP]
+
+===== sample 031 =====
+[CLS] customers. [SEP] the public service service also provides a perspective on entrepreneurship. [SEP] he threw the first touchdown of his own cowboys defense, 34 yards to justin garolo, the second in a 35 - yard drive. [SEP] the latest research also shows a fertility rate at nearly three per cent, and it is rising rapidly. [SEP] " you don ' t know what your body means, but now, everything is here, everything is normal, " he said. [SEP] he said he believed india could surpass the growth and growth rates year - to - end under the weight of the current global economic crisis. [SEP] " we are delighted that [SEP]
+
+===== sample 032 =====
+[CLS] director of the national football coaches association, said some players have been concerned about this practice because it ' s known to help minority players coach a football team, said nick smith, senior assistant to the college ' s vice director of policy and policy, and garrett, senior senior assistant vice president and dean to the president ' s school of sports. [SEP] clinton went to north korea, japan, south korea and the us secretaries of defense, pran and shin, and chinese foreign minister kye - sesong, north korean foreign ministry minister li yongyong and the washington post. [SEP] its u. s. at $ 10. [SEP]
+
+===== sample 033 =====
+[CLS] early years of celebrity golf legend bretton woods, his policy now is to spread the pressure to golf icon tiger woods through the sports arena, including his recent face - to - face tirade with tiger woods and espn ' s ged thomas on a sports web page. [SEP] but tehran has used the report as its strongest position on the issue after the 2001 nuclear shuttle agreement with washington. [SEP] western officials have dismissed growing demand that israel would have urged the security council not to freeze the country ' s nuclear - related arsenal over the next two years. [SEP] he has repeatedly used his successor to be a prime minister. [SEP] the agency has [SEP]
+
+===== sample 034 =====
+[CLS]yaan satellite station in russia. [SEP] thursday - - 5 : 30 p. a. m. 9 : 30 p. m. 7 : 30 p. m. ( gmt ). [SEP] police said it happened at crydon woods in pugden, on march 24. [SEP] the dow closed down 1. 2 points, the ftse - 50, 000 shares fell and the global 500 fell 0. 3 per cent, a decline of more than 10 per cent. [SEP] willis mcgahee was 7 - of - 17 for 278 yards and two interceptions, while fal was 4 - of - 6 passing for [SEP]
+
+===== sample 035 =====
+[CLS] total number of suicides has dropped by just 20 to 19 percent since the start of 2007, the lowest year in nearly a century in more than 50 countries. [SEP] " it ' s a very hard challenge to get through this, " gates told reporters. [SEP] she claimed to make the thing better in writing but found that almost " a little fruitless. " [SEP] ms rice also said that ties with china - - its worst since split by the south korean war - - was a growing concern in the current relationship with the united states. [SEP] this recession means an economy that has lost more than half a million jobs last year, company [SEP]
+
+===== sample 036 =====
+[CLS], i have the credit experience, not the ability to do all. [SEP] two of the migrants arrived yesterday after ships carrying supplies from the uk ' s west west of england were sent away. [SEP] meanwhile, violence still flared, mainly between arabs and thousands of palestinians, many from gaza in the west bank, where the gaza war was raging. [SEP] after being preptrained to be a rugby player in the british national team while at university, he started being a school boy, although he stayed on the touchline when twicke was at them, urging him to make use of his pen and physical skills and stay in his place [SEP]
+
+===== sample 037 =====
+[CLS] the international monetary fund. [SEP] the first question of what a senior has the ability to do is to who and who. [SEP] by virtue of his political personaes, america has turned its back with all the americanism. [SEP] warkojen was ninth in the german kring, the first group of riders to use nachovis in two years, which is just mcpond ' s ninth victory in the tour. [SEP] jerusalem ( ap ) - a senior cabinet official said the israeli leader is moving toward the end of u. s. president ' s term of a 50 - year freeze, and that the administration has not [SEP]
+
+===== sample 038 =====
+[CLS] down from 4. 3 percent at the end of last year. [SEP] meanwhile, growth rates rise 6. 5 percent in 2010 to 9. 8 percent in 2011 and another 8 percent in 2010, " it added. [SEP] it wasn ' t so long ago that some of the new records make no claim to be true. [SEP] " it is very hard to meet the californian workforce and move away from our ageing and aging record in the last 15 years, " says doug hau, president of brown college golf ' s new program that will allow american school workers to do at least 25 full - time at a third level. [SEP]
+
+===== sample 039 =====
+[CLS] " said professor richard taylor, a professor of law at the school of law, in washington. [SEP] the group ' s travel data and national travel tallies shows that yearly visitors to the united states would be reached $ 2. 7 - billion ( approximately $ 2. 5 billion, £1.. 3 billion ). [SEP] the bad debt, otherwise known as " bad " debt, has increased through the third quarter of 2008 to $ 3. 1 billion, the company announced. [SEP] he also has a strong following of schropia. [SEP] rickie wilshere, matthew murphy and craig hibbert had their goals, [SEP]
+
+===== sample 040 =====
+[CLS] £11. [SEP] the family of a car that is believed to be worth £3billon in ikea said it was not allowed to keep the car there for a few weeks. [SEP] medvedev has given president obama only one go, but he feels the united states can achieve a political deal, not the collapse of russia ' s position, the official said. [SEP] the idea of the grand council is to try to give a global change to the world. [SEP] depending on the transaction, the bank ' s working capital position will increase to $ 300 million in september 2007 - 2009 and $ 200 million in connection with the tarp [SEP]
+
+===== sample 041 =====
+[CLS] more than 1, 000 students who are not allowed to take a job, including a probation officer. [SEP] brown seems to understand his point. [SEP] but on monday in september 2007, when mr. daley was taking over the law school, his wife ' s college admission ( and degree ) would have put him as close to his head. [SEP] i don ' t think we are going to learn from a man more like obama. [SEP] paul hilsen ' s award - winning film, " tintin in the wild side, " reveals all about the film ' s trying times. [SEP] in the 1990s, china joined other countries [SEP]
+
+===== sample 042 =====
+[CLS] china, the world ' s largest export market and america ' s largest economy, had nearly 500 jobs and jobs on its payroll from the post office. [SEP] but wen acknowledged that china was seeking " close friendship " with us foreign policy, saying it was a sign to beijing not to wave a positive attitude, and an reference to china ' s willingness to allow greater human rights to say china must address all issues in need to " ensure our support for the period of real change. " [SEP] i was great for men ' s cup of football, i worked in all those sports, and i haven ' t gone anywhere before. [SEP] brian [SEP]
+
+===== sample 043 =====
+[CLS] prepare students in today ' s world " and get them into algebra. [SEP] so he came out of the building after winning the rose bowl. [SEP] messages and phone e - mails are sent to the hospital ' s web site. [SEP] this time it is keen to focus on the health and education field, because of the growing widespread tobacco use in some schools and universities. [SEP] he said the government was examining the cases but did not discuss any specific legal grounds. [SEP] lab _ wilson, philadelphia ( interference ), 2 : 03 : 34. [SEP] i don ' t hear the old - fashioned whines and thuggery [SEP]
+
+===== sample 044 =====
+[CLS] $ 10. 5 billion of public debt needed to finance it. [SEP] kerry said she wants to let the meetings involve other legislators and appoint several friends and family on washington state ' s board. [SEP] it leaves americans paul casey and mark allen on the same list. [SEP] now, he has learned what he is supposed to do : he really needs to be able to do things. [SEP] at that capacity, china produces a fifth of the world ' s agricultural food production. [SEP] " i think the snp has to do a good thing! " i asked. [SEP] now in france on a busy tour of asia, he will deal with [SEP]
+
+===== sample 045 =====
+[CLS] financial markets. [SEP] the task was soon completed and then got to the hands of the three remaining challengers. [SEP] but tom riley, the former senior team trainer at the high school, doesn ' t comment on whether there is a connection to the abuse. [SEP] the government report said a civil medical commission will ask council leader dr. kim sufel - - chairman of the country ' s chief medical council - - whether china is getting tougher than looking into its scientific work. [SEP] san francisco ( ap ) - pat zito went three scoreless innings, earning his second save of 2008 in the giants ' 2 - 0 win [SEP]
+
+===== sample 046 =====
+[CLS] in 2003 to be imposed on a group of older children - up from 19 % since 2004, according to the government. [SEP] the cause and ages of a 40 - year - old man to death and a 44 - year - old man has not been disclosed. [SEP] i must really ask if it would have to do it too long. [SEP] but when the mother of three says that marriage and death just can ' t do what you would like to do you see what she can do to do for her child - and your baby is not going out in front of her. [SEP] in january 2008, the lrb said it would investigate [SEP]
+
+===== sample 047 =====
+[CLS] that ' s when you get married, go on a family vacation and things get different. [SEP] the group ' s director of social services, mike and paula martin, the parents of education secretary james and father mark hayley,, arrived for the uk two years ago, and found it studying english, the internet, culture and dyshenia and most had just a few places to sleep. [SEP] " i do not want to go out with my child now and start a relationship with her son. [SEP] the former u. s. national security team moves into political austerity. [SEP] " family " ( channel 4 at 30 [SEP]
+
+===== sample 048 =====
+[CLS] to make it the kind of a great national sport.... if the vote...... go ahead.... " just to make a damn on it........ [SEP] but the president, vladimir putin ( fyb : pkn ), also said that he would ask the european union for a new ambassador to visit israel during his next few years as foreign minister, urging the country to improve ties with israel in its decades of self - rule. [SEP] he has also argued that government should concentrate the focus on reducing sector growth and boosting net public spending. [SEP] [SEP]
+
+===== sample 049 =====
+[CLS] market, with prices at about 3. 5 - 4 % of the market. [SEP] that ' s not true.... [SEP] i ' m sure you will do your best to avoid this, and why. [SEP] earlier this month, the scheme was opened up at the united nations conference near pittsburgh because french president nicolas sarkozy said he would save $ 17, 000 - worth of human waste each day. [SEP] supt kevin knonke, the council ' s executive director, said : " it is absolutely agreed that the scheme is an active part of the r4a and asked the council to understand the importance of [SEP]
+
+===== sample 050 =====
+[CLS] are much like my father and sisters. [SEP] the conservative leader has not officially been charged but has been under arrest and went on to become a minister of his country ' s ruling party. [SEP] debusch said monday that while congress has raised safety concerns, the official said it wants congress to do not take position on iran. [SEP] under the terms of the government ' s $ 250bn bailout programme, the bank has a capital deficit of $ 589bn this year, compared to a bailout of the $ 700bn by the us treasury department in september. [SEP] mr obama said on friday that the us was standing ready. [SEP]
+
+===== sample 051 =====
+[CLS] crisis. [SEP] a court spokesman said the boy was almost never heard of any abuse. [SEP] he went to kenya with the national trade agency, hoping to take it back to his native land. [SEP] they want this to reform education and health care. [SEP] i spent the night with the people from my very own england, including some french, and was always asking if i was going away. [SEP] it ' s the latest product of the credit crisis. [SEP] but england can ' t stop him. [SEP] 27 ( upi ) - - 41 - year - old professional golfer golfer seafon lesh was killed after his wife hit the [SEP]
+
+===== sample 052 =====
+[CLS], the highest since the survey began more than a half - century, was less than economists had been expected. [SEP] the bailout bill has met a barrage of objections from senate democrats and environmentalists. [SEP] " europe will have to take serious action on the largest issue in the world, and i can understand how difficult it will be, " said daniel englar, who is the eu ' s vice director of economy and economic policy. [SEP] but there is clearly a more real view of whether who does what should actually come from the business of politics. [SEP] here ' s what dan manley, obama ' s chief of staff, [SEP]
+
+===== sample 053 =====
+[CLS] done before, " he added. [SEP] ron george, a former u. n. official who led the u. s. program in 2005, declined to identify the group. [SEP] " i don ' t know what the whole goal is. [SEP] " i was a coach to londonderry and at the right time he has probably played, and i doubt that any part of this team would want to make this again. [SEP] dr. dae tsang, foreign ministry spokesman, also said : " china has strongly rejected the criticism of the u. n., saying it believed it was prepared to accept a supporting role in the [SEP]
+
+===== sample 054 =====
+[CLS]down on his country. [SEP] then everything happened. [SEP] the report was led by environment minister david boothroyd, chaired by mr howells and the culture minister ms jones. [SEP] some of the rules are written, consciously or superficially, to give us some context : we look at someone ' s nationality, instead of being a qualified person, so they can be easier to guess if they wish to buy. [SEP] he plays in the belief that the team represents every end of the league. [SEP] i want to find some truth about how the ecb had a long tradition of encouraging young people to vote for government debt securities. [SEP] [SEP]
+
+===== sample 055 =====
+[CLS] bush administration, clinton and others gave the white house a policy - making tour of capitol hill. [SEP] separately the korean news agency yonhap state news agency monday said the two ministers would leave china in beijing on trade, trade, jobs and education. [SEP] another ex - m. l. a. coach, john wyle, became president of the oklahoma department of health, education and human services to oversee player - control. [SEP] some home lenders want to scale down production. [SEP] mr kabila said : " the condition of the coalition negotiations is that we start our process at this time and need to be reached years ahead [SEP]
+
+===== sample 056 =====
+[CLS]...... he is going to take it..... look at the end..... and do it well, yes!!!!!! make sure they are... it is not.........................!!!!! the people said it was............................!........... what is that [SEP]
+
+===== sample 057 =====
+[CLS] of the process, saying it can ' t talk about its plans. [SEP] more than 1, 000 american soldiers have returned from iraq. [SEP] it is understood that the united states ' intelligence agency blames israel for the same goal, including east jerusalem, to create a free - for - all palestinian state. [SEP] thomas, who fired down in the first quarter wednesday and said that he would not be following a deal with the kings, was expected to be in the top half of the draft. [SEP] he urged the president on july 11 to set up checkpoints on beaches, airports, to deter foreign visitors to china, south korea, [SEP]
+
+===== sample 058 =====
+[CLS] council council, officials from the centre for the education of the sport and the council ' s sports authority, which will run the council ' s administration of the event. [SEP] cowboys coach alex mckeon will practice at the miami bowl next season and won ' t play in the redskins games because players have been playing with injuries while they play. [SEP] i don ' t think that favre will be in his team ' s shoes. [SEP] chinese officials have vowed to tone down china ' s statements on the u. s. future, saying they have both concerns of human rights and open government. [SEP] edgar gonzalez took a 3 - 2 [SEP]
+
+===== sample 059 =====
+[CLS] of manufacturing operations. [SEP] japan also plans to issue a package of economic measures tuesday to move attention to the world bank for the country ' s nuclear policy - a task force set up by the administration of former japanese president yasuo - kawakua, a conservative and the country ' s top foreign minister. [SEP] vick ' s father, john weatherley, pleaded guilty last week. [SEP] the researchers joined with david rohy, ms. verez, and david bye, director of public relations, human rights watch, and bill gulick, director of the national security institute at the university of chicago, in [SEP]
+
+===== sample 060 =====
+[CLS] to become one of those nations, " he says. [SEP] i simply don ' t know what she has to say with. [SEP] yes, you know, you didn ' t have the money opportunity to come here in 2003 and be head coach and golf coach no matter what the circumstances in the tour play, and it ' s the fact that he ' s watching the pros. [SEP] but the new zealand coach said : " i have said he didn ' t want to discuss any of the issues, and john was very worried. [SEP] he ' s not taking a final position on the climate change from president barack obama, saying he [SEP]
+
+===== sample 061 =====
+[CLS] to ucla medical center in los angeles city. [SEP] between 2007 and 2008, 6. 5m people of over 30 years in the premier league will spend an extra £3m to attract private league players, according to the report. [SEP] the u. s. supreme court ' s decision upheld same - sex marriage in a 2005 case that challenged the government ' s power to close illegal immigrant cases and said at least 12 residents could face up to five years in prison. [SEP] that would create a much smaller policy coalition, with a short range of solutions and with no plans to make a tax. [SEP] the us central bank said 78, 000 [SEP]
+
+===== sample 062 =====
+[CLS] industry and its retail industry. [SEP] los angeles, july 16 ( upi ) - - a woman was charged thursday with killing three men and two women in a las vegas bar accused the couple of assaulting a police suspect, law enforcement sources said. [SEP] john lynch was appointed head of bank of america ' s global banking and credit operations in october 2007. [SEP] andy streacha, head of the adb, said the force would continue to investigate the cases, including its deputy chief executive david fillon. [SEP] after the tournament around town in salt lake city from 6 am to 4 p. m., mcfee said [SEP]
+
+===== sample 063 =====
+[CLS] the company is likely to remain in debt if it is successful. [SEP] the assembly side includes representatives of senior political figures, including the indian prime minister and former us secretary of state clinton. [SEP] mr. dales and the national national park authority will hold a public meeting on the project, with a full public and private meeting to be held within the next few weeks. [SEP] ap writer kelly kim contributed to this report. [SEP] for her, i think that : there is an idea that demands the media toughness ; this is very fun to describe. [SEP] in the affected area of the zarin district in the sharab river, [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_diffusion_noise_steps_128steps_n64/tpow2p0_const1p45_c256_scored.jsonl

@@ -0,0 +1,65 @@
+{"type": "summary", "name": "tpow2p0_const1p45_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 187000, "decode": {"kind": "categorical_fullvocab_diffusion_state_noise", "config": "tpow2p0_const1p45_c256", "steps": 128, "temp_start": 1.45, "temp_end": 1.45, "temp_schedule": "const", "t_power": 2.0, "eta0": 0.0, "eta_schedule": "none", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 50.51946723435765, "nll_per_token": 3.922358751788475, "tokens": 9217}, "diversity": {"sample_entropy": 4.078867688498713, "unique_tokens": 1928, "token_count": 8192, "distinct_1": 0.2353515625, "distinct_2": 0.7000492125984252, "top_token_mass": 0.0865478515625}}
+{"type": "sample", "index": 0, "raw_text": "[CLS]8, 000 to £15 per year, would cost £40 per cent of the average nhs budget. [SEP] there was no word woods was on a strong par 72 in the third round, but the british pga leader was two shots off the lead after eight holes in front of him. [SEP] they seem like a long story line for an array of extraordinary jobs every year. [SEP] net debt stands at around $ 60. 5bn - nearly $ 100bn according to dp capital markets reported last month. [SEP] oil fell $ 2. 15 to $ 89. 09 a barrel while the euro rose to $. 542 [SEP]", "detok_text": "[CLS]8, 000 to £15 per year, would cost £40 per cent of the average nhs budget. [SEP] there was no word woods was on a strong par 72 in the third round, but the british pga leader was two shots off the lead after eight holes in front of him. [SEP] they seem like a long story line for an array of extraordinary jobs every year. [SEP] net debt stands at around $60. 5bn - nearly $100bn according to dp capital markets reported last month. [SEP] oil fell $2. 15 to $89. 09 a barrel while the euro rose to $. 542 [SEP]"}
+{"type": "sample", "index": 1, "raw_text": "[CLS] ' s acknowledged that he is just as an obstacle to change, but he ' s like it ' s up to figure out what he ' s doing. [SEP] and if the speech seems to lack a popular vote, how would you cope with mr. mccain? [SEP] \" he wants to find out the details of america... and the obama administration wants to show that, \" he said. [SEP] theodore alcora, mr. pickton ' s lawyer, could not provide much comment on mr. housberg. [SEP] they said none of mr. callier ' s accounts or contacts and contacts had gone to the company [SEP]", "detok_text": "[CLS]'s acknowledged that he is just as an obstacle to change, but he's like it's up to figure out what he's doing. [SEP] and if the speech seems to lack a popular vote, how would you cope with mr. mccain? [SEP] \"he wants to find out the details of america... and the obama administration wants to show that,\" he said. [SEP] theodore alcora, mr. pickton's lawyer, could not provide much comment on mr. housberg. [SEP] they said none of mr. callier's accounts or contacts and contacts had gone to the company [SEP]"}
+{"type": "sample", "index": 2, "raw_text": "[CLS] two points. [SEP] pyongyang said tuesday that the envoy would not meet north korean officials this month with south korean unification minister kim sung - bak, a former leader in north korea ' s april 25 - 25 war and with ties to the united states. [SEP] foreign minister sun roh mok hyun defended the comments, saying the president refused to be contacted by senior officials. [SEP] she stood outside, the day off with her family. [SEP] \" there is someone who needs to see through music, a person who wants something of the same it seems, and i ' m happy about it. [SEP] to that end, china [SEP]", "detok_text": "[CLS] two points. [SEP] pyongyang said tuesday that the envoy would not meet north korean officials this month with south korean unification minister kim sung - bak, a former leader in north korea's april 25 - 25 war and with ties to the united states. [SEP] foreign minister sun roh mok hyun defended the comments, saying the president refused to be contacted by senior officials. [SEP] she stood outside, the day off with her family. [SEP] \" there is someone who needs to see through music, a person who wants something of the same it seems, and i'm happy about it. [SEP] to that end, china [SEP]"}
+{"type": "sample", "index": 3, "raw_text": "[CLS] in the early morning, officials say it lights up on 8 to 10 hours per night, much longer than usual. [SEP] the drawback is simple : no one else has reached the summit. [SEP] iran is trying to team up with the united states to shore up its relations with \" non - core countries. \" [SEP] it was last updated at 14. 11 bst on monday 4 april 2009. cityjob. account manager is required to fur.... to £20k. london borough of eaf.... £26, 766 rising - £26, 038 pa.. bristol city council. [SEP]", "detok_text": "[CLS] in the early morning, officials say it lights up on 8 to 10 hours per night, much longer than usual. [SEP] the drawback is simple: no one else has reached the summit. [SEP] iran is trying to team up with the united states to shore up its relations with \"non - core countries.\" [SEP] it was last updated at 14. 11 bst on monday 4 april 2009. cityjob. account manager is required to fur.... to £20k. london borough of eaf.... £26, 766 rising - £26, 038 pa.. bristol city council. [SEP]"}
+{"type": "sample", "index": 4, "raw_text": "[CLS] this past 2010 and will not require much springboard time. [SEP] the israeli party leader, avidar abbas, said the rebels would not come forward during the israeli - fire cease - fire. [SEP] if they are the same people, what are they saying when they ask??? how do ya use the word?????....... the same television news microphones don ' t.......................................... [SEP]", "detok_text": "[CLS] this past 2010 and will not require much springboard time. [SEP] the israeli party leader, avidar abbas, said the rebels would not come forward during the israeli - fire cease - fire. [SEP] if they are the same people, what are they saying when they ask??? how do ya use the word?????....... the same television news microphones don't.......................................... [SEP]"}
+{"type": "sample", "index": 5, "raw_text": "[CLS].............................................................................................................................. [SEP]", "detok_text": "[CLS].............................................................................................................................. [SEP]"}
+{"type": "sample", "index": 6, "raw_text": "[CLS] megawatt called the u. s. department of water and interior to stay on the agency ' s decision after a federal commission had urged congress to approve the extension. [SEP] but if that happens in the course of season, they have no doubts about the team that ' s now playing. [SEP] \" that ' s why i don ' t think the storm is coming out, \" said bill sene. [SEP] 18 ( upi ) - - the cost of health care for american soldiers and families was asked whether washington would share more than 5 percent of nearly $ 3 billion under barack obama ' s war in iraq. [SEP] a japanese [SEP]", "detok_text": "[CLS] megawatt called the u. s. department of water and interior to stay on the agency's decision after a federal commission had urged congress to approve the extension. [SEP] but if that happens in the course of season, they have no doubts about the team that's now playing. [SEP] \"that's why i don't think the storm is coming out,\" said bill sene. [SEP] 18 (upi) - - the cost of health care for american soldiers and families was asked whether washington would share more than 5 percent of nearly $3 billion under barack obama's war in iraq. [SEP] a japanese [SEP]"}
+{"type": "sample", "index": 7, "raw_text": "[CLS] supplier revised down estimates of just over $ 500m in the three months to 2008 and has forecast that its annual cost savings will fall from $ 1m ( £73m ) to $ 2. 8bn ( £30m ). [SEP] in beijing, high - level officials, official lawyers and chinese journalists have a near - universal concern of how difficult the situation is for now. [SEP] mj : \" yeah... i can ' t remember anything from when i was watching this young man, i thought about the way, \" koreu said of his daughter. [SEP] but p. t. c., \" [SEP]", "detok_text": "[CLS] supplier revised down estimates of just over $500m in the three months to 2008 and has forecast that its annual cost savings will fall from $1m (£73m) to $2. 8bn (£30m). [SEP] in beijing, high - level officials, official lawyers and chinese journalists have a near - universal concern of how difficult the situation is for now. [SEP] mj: \"yeah... i can't remember anything from when i was watching this young man, i thought about the way,\" koreu said of his daughter. [SEP] but p. t. c., \" [SEP]"}
+{"type": "sample", "index": 8, "raw_text": "[CLS] and recognition of israel ' s human rights record. \" [SEP] many of the companies, however, were directly frustrated with the market ' s largesse. [SEP] no central government is able to keep american foreign investment because there is not enough money. [SEP] he added that he and the family had wanted to remain as a part of the church ' s life. [SEP] obama has little else to offer in these disparate societies. [SEP] \" that means the more young members know the tune to everyone ' s money, the better to pay them it, \" said mr. carombe. [SEP] when she was just 15 years old, american [SEP]", "detok_text": "[CLS] and recognition of israel's human rights record. \"[SEP] many of the companies, however, were directly frustrated with the market's largesse. [SEP] no central government is able to keep american foreign investment because there is not enough money. [SEP] he added that he and the family had wanted to remain as a part of the church's life. [SEP] obama has little else to offer in these disparate societies. [SEP]\" that means the more young members know the tune to everyone's money, the better to pay them it, \" said mr. carombe. [SEP] when she was just 15 years old, american [SEP]"}
+{"type": "sample", "index": 9, "raw_text": "[CLS] not aware of the commission, and he is not involved in the project and wants to find a list of the way to pay the costs, said dan todd, a spokesman for baltimore ' s finance agency. [SEP] he is to meet opposition party leaders who vote after a general election on tax rises and shadow education minister michael gov. [SEP] but you can ' t deal with it. [SEP] fox news. com knows the wisdom of the commenters at fox news - - tom coo, award - winning mike bierstein, bill jones. [SEP] what is called human behaviour? [SEP] paul mcfarland said last week ' s attempt at [SEP]", "detok_text": "[CLS] not aware of the commission, and he is not involved in the project and wants to find a list of the way to pay the costs, said dan todd, a spokesman for baltimore's finance agency. [SEP] he is to meet opposition party leaders who vote after a general election on tax rises and shadow education minister michael gov. [SEP] but you can't deal with it. [SEP] fox news. com knows the wisdom of the commenters at fox news - - tom coo, award - winning mike bierstein, bill jones. [SEP] what is called human behaviour? [SEP] paul mcfarland said last week's attempt at [SEP]"}
+{"type": "sample", "index": 10, "raw_text": "[CLS] obama, the rival mr. mccain, defended his new york words. [SEP] \" if we could talk about what happened, we ' d be talking talking about the situation and just wondering if there was someone who ' s talking about football or going back into the country. [SEP] indeed, mccain is more honest than his super - licensors ' negotor... but it ' s just not up to a democratic politician ' s standard. [SEP] \" we ' re having a lot of discussions... this morning, \" palin said. [SEP] washington ( ap ) - nancy biden ' s husband, friend, brother [SEP]", "detok_text": "[CLS] obama, the rival mr. mccain, defended his new york words. [SEP] \"if we could talk about what happened, we'd be talking talking about the situation and just wondering if there was someone who's talking about football or going back into the country. [SEP] indeed, mccain is more honest than his super - licensors' negotor... but it's just not up to a democratic politician's standard. [SEP]\" we're having a lot of discussions... this morning, \" palin said. [SEP] washington (ap) - nancy biden's husband, friend, brother [SEP]"}
+{"type": "sample", "index": 11, "raw_text": "[CLS] shot from the sky. [SEP] the court heard that the pair and the bbc ' s director sir richard walker, who had evidence of their families, called the head of the gmc to obtain calls for mi5 to conduct an information seeking investigation. [SEP] varitek is upset and excited about losing damon, but no one wants him to take him past his stall. [SEP] emmaus, a scottish, u. k. travel destination with its skiing services, attractions and private services, may have much more of a world - class character and tradition, but to the world of the very wealthy and far from famous. [SEP] \" we have [SEP]", "detok_text": "[CLS] shot from the sky. [SEP] the court heard that the pair and the bbc's director sir richard walker, who had evidence of their families, called the head of the gmc to obtain calls for mi5 to conduct an information seeking investigation. [SEP] varitek is upset and excited about losing damon, but no one wants him to take him past his stall. [SEP] emmaus, a scottish, u. k. travel destination with its skiing services, attractions and private services, may have much more of a world - class character and tradition, but to the world of the very wealthy and far from famous. [SEP] \" we have [SEP]"}
+{"type": "sample", "index": 12, "raw_text": "[CLS] to contact with iran in july 30, 2009, just 10 days after the missile landed in northeast qom, \" the statement said. [SEP] teachers, you know, are not just the bush administration ' s policy advisers. [SEP] for a majority of americans..... do not.............. well, by the constitution ' s logic...................... [SEP] it ' s just look like he was getting on with it, and now......... [SEP]", "detok_text": "[CLS] to contact with iran in july 30, 2009, just 10 days after the missile landed in northeast qom, \" the statement said. [SEP] teachers, you know, are not just the bush administration's policy advisers. [SEP] for a majority of americans..... do not.............. well, by the constitution's logic...................... [SEP] it's just look like he was getting on with it, and now......... [SEP]"}
+{"type": "sample", "index": 13, "raw_text": "[CLS] became clear that the prime minister was prepared to tell the truth on behalf of him, along with the newspaper ' s political editor, the parliamentary standards minister. [SEP] in the first place, however, people wanted to know certain things that would come across. [SEP] activity in the middle east is expected to slow down. [SEP] the governments of china and north korea defended the rights of the united states and russia, the paper said. [SEP] earlier this week david petraeus, the new u. s. general for afghanistan and pakistan, also said he was prepared to deal with the situation. [SEP] capello added : \" the players are facing questions [SEP]", "detok_text": "[CLS] became clear that the prime minister was prepared to tell the truth on behalf of him, along with the newspaper's political editor, the parliamentary standards minister. [SEP] in the first place, however, people wanted to know certain things that would come across. [SEP] activity in the middle east is expected to slow down. [SEP] the governments of china and north korea defended the rights of the united states and russia, the paper said. [SEP] earlier this week david petraeus, the new u. s. general for afghanistan and pakistan, also said he was prepared to deal with the situation. [SEP] capello added: \" the players are facing questions [SEP]"}
+{"type": "sample", "index": 14, "raw_text": "[CLS] the american economic finance committee will give the chinese government the united states as well as well as the resources for china and the united states, \" sengg lee said last wednesday, after meeting with beijing communist committee president yu of a group of six leading countries. [SEP] it was the coldest reported death made by the junta since taking office in february - march. [SEP] she said she was abducted, but she was freed after her local police had arrived. [SEP] i had to do that, \" he said. [SEP] i don ' t know if we just want obama to go this way, she is going to take the reins alone. [SEP]", "detok_text": "[CLS] the american economic finance committee will give the chinese government the united states as well as well as the resources for china and the united states, \"sengg lee said last wednesday, after meeting with beijing communist committee president yu of a group of six leading countries. [SEP] it was the coldest reported death made by the junta since taking office in february - march. [SEP] she said she was abducted, but she was freed after her local police had arrived. [SEP] i had to do that,\" he said. [SEP] i don't know if we just want obama to go this way, she is going to take the reins alone. [SEP]"}
+{"type": "sample", "index": 15, "raw_text": "[CLS] and f. d. i. rules. [SEP] but without the mention of israeli law, palestinian military outposts and arab foreign policy, bush described the israeli - palestinian peace process as one of the most contentious issues. [SEP] miami ( ap ) - two cubans charged with a massive plan to return to u. s. soil in cuba arrived friday at the airport. [SEP] but, they ' re doing that. [SEP] he ' s a good coach at the way this comes out, \" wells said. [SEP] about 90 people have been released from iraq, rwanda, congo, ethiopia, burundi, kenya, north korea, ireland and egypt [SEP]", "detok_text": "[CLS] and f. d. i. rules. [SEP] but without the mention of israeli law, palestinian military outposts and arab foreign policy, bush described the israeli - palestinian peace process as one of the most contentious issues. [SEP] miami (ap) - two cubans charged with a massive plan to return to u. s. soil in cuba arrived friday at the airport. [SEP] but, they're doing that. [SEP] he's a good coach at the way this comes out, \" wells said. [SEP] about 90 people have been released from iraq, rwanda, congo, ethiopia, burundi, kenya, north korea, ireland and egypt [SEP]"}
+{"type": "sample", "index": 16, "raw_text": "[CLS] talks. [SEP] north korea has taken a position to end all areas of friction with north korea on human rights, security and aid to achieve nuclear disarmament, gates said on tuesday in a rare statement on its nuclear policy. [SEP] huckabee ' s proposal at a meeting with fellow members of the republican and white houses of the senate. [SEP] the church - ulsteront committee to be unveiled on wednesday details of its main plan : drawing up a strategic plan to link the growth of the north of the irish peninsula and the use of public transport. [SEP] mr mcshane ' s claims that despite the circumstances around him, the [SEP]", "detok_text": "[CLS] talks. [SEP] north korea has taken a position to end all areas of friction with north korea on human rights, security and aid to achieve nuclear disarmament, gates said on tuesday in a rare statement on its nuclear policy. [SEP] huckabee's proposal at a meeting with fellow members of the republican and white houses of the senate. [SEP] the church - ulsteront committee to be unveiled on wednesday details of its main plan: drawing up a strategic plan to link the growth of the north of the irish peninsula and the use of public transport. [SEP] mr mcshane's claims that despite the circumstances around him, the [SEP]"}
+{"type": "sample", "index": 17, "raw_text": "[CLS] stop at this \" nonsense \" and create a new government. [SEP] he has decided on whether to give his speech to obama. [SEP] \" the joint build - up is a significant part of the ongoing review of the defense system in europe aimed at preserving the shield under the security treaty, \" the president ' s office said in a statement. [SEP] this isn ' t all about money and quality. [SEP] the spanish queen ' s birthday party was scheduled to be held in liverpool royal bank this morning. [SEP] mr obama ' s spokesman insisted that india had not been granted direct links to the united states and britain, and said he would ask the [SEP]", "detok_text": "[CLS] stop at this \"nonsense\" and create a new government. [SEP] he has decided on whether to give his speech to obama. [SEP] \"the joint build - up is a significant part of the ongoing review of the defense system in europe aimed at preserving the shield under the security treaty,\" the president's office said in a statement. [SEP] this isn't all about money and quality. [SEP] the spanish queen's birthday party was scheduled to be held in liverpool royal bank this morning. [SEP] mr obama's spokesman insisted that india had not been granted direct links to the united states and britain, and said he would ask the [SEP]"}
+{"type": "sample", "index": 18, "raw_text": "[CLS] would not want to live with him, but still would likely want to stay free for five years. [SEP] \" if you say what you say it ' s harder, \" he said. [SEP] farahi asked the group of islamic states saturday to begin the withdrawal of force troops from the south african states, a group that has about 40 taliban and al - qaeda leaders and members from central and west africa. [SEP] the newspaper said the prosecution lawyer said kercher kercher ' s wife and her boyfriend ' s wife, rudye guccio, and told her husband that contact between her and police was investigating, too. [SEP]", "detok_text": "[CLS] would not want to live with him, but still would likely want to stay free for five years. [SEP] \"if you say what you say it's harder,\" he said. [SEP] farahi asked the group of islamic states saturday to begin the withdrawal of force troops from the south african states, a group that has about 40 taliban and al - qaeda leaders and members from central and west africa. [SEP] the newspaper said the prosecution lawyer said kercher kercher's wife and her boyfriend's wife, rudye guccio, and told her husband that contact between her and police was investigating, too. [SEP]"}
+{"type": "sample", "index": 19, "raw_text": "[CLS] points, and atlanta ' s carlos villanueva also also scored. [SEP] richard bonse, an international airport officer with the department of space travel, said there were 4, 500 people, with an average of 24 hours of 20 minutes, to put up a demonstration of the palm beach savoy lighthouse and florida ' s 12 - foot monster. [SEP] el - muallem rejected the un general ' s proposal to allow iraqi participation in a joint road into talks. [SEP] the experience of the former us secretary of civil service and resources will not be discussed in the g - nations meeting, said john edwards, former us secretary general [SEP]", "detok_text": "[CLS] points, and atlanta's carlos villanueva also also scored. [SEP] richard bonse, an international airport officer with the department of space travel, said there were 4, 500 people, with an average of 24 hours of 20 minutes, to put up a demonstration of the palm beach savoy lighthouse and florida's 12 - foot monster. [SEP] el - muallem rejected the un general's proposal to allow iraqi participation in a joint road into talks. [SEP] the experience of the former us secretary of civil service and resources will not be discussed in the g - nations meeting, said john edwards, former us secretary general [SEP]"}
+{"type": "sample", "index": 20, "raw_text": "[CLS] said the move was an important dramatic change to the nature of post - cold war era ties and exchanges between russia and japan after world war i with china and russia. [SEP] one would like to see what he finds in the line, then you stay with the team he owns in order to look after the bad side. [SEP] british prime minister gordon brown has gone ahead with his call for a new common currency of the euro. [SEP] meanwhile the number of men ' s homicides in britain and wales has fallen more than 20 percent since the start in 2003. [SEP] israel must be united in its efforts to tackle the price of electricity and energy [SEP]", "detok_text": "[CLS] said the move was an important dramatic change to the nature of post - cold war era ties and exchanges between russia and japan after world war i with china and russia. [SEP] one would like to see what he finds in the line, then you stay with the team he owns in order to look after the bad side. [SEP] british prime minister gordon brown has gone ahead with his call for a new common currency of the euro. [SEP] meanwhile the number of men's homicides in britain and wales has fallen more than 20 percent since the start in 2003. [SEP] israel must be united in its efforts to tackle the price of electricity and energy [SEP]"}
+{"type": "sample", "index": 21, "raw_text": "[CLS] deal five years ago. [SEP] just the one thing to know : validation of our own policies. [SEP] they are aged over 10 years, with an average time of 19. 5 hours. central london. greater london. london city council. london, west midlands. c £28. 25 per hour. london metropolitan university. north london, birmingham, nottingham, london, leeds, leeds, north - west, newcastle, wokingham, east midlands, nottingham, north tees, nottingham, orpingtonshire, glasgow. [SEP] the result was a complete attack on george w annan ' s authority. [SEP] although the action includes [SEP]", "detok_text": "[CLS] deal five years ago. [SEP] just the one thing to know: validation of our own policies. [SEP] they are aged over 10 years, with an average time of 19. 5 hours. central london. greater london. london city council. london, west midlands. c £28. 25 per hour. london metropolitan university. north london, birmingham, nottingham, london, leeds, leeds, north - west, newcastle, wokingham, east midlands, nottingham, north tees, nottingham, orpingtonshire, glasgow. [SEP] the result was a complete attack on george w annan's authority. [SEP] although the action includes [SEP]"}
+{"type": "sample", "index": 22, "raw_text": "[CLS] the first bank holding company of the federal deposit and insurance corporation - - the nation ' s largest bank - - and national bank of scotland. [SEP] after his death in 2008, mr obama had spent his time promoting public policy but abandoned his presidency in the 1990s, bankrolling his trip to afghanistan. [SEP] the leader of britain ' s tennis team discusses the key subjects in higher education, sex and sport. [SEP] one of the women was rescued by rescuers after it fell in the village of kotria qur on friday. [SEP] a spokesman for the scc said : \" now it ' s time to stop, andy, [SEP]", "detok_text": "[CLS] the first bank holding company of the federal deposit and insurance corporation - - the nation's largest bank - - and national bank of scotland. [SEP] after his death in 2008, mr obama had spent his time promoting public policy but abandoned his presidency in the 1990s, bankrolling his trip to afghanistan. [SEP] the leader of britain's tennis team discusses the key subjects in higher education, sex and sport. [SEP] one of the women was rescued by rescuers after it fell in the village of kotria qur on friday. [SEP] a spokesman for the scc said: \" now it's time to stop, andy, [SEP]"}
+{"type": "sample", "index": 23, "raw_text": "[CLS] health insurance coverage will make a lot more than $ 300, people who will make more than $ 100, 000, those making an income of $ 35, 000. [SEP] on 16 december, paul kan, japan ' s foreign minister, visited hong kong after meeting with french opposition president jean president nicolas sarkozy, called on his foreign minister and government to intervene. [SEP] i think obama needs more. [SEP] the i. m. f. described the talks as \" co - operation \" and asked how much effort must be done to stabilise the market. [SEP] the department of health, clwyc and the duma government [SEP]", "detok_text": "[CLS] health insurance coverage will make a lot more than $300, people who will make more than $100, 000, those making an income of $35, 000. [SEP] on 16 december, paul kan, japan's foreign minister, visited hong kong after meeting with french opposition president jean president nicolas sarkozy, called on his foreign minister and government to intervene. [SEP] i think obama needs more. [SEP] the i. m. f. described the talks as \"co - operation\" and asked how much effort must be done to stabilise the market. [SEP] the department of health, clwyc and the duma government [SEP]"}
+{"type": "sample", "index": 24, "raw_text": "[CLS] 2008 general election campaign. [SEP] bob watson is a physician at the kennedy center. [SEP] rescue workers in the central region have found more than 50 people dead who were missing because of drug trafficking. [SEP] but with the votes to put up a bill in the new congress in the next week, president bush says they will be willing to remain on the agenda. [SEP] mr tobin was not involved with the sport until that time, in february 2003, when mr gardner had got into a period of violence and pregnancies with mr doran and ms hingdon. [SEP] firefighters have been at a house in shropshire to stop a series of wild [SEP]", "detok_text": "[CLS] 2008 general election campaign. [SEP] bob watson is a physician at the kennedy center. [SEP] rescue workers in the central region have found more than 50 people dead who were missing because of drug trafficking. [SEP] but with the votes to put up a bill in the new congress in the next week, president bush says they will be willing to remain on the agenda. [SEP] mr tobin was not involved with the sport until that time, in february 2003, when mr gardner had got into a period of violence and pregnancies with mr doran and ms hingdon. [SEP] firefighters have been at a house in shropshire to stop a series of wild [SEP]"}
+{"type": "sample", "index": 25, "raw_text": "[CLS] reserve and european fiscal policy and pledged to take \" seriously additional \" measures to help the economy. [SEP] as for doctors who report out a review of what ' s happening around abortion. [SEP] one needs to get that right. [SEP] \" what green are you? \" a friend asks impatiently. [SEP] the company is led by xue liqial, chief executive of the huazhou economic development co. [SEP] the franc ' s value rose faster against chinese currencies per month against other major currencies and has climbed 30pc to a record high. [SEP] in sydney, australia, while playing football at university. [SEP] tnk [SEP]", "detok_text": "[CLS] reserve and european fiscal policy and pledged to take \"seriously additional\" measures to help the economy. [SEP] as for doctors who report out a review of what's happening around abortion. [SEP] one needs to get that right. [SEP] \"what green are you?\" a friend asks impatiently. [SEP] the company is led by xue liqial, chief executive of the huazhou economic development co. [SEP] the franc's value rose faster against chinese currencies per month against other major currencies and has climbed 30pc to a record high. [SEP] in sydney, australia, while playing football at university. [SEP] tnk [SEP]"}
+{"type": "sample", "index": 26, "raw_text": "[CLS] would put an agreement on the gaza border and an israeli - palestinian peace treaty based on negotiations. [SEP] the obama white house and the senate have agreed agreement on states to hold its own early - voting polls at the weekend. [SEP] she is expected to get as much as 15 million of dollars. [SEP] it comes a month after she was confirmed as mayor of london and prime minister nick clegg to leave her post. [SEP] but this summer, he ' s facing a tough fight with chris boland, itv ' s chief executive, who believes brand should be strong in the run to european elections in 2008. [SEP] and since it has [SEP]", "detok_text": "[CLS] would put an agreement on the gaza border and an israeli - palestinian peace treaty based on negotiations. [SEP] the obama white house and the senate have agreed agreement on states to hold its own early - voting polls at the weekend. [SEP] she is expected to get as much as 15 million of dollars. [SEP] it comes a month after she was confirmed as mayor of london and prime minister nick clegg to leave her post. [SEP] but this summer, he's facing a tough fight with chris boland, itv's chief executive, who believes brand should be strong in the run to european elections in 2008. [SEP] and since it has [SEP]"}
+{"type": "sample", "index": 27, "raw_text": "[CLS] support in some states and could trigger a difficult campaign for mccain. [SEP] police launched the investigation after concerns over allegations of sexual behaviour. [SEP] but he is not a big dropper for a team that was interested in playing the game, but he has the experience to be successful with the team ' s offense. [SEP] since the report, mr johnson ' s deputy peter msp has made a personal pledge to the council ' s chairman david johnson to be confident the council will investigate the matter. [SEP] \" he was home at the same time - - i couldn ' t do it, \" he said. [SEP] \" some of these criteria are [SEP]", "detok_text": "[CLS] support in some states and could trigger a difficult campaign for mccain. [SEP] police launched the investigation after concerns over allegations of sexual behaviour. [SEP] but he is not a big dropper for a team that was interested in playing the game, but he has the experience to be successful with the team's offense. [SEP] since the report, mr johnson's deputy peter msp has made a personal pledge to the council's chairman david johnson to be confident the council will investigate the matter. [SEP] \"he was home at the same time - - i couldn't do it,\" he said. [SEP] \" some of these criteria are [SEP]"}
+{"type": "sample", "index": 28, "raw_text": "[CLS] while mr. obama ' s proposal included a $ 25 million end - of - the - year cost, the senate and democrats say that they ' re proposing a $ 5 - billion budget shortfall. [SEP] the commission was formed as part of a deal intended to replace the west bank - led regime, however, which has major traction with anti - western groups, further furtherraging russia ' s past demarning with the western osset region. [SEP] but he has the bulk of character, experience, a good attitude, with lots of money and a pair of handouts. [SEP] \" i have been in the hospital for some [SEP]", "detok_text": "[CLS] while mr. obama's proposal included a $25 million end - of - the - year cost, the senate and democrats say that they're proposing a $5 - billion budget shortfall. [SEP] the commission was formed as part of a deal intended to replace the west bank - led regime, however, which has major traction with anti - western groups, further furtherraging russia's past demarning with the western osset region. [SEP] but he has the bulk of character, experience, a good attitude, with lots of money and a pair of handouts. [SEP] \" i have been in the hospital for some [SEP]"}
+{"type": "sample", "index": 29, "raw_text": "[CLS] of the law should be protected by the law. [SEP] \" and if no case has been made \", it will be a tough decision, said david hogg, a labour spokesman. [SEP] the next 20 years, anthony smith, mr williams ' s father, saved the lives of his three grandchildren, living a little more than living back from their loved parents. [SEP] not just like expensive tvs, old - world watches and expensive dsl cables. [SEP] during a nba coaching career, donaghy has gone ahead. [SEP] the person in the hospital staff was patricia martin, director of medical services at the department of veterans ' affairs [SEP]", "detok_text": "[CLS] of the law should be protected by the law. [SEP] \"and if no case has been made\", it will be a tough decision, said david hogg, a labour spokesman. [SEP] the next 20 years, anthony smith, mr williams's father, saved the lives of his three grandchildren, living a little more than living back from their loved parents. [SEP] not just like expensive tvs, old - world watches and expensive dsl cables. [SEP] during a nba coaching career, donaghy has gone ahead. [SEP] the person in the hospital staff was patricia martin, director of medical services at the department of veterans' affairs [SEP]"}
+{"type": "sample", "index": 30, "raw_text": "[CLS] ' s painful management of the open. [SEP] but, this is something that gives the sense that the england team will live with it. [SEP] and even the african union has been described by many as the most corrupt countries in the world. [SEP] but he ' s popular with the program, which hasn ' t helped his football team. [SEP] \" it was pretty rough - - we ' re in the middle of the park, \" she said. [SEP] israel appears determined to put end to the violence. [SEP] and it has nothing to offer. [SEP] participants can call 301 - 630 - 3730 or toll - free code 8794 [SEP]", "detok_text": "[CLS]'s painful management of the open. [SEP] but, this is something that gives the sense that the england team will live with it. [SEP] and even the african union has been described by many as the most corrupt countries in the world. [SEP] but he's popular with the program, which hasn't helped his football team. [SEP] \"it was pretty rough - - we're in the middle of the park,\" she said. [SEP] israel appears determined to put end to the violence. [SEP] and it has nothing to offer. [SEP] participants can call 301 - 630 - 3730 or toll - free code 8794 [SEP]"}
+{"type": "sample", "index": 31, "raw_text": "[CLS] customers. [SEP] the public service service also provides a perspective on entrepreneurship. [SEP] he threw the first touchdown of his own cowboys defense, 34 yards to justin garolo, the second in a 35 - yard drive. [SEP] the latest research also shows a fertility rate at nearly three per cent, and it is rising rapidly. [SEP] \" you don ' t know what your body means, but now, everything is here, everything is normal, \" he said. [SEP] he said he believed india could surpass the growth and growth rates year - to - end under the weight of the current global economic crisis. [SEP] \" we are delighted that [SEP]", "detok_text": "[CLS] customers. [SEP] the public service service also provides a perspective on entrepreneurship. [SEP] he threw the first touchdown of his own cowboys defense, 34 yards to justin garolo, the second in a 35 - yard drive. [SEP] the latest research also shows a fertility rate at nearly three per cent, and it is rising rapidly. [SEP] \"you don't know what your body means, but now, everything is here, everything is normal,\" he said. [SEP] he said he believed india could surpass the growth and growth rates year - to - end under the weight of the current global economic crisis. [SEP] \" we are delighted that [SEP]"}
+{"type": "sample", "index": 32, "raw_text": "[CLS] director of the national football coaches association, said some players have been concerned about this practice because it ' s known to help minority players coach a football team, said nick smith, senior assistant to the college ' s vice director of policy and policy, and garrett, senior senior assistant vice president and dean to the president ' s school of sports. [SEP] clinton went to north korea, japan, south korea and the us secretaries of defense, pran and shin, and chinese foreign minister kye - sesong, north korean foreign ministry minister li yongyong and the washington post. [SEP] its u. s. at $ 10. [SEP]", "detok_text": "[CLS] director of the national football coaches association, said some players have been concerned about this practice because it's known to help minority players coach a football team, said nick smith, senior assistant to the college's vice director of policy and policy, and garrett, senior senior assistant vice president and dean to the president's school of sports. [SEP] clinton went to north korea, japan, south korea and the us secretaries of defense, pran and shin, and chinese foreign minister kye - sesong, north korean foreign ministry minister li yongyong and the washington post. [SEP] its u. s. at $10. [SEP]"}
+{"type": "sample", "index": 33, "raw_text": "[CLS] early years of celebrity golf legend bretton woods, his policy now is to spread the pressure to golf icon tiger woods through the sports arena, including his recent face - to - face tirade with tiger woods and espn ' s ged thomas on a sports web page. [SEP] but tehran has used the report as its strongest position on the issue after the 2001 nuclear shuttle agreement with washington. [SEP] western officials have dismissed growing demand that israel would have urged the security council not to freeze the country ' s nuclear - related arsenal over the next two years. [SEP] he has repeatedly used his successor to be a prime minister. [SEP] the agency has [SEP]", "detok_text": "[CLS] early years of celebrity golf legend bretton woods, his policy now is to spread the pressure to golf icon tiger woods through the sports arena, including his recent face - to - face tirade with tiger woods and espn's ged thomas on a sports web page. [SEP] but tehran has used the report as its strongest position on the issue after the 2001 nuclear shuttle agreement with washington. [SEP] western officials have dismissed growing demand that israel would have urged the security council not to freeze the country's nuclear - related arsenal over the next two years. [SEP] he has repeatedly used his successor to be a prime minister. [SEP] the agency has [SEP]"}
+{"type": "sample", "index": 34, "raw_text": "[CLS]yaan satellite station in russia. [SEP] thursday - - 5 : 30 p. a. m. 9 : 30 p. m. 7 : 30 p. m. ( gmt ). [SEP] police said it happened at crydon woods in pugden, on march 24. [SEP] the dow closed down 1. 2 points, the ftse - 50, 000 shares fell and the global 500 fell 0. 3 per cent, a decline of more than 10 per cent. [SEP] willis mcgahee was 7 - of - 17 for 278 yards and two interceptions, while fal was 4 - of - 6 passing for [SEP]", "detok_text": "[CLS]yaan satellite station in russia. [SEP] thursday - - 5: 30 p. a. m. 9: 30 p. m. 7: 30 p. m. (gmt). [SEP] police said it happened at crydon woods in pugden, on march 24. [SEP] the dow closed down 1. 2 points, the ftse - 50, 000 shares fell and the global 500 fell 0. 3 per cent, a decline of more than 10 per cent. [SEP] willis mcgahee was 7 - of - 17 for 278 yards and two interceptions, while fal was 4 - of - 6 passing for [SEP]"}
+{"type": "sample", "index": 35, "raw_text": "[CLS] total number of suicides has dropped by just 20 to 19 percent since the start of 2007, the lowest year in nearly a century in more than 50 countries. [SEP] \" it ' s a very hard challenge to get through this, \" gates told reporters. [SEP] she claimed to make the thing better in writing but found that almost \" a little fruitless. \" [SEP] ms rice also said that ties with china - - its worst since split by the south korean war - - was a growing concern in the current relationship with the united states. [SEP] this recession means an economy that has lost more than half a million jobs last year, company [SEP]", "detok_text": "[CLS] total number of suicides has dropped by just 20 to 19 percent since the start of 2007, the lowest year in nearly a century in more than 50 countries. [SEP] \"it's a very hard challenge to get through this,\" gates told reporters. [SEP] she claimed to make the thing better in writing but found that almost \"a little fruitless.\" [SEP] ms rice also said that ties with china - - its worst since split by the south korean war - - was a growing concern in the current relationship with the united states. [SEP] this recession means an economy that has lost more than half a million jobs last year, company [SEP]"}
+{"type": "sample", "index": 36, "raw_text": "[CLS], i have the credit experience, not the ability to do all. [SEP] two of the migrants arrived yesterday after ships carrying supplies from the uk ' s west west of england were sent away. [SEP] meanwhile, violence still flared, mainly between arabs and thousands of palestinians, many from gaza in the west bank, where the gaza war was raging. [SEP] after being preptrained to be a rugby player in the british national team while at university, he started being a school boy, although he stayed on the touchline when twicke was at them, urging him to make use of his pen and physical skills and stay in his place [SEP]", "detok_text": "[CLS], i have the credit experience, not the ability to do all. [SEP] two of the migrants arrived yesterday after ships carrying supplies from the uk's west west of england were sent away. [SEP] meanwhile, violence still flared, mainly between arabs and thousands of palestinians, many from gaza in the west bank, where the gaza war was raging. [SEP] after being preptrained to be a rugby player in the british national team while at university, he started being a school boy, although he stayed on the touchline when twicke was at them, urging him to make use of his pen and physical skills and stay in his place [SEP]"}
+{"type": "sample", "index": 37, "raw_text": "[CLS] the international monetary fund. [SEP] the first question of what a senior has the ability to do is to who and who. [SEP] by virtue of his political personaes, america has turned its back with all the americanism. [SEP] warkojen was ninth in the german kring, the first group of riders to use nachovis in two years, which is just mcpond ' s ninth victory in the tour. [SEP] jerusalem ( ap ) - a senior cabinet official said the israeli leader is moving toward the end of u. s. president ' s term of a 50 - year freeze, and that the administration has not [SEP]", "detok_text": "[CLS] the international monetary fund. [SEP] the first question of what a senior has the ability to do is to who and who. [SEP] by virtue of his political personaes, america has turned its back with all the americanism. [SEP] warkojen was ninth in the german kring, the first group of riders to use nachovis in two years, which is just mcpond's ninth victory in the tour. [SEP] jerusalem (ap) - a senior cabinet official said the israeli leader is moving toward the end of u. s. president's term of a 50 - year freeze, and that the administration has not [SEP]"}
+{"type": "sample", "index": 38, "raw_text": "[CLS] down from 4. 3 percent at the end of last year. [SEP] meanwhile, growth rates rise 6. 5 percent in 2010 to 9. 8 percent in 2011 and another 8 percent in 2010, \" it added. [SEP] it wasn ' t so long ago that some of the new records make no claim to be true. [SEP] \" it is very hard to meet the californian workforce and move away from our ageing and aging record in the last 15 years, \" says doug hau, president of brown college golf ' s new program that will allow american school workers to do at least 25 full - time at a third level. [SEP]", "detok_text": "[CLS] down from 4. 3 percent at the end of last year. [SEP] meanwhile, growth rates rise 6. 5 percent in 2010 to 9. 8 percent in 2011 and another 8 percent in 2010, \"it added. [SEP] it wasn't so long ago that some of the new records make no claim to be true. [SEP]\" it is very hard to meet the californian workforce and move away from our ageing and aging record in the last 15 years, \" says doug hau, president of brown college golf's new program that will allow american school workers to do at least 25 full - time at a third level. [SEP]"}
+{"type": "sample", "index": 39, "raw_text": "[CLS] \" said professor richard taylor, a professor of law at the school of law, in washington. [SEP] the group ' s travel data and national travel tallies shows that yearly visitors to the united states would be reached $ 2. 7 - billion ( approximately $ 2. 5 billion, £1.. 3 billion ). [SEP] the bad debt, otherwise known as \" bad \" debt, has increased through the third quarter of 2008 to $ 3. 1 billion, the company announced. [SEP] he also has a strong following of schropia. [SEP] rickie wilshere, matthew murphy and craig hibbert had their goals, [SEP]", "detok_text": "[CLS] \"said professor richard taylor, a professor of law at the school of law, in washington. [SEP] the group's travel data and national travel tallies shows that yearly visitors to the united states would be reached $2. 7 - billion (approximately $2. 5 billion, £1.. 3 billion). [SEP] the bad debt, otherwise known as\" bad \" debt, has increased through the third quarter of 2008 to $3. 1 billion, the company announced. [SEP] he also has a strong following of schropia. [SEP] rickie wilshere, matthew murphy and craig hibbert had their goals, [SEP]"}
+{"type": "sample", "index": 40, "raw_text": "[CLS] £11. [SEP] the family of a car that is believed to be worth £3billon in ikea said it was not allowed to keep the car there for a few weeks. [SEP] medvedev has given president obama only one go, but he feels the united states can achieve a political deal, not the collapse of russia ' s position, the official said. [SEP] the idea of the grand council is to try to give a global change to the world. [SEP] depending on the transaction, the bank ' s working capital position will increase to $ 300 million in september 2007 - 2009 and $ 200 million in connection with the tarp [SEP]", "detok_text": "[CLS] £11. [SEP] the family of a car that is believed to be worth £3billon in ikea said it was not allowed to keep the car there for a few weeks. [SEP] medvedev has given president obama only one go, but he feels the united states can achieve a political deal, not the collapse of russia's position, the official said. [SEP] the idea of the grand council is to try to give a global change to the world. [SEP] depending on the transaction, the bank's working capital position will increase to $300 million in september 2007 - 2009 and $200 million in connection with the tarp [SEP]"}
+{"type": "sample", "index": 41, "raw_text": "[CLS] more than 1, 000 students who are not allowed to take a job, including a probation officer. [SEP] brown seems to understand his point. [SEP] but on monday in september 2007, when mr. daley was taking over the law school, his wife ' s college admission ( and degree ) would have put him as close to his head. [SEP] i don ' t think we are going to learn from a man more like obama. [SEP] paul hilsen ' s award - winning film, \" tintin in the wild side, \" reveals all about the film ' s trying times. [SEP] in the 1990s, china joined other countries [SEP]", "detok_text": "[CLS] more than 1, 000 students who are not allowed to take a job, including a probation officer. [SEP] brown seems to understand his point. [SEP] but on monday in september 2007, when mr. daley was taking over the law school, his wife's college admission (and degree) would have put him as close to his head. [SEP] i don't think we are going to learn from a man more like obama. [SEP] paul hilsen's award - winning film, \"tintin in the wild side,\" reveals all about the film's trying times. [SEP] in the 1990s, china joined other countries [SEP]"}
+{"type": "sample", "index": 42, "raw_text": "[CLS] china, the world ' s largest export market and america ' s largest economy, had nearly 500 jobs and jobs on its payroll from the post office. [SEP] but wen acknowledged that china was seeking \" close friendship \" with us foreign policy, saying it was a sign to beijing not to wave a positive attitude, and an reference to china ' s willingness to allow greater human rights to say china must address all issues in need to \" ensure our support for the period of real change. \" [SEP] i was great for men ' s cup of football, i worked in all those sports, and i haven ' t gone anywhere before. [SEP] brian [SEP]", "detok_text": "[CLS] china, the world's largest export market and america's largest economy, had nearly 500 jobs and jobs on its payroll from the post office. [SEP] but wen acknowledged that china was seeking \"close friendship\" with us foreign policy, saying it was a sign to beijing not to wave a positive attitude, and an reference to china's willingness to allow greater human rights to say china must address all issues in need to \"ensure our support for the period of real change.\" [SEP] i was great for men's cup of football, i worked in all those sports, and i haven't gone anywhere before. [SEP] brian [SEP]"}
+{"type": "sample", "index": 43, "raw_text": "[CLS] prepare students in today ' s world \" and get them into algebra. [SEP] so he came out of the building after winning the rose bowl. [SEP] messages and phone e - mails are sent to the hospital ' s web site. [SEP] this time it is keen to focus on the health and education field, because of the growing widespread tobacco use in some schools and universities. [SEP] he said the government was examining the cases but did not discuss any specific legal grounds. [SEP] lab _ wilson, philadelphia ( interference ), 2 : 03 : 34. [SEP] i don ' t hear the old - fashioned whines and thuggery [SEP]", "detok_text": "[CLS] prepare students in today's world \" and get them into algebra. [SEP] so he came out of the building after winning the rose bowl. [SEP] messages and phone e - mails are sent to the hospital's web site. [SEP] this time it is keen to focus on the health and education field, because of the growing widespread tobacco use in some schools and universities. [SEP] he said the government was examining the cases but did not discuss any specific legal grounds. [SEP] lab _ wilson, philadelphia (interference), 2: 03: 34. [SEP] i don't hear the old - fashioned whines and thuggery [SEP]"}
+{"type": "sample", "index": 44, "raw_text": "[CLS] $ 10. 5 billion of public debt needed to finance it. [SEP] kerry said she wants to let the meetings involve other legislators and appoint several friends and family on washington state ' s board. [SEP] it leaves americans paul casey and mark allen on the same list. [SEP] now, he has learned what he is supposed to do : he really needs to be able to do things. [SEP] at that capacity, china produces a fifth of the world ' s agricultural food production. [SEP] \" i think the snp has to do a good thing! \" i asked. [SEP] now in france on a busy tour of asia, he will deal with [SEP]", "detok_text": "[CLS] $10. 5 billion of public debt needed to finance it. [SEP] kerry said she wants to let the meetings involve other legislators and appoint several friends and family on washington state's board. [SEP] it leaves americans paul casey and mark allen on the same list. [SEP] now, he has learned what he is supposed to do: he really needs to be able to do things. [SEP] at that capacity, china produces a fifth of the world's agricultural food production. [SEP] \"i think the snp has to do a good thing!\" i asked. [SEP] now in france on a busy tour of asia, he will deal with [SEP]"}
+{"type": "sample", "index": 45, "raw_text": "[CLS] financial markets. [SEP] the task was soon completed and then got to the hands of the three remaining challengers. [SEP] but tom riley, the former senior team trainer at the high school, doesn ' t comment on whether there is a connection to the abuse. [SEP] the government report said a civil medical commission will ask council leader dr. kim sufel - - chairman of the country ' s chief medical council - - whether china is getting tougher than looking into its scientific work. [SEP] san francisco ( ap ) - pat zito went three scoreless innings, earning his second save of 2008 in the giants ' 2 - 0 win [SEP]", "detok_text": "[CLS] financial markets. [SEP] the task was soon completed and then got to the hands of the three remaining challengers. [SEP] but tom riley, the former senior team trainer at the high school, doesn't comment on whether there is a connection to the abuse. [SEP] the government report said a civil medical commission will ask council leader dr. kim sufel - - chairman of the country's chief medical council - - whether china is getting tougher than looking into its scientific work. [SEP] san francisco (ap) - pat zito went three scoreless innings, earning his second save of 2008 in the giants' 2 - 0 win [SEP]"}
+{"type": "sample", "index": 46, "raw_text": "[CLS] in 2003 to be imposed on a group of older children - up from 19 % since 2004, according to the government. [SEP] the cause and ages of a 40 - year - old man to death and a 44 - year - old man has not been disclosed. [SEP] i must really ask if it would have to do it too long. [SEP] but when the mother of three says that marriage and death just can ' t do what you would like to do you see what she can do to do for her child - and your baby is not going out in front of her. [SEP] in january 2008, the lrb said it would investigate [SEP]", "detok_text": "[CLS] in 2003 to be imposed on a group of older children - up from 19 % since 2004, according to the government. [SEP] the cause and ages of a 40 - year - old man to death and a 44 - year - old man has not been disclosed. [SEP] i must really ask if it would have to do it too long. [SEP] but when the mother of three says that marriage and death just can't do what you would like to do you see what she can do to do for her child - and your baby is not going out in front of her. [SEP] in january 2008, the lrb said it would investigate [SEP]"}
+{"type": "sample", "index": 47, "raw_text": "[CLS] that ' s when you get married, go on a family vacation and things get different. [SEP] the group ' s director of social services, mike and paula martin, the parents of education secretary james and father mark hayley,, arrived for the uk two years ago, and found it studying english, the internet, culture and dyshenia and most had just a few places to sleep. [SEP] \" i do not want to go out with my child now and start a relationship with her son. [SEP] the former u. s. national security team moves into political austerity. [SEP] \" family \" ( channel 4 at 30 [SEP]", "detok_text": "[CLS] that's when you get married, go on a family vacation and things get different. [SEP] the group's director of social services, mike and paula martin, the parents of education secretary james and father mark hayley,, arrived for the uk two years ago, and found it studying english, the internet, culture and dyshenia and most had just a few places to sleep. [SEP] \"i do not want to go out with my child now and start a relationship with her son. [SEP] the former u. s. national security team moves into political austerity. [SEP]\" family \" ( channel 4 at 30 [SEP]"}
+{"type": "sample", "index": 48, "raw_text": "[CLS] to make it the kind of a great national sport.... if the vote...... go ahead.... \" just to make a damn on it........ [SEP] but the president, vladimir putin ( fyb : pkn ), also said that he would ask the european union for a new ambassador to visit israel during his next few years as foreign minister, urging the country to improve ties with israel in its decades of self - rule. [SEP] he has also argued that government should concentrate the focus on reducing sector growth and boosting net public spending. [SEP] [SEP]", "detok_text": "[CLS] to make it the kind of a great national sport.... if the vote...... go ahead.... \" just to make a damn on it........ [SEP] but the president, vladimir putin (fyb: pkn), also said that he would ask the european union for a new ambassador to visit israel during his next few years as foreign minister, urging the country to improve ties with israel in its decades of self - rule. [SEP] he has also argued that government should concentrate the focus on reducing sector growth and boosting net public spending. [SEP] [SEP]"}
+{"type": "sample", "index": 49, "raw_text": "[CLS] market, with prices at about 3. 5 - 4 % of the market. [SEP] that ' s not true.... [SEP] i ' m sure you will do your best to avoid this, and why. [SEP] earlier this month, the scheme was opened up at the united nations conference near pittsburgh because french president nicolas sarkozy said he would save $ 17, 000 - worth of human waste each day. [SEP] supt kevin knonke, the council ' s executive director, said : \" it is absolutely agreed that the scheme is an active part of the r4a and asked the council to understand the importance of [SEP]", "detok_text": "[CLS] market, with prices at about 3. 5 - 4 % of the market. [SEP] that's not true.... [SEP] i'm sure you will do your best to avoid this, and why. [SEP] earlier this month, the scheme was opened up at the united nations conference near pittsburgh because french president nicolas sarkozy said he would save $17, 000 - worth of human waste each day. [SEP] supt kevin knonke, the council's executive director, said: \" it is absolutely agreed that the scheme is an active part of the r4a and asked the council to understand the importance of [SEP]"}
+{"type": "sample", "index": 50, "raw_text": "[CLS] are much like my father and sisters. [SEP] the conservative leader has not officially been charged but has been under arrest and went on to become a minister of his country ' s ruling party. [SEP] debusch said monday that while congress has raised safety concerns, the official said it wants congress to do not take position on iran. [SEP] under the terms of the government ' s $ 250bn bailout programme, the bank has a capital deficit of $ 589bn this year, compared to a bailout of the $ 700bn by the us treasury department in september. [SEP] mr obama said on friday that the us was standing ready. [SEP]", "detok_text": "[CLS] are much like my father and sisters. [SEP] the conservative leader has not officially been charged but has been under arrest and went on to become a minister of his country's ruling party. [SEP] debusch said monday that while congress has raised safety concerns, the official said it wants congress to do not take position on iran. [SEP] under the terms of the government's $250bn bailout programme, the bank has a capital deficit of $589bn this year, compared to a bailout of the $700bn by the us treasury department in september. [SEP] mr obama said on friday that the us was standing ready. [SEP]"}
+{"type": "sample", "index": 51, "raw_text": "[CLS] crisis. [SEP] a court spokesman said the boy was almost never heard of any abuse. [SEP] he went to kenya with the national trade agency, hoping to take it back to his native land. [SEP] they want this to reform education and health care. [SEP] i spent the night with the people from my very own england, including some french, and was always asking if i was going away. [SEP] it ' s the latest product of the credit crisis. [SEP] but england can ' t stop him. [SEP] 27 ( upi ) - - 41 - year - old professional golfer golfer seafon lesh was killed after his wife hit the [SEP]", "detok_text": "[CLS] crisis. [SEP] a court spokesman said the boy was almost never heard of any abuse. [SEP] he went to kenya with the national trade agency, hoping to take it back to his native land. [SEP] they want this to reform education and health care. [SEP] i spent the night with the people from my very own england, including some french, and was always asking if i was going away. [SEP] it's the latest product of the credit crisis. [SEP] but england can't stop him. [SEP] 27 (upi) - - 41 - year - old professional golfer golfer seafon lesh was killed after his wife hit the [SEP]"}
+{"type": "sample", "index": 52, "raw_text": "[CLS], the highest since the survey began more than a half - century, was less than economists had been expected. [SEP] the bailout bill has met a barrage of objections from senate democrats and environmentalists. [SEP] \" europe will have to take serious action on the largest issue in the world, and i can understand how difficult it will be, \" said daniel englar, who is the eu ' s vice director of economy and economic policy. [SEP] but there is clearly a more real view of whether who does what should actually come from the business of politics. [SEP] here ' s what dan manley, obama ' s chief of staff, [SEP]", "detok_text": "[CLS], the highest since the survey began more than a half - century, was less than economists had been expected. [SEP] the bailout bill has met a barrage of objections from senate democrats and environmentalists. [SEP] \"europe will have to take serious action on the largest issue in the world, and i can understand how difficult it will be,\" said daniel englar, who is the eu's vice director of economy and economic policy. [SEP] but there is clearly a more real view of whether who does what should actually come from the business of politics. [SEP] here's what dan manley, obama's chief of staff, [SEP]"}
+{"type": "sample", "index": 53, "raw_text": "[CLS] done before, \" he added. [SEP] ron george, a former u. n. official who led the u. s. program in 2005, declined to identify the group. [SEP] \" i don ' t know what the whole goal is. [SEP] \" i was a coach to londonderry and at the right time he has probably played, and i doubt that any part of this team would want to make this again. [SEP] dr. dae tsang, foreign ministry spokesman, also said : \" china has strongly rejected the criticism of the u. n., saying it believed it was prepared to accept a supporting role in the [SEP]", "detok_text": "[CLS] done before, \"he added. [SEP] ron george, a former u. n. official who led the u. s. program in 2005, declined to identify the group. [SEP]\" i don't know what the whole goal is. [SEP] \"i was a coach to londonderry and at the right time he has probably played, and i doubt that any part of this team would want to make this again. [SEP] dr. dae tsang, foreign ministry spokesman, also said:\" china has strongly rejected the criticism of the u. n., saying it believed it was prepared to accept a supporting role in the [SEP]"}
+{"type": "sample", "index": 54, "raw_text": "[CLS]down on his country. [SEP] then everything happened. [SEP] the report was led by environment minister david boothroyd, chaired by mr howells and the culture minister ms jones. [SEP] some of the rules are written, consciously or superficially, to give us some context : we look at someone ' s nationality, instead of being a qualified person, so they can be easier to guess if they wish to buy. [SEP] he plays in the belief that the team represents every end of the league. [SEP] i want to find some truth about how the ecb had a long tradition of encouraging young people to vote for government debt securities. [SEP] [SEP]", "detok_text": "[CLS]down on his country. [SEP] then everything happened. [SEP] the report was led by environment minister david boothroyd, chaired by mr howells and the culture minister ms jones. [SEP] some of the rules are written, consciously or superficially, to give us some context: we look at someone's nationality, instead of being a qualified person, so they can be easier to guess if they wish to buy. [SEP] he plays in the belief that the team represents every end of the league. [SEP] i want to find some truth about how the ecb had a long tradition of encouraging young people to vote for government debt securities. [SEP] [SEP]"}
+{"type": "sample", "index": 55, "raw_text": "[CLS] bush administration, clinton and others gave the white house a policy - making tour of capitol hill. [SEP] separately the korean news agency yonhap state news agency monday said the two ministers would leave china in beijing on trade, trade, jobs and education. [SEP] another ex - m. l. a. coach, john wyle, became president of the oklahoma department of health, education and human services to oversee player - control. [SEP] some home lenders want to scale down production. [SEP] mr kabila said : \" the condition of the coalition negotiations is that we start our process at this time and need to be reached years ahead [SEP]", "detok_text": "[CLS] bush administration, clinton and others gave the white house a policy - making tour of capitol hill. [SEP] separately the korean news agency yonhap state news agency monday said the two ministers would leave china in beijing on trade, trade, jobs and education. [SEP] another ex - m. l. a. coach, john wyle, became president of the oklahoma department of health, education and human services to oversee player - control. [SEP] some home lenders want to scale down production. [SEP] mr kabila said: \" the condition of the coalition negotiations is that we start our process at this time and need to be reached years ahead [SEP]"}
+{"type": "sample", "index": 56, "raw_text": "[CLS]...... he is going to take it..... look at the end..... and do it well, yes!!!!!! make sure they are... it is not.........................!!!!! the people said it was............................!........... what is that [SEP]", "detok_text": "[CLS]...... he is going to take it..... look at the end..... and do it well, yes!!!!!! make sure they are... it is not.........................!!!!! the people said it was............................!........... what is that [SEP]"}
+{"type": "sample", "index": 57, "raw_text": "[CLS] of the process, saying it can ' t talk about its plans. [SEP] more than 1, 000 american soldiers have returned from iraq. [SEP] it is understood that the united states ' intelligence agency blames israel for the same goal, including east jerusalem, to create a free - for - all palestinian state. [SEP] thomas, who fired down in the first quarter wednesday and said that he would not be following a deal with the kings, was expected to be in the top half of the draft. [SEP] he urged the president on july 11 to set up checkpoints on beaches, airports, to deter foreign visitors to china, south korea, [SEP]", "detok_text": "[CLS] of the process, saying it can't talk about its plans. [SEP] more than 1, 000 american soldiers have returned from iraq. [SEP] it is understood that the united states' intelligence agency blames israel for the same goal, including east jerusalem, to create a free - for - all palestinian state. [SEP] thomas, who fired down in the first quarter wednesday and said that he would not be following a deal with the kings, was expected to be in the top half of the draft. [SEP] he urged the president on july 11 to set up checkpoints on beaches, airports, to deter foreign visitors to china, south korea, [SEP]"}
+{"type": "sample", "index": 58, "raw_text": "[CLS] council council, officials from the centre for the education of the sport and the council ' s sports authority, which will run the council ' s administration of the event. [SEP] cowboys coach alex mckeon will practice at the miami bowl next season and won ' t play in the redskins games because players have been playing with injuries while they play. [SEP] i don ' t think that favre will be in his team ' s shoes. [SEP] chinese officials have vowed to tone down china ' s statements on the u. s. future, saying they have both concerns of human rights and open government. [SEP] edgar gonzalez took a 3 - 2 [SEP]", "detok_text": "[CLS] council council, officials from the centre for the education of the sport and the council's sports authority, which will run the council's administration of the event. [SEP] cowboys coach alex mckeon will practice at the miami bowl next season and won't play in the redskins games because players have been playing with injuries while they play. [SEP] i don't think that favre will be in his team's shoes. [SEP] chinese officials have vowed to tone down china's statements on the u. s. future, saying they have both concerns of human rights and open government. [SEP] edgar gonzalez took a 3 - 2 [SEP]"}
+{"type": "sample", "index": 59, "raw_text": "[CLS] of manufacturing operations. [SEP] japan also plans to issue a package of economic measures tuesday to move attention to the world bank for the country ' s nuclear policy - a task force set up by the administration of former japanese president yasuo - kawakua, a conservative and the country ' s top foreign minister. [SEP] vick ' s father, john weatherley, pleaded guilty last week. [SEP] the researchers joined with david rohy, ms. verez, and david bye, director of public relations, human rights watch, and bill gulick, director of the national security institute at the university of chicago, in [SEP]", "detok_text": "[CLS] of manufacturing operations. [SEP] japan also plans to issue a package of economic measures tuesday to move attention to the world bank for the country's nuclear policy - a task force set up by the administration of former japanese president yasuo - kawakua, a conservative and the country's top foreign minister. [SEP] vick's father, john weatherley, pleaded guilty last week. [SEP] the researchers joined with david rohy, ms. verez, and david bye, director of public relations, human rights watch, and bill gulick, director of the national security institute at the university of chicago, in [SEP]"}
+{"type": "sample", "index": 60, "raw_text": "[CLS] to become one of those nations, \" he says. [SEP] i simply don ' t know what she has to say with. [SEP] yes, you know, you didn ' t have the money opportunity to come here in 2003 and be head coach and golf coach no matter what the circumstances in the tour play, and it ' s the fact that he ' s watching the pros. [SEP] but the new zealand coach said : \" i have said he didn ' t want to discuss any of the issues, and john was very worried. [SEP] he ' s not taking a final position on the climate change from president barack obama, saying he [SEP]", "detok_text": "[CLS] to become one of those nations, \"he says. [SEP] i simply don't know what she has to say with. [SEP] yes, you know, you didn't have the money opportunity to come here in 2003 and be head coach and golf coach no matter what the circumstances in the tour play, and it's the fact that he's watching the pros. [SEP] but the new zealand coach said:\" i have said he didn't want to discuss any of the issues, and john was very worried. [SEP] he's not taking a final position on the climate change from president barack obama, saying he [SEP]"}
+{"type": "sample", "index": 61, "raw_text": "[CLS] to ucla medical center in los angeles city. [SEP] between 2007 and 2008, 6. 5m people of over 30 years in the premier league will spend an extra £3m to attract private league players, according to the report. [SEP] the u. s. supreme court ' s decision upheld same - sex marriage in a 2005 case that challenged the government ' s power to close illegal immigrant cases and said at least 12 residents could face up to five years in prison. [SEP] that would create a much smaller policy coalition, with a short range of solutions and with no plans to make a tax. [SEP] the us central bank said 78, 000 [SEP]", "detok_text": "[CLS] to ucla medical center in los angeles city. [SEP] between 2007 and 2008, 6. 5m people of over 30 years in the premier league will spend an extra £3m to attract private league players, according to the report. [SEP] the u. s. supreme court's decision upheld same - sex marriage in a 2005 case that challenged the government's power to close illegal immigrant cases and said at least 12 residents could face up to five years in prison. [SEP] that would create a much smaller policy coalition, with a short range of solutions and with no plans to make a tax. [SEP] the us central bank said 78, 000 [SEP]"}
+{"type": "sample", "index": 62, "raw_text": "[CLS] industry and its retail industry. [SEP] los angeles, july 16 ( upi ) - - a woman was charged thursday with killing three men and two women in a las vegas bar accused the couple of assaulting a police suspect, law enforcement sources said. [SEP] john lynch was appointed head of bank of america ' s global banking and credit operations in october 2007. [SEP] andy streacha, head of the adb, said the force would continue to investigate the cases, including its deputy chief executive david fillon. [SEP] after the tournament around town in salt lake city from 6 am to 4 p. m., mcfee said [SEP]", "detok_text": "[CLS] industry and its retail industry. [SEP] los angeles, july 16 (upi) - - a woman was charged thursday with killing three men and two women in a las vegas bar accused the couple of assaulting a police suspect, law enforcement sources said. [SEP] john lynch was appointed head of bank of america's global banking and credit operations in october 2007. [SEP] andy streacha, head of the adb, said the force would continue to investigate the cases, including its deputy chief executive david fillon. [SEP] after the tournament around town in salt lake city from 6 am to 4 p. m., mcfee said [SEP]"}
+{"type": "sample", "index": 63, "raw_text": "[CLS] the company is likely to remain in debt if it is successful. [SEP] the assembly side includes representatives of senior political figures, including the indian prime minister and former us secretary of state clinton. [SEP] mr. dales and the national national park authority will hold a public meeting on the project, with a full public and private meeting to be held within the next few weeks. [SEP] ap writer kelly kim contributed to this report. [SEP] for her, i think that : there is an idea that demands the media toughness ; this is very fun to describe. [SEP] in the affected area of the zarin district in the sharab river, [SEP]", "detok_text": "[CLS] the company is likely to remain in debt if it is successful. [SEP] the assembly side includes representatives of senior political figures, including the indian prime minister and former us secretary of state clinton. [SEP] mr. dales and the national national park authority will hold a public meeting on the project, with a full public and private meeting to be held within the next few weeks. [SEP] ap writer kelly kim contributed to this report. [SEP] for her, i think that: there is an idea that demands the media toughness; this is very fun to describe. [SEP] in the affected area of the zarin district in the sharab river, [SEP]"}

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_temp_schedule_128steps_n64/const1p45_c1024_detok_raw_samples.txt

@@ -0,0 +1,230 @@
+const1p45_c1024_detok
+{
+  "type": "summary",
+  "name": "const1p45_c1024",
+  "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt",
+  "step": 168000,
+  "decode": {
+    "kind": "categorical_fullvocab_temp_schedule",
+    "config": "const1p45_c1024",
+    "steps": 128,
+    "model_t_mode": "post",
+    "support_power": 1.0,
+    "semantic_power": 1.0,
+    "temp_start": 1.45,
+    "temp_end": 1.45,
+    "temp_schedule": "const",
+    "concentration_min": 1.0,
+    "concentration_max": 1024.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 44.64688583445828,
+    "nll_per_token": 3.7987845587413815,
+    "tokens": 9790
+  },
+  "diversity": {
+    "sample_entropy": 4.190344770313543,
+    "unique_tokens": 1890,
+    "token_count": 8192,
+    "distinct_1": 0.230712890625,
+    "distinct_2": 0.6918061023622047,
+    "top_token_mass": 0.0584716796875
+  }
+}
+
+===== sample 000 =====
+[CLS] matches against manchester united and liverpool in their final final next season. [SEP] he started with a big losing streak at the start and found savvy trying to put himself in position. [SEP] and the inclusion of public employees in a private sector has dramatically eroded the constitutional right of privacy in new york city law since 1991. [SEP] on the job, she runs out of her job for only 10 days. [SEP] the red sox improved to 10 - 5 this year. [SEP] the group has members in canada, germany, canada, austria, sweden, norway, switzerland and the united kingdom, according to the iod. [SEP] the state is fighting [SEP]
+
+===== sample 001 =====
+[CLS] frento said. [SEP] last year's title in seven of eight riders were in second behind the wheel. [SEP] mr cameron said that children would not be taking enough drugs if they failed their own treatment in order to keep them informed about each particular possible course. [SEP] without releasing the true toll of u. s. troops, the military said sunday that of those killed had already 18 afghan civilians. [SEP] "it is a good thing we can do before it has to open up," he said. [SEP] a source involved at the scene told the associated press requested anonymity and would not be named discussing the crime involved. [SEP]
+
+===== sample 002 =====
+[CLS] scotland's disappointment, they could not take control when celtic came back by scoring an equal point. [SEP] "mothers are much more likely to develop the disease, as the number of healthy children who deal with it is increasing at this rate," the report says. [SEP] board members and mlas are facing a greater risk of losing seats around the country. [SEP] in afternoon trading, the dow jones industrial average fell 47. 00,, down 0. 34 percent, 10. 05. [SEP] williams and gerrard's team finish fifth, meaning they can qualify for the beginning of the year when the paris tournament is over. [SEP] [SEP]
+
+===== sample 003 =====
+[CLS] monday as americans tightened their views on the global economy. [SEP] third seed serena williams beat danish gretar mattek 7 - 6 7, 6 - 3, then lost one set and a third set game of the match. [SEP] it arrives at 1: 22: 15, dec. [SEP] on thursday in vancouver, the governor's spokesman rick smith said it was not clear whether there had been anything to do with the lawsuit. [SEP] " i don't know anything else. [SEP] john mccain's campaign has come to terms with this important issue in the polls; that's unlikely to happen. [SEP] the biggest concern, though [SEP]
+
+===== sample 004 =====
+[CLS]'s smoke away from the radio. [SEP] one car bomb killed three u. s. soldiers in iraq, and all were killed in the attack, which four people died. [SEP] london (reuters) - andy roddick's start with his wimbledon title on monday at swiss tennis turned out to be very unlikely. [SEP] sunderland's impressive run to a fourth in the two league cup games and the first win of their campaign for liverpool's premier league double title has begun with wayne rooney, who is expected to be sidelined at the start of christmas, and sir alex ferguson - - who may yet make a major start before [SEP]
+
+===== sample 005 =====
+[CLS], " he said. [SEP] liberal leader christian grubert is a leader of germany's conservative opposition liberal democratic party. [SEP] paris, april 20 (upi) - - the african nations didn't spell out any of the way of hosting the vote in africa's biggest muslim nation, officials said. [SEP] his brother was arrested by police in britain in 2004 and charged with murder, hours friday after a 19 - year - old woman was shot nine times in her apartment in a bar. [SEP] even today, they often remain behind the iconic towers of washington's former capital. [SEP] the broncos hope he can play sunday [SEP]
+
+===== sample 006 =====
+[CLS]'s poor and higher - income students at the university. [SEP] the department's air division was expected to carry the ration today. [SEP] "i was shocked," she told the associated press. [SEP] newark, n. j., aug - - novak djokovic lost the match to andy murray and sweden's robin soderling suffered a fourth - round defeat after rallying to snatch a 3 - 6 6 - 4 loss to novak djokovic. [SEP] djokovic (2 - 7) beat sam querrey 7 - 5 6 - 3, 6 - 3, 6 - 4, 6 - [SEP]
+
+===== sample 007 =====
+[CLS] 2002. [SEP] if we're rich enough, it is hard to think we can't do it, " general mozir ahmed, president of the national federal health protection agency, told reuters on tuesday. [SEP] in december 2002, lakeland was 90 miles north of pittsburgh, about 30 north of pittsburgh. [SEP] the lead was soon deserved, and lee struck the winner, hitting the near post with a header five minutes left before the interval, then was tied up by luke clark with a cross from given. [SEP] the road was was closed following a large amount of work. [SEP] yes, i know, it is time and [SEP]
+
+===== sample 008 =====
+[CLS]fina defeated radja rad of poland 7 - 5, 6 - 5, 7 - 5, 6 - 4, 7 - 5, 2 - 6 (6 - 7), 6 - 7, while second - seeded russian elena dementieva beat american shaha williams 4 - 6 to meet france's kim clijsters of belgium in the women's singles event. [SEP] 1 fight, " calzaghe said. [SEP] the number of people who have died is 2, 544 in the war, according to the u. s. defense ministry. [SEP] last month, the national union of [SEP]
+
+===== sample 009 =====
+[CLS] points, or 0. 06 percent, france's cac - 40 fell 1. 84, or 0. 01 percent, and france's cac - 40 fell 1. 50, or 0. 58 percent, to 3, 463. 88. [SEP] the panthers finish their season at least 0 - 11 with saturday night's regular - season games at florida at 10 p. m., and philadelphia. [SEP] by october, there had been 149 extra deaths of children in england and wales since wednesday, but this figure had to be confirmed wednesday, according to the latest figures. [SEP] that's not the point [SEP]
+
+===== sample 010 =====
+[CLS] - of - 14 shots in the second quarter. [SEP] "i think we do all our best to work so that there will be an end to the current downward situation," bos said. [SEP] jurors were ordered held in richmond, virginia, on thursday. [SEP] the palestinians ended their five - week bombardment of gaza. [SEP] what's for the taliban? " my friend imad osamaq said, widening his eyes as the line ran out. [SEP] ba shares climbed 0. 25 per cent to 0. 40 per cent (6. 75p) before closing 0. 6 per cent lower to 1. 20 [SEP]
+
+===== sample 011 =====
+[CLS], " obama's senior strategists said, and mccain's campaign is actually going only to peel away obama's likely popular appeal and help change the economy. [SEP] the event was free and manageable. [SEP] this, at least, began with the possibility that all the players could stay out for the first year of their contract. [SEP] melbourne (reuters) - the world number two, no. 10, and roger federer advanced into the first round of the marseilles open here on wednesday, but neither player claimed a double - chance just one minute later to lead 2 - 1. [SEP] the report also said the [SEP]
+
+===== sample 012 =====
+[CLS] at home on sunday and then failed to win. [SEP] the body of mr neale was found at about 1110 local on 7 march and found in the same area of the road in the early hours of the morning. [SEP] king juan ii, meanwhile, boosted the hopes of winning the men's title by 5 - 0 at the age of 62 on sunday. [SEP] tens of thousands of parents have begun a joint inquiry into the deaths of 502 children. [SEP] "i worry more about the economy, more about jobs, but i don't like race," he said. [SEP] arsenal's pique albert riera [SEP]
+
+===== sample 013 =====
+[CLS] the edwards air force base, calif., has failed to take off for normal wednesday, the agency reported. [SEP] it's time to get into the old - fashioned minds. [SEP] est, six people remained wounded, according to nato military reports. [SEP] " we have a team that is prepared to take care of the players, prepared to come to us and to help us out. [SEP] but capello, who can use the european title from his six - year football career, has said it's going to be high - minded in his favour. [SEP] if it cannot meet the deadline to increase its investment to itv and [SEP]
+
+===== sample 014 =====
+[CLS] said. [SEP] the final decision would have been known for a third time, given the location of the original u. s. air force site. [SEP] he wasn't checked out after hearing about the incident by the authorities. [SEP] carmakers are paying more, too, because the government can produce their cars at a time when the economy is strong. [SEP] the outcome of this next general election is inevitable. [SEP] in the course of the recession, it was possible for western businesses to make more payments in the first hours of the cold month. [SEP] "we believe that we can make the necessary progress along the way," he said [SEP]
+
+===== sample 015 =====
+[CLS] florida and halfway along the caribbean and eastern gulf. [SEP] since his death in 2002, he said he has been taking drugs, cutting her and grabbing a baby in his mouth, his back and putting on his head. [SEP] the dow slipped 13 points at 10, 642. [SEP] setback on sept. [SEP] now, he tells everyone, however, he's back. [SEP] in 2005, a senior science and policy analyst at the center for science and international studies center in washington said a clinton - friendly election is likely to tip the balance on the survival of a black leader in charge of the party. [SEP] for all middle - [SEP]
+
+===== sample 016 =====
+[CLS] war that killed roughly 1, 000 people there in early 2009. [SEP] " it is understandable that anyone responding to a robbery will be brought on to the police line at around 2200am. [SEP] but federer lost the first set on the 3 - 2 break. [SEP] in the early 1990s, abramovich said that he could face failure because he would be a player in chelsea's team. [SEP] a year before kennedy's death, some of the leading candidates came up against that and opened their careers. [SEP] mr grothey, a 21 - year - old from leech, wirrals, had agreed to [SEP]
+
+===== sample 017 =====
+[CLS] safe. [SEP] murray, who reached the quarter - final, fought his first return serve to take the hold on the game with the rest of the crowd. [SEP] the election was due before in july 2008. [SEP] "motorola, by contrast, is a huge and profitable way to buy phones and chips," said leesen, the company's chairman. [SEP] last year, she had lost only one set in the previous three, while suffering from a back injury. [SEP] congressional officials had said the plan would be approved by the senate and the house and the senate and could be picked up in bringing more costs to the economy. [SEP] [SEP]
+
+===== sample 018 =====
+[CLS] national cancer institute. [SEP] with the disease rising, nearly thousands more are at risk of dying from the health effects of the new sw1 in europe. [SEP] he was probably good at taking the boat and not dangerous. [SEP] i still don't have it. [SEP] "i think it is time to move on," he said. [SEP] according to data from the national institute of health and the uk in 2002, 294 people died in scotland. [SEP] they are optimistic that the number of displaced refugees will soon return. [SEP] the cardinals came to the fourth round, the title in the semifinals, and won it all in 2002, 2002 [SEP]
+
+===== sample 019 =====
+[CLS] alex ferguson believes that the pre - rested player would soon be able to finish with the second or better side of the new squad. [SEP] and in 1996, the democratic national committee announced the choice of senator john kerry days after the michigan primary, casting the party's nomination against a soon - to - be candidate to change the presidential race. [SEP] "we will win because we don't know our strategy," mullen told u. s. president and secretary of state hillary clinton. [SEP] (ap) - michael vick was sacked with 10 seconds left to lead michigan state back, 4 - 1, but the unbeaten ho [SEP]
+
+===== sample 020 =====
+[CLS] he said. [SEP] but he won it on his own. [SEP] because they said, doing something would prove difficult, but not impossible. [SEP] but there is also uncertainty about the long - term changes in gordon brown's leadership and the economic results of the election. [SEP] it was the first quarterly loss since september 2008. [SEP] nothing looked immediately apparent and he could have had a penalty saved when he was caught by alan johnson in the 12th minute, although the striker almost earned a goal - kick against the norwegians. [SEP] " i do not understand how, if i was sitting in your car i could have done something else out of [SEP]
+
+===== sample 021 =====
+[CLS] 2005. [SEP] oceaneere's security officials were unable to disclose the details of their fight with the pirates, who held the ship on wednesday night. [SEP] novak novak djokovic lost his fourth straight australian open final final, but today's 6 - 2 victory ended exactly what had been expected. [SEP] the attack, involving nearly 20 afghan soldiers, resulted in a mass evacuation of troops in two checkpoints elsewhere in the air district. [SEP] new york (reuters) - no. 1 seed shara williams has won the itf women's second event in two weeks, the women's tennis tournament on sunday, defeating american [SEP]
+
+===== sample 022 =====
+[CLS] concerns over mortgage risks. [SEP] i think about being a boy and he's trying to make sure that he's healthy, he doesn't want to do so. [SEP] but john prosser, 35, says he'll know what his ability to do after his job is likely to end. [SEP] a new study is being carried out by scientists. [SEP] it is much less a nightmare. [SEP] even so, of course, the result will be an inevitable result, not upset. [SEP] she declined to comment on the nature of the questions, citing schiller's former rep. [SEP] then came the end of the [SEP]
+
+===== sample 023 =====
+[CLS] [SEP] renault and toyota have already been locked in three race wars, which ended in 2009, leaving them only seven points in the german - american standings. [SEP] the latest attack came just days after u. s. - led forces fighting for al - qaida launched a series of suicide bombings in north - west waziristan region north of baghdad, killing at least 20 people. [SEP] she had reached third and ranked 30th before losing on 10 of the first 13 games, but henin fell short with another set of double - break points in the second set to win 4 - 1, 2 - 2. [SEP] this week, [SEP]
+
+===== sample 024 =====
+[CLS] said he didn't know exactly when it was written, or the fact it would have happened. [SEP] washington - - barack obama's political and military party is holding talks over whether to open negotiations for a new comprehensive peace deal. [SEP] the head of the tamil tigers went on a flight to india late saturday amid reports of a terrorist threat in the region, the government said. [SEP] he had a similar view about the rest of his class. [SEP] on the edge of the rugged valley, they look at the location of the fire - - and where it was taking place. [SEP] she's currently in charge of the international olympic [SEP]
+
+===== sample 025 =====
+[CLS] more likely parents, pension workers and their families to lose more care of their young children and end up in dire straits. [SEP] if that's the case, we'll get our point. [SEP] "it's a part of that," she said. [SEP] "you see, i can't be here. [SEP] at this point, it's" unrescusable, " about 2. 2 seconds off a fast pace before some passengers said they could go back to the air in the morning. [SEP] a nice feel with a white, wooded valley, a good sight to the hotel and a strong sense that [SEP]
+
+===== sample 026 =====
+[CLS] majority in two weeks, in an election that could have left him in the race for the current presidency. [SEP] it was pretty gut - wrenching. [SEP] i'm very sorry, i was very happy, " he said. [SEP] obama's isn't going anywhere. [SEP] he defeated the st. louis cardinals 2 - 0 and lost three in seven innings to earn a first - round bye. [SEP] it has a network of 17 branches in london, london, yorkshire, north yorkshire, birmingham, blackpool, lancashire, derbyshire, hertfordshire, south yorkshire and doncaster. [SEP] more than 16, 000 people were killed and more than [SEP]
+
+===== sample 027 =====
+[CLS] on the night. [SEP] rachida ouldinu, 30, has been charged with attempted murder on 18 june. [SEP] the majority of economists don't believe this is a big part of a plan that will be available to americans at all income levels. [SEP] with the year and winter olympics due to end, warm weather in britain coming between mid - march and december could produce more snow this week. [SEP] marin cilic, the us open champion, had six points in the opening set, 4 - 5, and in the second it was set for a tie. [SEP] texas, which has finished more than 40 - 0 [SEP]
+
+===== sample 028 =====
+[CLS] second race, a neck down to his last time, seems to be winning. [SEP] but six days later, the former left - right winger came into government. [SEP] england reached 170 for five with nine wickets by paceer andrew flintoff and pace opener ricky ponting, while clarke has claimed a test wicket with the reserve side shortly after completing his debut from durham. [SEP] he warned not to take the risk. [SEP] new york opened its regular season with six wins in eight straight overall and seventh - worst in the east in its history.... [SEP] this year's open champion safina of russia was able to make [SEP]
+
+===== sample 029 =====
+[CLS] year - old son in the northern region. [SEP] also thursday, health ministry official sarhad khan said the local council said 60 were killed, including one soldier were wounded in the fighting. [SEP] for example, the defense department's survey of strategic public agents and its personal computer systems students may affect their federal income. [SEP] the meeting included 16 members of the national organising committee, including kasab ghabar, the president of the organising committee, earlier in the month. [SEP] while the dow jones index is below 100 percent, the s & p was trading 0. 4 percent lower at 12, 930. 00. [SEP] he [SEP]
+
+===== sample 030 =====
+[CLS] 2004, when she broke the same mark for the first time since the ban after being a woman. [SEP] there were some questions about it. [SEP] the information security commission just disclosed that it was receiving 500 claims by members of the public, claiming the firm has received a maximum of £37, 642 from labour clients. [SEP] he was taken to hospital, police said, adding reports later in the condition were stable. [SEP] the report was written in a journal by matthew dowd, an expert on the state peace program at the korea institute. [SEP] the north's military had heard reports of the firing by georgian troops at the time [SEP]
+
+===== sample 031 =====
+[CLS] muhammad's lawyer son muhammad jr. declined to press the sentence. [SEP] manchester united manager sir david james has admitted he has helped the 30 - year - old england midfielder make his first start at the club. [SEP] "i think that when he puts up the challenge in the history of the game, i don't see the reality now," he told cbs news. [SEP] "this is a very exciting result," he said. [SEP] "it was something very unhirl." [SEP] and as a result, it's easy to say to me, "we have lost the chance of achieving it." [SEP] [SEP]
+
+===== sample 032 =====
+[CLS] family's home along the desaie river on sept. [SEP] it seems to have no further information on the outcome of the debate, it does, however, depend on the validity of what he thinks and what the media thinks in the light of what this might mean to him today. [SEP] they had to try to make the term "nonpartisan" by getting involved in politics. [SEP] "we've had the talking with the celtic manager before, but we had a very rough time people were trying to get over what was happening for us," he said. [SEP] the ruling comes the day after a second review of international [SEP]
+
+===== sample 033 =====
+[CLS]. [SEP] former rangers striker thomas mccarthy hopes to improve coach joe young's side. [SEP] official results have yet to be released. [SEP] after mr. smith died last year, mr. van der veer's life changed dramatically. [SEP] 31, 2005, he died at 9 a. m. [SEP] he, from a three - month break, held the lead of his sixth open rematch, with roger federer, before beating his friend novak djokovic at the 2005 french open. [SEP] at this stage, it isn't clear if the person died from the injuries. [SEP] most of those lived in the secure area of baghdad [SEP]
+
+===== sample 034 =====
+[CLS] through. [SEP] new york at new england, 4 p. m. [SEP] but then, if the effort is successful, fincher would have decided to get that far. [SEP] one of the two largest shareholders of us media said 21 police officers would be fired and 200 more would be filled by the second quarter of 2010. [SEP] they said the fed and treasury are also responsible for raising standards for mortgage regulators and brokers to better understand the credit - rating system at the expense of many borrowers. [SEP] he is living in a family's house and works in the small city of kashal in the north - central province. [SEP]
+
+===== sample 035 =====
+[CLS] just scored the last of their goals. [SEP] according to the nature of the case, no decision was given to police for the release of a bail report on his death. [SEP] while the unrepared experts know there is some reason to go out on it, experts say they can get a break with their public health. [SEP] he was elected america's elected president for the first time in 1999, and ran for the presidency for up to a year. [SEP] "nobody comes here to play more than a champion, it's possible," he said. [SEP] what should not happen to universal health care is the cost and [SEP]
+
+===== sample 036 =====
+[CLS] democrats expected ahead of tuesday night's election could help push gop sen. john mccain and republicans to keep control. [SEP] a bomb has also struck off at the queen's university and the queen's college in birmingham, killing more than 100 members of staff and students. [SEP] the americans were fourth in the women's singles, while china lost a fourth in the women's and the men's doubles. [SEP] he is a professor of sociology at the university of southern california and has written five medical books since his death from 2001 until august 2007. [SEP] henin was won in 2002 only five times in a season [SEP]
+
+===== sample 037 =====
+[CLS]. [SEP] the results of the original study, published in a 12 - month public online issue of the journal of psychology, asked college - age consumers about the health benefits of personalised planning for families and a personalised lifestyle. [SEP] thai soldiers attacked rumwindi army garrison, 40 km south, near the city of mohalin, in the early early hours of the morning, the officials said. [SEP] grossman signed a four - year contract with the seahawks until next season. [SEP] tebow has thrown for 272 yards and four touchdowns. [SEP] in 2003, they won five first - class games, made it six finals before losing [SEP]
+
+===== sample 038 =====
+[CLS] along the banks of the river. [SEP] but he should know that. [SEP] i'm skeptical that senator clinton, who is a senator, can be staying on the edge. [SEP] only a group of professional curators can get a complete history of a classic subject. [SEP] though, the operation won't take much long. [SEP] he made his own personal mistake, sending home an e - mail message to his children's account as his mother threatened him over a telephone and refused to speak again. [SEP] it has claimed that the film will be screened this year. [SEP] in the south, the city of iraq's northern third [SEP]
+
+===== sample 039 =====
+[CLS] at the university of british columbia. [SEP] the 29 - year - old haurov made a surprise announcement this week about his status as a rider on his way to the title, which gave him the chance to change his form in friday's final race. [SEP] "we have been looking at the chances that the ice would pick up in the early stages of the last five years," said an ice official, who anonymously declined to speak to media focused on the research. [SEP] several women in britain have said they were losing concern for the safety of their lives as a result of debile disease. [SEP] washington ( ap [SEP]
+
+===== sample 040 =====
+[CLS] - 3 and american mardy fish of the netherlands defeated american richard haas 3 - 6 7 - 6 6 - 3. [SEP] even before mr brown's departure announcement that the soldiers would face a reshuffle of military operations, the government privately held out the future of some troops. [SEP] u. s. markets rose in april ahead of tuesday, but the first week of march trading ended at 10 yen, when they will be trading on the new york stock exchange. [SEP] the australian open champion was lost at a similar event in 2007, when serbian novak djokovic and david haas lost at the five - french open. [SEP] [SEP]
+
+===== sample 041 =====
+[CLS] an $8, 500 credit for child support. [SEP] the flight time means passengers need just five or seven minutes before time to get home to board the next flight. [SEP] " it seems to me that there is a huge market environment in mexico. [SEP] david moyes will not try to finish this big way as he has made sure of his return for liverpool winning the champions league this year. [SEP] women who are relatively out of work are significantly more likely when they leave their 11 - year - olds with more education in the uk, and are at risk of losing their two children and losing their daughter when they have brought enough money to [SEP]
+
+===== sample 042 =====
+[CLS] more likely to monitor their health, the researchers said. [SEP] he was also convicted in november of five counts of attempted sexual assault in the mersey crown court. [SEP] it is the most popular group, a group made up of 24 americans, and 14 pakistanis and the american captain. [SEP] with safin winning the match, williams will face serena williams and possibly the likes of dinara safina, dinara safina, rafael nadal and novak djokovic, who also beat dinara safina on match - point at 2 - 2pm. [SEP] what a bunch of whine's. [SEP] it [SEP]
+
+===== sample 043 =====
+[CLS] underpaid. [SEP] with the global recession biting costs, consumers are slashing their own businesses. [SEP] the four defendants were declared not guilty and brought to the government. [SEP] but health officials have stayed away from the debate. [SEP] keane's opening goal helped liverpool regain the lead at the break but could not equalise as the portuguese striker returned midway through the second after a powerful effort from david hamel was followed by a superb shot from right - back that sent the goal wide. [SEP] at the other end of a spectrum, you start with a lot of turmoil. [SEP] labour's overall performance early today was hit by a [SEP]
+
+===== sample 044 =====
+[CLS] [SEP] among non - retired workers, this was 43 % less - but about 40 % higher - than at the start of 2005. [SEP] but clinton and her staff say they are confident in sparing the money that needs to go from clinton to obama. [SEP] but he was not guilty. [SEP] the man has been taken to an area hospital. [SEP] the german, a five - time open champion, eliminated venus williams, who completed her first run in 2004 and 2007, defeated elena dementieva in the french - french french open final and she was eliminated in the fourth round of the following year. [SEP] the company said it expects [SEP]
+
+===== sample 045 =====
+[CLS] but had now come through the match, and with the loss of one goal they would not know what to do. [SEP] yet this thing was rather good, i thought. [SEP] ivanovic bounced back to win twice in the first women's singles match against an ethiopian opponent in each of the previous 10 years. [SEP] it seems like his best strategy. [SEP] i didn't know how my husband left. [SEP] some said more than one - third customers, at $10, 000, are at least asked to spend their money to save themselves, earning 1, 000 - dollar bonus points. [SEP] i have to focus on the brand [SEP]
+
+===== sample 046 =====
+[CLS] in south waziristan, pakistan's main province to the north - west border, the taliban killed a soldier and a belgian - born son in a car bombing on saturday in afghanistan's northwest of peshawar, killing american and un troops. [SEP] a friend who identified his friend as washington rep. andrew janis, declined to speak further from the post early tuesday. [SEP] i wonder if there is something, but if we're still here, it's no longer possible, we're going to tell him everything, and they're just going to go. [SEP] " i just didn't be as easy [SEP]
+
+===== sample 047 =====
+[CLS], according to john o' brennan, the president's national security adviser. [SEP] "i've lost the way out now," the new york senator said, according to the results. [SEP] it looked as though england had regained the first - half lead in the 27th minute but gera broke his serve to claim his second goal of the night when his counter - attack produced just the second chance to pull a goal away after four minutes. [SEP] woods suffered the sharpest stroke of his career, a playoff defeat at golf's world golf classic in sydney on nov. [SEP] penn state, n. y., march 3 [SEP]
+
+===== sample 048 =====
+[CLS] a lead on his second drive that ended with a field goal early in the second half. [SEP] very good, " said a spokeswoman for the british association. [SEP] the packers also scored three times in the second half against 7 - foot - 5 23 - year safety ryan ga grounder, who took advantage of a late interception late in the second quarter and will miss saturday's game. [SEP] the board has had a long way of convening questions about the fda's handling of the drug probe, especially when it failed to adequately answer any question about mr. martin's independent background. [SEP] during the time the [SEP]
+
+===== sample 049 =====
+[CLS] a low - income income topping 50 %. [SEP] the unite union represents around 9, 000 members of a total of 2, 500 ba staff and passengers outside their belts. [SEP] if you have a higher amount of pension coverage by retirement, the number of hours to work at your employer actually decreases to account for the loss of work, factoring the outcome of work. [SEP] boston (ap) - it's the first time he's been eliminated in the third round. [SEP] the department of health said yesterday that ministers had agreed to consider the impact of adding extra young people to new guidelines for mental health services. [SEP] the company [SEP]
+
+===== sample 050 =====
+[CLS] requires more exercise, perhaps even less sleep. [SEP] "i think that when we're running, it's likely we think that will set the goal for it," the official said. [SEP] robert st. michael greini of bloomington, mo., was second in 1: 09. 97, 39. 88, respectively, and john lasse 1: 05. 50. 65, second in 42. 93, 088: 19. 80 ). [SEP] i said "he won't change the word." [SEP] michael icahn, former managing director of international asset management at morgan stanley, which runs [SEP]
+
+===== sample 051 =====
+[CLS] within a decade. [SEP] the most publicized case this year was reported in 1975. [SEP] " but it's a joke. [SEP] and it won't matter what you might turn out for. [SEP] and, yes, it is very scary. [SEP] and that's why it's so difficult and so important. [SEP] the ap news agency said that the public search for the body was in its early stages. [SEP] all three board members were removed. [SEP] in another round, former world no. 1 davydenko also defeated french eighth seed tommy haase 6 - 3, 4 - 6, 7 - 7, 6 - [SEP]
+
+===== sample 052 =====
+[CLS]. [SEP] ten per cent of the population from 2000 - 08 died in england and in 2001 some 8. 7 per cent. [SEP] the irish lost 12 straight since falling out of the tournament in 2005. [SEP] the book's authors have already published a comprehensive study at the end of the disease assessing survivors more clinically, under stressing the potential for their lives. [SEP] among the first group who died, a 15 % reduction in the impact of the disease reduced nervousness. [SEP] madrid (reuters) - a spanish high court on saturday ordered the trial of a woman wanted in the death of a journalist killed in madrid. [SEP] three [SEP]
+
+===== sample 053 =====
+[CLS] season, he took on the show as a rookie in early 2006. [SEP] she studied theology at cambridge, then moved to the netherlands in france, france and then germany. [SEP] kabul (reuters) - a u. s. military coalition killed in a bomb attack on the main city of kabul, afghanistan, had detained more than 50 militants while assaulting nato air force units, a nato official said thursday. [SEP] the loss won for the third straight after losing all 10 of 16 games. [SEP] the founder of the popular internet web site lisa jones, who had lost her younger daughter, miss smith, died thursday, shortly after losing her [SEP]
+
+===== sample 054 =====
+[CLS] 400 million of the season will end up at home as well as the oscars. [SEP] the conservatives lost the conservative government in this year's general election and are hoping to form a new coalition in 2010. [SEP] there's no real truth. [SEP] people should get it. [SEP] the bus was ordered to pass into the bridgend area at about 2000 gmt on saturday, police said. [SEP] the poll was found that 20 % were very optimistic. [SEP] " the blood came in top of his head and he lost his hand. [SEP] he resumed his candidacy to a second term last month with a loss in the polls in the [SEP]
+
+===== sample 055 =====
+[CLS] on wall street. [SEP] and those who can decide whether you want to make the people feel responsible for what's going to happen just as a response to the moment of truth. [SEP] china's foreign ministry was not immediately available saturday. [SEP] the national register reported the deaths and deaths just five days after last year's round of earthquakes in california's san bernardino county, in the first week of march 2005. [SEP] the same unhappy, three - year daughter was nearly raped by her boyfriend in paris and held back by the loss of my mother's marriage. [SEP] " the international community got its due out in 2000 and [SEP]
+
+===== sample 056 =====
+[CLS] on the line. [SEP] and if one can be sure that it would not take a long break anyway, one only has the feeling that it could take a long to make. [SEP] "he asked me if i wanted to stay i realised there was nothing," he said. [SEP] but then that's what i think about and trying to understand, they are a big story. [SEP] federer, 7 - 2, who lost to djokovic in the first round, now has lost eight of 14, including the defending champion federer, who then lost out at the french open, the last time in 2004. [SEP] she played at [SEP]
+
+===== sample 057 =====
+[CLS]khazia province in south ossetia province, the official news agency reported. [SEP] the who also urged state health authorities when assessing whether a flu vaccine needed to be available. [SEP] montreal (reuters) - the cy young champions earned their fourth win in five games to lead the philadelphia flyers team to a 2 - 0 victory over pittsburgh pirates on tuesday. [SEP] some were killed in the region early last year when taliban missiles hit a british vessel, but some more are handed over to afghanistan, the ministry of defence said. [SEP] but no one might be upset by the cia's recent attempt to protect its long - earned reputation with a [SEP]
+
+===== sample 058 =====
+[CLS] 30 miles ) south of the nation's northern border. [SEP] "while it is possible that some other forms of the disease could be cured through the cultural changes, as well as it difficult to think about it," musser said. [SEP] albany n. y., sept. [SEP] the young man... [SEP] "if we do this, we will then get it back on our hands," she told reuters, who was born by her grandparents in the central valley of north lalande province, where her father's home was. [SEP] the u. s. circuit court of appeals, the division of federal [SEP]
+
+===== sample 059 =====
+[CLS] a local official in the northwestern province of nangarhar. [SEP] "by the end of 2008, we had been convinced that the majority of the people involved were very confident that they will happen," he said. [SEP] but it is also very difficult to handle. [SEP] they were not hospitalised, and a judge said their condition was "excellent." [SEP] the taliban in kabul, afghanistan, killed 11, 000 women after the u. s. army began combating militants sept. [SEP] meanwhile, serbian champion djokovic, who was losing one of three games with a virus, lost 3 - 0 in the second to clinch [SEP]
+
+===== sample 060 =====
+[CLS] 2008. [SEP] the main draw, third, second seed roddick and the other champion, andy roddick, was second and seventh. [SEP] thousands of candidates would be eligible to run in the republican primary in the 2008 presidential election, and go to the superdelegates for a popular vote. [SEP] madrid (reuters) - the french open took the first and second seeds on tuesday, and the fourth - seeded serbian rallied past samantha stosur 3 - 6 6 - 1 6 - 4, 6 - 0 6 - 4 win in two hours, 53 minutes. [SEP] the woman, who was taken to the hospital, was treated [SEP]
+
+===== sample 061 =====
+[CLS] upsetting the economy. [SEP] marseille's jean - claude g canale beat marseille's sami betoneri for a penalty, leaving substitute christoph metzler injured. [SEP] the military officials said last week that the offensive has resulted in 1, 500 deaths of afghan militants over the past two weeks. [SEP] the changes have been widely anticipated, with a relatively small and large effect in the population leading to a bigger increase in incomes. [SEP] he had fired two of four rounds and shot a 5 - under 66 to take the lead. [SEP] the study was conducted by the group's global survey. [SEP] the report was carried by the [SEP]
+
+===== sample 062 =====
+[CLS] under the terms of the deal. [SEP] the results should come from a severe version of the current virus in the united states and it could trigger a slowdown of the situation in the rest of asia, health experts said. [SEP] the result is an exhaust of history, a fascinating series of conversations and analyses. [SEP] in january, the 26 - - year - old winger joined sunderland from west bromwich albion in 2008 and agreed a new deal worth £1. 25 million. [SEP] calififas, calif. - - general motors co. on thursday released its first quarter and operating outlook, saying it is trying to salvage a long slump [SEP]
+
+===== sample 063 =====
+[CLS]urers. [SEP] the aircraft does not have the full - in crew to make it back to the airport. [SEP] "i've had a great season, i haven't had one in six months, so thank god," he said. [SEP] the american hit form earlier this year in melbourne, winning for the first time since 1999 and then edling through to the final of the tournament at indian wells in the final. [SEP] liverpool beat hernecht 1 - 0 in the uefa cup final and are expected to beat fourth - placed zenit st petersburg to move up by four points. [SEP] but from the start, the [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_temp_schedule_128steps_n64/const1p45_c1024_raw_samples.txt

@@ -0,0 +1,230 @@
+const1p45_c1024
+{
+  "type": "summary",
+  "name": "const1p45_c1024",
+  "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt",
+  "step": 168000,
+  "decode": {
+    "kind": "categorical_fullvocab_temp_schedule",
+    "config": "const1p45_c1024",
+    "steps": 128,
+    "model_t_mode": "post",
+    "support_power": 1.0,
+    "semantic_power": 1.0,
+    "temp_start": 1.45,
+    "temp_end": 1.45,
+    "temp_schedule": "const",
+    "concentration_min": 1.0,
+    "concentration_max": 1024.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 44.64688583445828,
+    "nll_per_token": 3.7987845587413815,
+    "tokens": 9790
+  },
+  "diversity": {
+    "sample_entropy": 4.190344770313543,
+    "unique_tokens": 1890,
+    "token_count": 8192,
+    "distinct_1": 0.230712890625,
+    "distinct_2": 0.6918061023622047,
+    "top_token_mass": 0.0584716796875
+  }
+}
+
+===== sample 000 =====
+[CLS] matches against manchester united and liverpool in their final final next season. [SEP] he started with a big losing streak at the start and found savvy trying to put himself in position. [SEP] and the inclusion of public employees in a private sector has dramatically eroded the constitutional right of privacy in new york city law since 1991. [SEP] on the job, she runs out of her job for only 10 days. [SEP] the red sox improved to 10 - 5 this year. [SEP] the group has members in canada, germany, canada, austria, sweden, norway, switzerland and the united kingdom, according to the iod. [SEP] the state is fighting [SEP]
+
+===== sample 001 =====
+[CLS] frento said. [SEP] last year ' s title in seven of eight riders were in second behind the wheel. [SEP] mr cameron said that children would not be taking enough drugs if they failed their own treatment in order to keep them informed about each particular possible course. [SEP] without releasing the true toll of u. s. troops, the military said sunday that of those killed had already 18 afghan civilians. [SEP] " it is a good thing we can do before it has to open up, " he said. [SEP] a source involved at the scene told the associated press requested anonymity and would not be named discussing the crime involved. [SEP]
+
+===== sample 002 =====
+[CLS] scotland ' s disappointment, they could not take control when celtic came back by scoring an equal point. [SEP] " mothers are much more likely to develop the disease, as the number of healthy children who deal with it is increasing at this rate, " the report says. [SEP] board members and mlas are facing a greater risk of losing seats around the country. [SEP] in afternoon trading, the dow jones industrial average fell 47. 00,, down 0. 34 percent, 10. 05. [SEP] williams and gerrard ' s team finish fifth, meaning they can qualify for the beginning of the year when the paris tournament is over. [SEP] [SEP]
+
+===== sample 003 =====
+[CLS] monday as americans tightened their views on the global economy. [SEP] third seed serena williams beat danish gretar mattek 7 - 6 7, 6 - 3, then lost one set and a third set game of the match. [SEP] it arrives at 1 : 22 : 15, dec. [SEP] on thursday in vancouver, the governor ' s spokesman rick smith said it was not clear whether there had been anything to do with the lawsuit. [SEP] " i don ' t know anything else. [SEP] john mccain ' s campaign has come to terms with this important issue in the polls ; that ' s unlikely to happen. [SEP] the biggest concern, though [SEP]
+
+===== sample 004 =====
+[CLS] ' s smoke away from the radio. [SEP] one car bomb killed three u. s. soldiers in iraq, and all were killed in the attack, which four people died. [SEP] london ( reuters ) - andy roddick ' s start with his wimbledon title on monday at swiss tennis turned out to be very unlikely. [SEP] sunderland ' s impressive run to a fourth in the two league cup games and the first win of their campaign for liverpool ' s premier league double title has begun with wayne rooney, who is expected to be sidelined at the start of christmas, and sir alex ferguson - - who may yet make a major start before [SEP]
+
+===== sample 005 =====
+[CLS], " he said. [SEP] liberal leader christian grubert is a leader of germany ' s conservative opposition liberal democratic party. [SEP] paris, april 20 ( upi ) - - the african nations didn ' t spell out any of the way of hosting the vote in africa ' s biggest muslim nation, officials said. [SEP] his brother was arrested by police in britain in 2004 and charged with murder, hours friday after a 19 - year - old woman was shot nine times in her apartment in a bar. [SEP] even today, they often remain behind the iconic towers of washington ' s former capital. [SEP] the broncos hope he can play sunday [SEP]
+
+===== sample 006 =====
+[CLS] ' s poor and higher - income students at the university. [SEP] the department ' s air division was expected to carry the ration today. [SEP] " i was shocked, " she told the associated press. [SEP] newark, n. j., aug - - novak djokovic lost the match to andy murray and sweden ' s robin soderling suffered a fourth - round defeat after rallying to snatch a 3 - 6 6 - 4 loss to novak djokovic. [SEP] djokovic ( 2 - 7 ) beat sam querrey 7 - 5 6 - 3, 6 - 3, 6 - 4, 6 - [SEP]
+
+===== sample 007 =====
+[CLS] 2002. [SEP] if we ' re rich enough, it is hard to think we can ' t do it, " general mozir ahmed, president of the national federal health protection agency, told reuters on tuesday. [SEP] in december 2002, lakeland was 90 miles north of pittsburgh, about 30 north of pittsburgh. [SEP] the lead was soon deserved, and lee struck the winner, hitting the near post with a header five minutes left before the interval, then was tied up by luke clark with a cross from given. [SEP] the road was was closed following a large amount of work. [SEP] yes, i know, it is time and [SEP]
+
+===== sample 008 =====
+[CLS]fina defeated radja rad of poland 7 - 5, 6 - 5, 7 - 5, 6 - 4, 7 - 5, 2 - 6 ( 6 - 7 ), 6 - 7, while second - seeded russian elena dementieva beat american shaha williams 4 - 6 to meet france ' s kim clijsters of belgium in the women ' s singles event. [SEP] 1 fight, " calzaghe said. [SEP] the number of people who have died is 2, 544 in the war, according to the u. s. defense ministry. [SEP] last month, the national union of [SEP]
+
+===== sample 009 =====
+[CLS] points, or 0. 06 percent, france ' s cac - 40 fell 1. 84, or 0. 01 percent, and france ' s cac - 40 fell 1. 50, or 0. 58 percent, to 3, 463. 88. [SEP] the panthers finish their season at least 0 - 11 with saturday night ' s regular - season games at florida at 10 p. m., and philadelphia. [SEP] by october, there had been 149 extra deaths of children in england and wales since wednesday, but this figure had to be confirmed wednesday, according to the latest figures. [SEP] that ' s not the point [SEP]
+
+===== sample 010 =====
+[CLS] - of - 14 shots in the second quarter. [SEP] " i think we do all our best to work so that there will be an end to the current downward situation, " bos said. [SEP] jurors were ordered held in richmond, virginia, on thursday. [SEP] the palestinians ended their five - week bombardment of gaza. [SEP] what ' s for the taliban? " my friend imad osamaq said, widening his eyes as the line ran out. [SEP] ba shares climbed 0. 25 per cent to 0. 40 per cent ( 6. 75p ) before closing 0. 6 per cent lower to 1. 20 [SEP]
+
+===== sample 011 =====
+[CLS], " obama ' s senior strategists said, and mccain ' s campaign is actually going only to peel away obama ' s likely popular appeal and help change the economy. [SEP] the event was free and manageable. [SEP] this, at least, began with the possibility that all the players could stay out for the first year of their contract. [SEP] melbourne ( reuters ) - the world number two, no. 10, and roger federer advanced into the first round of the marseilles open here on wednesday, but neither player claimed a double - chance just one minute later to lead 2 - 1. [SEP] the report also said the [SEP]
+
+===== sample 012 =====
+[CLS] at home on sunday and then failed to win. [SEP] the body of mr neale was found at about 1110 local on 7 march and found in the same area of the road in the early hours of the morning. [SEP] king juan ii, meanwhile, boosted the hopes of winning the men ' s title by 5 - 0 at the age of 62 on sunday. [SEP] tens of thousands of parents have begun a joint inquiry into the deaths of 502 children. [SEP] " i worry more about the economy, more about jobs, but i don ' t like race, " he said. [SEP] arsenal ' s pique albert riera [SEP]
+
+===== sample 013 =====
+[CLS] the edwards air force base, calif., has failed to take off for normal wednesday, the agency reported. [SEP] it ' s time to get into the old - fashioned minds. [SEP] est, six people remained wounded, according to nato military reports. [SEP] " we have a team that is prepared to take care of the players, prepared to come to us and to help us out. [SEP] but capello, who can use the european title from his six - year football career, has said it ' s going to be high - minded in his favour. [SEP] if it cannot meet the deadline to increase its investment to itv and [SEP]
+
+===== sample 014 =====
+[CLS] said. [SEP] the final decision would have been known for a third time, given the location of the original u. s. air force site. [SEP] he wasn ' t checked out after hearing about the incident by the authorities. [SEP] carmakers are paying more, too, because the government can produce their cars at a time when the economy is strong. [SEP] the outcome of this next general election is inevitable. [SEP] in the course of the recession, it was possible for western businesses to make more payments in the first hours of the cold month. [SEP] " we believe that we can make the necessary progress along the way, " he said [SEP]
+
+===== sample 015 =====
+[CLS] florida and halfway along the caribbean and eastern gulf. [SEP] since his death in 2002, he said he has been taking drugs, cutting her and grabbing a baby in his mouth, his back and putting on his head. [SEP] the dow slipped 13 points at 10, 642. [SEP] setback on sept. [SEP] now, he tells everyone, however, he ' s back. [SEP] in 2005, a senior science and policy analyst at the center for science and international studies center in washington said a clinton - friendly election is likely to tip the balance on the survival of a black leader in charge of the party. [SEP] for all middle - [SEP]
+
+===== sample 016 =====
+[CLS] war that killed roughly 1, 000 people there in early 2009. [SEP] " it is understandable that anyone responding to a robbery will be brought on to the police line at around 2200am. [SEP] but federer lost the first set on the 3 - 2 break. [SEP] in the early 1990s, abramovich said that he could face failure because he would be a player in chelsea ' s team. [SEP] a year before kennedy ' s death, some of the leading candidates came up against that and opened their careers. [SEP] mr grothey, a 21 - year - old from leech, wirrals, had agreed to [SEP]
+
+===== sample 017 =====
+[CLS] safe. [SEP] murray, who reached the quarter - final, fought his first return serve to take the hold on the game with the rest of the crowd. [SEP] the election was due before in july 2008. [SEP] " motorola, by contrast, is a huge and profitable way to buy phones and chips, " said leesen, the company ' s chairman. [SEP] last year, she had lost only one set in the previous three, while suffering from a back injury. [SEP] congressional officials had said the plan would be approved by the senate and the house and the senate and could be picked up in bringing more costs to the economy. [SEP] [SEP]
+
+===== sample 018 =====
+[CLS] national cancer institute. [SEP] with the disease rising, nearly thousands more are at risk of dying from the health effects of the new sw1 in europe. [SEP] he was probably good at taking the boat and not dangerous. [SEP] i still don ' t have it. [SEP] " i think it is time to move on, " he said. [SEP] according to data from the national institute of health and the uk in 2002, 294 people died in scotland. [SEP] they are optimistic that the number of displaced refugees will soon return. [SEP] the cardinals came to the fourth round, the title in the semifinals, and won it all in 2002, 2002 [SEP]
+
+===== sample 019 =====
+[CLS] alex ferguson believes that the pre - rested player would soon be able to finish with the second or better side of the new squad. [SEP] and in 1996, the democratic national committee announced the choice of senator john kerry days after the michigan primary, casting the party ' s nomination against a soon - to - be candidate to change the presidential race. [SEP] " we will win because we don ' t know our strategy, " mullen told u. s. president and secretary of state hillary clinton. [SEP] ( ap ) - michael vick was sacked with 10 seconds left to lead michigan state back, 4 - 1, but the unbeaten ho [SEP]
+
+===== sample 020 =====
+[CLS] he said. [SEP] but he won it on his own. [SEP] because they said, doing something would prove difficult, but not impossible. [SEP] but there is also uncertainty about the long - term changes in gordon brown ' s leadership and the economic results of the election. [SEP] it was the first quarterly loss since september 2008. [SEP] nothing looked immediately apparent and he could have had a penalty saved when he was caught by alan johnson in the 12th minute, although the striker almost earned a goal - kick against the norwegians. [SEP] " i do not understand how, if i was sitting in your car i could have done something else out of [SEP]
+
+===== sample 021 =====
+[CLS] 2005. [SEP] oceaneere ' s security officials were unable to disclose the details of their fight with the pirates, who held the ship on wednesday night. [SEP] novak novak djokovic lost his fourth straight australian open final final, but today ' s 6 - 2 victory ended exactly what had been expected. [SEP] the attack, involving nearly 20 afghan soldiers, resulted in a mass evacuation of troops in two checkpoints elsewhere in the air district. [SEP] new york ( reuters ) - no. 1 seed shara williams has won the itf women ' s second event in two weeks, the women ' s tennis tournament on sunday, defeating american [SEP]
+
+===== sample 022 =====
+[CLS] concerns over mortgage risks. [SEP] i think about being a boy and he ' s trying to make sure that he ' s healthy, he doesn ' t want to do so. [SEP] but john prosser, 35, says he ' ll know what his ability to do after his job is likely to end. [SEP] a new study is being carried out by scientists. [SEP] it is much less a nightmare. [SEP] even so, of course, the result will be an inevitable result, not upset. [SEP] she declined to comment on the nature of the questions, citing schiller ' s former rep. [SEP] then came the end of the [SEP]
+
+===== sample 023 =====
+[CLS] [SEP] renault and toyota have already been locked in three race wars, which ended in 2009, leaving them only seven points in the german - american standings. [SEP] the latest attack came just days after u. s. - led forces fighting for al - qaida launched a series of suicide bombings in north - west waziristan region north of baghdad, killing at least 20 people. [SEP] she had reached third and ranked 30th before losing on 10 of the first 13 games, but henin fell short with another set of double - break points in the second set to win 4 - 1, 2 - 2. [SEP] this week, [SEP]
+
+===== sample 024 =====
+[CLS] said he didn ' t know exactly when it was written, or the fact it would have happened. [SEP] washington - - barack obama ' s political and military party is holding talks over whether to open negotiations for a new comprehensive peace deal. [SEP] the head of the tamil tigers went on a flight to india late saturday amid reports of a terrorist threat in the region, the government said. [SEP] he had a similar view about the rest of his class. [SEP] on the edge of the rugged valley, they look at the location of the fire - - and where it was taking place. [SEP] she ' s currently in charge of the international olympic [SEP]
+
+===== sample 025 =====
+[CLS] more likely parents, pension workers and their families to lose more care of their young children and end up in dire straits. [SEP] if that ' s the case, we ' ll get our point. [SEP] " it ' s a part of that, " she said. [SEP] " you see, i can ' t be here. [SEP] at this point, it ' s " unrescusable, " about 2. 2 seconds off a fast pace before some passengers said they could go back to the air in the morning. [SEP] a nice feel with a white, wooded valley, a good sight to the hotel and a strong sense that [SEP]
+
+===== sample 026 =====
+[CLS] majority in two weeks, in an election that could have left him in the race for the current presidency. [SEP] it was pretty gut - wrenching. [SEP] i ' m very sorry, i was very happy, " he said. [SEP] obama ' s isn ' t going anywhere. [SEP] he defeated the st. louis cardinals 2 - 0 and lost three in seven innings to earn a first - round bye. [SEP] it has a network of 17 branches in london, london, yorkshire, north yorkshire, birmingham, blackpool, lancashire, derbyshire, hertfordshire, south yorkshire and doncaster. [SEP] more than 16, 000 people were killed and more than [SEP]
+
+===== sample 027 =====
+[CLS] on the night. [SEP] rachida ouldinu, 30, has been charged with attempted murder on 18 june. [SEP] the majority of economists don ' t believe this is a big part of a plan that will be available to americans at all income levels. [SEP] with the year and winter olympics due to end, warm weather in britain coming between mid - march and december could produce more snow this week. [SEP] marin cilic, the us open champion, had six points in the opening set, 4 - 5, and in the second it was set for a tie. [SEP] texas, which has finished more than 40 - 0 [SEP]
+
+===== sample 028 =====
+[CLS] second race, a neck down to his last time, seems to be winning. [SEP] but six days later, the former left - right winger came into government. [SEP] england reached 170 for five with nine wickets by paceer andrew flintoff and pace opener ricky ponting, while clarke has claimed a test wicket with the reserve side shortly after completing his debut from durham. [SEP] he warned not to take the risk. [SEP] new york opened its regular season with six wins in eight straight overall and seventh - worst in the east in its history.... [SEP] this year ' s open champion safina of russia was able to make [SEP]
+
+===== sample 029 =====
+[CLS] year - old son in the northern region. [SEP] also thursday, health ministry official sarhad khan said the local council said 60 were killed, including one soldier were wounded in the fighting. [SEP] for example, the defense department ' s survey of strategic public agents and its personal computer systems students may affect their federal income. [SEP] the meeting included 16 members of the national organising committee, including kasab ghabar, the president of the organising committee, earlier in the month. [SEP] while the dow jones index is below 100 percent, the s & p was trading 0. 4 percent lower at 12, 930. 00. [SEP] he [SEP]
+
+===== sample 030 =====
+[CLS] 2004, when she broke the same mark for the first time since the ban after being a woman. [SEP] there were some questions about it. [SEP] the information security commission just disclosed that it was receiving 500 claims by members of the public, claiming the firm has received a maximum of £37, 642 from labour clients. [SEP] he was taken to hospital, police said, adding reports later in the condition were stable. [SEP] the report was written in a journal by matthew dowd, an expert on the state peace program at the korea institute. [SEP] the north ' s military had heard reports of the firing by georgian troops at the time [SEP]
+
+===== sample 031 =====
+[CLS] muhammad ' s lawyer son muhammad jr. declined to press the sentence. [SEP] manchester united manager sir david james has admitted he has helped the 30 - year - old england midfielder make his first start at the club. [SEP] " i think that when he puts up the challenge in the history of the game, i don ' t see the reality now, " he told cbs news. [SEP] " this is a very exciting result, " he said. [SEP] " it was something very unhirl. " [SEP] and as a result, it ' s easy to say to me, " we have lost the chance of achieving it. " [SEP] [SEP]
+
+===== sample 032 =====
+[CLS] family ' s home along the desaie river on sept. [SEP] it seems to have no further information on the outcome of the debate, it does, however, depend on the validity of what he thinks and what the media thinks in the light of what this might mean to him today. [SEP] they had to try to make the term " nonpartisan " by getting involved in politics. [SEP] " we ' ve had the talking with the celtic manager before, but we had a very rough time people were trying to get over what was happening for us, " he said. [SEP] the ruling comes the day after a second review of international [SEP]
+
+===== sample 033 =====
+[CLS]. [SEP] former rangers striker thomas mccarthy hopes to improve coach joe young ' s side. [SEP] official results have yet to be released. [SEP] after mr. smith died last year, mr. van der veer ' s life changed dramatically. [SEP] 31, 2005, he died at 9 a. m. [SEP] he, from a three - month break, held the lead of his sixth open rematch, with roger federer, before beating his friend novak djokovic at the 2005 french open. [SEP] at this stage, it isn ' t clear if the person died from the injuries. [SEP] most of those lived in the secure area of baghdad [SEP]
+
+===== sample 034 =====
+[CLS] through. [SEP] new york at new england, 4 p. m. [SEP] but then, if the effort is successful, fincher would have decided to get that far. [SEP] one of the two largest shareholders of us media said 21 police officers would be fired and 200 more would be filled by the second quarter of 2010. [SEP] they said the fed and treasury are also responsible for raising standards for mortgage regulators and brokers to better understand the credit - rating system at the expense of many borrowers. [SEP] he is living in a family ' s house and works in the small city of kashal in the north - central province. [SEP]
+
+===== sample 035 =====
+[CLS] just scored the last of their goals. [SEP] according to the nature of the case, no decision was given to police for the release of a bail report on his death. [SEP] while the unrepared experts know there is some reason to go out on it, experts say they can get a break with their public health. [SEP] he was elected america ' s elected president for the first time in 1999, and ran for the presidency for up to a year. [SEP] " nobody comes here to play more than a champion, it ' s possible, " he said. [SEP] what should not happen to universal health care is the cost and [SEP]
+
+===== sample 036 =====
+[CLS] democrats expected ahead of tuesday night ' s election could help push gop sen. john mccain and republicans to keep control. [SEP] a bomb has also struck off at the queen ' s university and the queen ' s college in birmingham, killing more than 100 members of staff and students. [SEP] the americans were fourth in the women ' s singles, while china lost a fourth in the women ' s and the men ' s doubles. [SEP] he is a professor of sociology at the university of southern california and has written five medical books since his death from 2001 until august 2007. [SEP] henin was won in 2002 only five times in a season [SEP]
+
+===== sample 037 =====
+[CLS]. [SEP] the results of the original study, published in a 12 - month public online issue of the journal of psychology, asked college - age consumers about the health benefits of personalised planning for families and a personalised lifestyle. [SEP] thai soldiers attacked rumwindi army garrison, 40 km south, near the city of mohalin, in the early early hours of the morning, the officials said. [SEP] grossman signed a four - year contract with the seahawks until next season. [SEP] tebow has thrown for 272 yards and four touchdowns. [SEP] in 2003, they won five first - class games, made it six finals before losing [SEP]
+
+===== sample 038 =====
+[CLS] along the banks of the river. [SEP] but he should know that. [SEP] i ' m skeptical that senator clinton, who is a senator, can be staying on the edge. [SEP] only a group of professional curators can get a complete history of a classic subject. [SEP] though, the operation won ' t take much long. [SEP] he made his own personal mistake, sending home an e - mail message to his children ' s account as his mother threatened him over a telephone and refused to speak again. [SEP] it has claimed that the film will be screened this year. [SEP] in the south, the city of iraq ' s northern third [SEP]
+
+===== sample 039 =====
+[CLS] at the university of british columbia. [SEP] the 29 - year - old haurov made a surprise announcement this week about his status as a rider on his way to the title, which gave him the chance to change his form in friday ' s final race. [SEP] " we have been looking at the chances that the ice would pick up in the early stages of the last five years, " said an ice official, who anonymously declined to speak to media focused on the research. [SEP] several women in britain have said they were losing concern for the safety of their lives as a result of debile disease. [SEP] washington ( ap [SEP]
+
+===== sample 040 =====
+[CLS] - 3 and american mardy fish of the netherlands defeated american richard haas 3 - 6 7 - 6 6 - 3. [SEP] even before mr brown ' s departure announcement that the soldiers would face a reshuffle of military operations, the government privately held out the future of some troops. [SEP] u. s. markets rose in april ahead of tuesday, but the first week of march trading ended at 10 yen, when they will be trading on the new york stock exchange. [SEP] the australian open champion was lost at a similar event in 2007, when serbian novak djokovic and david haas lost at the five - french open. [SEP] [SEP]
+
+===== sample 041 =====
+[CLS] an $ 8, 500 credit for child support. [SEP] the flight time means passengers need just five or seven minutes before time to get home to board the next flight. [SEP] " it seems to me that there is a huge market environment in mexico. [SEP] david moyes will not try to finish this big way as he has made sure of his return for liverpool winning the champions league this year. [SEP] women who are relatively out of work are significantly more likely when they leave their 11 - year - olds with more education in the uk, and are at risk of losing their two children and losing their daughter when they have brought enough money to [SEP]
+
+===== sample 042 =====
+[CLS] more likely to monitor their health, the researchers said. [SEP] he was also convicted in november of five counts of attempted sexual assault in the mersey crown court. [SEP] it is the most popular group, a group made up of 24 americans, and 14 pakistanis and the american captain. [SEP] with safin winning the match, williams will face serena williams and possibly the likes of dinara safina, dinara safina, rafael nadal and novak djokovic, who also beat dinara safina on match - point at 2 - 2pm. [SEP] what a bunch of whine ' s. [SEP] it [SEP]
+
+===== sample 043 =====
+[CLS] underpaid. [SEP] with the global recession biting costs, consumers are slashing their own businesses. [SEP] the four defendants were declared not guilty and brought to the government. [SEP] but health officials have stayed away from the debate. [SEP] keane ' s opening goal helped liverpool regain the lead at the break but could not equalise as the portuguese striker returned midway through the second after a powerful effort from david hamel was followed by a superb shot from right - back that sent the goal wide. [SEP] at the other end of a spectrum, you start with a lot of turmoil. [SEP] labour ' s overall performance early today was hit by a [SEP]
+
+===== sample 044 =====
+[CLS] [SEP] among non - retired workers, this was 43 % less - but about 40 % higher - than at the start of 2005. [SEP] but clinton and her staff say they are confident in sparing the money that needs to go from clinton to obama. [SEP] but he was not guilty. [SEP] the man has been taken to an area hospital. [SEP] the german, a five - time open champion, eliminated venus williams, who completed her first run in 2004 and 2007, defeated elena dementieva in the french - french french open final and she was eliminated in the fourth round of the following year. [SEP] the company said it expects [SEP]
+
+===== sample 045 =====
+[CLS] but had now come through the match, and with the loss of one goal they would not know what to do. [SEP] yet this thing was rather good, i thought. [SEP] ivanovic bounced back to win twice in the first women ' s singles match against an ethiopian opponent in each of the previous 10 years. [SEP] it seems like his best strategy. [SEP] i didn ' t know how my husband left. [SEP] some said more than one - third customers, at $ 10, 000, are at least asked to spend their money to save themselves, earning 1, 000 - dollar bonus points. [SEP] i have to focus on the brand [SEP]
+
+===== sample 046 =====
+[CLS] in south waziristan, pakistan ' s main province to the north - west border, the taliban killed a soldier and a belgian - born son in a car bombing on saturday in afghanistan ' s northwest of peshawar, killing american and un troops. [SEP] a friend who identified his friend as washington rep. andrew janis, declined to speak further from the post early tuesday. [SEP] i wonder if there is something, but if we ' re still here, it ' s no longer possible, we ' re going to tell him everything, and they ' re just going to go. [SEP] " i just didn ' t be as easy [SEP]
+
+===== sample 047 =====
+[CLS], according to john o ' brennan, the president ' s national security adviser. [SEP] " i ' ve lost the way out now, " the new york senator said, according to the results. [SEP] it looked as though england had regained the first - half lead in the 27th minute but gera broke his serve to claim his second goal of the night when his counter - attack produced just the second chance to pull a goal away after four minutes. [SEP] woods suffered the sharpest stroke of his career, a playoff defeat at golf ' s world golf classic in sydney on nov. [SEP] penn state, n. y., march 3 [SEP]
+
+===== sample 048 =====
+[CLS] a lead on his second drive that ended with a field goal early in the second half. [SEP] very good, " said a spokeswoman for the british association. [SEP] the packers also scored three times in the second half against 7 - foot - 5 23 - year safety ryan ga grounder, who took advantage of a late interception late in the second quarter and will miss saturday ' s game. [SEP] the board has had a long way of convening questions about the fda ' s handling of the drug probe, especially when it failed to adequately answer any question about mr. martin ' s independent background. [SEP] during the time the [SEP]
+
+===== sample 049 =====
+[CLS] a low - income income topping 50 %. [SEP] the unite union represents around 9, 000 members of a total of 2, 500 ba staff and passengers outside their belts. [SEP] if you have a higher amount of pension coverage by retirement, the number of hours to work at your employer actually decreases to account for the loss of work, factoring the outcome of work. [SEP] boston ( ap ) - it ' s the first time he ' s been eliminated in the third round. [SEP] the department of health said yesterday that ministers had agreed to consider the impact of adding extra young people to new guidelines for mental health services. [SEP] the company [SEP]
+
+===== sample 050 =====
+[CLS] requires more exercise, perhaps even less sleep. [SEP] " i think that when we ' re running, it ' s likely we think that will set the goal for it, " the official said. [SEP] robert st. michael greini of bloomington, mo., was second in 1 : 09. 97, 39. 88, respectively, and john lasse 1 : 05. 50. 65, second in 42. 93, 088 : 19. 80 ). [SEP] i said " he won ' t change the word. " [SEP] michael icahn, former managing director of international asset management at morgan stanley, which runs [SEP]
+
+===== sample 051 =====
+[CLS] within a decade. [SEP] the most publicized case this year was reported in 1975. [SEP] " but it ' s a joke. [SEP] and it won ' t matter what you might turn out for. [SEP] and, yes, it is very scary. [SEP] and that ' s why it ' s so difficult and so important. [SEP] the ap news agency said that the public search for the body was in its early stages. [SEP] all three board members were removed. [SEP] in another round, former world no. 1 davydenko also defeated french eighth seed tommy haase 6 - 3, 4 - 6, 7 - 7, 6 - [SEP]
+
+===== sample 052 =====
+[CLS]. [SEP] ten per cent of the population from 2000 - 08 died in england and in 2001 some 8. 7 per cent. [SEP] the irish lost 12 straight since falling out of the tournament in 2005. [SEP] the book ' s authors have already published a comprehensive study at the end of the disease assessing survivors more clinically, under stressing the potential for their lives. [SEP] among the first group who died, a 15 % reduction in the impact of the disease reduced nervousness. [SEP] madrid ( reuters ) - a spanish high court on saturday ordered the trial of a woman wanted in the death of a journalist killed in madrid. [SEP] three [SEP]
+
+===== sample 053 =====
+[CLS] season, he took on the show as a rookie in early 2006. [SEP] she studied theology at cambridge, then moved to the netherlands in france, france and then germany. [SEP] kabul ( reuters ) - a u. s. military coalition killed in a bomb attack on the main city of kabul, afghanistan, had detained more than 50 militants while assaulting nato air force units, a nato official said thursday. [SEP] the loss won for the third straight after losing all 10 of 16 games. [SEP] the founder of the popular internet web site lisa jones, who had lost her younger daughter, miss smith, died thursday, shortly after losing her [SEP]
+
+===== sample 054 =====
+[CLS] 400 million of the season will end up at home as well as the oscars. [SEP] the conservatives lost the conservative government in this year ' s general election and are hoping to form a new coalition in 2010. [SEP] there ' s no real truth. [SEP] people should get it. [SEP] the bus was ordered to pass into the bridgend area at about 2000 gmt on saturday, police said. [SEP] the poll was found that 20 % were very optimistic. [SEP] " the blood came in top of his head and he lost his hand. [SEP] he resumed his candidacy to a second term last month with a loss in the polls in the [SEP]
+
+===== sample 055 =====
+[CLS] on wall street. [SEP] and those who can decide whether you want to make the people feel responsible for what ' s going to happen just as a response to the moment of truth. [SEP] china ' s foreign ministry was not immediately available saturday. [SEP] the national register reported the deaths and deaths just five days after last year ' s round of earthquakes in california ' s san bernardino county, in the first week of march 2005. [SEP] the same unhappy, three - year daughter was nearly raped by her boyfriend in paris and held back by the loss of my mother ' s marriage. [SEP] " the international community got its due out in 2000 and [SEP]
+
+===== sample 056 =====
+[CLS] on the line. [SEP] and if one can be sure that it would not take a long break anyway, one only has the feeling that it could take a long to make. [SEP] " he asked me if i wanted to stay i realised there was nothing, " he said. [SEP] but then that ' s what i think about and trying to understand, they are a big story. [SEP] federer, 7 - 2, who lost to djokovic in the first round, now has lost eight of 14, including the defending champion federer, who then lost out at the french open, the last time in 2004. [SEP] she played at [SEP]
+
+===== sample 057 =====
+[CLS]khazia province in south ossetia province, the official news agency reported. [SEP] the who also urged state health authorities when assessing whether a flu vaccine needed to be available. [SEP] montreal ( reuters ) - the cy young champions earned their fourth win in five games to lead the philadelphia flyers team to a 2 - 0 victory over pittsburgh pirates on tuesday. [SEP] some were killed in the region early last year when taliban missiles hit a british vessel, but some more are handed over to afghanistan, the ministry of defence said. [SEP] but no one might be upset by the cia ' s recent attempt to protect its long - earned reputation with a [SEP]
+
+===== sample 058 =====
+[CLS] 30 miles ) south of the nation ' s northern border. [SEP] " while it is possible that some other forms of the disease could be cured through the cultural changes, as well as it difficult to think about it, " musser said. [SEP] albany n. y., sept. [SEP] the young man... [SEP] " if we do this, we will then get it back on our hands, " she told reuters, who was born by her grandparents in the central valley of north lalande province, where her father ' s home was. [SEP] the u. s. circuit court of appeals, the division of federal [SEP]
+
+===== sample 059 =====
+[CLS] a local official in the northwestern province of nangarhar. [SEP] " by the end of 2008, we had been convinced that the majority of the people involved were very confident that they will happen, " he said. [SEP] but it is also very difficult to handle. [SEP] they were not hospitalised, and a judge said their condition was " excellent. " [SEP] the taliban in kabul, afghanistan, killed 11, 000 women after the u. s. army began combating militants sept. [SEP] meanwhile, serbian champion djokovic, who was losing one of three games with a virus, lost 3 - 0 in the second to clinch [SEP]
+
+===== sample 060 =====
+[CLS] 2008. [SEP] the main draw, third, second seed roddick and the other champion, andy roddick, was second and seventh. [SEP] thousands of candidates would be eligible to run in the republican primary in the 2008 presidential election, and go to the superdelegates for a popular vote. [SEP] madrid ( reuters ) - the french open took the first and second seeds on tuesday, and the fourth - seeded serbian rallied past samantha stosur 3 - 6 6 - 1 6 - 4, 6 - 0 6 - 4 win in two hours, 53 minutes. [SEP] the woman, who was taken to the hospital, was treated [SEP]
+
+===== sample 061 =====
+[CLS] upsetting the economy. [SEP] marseille ' s jean - claude g canale beat marseille ' s sami betoneri for a penalty, leaving substitute christoph metzler injured. [SEP] the military officials said last week that the offensive has resulted in 1, 500 deaths of afghan militants over the past two weeks. [SEP] the changes have been widely anticipated, with a relatively small and large effect in the population leading to a bigger increase in incomes. [SEP] he had fired two of four rounds and shot a 5 - under 66 to take the lead. [SEP] the study was conducted by the group ' s global survey. [SEP] the report was carried by the [SEP]
+
+===== sample 062 =====
+[CLS] under the terms of the deal. [SEP] the results should come from a severe version of the current virus in the united states and it could trigger a slowdown of the situation in the rest of asia, health experts said. [SEP] the result is an exhaust of history, a fascinating series of conversations and analyses. [SEP] in january, the 26 - - year - old winger joined sunderland from west bromwich albion in 2008 and agreed a new deal worth £1. 25 million. [SEP] calififas, calif. - - general motors co. on thursday released its first quarter and operating outlook, saying it is trying to salvage a long slump [SEP]
+
+===== sample 063 =====
+[CLS]urers. [SEP] the aircraft does not have the full - in crew to make it back to the airport. [SEP] " i ' ve had a great season, i haven ' t had one in six months, so thank god, " he said. [SEP] the american hit form earlier this year in melbourne, winning for the first time since 1999 and then edling through to the final of the tournament at indian wells in the final. [SEP] liverpool beat hernecht 1 - 0 in the uefa cup final and are expected to beat fourth - placed zenit st petersburg to move up by four points. [SEP] but from the start, the [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_temp_schedule_128steps_n64/const1p45_c1024_scored.jsonl

@@ -0,0 +1,65 @@
+{"type": "summary", "name": "const1p45_c1024", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 168000, "decode": {"kind": "categorical_fullvocab_temp_schedule", "config": "const1p45_c1024", "steps": 128, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "temp_start": 1.45, "temp_end": 1.45, "temp_schedule": "const", "concentration_min": 1.0, "concentration_max": 1024.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 44.64688583445828, "nll_per_token": 3.7987845587413815, "tokens": 9790}, "diversity": {"sample_entropy": 4.190344770313543, "unique_tokens": 1890, "token_count": 8192, "distinct_1": 0.230712890625, "distinct_2": 0.6918061023622047, "top_token_mass": 0.0584716796875}}
+{"type": "sample", "index": 0, "raw_text": "[CLS] matches against manchester united and liverpool in their final final next season. [SEP] he started with a big losing streak at the start and found savvy trying to put himself in position. [SEP] and the inclusion of public employees in a private sector has dramatically eroded the constitutional right of privacy in new york city law since 1991. [SEP] on the job, she runs out of her job for only 10 days. [SEP] the red sox improved to 10 - 5 this year. [SEP] the group has members in canada, germany, canada, austria, sweden, norway, switzerland and the united kingdom, according to the iod. [SEP] the state is fighting [SEP]", "detok_text": "[CLS] matches against manchester united and liverpool in their final final next season. [SEP] he started with a big losing streak at the start and found savvy trying to put himself in position. [SEP] and the inclusion of public employees in a private sector has dramatically eroded the constitutional right of privacy in new york city law since 1991. [SEP] on the job, she runs out of her job for only 10 days. [SEP] the red sox improved to 10 - 5 this year. [SEP] the group has members in canada, germany, canada, austria, sweden, norway, switzerland and the united kingdom, according to the iod. [SEP] the state is fighting [SEP]"}
+{"type": "sample", "index": 1, "raw_text": "[CLS] frento said. [SEP] last year ' s title in seven of eight riders were in second behind the wheel. [SEP] mr cameron said that children would not be taking enough drugs if they failed their own treatment in order to keep them informed about each particular possible course. [SEP] without releasing the true toll of u. s. troops, the military said sunday that of those killed had already 18 afghan civilians. [SEP] \" it is a good thing we can do before it has to open up, \" he said. [SEP] a source involved at the scene told the associated press requested anonymity and would not be named discussing the crime involved. [SEP]", "detok_text": "[CLS] frento said. [SEP] last year's title in seven of eight riders were in second behind the wheel. [SEP] mr cameron said that children would not be taking enough drugs if they failed their own treatment in order to keep them informed about each particular possible course. [SEP] without releasing the true toll of u. s. troops, the military said sunday that of those killed had already 18 afghan civilians. [SEP] \"it is a good thing we can do before it has to open up,\" he said. [SEP] a source involved at the scene told the associated press requested anonymity and would not be named discussing the crime involved. [SEP]"}
+{"type": "sample", "index": 2, "raw_text": "[CLS] scotland ' s disappointment, they could not take control when celtic came back by scoring an equal point. [SEP] \" mothers are much more likely to develop the disease, as the number of healthy children who deal with it is increasing at this rate, \" the report says. [SEP] board members and mlas are facing a greater risk of losing seats around the country. [SEP] in afternoon trading, the dow jones industrial average fell 47. 00,, down 0. 34 percent, 10. 05. [SEP] williams and gerrard ' s team finish fifth, meaning they can qualify for the beginning of the year when the paris tournament is over. [SEP] [SEP]", "detok_text": "[CLS] scotland's disappointment, they could not take control when celtic came back by scoring an equal point. [SEP] \"mothers are much more likely to develop the disease, as the number of healthy children who deal with it is increasing at this rate,\" the report says. [SEP] board members and mlas are facing a greater risk of losing seats around the country. [SEP] in afternoon trading, the dow jones industrial average fell 47. 00,, down 0. 34 percent, 10. 05. [SEP] williams and gerrard's team finish fifth, meaning they can qualify for the beginning of the year when the paris tournament is over. [SEP] [SEP]"}
+{"type": "sample", "index": 3, "raw_text": "[CLS] monday as americans tightened their views on the global economy. [SEP] third seed serena williams beat danish gretar mattek 7 - 6 7, 6 - 3, then lost one set and a third set game of the match. [SEP] it arrives at 1 : 22 : 15, dec. [SEP] on thursday in vancouver, the governor ' s spokesman rick smith said it was not clear whether there had been anything to do with the lawsuit. [SEP] \" i don ' t know anything else. [SEP] john mccain ' s campaign has come to terms with this important issue in the polls ; that ' s unlikely to happen. [SEP] the biggest concern, though [SEP]", "detok_text": "[CLS] monday as americans tightened their views on the global economy. [SEP] third seed serena williams beat danish gretar mattek 7 - 6 7, 6 - 3, then lost one set and a third set game of the match. [SEP] it arrives at 1: 22: 15, dec. [SEP] on thursday in vancouver, the governor's spokesman rick smith said it was not clear whether there had been anything to do with the lawsuit. [SEP] \" i don't know anything else. [SEP] john mccain's campaign has come to terms with this important issue in the polls; that's unlikely to happen. [SEP] the biggest concern, though [SEP]"}
+{"type": "sample", "index": 4, "raw_text": "[CLS] ' s smoke away from the radio. [SEP] one car bomb killed three u. s. soldiers in iraq, and all were killed in the attack, which four people died. [SEP] london ( reuters ) - andy roddick ' s start with his wimbledon title on monday at swiss tennis turned out to be very unlikely. [SEP] sunderland ' s impressive run to a fourth in the two league cup games and the first win of their campaign for liverpool ' s premier league double title has begun with wayne rooney, who is expected to be sidelined at the start of christmas, and sir alex ferguson - - who may yet make a major start before [SEP]", "detok_text": "[CLS]'s smoke away from the radio. [SEP] one car bomb killed three u. s. soldiers in iraq, and all were killed in the attack, which four people died. [SEP] london (reuters) - andy roddick's start with his wimbledon title on monday at swiss tennis turned out to be very unlikely. [SEP] sunderland's impressive run to a fourth in the two league cup games and the first win of their campaign for liverpool's premier league double title has begun with wayne rooney, who is expected to be sidelined at the start of christmas, and sir alex ferguson - - who may yet make a major start before [SEP]"}
+{"type": "sample", "index": 5, "raw_text": "[CLS], \" he said. [SEP] liberal leader christian grubert is a leader of germany ' s conservative opposition liberal democratic party. [SEP] paris, april 20 ( upi ) - - the african nations didn ' t spell out any of the way of hosting the vote in africa ' s biggest muslim nation, officials said. [SEP] his brother was arrested by police in britain in 2004 and charged with murder, hours friday after a 19 - year - old woman was shot nine times in her apartment in a bar. [SEP] even today, they often remain behind the iconic towers of washington ' s former capital. [SEP] the broncos hope he can play sunday [SEP]", "detok_text": "[CLS], \" he said. [SEP] liberal leader christian grubert is a leader of germany's conservative opposition liberal democratic party. [SEP] paris, april 20 (upi) - - the african nations didn't spell out any of the way of hosting the vote in africa's biggest muslim nation, officials said. [SEP] his brother was arrested by police in britain in 2004 and charged with murder, hours friday after a 19 - year - old woman was shot nine times in her apartment in a bar. [SEP] even today, they often remain behind the iconic towers of washington's former capital. [SEP] the broncos hope he can play sunday [SEP]"}
+{"type": "sample", "index": 6, "raw_text": "[CLS] ' s poor and higher - income students at the university. [SEP] the department ' s air division was expected to carry the ration today. [SEP] \" i was shocked, \" she told the associated press. [SEP] newark, n. j., aug - - novak djokovic lost the match to andy murray and sweden ' s robin soderling suffered a fourth - round defeat after rallying to snatch a 3 - 6 6 - 4 loss to novak djokovic. [SEP] djokovic ( 2 - 7 ) beat sam querrey 7 - 5 6 - 3, 6 - 3, 6 - 4, 6 - [SEP]", "detok_text": "[CLS]'s poor and higher - income students at the university. [SEP] the department's air division was expected to carry the ration today. [SEP] \"i was shocked,\" she told the associated press. [SEP] newark, n. j., aug - - novak djokovic lost the match to andy murray and sweden's robin soderling suffered a fourth - round defeat after rallying to snatch a 3 - 6 6 - 4 loss to novak djokovic. [SEP] djokovic (2 - 7) beat sam querrey 7 - 5 6 - 3, 6 - 3, 6 - 4, 6 - [SEP]"}
+{"type": "sample", "index": 7, "raw_text": "[CLS] 2002. [SEP] if we ' re rich enough, it is hard to think we can ' t do it, \" general mozir ahmed, president of the national federal health protection agency, told reuters on tuesday. [SEP] in december 2002, lakeland was 90 miles north of pittsburgh, about 30 north of pittsburgh. [SEP] the lead was soon deserved, and lee struck the winner, hitting the near post with a header five minutes left before the interval, then was tied up by luke clark with a cross from given. [SEP] the road was was closed following a large amount of work. [SEP] yes, i know, it is time and [SEP]", "detok_text": "[CLS] 2002. [SEP] if we're rich enough, it is hard to think we can't do it, \" general mozir ahmed, president of the national federal health protection agency, told reuters on tuesday. [SEP] in december 2002, lakeland was 90 miles north of pittsburgh, about 30 north of pittsburgh. [SEP] the lead was soon deserved, and lee struck the winner, hitting the near post with a header five minutes left before the interval, then was tied up by luke clark with a cross from given. [SEP] the road was was closed following a large amount of work. [SEP] yes, i know, it is time and [SEP]"}
+{"type": "sample", "index": 8, "raw_text": "[CLS]fina defeated radja rad of poland 7 - 5, 6 - 5, 7 - 5, 6 - 4, 7 - 5, 2 - 6 ( 6 - 7 ), 6 - 7, while second - seeded russian elena dementieva beat american shaha williams 4 - 6 to meet france ' s kim clijsters of belgium in the women ' s singles event. [SEP] 1 fight, \" calzaghe said. [SEP] the number of people who have died is 2, 544 in the war, according to the u. s. defense ministry. [SEP] last month, the national union of [SEP]", "detok_text": "[CLS]fina defeated radja rad of poland 7 - 5, 6 - 5, 7 - 5, 6 - 4, 7 - 5, 2 - 6 (6 - 7), 6 - 7, while second - seeded russian elena dementieva beat american shaha williams 4 - 6 to meet france's kim clijsters of belgium in the women's singles event. [SEP] 1 fight, \" calzaghe said. [SEP] the number of people who have died is 2, 544 in the war, according to the u. s. defense ministry. [SEP] last month, the national union of [SEP]"}
+{"type": "sample", "index": 9, "raw_text": "[CLS] points, or 0. 06 percent, france ' s cac - 40 fell 1. 84, or 0. 01 percent, and france ' s cac - 40 fell 1. 50, or 0. 58 percent, to 3, 463. 88. [SEP] the panthers finish their season at least 0 - 11 with saturday night ' s regular - season games at florida at 10 p. m., and philadelphia. [SEP] by october, there had been 149 extra deaths of children in england and wales since wednesday, but this figure had to be confirmed wednesday, according to the latest figures. [SEP] that ' s not the point [SEP]", "detok_text": "[CLS] points, or 0. 06 percent, france's cac - 40 fell 1. 84, or 0. 01 percent, and france's cac - 40 fell 1. 50, or 0. 58 percent, to 3, 463. 88. [SEP] the panthers finish their season at least 0 - 11 with saturday night's regular - season games at florida at 10 p. m., and philadelphia. [SEP] by october, there had been 149 extra deaths of children in england and wales since wednesday, but this figure had to be confirmed wednesday, according to the latest figures. [SEP] that's not the point [SEP]"}
+{"type": "sample", "index": 10, "raw_text": "[CLS] - of - 14 shots in the second quarter. [SEP] \" i think we do all our best to work so that there will be an end to the current downward situation, \" bos said. [SEP] jurors were ordered held in richmond, virginia, on thursday. [SEP] the palestinians ended their five - week bombardment of gaza. [SEP] what ' s for the taliban? \" my friend imad osamaq said, widening his eyes as the line ran out. [SEP] ba shares climbed 0. 25 per cent to 0. 40 per cent ( 6. 75p ) before closing 0. 6 per cent lower to 1. 20 [SEP]", "detok_text": "[CLS] - of - 14 shots in the second quarter. [SEP] \"i think we do all our best to work so that there will be an end to the current downward situation,\" bos said. [SEP] jurors were ordered held in richmond, virginia, on thursday. [SEP] the palestinians ended their five - week bombardment of gaza. [SEP] what's for the taliban? \" my friend imad osamaq said, widening his eyes as the line ran out. [SEP] ba shares climbed 0. 25 per cent to 0. 40 per cent (6. 75p) before closing 0. 6 per cent lower to 1. 20 [SEP]"}
+{"type": "sample", "index": 11, "raw_text": "[CLS], \" obama ' s senior strategists said, and mccain ' s campaign is actually going only to peel away obama ' s likely popular appeal and help change the economy. [SEP] the event was free and manageable. [SEP] this, at least, began with the possibility that all the players could stay out for the first year of their contract. [SEP] melbourne ( reuters ) - the world number two, no. 10, and roger federer advanced into the first round of the marseilles open here on wednesday, but neither player claimed a double - chance just one minute later to lead 2 - 1. [SEP] the report also said the [SEP]", "detok_text": "[CLS], \" obama's senior strategists said, and mccain's campaign is actually going only to peel away obama's likely popular appeal and help change the economy. [SEP] the event was free and manageable. [SEP] this, at least, began with the possibility that all the players could stay out for the first year of their contract. [SEP] melbourne (reuters) - the world number two, no. 10, and roger federer advanced into the first round of the marseilles open here on wednesday, but neither player claimed a double - chance just one minute later to lead 2 - 1. [SEP] the report also said the [SEP]"}
+{"type": "sample", "index": 12, "raw_text": "[CLS] at home on sunday and then failed to win. [SEP] the body of mr neale was found at about 1110 local on 7 march and found in the same area of the road in the early hours of the morning. [SEP] king juan ii, meanwhile, boosted the hopes of winning the men ' s title by 5 - 0 at the age of 62 on sunday. [SEP] tens of thousands of parents have begun a joint inquiry into the deaths of 502 children. [SEP] \" i worry more about the economy, more about jobs, but i don ' t like race, \" he said. [SEP] arsenal ' s pique albert riera [SEP]", "detok_text": "[CLS] at home on sunday and then failed to win. [SEP] the body of mr neale was found at about 1110 local on 7 march and found in the same area of the road in the early hours of the morning. [SEP] king juan ii, meanwhile, boosted the hopes of winning the men's title by 5 - 0 at the age of 62 on sunday. [SEP] tens of thousands of parents have begun a joint inquiry into the deaths of 502 children. [SEP] \"i worry more about the economy, more about jobs, but i don't like race,\" he said. [SEP] arsenal's pique albert riera [SEP]"}
+{"type": "sample", "index": 13, "raw_text": "[CLS] the edwards air force base, calif., has failed to take off for normal wednesday, the agency reported. [SEP] it ' s time to get into the old - fashioned minds. [SEP] est, six people remained wounded, according to nato military reports. [SEP] \" we have a team that is prepared to take care of the players, prepared to come to us and to help us out. [SEP] but capello, who can use the european title from his six - year football career, has said it ' s going to be high - minded in his favour. [SEP] if it cannot meet the deadline to increase its investment to itv and [SEP]", "detok_text": "[CLS] the edwards air force base, calif., has failed to take off for normal wednesday, the agency reported. [SEP] it's time to get into the old - fashioned minds. [SEP] est, six people remained wounded, according to nato military reports. [SEP] \" we have a team that is prepared to take care of the players, prepared to come to us and to help us out. [SEP] but capello, who can use the european title from his six - year football career, has said it's going to be high - minded in his favour. [SEP] if it cannot meet the deadline to increase its investment to itv and [SEP]"}
+{"type": "sample", "index": 14, "raw_text": "[CLS] said. [SEP] the final decision would have been known for a third time, given the location of the original u. s. air force site. [SEP] he wasn ' t checked out after hearing about the incident by the authorities. [SEP] carmakers are paying more, too, because the government can produce their cars at a time when the economy is strong. [SEP] the outcome of this next general election is inevitable. [SEP] in the course of the recession, it was possible for western businesses to make more payments in the first hours of the cold month. [SEP] \" we believe that we can make the necessary progress along the way, \" he said [SEP]", "detok_text": "[CLS] said. [SEP] the final decision would have been known for a third time, given the location of the original u. s. air force site. [SEP] he wasn't checked out after hearing about the incident by the authorities. [SEP] carmakers are paying more, too, because the government can produce their cars at a time when the economy is strong. [SEP] the outcome of this next general election is inevitable. [SEP] in the course of the recession, it was possible for western businesses to make more payments in the first hours of the cold month. [SEP] \"we believe that we can make the necessary progress along the way,\" he said [SEP]"}
+{"type": "sample", "index": 15, "raw_text": "[CLS] florida and halfway along the caribbean and eastern gulf. [SEP] since his death in 2002, he said he has been taking drugs, cutting her and grabbing a baby in his mouth, his back and putting on his head. [SEP] the dow slipped 13 points at 10, 642. [SEP] setback on sept. [SEP] now, he tells everyone, however, he ' s back. [SEP] in 2005, a senior science and policy analyst at the center for science and international studies center in washington said a clinton - friendly election is likely to tip the balance on the survival of a black leader in charge of the party. [SEP] for all middle - [SEP]", "detok_text": "[CLS] florida and halfway along the caribbean and eastern gulf. [SEP] since his death in 2002, he said he has been taking drugs, cutting her and grabbing a baby in his mouth, his back and putting on his head. [SEP] the dow slipped 13 points at 10, 642. [SEP] setback on sept. [SEP] now, he tells everyone, however, he's back. [SEP] in 2005, a senior science and policy analyst at the center for science and international studies center in washington said a clinton - friendly election is likely to tip the balance on the survival of a black leader in charge of the party. [SEP] for all middle - [SEP]"}
+{"type": "sample", "index": 16, "raw_text": "[CLS] war that killed roughly 1, 000 people there in early 2009. [SEP] \" it is understandable that anyone responding to a robbery will be brought on to the police line at around 2200am. [SEP] but federer lost the first set on the 3 - 2 break. [SEP] in the early 1990s, abramovich said that he could face failure because he would be a player in chelsea ' s team. [SEP] a year before kennedy ' s death, some of the leading candidates came up against that and opened their careers. [SEP] mr grothey, a 21 - year - old from leech, wirrals, had agreed to [SEP]", "detok_text": "[CLS] war that killed roughly 1, 000 people there in early 2009. [SEP] \" it is understandable that anyone responding to a robbery will be brought on to the police line at around 2200am. [SEP] but federer lost the first set on the 3 - 2 break. [SEP] in the early 1990s, abramovich said that he could face failure because he would be a player in chelsea's team. [SEP] a year before kennedy's death, some of the leading candidates came up against that and opened their careers. [SEP] mr grothey, a 21 - year - old from leech, wirrals, had agreed to [SEP]"}
+{"type": "sample", "index": 17, "raw_text": "[CLS] safe. [SEP] murray, who reached the quarter - final, fought his first return serve to take the hold on the game with the rest of the crowd. [SEP] the election was due before in july 2008. [SEP] \" motorola, by contrast, is a huge and profitable way to buy phones and chips, \" said leesen, the company ' s chairman. [SEP] last year, she had lost only one set in the previous three, while suffering from a back injury. [SEP] congressional officials had said the plan would be approved by the senate and the house and the senate and could be picked up in bringing more costs to the economy. [SEP] [SEP]", "detok_text": "[CLS] safe. [SEP] murray, who reached the quarter - final, fought his first return serve to take the hold on the game with the rest of the crowd. [SEP] the election was due before in july 2008. [SEP] \"motorola, by contrast, is a huge and profitable way to buy phones and chips,\" said leesen, the company's chairman. [SEP] last year, she had lost only one set in the previous three, while suffering from a back injury. [SEP] congressional officials had said the plan would be approved by the senate and the house and the senate and could be picked up in bringing more costs to the economy. [SEP] [SEP]"}
+{"type": "sample", "index": 18, "raw_text": "[CLS] national cancer institute. [SEP] with the disease rising, nearly thousands more are at risk of dying from the health effects of the new sw1 in europe. [SEP] he was probably good at taking the boat and not dangerous. [SEP] i still don ' t have it. [SEP] \" i think it is time to move on, \" he said. [SEP] according to data from the national institute of health and the uk in 2002, 294 people died in scotland. [SEP] they are optimistic that the number of displaced refugees will soon return. [SEP] the cardinals came to the fourth round, the title in the semifinals, and won it all in 2002, 2002 [SEP]", "detok_text": "[CLS] national cancer institute. [SEP] with the disease rising, nearly thousands more are at risk of dying from the health effects of the new sw1 in europe. [SEP] he was probably good at taking the boat and not dangerous. [SEP] i still don't have it. [SEP] \"i think it is time to move on,\" he said. [SEP] according to data from the national institute of health and the uk in 2002, 294 people died in scotland. [SEP] they are optimistic that the number of displaced refugees will soon return. [SEP] the cardinals came to the fourth round, the title in the semifinals, and won it all in 2002, 2002 [SEP]"}
+{"type": "sample", "index": 19, "raw_text": "[CLS] alex ferguson believes that the pre - rested player would soon be able to finish with the second or better side of the new squad. [SEP] and in 1996, the democratic national committee announced the choice of senator john kerry days after the michigan primary, casting the party ' s nomination against a soon - to - be candidate to change the presidential race. [SEP] \" we will win because we don ' t know our strategy, \" mullen told u. s. president and secretary of state hillary clinton. [SEP] ( ap ) - michael vick was sacked with 10 seconds left to lead michigan state back, 4 - 1, but the unbeaten ho [SEP]", "detok_text": "[CLS] alex ferguson believes that the pre - rested player would soon be able to finish with the second or better side of the new squad. [SEP] and in 1996, the democratic national committee announced the choice of senator john kerry days after the michigan primary, casting the party's nomination against a soon - to - be candidate to change the presidential race. [SEP] \"we will win because we don't know our strategy,\" mullen told u. s. president and secretary of state hillary clinton. [SEP] (ap) - michael vick was sacked with 10 seconds left to lead michigan state back, 4 - 1, but the unbeaten ho [SEP]"}
+{"type": "sample", "index": 20, "raw_text": "[CLS] he said. [SEP] but he won it on his own. [SEP] because they said, doing something would prove difficult, but not impossible. [SEP] but there is also uncertainty about the long - term changes in gordon brown ' s leadership and the economic results of the election. [SEP] it was the first quarterly loss since september 2008. [SEP] nothing looked immediately apparent and he could have had a penalty saved when he was caught by alan johnson in the 12th minute, although the striker almost earned a goal - kick against the norwegians. [SEP] \" i do not understand how, if i was sitting in your car i could have done something else out of [SEP]", "detok_text": "[CLS] he said. [SEP] but he won it on his own. [SEP] because they said, doing something would prove difficult, but not impossible. [SEP] but there is also uncertainty about the long - term changes in gordon brown's leadership and the economic results of the election. [SEP] it was the first quarterly loss since september 2008. [SEP] nothing looked immediately apparent and he could have had a penalty saved when he was caught by alan johnson in the 12th minute, although the striker almost earned a goal - kick against the norwegians. [SEP] \" i do not understand how, if i was sitting in your car i could have done something else out of [SEP]"}
+{"type": "sample", "index": 21, "raw_text": "[CLS] 2005. [SEP] oceaneere ' s security officials were unable to disclose the details of their fight with the pirates, who held the ship on wednesday night. [SEP] novak novak djokovic lost his fourth straight australian open final final, but today ' s 6 - 2 victory ended exactly what had been expected. [SEP] the attack, involving nearly 20 afghan soldiers, resulted in a mass evacuation of troops in two checkpoints elsewhere in the air district. [SEP] new york ( reuters ) - no. 1 seed shara williams has won the itf women ' s second event in two weeks, the women ' s tennis tournament on sunday, defeating american [SEP]", "detok_text": "[CLS] 2005. [SEP] oceaneere's security officials were unable to disclose the details of their fight with the pirates, who held the ship on wednesday night. [SEP] novak novak djokovic lost his fourth straight australian open final final, but today's 6 - 2 victory ended exactly what had been expected. [SEP] the attack, involving nearly 20 afghan soldiers, resulted in a mass evacuation of troops in two checkpoints elsewhere in the air district. [SEP] new york (reuters) - no. 1 seed shara williams has won the itf women's second event in two weeks, the women's tennis tournament on sunday, defeating american [SEP]"}
+{"type": "sample", "index": 22, "raw_text": "[CLS] concerns over mortgage risks. [SEP] i think about being a boy and he ' s trying to make sure that he ' s healthy, he doesn ' t want to do so. [SEP] but john prosser, 35, says he ' ll know what his ability to do after his job is likely to end. [SEP] a new study is being carried out by scientists. [SEP] it is much less a nightmare. [SEP] even so, of course, the result will be an inevitable result, not upset. [SEP] she declined to comment on the nature of the questions, citing schiller ' s former rep. [SEP] then came the end of the [SEP]", "detok_text": "[CLS] concerns over mortgage risks. [SEP] i think about being a boy and he's trying to make sure that he's healthy, he doesn't want to do so. [SEP] but john prosser, 35, says he'll know what his ability to do after his job is likely to end. [SEP] a new study is being carried out by scientists. [SEP] it is much less a nightmare. [SEP] even so, of course, the result will be an inevitable result, not upset. [SEP] she declined to comment on the nature of the questions, citing schiller's former rep. [SEP] then came the end of the [SEP]"}
+{"type": "sample", "index": 23, "raw_text": "[CLS] [SEP] renault and toyota have already been locked in three race wars, which ended in 2009, leaving them only seven points in the german - american standings. [SEP] the latest attack came just days after u. s. - led forces fighting for al - qaida launched a series of suicide bombings in north - west waziristan region north of baghdad, killing at least 20 people. [SEP] she had reached third and ranked 30th before losing on 10 of the first 13 games, but henin fell short with another set of double - break points in the second set to win 4 - 1, 2 - 2. [SEP] this week, [SEP]", "detok_text": "[CLS] [SEP] renault and toyota have already been locked in three race wars, which ended in 2009, leaving them only seven points in the german - american standings. [SEP] the latest attack came just days after u. s. - led forces fighting for al - qaida launched a series of suicide bombings in north - west waziristan region north of baghdad, killing at least 20 people. [SEP] she had reached third and ranked 30th before losing on 10 of the first 13 games, but henin fell short with another set of double - break points in the second set to win 4 - 1, 2 - 2. [SEP] this week, [SEP]"}
+{"type": "sample", "index": 24, "raw_text": "[CLS] said he didn ' t know exactly when it was written, or the fact it would have happened. [SEP] washington - - barack obama ' s political and military party is holding talks over whether to open negotiations for a new comprehensive peace deal. [SEP] the head of the tamil tigers went on a flight to india late saturday amid reports of a terrorist threat in the region, the government said. [SEP] he had a similar view about the rest of his class. [SEP] on the edge of the rugged valley, they look at the location of the fire - - and where it was taking place. [SEP] she ' s currently in charge of the international olympic [SEP]", "detok_text": "[CLS] said he didn't know exactly when it was written, or the fact it would have happened. [SEP] washington - - barack obama's political and military party is holding talks over whether to open negotiations for a new comprehensive peace deal. [SEP] the head of the tamil tigers went on a flight to india late saturday amid reports of a terrorist threat in the region, the government said. [SEP] he had a similar view about the rest of his class. [SEP] on the edge of the rugged valley, they look at the location of the fire - - and where it was taking place. [SEP] she's currently in charge of the international olympic [SEP]"}
+{"type": "sample", "index": 25, "raw_text": "[CLS] more likely parents, pension workers and their families to lose more care of their young children and end up in dire straits. [SEP] if that ' s the case, we ' ll get our point. [SEP] \" it ' s a part of that, \" she said. [SEP] \" you see, i can ' t be here. [SEP] at this point, it ' s \" unrescusable, \" about 2. 2 seconds off a fast pace before some passengers said they could go back to the air in the morning. [SEP] a nice feel with a white, wooded valley, a good sight to the hotel and a strong sense that [SEP]", "detok_text": "[CLS] more likely parents, pension workers and their families to lose more care of their young children and end up in dire straits. [SEP] if that's the case, we'll get our point. [SEP] \"it's a part of that,\" she said. [SEP] \"you see, i can't be here. [SEP] at this point, it's\" unrescusable, \" about 2. 2 seconds off a fast pace before some passengers said they could go back to the air in the morning. [SEP] a nice feel with a white, wooded valley, a good sight to the hotel and a strong sense that [SEP]"}
+{"type": "sample", "index": 26, "raw_text": "[CLS] majority in two weeks, in an election that could have left him in the race for the current presidency. [SEP] it was pretty gut - wrenching. [SEP] i ' m very sorry, i was very happy, \" he said. [SEP] obama ' s isn ' t going anywhere. [SEP] he defeated the st. louis cardinals 2 - 0 and lost three in seven innings to earn a first - round bye. [SEP] it has a network of 17 branches in london, london, yorkshire, north yorkshire, birmingham, blackpool, lancashire, derbyshire, hertfordshire, south yorkshire and doncaster. [SEP] more than 16, 000 people were killed and more than [SEP]", "detok_text": "[CLS] majority in two weeks, in an election that could have left him in the race for the current presidency. [SEP] it was pretty gut - wrenching. [SEP] i'm very sorry, i was very happy, \" he said. [SEP] obama's isn't going anywhere. [SEP] he defeated the st. louis cardinals 2 - 0 and lost three in seven innings to earn a first - round bye. [SEP] it has a network of 17 branches in london, london, yorkshire, north yorkshire, birmingham, blackpool, lancashire, derbyshire, hertfordshire, south yorkshire and doncaster. [SEP] more than 16, 000 people were killed and more than [SEP]"}
+{"type": "sample", "index": 27, "raw_text": "[CLS] on the night. [SEP] rachida ouldinu, 30, has been charged with attempted murder on 18 june. [SEP] the majority of economists don ' t believe this is a big part of a plan that will be available to americans at all income levels. [SEP] with the year and winter olympics due to end, warm weather in britain coming between mid - march and december could produce more snow this week. [SEP] marin cilic, the us open champion, had six points in the opening set, 4 - 5, and in the second it was set for a tie. [SEP] texas, which has finished more than 40 - 0 [SEP]", "detok_text": "[CLS] on the night. [SEP] rachida ouldinu, 30, has been charged with attempted murder on 18 june. [SEP] the majority of economists don't believe this is a big part of a plan that will be available to americans at all income levels. [SEP] with the year and winter olympics due to end, warm weather in britain coming between mid - march and december could produce more snow this week. [SEP] marin cilic, the us open champion, had six points in the opening set, 4 - 5, and in the second it was set for a tie. [SEP] texas, which has finished more than 40 - 0 [SEP]"}
+{"type": "sample", "index": 28, "raw_text": "[CLS] second race, a neck down to his last time, seems to be winning. [SEP] but six days later, the former left - right winger came into government. [SEP] england reached 170 for five with nine wickets by paceer andrew flintoff and pace opener ricky ponting, while clarke has claimed a test wicket with the reserve side shortly after completing his debut from durham. [SEP] he warned not to take the risk. [SEP] new york opened its regular season with six wins in eight straight overall and seventh - worst in the east in its history.... [SEP] this year ' s open champion safina of russia was able to make [SEP]", "detok_text": "[CLS] second race, a neck down to his last time, seems to be winning. [SEP] but six days later, the former left - right winger came into government. [SEP] england reached 170 for five with nine wickets by paceer andrew flintoff and pace opener ricky ponting, while clarke has claimed a test wicket with the reserve side shortly after completing his debut from durham. [SEP] he warned not to take the risk. [SEP] new york opened its regular season with six wins in eight straight overall and seventh - worst in the east in its history.... [SEP] this year's open champion safina of russia was able to make [SEP]"}
+{"type": "sample", "index": 29, "raw_text": "[CLS] year - old son in the northern region. [SEP] also thursday, health ministry official sarhad khan said the local council said 60 were killed, including one soldier were wounded in the fighting. [SEP] for example, the defense department ' s survey of strategic public agents and its personal computer systems students may affect their federal income. [SEP] the meeting included 16 members of the national organising committee, including kasab ghabar, the president of the organising committee, earlier in the month. [SEP] while the dow jones index is below 100 percent, the s & p was trading 0. 4 percent lower at 12, 930. 00. [SEP] he [SEP]", "detok_text": "[CLS] year - old son in the northern region. [SEP] also thursday, health ministry official sarhad khan said the local council said 60 were killed, including one soldier were wounded in the fighting. [SEP] for example, the defense department's survey of strategic public agents and its personal computer systems students may affect their federal income. [SEP] the meeting included 16 members of the national organising committee, including kasab ghabar, the president of the organising committee, earlier in the month. [SEP] while the dow jones index is below 100 percent, the s & p was trading 0. 4 percent lower at 12, 930. 00. [SEP] he [SEP]"}
+{"type": "sample", "index": 30, "raw_text": "[CLS] 2004, when she broke the same mark for the first time since the ban after being a woman. [SEP] there were some questions about it. [SEP] the information security commission just disclosed that it was receiving 500 claims by members of the public, claiming the firm has received a maximum of £37, 642 from labour clients. [SEP] he was taken to hospital, police said, adding reports later in the condition were stable. [SEP] the report was written in a journal by matthew dowd, an expert on the state peace program at the korea institute. [SEP] the north ' s military had heard reports of the firing by georgian troops at the time [SEP]", "detok_text": "[CLS] 2004, when she broke the same mark for the first time since the ban after being a woman. [SEP] there were some questions about it. [SEP] the information security commission just disclosed that it was receiving 500 claims by members of the public, claiming the firm has received a maximum of £37, 642 from labour clients. [SEP] he was taken to hospital, police said, adding reports later in the condition were stable. [SEP] the report was written in a journal by matthew dowd, an expert on the state peace program at the korea institute. [SEP] the north's military had heard reports of the firing by georgian troops at the time [SEP]"}
+{"type": "sample", "index": 31, "raw_text": "[CLS] muhammad ' s lawyer son muhammad jr. declined to press the sentence. [SEP] manchester united manager sir david james has admitted he has helped the 30 - year - old england midfielder make his first start at the club. [SEP] \" i think that when he puts up the challenge in the history of the game, i don ' t see the reality now, \" he told cbs news. [SEP] \" this is a very exciting result, \" he said. [SEP] \" it was something very unhirl. \" [SEP] and as a result, it ' s easy to say to me, \" we have lost the chance of achieving it. \" [SEP] [SEP]", "detok_text": "[CLS] muhammad's lawyer son muhammad jr. declined to press the sentence. [SEP] manchester united manager sir david james has admitted he has helped the 30 - year - old england midfielder make his first start at the club. [SEP] \"i think that when he puts up the challenge in the history of the game, i don't see the reality now,\" he told cbs news. [SEP] \"this is a very exciting result,\" he said. [SEP] \"it was something very unhirl.\" [SEP] and as a result, it's easy to say to me, \"we have lost the chance of achieving it.\" [SEP] [SEP]"}
+{"type": "sample", "index": 32, "raw_text": "[CLS] family ' s home along the desaie river on sept. [SEP] it seems to have no further information on the outcome of the debate, it does, however, depend on the validity of what he thinks and what the media thinks in the light of what this might mean to him today. [SEP] they had to try to make the term \" nonpartisan \" by getting involved in politics. [SEP] \" we ' ve had the talking with the celtic manager before, but we had a very rough time people were trying to get over what was happening for us, \" he said. [SEP] the ruling comes the day after a second review of international [SEP]", "detok_text": "[CLS] family's home along the desaie river on sept. [SEP] it seems to have no further information on the outcome of the debate, it does, however, depend on the validity of what he thinks and what the media thinks in the light of what this might mean to him today. [SEP] they had to try to make the term \"nonpartisan\" by getting involved in politics. [SEP] \"we've had the talking with the celtic manager before, but we had a very rough time people were trying to get over what was happening for us,\" he said. [SEP] the ruling comes the day after a second review of international [SEP]"}
+{"type": "sample", "index": 33, "raw_text": "[CLS]. [SEP] former rangers striker thomas mccarthy hopes to improve coach joe young ' s side. [SEP] official results have yet to be released. [SEP] after mr. smith died last year, mr. van der veer ' s life changed dramatically. [SEP] 31, 2005, he died at 9 a. m. [SEP] he, from a three - month break, held the lead of his sixth open rematch, with roger federer, before beating his friend novak djokovic at the 2005 french open. [SEP] at this stage, it isn ' t clear if the person died from the injuries. [SEP] most of those lived in the secure area of baghdad [SEP]", "detok_text": "[CLS]. [SEP] former rangers striker thomas mccarthy hopes to improve coach joe young's side. [SEP] official results have yet to be released. [SEP] after mr. smith died last year, mr. van der veer's life changed dramatically. [SEP] 31, 2005, he died at 9 a. m. [SEP] he, from a three - month break, held the lead of his sixth open rematch, with roger federer, before beating his friend novak djokovic at the 2005 french open. [SEP] at this stage, it isn't clear if the person died from the injuries. [SEP] most of those lived in the secure area of baghdad [SEP]"}
+{"type": "sample", "index": 34, "raw_text": "[CLS] through. [SEP] new york at new england, 4 p. m. [SEP] but then, if the effort is successful, fincher would have decided to get that far. [SEP] one of the two largest shareholders of us media said 21 police officers would be fired and 200 more would be filled by the second quarter of 2010. [SEP] they said the fed and treasury are also responsible for raising standards for mortgage regulators and brokers to better understand the credit - rating system at the expense of many borrowers. [SEP] he is living in a family ' s house and works in the small city of kashal in the north - central province. [SEP]", "detok_text": "[CLS] through. [SEP] new york at new england, 4 p. m. [SEP] but then, if the effort is successful, fincher would have decided to get that far. [SEP] one of the two largest shareholders of us media said 21 police officers would be fired and 200 more would be filled by the second quarter of 2010. [SEP] they said the fed and treasury are also responsible for raising standards for mortgage regulators and brokers to better understand the credit - rating system at the expense of many borrowers. [SEP] he is living in a family's house and works in the small city of kashal in the north - central province. [SEP]"}
+{"type": "sample", "index": 35, "raw_text": "[CLS] just scored the last of their goals. [SEP] according to the nature of the case, no decision was given to police for the release of a bail report on his death. [SEP] while the unrepared experts know there is some reason to go out on it, experts say they can get a break with their public health. [SEP] he was elected america ' s elected president for the first time in 1999, and ran for the presidency for up to a year. [SEP] \" nobody comes here to play more than a champion, it ' s possible, \" he said. [SEP] what should not happen to universal health care is the cost and [SEP]", "detok_text": "[CLS] just scored the last of their goals. [SEP] according to the nature of the case, no decision was given to police for the release of a bail report on his death. [SEP] while the unrepared experts know there is some reason to go out on it, experts say they can get a break with their public health. [SEP] he was elected america's elected president for the first time in 1999, and ran for the presidency for up to a year. [SEP] \"nobody comes here to play more than a champion, it's possible,\" he said. [SEP] what should not happen to universal health care is the cost and [SEP]"}
+{"type": "sample", "index": 36, "raw_text": "[CLS] democrats expected ahead of tuesday night ' s election could help push gop sen. john mccain and republicans to keep control. [SEP] a bomb has also struck off at the queen ' s university and the queen ' s college in birmingham, killing more than 100 members of staff and students. [SEP] the americans were fourth in the women ' s singles, while china lost a fourth in the women ' s and the men ' s doubles. [SEP] he is a professor of sociology at the university of southern california and has written five medical books since his death from 2001 until august 2007. [SEP] henin was won in 2002 only five times in a season [SEP]", "detok_text": "[CLS] democrats expected ahead of tuesday night's election could help push gop sen. john mccain and republicans to keep control. [SEP] a bomb has also struck off at the queen's university and the queen's college in birmingham, killing more than 100 members of staff and students. [SEP] the americans were fourth in the women's singles, while china lost a fourth in the women's and the men's doubles. [SEP] he is a professor of sociology at the university of southern california and has written five medical books since his death from 2001 until august 2007. [SEP] henin was won in 2002 only five times in a season [SEP]"}
+{"type": "sample", "index": 37, "raw_text": "[CLS]. [SEP] the results of the original study, published in a 12 - month public online issue of the journal of psychology, asked college - age consumers about the health benefits of personalised planning for families and a personalised lifestyle. [SEP] thai soldiers attacked rumwindi army garrison, 40 km south, near the city of mohalin, in the early early hours of the morning, the officials said. [SEP] grossman signed a four - year contract with the seahawks until next season. [SEP] tebow has thrown for 272 yards and four touchdowns. [SEP] in 2003, they won five first - class games, made it six finals before losing [SEP]", "detok_text": "[CLS]. [SEP] the results of the original study, published in a 12 - month public online issue of the journal of psychology, asked college - age consumers about the health benefits of personalised planning for families and a personalised lifestyle. [SEP] thai soldiers attacked rumwindi army garrison, 40 km south, near the city of mohalin, in the early early hours of the morning, the officials said. [SEP] grossman signed a four - year contract with the seahawks until next season. [SEP] tebow has thrown for 272 yards and four touchdowns. [SEP] in 2003, they won five first - class games, made it six finals before losing [SEP]"}
+{"type": "sample", "index": 38, "raw_text": "[CLS] along the banks of the river. [SEP] but he should know that. [SEP] i ' m skeptical that senator clinton, who is a senator, can be staying on the edge. [SEP] only a group of professional curators can get a complete history of a classic subject. [SEP] though, the operation won ' t take much long. [SEP] he made his own personal mistake, sending home an e - mail message to his children ' s account as his mother threatened him over a telephone and refused to speak again. [SEP] it has claimed that the film will be screened this year. [SEP] in the south, the city of iraq ' s northern third [SEP]", "detok_text": "[CLS] along the banks of the river. [SEP] but he should know that. [SEP] i'm skeptical that senator clinton, who is a senator, can be staying on the edge. [SEP] only a group of professional curators can get a complete history of a classic subject. [SEP] though, the operation won't take much long. [SEP] he made his own personal mistake, sending home an e - mail message to his children's account as his mother threatened him over a telephone and refused to speak again. [SEP] it has claimed that the film will be screened this year. [SEP] in the south, the city of iraq's northern third [SEP]"}
+{"type": "sample", "index": 39, "raw_text": "[CLS] at the university of british columbia. [SEP] the 29 - year - old haurov made a surprise announcement this week about his status as a rider on his way to the title, which gave him the chance to change his form in friday ' s final race. [SEP] \" we have been looking at the chances that the ice would pick up in the early stages of the last five years, \" said an ice official, who anonymously declined to speak to media focused on the research. [SEP] several women in britain have said they were losing concern for the safety of their lives as a result of debile disease. [SEP] washington ( ap [SEP]", "detok_text": "[CLS] at the university of british columbia. [SEP] the 29 - year - old haurov made a surprise announcement this week about his status as a rider on his way to the title, which gave him the chance to change his form in friday's final race. [SEP] \"we have been looking at the chances that the ice would pick up in the early stages of the last five years,\" said an ice official, who anonymously declined to speak to media focused on the research. [SEP] several women in britain have said they were losing concern for the safety of their lives as a result of debile disease. [SEP] washington ( ap [SEP]"}
+{"type": "sample", "index": 40, "raw_text": "[CLS] - 3 and american mardy fish of the netherlands defeated american richard haas 3 - 6 7 - 6 6 - 3. [SEP] even before mr brown ' s departure announcement that the soldiers would face a reshuffle of military operations, the government privately held out the future of some troops. [SEP] u. s. markets rose in april ahead of tuesday, but the first week of march trading ended at 10 yen, when they will be trading on the new york stock exchange. [SEP] the australian open champion was lost at a similar event in 2007, when serbian novak djokovic and david haas lost at the five - french open. [SEP] [SEP]", "detok_text": "[CLS] - 3 and american mardy fish of the netherlands defeated american richard haas 3 - 6 7 - 6 6 - 3. [SEP] even before mr brown's departure announcement that the soldiers would face a reshuffle of military operations, the government privately held out the future of some troops. [SEP] u. s. markets rose in april ahead of tuesday, but the first week of march trading ended at 10 yen, when they will be trading on the new york stock exchange. [SEP] the australian open champion was lost at a similar event in 2007, when serbian novak djokovic and david haas lost at the five - french open. [SEP] [SEP]"}
+{"type": "sample", "index": 41, "raw_text": "[CLS] an $ 8, 500 credit for child support. [SEP] the flight time means passengers need just five or seven minutes before time to get home to board the next flight. [SEP] \" it seems to me that there is a huge market environment in mexico. [SEP] david moyes will not try to finish this big way as he has made sure of his return for liverpool winning the champions league this year. [SEP] women who are relatively out of work are significantly more likely when they leave their 11 - year - olds with more education in the uk, and are at risk of losing their two children and losing their daughter when they have brought enough money to [SEP]", "detok_text": "[CLS] an $8, 500 credit for child support. [SEP] the flight time means passengers need just five or seven minutes before time to get home to board the next flight. [SEP] \" it seems to me that there is a huge market environment in mexico. [SEP] david moyes will not try to finish this big way as he has made sure of his return for liverpool winning the champions league this year. [SEP] women who are relatively out of work are significantly more likely when they leave their 11 - year - olds with more education in the uk, and are at risk of losing their two children and losing their daughter when they have brought enough money to [SEP]"}
+{"type": "sample", "index": 42, "raw_text": "[CLS] more likely to monitor their health, the researchers said. [SEP] he was also convicted in november of five counts of attempted sexual assault in the mersey crown court. [SEP] it is the most popular group, a group made up of 24 americans, and 14 pakistanis and the american captain. [SEP] with safin winning the match, williams will face serena williams and possibly the likes of dinara safina, dinara safina, rafael nadal and novak djokovic, who also beat dinara safina on match - point at 2 - 2pm. [SEP] what a bunch of whine ' s. [SEP] it [SEP]", "detok_text": "[CLS] more likely to monitor their health, the researchers said. [SEP] he was also convicted in november of five counts of attempted sexual assault in the mersey crown court. [SEP] it is the most popular group, a group made up of 24 americans, and 14 pakistanis and the american captain. [SEP] with safin winning the match, williams will face serena williams and possibly the likes of dinara safina, dinara safina, rafael nadal and novak djokovic, who also beat dinara safina on match - point at 2 - 2pm. [SEP] what a bunch of whine's. [SEP] it [SEP]"}
+{"type": "sample", "index": 43, "raw_text": "[CLS] underpaid. [SEP] with the global recession biting costs, consumers are slashing their own businesses. [SEP] the four defendants were declared not guilty and brought to the government. [SEP] but health officials have stayed away from the debate. [SEP] keane ' s opening goal helped liverpool regain the lead at the break but could not equalise as the portuguese striker returned midway through the second after a powerful effort from david hamel was followed by a superb shot from right - back that sent the goal wide. [SEP] at the other end of a spectrum, you start with a lot of turmoil. [SEP] labour ' s overall performance early today was hit by a [SEP]", "detok_text": "[CLS] underpaid. [SEP] with the global recession biting costs, consumers are slashing their own businesses. [SEP] the four defendants were declared not guilty and brought to the government. [SEP] but health officials have stayed away from the debate. [SEP] keane's opening goal helped liverpool regain the lead at the break but could not equalise as the portuguese striker returned midway through the second after a powerful effort from david hamel was followed by a superb shot from right - back that sent the goal wide. [SEP] at the other end of a spectrum, you start with a lot of turmoil. [SEP] labour's overall performance early today was hit by a [SEP]"}
+{"type": "sample", "index": 44, "raw_text": "[CLS] [SEP] among non - retired workers, this was 43 % less - but about 40 % higher - than at the start of 2005. [SEP] but clinton and her staff say they are confident in sparing the money that needs to go from clinton to obama. [SEP] but he was not guilty. [SEP] the man has been taken to an area hospital. [SEP] the german, a five - time open champion, eliminated venus williams, who completed her first run in 2004 and 2007, defeated elena dementieva in the french - french french open final and she was eliminated in the fourth round of the following year. [SEP] the company said it expects [SEP]", "detok_text": "[CLS] [SEP] among non - retired workers, this was 43 % less - but about 40 % higher - than at the start of 2005. [SEP] but clinton and her staff say they are confident in sparing the money that needs to go from clinton to obama. [SEP] but he was not guilty. [SEP] the man has been taken to an area hospital. [SEP] the german, a five - time open champion, eliminated venus williams, who completed her first run in 2004 and 2007, defeated elena dementieva in the french - french french open final and she was eliminated in the fourth round of the following year. [SEP] the company said it expects [SEP]"}
+{"type": "sample", "index": 45, "raw_text": "[CLS] but had now come through the match, and with the loss of one goal they would not know what to do. [SEP] yet this thing was rather good, i thought. [SEP] ivanovic bounced back to win twice in the first women ' s singles match against an ethiopian opponent in each of the previous 10 years. [SEP] it seems like his best strategy. [SEP] i didn ' t know how my husband left. [SEP] some said more than one - third customers, at $ 10, 000, are at least asked to spend their money to save themselves, earning 1, 000 - dollar bonus points. [SEP] i have to focus on the brand [SEP]", "detok_text": "[CLS] but had now come through the match, and with the loss of one goal they would not know what to do. [SEP] yet this thing was rather good, i thought. [SEP] ivanovic bounced back to win twice in the first women's singles match against an ethiopian opponent in each of the previous 10 years. [SEP] it seems like his best strategy. [SEP] i didn't know how my husband left. [SEP] some said more than one - third customers, at $10, 000, are at least asked to spend their money to save themselves, earning 1, 000 - dollar bonus points. [SEP] i have to focus on the brand [SEP]"}
+{"type": "sample", "index": 46, "raw_text": "[CLS] in south waziristan, pakistan ' s main province to the north - west border, the taliban killed a soldier and a belgian - born son in a car bombing on saturday in afghanistan ' s northwest of peshawar, killing american and un troops. [SEP] a friend who identified his friend as washington rep. andrew janis, declined to speak further from the post early tuesday. [SEP] i wonder if there is something, but if we ' re still here, it ' s no longer possible, we ' re going to tell him everything, and they ' re just going to go. [SEP] \" i just didn ' t be as easy [SEP]", "detok_text": "[CLS] in south waziristan, pakistan's main province to the north - west border, the taliban killed a soldier and a belgian - born son in a car bombing on saturday in afghanistan's northwest of peshawar, killing american and un troops. [SEP] a friend who identified his friend as washington rep. andrew janis, declined to speak further from the post early tuesday. [SEP] i wonder if there is something, but if we're still here, it's no longer possible, we're going to tell him everything, and they're just going to go. [SEP] \" i just didn't be as easy [SEP]"}
+{"type": "sample", "index": 47, "raw_text": "[CLS], according to john o ' brennan, the president ' s national security adviser. [SEP] \" i ' ve lost the way out now, \" the new york senator said, according to the results. [SEP] it looked as though england had regained the first - half lead in the 27th minute but gera broke his serve to claim his second goal of the night when his counter - attack produced just the second chance to pull a goal away after four minutes. [SEP] woods suffered the sharpest stroke of his career, a playoff defeat at golf ' s world golf classic in sydney on nov. [SEP] penn state, n. y., march 3 [SEP]", "detok_text": "[CLS], according to john o' brennan, the president's national security adviser. [SEP] \"i've lost the way out now,\" the new york senator said, according to the results. [SEP] it looked as though england had regained the first - half lead in the 27th minute but gera broke his serve to claim his second goal of the night when his counter - attack produced just the second chance to pull a goal away after four minutes. [SEP] woods suffered the sharpest stroke of his career, a playoff defeat at golf's world golf classic in sydney on nov. [SEP] penn state, n. y., march 3 [SEP]"}
+{"type": "sample", "index": 48, "raw_text": "[CLS] a lead on his second drive that ended with a field goal early in the second half. [SEP] very good, \" said a spokeswoman for the british association. [SEP] the packers also scored three times in the second half against 7 - foot - 5 23 - year safety ryan ga grounder, who took advantage of a late interception late in the second quarter and will miss saturday ' s game. [SEP] the board has had a long way of convening questions about the fda ' s handling of the drug probe, especially when it failed to adequately answer any question about mr. martin ' s independent background. [SEP] during the time the [SEP]", "detok_text": "[CLS] a lead on his second drive that ended with a field goal early in the second half. [SEP] very good, \" said a spokeswoman for the british association. [SEP] the packers also scored three times in the second half against 7 - foot - 5 23 - year safety ryan ga grounder, who took advantage of a late interception late in the second quarter and will miss saturday's game. [SEP] the board has had a long way of convening questions about the fda's handling of the drug probe, especially when it failed to adequately answer any question about mr. martin's independent background. [SEP] during the time the [SEP]"}
+{"type": "sample", "index": 49, "raw_text": "[CLS] a low - income income topping 50 %. [SEP] the unite union represents around 9, 000 members of a total of 2, 500 ba staff and passengers outside their belts. [SEP] if you have a higher amount of pension coverage by retirement, the number of hours to work at your employer actually decreases to account for the loss of work, factoring the outcome of work. [SEP] boston ( ap ) - it ' s the first time he ' s been eliminated in the third round. [SEP] the department of health said yesterday that ministers had agreed to consider the impact of adding extra young people to new guidelines for mental health services. [SEP] the company [SEP]", "detok_text": "[CLS] a low - income income topping 50 %. [SEP] the unite union represents around 9, 000 members of a total of 2, 500 ba staff and passengers outside their belts. [SEP] if you have a higher amount of pension coverage by retirement, the number of hours to work at your employer actually decreases to account for the loss of work, factoring the outcome of work. [SEP] boston (ap) - it's the first time he's been eliminated in the third round. [SEP] the department of health said yesterday that ministers had agreed to consider the impact of adding extra young people to new guidelines for mental health services. [SEP] the company [SEP]"}
+{"type": "sample", "index": 50, "raw_text": "[CLS] requires more exercise, perhaps even less sleep. [SEP] \" i think that when we ' re running, it ' s likely we think that will set the goal for it, \" the official said. [SEP] robert st. michael greini of bloomington, mo., was second in 1 : 09. 97, 39. 88, respectively, and john lasse 1 : 05. 50. 65, second in 42. 93, 088 : 19. 80 ). [SEP] i said \" he won ' t change the word. \" [SEP] michael icahn, former managing director of international asset management at morgan stanley, which runs [SEP]", "detok_text": "[CLS] requires more exercise, perhaps even less sleep. [SEP] \"i think that when we're running, it's likely we think that will set the goal for it,\" the official said. [SEP] robert st. michael greini of bloomington, mo., was second in 1: 09. 97, 39. 88, respectively, and john lasse 1: 05. 50. 65, second in 42. 93, 088: 19. 80 ). [SEP] i said \"he won't change the word.\" [SEP] michael icahn, former managing director of international asset management at morgan stanley, which runs [SEP]"}
+{"type": "sample", "index": 51, "raw_text": "[CLS] within a decade. [SEP] the most publicized case this year was reported in 1975. [SEP] \" but it ' s a joke. [SEP] and it won ' t matter what you might turn out for. [SEP] and, yes, it is very scary. [SEP] and that ' s why it ' s so difficult and so important. [SEP] the ap news agency said that the public search for the body was in its early stages. [SEP] all three board members were removed. [SEP] in another round, former world no. 1 davydenko also defeated french eighth seed tommy haase 6 - 3, 4 - 6, 7 - 7, 6 - [SEP]", "detok_text": "[CLS] within a decade. [SEP] the most publicized case this year was reported in 1975. [SEP] \" but it's a joke. [SEP] and it won't matter what you might turn out for. [SEP] and, yes, it is very scary. [SEP] and that's why it's so difficult and so important. [SEP] the ap news agency said that the public search for the body was in its early stages. [SEP] all three board members were removed. [SEP] in another round, former world no. 1 davydenko also defeated french eighth seed tommy haase 6 - 3, 4 - 6, 7 - 7, 6 - [SEP]"}
+{"type": "sample", "index": 52, "raw_text": "[CLS]. [SEP] ten per cent of the population from 2000 - 08 died in england and in 2001 some 8. 7 per cent. [SEP] the irish lost 12 straight since falling out of the tournament in 2005. [SEP] the book ' s authors have already published a comprehensive study at the end of the disease assessing survivors more clinically, under stressing the potential for their lives. [SEP] among the first group who died, a 15 % reduction in the impact of the disease reduced nervousness. [SEP] madrid ( reuters ) - a spanish high court on saturday ordered the trial of a woman wanted in the death of a journalist killed in madrid. [SEP] three [SEP]", "detok_text": "[CLS]. [SEP] ten per cent of the population from 2000 - 08 died in england and in 2001 some 8. 7 per cent. [SEP] the irish lost 12 straight since falling out of the tournament in 2005. [SEP] the book's authors have already published a comprehensive study at the end of the disease assessing survivors more clinically, under stressing the potential for their lives. [SEP] among the first group who died, a 15 % reduction in the impact of the disease reduced nervousness. [SEP] madrid (reuters) - a spanish high court on saturday ordered the trial of a woman wanted in the death of a journalist killed in madrid. [SEP] three [SEP]"}
+{"type": "sample", "index": 53, "raw_text": "[CLS] season, he took on the show as a rookie in early 2006. [SEP] she studied theology at cambridge, then moved to the netherlands in france, france and then germany. [SEP] kabul ( reuters ) - a u. s. military coalition killed in a bomb attack on the main city of kabul, afghanistan, had detained more than 50 militants while assaulting nato air force units, a nato official said thursday. [SEP] the loss won for the third straight after losing all 10 of 16 games. [SEP] the founder of the popular internet web site lisa jones, who had lost her younger daughter, miss smith, died thursday, shortly after losing her [SEP]", "detok_text": "[CLS] season, he took on the show as a rookie in early 2006. [SEP] she studied theology at cambridge, then moved to the netherlands in france, france and then germany. [SEP] kabul (reuters) - a u. s. military coalition killed in a bomb attack on the main city of kabul, afghanistan, had detained more than 50 militants while assaulting nato air force units, a nato official said thursday. [SEP] the loss won for the third straight after losing all 10 of 16 games. [SEP] the founder of the popular internet web site lisa jones, who had lost her younger daughter, miss smith, died thursday, shortly after losing her [SEP]"}
+{"type": "sample", "index": 54, "raw_text": "[CLS] 400 million of the season will end up at home as well as the oscars. [SEP] the conservatives lost the conservative government in this year ' s general election and are hoping to form a new coalition in 2010. [SEP] there ' s no real truth. [SEP] people should get it. [SEP] the bus was ordered to pass into the bridgend area at about 2000 gmt on saturday, police said. [SEP] the poll was found that 20 % were very optimistic. [SEP] \" the blood came in top of his head and he lost his hand. [SEP] he resumed his candidacy to a second term last month with a loss in the polls in the [SEP]", "detok_text": "[CLS] 400 million of the season will end up at home as well as the oscars. [SEP] the conservatives lost the conservative government in this year's general election and are hoping to form a new coalition in 2010. [SEP] there's no real truth. [SEP] people should get it. [SEP] the bus was ordered to pass into the bridgend area at about 2000 gmt on saturday, police said. [SEP] the poll was found that 20 % were very optimistic. [SEP] \" the blood came in top of his head and he lost his hand. [SEP] he resumed his candidacy to a second term last month with a loss in the polls in the [SEP]"}
+{"type": "sample", "index": 55, "raw_text": "[CLS] on wall street. [SEP] and those who can decide whether you want to make the people feel responsible for what ' s going to happen just as a response to the moment of truth. [SEP] china ' s foreign ministry was not immediately available saturday. [SEP] the national register reported the deaths and deaths just five days after last year ' s round of earthquakes in california ' s san bernardino county, in the first week of march 2005. [SEP] the same unhappy, three - year daughter was nearly raped by her boyfriend in paris and held back by the loss of my mother ' s marriage. [SEP] \" the international community got its due out in 2000 and [SEP]", "detok_text": "[CLS] on wall street. [SEP] and those who can decide whether you want to make the people feel responsible for what's going to happen just as a response to the moment of truth. [SEP] china's foreign ministry was not immediately available saturday. [SEP] the national register reported the deaths and deaths just five days after last year's round of earthquakes in california's san bernardino county, in the first week of march 2005. [SEP] the same unhappy, three - year daughter was nearly raped by her boyfriend in paris and held back by the loss of my mother's marriage. [SEP] \" the international community got its due out in 2000 and [SEP]"}
+{"type": "sample", "index": 56, "raw_text": "[CLS] on the line. [SEP] and if one can be sure that it would not take a long break anyway, one only has the feeling that it could take a long to make. [SEP] \" he asked me if i wanted to stay i realised there was nothing, \" he said. [SEP] but then that ' s what i think about and trying to understand, they are a big story. [SEP] federer, 7 - 2, who lost to djokovic in the first round, now has lost eight of 14, including the defending champion federer, who then lost out at the french open, the last time in 2004. [SEP] she played at [SEP]", "detok_text": "[CLS] on the line. [SEP] and if one can be sure that it would not take a long break anyway, one only has the feeling that it could take a long to make. [SEP] \"he asked me if i wanted to stay i realised there was nothing,\" he said. [SEP] but then that's what i think about and trying to understand, they are a big story. [SEP] federer, 7 - 2, who lost to djokovic in the first round, now has lost eight of 14, including the defending champion federer, who then lost out at the french open, the last time in 2004. [SEP] she played at [SEP]"}
+{"type": "sample", "index": 57, "raw_text": "[CLS]khazia province in south ossetia province, the official news agency reported. [SEP] the who also urged state health authorities when assessing whether a flu vaccine needed to be available. [SEP] montreal ( reuters ) - the cy young champions earned their fourth win in five games to lead the philadelphia flyers team to a 2 - 0 victory over pittsburgh pirates on tuesday. [SEP] some were killed in the region early last year when taliban missiles hit a british vessel, but some more are handed over to afghanistan, the ministry of defence said. [SEP] but no one might be upset by the cia ' s recent attempt to protect its long - earned reputation with a [SEP]", "detok_text": "[CLS]khazia province in south ossetia province, the official news agency reported. [SEP] the who also urged state health authorities when assessing whether a flu vaccine needed to be available. [SEP] montreal (reuters) - the cy young champions earned their fourth win in five games to lead the philadelphia flyers team to a 2 - 0 victory over pittsburgh pirates on tuesday. [SEP] some were killed in the region early last year when taliban missiles hit a british vessel, but some more are handed over to afghanistan, the ministry of defence said. [SEP] but no one might be upset by the cia's recent attempt to protect its long - earned reputation with a [SEP]"}
+{"type": "sample", "index": 58, "raw_text": "[CLS] 30 miles ) south of the nation ' s northern border. [SEP] \" while it is possible that some other forms of the disease could be cured through the cultural changes, as well as it difficult to think about it, \" musser said. [SEP] albany n. y., sept. [SEP] the young man... [SEP] \" if we do this, we will then get it back on our hands, \" she told reuters, who was born by her grandparents in the central valley of north lalande province, where her father ' s home was. [SEP] the u. s. circuit court of appeals, the division of federal [SEP]", "detok_text": "[CLS] 30 miles ) south of the nation's northern border. [SEP] \"while it is possible that some other forms of the disease could be cured through the cultural changes, as well as it difficult to think about it,\" musser said. [SEP] albany n. y., sept. [SEP] the young man... [SEP] \"if we do this, we will then get it back on our hands,\" she told reuters, who was born by her grandparents in the central valley of north lalande province, where her father's home was. [SEP] the u. s. circuit court of appeals, the division of federal [SEP]"}
+{"type": "sample", "index": 59, "raw_text": "[CLS] a local official in the northwestern province of nangarhar. [SEP] \" by the end of 2008, we had been convinced that the majority of the people involved were very confident that they will happen, \" he said. [SEP] but it is also very difficult to handle. [SEP] they were not hospitalised, and a judge said their condition was \" excellent. \" [SEP] the taliban in kabul, afghanistan, killed 11, 000 women after the u. s. army began combating militants sept. [SEP] meanwhile, serbian champion djokovic, who was losing one of three games with a virus, lost 3 - 0 in the second to clinch [SEP]", "detok_text": "[CLS] a local official in the northwestern province of nangarhar. [SEP] \"by the end of 2008, we had been convinced that the majority of the people involved were very confident that they will happen,\" he said. [SEP] but it is also very difficult to handle. [SEP] they were not hospitalised, and a judge said their condition was \"excellent.\" [SEP] the taliban in kabul, afghanistan, killed 11, 000 women after the u. s. army began combating militants sept. [SEP] meanwhile, serbian champion djokovic, who was losing one of three games with a virus, lost 3 - 0 in the second to clinch [SEP]"}
+{"type": "sample", "index": 60, "raw_text": "[CLS] 2008. [SEP] the main draw, third, second seed roddick and the other champion, andy roddick, was second and seventh. [SEP] thousands of candidates would be eligible to run in the republican primary in the 2008 presidential election, and go to the superdelegates for a popular vote. [SEP] madrid ( reuters ) - the french open took the first and second seeds on tuesday, and the fourth - seeded serbian rallied past samantha stosur 3 - 6 6 - 1 6 - 4, 6 - 0 6 - 4 win in two hours, 53 minutes. [SEP] the woman, who was taken to the hospital, was treated [SEP]", "detok_text": "[CLS] 2008. [SEP] the main draw, third, second seed roddick and the other champion, andy roddick, was second and seventh. [SEP] thousands of candidates would be eligible to run in the republican primary in the 2008 presidential election, and go to the superdelegates for a popular vote. [SEP] madrid (reuters) - the french open took the first and second seeds on tuesday, and the fourth - seeded serbian rallied past samantha stosur 3 - 6 6 - 1 6 - 4, 6 - 0 6 - 4 win in two hours, 53 minutes. [SEP] the woman, who was taken to the hospital, was treated [SEP]"}
+{"type": "sample", "index": 61, "raw_text": "[CLS] upsetting the economy. [SEP] marseille ' s jean - claude g canale beat marseille ' s sami betoneri for a penalty, leaving substitute christoph metzler injured. [SEP] the military officials said last week that the offensive has resulted in 1, 500 deaths of afghan militants over the past two weeks. [SEP] the changes have been widely anticipated, with a relatively small and large effect in the population leading to a bigger increase in incomes. [SEP] he had fired two of four rounds and shot a 5 - under 66 to take the lead. [SEP] the study was conducted by the group ' s global survey. [SEP] the report was carried by the [SEP]", "detok_text": "[CLS] upsetting the economy. [SEP] marseille's jean - claude g canale beat marseille's sami betoneri for a penalty, leaving substitute christoph metzler injured. [SEP] the military officials said last week that the offensive has resulted in 1, 500 deaths of afghan militants over the past two weeks. [SEP] the changes have been widely anticipated, with a relatively small and large effect in the population leading to a bigger increase in incomes. [SEP] he had fired two of four rounds and shot a 5 - under 66 to take the lead. [SEP] the study was conducted by the group's global survey. [SEP] the report was carried by the [SEP]"}
+{"type": "sample", "index": 62, "raw_text": "[CLS] under the terms of the deal. [SEP] the results should come from a severe version of the current virus in the united states and it could trigger a slowdown of the situation in the rest of asia, health experts said. [SEP] the result is an exhaust of history, a fascinating series of conversations and analyses. [SEP] in january, the 26 - - year - old winger joined sunderland from west bromwich albion in 2008 and agreed a new deal worth £1. 25 million. [SEP] calififas, calif. - - general motors co. on thursday released its first quarter and operating outlook, saying it is trying to salvage a long slump [SEP]", "detok_text": "[CLS] under the terms of the deal. [SEP] the results should come from a severe version of the current virus in the united states and it could trigger a slowdown of the situation in the rest of asia, health experts said. [SEP] the result is an exhaust of history, a fascinating series of conversations and analyses. [SEP] in january, the 26 - - year - old winger joined sunderland from west bromwich albion in 2008 and agreed a new deal worth £1. 25 million. [SEP] calififas, calif. - - general motors co. on thursday released its first quarter and operating outlook, saying it is trying to salvage a long slump [SEP]"}
+{"type": "sample", "index": 63, "raw_text": "[CLS]urers. [SEP] the aircraft does not have the full - in crew to make it back to the airport. [SEP] \" i ' ve had a great season, i haven ' t had one in six months, so thank god, \" he said. [SEP] the american hit form earlier this year in melbourne, winning for the first time since 1999 and then edling through to the final of the tournament at indian wells in the final. [SEP] liverpool beat hernecht 1 - 0 in the uefa cup final and are expected to beat fourth - placed zenit st petersburg to move up by four points. [SEP] but from the start, the [SEP]", "detok_text": "[CLS]urers. [SEP] the aircraft does not have the full - in crew to make it back to the airport. [SEP] \"i've had a great season, i haven't had one in six months, so thank god,\" he said. [SEP] the american hit form earlier this year in melbourne, winning for the first time since 1999 and then edling through to the final of the tournament at indian wells in the final. [SEP] liverpool beat hernecht 1 - 0 in the uefa cup final and are expected to beat fourth - placed zenit st petersburg to move up by four points. [SEP] but from the start, the [SEP]"}

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_temp_schedule_128steps_n64/const1p45_c256_detok_raw_samples.txt

@@ -0,0 +1,230 @@
+const1p45_c256_detok
+{
+  "type": "summary",
+  "name": "const1p45_c256",
+  "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt",
+  "step": 168000,
+  "decode": {
+    "kind": "categorical_fullvocab_temp_schedule",
+    "config": "const1p45_c256",
+    "steps": 128,
+    "model_t_mode": "post",
+    "support_power": 1.0,
+    "semantic_power": 1.0,
+    "temp_start": 1.45,
+    "temp_end": 1.45,
+    "temp_schedule": "const",
+    "concentration_min": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 46.167692609958465,
+    "nll_per_token": 3.8322802593107435,
+    "tokens": 9678
+  },
+  "diversity": {
+    "sample_entropy": 4.203627610836947,
+    "unique_tokens": 1868,
+    "token_count": 8192,
+    "distinct_1": 0.22802734375,
+    "distinct_2": 0.7084153543307087,
+    "top_token_mass": 0.0589599609375
+  }
+}
+
+===== sample 000 =====
+[CLS] led the sec and top defense in atlanta from 1998 to 2004. [SEP] injury - hit scotland made up an early half - time goal from distance after michael chopra sent in a fantastic drive, palming paul brown's corner over the bar. [SEP] trading in new york, particularly the new york region, was very weak, said david ross, an independent strategist with deutsche securities in new york city. [SEP] however, the second stage for the death had to be announced at shakira's official home on thursday. [SEP] " i'm trying to imagine this could well have been drawn up. [SEP] (ap) - [SEP]
+
+===== sample 001 =====
+[CLS] the national age of 65 at 5. 6 per cent of people the same age limit in south africa and japan. [SEP] elizabeth wihm died at the hotel in buffalo, n. y., tuesday, 26 december 2002. [SEP] it was wrong, he said. [SEP] this entry was posted by hume on tuesday, august 30th, 2009 at 4: 51 and is filed under capital markets, capital markets. [SEP] some of the deals paid to small small business companies paid to buy new homes have proved negative. [SEP] "everything knows," he said in a telephone interview. [SEP] the agency would not say where the data was placed in [SEP]
+
+===== sample 002 =====
+[CLS] lost the first point on serve but could make three break points, and held to 6 - 2, 3 - all. [SEP] at the top of the standings, the taxpayers are likely to get the total equivalent of a few of dollars to gm's common shares. [SEP] that's less than saturday's thrashing of bolton, whose team were brought down by arsenal on october 5. [SEP] "one thing we have to do is to start round the summer's world cup schedule for england and then we' have a big game to win," he said. [SEP] we have a much more educated and dynamic middle class, [SEP]
+
+===== sample 003 =====
+[CLS] died as she called for a fight to save her. [SEP] thousands of american visitors are expected to travel into canada. [SEP] last year 55 mexicans died from swine flu virus and about one - third of the deaths is attributed to swine flu, mexico's national emergency department reported. [SEP] he then made robben's goal that put ireland ahead, and after four minutes, scott thomas scored twice, while stephen mcshane picked up a penalty kick in the 3 - 2 draw, while david wallace fired powerfully into the net with 10 minutes left, before the visitors combined to finish matters. [SEP] but after 24 hours [SEP]
+
+===== sample 004 =====
+[CLS]'s hold away from darra. [SEP] saturday, and later the u. s. military launched the heavy rocket fire, hitting the compound and several afghan soldiers by helicopter. [SEP] miami (reuters) - french open champion elena dementieva missed out on the opening round at the u. s. open tournament on sunday. [SEP] " they think we've heard of a good record. [SEP] the cubs gave up the first two outs in the first, and with the right - hander counting the ball on the relievers, the cubs could have won 2 - 0. [SEP] in fact, what do you call a small [SEP]
+
+===== sample 005 =====
+[CLS] tuesday's meeting. [SEP] livni's top aide is a leader of israel's labor union (rad), which comes from the governing coalition of 27 coalition members, including the people's party, the very powerful wing of the ruling party. [SEP] bridge, 38, featured in three out - form games when united play home to chelsea in april and then was later suspended by football's governing body, the former club playing one - day internationals during the current premier league campaign. [SEP] some one - quarter - points behind their city rivals wigan, who lie fifth in the table, arsenal have won 15 league games [SEP]
+
+===== sample 006 =====
+[CLS]. s. military strategy against taliban insurgents. [SEP] the cost takes up to £200, so finding the house can cost £25 more. [SEP] she was with friends, just not getting enough together. [SEP] the u. s. military said at least 37 civilians were killed in the operation, including three soldiers, and more afghan civilians were killed in insurgent operations in the same month of june earlier this month. [SEP] the second seed lost in the third set and 8 - 0 in the opening set at 5 - 3, but went 6 - 4 down in the third set, going 4 - 0 down. [SEP] they had struggled for [SEP]
+
+===== sample 007 =====
+[CLS] staff, two men and a young irish man, are being transferred to a hospital in bristol for treatment. [SEP] the war took place in may 2008, in which 300, 000 died, killing 6, 000 people. [SEP] yesterday, both candidates also announced that they would make the running. [SEP] " there is something beyond doubt, that that was the intention to kill in the future and never to be considered. [SEP] in a july 2007 report, federal officials said they believe it's possible that a computer system's radar system failed to shed enough information on that part of the sky. [SEP] over the years, it became clear to [SEP]
+
+===== sample 008 =====
+[CLS] he was trying hard to tackle. [SEP] moya was 60 when he made his f1 debut in 2002 but the 23 - year - old had to retire with the world title in front of him. [SEP] her father was jailed in july 2006, and quickly became the sport's governing body. [SEP] i think it is not a great deal at this point. [SEP] no. 16 federer has lost more than 100 pounds overall, with earnings of between $11, 000 and $18, 000 this year. [SEP] the change would allow federal regulators to share losses in the bank's toxic assets to the rest of the country, while it [SEP]
+
+===== sample 009 =====
+[CLS]. [SEP] neil edmonds, 33, was arrested by the us authorities and booked on a plane to the uk, and andrew smith, 27, arrested in new zealand after returning in march from the trip in barbados, was reported missing. [SEP] i did not believe it, " she said. [SEP] murray's absence will make it easy for murray to see how he can play time to his advantage. [SEP] a small fishing boat and its three other crew have been rescued from the sea off dorset. [SEP] in the second quarter, goldman lost only 2. 1 per cent of its net assets under its capital fund from its peak in 2007 [SEP]
+
+===== sample 010 =====
+[CLS] - of - 10 ) with no chances to stay. [SEP] no surprise, george. "[SEP] the story was a terrible start, and only changed his mind. [SEP] some 240 people were waiting at polling booths in the southern province of buner, a number that officials said were among the 44 - year - old casualties of a series of strikes last week. [SEP] the health department's center for disease control has said the rate of deaths is likely to end next year, despite a gloomy prediction that the flu outbreaks may be hitting people. [SEP] dr brown said:" the preliminary work and quality should be reviewed as it is [SEP]
+
+===== sample 011 =====
+[CLS] president - obama's campaign receives the democratic nomination from clinton's presidential campaign and spends $24 billion per year to cover a $5 million bailout bill, clinton said. [SEP] he walked out, and i was just one hundred feet away. [SEP] there was no suggestion of bomb - making at the start of this match that left him scratching his head. [SEP] you'll be aware of the violence. [SEP] or maybe just ride his bicycle. [SEP] now, though, his time goes by more than 10 points from the top of the opening gate. [SEP] they told me that they're ready to work out a measure of [SEP]
+
+===== sample 012 =====
+[CLS] he said. [SEP] no choice but to vote. [SEP] but some pro - obama democrats are still nervous about taking their party to the polls. [SEP] but following saturday's decision, obama formally dropped his support for that provision. [SEP] keefer was chosen in the fourth round by the yankees, according to an e - mail to the tabloids. [SEP] the england international was the winner of five major titles in the england series for more than 50 years. [SEP] he was struck several times with no injuries and his father dropped the gun. [SEP] that's no accident. [SEP] motorola, the world's largest phone maker, is [SEP]
+
+===== sample 013 =====
+[CLS] time, "said l' oreal. [SEP] the times has compiled records for a total of 36 people who died in north korea in the early 1950s and who died in 738. [SEP] he was denied by the israeli prime minister ehud olmert by a news agency that he had suffered a tough campaign and had never asked for the withdrawal of his forces during his presidency in 2002. [SEP] the dems had 53 percent of the vote cast in a six - way race compared with 28 percent in the earlier primaries and florida. [SEP]" i'm strong and competitive, and it's worth paying off. [SEP] she ' [SEP]
+
+===== sample 014 =====
+[CLS]ckabee, who he said had cast him as a figure in the battle for the nomination. [SEP] it is time to finalise the line - up. [SEP] batting disappointingly at the end, helped by michael clarke's 76 for his first test, collingwood, too, played a long over - drive and led england to a surprise win. [SEP] the percentage of young people taking work aged 60 to 65 at this rate is up by 6. 7 per cent on the year before. [SEP] also, only one hundred billion kr4bn will be issued by the company this year. [SEP] on march 12 i asked the bbc [SEP]
+
+===== sample 015 =====
+[CLS] study revealed that the higher - education women were more likely to develop breast cancer with a different number of adults - - although dna analyses failed to show that the risk was greater for the group. [SEP] the former governor is a contrast to the rest of his rivals. [SEP] 19. [SEP] 5 - 11 p. m. [SEP] in european markets, however, germany's asx equity index, which pummeled the euro and against the dollar, rose 0. 3 percent. [SEP] in the years up to power, 24 were members in the opposition the liberal democrats and a leader in the liberal democratic party. [SEP] birmingham's hopes [SEP]
+
+===== sample 016 =====
+[CLS] refused to take orders to strike against the will of the troops. [SEP] it will only take two weeks' time for the results to be made on a full basis followed by fresh evidence from the two parties. [SEP] "the tough part of the task that i'm facing right now, which is not for my players, which i'm not sure, but in time, i'll lose. [SEP] early west yorkshire police said the fire was discovered near the crash site off on victoria road and started on tuesday. [SEP]" i really have difficulties. [SEP] the german generals, part of the german military serving mainly in europe, said [SEP]
+
+===== sample 017 =====
+[CLS] [SEP] federer dropped shots in the first set in the first game of his career as the 25th - ranked swiss overpowered the eighth - ranked american 5 - 7 here on monday. [SEP] the iowa poll is a highly likely predictor based on an opinion poll reported by the new york times on april 7, 2009. [SEP] he had to accept that he has not won, and that it was that he was able to beat his opponents, because he had the worst thing for him, not himself. [SEP] 15, 1943. [SEP] officers asked them to give their full names because they wanted to see the recovery of mr krame. [SEP] [SEP]
+
+===== sample 018 =====
+[CLS] war crimes and asked for her to serve her sentence. [SEP] more than 100 people have died in the attacks since august. [SEP] bring the parties together. [SEP] he has a place at liverpool's liberty stadium, training for sunday's game against cardiff city. [SEP] "i think it was probably the only thing that saved his life, and i think he was very thankful he was out there and seeing his son," said kevin jackson, kennedy's brother. [SEP] but the reaction was over. [SEP] the best side to beat federer come a year after winning the title in 2003 - 2007 and winning the tournament in 2008. [SEP] [SEP]
+
+===== sample 019 =====
+[CLS] close, they were already ahead by four, but came out later to finish up 40 - 1, after a sparkling second innings. [SEP] but in the opening set, the second - seeded broke again on serve, holding to love to break, before the german broke serve in the third set and pulled ahead 6 - 0 4 - 1. [SEP] the first scientific issue, "big time: the history of japan," was written by u. s. academic and history professor. [SEP] diabe got ballack's cross, and was forced to put himself on his left foot after turning to a long - range chance by matthew wright [SEP]
+
+===== sample 020 =====
+[CLS] said tuesday. [SEP] but he shouldn't have turned to the need to campaign, as he did in iowa on friday and monday. [SEP] rik is also known for the high - tech development of north korea's own dmj missile jetliners. [SEP] he had a wonderful husband, after all. [SEP] the soldiers were both happy and healthy, with just one eye on the body. [SEP] the euro index fell 5. 97 percent, or 300, 1. 2 points, at 1, 450. 10. [SEP] but for those who really want to be independent, the fact that it is someone who is most popular [SEP]
+
+===== sample 021 =====
+[CLS] the ball to hit the leg, the arm and leg. [SEP] even the firm's head of retail research, david crazer, refused to speak to journalists. [SEP] after months of crosschiping into the final stages, the englishman managed to run impressively and wrapped up his win by landing a brace on his left shoulder. [SEP] and though we know that he has been to the country, he is still in the middle east. [SEP] he saved three match points in the fourth game before losing - - 6 - 0 - - with two consecutive third - set breaks in the season - opening third set. [SEP] the hurricanes are [SEP]
+
+===== sample 022 =====
+[CLS] hour over three hours. [SEP] "the overall one of the reasons is they're going to sign him for the job. [SEP] he doesn't want to do it on his own terms; he can leave the money thrown away because he's making any of what he's supposed to spend. [SEP] he didn't take his phone to me before midnight but he said i was helping him in the evening. [SEP]" they read, listen, go, watch, just kind of say, say, ' i'm sorry, you're wrong. ' [SEP] after 48 hours and counting, the defense failed to reach [SEP]
+
+===== sample 023 =====
+[CLS] report. [SEP] the left - hander gave up just five hits in his last 11 innings, and may have won his fourth straight start as maine attempted to throw away the ball before losing all four hits. [SEP] they were arrested after a police driver was believed to have taken him to a police station. [SEP] the body of her 17 - year - old daughter, emily edwards, 37, from warrenton had been left tied up during the final five months of the trial, the court heard. [SEP] i and i had lived in the same area long ago and knew i was too young to let my friends go. [SEP] the president is [SEP]
+
+===== sample 024 =====
+[CLS] thursday. [SEP] this success, whatever the case, leaves us in the midst of a big recession. [SEP] but since mr. brown's resignation last november, gordon brown, the prime minister, has become the political heart of the party over a generation of time. [SEP] the man is said to be in his late teens, about about 6ft 4in, wearing grey hair. [SEP] wednesday's economic output report is just not surprising. [SEP] ucla rookie aaron schafer had a 58 - yard drive, put up a td run to put the bruins on track and make it 21 - 12 by taking the second play of the [SEP]
+
+===== sample 025 =====
+[CLS] to diagnose disease, and increasingly use non - food supplements. [SEP] we have got a lot of work to do - - to see what our stand - up comedians aren't like. [SEP] "it's not a great team," says ferguson. [SEP] it is important to know whether to be a nuclear weapons power? [SEP] "it was the experience of winning on the court, i feel good," williams said. [SEP] maybe 10 years ago...... i doubt everyone was surprised. [SEP] another officer, 18, was shot in the abdomen. [SEP] now, the problem is solved. [SEP] that [SEP]
+
+===== sample 026 =====
+[CLS], his children, said that he did not know about whether his father was entitled to the same rights. [SEP] the two rooms start out at $39. [SEP] industry leaders have lambasted the restructuring proposals and begun taking a view of what's being done by the u. s. government, making them public in two visits to the industry earlier this week. [SEP] "it is beyond the interest of the many that understanding of the extra importance of this provision is not surprising either because of the nature of the change in the quality of life," the report said. [SEP] the company's range of electronic communications services, including [SEP]
+
+===== sample 027 =====
+[CLS]. [SEP] the man was in his late thirties or early twenties and is thought to have received similar injuries from the local area. [SEP] when compared to a cross - country specialist, she flashed a sign of losing her ability to compete, the figure that is on record. [SEP] but wolves haven't been able to secure promotion, while arsenal have made sure they equalise and gareth bales are left behind and manager mick mccarthy is happy to back the experienced debutant steven wilson. [SEP] most of the roads had remained in place for a half hour and for more than a day. [SEP] dallas was 2 - 2 all season, and the [SEP]
+
+===== sample 028 =====
+[CLS] winning streak in august. [SEP] 1438: england striker and striker rooney saves the equaliser to keep a hold of his goalbound winning attempt from the post. [SEP] and by may, the floor of our darkened house could be nearly complete. [SEP] india's mayor said shinkom was on the national party's list of new seats early tuesday. [SEP] her insurance company told her to take the test. [SEP] while it was profoundly difficult and tasti for the work of men and women, it gave the rest of its history to women. [SEP] news of russia's latest missile launch on tuesday has provided a reason to keep [SEP]
+
+===== sample 029 =====
+[CLS]'s world championship in 2005, died on 22 november when he resumed his playing career. [SEP] michael jackson's publicist peter told the associated press thursday that he had sued one of the singer's dead sons. [SEP] the other one in five is labour, with a lot of money on their hands, but in very small numbers - a few are not powerful enough to win the right to vote. [SEP] the officials said one person was injured in the crash and the woman died of natural causes shortly after the accident. [SEP] it's what i have not expected to see him. [SEP] he claimed that jarkolvic was [SEP]
+
+===== sample 030 =====
+[CLS] williams lost only five points in the opening set and scored twice as she went to 6 - 0. [SEP] you put a date on "the hills" or just be catchy? 8 what would you want to be part of the game? [SEP] " in the past, i've never seen an impact on the market again. [SEP] it is also possible that because the superdels, the super are the incumbents, the entire democratic party vote will fall. [SEP] let's note that i'm confident that this is, for the nature of the campaign, people. [SEP] when the series began it will be felt like [SEP]
+
+===== sample 031 =====
+[CLS] claims that they got as much as $75 million in tax aid. [SEP] the portuguese midfielder has finished all stages of the champions league campaign but had been the main figure in his premier league debut at manchester united. [SEP] "i couldn't do all my best to get a job in the game because i could not do a lot for them," he said. [SEP] the toll was unclear but the extent of the injuries began to emerge wednesday, xinhua report said. [SEP] "i'm in a bad position, that's pretty unlikely, either," he said. [SEP] the 15 - year - old u. [SEP]
+
+===== sample 032 =====
+[CLS] government's role in mediating with the militants, a group often viewed as one of the key to winning elections. [SEP] the uk's largest national energy group, said it welcomes the offer. [SEP] "when i'm in the field i'm going to play today i've had loads of pretty exciting stuff," said nadal. [SEP] the democrats are at the top of the feuding house and senate of their party, and i'm very surprised that gop senate chairman joseph k.unu, d - minn., might not be back in a very long time. [SEP] it was [SEP]
+
+===== sample 033 =====
+[CLS]. [SEP] boston police spokesman. joseph b. williams said that about 2, 000 patients listed by the commission are not receiving treatment. [SEP] so how did this offer appear on the table? [SEP] although isner's sixth victory was made at all last year, along with his third victory in 2008 and one of 16 challengers, there is still a lot of space of time to even hold the number one ranking level. [SEP] it is clear, however, that the most manageable condition of returning to work today is the need for a focus on what government can do and what it takes to improve the situation in the economy and bring [SEP]
+
+===== sample 034 =====
+[CLS] down 8 cents at $1. 948 to $1. 25 a gallon. [SEP] among the top gainers however, britain's ftse 100 index fell 4. 3 per cent and in the afternoon trading, russia's index lost 6. 8 per cent. [SEP] the only break to end the game was lost by griejeant serving, serving again at the start of the first match went up 4 - 1, but then lost to kowrdny at the start of the second set with a long rally, and henin had a break point for the 19 - year - old belgian. [SEP] the only [SEP]
+
+===== sample 035 =====
+[CLS] education to help students facing extra costs. [SEP] gordon brown was one of the first mps on the government today to make much of the debate before parliament about the impact of his victory in the general election election. [SEP] he decided that the coalition would remain in office until early next year, including whether to suspend his seat or resign. [SEP] when this happens there's real doubt that's likely will not put you off. [SEP] no. 41 williams then rolled over eighth - seeded ali kleybanova 6 - 2, 6 - 4. [SEP] " you want to know what should have happened to the way that we came down and [SEP]
+
+===== sample 036 =====
+[CLS] record. [SEP] on tuesday, british foreign david miliband said the u. s. and its allies were calling for the inquiry. [SEP] his authors have proved that at the end of an art form, one used to question whether the novel has lost its fascination with modern art. [SEP] yang was reported having held a father's hand at his neck after a meeting with the u. s. olympic men's team. [SEP] but england came into the game with a premier league win to the bottom side and scott brown had a goal header from five yards out to have the score level 4 - 0. [SEP] they suffered a sustained [SEP]
+
+===== sample 037 =====
+[CLS] expect him to take an unsociad position on these issues. [SEP] at the time of the budget, mrs cameron warned the tory government that changing the £1 per person a year tax for families would have to pay for the income tax bill to the top 20, 000 income earner, at a cost of £86. [SEP] at the top of that, 95 percent of the world's new car companies in the u. s. lost 19. 6 million jobs. [SEP] scola saved the visitors from an eight - goal deficit in the final half, but four first - half headers to pull within 10 points with [SEP]
+
+===== sample 038 =====
+[CLS] [SEP] the sabres have lost three straight, four of five overall, while boston has five goals in five games for the place overall in the conference.... [SEP] the small business is in distress. [SEP] cameron had also had to get back to labour's heartlands, where he would keep his temper and vote again. [SEP] if the subsidies are fair and fair with the insurers and premiums, the fragmentation of the market is not a problem. [SEP] everyone else gets a bad deal for services where he can save a bit of money, especially for the consumer. [SEP] " on wednesday night, perhaps 30, 000 of [SEP]
+
+===== sample 039 =====
+[CLS] over the issue of the nomination. [SEP] if he wants to play, we want to see his best friend and perhaps son of the country play with his family. [SEP] williams and the czechs failed to advance on thursday's last four until the second round. [SEP] the island runs around the islands and is about about 12 miles to the southern coast of the california national islands, which is about 13 times the size of a motorway. [SEP] more than 20 people died there in the fall, while another remained in hospital. [SEP] the study appears in the department of medicine's study appeared in the latest issue of nature. [SEP] while it [SEP]
+
+===== sample 040 =====
+[CLS] that was when we could get to the right place or go to another place, " he wrote. [SEP] boston could catch up for the rangers, 2 - 0, in the first, and martin brodeur held off a 1 - 1 deficit and lost a short - handed lead. [SEP] u. s. olympic champion jason breckner, who won the 125cc in 2007, the tour de france and 2006 olympics, was third on a fast track in 1 minute 40. 42 seconds, then got rolling with a goalless penalty after stoner of france won a race he could have started a day earlier. [SEP] 17 - [SEP]
+
+===== sample 041 =====
+[CLS] win was "a dream" for his generation. [SEP] the group would probably do more than ever to look up and come to life. [SEP] david cameron, the liberal opposition leader who lost a close race to him in 1997 in yesterday's election, could officially call off his second wife in this race. [SEP] he hit 7 - of - 26 shots on 25 - of - 37 shooting. [SEP] "the economy is still a pretty bear mood in the workplace, it might have been there for decades," a survey said. [SEP] at one time a leader in u. s. technology, dell slashed its fourth - quarter outlook to [SEP]
+
+===== sample 042 =====
+[CLS] so - called "shot to run" a woman who wanted to drive from london's streets of pubs and shops. [SEP] the prime minister's spokesman said the office did not release a name, but that he would be in the united states and try to be the prime minister. [SEP] the sale of the course, which comes the fifth year since the new tiger was put on display at hong kong's golf club, will not be open until early november. [SEP] today, the numbers of students, teachers and parents at stand - bys are all too high. [SEP] but a lot of wh's don't [SEP]
+
+===== sample 043 =====
+[CLS] based energy firm. [SEP] "it could be a fact - check, which is required by the age of 35, especially in the workplace," according to the researchers. [SEP] in the third match of the tournament, world number one scotland's robert green, the leader after a first - round 68, fell three times on his third attempt. [SEP] but it does not change the debate. [SEP] this figure was too low partly because of the economic impact of online trading from us retailers. [SEP] as a child, auer had volunteered for service as a female soldier who died at a military air base in iraq. [SEP] their album, [SEP]
+
+===== sample 044 =====
+[CLS] losing on friday - although the americans had never won in the semi - finals of their previous major tournaments. [SEP] edt on friday 10, 2007. [SEP] and in a 14 - 7 tie, the giants had failed to move the ball out again when the jets picked up the fourth. [SEP] the man has been taken to newcastle general hospital. [SEP] it's back around 70 million years ago, when the dinosaurs lived at a different age. [SEP] the final draft report will be made this week at a special general meeting and a public meeting of the committee. [SEP] thompson, however, is played by a film director who said he will [SEP]
+
+===== sample 045 =====
+[CLS] before parliament can make a decision, but it is up to the opposition. [SEP] health officials said it was unclear whether the 4 - year - old had contracted the virus after saturday's suicide attack. [SEP] his death has been ruled as homicide and a coroner prepared to release a cause of death is expected to hear. [SEP] i had a choice now. [SEP] federer said roger federer would play today and could decide the next team today. [SEP] liverpool's javier agar scored the late goal with 55 seconds left to edge champions germany 2 - 2 and one point behind fourth - place bordeaux in their champions league match. [SEP] at the second [SEP]
+
+===== sample 046 =====
+[CLS] expected biden to meet the white house to discuss the issue of the parameters for the release of the final budget report, which are expected to be released for consideration later this week. [SEP] obama's announcement late sunday night that he would campaign with a 2 - point margin needed to win the democratic primary came instead of narrowly losing himself in the november race for a second term. [SEP] but they don't drive to work and they don't have a car at all. [SEP] granted, in france, many ideas are probably quite wrong, but they might be "purest" - but they don't describe it as " [SEP]
+
+===== sample 047 =====
+[CLS] are expected to become extinct in the current year, rising from 55 in april. [SEP] the merrill investors are demanding the return of up to nearly $500 million in bonuses, according to the sec. [SEP] it would have been worse if he had had a shot or, perhaps, a penalty. [SEP] researchers found improvements in the second study, which followed patients who had no information about their diet changes just because of their activities for more than four months. [SEP] we have no idea what is wrong with the pitch. [SEP] since april, the government's security forces have killed 82 people, according to local health officials in the worst areas. [SEP]
+
+===== sample 048 =====
+[CLS] factors, "survivors with breast cancer may face a focus on women's health and children's health," said the study, which reported sunday. [SEP] but the truth is a simple and open question. [SEP] "it is really a very play in business," said the prime minister, who is still high in the business area of the downing street. [SEP] but that's because they haven't really had a look at the details. [SEP] the tigers had a strong start in the east and moved back from the home opener in the ninth to earn a playoff berth for the first time in the division. [SEP] since 1990 [SEP]
+
+===== sample 049 =====
+[CLS] wednesday. [SEP] philadelphia had a huge first - half lead and 9. 8 points behind in the half. [SEP] two of the soldiers were hospitalized friday, the report said. [SEP] if you can spend one - dollar amount of time checking on a bad idea, there's a lot of upside to this. [SEP] obama wished the terrorists didn't end up in jail just for the united states. [SEP] he says the only way to play is to get elected. [SEP] and their side are within 15 - points of winning a first title in the semi - final as their season ends without defeat. [SEP] there's time for everyone to [SEP]
+
+===== sample 050 =====
+[CLS] home. [SEP] yes, you did. [SEP] a team statement said that although the investigation was ongoing, there was "no doubt that there was significant action." [SEP] one of the dead, the first victim, michael schuster, 30, of cicero, ill., was killed in 2006. [SEP] it doesn't have much way for me to go. [SEP] congress has asked for $50 billion until march 2011, in which people can only pay insurance for their work. [SEP] it's not easy. [SEP] he was on the front line again in 2001 - - he's coming out of a little brother's nightmare. [SEP]
+
+===== sample 051 =====
+[CLS], she said. [SEP] the stourbridge dales are believed to hold the same position. [SEP] pakistan's opposition leader, morgan tsvangirai moved sunday to extroduce musharraf's defeat in the elections. [SEP] and he's crazy. [SEP] there's the first time on sunday, and the rest of the first quarter, the jets 22 - 20 on dec. [SEP] even though it exists, it hasn't had a level of growth for years. [SEP] new york is where job losses are starting to come because now i don't see a lot of them. [SEP] while russia [SEP]
+
+===== sample 052 =====
+[CLS] out fourth seed david ous 6 - 6 6 - 4, 6 - 3 later on friday. [SEP] speaking to journalists shortly after announcing his intention of retirement and dropping out of the race, raikko says he could have saved his day anyway. [SEP] that helped, and mattel had the best chance of his second bid in five days in a row to finish in the third round. [SEP] mccomb has already put england's no. 1 jersey over ireland, and france's france, to secure just one league place. [SEP] the most recent record in four years came in the 1990 - 1998 world series. [SEP] " [SEP]
+
+===== sample 053 =====
+[CLS] " into the war on the wmds. [SEP] officials said it was difficult, however, and offered no data on the numbers. [SEP] he started as a quarterback in pittsburgh in the near - destroyed baltimore hometown of baltimore and moved to florida, where he eventually became his former team professional in 2004, and then said that it looked like he's not too ready to escape his own life and death. [SEP] the judge had looked into ms. wister's family and her suicide as a result of mental illness that the court said was untaged by her guilt. [SEP] the two men were charged, the police said. [SEP]
+
+===== sample 054 =====
+[CLS] a 1 - 1 - 2 loss to the wild - card opponent. [SEP] he threw three interceptions and was sacked after an interception. [SEP] the only doubt, insolven in today's times, is that government lenders are ready to hold enough cash to do so. [SEP] a road blockade is planned. [SEP] the fires were set out at about 2000 gmt on saturday, police said. [SEP] sundaru, a 20 - year - old doctoral student, told abc news his young son was dating his hiv - positive father, who had suffered from cancer. [SEP] " it's so bad to see the car at the [SEP]
+
+===== sample 055 =====
+[CLS] streep. [SEP] french president nicolas sarkozy is set to lead the race for presidency over what mr sarkozy has described as a major international crisis. [SEP] last friday, jermain defoe scored in the seventh game against portsmouth while boss paul hart guided sunderland to a 2 - 2 victory over robin druble. [SEP] in russia's first regional election, a main united opposition newspaper said tuesday that a majority of the country's population will support putin, not the parliaments that will decide who to choose president. [SEP] imo spokesman mark storck said there would be no information on the cause of [SEP]
+
+===== sample 056 =====
+[CLS] any knowledge of what you value? [SEP] the choice of sarah palin makes for a dramatic break in one of the most behind - the - scenes campaign of sarah palin, in which the republican party struggles to win, courting state voters and faltering television ratings. [SEP] but when it's difficult to raise money and spend, it may well be a different story. [SEP] google, whose advertising accounts for up to 20 per cent of their web advertising revenue, is regarded as one of the number one brands of the national newspaper and online age. [SEP] others were able to help pay for climate change. [SEP] " it seems [SEP]
+
+===== sample 057 =====
+[CLS]. [SEP] if we do it wrong, though, will it do this week? [SEP] the city of iraq ended a five - day period for air troops deployed by the u. s. military, expressing concern that air strikes in the region could result in new death tolls for suspected foreign fighters fighting with insurgents, the times trust in london reported tuesday. [SEP] the red sox lost thousands of dollars last year as the club finished a b. a. a. - game winning streak. [SEP] the upturn had threatened to weaken on wednesday. [SEP] she also said she won't be able to offer her education and health insurance until a [SEP]
+
+===== sample 058 =====
+[CLS] series lead saturday against the pittsburgh pirates, 5 - 3. [SEP] i believe this happened with this earlier poll. [SEP] sex tourism may be part of a cultural shift, says ms starvin. [SEP] men and more women were about twice as likely to get similar care, the study found. [SEP] j. p. verlander struck three innings and lasted three innings for his first career major league rbi double, back into a slump, and was released by pittsburgh last month. [SEP] 31, his first season in position as the former no. 1 player and has won a u. s. open title and the four sectionals. [SEP] [SEP]
+
+===== sample 059 =====
+[CLS] he didn't become angry. [SEP] "at the time, they knew, there was another person who, looking at her, said they would play it, and said that they should leave," he said. [SEP] organizers said many who had made their last decision due to vote in april weren't aware that a rather high turnout was coming. [SEP] it takes about two years for his house to rise. [SEP] on thursday, men's champion davydenko won the record of the year, with nadal, who had 10 of a career high 12 points and a second - place finish. [SEP] to investors, citi [SEP]
+
+===== sample 060 =====
+[CLS], ill., and melbourne, australia, were down almost 7 percent. [SEP] they are told they give back everything they need to fight the insurgency. [SEP] four people were wounded, 10 of them died yesterday. [SEP] full of stupid lies. [SEP] the match was 2 - 2 and england went on the win for a second time at the oval. [SEP] rumours that he was not available to join the company were considered "fantasy" long before the stock market opened in january. [SEP] shares rose 3. 3 per cent after the announcement. [SEP] it runs from 8 a. m. until early saturday. [SEP] the standard & poor index, [SEP]
+
+===== sample 061 =====
+[CLS]. [SEP] the 10th - minute opener finished his 90th minute equaliser with gary richardson's goal flitting for a fine save with a shot from the bar on the half - hour. [SEP] pima, known as an open - ended institute of cultural and global health, was impressively coming out of the running. [SEP] virginia sen. robert f. mcdonnell, the co - winner of a primary that will be his last chance at the democratic seat, has faced a political challenge in losing his father's state senate seat in the republican primary, making the republican more vulnerable to the party's political future. [SEP] the [SEP]
+
+===== sample 062 =====
+[CLS] their age - related rates, the nation's leading indicator of childhood cancer and childhood cancer. [SEP] in the united states more people could become an actual flu, such as pandemic type flu, the association said. [SEP] the deal comes days after the afghan minister opened a series of public debates with nato about the issue of the election. [SEP] but the chance of living is much more expensive and more uncertain, " says dr brooks. [SEP] if the short recovery is limited, it can be very hard - lived. [SEP] this is the first time in training he has not scored a goal and is not enough to have the winning goal [SEP]
+
+===== sample 063 =====
+[CLS] election day campaign today. [SEP] one recent morning, at a school in the heights area of new york, several students were arrested but not charged while they were killed when the group tried to change their names early. [SEP] "it's amazing," says john lee, a manager at wellmane capital partners, calif., a consultancy in new york. [SEP] but they also had to forget about the mid - 1990s and tried to remember it. [SEP] children aged 11 to 14 - year - olds were not offered the money at the time when their parents were asked to play the part. [SEP] but, the washington official said [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_temp_schedule_128steps_n64/cosine_2p0_to_0p8_c256_detok_raw_samples.txt

@@ -0,0 +1,230 @@
+cosine_2p0_to_0p8_c256_detok
+{
+  "type": "summary",
+  "name": "cosine_2p0_to_0p8_c256",
+  "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt",
+  "step": 168000,
+  "decode": {
+    "kind": "categorical_fullvocab_temp_schedule",
+    "config": "cosine_2p0_to_0p8_c256",
+    "steps": 128,
+    "model_t_mode": "post",
+    "support_power": 1.0,
+    "semantic_power": 1.0,
+    "temp_start": 2.0,
+    "temp_end": 0.8,
+    "temp_schedule": "cosine",
+    "concentration_min": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 52.61771836855152,
+    "nll_per_token": 3.963052914135212,
+    "tokens": 9670
+  },
+  "diversity": {
+    "sample_entropy": 4.229658640820065,
+    "unique_tokens": 1833,
+    "token_count": 8192,
+    "distinct_1": 0.2237548828125,
+    "distinct_2": 0.7153051181102362,
+    "top_token_mass": 0.052490234375
+  }
+}
+
+===== sample 000 =====
+[CLS] are finding an easy way to get their money back on track. [SEP] "i really want to win this year," he said. [SEP] he had to close in the next game against ivanovic, putting him ahead 40 - 0 and taking the lead almost two all the way to set point. [SEP] "i was scared on my face," he said, speaking with a toothy smile. [SEP] kevin suppan struck out five for the rangers, improving to 6 - 0, 4. 5 era. [SEP] but they came away with a couple of second - half goals from david monza, lowly nderiay [SEP]
+
+===== sample 001 =====
+[CLS]rsteing said. [SEP] button has won eight of his last seven wins, including seven in the san siro, including in a year's championship in mid - july at mormio yesterday, when the spaniard last year won the sixth stage for the 2007 season, finishing just four seconds back. [SEP] southers, 26, finished third and seventh. [SEP] "i was in a crash in a british village on october 19 2006 and i had before christmas to buy a car which said someone that was actually driving it," he said in his radio interview. [SEP] the military would not say if the crash was involved in [SEP]
+
+===== sample 002 =====
+[CLS] said the flyover for the event was "in due course," and the airline had told pilots to come home. [SEP] at pittsburgh, the fifth - seeded mets led 1 - 0 for the ninth win in two games this season and seventh of eight league chances. [SEP] it's less than today's exhausting stuff. [SEP] the sch - 80 aircraft went down at about 2: 30 p. m, then went down. [SEP] i can't take your whole life for your good. [SEP] they came a little closer, and we can win the game. [SEP] still, the more expensive and out - of - [SEP]
+
+===== sample 003 =====
+[CLS] much as $4, 000. [SEP] be worried about cutting off your budget. [SEP] the new president is retiring the beginning of april, according to the general staff of brown books and a co - member of the special executive committee of the business publishing association involved in the company's online business. [SEP] also friday, france's martin vaudej bravely won the seventh masters doubles title sunday, 6 - 5 3 - 6, 7 - 5 after holding off britain's andy murray, defeating the unseeded phaun 6 - 4. [SEP] experts said the goal was to increase the number of " sick people infected [SEP]
+
+===== sample 004 =====
+[CLS]. s. troops in afghanistan. [SEP] after the attack monday, the u. s. military also took control of the town of marja and left 16 dead after six hours of the fighting, the source who did not return a call told reuters, speaking on condition of anony. [SEP] while 88 percent of men live aged 60 and older and have alzheimer's, about 4 percent of adults do not have a normal or lower risk of a severe disease to death by the next day, such as death or stroke, increased weight loss, loss of weight and body count ). [SEP] never mind, how do you run a city [SEP]
+
+===== sample 005 =====
+[CLS] saturday's motogp series title and will finish just nine points ahead of britain's world champion lewis hamilton so the mclaren team can focus to focus on the race. [SEP] but next time, he knows a little more about making it seem astonishingly difficult. [SEP] bridge, 38, featured as the most - form midfield player of his motherwell side and, despite, five minutes into this season's final triumph, the gunners continued to top - class form during the opening premier league campaign. [SEP] with five - goal losing games in their four home games, the visitors were back in extra - time and could win a goal [SEP]
+
+===== sample 006 =====
+[CLS]. [SEP] copenhagen, 2008; copenhagen, florence, 2004; paris, april 7 - 6; aug 11 - oct 2, copenhagen, frankfurt; july 12; paris, 2006; paris, 2007; april 11 - 18, 2005; and at least 14, 500 north of copenhagen, berlin and 19 other countries, all in 2006 and 2007. [SEP] surrey police said the incident, a serious heart attack, happened at about 2000 gmt, on bridge lane shut down in the early part of the town. [SEP] " i remember it was with 12 young people and 10 children, and there's just about people having their children taken [SEP]
+
+===== sample 007 =====
+[CLS] comment on the claim whether the move is part of labour's decision to come in early on thursday. [SEP] mrs taylor' home in county down, west yorkshire, described hearing from a friend sunday night that the disappearance of a fourth, two children who was murdered was ruled a suicide. [SEP] " there is a surprise because, by that two hours, there is an amazing amount of time but if we saw our daughter in the wrong way, they don't. [SEP] chelsea threatened twice with daniel nani's low drive, but ivanovic dropped to his left on the rebound. [SEP] over the years, it became clear to [SEP]
+
+===== sample 008 =====
+[CLS] he was the last to die in july. [SEP] lyon had a groundout and one out in the fourth, but washington's santana almost left his mark after only arriving in the sixth inning. [SEP] i was more told that they would face a prosecution and to worry about an adverse outcome. [SEP] the blood test was a test to see if his fighters can fight for the wbf title, with their near - certainty rival joe calzaghe confirming whether he would quit the ring for this year. [SEP] i believe his victim was right. [SEP] police have treated ledger's death as a homicide ahead of the event, which has [SEP]
+
+===== sample 009 =====
+[CLS]. [SEP] police said the burglar was taken at a detached house in hill on the island on sunday. [SEP] it really was about time. [SEP] can we rebalance the economy? [SEP] the winner of the contest was announced tuesday. [SEP] a spokeswoman for journalists and government officials said monday night's attack targeted the headquarters of the anti - taliban party on the outskirts of hazni city. [SEP] however, half of an equal group of young men came forward with a different choice to care for. [SEP] in 1919, half of britain's remaining 2, 100 gurkrkhagans lost their lives in the [SEP]
+
+===== sample 010 =====
+[CLS] of people are not to take any action to protest. [SEP] i was even nervous. "[SEP] analysts estimated the company would be close at 11. 67 billion. [SEP] but if it's not unprotected, then it is only fair. [SEP] but the economy - the rising number of long - haul flights - is not the answer. [SEP] the nato - led coalition force of up to 2, 000 german troops support the 6, 000 strong afghan national police force and an estimated about 7, 000 militants. [SEP] chief general sir william schhorne said:" the trial shows that at the very time, it is [SEP]
+
+===== sample 011 =====
+[CLS]s by keeping them on the so - called black market. [SEP] republicans are feeling some pressure from democrats, just as the bill resols into its final bill, which would actually help attract more votes, and allow democrats to raise a seat from early 2010. [SEP] she made a strong political impact on the 2008 presidential race when she lost the state's primary in the democratic party primary in september, but the democrats' efforts failed to back her. [SEP] four - week stay with england goes by three hours, 9 a. m. - 8: 30 p. m., all winter, just a little. the date of [SEP]
+
+===== sample 012 =====
+[CLS] when voters didn't know when to vote. [SEP] for the 24 - year - old england forward from southampton, only to hit 30 premier league goals in his last season, having scored nine of his 30 goals, including eight against tottenham hotspur, england needed only the strength of a fourth goal from home to win 2 - 0 in the semis. [SEP] they had been given the opening over by the hosts before the hosts did it in the fourth over. [SEP] he was also rethinking much of his father's business. [SEP] it is " not an impression that someone, of the future, would like that.. [SEP]
+
+===== sample 013 =====
+[CLS] wrong, "said mr gisli. [SEP] don't take time for granted," says a woman with a total of 20, 000 pounds for her money. [SEP] glast, who won for the fourth time, made 26 starts for the event last year. [SEP] but they should get less. [SEP] the national bureau of national survey of unemployment came back thursday with the pace unchanged at - - 3. 2 percent. [SEP] mccarthy's side are third with five points from 18 games in the league cup and was dismissed in a 3 - 2 win by tottenham at the london club. [SEP] it had been backed down and [SEP]
+
+===== sample 014 =====
+[CLS] of their lead in the last general election, held in 2005, where they last won the presidency. [SEP] some people don't think they were doing well. [SEP] after being tied two minutes later, junya parra's superb effort from the right was blocked by kaka. [SEP] 1, they finished the last season in 1997 and suffered a one - game victory in four days earlier at baltimore. [SEP] at the center is the young man, david carlsen, a former heavyweight champion. [SEP] the 0600 gmt at 2000 gmt and the 0400 gm by 0700 gmt on sunday. [SEP] on the opening [SEP]
+
+===== sample 015 =====
+[CLS] people who died in the study, 43 percent were likely young children who lost more or more half of their body weight. [SEP] but stahl said that is not normal in his life, and there's no time a person would don't want to do the job. [SEP] most were iraqis, but the majority are arabs. [SEP] you even get to jobs done if you want to get them into class.... you won't put off the kids. [SEP] wasps went past reading with a penalty 5 - 4 but the harlequins side managed three points with a first - half goal at the line and [SEP]
+
+===== sample 016 =====
+[CLS] [SEP] you just got to play against the level of the forces he could and play. [SEP] financial results of struggling banks are expected to be discussed by a committee to run the deal through an internal review panel. [SEP] i just can't say he doesn't make money at all, so he could hardly say how much he's paying now. [SEP] in afghanistan september 12, 2001, in one of the deadliest attacks of u. s. military history, gunmen killed 19 pakistani soldiers and wounded 52 others. [SEP] born in early 1933, the 66 - year - old stage - head chef was seen standing in the middle of [SEP]
+
+===== sample 017 =====
+[CLS] debt would not be reduced. [SEP] the fourth - seeded lakers rallied monday night in a fourth - round victory over sacramento, 118 - 105 in the nba series here on monday night. [SEP] check out which you're right now, which are more of a trend. [SEP] "it's fun," he says. [SEP] mr barret, 45, from texas, said he had been waiting for his injuries by the time, when he had a full view of the heart valve - - the high - voltages brought to control him by doctors and doctors. [SEP] they would track the extent of the causes and chance of deaths - [SEP]
+
+===== sample 018 =====
+[CLS] two points as cardiff held on to safety following a draw and a two - man spl last game after 15 minutes. [SEP] a man aged 21 and 39 was killed friday at his home in wessett, ohio, the newspaper reported wednesday night. [SEP] if you only know, this is one of the years when people grew up together to use facebook's platform. [SEP] he had been under armed guard at a military hospital since june, but could not identify himself. [SEP] in the meantime, parents should get the right information to get a dose, she said, but sometimes it takes months to save symptoms. [SEP] i want to be [SEP]
+
+===== sample 019 =====
+[CLS], since they had won the final four in a row and probably should not play the opening game in a tie for second place. [SEP] earlier in the day, england did four overs of pressure at the end, caught by johnson to remove onions before pietersen was elected to pull on for five, and he went out for another six. [SEP] "the focus for the olympics is a challenge to the british focus," said ecb president tom miller. [SEP] one of their friends, along with the spanish club's manager of the year, was confirmed to the italian media that after travelling to germany, he had agreed to provide him [SEP]
+
+===== sample 020 =====
+[CLS] reported tuesday. [SEP] but he won't be keen to jump on the ground until back then. [SEP] further attacks on deepen warne's side, who are the top three scorers in south africa's confederations league cup's confederations cup campaign. [SEP] that is normal, after all. [SEP] ivanovic hit 10 aces and got into trouble with a double - fault to venus. [SEP] "but it was always unrespeable. [SEP] in europe, where high - margin products fell, operating profit jumped 9. 4 percent. [SEP]" we have got the impression that it is not in the interests of [SEP]
+
+===== sample 021 =====
+[CLS]t. [SEP] before the game, he agreed and said he had no idea at home. [SEP] new england, which was 0 - 12, rallied to win its fifth game in three games. [SEP] " i was tired of living on bed. [SEP] you - - have to wake up. [SEP] nearly 2, 000 people are killed and nearly 20 million homeless. [SEP] we all really believe. [SEP] in 2005 he beat mr thaksin's party, 15 - 7, in the second round of a 222 - seat parliament, and could take part just seven months after retiring. [SEP] another rebel general, who is familiar with the cast [SEP]
+
+===== sample 022 =====
+[CLS] lead over them. [SEP] midfielder steve jones made another superb chance from 18 yards with a powerful header 10 yards from goal, but his goal to reclaim the premier league title helped birmingham to maintain second place at another level after being carried away an early goal in sunday's league premier league win when burnley was held over manchester united. [SEP] that vote failed to get democrats a second referendum on a nomination in 2012. [SEP] but more aggressive efforts have focused on finding militants in eastern iraq, where at least one of the u. s. soldiers killed a taliban bomber earlier friday. [SEP] it was about 20 and we had more than a dozen. [SEP]
+
+===== sample 023 =====
+[CLS] for six after a tip - out. [SEP] wayne rooney, a young driver with a red side of his hands, looked a little nervous as he attempted to turn around the ball in midfield and made his first appearance of the year. [SEP] at the hospital in tashegu, a heavily buddhist district in the capital ossetia, cut off by the fighting of a local region, polling booths opened at night. [SEP] the remainder of the season will be dependent on united's first - half form and should they return in the premier league cup next month they could stay up to five points. [SEP] there would have to be some [SEP]
+
+===== sample 024 =====
+[CLS] country. [SEP] the finality of the independent inquiry is one of the concerns of a former army official who decided not to run the darfur region last summer. [SEP] we should take a look, given their lack of experience. [SEP] by the 1980s, he had said production would come back soon. [SEP] but that left him out of contention and the back includes steve mcclaren as well as mathis hargle and gareth bale. [SEP] the result was schafer's second to win the match, 6 - 9, and made sure of his second and fourth delivery sailed over the target. [SEP] but the fears of [SEP]
+
+===== sample 025 =====
+[CLS] of liberal democrats from conservative seats and conservative seats - could need five years for congressional re - election in january 2010, but he could be seen that november. [SEP] john mccain lost the presidential election in 1992 - 2004. [SEP] the canadian national team, who lost in 2002 to canada, failed to win a series for a third time. [SEP] we can take a financial advantage of all kinds of privacy, " says brad porter, who has done online sales marketing for allperstatemarket. com before getting into ctl. [SEP] another first - round opponent, philippe wilshere, soderling this time, who can break the [SEP]
+
+===== sample 026 =====
+[CLS], in charge. [SEP] how do i ever get the kids to take a game!!? 2, 000 patients should have been given the test in the first week, educating 4, 000 parents, children and parents about their condition and their prospects. [SEP] the english team pundits forced the start when the hamilton rubens, the f1 team, feared that they would press ahead on the first race and they could miss the second of the opening race to put their team's hopes at the top of the world championship. [SEP] a concession to a local election was clear that it could only generate some of the biggest gains, such [SEP]
+
+===== sample 027 =====
+[CLS] the back of his shock loss, was beaten 2 - 2, 6 - 2 in the fourth round final. [SEP] both microsoft and tcu signed a two - year sales deal in early 2005, and microsoft spent $30. 6 billion in february. [SEP] newcastle, liverpool and sunderland have 11 goals to add to their 14, while arsenal have beaten chelsea, liverpool, and barnsley, they are seventh and chelsea face sunderland, who have moved into the top four in the table. [SEP] at least two hours a day worked daily for about four hours compared to three hours a day. [SEP] she talked about her "nightmare" movies on television [SEP]
+
+===== sample 028 =====
+[CLS] it, especially if i try to do a bit more exercise to try when it can. [SEP] american champion williams of belgium lost her opening set match, going up 3 - 4 to take the lead to 5 - 3 before holding off dementieva's putt to rightie steve stricker of britain who sealed a victory in the u. s. open classic. [SEP] however, the risk of losing a life can be dramatically reduced. [SEP] the british national team was playing for the majority of the game with its home fans after its first appearance in 1997. [SEP] i think to listen to see what you want to make [SEP]
+
+===== sample 029 =====
+[CLS] its plan had a "positive impact" on the market overall. [SEP] for those who have already applied for four years, the application is then being given the chance to apply and return. [SEP] the south side, who have won the 2010 world cup series nine times, scored a record 17 points in their last two games and won a half - a - time in south africa and only two more more. [SEP] afghan government reports said one nato soldier died early at the taliban base in the eastern region, which is where many of the town's thousands of people are expected to. [SEP] however, it faced serious dilemmas with the public [SEP]
+
+===== sample 030 =====
+[CLS] 30 december, were discovered at 2130 gmt on 7 march. [SEP] as a girl i'd never put my hands on by the pool, nor just be able to walk all my way into trouble with the force of life. [SEP] does it really matter that the way i played in the game? [SEP] lyon (4), k agger, (4 - 2): a scourt, g henry, k reina, h silva, a messi, m boruc, m henry, j henry, m benitez, k jsc. [SEP] when the series began it will be much less [SEP]
+
+===== sample 031 =====
+[CLS] imposed last year. [SEP] 21 ). [SEP] having so had four aces and five points which cost him a few points at the garros has been the biggest disappointment in his second - round career in 2005. [SEP] their son, alex, was killed in shooting... [SEP] but some of the blame should never be dismissed. [SEP] hong kong (reuters health) - a strong earthquake is expected outside the world's capital after a massive earthquake broke out sunday in indonesia. [SEP] but gulvini, an economic analyst in new delhi, india, believes that the united states is in a position to help the nation's [SEP]
+
+===== sample 032 =====
+[CLS] country's elections in 2006, but i thought few of the sports and media involved were loyal enough to watch elections. [SEP] the uk's largest energy industry group, despite its forecasts for corporate growth and energy capacity, predicted no recovery in the market and warned of further high uk growth next year. [SEP] then: children, aged 17 per cent and 10, are the losers. [SEP] this is the second defeat in this tournament for tiger woods, and i have serious memories of being up at home for the finals of golf's top - ranked team. [SEP] they can cut back in next year. [SEP] in addition to this [SEP]
+
+===== sample 033 =====
+[CLS]al's bid to reach his fourth successive final in the french open, federer has come down to be having so much success. [SEP] the match is to kick off on april 3. [SEP] john isner's hard - fought start in the final set was starting with his right serve which yielded break points from 16 servings, but it took a couple of months of time to get a hold of his game again. [SEP] more than 40, 000 adults with the mental illness of hundreds of children under 35 died at the age of 6 years, a study by uk researchers found. [SEP] as a result of the current economy's [SEP]
+
+===== sample 034 =====
+[CLS] zimbabwe's people over the last five decades, the world bank said. [SEP] a study by the department for national security estimated last month that inflation would be down at 4. 3 per cent and the cost of working abroad had to hit the total by about 25 per cent. [SEP] the labour government spokesman said the case was fresh from her campaign and that police were a systematic approach to protecting people's lives. [SEP] i arrived at the school and came on the final day of my first sister's high school at the university. [SEP] he was due to present his verdict at the court later. [SEP] a live show will play the [SEP]
+
+===== sample 035 =====
+[CLS] just one and last eight games of the competition. [SEP] former opposition leader khatami on thursday announced plans to show his support to president ahmadinejad, one of iran's most - muslim factions. [SEP] we are scared of being known as the family, "says a councilman. [SEP] he has appeared on cbs's cooking show" america's kitchen "for the first time in years. [SEP] 5, while no. 4 nadal played against no. 6 nicolas krreo in the quarterfinals. [SEP]" we have not had a formal report to consider what should have happened, " said former german head coach jens [SEP]
+
+===== sample 036 =====
+[CLS] record. [SEP] on tuesday, three officers arrested over the bombing by police at a business meeting in the northern city of caracas. [SEP] the board that met monday said a review would be conducted in the coming year, according to a staff statement. [SEP] beijing (ap) - - assistant attorney general hu is headed to tokyo wednesday for launching what is expected to be a new phase of u. s. - china relations, even if, perhaps this time, the u. s, russia and other nations have agreed to participate in the talks. [SEP] in 2005, he spent three years with the company, making it the first to hand over [SEP]
+
+===== sample 037 =====
+[CLS] britain, america, italy, asia and denmark, and eventually scotland. [SEP] they looked shaky, losing five games on career - high five and scoring three runs in eight innings. [SEP] the red sox would have to turn out fans who bought tickets to the game before post game 5, and had to play 3 - d games. [SEP] so we tried this, using a comprehensive study that is considered a health - and - safety approach among younger people. [SEP] we are angry and disappointed. [SEP] for years, the government had been on a roll. [SEP] the rockets shot at least 50 percent from the field, who won eight of their last [SEP]
+
+===== sample 038 =====
+[CLS] to go, are offering limited opportunities, " he said. [SEP] while only 17 other people have received the h1n1, 61 percent of the risk of non - reusal respiratory disease. [SEP] the russian, forced to withdraw after his country's first defeat, lost five break points in the first set, beating former seed nicolas kiruso and gasquet went on to win and take a first - half 6 - 3 2 - 3 6 - 3 6 - 7 lead. [SEP] but the officers thought it was untenable as people waited for the call. [SEP] 15, 2007, was $31, 712 [SEP]
+
+===== sample 039 =====
+[CLS] giving details of the 23 - year - old defender's death, but says the president was the player and is not to blame. [SEP] 5, 2006. [SEP] friends and family nearby told her that he was devastated and contacted a number of friends within hours before returning to the hospital and on their way to hospital. [SEP] it all ended long ago if the team had lost an important match, we thought it would have been 15 points, rather than 20 points away and their top five points. [SEP] ferguson's manager sir alex ferguson won last year's third - round tie at club olympiaafe on sunday. [SEP] what is [SEP]
+
+===== sample 040 =====
+[CLS] two set points, and won 11 points in five matches, to defeat justine henin's number one on wednesday. [SEP] despite the most impressive run defense of the n. a. a., they got 37 points out of 31 from connecticut and won the next round, 24 - 26. [SEP] u. s. military officials said coalition air jets raided the taliban base in marjah early tuesday, giving the first that the taliban had died in three days. [SEP] they were delivered to retired air force officials at a base near fort hood, in texas, ahead of the official start of hostilities during the civil war. [SEP] 17 - [SEP]
+
+===== sample 041 =====
+[CLS] when they make a formal bid for the club. [SEP] the answer: good news is going to be good. [SEP] that number is expected to reach 18, 000 units by the end of 2011. [SEP] the approval of the deal which is currently being debated in a general session of the house will make its way to parliament by the end of the year but was rejected by some 70 per cent. [SEP] "the plan is probably right now to race in paris or manchester by 2010, but there is some evidence of a plan for the team to run," said button, who won the 2008 tour, who withdrew after the race due to [SEP]
+
+===== sample 042 =====
+[CLS]. [SEP] nadal was to play on wednesday in his first match here at london's o2 arena. [SEP] (cnn) - - ljubicic lost two sets against china on sunday, and against robert bosco of the united states, who he won the 2006 australian open and the tour of the nation, his win of the year was effectively preventing the german national team from competing until july's eighth edition, the tour of south open. [SEP] in florida... texas, california, california and california are all put up for grabs by these voters. we have a lot of wh's. [SEP] " [SEP]
+
+===== sample 043 =====
+[CLS] any details as to how the service would be affected, but he said that information about the new service would be available by mid - afternoon and by the publication of the report. [SEP] the australians have been very strong at the oval, they've been a bit as good on a good pitch, well and good, and there's a lot of pressure and a lot at the top. [SEP] dr phil evans, director of cervical cancer uk, said: " we are aware that screening is not good for cervical cancer. [SEP] there were six crew members among those who died at a naval air base in iraq. [SEP] top military official [SEP]
+
+===== sample 044 =====
+[CLS] everything from the back to the head. [SEP] about 9, 000 foreign visitors were expected to stay off the streets of taiwan on wednesday, but police and the national authorities put off their alert to ensure the warnings had not been heeded by the department of finance. [SEP] there is a pr business that runs travel and finance services from both airlines. [SEP] it's so improbable you'd pay a lot of council tax. [SEP] nadal, who led 5 - 2 in the first set before he was out, hit an ace on second. [SEP] thompson's lawyer, 29 - year - old john belford, [SEP]
+
+===== sample 045 =====
+[CLS] director at the national capital institute. [SEP] she is the face of her child's life. [SEP] it was difficult to comprehend, but was ultimately realistic. [SEP] as of saturday's death, only the death count had been ruled as homicide, wake county coroner's attorney mark said in the statement that the coroner doesn't know the victims. [SEP] "i would love to play golf and not hide," he said. [SEP] o' shea then added a half - time goal with 13 seconds left to give chelsea a 4 - 2, giving them a fourth - place victory over their premier league opponents. [SEP] at the time [SEP]
+
+===== sample 046 =====
+[CLS] joe biden. [SEP] leicester and half - back wogan, who lost his job from england after losing three caps, appears to be the leading candidate for their team this week. [SEP] at pittsburgh, eric brezon also scored twice to end a three - point deficit for pittsburgh, which beat st. louis for the fourth time in five games. [SEP] a tornado forecast tuesday in ohio and wisconsin started early monday or friday and continued late - night until sunday. [SEP] perhaps by next year, he claimed, the sense was that mr obama would fight to gain the presidency of his own and win "the presidency" if he took them [SEP]
+
+===== sample 047 =====
+[CLS] is expected to support the growing popularity of smartphones. [SEP] no, wait. [SEP] "the whole story is a lot of money about money, that we can't really pay back because they don't have the money they'd spend," mr. cynics said. [SEP] wales' chances in the second half, which had failed to put the focus on their ball away from play, were a brilliant attempt to get clear for the first goal. [SEP] the woman had been treated for severe shock at anfield hospital in the midlands. [SEP] he scored 11 runs in one match, finishing with 22, again setting up [SEP]
+
+===== sample 048 =====
+[CLS] a gun on his face after his hand took a blow on the shoulder. [SEP] "everything is very good," he told the financial times on sunday. [SEP] the mission has set a target for may 2012. [SEP] former police chief mohammed mouri al - maliki is backed by prime minister mohammad daoud and said he won the majority of the 18 provinces. [SEP] i was so exhausted, i haven't even had a shot at the first round. [SEP] a version this article was published on guardian. co. uk at 20. 20 bst on thursday 29 april 2010. [SEP] the idea is to pay a reasonable price of [SEP]
+
+===== sample 049 =====
+[CLS] of anti - flu drugs is 60 percent. [SEP] "i am sure this will be the last of years," the british champion said, referring to the date of his final event against borg, who won here in july. [SEP] india's half - hitting opener plundered three leg - spins, but helped england's lead make it up in the match and hit a fifth century in reply with a help from diller, who went for a six. [SEP] he fell to 15 - 7 after winning his first victory in seven starts, before starting the season at just 79. [SEP] there's time for a serious [SEP]
+
+===== sample 050 =====
+[CLS] "said peter wilson, leader of the upper house, which has passed on the green party's manifesto. [SEP]" if you're thinking of people who may do a little more of a little bit, you may have to make it, in the end, don't you? [SEP] it doesn't have much to do with our history. [SEP] calls is called out (r. i. e.), people can make those calls on their blackberry. [SEP] it's probably because it's all over the place. [SEP] he remained in second place, eight points ahead of liverpool while bayern's decei [SEP]
+
+===== sample 051 =====
+[CLS] a source suggested that he was likely to stay early because he failed to hold up his opposition. [SEP] police found a dark - car parked car with four occupants and a large passenger vehicle in the redcropted road area near knightsbridge. [SEP] for only six months, his competitive aspirations were destroyed, the german having lost a match in the french open in september 2007, the third of his entire major career. [SEP] if it happens, it won't get out of the way, he says. [SEP] cancellara pulled out of the race on monday because of his crash in this year's vuelta race and claimed that the [SEP]
+
+===== sample 052 =====
+[CLS] his side. [SEP] "you were ready here that you can get back - up as well because it always wants to be nice, to have the pace to keep yourself out of the game," he says, adding something about his first season. [SEP] the researchers believed those in history had a better chance of death, but 55, 000 who said they could have been affected by breast cancer. [SEP] nadal has spent hard time winning all four of the same event this year and earned his place in third place finishes in doha and beijing. [SEP] the most recent is that he is a king. [SEP] the new rate of tax, which [SEP]
+
+===== sample 053 =====
+[CLS] about half the population in the united states, but today's population of 6, 000 and more when they moved to eastern paris in 1984. [SEP] fighting broke out in 1999 when the pair were both playing for the west siders. [SEP] the visitors took advantage of the 2 - 2 - 0 deficit in the 21st minute from midfielder sean taylor's header for an own goal which could be seen as hiddink's first goal. [SEP] "it's quite very nice to get a glimpse of the earth," said turner, a devoted writer. [SEP] but he was worried about the prospect of closing the banking system. [SEP]
+
+===== sample 054 =====
+[CLS] 1 million in general operating expenses related to its risk - management unit. [SEP] the major indexes earlier rose 13 percent after key results - - standard & poor's international insurance co. - - gained strength from moody's moody's world credit report and the nxia's global telecoms index. [SEP] votes were set for sunday at 2000 gmt and saturday (sunday). [SEP] the little girl is keeping cool. [SEP] alisa lula, the danish second seed, beat lilian der kos 5 - 6, and former u. s. open champion casey kutcher 6 - 0 6 - 1 [SEP]
+
+===== sample 055 =====
+[CLS] taseer. [SEP] and we consider all the options on top of the mind, and even think about what we can do to determine what is the safest way to use a computer. [SEP] more patients know that it is part of our lives. [SEP] the man was hit by a peugeot car in kingsfield road, reading, in the early hours of the morning, 2005, on saturday. [SEP] the jets failed to stop the rebels in a three - day ambush of militants at mohmand in the east north of afghanistan on tuesday. [SEP] malin, president barack obama's first wife, got the call. [SEP] the [SEP]
+
+===== sample 056 =====
+[CLS] on thursday and urged the president to remain focused on the side of the campaign for a primary election, however, sen. claire e.rieu, r - tenn., said on thursday. [SEP] while diesel costs around $3. 45 a gallon for conventional diesel, experts said it would cost 230 miles more per one - day gallon of oil, at about $1. 88 a gallon on gasoline and $1. 87 per gallon more oil on gasoline. [SEP] blake led three sets in five minutes before fighting early on in the fourth set against his friend syp melzer 6 - 3, 6 - 0, 7 - [SEP]
+
+===== sample 057 =====
+[CLS]. [SEP] we, as you say, have looked up at the sheer intensity of the power with which they came. [SEP] the results will be published by february 24 - 19 september. [SEP] palatine, ill., sept. [SEP] the 37 - year - old allowed 15 run innings from his start since the 2005 loss to cincinnati, who fell to 9 - 5. [SEP] and they will not brief his family until wednesday before making a statement. [SEP] "it really makes me money." [SEP] the czech news agency said the 10 - day war reached a remote island of 1, 000 miles (100 miles) of territory and more than a [SEP]
+
+===== sample 058 =====
+[CLS] movie on the web. [SEP] the airline has said the occurred around 7: 30 a. m. [SEP] and it's clear this comes from a number of sources i want to think. [SEP] men and young women were more or less likely to develop far greater problems than overweight women of the control group. [SEP] "it will be long and tough, but it's still before us that we'll have to keep that for now," he added. [SEP] the scot, who made a three - set record in winning his sixth career title at the u. s. open in 2005 and made the year's [SEP]
+
+===== sample 059 =====
+[CLS] regardless of his age. [SEP] last year, 0. 3 percent of obese children, died per 10, 000 people. [SEP] schali had been given a cap at the age of 18 and in 2006 as a promising young player and has used his last - gasp form during his six nations career against the all blacks to give up a try. [SEP] a group of charities has collected more than $500, 000 annually for the foundation's cause, insureing the savings of more than 50, 000 donors, including breast cancer survivors, non - income groups, young adults and young children. [SEP] and since the first labour [SEP]
+
+===== sample 060 =====
+[CLS] an initial flight which, two weeks ago, lost its close eye and lost its life. [SEP] they appealed to "contact police" to find them. [SEP] in 2008, hatter wrapped up his sixth title in the tour of germany, which gave him two points from his grasp. [SEP] they were well ahead at full - time at the start of the half but the fly - half armitage missed a chance when he hit by his captain with a deep flurry. [SEP] the latest attack took place near the afghan capital, said general abbas omar, a u. s. military spokesman in zawa district. [SEP] a seven - [SEP]
+
+===== sample 061 =====
+[CLS] force. [SEP] england's chairman sir alex capesh said he was confident that england's side could now qualify for a tournament in the united states. [SEP] the majority of the patients were probably stopped using a procedure known as an x - ray machine, or ct scan. [SEP] but there are no un - made home owners, who saw their recovery take place in february. [SEP] it also reported a market value of $35 million. [SEP] over two years, one person would be able to get a car's fuel economy. [SEP] the facility is one of the site's oldest facilities. [SEP] an investigation under the terrorism section [SEP]
+
+===== sample 062 =====
+[CLS] ahead 1 - 0 in saturday's first quarter - final, when essien added a goal in the 67th minute that could have saved life for the wales defender. [SEP] england paceman stephen jones doubled cardiff's last - minute lead as the bottom side beat southend 3 - 0 after three minutes to win their second home title. [SEP] but the impetling distance between the giants and the brits, however, is not good, so much, if any, it's hard to hold it. [SEP] there is no chance of failure, but in the case of injury he is good enough to have the next goal [SEP]
+
+===== sample 063 =====
+[CLS] from 1979 to 1998. [SEP] the remaining 5, 000 were started on sunday with the loss of sir michael gossek. [SEP] the other way to save your money. [SEP] the military said at the time that eight american soldiers were not among the soldier's 25 members, but were seriously wounded sunday. [SEP] that, of course, was a half - point thursday night. [SEP] a new deal of "change" is the most important of all priorities. [SEP] the 4 - and 3 - year - olds were taken to hospital at about midday on sunday. [SEP] at the time of the deal, amid opposition from pakistani politicians and the [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_temp_schedule_128steps_n64/cosine_2p0_to_0p8_c256_scored.jsonl

@@ -0,0 +1,65 @@
+{"type": "summary", "name": "cosine_2p0_to_0p8_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 168000, "decode": {"kind": "categorical_fullvocab_temp_schedule", "config": "cosine_2p0_to_0p8_c256", "steps": 128, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "cosine", "concentration_min": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 52.61771836855152, "nll_per_token": 3.963052914135212, "tokens": 9670}, "diversity": {"sample_entropy": 4.229658640820065, "unique_tokens": 1833, "token_count": 8192, "distinct_1": 0.2237548828125, "distinct_2": 0.7153051181102362, "top_token_mass": 0.052490234375}}
+{"type": "sample", "index": 0, "raw_text": "[CLS] are finding an easy way to get their money back on track. [SEP] \" i really want to win this year, \" he said. [SEP] he had to close in the next game against ivanovic, putting him ahead 40 - 0 and taking the lead almost two all the way to set point. [SEP] \" i was scared on my face, \" he said, speaking with a toothy smile. [SEP] kevin suppan struck out five for the rangers, improving to 6 - 0, 4. 5 era. [SEP] but they came away with a couple of second - half goals from david monza, lowly nderiay [SEP]", "detok_text": "[CLS] are finding an easy way to get their money back on track. [SEP] \"i really want to win this year,\" he said. [SEP] he had to close in the next game against ivanovic, putting him ahead 40 - 0 and taking the lead almost two all the way to set point. [SEP] \"i was scared on my face,\" he said, speaking with a toothy smile. [SEP] kevin suppan struck out five for the rangers, improving to 6 - 0, 4. 5 era. [SEP] but they came away with a couple of second - half goals from david monza, lowly nderiay [SEP]"}
+{"type": "sample", "index": 1, "raw_text": "[CLS]rsteing said. [SEP] button has won eight of his last seven wins, including seven in the san siro, including in a year ' s championship in mid - july at mormio yesterday, when the spaniard last year won the sixth stage for the 2007 season, finishing just four seconds back. [SEP] southers, 26, finished third and seventh. [SEP] \" i was in a crash in a british village on october 19 2006 and i had before christmas to buy a car which said someone that was actually driving it, \" he said in his radio interview. [SEP] the military would not say if the crash was involved in [SEP]", "detok_text": "[CLS]rsteing said. [SEP] button has won eight of his last seven wins, including seven in the san siro, including in a year's championship in mid - july at mormio yesterday, when the spaniard last year won the sixth stage for the 2007 season, finishing just four seconds back. [SEP] southers, 26, finished third and seventh. [SEP] \"i was in a crash in a british village on october 19 2006 and i had before christmas to buy a car which said someone that was actually driving it,\" he said in his radio interview. [SEP] the military would not say if the crash was involved in [SEP]"}
+{"type": "sample", "index": 2, "raw_text": "[CLS] said the flyover for the event was \" in due course, \" and the airline had told pilots to come home. [SEP] at pittsburgh, the fifth - seeded mets led 1 - 0 for the ninth win in two games this season and seventh of eight league chances. [SEP] it ' s less than today ' s exhausting stuff. [SEP] the sch - 80 aircraft went down at about 2 : 30 p. m, then went down. [SEP] i can ' t take your whole life for your good. [SEP] they came a little closer, and we can win the game. [SEP] still, the more expensive and out - of - [SEP]", "detok_text": "[CLS] said the flyover for the event was \"in due course,\" and the airline had told pilots to come home. [SEP] at pittsburgh, the fifth - seeded mets led 1 - 0 for the ninth win in two games this season and seventh of eight league chances. [SEP] it's less than today's exhausting stuff. [SEP] the sch - 80 aircraft went down at about 2: 30 p. m, then went down. [SEP] i can't take your whole life for your good. [SEP] they came a little closer, and we can win the game. [SEP] still, the more expensive and out - of - [SEP]"}
+{"type": "sample", "index": 3, "raw_text": "[CLS] much as $ 4, 000. [SEP] be worried about cutting off your budget. [SEP] the new president is retiring the beginning of april, according to the general staff of brown books and a co - member of the special executive committee of the business publishing association involved in the company ' s online business. [SEP] also friday, france ' s martin vaudej bravely won the seventh masters doubles title sunday, 6 - 5 3 - 6, 7 - 5 after holding off britain ' s andy murray, defeating the unseeded phaun 6 - 4. [SEP] experts said the goal was to increase the number of \" sick people infected [SEP]", "detok_text": "[CLS] much as $4, 000. [SEP] be worried about cutting off your budget. [SEP] the new president is retiring the beginning of april, according to the general staff of brown books and a co - member of the special executive committee of the business publishing association involved in the company's online business. [SEP] also friday, france's martin vaudej bravely won the seventh masters doubles title sunday, 6 - 5 3 - 6, 7 - 5 after holding off britain's andy murray, defeating the unseeded phaun 6 - 4. [SEP] experts said the goal was to increase the number of \" sick people infected [SEP]"}
+{"type": "sample", "index": 4, "raw_text": "[CLS]. s. troops in afghanistan. [SEP] after the attack monday, the u. s. military also took control of the town of marja and left 16 dead after six hours of the fighting, the source who did not return a call told reuters, speaking on condition of anony. [SEP] while 88 percent of men live aged 60 and older and have alzheimer ' s, about 4 percent of adults do not have a normal or lower risk of a severe disease to death by the next day, such as death or stroke, increased weight loss, loss of weight and body count ). [SEP] never mind, how do you run a city [SEP]", "detok_text": "[CLS]. s. troops in afghanistan. [SEP] after the attack monday, the u. s. military also took control of the town of marja and left 16 dead after six hours of the fighting, the source who did not return a call told reuters, speaking on condition of anony. [SEP] while 88 percent of men live aged 60 and older and have alzheimer's, about 4 percent of adults do not have a normal or lower risk of a severe disease to death by the next day, such as death or stroke, increased weight loss, loss of weight and body count ). [SEP] never mind, how do you run a city [SEP]"}
+{"type": "sample", "index": 5, "raw_text": "[CLS] saturday ' s motogp series title and will finish just nine points ahead of britain ' s world champion lewis hamilton so the mclaren team can focus to focus on the race. [SEP] but next time, he knows a little more about making it seem astonishingly difficult. [SEP] bridge, 38, featured as the most - form midfield player of his motherwell side and, despite, five minutes into this season ' s final triumph, the gunners continued to top - class form during the opening premier league campaign. [SEP] with five - goal losing games in their four home games, the visitors were back in extra - time and could win a goal [SEP]", "detok_text": "[CLS] saturday's motogp series title and will finish just nine points ahead of britain's world champion lewis hamilton so the mclaren team can focus to focus on the race. [SEP] but next time, he knows a little more about making it seem astonishingly difficult. [SEP] bridge, 38, featured as the most - form midfield player of his motherwell side and, despite, five minutes into this season's final triumph, the gunners continued to top - class form during the opening premier league campaign. [SEP] with five - goal losing games in their four home games, the visitors were back in extra - time and could win a goal [SEP]"}
+{"type": "sample", "index": 6, "raw_text": "[CLS]. [SEP] copenhagen, 2008 ; copenhagen, florence, 2004 ; paris, april 7 - 6 ; aug 11 - oct 2, copenhagen, frankfurt ; july 12 ; paris, 2006 ; paris, 2007 ; april 11 - 18, 2005 ; and at least 14, 500 north of copenhagen, berlin and 19 other countries, all in 2006 and 2007. [SEP] surrey police said the incident, a serious heart attack, happened at about 2000 gmt, on bridge lane shut down in the early part of the town. [SEP] \" i remember it was with 12 young people and 10 children, and there ' s just about people having their children taken [SEP]", "detok_text": "[CLS]. [SEP] copenhagen, 2008; copenhagen, florence, 2004; paris, april 7 - 6; aug 11 - oct 2, copenhagen, frankfurt; july 12; paris, 2006; paris, 2007; april 11 - 18, 2005; and at least 14, 500 north of copenhagen, berlin and 19 other countries, all in 2006 and 2007. [SEP] surrey police said the incident, a serious heart attack, happened at about 2000 gmt, on bridge lane shut down in the early part of the town. [SEP] \" i remember it was with 12 young people and 10 children, and there's just about people having their children taken [SEP]"}
+{"type": "sample", "index": 7, "raw_text": "[CLS] comment on the claim whether the move is part of labour ' s decision to come in early on thursday. [SEP] mrs taylor ' home in county down, west yorkshire, described hearing from a friend sunday night that the disappearance of a fourth, two children who was murdered was ruled a suicide. [SEP] \" there is a surprise because, by that two hours, there is an amazing amount of time but if we saw our daughter in the wrong way, they don ' t. [SEP] chelsea threatened twice with daniel nani ' s low drive, but ivanovic dropped to his left on the rebound. [SEP] over the years, it became clear to [SEP]", "detok_text": "[CLS] comment on the claim whether the move is part of labour's decision to come in early on thursday. [SEP] mrs taylor' home in county down, west yorkshire, described hearing from a friend sunday night that the disappearance of a fourth, two children who was murdered was ruled a suicide. [SEP] \" there is a surprise because, by that two hours, there is an amazing amount of time but if we saw our daughter in the wrong way, they don't. [SEP] chelsea threatened twice with daniel nani's low drive, but ivanovic dropped to his left on the rebound. [SEP] over the years, it became clear to [SEP]"}
+{"type": "sample", "index": 8, "raw_text": "[CLS] he was the last to die in july. [SEP] lyon had a groundout and one out in the fourth, but washington ' s santana almost left his mark after only arriving in the sixth inning. [SEP] i was more told that they would face a prosecution and to worry about an adverse outcome. [SEP] the blood test was a test to see if his fighters can fight for the wbf title, with their near - certainty rival joe calzaghe confirming whether he would quit the ring for this year. [SEP] i believe his victim was right. [SEP] police have treated ledger ' s death as a homicide ahead of the event, which has [SEP]", "detok_text": "[CLS] he was the last to die in july. [SEP] lyon had a groundout and one out in the fourth, but washington's santana almost left his mark after only arriving in the sixth inning. [SEP] i was more told that they would face a prosecution and to worry about an adverse outcome. [SEP] the blood test was a test to see if his fighters can fight for the wbf title, with their near - certainty rival joe calzaghe confirming whether he would quit the ring for this year. [SEP] i believe his victim was right. [SEP] police have treated ledger's death as a homicide ahead of the event, which has [SEP]"}
+{"type": "sample", "index": 9, "raw_text": "[CLS]. [SEP] police said the burglar was taken at a detached house in hill on the island on sunday. [SEP] it really was about time. [SEP] can we rebalance the economy? [SEP] the winner of the contest was announced tuesday. [SEP] a spokeswoman for journalists and government officials said monday night ' s attack targeted the headquarters of the anti - taliban party on the outskirts of hazni city. [SEP] however, half of an equal group of young men came forward with a different choice to care for. [SEP] in 1919, half of britain ' s remaining 2, 100 gurkrkhagans lost their lives in the [SEP]", "detok_text": "[CLS]. [SEP] police said the burglar was taken at a detached house in hill on the island on sunday. [SEP] it really was about time. [SEP] can we rebalance the economy? [SEP] the winner of the contest was announced tuesday. [SEP] a spokeswoman for journalists and government officials said monday night's attack targeted the headquarters of the anti - taliban party on the outskirts of hazni city. [SEP] however, half of an equal group of young men came forward with a different choice to care for. [SEP] in 1919, half of britain's remaining 2, 100 gurkrkhagans lost their lives in the [SEP]"}
+{"type": "sample", "index": 10, "raw_text": "[CLS] of people are not to take any action to protest. [SEP] i was even nervous. \" [SEP] analysts estimated the company would be close at 11. 67 billion. [SEP] but if it ' s not unprotected, then it is only fair. [SEP] but the economy - the rising number of long - haul flights - is not the answer. [SEP] the nato - led coalition force of up to 2, 000 german troops support the 6, 000 strong afghan national police force and an estimated about 7, 000 militants. [SEP] chief general sir william schhorne said : \" the trial shows that at the very time, it is [SEP]", "detok_text": "[CLS] of people are not to take any action to protest. [SEP] i was even nervous. \"[SEP] analysts estimated the company would be close at 11. 67 billion. [SEP] but if it's not unprotected, then it is only fair. [SEP] but the economy - the rising number of long - haul flights - is not the answer. [SEP] the nato - led coalition force of up to 2, 000 german troops support the 6, 000 strong afghan national police force and an estimated about 7, 000 militants. [SEP] chief general sir william schhorne said:\" the trial shows that at the very time, it is [SEP]"}
+{"type": "sample", "index": 11, "raw_text": "[CLS]s by keeping them on the so - called black market. [SEP] republicans are feeling some pressure from democrats, just as the bill resols into its final bill, which would actually help attract more votes, and allow democrats to raise a seat from early 2010. [SEP] she made a strong political impact on the 2008 presidential race when she lost the state ' s primary in the democratic party primary in september, but the democrats ' efforts failed to back her. [SEP] four - week stay with england goes by three hours, 9 a. m. - 8 : 30 p. m., all winter, just a little. the date of [SEP]", "detok_text": "[CLS]s by keeping them on the so - called black market. [SEP] republicans are feeling some pressure from democrats, just as the bill resols into its final bill, which would actually help attract more votes, and allow democrats to raise a seat from early 2010. [SEP] she made a strong political impact on the 2008 presidential race when she lost the state's primary in the democratic party primary in september, but the democrats' efforts failed to back her. [SEP] four - week stay with england goes by three hours, 9 a. m. - 8: 30 p. m., all winter, just a little. the date of [SEP]"}
+{"type": "sample", "index": 12, "raw_text": "[CLS] when voters didn ' t know when to vote. [SEP] for the 24 - year - old england forward from southampton, only to hit 30 premier league goals in his last season, having scored nine of his 30 goals, including eight against tottenham hotspur, england needed only the strength of a fourth goal from home to win 2 - 0 in the semis. [SEP] they had been given the opening over by the hosts before the hosts did it in the fourth over. [SEP] he was also rethinking much of his father ' s business. [SEP] it is \" not an impression that someone, of the future, would like that.. [SEP]", "detok_text": "[CLS] when voters didn't know when to vote. [SEP] for the 24 - year - old england forward from southampton, only to hit 30 premier league goals in his last season, having scored nine of his 30 goals, including eight against tottenham hotspur, england needed only the strength of a fourth goal from home to win 2 - 0 in the semis. [SEP] they had been given the opening over by the hosts before the hosts did it in the fourth over. [SEP] he was also rethinking much of his father's business. [SEP] it is \" not an impression that someone, of the future, would like that.. [SEP]"}
+{"type": "sample", "index": 13, "raw_text": "[CLS] wrong, \" said mr gisli. [SEP] don ' t take time for granted, \" says a woman with a total of 20, 000 pounds for her money. [SEP] glast, who won for the fourth time, made 26 starts for the event last year. [SEP] but they should get less. [SEP] the national bureau of national survey of unemployment came back thursday with the pace unchanged at - - 3. 2 percent. [SEP] mccarthy ' s side are third with five points from 18 games in the league cup and was dismissed in a 3 - 2 win by tottenham at the london club. [SEP] it had been backed down and [SEP]", "detok_text": "[CLS] wrong, \"said mr gisli. [SEP] don't take time for granted,\" says a woman with a total of 20, 000 pounds for her money. [SEP] glast, who won for the fourth time, made 26 starts for the event last year. [SEP] but they should get less. [SEP] the national bureau of national survey of unemployment came back thursday with the pace unchanged at - - 3. 2 percent. [SEP] mccarthy's side are third with five points from 18 games in the league cup and was dismissed in a 3 - 2 win by tottenham at the london club. [SEP] it had been backed down and [SEP]"}
+{"type": "sample", "index": 14, "raw_text": "[CLS] of their lead in the last general election, held in 2005, where they last won the presidency. [SEP] some people don ' t think they were doing well. [SEP] after being tied two minutes later, junya parra ' s superb effort from the right was blocked by kaka. [SEP] 1, they finished the last season in 1997 and suffered a one - game victory in four days earlier at baltimore. [SEP] at the center is the young man, david carlsen, a former heavyweight champion. [SEP] the 0600 gmt at 2000 gmt and the 0400 gm by 0700 gmt on sunday. [SEP] on the opening [SEP]", "detok_text": "[CLS] of their lead in the last general election, held in 2005, where they last won the presidency. [SEP] some people don't think they were doing well. [SEP] after being tied two minutes later, junya parra's superb effort from the right was blocked by kaka. [SEP] 1, they finished the last season in 1997 and suffered a one - game victory in four days earlier at baltimore. [SEP] at the center is the young man, david carlsen, a former heavyweight champion. [SEP] the 0600 gmt at 2000 gmt and the 0400 gm by 0700 gmt on sunday. [SEP] on the opening [SEP]"}
+{"type": "sample", "index": 15, "raw_text": "[CLS] people who died in the study, 43 percent were likely young children who lost more or more half of their body weight. [SEP] but stahl said that is not normal in his life, and there ' s no time a person would don ' t want to do the job. [SEP] most were iraqis, but the majority are arabs. [SEP] you even get to jobs done if you want to get them into class.... you won ' t put off the kids. [SEP] wasps went past reading with a penalty 5 - 4 but the harlequins side managed three points with a first - half goal at the line and [SEP]", "detok_text": "[CLS] people who died in the study, 43 percent were likely young children who lost more or more half of their body weight. [SEP] but stahl said that is not normal in his life, and there's no time a person would don't want to do the job. [SEP] most were iraqis, but the majority are arabs. [SEP] you even get to jobs done if you want to get them into class.... you won't put off the kids. [SEP] wasps went past reading with a penalty 5 - 4 but the harlequins side managed three points with a first - half goal at the line and [SEP]"}
+{"type": "sample", "index": 16, "raw_text": "[CLS] [SEP] you just got to play against the level of the forces he could and play. [SEP] financial results of struggling banks are expected to be discussed by a committee to run the deal through an internal review panel. [SEP] i just can ' t say he doesn ' t make money at all, so he could hardly say how much he ' s paying now. [SEP] in afghanistan september 12, 2001, in one of the deadliest attacks of u. s. military history, gunmen killed 19 pakistani soldiers and wounded 52 others. [SEP] born in early 1933, the 66 - year - old stage - head chef was seen standing in the middle of [SEP]", "detok_text": "[CLS] [SEP] you just got to play against the level of the forces he could and play. [SEP] financial results of struggling banks are expected to be discussed by a committee to run the deal through an internal review panel. [SEP] i just can't say he doesn't make money at all, so he could hardly say how much he's paying now. [SEP] in afghanistan september 12, 2001, in one of the deadliest attacks of u. s. military history, gunmen killed 19 pakistani soldiers and wounded 52 others. [SEP] born in early 1933, the 66 - year - old stage - head chef was seen standing in the middle of [SEP]"}
+{"type": "sample", "index": 17, "raw_text": "[CLS] debt would not be reduced. [SEP] the fourth - seeded lakers rallied monday night in a fourth - round victory over sacramento, 118 - 105 in the nba series here on monday night. [SEP] check out which you ' re right now, which are more of a trend. [SEP] \" it ' s fun, \" he says. [SEP] mr barret, 45, from texas, said he had been waiting for his injuries by the time, when he had a full view of the heart valve - - the high - voltages brought to control him by doctors and doctors. [SEP] they would track the extent of the causes and chance of deaths - [SEP]", "detok_text": "[CLS] debt would not be reduced. [SEP] the fourth - seeded lakers rallied monday night in a fourth - round victory over sacramento, 118 - 105 in the nba series here on monday night. [SEP] check out which you're right now, which are more of a trend. [SEP] \"it's fun,\" he says. [SEP] mr barret, 45, from texas, said he had been waiting for his injuries by the time, when he had a full view of the heart valve - - the high - voltages brought to control him by doctors and doctors. [SEP] they would track the extent of the causes and chance of deaths - [SEP]"}
+{"type": "sample", "index": 18, "raw_text": "[CLS] two points as cardiff held on to safety following a draw and a two - man spl last game after 15 minutes. [SEP] a man aged 21 and 39 was killed friday at his home in wessett, ohio, the newspaper reported wednesday night. [SEP] if you only know, this is one of the years when people grew up together to use facebook ' s platform. [SEP] he had been under armed guard at a military hospital since june, but could not identify himself. [SEP] in the meantime, parents should get the right information to get a dose, she said, but sometimes it takes months to save symptoms. [SEP] i want to be [SEP]", "detok_text": "[CLS] two points as cardiff held on to safety following a draw and a two - man spl last game after 15 minutes. [SEP] a man aged 21 and 39 was killed friday at his home in wessett, ohio, the newspaper reported wednesday night. [SEP] if you only know, this is one of the years when people grew up together to use facebook's platform. [SEP] he had been under armed guard at a military hospital since june, but could not identify himself. [SEP] in the meantime, parents should get the right information to get a dose, she said, but sometimes it takes months to save symptoms. [SEP] i want to be [SEP]"}
+{"type": "sample", "index": 19, "raw_text": "[CLS], since they had won the final four in a row and probably should not play the opening game in a tie for second place. [SEP] earlier in the day, england did four overs of pressure at the end, caught by johnson to remove onions before pietersen was elected to pull on for five, and he went out for another six. [SEP] \" the focus for the olympics is a challenge to the british focus, \" said ecb president tom miller. [SEP] one of their friends, along with the spanish club ' s manager of the year, was confirmed to the italian media that after travelling to germany, he had agreed to provide him [SEP]", "detok_text": "[CLS], since they had won the final four in a row and probably should not play the opening game in a tie for second place. [SEP] earlier in the day, england did four overs of pressure at the end, caught by johnson to remove onions before pietersen was elected to pull on for five, and he went out for another six. [SEP] \"the focus for the olympics is a challenge to the british focus,\" said ecb president tom miller. [SEP] one of their friends, along with the spanish club's manager of the year, was confirmed to the italian media that after travelling to germany, he had agreed to provide him [SEP]"}
+{"type": "sample", "index": 20, "raw_text": "[CLS] reported tuesday. [SEP] but he won ' t be keen to jump on the ground until back then. [SEP] further attacks on deepen warne ' s side, who are the top three scorers in south africa ' s confederations league cup ' s confederations cup campaign. [SEP] that is normal, after all. [SEP] ivanovic hit 10 aces and got into trouble with a double - fault to venus. [SEP] \" but it was always unrespeable. [SEP] in europe, where high - margin products fell, operating profit jumped 9. 4 percent. [SEP] \" we have got the impression that it is not in the interests of [SEP]", "detok_text": "[CLS] reported tuesday. [SEP] but he won't be keen to jump on the ground until back then. [SEP] further attacks on deepen warne's side, who are the top three scorers in south africa's confederations league cup's confederations cup campaign. [SEP] that is normal, after all. [SEP] ivanovic hit 10 aces and got into trouble with a double - fault to venus. [SEP] \"but it was always unrespeable. [SEP] in europe, where high - margin products fell, operating profit jumped 9. 4 percent. [SEP]\" we have got the impression that it is not in the interests of [SEP]"}
+{"type": "sample", "index": 21, "raw_text": "[CLS]t. [SEP] before the game, he agreed and said he had no idea at home. [SEP] new england, which was 0 - 12, rallied to win its fifth game in three games. [SEP] \" i was tired of living on bed. [SEP] you - - have to wake up. [SEP] nearly 2, 000 people are killed and nearly 20 million homeless. [SEP] we all really believe. [SEP] in 2005 he beat mr thaksin ' s party, 15 - 7, in the second round of a 222 - seat parliament, and could take part just seven months after retiring. [SEP] another rebel general, who is familiar with the cast [SEP]", "detok_text": "[CLS]t. [SEP] before the game, he agreed and said he had no idea at home. [SEP] new england, which was 0 - 12, rallied to win its fifth game in three games. [SEP] \" i was tired of living on bed. [SEP] you - - have to wake up. [SEP] nearly 2, 000 people are killed and nearly 20 million homeless. [SEP] we all really believe. [SEP] in 2005 he beat mr thaksin's party, 15 - 7, in the second round of a 222 - seat parliament, and could take part just seven months after retiring. [SEP] another rebel general, who is familiar with the cast [SEP]"}
+{"type": "sample", "index": 22, "raw_text": "[CLS] lead over them. [SEP] midfielder steve jones made another superb chance from 18 yards with a powerful header 10 yards from goal, but his goal to reclaim the premier league title helped birmingham to maintain second place at another level after being carried away an early goal in sunday ' s league premier league win when burnley was held over manchester united. [SEP] that vote failed to get democrats a second referendum on a nomination in 2012. [SEP] but more aggressive efforts have focused on finding militants in eastern iraq, where at least one of the u. s. soldiers killed a taliban bomber earlier friday. [SEP] it was about 20 and we had more than a dozen. [SEP]", "detok_text": "[CLS] lead over them. [SEP] midfielder steve jones made another superb chance from 18 yards with a powerful header 10 yards from goal, but his goal to reclaim the premier league title helped birmingham to maintain second place at another level after being carried away an early goal in sunday's league premier league win when burnley was held over manchester united. [SEP] that vote failed to get democrats a second referendum on a nomination in 2012. [SEP] but more aggressive efforts have focused on finding militants in eastern iraq, where at least one of the u. s. soldiers killed a taliban bomber earlier friday. [SEP] it was about 20 and we had more than a dozen. [SEP]"}
+{"type": "sample", "index": 23, "raw_text": "[CLS] for six after a tip - out. [SEP] wayne rooney, a young driver with a red side of his hands, looked a little nervous as he attempted to turn around the ball in midfield and made his first appearance of the year. [SEP] at the hospital in tashegu, a heavily buddhist district in the capital ossetia, cut off by the fighting of a local region, polling booths opened at night. [SEP] the remainder of the season will be dependent on united ' s first - half form and should they return in the premier league cup next month they could stay up to five points. [SEP] there would have to be some [SEP]", "detok_text": "[CLS] for six after a tip - out. [SEP] wayne rooney, a young driver with a red side of his hands, looked a little nervous as he attempted to turn around the ball in midfield and made his first appearance of the year. [SEP] at the hospital in tashegu, a heavily buddhist district in the capital ossetia, cut off by the fighting of a local region, polling booths opened at night. [SEP] the remainder of the season will be dependent on united's first - half form and should they return in the premier league cup next month they could stay up to five points. [SEP] there would have to be some [SEP]"}
+{"type": "sample", "index": 24, "raw_text": "[CLS] country. [SEP] the finality of the independent inquiry is one of the concerns of a former army official who decided not to run the darfur region last summer. [SEP] we should take a look, given their lack of experience. [SEP] by the 1980s, he had said production would come back soon. [SEP] but that left him out of contention and the back includes steve mcclaren as well as mathis hargle and gareth bale. [SEP] the result was schafer ' s second to win the match, 6 - 9, and made sure of his second and fourth delivery sailed over the target. [SEP] but the fears of [SEP]", "detok_text": "[CLS] country. [SEP] the finality of the independent inquiry is one of the concerns of a former army official who decided not to run the darfur region last summer. [SEP] we should take a look, given their lack of experience. [SEP] by the 1980s, he had said production would come back soon. [SEP] but that left him out of contention and the back includes steve mcclaren as well as mathis hargle and gareth bale. [SEP] the result was schafer's second to win the match, 6 - 9, and made sure of his second and fourth delivery sailed over the target. [SEP] but the fears of [SEP]"}
+{"type": "sample", "index": 25, "raw_text": "[CLS] of liberal democrats from conservative seats and conservative seats - could need five years for congressional re - election in january 2010, but he could be seen that november. [SEP] john mccain lost the presidential election in 1992 - 2004. [SEP] the canadian national team, who lost in 2002 to canada, failed to win a series for a third time. [SEP] we can take a financial advantage of all kinds of privacy, \" says brad porter, who has done online sales marketing for allperstatemarket. com before getting into ctl. [SEP] another first - round opponent, philippe wilshere, soderling this time, who can break the [SEP]", "detok_text": "[CLS] of liberal democrats from conservative seats and conservative seats - could need five years for congressional re - election in january 2010, but he could be seen that november. [SEP] john mccain lost the presidential election in 1992 - 2004. [SEP] the canadian national team, who lost in 2002 to canada, failed to win a series for a third time. [SEP] we can take a financial advantage of all kinds of privacy, \" says brad porter, who has done online sales marketing for allperstatemarket. com before getting into ctl. [SEP] another first - round opponent, philippe wilshere, soderling this time, who can break the [SEP]"}
+{"type": "sample", "index": 26, "raw_text": "[CLS], in charge. [SEP] how do i ever get the kids to take a game!!? 2, 000 patients should have been given the test in the first week, educating 4, 000 parents, children and parents about their condition and their prospects. [SEP] the english team pundits forced the start when the hamilton rubens, the f1 team, feared that they would press ahead on the first race and they could miss the second of the opening race to put their team ' s hopes at the top of the world championship. [SEP] a concession to a local election was clear that it could only generate some of the biggest gains, such [SEP]", "detok_text": "[CLS], in charge. [SEP] how do i ever get the kids to take a game!!? 2, 000 patients should have been given the test in the first week, educating 4, 000 parents, children and parents about their condition and their prospects. [SEP] the english team pundits forced the start when the hamilton rubens, the f1 team, feared that they would press ahead on the first race and they could miss the second of the opening race to put their team's hopes at the top of the world championship. [SEP] a concession to a local election was clear that it could only generate some of the biggest gains, such [SEP]"}
+{"type": "sample", "index": 27, "raw_text": "[CLS] the back of his shock loss, was beaten 2 - 2, 6 - 2 in the fourth round final. [SEP] both microsoft and tcu signed a two - year sales deal in early 2005, and microsoft spent $ 30. 6 billion in february. [SEP] newcastle, liverpool and sunderland have 11 goals to add to their 14, while arsenal have beaten chelsea, liverpool, and barnsley, they are seventh and chelsea face sunderland, who have moved into the top four in the table. [SEP] at least two hours a day worked daily for about four hours compared to three hours a day. [SEP] she talked about her \" nightmare \" movies on television [SEP]", "detok_text": "[CLS] the back of his shock loss, was beaten 2 - 2, 6 - 2 in the fourth round final. [SEP] both microsoft and tcu signed a two - year sales deal in early 2005, and microsoft spent $30. 6 billion in february. [SEP] newcastle, liverpool and sunderland have 11 goals to add to their 14, while arsenal have beaten chelsea, liverpool, and barnsley, they are seventh and chelsea face sunderland, who have moved into the top four in the table. [SEP] at least two hours a day worked daily for about four hours compared to three hours a day. [SEP] she talked about her \"nightmare\" movies on television [SEP]"}
+{"type": "sample", "index": 28, "raw_text": "[CLS] it, especially if i try to do a bit more exercise to try when it can. [SEP] american champion williams of belgium lost her opening set match, going up 3 - 4 to take the lead to 5 - 3 before holding off dementieva ' s putt to rightie steve stricker of britain who sealed a victory in the u. s. open classic. [SEP] however, the risk of losing a life can be dramatically reduced. [SEP] the british national team was playing for the majority of the game with its home fans after its first appearance in 1997. [SEP] i think to listen to see what you want to make [SEP]", "detok_text": "[CLS] it, especially if i try to do a bit more exercise to try when it can. [SEP] american champion williams of belgium lost her opening set match, going up 3 - 4 to take the lead to 5 - 3 before holding off dementieva's putt to rightie steve stricker of britain who sealed a victory in the u. s. open classic. [SEP] however, the risk of losing a life can be dramatically reduced. [SEP] the british national team was playing for the majority of the game with its home fans after its first appearance in 1997. [SEP] i think to listen to see what you want to make [SEP]"}
+{"type": "sample", "index": 29, "raw_text": "[CLS] its plan had a \" positive impact \" on the market overall. [SEP] for those who have already applied for four years, the application is then being given the chance to apply and return. [SEP] the south side, who have won the 2010 world cup series nine times, scored a record 17 points in their last two games and won a half - a - time in south africa and only two more more. [SEP] afghan government reports said one nato soldier died early at the taliban base in the eastern region, which is where many of the town ' s thousands of people are expected to. [SEP] however, it faced serious dilemmas with the public [SEP]", "detok_text": "[CLS] its plan had a \"positive impact\" on the market overall. [SEP] for those who have already applied for four years, the application is then being given the chance to apply and return. [SEP] the south side, who have won the 2010 world cup series nine times, scored a record 17 points in their last two games and won a half - a - time in south africa and only two more more. [SEP] afghan government reports said one nato soldier died early at the taliban base in the eastern region, which is where many of the town's thousands of people are expected to. [SEP] however, it faced serious dilemmas with the public [SEP]"}
+{"type": "sample", "index": 30, "raw_text": "[CLS] 30 december, were discovered at 2130 gmt on 7 march. [SEP] as a girl i ' d never put my hands on by the pool, nor just be able to walk all my way into trouble with the force of life. [SEP] does it really matter that the way i played in the game? [SEP] lyon ( 4 ), k agger, ( 4 - 2 ) : a scourt, g henry, k reina, h silva, a messi, m boruc, m henry, j henry, m benitez, k jsc. [SEP] when the series began it will be much less [SEP]", "detok_text": "[CLS] 30 december, were discovered at 2130 gmt on 7 march. [SEP] as a girl i'd never put my hands on by the pool, nor just be able to walk all my way into trouble with the force of life. [SEP] does it really matter that the way i played in the game? [SEP] lyon (4), k agger, (4 - 2): a scourt, g henry, k reina, h silva, a messi, m boruc, m henry, j henry, m benitez, k jsc. [SEP] when the series began it will be much less [SEP]"}
+{"type": "sample", "index": 31, "raw_text": "[CLS] imposed last year. [SEP] 21 ). [SEP] having so had four aces and five points which cost him a few points at the garros has been the biggest disappointment in his second - round career in 2005. [SEP] their son, alex, was killed in shooting... [SEP] but some of the blame should never be dismissed. [SEP] hong kong ( reuters health ) - a strong earthquake is expected outside the world ' s capital after a massive earthquake broke out sunday in indonesia. [SEP] but gulvini, an economic analyst in new delhi, india, believes that the united states is in a position to help the nation ' s [SEP]", "detok_text": "[CLS] imposed last year. [SEP] 21 ). [SEP] having so had four aces and five points which cost him a few points at the garros has been the biggest disappointment in his second - round career in 2005. [SEP] their son, alex, was killed in shooting... [SEP] but some of the blame should never be dismissed. [SEP] hong kong (reuters health) - a strong earthquake is expected outside the world's capital after a massive earthquake broke out sunday in indonesia. [SEP] but gulvini, an economic analyst in new delhi, india, believes that the united states is in a position to help the nation's [SEP]"}
+{"type": "sample", "index": 32, "raw_text": "[CLS] country ' s elections in 2006, but i thought few of the sports and media involved were loyal enough to watch elections. [SEP] the uk ' s largest energy industry group, despite its forecasts for corporate growth and energy capacity, predicted no recovery in the market and warned of further high uk growth next year. [SEP] then : children, aged 17 per cent and 10, are the losers. [SEP] this is the second defeat in this tournament for tiger woods, and i have serious memories of being up at home for the finals of golf ' s top - ranked team. [SEP] they can cut back in next year. [SEP] in addition to this [SEP]", "detok_text": "[CLS] country's elections in 2006, but i thought few of the sports and media involved were loyal enough to watch elections. [SEP] the uk's largest energy industry group, despite its forecasts for corporate growth and energy capacity, predicted no recovery in the market and warned of further high uk growth next year. [SEP] then: children, aged 17 per cent and 10, are the losers. [SEP] this is the second defeat in this tournament for tiger woods, and i have serious memories of being up at home for the finals of golf's top - ranked team. [SEP] they can cut back in next year. [SEP] in addition to this [SEP]"}
+{"type": "sample", "index": 33, "raw_text": "[CLS]al ' s bid to reach his fourth successive final in the french open, federer has come down to be having so much success. [SEP] the match is to kick off on april 3. [SEP] john isner ' s hard - fought start in the final set was starting with his right serve which yielded break points from 16 servings, but it took a couple of months of time to get a hold of his game again. [SEP] more than 40, 000 adults with the mental illness of hundreds of children under 35 died at the age of 6 years, a study by uk researchers found. [SEP] as a result of the current economy ' s [SEP]", "detok_text": "[CLS]al's bid to reach his fourth successive final in the french open, federer has come down to be having so much success. [SEP] the match is to kick off on april 3. [SEP] john isner's hard - fought start in the final set was starting with his right serve which yielded break points from 16 servings, but it took a couple of months of time to get a hold of his game again. [SEP] more than 40, 000 adults with the mental illness of hundreds of children under 35 died at the age of 6 years, a study by uk researchers found. [SEP] as a result of the current economy's [SEP]"}
+{"type": "sample", "index": 34, "raw_text": "[CLS] zimbabwe ' s people over the last five decades, the world bank said. [SEP] a study by the department for national security estimated last month that inflation would be down at 4. 3 per cent and the cost of working abroad had to hit the total by about 25 per cent. [SEP] the labour government spokesman said the case was fresh from her campaign and that police were a systematic approach to protecting people ' s lives. [SEP] i arrived at the school and came on the final day of my first sister ' s high school at the university. [SEP] he was due to present his verdict at the court later. [SEP] a live show will play the [SEP]", "detok_text": "[CLS] zimbabwe's people over the last five decades, the world bank said. [SEP] a study by the department for national security estimated last month that inflation would be down at 4. 3 per cent and the cost of working abroad had to hit the total by about 25 per cent. [SEP] the labour government spokesman said the case was fresh from her campaign and that police were a systematic approach to protecting people's lives. [SEP] i arrived at the school and came on the final day of my first sister's high school at the university. [SEP] he was due to present his verdict at the court later. [SEP] a live show will play the [SEP]"}
+{"type": "sample", "index": 35, "raw_text": "[CLS] just one and last eight games of the competition. [SEP] former opposition leader khatami on thursday announced plans to show his support to president ahmadinejad, one of iran ' s most - muslim factions. [SEP] we are scared of being known as the family, \" says a councilman. [SEP] he has appeared on cbs ' s cooking show \" america ' s kitchen \" for the first time in years. [SEP] 5, while no. 4 nadal played against no. 6 nicolas krreo in the quarterfinals. [SEP] \" we have not had a formal report to consider what should have happened, \" said former german head coach jens [SEP]", "detok_text": "[CLS] just one and last eight games of the competition. [SEP] former opposition leader khatami on thursday announced plans to show his support to president ahmadinejad, one of iran's most - muslim factions. [SEP] we are scared of being known as the family, \"says a councilman. [SEP] he has appeared on cbs's cooking show\" america's kitchen \"for the first time in years. [SEP] 5, while no. 4 nadal played against no. 6 nicolas krreo in the quarterfinals. [SEP]\" we have not had a formal report to consider what should have happened, \" said former german head coach jens [SEP]"}
+{"type": "sample", "index": 36, "raw_text": "[CLS] record. [SEP] on tuesday, three officers arrested over the bombing by police at a business meeting in the northern city of caracas. [SEP] the board that met monday said a review would be conducted in the coming year, according to a staff statement. [SEP] beijing ( ap ) - - assistant attorney general hu is headed to tokyo wednesday for launching what is expected to be a new phase of u. s. - china relations, even if, perhaps this time, the u. s, russia and other nations have agreed to participate in the talks. [SEP] in 2005, he spent three years with the company, making it the first to hand over [SEP]", "detok_text": "[CLS] record. [SEP] on tuesday, three officers arrested over the bombing by police at a business meeting in the northern city of caracas. [SEP] the board that met monday said a review would be conducted in the coming year, according to a staff statement. [SEP] beijing (ap) - - assistant attorney general hu is headed to tokyo wednesday for launching what is expected to be a new phase of u. s. - china relations, even if, perhaps this time, the u. s, russia and other nations have agreed to participate in the talks. [SEP] in 2005, he spent three years with the company, making it the first to hand over [SEP]"}
+{"type": "sample", "index": 37, "raw_text": "[CLS] britain, america, italy, asia and denmark, and eventually scotland. [SEP] they looked shaky, losing five games on career - high five and scoring three runs in eight innings. [SEP] the red sox would have to turn out fans who bought tickets to the game before post game 5, and had to play 3 - d games. [SEP] so we tried this, using a comprehensive study that is considered a health - and - safety approach among younger people. [SEP] we are angry and disappointed. [SEP] for years, the government had been on a roll. [SEP] the rockets shot at least 50 percent from the field, who won eight of their last [SEP]", "detok_text": "[CLS] britain, america, italy, asia and denmark, and eventually scotland. [SEP] they looked shaky, losing five games on career - high five and scoring three runs in eight innings. [SEP] the red sox would have to turn out fans who bought tickets to the game before post game 5, and had to play 3 - d games. [SEP] so we tried this, using a comprehensive study that is considered a health - and - safety approach among younger people. [SEP] we are angry and disappointed. [SEP] for years, the government had been on a roll. [SEP] the rockets shot at least 50 percent from the field, who won eight of their last [SEP]"}
+{"type": "sample", "index": 38, "raw_text": "[CLS] to go, are offering limited opportunities, \" he said. [SEP] while only 17 other people have received the h1n1, 61 percent of the risk of non - reusal respiratory disease. [SEP] the russian, forced to withdraw after his country ' s first defeat, lost five break points in the first set, beating former seed nicolas kiruso and gasquet went on to win and take a first - half 6 - 3 2 - 3 6 - 3 6 - 7 lead. [SEP] but the officers thought it was untenable as people waited for the call. [SEP] 15, 2007, was $ 31, 712 [SEP]", "detok_text": "[CLS] to go, are offering limited opportunities, \" he said. [SEP] while only 17 other people have received the h1n1, 61 percent of the risk of non - reusal respiratory disease. [SEP] the russian, forced to withdraw after his country's first defeat, lost five break points in the first set, beating former seed nicolas kiruso and gasquet went on to win and take a first - half 6 - 3 2 - 3 6 - 3 6 - 7 lead. [SEP] but the officers thought it was untenable as people waited for the call. [SEP] 15, 2007, was $31, 712 [SEP]"}
+{"type": "sample", "index": 39, "raw_text": "[CLS] giving details of the 23 - year - old defender ' s death, but says the president was the player and is not to blame. [SEP] 5, 2006. [SEP] friends and family nearby told her that he was devastated and contacted a number of friends within hours before returning to the hospital and on their way to hospital. [SEP] it all ended long ago if the team had lost an important match, we thought it would have been 15 points, rather than 20 points away and their top five points. [SEP] ferguson ' s manager sir alex ferguson won last year ' s third - round tie at club olympiaafe on sunday. [SEP] what is [SEP]", "detok_text": "[CLS] giving details of the 23 - year - old defender's death, but says the president was the player and is not to blame. [SEP] 5, 2006. [SEP] friends and family nearby told her that he was devastated and contacted a number of friends within hours before returning to the hospital and on their way to hospital. [SEP] it all ended long ago if the team had lost an important match, we thought it would have been 15 points, rather than 20 points away and their top five points. [SEP] ferguson's manager sir alex ferguson won last year's third - round tie at club olympiaafe on sunday. [SEP] what is [SEP]"}
+{"type": "sample", "index": 40, "raw_text": "[CLS] two set points, and won 11 points in five matches, to defeat justine henin ' s number one on wednesday. [SEP] despite the most impressive run defense of the n. a. a., they got 37 points out of 31 from connecticut and won the next round, 24 - 26. [SEP] u. s. military officials said coalition air jets raided the taliban base in marjah early tuesday, giving the first that the taliban had died in three days. [SEP] they were delivered to retired air force officials at a base near fort hood, in texas, ahead of the official start of hostilities during the civil war. [SEP] 17 - [SEP]", "detok_text": "[CLS] two set points, and won 11 points in five matches, to defeat justine henin's number one on wednesday. [SEP] despite the most impressive run defense of the n. a. a., they got 37 points out of 31 from connecticut and won the next round, 24 - 26. [SEP] u. s. military officials said coalition air jets raided the taliban base in marjah early tuesday, giving the first that the taliban had died in three days. [SEP] they were delivered to retired air force officials at a base near fort hood, in texas, ahead of the official start of hostilities during the civil war. [SEP] 17 - [SEP]"}
+{"type": "sample", "index": 41, "raw_text": "[CLS] when they make a formal bid for the club. [SEP] the answer : good news is going to be good. [SEP] that number is expected to reach 18, 000 units by the end of 2011. [SEP] the approval of the deal which is currently being debated in a general session of the house will make its way to parliament by the end of the year but was rejected by some 70 per cent. [SEP] \" the plan is probably right now to race in paris or manchester by 2010, but there is some evidence of a plan for the team to run, \" said button, who won the 2008 tour, who withdrew after the race due to [SEP]", "detok_text": "[CLS] when they make a formal bid for the club. [SEP] the answer: good news is going to be good. [SEP] that number is expected to reach 18, 000 units by the end of 2011. [SEP] the approval of the deal which is currently being debated in a general session of the house will make its way to parliament by the end of the year but was rejected by some 70 per cent. [SEP] \"the plan is probably right now to race in paris or manchester by 2010, but there is some evidence of a plan for the team to run,\" said button, who won the 2008 tour, who withdrew after the race due to [SEP]"}
+{"type": "sample", "index": 42, "raw_text": "[CLS]. [SEP] nadal was to play on wednesday in his first match here at london ' s o2 arena. [SEP] ( cnn ) - - ljubicic lost two sets against china on sunday, and against robert bosco of the united states, who he won the 2006 australian open and the tour of the nation, his win of the year was effectively preventing the german national team from competing until july ' s eighth edition, the tour of south open. [SEP] in florida... texas, california, california and california are all put up for grabs by these voters. we have a lot of wh ' s. [SEP] \" [SEP]", "detok_text": "[CLS]. [SEP] nadal was to play on wednesday in his first match here at london's o2 arena. [SEP] (cnn) - - ljubicic lost two sets against china on sunday, and against robert bosco of the united states, who he won the 2006 australian open and the tour of the nation, his win of the year was effectively preventing the german national team from competing until july's eighth edition, the tour of south open. [SEP] in florida... texas, california, california and california are all put up for grabs by these voters. we have a lot of wh's. [SEP] \" [SEP]"}
+{"type": "sample", "index": 43, "raw_text": "[CLS] any details as to how the service would be affected, but he said that information about the new service would be available by mid - afternoon and by the publication of the report. [SEP] the australians have been very strong at the oval, they ' ve been a bit as good on a good pitch, well and good, and there ' s a lot of pressure and a lot at the top. [SEP] dr phil evans, director of cervical cancer uk, said : \" we are aware that screening is not good for cervical cancer. [SEP] there were six crew members among those who died at a naval air base in iraq. [SEP] top military official [SEP]", "detok_text": "[CLS] any details as to how the service would be affected, but he said that information about the new service would be available by mid - afternoon and by the publication of the report. [SEP] the australians have been very strong at the oval, they've been a bit as good on a good pitch, well and good, and there's a lot of pressure and a lot at the top. [SEP] dr phil evans, director of cervical cancer uk, said: \" we are aware that screening is not good for cervical cancer. [SEP] there were six crew members among those who died at a naval air base in iraq. [SEP] top military official [SEP]"}
+{"type": "sample", "index": 44, "raw_text": "[CLS] everything from the back to the head. [SEP] about 9, 000 foreign visitors were expected to stay off the streets of taiwan on wednesday, but police and the national authorities put off their alert to ensure the warnings had not been heeded by the department of finance. [SEP] there is a pr business that runs travel and finance services from both airlines. [SEP] it ' s so improbable you ' d pay a lot of council tax. [SEP] nadal, who led 5 - 2 in the first set before he was out, hit an ace on second. [SEP] thompson ' s lawyer, 29 - year - old john belford, [SEP]", "detok_text": "[CLS] everything from the back to the head. [SEP] about 9, 000 foreign visitors were expected to stay off the streets of taiwan on wednesday, but police and the national authorities put off their alert to ensure the warnings had not been heeded by the department of finance. [SEP] there is a pr business that runs travel and finance services from both airlines. [SEP] it's so improbable you'd pay a lot of council tax. [SEP] nadal, who led 5 - 2 in the first set before he was out, hit an ace on second. [SEP] thompson's lawyer, 29 - year - old john belford, [SEP]"}
+{"type": "sample", "index": 45, "raw_text": "[CLS] director at the national capital institute. [SEP] she is the face of her child ' s life. [SEP] it was difficult to comprehend, but was ultimately realistic. [SEP] as of saturday ' s death, only the death count had been ruled as homicide, wake county coroner ' s attorney mark said in the statement that the coroner doesn ' t know the victims. [SEP] \" i would love to play golf and not hide, \" he said. [SEP] o ' shea then added a half - time goal with 13 seconds left to give chelsea a 4 - 2, giving them a fourth - place victory over their premier league opponents. [SEP] at the time [SEP]", "detok_text": "[CLS] director at the national capital institute. [SEP] she is the face of her child's life. [SEP] it was difficult to comprehend, but was ultimately realistic. [SEP] as of saturday's death, only the death count had been ruled as homicide, wake county coroner's attorney mark said in the statement that the coroner doesn't know the victims. [SEP] \"i would love to play golf and not hide,\" he said. [SEP] o' shea then added a half - time goal with 13 seconds left to give chelsea a 4 - 2, giving them a fourth - place victory over their premier league opponents. [SEP] at the time [SEP]"}
+{"type": "sample", "index": 46, "raw_text": "[CLS] joe biden. [SEP] leicester and half - back wogan, who lost his job from england after losing three caps, appears to be the leading candidate for their team this week. [SEP] at pittsburgh, eric brezon also scored twice to end a three - point deficit for pittsburgh, which beat st. louis for the fourth time in five games. [SEP] a tornado forecast tuesday in ohio and wisconsin started early monday or friday and continued late - night until sunday. [SEP] perhaps by next year, he claimed, the sense was that mr obama would fight to gain the presidency of his own and win \" the presidency \" if he took them [SEP]", "detok_text": "[CLS] joe biden. [SEP] leicester and half - back wogan, who lost his job from england after losing three caps, appears to be the leading candidate for their team this week. [SEP] at pittsburgh, eric brezon also scored twice to end a three - point deficit for pittsburgh, which beat st. louis for the fourth time in five games. [SEP] a tornado forecast tuesday in ohio and wisconsin started early monday or friday and continued late - night until sunday. [SEP] perhaps by next year, he claimed, the sense was that mr obama would fight to gain the presidency of his own and win \"the presidency\" if he took them [SEP]"}
+{"type": "sample", "index": 47, "raw_text": "[CLS] is expected to support the growing popularity of smartphones. [SEP] no, wait. [SEP] \" the whole story is a lot of money about money, that we can ' t really pay back because they don ' t have the money they ' d spend, \" mr. cynics said. [SEP] wales ' chances in the second half, which had failed to put the focus on their ball away from play, were a brilliant attempt to get clear for the first goal. [SEP] the woman had been treated for severe shock at anfield hospital in the midlands. [SEP] he scored 11 runs in one match, finishing with 22, again setting up [SEP]", "detok_text": "[CLS] is expected to support the growing popularity of smartphones. [SEP] no, wait. [SEP] \"the whole story is a lot of money about money, that we can't really pay back because they don't have the money they'd spend,\" mr. cynics said. [SEP] wales' chances in the second half, which had failed to put the focus on their ball away from play, were a brilliant attempt to get clear for the first goal. [SEP] the woman had been treated for severe shock at anfield hospital in the midlands. [SEP] he scored 11 runs in one match, finishing with 22, again setting up [SEP]"}
+{"type": "sample", "index": 48, "raw_text": "[CLS] a gun on his face after his hand took a blow on the shoulder. [SEP] \" everything is very good, \" he told the financial times on sunday. [SEP] the mission has set a target for may 2012. [SEP] former police chief mohammed mouri al - maliki is backed by prime minister mohammad daoud and said he won the majority of the 18 provinces. [SEP] i was so exhausted, i haven ' t even had a shot at the first round. [SEP] a version this article was published on guardian. co. uk at 20. 20 bst on thursday 29 april 2010. [SEP] the idea is to pay a reasonable price of [SEP]", "detok_text": "[CLS] a gun on his face after his hand took a blow on the shoulder. [SEP] \"everything is very good,\" he told the financial times on sunday. [SEP] the mission has set a target for may 2012. [SEP] former police chief mohammed mouri al - maliki is backed by prime minister mohammad daoud and said he won the majority of the 18 provinces. [SEP] i was so exhausted, i haven't even had a shot at the first round. [SEP] a version this article was published on guardian. co. uk at 20. 20 bst on thursday 29 april 2010. [SEP] the idea is to pay a reasonable price of [SEP]"}
+{"type": "sample", "index": 49, "raw_text": "[CLS] of anti - flu drugs is 60 percent. [SEP] \" i am sure this will be the last of years, \" the british champion said, referring to the date of his final event against borg, who won here in july. [SEP] india ' s half - hitting opener plundered three leg - spins, but helped england ' s lead make it up in the match and hit a fifth century in reply with a help from diller, who went for a six. [SEP] he fell to 15 - 7 after winning his first victory in seven starts, before starting the season at just 79. [SEP] there ' s time for a serious [SEP]", "detok_text": "[CLS] of anti - flu drugs is 60 percent. [SEP] \"i am sure this will be the last of years,\" the british champion said, referring to the date of his final event against borg, who won here in july. [SEP] india's half - hitting opener plundered three leg - spins, but helped england's lead make it up in the match and hit a fifth century in reply with a help from diller, who went for a six. [SEP] he fell to 15 - 7 after winning his first victory in seven starts, before starting the season at just 79. [SEP] there's time for a serious [SEP]"}
+{"type": "sample", "index": 50, "raw_text": "[CLS] \" said peter wilson, leader of the upper house, which has passed on the green party ' s manifesto. [SEP] \" if you ' re thinking of people who may do a little more of a little bit, you may have to make it, in the end, don ' t you? [SEP] it doesn ' t have much to do with our history. [SEP] calls is called out ( r. i. e. ), people can make those calls on their blackberry. [SEP] it ' s probably because it ' s all over the place. [SEP] he remained in second place, eight points ahead of liverpool while bayern ' s decei [SEP]", "detok_text": "[CLS] \"said peter wilson, leader of the upper house, which has passed on the green party's manifesto. [SEP]\" if you're thinking of people who may do a little more of a little bit, you may have to make it, in the end, don't you? [SEP] it doesn't have much to do with our history. [SEP] calls is called out (r. i. e.), people can make those calls on their blackberry. [SEP] it's probably because it's all over the place. [SEP] he remained in second place, eight points ahead of liverpool while bayern's decei [SEP]"}
+{"type": "sample", "index": 51, "raw_text": "[CLS] a source suggested that he was likely to stay early because he failed to hold up his opposition. [SEP] police found a dark - car parked car with four occupants and a large passenger vehicle in the redcropted road area near knightsbridge. [SEP] for only six months, his competitive aspirations were destroyed, the german having lost a match in the french open in september 2007, the third of his entire major career. [SEP] if it happens, it won ' t get out of the way, he says. [SEP] cancellara pulled out of the race on monday because of his crash in this year ' s vuelta race and claimed that the [SEP]", "detok_text": "[CLS] a source suggested that he was likely to stay early because he failed to hold up his opposition. [SEP] police found a dark - car parked car with four occupants and a large passenger vehicle in the redcropted road area near knightsbridge. [SEP] for only six months, his competitive aspirations were destroyed, the german having lost a match in the french open in september 2007, the third of his entire major career. [SEP] if it happens, it won't get out of the way, he says. [SEP] cancellara pulled out of the race on monday because of his crash in this year's vuelta race and claimed that the [SEP]"}
+{"type": "sample", "index": 52, "raw_text": "[CLS] his side. [SEP] \" you were ready here that you can get back - up as well because it always wants to be nice, to have the pace to keep yourself out of the game, \" he says, adding something about his first season. [SEP] the researchers believed those in history had a better chance of death, but 55, 000 who said they could have been affected by breast cancer. [SEP] nadal has spent hard time winning all four of the same event this year and earned his place in third place finishes in doha and beijing. [SEP] the most recent is that he is a king. [SEP] the new rate of tax, which [SEP]", "detok_text": "[CLS] his side. [SEP] \"you were ready here that you can get back - up as well because it always wants to be nice, to have the pace to keep yourself out of the game,\" he says, adding something about his first season. [SEP] the researchers believed those in history had a better chance of death, but 55, 000 who said they could have been affected by breast cancer. [SEP] nadal has spent hard time winning all four of the same event this year and earned his place in third place finishes in doha and beijing. [SEP] the most recent is that he is a king. [SEP] the new rate of tax, which [SEP]"}
+{"type": "sample", "index": 53, "raw_text": "[CLS] about half the population in the united states, but today ' s population of 6, 000 and more when they moved to eastern paris in 1984. [SEP] fighting broke out in 1999 when the pair were both playing for the west siders. [SEP] the visitors took advantage of the 2 - 2 - 0 deficit in the 21st minute from midfielder sean taylor ' s header for an own goal which could be seen as hiddink ' s first goal. [SEP] \" it ' s quite very nice to get a glimpse of the earth, \" said turner, a devoted writer. [SEP] but he was worried about the prospect of closing the banking system. [SEP]", "detok_text": "[CLS] about half the population in the united states, but today's population of 6, 000 and more when they moved to eastern paris in 1984. [SEP] fighting broke out in 1999 when the pair were both playing for the west siders. [SEP] the visitors took advantage of the 2 - 2 - 0 deficit in the 21st minute from midfielder sean taylor's header for an own goal which could be seen as hiddink's first goal. [SEP] \"it's quite very nice to get a glimpse of the earth,\" said turner, a devoted writer. [SEP] but he was worried about the prospect of closing the banking system. [SEP]"}
+{"type": "sample", "index": 54, "raw_text": "[CLS] 1 million in general operating expenses related to its risk - management unit. [SEP] the major indexes earlier rose 13 percent after key results - - standard & poor ' s international insurance co. - - gained strength from moody ' s moody ' s world credit report and the nxia ' s global telecoms index. [SEP] votes were set for sunday at 2000 gmt and saturday ( sunday ). [SEP] the little girl is keeping cool. [SEP] alisa lula, the danish second seed, beat lilian der kos 5 - 6, and former u. s. open champion casey kutcher 6 - 0 6 - 1 [SEP]", "detok_text": "[CLS] 1 million in general operating expenses related to its risk - management unit. [SEP] the major indexes earlier rose 13 percent after key results - - standard & poor's international insurance co. - - gained strength from moody's moody's world credit report and the nxia's global telecoms index. [SEP] votes were set for sunday at 2000 gmt and saturday (sunday). [SEP] the little girl is keeping cool. [SEP] alisa lula, the danish second seed, beat lilian der kos 5 - 6, and former u. s. open champion casey kutcher 6 - 0 6 - 1 [SEP]"}
+{"type": "sample", "index": 55, "raw_text": "[CLS] taseer. [SEP] and we consider all the options on top of the mind, and even think about what we can do to determine what is the safest way to use a computer. [SEP] more patients know that it is part of our lives. [SEP] the man was hit by a peugeot car in kingsfield road, reading, in the early hours of the morning, 2005, on saturday. [SEP] the jets failed to stop the rebels in a three - day ambush of militants at mohmand in the east north of afghanistan on tuesday. [SEP] malin, president barack obama ' s first wife, got the call. [SEP] the [SEP]", "detok_text": "[CLS] taseer. [SEP] and we consider all the options on top of the mind, and even think about what we can do to determine what is the safest way to use a computer. [SEP] more patients know that it is part of our lives. [SEP] the man was hit by a peugeot car in kingsfield road, reading, in the early hours of the morning, 2005, on saturday. [SEP] the jets failed to stop the rebels in a three - day ambush of militants at mohmand in the east north of afghanistan on tuesday. [SEP] malin, president barack obama's first wife, got the call. [SEP] the [SEP]"}
+{"type": "sample", "index": 56, "raw_text": "[CLS] on thursday and urged the president to remain focused on the side of the campaign for a primary election, however, sen. claire e.rieu, r - tenn., said on thursday. [SEP] while diesel costs around $ 3. 45 a gallon for conventional diesel, experts said it would cost 230 miles more per one - day gallon of oil, at about $ 1. 88 a gallon on gasoline and $ 1. 87 per gallon more oil on gasoline. [SEP] blake led three sets in five minutes before fighting early on in the fourth set against his friend syp melzer 6 - 3, 6 - 0, 7 - [SEP]", "detok_text": "[CLS] on thursday and urged the president to remain focused on the side of the campaign for a primary election, however, sen. claire e.rieu, r - tenn., said on thursday. [SEP] while diesel costs around $3. 45 a gallon for conventional diesel, experts said it would cost 230 miles more per one - day gallon of oil, at about $1. 88 a gallon on gasoline and $1. 87 per gallon more oil on gasoline. [SEP] blake led three sets in five minutes before fighting early on in the fourth set against his friend syp melzer 6 - 3, 6 - 0, 7 - [SEP]"}
+{"type": "sample", "index": 57, "raw_text": "[CLS]. [SEP] we, as you say, have looked up at the sheer intensity of the power with which they came. [SEP] the results will be published by february 24 - 19 september. [SEP] palatine, ill., sept. [SEP] the 37 - year - old allowed 15 run innings from his start since the 2005 loss to cincinnati, who fell to 9 - 5. [SEP] and they will not brief his family until wednesday before making a statement. [SEP] \" it really makes me money. \" [SEP] the czech news agency said the 10 - day war reached a remote island of 1, 000 miles ( 100 miles ) of territory and more than a [SEP]", "detok_text": "[CLS]. [SEP] we, as you say, have looked up at the sheer intensity of the power with which they came. [SEP] the results will be published by february 24 - 19 september. [SEP] palatine, ill., sept. [SEP] the 37 - year - old allowed 15 run innings from his start since the 2005 loss to cincinnati, who fell to 9 - 5. [SEP] and they will not brief his family until wednesday before making a statement. [SEP] \"it really makes me money.\" [SEP] the czech news agency said the 10 - day war reached a remote island of 1, 000 miles (100 miles) of territory and more than a [SEP]"}
+{"type": "sample", "index": 58, "raw_text": "[CLS] movie on the web. [SEP] the airline has said the occurred around 7 : 30 a. m. [SEP] and it ' s clear this comes from a number of sources i want to think. [SEP] men and young women were more or less likely to develop far greater problems than overweight women of the control group. [SEP] \" it will be long and tough, but it ' s still before us that we ' ll have to keep that for now, \" he added. [SEP] the scot, who made a three - set record in winning his sixth career title at the u. s. open in 2005 and made the year ' s [SEP]", "detok_text": "[CLS] movie on the web. [SEP] the airline has said the occurred around 7: 30 a. m. [SEP] and it's clear this comes from a number of sources i want to think. [SEP] men and young women were more or less likely to develop far greater problems than overweight women of the control group. [SEP] \"it will be long and tough, but it's still before us that we'll have to keep that for now,\" he added. [SEP] the scot, who made a three - set record in winning his sixth career title at the u. s. open in 2005 and made the year's [SEP]"}
+{"type": "sample", "index": 59, "raw_text": "[CLS] regardless of his age. [SEP] last year, 0. 3 percent of obese children, died per 10, 000 people. [SEP] schali had been given a cap at the age of 18 and in 2006 as a promising young player and has used his last - gasp form during his six nations career against the all blacks to give up a try. [SEP] a group of charities has collected more than $ 500, 000 annually for the foundation ' s cause, insureing the savings of more than 50, 000 donors, including breast cancer survivors, non - income groups, young adults and young children. [SEP] and since the first labour [SEP]", "detok_text": "[CLS] regardless of his age. [SEP] last year, 0. 3 percent of obese children, died per 10, 000 people. [SEP] schali had been given a cap at the age of 18 and in 2006 as a promising young player and has used his last - gasp form during his six nations career against the all blacks to give up a try. [SEP] a group of charities has collected more than $500, 000 annually for the foundation's cause, insureing the savings of more than 50, 000 donors, including breast cancer survivors, non - income groups, young adults and young children. [SEP] and since the first labour [SEP]"}
+{"type": "sample", "index": 60, "raw_text": "[CLS] an initial flight which, two weeks ago, lost its close eye and lost its life. [SEP] they appealed to \" contact police \" to find them. [SEP] in 2008, hatter wrapped up his sixth title in the tour of germany, which gave him two points from his grasp. [SEP] they were well ahead at full - time at the start of the half but the fly - half armitage missed a chance when he hit by his captain with a deep flurry. [SEP] the latest attack took place near the afghan capital, said general abbas omar, a u. s. military spokesman in zawa district. [SEP] a seven - [SEP]", "detok_text": "[CLS] an initial flight which, two weeks ago, lost its close eye and lost its life. [SEP] they appealed to \"contact police\" to find them. [SEP] in 2008, hatter wrapped up his sixth title in the tour of germany, which gave him two points from his grasp. [SEP] they were well ahead at full - time at the start of the half but the fly - half armitage missed a chance when he hit by his captain with a deep flurry. [SEP] the latest attack took place near the afghan capital, said general abbas omar, a u. s. military spokesman in zawa district. [SEP] a seven - [SEP]"}
+{"type": "sample", "index": 61, "raw_text": "[CLS] force. [SEP] england ' s chairman sir alex capesh said he was confident that england ' s side could now qualify for a tournament in the united states. [SEP] the majority of the patients were probably stopped using a procedure known as an x - ray machine, or ct scan. [SEP] but there are no un - made home owners, who saw their recovery take place in february. [SEP] it also reported a market value of $ 35 million. [SEP] over two years, one person would be able to get a car ' s fuel economy. [SEP] the facility is one of the site ' s oldest facilities. [SEP] an investigation under the terrorism section [SEP]", "detok_text": "[CLS] force. [SEP] england's chairman sir alex capesh said he was confident that england's side could now qualify for a tournament in the united states. [SEP] the majority of the patients were probably stopped using a procedure known as an x - ray machine, or ct scan. [SEP] but there are no un - made home owners, who saw their recovery take place in february. [SEP] it also reported a market value of $35 million. [SEP] over two years, one person would be able to get a car's fuel economy. [SEP] the facility is one of the site's oldest facilities. [SEP] an investigation under the terrorism section [SEP]"}
+{"type": "sample", "index": 62, "raw_text": "[CLS] ahead 1 - 0 in saturday ' s first quarter - final, when essien added a goal in the 67th minute that could have saved life for the wales defender. [SEP] england paceman stephen jones doubled cardiff ' s last - minute lead as the bottom side beat southend 3 - 0 after three minutes to win their second home title. [SEP] but the impetling distance between the giants and the brits, however, is not good, so much, if any, it ' s hard to hold it. [SEP] there is no chance of failure, but in the case of injury he is good enough to have the next goal [SEP]", "detok_text": "[CLS] ahead 1 - 0 in saturday's first quarter - final, when essien added a goal in the 67th minute that could have saved life for the wales defender. [SEP] england paceman stephen jones doubled cardiff's last - minute lead as the bottom side beat southend 3 - 0 after three minutes to win their second home title. [SEP] but the impetling distance between the giants and the brits, however, is not good, so much, if any, it's hard to hold it. [SEP] there is no chance of failure, but in the case of injury he is good enough to have the next goal [SEP]"}
+{"type": "sample", "index": 63, "raw_text": "[CLS] from 1979 to 1998. [SEP] the remaining 5, 000 were started on sunday with the loss of sir michael gossek. [SEP] the other way to save your money. [SEP] the military said at the time that eight american soldiers were not among the soldier ' s 25 members, but were seriously wounded sunday. [SEP] that, of course, was a half - point thursday night. [SEP] a new deal of \" change \" is the most important of all priorities. [SEP] the 4 - and 3 - year - olds were taken to hospital at about midday on sunday. [SEP] at the time of the deal, amid opposition from pakistani politicians and the [SEP]", "detok_text": "[CLS] from 1979 to 1998. [SEP] the remaining 5, 000 were started on sunday with the loss of sir michael gossek. [SEP] the other way to save your money. [SEP] the military said at the time that eight american soldiers were not among the soldier's 25 members, but were seriously wounded sunday. [SEP] that, of course, was a half - point thursday night. [SEP] a new deal of \"change\" is the most important of all priorities. [SEP] the 4 - and 3 - year - olds were taken to hospital at about midday on sunday. [SEP] at the time of the deal, amid opposition from pakistani politicians and the [SEP]"}

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_temp_schedule_128steps_n64/cosine_2p0_to_1p0_c1024_detok_raw_samples.txt

@@ -0,0 +1,230 @@
+cosine_2p0_to_1p0_c1024_detok
+{
+  "type": "summary",
+  "name": "cosine_2p0_to_1p0_c1024",
+  "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt",
+  "step": 168000,
+  "decode": {
+    "kind": "categorical_fullvocab_temp_schedule",
+    "config": "cosine_2p0_to_1p0_c1024",
+    "steps": 128,
+    "model_t_mode": "post",
+    "support_power": 1.0,
+    "semantic_power": 1.0,
+    "temp_start": 2.0,
+    "temp_end": 1.0,
+    "temp_schedule": "cosine",
+    "concentration_min": 1.0,
+    "concentration_max": 1024.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 69.45955054398952,
+    "nll_per_token": 4.240744576577883,
+    "tokens": 9751
+  },
+  "diversity": {
+    "sample_entropy": 4.014714437300709,
+    "unique_tokens": 1477,
+    "token_count": 8192,
+    "distinct_1": 0.1802978515625,
+    "distinct_2": 0.59251968503937,
+    "top_token_mass": 0.058837890625
+  }
+}
+
+===== sample 000 =====
+[CLS] 2003 to 2004 and 2006 - 11 times from 1998 to 2004. [SEP] frankfurt - liverpool failed to win the champions league, while champions lyon have also tried to close their champions league deficit by thrashing out third place lyon, with side har aar taking place in the group 16 at liverpool. [SEP] the survey was conducted among 274 women, based on telephone of 686 women aged between 18 and older. [SEP] fourth - seeded roger federer beat marcos bohdandr 1 - 6 - 0, 6 - 4, 7 - 3 in the first round, while fourth - seeded robin gulband, and frenchman david guandet [SEP]
+
+===== sample 001 =====
+[CLS] eighth - seeded frenchman and sixth - seeded federer 6 - 0 - 7 6 - 0 sunday to upset eighth - seeded russian k savvili 2 - 1. [SEP] elsewhere, blake lost 6 - 1, 6 - 3, 6 - 7 4 - 6, 2 - 5, 6 - 7 and lost 6 - 4 6 - 1, and sixth seeded eighth - seeded nadal and sixth seed jankpovic defeated no. 3 6 - 3, 7 - 5 7 - 6, 4 - frenchman jo - tsonga. [SEP] the youngest of the men, aged 35, died just five months after his death. [SEP] they [SEP]
+
+===== sample 002 =====
+[CLS] budget. [SEP] davydenko of russia 6 - 2 7 - 5 defeated nicolas fourthent of france 6 - 4 6 - 2 and claim a 9 - 6 6, 7 - 5 7, 5 - 7, 6 - 1, 6 - 3 - 2. [SEP] elsewhere in the quarterfinals of saturday's french open, djokovic defeated fellow fourth seed michael becker 7 - 5 2 - 0 and beat karlovic 6 - 4 6 - 4, 6 - 7, 7 - 7, 7 - 6 - 7 victory over ninth - seeded david nalbandian. [SEP] fourth - seeded roger federer crashed out of the french [SEP]
+
+===== sample 003 =====
+[CLS] on sunday until until november 2008. [SEP] 16 - 10, london, sept. [SEP] the quake was centered centered 215 miles (625 kilometers) 280 miles southwest of the capital and centered about 300 miles (260 miles) west north of harare. [SEP] fourth seed djokovic opened the fourth grand slam in roger federer's team this season, brilliantly rolling over his fellow frenchman joie marin cilic, beating nicolas kolbek 6 - 3 6 - 3 and belgian fourth seed james blake and fourth round quarter - finalist kim clijsters. [SEP] the next investigation will take place on on may 19 and sunday 24 may [SEP]
+
+===== sample 004 =====
+[CLS]'s long - term outlook, which was said to be released on thursday. [SEP] m & b's 7. 3 billion ($6. 50) valuation tied with ge at $2, 450, 000, and ge at $7, 644 per share. [SEP] the men's draw for wimbledon champion andy roddick was marred by a stunning defeat by british open at the french open on saturday after federer lost his fourth time in his first major title in the u. s. open beating off - defending champion rafael nadal at the french open, his one last win in 2007. [SEP] if you have a small [SEP]
+
+===== sample 005 =====
+[CLS] seed dinara safina eased from exhaustion into the fourth round, defeating virginie razzano 6 - 4 7 - 5 to win 4 - 0 on friday. [SEP] elena dementieva's record wins at the french open and the australian open. [SEP] arsenal's leaders will play their fourth - round game when arsenal play defending champions arsenal, liverpool and barcelona. • toulouse, france's only finish of the season held on points against the bottom side (3 - 2, 2 - 2), and bordeaux ( 1 - 2, 1 - 0, in sixth place. [SEP] but the company makes clear that [SEP]
+
+===== sample 006 =====
+[CLS] series. [SEP] nadal, seeded fourth above rafael nadal, defeated nicolas djko 6 - 6 6 - 6 6 - 0, and andy murray 7 - 6, 6 - 7 - 6, 4 - 6 - 0. [SEP] the 90, 000 - pound native of france has made his debut appearance in his seventeenth campaign after his victory in paris in 2004. [SEP] sixth - seeded andy murray 7 - 1, 7 - 7 ), frenchman tommy robredo survived 6 - 3, 7 - 6 (7 - 4), former frenchman wil youngsters and german david johansson and france's marco bourro survived. [SEP] [SEP]
+
+===== sample 007 =====
+[CLS] lost 4 - 1, 7 - 0 and frenchman dji pulled up scoring three points when city roared back from a goal down in the sixth minute, but the defender frank murphy pulled ahead with a penalty winner in the 19th minute to finish the first half. [SEP] the fifth - seeded frenchman nicolas sahdand, and sixth - seeded frenchman nikolay sav face france 6 - 1, with no. 4 seed nikolay petrovic, and david nalbandian 7 - 6 and philipp kzschko's eighth seed vassall russa losing 7 - 6 6 - 7. [SEP] the majority of children are healthy and getting [SEP]
+
+===== sample 008 =====
+[CLS] prison or committing himself to death. [SEP] safin, runner - up in the french open 2005 and 2006 and again this year, won the french open and the australian open in 2005 and 2004. [SEP] eurostard, sweden, 2011 (upi) - - kaira sava scored 6 - 2 against ernestie gulbs and produced a surprise winner at the stockholm open open thursday, taking no 1 seed andy murray and third seed azavia gafin 6 - 2, defeating teenager khrir kjelbic. [SEP] it follows concern over the government's decision to hold public hearings of the plan, which has [SEP]
+
+===== sample 009 =====
+[CLS]. [SEP] police said a black helicopter hit the side of the m4 in worcestershire on early saturday. [SEP] i had waited there from last time this morning at 6. 30 am until tuesday at 7 a. m, was sunday morning. [SEP] more than one died in custody, she said. [SEP] birmingham sit back after fifth - placed coventry drew 6 - 0, birmingham host second rated sunderland and cardiff city. [SEP] germany's nicolas kiefer 6 - 0, 7 - 6, 6 - 4, fourth and fourth - seed richard gady lost 6 - 2, 6 - 3 and fellow frenchman novak djokoko pulled out [SEP]
+
+===== sample 010 =====
+[CLS] justine henin was losing 2 - 6, 2 - 5 ), sixth - seeded venus williams lost 6 - 7, 6 - 7, 3 - 6. [SEP] i guess it's important to know what they can do to keep their minds. [SEP] nader's next serve survived a five - set chance earlier when american gretling won a two - point with safinarer in the third round to out - face 15 - year - old veteran belgian justine henin at 7 - 6 - 5, and the fourth seed rallied from a set on wednesday against fellow russian frenchman jev soderling, who lost [SEP]
+
+===== sample 011 =====
+[CLS] 6 - 2 friday, no. 17 nalbandian defeated frenchman robert blake and third seed nicolas tsonga of france 7 - 3 6, 6 - 2, 6 - 3, 6 - 2 7 - 5, and 6 - 3 - 2 up. [SEP] they lost for just the fifth time in 17 their last eight games. [SEP] spain's compatriot tshdassi, the 2004 french open champion, extended his lead to eighth place, losing at no. 13 gilles raze cornet, france's second seed, to take his place at no. 11 and frenchman thomas sorenfeld also retained [SEP]
+
+===== sample 012 =====
+[CLS] makes them more depressed and makes them feel the same way. [SEP] 27 - - joe vil scored his fifth goal saturday, netting seven premier league goals while robin van persie's brace left arsenal level three points behind premier league leaders liverpool, who travel to the emirates to face champions league. [SEP] arsenal were three points down at the beginning of the season, liverpool bounced back from 10th to win the premier league and liverpool sixth and liverpool in fourth place, while fourth - bottom clenna win promotion, gaffeia 10th to bottom side and third - side psvlba, who earlier beat 4 - 0 at anfield [SEP]
+
+===== sample 013 =====
+[CLS] consumers to spend more time on online spending. [SEP] ali kalou, the former arsenal manager, pulled a goal away from liverpool for chelsea's crown by scoring a second arsenal goal, while german defender sami sabakhtar celebrates a late goal for bordeaux after scoring the goal to draw sixth - place villa. [SEP] the figures looked at 370 deaths between 1971, the same period in the 1950s, the period 1979 to 2030. [SEP] 6 - 2, 6 - year - old champion mikhail saakashvili 6 - 2, 7 - 2 3 - 6, 6 - 4 fourth - seeded roger federer had seven break chances and [SEP]
+
+===== sample 014 =====
+[CLS] field included serbian 10th seed djokovic, belgian king kleyjestan, netherlands, and 11th seed roland garros of france, 73 - 69. [SEP] liverpool deservedly lost a deserved chance, with parra's glancing header down the right flank, just enough to earn a neat chance. [SEP] manchester united striker alex ferguson opened up a one - goal lead in a miserable season as aberdeen kept it at the foot of the scottish league group and champions league leaders rangers on saturday night. [SEP] i was born in london between 11 and 14 december and was diagnosed with a depressive later. [SEP] his decision came on the eve [SEP]
+
+===== sample 015 =====
+[CLS] only goal came after the interval, when the dutch centre michael essien lost the second half point when juve had found david st mirie, nose - dived at the corner and flicked the visitors' shot a long angle before beating novo before racing off the post. [SEP] a study of data, conducted for the department of health, found that the average age age at the age of 65 cancer was 1. 9 per higher than women of health problems in the study. [SEP] the flyers trailed 2 - 3 when pittsburgh was scored on a straight break. [SEP] pascal medoute, a 25 - year - old mechanic from antwerp [SEP]
+
+===== sample 016 =====
+[CLS] it would be impossible to determine the true identity of its troops. [SEP] federer beat dinara safin 6 - 2, including marcos baghdatis and gilles williams, andy murray, andy murray and nikolay davydenko; sixth - seeded karlsson and nicolas janko of the 2008 australian open, nikolay davydenko 6 - 1 gael monfils of france and seventh - seeded djokovic of serbia, who lost 2 - 3 in toronto. [SEP] the palace was opened in 2006 and opened in august. [SEP] the company received 55, 500 emergency calls from call users last year, compared to 675 in 2006. [SEP] [SEP]
+
+===== sample 017 =====
+[CLS] cuts and widespread market swings. [SEP] the surrey - born driver made his way. [SEP] 2009: seven grand grand prix, 4 - 21 - 3, williams 15 - 4 - 1 - 10 - 17, coulthard 2, williams 1 - 1 - 1 - 21, williams 4 - 1 - 18 - 1, rosberg 1 - 1 - 1, saicher 2 - 6 - 4, williams 4 - 1, williams 6 - 1, g williams 3 - 1, williams 6 - 1, s williams 1 - 0 - 1, 6 - 0 - 2 - 1, williams 4 - 4, williams 4 - [SEP]
+
+===== sample 018 =====
+[CLS] health and education. [SEP] emmanuel fabregas was injured for arsenal former arsenal man arsene wenger was out until tuesday with a hamstring injury and he sealed his place at home with a 2 point win over 10th place on wednesday night as defending champions league title chasing champions retained the premier league title. [SEP] the sixth - ranked fish advanced by rafael nadal and novak djokovic and lost 6 - 1 to novak djokovic. [SEP] the badgers lost 15 straight games and has lost three of the last four games against tennessee state in the third round. [SEP] thomas rundle, the team's chief executive, said [SEP]
+
+===== sample 019 =====
+[CLS] president general musharraf, died in an operation on sunday around the northern city of kabul, a nato statement said said. [SEP] also in the second round, teenager gilles simon of france got a scare and beat spain's michael isner 2 - 0 6 - 7 6 - 1. 7 million euros to defending champion roger federer. [SEP] the fourth - seeded sakovonva, defeated djokovicic 6 - 2 in moscow, but the winner of the quarter - final on davydenko's serve, beating russian vladimir radmanovic 6 - 2 and seventh - seeded german raimi 6 - 7 7 - [SEP]
+
+===== sample 020 =====
+[CLS] who finished holes at 67 - 73 and played the same at the 10th and final round of 65. [SEP] in 2006 germany was hit by europe's worst economic disaster. [SEP] french side champions bordeaux looked to earn a spot from a winning start by falling behind struggling reading and one point of fourth place german side ajax. [SEP] they then jumped on board and fled into the royal canal. [SEP] mark schwarzer fired the visitors into the 73rd minute with a second - half lead just seven minutes after johan rien equalle hit the goal to level stuttgart 3 - 1. [SEP] there has been speculation that she will not be out until june [SEP]
+
+===== sample 021 =====
+[CLS] faces fellow frenchman ram - bin makhra and fourth seed jb khev. [SEP] new zealand lost its fifth and fourth round, while pavlvy lost seven of 16. [SEP] ten others also died in hospital and spent 10 months in royal general hospital in early 2005. [SEP] nearly 1, 000 people have been killed and around 3, 000 homeless of their affected districts in the central province, neighbouring eastern nazand province. [SEP] clijsters won 6 - 3 - 6, 6 - 1 6 - 1, 0 - 6 second seed venus williams and american david galbs, a fourth - ranked player in [SEP]
+
+===== sample 022 =====
+[CLS] been under way around the whole of the canary islands, including palma and the canary islands. [SEP] another other french finalist, frenchman nicolas saeul, sixth - seeded tommy haas, third - seeded sixth seed richard hossein and monfionen, fifth - seeded sixth - seed nicolas mahkar 7 - 0. [SEP] he was reluctant to talk. [SEP] fourth - quarter finalist andy roddick reached the semifinals of the tournament after losing to twice former world no. 1 - seeded roger federer after his fourth final round was marred by a disappointing draw on friday. [SEP] at the end of the day, about 12 percent of all [SEP]
+
+===== sample 023 =====
+[CLS] finalist who lost in paris and doha, lost 12th seeded finalist roger williams and frenchman arnaud clement, frenchman jean - gilles simon in montreal and sixth - seeded australian open seed andy safina making his first appearance of the year. [SEP] in the draw, seventh seed sa kos defeated germany 0 - 1, 7, 5, 73, 73, 73, 74, france 74, france, 73, sweden. [SEP] frankel had scored on striker andrei arshavin's opening goal before goalkeeper johan babel scored in the second minute, giving substitute international frankell an early header. [SEP] there were close to 60 people [SEP]
+
+===== sample 024 =====
+[CLS] country. [SEP] federer came out of the match, 6 - 2, 6 - 3, and fourth seed nadie withdrew for britain's second tournament on thursday. [SEP] generali hawazni mohammad, from nato's national forces in afghanistan. [SEP] fifth seed novak djokovic made a mistake in losing him one match point in the fourth round, no. 3 seed david gulbis finished 10th and novakokovic ninth. [SEP] the opener was dropped three times before he began to finish on four, three for 23, with flintoff unbeaten on 80 and lee on five from seven overs. [SEP] a number of experts [SEP]
+
+===== sample 025 =====
+[CLS]........................................................................................... 3..... 3.... 4....................... [SEP]
+
+===== sample 026 =====
+[CLS] 838 708 767 767 7256 734 757 735. 767778 75818. 01317 723 8068 005, www. badsford. co. uk, 71 767 7574. 75810 ) and 77 74318. 738 738 758 737 71787. 688 7582. 7523 736. 7367 718 718 617 4. 2. 712. 711 757 1, 716 5. 2. 718. 768 1, 76 [SEP]
+
+===== sample 027 =====
+[CLS]. [SEP] sixth - seeded fourth - seeded andy roddick and fourth seed and fellow russian dinat safina pulled out of the quarterfinal when they lost 6 - 2 6 - 2 - 4, and could not break serve for a tight third set. [SEP] taylor was dismissed and michael vaughan made a fine start to his season, while arsenal midfielder louis arsha equall and tom huddlestone scored as chelsea returned from an injury to seal their third unbeaten start in five nations. [SEP] at the end of july 2006, oil inventories averaged some 100, 000 barrels a day. [SEP] she lost about 18, 000. [SEP] after winning [SEP]
+
+===== sample 028 =====
+[CLS]th, 65th, 73. [SEP] top seed and defending champion novak ivanovic and fourth - seeded venus williams also lost a paris open round match on thursday, losing 6 - 3 and the frenchman and 7 - foot and defending finalist l klbic of france and robin soderling withdrew on the eve of a french open. [SEP] rafael nadal's former coach andy perry, who took the title after six holes of winning the 2005 french open, beat ailing frenchman ben vagendos, 1 - 0 - - 7 - 1. [SEP] news of russia's latest missile attack on sunday said russia was preparing to launch [SEP]
+
+===== sample 029 =====
+[CLS] cac 40 was 0. 2 percent lower, germany's dax 30. 75 was flat, down 0. 7 percent, and france's cac - 40 gained 0. 1 percent, france, 289. 60, or 1. 1 percent, at 5, 450. 40. [SEP] france's cac 40 - - leading shares was down 6. 50 points, or 0. 02 percent, at 1, 810. 73. [SEP] but mulul spokeswoman aliyazip said the group's new leader was not expected to name him. [SEP] fourth seed nicolas kostelvic was [SEP]
+
+===== sample 030 =====
+[CLS] germany, florence, germany, vienna, france and scrabbling hopefuls from the field here. [SEP] tenth seed dj delic of the netherlands, 6 - 5 - 4 seed haas of germany, defeated champion andreas seppi of ukraine, 6 - 7, defeated srd pennic 6 - 2 - 7, 7, 6 - 7, 5 - 7, no. 3 - 4, 4 - 7 - 5, 7 - 6, and fourth - seeded cilic twice beat nicolas stepaner 7 - 5 6 - 3 at the sony ericsson open title tournament. [SEP] fourth seed almaleb will play swiss tommy [SEP]
+
+===== sample 031 =====
+[CLS] euros (7. 3bn). [SEP] collingwood, hajdin and danish radwan tried to open up the lead before denly had given the first chance in his career not to get a chance. [SEP] stuttgart's eighth - side wolfsburg beat frankfurt 0 - 0, losing 2 - 0 at home in third place, while german kroenke won 4 - 0 2 - 2 over belgium's defending champions lyon, eliminated frankfurt in an early draw. [SEP] but madkesh kumar, an analyst with analysts allstate insight, says that the weak dollar is fueling luxury - and - built cars in [SEP]
+
+===== sample 032 =====
+[CLS] france's champion williams and former men's open champion djokovic survived an early set sunday to finish the open - title winner over third - seeded andy murray, and frenchman louis tsonga of france and the former champion. [SEP] the rebels have lost a presidential election due to be held this week. [SEP] (cnn) - - russian dinara safina beat the french open finalist 7 - 5 6 - 2 and eighth - seeded haas ousted german teenager robin sodenn and dinara krapova, world's sixth - ranked player. [SEP] she also plans her retirement next year after having eight bouts of cancer [SEP]
+
+===== sample 033 =====
+[CLS]. [SEP] died in 2003. [SEP] one day back in 2004, wimbledon, 2005, wimbledon and 2005 sav lost in 2002. [SEP] federer has already defended his third singles title last season, winning the three - times titles in french open, wimbledon and wimbledon, then to set up the quarterfinals in paris, and l' finals in paris and paris, who made it in stuttgart and paris, and in 2002 and 2004, elena demerchova, the paris champion, to take the fourth round to 4 - 6 6 decision over novak djokovic in paris later on tuesday. [SEP] total is awarded under the multi - billion pound [SEP]
+
+===== sample 034 =====
+[CLS] 4. 0, the ftse 100 100 index closed up 1. 1 per cent, and the nasse 100. asx was up 47. 14, or 1. 3 per cent, at 2, 951. 21. [SEP] novak djokovic, the french open, came close to the semifinals after being lost from the start 7 - 5 - 4 5 - 0 6 - 3 to match fourth - seeded nicolas kiefer and french open champion nicolas andresters lost to french qualifier novak djokovic on monday. [SEP] elsewhere, double defending champion roger federer won his opening set after taking a late defeat to win a [SEP]
+
+===== sample 035 =====
+[CLS] federer scraped through the eighth - round at qatari and cruised past frenchman dinara safini today to finish fourth, four points of finishing place. [SEP] i don't want a good article. [SEP] i are very very optimistic. [SEP] is how he should make a good film. [SEP] they are all on the same level. [SEP] "people's choice wants to know more of those who put themselves off," said daniele bahari, editor of the oil news capital of iraq, told a meeting of editors from arab oil countries. [SEP] he had saved the break point with a double break in the first game when [SEP]
+
+===== sample 036 =====
+[CLS] in its report on tuesday, but expected profits at the end of this year. [SEP] sheffield united had withdrawn a £150m from middlesbrough to wigan athletic earlier this month after news of losing their contracts and middlesbrough for refusing to pay cash back. [SEP] davydenko won 0 - 2, 6 - 15, radwanska won 6 - 4 7 - 6, beat 20th teenager david gatchov 6 - 7 6 - 4 and russian klitschko lost 5 - 7 to beat belgian nicolas janko 7 - 5. [SEP] the russian seeded fourth has lost to rafael nadal, who defeated 6 - 7 7 - [SEP]
+
+===== sample 037 =====
+[CLS] tuesday. [SEP] the body was found at a supermarket in winchron way, near london, about 030 on monday. [SEP] nadal, who is bowing out at a tough stage, will be hoping to keep alive a strong early start of the tournament before losing 11th, 10th and 11th, losing the third time after losing the french in 2005 and 2008, losing the first gretles 2 - 5 and then another at 2 - 2. [SEP] everyone is angry and distraught. [SEP] he believes that the figures have been extremely inaccurate, in which more than 400, 000 low - income children have been born prematurely, while 800, [SEP]
+
+===== sample 038 =====
+[CLS] second round in 2005 saw three players, including the chinese player, upset fourth - round loser and beat fourth - seeded gilles simon in beating frenchman robin soderling 6 - 3, 6 - 3. [SEP] andy roddick lost out of the swiss team's opening set, losing five straight points in the first set. [SEP] defending champion tommy isnal has won a 6 - 3 decision over france's nicolas almagr. [SEP] she might not think about about enrolling her children until though, but she won't be back until after has lost her job. [SEP] the decision over the preliminary plan was released early on sunday. [SEP]
+
+===== sample 039 =====
+[CLS] 888. 91, 852 62. 747. 71, 743. 905. 78. 2 - 1. 7 percent, 7. 81. 73, 7. 711 85. 73, 7. 75 6. 72. 20, 6. 73. 73, 6 73. 73, 71. 78. [SEP] djokovic beat nicolas agasst 6 - 1, who was ninth in the match, and russian nikolay savedev at the french open. [SEP] edt on sunday, 0300 on thursday, wednesday at 07. 045 sunday ( 1400 gmt, saturday at 2200 gm [SEP]
+
+===== sample 040 =====
+[CLS] the ninth - seeded djoko 6 - 7 6 - 2 to hand the first round spot to the australian open champion. [SEP] in the afternoon market the ftse european index was up 2. 733 points, close at 3. 741. 73 and 888. 748. 73. 72 717. 7687. 74, 6071. 81 and 611. 65, but opened just 1. 0 percent higher at 880. 80. [SEP] the replay number is 847777777. 69731777777777. 761. 9 - [SEP]
+
+===== sample 041 =====
+[CLS] said: " maybe i just wanted to drive. [SEP] the german scored three times to pull to a seven - goal lead at ham that ended with a break after belgian striker louis michel scored his fifth goal for arsenal. [SEP] on sunday, austria's thomas barros lost his team - mate kimi raikkonen by 10 seconds ahead of the sixth stage - ahead of the overall leader. [SEP] fifth fifth, fifth fourth, fourth, fifth, sixth, fifth and fifth, arsenal third, fourth, arsenal and tottenham's chances to win, quarter - finalists, chelsea and tottenham. [SEP] obama's team has also managed to [SEP]
+
+===== sample 042 =====
+[CLS]ka klitschko to play a quarterfinal sunday in a round match against russia's maria sharapova. [SEP] djokovic set up frenchman nicolas stailner at the australian open in 2003, frenchman soderling in 2005 and frenchman nicolas safaro in 2005. [SEP] azarenka won the match, 6 - 1 - 6, 7 - 5, 4 - 0 6 - 4, and safina lost 7 - 5, williams 8 - 6, 6 - 5, lvetadze 3 - 6 6 - 3, wawrinka 6 - 7 0 - 6 7 - 6 7 - [SEP]
+
+===== sample 043 =====
+[CLS] their lead at 2 - 2 through the australian champion williams, who held on to win the set before pulling back to win 2 - 5 and won 2 - 3 with seven points. [SEP] defending champion andy roddick, the conqueror of belgium's rako durbin, ousted the second - seeded german monfir and fourth seed richard gasquet 6 - 3 6 - 3 on tuesday. [SEP] (cnn) - - andy murray feels good but he has never lost confidence, " he said in a semi - final. [SEP] the united states' coalition killed nine militants and killed six civilians in helmand province, the afghan military said [SEP]
+
+===== sample 044 =====
+[CLS] arsenal draw 1 - 0, wolverhampton wanderers on saturday, champions league finalist side arsenal on thursday, the bottom team host arsenal on wednesday, and defending champions bordeaux face blackburn on tuesday, league finalists bordeaux 2 and top side toulouse 0 - 6, toulouse of france, toulouse 0 - 0 bordeaux 0. 3 bordeaux, 2 - 0 on saturday. [SEP] argentina's del potro next plays seventh - seeded simon karlke and faces seventh seed rafael nadal, with german patty schnyder seeded fourth, facing eighth - seeded frenchman gilles simon on sunday. [SEP] she's already cast her son daniel nicol's character in [SEP]
+
+===== sample 045 =====
+[CLS] monfils lost a set 6 - 2, 10th - seventh seed novak djokovic lost seven matches to fellow russian german victor hantuchov, fourth seed robinsfretling ahead of the french - belgian pairing. - fourth seedt safin of russia and seventh - seeded - serving novak djokovic 6 - defeated federer 3 - 6 2 - 0. - frenchman 7 - 6 won 2 - 4 - 2 - - chelsea international frank lampard celebrates three - goal header five seconds later to give chelsea a 2 - 1 lead to take a fourth - place lead in their premier league qualifier. [SEP] however the number [SEP]
+
+===== sample 046 =====
+[CLS] after the defending champions barnsley sealed a 2 - 0 draw after they had lost twice before trying to beat tottenham's 2 - 0 in the cisf cup final earlier this week. [SEP] fifth - svetr davydenko defeated david beckham, 2 - 3, 6 - 0 and seventh - seeded dementieva defeated german robin soderling and italian marin citil in a later round monday. [SEP] he declined to comment yesterday whether he was stepping down. [SEP] lord mandelson, the labour business secretary, who had refused to give him his resignation on thursday after alan shearer had left the job, resigned [SEP]
+
+===== sample 047 =====
+[CLS] yen and 881. 89, and 921. swiss francs, 1. 941 and 0. 947 and 1. 7361 swiss francs and. 7488. [SEP] 18 at 1600 pennsylvania avenue, 65th and 111th, at st. louis, new york. [SEP] arsenal's gunners premier league side won 2 - 0 to go on to keep their championship credentials from beating their rivals. [SEP] toulouse beat reading 4 - 0 and fourth bottom bordeaux dropped to fourth and three points behind eurostard 2 - 0. [SEP] nadal, 26, of france, lost in the first round of the french open [SEP]
+
+===== sample 048 =====
+[CLS] was facing a "dangerous situation." [SEP] frenchman nikolai valuev finished fourth with a five - point win at the lyon grand prix in 2005, finishing on 11 points after losing a fourth round decision at stuttgart. [SEP] second - eighth seed frenchman tsonga beat ivanovic 6 - 2 6 - while fellow french number one nalband 6 - - 6 - and fourth - seeded 11th seed andy robic defeated andy williams 6 - 7 - 6 6 - 7, 6 - 7. [SEP] in their other match, fourth seed djokovic defeated frenchman viktort bartoli of germany. [SEP] the district court had rejected the argument by the [SEP]
+
+===== sample 049 =====
+[CLS], just 60 per cent of half - and half - adult children were obese, compared to 70 per cent of those aged 10 - 25 - age, children born until early age 5, those aged five and four years. [SEP] england's 5 - 1 win over croatia ended 2 - 0 last night, england captain kevin mccully securing his fifth world cup spot for the second time in his career with a first victory in australia. [SEP] safin saved six and safina winning 1 - 0 after winning his first service game before failing to effectively hold the season - opening contest. [SEP] there's a reason to think [SEP]
+
+===== sample 050 =====
+[CLS] unbeaten from 155 behind, lost his toss to take a five - wicket lead of 130 - 6, while pakistan closed on five wickets on 3 before lunch and host australia (5 - 3), trailing 6 - 2 by five runs, lost the final 10 wickets in the quarter - final. [SEP] he finished out fifth overall, finishing 12th at the summit. [SEP] the postgate package starts at $15. 00 on sale thursday, £8. 80 on thursday afternoon. [SEP] second - seeded fourth seed nikolay davydenko advanced with a 3 - 6, 7 - 7 win to reach the final against belgian frenchman nicolas almavic. [SEP]
+
+===== sample 051 =====
+[CLS] defeated seeded nikolay davydenko 6 - 0 - 7 7 - 6 - 3, roger federer 6 - 7 7 - 6, and's novak galbr upset no. 6 seed tommy robo 6 - 0. [SEP] men's seed andy murray lost a tense opening match on friday, beating fellow round leader gael monfils 6 - 1, 6 - 4 and israeli eighth seed marcos baghdatis and no. 1 seed david gulband 7 - 0, lost 7 - 6 in the men's quarter - final. [SEP] venus williams, who played poorly, broke twice in the first set, losing [SEP]
+
+===== sample 052 =====
+[CLS] seeded frenchman 6 - 4 6 - 7, 6 - 7, 6 - 3, 7 - 5 ( 7. [SEP] "i would have been able to see these things through the lens," he says. [SEP] ivanovic, 26, was moved into fourth place at just five points by the eighth - seeded frenchman alia klata of russia, and belgian champion penne. [SEP] stosur has reached a final twice, won for the first time this year and captured his first french open open title at barcelona in 2007. [SEP] "most people think there would be a better outcome at the end of the year," [SEP]
+
+===== sample 053 =====
+[CLS] players at the 2008 tour st. open and sony ericsson tournament. [SEP] five - time champion roger federer have moved to seventh place in ninth, eighth, fifth and sixth rankings thanks for their place at the open era, beating federer. * federer beat fourth - ranked blake 3 - 6 6 - 3 6 - 2 and france's gael 7 - 6 6 - 3 6 - 7 7 in the bangkok open quarterfinals. [SEP] verdasco ended nadal's hopes and frenchman nicolas anefen fought back to win 2 - 5 and beat defending champion robert kubicch of germany in the second round of the french open grand [SEP]
+
+===== sample 054 =====
+[CLS] losing 6 - 1 of france 7 - 6 6 - 3, and defending champion novak djokovic will play ninth - seeded belgian nikolay davydenko, belgian henin and france's who ousted eighth - seeded frenchman gilles simon 6 - 6, and seventh seed simon schiller was in ninth place. [SEP] it was last updated at 16. 21 bst on saturday 30 may 2009. [SEP] who are you now keeping secret? [SEP] belgian 10th seed roland garros ninth seed richard gasquet of france 6 - 3 7 - 2 in the third set, he lost to david nalband 6 - 2 6 - 1 [SEP]
+
+===== sample 055 =====
+[CLS] lost 5 - 0 rezai was 1 - 0. 6 points behind fourth - seeded belgian roger federer and lost 0 - 2 - 0 in a quarterfinal match against germany, while fourth seed jelena jankovic 6 - 0, 6 - 6 and defending champion venus williams defeated eighth - seeded robert garber of france in the first round of the tournament in melbourne on saturday night. [SEP] australian open dinara safin was happy and gave herself an early 3 - 1 lead. [SEP] but federer lost twice in an opening set before losing 6 - 7, 6 - 3 and losing against frenchman gilles simon 6 - 2, and serb novak dj [SEP]
+
+===== sample 056 =====
+[CLS] 18: 23. 20; 3: 16. 21; williams 1: 17. 17; 5: 26. 30; 6: 17: 16. 18 33; 2: 18. 20; 2: 24. 24; 3: 15, 27 25; 5: 29. 17; 3: 20, 20: 15. 25; 5: 9: 37,. 24; 5: 20. 17; 6: 16: 25. 15; 16, 22 23; 17: 17, 7. 15; 20: 23. 18 23; 16: 17, 17. 15; 7: 17, 18. [SEP]
+
+===== sample 057 =====
+[CLS] seventh - seeded frenchman mariah safin 7 - 6, 6 - 2; seeded venus williams won 4 - 6 6 - 0, 4 - 6 (7) 7 - 5, 6 - 2; and eighth - seeded williams 5 - 7, 6 - 4 (7) and russian ninth seed elena dementieva, 7 - 6, 5 - 6. [SEP] novak djokovic ended as no. 3 seed federer survived a 72 - hole match to beat 4 - 6, 6 - 7, 6 - 0, 6 - 7, 5 in men's quarterfinals, giving federer another place after fellow belgian frenchman julien [SEP]
+
+===== sample 058 =====
+[CLS] to meet her husband. [SEP] but, he said, he felt more safe. [SEP] toronto (reuters) - japan's mitsubishi motor corp group said on tuesday that it would announce it plans to shed about 6, 500 people worldwide to pay off the u. s. automaker. [SEP] president george w. bush, the commander of afghanistan and other allied forces in afghanistan,, has urged them to become a far more complex. [SEP] the belgian lost 5 - 2 6 - 3 when sixth - seeded frenchman richard galband opened a 5 - fought hold on a final lead against frenchman robert maths 6 - 6 and german jar [SEP]
+
+===== sample 059 =====
+[CLS] regardless of his age. [SEP] third - seed david nalbandian, fourth round of the french open, 7 - 7 7 - 6 to play argentina's martin del potro in the round. [SEP] former england star david beckham has made his first fa cup debut with his fourth consecutive goal against middlesbrough. [SEP] she then faces belgian david gaut, who lost 6 - 5, 6 - 3, 6 - 2, and the third - seed at the fourth - seeded paris open, while sixth seeded teenager nicolas dementie defeated frenchman david isner in the fourth round. [SEP] hong kong, aug. [SEP] one large [SEP]
+
+===== sample 060 =====
+[CLS] north carolina, oxford, cambridge, cambridge, cardiff, nottingham university, glasgow, birmingham. [SEP] they go to our country, " nagin said. [SEP] second - ranked nadal wrapped up his australian title in 2002, losing at no. 21 in a victory over monaco, but held a set - point to come close to winning, sending roger federer into the fourth. [SEP] in asia, the dollar rose 1. 3 per cent cent to 1. 031, while the euro rose 0. 3 per cent to c $1. 408 and the dollar added 0. 9 cent to 78. 60. [SEP] in july, [SEP]
+
+===== sample 061 =====
+[CLS] the protection of georgia's territorial integrity. [SEP] the most likely that federer, federer's top opponent, bidding for a fourth slam, the top - seeded no. 2 and another six - time grand slam, sixth seed novak safinian, will face belgian eighth seeded nicolas galbis and eighth - seeded dina safina 6 - 3, 7 - 6. [SEP] it also creates a high amount of large - scale single infectious disease and a respiratory disease that is much higher in the region than in european latitudes. [SEP] the report was sent to the government's independent committee. [SEP] but he said that if the [SEP]
+
+===== sample 062 =====
+[CLS] inc., inc., the nation's largest chain of childhood cancer products focused on lung cancer in the united states. [SEP] the infected virus re - emerged in komodopura, south of mundakara province and hajdan, the capital of the nukud capital and then back to life, health officials said. [SEP] fourth seed juan ignacio chesling homered and the czechs were found unconforced on tuesday evening. [SEP] still, it's unlikely - - but belgian champion henin could hardly assume four - time veteran ninth seed kim clijsters wants him to take a break from [SEP]
+
+===== sample 063 =====
+[CLS]ton road in manicot, near tunbridge wells, died just before 0400 on friday night. [SEP] belgians faces roger federer, eighth - seeded djokovic lost 7 - 7 - 5 6 - 9; frenchman federer 5 - 6, 6 - 7, 6 - 13, 4 - 11 - 7, 11 - 6, defeated albert montanes 7 - 5, 6 - 7 (7) 10 - 6; and wil - tsonga 6 - 7 (7 5) defeated teenager nicolas korolovic 6 - 7, 7 - 6. [SEP] the driver died at the scene of the accident from 1800 gmt on [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_temp_schedule_128steps_n64/cosine_2p0_to_1p0_c256_detok_raw_samples.txt

@@ -0,0 +1,230 @@
+cosine_2p0_to_1p0_c256_detok
+{
+  "type": "summary",
+  "name": "cosine_2p0_to_1p0_c256",
+  "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt",
+  "step": 168000,
+  "decode": {
+    "kind": "categorical_fullvocab_temp_schedule",
+    "config": "cosine_2p0_to_1p0_c256",
+    "steps": 128,
+    "model_t_mode": "post",
+    "support_power": 1.0,
+    "semantic_power": 1.0,
+    "temp_start": 2.0,
+    "temp_end": 1.0,
+    "temp_schedule": "cosine",
+    "concentration_min": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 57.69433042345068,
+    "nll_per_token": 4.055158909127353,
+    "tokens": 9666
+  },
+  "diversity": {
+    "sample_entropy": 4.217734038811499,
+    "unique_tokens": 1913,
+    "token_count": 8192,
+    "distinct_1": 0.2335205078125,
+    "distinct_2": 0.7210875984251969,
+    "top_token_mass": 0.0491943359375
+  }
+}
+
+===== sample 000 =====
+[CLS] edinburgh, glasgow and leeds - london airport from 2006 to 2005. [SEP] safin, hoping to win the world title title this season, needed five minutes to reverse his first quarterfinal loss at the roland garros on saturday. [SEP] abdullah is to hold a two - day cabinet meeting on sunday. [SEP] but officials liked the jets' lack of control. [SEP] the economy is sluggish...... [SEP] setting the stage for force, who took a 6 - 0 lead in the third and scored a deserved early try in the second minute when jack goodell scored his own half goal, while amoque's [SEP]
+
+===== sample 001 =====
+[CLS] of breast cancer, which is responsible for 40 per cent of people who die from cancer in south africa. [SEP] "conservatives will choose to support obama, or become more conservative, likely to vote, overall, but conservatives have no choice but to lose a second round vote," he said. [SEP] and then it took him just months away on time. [SEP] and if i haven't able to fully explain my situation, then i should wait some time, before heading into some bigger waters. [SEP] "that was really very worrying," he said. [SEP] however, the court found that some 130, 000 of them had already been [SEP]
+
+===== sample 002 =====
+[CLS] and the average price of the vaccine was $599 at the plant in september 2008. [SEP] the german - based company, microsoft and internet company google have said that they wanted to cost control the companies, but they might spend money to stymish technology investments. [SEP] that's more than mother's day. [SEP] police are appealing for witnesses to the collision which happened at about 2100 bst on saturday 1300 gmt sunday. [SEP] in 2005, over 2, 400 schools within the eight - year system, a number of schools and academies providing £25, 000 of public income to middle income and low middle class children [SEP]
+
+===== sample 003 =====
+[CLS] 4 6 - 6, 4 - 6 - 2 win over elena dementva for the second - seeded french open title last week, enough to go down, 2 - 0 and down 5 - 0 to reach the third match against sharava. [SEP] in between the two men linked, three and seven colleagues said they showed a broken jaw. [SEP] he was cheered by the fans when the new york yankees, who had lost their of those four games, first met in 2005, they'd been playing unproductively for the last two seasons. [SEP] the new investigation will include a study in the annual world biodeter [SEP]
+
+===== sample 004 =====
+[CLS]'s second - biggest airliner from frankfurt in october. [SEP] the u. s. stock market was down 0. 8 percent of a four - month low thursday, with the euro closing at $1, 875 the week after down $6, 648 from monday. [SEP] chelsea finally lost a first - half when england defender andrew johnson's johnson's cross met harry redknapp's free - kick and finally scored in the second minute of a free - kick, an hour after the second from lampard, a goal from mike green, was blocked. [SEP] in 2006, al qaeda sent a single official [SEP]
+
+===== sample 005 =====
+[CLS] strength of the economy. [SEP] mantelke will finish in the grand prix of his home gp in germany on september 18, in order to make the start of the season. [SEP] the next day, he was still able to survive, he was returned to hospital. [SEP] when england defeated pakistan to become the most - tendered team to play both next year, 16 and 20, officials of the sport's governing body, the icc gave a two - year delay in principle to extending that ban, which was imposed after the fourth test in 2004. [SEP] three survivors and injured were found on board boats late on tuesday in a field [SEP]
+
+===== sample 006 =====
+[CLS]. m., germany 0 - 3; italy 6 - 0, 4, 4, 2 ); belgium 5 6 - 0, 4 - 3 ( 0 1, 2; and italy 4 (4) 9 - 0. [SEP] the average age (15 per cent of women aged over 40) is up to 55 in the fifties in 2007 and in 2004. [SEP] he killed himself. [SEP] the collision happened at about 2000 gmt, at 080 bst near the 1400 block of moss road. [SEP] people haven't been evacuated, but it was like this, so there's talk about being at risk. [SEP] [SEP]
+
+===== sample 007 =====
+[CLS] 2008. [SEP] slovakia and finland sealed their place at europe's third hockey tournament in august. [SEP] back then, only 10 points from four games, they fell 10 points behind, and verlander had finished 0 - 10, after the first round had finished in the second set. [SEP] there's already a system, one that allows the population to build itself and function, with a system created by paying people in the lower end of an american healthcare system. [SEP] cardiff scored twice after a poor penalty miss as five straight away chances opened the season with a win win at cardiff. [SEP] over the years it has become a big [SEP]
+
+===== sample 008 =====
+[CLS] bills or reducing their credit payments. [SEP] andy murray was a surprise winner in the french last 16, but the 21 - year - old champion earned his second masters final appearance in his opening event. [SEP] i had lived here since my childhood 40 years ago and came here about 50 years ago. [SEP] lincecum got the fourth out of seven of his pitchers to lead the victory. [SEP] he's last put prize was 25 million pounds ($30 million) in 1999, then finished the year with 12 million pounds. [SEP] they asked. [SEP] police have closed london's railway station to other areas in the capital, including the [SEP]
+
+===== sample 009 =====
+[CLS]s and layoffs. [SEP] they have also responded by back us forces and troops on both sides of europe. [SEP] it comes at the time: when can we work out the future? [SEP] the business scene has just started to change. [SEP] it is no new thing, " he said. [SEP] it's pretty good, cheap and not wirelessly charged by american users, according to bharti, the nation's largest mobile phone market. [SEP] sales of personal footwear fell 17. 4 per cent and beauty chain led sales up 45. 4 per cent, or 31. 7 per cent, in its final quarter of [SEP]
+
+===== sample 010 =====
+[CLS] 000 women in 1960 to 56, 400 men in 2006, according to an american survey. [SEP] it has a cost of $15. 00. [SEP] yesterday at one of the team's main international skis, abdul mutil said in an interview that he had suffered f1's only injury since 2004, which is squeezing the number of american players. [SEP] no. 7 david garrele ousted american david kosnik 6 - 3 6 - 1, and fellow german kevin kuschner led 6 - 1 in the semi - finals coming off their quarterfinal match against no. 10 danish robin soderling, while sixth [SEP]
+
+===== sample 011 =====
+[CLS] 2 - 2 at the break, but hantuchova was held by ana ivanovic who took the lead. [SEP] but france scored an early start to start, holding a fine combination from domenech and thierry henry which might have saved the french champions. [SEP] they made the right decision in 2006. [SEP] a final chance to take the fourth set turned to him when his shot landed in front, but the driver refused to fight for his life. [SEP] time, when: friday 10, 2008 - wednesday 10 9 a. m. - 8: 30 p. m. [SEP] " then, just a little bit early, they [SEP]
+
+===== sample 012 =====
+[CLS] the work was over and it might have been done earlier. [SEP] centre - back joe nolan scored one point from his own ten minutes to put wigan a second point ahead against birmingham, who started the second half hour when david veronin smashed a free kick near the edge of the penalty area. [SEP] they lost 2 - 0 at the start of the contest and then pulled through their fifth penalty of the game, but ireland rebounded with the own goal. [SEP] he was asked about when, how and when he tried to move to a hotel, he was understandable. [SEP] but, with the success, he knows that he is [SEP]
+
+===== sample 013 =====
+[CLS] [SEP] it might help the economy with oil. [SEP] henin has now won five straight french open and a total of seven titles for the event which is launched on september 30 on sunday. [SEP] a young child has a family, one of just a family and possibly a child. [SEP] " they can be dangerous. [SEP] the combined rate for the rate of unemployment in the survey period from the end of 2006 was 3. 2 percent. [SEP] then, the scolari's side failed to regain their first european title and even though chelsea, arsenal and liverpool scored twice, only tentative assurances from the germans had become available that they [SEP]
+
+===== sample 014 =====
+[CLS] la daniele in 2001, with ajax finishing third behind other leaders ajax and connmin and rifes almeria, who finished in the group. [SEP] a fifth place is a distant dream, and he is a consistent fourth - placer after the final three grand prix, a month ahead of the world championship in italy having missed out on the title for six months. [SEP] 704. 300, 71. 883. 7292. 651, 48. 877. 716. 719, 717. 289. 723, 712. 728, 61. 881. 742 [SEP]
+
+===== sample 015 =====
+[CLS] 0 - 3 as the bulldogs (14 - 7, 2 - 8) finished on the way. [SEP] defending: defending champion gordon stumulates that he's improving his back quickly and that there isn't a chance he won't compete. [SEP] sunday 10. m. to 3 p. m., so the boat isn't going to be on the way to their destination at the moment.... [SEP] eventually they paid us off the phone. [SEP] in the past three months a number of trainees have lost almost 10, 000 after being taken on by small firms. [SEP] 10: 24: - [SEP]
+
+===== sample 016 =====
+[CLS] [SEP] mcenroe is a point ahead of second - seeded us open champion federer who was unable to advance to the opening round and the czechs made 10 early runs to the masters cup, and five break errors. [SEP] investors, however, don't be surprised that the december advance is running at a 5 % annual rate of economic gains. [SEP] in the abnit district in this area of afghanistan, an aircraft of u. s. forces has recently crashed in iraq, nato and company officials said. [SEP] mr macbrish, who was a lifelong public speaker diagnosed with the disease, was standing in the midst of [SEP]
+
+===== sample 017 =====
+[CLS] spending and widespread market speculation. [SEP] a further 18 points were made with 15 minutes to go - - this was the first time that he scored a goal this season, six more than the dutch, following a blip in form after steven redkna's win over burnley. [SEP] the third question is whether it exists. [SEP] but even he has tried to make truth about the allegations that he had tried to hide gold last year when he lost a berlin final to kimi in 2007. [SEP] grebe said he was awaiting more information on the case. [SEP] associated press writers mez ahmad shah in kabul, ahmed mohta [SEP]
+
+===== sample 018 =====
+[CLS] 20 minutes when he went on to point to a mistake as a two - man cut saved his game after 40 seconds. [SEP] a man and woman has been arrested after police found the second man with a serious injuries. [SEP] but the women and men who think the only thing that matters is to but doesn't have any real way of seeing what's best for their childrens. [SEP] prince harry was a 19 - year old who was married in january 1942. [SEP] he lifted a free - kick down the right flank and beat ryan miller in the 10th straight into a corner just for an outside corner. [SEP] like anyone in the [SEP]
+
+===== sample 019 =====
+[CLS] saturday. [SEP] when the wall was blown in 1851, it had dropped over the mountains of east jerusalem and the vast northern coast. [SEP] earlier in the night, the hurricane center system was putting it at a flood risk of 30 to 40, before forecasts ordered it to move to the louisiana coast and dump it into the florida river. [SEP] she beat russian open seed sakonetsvili, the french champion at the french open in 2008 and the masters cup event of 2007. [SEP] french coach david ballet's results of the title have been confirmed to trim the speculation that defender carlo janka will play in paris if he would [SEP]
+
+===== sample 020 =====
+[CLS], mr. fars said in iran's state news agency. [SEP] the qatari had agreed to delay the takeover offer until the board's meeting next month. [SEP] the 2005 major storm led to the deaths of six people with life threatening injuries. [SEP] they would not be left behind, "he said. [SEP] they then raised the alarm and threatened him with a knife. [SEP] shanghai shares gained 1. 1 percent, the index added 1. 3 percent at 1, 061. 01 and the people's bank jumped 0. 3 percent. [SEP]" there's no question that they didn't have the idea [SEP]
+
+===== sample 021 =====
+[CLS] says he can tell her something - - he says that he refuses to write her down. [SEP] new york (reuters) - thousands of u. s. cancer patients born in the u. s. may remain in the hospital after having their organs returned to the hospital from major operations. [SEP] nearly 1, 200 students claim to take free courses and exams. [SEP] he got the idea. [SEP] last month he gave mr thaksin's party a 13 - 7 victory in the second round of the 100 - seat parliament, and denied the 59 - year - old republican challenger of another run - off on the grounds of the campaign [SEP]
+
+===== sample 022 =====
+[CLS] by afghan citizens, a majority of whom were held back. [SEP] and this is that my eldest son died in 2003, aged 41. [SEP] the young toyota driver won a three - time title, but returned to the first stage after struggling to finish eighth, thus resuming britain's first grand prix of their 2007 season. [SEP] united nations director general motavi haema on saturday said 11 u. n. soldiers had died after militants attacked a vehicle near the capital, leaving at least 47 people injured. [SEP] a quarter of children aged 25 and older did not have age before the age of 65, and their health increased. [SEP]
+
+===== sample 023 =====
+[CLS] for democracy reported. [SEP] democratic sen. chris rucker, a leader in baltimore county for the democratic house senate majority, called in tuesday as he kept a strong republican leader from mulling to seek his republican seat again early tuesday. [SEP] at the high school in kisumu, a senior police official where the governor was staying reported at least five killed and seven people, including three children, wounded, officials said. [SEP] though nadya aleaud, the french open's three - time champion, lost her serve in the second set, safinfina lost back in early october. [SEP] there would be an additional £[SEP]
+
+===== sample 024 =====
+[CLS] election. [SEP] phillardo took the initiative, and woods topped mickelson, who won his third round at the pga states grand slam championship last month. [SEP] the game was his second straight loss in five star game. [SEP] "the winning pick," said gordon cowhery, who was the winner of john walsh in october and the winner two years ago. [SEP] it also represents everything from the most expensive to expensive to charities. [SEP] the tories and mr cameron have privately suggested that they would have to hold a final line over mr brown on the contentious and divisive issue of iraq. [SEP] about 30 percent of [SEP]
+
+===== sample 025 =====
+[CLS] to power by winning six seats and losing four polls - - five years after his re - election. [SEP] swiss champion roger federer, who won 14 times during his rookie season, made his name his own at the 2006 australian open. [SEP] having trailed in the first set, it was possible to take a set back, win the set and eventually win 1 - 0. [SEP] thanks now. [SEP] after losing an match in the fourth final williams lost the match but only came back from a quarterfinal match with agniestka. [SEP] the yemeni man failed to take a pre - negotiated gilt bid by jumping into the air. [SEP] [SEP]
+
+===== sample 026 =====
+[CLS], " it said. [SEP] how do you bring the positives into action? [SEP] the third driver was seen, but he was driving over again when the crash happened. [SEP] in the opening set, the 19 - year - old swiss had dropped to just 15 points from start to finish when the russian broke back again and two points into the match, but she failed to move ahead at the end. [SEP] princeton, n. j. - how are you in a terrible state? [SEP] the lack of bodies is a reason. [SEP] a 1980 meta - study in copenhagen university, denmark, found 59 percent of early cancer survivors, including [SEP]
+
+===== sample 027 =====
+[CLS] her clipping and appeared again, losing through 2 - 2, 6 - 2 in the fourth round on sunday. [SEP] federer and federer have fought a hard - fought losing battle against tim henman before winning 3 - 1. [SEP] sunderland are seven points of city rivals liverpool and newcastle five points behind, fifth with their rivals, while arsenal fifth at home, birmingham sixth and barnsley 13 points at home and chelsea, who have the advantage of two more league days of replays. [SEP] however, in 2005 and 2006, the deputy coroner's office failed to tell the public whether the county was about to become a legal target for the [SEP]
+
+===== sample 028 =====
+[CLS] national elections in august, trying to produce a credible, realistic assessment of whether it can claim to the viability of britain's economy. [SEP] both teams were tied in the quarterfinals of the women's stanley cup tournament, officials said. [SEP] india's meg munku is resting on her right shoulder. [SEP] moreover, researchers know that it's important for black students not to increase the risk of premature death. [SEP] u. s. open champion federer took his fourth place while no. 1 seed ivo karlovic of france pulled out of fellow ninth seed roger federer, 6 - 7 6 - 7 7 - 5 7 [SEP]
+
+===== sample 029 =====
+[CLS] its plan of cutting costs and using cash to help pay for the closures, which have already saved more than 100 jobs. [SEP] but then moyes looked certain to score another goal after frank lampard was twice and he found the visitors close with another impressive volley, scoring the equalizer in the 75th minute, with arshavin then hitting a high angled own goal to eventually keep the points at 12 - 13. [SEP] about one - third of the households that emit their own carbon emissions are used in nuclear energy, the uk's largest producer of renewable nuclear plants. [SEP] however, it was said dr fritzl returned to [SEP]
+
+===== sample 030 =====
+[CLS] 25 teams, including williams, ferrari, mercedes and bmws, as well as six medals here. [SEP] russia: 3 k k 6 (4 - 4 - 5 - 4) 6 k c 6 6 - k k j 6 7, k j 6 7 (k k 7 7 4) 7 k j 6 7, k q 7 6 5 j k j 7 6 m 5 7 - 8 6 k j 7, w henin 6 - 3, k k 6 7, k j 6 7 r 5. [SEP] how good it is manageable to me, but it has done. [SEP] the effects will be felt from [SEP]
+
+===== sample 031 =====
+[CLS] national association association (ntia). [SEP] finally, after four - and - a - half - shot losses in the east, his team had all but decided he was the right thing to win the title. [SEP] their son, alex, was killed in 2007. [SEP] arsenal have beaten liverpool for the season in their last three 16 matches, and are hoping to put themselves in the title chase, ahead of europe's defending champions liverpool this weekend against manchester united and everton. [SEP] mohammad gul mohammadi, a top political analyst with the associated press, reported that last summer, at least 13 anti - qaeda militants were killed in [SEP]
+
+===== sample 032 =====
+[CLS] liverpool's lead in the domestic cup, having won here in 1998 and 1996, was not going to happen again. [SEP] bagel's captain, eric stewart, was shot at the scene and later released, the survivor told afp. [SEP] a us election is due to be held in january. [SEP] cost: what, how much, was you time spent on it? 2. [SEP] it will ring up every time she says her name, and i'm just going up. [SEP] sen. joseph i. lieberman, i - conn., pledged to cut the deficit next year by about 10 percent of american [SEP]
+
+===== sample 033 =====
+[CLS]. [SEP] people asked said they thought one of the candidates had bought out, or because of voting labour in the past five years. [SEP] we are determined to work together on that mission. [SEP] he thinks he's ok and calm down. [SEP] two factors: a build - up of celiac ability to control their lifestyles, and high - cal risk, leading to high - birth weight and fatter habits, becoming more important in obesity than healthy adults. [SEP] the number of children scoring in maths at high school could soon be scrapped, labour's report revealed today. [SEP] entitlement under the current plan would be [SEP]
+
+===== sample 034 =====
+[CLS] the dow jones industrial average was down 20. 75 points, or 0. 72 percent, to 9, 734. 81 and the nasdaq was down just 1. 7 points at 2, 272. 7, 2, 411. 10. [SEP] it started now. [SEP] " they took the child to the hospital where he died and soon he died after a bottle hit to his wife's head. [SEP] alabama, louisville, cincinnati and lsu don't plan to play in saturday's women's regular season. [SEP] the other was to reinforce the point that ancelotti must be a premier champion to win a [SEP]
+
+===== sample 035 =====
+[CLS]rzai's second day of talks on security and afghanistan came a day before the election, originally due to finish with the result of a backlash against president karzai's anti - taliban administration. [SEP] but it just came here. [SEP] and others thought he was a good guy. [SEP] police asked witnesses for an early report. [SEP] "people's sense that anything but the key figure is not far off," said daniel krassen, director of the international institute for asset management, at a meeting of barclays and capital markets. [SEP] hamilton had missed a break because of a wind problem in the first session and [SEP]
+
+===== sample 036 =====
+[CLS] record. [SEP] on tuesday, it was released by the national electoral research institute. [SEP] researchers in paris, a french ski resort town of monteveen, found that ten per cent of their women have cancer for four to five years more age than their men and almost half have the early childhood cancer, of which they are likely to develop breast cancer years after a study. [SEP] u. s. secretary of state susan rice, who visited wednesday to discuss the crisis, made the argument iran is otherwise safe. [SEP] but that cannot be done because the ceo is due to retire in of march, according to a person familiar with the discussions [SEP]
+
+===== sample 037 =====
+[CLS] could disrupt air travel promotion plans for several airlines, and flights don't take off of planes. [SEP] friends sent e - mails to each saying that supplies would be enough and the red cross would have to hand them all their medical needs to the company. [SEP] diesel (01300 - 00 - 31 - - 000 euros, 908 dollars); a liter of diesel is 0. 1 euros - 0. 1 euros - 0. 50 dollars, 100 dollars ). [SEP] the bulk of the figures had been done in 2001 in which almost 2, 300 children were children aged 19, 16 to 19, while children aged [SEP]
+
+===== sample 038 =====
+[CLS] to go in. [SEP] very open, " she said. [SEP] in the final round of wimbledon at the french masters on sunday 22, 2004, when he was robbed of a big victory in a run of four titles - - but he lost in the tournament and won a grand in paris. [SEP] in the recent 1980s, environmentalists complained about aggressive roadworks and road closures on motorways and motorways, while pedestrians protested at the prospect of damaging medium - range escalators. [SEP] the death toll - - including the record number of 294 people killed during the first quarter of the war - - was nearly as the number of [SEP]
+
+===== sample 039 =====
+[CLS], 000 - county border. [SEP] finalists for the opening top 10, seventh seed stefan kolbainen and fourth - seeded shakhtari, and frenchman american williams and belgian florent serra are fourth, even though the number will be split - - 94 and 71. [SEP] but, when brown joined brown, nothing went away. [SEP] real madrid, in third, drawing 1 - 2, are in fourth place, a point of five points behind united in their group game, while babel's header for liverpool could beat last year's champions cup while preserving the club's premier league survival. [SEP] one day [SEP]
+
+===== sample 040 =====
+[CLS] the 19 - year - old striker lost his bid and refused to play again because of his lack of preparation on wednesday. [SEP] despite the wales international's departure, it is a miserable season, the team accounting for six out of 10 lost performances and now only 5 % of income according to their official estimates. tendulkar, making his second wicket at the break with another against australia at lunch, was the scorer with 20 for the second wicket before tea. [SEP] harrer, 27, from poland, a five - time defending champion, lost her serve on games in any of four and twice, racing to a 9 - [SEP]
+
+===== sample 041 =====
+[CLS] said: "a person who had been running out of time learning to live was not going to work and was not going to work was considered clinically advanced. [SEP] they also found that democrats in congress contributed heavily to the vote, with support from the left and the right. [SEP] southerners will not feel so threatened by the democrats, especially if they do - - and democrats won't overhittere to defeat them. [SEP]" in the tough times, we have had the support and support of a partner for the past two years, " she says, looking uncertainly. [SEP] i pick up for dinner at 4: [SEP]
+
+===== sample 042 =====
+[CLS] soderling is expected to play a repeat of his first match appearance at london's o2 arena this week. [SEP] " this is wrong. [SEP] he was unable to play his first event, but he had to fly to the united states to complete more of the british open. [SEP] the battle of texas is her seventh win in the year on the tour and her fourth this season at the suster international golf club, set on the northern olympic course on the north island. [SEP] cincinnati, march 18 (upi) - - u. s. open champion maria saaduas of spain died wednesday after a bout of [SEP]
+
+===== sample 043 =====
+[CLS] their star opponents to the premier league title in the play - off. [SEP] but birmingham then did nothing of luck in the free - kick, which friedel cut back and landed in the yard of gary megson's cross, after half - time nolan had dropped the ball to the left, prunted back deep down his left, raised his hand and fell back behind the line. [SEP] (ap) - a northwest airlines flight headed to buffalo airport crashed early saturday, killing six people and leaving 21 people on board. [SEP] united states crew members among those who died on the other flight, the u. s. military said [SEP]
+
+===== sample 044 =====
+[CLS] (ap) - - the slumping phillies snapped a record five - game winning streak against national league champion los angeles dodgers on friday night with a home victory late in game 5 for a 6 - 2 victory over the philadelphia philadelphia phillies in the opener of the series. [SEP] i just had to see him get a simple lesson from his mother. [SEP] ferguson's most improbable goal with seven minutes to time arrived at storrie on saturday, but anelka missed on the first goal, saving three first - half 3 - 0 chances. [SEP] they're already degenerated - - not by any measure - [SEP]
+
+===== sample 045 =====
+[CLS]wakah, capital islamabad. [SEP] oh, the inside of palin's mouth. [SEP] in june, a 20 - year - old boy died in russia and four others in an accident in the eastern german town of zeebo. [SEP] only 61 percent of republicans and 44 percent said they plan to vote mccain against a republican majority by jan. [SEP] he said roger federer would play today and could have the best team today. [SEP] texas senior back david warren set up a field goal with 25 seconds left to give arkansas a 24 - 27 lead saturday and a fourth - round bye in the big 12 game. [SEP] at the second [SEP]
+
+===== sample 046 =====
+[CLS] led the premier league last season and the season this season when they had six goals in 10 games after losing to reading 1 - 0 to the scottish fa cup first team on jan. [SEP] gm's announcement comes as gm also plans to sell its opel units of chevrolet and gm brands in the us and germany, the smallest market in the country. [SEP] she beat russian elena dementieva 6 - 3, 6 - 2 3 - 6 - 4. [SEP] in a later interview, some democrats, however, suggested that mr obama would fight to gain another seat in his own party, which he would avoid if she took him [SEP]
+
+===== sample 047 =====
+[CLS] another who was wounded and wounded, the paper said. [SEP] dawke missed only 13 of the game's shots, hitting 58 percent (3 of 22) of his 3 - pointer. [SEP] federer's 4 - point defeat over spain yesterday at st. john's was also on europe's match at home, when they are seeking to turn their focus on their tennis away from a hard - fought performance at jolen - dreul. [SEP] the total group, the dutch group, rose 4. 2 per cent to skr1. 82bn, according to people familiar with the matter at the paris [SEP]
+
+===== sample 048 =====
+[CLS] [SEP] washington (ap) - lawmakers took a symbolic vote wednesday to make sure the california economy remained growing at 4 percent, the washington times reported sunday. [SEP] however, leeds probably saw the best chance of the match came closer, especially when radhii faye made his mark, caught behind the offside defence with his second left midway through the second quarter. [SEP] robertson, who pitched just 88 pitches in september, had a run in the ninth and a leadoff double against carlos lee in the eighth for his fourth consecutive victory, ending a six - game streak.... [SEP] the region had no expectations and lost some of [SEP]
+
+===== sample 049 =====
+[CLS] more low - paid average household income, almost half of their paychecks in the first year of 2007. [SEP] even the most powerful women were happy with their experience in their own country. [SEP] today's slowshoe will continue. [SEP] with the scoreless runs and moving three games behind the yankees, the veteran looked safe after leading 3 - 3 in the fourth and picked up his sixth this season with an rbi single in the fourth game, tied at 3. [SEP] the packers lost 15 - 7 to jacksonville at home and were only dropped to second in the playoffs at home sunday. [SEP] there's time for someone to [SEP]
+
+===== sample 050 =====
+[CLS]. 6 billion dollars a year earlier. [SEP] but they claim they will defend the seat in london, even if they rise to 25 per cent this tuesday. [SEP] the researchers took the lives of 26 women, from the poorest region, who return to the netherlands in northern france without children. [SEP] it doesn't have much to do with the deficit. [SEP] sometimes it cost you $100 billion i. e., a dollar sum with those assets on the horizon. [SEP] in early morning trading, britain's ftse 100 was 3. 9 percent lower. [SEP] france finished fifth out of second and fifth in the u. [SEP]
+
+===== sample 051 =====
+[CLS] especially in europe, if they continue to lose their european cup and then at home they have lost their european champions next year. [SEP] they're recovering after a tumor was expended two months ago and seven days later, he said. [SEP] this year he lost a 25 - set match to england last season and lost a point in the 25 - minute defeat of the golden lions 22 - 19 on saturday. [SEP] nadal will return to tennis - - five french open titles while the wimbledon fourth - round champion and britain's andy henman ended a 10 - year stay in this year's wimbledon title and has lost a [SEP]
+
+===== sample 052 =====
+[CLS] the process, "he said. [SEP] the bills were led by 6 - 2 in a series. [SEP] he also has headache, swelling, permanent pain and stomach injuries. [SEP] the study was drawn from patients working between between 2002 and early 2006. [SEP] that could shut down the entire single - vehicle sector and possibly spur economic growth. [SEP] officials said it could have been linked to an accident. [SEP] nadal has won 18 straight twice, won only 20 - 16 this year and earned his last full french open title in paris and beijing. [SEP]" you would think there would be a big increase in the u. s., " [SEP]
+
+===== sample 053 =====
+[CLS] scale down the travel business. [SEP] "it was impossible to do something but it would be left playing at good quality," the father said. [SEP] venus had responded well with a set victory over serena, who was a winner. [SEP] premier league survival may be returning to sunderland, england boss paul ince has warned after referee dougie smith's goal for 69 minutes gave his side 18 points to secure their survival. [SEP] verizon has lost its six consecutive series and not reached the final since losing in 2002. [SEP] the dispute over unleaded food and energy prices have led to the collapse of the rspca, [SEP]
+
+===== sample 054 =====
+[CLS] 1 mark in defending the division and made it 13 - 2 in the final at the group stage. [SEP] former leaders club wigan, who are currently ninth at the table, hit a 2 - 1 - 0 draw with douthat's zakae. [SEP] the local parliament's instalment will take place live by national media at 2200 gmt on saturday, 9 december. [SEP] but little information is kept clear. [SEP] hibbert scored after the hour mark and once birmingham sent in a five - yard goal only in the first two minutes, he produced birmingham's third to put birmingham ahead 2 - 1 [SEP]
+
+===== sample 055 =====
+[CLS] when kerviel was swept into the lead. [SEP] speaking of the mind, of course, at least one can argue reasonably of what is an important and important part of this term. [SEP] london - chelsea claimed their place in the premier league when the chelsea striker equalised a penalty equalizer which gave top - ranked club bottom of the premier league table on wednesday night after finishing second at west ham where high - table west ham held an early 3 - 1 lead. [SEP] but if it works in her way, it's unlikely to change her life; she says it's difficult to think about this time. [SEP] the [SEP]
+
+===== sample 056 =====
+[CLS] of the season remaining of a draw at cologne, schalke 04 hope for a home victory, germany drawing 1 - 1 on monday as the german champions finished third, bordeaux holding a 2 - 1 victory over sunday and third - place bordeaux at the spot against the world cup champions, but they should stay in contention. [SEP] the police chief's ex - wife, amy kelly, said it was impossible for him to make a decision whether he wanted to retire. [SEP] the american had the crown a year before retiring at the time, while alonso, a first driver, was unbeaten at the bmw open in 2005. [SEP] the risk [SEP]
+
+===== sample 057 =====
+[CLS]. [SEP] more than 20 years ago, there was a demand for the power of nuclear energy, which has a thriving and fractious economy to provide a higher energy demand and more food, according to the energy industry. [SEP] the 37 - year - old german dropped his serve and had broken through maybe three or four times in the opening set, not losing his serve. [SEP] rolen made his second consecutive start and finished with a 2 - 2 - 1 - game losing streak. [SEP] the government also had said it is short of financial aid to provide help, allowing it to continue the restructuring of its loss - making assets, a [SEP]
+
+===== sample 058 =====
+[CLS] comment on the figures. [SEP] the mayor has said that he will stand trial. [SEP] for the first six months i've never seen one. [SEP] he had pleaded guilty prior to the ruling and instead entered a full drug trial on the basis of the u. s. district court agreement under the swiss constitution. [SEP] others draw signs of human kindness. [SEP] " investment in private - sector such as fuel production is much more profitable. [SEP] the official spoke on condition of anonymity because the military differed on whether an air strike was carried in the afghan border from a u. s. military base in afghanistan. [SEP] under a pressure [SEP]
+
+===== sample 059 =====
+[CLS] students at the university. [SEP] he was 1. 68 seconds behind, 41sec and back in fourth, just ahead of st. louis - based american dan davison. [SEP] the european commission did now expect the ecc to release the results before the election, and to take control of the economy before it was due to begin the next day. [SEP] the swede, seeded 27, has no time to face american beck in men's first round after sweden's joachim stead, who beat richard gonzalez, 6 - 3, 6 6 - 4, of german andrea kanepi in helsinki on wednesday. [SEP] one large [SEP]
+
+===== sample 060 =====
+[CLS] an investor. [SEP] the report followed 150 parents - children, teachers and pet - shop staff as they tried to track who they thought they were taking. [SEP] four points were equal to those who scored eight touchdowns. [SEP] griem was set free in court in the federal district of new york on july 22. [SEP] sodery, the defending champion and champion, had to resamped to within a point when he came ahead and lost his hand off the ice. [SEP] manufacturing rose 3. 0 per cent to 46, 000 german factories, after having increased only 0. 6 percent in the previous quarter. [SEP] a company, [SEP]
+
+===== sample 061 =====
+[CLS] said. [SEP] england's goalie smith arrived 10 minutes after a penalty shot and then capped smith's revival with a crucial third - minute goal. [SEP] a diagnosis of the advanced form of amauroma, known as positive lymphoma (tmo). [SEP] but they then remained unconieved and failed to keep their hopes alive. [SEP] in a press conference yesterday morning the fa director of rugby executive refused to talk to a member of the medical staff and is looking at the fa's disposals. [SEP] the woman was transported to the hospital's emergency department. [SEP] an investigation into the fire led [SEP]
+
+===== sample 062 =====
+[CLS] market, where it is shared by toyota's popular fusion focus, a more highly popular prius in the united states. [SEP] scotland win: england 4 - 1, murray 6 - 1, daley 6 - 2, 0 - 2 - 3, kl 3 - 3, 25, 18, 21, 17, 16, 18 - 9, 21, 26, 27, 21, 20, 21, 26, 19, johnson's 3 - 7, hazell's 1 2 - 0. [SEP] this is an important time in my part - time career. [SEP] sebela returned to the squad in september [SEP]
+
+===== sample 063 =====
+[CLS] election day of today. [SEP] the study included results of cancer patients, up to the age of 50, showed a high number of people being exposed to "normal cancers." [SEP] he said earlier this week that it wasn't clear that the letter bearing his name would be released until on sunday afternoon. [SEP] morrissey, 70, was convicted by the u. s. supreme court and was returned to the u. s. district court in 2006. [SEP] five of his 10 top picks hail from around new england, including carolina, jacksonville and tennessee. [SEP] the driver died from the 24 - hour crash from 1300 gmt on [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_temp_schedule_128steps_n64/cosine_2p0_to_1p0_c256_scored.jsonl

@@ -0,0 +1,65 @@
+{"type": "summary", "name": "cosine_2p0_to_1p0_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 168000, "decode": {"kind": "categorical_fullvocab_temp_schedule", "config": "cosine_2p0_to_1p0_c256", "steps": 128, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "temp_start": 2.0, "temp_end": 1.0, "temp_schedule": "cosine", "concentration_min": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 57.69433042345068, "nll_per_token": 4.055158909127353, "tokens": 9666}, "diversity": {"sample_entropy": 4.217734038811499, "unique_tokens": 1913, "token_count": 8192, "distinct_1": 0.2335205078125, "distinct_2": 0.7210875984251969, "top_token_mass": 0.0491943359375}}
+{"type": "sample", "index": 0, "raw_text": "[CLS] edinburgh, glasgow and leeds - london airport from 2006 to 2005. [SEP] safin, hoping to win the world title title this season, needed five minutes to reverse his first quarterfinal loss at the roland garros on saturday. [SEP] abdullah is to hold a two - day cabinet meeting on sunday. [SEP] but officials liked the jets ' lack of control. [SEP] the economy is sluggish...... [SEP] setting the stage for force, who took a 6 - 0 lead in the third and scored a deserved early try in the second minute when jack goodell scored his own half goal, while amoque ' s [SEP]", "detok_text": "[CLS] edinburgh, glasgow and leeds - london airport from 2006 to 2005. [SEP] safin, hoping to win the world title title this season, needed five minutes to reverse his first quarterfinal loss at the roland garros on saturday. [SEP] abdullah is to hold a two - day cabinet meeting on sunday. [SEP] but officials liked the jets' lack of control. [SEP] the economy is sluggish...... [SEP] setting the stage for force, who took a 6 - 0 lead in the third and scored a deserved early try in the second minute when jack goodell scored his own half goal, while amoque's [SEP]"}
+{"type": "sample", "index": 1, "raw_text": "[CLS] of breast cancer, which is responsible for 40 per cent of people who die from cancer in south africa. [SEP] \" conservatives will choose to support obama, or become more conservative, likely to vote, overall, but conservatives have no choice but to lose a second round vote, \" he said. [SEP] and then it took him just months away on time. [SEP] and if i haven ' t able to fully explain my situation, then i should wait some time, before heading into some bigger waters. [SEP] \" that was really very worrying, \" he said. [SEP] however, the court found that some 130, 000 of them had already been [SEP]", "detok_text": "[CLS] of breast cancer, which is responsible for 40 per cent of people who die from cancer in south africa. [SEP] \"conservatives will choose to support obama, or become more conservative, likely to vote, overall, but conservatives have no choice but to lose a second round vote,\" he said. [SEP] and then it took him just months away on time. [SEP] and if i haven't able to fully explain my situation, then i should wait some time, before heading into some bigger waters. [SEP] \"that was really very worrying,\" he said. [SEP] however, the court found that some 130, 000 of them had already been [SEP]"}
+{"type": "sample", "index": 2, "raw_text": "[CLS] and the average price of the vaccine was $ 599 at the plant in september 2008. [SEP] the german - based company, microsoft and internet company google have said that they wanted to cost control the companies, but they might spend money to stymish technology investments. [SEP] that ' s more than mother ' s day. [SEP] police are appealing for witnesses to the collision which happened at about 2100 bst on saturday 1300 gmt sunday. [SEP] in 2005, over 2, 400 schools within the eight - year system, a number of schools and academies providing £25, 000 of public income to middle income and low middle class children [SEP]", "detok_text": "[CLS] and the average price of the vaccine was $599 at the plant in september 2008. [SEP] the german - based company, microsoft and internet company google have said that they wanted to cost control the companies, but they might spend money to stymish technology investments. [SEP] that's more than mother's day. [SEP] police are appealing for witnesses to the collision which happened at about 2100 bst on saturday 1300 gmt sunday. [SEP] in 2005, over 2, 400 schools within the eight - year system, a number of schools and academies providing £25, 000 of public income to middle income and low middle class children [SEP]"}
+{"type": "sample", "index": 3, "raw_text": "[CLS] 4 6 - 6, 4 - 6 - 2 win over elena dementva for the second - seeded french open title last week, enough to go down, 2 - 0 and down 5 - 0 to reach the third match against sharava. [SEP] in between the two men linked, three and seven colleagues said they showed a broken jaw. [SEP] he was cheered by the fans when the new york yankees, who had lost their of those four games, first met in 2005, they ' d been playing unproductively for the last two seasons. [SEP] the new investigation will include a study in the annual world biodeter [SEP]", "detok_text": "[CLS] 4 6 - 6, 4 - 6 - 2 win over elena dementva for the second - seeded french open title last week, enough to go down, 2 - 0 and down 5 - 0 to reach the third match against sharava. [SEP] in between the two men linked, three and seven colleagues said they showed a broken jaw. [SEP] he was cheered by the fans when the new york yankees, who had lost their of those four games, first met in 2005, they'd been playing unproductively for the last two seasons. [SEP] the new investigation will include a study in the annual world biodeter [SEP]"}
+{"type": "sample", "index": 4, "raw_text": "[CLS] ' s second - biggest airliner from frankfurt in october. [SEP] the u. s. stock market was down 0. 8 percent of a four - month low thursday, with the euro closing at $ 1, 875 the week after down $ 6, 648 from monday. [SEP] chelsea finally lost a first - half when england defender andrew johnson ' s johnson ' s cross met harry redknapp ' s free - kick and finally scored in the second minute of a free - kick, an hour after the second from lampard, a goal from mike green, was blocked. [SEP] in 2006, al qaeda sent a single official [SEP]", "detok_text": "[CLS]'s second - biggest airliner from frankfurt in october. [SEP] the u. s. stock market was down 0. 8 percent of a four - month low thursday, with the euro closing at $1, 875 the week after down $6, 648 from monday. [SEP] chelsea finally lost a first - half when england defender andrew johnson's johnson's cross met harry redknapp's free - kick and finally scored in the second minute of a free - kick, an hour after the second from lampard, a goal from mike green, was blocked. [SEP] in 2006, al qaeda sent a single official [SEP]"}
+{"type": "sample", "index": 5, "raw_text": "[CLS] strength of the economy. [SEP] mantelke will finish in the grand prix of his home gp in germany on september 18, in order to make the start of the season. [SEP] the next day, he was still able to survive, he was returned to hospital. [SEP] when england defeated pakistan to become the most - tendered team to play both next year, 16 and 20, officials of the sport ' s governing body, the icc gave a two - year delay in principle to extending that ban, which was imposed after the fourth test in 2004. [SEP] three survivors and injured were found on board boats late on tuesday in a field [SEP]", "detok_text": "[CLS] strength of the economy. [SEP] mantelke will finish in the grand prix of his home gp in germany on september 18, in order to make the start of the season. [SEP] the next day, he was still able to survive, he was returned to hospital. [SEP] when england defeated pakistan to become the most - tendered team to play both next year, 16 and 20, officials of the sport's governing body, the icc gave a two - year delay in principle to extending that ban, which was imposed after the fourth test in 2004. [SEP] three survivors and injured were found on board boats late on tuesday in a field [SEP]"}
+{"type": "sample", "index": 6, "raw_text": "[CLS]. m., germany 0 - 3 ; italy 6 - 0, 4, 4, 2 ) ; belgium 5 6 - 0, 4 - 3 ( 0 1, 2 ; and italy 4 ( 4 ) 9 - 0. [SEP] the average age ( 15 per cent of women aged over 40 ) is up to 55 in the fifties in 2007 and in 2004. [SEP] he killed himself. [SEP] the collision happened at about 2000 gmt, at 080 bst near the 1400 block of moss road. [SEP] people haven ' t been evacuated, but it was like this, so there ' s talk about being at risk. [SEP] [SEP]", "detok_text": "[CLS]. m., germany 0 - 3; italy 6 - 0, 4, 4, 2 ); belgium 5 6 - 0, 4 - 3 ( 0 1, 2; and italy 4 (4) 9 - 0. [SEP] the average age (15 per cent of women aged over 40) is up to 55 in the fifties in 2007 and in 2004. [SEP] he killed himself. [SEP] the collision happened at about 2000 gmt, at 080 bst near the 1400 block of moss road. [SEP] people haven't been evacuated, but it was like this, so there's talk about being at risk. [SEP] [SEP]"}
+{"type": "sample", "index": 7, "raw_text": "[CLS] 2008. [SEP] slovakia and finland sealed their place at europe ' s third hockey tournament in august. [SEP] back then, only 10 points from four games, they fell 10 points behind, and verlander had finished 0 - 10, after the first round had finished in the second set. [SEP] there ' s already a system, one that allows the population to build itself and function, with a system created by paying people in the lower end of an american healthcare system. [SEP] cardiff scored twice after a poor penalty miss as five straight away chances opened the season with a win win at cardiff. [SEP] over the years it has become a big [SEP]", "detok_text": "[CLS] 2008. [SEP] slovakia and finland sealed their place at europe's third hockey tournament in august. [SEP] back then, only 10 points from four games, they fell 10 points behind, and verlander had finished 0 - 10, after the first round had finished in the second set. [SEP] there's already a system, one that allows the population to build itself and function, with a system created by paying people in the lower end of an american healthcare system. [SEP] cardiff scored twice after a poor penalty miss as five straight away chances opened the season with a win win at cardiff. [SEP] over the years it has become a big [SEP]"}
+{"type": "sample", "index": 8, "raw_text": "[CLS] bills or reducing their credit payments. [SEP] andy murray was a surprise winner in the french last 16, but the 21 - year - old champion earned his second masters final appearance in his opening event. [SEP] i had lived here since my childhood 40 years ago and came here about 50 years ago. [SEP] lincecum got the fourth out of seven of his pitchers to lead the victory. [SEP] he ' s last put prize was 25 million pounds ( $ 30 million ) in 1999, then finished the year with 12 million pounds. [SEP] they asked. [SEP] police have closed london ' s railway station to other areas in the capital, including the [SEP]", "detok_text": "[CLS] bills or reducing their credit payments. [SEP] andy murray was a surprise winner in the french last 16, but the 21 - year - old champion earned his second masters final appearance in his opening event. [SEP] i had lived here since my childhood 40 years ago and came here about 50 years ago. [SEP] lincecum got the fourth out of seven of his pitchers to lead the victory. [SEP] he's last put prize was 25 million pounds ($30 million) in 1999, then finished the year with 12 million pounds. [SEP] they asked. [SEP] police have closed london's railway station to other areas in the capital, including the [SEP]"}
+{"type": "sample", "index": 9, "raw_text": "[CLS]s and layoffs. [SEP] they have also responded by back us forces and troops on both sides of europe. [SEP] it comes at the time : when can we work out the future? [SEP] the business scene has just started to change. [SEP] it is no new thing, \" he said. [SEP] it ' s pretty good, cheap and not wirelessly charged by american users, according to bharti, the nation ' s largest mobile phone market. [SEP] sales of personal footwear fell 17. 4 per cent and beauty chain led sales up 45. 4 per cent, or 31. 7 per cent, in its final quarter of [SEP]", "detok_text": "[CLS]s and layoffs. [SEP] they have also responded by back us forces and troops on both sides of europe. [SEP] it comes at the time: when can we work out the future? [SEP] the business scene has just started to change. [SEP] it is no new thing, \" he said. [SEP] it's pretty good, cheap and not wirelessly charged by american users, according to bharti, the nation's largest mobile phone market. [SEP] sales of personal footwear fell 17. 4 per cent and beauty chain led sales up 45. 4 per cent, or 31. 7 per cent, in its final quarter of [SEP]"}
+{"type": "sample", "index": 10, "raw_text": "[CLS] 000 women in 1960 to 56, 400 men in 2006, according to an american survey. [SEP] it has a cost of $ 15. 00. [SEP] yesterday at one of the team ' s main international skis, abdul mutil said in an interview that he had suffered f1 ' s only injury since 2004, which is squeezing the number of american players. [SEP] no. 7 david garrele ousted american david kosnik 6 - 3 6 - 1, and fellow german kevin kuschner led 6 - 1 in the semi - finals coming off their quarterfinal match against no. 10 danish robin soderling, while sixth [SEP]", "detok_text": "[CLS] 000 women in 1960 to 56, 400 men in 2006, according to an american survey. [SEP] it has a cost of $15. 00. [SEP] yesterday at one of the team's main international skis, abdul mutil said in an interview that he had suffered f1's only injury since 2004, which is squeezing the number of american players. [SEP] no. 7 david garrele ousted american david kosnik 6 - 3 6 - 1, and fellow german kevin kuschner led 6 - 1 in the semi - finals coming off their quarterfinal match against no. 10 danish robin soderling, while sixth [SEP]"}
+{"type": "sample", "index": 11, "raw_text": "[CLS] 2 - 2 at the break, but hantuchova was held by ana ivanovic who took the lead. [SEP] but france scored an early start to start, holding a fine combination from domenech and thierry henry which might have saved the french champions. [SEP] they made the right decision in 2006. [SEP] a final chance to take the fourth set turned to him when his shot landed in front, but the driver refused to fight for his life. [SEP] time, when : friday 10, 2008 - wednesday 10 9 a. m. - 8 : 30 p. m. [SEP] \" then, just a little bit early, they [SEP]", "detok_text": "[CLS] 2 - 2 at the break, but hantuchova was held by ana ivanovic who took the lead. [SEP] but france scored an early start to start, holding a fine combination from domenech and thierry henry which might have saved the french champions. [SEP] they made the right decision in 2006. [SEP] a final chance to take the fourth set turned to him when his shot landed in front, but the driver refused to fight for his life. [SEP] time, when: friday 10, 2008 - wednesday 10 9 a. m. - 8: 30 p. m. [SEP] \" then, just a little bit early, they [SEP]"}
+{"type": "sample", "index": 12, "raw_text": "[CLS] the work was over and it might have been done earlier. [SEP] centre - back joe nolan scored one point from his own ten minutes to put wigan a second point ahead against birmingham, who started the second half hour when david veronin smashed a free kick near the edge of the penalty area. [SEP] they lost 2 - 0 at the start of the contest and then pulled through their fifth penalty of the game, but ireland rebounded with the own goal. [SEP] he was asked about when, how and when he tried to move to a hotel, he was understandable. [SEP] but, with the success, he knows that he is [SEP]", "detok_text": "[CLS] the work was over and it might have been done earlier. [SEP] centre - back joe nolan scored one point from his own ten minutes to put wigan a second point ahead against birmingham, who started the second half hour when david veronin smashed a free kick near the edge of the penalty area. [SEP] they lost 2 - 0 at the start of the contest and then pulled through their fifth penalty of the game, but ireland rebounded with the own goal. [SEP] he was asked about when, how and when he tried to move to a hotel, he was understandable. [SEP] but, with the success, he knows that he is [SEP]"}
+{"type": "sample", "index": 13, "raw_text": "[CLS] [SEP] it might help the economy with oil. [SEP] henin has now won five straight french open and a total of seven titles for the event which is launched on september 30 on sunday. [SEP] a young child has a family, one of just a family and possibly a child. [SEP] \" they can be dangerous. [SEP] the combined rate for the rate of unemployment in the survey period from the end of 2006 was 3. 2 percent. [SEP] then, the scolari ' s side failed to regain their first european title and even though chelsea, arsenal and liverpool scored twice, only tentative assurances from the germans had become available that they [SEP]", "detok_text": "[CLS] [SEP] it might help the economy with oil. [SEP] henin has now won five straight french open and a total of seven titles for the event which is launched on september 30 on sunday. [SEP] a young child has a family, one of just a family and possibly a child. [SEP] \" they can be dangerous. [SEP] the combined rate for the rate of unemployment in the survey period from the end of 2006 was 3. 2 percent. [SEP] then, the scolari's side failed to regain their first european title and even though chelsea, arsenal and liverpool scored twice, only tentative assurances from the germans had become available that they [SEP]"}
+{"type": "sample", "index": 14, "raw_text": "[CLS] la daniele in 2001, with ajax finishing third behind other leaders ajax and connmin and rifes almeria, who finished in the group. [SEP] a fifth place is a distant dream, and he is a consistent fourth - placer after the final three grand prix, a month ahead of the world championship in italy having missed out on the title for six months. [SEP] 704. 300, 71. 883. 7292. 651, 48. 877. 716. 719, 717. 289. 723, 712. 728, 61. 881. 742 [SEP]", "detok_text": "[CLS] la daniele in 2001, with ajax finishing third behind other leaders ajax and connmin and rifes almeria, who finished in the group. [SEP] a fifth place is a distant dream, and he is a consistent fourth - placer after the final three grand prix, a month ahead of the world championship in italy having missed out on the title for six months. [SEP] 704. 300, 71. 883. 7292. 651, 48. 877. 716. 719, 717. 289. 723, 712. 728, 61. 881. 742 [SEP]"}
+{"type": "sample", "index": 15, "raw_text": "[CLS] 0 - 3 as the bulldogs ( 14 - 7, 2 - 8 ) finished on the way. [SEP] defending : defending champion gordon stumulates that he ' s improving his back quickly and that there isn ' t a chance he won ' t compete. [SEP] sunday 10. m. to 3 p. m., so the boat isn ' t going to be on the way to their destination at the moment.... [SEP] eventually they paid us off the phone. [SEP] in the past three months a number of trainees have lost almost 10, 000 after being taken on by small firms. [SEP] 10 : 24 : - [SEP]", "detok_text": "[CLS] 0 - 3 as the bulldogs (14 - 7, 2 - 8) finished on the way. [SEP] defending: defending champion gordon stumulates that he's improving his back quickly and that there isn't a chance he won't compete. [SEP] sunday 10. m. to 3 p. m., so the boat isn't going to be on the way to their destination at the moment.... [SEP] eventually they paid us off the phone. [SEP] in the past three months a number of trainees have lost almost 10, 000 after being taken on by small firms. [SEP] 10: 24: - [SEP]"}
+{"type": "sample", "index": 16, "raw_text": "[CLS] [SEP] mcenroe is a point ahead of second - seeded us open champion federer who was unable to advance to the opening round and the czechs made 10 early runs to the masters cup, and five break errors. [SEP] investors, however, don ' t be surprised that the december advance is running at a 5 % annual rate of economic gains. [SEP] in the abnit district in this area of afghanistan, an aircraft of u. s. forces has recently crashed in iraq, nato and company officials said. [SEP] mr macbrish, who was a lifelong public speaker diagnosed with the disease, was standing in the midst of [SEP]", "detok_text": "[CLS] [SEP] mcenroe is a point ahead of second - seeded us open champion federer who was unable to advance to the opening round and the czechs made 10 early runs to the masters cup, and five break errors. [SEP] investors, however, don't be surprised that the december advance is running at a 5 % annual rate of economic gains. [SEP] in the abnit district in this area of afghanistan, an aircraft of u. s. forces has recently crashed in iraq, nato and company officials said. [SEP] mr macbrish, who was a lifelong public speaker diagnosed with the disease, was standing in the midst of [SEP]"}
+{"type": "sample", "index": 17, "raw_text": "[CLS] spending and widespread market speculation. [SEP] a further 18 points were made with 15 minutes to go - - this was the first time that he scored a goal this season, six more than the dutch, following a blip in form after steven redkna ' s win over burnley. [SEP] the third question is whether it exists. [SEP] but even he has tried to make truth about the allegations that he had tried to hide gold last year when he lost a berlin final to kimi in 2007. [SEP] grebe said he was awaiting more information on the case. [SEP] associated press writers mez ahmad shah in kabul, ahmed mohta [SEP]", "detok_text": "[CLS] spending and widespread market speculation. [SEP] a further 18 points were made with 15 minutes to go - - this was the first time that he scored a goal this season, six more than the dutch, following a blip in form after steven redkna's win over burnley. [SEP] the third question is whether it exists. [SEP] but even he has tried to make truth about the allegations that he had tried to hide gold last year when he lost a berlin final to kimi in 2007. [SEP] grebe said he was awaiting more information on the case. [SEP] associated press writers mez ahmad shah in kabul, ahmed mohta [SEP]"}
+{"type": "sample", "index": 18, "raw_text": "[CLS] 20 minutes when he went on to point to a mistake as a two - man cut saved his game after 40 seconds. [SEP] a man and woman has been arrested after police found the second man with a serious injuries. [SEP] but the women and men who think the only thing that matters is to but doesn ' t have any real way of seeing what ' s best for their childrens. [SEP] prince harry was a 19 - year old who was married in january 1942. [SEP] he lifted a free - kick down the right flank and beat ryan miller in the 10th straight into a corner just for an outside corner. [SEP] like anyone in the [SEP]", "detok_text": "[CLS] 20 minutes when he went on to point to a mistake as a two - man cut saved his game after 40 seconds. [SEP] a man and woman has been arrested after police found the second man with a serious injuries. [SEP] but the women and men who think the only thing that matters is to but doesn't have any real way of seeing what's best for their childrens. [SEP] prince harry was a 19 - year old who was married in january 1942. [SEP] he lifted a free - kick down the right flank and beat ryan miller in the 10th straight into a corner just for an outside corner. [SEP] like anyone in the [SEP]"}
+{"type": "sample", "index": 19, "raw_text": "[CLS] saturday. [SEP] when the wall was blown in 1851, it had dropped over the mountains of east jerusalem and the vast northern coast. [SEP] earlier in the night, the hurricane center system was putting it at a flood risk of 30 to 40, before forecasts ordered it to move to the louisiana coast and dump it into the florida river. [SEP] she beat russian open seed sakonetsvili, the french champion at the french open in 2008 and the masters cup event of 2007. [SEP] french coach david ballet ' s results of the title have been confirmed to trim the speculation that defender carlo janka will play in paris if he would [SEP]", "detok_text": "[CLS] saturday. [SEP] when the wall was blown in 1851, it had dropped over the mountains of east jerusalem and the vast northern coast. [SEP] earlier in the night, the hurricane center system was putting it at a flood risk of 30 to 40, before forecasts ordered it to move to the louisiana coast and dump it into the florida river. [SEP] she beat russian open seed sakonetsvili, the french champion at the french open in 2008 and the masters cup event of 2007. [SEP] french coach david ballet's results of the title have been confirmed to trim the speculation that defender carlo janka will play in paris if he would [SEP]"}
+{"type": "sample", "index": 20, "raw_text": "[CLS], mr. fars said in iran ' s state news agency. [SEP] the qatari had agreed to delay the takeover offer until the board ' s meeting next month. [SEP] the 2005 major storm led to the deaths of six people with life threatening injuries. [SEP] they would not be left behind, \" he said. [SEP] they then raised the alarm and threatened him with a knife. [SEP] shanghai shares gained 1. 1 percent, the index added 1. 3 percent at 1, 061. 01 and the people ' s bank jumped 0. 3 percent. [SEP] \" there ' s no question that they didn ' t have the idea [SEP]", "detok_text": "[CLS], mr. fars said in iran's state news agency. [SEP] the qatari had agreed to delay the takeover offer until the board's meeting next month. [SEP] the 2005 major storm led to the deaths of six people with life threatening injuries. [SEP] they would not be left behind, \"he said. [SEP] they then raised the alarm and threatened him with a knife. [SEP] shanghai shares gained 1. 1 percent, the index added 1. 3 percent at 1, 061. 01 and the people's bank jumped 0. 3 percent. [SEP]\" there's no question that they didn't have the idea [SEP]"}
+{"type": "sample", "index": 21, "raw_text": "[CLS] says he can tell her something - - he says that he refuses to write her down. [SEP] new york ( reuters ) - thousands of u. s. cancer patients born in the u. s. may remain in the hospital after having their organs returned to the hospital from major operations. [SEP] nearly 1, 200 students claim to take free courses and exams. [SEP] he got the idea. [SEP] last month he gave mr thaksin ' s party a 13 - 7 victory in the second round of the 100 - seat parliament, and denied the 59 - year - old republican challenger of another run - off on the grounds of the campaign [SEP]", "detok_text": "[CLS] says he can tell her something - - he says that he refuses to write her down. [SEP] new york (reuters) - thousands of u. s. cancer patients born in the u. s. may remain in the hospital after having their organs returned to the hospital from major operations. [SEP] nearly 1, 200 students claim to take free courses and exams. [SEP] he got the idea. [SEP] last month he gave mr thaksin's party a 13 - 7 victory in the second round of the 100 - seat parliament, and denied the 59 - year - old republican challenger of another run - off on the grounds of the campaign [SEP]"}
+{"type": "sample", "index": 22, "raw_text": "[CLS] by afghan citizens, a majority of whom were held back. [SEP] and this is that my eldest son died in 2003, aged 41. [SEP] the young toyota driver won a three - time title, but returned to the first stage after struggling to finish eighth, thus resuming britain ' s first grand prix of their 2007 season. [SEP] united nations director general motavi haema on saturday said 11 u. n. soldiers had died after militants attacked a vehicle near the capital, leaving at least 47 people injured. [SEP] a quarter of children aged 25 and older did not have age before the age of 65, and their health increased. [SEP]", "detok_text": "[CLS] by afghan citizens, a majority of whom were held back. [SEP] and this is that my eldest son died in 2003, aged 41. [SEP] the young toyota driver won a three - time title, but returned to the first stage after struggling to finish eighth, thus resuming britain's first grand prix of their 2007 season. [SEP] united nations director general motavi haema on saturday said 11 u. n. soldiers had died after militants attacked a vehicle near the capital, leaving at least 47 people injured. [SEP] a quarter of children aged 25 and older did not have age before the age of 65, and their health increased. [SEP]"}
+{"type": "sample", "index": 23, "raw_text": "[CLS] for democracy reported. [SEP] democratic sen. chris rucker, a leader in baltimore county for the democratic house senate majority, called in tuesday as he kept a strong republican leader from mulling to seek his republican seat again early tuesday. [SEP] at the high school in kisumu, a senior police official where the governor was staying reported at least five killed and seven people, including three children, wounded, officials said. [SEP] though nadya aleaud, the french open ' s three - time champion, lost her serve in the second set, safinfina lost back in early october. [SEP] there would be an additional £ [SEP]", "detok_text": "[CLS] for democracy reported. [SEP] democratic sen. chris rucker, a leader in baltimore county for the democratic house senate majority, called in tuesday as he kept a strong republican leader from mulling to seek his republican seat again early tuesday. [SEP] at the high school in kisumu, a senior police official where the governor was staying reported at least five killed and seven people, including three children, wounded, officials said. [SEP] though nadya aleaud, the french open's three - time champion, lost her serve in the second set, safinfina lost back in early october. [SEP] there would be an additional £[SEP]"}
+{"type": "sample", "index": 24, "raw_text": "[CLS] election. [SEP] phillardo took the initiative, and woods topped mickelson, who won his third round at the pga states grand slam championship last month. [SEP] the game was his second straight loss in five star game. [SEP] \" the winning pick, \" said gordon cowhery, who was the winner of john walsh in october and the winner two years ago. [SEP] it also represents everything from the most expensive to expensive to charities. [SEP] the tories and mr cameron have privately suggested that they would have to hold a final line over mr brown on the contentious and divisive issue of iraq. [SEP] about 30 percent of [SEP]", "detok_text": "[CLS] election. [SEP] phillardo took the initiative, and woods topped mickelson, who won his third round at the pga states grand slam championship last month. [SEP] the game was his second straight loss in five star game. [SEP] \"the winning pick,\" said gordon cowhery, who was the winner of john walsh in october and the winner two years ago. [SEP] it also represents everything from the most expensive to expensive to charities. [SEP] the tories and mr cameron have privately suggested that they would have to hold a final line over mr brown on the contentious and divisive issue of iraq. [SEP] about 30 percent of [SEP]"}
+{"type": "sample", "index": 25, "raw_text": "[CLS] to power by winning six seats and losing four polls - - five years after his re - election. [SEP] swiss champion roger federer, who won 14 times during his rookie season, made his name his own at the 2006 australian open. [SEP] having trailed in the first set, it was possible to take a set back, win the set and eventually win 1 - 0. [SEP] thanks now. [SEP] after losing an match in the fourth final williams lost the match but only came back from a quarterfinal match with agniestka. [SEP] the yemeni man failed to take a pre - negotiated gilt bid by jumping into the air. [SEP] [SEP]", "detok_text": "[CLS] to power by winning six seats and losing four polls - - five years after his re - election. [SEP] swiss champion roger federer, who won 14 times during his rookie season, made his name his own at the 2006 australian open. [SEP] having trailed in the first set, it was possible to take a set back, win the set and eventually win 1 - 0. [SEP] thanks now. [SEP] after losing an match in the fourth final williams lost the match but only came back from a quarterfinal match with agniestka. [SEP] the yemeni man failed to take a pre - negotiated gilt bid by jumping into the air. [SEP] [SEP]"}
+{"type": "sample", "index": 26, "raw_text": "[CLS], \" it said. [SEP] how do you bring the positives into action? [SEP] the third driver was seen, but he was driving over again when the crash happened. [SEP] in the opening set, the 19 - year - old swiss had dropped to just 15 points from start to finish when the russian broke back again and two points into the match, but she failed to move ahead at the end. [SEP] princeton, n. j. - how are you in a terrible state? [SEP] the lack of bodies is a reason. [SEP] a 1980 meta - study in copenhagen university, denmark, found 59 percent of early cancer survivors, including [SEP]", "detok_text": "[CLS], \" it said. [SEP] how do you bring the positives into action? [SEP] the third driver was seen, but he was driving over again when the crash happened. [SEP] in the opening set, the 19 - year - old swiss had dropped to just 15 points from start to finish when the russian broke back again and two points into the match, but she failed to move ahead at the end. [SEP] princeton, n. j. - how are you in a terrible state? [SEP] the lack of bodies is a reason. [SEP] a 1980 meta - study in copenhagen university, denmark, found 59 percent of early cancer survivors, including [SEP]"}
+{"type": "sample", "index": 27, "raw_text": "[CLS] her clipping and appeared again, losing through 2 - 2, 6 - 2 in the fourth round on sunday. [SEP] federer and federer have fought a hard - fought losing battle against tim henman before winning 3 - 1. [SEP] sunderland are seven points of city rivals liverpool and newcastle five points behind, fifth with their rivals, while arsenal fifth at home, birmingham sixth and barnsley 13 points at home and chelsea, who have the advantage of two more league days of replays. [SEP] however, in 2005 and 2006, the deputy coroner ' s office failed to tell the public whether the county was about to become a legal target for the [SEP]", "detok_text": "[CLS] her clipping and appeared again, losing through 2 - 2, 6 - 2 in the fourth round on sunday. [SEP] federer and federer have fought a hard - fought losing battle against tim henman before winning 3 - 1. [SEP] sunderland are seven points of city rivals liverpool and newcastle five points behind, fifth with their rivals, while arsenal fifth at home, birmingham sixth and barnsley 13 points at home and chelsea, who have the advantage of two more league days of replays. [SEP] however, in 2005 and 2006, the deputy coroner's office failed to tell the public whether the county was about to become a legal target for the [SEP]"}
+{"type": "sample", "index": 28, "raw_text": "[CLS] national elections in august, trying to produce a credible, realistic assessment of whether it can claim to the viability of britain ' s economy. [SEP] both teams were tied in the quarterfinals of the women ' s stanley cup tournament, officials said. [SEP] india ' s meg munku is resting on her right shoulder. [SEP] moreover, researchers know that it ' s important for black students not to increase the risk of premature death. [SEP] u. s. open champion federer took his fourth place while no. 1 seed ivo karlovic of france pulled out of fellow ninth seed roger federer, 6 - 7 6 - 7 7 - 5 7 [SEP]", "detok_text": "[CLS] national elections in august, trying to produce a credible, realistic assessment of whether it can claim to the viability of britain's economy. [SEP] both teams were tied in the quarterfinals of the women's stanley cup tournament, officials said. [SEP] india's meg munku is resting on her right shoulder. [SEP] moreover, researchers know that it's important for black students not to increase the risk of premature death. [SEP] u. s. open champion federer took his fourth place while no. 1 seed ivo karlovic of france pulled out of fellow ninth seed roger federer, 6 - 7 6 - 7 7 - 5 7 [SEP]"}
+{"type": "sample", "index": 29, "raw_text": "[CLS] its plan of cutting costs and using cash to help pay for the closures, which have already saved more than 100 jobs. [SEP] but then moyes looked certain to score another goal after frank lampard was twice and he found the visitors close with another impressive volley, scoring the equalizer in the 75th minute, with arshavin then hitting a high angled own goal to eventually keep the points at 12 - 13. [SEP] about one - third of the households that emit their own carbon emissions are used in nuclear energy, the uk ' s largest producer of renewable nuclear plants. [SEP] however, it was said dr fritzl returned to [SEP]", "detok_text": "[CLS] its plan of cutting costs and using cash to help pay for the closures, which have already saved more than 100 jobs. [SEP] but then moyes looked certain to score another goal after frank lampard was twice and he found the visitors close with another impressive volley, scoring the equalizer in the 75th minute, with arshavin then hitting a high angled own goal to eventually keep the points at 12 - 13. [SEP] about one - third of the households that emit their own carbon emissions are used in nuclear energy, the uk's largest producer of renewable nuclear plants. [SEP] however, it was said dr fritzl returned to [SEP]"}
+{"type": "sample", "index": 30, "raw_text": "[CLS] 25 teams, including williams, ferrari, mercedes and bmws, as well as six medals here. [SEP] russia : 3 k k 6 ( 4 - 4 - 5 - 4 ) 6 k c 6 6 - k k j 6 7, k j 6 7 ( k k 7 7 4 ) 7 k j 6 7, k q 7 6 5 j k j 7 6 m 5 7 - 8 6 k j 7, w henin 6 - 3, k k 6 7, k j 6 7 r 5. [SEP] how good it is manageable to me, but it has done. [SEP] the effects will be felt from [SEP]", "detok_text": "[CLS] 25 teams, including williams, ferrari, mercedes and bmws, as well as six medals here. [SEP] russia: 3 k k 6 (4 - 4 - 5 - 4) 6 k c 6 6 - k k j 6 7, k j 6 7 (k k 7 7 4) 7 k j 6 7, k q 7 6 5 j k j 7 6 m 5 7 - 8 6 k j 7, w henin 6 - 3, k k 6 7, k j 6 7 r 5. [SEP] how good it is manageable to me, but it has done. [SEP] the effects will be felt from [SEP]"}
+{"type": "sample", "index": 31, "raw_text": "[CLS] national association association ( ntia ). [SEP] finally, after four - and - a - half - shot losses in the east, his team had all but decided he was the right thing to win the title. [SEP] their son, alex, was killed in 2007. [SEP] arsenal have beaten liverpool for the season in their last three 16 matches, and are hoping to put themselves in the title chase, ahead of europe ' s defending champions liverpool this weekend against manchester united and everton. [SEP] mohammad gul mohammadi, a top political analyst with the associated press, reported that last summer, at least 13 anti - qaeda militants were killed in [SEP]", "detok_text": "[CLS] national association association (ntia). [SEP] finally, after four - and - a - half - shot losses in the east, his team had all but decided he was the right thing to win the title. [SEP] their son, alex, was killed in 2007. [SEP] arsenal have beaten liverpool for the season in their last three 16 matches, and are hoping to put themselves in the title chase, ahead of europe's defending champions liverpool this weekend against manchester united and everton. [SEP] mohammad gul mohammadi, a top political analyst with the associated press, reported that last summer, at least 13 anti - qaeda militants were killed in [SEP]"}
+{"type": "sample", "index": 32, "raw_text": "[CLS] liverpool ' s lead in the domestic cup, having won here in 1998 and 1996, was not going to happen again. [SEP] bagel ' s captain, eric stewart, was shot at the scene and later released, the survivor told afp. [SEP] a us election is due to be held in january. [SEP] cost : what, how much, was you time spent on it? 2. [SEP] it will ring up every time she says her name, and i ' m just going up. [SEP] sen. joseph i. lieberman, i - conn., pledged to cut the deficit next year by about 10 percent of american [SEP]", "detok_text": "[CLS] liverpool's lead in the domestic cup, having won here in 1998 and 1996, was not going to happen again. [SEP] bagel's captain, eric stewart, was shot at the scene and later released, the survivor told afp. [SEP] a us election is due to be held in january. [SEP] cost: what, how much, was you time spent on it? 2. [SEP] it will ring up every time she says her name, and i'm just going up. [SEP] sen. joseph i. lieberman, i - conn., pledged to cut the deficit next year by about 10 percent of american [SEP]"}
+{"type": "sample", "index": 33, "raw_text": "[CLS]. [SEP] people asked said they thought one of the candidates had bought out, or because of voting labour in the past five years. [SEP] we are determined to work together on that mission. [SEP] he thinks he ' s ok and calm down. [SEP] two factors : a build - up of celiac ability to control their lifestyles, and high - cal risk, leading to high - birth weight and fatter habits, becoming more important in obesity than healthy adults. [SEP] the number of children scoring in maths at high school could soon be scrapped, labour ' s report revealed today. [SEP] entitlement under the current plan would be [SEP]", "detok_text": "[CLS]. [SEP] people asked said they thought one of the candidates had bought out, or because of voting labour in the past five years. [SEP] we are determined to work together on that mission. [SEP] he thinks he's ok and calm down. [SEP] two factors: a build - up of celiac ability to control their lifestyles, and high - cal risk, leading to high - birth weight and fatter habits, becoming more important in obesity than healthy adults. [SEP] the number of children scoring in maths at high school could soon be scrapped, labour's report revealed today. [SEP] entitlement under the current plan would be [SEP]"}
+{"type": "sample", "index": 34, "raw_text": "[CLS] the dow jones industrial average was down 20. 75 points, or 0. 72 percent, to 9, 734. 81 and the nasdaq was down just 1. 7 points at 2, 272. 7, 2, 411. 10. [SEP] it started now. [SEP] \" they took the child to the hospital where he died and soon he died after a bottle hit to his wife ' s head. [SEP] alabama, louisville, cincinnati and lsu don ' t plan to play in saturday ' s women ' s regular season. [SEP] the other was to reinforce the point that ancelotti must be a premier champion to win a [SEP]", "detok_text": "[CLS] the dow jones industrial average was down 20. 75 points, or 0. 72 percent, to 9, 734. 81 and the nasdaq was down just 1. 7 points at 2, 272. 7, 2, 411. 10. [SEP] it started now. [SEP] \" they took the child to the hospital where he died and soon he died after a bottle hit to his wife's head. [SEP] alabama, louisville, cincinnati and lsu don't plan to play in saturday's women's regular season. [SEP] the other was to reinforce the point that ancelotti must be a premier champion to win a [SEP]"}
+{"type": "sample", "index": 35, "raw_text": "[CLS]rzai ' s second day of talks on security and afghanistan came a day before the election, originally due to finish with the result of a backlash against president karzai ' s anti - taliban administration. [SEP] but it just came here. [SEP] and others thought he was a good guy. [SEP] police asked witnesses for an early report. [SEP] \" people ' s sense that anything but the key figure is not far off, \" said daniel krassen, director of the international institute for asset management, at a meeting of barclays and capital markets. [SEP] hamilton had missed a break because of a wind problem in the first session and [SEP]", "detok_text": "[CLS]rzai's second day of talks on security and afghanistan came a day before the election, originally due to finish with the result of a backlash against president karzai's anti - taliban administration. [SEP] but it just came here. [SEP] and others thought he was a good guy. [SEP] police asked witnesses for an early report. [SEP] \"people's sense that anything but the key figure is not far off,\" said daniel krassen, director of the international institute for asset management, at a meeting of barclays and capital markets. [SEP] hamilton had missed a break because of a wind problem in the first session and [SEP]"}
+{"type": "sample", "index": 36, "raw_text": "[CLS] record. [SEP] on tuesday, it was released by the national electoral research institute. [SEP] researchers in paris, a french ski resort town of monteveen, found that ten per cent of their women have cancer for four to five years more age than their men and almost half have the early childhood cancer, of which they are likely to develop breast cancer years after a study. [SEP] u. s. secretary of state susan rice, who visited wednesday to discuss the crisis, made the argument iran is otherwise safe. [SEP] but that cannot be done because the ceo is due to retire in of march, according to a person familiar with the discussions [SEP]", "detok_text": "[CLS] record. [SEP] on tuesday, it was released by the national electoral research institute. [SEP] researchers in paris, a french ski resort town of monteveen, found that ten per cent of their women have cancer for four to five years more age than their men and almost half have the early childhood cancer, of which they are likely to develop breast cancer years after a study. [SEP] u. s. secretary of state susan rice, who visited wednesday to discuss the crisis, made the argument iran is otherwise safe. [SEP] but that cannot be done because the ceo is due to retire in of march, according to a person familiar with the discussions [SEP]"}
+{"type": "sample", "index": 37, "raw_text": "[CLS] could disrupt air travel promotion plans for several airlines, and flights don ' t take off of planes. [SEP] friends sent e - mails to each saying that supplies would be enough and the red cross would have to hand them all their medical needs to the company. [SEP] diesel ( 01300 - 00 - 31 - - 000 euros, 908 dollars ) ; a liter of diesel is 0. 1 euros - 0. 1 euros - 0. 50 dollars, 100 dollars ). [SEP] the bulk of the figures had been done in 2001 in which almost 2, 300 children were children aged 19, 16 to 19, while children aged [SEP]", "detok_text": "[CLS] could disrupt air travel promotion plans for several airlines, and flights don't take off of planes. [SEP] friends sent e - mails to each saying that supplies would be enough and the red cross would have to hand them all their medical needs to the company. [SEP] diesel (01300 - 00 - 31 - - 000 euros, 908 dollars); a liter of diesel is 0. 1 euros - 0. 1 euros - 0. 50 dollars, 100 dollars ). [SEP] the bulk of the figures had been done in 2001 in which almost 2, 300 children were children aged 19, 16 to 19, while children aged [SEP]"}
+{"type": "sample", "index": 38, "raw_text": "[CLS] to go in. [SEP] very open, \" she said. [SEP] in the final round of wimbledon at the french masters on sunday 22, 2004, when he was robbed of a big victory in a run of four titles - - but he lost in the tournament and won a grand in paris. [SEP] in the recent 1980s, environmentalists complained about aggressive roadworks and road closures on motorways and motorways, while pedestrians protested at the prospect of damaging medium - range escalators. [SEP] the death toll - - including the record number of 294 people killed during the first quarter of the war - - was nearly as the number of [SEP]", "detok_text": "[CLS] to go in. [SEP] very open, \" she said. [SEP] in the final round of wimbledon at the french masters on sunday 22, 2004, when he was robbed of a big victory in a run of four titles - - but he lost in the tournament and won a grand in paris. [SEP] in the recent 1980s, environmentalists complained about aggressive roadworks and road closures on motorways and motorways, while pedestrians protested at the prospect of damaging medium - range escalators. [SEP] the death toll - - including the record number of 294 people killed during the first quarter of the war - - was nearly as the number of [SEP]"}
+{"type": "sample", "index": 39, "raw_text": "[CLS], 000 - county border. [SEP] finalists for the opening top 10, seventh seed stefan kolbainen and fourth - seeded shakhtari, and frenchman american williams and belgian florent serra are fourth, even though the number will be split - - 94 and 71. [SEP] but, when brown joined brown, nothing went away. [SEP] real madrid, in third, drawing 1 - 2, are in fourth place, a point of five points behind united in their group game, while babel ' s header for liverpool could beat last year ' s champions cup while preserving the club ' s premier league survival. [SEP] one day [SEP]", "detok_text": "[CLS], 000 - county border. [SEP] finalists for the opening top 10, seventh seed stefan kolbainen and fourth - seeded shakhtari, and frenchman american williams and belgian florent serra are fourth, even though the number will be split - - 94 and 71. [SEP] but, when brown joined brown, nothing went away. [SEP] real madrid, in third, drawing 1 - 2, are in fourth place, a point of five points behind united in their group game, while babel's header for liverpool could beat last year's champions cup while preserving the club's premier league survival. [SEP] one day [SEP]"}
+{"type": "sample", "index": 40, "raw_text": "[CLS] the 19 - year - old striker lost his bid and refused to play again because of his lack of preparation on wednesday. [SEP] despite the wales international ' s departure, it is a miserable season, the team accounting for six out of 10 lost performances and now only 5 % of income according to their official estimates. tendulkar, making his second wicket at the break with another against australia at lunch, was the scorer with 20 for the second wicket before tea. [SEP] harrer, 27, from poland, a five - time defending champion, lost her serve on games in any of four and twice, racing to a 9 - [SEP]", "detok_text": "[CLS] the 19 - year - old striker lost his bid and refused to play again because of his lack of preparation on wednesday. [SEP] despite the wales international's departure, it is a miserable season, the team accounting for six out of 10 lost performances and now only 5 % of income according to their official estimates. tendulkar, making his second wicket at the break with another against australia at lunch, was the scorer with 20 for the second wicket before tea. [SEP] harrer, 27, from poland, a five - time defending champion, lost her serve on games in any of four and twice, racing to a 9 - [SEP]"}
+{"type": "sample", "index": 41, "raw_text": "[CLS] said : \" a person who had been running out of time learning to live was not going to work and was not going to work was considered clinically advanced. [SEP] they also found that democrats in congress contributed heavily to the vote, with support from the left and the right. [SEP] southerners will not feel so threatened by the democrats, especially if they do - - and democrats won ' t overhittere to defeat them. [SEP] \" in the tough times, we have had the support and support of a partner for the past two years, \" she says, looking uncertainly. [SEP] i pick up for dinner at 4 : [SEP]", "detok_text": "[CLS] said: \"a person who had been running out of time learning to live was not going to work and was not going to work was considered clinically advanced. [SEP] they also found that democrats in congress contributed heavily to the vote, with support from the left and the right. [SEP] southerners will not feel so threatened by the democrats, especially if they do - - and democrats won't overhittere to defeat them. [SEP]\" in the tough times, we have had the support and support of a partner for the past two years, \" she says, looking uncertainly. [SEP] i pick up for dinner at 4: [SEP]"}
+{"type": "sample", "index": 42, "raw_text": "[CLS] soderling is expected to play a repeat of his first match appearance at london ' s o2 arena this week. [SEP] \" this is wrong. [SEP] he was unable to play his first event, but he had to fly to the united states to complete more of the british open. [SEP] the battle of texas is her seventh win in the year on the tour and her fourth this season at the suster international golf club, set on the northern olympic course on the north island. [SEP] cincinnati, march 18 ( upi ) - - u. s. open champion maria saaduas of spain died wednesday after a bout of [SEP]", "detok_text": "[CLS] soderling is expected to play a repeat of his first match appearance at london's o2 arena this week. [SEP] \" this is wrong. [SEP] he was unable to play his first event, but he had to fly to the united states to complete more of the british open. [SEP] the battle of texas is her seventh win in the year on the tour and her fourth this season at the suster international golf club, set on the northern olympic course on the north island. [SEP] cincinnati, march 18 (upi) - - u. s. open champion maria saaduas of spain died wednesday after a bout of [SEP]"}
+{"type": "sample", "index": 43, "raw_text": "[CLS] their star opponents to the premier league title in the play - off. [SEP] but birmingham then did nothing of luck in the free - kick, which friedel cut back and landed in the yard of gary megson ' s cross, after half - time nolan had dropped the ball to the left, prunted back deep down his left, raised his hand and fell back behind the line. [SEP] ( ap ) - a northwest airlines flight headed to buffalo airport crashed early saturday, killing six people and leaving 21 people on board. [SEP] united states crew members among those who died on the other flight, the u. s. military said [SEP]", "detok_text": "[CLS] their star opponents to the premier league title in the play - off. [SEP] but birmingham then did nothing of luck in the free - kick, which friedel cut back and landed in the yard of gary megson's cross, after half - time nolan had dropped the ball to the left, prunted back deep down his left, raised his hand and fell back behind the line. [SEP] (ap) - a northwest airlines flight headed to buffalo airport crashed early saturday, killing six people and leaving 21 people on board. [SEP] united states crew members among those who died on the other flight, the u. s. military said [SEP]"}
+{"type": "sample", "index": 44, "raw_text": "[CLS] ( ap ) - - the slumping phillies snapped a record five - game winning streak against national league champion los angeles dodgers on friday night with a home victory late in game 5 for a 6 - 2 victory over the philadelphia philadelphia phillies in the opener of the series. [SEP] i just had to see him get a simple lesson from his mother. [SEP] ferguson ' s most improbable goal with seven minutes to time arrived at storrie on saturday, but anelka missed on the first goal, saving three first - half 3 - 0 chances. [SEP] they ' re already degenerated - - not by any measure - [SEP]", "detok_text": "[CLS] (ap) - - the slumping phillies snapped a record five - game winning streak against national league champion los angeles dodgers on friday night with a home victory late in game 5 for a 6 - 2 victory over the philadelphia philadelphia phillies in the opener of the series. [SEP] i just had to see him get a simple lesson from his mother. [SEP] ferguson's most improbable goal with seven minutes to time arrived at storrie on saturday, but anelka missed on the first goal, saving three first - half 3 - 0 chances. [SEP] they're already degenerated - - not by any measure - [SEP]"}
+{"type": "sample", "index": 45, "raw_text": "[CLS]wakah, capital islamabad. [SEP] oh, the inside of palin ' s mouth. [SEP] in june, a 20 - year - old boy died in russia and four others in an accident in the eastern german town of zeebo. [SEP] only 61 percent of republicans and 44 percent said they plan to vote mccain against a republican majority by jan. [SEP] he said roger federer would play today and could have the best team today. [SEP] texas senior back david warren set up a field goal with 25 seconds left to give arkansas a 24 - 27 lead saturday and a fourth - round bye in the big 12 game. [SEP] at the second [SEP]", "detok_text": "[CLS]wakah, capital islamabad. [SEP] oh, the inside of palin's mouth. [SEP] in june, a 20 - year - old boy died in russia and four others in an accident in the eastern german town of zeebo. [SEP] only 61 percent of republicans and 44 percent said they plan to vote mccain against a republican majority by jan. [SEP] he said roger federer would play today and could have the best team today. [SEP] texas senior back david warren set up a field goal with 25 seconds left to give arkansas a 24 - 27 lead saturday and a fourth - round bye in the big 12 game. [SEP] at the second [SEP]"}
+{"type": "sample", "index": 46, "raw_text": "[CLS] led the premier league last season and the season this season when they had six goals in 10 games after losing to reading 1 - 0 to the scottish fa cup first team on jan. [SEP] gm ' s announcement comes as gm also plans to sell its opel units of chevrolet and gm brands in the us and germany, the smallest market in the country. [SEP] she beat russian elena dementieva 6 - 3, 6 - 2 3 - 6 - 4. [SEP] in a later interview, some democrats, however, suggested that mr obama would fight to gain another seat in his own party, which he would avoid if she took him [SEP]", "detok_text": "[CLS] led the premier league last season and the season this season when they had six goals in 10 games after losing to reading 1 - 0 to the scottish fa cup first team on jan. [SEP] gm's announcement comes as gm also plans to sell its opel units of chevrolet and gm brands in the us and germany, the smallest market in the country. [SEP] she beat russian elena dementieva 6 - 3, 6 - 2 3 - 6 - 4. [SEP] in a later interview, some democrats, however, suggested that mr obama would fight to gain another seat in his own party, which he would avoid if she took him [SEP]"}
+{"type": "sample", "index": 47, "raw_text": "[CLS] another who was wounded and wounded, the paper said. [SEP] dawke missed only 13 of the game ' s shots, hitting 58 percent ( 3 of 22 ) of his 3 - pointer. [SEP] federer ' s 4 - point defeat over spain yesterday at st. john ' s was also on europe ' s match at home, when they are seeking to turn their focus on their tennis away from a hard - fought performance at jolen - dreul. [SEP] the total group, the dutch group, rose 4. 2 per cent to skr1. 82bn, according to people familiar with the matter at the paris [SEP]", "detok_text": "[CLS] another who was wounded and wounded, the paper said. [SEP] dawke missed only 13 of the game's shots, hitting 58 percent (3 of 22) of his 3 - pointer. [SEP] federer's 4 - point defeat over spain yesterday at st. john's was also on europe's match at home, when they are seeking to turn their focus on their tennis away from a hard - fought performance at jolen - dreul. [SEP] the total group, the dutch group, rose 4. 2 per cent to skr1. 82bn, according to people familiar with the matter at the paris [SEP]"}
+{"type": "sample", "index": 48, "raw_text": "[CLS] [SEP] washington ( ap ) - lawmakers took a symbolic vote wednesday to make sure the california economy remained growing at 4 percent, the washington times reported sunday. [SEP] however, leeds probably saw the best chance of the match came closer, especially when radhii faye made his mark, caught behind the offside defence with his second left midway through the second quarter. [SEP] robertson, who pitched just 88 pitches in september, had a run in the ninth and a leadoff double against carlos lee in the eighth for his fourth consecutive victory, ending a six - game streak.... [SEP] the region had no expectations and lost some of [SEP]", "detok_text": "[CLS] [SEP] washington (ap) - lawmakers took a symbolic vote wednesday to make sure the california economy remained growing at 4 percent, the washington times reported sunday. [SEP] however, leeds probably saw the best chance of the match came closer, especially when radhii faye made his mark, caught behind the offside defence with his second left midway through the second quarter. [SEP] robertson, who pitched just 88 pitches in september, had a run in the ninth and a leadoff double against carlos lee in the eighth for his fourth consecutive victory, ending a six - game streak.... [SEP] the region had no expectations and lost some of [SEP]"}
+{"type": "sample", "index": 49, "raw_text": "[CLS] more low - paid average household income, almost half of their paychecks in the first year of 2007. [SEP] even the most powerful women were happy with their experience in their own country. [SEP] today ' s slowshoe will continue. [SEP] with the scoreless runs and moving three games behind the yankees, the veteran looked safe after leading 3 - 3 in the fourth and picked up his sixth this season with an rbi single in the fourth game, tied at 3. [SEP] the packers lost 15 - 7 to jacksonville at home and were only dropped to second in the playoffs at home sunday. [SEP] there ' s time for someone to [SEP]", "detok_text": "[CLS] more low - paid average household income, almost half of their paychecks in the first year of 2007. [SEP] even the most powerful women were happy with their experience in their own country. [SEP] today's slowshoe will continue. [SEP] with the scoreless runs and moving three games behind the yankees, the veteran looked safe after leading 3 - 3 in the fourth and picked up his sixth this season with an rbi single in the fourth game, tied at 3. [SEP] the packers lost 15 - 7 to jacksonville at home and were only dropped to second in the playoffs at home sunday. [SEP] there's time for someone to [SEP]"}
+{"type": "sample", "index": 50, "raw_text": "[CLS]. 6 billion dollars a year earlier. [SEP] but they claim they will defend the seat in london, even if they rise to 25 per cent this tuesday. [SEP] the researchers took the lives of 26 women, from the poorest region, who return to the netherlands in northern france without children. [SEP] it doesn ' t have much to do with the deficit. [SEP] sometimes it cost you $ 100 billion i. e., a dollar sum with those assets on the horizon. [SEP] in early morning trading, britain ' s ftse 100 was 3. 9 percent lower. [SEP] france finished fifth out of second and fifth in the u. [SEP]", "detok_text": "[CLS]. 6 billion dollars a year earlier. [SEP] but they claim they will defend the seat in london, even if they rise to 25 per cent this tuesday. [SEP] the researchers took the lives of 26 women, from the poorest region, who return to the netherlands in northern france without children. [SEP] it doesn't have much to do with the deficit. [SEP] sometimes it cost you $100 billion i. e., a dollar sum with those assets on the horizon. [SEP] in early morning trading, britain's ftse 100 was 3. 9 percent lower. [SEP] france finished fifth out of second and fifth in the u. [SEP]"}
+{"type": "sample", "index": 51, "raw_text": "[CLS] especially in europe, if they continue to lose their european cup and then at home they have lost their european champions next year. [SEP] they ' re recovering after a tumor was expended two months ago and seven days later, he said. [SEP] this year he lost a 25 - set match to england last season and lost a point in the 25 - minute defeat of the golden lions 22 - 19 on saturday. [SEP] nadal will return to tennis - - five french open titles while the wimbledon fourth - round champion and britain ' s andy henman ended a 10 - year stay in this year ' s wimbledon title and has lost a [SEP]", "detok_text": "[CLS] especially in europe, if they continue to lose their european cup and then at home they have lost their european champions next year. [SEP] they're recovering after a tumor was expended two months ago and seven days later, he said. [SEP] this year he lost a 25 - set match to england last season and lost a point in the 25 - minute defeat of the golden lions 22 - 19 on saturday. [SEP] nadal will return to tennis - - five french open titles while the wimbledon fourth - round champion and britain's andy henman ended a 10 - year stay in this year's wimbledon title and has lost a [SEP]"}
+{"type": "sample", "index": 52, "raw_text": "[CLS] the process, \" he said. [SEP] the bills were led by 6 - 2 in a series. [SEP] he also has headache, swelling, permanent pain and stomach injuries. [SEP] the study was drawn from patients working between between 2002 and early 2006. [SEP] that could shut down the entire single - vehicle sector and possibly spur economic growth. [SEP] officials said it could have been linked to an accident. [SEP] nadal has won 18 straight twice, won only 20 - 16 this year and earned his last full french open title in paris and beijing. [SEP] \" you would think there would be a big increase in the u. s., \" [SEP]", "detok_text": "[CLS] the process, \"he said. [SEP] the bills were led by 6 - 2 in a series. [SEP] he also has headache, swelling, permanent pain and stomach injuries. [SEP] the study was drawn from patients working between between 2002 and early 2006. [SEP] that could shut down the entire single - vehicle sector and possibly spur economic growth. [SEP] officials said it could have been linked to an accident. [SEP] nadal has won 18 straight twice, won only 20 - 16 this year and earned his last full french open title in paris and beijing. [SEP]\" you would think there would be a big increase in the u. s., \" [SEP]"}
+{"type": "sample", "index": 53, "raw_text": "[CLS] scale down the travel business. [SEP] \" it was impossible to do something but it would be left playing at good quality, \" the father said. [SEP] venus had responded well with a set victory over serena, who was a winner. [SEP] premier league survival may be returning to sunderland, england boss paul ince has warned after referee dougie smith ' s goal for 69 minutes gave his side 18 points to secure their survival. [SEP] verizon has lost its six consecutive series and not reached the final since losing in 2002. [SEP] the dispute over unleaded food and energy prices have led to the collapse of the rspca, [SEP]", "detok_text": "[CLS] scale down the travel business. [SEP] \"it was impossible to do something but it would be left playing at good quality,\" the father said. [SEP] venus had responded well with a set victory over serena, who was a winner. [SEP] premier league survival may be returning to sunderland, england boss paul ince has warned after referee dougie smith's goal for 69 minutes gave his side 18 points to secure their survival. [SEP] verizon has lost its six consecutive series and not reached the final since losing in 2002. [SEP] the dispute over unleaded food and energy prices have led to the collapse of the rspca, [SEP]"}
+{"type": "sample", "index": 54, "raw_text": "[CLS] 1 mark in defending the division and made it 13 - 2 in the final at the group stage. [SEP] former leaders club wigan, who are currently ninth at the table, hit a 2 - 1 - 0 draw with douthat ' s zakae. [SEP] the local parliament ' s instalment will take place live by national media at 2200 gmt on saturday, 9 december. [SEP] but little information is kept clear. [SEP] hibbert scored after the hour mark and once birmingham sent in a five - yard goal only in the first two minutes, he produced birmingham ' s third to put birmingham ahead 2 - 1 [SEP]", "detok_text": "[CLS] 1 mark in defending the division and made it 13 - 2 in the final at the group stage. [SEP] former leaders club wigan, who are currently ninth at the table, hit a 2 - 1 - 0 draw with douthat's zakae. [SEP] the local parliament's instalment will take place live by national media at 2200 gmt on saturday, 9 december. [SEP] but little information is kept clear. [SEP] hibbert scored after the hour mark and once birmingham sent in a five - yard goal only in the first two minutes, he produced birmingham's third to put birmingham ahead 2 - 1 [SEP]"}
+{"type": "sample", "index": 55, "raw_text": "[CLS] when kerviel was swept into the lead. [SEP] speaking of the mind, of course, at least one can argue reasonably of what is an important and important part of this term. [SEP] london - chelsea claimed their place in the premier league when the chelsea striker equalised a penalty equalizer which gave top - ranked club bottom of the premier league table on wednesday night after finishing second at west ham where high - table west ham held an early 3 - 1 lead. [SEP] but if it works in her way, it ' s unlikely to change her life ; she says it ' s difficult to think about this time. [SEP] the [SEP]", "detok_text": "[CLS] when kerviel was swept into the lead. [SEP] speaking of the mind, of course, at least one can argue reasonably of what is an important and important part of this term. [SEP] london - chelsea claimed their place in the premier league when the chelsea striker equalised a penalty equalizer which gave top - ranked club bottom of the premier league table on wednesday night after finishing second at west ham where high - table west ham held an early 3 - 1 lead. [SEP] but if it works in her way, it's unlikely to change her life; she says it's difficult to think about this time. [SEP] the [SEP]"}
+{"type": "sample", "index": 56, "raw_text": "[CLS] of the season remaining of a draw at cologne, schalke 04 hope for a home victory, germany drawing 1 - 1 on monday as the german champions finished third, bordeaux holding a 2 - 1 victory over sunday and third - place bordeaux at the spot against the world cup champions, but they should stay in contention. [SEP] the police chief ' s ex - wife, amy kelly, said it was impossible for him to make a decision whether he wanted to retire. [SEP] the american had the crown a year before retiring at the time, while alonso, a first driver, was unbeaten at the bmw open in 2005. [SEP] the risk [SEP]", "detok_text": "[CLS] of the season remaining of a draw at cologne, schalke 04 hope for a home victory, germany drawing 1 - 1 on monday as the german champions finished third, bordeaux holding a 2 - 1 victory over sunday and third - place bordeaux at the spot against the world cup champions, but they should stay in contention. [SEP] the police chief's ex - wife, amy kelly, said it was impossible for him to make a decision whether he wanted to retire. [SEP] the american had the crown a year before retiring at the time, while alonso, a first driver, was unbeaten at the bmw open in 2005. [SEP] the risk [SEP]"}
+{"type": "sample", "index": 57, "raw_text": "[CLS]. [SEP] more than 20 years ago, there was a demand for the power of nuclear energy, which has a thriving and fractious economy to provide a higher energy demand and more food, according to the energy industry. [SEP] the 37 - year - old german dropped his serve and had broken through maybe three or four times in the opening set, not losing his serve. [SEP] rolen made his second consecutive start and finished with a 2 - 2 - 1 - game losing streak. [SEP] the government also had said it is short of financial aid to provide help, allowing it to continue the restructuring of its loss - making assets, a [SEP]", "detok_text": "[CLS]. [SEP] more than 20 years ago, there was a demand for the power of nuclear energy, which has a thriving and fractious economy to provide a higher energy demand and more food, according to the energy industry. [SEP] the 37 - year - old german dropped his serve and had broken through maybe three or four times in the opening set, not losing his serve. [SEP] rolen made his second consecutive start and finished with a 2 - 2 - 1 - game losing streak. [SEP] the government also had said it is short of financial aid to provide help, allowing it to continue the restructuring of its loss - making assets, a [SEP]"}
+{"type": "sample", "index": 58, "raw_text": "[CLS] comment on the figures. [SEP] the mayor has said that he will stand trial. [SEP] for the first six months i ' ve never seen one. [SEP] he had pleaded guilty prior to the ruling and instead entered a full drug trial on the basis of the u. s. district court agreement under the swiss constitution. [SEP] others draw signs of human kindness. [SEP] \" investment in private - sector such as fuel production is much more profitable. [SEP] the official spoke on condition of anonymity because the military differed on whether an air strike was carried in the afghan border from a u. s. military base in afghanistan. [SEP] under a pressure [SEP]", "detok_text": "[CLS] comment on the figures. [SEP] the mayor has said that he will stand trial. [SEP] for the first six months i've never seen one. [SEP] he had pleaded guilty prior to the ruling and instead entered a full drug trial on the basis of the u. s. district court agreement under the swiss constitution. [SEP] others draw signs of human kindness. [SEP] \" investment in private - sector such as fuel production is much more profitable. [SEP] the official spoke on condition of anonymity because the military differed on whether an air strike was carried in the afghan border from a u. s. military base in afghanistan. [SEP] under a pressure [SEP]"}
+{"type": "sample", "index": 59, "raw_text": "[CLS] students at the university. [SEP] he was 1. 68 seconds behind, 41sec and back in fourth, just ahead of st. louis - based american dan davison. [SEP] the european commission did now expect the ecc to release the results before the election, and to take control of the economy before it was due to begin the next day. [SEP] the swede, seeded 27, has no time to face american beck in men ' s first round after sweden ' s joachim stead, who beat richard gonzalez, 6 - 3, 6 6 - 4, of german andrea kanepi in helsinki on wednesday. [SEP] one large [SEP]", "detok_text": "[CLS] students at the university. [SEP] he was 1. 68 seconds behind, 41sec and back in fourth, just ahead of st. louis - based american dan davison. [SEP] the european commission did now expect the ecc to release the results before the election, and to take control of the economy before it was due to begin the next day. [SEP] the swede, seeded 27, has no time to face american beck in men's first round after sweden's joachim stead, who beat richard gonzalez, 6 - 3, 6 6 - 4, of german andrea kanepi in helsinki on wednesday. [SEP] one large [SEP]"}
+{"type": "sample", "index": 60, "raw_text": "[CLS] an investor. [SEP] the report followed 150 parents - children, teachers and pet - shop staff as they tried to track who they thought they were taking. [SEP] four points were equal to those who scored eight touchdowns. [SEP] griem was set free in court in the federal district of new york on july 22. [SEP] sodery, the defending champion and champion, had to resamped to within a point when he came ahead and lost his hand off the ice. [SEP] manufacturing rose 3. 0 per cent to 46, 000 german factories, after having increased only 0. 6 percent in the previous quarter. [SEP] a company, [SEP]", "detok_text": "[CLS] an investor. [SEP] the report followed 150 parents - children, teachers and pet - shop staff as they tried to track who they thought they were taking. [SEP] four points were equal to those who scored eight touchdowns. [SEP] griem was set free in court in the federal district of new york on july 22. [SEP] sodery, the defending champion and champion, had to resamped to within a point when he came ahead and lost his hand off the ice. [SEP] manufacturing rose 3. 0 per cent to 46, 000 german factories, after having increased only 0. 6 percent in the previous quarter. [SEP] a company, [SEP]"}
+{"type": "sample", "index": 61, "raw_text": "[CLS] said. [SEP] england ' s goalie smith arrived 10 minutes after a penalty shot and then capped smith ' s revival with a crucial third - minute goal. [SEP] a diagnosis of the advanced form of amauroma, known as positive lymphoma ( tmo ). [SEP] but they then remained unconieved and failed to keep their hopes alive. [SEP] in a press conference yesterday morning the fa director of rugby executive refused to talk to a member of the medical staff and is looking at the fa ' s disposals. [SEP] the woman was transported to the hospital ' s emergency department. [SEP] an investigation into the fire led [SEP]", "detok_text": "[CLS] said. [SEP] england's goalie smith arrived 10 minutes after a penalty shot and then capped smith's revival with a crucial third - minute goal. [SEP] a diagnosis of the advanced form of amauroma, known as positive lymphoma (tmo). [SEP] but they then remained unconieved and failed to keep their hopes alive. [SEP] in a press conference yesterday morning the fa director of rugby executive refused to talk to a member of the medical staff and is looking at the fa's disposals. [SEP] the woman was transported to the hospital's emergency department. [SEP] an investigation into the fire led [SEP]"}
+{"type": "sample", "index": 62, "raw_text": "[CLS] market, where it is shared by toyota ' s popular fusion focus, a more highly popular prius in the united states. [SEP] scotland win : england 4 - 1, murray 6 - 1, daley 6 - 2, 0 - 2 - 3, kl 3 - 3, 25, 18, 21, 17, 16, 18 - 9, 21, 26, 27, 21, 20, 21, 26, 19, johnson ' s 3 - 7, hazell ' s 1 2 - 0. [SEP] this is an important time in my part - time career. [SEP] sebela returned to the squad in september [SEP]", "detok_text": "[CLS] market, where it is shared by toyota's popular fusion focus, a more highly popular prius in the united states. [SEP] scotland win: england 4 - 1, murray 6 - 1, daley 6 - 2, 0 - 2 - 3, kl 3 - 3, 25, 18, 21, 17, 16, 18 - 9, 21, 26, 27, 21, 20, 21, 26, 19, johnson's 3 - 7, hazell's 1 2 - 0. [SEP] this is an important time in my part - time career. [SEP] sebela returned to the squad in september [SEP]"}
+{"type": "sample", "index": 63, "raw_text": "[CLS] election day of today. [SEP] the study included results of cancer patients, up to the age of 50, showed a high number of people being exposed to \" normal cancers. \" [SEP] he said earlier this week that it wasn ' t clear that the letter bearing his name would be released until on sunday afternoon. [SEP] morrissey, 70, was convicted by the u. s. supreme court and was returned to the u. s. district court in 2006. [SEP] five of his 10 top picks hail from around new england, including carolina, jacksonville and tennessee. [SEP] the driver died from the 24 - hour crash from 1300 gmt on [SEP]", "detok_text": "[CLS] election day of today. [SEP] the study included results of cancer patients, up to the age of 50, showed a high number of people being exposed to \"normal cancers.\" [SEP] he said earlier this week that it wasn't clear that the letter bearing his name would be released until on sunday afternoon. [SEP] morrissey, 70, was convicted by the u. s. supreme court and was returned to the u. s. district court in 2006. [SEP] five of his 10 top picks hail from around new england, including carolina, jacksonville and tennessee. [SEP] the driver died from the 24 - hour crash from 1300 gmt on [SEP]"}

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_temp_schedule_128steps_n64/late_2p0_to_0p8_c1024_detok_raw_samples.txt

@@ -0,0 +1,230 @@
+late_2p0_to_0p8_c1024_detok
+{
+  "type": "summary",
+  "name": "late_2p0_to_0p8_c1024",
+  "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt",
+  "step": 168000,
+  "decode": {
+    "kind": "categorical_fullvocab_temp_schedule",
+    "config": "late_2p0_to_0p8_c1024",
+    "steps": 128,
+    "model_t_mode": "post",
+    "support_power": 1.0,
+    "semantic_power": 1.0,
+    "temp_start": 2.0,
+    "temp_end": 0.8,
+    "temp_schedule": "late",
+    "concentration_min": 1.0,
+    "concentration_max": 1024.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 30.292676715795903,
+    "nll_per_token": 3.4109059907549826,
+    "tokens": 6918
+  },
+  "diversity": {
+    "sample_entropy": 1.950918831735721,
+    "unique_tokens": 508,
+    "token_count": 8192,
+    "distinct_1": 0.06201171875,
+    "distinct_2": 0.21345964566929135,
+    "top_token_mass": 0.4271240234375
+  }
+}
+
+===== sample 000 =====
+##77777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777
+
+===== sample 001 =====
+##44097477781878731842447707731788872977313151974474773477731978310834870744734077878424477734777770237777883400007348787317093140510677767792377776677783436877777235177 [SEP]
+
+===== sample 002 =====
+[CLS]09320777887770773173131777313173173187510077700315185134313472331317778783477317313173189840851667773100518317873188787777003177883131005167313100007316780031347317347317773100313134 [SEP]
+
+===== sample 003 =====
+##77777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777
+
+===== sample 004 =====
+[CLS] 7583 75787 718 72 717 727 728 712 72 7177 743 717 697 74745 69458 729 727 718 757 713 7387777 718 713 627 677 718 717 7377 75987 747 8897 768 717 7677 743 7283 7168 7587 7167 7174 7537 6978 74787 698 7273 7477 718 6787 748 7477 [SEP]
+
+===== sample 005 =====
+[CLS] - 7, 7 - 7, 7 - 5, 7 - 7, 6 - 7 (7) 5 - 7 7 - 7, 7 - 7, 7 - 7, 7 - 7 (7 - 7, 6 - 4), 7 - 7, 6 - 1, 7 - 5 7 (7), 7 - 6 7 - 6 6 - 4 7 - 5 7 - 6, 7 - 7, 7 - 6, 6 - 1, 7 - 5 6 - 3, 6 - 7 (3) 7 - 7 (7) 7 - 5, 7 - 5, 7 - 5 6 - 7 [SEP]
+
+===== sample 006 =====
+[CLS] gmt on sunday 29 october 2009. [SEP] another 65 people were taken seriously wounded. [SEP] the match airs on, sunday dec 29, at 11pm. [SEP] born at 11pm uk on saturday, july, on until dec. [SEP] it was frustrating, not logical. [SEP] frenchman arnaud clement and fellow frenchman nicolas sahdandi and french seeded frenchman nicolas rocko lost 6 - 3 on tuesday. [SEP] fourth - seeded and fifth seed novak djokovic face fourth - seeded frenchman sebastien safin, seventh seeded frenchman nicolas maunov, fourth - seeded frenchman frenchman gilles tsonga and sixth seed novak djokovic. [SEP] [SEP]
+
+===== sample 007 =====
+[CLS] 715 74 768 76 747 72 747 74 748 75 748 72 748 74 768 75 7423 72 810 745 757 75 745 788 763 768 767 769, 7623. com. 767 767 76237, 7231, 73111, 767322, 7271, 745117, 74000, 747831810. [SEP] french eighth seed safina ousted belgian sixth seed ali janic of serbia, danish seventh seed and 10th seed robin soderling ousted out french 13th seed nicolas ts [SEP]
+
+===== sample 008 =====
+[CLS] 75, 000 late on sunday. [SEP] the mother was arrested aug. [SEP] " i told her to know what to tell my son. [SEP] he wanted everything. [SEP] i was nervous about losing his job. [SEP] 757310077313100003131310031000031003170031000031318313131003173100007831003100770331007319230000000031237238312383100319823317873173199951779 [SEP]
+
+===== sample 009 =====
+[CLS]. open champion roger federer and roger federer of the french open open and french open. [SEP] she led 7 - 0 in seven sets. [SEP] paris - paris, france - french open fourth seed novak safina lost the quarterfinals at the french open last round and the australian open french open. [SEP] fourth - seed janko tsonga makes the quarterfinals of the paris open sunday, fourth - seeded french open champion robert de france 6 - 0. frenchman marat safin, 7 - 3, 7 - 0, 7 - 6 7 - 0, 7 - 6. frenchman arnaud clement, the frenchman, 7 - 6, 7 [SEP]
+
+===== sample 010 =====
+[CLS] 71 74 75 73 74 74 74 74 75 74 74 74 75 73 74 74 74 74 88 74 74 74 74 76 73 73 74 74 80 74 73 74 74 73 74 73 76 74 74 71 74 74 76 74 74 74 74 74 73 73 74 74 73 74 73 73 73 74 70 74 718 74 74 74 74 858 747 748 748 74 768 7173 768 74 74 718 74 717 712 748 72 75 708 74 72 74 697 74 72 767 74 767 74 74 76 75 718 767 718 767 74 111 118, 142 [SEP]
+
+===== sample 011 =====
+[CLS] 72 71 76 76 74 76 71 741 727 73 768 737 72 714 73 71 74 74 71 74 71. 74 745 71. 69 7145 688 72 717 72 717 713 718 72 719 715 73 748 748 73 715 72 763 718 728 721 72878 718 75 7383 71 728 708 716 713 718 72 713 71 741 715 718 6988 728 757 71887 718 678 717 718 748 711 716 71 [SEP]
+
+===== sample 012 =====
+[CLS] 767 ) 711 729 761 727 748 71 713 718 7581 731 74 717 692 6983 718 74 737 72 6287 74 74 711 717 717 33 - 711 73 713 697 717 74 707 712 713 727 75 75 7187 722 71 767 718 75 738 75 703 718 71 748 757 747 7188 71 617 718 728 68 758 767 718 768 728 727 711 717 74 759 72 [SEP]
+
+===== sample 013 =====
+##78777777778773177777317773170777878873677317777878873473177317840723777227870877287777877731988773134877778777736787877715877777736777787778777970 [SEP]
+
+===== sample 014 =====
+##77777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777
+
+===== sample 015 =====
+[CLS] 6 - 3, frenchman gilles simon 7 - 6, 4 - 2, 7 - 6, 6 7 - 5, defeated novak djokovic 6 - 7 - 3, and sixth frenchman nicolas djokovic claimed a five - set 7 - 0 lead in the set. [SEP] belgian fourth round, fourth - seeded fourth - finalist louis - safina, fourth - seeded novakokovic - frenchman gilles simon - and third - seeded kuznetsova in the third. [SEP] roger federer won the wimbledon open, the french open in 1999, while australian open finalist sabbatini lost 1. 6 million euros in his final [SEP]
+
+===== sample 016 =====
+[CLS] roland gauthner, frenchman frenchman arnaud arnaud, french frenchman philippe savt, frenchman philippe rogen, frenchman frenchman ar arnaud clement, frenchman frank schalken, and frenchman arnaud arnaudt and frenchman philippe sakhin. [SEP] frenchman gilles simon lost frenchman david nalbian, belgian andre agassi defeated marcos baghdatis and sixth seed gilles tsonga the quarterfinals. [SEP] 18 by the nov. [SEP] 310 275 1111, 275 275 1111, 220 1111. [SEP] the swiss maestro reached his final round at the australian open last year, winning the australian open final on jan. [SEP]
+
+===== sample 017 =====
+[CLS] 73 73 73 76 73 73 76 76 74 73 73 76 73 73 74 73 74 73 76 76 73 73 71 74 76 73 73 73 73 73 74 73 73 73 74 76 73 69 73 73 70 73 71 76 76 73 73 73 73 74 73 76 73 71 76 76 74 73 74 76 76 73 73 73 76 76 73 76 73 74 73 73 73 73 73 76 76 74 73 73 73 74 73 73 73 73 73 73 73 73 73 73 73 73 73 73 73. [SEP] dec. [SEP] wrong dec. [SEP] " sixteen people were ill and dec. [SEP] she said. [SEP] the british, french and french investigators [SEP]
+
+===== sample 018 =====
+##77777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777
+
+===== sample 019 =====
+[CLS] toulouse 4 - 0 - 0, toulouse 1 - 0 0, toulouse 0 - 0, toulouse 0 - 0 - 0, toulouse 0 - 4 - 0 0 - 0, toulouse 2 - 2, toulouse 0 - 0, toulouse 0, toulouse 2 - 0, toulouse 0 0 - 0, toulouse 2 - 0 - 0 - 0, toulouse 2 - 0 - 0 toulouse 1 - 0, toulouse 0. [SEP] the study was conducted in stockholm, sweden in september 2006. [SEP] venus williams reached the women's semifinals, joining fellow - finalist kim clijsters of france and eighth - seeded safina who lost the french [SEP]
+
+===== sample 020 =====
+[CLS] 10 a. m. [SEP] on sunday, jan. [SEP] on sunday, jan. [SEP] the french open lost 2001 - 3, lost in 2004 and wimbledon in 2003. [SEP] halbatik refused to win. [SEP] tuesday, september 2008 until sunday until october 2009. [SEP] the sixth -, ninth - seeded, ninth - and sixth - seeded belgian frank janko seventh, frenchman - frenchman haas, sixth - seeded ernest gulbis seventh and eighth, sixth - seeded frenchman safin sixth, sixth - seeded and eighth - seeded frenchman roger federer and ninth - seeded frenchman rogeret ranked eighth, ninth - seeded nicolas sahdr [SEP]
+
+===== sample 021 =====
+##77077407997777836777773177731783451731777777363478745517777777777878777777777517774477777877877777777878778877777787877734877777877773478777777 [SEP]
+
+===== sample 022 =====
+[CLS] 083178777877777731777777187317777377787877787731778777777777783175317788778777323878378873178888787872387877723877787887777877777727777767 [SEP]
+
+===== sample 023 =====
+[CLS]323131831031313131731313131310031031313131003231310031310031313100313131007731310000873131323131317310078310066. [SEP] sixth seed belgian clijsters and frenchman gilles ousters defeated france's jose gasquet 6 - 4, 6 - 3 eighth seed gilles simon, france's lucie safarova, seventh and belgian open finalist and fourth seed janko williams, ninth french seed dementieva and frenchman david petetner [SEP]
+
+===== sample 024 =====
+[CLS]77777787318777777238878317888787778883477878777777789876798877887727777787347878777777777887787777877777778877877878777787778777787 [SEP]
+
+===== sample 025 =====
+[CLS]0777877123775177777777773487773123477778779346651787773677877077778317349778777877731777873477877777347317777777787728834778777872887733777073487367 [SEP]
+
+===== sample 026 =====
+[CLS]78777747773176777777777887347453177700318787337778742778877770077729077747343177777777778887774477777777767773677345177778731777777777773477127777 [SEP]
+
+===== sample 027 =====
+[CLS] the presidential primary on jan. [SEP] the contest is open from friday - thursday through sept. [SEP] fourth - - seeded kuznetsova never lost the match, the losing finalist was down 6 - 2 in the fourth round and the french open finalist lost the first round on jan. [SEP] the poll was taken on sunday online and via online phone interviews online aged 2005 - 2006. [SEP] the cardinals lost 13 points at the start of the break. [SEP] frenchman andy murray defeated his fellow frenchman richard gasquet 7 - 6 6 - 2, and fourth - seed joko tsonga 6 - 7 7 - 6 6 - 7 6 - 7 [SEP]
+
+===== sample 028 =====
+[CLS]77787877777787777347778776777877778877777777777877777777777317777878787777778787777877777377777777787877777778777777777877887878 [SEP]
+
+===== sample 029 =====
+##77777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777
+
+===== sample 030 =====
+##77777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777
+
+===== sample 031 =====
+[CLS] ninth - seeded nikolay menchov and fifth - seeded khlschko also lost to fourth - seeded frenchman philipp kohlschreiber 7 - 6 (7 - 5), 6 - 3. [SEP] sixth - and sixth - seeded and eighth - seeded seventh seed robin khdea beat the eighth - seeded frenchman roddick 6 - 4, and eighth seed jebelie nalband and the eighth - seeded german sixth, sixth seed kohlner, sixth - seeded nikolay safina and seventh - fourth - seeded aliko davydenko, the fourth seed. [SEP] the press said friday that several people were [SEP]
+
+===== sample 032 =====
+##77777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777
+
+===== sample 033 =====
+[CLS] near london on 27 october 2002. [SEP] fourth - seeded klbden lost, frenchman gael safis, frenchman djokovic and frenchman novak djokovic, and sixth - seeded davydenko completed fourth - round picks. [SEP] in 2006, 80 per cent of older workers lost their jobs. [SEP] fifth - seeded fourth seeded djokovic defeated eighth - seeded roger federer 6 - 2 and fourth seed novak djokovic, the seventh seed, defeated third - seeded sixth - seeded nicolas kronko 7 - 6, 6 - 3, 6 - 5 7 - 5. [SEP] elsewhere, the sixth seed, fifth and fourth [SEP]
+
+===== sample 034 =====
+[CLS]777782378778237777777773467770777887777787777987878783177787887777777782877777737787237778887879707977777477787787787777777785587708777 [SEP]
+
+===== sample 035 =====
+##77777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777
+
+===== sample 036 =====
+[CLS]7777777777777777777774577777777777777777777777777877778777777777778777787778877877777778777878777777878777777777777778777777777 [SEP]
+
+===== sample 037 =====
+##317731873434031313131731313183131731313131007313131734317317313431313131343131310070031731003173131310313131310000517708731731731778317783173100313131317313173473103434773400003403477317317317340343183451793131
+
+===== sample 038 =====
+##77777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777
+
+===== sample 039 =====
+##77777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777
+
+===== sample 040 =====
+[CLS] curling a shot over the bar. [SEP] he knew nothing to wrong. [SEP] louis, sept. [SEP] washington, jan. [SEP] 18, july 29 - jan. [SEP] totals 73, 73, 73, 73, 73, 73, 73 73, 71, 69, 73, 73, 73, 73, 73, 71, 73, 73, 73 73, 73, 73, 73, 73, 73, 76, 73, 73, 73, 73. [SEP] swiss kleko 7, who reached the fourth round of the french open with sixth seed nicolas kiefer of france and sixth seed novak djokovic of serbia [SEP]
+
+===== sample 041 =====
+[CLS]31873187731773170731317731777317783131317773477323431313134783131731077003131731831313478031031233131773477318327313177731531777873187831723317000078777778773173477731777788734 [SEP]
+
+===== sample 042 =====
+[CLS]77989793473177313177773131777787798778731777317517723776674473177987773123832651777340347457317723751517988363134034783177505175197772777740347360697777238937343400517 [SEP]
+
+===== sample 043 =====
+[CLS]45003007230700831517734783131073177777704577787773131734093431731883173407317667428347973178307677777297777777332274477777407777477734683772777513177734777777237778320 [SEP]
+
+===== sample 044 =====
+[CLS] colchester on feb. [SEP] 1 through sept. [SEP] 25, through dec. [SEP] open, through dec. [SEP] tuesday, sunday and available online, sunday, nov. [SEP] i started my childhood reading reading schools, reading, and reading reading books and writing. [SEP] " they told me something about the way we thought about it. [SEP] in other quarterfinals, sixth - seeded roger federer defeated fourth seed djokovic, sixth seed david nalbandian beat frenchman novak djokovic and russian eighth seed nikolay davydenko 6 - 7, 6 - 3. [SEP] the survey was conducted by telephone and telephone telephone telephone - 24 july. [SEP]
+
+===== sample 045 =====
+##77777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777
+
+===== sample 046 =====
+##77777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777
+
+===== sample 047 =====
+[CLS]83175177778779934731051347427734840317777403151785127840510878751777776631785177726731887878517783440777766777460457788873477797774277888227722773448731726774577517 [SEP]
+
+===== sample 048 =====
+[CLS] 73 73 76 76 76 73 88 73 74 73 71 73 76 76 73 76 75 76 74 73 76 76 76 71 73 76 76 73 73 74 73 76 76 73 76 73 76 73 76 73 74 74 71 76 73 76 76 70 76 76 73 76 71 75 74 76 76 76 73 76 73 71 73 73 70 71 76 76 76 73 73 76 73 73 76 73 69 73 73 73 74 73 73 73 73 73 75 76 73 73 76 76 76 76 73 76 73 74 73 73 73 76 73 74 75 73 76 76 76 73 76 73 76 73 73. [SEP] the study, published at the end of the [SEP]
+
+===== sample 049 =====
+[CLS]7778775177773477313134831873823313173173172383451317233177310773483697517312334233473193473172323313483127234477235373423077237347667347777347360077828473477343183477834362377789277319723 [SEP]
+
+===== sample 050 =====
+[CLS]7777777774034087317457773177777777777927777787778800773407677879777789. £7778. com. £425. £997777723. £429877347777777777777317777777787877797797 [SEP]
+
+===== sample 051 =====
+[CLS] round, fourth seeded frenchman nicolas djokovic of france ousted fourth - fourth seed nicolas saefee, fourth in the 2007 french open. [SEP] saville, france, sunday, jan. [SEP] sixth - seeded french open finalist nadal was to beat 11th seed david nalband 7 - 5, 7 - 5 and seventh - sixth - seeded frenchman novak djokovic defeated sixth - eighth seed nicolas khdandr 6 - 4. [SEP] on sunday, aug. [SEP] 25, 2008, 31 open; and brussels, dec. [SEP] safina struggled to win her fourth title this year, but russian safina lost [SEP]
+
+===== sample 052 =====
+[CLS] losing streak after losing and their first losing time since jan. [SEP] new york, dec. [SEP] the driver was arrested friday night. [SEP] nikolay safina defeated frenchman robin haase 6 - 3, round, gilles tsnaud defeated david gulband 5 - 6, and blake 6 - -,, 6 - 7, gilles arnaud defeated frenchman robin wilenfronga. [SEP] the third seed defeated eighth - seeded janko nalbandian, 6 - 4 6 - 3, 6 - 4, losing one match to eighth - seeded jozballer. [SEP] fourth - seeded and france's gilles haas lost his [SEP]
+
+===== sample 053 =====
+[CLS] [SEP] sixth seed novak djokovic ousted the seeded frenchman 6 - 7, 6 - 6, 3. [SEP] elsewhere, fourth seeded xavier rocch defeated frenchman frenchman melzer 6 - 1, 6 - 3, 6 - 3. [SEP] the eighth - seeded frenchman defeated frenchman arnaud 7 - 5 before serving frenchman frank djoko 6 - 5, 7 - 2. [SEP] telephone numbers: 310 810, 810, 810, 31071, 310308, 310307, 310317, 830 and 817. [SEP] this idea is hardly feasible, according to other people close to the situation. [SEP] [SEP]
+
+===== sample 054 =====
+[CLS] 7871 7478 7778 763 74797 7477 74707 7477 7473 74777 76773 717 7473 767 7187. [SEP] the m24, 767 7634, 83301 and bury avenue and euston were also closed at about 2000 gmt on saturday. [SEP] other other quarterfinalists yesterday, 14th seed marcos baghdatis, 10th and sixth - seeded julien mahdet, 7 - 6; and sixth seed rac gasquet, eighth - seeded robin gadenling 7 - 3 7 - 6 [SEP]
+
+===== sample 055 =====
+[CLS]700777777778787777777787777877777777777778777777778778347777787778777777777777877777777777777367777777777777877777787777777777777 [SEP]
+
+===== sample 056 =====
+[CLS]77877778777787798777778797777777777777778777777777778777777477778777777777877778777787777777777777777777777777782778776777873177 [SEP]
+
+===== sample 057 =====
+[CLS]32777317318317313431313431734310237317343131003187313173477731313400007313193131313131317317783107237313132773134773177777318883134803477318877723347343434787831238347317317313423731313131317734 [SEP]
+
+===== sample 058 =====
+[CLS] open after losing in his fourth round here. [SEP] brussels, belgium, dec. [SEP] frenchman sixth - seeded federer and u. s. - based frenchman novak djokovic lost fourth - round matches and 10th seeded frenchman arnaud simon also defeated french finalist gilles federer 5 - 7 - 2, 6 - 3 7 - 6 7 - 6. [SEP] opens sunday, sept. [SEP] brussels, july 18, brussels, monday, oct. [SEP] french 2004, 2004, 2004, 2007, july 2004, august 2004, july 2008, the french open, 2001, open and 2007 novak djoko, the french open and the french open. [SEP]
+
+===== sample 059 =====
+[CLS]vic, sixth - seeded elena dementieva, seventh - seeded nicolas cornt, 11th - sixth - finalist janko saen, french frenchman nicolas safina and seventh seed novak djokovic; and sixth - seeded novak djokovic beat seventh - seeded frenchman 3 - 7. [SEP] sixth seed sav ousted seeded frenchman louis saas 4 - 6 5 - 7, 6 - 1, 3 - 7, 6 - 7; 12th - belgian ninth seed nicolas volandet and sixth - seeded german david nalband beat frenchman frenchman robert soder 6 - 3, 6 - 3 on wednesday. [SEP] the dow [SEP]
+
+===== sample 060 =====
+[CLS] - 7, 6 - 7 (5 6), 6 - 7, 5 - 7, 7 - 6 french open on sunday. [SEP] sixth - seeded nikolay davydenko defeated germany 7 - 7 yesterday, sixth - seeded frenchman gilles simon of france 7 - 7 and frenchman gilles simon 7 - 5 6 - 3 5 - 7 6 - 4, 6 - 3. [SEP] the spaniards reached a fourth - round match in france with sixth - seeded arnaud clement on dec. fourth - seeded frenchman sixth seed nikolay arnaudnaud ousted and sixth seed tsonga and seventh - seeded gilles ousted eighth - seeded frenchman novak djokovic 6 [SEP]
+
+===== sample 061 =====
+##77777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777
+
+===== sample 062 =====
+[CLS], eighth seed frenchman jester tsonga ousted ninth seed tommy simon 6 - 4, 6 - 7, frenchman marat safina and no. 8 novak djokovic of serbia 1 - 7, defeating seventh seed novak djokovic of serbia 7 - 5, 11th ninth seed marcos baghdatis of cyprus lost 6 - 0, 7 - 7, 6 - 3, and the frenchman upset sixth finalist nikolay davydenko 6 - 7 6 - 6 (7 - 2), 6 - 0 yesterday. [SEP] fourth - seeded belgian teenager marin cilic ousted frenchman ninth seed nicolas kiefer, fourth - seed dj [SEP]
+
+===== sample 063 =====
+##77777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777777
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_temp_schedule_128steps_n64/linear_1p8_to_0p8_c1024_detok_raw_samples.txt

@@ -0,0 +1,230 @@
+linear_1p8_to_0p8_c1024_detok
+{
+  "type": "summary",
+  "name": "linear_1p8_to_0p8_c1024",
+  "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt",
+  "step": 168000,
+  "decode": {
+    "kind": "categorical_fullvocab_temp_schedule",
+    "config": "linear_1p8_to_0p8_c1024",
+    "steps": 128,
+    "model_t_mode": "post",
+    "support_power": 1.0,
+    "semantic_power": 1.0,
+    "temp_start": 1.8,
+    "temp_end": 0.8,
+    "temp_schedule": "linear",
+    "concentration_min": 1.0,
+    "concentration_max": 1024.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 44.10530348094567,
+    "nll_per_token": 3.7865800355610095,
+    "tokens": 9728
+  },
+  "diversity": {
+    "sample_entropy": 4.16083612008407,
+    "unique_tokens": 1814,
+    "token_count": 8192,
+    "distinct_1": 0.221435546875,
+    "distinct_2": 0.6830708661417323,
+    "top_token_mass": 0.0643310546875
+  }
+}
+
+===== sample 000 =====
+[CLS] first set on a love break, setting up an 80 - foot cross - volley to del potro in the third game and again at 3 - 3 to take the second set. [SEP] and the dream story of a african - american who has prepared for the final stages of the first new york city marathon since the beginning of the decade, with a solid expectation of success. [SEP] the report was criticised by the government and took a deep role in the proceedings. [SEP] monday was forecast to bring up to 8 inches of rain for some areas of china's north - western province, according to the weather ministry. [SEP] " the idea of [SEP]
+
+===== sample 001 =====
+[CLS] it is currently expected to stand in january's elections but is expected to run for a second term in 2012. [SEP] mr. boehner would not be surprised that mr. g. edwards had spent several decades in prison before becoming the governor in the 1980s. [SEP] it was less shocking. [SEP] u. s. forces in southern afghanistan said sunday that eight were killed in the southern afghan capital. [SEP] "the problem at the beginning of the year was that we're on the high end of the market, the point where they are going to be available," mr. wood said. [SEP] this is a crime against humanity [SEP]
+
+===== sample 002 =====
+[CLS] ferguson's belief that he could still win back - to - back league games with manchester united. [SEP] it was about 15: 15 on monday november 11, 2008. [SEP] "there is going to be some talks with some wealthy individuals," collis said. [SEP] there was no deal, "taha says. [SEP] the old station, near crown street, is due to reopen again on saturday monday evening and sunday afternoon. [SEP] but we can't bear it anymore. [SEP] this week marks the start of labour's" democratic leadership " campaign for the future of television. [SEP] the european commission is scheduled to vote [SEP]
+
+===== sample 003 =====
+[CLS] - 2 ) drove in the bottom of the ninth. [SEP] defending champion dinara safin lost 6 - 6 7 - 6 7, 6 - 0 to venus williams at the 2002 open and final event of the season. [SEP] it arrives at 1: 22: 15, ca. [SEP] the source would not comment about friday's report, but said it could begin within an hour after a final review of the investigation - - or a hearing could take place by the day. [SEP] john mccain's campaign team came to believe race played a role in the outcome and it was naive to suggest that. [SEP] as well as the political [SEP]
+
+===== sample 004 =====
+[CLS]'s way away from the court. [SEP] since july, the 18 u. s. soldiers in afghanistan, eight of them killed in the attack, suffered four gunshots. [SEP] london (reuters) - the ryder cup's injured kervien is in good form as he prepares to miss the french open and england's team tournament in paris later on friday. [SEP] the pair have been called up by their manager for sunday's premier league match and in talks with lee campbell, who is understood to be in charge of the game, it turned out - - chelsea - - who had kept their place within a goal [SEP]
+
+===== sample 005 =====
+[CLS], " he said. [SEP] the defeat was the second, for though, as england's win appeared to be under the rug. [SEP] (cnn) - - up until the 90s, it didn't pay off as england cruised to secure victory in south africa's first test in a two - day series where he was named up to friday's latest game against sri lanka. [SEP] the web currently receives only over 100, 000 copies a year, which is rare in the world. [SEP] even today, it is the glamour that attracts some of hollywood's greatest stars. [SEP] the company added that falling demand is [SEP]
+
+===== sample 006 =====
+[CLS]. s. - led troops sunday, a spokesman said. [SEP] the boy's bus driver was able to get to the scene today. [SEP] "i was shocked," he told the members of the company's staff. [SEP] (cnn) - - two days of the first game of an american pitcher in baseball's world series are set to end in the coming days, says a government report. [SEP] well, wait, i don't have another clue. [SEP] federer fought back from 2 - 0, losing the tie - break match in the first set, forcing sixth seed safina to pull ahead 6 - [SEP]
+
+===== sample 007 =====
+[CLS] said. [SEP] if they're no longer, it will create a better situation, it will definitely happen, " abdul kazir, deputy governor of the eastern rakni province, told me sunday afternoon. [SEP] basel, switzerland - spain's carlos zawika won his first race of the season sunday and the second - ranked armstrong, who won the tour of california title in his giro debut, mounted a superb attack on the 2, 500 - minute mark that brought him his first grand cup victory. [SEP] the fact is, more than a decade ago, the story of the national mall - - it is a huge [SEP]
+
+===== sample 008 =====
+[CLS] who was sent out to action on tuesday, where he played for germany at the french open in august. [SEP] as the 2008 race up between clinton and obama turns closer, independent - minded voters are more likely to be as enthusiastic or undeclarted with obama. [SEP] he attended the conference before his speech and is britain's minister on the rights of human rights to the eu's largest muslim nation. [SEP] the body was charlyne mclendon in the middle of the night. [SEP] in total between 1999 and 2005, 700 thought to have died in the west of afghanistan. [SEP] last month, the commission approved the [SEP]
+
+===== sample 009 =====
+[CLS] in afghanistan, including troops from the u. s. army of engineers and the state health department. [SEP] " i have no plans to change my heart, they would take me seriously... just in case you try it again. [SEP] the mps have refused to comment on the results of the preliminary inquiry, which will take up their verdicts to see if due to take place at the high court. [SEP] a national trust with a bid to raise the names of a group of children in england are to go to the court. [SEP] but to be a target of a political challenge is difficult. [SEP] that's a bit of [SEP]
+
+===== sample 010 =====
+[CLS] - playing, and if he's realistic about a competitive position in the middle east, he's probably have a little of an interest, and is very confident, " he told reporters. [SEP] chavez, who won general elections in march, had said on thursday that he intended as a political candidate. [SEP] he looked like it would take a while to the city and he could end the crisis. [SEP] the police said he was able to give up but had been walking close to the pavement when he hit his wife's car on sunday. [SEP] this means serving as the choice between president and vice president of the european central bank [SEP]
+
+===== sample 011 =====
+[CLS] off the capitals' 10 - 3 - 11 - 1 - 2 record. [SEP] "that's just the best part of the debate," she said. [SEP] they also got away from tehran in the summer of 2007. [SEP] this, in fact, began with a philosophical view as a commitment that a player had the better side of their game. [SEP] dubai (reuters) - defending champion tiger woods recovered from a broken wrist to go on 78 in the first round of the barclays open here on wednesday, and failed to claim a two - stroke lead following his victory at the masters. [SEP] labour's alex davies said: [SEP]
+
+===== sample 012 =====
+[CLS] funds for the region for 8 to 15 years. [SEP] the second attacker detonated the bomb at 8. 0675 gmt (10. 40) in the middle of the night in the western city of jaipur, the official said. [SEP] it is, then, to cringe at someone's house or to shut down. [SEP] years of research at the university have found that most of us have written about the women in sweden since about 50 years ago. [SEP] "i need to become the captain of wales and i've needed a whole lot of preparation," he said. [SEP] india's foreign minister gordon mandro [SEP]
+
+===== sample 013 =====
+[CLS] australia, gaining 0. 6 per cent to 360. 40. [SEP] mr correa, the interim mayor of the city, has already been beaten by an opponent in the last election, and is expected to lose in the second round of the year. [SEP] " what i tell me that is, at the expense of my government, is to come to me and bring me to justice. [SEP] but, hopefully, he can use the occasion to sort of the crucial issues of his life but it is better to go to the test. [SEP] large amounts of the illness can come from the mouth and part of the patient is coughing. [SEP]
+
+===== sample 014 =====
+[CLS] said. [SEP] the cost of the defense force is about a third of the total costs included in the overall u. s. air war strategy. [SEP] he wasn't speaking out after hearing about the interview by the government. [SEP] but liverpool had the right to be close to the stage 2 - 1 and, ultimately, it was a little more difficult by the european cup to hold it at the top. [SEP] i can't be very sure. [SEP] i was angry at my words because i had just been caught, "he said. [SEP]" we believe that we can be prepared in this increasingly sustainable way, " the joint [SEP]
+
+===== sample 015 =====
+[CLS], but the area is safe and relatively safe. [SEP] but, mr. conserstein said he believed the pain could be alleviated by the funds. [SEP] the fastest time of the two women's downhills was a blustery time of 1. 30 seconds. [SEP] 5 - 11 a. m. [SEP] in the past, however, america's opposition had been feeling the brunt of hitler's wrath when the soviet was in power and down. [SEP] but some mps said they would reserve the right to put their foot on the liberal democrats and come third in charge of the party. [SEP] a few weeks later [SEP]
+
+===== sample 016 =====
+[CLS] and that it's just a little compared to apple's iphone. [SEP] benitez's side made a strong start in the championship on monday and opened it with a three - goal cushion when keane scored the first liverpool goal in less than a minute. [SEP] what would you do this time? [SEP] but pietersen, a young all - rounder, will replace pakistan's jekib singh, and middlesex's hajha scored the winner for the home side in a fourth - wicket victory with just 11 minutes to play. [SEP] the four - day test is held at friday times, but is due to [SEP]
+
+===== sample 017 =====
+[CLS] soon. [SEP] when i think at the start of the year, it may be left to me to set out. [SEP] the study looked at 55 small children and three children. [SEP] "the war is kind of about winning," karzai has said. [SEP] policymakers, in some cases, have had little optimism about the company's future. [SEP] last year, she had an early season, having missed both tournaments and one game from a side injury. [SEP] it says it shows the impact 25 per cent of the population and that a quarter of the population could even be forced to focus on the treatment of children. [SEP] [SEP]
+
+===== sample 018 =====
+[CLS] two points behind. [SEP] ministers have suggested that patients should stay sober if the risk of dying of cancer is rising. [SEP] mr alyddon agreed that there was an important role for the debate, although perhaps he doubted that yesterday's statement was not true. [SEP] "i think it's what is happening at a national level. [SEP]" i'm the first person to know enough to make a play, " she said of scotland. [SEP] they were undefeated in the last three games and, after the 2008 world cup, came to the tournament as good hosts. [SEP] kawagan then moved from switzerland in 1992 to the [SEP]
+
+===== sample 019 =====
+[CLS] [SEP] manchester united was comfortably ahead on four occasions and then went side to finish for six minutes from the inside of the goal line. [SEP] in the past few weeks, romney was defeated in the polls; he was held by bush by primary, followed by mccain's. [SEP] "it is necessary for a complete re - engage in the surge and for giving u. s. forces a greater risk in afghanistan," said one former u. s. senator and member of the state department. [SEP] (ap) - a college student has been refused permission to make a 14 - minute trip to the great lakes range on the way to [SEP]
+
+===== sample 020 =====
+[CLS] fans, said phil dawson, president of the general manager. [SEP] "there's now that more than 150 people on the final day of the presidential election, or more have died in the fighting in north yemen's capital bakri," the official said, depending on the location of sunday's announcement. [SEP] democrats will not win the fight for a new democratic majority. [SEP] before he was able to stand in front of me, they've got to ask him, "what are you doing now?" [SEP] the union federation of teachers and traders said that in the days when it is cutting tens of thousands of [SEP]
+
+===== sample 021 =====
+[CLS] the fiscal year as the company's income stream is unlikely to improve. [SEP] a year ago, the figure was down somewhat compared with a year ago. [SEP] however, the first match having pulled a tear on his left hand, the second seeded agassi struggled to hold up his chance at best. [SEP] but tuesday's version of "american idol" was as much of a surprise as a reflection of the show's power. [SEP] stoner, who started the race at 10 - 1 favourite and then recovered to reach germany's fourth victory in two weeks, failed to reach the finish line. [SEP] new york ( [SEP]
+
+===== sample 022 =====
+[CLS] concerns over supply risks. [SEP] " uncertainty about the size of the settlement comes with a bitter cost. [SEP] rbs will have to pay £12bn of new capital to start rescuing the troubled financial system. [SEP] capello is said to know for his future. [SEP] save the nation and grow up again. [SEP] a new trust is being set up by officials. [SEP] it is much less a question of the economy, and it raises doubts about who will be able to lead, said analysts. [SEP] kardashian has 22 points for the hawks (29 -. 5) in 18 games. [SEP] however, she added, the [SEP]
+
+===== sample 023 =====
+[CLS] games liverpool and liverpool have lost five straight games and two to inter, who will finish the season with just three points in the champions league. [SEP] he resigned after more than 20 years in the u. s. army. [SEP] in october, 2002, in florida, a student at a school in new york, ny, was found with near - naked brain problems. [SEP] nearly 30, 000 people die every year alone, or only about 15 percent of their lives. [SEP] in the 1980s, the army developed a survey of iraqi soldiers who were ready, and soldiers who were not considered dangerous to serve in combat. [SEP] the inquiry is [SEP]
+
+===== sample 024 =====
+[CLS] st. bernard parish, a suburb of the city. [SEP] on the recent day, it came with something like mike mcnamee's drive to win the championship. [SEP] the un said it might hold a general election, at least at the start of the year. [SEP] the peace deal was announced on a day that peace talks have stalled in south korea, where both leaders have called on the north government to comply with their pledge to withdraw. [SEP] on the eve of next friday he will be summoned by the members of the national council's african envoys, all of whom will be brought in in support of robert mugabe [SEP]
+
+===== sample 025 =====
+[CLS] build a 4 - 3 lead on the dead end and then jumped ahead after just one goal. [SEP] he eventually hit the australian serve then at bay, before the american picked up a set point. [SEP] "it's pretty dangerous and dangerous," she said. [SEP] by any standards, i can't be bothered. [SEP] at this point, people don't feel like the rest of their time is going to pay off. [SEP] although she did, she has been been supportive of the strategy in the past. [SEP] a more human option and, more basicly, a downside of the news and billboards is that [SEP]
+
+===== sample 026 =====
+[CLS]l in november 2008, in an election that will have left him in the race for the current presidency. [SEP] it was a very emotional day, and one that was a very emotional day, " he said, being supported by a group of friends. [SEP] something is changed already. [SEP] dallas finished the current team no. 2 points back in third and second overall in sunday's first - round playoffs. [SEP] about one in three of its rivals are based in lanarkshire, glasgow, west london, north yorkshire, derbyshire, newham, southwark and doncaster. [SEP] more than 5, 500 people were killed and more than [SEP]
+
+===== sample 027 =====
+[CLS] elsewhere in the region on friday. [SEP] philip sonnex, 30, has been charged with criminal murder after the sept. [SEP] adil rashid made india's inclusion in the first match part of a bigger attack against england for the ashes at the world cup. [SEP] the former star, who died due to a series of overdoses and heart disease 2002 - 27, will announce her decision later this week. [SEP] the french player, the us open champion, had the chance to finish in third in 2005, but was ninth in the champions league and sixth in the west. [SEP] denver, runner - up, lost 17 - 0 [SEP]
+
+===== sample 028 =====
+[CLS] of the war in afghanistan appear to be the result - - directly or indirectly in the form of significant changes in the war policy - - of iraq and both public security and war. [SEP] they're a lot more proud of themselves when they beat the world cup favourites england 3 - 0, a draw in a match which ended them after two series of disappointments. [SEP] i'm really a strength coach. [SEP] the company hopes soon to start its own treatment of cancer in men and women by testing its human hormone test in the united states. [SEP] look at russia's osrakhav and i feel a place to come [SEP]
+
+===== sample 029 =====
+[CLS]. [SEP] when he told the jury he couldn't find an answer, he could have saved his own life. [SEP] he is now 17 years of a term. [SEP] that goal is not going to be lost in iran's presidential election. [SEP] agents in the main cities are atlanta, geneva, zurich, london, brussels, oslo and stockholm. [SEP] not everyone who had ever heard understood that way. [SEP] the figure was one percent lower than in 2007, when it lost $$384 million over the full fiscal year, according to thomson reuters inc. [SEP] "i didn't know," he says. [SEP] the [SEP]
+
+===== sample 030 =====
+[CLS] russian nikolay davydenko and third seed seed nadal, claimed the win as being a positive. [SEP] (otc bulletin board: dhen. l), announced today that it has completed the second quarter distribution of a $1. 7 million (euro676 million) 2009 operating profit from the company. [SEP] however, according to the daily news, 43 % believed they believed the polls were rigged. [SEP] the report was obtained by canadian government officials. [SEP] the man was later taken to the injury unit at the police station. [SEP] i was an agent of everything. [SEP] this year, the colts will play the afc [SEP]
+
+===== sample 031 =====
+[CLS] party's real role in the presidential election to be published today. [SEP] the police did not give information to the media. [SEP] the offices are spread from bristol, the west and the north east of england. [SEP] "i knew that when he put me to the back of one of the cars, i didn't make the step right," she told cbs news. [SEP] "it is a very exciting result," fauci said. [SEP] " in japan, when you are playing at 15 minutes a game, it's safe to say it is really the only cut you need to take this year. [SEP] the [SEP]
+
+===== sample 032 =====
+[CLS]. [SEP] 12 - - 10 days before the start of sept. [SEP] she reached her wimbledon semi - final for the first time since 2005, losing her 6 - 4 record on the first set to venus, and reaching the fourth round, kuznetsova's fourth to nadal. [SEP] they had to try to make a game, " he said. [SEP] the pirates left closer joe owings as a conservative starter, giving up two outs in the eighth inning. [SEP] the lack of an alternative life, particularly health care, is cancer, which can't directly affect your life until you're 50. [SEP] it came [SEP]
+
+===== sample 033 =====
+[CLS] - income young women living in the region. [SEP] they were held in afghanistan, germany and iraq in 2006. [SEP] the runner - up dropped to sixth in pittsburgh, where the st. louis mystics have a good chance of playing in the playoffs. [SEP] after recent polls in iowa, nevada and texas, mr merkel feels his choice to serve as governor, who is seeking to buy some of his party's electoral power, is deductible as uncommitable. [SEP] the cardinals had won their eighth straight game before losing their fourth straight the year before. [SEP] one of those killed in the northern district of ban [SEP]
+
+===== sample 034 =====
+[CLS] he calls on international support for the united states president.... [SEP] but then, before the match started to close, united would have appeared to be making an impact. [SEP] yesterday, the billionaire investor alex giuliani announced a deal to buy the 49 per cent stake in italy's total, the uk's largest bank asset manager (kp) and rescue the £176bn of mortgage assets that set up britain's financial system at the end of last year. [SEP] the day may count as a year's end but rather a turning point for labour in the polls and the fate of mr brown ' [SEP]
+
+===== sample 035 =====
+[CLS] just ended the last of their lives. [SEP] who cares about the many friends who are on vacation and trying to get their kids to leave funerals on the way out. [SEP] but the unstring is clear that there are some reasons to remain in the family. [SEP] it is shocking. [SEP] they had to do it. [SEP] a report of khan's health has suggested that he was in hospital at the time of the attack for up to a year. [SEP] "60 minutes: ny," "newsreet" (thursday, 10), 9: 00 (9 gmt). [SEP] i thought it was due [SEP]
+
+===== sample 036 =====
+[CLS], hoping to become a presidential contender. [SEP] nearly a year, he took his sixth spot and then came in second for the season. [SEP] i can understand that he's able to pay so well to what he did yesterday, but i think his bill doesn't go as high as to justify it. [SEP] women's doubles: roddick earned a place in the women's doubles in men's doubles. [SEP] there is a lot more anger at the quality of china's banks, where most of them are in the u. s. government. [SEP] the risk of recession was raised when the euro slumped by [SEP]
+
+===== sample 037 =====
+[CLS]. [SEP] the belgian was one of the top players on sunday and finished third in the semifinals of the atp tour event, final and final and earned a go - ahead in the third set, according to a statement released tuesday. [SEP] a police official said three rounds were fired, four people standing at a wall and two wounded in a section of the busy area northwest of the capital, the report said. [SEP] in a 2006 study, the researchers studied around 10, 000 finnish adults at harvard's general medical center from 1999 until early march. [SEP] des moines, iowa, which has nine games left in the southeastern title game, made [SEP]
+
+===== sample 038 =====
+[CLS] and the government said on tuesday retail sales rose by 2. 5 percent in the year to august. [SEP] but it's a fairly simple question. [SEP] today, the fashion business is a mess. [SEP] a man suffered a concussion, said he rushed to his friends, though he was recovered at the scene and underwent surgery. [SEP] overall credibility was still a risk, though. [SEP] "i don't have any way of knowing when he's getting out of his car," he said. [SEP] it has not responded to the original round of hostile offers. [SEP] james paget, the director of microsoft's enterprise design [SEP]
+
+===== sample 039 =====
+[CLS] at the university of british columbia. [SEP] michael broad's 10th century off cook was dropped to a modest 200 lower than his mark as south africa had their wickets drawn 5 - 0 in 10 balls to reply to india's five runs at tea on friday. [SEP] "we have been looking at the best part of the year," he said. [SEP] back in the third quarter of 2006, more focus was on how the colts used to lose their first 3 games at home. [SEP] insurgents attacked a village of sangin in, north of the centre of the town as well as a home to afghan police. [SEP] during its hearing [SEP]
+
+===== sample 040 =====
+[CLS] - final appearance in london, with the french star finally beating lleyton hewitt, 6 - 6 6 - 3. [SEP] the giants went a 4 - yard run in the first quarter for a touchdown when the steelers forced a 27 - yard game to close the way back within five. [SEP] gm's chief executive, fritz henderson, said opel's factory site in the netherlands would close last night, though two people who worked on the matter were still talking on the matter. [SEP] he won five straight british titles, an average of 3. 07m when he tried to defend his title from 2000 onwards, then lost his [SEP]
+
+===== sample 041 =====
+[CLS], who was expected to turn 65 next year. [SEP] more than half of the uk population are children with autism, according to a survey of early data, published on wednesday. [SEP] ten people have been arrested and several others detained by the fbi. [SEP] although moyes has now failed to travel the right way, he has been short of inviting offers for players who lost their jobs this season. [SEP] the team are due to draw in belfast on thursday. [SEP] the rate for three to 17 years is about 40 per cent, which means the average annual cost of having these two children is £100, 000. [SEP] he brought her back to [SEP]
+
+===== sample 042 =====
+[CLS] their daughters better than their husbands, the study found. [SEP] they were each found of guilty of five counts of murder. [SEP] the dispute is an important one. [SEP] "i was at least very positive about the high performance of the performance," he said. [SEP] this is simple. [SEP] when williams had more than a point in the fourth game, and safin set up a forehand return to love, but safina bowed out in the first set on a hit - and - run forehand, then lost a match - point, the game went wide. [SEP] what makes the air - based computer safe? [SEP] even [SEP]
+
+===== sample 043 =====
+[CLS] people in at least 35 countries, was available in mid - year. [SEP] zafar mujahin, the board's chairman, said buying the stake was not an option. [SEP] 18 and was released from the hospital. [SEP] o' louis's fernando gonzalez closed the ninth with a slow - motioning walk from the first batter to open the fourth inning, taking a 14 - run lead against cincinnati in the final innings. [SEP] he said there was certainly no need for help. [SEP] new york, april 13 (upi) - - last week a oil tycoon was ordered by a u. s. bankruptcy court [SEP]
+
+===== sample 044 =====
+[CLS] institute of architecture at northwestern university and national university between 2000 and 2008. [SEP] the rockets were just 2 - 12 overall and 5 - 9 in games. [SEP] rangers' alex boyd led liverpool out of the champions league after they lost their last game with leaders manchester united in the championship game. [SEP] the man had been taken to a nearby hospital. [SEP] mr bennett, a former electrical engineer, was found dead at a window outside a flat in birmingham, in west midlands, when he was shot three times in the chest. [SEP] another survived, another man was killed in the abdomen and five others are wounded. [SEP] the park was completed by [SEP]
+
+===== sample 045 =====
+[CLS] after the fourth round of the french open on thursday, and soon finished the fourth for himself after failing to win. [SEP] 4, when the cubs could be the playoffs. [SEP] the rangers are looking to win for the third time in five games at home, and have dropped all five of the previous 10 games. [SEP] " the bodies are not dead. [SEP] the next largest middle - income family was $2, 500 for children; fourth - 800 for families; $1, 000 for couples; and $500 per family. [SEP] is there any such uncertainty to the cause of the climate? [SEP] i have seen plenty of the times [SEP]
+
+===== sample 046 =====
+[CLS] [SEP] south waziristan is widely regarded as a stronghold of the taliban - based militant group al - qaeda, which had fought al - qaeda in the area until last week. [SEP] michael's family has not been contacted with the news of the attack by his brother or his parents, or his brother andrew, but he wants to tell his mother in an early morning. [SEP] if you think there is something, or if you're a teacher, it's no longer true, it's time to tell the truth. [SEP] " it's not a matter of £100, 000 or more looking ahead of a new [SEP]
+
+===== sample 047 =====
+[CLS] narrowly lost to john o' brien, the uk's current heavyweight champion. [SEP] the increased tax increase on the way cost the city about $100 million, however, officials said. [SEP] that's a little over two percent of what i think and means everything that could be said. [SEP] the family is being advised to do so early thursday because of reports of problems in the girl's body and the results is far from being released. [SEP] it was the biggest national effort of his young life. [SEP] at least one died, said dr. peter klee, a health official at the state's department of health. [SEP]
+
+===== sample 048 =====
+[CLS] refused to give his idea of that prospect. [SEP] they last came on the way to the third largest province, the east of the country. [SEP] the 23 - year - old australian 6 - 4 saved a set point in his last - french open 7 - 0 win over nikolay davydenko, who took a six - game lead early in the second set and then the swiss matt kurret couldn't pull even a set on a crucial match point that ended the set. [SEP] he was dismissed for four, who fired home after being dropped on 149 with a stunning 61. 20 average. [SEP] the small number of people who [SEP]
+
+===== sample 049 =====
+[CLS], the nation's largest transportation expert. [SEP] for the 2008 - 8 figures, overall, 84 per cent of women said they were the most popular source of choice. [SEP] "you should be sure something's done." [SEP] the couple have been living in a state of life - threatening conditions for the past three days, according to the polk county sheriff's department, kmh - tv. [SEP] the first thing i wanted was to see if he would ever take out the rest of his prost career. [SEP] he has insisted that only he had an idea about taking place, but there's no guarantee that he [SEP]
+
+===== sample 050 =====
+[CLS] them are on a tough and "difficult course." [SEP] ian bell, england's captain, is likely to miss two weeks, because of a calf which is likely to require the match. [SEP] kevin st. paul, the acting mayor of new orleans, said people wrote about 1, 000 tickets, and 20, 000 of them came to town. [SEP] the boy's mother and daughter had moved to a new home in keene, gloucestershire, this month. [SEP] once more a man with heart disease died in 1993. [SEP] u. s. officials said tuesday's report, which came days before congress, was not [SEP]
+
+===== sample 051 =====
+[CLS], a bond. [SEP] today is the first financial year to go in which the group is expected to announce its plans for a longer and more detailed financial statement. [SEP] new york -... [SEP] and the rates were set in recent years. [SEP] and that's what it's going to do for us. [SEP] the federal space agency denied the report, saying the air probe was in its last stage of the investigation. [SEP] with a total mass of a fine of over 20 miles per hour, it is dated around 3, 000 years to 6, 000 years ago, creating the entire network of galaxies. [SEP] swiss banking [SEP]
+
+===== sample 052 =====
+[CLS]. [SEP] prof jones spent a few years at the university of wales in 2006 and was on administrative leave from 1978 to 2002. [SEP] the study in 1999 - 97, published of cancer last week, found eight children had called it "a serious, a traumatic disease," and parents had expressed fear of each other's disease because of their fear for their lives. [SEP] in fact, he came to dropping back in the tournament in the first round and suffering a nervousness. [SEP] kabul (ap) - nato forces announced a deal saturday for the funeral of five soldiers who died at the scene of a suicide attack on an afghan army [SEP]
+
+===== sample 053 =====
+[CLS] - year - old in the whack. [SEP] keselowski was intercepted by martin, and moved the ball to the 4, allowing the patriots to a turnover. [SEP] he was also injured in the team's opener against the panthers in 2005. [SEP] he was followed by his 14 - year - old son, growing up early in high school. [SEP] by contrast, about 7, 000 residents had little chance of the disease, but was protected by a large population of owls. [SEP] he noted that the north american market is only expected to be bought from the younger generation. [SEP] watson, who was among the first and seventh [SEP]
+
+===== sample 054 =====
+[CLS] proposal is expected to be published by the end of the year in the report. [SEP] it's been a very competitive match of the season in which two dads have lost by way, when nadal's tennis and justine henin lost. [SEP] last month, u. s. forces were able to take a position in the afghan taliban stronghold of al - ghazni district on the north side of the balgaz province. [SEP] the author, the son of barry young, will open his shop on the street. [SEP] a change in the effect of the term on january 30, however, will not affect the [SEP]
+
+===== sample 055 =====
+[CLS] 68th street. [SEP] new president frank gazt has ended the prospect of a disastrous victory for germany's champions league bid by putting a heartfelt smile on his face. [SEP] russia's foreign ministry was not immediately immediately available. [SEP] it was ideal for the evaluation system to assess the quality of a child's pregnancies in their work, reading, income, and e - level of education. [SEP] eight days after the attack, the school bus was attacked by four women, three boys and another woman in the car. [SEP] he said a "growing number" of children had been treated for abuse of drugs and [SEP]
+
+===== sample 056 =====
+[CLS] is hard to get it. [SEP] one can be blamed for the loss of democracy. [SEP] they interviewed some of the parents who declined to be named, saying they were not sure that the children were "under care" if they were coping with their hard work or their families. [SEP] the b - 29 flight was delayed for 24 hours and landed about 1: 35 a. m. [SEP] finally, tennessee, who won five out of their possible 10 in the first half, never led. [SEP] roger federer is the last major title winner, but he lost twice in the french open, the last time in 1998. [SEP] however, the [SEP]
+
+===== sample 057 =====
+[CLS] it 2 - 0, but gaal came to accept it at the end. [SEP] they took a 15 - point lead with 7 1/2 minutes left in the first. [SEP] after finishing the mile - - in 1: 52. 20 - - bilara captured the final lap in the sixth, with a lap of 55. 17 seconds. [SEP] what has happened in the middle of last year when election is called, the government is the last of three elected government to make it the future of higher education. [SEP] now, he might be close to explaining himself as he faces the temptation to say "no" due to a [SEP]
+
+===== sample 058 =====
+[CLS] taliban to regain control of the country's central border. [SEP] impressive but it could not have been better for redknapp, who is a regular manager, has now returned brilliantly to take advantage of his place on the bench. [SEP] so it's the right thing. [SEP] that's the eye. [SEP] ward, who earlier this season was at his best. [SEP] the safety commission, representing china's national agency, said it would review all affected products, saying it would improve the safety of all products in the recall. [SEP] but in the u. s. circuit court of appeals, the panel said the [SEP]
+
+===== sample 059 =====
+[CLS] official said. [SEP] the americans took a set 8 - 0 their way to the quarter - finals after losing just one, and lost next to the big - serving frenchman 6 - 4. [SEP] it is just too cold - - it is really very, very cold. [SEP] there were four people today, and a third said the vehicle had "collapsed." [SEP] dinara sharapova, injured by injury, lost in the women's first round. [SEP] the defending champion was in his second stop at metzen, germany. [SEP] in one of three he lost his serve after dropping him on no. 14 instead of his [SEP]
+
+===== sample 060 =====
+[CLS] feb. [SEP] the tigers repeated their losses in late 2005, 2005 and again last season, but clemson's defense was able to keep it alive. [SEP] he lost his left side, but he was in an eye for the last 45 minutes before recovering in the other crash. [SEP] england comprehensively missed a target, followed by a close wicket in the mid - afternoon, by england, and the end of an anxious afternoon, michael clarke comprehensively dropped twice in front of his wicket and the hosts tried to keep kallis at slip but it was a good bounce. [SEP] the crisis began sept. [SEP] the american, who has admitted [SEP]
+
+===== sample 061 =====
+[CLS]storting the region. [SEP] hull went on for second, but ince dived back to long - range down after taking a long clearance to play the opening minute of a second penalty attempt. [SEP] jacques duverne, an english teacher, recalls how much he had started to fall brilliantly in the morning, and how he came free from the early age of cancer. [SEP] the american moved to a third round in 2 - under 140 and fourth in the houston open to finish at 8 - under 139 along with another american. [SEP] the group, led by the jihadist al - qaida and political group in iraq, [SEP]
+
+===== sample 062 =====
+[CLS] people with pictures of relatively personal objects, such as james david, a co - writer of a book called "the battle of the city," originally published in 2008, in the international center for the health science research. [SEP] the prime minister has been forced to resign over a series of bombings and protests. [SEP] in january, a promising 21 - year - old ivory coast international arrived with an interest at stoke and offered a new deal worth £1. 25 million. [SEP] it is only over the next 12 years that the general public of the new administration believes it can afford to cut the budget deficits by 50 percent of the current total [SEP]
+
+===== sample 063 =====
+[CLS] - 3 win on the road against the philadelphia flyers - - either looking to make the finals of the regular season or expecting to be eliminated - - yielded seven goals in the last 10 minutes. [SEP] new england led the quakers (2 - 1, 0 - 1), who scored just 4. 50 points in the third quarter and moved up three points of the conference after the thrashers held off at one point in the fourth. [SEP] liverpool's goal beat liverpool by three earlier in the night, and held a four - and - a - half - 2 - 1 win win for their third straight victory. [SEP] however, the [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_temp_schedule_128steps_n64/linear_2p0_to_0p8_c1024_scored.jsonl

@@ -0,0 +1,65 @@
+{"type": "summary", "name": "linear_2p0_to_0p8_c1024", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 168000, "decode": {"kind": "categorical_fullvocab_temp_schedule", "config": "linear_2p0_to_0p8_c1024", "steps": 128, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "concentration_min": 1.0, "concentration_max": 1024.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 59.49218961431751, "nll_per_token": 4.085845036949059, "tokens": 9722}, "diversity": {"sample_entropy": 4.231511210178493, "unique_tokens": 1904, "token_count": 8192, "distinct_1": 0.232421875, "distinct_2": 0.7090305118110236, "top_token_mass": 0.051025390625}}
+{"type": "sample", "index": 0, "raw_text": "[CLS] said zarzai, who has access to jatrol. [SEP] saaka managed a superb finish from a cross from vinas sav, who then sent a deep - diving header over the bar and then fired a shot that saha tried to get back from the edge of the area. [SEP] he has done everyone on the job, a small range of supporters eager to raise their minds. [SEP] the shutout is a body blow for philadelphia, who fell to 1 - 5 this series. [SEP] arbourn would not comment about jackson ' s death directly, but was reluctant to discuss the matter. [SEP] the threat rate is [SEP]", "detok_text": "[CLS] said zarzai, who has access to jatrol. [SEP] saaka managed a superb finish from a cross from vinas sav, who then sent a deep - diving header over the bar and then fired a shot that saha tried to get back from the edge of the area. [SEP] he has done everyone on the job, a small range of supporters eager to raise their minds. [SEP] the shutout is a body blow for philadelphia, who fell to 1 - 5 this series. [SEP] arbourn would not comment about jackson's death directly, but was reluctant to discuss the matter. [SEP] the threat rate is [SEP]"}
+{"type": "sample", "index": 1, "raw_text": "[CLS] withdraw from june 7. [SEP] the women ' s title champion stopped and lost control in the second set although the former world number one had 35 points in her last six games against agbelie jan peer, who lost 6 - 0, in the fifth straight win. [SEP] mike mosley, the manager of manchester city football club, who bought liverpool third on 15 august 2008, had previously refused to comment on whether he would take over at the weekend after anfield agreed to buy the defender by succeeding him with the republic of scotland, but asked about the status of discussions. [SEP] the ministry would not say more what would be involved in [SEP]", "detok_text": "[CLS] withdraw from june 7. [SEP] the women's title champion stopped and lost control in the second set although the former world number one had 35 points in her last six games against agbelie jan peer, who lost 6 - 0, in the fifth straight win. [SEP] mike mosley, the manager of manchester city football club, who bought liverpool third on 15 august 2008, had previously refused to comment on whether he would take over at the weekend after anfield agreed to buy the defender by succeeding him with the republic of scotland, but asked about the status of discussions. [SEP] the ministry would not say more what would be involved in [SEP]"}
+{"type": "sample", "index": 2, "raw_text": "[CLS] group ' s board, said debbie miller, a general manager of the national union of government employees. [SEP] sixth - seeded williams recovered to clinch her fifth match, falling to 3 - 2 - 0 in the final three sets at 15 and had won only one set. [SEP] the french and european champions also won the opening round of the fa cup, having beaten tottenham at birmingham, while cardiff lost a point with rivals albion and then wolverhampton wanderers. [SEP] i can ' t believe for sure. [SEP] the final round wasn ' t a big deal right now, but it was a day of fun, so he won five out of the last [SEP]", "detok_text": "[CLS] group's board, said debbie miller, a general manager of the national union of government employees. [SEP] sixth - seeded williams recovered to clinch her fifth match, falling to 3 - 2 - 0 in the final three sets at 15 and had won only one set. [SEP] the french and european champions also won the opening round of the fa cup, having beaten tottenham at birmingham, while cardiff lost a point with rivals albion and then wolverhampton wanderers. [SEP] i can't believe for sure. [SEP] the final round wasn't a big deal right now, but it was a day of fun, so he won five out of the last [SEP]"}
+{"type": "sample", "index": 3, "raw_text": "[CLS] seed djokovic he held on to upset fourth - seeded roger federer no. 1 in the french open 6 - 4 6 - 3 to beat spaniard andy murray three times and a one - set lead. [SEP] it had been reported at 11. 22am. [SEP] but it was a long dream. [SEP] the u. s. military also said it was reported that four people including a militant leader were killed killed when soldiers died in an air strike in logar province. [SEP] john mccain ' s long time as presidential candidate has an overwhelming showing in both states, according to an internet research poll. [SEP] the biggest challenge, though [SEP]", "detok_text": "[CLS] seed djokovic he held on to upset fourth - seeded roger federer no. 1 in the french open 6 - 4 6 - 3 to beat spaniard andy murray three times and a one - set lead. [SEP] it had been reported at 11. 22am. [SEP] but it was a long dream. [SEP] the u. s. military also said it was reported that four people including a militant leader were killed killed when soldiers died in an air strike in logar province. [SEP] john mccain's long time as presidential candidate has an overwhelming showing in both states, according to an internet research poll. [SEP] the biggest challenge, though [SEP]"}
+{"type": "sample", "index": 4, "raw_text": "[CLS] ' s smoke away from the scene. [SEP] of the 11, 000 u. s. soldiers in afghanistan, 99. 3 percent of the 2, 000 soldiers, the ministry said. [SEP] and the present situation did not change much for the yankees, but new york yankees. [SEP] the russian ubani lost, coming up in the 11th and losing a break in the sixth - set before losing the first set of his match, before reeling off 10 kl points in the ninth. [SEP] mrs edwards, 25, was then shot in the eye shortly after hearing gunshot. [SEP] goldin, who was serving a sentence in a federal [SEP]", "detok_text": "[CLS]'s smoke away from the scene. [SEP] of the 11, 000 u. s. soldiers in afghanistan, 99. 3 percent of the 2, 000 soldiers, the ministry said. [SEP] and the present situation did not change much for the yankees, but new york yankees. [SEP] the russian ubani lost, coming up in the 11th and losing a break in the sixth - set before losing the first set of his match, before reeling off 10 kl points in the ninth. [SEP] mrs edwards, 25, was then shot in the eye shortly after hearing gunshot. [SEP] goldin, who was serving a sentence in a federal [SEP]"}
+{"type": "sample", "index": 5, "raw_text": "[CLS], though he was at the center of that saga. [SEP] it was zheng jie ' s win since venus lost 5 - 4 to go 4 - 0 in the set, before saakashvili ' s heavy win ended kuznetsova by 13 points. [SEP] after losing sweden, sweden and the fourth - seeded defending champion will play matches against serbia and estonia. [SEP] steve quinn, manchester city ' s financial chief executive, who left on monday - the former city star has been appointed chairman. [SEP] with middlesbrough now just five points behind their midlands rivals wigan, who lie fifth in the table, blackburn are seven points clear of [SEP]", "detok_text": "[CLS], though he was at the center of that saga. [SEP] it was zheng jie's win since venus lost 5 - 4 to go 4 - 0 in the set, before saakashvili's heavy win ended kuznetsova by 13 points. [SEP] after losing sweden, sweden and the fourth - seeded defending champion will play matches against serbia and estonia. [SEP] steve quinn, manchester city's financial chief executive, who left on monday - the former city star has been appointed chairman. [SEP] with middlesbrough now just five points behind their midlands rivals wigan, who lie fifth in the table, blackburn are seven points clear of [SEP]"}
+{"type": "sample", "index": 6, "raw_text": "[CLS] ' s top division. [SEP] finally, i waited until i thought i ' d be ready. [SEP] a review of its international conference, the journal of the nutrition system, is published by the company, based in columbus, ohio. [SEP] the 23 - year - old women ' s top singles player will clinch her fifth title in the aegon event later on thursday. [SEP] he is a real contender this year. [SEP] dinara safina rallied to set it 8 - 2, and lucie safina defeated the klotzlies 6 - 2 in the opening set, but the world number one dina safina of russia [SEP]", "detok_text": "[CLS]'s top division. [SEP] finally, i waited until i thought i'd be ready. [SEP] a review of its international conference, the journal of the nutrition system, is published by the company, based in columbus, ohio. [SEP] the 23 - year - old women's top singles player will clinch her fifth title in the aegon event later on thursday. [SEP] he is a real contender this year. [SEP] dinara safina rallied to set it 8 - 2, and lucie safina defeated the klotzlies 6 - 2 in the opening set, but the world number one dina safina of russia [SEP]"}
+{"type": "sample", "index": 7, "raw_text": "[CLS] 2002. [SEP] it is because for older men, they ' re starting to get over their prostate cancer. [SEP] less than one - in 10 those surveyed said only seven per cent would be confident enough, whereas 5. 1 per cent in the first half said they would have a better chance of earning in the future. [SEP] the eighth - seeded belgian, who is the third seed to win at the 2005 open after winning the event in berlin, also said she had no plans to give up her drugs following her 19 - year - old losses to serena ' s second win in the french. [SEP] the report says parents are concerned that these [SEP]", "detok_text": "[CLS] 2002. [SEP] it is because for older men, they're starting to get over their prostate cancer. [SEP] less than one - in 10 those surveyed said only seven per cent would be confident enough, whereas 5. 1 per cent in the first half said they would have a better chance of earning in the future. [SEP] the eighth - seeded belgian, who is the third seed to win at the 2005 open after winning the event in berlin, also said she had no plans to give up her drugs following her 19 - year - old losses to serena's second win in the french. [SEP] the report says parents are concerned that these [SEP]"}
+{"type": "sample", "index": 8, "raw_text": "[CLS] nothing was really clear, \" said jan. [SEP] in 2006, she was spending two weeks in singapore, earning about 3, 000 dollars per hour ( 1, 200 ) per hour a minute. [SEP] cancoal, australia, new zealand ( reuters ) - andy murray won for the third time in five matches over rafael nadal on wednesday, thrashing federer at the australian open on thursday, undefeated and runner - up joe calzaghe. [SEP] he was named boxing champion of the year as britain ' s two - time olympic champion in 1999, won his first medal at the beijing olympics last month before retiring, losing his [SEP]", "detok_text": "[CLS] nothing was really clear, \" said jan. [SEP] in 2006, she was spending two weeks in singapore, earning about 3, 000 dollars per hour (1, 200) per hour a minute. [SEP] cancoal, australia, new zealand (reuters) - andy murray won for the third time in five matches over rafael nadal on wednesday, thrashing federer at the australian open on thursday, undefeated and runner - up joe calzaghe. [SEP] he was named boxing champion of the year as britain's two - time olympic champion in 1999, won his first medal at the beijing olympics last month before retiring, losing his [SEP]"}
+{"type": "sample", "index": 9, "raw_text": "[CLS]. [SEP] police were investigating when the man was killed or possibly killed by two women on the house. [SEP] since there have not been more reliable evidence since 2000 they believe a 17 - year - old girl was deliberately raped or possibly dead. [SEP] a thoughtful, confident and thoughtful letter was said. [SEP] england ' s men will be reviewing their final reports to see if on the merits of retaining their qualification place at the current tournament. [SEP] by october, it had been estimated 1. 695 million people die by seasonal flu, while deaths were up by nearly 1 per cent, the health organization said. [SEP] that ' s not the point [SEP]", "detok_text": "[CLS]. [SEP] police were investigating when the man was killed or possibly killed by two women on the house. [SEP] since there have not been more reliable evidence since 2000 they believe a 17 - year - old girl was deliberately raped or possibly dead. [SEP] a thoughtful, confident and thoughtful letter was said. [SEP] england's men will be reviewing their final reports to see if on the merits of retaining their qualification place at the current tournament. [SEP] by october, it had been estimated 1. 695 million people die by seasonal flu, while deaths were up by nearly 1 per cent, the health organization said. [SEP] that's not the point [SEP]"}
+{"type": "sample", "index": 10, "raw_text": "[CLS] 2002. [SEP] but it is still really worth knowing who really wants to do it. \" [SEP] harsen patel has already recovered from injury and was enrolled at london - st king ' s private college at wycombe high school in canterbury, kent, on thursday. [SEP] the researchers found it difficult to determine the timing and severity of the disease associated with the treatment and diagnosis and treatment of disease. [SEP] the pakistani military said around 60 militants had died until late sunday, despite an airy warning that the army would be winning its fourth - year war against the taliban in the upper swat valley and other areas of the middle east. [SEP]", "detok_text": "[CLS] 2002. [SEP] but it is still really worth knowing who really wants to do it. \" [SEP] harsen patel has already recovered from injury and was enrolled at london - st king's private college at wycombe high school in canterbury, kent, on thursday. [SEP] the researchers found it difficult to determine the timing and severity of the disease associated with the treatment and diagnosis and treatment of disease. [SEP] the pakistani military said around 60 militants had died until late sunday, despite an airy warning that the army would be winning its fourth - year war against the taliban in the upper swat valley and other areas of the middle east. [SEP]"}
+{"type": "sample", "index": 11, "raw_text": "[CLS] t stop hearing them now. [SEP] the entire number of london ' s great western line service would be expected to be diverted to the south ' s westernmost regions, down to south africa. [SEP] former world champion australian lewis hamilton won this weekend in the us - china race, while hamilton ' s team - mate alonso lost their way in the race for the long - coveted title. [SEP] michael driver ' s anelka, who scored on sunday for barcelona and barcelona, could not set up an impressive comeback after scoring into the five - second spot, just one minute before the full break. [SEP] goldman ' s lawyers have said they [SEP]", "detok_text": "[CLS] t stop hearing them now. [SEP] the entire number of london's great western line service would be expected to be diverted to the south's westernmost regions, down to south africa. [SEP] former world champion australian lewis hamilton won this weekend in the us - china race, while hamilton's team - mate alonso lost their way in the race for the long - coveted title. [SEP] michael driver's anelka, who scored on sunday for barcelona and barcelona, could not set up an impressive comeback after scoring into the five - second spot, just one minute before the full break. [SEP] goldman's lawyers have said they [SEP]"}
+{"type": "sample", "index": 12, "raw_text": "[CLS] was diagnosed in 2002, but refused to live. [SEP] the leading pro - obama movement say 200, 000 people have headed to the polls. [SEP] the fourth - round australian will face david galbs of france and the fourth - ranked federer, who will repeat the title of 2007, but has yet to win at the u. s. open. [SEP] nalbandian lost four of the last eight match before he retired in the ninth - hour, when he lost a semi - final match against belgian nikolay davydenko of russia and vaslav garejcak, the u. s. open champion, was [SEP]", "detok_text": "[CLS] was diagnosed in 2002, but refused to live. [SEP] the leading pro - obama movement say 200, 000 people have headed to the polls. [SEP] the fourth - round australian will face david galbs of france and the fourth - ranked federer, who will repeat the title of 2007, but has yet to win at the u. s. open. [SEP] nalbandian lost four of the last eight match before he retired in the ninth - hour, when he lost a semi - final match against belgian nikolay davydenko of russia and vaslav garejcak, the u. s. open champion, was [SEP]"}
+{"type": "sample", "index": 13, "raw_text": "[CLS] wrong, \" said michael holwell. [SEP] safin next faces jelena ivanovic of serbia, who is a winner of the french open title for the french open, but djokovic failed to serve for the match, beating seventh seed tort isner of the united states to take the set. [SEP] the study of 1, 000 children between four and five began in the 2004 and 2006 tests. [SEP] you can use the javelin train from amsterdam ( 0077 71778 677 ) from new york city. [SEP] in 2001, swedish teenager louise aruba was told that her father had been sexually raped and [SEP]", "detok_text": "[CLS] wrong, \" said michael holwell. [SEP] safin next faces jelena ivanovic of serbia, who is a winner of the french open title for the french open, but djokovic failed to serve for the match, beating seventh seed tort isner of the united states to take the set. [SEP] the study of 1, 000 children between four and five began in the 2004 and 2006 tests. [SEP] you can use the javelin train from amsterdam (0077 71778 677) from new york city. [SEP] in 2001, swedish teenager louise aruba was told that her father had been sexually raped and [SEP]"}
+{"type": "sample", "index": 14, "raw_text": "[CLS] said. [SEP] the soldiers and marines still make up about a third of the u. s. army and u. s. forces. [SEP] he said he couldn ' t get out of his way, particularly by the government ' s safety record. [SEP] she was attacked by four teens. [SEP] at the time, she had returned to the tournament after losing the 2002 french open and the belgian open cup title last year, but then lost the french open - - and the winning frenchman in basra - - 6 - 1, while fourth - seeded agassi withdrew from the french open final in paris on sunday after losing 15 matches at [SEP]", "detok_text": "[CLS] said. [SEP] the soldiers and marines still make up about a third of the u. s. army and u. s. forces. [SEP] he said he couldn't get out of his way, particularly by the government's safety record. [SEP] she was attacked by four teens. [SEP] at the time, she had returned to the tournament after losing the 2002 french open and the belgian open cup title last year, but then lost the french open - - and the winning frenchman in basra - - 6 - 1, while fourth - seeded agassi withdrew from the french open final in paris on sunday after losing 15 matches at [SEP]"}
+{"type": "sample", "index": 15, "raw_text": "[CLS] 7488771, 877778 743177778, 768777777, 747987317877 or b. 2 ( 703 749777, www. co. uk - telephones. org. uk ). £10, 657, 940 euros ). [SEP] but mourinho ' s findings were public at the final shortly after the match. [SEP] federer had won 11 - 3, 6 - 6 - 2 on the night, and had set point from a 3 - 0 deficit for the fourth victory [SEP]", "detok_text": "[CLS] 7488771, 877778 743177778, 768777777, 747987317877 or b. 2 (703 749777, www. co. uk - telephones. org. uk). £10, 657, 940 euros ). [SEP] but mourinho's findings were public at the final shortly after the match. [SEP] federer had won 11 - 3, 6 - 6 - 2 on the night, and had set point from a 3 - 0 deficit for the fourth victory [SEP]"}
+{"type": "sample", "index": 16, "raw_text": "[CLS] war that killed roughly 130, 000 people there in early 2009. [SEP] i have never questioned myself. [SEP] the full morning news will be broadcast on to the newsline at 1900 bst on 6 october. [SEP] he took the lead on the start of the round. [SEP] it would take a long time before ferguson understood that he had lost contact with hughes, his twin brother and liverpool ' s captain. [SEP] the assessment of losses of events at the time of the study is based largely on 2006 and 2008 - 09. [SEP] jeff freuer, a 6 - foot - 3 - year - old belgian athlete who lives in washington, [SEP]", "detok_text": "[CLS] war that killed roughly 130, 000 people there in early 2009. [SEP] i have never questioned myself. [SEP] the full morning news will be broadcast on to the newsline at 1900 bst on 6 october. [SEP] he took the lead on the start of the round. [SEP] it would take a long time before ferguson understood that he had lost contact with hughes, his twin brother and liverpool's captain. [SEP] the assessment of losses of events at the time of the study is based largely on 2006 and 2008 - 09. [SEP] jeff freuer, a 6 - foot - 3 - year - old belgian athlete who lives in washington, [SEP]"}
+{"type": "sample", "index": 17, "raw_text": "[CLS] 500, 000 - plus jobs at the bristol - manchester airport, which would leave a 200 - dollar airline footprint on the global network and risk factors underpinning profits. [SEP] the women who lost their pounds were a rationale - grader and have waited for months trying to get a better one, too. [SEP] \" my parents don ' t know how to put me all into my own, \" she said, noting that she rarely worked without a side injury. [SEP] ofgem said the plan would raise £20m a year in costs and warned ordinary people could be forced to pay even more bonuses. [SEP] new york - [SEP]", "detok_text": "[CLS] 500, 000 - plus jobs at the bristol - manchester airport, which would leave a 200 - dollar airline footprint on the global network and risk factors underpinning profits. [SEP] the women who lost their pounds were a rationale - grader and have waited for months trying to get a better one, too. [SEP] \"my parents don't know how to put me all into my own,\" she said, noting that she rarely worked without a side injury. [SEP] ofgem said the plan would raise £20m a year in costs and warned ordinary people could be forced to pay even more bonuses. [SEP] new york - [SEP]"}
+{"type": "sample", "index": 18, "raw_text": "[CLS] here on sunday. [SEP] but the dollar suffered a bit of a break, and it ' s traded up $ 1. 90 a barrel. [SEP] pique was an important role at liverpool, and again last season and at arsenal and arsenal ' s home stadium. [SEP] when he was originally discharged from cancer, his home office changed his name and he said he looked ill when he was in a maternity unit in a private hospital in north of scotland. [SEP] the gunners have won the last seven games and had held off a 2 - 1 deficit to the gunners before the league title in 1999 but they then lost it all after failing to finish [SEP]", "detok_text": "[CLS] here on sunday. [SEP] but the dollar suffered a bit of a break, and it's traded up $1. 90 a barrel. [SEP] pique was an important role at liverpool, and again last season and at arsenal and arsenal's home stadium. [SEP] when he was originally discharged from cancer, his home office changed his name and he said he looked ill when he was in a maternity unit in a private hospital in north of scotland. [SEP] the gunners have won the last seven games and had held off a 2 - 1 deficit to the gunners before the league title in 1999 but they then lost it all after failing to finish [SEP]"}
+{"type": "sample", "index": 19, "raw_text": "[CLS] dec. [SEP] nakamura twice finished in the second but the home side punished novo for the cross by curling it over the goal line. [SEP] but in 2 hours, williams and quarter - finalist tim petzsters also lost at the french open, before the us open made break - point errors to end a 6 - 0 3 - 0 loss. [SEP] but no one, god, doesn ' t know my name, \" he said, adding that he was scared when he climbed above his car and got his bike through the nets, and was forced to rest on the floor. [SEP] portland, maine, july 14 ( upi ) - [SEP]", "detok_text": "[CLS] dec. [SEP] nakamura twice finished in the second but the home side punished novo for the cross by curling it over the goal line. [SEP] but in 2 hours, williams and quarter - finalist tim petzsters also lost at the french open, before the us open made break - point errors to end a 6 - 0 3 - 0 loss. [SEP] but no one, god, doesn't know my name, \" he said, adding that he was scared when he climbed above his car and got his bike through the nets, and was forced to rest on the floor. [SEP] portland, maine, july 14 (upi) - [SEP]"}
+{"type": "sample", "index": 20, "raw_text": "[CLS] wife, judith, had left her son on his own. [SEP] indiana ( 2, 1 - 0 in big 12 ) never lost without top - seeded johnson, who were the top - ranked team in last year ' s ncaa tournament after ranked second buckeyes. [SEP] this is a complicated game, for me. [SEP] then then go to bed and jump into a new world. [SEP] not necessarily good, but not really scary. [SEP] since then, they lost to 1 - 2 after two innings, most in the ninth. [SEP] \" around 40 percent of the entire population live in the uk but it is only 2, 500 miles [SEP]", "detok_text": "[CLS] wife, judith, had left her son on his own. [SEP] indiana (2, 1 - 0 in big 12) never lost without top - seeded johnson, who were the top - ranked team in last year's ncaa tournament after ranked second buckeyes. [SEP] this is a complicated game, for me. [SEP] then then go to bed and jump into a new world. [SEP] not necessarily good, but not really scary. [SEP] since then, they lost to 1 - 2 after two innings, most in the ninth. [SEP] \" around 40 percent of the entire population live in the uk but it is only 2, 500 miles [SEP]"}
+{"type": "sample", "index": 21, "raw_text": "[CLS]. [SEP] third seed number 16, had survived the straight set to become the first russian champion and went 5 - 0 with a break in the first set. [SEP] she lost her ability to serve and got two championship points in both, but then held serve until the start of the year. [SEP] the quake left 34 people killed, among them 20 young children. [SEP] at st., third - ranked florida state is 24 - 0 against no. 9 florida state ( 7 - 2 overall, 10 - 1 big 12 ). [SEP] last year ' s ruling party called on the national elections to seat parliament, a special high - profile initiative [SEP]", "detok_text": "[CLS]. [SEP] third seed number 16, had survived the straight set to become the first russian champion and went 5 - 0 with a break in the first set. [SEP] she lost her ability to serve and got two championship points in both, but then held serve until the start of the year. [SEP] the quake left 34 people killed, among them 20 young children. [SEP] at st., third - ranked florida state is 24 - 0 against no. 9 florida state (7 - 2 overall, 10 - 1 big 12). [SEP] last year's ruling party called on the national elections to seat parliament, a special high - profile initiative [SEP]"}
+{"type": "sample", "index": 22, "raw_text": "[CLS] concerns over its risks. [SEP] that ' s the part of a story you ' re trying to achieve. [SEP] the fourth seed put up five consecutive set points in the set on his opening serve in the eighth game but federer held back to then won the first point of the second set and lost it 0 - 6. [SEP] much progress have not been made yet. [SEP] it is now more a dream than a reality, but jonesly believes that there will be no value at his present level. [SEP] kalua himself has been living there more than 16 times previously. [SEP] she raised her arms and looked down at her husband after being [SEP]", "detok_text": "[CLS] concerns over its risks. [SEP] that's the part of a story you're trying to achieve. [SEP] the fourth seed put up five consecutive set points in the set on his opening serve in the eighth game but federer held back to then won the first point of the second set and lost it 0 - 6. [SEP] much progress have not been made yet. [SEP] it is now more a dream than a reality, but jonesly believes that there will be no value at his present level. [SEP] kalua himself has been living there more than 16 times previously. [SEP] she raised her arms and looked down at her husband after being [SEP]"}
+{"type": "sample", "index": 23, "raw_text": "[CLS] report. [SEP] a us health spokeswoman said 297 cases were confirmed in 22 states, connecticut, massachusetts, massachusetts, georgia, massachusetts and georgia. [SEP] gm ' s main interest has been negotiating with creditors, the paper said. [SEP] chicago woman ubuntu was killed during a hospital ceremony saturday after the death of her 17 - year - old son cost her about $ 500, 000 weekly, prosecutors said. [SEP] in the second set, he broke the advantage and went down big - serving djokovic, 3 - 1, with the next seed breaking but was struggling in the fourth. [SEP] there are a new york times [SEP]", "detok_text": "[CLS] report. [SEP] a us health spokeswoman said 297 cases were confirmed in 22 states, connecticut, massachusetts, massachusetts, georgia, massachusetts and georgia. [SEP] gm's main interest has been negotiating with creditors, the paper said. [SEP] chicago woman ubuntu was killed during a hospital ceremony saturday after the death of her 17 - year - old son cost her about $500, 000 weekly, prosecutors said. [SEP] in the second set, he broke the advantage and went down big - serving djokovic, 3 - 1, with the next seed breaking but was struggling in the fourth. [SEP] there are a new york times [SEP]"}
+{"type": "sample", "index": 24, "raw_text": "[CLS] country. [SEP] this figure meant about 10, 000 - plus post offices across the country have had 24 hours already closed since mr brown ' s resignation last spring. [SEP] humar mahmood, 52, a former army air chief in afghanistan and head of the army, was on a flight to russia on saturday night. [SEP] we finished ninth in the start of the tournament and have not suffered from a similar problem in the last two weeks. [SEP] the visitors forward equalised after 17 minutes when james wood headed across fulham ' s starting line - up after having a good chance to win his header by a minute. [SEP] many of the [SEP]", "detok_text": "[CLS] country. [SEP] this figure meant about 10, 000 - plus post offices across the country have had 24 hours already closed since mr brown's resignation last spring. [SEP] humar mahmood, 52, a former army air chief in afghanistan and head of the army, was on a flight to russia on saturday night. [SEP] we finished ninth in the start of the tournament and have not suffered from a similar problem in the last two weeks. [SEP] the visitors forward equalised after 17 minutes when james wood headed across fulham's starting line - up after having a good chance to win his header by a minute. [SEP] many of the [SEP]"}
+{"type": "sample", "index": 25, "raw_text": "[CLS] - 5, 2 - 0 and venus lost 2 - 2 - 6 and 5 - 1, losing 6 - 2. [SEP] now that ' s a possibility, but numbers aren ' t enough. [SEP] \" it ' s quite easy to think, \" she said. [SEP] raich, the world championship no. 1 toyota no. 1, ahead of saeed saeeda 7. 0, was about 2. 7 seconds off a quick restart, but finished fourth in his 0. 75 - second time of 73. 8 seconds for fifth at the grand grand prix on saturday. [SEP] as we look to the future, the american [SEP]", "detok_text": "[CLS] - 5, 2 - 0 and venus lost 2 - 2 - 6 and 5 - 1, losing 6 - 2. [SEP] now that's a possibility, but numbers aren't enough. [SEP] \"it's quite easy to think,\" she said. [SEP] raich, the world championship no. 1 toyota no. 1, ahead of saeed saeeda 7. 0, was about 2. 7 seconds off a quick restart, but finished fourth in his 0. 75 - second time of 73. 8 seconds for fifth at the grand grand prix on saturday. [SEP] as we look to the future, the american [SEP]"}
+{"type": "sample", "index": 26, "raw_text": "[CLS] at a range of prices. [SEP] roger federer will defend his men ' s title at the weekend when he beat his second - place foe roger federer in the sony ericsson masters on monday. [SEP] shops have been closed in the area and shops had been closed altogether. [SEP] the slovaks ended the match, handing down all three points to the hosts, who fell only three points ahead. [SEP] the eighth - seeded no. 1 lost two - - and three set but saved set points in the third before losing the match in the set before losing the set 3 - 4. [SEP] the company offers a number of innovative products for the consumer [SEP]", "detok_text": "[CLS] at a range of prices. [SEP] roger federer will defend his men's title at the weekend when he beat his second - place foe roger federer in the sony ericsson masters on monday. [SEP] shops have been closed in the area and shops had been closed altogether. [SEP] the slovaks ended the match, handing down all three points to the hosts, who fell only three points ahead. [SEP] the eighth - seeded no. 1 lost two - - and three set but saved set points in the third before losing the match in the set before losing the set 3 - 4. [SEP] the company offers a number of innovative products for the consumer [SEP]"}
+{"type": "sample", "index": 27, "raw_text": "[CLS] vote in the same time since she was first re - elected just 18 months ago. [SEP] the qatar - born player arrived by the club monday to a five - year extension of nine years as part of a deal that will be worth the club, the newspaper said. [SEP] safin williams, who failed twice to win first, beat jevonareva 7 - 6 and no. 5 serena williams, captured the us open earlier this year and australian open champion, saved eight break points before winning 6 - 4 6 - 2, 7 - 6, 6 - 3 on sunday. [SEP] that goal could be tricky if both sides support a [SEP]", "detok_text": "[CLS] vote in the same time since she was first re - elected just 18 months ago. [SEP] the qatar - born player arrived by the club monday to a five - year extension of nine years as part of a deal that will be worth the club, the newspaper said. [SEP] safin williams, who failed twice to win first, beat jevonareva 7 - 6 and no. 5 serena williams, captured the us open earlier this year and australian open champion, saved eight break points before winning 6 - 4 6 - 2, 7 - 6, 6 - 3 on sunday. [SEP] that goal could be tricky if both sides support a [SEP]"}
+{"type": "sample", "index": 28, "raw_text": "[CLS] office in october, what appear to be a serious development appears to be its head start. [SEP] but it isn ' t like the right thing. [SEP] kevin keegan and joe hart, who have been replaced by fellow skipper andrew flintoff and full - time centre ben davies, will now become a part of cardiff ' s international squad after his controversial debut from middlesbrough. [SEP] firefighters battled fire fighters in the rugged mountains as a wild blaze early sunday destroyed over 400 acres of central area forest and destroyed entire houses along the city ' s northern california coast. [SEP] at this year ' s end of fashion week, protesters fought a row to save [SEP]", "detok_text": "[CLS] office in october, what appear to be a serious development appears to be its head start. [SEP] but it isn't like the right thing. [SEP] kevin keegan and joe hart, who have been replaced by fellow skipper andrew flintoff and full - time centre ben davies, will now become a part of cardiff's international squad after his controversial debut from middlesbrough. [SEP] firefighters battled fire fighters in the rugged mountains as a wild blaze early sunday destroyed over 400 acres of central area forest and destroyed entire houses along the city's northern california coast. [SEP] at this year's end of fashion week, protesters fought a row to save [SEP]"}
+{"type": "sample", "index": 29, "raw_text": "[CLS] s & 100 down was down 1. 1 and france ' s cac - 40 was 0. 3 per cent lower at 5, 400 ; the dax closed down 1. 0 points. [SEP] the side lost four more and then trailed 1 - 2, england, who led by 29, lost their last five wickets and should be beaten by a further 40 - run deficit with just eight minutes to play. [SEP] ge suffered just one of its three financial losses last year, including $ 2. 3 billion worth of losses from the company ' s healthcare division arm, according to london - based business intelligence firm creditsights, the analyst [SEP]", "detok_text": "[CLS] s & 100 down was down 1. 1 and france's cac - 40 was 0. 3 per cent lower at 5, 400; the dax closed down 1. 0 points. [SEP] the side lost four more and then trailed 1 - 2, england, who led by 29, lost their last five wickets and should be beaten by a further 40 - run deficit with just eight minutes to play. [SEP] ge suffered just one of its three financial losses last year, including $2. 3 billion worth of losses from the company's healthcare division arm, according to london - based business intelligence firm creditsights, the analyst [SEP]"}
+{"type": "sample", "index": 30, "raw_text": "[CLS] had lost only five of his games and was then lucky twice sunday to win as many set points. [SEP] there were no questions about the fate of 15, 000 people hospitalized over the past five years, up to 35 percent of the population. [SEP] why won ' t the green party go???? [SEP] the winner will meet fifth seed albert montanes, of spain, against fellow daniel gulschl of austria, the sixth seed, and daniel gajzay, 28, of russia, 7 - 2 7 - 5 in the season - ending french open tournament. [SEP] when the series ends we will play a game [SEP]", "detok_text": "[CLS] had lost only five of his games and was then lucky twice sunday to win as many set points. [SEP] there were no questions about the fate of 15, 000 people hospitalized over the past five years, up to 35 percent of the population. [SEP] why won't the green party go???? [SEP] the winner will meet fifth seed albert montanes, of spain, against fellow daniel gulschl of austria, the sixth seed, and daniel gajzay, 28, of russia, 7 - 2 7 - 5 in the season - ending french open tournament. [SEP] when the series ends we will play a game [SEP]"}
+{"type": "sample", "index": 31, "raw_text": "[CLS] 8. 9 million ( $ 9. 65 ) in tax aid. [SEP] the report, which looked at the journal of health, said he had had to have improvements in his health not to stop the disease. [SEP] belgium ' s robin haase, who also reached the first round of the grand slam event in 2005, is now struggling to recover from a back injury. [SEP] roger nadal was a winner of the australian grand slams in 2006, in 1996 and june 2004. [SEP] the panthers ' s recovery from an upset start in the 1970s and 1980s, falling 4 - 2 and finishing with a 69 - 62 victory. [SEP] the [SEP]", "detok_text": "[CLS] 8. 9 million ($9. 65) in tax aid. [SEP] the report, which looked at the journal of health, said he had had to have improvements in his health not to stop the disease. [SEP] belgium's robin haase, who also reached the first round of the grand slam event in 2005, is now struggling to recover from a back injury. [SEP] roger nadal was a winner of the australian grand slams in 2006, in 1996 and june 2004. [SEP] the panthers's recovery from an upset start in the 1970s and 1980s, falling 4 - 2 and finishing with a 69 - 62 victory. [SEP] the [SEP]"}
+{"type": "sample", "index": 32, "raw_text": "[CLS] mccain ' s name at the web address of fox news news - - though no one understood whether he would do so. [SEP] the day i was diagnosed, i think that i ' m wearing my military uniform and that when i ' ll get up, i ' m going to play today. [SEP] i had to try to get away, \" said mr griffiths. [SEP] the deal will see a resolution of the issues that have gset the current structure, and will have no chance of being done, \" said joseph bozet, the european union ' s secretary - general. [SEP] the united nations was also involved, refused to confirm [SEP]", "detok_text": "[CLS] mccain's name at the web address of fox news news - - though no one understood whether he would do so. [SEP] the day i was diagnosed, i think that i'm wearing my military uniform and that when i'll get up, i'm going to play today. [SEP] i had to try to get away, \"said mr griffiths. [SEP] the deal will see a resolution of the issues that have gset the current structure, and will have no chance of being done,\" said joseph bozet, the european union's secretary - general. [SEP] the united nations was also involved, refused to confirm [SEP]"}
+{"type": "sample", "index": 33, "raw_text": "[CLS]. [SEP] union representatives said yesterday that they had no comment about kraft ' s position, but said the situation would not be affected. [SEP] the swiss star, the 2007 u. s. open winner by three points after their opening loss in sixth and final set, battled to five points, 25 - 0, 21 - 6, 21 - 10 and then held the first set points to share early points with france ' s nicolas gaerter 65th. [SEP] as england slumped to the brink of mid - wicket in the final over their side added 139 to leave them ahead on 139. [SEP] a fourth over and anderson, with their first [SEP]", "detok_text": "[CLS]. [SEP] union representatives said yesterday that they had no comment about kraft's position, but said the situation would not be affected. [SEP] the swiss star, the 2007 u. s. open winner by three points after their opening loss in sixth and final set, battled to five points, 25 - 0, 21 - 6, 21 - 10 and then held the first set points to share early points with france's nicolas gaerter 65th. [SEP] as england slumped to the brink of mid - wicket in the final over their side added 139 to leave them ahead on 139. [SEP] a fourth over and anderson, with their first [SEP]"}
+{"type": "sample", "index": 34, "raw_text": "[CLS] said. [SEP] new york city at pittsburgh, 9 p. m. [SEP] bmw ag, the german - based manufacturer, was the best performing sector, with renault off 1. 3 per cent to € 1. 50. [SEP] the jaguars needed just one yard of pennington ' s drive, and scored on a 35 - yard pass by taylor to settle for a field goal for a quick five - point lead. [SEP] since august 2007, the government has lost the battle, mostly as a bastion of the taliban stronghold of nangarhar in helmand province. [SEP] the court heard a guilty plea from a swiss prosecutor who had lost a [SEP]", "detok_text": "[CLS] said. [SEP] new york city at pittsburgh, 9 p. m. [SEP] bmw ag, the german - based manufacturer, was the best performing sector, with renault off 1. 3 per cent to € 1. 50. [SEP] the jaguars needed just one yard of pennington's drive, and scored on a 35 - yard pass by taylor to settle for a field goal for a quick five - point lead. [SEP] since august 2007, the government has lost the battle, mostly as a bastion of the taliban stronghold of nangarhar in helmand province. [SEP] the court heard a guilty plea from a swiss prosecutor who had lost a [SEP]"}
+{"type": "sample", "index": 35, "raw_text": "[CLS] for italy ' s pontifical college of public health. [SEP] the majority of those who are on medicare were forced to leave their pensions because of a vote on the age of medicare. [SEP] the consultation hearing to open a school for children is due to go on until saturday. [SEP] the chancellor is believed to have warned tory mps about the war. [SEP] \" yesterday ' s good news started to come about in the uk. [SEP] there is a growing number of illegal workers seeking compensation. [SEP] \" south africa is difficult to get to, it ' s inevitable, \" he added. [SEP] what should have happened, she says, is that taxes and [SEP]", "detok_text": "[CLS] for italy's pontifical college of public health. [SEP] the majority of those who are on medicare were forced to leave their pensions because of a vote on the age of medicare. [SEP] the consultation hearing to open a school for children is due to go on until saturday. [SEP] the chancellor is believed to have warned tory mps about the war. [SEP] \"yesterday's good news started to come about in the uk. [SEP] there is a growing number of illegal workers seeking compensation. [SEP]\" south africa is difficult to get to, it's inevitable, \" he added. [SEP] what should have happened, she says, is that taxes and [SEP]"}
+{"type": "sample", "index": 36, "raw_text": "[CLS] on the field for tuesday night ' s final defeat at ninth - ranked pittsburgh. [SEP] manning and tom smith were thrown for 109 yards. [SEP] i was terrified that he would try to tell himself so much, but i ' d only heard within a few weeks of a losing battle. [SEP] ( ap ) - - andy murray ' s kim clijsters lost a place in the women ' s fed singles men ' s singles match on monday when czech radek sawanska defeated american richard serra and jelena jankovic fought back control. [SEP] lopez, a big selection in chicago, was drafted in no. 6 early in a season [SEP]", "detok_text": "[CLS] on the field for tuesday night's final defeat at ninth - ranked pittsburgh. [SEP] manning and tom smith were thrown for 109 yards. [SEP] i was terrified that he would try to tell himself so much, but i'd only heard within a few weeks of a losing battle. [SEP] (ap) - - andy murray's kim clijsters lost a place in the women's fed singles men's singles match on monday when czech radek sawanska defeated american richard serra and jelena jankovic fought back control. [SEP] lopez, a big selection in chicago, was drafted in no. 6 early in a season [SEP]"}
+{"type": "sample", "index": 37, "raw_text": "[CLS] said. [SEP] david brancain and frederic kaletik were levelling at the end of the deciding draw, which they scored 4 - 2 in the 29th minute as they fought back for a draw finish to a very important sixth match. [SEP] on thursday of the attack, four gunmen fired at a building that police described as a \" bastion of total control \" of the population, the police said. [SEP] the fda says the 50 - patient study found 10, 000 out of about 2, 000 patients had died from hiv - 1 disease. [SEP] \" and i had just said ' as you know, i never want a woman on [SEP]", "detok_text": "[CLS] said. [SEP] david brancain and frederic kaletik were levelling at the end of the deciding draw, which they scored 4 - 2 in the 29th minute as they fought back for a draw finish to a very important sixth match. [SEP] on thursday of the attack, four gunmen fired at a building that police described as a \"bastion of total control\" of the population, the police said. [SEP] the fda says the 50 - patient study found 10, 000 out of about 2, 000 patients had died from hiv - 1 disease. [SEP] \" and i had just said' as you know, i never want a woman on [SEP]"}
+{"type": "sample", "index": 38, "raw_text": "[CLS] contract closed up 0. 8 to 5. 30 dollars. [SEP] another risk that most older patients will die at the age of 65, is that those who are unseposed - - a diagnosis of depression - - can experience a high likelihood of symptoms of early disease as well as the likelihood of serious illness and medical history. [SEP] yet federer is in fine form, having only won two grand slam berths since paris in 2003, but he has put heart - strings into his bid to improve his bounce back from last year and to lose his crucial match at wimbledon. [SEP] he trailed 5 - 6, 6 - 0, but was [SEP]", "detok_text": "[CLS] contract closed up 0. 8 to 5. 30 dollars. [SEP] another risk that most older patients will die at the age of 65, is that those who are unseposed - - a diagnosis of depression - - can experience a high likelihood of symptoms of early disease as well as the likelihood of serious illness and medical history. [SEP] yet federer is in fine form, having only won two grand slam berths since paris in 2003, but he has put heart - strings into his bid to improve his bounce back from last year and to lose his crucial match at wimbledon. [SEP] he trailed 5 - 6, 6 - 0, but was [SEP]"}
+{"type": "sample", "index": 39, "raw_text": "[CLS] third consecutive singles championship by winning 5 - 0 6 - 0 thursday. [SEP] london ( reuters ) - first - time fa cup side ramsey will be given his best chance at west ham ' s visit to sunderland on saturday after the last four hours to see the young scotsman lead england to win the 2010 european cup. [SEP] walch, who has won the gn championships in stuttgart and played three times, finished second in the slalom and downhill, fourth in the slalom at the tour de france, in austria where he takes on the overall title sunday. [SEP] dr. michael klein, an scripe disease center at vanderbilt university in [SEP]", "detok_text": "[CLS] third consecutive singles championship by winning 5 - 0 6 - 0 thursday. [SEP] london (reuters) - first - time fa cup side ramsey will be given his best chance at west ham's visit to sunderland on saturday after the last four hours to see the young scotsman lead england to win the 2010 european cup. [SEP] walch, who has won the gn championships in stuttgart and played three times, finished second in the slalom and downhill, fourth in the slalom at the tour de france, in austria where he takes on the overall title sunday. [SEP] dr. michael klein, an scripe disease center at vanderbilt university in [SEP]"}
+{"type": "sample", "index": 40, "raw_text": "[CLS] crime. [SEP] you would begin to make your own choice, to contemplate or not to write. [SEP] \" we were excited about the job and i remember the work. [SEP] the company has a total workforce of about 20, 000 staff, and will axe 100 jobs this week. [SEP] then he came up with his second act of late, getting caught at the lancashire side on 35 for four, but clarke resumed with another ball after being caught at 13 - 1. [SEP] less than 80 percent of the participants undergoing tests had either disease or cancer detected, or at an early age, while only some half were positive. [SEP] but [SEP]", "detok_text": "[CLS] crime. [SEP] you would begin to make your own choice, to contemplate or not to write. [SEP] \" we were excited about the job and i remember the work. [SEP] the company has a total workforce of about 20, 000 staff, and will axe 100 jobs this week. [SEP] then he came up with his second act of late, getting caught at the lancashire side on 35 for four, but clarke resumed with another ball after being caught at 13 - 1. [SEP] less than 80 percent of the participants undergoing tests had either disease or cancer detected, or at an early age, while only some half were positive. [SEP] but [SEP]"}
+{"type": "sample", "index": 41, "raw_text": "[CLS] council of the deal and asked for public support. [SEP] the england striker three minutes later went on to look close to scoring a goal early in the ninth minute after scoring just with a second left. [SEP] for him, the second - wicket captain struck an early century for five before lunch as england were dismissed for 27, seven runs short of a county record of winning their sixth twenty20 cup match. [SEP] ryanair, tel : 0845 600 8320 ; based at www. unitedholalteamjet. com ; £71 ( 087 698 489 ; france : £7 ( 0 ) 7277 625 [SEP]", "detok_text": "[CLS] council of the deal and asked for public support. [SEP] the england striker three minutes later went on to look close to scoring a goal early in the ninth minute after scoring just with a second left. [SEP] for him, the second - wicket captain struck an early century for five before lunch as england were dismissed for 27, seven runs short of a county record of winning their sixth twenty20 cup match. [SEP] ryanair, tel: 0845 600 8320; based at www. unitedholalteamjet. com; £71 ( 087 698 489; france: £7 (0) 7277 625 [SEP]"}
+{"type": "sample", "index": 42, "raw_text": "[CLS] more cell phones in their lives, the researchers said. [SEP] it would, however, the impact of the recession would be felt. [SEP] merkele, 62, was born in august 1940, the age of 50 berlin, under the supervision of a german crown, the times said. [SEP] seed serena williams won the match three sets - - against fourth - seeded makhaya dinara safina, dinara safina seeded fifth, against belgian elena dementis, and 12th seed dinara safina 7 - 5 6 - 3 6 - 4. [SEP] what a bunch of wh ' s. [SEP] \" [SEP]", "detok_text": "[CLS] more cell phones in their lives, the researchers said. [SEP] it would, however, the impact of the recession would be felt. [SEP] merkele, 62, was born in august 1940, the age of 50 berlin, under the supervision of a german crown, the times said. [SEP] seed serena williams won the match three sets - - against fourth - seeded makhaya dinara safina, dinara safina seeded fifth, against belgian elena dementis, and 12th seed dinara safina 7 - 5 6 - 3 6 - 4. [SEP] what a bunch of wh's. [SEP] \" [SEP]"}
+{"type": "sample", "index": 43, "raw_text": "[CLS] their final opponents. [SEP] williams was the williams ' second - year, then lost to the season ' s no. 1 player - - and she tied a franchise record. [SEP] in the air, it might be a lot, but you ' ve got much more dangerous than the jets. [SEP] the americans opened at halftime and martin schaefer scored with a second - minute shot from goal. [SEP] ( cnn ) - - swiss defending champion roger federer earned his first points from behind on his final break. [SEP] the fourth sixth seed lost before making his debut final, having slumped to 3 - 2 in the australian open, 3 - 6 [SEP]", "detok_text": "[CLS] their final opponents. [SEP] williams was the williams' second - year, then lost to the season's no. 1 player - - and she tied a franchise record. [SEP] in the air, it might be a lot, but you've got much more dangerous than the jets. [SEP] the americans opened at halftime and martin schaefer scored with a second - minute shot from goal. [SEP] (cnn) - - swiss defending champion roger federer earned his first points from behind on his final break. [SEP] the fourth sixth seed lost before making his debut final, having slumped to 3 - 2 in the australian open, 3 - 6 [SEP]"}
+{"type": "sample", "index": 44, "raw_text": "[CLS] around 8 per cent of the total population of about 350, and 12, 000 people in eastern europe and the rest of germany, denmark, denmark and sweden. [SEP] the first was in 2002 at the refugee camp north of goma town, which has nearly 2, 200 displaced children. [SEP] she has spent five years studying her political career. [SEP] they make that so improbable you can make decisions by buying at a steep discount. [SEP] the new party members will be asked to vote first on the power issues in the country ' s electoral system. [SEP] he ' d see if he needed to play.... [SEP] [SEP]", "detok_text": "[CLS] around 8 per cent of the total population of about 350, and 12, 000 people in eastern europe and the rest of germany, denmark, denmark and sweden. [SEP] the first was in 2002 at the refugee camp north of goma town, which has nearly 2, 200 displaced children. [SEP] she has spent five years studying her political career. [SEP] they make that so improbable you can make decisions by buying at a steep discount. [SEP] the new party members will be asked to vote first on the power issues in the country's electoral system. [SEP] he'd see if he needed to play.... [SEP] [SEP]"}
+{"type": "sample", "index": 45, "raw_text": "[CLS] 2008 elections. [SEP] lunch on the sunday afternoon, go to a beach. [SEP] 12 - 18 september 2008 on 19, 0709 5877. webcasts of the call. telepresourcing and conference call replays. available at http : / / www. img. com. + 1 1 1 8782 68877. ( 0 ) 7578 7194 917. www. consumermoreit. com. £8. 50. 1. 7578 7586, + 1. 1 50775. [SEP] i used to focus on the brand [SEP]", "detok_text": "[CLS] 2008 elections. [SEP] lunch on the sunday afternoon, go to a beach. [SEP] 12 - 18 september 2008 on 19, 0709 5877. webcasts of the call. telepresourcing and conference call replays. available at http://www. img. com. + 1 1 1 8782 68877. (0) 7578 7194 917. www. consumermoreit. com. £8. 50. 1. 7578 7586, + 1. 1 50775. [SEP] i used to focus on the brand [SEP]"}
+{"type": "sample", "index": 46, "raw_text": "[CLS] in south waziristan, close to the law district of waziristan and the swat valley region, close to the taliban - held region in pakistan along the border. [SEP] men ' s finalist roger federer rallied champion richard haase from a 2 - 3 opening set loss to move up to a final against fifth - seed nicolas ginepr in the early morning. [SEP] mattie died on 2 june, 2001 and 2003, and lived as a teacher at a school in west sussex. [SEP] news shifted from northern khost province up to marjah and kabul, in the helmand region where six people died in an [SEP]", "detok_text": "[CLS] in south waziristan, close to the law district of waziristan and the swat valley region, close to the taliban - held region in pakistan along the border. [SEP] men's finalist roger federer rallied champion richard haase from a 2 - 3 opening set loss to move up to a final against fifth - seed nicolas ginepr in the early morning. [SEP] mattie died on 2 june, 2001 and 2003, and lived as a teacher at a school in west sussex. [SEP] news shifted from northern khost province up to marjah and kabul, in the helmand region where six people died in an [SEP]"}
+{"type": "sample", "index": 47, "raw_text": "[CLS] been forced to close its british gas and insurance operations. [SEP] however, you could do plenty of vigorous walking on the way of work and will likely require a bit of air time under the sun. [SEP] it would have a significant impact on our businesses, \" strogdals said. [SEP] the british seed worked his way back to victory when federer claimed his first defence of a title with his sixth ace in the second, hitting four straight, finishing past nadal at the end of his first serve. [SEP] at least one people, including children, marines have killed 13 militants in a volatile afghan district and five others believed dead. [SEP]", "detok_text": "[CLS] been forced to close its british gas and insurance operations. [SEP] however, you could do plenty of vigorous walking on the way of work and will likely require a bit of air time under the sun. [SEP] it would have a significant impact on our businesses, \" strogdals said. [SEP] the british seed worked his way back to victory when federer claimed his first defence of a title with his sixth ace in the second, hitting four straight, finishing past nadal at the end of his first serve. [SEP] at least one people, including children, marines have killed 13 militants in a volatile afghan district and five others believed dead. [SEP]"}
+{"type": "sample", "index": 48, "raw_text": "[CLS] appeared to keep their composure after the ravens took a grip on the conference. [SEP] \" the economy is good, \" said centre - back tom beckford. [SEP] the cabinet meeting set to be held on sunday. [SEP] jacksonville ( 16 - 16, 5 - 11 southeastern conference ) allowed the blue devils a close score after a stingy start in the second quarter. [SEP] california coach matt leinart can ' t help but hope that england can shake out of their disappointments. [SEP] boa employs about 50, 000 people worldwide and expects to close the loss after a € 7. 5 billion loss in september. [SEP] however, the [SEP]", "detok_text": "[CLS] appeared to keep their composure after the ravens took a grip on the conference. [SEP] \"the economy is good,\" said centre - back tom beckford. [SEP] the cabinet meeting set to be held on sunday. [SEP] jacksonville (16 - 16, 5 - 11 southeastern conference) allowed the blue devils a close score after a stingy start in the second quarter. [SEP] california coach matt leinart can't help but hope that england can shake out of their disappointments. [SEP] boa employs about 50, 000 people worldwide and expects to close the loss after a € 7. 5 billion loss in september. [SEP] however, the [SEP]"}
+{"type": "sample", "index": 49, "raw_text": "[CLS], with total losses being around 60 %. [SEP] if house prices increase by 2011, then around 75 per cent of their pay will be paid back by the new government. [SEP] the record was published by a jury in july. [SEP] newcastle ' s 3 - 2 win at west bromwich albion on thursday night for the first time in seven days marked the collapse of the fa cup as they failed to win the championship with a first loss. [SEP] a man has killed six soldiers and his son were killed when a car bomber detonated at a checkpoint in the southern town of sangin, police said. [SEP] but there ' s no reason someone would [SEP]", "detok_text": "[CLS], with total losses being around 60 %. [SEP] if house prices increase by 2011, then around 75 per cent of their pay will be paid back by the new government. [SEP] the record was published by a jury in july. [SEP] newcastle's 3 - 2 win at west bromwich albion on thursday night for the first time in seven days marked the collapse of the fa cup as they failed to win the championship with a first loss. [SEP] a man has killed six soldiers and his son were killed when a car bomber detonated at a checkpoint in the southern town of sangin, police said. [SEP] but there's no reason someone would [SEP]"}
+{"type": "sample", "index": 50, "raw_text": "[CLS] $ 800 million worth of job losses last year, but analysts warn that the economy ' s losing performance, in one or two years, will not be better than last year as the crisis in the economy weakens. [SEP] anne coughlin of independence, mo., lost her son at home and killed and joseph jr., 35, lost her daughter. [SEP] south korean financial group klocateur also plans a $ 8. 7 million ( £72 million ) takeover offer for india ' s largest operator, billiton ltd. [SEP] the sfa ' s executive director, trevor rees, was speaking at a national conference [SEP]", "detok_text": "[CLS] $800 million worth of job losses last year, but analysts warn that the economy's losing performance, in one or two years, will not be better than last year as the crisis in the economy weakens. [SEP] anne coughlin of independence, mo., lost her son at home and killed and joseph jr., 35, lost her daughter. [SEP] south korean financial group klocateur also plans a $8. 7 million (£72 million) takeover offer for india's largest operator, billiton ltd. [SEP] the sfa's executive director, trevor rees, was speaking at a national conference [SEP]"}
+{"type": "sample", "index": 51, "raw_text": "[CLS], she said. [SEP] he told reuters earlier this year he planned to spend about $ 200 million in more than a year, if necessary, with each salary, which would worth about $ 2. 5 million dollars a year. [SEP] the early data left the dow ' s 6. 5 points higher at 8, 543. 68, the paris - based french cac - 40 edged 0. 4 percent lower at 9, 690. 53, france ' s cac - 40 closed up 7. 15 to 4, 764. 30 and germany ' s dax lost 3. 30 points to 690. 2. [SEP] while russia [SEP]", "detok_text": "[CLS], she said. [SEP] he told reuters earlier this year he planned to spend about $200 million in more than a year, if necessary, with each salary, which would worth about $2. 5 million dollars a year. [SEP] the early data left the dow's 6. 5 points higher at 8, 543. 68, the paris - based french cac - 40 edged 0. 4 percent lower at 9, 690. 53, france's cac - 40 closed up 7. 15 to 4, 764. 30 and germany's dax lost 3. 30 points to 690. 2. [SEP] while russia [SEP]"}
+{"type": "sample", "index": 52, "raw_text": "[CLS] rising above 15 per cent in 2006 and from about 10 per cent in 2006, while unemployment remained unchanged at 27 per cent. [SEP] sunderland have been able to keep their first - half lead in the fa cup final on saturday when they have already lost 2 - 0 at their home in nine games. [SEP] in other words, she ' s not flexing her muscles or her muscles. [SEP] nick heldy has turned his back on the image of the king ' s champion and put his nearly 14 - place crown ahead of lewis hamilton, the grand british champion, who won in paris in 2001 at the british grand national. [SEP] \" [SEP]", "detok_text": "[CLS] rising above 15 per cent in 2006 and from about 10 per cent in 2006, while unemployment remained unchanged at 27 per cent. [SEP] sunderland have been able to keep their first - half lead in the fa cup final on saturday when they have already lost 2 - 0 at their home in nine games. [SEP] in other words, she's not flexing her muscles or her muscles. [SEP] nick heldy has turned his back on the image of the king's champion and put his nearly 14 - place crown ahead of lewis hamilton, the grand british champion, who won in paris in 2001 at the british grand national. [SEP] \" [SEP]"}
+{"type": "sample", "index": 53, "raw_text": "[CLS] from a costly war on the wmds. [SEP] in 1936 he was captured in germany, and he quickly moved to the netherlands in 1975, eventually settling in germany. [SEP] williams also, back at the french open, took a surprise break in the third set when defending champion dementieva lost the second set to open up three points behind when henin lost 5 - 3. [SEP] in install edition of the adaptation of alfred sefkin ' s epic book, he tells the story of the popular german novelist and writer jan unsandi. [SEP] they still have a very good time to the game, and [SEP]", "detok_text": "[CLS] from a costly war on the wmds. [SEP] in 1936 he was captured in germany, and he quickly moved to the netherlands in 1975, eventually settling in germany. [SEP] williams also, back at the french open, took a surprise break in the third set when defending champion dementieva lost the second set to open up three points behind when henin lost 5 - 3. [SEP] in install edition of the adaptation of alfred sefkin's epic book, he tells the story of the popular german novelist and writer jan unsandi. [SEP] they still have a very good time to the game, and [SEP]"}
+{"type": "sample", "index": 54, "raw_text": "[CLS] meeting review of the european council is expected at half - time of its meeting on thursday. [SEP] third - seeded nadal plays 10th - seeded rafael nadal, seeded 15th in men ' s tournament in italy. [SEP] no, it wants to work. [SEP] anyone with any information in the area is being asked to contact officers in the bristol area at about 2000 gmt on saturday, police said. [SEP] how could anyone see it off? [SEP] vice - president vladimir solovkov, 56, who will abandon his cabinet after resigning thursday, defended nato ' s decision to leave his post last week after a review of operations, stood down [SEP]", "detok_text": "[CLS] meeting review of the european council is expected at half - time of its meeting on thursday. [SEP] third - seeded nadal plays 10th - seeded rafael nadal, seeded 15th in men's tournament in italy. [SEP] no, it wants to work. [SEP] anyone with any information in the area is being asked to contact officers in the bristol area at about 2000 gmt on saturday, police said. [SEP] how could anyone see it off? [SEP] vice - president vladimir solovkov, 56, who will abandon his cabinet after resigning thursday, defended nato's decision to leave his post last week after a review of operations, stood down [SEP]"}
+{"type": "sample", "index": 55, "raw_text": "[CLS] for the leader. [SEP] lyon, who needed only 17 games left to make the final four of the league ' s record seven games, produced a superb 54th - minute header from a corner which rangel missed on the face of a goalmouth after belgian side ziemanz and daniel harm were forced out of the match. [SEP] \" in today ' s sangin district, the taliban - led forces have begun to withdraw 10 soldiers from the pakistani capital, \" lt. gen. mohammad habib, a spokesman for the army division of helmand province, said. [SEP] a new study found that the high rate of lung cancer [SEP]", "detok_text": "[CLS] for the leader. [SEP] lyon, who needed only 17 games left to make the final four of the league's record seven games, produced a superb 54th - minute header from a corner which rangel missed on the face of a goalmouth after belgian side ziemanz and daniel harm were forced out of the match. [SEP] \"in today's sangin district, the taliban - led forces have begun to withdraw 10 soldiers from the pakistani capital,\" lt. gen. mohammad habib, a spokesman for the army division of helmand province, said. [SEP] a new study found that the high rate of lung cancer [SEP]"}
+{"type": "sample", "index": 56, "raw_text": "[CLS] much more needed information and analysis, \" he said. [SEP] fernando torres departed for the spanish side thrashing cup leaders barcelona and adebayor benzema last night as it became revealed young striker fernando torres is unlikely to stay with the club for the second of 12 seasons. [SEP] the lowest price for a private hotel is just $ 850 per person, august ' s $ 2, 675, the price of $ 1, 659 per person, including breakfasts, the standard hotel costs at $ 925 per person and £1, 850 per person. [SEP] today phil lamb, the conservative leader for hodge hill, was questioned about [SEP]", "detok_text": "[CLS] much more needed information and analysis, \" he said. [SEP] fernando torres departed for the spanish side thrashing cup leaders barcelona and adebayor benzema last night as it became revealed young striker fernando torres is unlikely to stay with the club for the second of 12 seasons. [SEP] the lowest price for a private hotel is just $850 per person, august's $2, 675, the price of $1, 659 per person, including breakfasts, the standard hotel costs at $925 per person and £1, 850 per person. [SEP] today phil lamb, the conservative leader for hodge hill, was questioned about [SEP]"}
+{"type": "sample", "index": 57, "raw_text": "[CLS] the central and western uruzar province, 25 miles to the north and the wanst district of the afghan capital and largest city joined the taliban forces in mid - 2006. [SEP] eastgate, the european champions, made to the uefa cup semis by winning their bid for an eighth division with a 3 - 0 victory over anfield on tuesday. [SEP] japanese prime minister taro aso, who was due to host a summit government meeting on monday, called for a fresh position on the global recovery, with the support of his own obama administration. [SEP] \" no, no longer, trying to save myself, \" she said. [SEP]", "detok_text": "[CLS] the central and western uruzar province, 25 miles to the north and the wanst district of the afghan capital and largest city joined the taliban forces in mid - 2006. [SEP] eastgate, the european champions, made to the uefa cup semis by winning their bid for an eighth division with a 3 - 0 victory over anfield on tuesday. [SEP] japanese prime minister taro aso, who was due to host a summit government meeting on monday, called for a fresh position on the global recovery, with the support of his own obama administration. [SEP] \"no, no longer, trying to save myself,\" she said. [SEP]"}
+{"type": "sample", "index": 58, "raw_text": "[CLS] action based on the results of georgia ' s democratic elections. [SEP] but germany ' s tommy haas, who beat france ' s chardy yesterday at the french open, lost 6 - 1 7 to federer and the world no 2 lost to federer at the u. s. open open. [SEP] j. w. hexilein ' s lawsuit earlier this week, which has been published extensively on wall street, revealed her husband ' s widow, contacted by her publisher, the baltimore sun, founded the information society, an independent agency in san francisco. [SEP] but, the u. s. military considered the fight just one of the biggest [SEP]", "detok_text": "[CLS] action based on the results of georgia's democratic elections. [SEP] but germany's tommy haas, who beat france's chardy yesterday at the french open, lost 6 - 1 7 to federer and the world no 2 lost to federer at the u. s. open open. [SEP] j. w. hexilein's lawsuit earlier this week, which has been published extensively on wall street, revealed her husband's widow, contacted by her publisher, the baltimore sun, founded the information society, an independent agency in san francisco. [SEP] but, the u. s. military considered the fight just one of the biggest [SEP]"}
+{"type": "sample", "index": 59, "raw_text": "[CLS] beginning in the 1970s. [SEP] spokesman for the u. s. military said the soldier who received his post had been arrested. [SEP] however, the idea of a happy, milky way out of house is pretty similar - - you may have a little better time off putting it out before the day or you won ' t get to \" cover your face. \" [SEP] mahsud abdul jameel, 54, was famous for his father ' s help after allegedly assaulting his young daughter more than 30 years ago. [SEP] last year, more than one in three people diagnosed with early stage prostate cancer. [SEP] for the whole of this [SEP]", "detok_text": "[CLS] beginning in the 1970s. [SEP] spokesman for the u. s. military said the soldier who received his post had been arrested. [SEP] however, the idea of a happy, milky way out of house is pretty similar - - you may have a little better time off putting it out before the day or you won't get to \"cover your face.\" [SEP] mahsud abdul jameel, 54, was famous for his father's help after allegedly assaulting his young daughter more than 30 years ago. [SEP] last year, more than one in three people diagnosed with early stage prostate cancer. [SEP] for the whole of this [SEP]"}
+{"type": "sample", "index": 60, "raw_text": "[CLS] tuesday. [SEP] the tigers reached their zenith in the first half, and held off early behind by clemson ' s jon parbler to keep it close. [SEP] but isner soon took control of his serve, piling 11 of the opening set before knocking on the other frenchman. [SEP] serena had reached that point for the fifth time at the australian open but had williams losing five - set points and compiling a 5 - 0 record in 64 games against the swiss. [SEP] italy coach claudio bocciassi refused to talk about his decision, saying he was a good, more defensive player than he needed. [SEP] the bleak news for consumer confidence [SEP]", "detok_text": "[CLS] tuesday. [SEP] the tigers reached their zenith in the first half, and held off early behind by clemson's jon parbler to keep it close. [SEP] but isner soon took control of his serve, piling 11 of the opening set before knocking on the other frenchman. [SEP] serena had reached that point for the fifth time at the australian open but had williams losing five - set points and compiling a 5 - 0 record in 64 games against the swiss. [SEP] italy coach claudio bocciassi refused to talk about his decision, saying he was a good, more defensive player than he needed. [SEP] the bleak news for consumer confidence [SEP]"}
+{"type": "sample", "index": 61, "raw_text": "[CLS]. [SEP] the 28 - year - old, who is to represent england in this month ' s tournament event he hopes for a place in switzerland, could face roger federer in the 2008 - 09. [SEP] dr. joan johnson, an nhs psychiatrist, said the new guidelines could not be helpful to people with high - risk insurance. [SEP] byrd was tied at three under 139 going into the final round with a three - under 66, but had three birdies in the final holes and shot a 8 - under 65 for the fifth hole. [SEP] the study was commissioned by the government ' s environment survey. [SEP] the report was carried by the [SEP]", "detok_text": "[CLS]. [SEP] the 28 - year - old, who is to represent england in this month's tournament event he hopes for a place in switzerland, could face roger federer in the 2008 - 09. [SEP] dr. joan johnson, an nhs psychiatrist, said the new guidelines could not be helpful to people with high - risk insurance. [SEP] byrd was tied at three under 139 going into the final round with a three - under 66, but had three birdies in the final holes and shot a 8 - under 65 for the fifth hole. [SEP] the study was commissioned by the government's environment survey. [SEP] the report was carried by the [SEP]"}
+{"type": "sample", "index": 62, "raw_text": "[CLS] market, volvo, europe ' s nation ' s largest manufacturer of luxury sports lightbutd cars in the united states. [SEP] the taliban fighting has displaced 25, 500 troops and killed over 1, 000 soldiers in the capital kabul and nearly 25, 000 troops in a daily series of bombings and insurgent attacks, an international commission said tuesday. [SEP] the impetlingly incomped and painful denials of torture, dr fayed ' s allegations and, still, it will. [SEP] half - time keeper philipp degen charged at the break level when dutch defender john holeheim scurried to make the breakthrough. [SEP]", "detok_text": "[CLS] market, volvo, europe's nation's largest manufacturer of luxury sports lightbutd cars in the united states. [SEP] the taliban fighting has displaced 25, 500 troops and killed over 1, 000 soldiers in the capital kabul and nearly 25, 000 troops in a daily series of bombings and insurgent attacks, an international commission said tuesday. [SEP] the impetlingly incomped and painful denials of torture, dr fayed's allegations and, still, it will. [SEP] half - time keeper philipp degen charged at the break level when dutch defender john holeheim scurried to make the breakthrough. [SEP]"}
+{"type": "sample", "index": 63, "raw_text": "[CLS], benfica ' s joja casillas, put liverpool ahead with his second - half penalty. [SEP] all three were injured and two were taken to ipswich hospital when they were aged 30. [SEP] in an initial survey by china ' s seng markets on thursday, the industrial index were 4, 450. 72 points lower at 3, 068. 20, or 0. 54 percent. [SEP] they narrowly lost 5 - 0 final last season when they lost their early challengers in the champions league - they progressed through to the european cup and uefa cup. [SEP] i get much from the rest of us and from the media, the [SEP]", "detok_text": "[CLS], benfica's joja casillas, put liverpool ahead with his second - half penalty. [SEP] all three were injured and two were taken to ipswich hospital when they were aged 30. [SEP] in an initial survey by china's seng markets on thursday, the industrial index were 4, 450. 72 points lower at 3, 068. 20, or 0. 54 percent. [SEP] they narrowly lost 5 - 0 final last season when they lost their early challengers in the champions league - they progressed through to the european cup and uefa cup. [SEP] i get much from the rest of us and from the media, the [SEP]"}

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_latest_temp_schedule_128steps_n64/linear_2p0_to_1p0_c256_scored.jsonl

@@ -0,0 +1,65 @@
+{"type": "summary", "name": "linear_2p0_to_1p0_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/latest.pt", "step": 168000, "decode": {"kind": "categorical_fullvocab_temp_schedule", "config": "linear_2p0_to_1p0_c256", "steps": 128, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "temp_start": 2.0, "temp_end": 1.0, "temp_schedule": "linear", "concentration_min": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 57.89282886876284, "nll_per_token": 4.058593523173776, "tokens": 9687}, "diversity": {"sample_entropy": 4.230719319713245, "unique_tokens": 1950, "token_count": 8192, "distinct_1": 0.238037109375, "distinct_2": 0.7317913385826772, "top_token_mass": 0.0478515625}}
+{"type": "sample", "index": 0, "raw_text": "[CLS] hospital trust in london and royal lancaster infirmary in 2006 and 2006. [SEP] \" i don ' t know what i think about roger and what i was trying to get people to control him, \" said the bank of england international. [SEP] de niro had just two days of balloting on sunday. [SEP] in five of the worst - hit provinces, people were evacuated or forced from leaving their homes. [SEP] cincinnati fell two behind in the fifth before the jets lost 4 - 0 in first - place buffalo. [SEP] replacements : g, m, b - m silva, s kabo, a robinho, s welbeck, c [SEP]", "detok_text": "[CLS] hospital trust in london and royal lancaster infirmary in 2006 and 2006. [SEP] \"i don't know what i think about roger and what i was trying to get people to control him,\" said the bank of england international. [SEP] de niro had just two days of balloting on sunday. [SEP] in five of the worst - hit provinces, people were evacuated or forced from leaving their homes. [SEP] cincinnati fell two behind in the fifth before the jets lost 4 - 0 in first - place buffalo. [SEP] replacements: g, m, b - m silva, s kabo, a robinho, s welbeck, c [SEP]"}
+{"type": "sample", "index": 1, "raw_text": "[CLS] clegg said. [SEP] he said he still needs his money in america. [SEP] while \" democrats and independents were likely more likely to support obama, though far more conservative, likely democratic republicans, and much more conservative democrats were more likely to see a competitive presidential election, \" said democratic strategist peter schock told reporters traveling to washington. [SEP] and if i haven ' t got a bad decision then i ' m talking to my coaches and i ' ve got some worry about the kind of that was really making it, \" he said in his television interview. [SEP] the company would not say when it might be published in [SEP]", "detok_text": "[CLS] clegg said. [SEP] he said he still needs his money in america. [SEP] while \"democrats and independents were likely more likely to support obama, though far more conservative, likely democratic republicans, and much more conservative democrats were more likely to see a competitive presidential election,\" said democratic strategist peter schock told reporters traveling to washington. [SEP] and if i haven't got a bad decision then i'm talking to my coaches and i've got some worry about the kind of that was really making it, \" he said in his television interview. [SEP] the company would not say when it might be published in [SEP]"}
+{"type": "sample", "index": 2, "raw_text": "[CLS] and the northwest section of the road was owned by the railway society. [SEP] the french open challenge kicks off on wednesday. [SEP] at the foul line, the hoers led 66 - 62 with 3 minutes left, but by the big ten made just two free throws. [SEP] chelsea had scored less than liverpool ' s nicolas anelka - - who could face a further penalty award at one point - - and lost a deep goal - down. [SEP] i can ' t pay your taxes back for the time - my wife made a lot of money and i can pay more now. [SEP] in december 1997, 2005 and in august 2002, [SEP]", "detok_text": "[CLS] and the northwest section of the road was owned by the railway society. [SEP] the french open challenge kicks off on wednesday. [SEP] at the foul line, the hoers led 66 - 62 with 3 minutes left, but by the big ten made just two free throws. [SEP] chelsea had scored less than liverpool's nicolas anelka - - who could face a further penalty award at one point - - and lost a deep goal - down. [SEP] i can't pay your taxes back for the time - my wife made a lot of money and i can pay more now. [SEP] in december 1997, 2005 and in august 2002, [SEP]"}
+{"type": "sample", "index": 3, "raw_text": "[CLS] wealth management and wealth management have expected to reduce rates by cutting off international travel. [SEP] the tigers were the no. 5 seed overall, losing to cincinnati ( 1 - 0 ) and downing top - seeded no. 1 georgia, 2 - 0 tuesday. [SEP] while liverpool dropped two points from the draw at half time, hull ' s lee bowyer fired bravely off a corner, but the six - point goal of substitute nicolas anelka supplected off villa ' s shot free kick in the 27th minute after the norwegian cleared the blue line. [SEP] the human health watch could have been used to determine which predeter [SEP]", "detok_text": "[CLS] wealth management and wealth management have expected to reduce rates by cutting off international travel. [SEP] the tigers were the no. 5 seed overall, losing to cincinnati (1 - 0) and downing top - seeded no. 1 georgia, 2 - 0 tuesday. [SEP] while liverpool dropped two points from the draw at half time, hull's lee bowyer fired bravely off a corner, but the six - point goal of substitute nicolas anelka supplected off villa's shot free kick in the 27th minute after the norwegian cleared the blue line. [SEP] the human health watch could have been used to determine which predeter [SEP]"}
+{"type": "sample", "index": 4, "raw_text": "[CLS]. s. citizens of darfur and other allied countries, \" the u. s. military said. [SEP] a judge stayed ahead of the case brought by the supreme court with the court ruling that the court system did not go in with the decision, saying the defendants dropped the counts. [SEP] while 75 percent of men with prostate cancer are considered free of a severe disease, about 4 percent of adults in those countries experienced increases with prostate cancer shortly after the first stage of the study was followed, the researchers said. [SEP] the police later found several traces of his property, it said. [SEP] in fact, why do you run a small [SEP]", "detok_text": "[CLS]. s. citizens of darfur and other allied countries, \" the u. s. military said. [SEP] a judge stayed ahead of the case brought by the supreme court with the court ruling that the court system did not go in with the decision, saying the defendants dropped the counts. [SEP] while 75 percent of men with prostate cancer are considered free of a severe disease, about 4 percent of adults in those countries experienced increases with prostate cancer shortly after the first stage of the study was followed, the researchers said. [SEP] the police later found several traces of his property, it said. [SEP] in fact, why do you run a small [SEP]"}
+{"type": "sample", "index": 5, "raw_text": "[CLS]o ' s death. [SEP] german leaders hamburg will finish their season at dundee united while burnley host manchester city on wednesday, while liverpool will face second division rivals birmingham, to finish at half - time, and marseilles and marseille face sunderland on sunday and manchester city. [SEP] tomorrow ' s eastern athletic conference 17 out - rebounded teams will play back to purdue, georgia and vanderbilt in advance of the season ' s semifinals. [SEP] the result was a 25 - 0 lead during the opening - day tournament. [SEP] with only eight half - games left, liverpool have three points of safety in the premier league, and have lost four league games [SEP]", "detok_text": "[CLS]o's death. [SEP] german leaders hamburg will finish their season at dundee united while burnley host manchester city on wednesday, while liverpool will face second division rivals birmingham, to finish at half - time, and marseilles and marseille face sunderland on sunday and manchester city. [SEP] tomorrow's eastern athletic conference 17 out - rebounded teams will play back to purdue, georgia and vanderbilt in advance of the season's semifinals. [SEP] the result was a 25 - 0 lead during the opening - day tournament. [SEP] with only eight half - games left, liverpool have three points of safety in the premier league, and have lost four league games [SEP]"}
+{"type": "sample", "index": 6, "raw_text": "[CLS]. m., 73 ; germany, sweden, 71 ; finland, 73 ; england, 71 ; canada 75, 74 ; germany, 74 ; britain, israel 75, 73 ; britain, 73, 73 ; france, 76. [SEP] gl : ( aus ) 16 - 8 oustreet 27 - 20 - 4 hantuchova crashed out of israel, 16 - 14 7 - 7, 20 - 6 ( 7 ), 25 - 25 - 7 dementieva of russia. - - 6 - 2 over former world number one justine henin. [SEP] \" there ' s no need to change their call for [SEP]", "detok_text": "[CLS]. m., 73; germany, sweden, 71; finland, 73; england, 71; canada 75, 74; germany, 74; britain, israel 75, 73; britain, 73, 73; france, 76. [SEP] gl: (aus) 16 - 8 oustreet 27 - 20 - 4 hantuchova crashed out of israel, 16 - 14 7 - 7, 20 - 6 (7), 25 - 25 - 7 dementieva of russia. - - 6 - 2 over former world number one justine henin. [SEP] \" there's no need to change their call for [SEP]"}
+{"type": "sample", "index": 7, "raw_text": "[CLS] jaffling of the british media is part of brown ' s responsibility to prove in the british election. [SEP] chief executive edf also rejected sarkozy ' s request to resign in july. [SEP] the combined division of umbro, the world ' s second second - largest retailer, is worth close to 90 percent of the company ' s shares, and is in the future, according to a industry source. [SEP] in the top table, sir alex ferguson ' s side dropped from their points held by city ' s 2 - 0 defeat against stoke united on sunday. [SEP] \" alcord ( r ) patients were obese ages [SEP]", "detok_text": "[CLS] jaffling of the british media is part of brown's responsibility to prove in the british election. [SEP] chief executive edf also rejected sarkozy's request to resign in july. [SEP] the combined division of umbro, the world's second second - largest retailer, is worth close to 90 percent of the company's shares, and is in the future, according to a industry source. [SEP] in the top table, sir alex ferguson's side dropped from their points held by city's 2 - 0 defeat against stoke united on sunday. [SEP] \" alcord (r) patients were obese ages [SEP]"}
+{"type": "sample", "index": 8, "raw_text": "[CLS] south west of england on sunday and saturday. [SEP] murray suffered a bad scare after testing positive in the first round but this year ' s australian lost his second - round appearance in his first match. [SEP] i found an english father who just was overweight and was just about 40 years old. [SEP] the british fighter was almost certain to see whether hatton can fight for the ibf title along with their near - certainty, joe calzaghe, saying he was prepared to fight for the title. [SEP] i worked hard for 10 years. [SEP] police have said people ' s bodies appeared to be found in the area, including three [SEP]", "detok_text": "[CLS] south west of england on sunday and saturday. [SEP] murray suffered a bad scare after testing positive in the first round but this year's australian lost his second - round appearance in his first match. [SEP] i found an english father who just was overweight and was just about 40 years old. [SEP] the british fighter was almost certain to see whether hatton can fight for the ibf title along with their near - certainty, joe calzaghe, saying he was prepared to fight for the title. [SEP] i worked hard for 10 years. [SEP] police have said people's bodies appeared to be found in the area, including three [SEP]"}
+{"type": "sample", "index": 9, "raw_text": "[CLS]. [SEP] police said he was found with serious head injuries at about 1500 bst on 10 october. [SEP] until recently, it was so hard that the yankees have had been losing $ 1, 000 annually on the health and insurance costs. [SEP] it is a new species, \" he said. [SEP] it ' s an intriguing, if not just one - sided idea, it ' s good, bad news. [SEP] nokia, the finnish mobile phone group, reported sales for the fourth quarter down 11. 4 per cent and full - year sales of 2. 1 per cent, or 25. 1 per cent, in its fourth quarter, [SEP]", "detok_text": "[CLS]. [SEP] police said he was found with serious head injuries at about 1500 bst on 10 october. [SEP] until recently, it was so hard that the yankees have had been losing $1, 000 annually on the health and insurance costs. [SEP] it is a new species, \" he said. [SEP] it's an intriguing, if not just one - sided idea, it's good, bad news. [SEP] nokia, the finnish mobile phone group, reported sales for the fourth quarter down 11. 4 per cent and full - year sales of 2. 1 per cent, or 25. 1 per cent, in its fourth quarter, [SEP]"}
+{"type": "sample", "index": 10, "raw_text": "[CLS] elderly women after being diagnosed with prostate disease will be more less prone to \" stress. \" [SEP] a 15 - year - old boy who fatally stabbed his mother at one of the city ' s busiest subway and rail lines remained released on thursday, officials said. [SEP] she had won the highest number of titles since 2004 when ninth seed olivier cornet of france upset third - seeded fourth seed williams 6 - 2, and german timea schl went up 7 - 1, beating justine henin - 7, 6 - 6, 6 6 - 3. [SEP] he has faced the difficult prospect of asking for at least £6, 000. [SEP]", "detok_text": "[CLS] elderly women after being diagnosed with prostate disease will be more less prone to \"stress.\" [SEP] a 15 - year - old boy who fatally stabbed his mother at one of the city's busiest subway and rail lines remained released on thursday, officials said. [SEP] she had won the highest number of titles since 2004 when ninth seed olivier cornet of france upset third - seeded fourth seed williams 6 - 2, and german timea schl went up 7 - 1, beating justine henin - 7, 6 - 6, 6 6 - 3. [SEP] he has faced the difficult prospect of asking for at least £6, 000. [SEP]"}
+{"type": "sample", "index": 11, "raw_text": "[CLS] not to save people from losing their homes or mortgages. [SEP] republicans are building a congressional majority in congress after they began to rescind versions of legislation in 2008. [SEP] it finished with five wickets, and clarke ' s final three was his first success. [SEP] woods made a bogeyie on the final hole and shot three birdies in his second round after winning his second round in green, but the young tiger held up for his victory. [SEP] just last week, his campaign began by almost midnight to 9 a. m. [SEP] 15, so that the conference at mid - pacific, just a little less interesting, might [SEP]", "detok_text": "[CLS] not to save people from losing their homes or mortgages. [SEP] republicans are building a congressional majority in congress after they began to rescind versions of legislation in 2008. [SEP] it finished with five wickets, and clarke's final three was his first success. [SEP] woods made a bogeyie on the final hole and shot three birdies in his second round after winning his second round in green, but the young tiger held up for his victory. [SEP] just last week, his campaign began by almost midnight to 9 a. m. [SEP] 15, so that the conference at mid - pacific, just a little less interesting, might [SEP]"}
+{"type": "sample", "index": 12, "raw_text": "[CLS] said he was not telling them when to leave. [SEP] they are currently 23 points behind. [SEP] french league leaders racing lyon snatched three points from lyon as marseille beat de lavalas seven five minutes in the hour when liverpool and ryan babel fired a home goal near the foot of the net on the hour to win 2 - 1 in the semis. [SEP] the french open winner has been expected to drop a place on the world ' s top 10 since june. [SEP] but he does not know how much time he has, only to a more fast - paced second set. [SEP] but, with the skepticism, he decided that he had [SEP]", "detok_text": "[CLS] said he was not telling them when to leave. [SEP] they are currently 23 points behind. [SEP] french league leaders racing lyon snatched three points from lyon as marseille beat de lavalas seven five minutes in the hour when liverpool and ryan babel fired a home goal near the foot of the net on the hour to win 2 - 1 in the semis. [SEP] the french open winner has been expected to drop a place on the world's top 10 since june. [SEP] but he does not know how much time he has, only to a more fast - paced second set. [SEP] but, with the skepticism, he decided that he had [SEP]"}
+{"type": "sample", "index": 13, "raw_text": "[CLS] before they get into school, officials said. [SEP] persson, who founded newsweek in 1962, was a journalist with a history of combating the internet and promoting a successful online website. [SEP] australian film star david toms makes one of just a film and stars a sequel. [SEP] but they do get less. [SEP] the national rate for the rate of unemployment rolled back from high before the recession started - - 5. 2 percent. [SEP] arsenal ' s fa eduardo bounced back after 23 years to win their first uefa cup and was dismissed in a 4 - 2 win by tottenham at the emirates stadium. [SEP] mrs leach was initially referred to [SEP]", "detok_text": "[CLS] before they get into school, officials said. [SEP] persson, who founded newsweek in 1962, was a journalist with a history of combating the internet and promoting a successful online website. [SEP] australian film star david toms makes one of just a film and stars a sequel. [SEP] but they do get less. [SEP] the national rate for the rate of unemployment rolled back from high before the recession started - - 5. 2 percent. [SEP] arsenal's fa eduardo bounced back after 23 years to win their first uefa cup and was dismissed in a 4 - 2 win by tottenham at the emirates stadium. [SEP] mrs leach was initially referred to [SEP]"}
+{"type": "sample", "index": 14, "raw_text": "[CLS] said. [SEP] andy roddick federer and roger federer reached the quarterfinals in the third round as no. 15 seed when they beat roger federer again in the quarterfinals. [SEP] villa deservedly claimed the game, in which parra ' s superb effort from the right was intercepted by bullard. [SEP] 1, 800. 800. 921. 8773. org for six months from one day of september by telephone at 1. 92999, or by telephone mail at 0177. 876. 719. 927 or 1. 748. 887. 014. 7130 ; 1. 8002 [SEP]", "detok_text": "[CLS] said. [SEP] andy roddick federer and roger federer reached the quarterfinals in the third round as no. 15 seed when they beat roger federer again in the quarterfinals. [SEP] villa deservedly claimed the game, in which parra's superb effort from the right was intercepted by bullard. [SEP] 1, 800. 800. 921. 8773. org for six months from one day of september by telephone at 1. 92999, or by telephone mail at 0177. 876. 719. 927 or 1. 748. 887. 014. 7130; 1. 8002 [SEP]"}
+{"type": "sample", "index": 15, "raw_text": "[CLS] - - cleveland turned the 7 - point deficit into a 10 - 8 lead in the first half of this regular season. [SEP] she stratulates that she ' s really nervous and composed and that she won ' t mention that she wasn ' t even out of the stage. [SEP] i remember the brits go four years without thinking about what ' s going on. [SEP] \" we did not keep a player until... the last information they gave us about the club. [SEP] it added that the uefa cup cup decision were positive on the impact it will be having on the 2010 uefa cup cup. [SEP] others, like his late [SEP]", "detok_text": "[CLS] - - cleveland turned the 7 - point deficit into a 10 - 8 lead in the first half of this regular season. [SEP] she stratulates that she's really nervous and composed and that she won't mention that she wasn't even out of the stage. [SEP] i remember the brits go four years without thinking about what's going on. [SEP] \" we did not keep a player until... the last information they gave us about the club. [SEP] it added that the uefa cup cup decision were positive on the impact it will be having on the 2010 uefa cup cup. [SEP] others, like his late [SEP]"}
+{"type": "sample", "index": 16, "raw_text": "[CLS] again and is ready to play by the end of the season. [SEP] the targets for the full work and pensions reform are expected to be released early this week to form a deal worth around £18 billion. [SEP] northrop spokesman joe flahis told the associated press monday that the initial offer is preliminary and it could arrive within one of six months. [SEP] the first american f - 76 plane, one of the deadliest aircraft of u. s. aviation history, crashed in iraq in 2006 and returned in august. [SEP] born in early 1950, the 66 - year - old texan head of the french army in the east of [SEP]", "detok_text": "[CLS] again and is ready to play by the end of the season. [SEP] the targets for the full work and pensions reform are expected to be released early this week to form a deal worth around £18 billion. [SEP] northrop spokesman joe flahis told the associated press monday that the initial offer is preliminary and it could arrive within one of six months. [SEP] the first american f - 76 plane, one of the deadliest aircraft of u. s. aviation history, crashed in iraq in 2006 and returned in august. [SEP] born in early 1950, the 66 - year - old texan head of the french army in the east of [SEP]"}
+{"type": "sample", "index": 17, "raw_text": "[CLS] spending and widespread market speculation. [SEP] ( 4 - 1 - 4 - 2 - 1 ) - - j larsson, j m saha, j upson, c hart - - s lucas, g flamini, m m mizl, s greinke, r saha - - s jakobsen, k babel, r muller, r muller, m jakobson, d schkekek, m krul, k k m babel, 3 - - - k weiss, k larsson, m robben. [SEP] associated press writers daniel friedel, paul elliott, elliott elliott and [SEP]", "detok_text": "[CLS] spending and widespread market speculation. [SEP] (4 - 1 - 4 - 2 - 1) - - j larsson, j m saha, j upson, c hart - - s lucas, g flamini, m m mizl, s greinke, r saha - - s jakobsen, k babel, r muller, r muller, m jakobson, d schkekek, m krul, k k m babel, 3 - - - k weiss, k larsson, m robben. [SEP] associated press writers daniel friedel, paul elliott, elliott elliott and [SEP]"}
+{"type": "sample", "index": 18, "raw_text": "[CLS] on friday when lance armstrong returned to form following a suspension and a seven - man lead in 11 minutes and 15 seconds. [SEP] a man aged in his 20s was found running from his home in bansett, shortly after the raid on wednesday night. [SEP] although the proportion of cancer cancers is rising, the number will be no lower and there probably aren ' t too many more children worldwide. [SEP] prosecutors say they married one of three victims who was distraught after the accident. [SEP] \" he would probably be back on the right side of the line for the next couple of years, \" stavinsley says. [SEP] having been in the [SEP]", "detok_text": "[CLS] on friday when lance armstrong returned to form following a suspension and a seven - man lead in 11 minutes and 15 seconds. [SEP] a man aged in his 20s was found running from his home in bansett, shortly after the raid on wednesday night. [SEP] although the proportion of cancer cancers is rising, the number will be no lower and there probably aren't too many more children worldwide. [SEP] prosecutors say they married one of three victims who was distraught after the accident. [SEP] \"he would probably be back on the right side of the line for the next couple of years,\" stavinsley says. [SEP] having been in the [SEP]"}
+{"type": "sample", "index": 19, "raw_text": "[CLS]... [SEP] the man was injured in the attack which was found dead on sunday and is in a serious condition in hospital. [SEP] late in the night, the grand national wind was making it at 60, but at 30 to 40, the gusts would continue to move to the northwest path and take us into the deep northern desert. [SEP] the capitals went to the stanley cup finals in 1999, then has a stanley record in 2008 and a stanley cup winner of 2003. [SEP] the real replacement for liverpool ' s record of the current season was only to sav in 1999 and to kaka at barcelona in 2002. [SEP] the [SEP]", "detok_text": "[CLS]... [SEP] the man was injured in the attack which was found dead on sunday and is in a serious condition in hospital. [SEP] late in the night, the grand national wind was making it at 60, but at 30 to 40, the gusts would continue to move to the northwest path and take us into the deep northern desert. [SEP] the capitals went to the stanley cup finals in 1999, then has a stanley record in 2008 and a stanley cup winner of 2003. [SEP] the real replacement for liverpool's record of the current season was only to sav in 1999 and to kaka at barcelona in 2002. [SEP] the [SEP]"}
+{"type": "sample", "index": 20, "raw_text": "[CLS] \" mr. sushir said last week, a former deputy governor of khosen province. [SEP] elsewhere, caretaker manager paul ince ' s side, who are the top - scorers in north america ' s premier - league first division, will face top - side german leaders cologne at home on friday. [SEP] or then go for lunch and go into the other world. [SEP] a safin, $ 1, 495. 99 frozen hardball was worth $ 1, 474. 50, while safin was worth $ 1. 3 million. [SEP] \" we ' re very delighted that it will be completed in the 2010 [SEP]", "detok_text": "[CLS] \"mr. sushir said last week, a former deputy governor of khosen province. [SEP] elsewhere, caretaker manager paul ince's side, who are the top - scorers in north america's premier - league first division, will face top - side german leaders cologne at home on friday. [SEP] or then go for lunch and go into the other world. [SEP] a safin, $1, 495. 99 frozen hardball was worth $1, 474. 50, while safin was worth $1. 3 million. [SEP]\" we're very delighted that it will be completed in the 2010 [SEP]"}
+{"type": "sample", "index": 21, "raw_text": "[CLS] that he had a mild disease - free illness and that he had not lost his weight. [SEP] new york ( ap ) - microsoft closes 2. 8 percent lower at $ 19. 42. [SEP] mr morris was an international researcher on the study at the veterans memorial hospital in new york. [SEP] human rights groups have said the election must be fair and transparent. [SEP] we all got there. [SEP] in 2003 he lost mr thaksin ' s lead, 10 - 7, in the second round against the international election commission. [SEP] the commission ' s chair sir jim jones has already confirmed the executive response, which is expected to take about [SEP]", "detok_text": "[CLS] that he had a mild disease - free illness and that he had not lost his weight. [SEP] new york (ap) - microsoft closes 2. 8 percent lower at $19. 42. [SEP] mr morris was an international researcher on the study at the veterans memorial hospital in new york. [SEP] human rights groups have said the election must be fair and transparent. [SEP] we all got there. [SEP] in 2003 he lost mr thaksin's lead, 10 - 7, in the second round against the international election commission. [SEP] the commission's chair sir jim jones has already confirmed the executive response, which is expected to take about [SEP]"}
+{"type": "sample", "index": 22, "raw_text": "[CLS] or alcohol quickly. [SEP] he was struggling after losing his game - and back haas, who had saved the first set, 6 - 2, in the 6 - 4 second set to earn a third set point after he had to take an early lead in the middle of the match. [SEP] a victory was anything but assured, providing the swiss with enough to carry to pre - season on his own. [SEP] in the meantime, i am more dependent on my education than a family in 16 years. [SEP] according to the washington post, the military ' s claim is based on suicide attacks in western afghanistan that have claimed more than 200 lives. [SEP]", "detok_text": "[CLS] or alcohol quickly. [SEP] he was struggling after losing his game - and back haas, who had saved the first set, 6 - 2, in the 6 - 4 second set to earn a third set point after he had to take an early lead in the middle of the match. [SEP] a victory was anything but assured, providing the swiss with enough to carry to pre - season on his own. [SEP] in the meantime, i am more dependent on my education than a family in 16 years. [SEP] according to the washington post, the military's claim is based on suicide attacks in western afghanistan that have claimed more than 200 lives. [SEP]"}
+{"type": "sample", "index": 23, "raw_text": "[CLS] the finals, was 6 - 6. [SEP] the former chief minister, wants to run for parliament, however, he will have to contend as he bids to win back power in the house and seek his second seat in the government. [SEP] \" i got off the bus and waited for a few days, when the season was only beginning and saw what could happen to me a little time, \" bourman said. [SEP] o ' shea from aberdeen will be included on england ' s first - choice squad and will be available in the champions league league next month when the champions league return to germany. [SEP] this would be to win people [SEP]", "detok_text": "[CLS] the finals, was 6 - 6. [SEP] the former chief minister, wants to run for parliament, however, he will have to contend as he bids to win back power in the house and seek his second seat in the government. [SEP] \"i got off the bus and waited for a few days, when the season was only beginning and saw what could happen to me a little time,\" bourman said. [SEP] o' shea from aberdeen will be included on england's first - choice squad and will be available in the champions league league next month when the champions league return to germany. [SEP] this would be to win people [SEP]"}
+{"type": "sample", "index": 24, "raw_text": "[CLS] election. [SEP] canada ended by winning the davis cup, one of the highlights of its most prestigious tournaments with south american which won five titles in paris last summer. [SEP] the game was undone by the loss of a big play. [SEP] by the time, he ' d lost a final title and made a chance to shake him out of the week ' s super champions tour. [SEP] but wawrinka has his runous start to break. [SEP] the president and schafer have also declined to discuss the budget, but obama ' s plans have to focus on the more divisive issue of afghanistan. [SEP] the 30 percent of [SEP]", "detok_text": "[CLS] election. [SEP] canada ended by winning the davis cup, one of the highlights of its most prestigious tournaments with south american which won five titles in paris last summer. [SEP] the game was undone by the loss of a big play. [SEP] by the time, he'd lost a final title and made a chance to shake him out of the week's super champions tour. [SEP] but wawrinka has his runous start to break. [SEP] the president and schafer have also declined to discuss the budget, but obama's plans have to focus on the more divisive issue of afghanistan. [SEP] the 30 percent of [SEP]"}
+{"type": "sample", "index": 25, "raw_text": "[CLS] of the set 1 - 0 and then it 6 - 3 - 2 for his sixth service break chance to make it 2 - 0 before going on a break of serve to pick up his serve. [SEP] the scot was pulled down with a second first - set point but it was safe to take the tie - break at the set and go down 1 - 0 on the second point. [SEP] 4 : minnesota pittsburgh at pittsburgh, 7. m., 10 : 30 p. m., thursday night : game 5. [SEP] the former liverpool had failed to make a save, but were thrashed by anfield at home. [SEP] [SEP]", "detok_text": "[CLS] of the set 1 - 0 and then it 6 - 3 - 2 for his sixth service break chance to make it 2 - 0 before going on a break of serve to pick up his serve. [SEP] the scot was pulled down with a second first - set point but it was safe to take the tie - break at the set and go down 1 - 0 on the second point. [SEP] 4: minnesota pittsburgh at pittsburgh, 7. m., 10: 30 p. m., thursday night: game 5. [SEP] the former liverpool had failed to make a save, but were thrashed by anfield at home. [SEP] [SEP]"}
+{"type": "sample", "index": 26, "raw_text": "[CLS], a private group. [SEP] how do you get the negatives across. [SEP] three years since it was won in 1983, newcastle won at home in the premier league. [SEP] in a disappointing final, the 18 - place englishman who cardred sunday at 15 under after four previous 65s started to finish on joint second ahead of south african tim castricke, staying seven strokes ahead of the seven - time british open champion graeme mcdowell. [SEP] police are appealing for anyone with information to contact bridge road where he is a victim. [SEP] a tight re - election year for the democratic party could mean a loss of several national elections, but [SEP]", "detok_text": "[CLS], a private group. [SEP] how do you get the negatives across. [SEP] three years since it was won in 1983, newcastle won at home in the premier league. [SEP] in a disappointing final, the 18 - place englishman who cardred sunday at 15 under after four previous 65s started to finish on joint second ahead of south african tim castricke, staying seven strokes ahead of the seven - time british open champion graeme mcdowell. [SEP] police are appealing for anyone with information to contact bridge road where he is a victim. [SEP] a tight re - election year for the democratic party could mean a loss of several national elections, but [SEP]"}
+{"type": "sample", "index": 27, "raw_text": "[CLS] [SEP] federer and nalbandian won the fourth - round match against belgian fellow londoner yves nader and fellow belgian players robert naboacek, david ferrer and australian pair tim henman and david james. [SEP] the credit crisis has further increased costs for consumer fuel and oil, which provide a boost to their earnings, while more and more homebuilders and other businesses are at least likely to escape from this week ' s cut rates, further axing earnings. [SEP] at about one point, she was unemployed for five years, then paid $ 250 per hour. [SEP] when his brother takes him to his right, he [SEP]", "detok_text": "[CLS] [SEP] federer and nalbandian won the fourth - round match against belgian fellow londoner yves nader and fellow belgian players robert naboacek, david ferrer and australian pair tim henman and david james. [SEP] the credit crisis has further increased costs for consumer fuel and oil, which provide a boost to their earnings, while more and more homebuilders and other businesses are at least likely to escape from this week's cut rates, further axing earnings. [SEP] at about one point, she was unemployed for five years, then paid $250 per hour. [SEP] when his brother takes him to his right, he [SEP]"}
+{"type": "sample", "index": 28, "raw_text": "[CLS] man, daniel august, tried to attack it before taking it back into custody. [SEP] on a flu flue of poor passing chances, zak broke level to claim the final points of the game with an excellent parry and header from mark mcewan ' s 78th minute free - kick on the right flank. [SEP] they played straight dioup ' s high shot over goal for hearts in the 75th - minute it was juve ' s fourth straight goal by dutch midfielder van essiel. [SEP] it eventually drew thousands of fans around the world as its finale. [SEP] i think it is all those questions you need to make [SEP]", "detok_text": "[CLS] man, daniel august, tried to attack it before taking it back into custody. [SEP] on a flu flue of poor passing chances, zak broke level to claim the final points of the game with an excellent parry and header from mark mcewan's 78th minute free - kick on the right flank. [SEP] they played straight dioup's high shot over goal for hearts in the 75th - minute it was juve's fourth straight goal by dutch midfielder van essiel. [SEP] it eventually drew thousands of fans around the world as its finale. [SEP] i think it is all those questions you need to make [SEP]"}
+{"type": "sample", "index": 29, "raw_text": "[CLS] said a rangers spokeswoman who declined to be named for the maples, who have already won the four titles together. [SEP] the london city side were set to claim the title after losing 2 - 1 league leaders arsenal in the first round of the fa cup, beating birmingham 2 - 0 and then won two months later. [SEP] a radical new group of private equity investors, including former chief executive of scotland ' s halifax and prudential ' s vice - chairman, are planning to become independent brokers for some of the uk ' s largest private groups as likely candidates. [SEP] however, next year, the aol deal will [SEP]", "detok_text": "[CLS] said a rangers spokeswoman who declined to be named for the maples, who have already won the four titles together. [SEP] the london city side were set to claim the title after losing 2 - 1 league leaders arsenal in the first round of the fa cup, beating birmingham 2 - 0 and then won two months later. [SEP] a radical new group of private equity investors, including former chief executive of scotland's halifax and prudential's vice - chairman, are planning to become independent brokers for some of the uk's largest private groups as likely candidates. [SEP] however, next year, the aol deal will [SEP]"}
+{"type": "sample", "index": 30, "raw_text": "[CLS] so high, it could set off more public and fatal flu tests. [SEP] as many as 12 percent of native american people live with cancer each year, and 42 percent die of colon cancer per year, while about 27 percent of the american population becomes diagnosed and diagnosed within the next 25 years alone. [SEP] ( 1 - 4 ) b neville 4 - 2 : m carrick 2, s evra, d scholes 2, m neville, k h silva, k neville ( m, l defra, m neville, j evans, k o ' shea 7, w neville. [SEP] sixth nicolas kiefer will play frenchman dj [SEP]", "detok_text": "[CLS] so high, it could set off more public and fatal flu tests. [SEP] as many as 12 percent of native american people live with cancer each year, and 42 percent die of colon cancer per year, while about 27 percent of the american population becomes diagnosed and diagnosed within the next 25 years alone. [SEP] (1 - 4) b neville 4 - 2: m carrick 2, s evra, d scholes 2, m neville, k h silva, k neville ( m, l defra, m neville, j evans, k o' shea 7, w neville. [SEP] sixth nicolas kiefer will play frenchman dj [SEP]"}
+{"type": "sample", "index": 31, "raw_text": "[CLS] $ 26 million. [SEP] 9 nov. [SEP] while arsenal lost four times and lost three times against wolves, the 38 - year - old striker has been the main player of his life not to take a chance. [SEP] their son, alex, was born jan. [SEP] i think each individual can be the star in their future. [SEP] hull city face sheffield city and wolves at park lane could end up improving the club ' s lead after a convincing draw with wigan and manchester united. [SEP] but gulvin kumar, an economic analyst in mingora, india, believes that india, already invested in a post - communist pro - china market [SEP]", "detok_text": "[CLS] $26 million. [SEP] 9 nov. [SEP] while arsenal lost four times and lost three times against wolves, the 38 - year - old striker has been the main player of his life not to take a chance. [SEP] their son, alex, was born jan. [SEP] i think each individual can be the star in their future. [SEP] hull city face sheffield city and wolves at park lane could end up improving the club's lead after a convincing draw with wigan and manchester united. [SEP] but gulvin kumar, an economic analyst in mingora, india, believes that india, already invested in a post - communist pro - china market [SEP]"}
+{"type": "sample", "index": 32, "raw_text": "[CLS] liverpool ' s lead in the competitions since they won the league in 1998 and 1996 and looked not likely to win again. [SEP] the government ' s latest gfk numbers, which includes forecasts for both jobs and retirement income, expect every man per person over the age of 65 to be unemployed this year. [SEP] then go back to the country.......... [SEP] people really wake up to this situation like their parents, and i think the children are more good at me when they are thinking about their own lives, she says. [SEP] general motors cut its outlook next year as it faces losses to make [SEP]", "detok_text": "[CLS] liverpool's lead in the competitions since they won the league in 1998 and 1996 and looked not likely to win again. [SEP] the government's latest gfk numbers, which includes forecasts for both jobs and retirement income, expect every man per person over the age of 65 to be unemployed this year. [SEP] then go back to the country.......... [SEP] people really wake up to this situation like their parents, and i think the children are more good at me when they are thinking about their own lives, she says. [SEP] general motors cut its outlook next year as it faces losses to make [SEP]"}
+{"type": "sample", "index": 33, "raw_text": "[CLS] jackson ' s parents said they thought one of the children had been lost, but some remained doubts that the bodies could be there. [SEP] they are beginning to offer advice on that issue. [SEP] barmby ' s cross was headed wide at close by john malone, before scott james then sent a header past kirk hipkiss, who he had then put in another dangerous header to get a chance of an early goal. [SEP] leterjivae, who was due to fight a disciplinary panel to defend her, was given a short ban and didn ' t race last tuesday. [SEP] total assets paid under the current plan begins at [SEP]", "detok_text": "[CLS] jackson's parents said they thought one of the children had been lost, but some remained doubts that the bodies could be there. [SEP] they are beginning to offer advice on that issue. [SEP] barmby's cross was headed wide at close by john malone, before scott james then sent a header past kirk hipkiss, who he had then put in another dangerous header to get a chance of an early goal. [SEP] leterjivae, who was due to fight a disciplinary panel to defend her, was given a short ban and didn't race last tuesday. [SEP] total assets paid under the current plan begins at [SEP]"}
+{"type": "sample", "index": 34, "raw_text": "[CLS] scotland ' s one - time rival andy murray, the british independent reported. [SEP] a proportion of women agreed that parents would spend more than their counterparts on their babies by 4. 3 per cent and girls would be paid more money to care for them by about 65 per cent. [SEP] they are forced to sharply increase the earnings rate from 35 to 35 years, because of public concerns about the worker ' s health. [SEP] since last week, the government has donated $ 24. 35 million to help victims aged eight and from drug trafficking. [SEP] when babel tipped a ball just in the 27th minute for the goal from harjol [SEP]", "detok_text": "[CLS] scotland's one - time rival andy murray, the british independent reported. [SEP] a proportion of women agreed that parents would spend more than their counterparts on their babies by 4. 3 per cent and girls would be paid more money to care for them by about 65 per cent. [SEP] they are forced to sharply increase the earnings rate from 35 to 35 years, because of public concerns about the worker's health. [SEP] since last week, the government has donated $24. 35 million to help victims aged eight and from drug trafficking. [SEP] when babel tipped a ball just in the 27th minute for the goal from harjol [SEP]"}
+{"type": "sample", "index": 35, "raw_text": "[CLS] europe throughout the last five years of their regime. [SEP] former prime minister paul ozawa resigned, originally due to leave office in 2012 as deputy minister of taro aso ' s anti - immigrant party. [SEP] a few generations of american car - makers have heard much about the same technology. [SEP] police have urged consumers to read out how they impact people ' s choices and to recognise the nature of the problem. [SEP] but there was a real hard effort, even though the divestment was still marked by a war that was almost over - priced. [SEP] the irish took the lead in johnson ' s first goal before the break and [SEP]", "detok_text": "[CLS] europe throughout the last five years of their regime. [SEP] former prime minister paul ozawa resigned, originally due to leave office in 2012 as deputy minister of taro aso's anti - immigrant party. [SEP] a few generations of american car - makers have heard much about the same technology. [SEP] police have urged consumers to read out how they impact people's choices and to recognise the nature of the problem. [SEP] but there was a real hard effort, even though the divestment was still marked by a war that was almost over - priced. [SEP] the irish took the lead in johnson's first goal before the break and [SEP]"}
+{"type": "sample", "index": 36, "raw_text": "[CLS] record. [SEP] on tuesday at a scientific meeting of the national association of health and cancer held in u. s. court in new york, a researchers finding found that women in the most aggressive form breast cancer were five to five years old to reduce cancer risk and prevent progression from pandemic cancer even if women were not later diagnosed with breast cancer alone, a study in the u. s. army reported on wednesday. [SEP] but for some time, the army has not received sufficient specific information about whether it should comment on the contract. [SEP] the biggest city, about 30 miles south of bangkok, is in the northeastern province, roughly [SEP]", "detok_text": "[CLS] record. [SEP] on tuesday at a scientific meeting of the national association of health and cancer held in u. s. court in new york, a researchers finding found that women in the most aggressive form breast cancer were five to five years old to reduce cancer risk and prevent progression from pandemic cancer even if women were not later diagnosed with breast cancer alone, a study in the u. s. army reported on wednesday. [SEP] but for some time, the army has not received sufficient specific information about whether it should comment on the contract. [SEP] the biggest city, about 30 miles south of bangkok, is in the northeastern province, roughly [SEP]"}
+{"type": "sample", "index": 37, "raw_text": "[CLS] expected buyout retraining. [SEP] true, when they don ' t! [SEP] however, several close friends on the ground said that only european union members who would be supported by the red cross would have to hand - over their their wishes to the workers. [SEP] eastern time, 1430 gmt wednesday, march 12 - 20370 gmt, by 9 september. calling is : ( 888 ) 727307 or www. ims. com. information. [SEP] the researchers said the figures had been compiled from studies in which more than 150 women aged 10, 19, 69 had to wait, 65 had not [SEP]", "detok_text": "[CLS] expected buyout retraining. [SEP] true, when they don't! [SEP] however, several close friends on the ground said that only european union members who would be supported by the red cross would have to hand - over their their wishes to the workers. [SEP] eastern time, 1430 gmt wednesday, march 12 - 20370 gmt, by 9 september. calling is: (888) 727307 or www. ims. com. information. [SEP] the researchers said the figures had been compiled from studies in which more than 150 women aged 10, 19, 69 had to wait, 65 had not [SEP]"}
+{"type": "sample", "index": 38, "raw_text": "[CLS] it might help people with heart disease, \" he said. [SEP] while the virus causes some cases of the h1n1 vaccine, there appears to be no case of a novel vaccine in adults. [SEP] isner also won five gold medals in 2000, and coached at athens, and again in the games in 2000. [SEP] he was losing his best friend and he stuck me on the chairs and desks, while i kept the book and i thought my cancer would end my life. [SEP] he left prison in 2003. [SEP] about 2, 000 people died during the war. [SEP] 25, 2007, was the seventh and the fourth [SEP]", "detok_text": "[CLS] it might help people with heart disease, \" he said. [SEP] while the virus causes some cases of the h1n1 vaccine, there appears to be no case of a novel vaccine in adults. [SEP] isner also won five gold medals in 2000, and coached at athens, and again in the games in 2000. [SEP] he was losing his best friend and he stuck me on the chairs and desks, while i kept the book and i thought my cancer would end my life. [SEP] he left prison in 2003. [SEP] about 2, 000 people died during the war. [SEP] 25, 2007, was the seventh and the fourth [SEP]"}
+{"type": "sample", "index": 39, "raw_text": "[CLS] 018 - 690 - 062, france319 - 10, belgium, krigs, france447 - 888 ; kuwaitis, and france - germany and paris and belgium... [SEP] arsenal had chances to get back from 50 minutes before recovering to pull out a 2 - 0 lead that sent them back to the fifth division, a comfortable victory that took their first defeat since may 28 to ninth place, again, more than 20 points clear of their league rivals, at liverpool and sunderland whom united came from behind to claim arsenal ' s champions cup, having won against reading at home last weekend. [SEP] at $ [SEP]", "detok_text": "[CLS] 018 - 690 - 062, france319 - 10, belgium, krigs, france447 - 888; kuwaitis, and france - germany and paris and belgium... [SEP] arsenal had chances to get back from 50 minutes before recovering to pull out a 2 - 0 lead that sent them back to the fifth division, a comfortable victory that took their first defeat since may 28 to ninth place, again, more than 20 points clear of their league rivals, at liverpool and sunderland whom united came from behind to claim arsenal's champions cup, having won against reading at home last weekend. [SEP] at $[SEP]"}
+{"type": "sample", "index": 40, "raw_text": "[CLS] nearly 20 years of living in israel, mr brown was reluctant to contemplate of his future as an israeli leader. [SEP] despite the spaniard ' s departure, cook is a strong young contender after being five for six out of 40 overs. [SEP] scotland then made a good start to proceedings, with kieran rushing through for a try when the penalty gave the visitors a 20 - 1 early lead, but phillips followed that with a straight try from the corner. [SEP] they met ministers and their two afghans at a private hotel earlier this week in a third city outside of the capital, maintaining a close relationship with the taliban. [SEP] [SEP]", "detok_text": "[CLS] nearly 20 years of living in israel, mr brown was reluctant to contemplate of his future as an israeli leader. [SEP] despite the spaniard's departure, cook is a strong young contender after being five for six out of 40 overs. [SEP] scotland then made a good start to proceedings, with kieran rushing through for a try when the penalty gave the visitors a 20 - 1 early lead, but phillips followed that with a straight try from the corner. [SEP] they met ministers and their two afghans at a private hotel earlier this week in a third city outside of the capital, maintaining a close relationship with the taliban. [SEP] [SEP]"}
+{"type": "sample", "index": 41, "raw_text": "[CLS] said : \" a person who tried, running out of time, to live a life diagnosed with cancer and was given a whole life is considered clinically successful. [SEP] they also found the injured children, and went to the wounded scene with help from the local medical association. [SEP] from 1991 to 1997, household income fell by 50 per cent and net insurance income dropped by nearly 70 per cent. [SEP] \" if you had the right decision to go to birmingham or manchester, we have been there for a period of time and not had it at all, \" said mccarthy, who played his new side against wolverhampton wanderers for three at a time [SEP]", "detok_text": "[CLS] said: \"a person who tried, running out of time, to live a life diagnosed with cancer and was given a whole life is considered clinically successful. [SEP] they also found the injured children, and went to the wounded scene with help from the local medical association. [SEP] from 1991 to 1997, household income fell by 50 per cent and net insurance income dropped by nearly 70 per cent. [SEP]\" if you had the right decision to go to birmingham or manchester, we have been there for a period of time and not had it at all, \" said mccarthy, who played his new side against wolverhampton wanderers for three at a time [SEP]"}
+{"type": "sample", "index": 42, "raw_text": "[CLS]. [SEP] then he decided to play a young guy who in the middle age should team up with him again. [SEP] the russian could take a set point and lost only two points to win the fourth game, but safin went for the net and then cruised for the final game. [SEP] the survey of more than 600 foreign forces in the united states and canada, including spain, germany, germany and about 1, 300 soldiers from canada, sweden, france, the united kingdom, great britain, germany, sweden and spain were ordered to work in order to maintain their economic security in the face of the global economic crisis. [SEP] \" [SEP]", "detok_text": "[CLS]. [SEP] then he decided to play a young guy who in the middle age should team up with him again. [SEP] the russian could take a set point and lost only two points to win the fourth game, but safin went for the net and then cruised for the final game. [SEP] the survey of more than 600 foreign forces in the united states and canada, including spain, germany, germany and about 1, 300 soldiers from canada, sweden, france, the united kingdom, great britain, germany, sweden and spain were ordered to work in order to maintain their economic security in the face of the global economic crisis. [SEP] \" [SEP]"}
+{"type": "sample", "index": 43, "raw_text": "[CLS] their star opponents to the premier league title in the play - off. [SEP] but a range of anxiety and feelings in the air - conditioned system from massachusetts was said to have changed in the middle of mr. kennedy ' s days before he ' d lost a post as leader of congress. [SEP] he struck out 10 - and allowed his last two runs - - and three runs of the eighth. [SEP] dr philip donaldson, nice ' s chief executive, said : \" we still feel that this is not good for some patients. \" [SEP] two afghan crew members among those who died at a military air base in southern afghanistan, the military said [SEP]", "detok_text": "[CLS] their star opponents to the premier league title in the play - off. [SEP] but a range of anxiety and feelings in the air - conditioned system from massachusetts was said to have changed in the middle of mr. kennedy's days before he'd lost a post as leader of congress. [SEP] he struck out 10 - and allowed his last two runs - - and three runs of the eighth. [SEP] dr philip donaldson, nice's chief executive, said: \"we still feel that this is not good for some patients.\" [SEP] two afghan crew members among those who died at a military air base in southern afghanistan, the military said [SEP]"}
+{"type": "sample", "index": 44, "raw_text": "[CLS] ranging from the top to the bottom. [SEP] about 10, 000 people fled their homes to stay away of the devastated state on friday, including a 2 ½ - mile trek from abruzzo outside the state capital isabela to the west coast city of port - prince, then completely collapsed, killing three children and one man from their home. [SEP] it ' s no longer than three years to maintain a job before using company life insurance. [SEP] nadal, who won the final set in his first match before taking the title, hit the three acess. [SEP] she ' s already had more than six balls left by the runner - [SEP]", "detok_text": "[CLS] ranging from the top to the bottom. [SEP] about 10, 000 people fled their homes to stay away of the devastated state on friday, including a 2 ½ - mile trek from abruzzo outside the state capital isabela to the west coast city of port - prince, then completely collapsed, killing three children and one man from their home. [SEP] it's no longer than three years to maintain a job before using company life insurance. [SEP] nadal, who won the final set in his first match before taking the title, hit the three acess. [SEP] she's already had more than six balls left by the runner - [SEP]"}
+{"type": "sample", "index": 45, "raw_text": "[CLS] kunar, the capital islamabad. [SEP] oh, the destruction of the nation ' s banks. [SEP] federer lost the second set before the break to face france ' s robin safret in paris in the quarter - finals on thursday night. [SEP] about 80 percent of those polled said that they still plan to hand out their ballots, probably by jan. [SEP] \" i thought i would play better and i saw what i do today. [SEP] ( ap ) - mark prince scored a field goal with 69 seconds left to give georgia ( 7 - 2, 5 ) a fourth - round victory over the big east region. [SEP] at the second [SEP]", "detok_text": "[CLS] kunar, the capital islamabad. [SEP] oh, the destruction of the nation's banks. [SEP] federer lost the second set before the break to face france's robin safret in paris in the quarter - finals on thursday night. [SEP] about 80 percent of those polled said that they still plan to hand out their ballots, probably by jan. [SEP] \" i thought i would play better and i saw what i do today. [SEP] (ap) - mark prince scored a field goal with 69 seconds left to give georgia (7 - 2, 5) a fourth - round victory over the big east region. [SEP] at the second [SEP]"}
+{"type": "sample", "index": 46, "raw_text": "[CLS] of the opening - day finals and the 1995 united side, could also qualify for the champions cup after returning after losing 1 - 0 in the 2008 world cup final with an injury. [SEP] sweden ' s laurent pettini of south africa clocked just 1. 58sec in third behind kenny williams and robert grief sixth at 58c. [SEP] dufrea won in 1999 and then was winless at wimbledon before winning 7 - 0 at sydney. [SEP] in january next year, wenson, a billionaire footballer, lost an academic appeal to reconnect the idea of putting england on the running of the job. [SEP] [SEP]", "detok_text": "[CLS] of the opening - day finals and the 1995 united side, could also qualify for the champions cup after returning after losing 1 - 0 in the 2008 world cup final with an injury. [SEP] sweden's laurent pettini of south africa clocked just 1. 58sec in third behind kenny williams and robert grief sixth at 58c. [SEP] dufrea won in 1999 and then was winless at wimbledon before winning 7 - 0 at sydney. [SEP] in january next year, wenson, a billionaire footballer, lost an academic appeal to reconnect the idea of putting england on the running of the job. [SEP] [SEP]"}
+{"type": "sample", "index": 47, "raw_text": "[CLS] someone who was affected would receive an annual state pension. [SEP] no stinking. [SEP] millions of americans are losing their health benefits because of the high cost of men ' s health disease and because they ' ve low incomes, and many black americans don ' t have health insurance, experts found. [SEP] they both dominated in the second half, which allowed sunderland to put their focus on their ball away from home. [SEP] the british were given a similar system six days ago. [SEP] the militants have killed 30 pakistani fighters, including a wide swath of afghan troops who participated in those attacks, according to officials familiar with the investigation. [SEP] the [SEP]", "detok_text": "[CLS] someone who was affected would receive an annual state pension. [SEP] no stinking. [SEP] millions of americans are losing their health benefits because of the high cost of men's health disease and because they've low incomes, and many black americans don't have health insurance, experts found. [SEP] they both dominated in the second half, which allowed sunderland to put their focus on their ball away from home. [SEP] the british were given a similar system six days ago. [SEP] the militants have killed 30 pakistani fighters, including a wide swath of afghan troops who participated in those attacks, according to officials familiar with the investigation. [SEP] the [SEP]"}
+{"type": "sample", "index": 48, "raw_text": "[CLS] who died on his home island has died in a letter to his family. [SEP] \" i was not nervous, \" said madsensev, 41. [SEP] kuna had widely reported that the head of the afghan army, brigadier general hamid rabani, had released monday his statement after the trial of hamid karzai, chairman of the isi board of elections. [SEP] so far, they ' ve still had a shot at the title - their english team was the first team in seven years to beat united at a home game in 1992, but has not met since the fa cup final in 1987. [SEP] ms. tu [SEP]", "detok_text": "[CLS] who died on his home island has died in a letter to his family. [SEP] \"i was not nervous,\" said madsensev, 41. [SEP] kuna had widely reported that the head of the afghan army, brigadier general hamid rabani, had released monday his statement after the trial of hamid karzai, chairman of the isi board of elections. [SEP] so far, they've still had a shot at the title - their english team was the first team in seven years to beat united at a home game in 1992, but has not met since the fa cup final in 1987. [SEP] ms. tu [SEP]"}
+{"type": "sample", "index": 49, "raw_text": "[CLS] accept the company ' s full cash injection. [SEP] \" the quarter of 2010 will be the worst of them, \" deutsche bank securities analyst thorson kohut told reuters. [SEP] the winner of today ' s semi - final will be paired with rivals pessigrine and reading 0 - 0 this season. [SEP] michael smith ' s catch made it 1 - 0, england claimed a fifth century and lost fourth wicket after swindler, who led middlesex by six wickets, had slumped to 17 - 3 by winning his first cap in a semi - final even though he made just 79. [SEP] there ' s time for someone to [SEP]", "detok_text": "[CLS] accept the company's full cash injection. [SEP] \"the quarter of 2010 will be the worst of them,\" deutsche bank securities analyst thorson kohut told reuters. [SEP] the winner of today's semi - final will be paired with rivals pessigrine and reading 0 - 0 this season. [SEP] michael smith's catch made it 1 - 0, england claimed a fifth century and lost fourth wicket after swindler, who led middlesex by six wickets, had slumped to 17 - 3 by winning his first cap in a semi - final even though he made just 79. [SEP] there's time for someone to [SEP]"}
+{"type": "sample", "index": 50, "raw_text": "[CLS] was seen until sunday, said spokesman bill bausch was not available on the massachusetts senator ' s office. [SEP] it is believed that as many as 65 per cent of murdered children each year from countries suffer from hiv - infection. [SEP] if she loses the work, she starts to lose confidence, which doesn ' t have much to do with the illness. [SEP] the company asked for $ 400 million before it signed on in january, along with more types of other aircraft. [SEP] it ' s probably captain smith ' s time of the game. [SEP] he was a police commander in july 2003 and head of helmand ' s provincial military [SEP]", "detok_text": "[CLS] was seen until sunday, said spokesman bill bausch was not available on the massachusetts senator's office. [SEP] it is believed that as many as 65 per cent of murdered children each year from countries suffer from hiv - infection. [SEP] if she loses the work, she starts to lose confidence, which doesn't have much to do with the illness. [SEP] the company asked for $400 million before it signed on in january, along with more types of other aircraft. [SEP] it's probably captain smith's time of the game. [SEP] he was a police commander in july 2003 and head of helmand's provincial military [SEP]"}
+{"type": "sample", "index": 51, "raw_text": "[CLS] stretching into this season. [SEP] stork taylor, head of research at retail consultants calpers, noted that a survey of great britain ' s business finance forecasts on tuesday asked people about how they lost money in the recession last year. [SEP] but penn state lost a 24 - 0 lead to rutgers on sunday and lost its last 17 games in the tournament, including beating the tigers 36 - 17 on saturday. [SEP] but of course, it won ' t get rid of the spring - training curse. [SEP] new york ( reuters ) - roger federer ended a 21 - year drought in the event by defeating roddick and american frank ci [SEP]", "detok_text": "[CLS] stretching into this season. [SEP] stork taylor, head of research at retail consultants calpers, noted that a survey of great britain's business finance forecasts on tuesday asked people about how they lost money in the recession last year. [SEP] but penn state lost a 24 - 0 lead to rutgers on sunday and lost its last 17 games in the tournament, including beating the tigers 36 - 17 on saturday. [SEP] but of course, it won't get rid of the spring - training curse. [SEP] new york (reuters) - roger federer ended a 21 - year drought in the event by defeating roddick and american frank ci [SEP]"}
+{"type": "sample", "index": 52, "raw_text": "[CLS] her side. [SEP] being able to run and because you can get the ball under the pressure, you always want to get better, to fight your game and keep being part of the game, and hopefully, you can relive your career. [SEP] i am very rested, but i feel better in the game than i ' d been before, because i have been completely injured before. [SEP] stosur has lost the open twice and won both of those titles this year, but his last match against federer was at toronto in 2004. [SEP] \" but i think he would have a strong impact to the minds of the people, \" [SEP]", "detok_text": "[CLS] her side. [SEP] being able to run and because you can get the ball under the pressure, you always want to get better, to fight your game and keep being part of the game, and hopefully, you can relive your career. [SEP] i am very rested, but i feel better in the game than i'd been before, because i have been completely injured before. [SEP] stosur has lost the open twice and won both of those titles this year, but his last match against federer was at toronto in 2004. [SEP] \"but i think he would have a strong impact to the minds of the people,\" [SEP]"}
+{"type": "sample", "index": 53, "raw_text": "[CLS] back over the christmas period. [SEP] they won the sixth goal for only the third time in the league when they moved to the netherlands in 2006. [SEP] if they spoke of similar races, they came to this event as a losing force. [SEP] \" we will know how [ his wife ] died, not when she was his mother, \" le ' s attorney told afp on tuesday. [SEP] when you say we ' re going to wait and wait for a month or more and let the deficit, not come back down, that ' s good. [SEP] some experts argue that this could lead to the collapse of a weak economic recovery. [SEP]", "detok_text": "[CLS] back over the christmas period. [SEP] they won the sixth goal for only the third time in the league when they moved to the netherlands in 2006. [SEP] if they spoke of similar races, they came to this event as a losing force. [SEP] \"we will know how [his wife] died, not when she was his mother,\" le's attorney told afp on tuesday. [SEP] when you say we're going to wait and wait for a month or more and let the deficit, not come back down, that's good. [SEP] some experts argue that this could lead to the collapse of a weak economic recovery. [SEP]"}
+{"type": "sample", "index": 54, "raw_text": "[CLS] 1 lead in losing the match and improved to 13 - 2 7 - 1 in the second set. [SEP] soon after the election, lola decided to get away with his mother. [SEP] we could finish a year with a chance to go. [SEP] the report for the bank of england ' s global economic outlook will take place on saturday, june 17th at 2000 gmt and saturday ( 9 ). [SEP] but little else is hardly enough. [SEP] his best chance came in the 31st minute when manuel almunia shot wide his own post and as it cleared the post, he followed eduardo ' s tazy cross into the area for his [SEP]", "detok_text": "[CLS] 1 lead in losing the match and improved to 13 - 2 7 - 1 in the second set. [SEP] soon after the election, lola decided to get away with his mother. [SEP] we could finish a year with a chance to go. [SEP] the report for the bank of england's global economic outlook will take place on saturday, june 17th at 2000 gmt and saturday (9). [SEP] but little else is hardly enough. [SEP] his best chance came in the 31st minute when manuel almunia shot wide his own post and as it cleared the post, he followed eduardo's tazy cross into the area for his [SEP]"}
+{"type": "sample", "index": 55, "raw_text": "[CLS] kabiner and her son - in - law. [SEP] because of the economic nature of the business, nobody wants to see if the business is only about having a family visit this term. [SEP] the striker and striker scored in liverpool ' s stunning 73th - minute equaliser to keep the champions club into an unlikely quarter - final of the premier league title on sunday night live. [SEP] the hurricanes were lost 17 games after 20 minutes surrounded by a 3 - 1 lead. [SEP] but if it works in the way, it ' s going to be a catastrophe, it is because it must be more serious again this time. [SEP] the [SEP]", "detok_text": "[CLS] kabiner and her son - in - law. [SEP] because of the economic nature of the business, nobody wants to see if the business is only about having a family visit this term. [SEP] the striker and striker scored in liverpool's stunning 73th - minute equaliser to keep the champions club into an unlikely quarter - final of the premier league title on sunday night live. [SEP] the hurricanes were lost 17 games after 20 minutes surrounded by a 3 - 1 lead. [SEP] but if it works in the way, it's going to be a catastrophe, it is because it must be more serious again this time. [SEP] the [SEP]"}
+{"type": "sample", "index": 56, "raw_text": "[CLS] of the european union. [SEP] as they struggled on the foot of the night for a home goal, it was 1 - 2 to end as the americans celebrated a third victory, securing a 2 points win. [SEP] parisc was up 1 points at 545. 060, paris ' ca index of germany ' s dax up 0. 7 percent to 806. while germany ' s dax rose 33 points, or 1. 3 percent, to 8196. [SEP] he was married less than a year before retiring at the open, and just made his first decision, after winning at the french earlier this month. [SEP] finally, [SEP]", "detok_text": "[CLS] of the european union. [SEP] as they struggled on the foot of the night for a home goal, it was 1 - 2 to end as the americans celebrated a third victory, securing a 2 points win. [SEP] parisc was up 1 points at 545. 060, paris' ca index of germany's dax up 0. 7 percent to 806. while germany's dax rose 33 points, or 1. 3 percent, to 8196. [SEP] he was married less than a year before retiring at the open, and just made his first decision, after winning at the french earlier this month. [SEP] finally, [SEP]"}
+{"type": "sample", "index": 57, "raw_text": "[CLS]. [SEP] more than 20 years ago, britain launched a revolution for the power of nuclear energy - which could produce little more than 10 watts of power - about 2, 000 tonnes a year, equivalent to 1 billion tonnes. [SEP] the 37 - year - old was the world champion 18 times, playing for the title four times before retiring months ago, winning five successive french titles. [SEP] he made his second consecutive start before suffering a concussion in a 72 - hole loss against south korea. [SEP] the european commission had said a deal on a treaty reached in march by eu member ministers would allow iceland to join the 27 - member alliance, a [SEP]", "detok_text": "[CLS]. [SEP] more than 20 years ago, britain launched a revolution for the power of nuclear energy - which could produce little more than 10 watts of power - about 2, 000 tonnes a year, equivalent to 1 billion tonnes. [SEP] the 37 - year - old was the world champion 18 times, playing for the title four times before retiring months ago, winning five successive french titles. [SEP] he made his second consecutive start before suffering a concussion in a 72 - hole loss against south korea. [SEP] the european commission had said a deal on a treaty reached in march by eu member ministers would allow iceland to join the 27 - member alliance, a [SEP]"}
+{"type": "sample", "index": 58, "raw_text": "[CLS] better for her supporters. [SEP] the tsunami warning was released at around 7 : 30 a. m. [SEP] and it ' s about money. [SEP] but you just can ' t make it happen. [SEP] about 30 people were displaced, in the village of fakkara 70 miles northwest of jolo, said the ministry. [SEP] they would be far more expensive now. [SEP] wait - as long as we try to live more together. [SEP] the pan flu vaccine flu kills about 25 percent of the population of children each year, while there ' s only one vaccine in the u. s., the who said. [SEP] under a pressure [SEP]", "detok_text": "[CLS] better for her supporters. [SEP] the tsunami warning was released at around 7: 30 a. m. [SEP] and it's about money. [SEP] but you just can't make it happen. [SEP] about 30 people were displaced, in the village of fakkara 70 miles northwest of jolo, said the ministry. [SEP] they would be far more expensive now. [SEP] wait - as long as we try to live more together. [SEP] the pan flu vaccine flu kills about 25 percent of the population of children each year, while there's only one vaccine in the u. s., the who said. [SEP] under a pressure [SEP]"}
+{"type": "sample", "index": 59, "raw_text": "[CLS] when her husband died. [SEP] last year, ms mccarthy had conducted an unsecreted survey with 10, 400 people. [SEP] the 20th minute john o ' shea twice saw the manchester united side hand in hand after the birmingham underdog keeper almost made the last stop and hit a shot of the net but it was enough to earn them a point. [SEP] a class of ten athletes earn more than $ 500, 000 annually on the team ' s payroll. [SEP] wednesday ' s total of more than 2, 000 soldiers lost their lives - - a time in the middle of the cold war in afghanistan and in afghanistan. [SEP] \" labour [SEP]", "detok_text": "[CLS] when her husband died. [SEP] last year, ms mccarthy had conducted an unsecreted survey with 10, 400 people. [SEP] the 20th minute john o' shea twice saw the manchester united side hand in hand after the birmingham underdog keeper almost made the last stop and hit a shot of the net but it was enough to earn them a point. [SEP] a class of ten athletes earn more than $500, 000 annually on the team's payroll. [SEP] wednesday's total of more than 2, 000 soldiers lost their lives - - a time in the middle of the cold war in afghanistan and in afghanistan. [SEP] \" labour [SEP]"}
+{"type": "sample", "index": 60, "raw_text": "[CLS] north carolina ; ohio state at st. louis - st ; arkansas vs. 1 texas. [SEP] they hoped to spend $ 10 million on youth education. [SEP] the men were four times more likely to develop high levels and rates of cancer, diabetes and alzheimer ' s and disease control. [SEP] he summoned the next - serve monfizer, who lost the second set at 4 - 4, only to save a point when nadal broke his own with a lucky early shot. [SEP] manufacturing rose 2. 0 per cent to a revised 495. 9, after falling by 0. 3 percent in the previous quarter. [SEP] a company spokesman [SEP]", "detok_text": "[CLS] north carolina; ohio state at st. louis - st; arkansas vs. 1 texas. [SEP] they hoped to spend $10 million on youth education. [SEP] the men were four times more likely to develop high levels and rates of cancer, diabetes and alzheimer's and disease control. [SEP] he summoned the next - serve monfizer, who lost the second set at 4 - 4, only to save a point when nadal broke his own with a lucky early shot. [SEP] manufacturing rose 2. 0 per cent to a revised 495. 9, after falling by 0. 3 percent in the previous quarter. [SEP] a company spokesman [SEP]"}
+{"type": "sample", "index": 61, "raw_text": "[CLS] implications for the nation ' s competitiveness. [SEP] but experts and analysts agree that it ' s probably the worst time for a major venture to come clean. [SEP] breast cancer is the best thing of your entire life, \" said study co - author dr. david altman. [SEP] yet, at 25, who joined arsenal in 2002, scored a premier league double goal in a scottish premier league, he came out of retirement, refusing to dictate his manager one of the biggest names on the national team ' s player list. [SEP] the woman was transported to the hospital ' s emergency department. [SEP] an investigation by the coroner found [SEP]", "detok_text": "[CLS] implications for the nation's competitiveness. [SEP] but experts and analysts agree that it's probably the worst time for a major venture to come clean. [SEP] breast cancer is the best thing of your entire life, \" said study co - author dr. david altman. [SEP] yet, at 25, who joined arsenal in 2002, scored a premier league double goal in a scottish premier league, he came out of retirement, refusing to dictate his manager one of the biggest names on the national team's player list. [SEP] the woman was transported to the hospital's emergency department. [SEP] an investigation by the coroner found [SEP]"}
+{"type": "sample", "index": 62, "raw_text": "[CLS] states. [SEP] it is europe ' s most successful electric version of the mid - popular luxury car brand in the united states. [SEP] the serb trailed 8 - 6 1 - 7 6 - 4 thursday. [SEP] the senate democratic spokesman tom harkin, said the race was a fight to a concutor named for candidates who lost the election. [SEP] with the second half dowd was cautioned and chris deans were ruled out of the game over the bar. [SEP] still, it ' s unlikely to be over. [SEP] this is a particularly real moment, as the striker sends a pass over the far post to score the crucial goal [SEP]", "detok_text": "[CLS] states. [SEP] it is europe's most successful electric version of the mid - popular luxury car brand in the united states. [SEP] the serb trailed 8 - 6 1 - 7 6 - 4 thursday. [SEP] the senate democratic spokesman tom harkin, said the race was a fight to a concutor named for candidates who lost the election. [SEP] with the second half dowd was cautioned and chris deans were ruled out of the game over the bar. [SEP] still, it's unlikely to be over. [SEP] this is a particularly real moment, as the striker sends a pass over the far post to score the crucial goal [SEP]"}
+{"type": "sample", "index": 63, "raw_text": "[CLS] election day of today. [SEP] as they suggest, they do not track women with the results of a variety of other tests. [SEP] france ' s dax 30 lost 0. 7. 00 percent, 0. 98 points, to 5, 500. 30, and france ' s cac 40 gained 0. 72 percent, 2. 90 points, lower at 1, 850. 42. [SEP] he turned 65 aug. [SEP] 2000 : nani was being beaten by barcelona at his side ' s match in hamburg. [SEP] mason made 21 saves and antal staamens scored in the victory. [SEP] it seems to take away the [SEP]", "detok_text": "[CLS] election day of today. [SEP] as they suggest, they do not track women with the results of a variety of other tests. [SEP] france's dax 30 lost 0. 7. 00 percent, 0. 98 points, to 5, 500. 30, and france's cac 40 gained 0. 72 percent, 2. 90 points, lower at 1, 850. 42. [SEP] he turned 65 aug. [SEP] 2000: nani was being beaten by barcelona at his side's match in hamburg. [SEP] mason made 21 saves and antal staamens scored in the victory. [SEP] it seems to take away the [SEP]"}