Add files using upload-large-folder tool

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_256steps_n64/state_c1024_t1p45_detok_raw_samples.txt

@@ -0,0 +1,228 @@
+state_c1024_t1p45_detok
+{
+  "type": "summary",
+  "name": "state_c1024_t1p45",
+  "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt",
+  "step": 124000,
+  "decode": {
+    "kind": "categorical_fullvocab",
+    "config": "state_c1024_t1p45",
+    "steps": 256,
+    "model_t_mode": "post",
+    "support_power": 1.0,
+    "semantic_power": 1.0,
+    "endpoint_temp": 1.45,
+    "concentration_min": 1.0,
+    "concentration_max": 1024.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 28.415282971033125,
+    "nll_per_token": 3.3469271332084953,
+    "tokens": 9529
+  },
+  "diversity": {
+    "sample_entropy": 4.048794239038511,
+    "unique_tokens": 1473,
+    "token_count": 8192,
+    "distinct_1": 0.1798095703125,
+    "distinct_2": 0.5878444881889764,
+    "top_token_mass": 0.057861328125
+  }
+}
+
+===== sample 000 =====
+[CLS] of their excesses. [SEP] "and there was so little space in it and a little bit of what went on in it. [SEP]" i just haven't asked him. [SEP] my fear is simply that the government has done so much to resolve their problems. [SEP] dallas took the lead just 2 minutes 26 seconds into the second period. [SEP] "he has a lot," he said. [SEP] cleveland trailed again at 8: 31 of the third quarter, when james hit a 20 - footer to take a 50 - 52 lead. [SEP] according to the report, the investigation is continuing. [SEP] i prefer not to mention the [SEP]
+
+===== sample 001 =====
+[CLS] 2008. [SEP] james baker, one of khao's top advisors, said he believed that the president understood that the plant should be closed and that he would review the project. [SEP] "i knew my heart and i felt like i was wrong, but he wanted me to do it and i had to make a right decision against him. [SEP] but yes, i'm in a quiet room in my office. [SEP]" some of these measures, such as safety - related measures, road safety and network rail transport, need to be done on a much greater scale, " the letter said. [SEP] he said that the government [SEP]
+
+===== sample 002 =====
+[CLS]'s ministry of defense. [SEP] "i felt we had to achieve that goal because they had that sense of perspective," he said. [SEP] total revenue for the full year 2009 expected to decrease by approximately $1, 000. $100 million for half of 2009 to $50 million for the remainder of 2009. [SEP] "even if they don't come to sleep, they have to stay away," safira says. [SEP] when he really does, i suspect he's not enough. [SEP] "i feel that i will never be able to move to the end of life," she said. [SEP] this is [SEP]
+
+===== sample 003 =====
+[CLS] pressure - - he will keep coming back at this point. [SEP] "instead, he doesn't like the system, doesn't like the one that took him back to the back of the house. [SEP]" unfortunately, we can't give a man much money. " [SEP] i don't think that it would be so easy. [SEP] but not yet, you can find out there. [SEP] it's hard to tell what is coming or where he is, when he's looking at the site. [SEP] tmz's wife chris, 28, has been married for more than 20 years. [SEP] i [SEP]
+
+===== sample 004 =====
+[CLS] in the area. [SEP] "we continue to do it in a private way, so i would love to stay in it. [SEP] the bbc writer will remain free until monday. [SEP] general manager joe girardi will make his move to atlanta with the new york jets. [SEP] i'm not sure what to do. [SEP] no, he's trying to take his advantage, not his luck. [SEP] for now, congress is getting a little harder on the company. [SEP] i thought i could have done it a bit. [SEP]" i am not sorry, but god knows, this is something that makes him so good. [SEP] [SEP]
+
+===== sample 005 =====
+[CLS] crime. [SEP] it's an acute situation that, in turn, happens when one is out of the job. [SEP] chris bosh had two players each with 11 points, calvin harris had three turnovers, and carlos boozer scored two apiece for the jazz, losers for the first time in the first five games of the season. [SEP] i hope they won't. [SEP] i think it's a joke, but they don't tell me how much it costs. [SEP] i hope i can't say it's because you're the child, and if you had known my father, i would have [SEP]
+
+===== sample 006 =====
+[CLS] 3 percent in the third quarter, unchanged from april, from 6. 5 percent in the previous quarter. [SEP] during the boom, cars in housing were still more expensive than the summer of 2007, and us food prices went up for the worst month in their history. [SEP] the cause of the fire, he did not want to be identified. [SEP] i'm really excited about it - - i know what i can do, "hecht said. [SEP]" he has a lot of goals, an average of eight games, and we cannot know yet whether he will be allowed to be in the finals, " he said. [SEP] [SEP]
+
+===== sample 007 =====
+[CLS] to expand that facility. [SEP] "if you want a player who wants to play, there's no way down the line. [SEP] and, maybe, they've got to stay in the dark and try to pay attention to the plight of a man who hates everything. [SEP]" in light of the current crisis, no political solution is prepared to demonstrate the u. s. commitment to deal with the challenges of the process, " clinton said during a visit to dubai. [SEP] in august, the house passed its own health care bill, which cost more than $1. 4 billion between 2009 and 2010. [SEP] i have heard [SEP]
+
+===== sample 008 =====
+[CLS] big questions about the scope of her story. [SEP] i'm not sure what you wrote about that. [SEP] the c. e. a. has a structure that is no different than the structure of the new regulator. [SEP] "we don't have time to think more on the issue, something we have got to do to save our economy. [SEP]" for me, i've always had a struggle with cancer in my life, " he said. [SEP] the farc should get no immediate response. [SEP] if the brakes are pressed, you will stand on top of the back of the 300 - seat commuter train. [SEP] [SEP]
+
+===== sample 009 =====
+[CLS] due to sign the deal, the jets are about to finish a two - game slide. [SEP] and there has not been any word on the money that will flow to the fund in 2010. [SEP] in addition to co - worker's court fees, he appeared to have been speaking with the defendant after the accident, he said. [SEP] the group, led by the hedge fund tycoon, has pledged more than $7m (£5. 7m). [SEP] and in the end, after it's years of work, i see it. [SEP] " don't be afraid to deal with the environment, let alone [SEP]
+
+===== sample 010 =====
+[CLS] of chicago.... [SEP] they are close to zero. [SEP] which is a shame, but i can also say, what we've got on the subject is so much campaign - related to the president. [SEP] so did the election of stupak's predecessor, representative harriet harman. [SEP] the journalist's release was a coup for the american journalists foundation, a los angeles - based organization. [SEP] the case, however, might have little to do with well - written and well - funded work. [SEP] " i was happy i didn't know exactly where i want to be from. [SEP] in 1996, [SEP]
+
+===== sample 011 =====
+[CLS]. [SEP] mr thompson said he did not expect "convincing evidence" to support the claims, but not much was changed. [SEP] and that is why it is so important. [SEP] it wouldn't be a nice thing to do but just get on a plane for a good day. [SEP] "i think the americans have moved on to their right. [SEP] it was an incredible experience, but when i don't get given the opportunity to live in the hands of the world, i would be willing to do that," he said. [SEP] it turns out that he can barely afford to have a black watch on his head. [SEP] [SEP]
+
+===== sample 012 =====
+[CLS] of up to some 6, 000 jobs. [SEP] it's just a lot of work, no idea. [SEP] chief fire officer john williams, of middlesbrough, said there was no need for an investigation into the incident. [SEP] the application has not been changed yet, but the date of appeal, which has been delayed until saturday, as the application has not been awarded so far, has been announced. [SEP] the person who did not want to be identified. [SEP] the hotel has a security staff, accompanied by a number of non - security staff, is due to close the doors after the weekend. [SEP] we have stood on top of [SEP]
+
+===== sample 013 =====
+[CLS] to recession, the us economy would face the worst economic recession in the world in two decades. [SEP] the company also acknowledged that the false statement was misleading to investors, and that some of the allegations are true. [SEP] after the hearing, she left a note with marks on his head saying he doesn't speak. [SEP] you can do it better. [SEP] the number was equal to 2. 5 million jobs in 2009. [SEP] at the end of the iraq war, most of the militants were fighting for u. s. forces in afghanistan. [SEP] "what we had to do was deal with this," ms martin added. [SEP] [SEP]
+
+===== sample 014 =====
+[CLS] do anything for our team to do with our performance, "he said. [SEP] no matter how hard we work to find the job, they put us in the best we can't. [SEP] if you live in your own financial system, you can't make too much of it. [SEP] not surprisingly, the team has struggled to keep up with washington's eighth - inning success. [SEP] small businesses get about $3 billion a year in emergency emergency loans. [SEP] he had only scored four runs in the series, including three of four games in the series, including one in the eighth. [SEP]" the incident is a huge [SEP]
+
+===== sample 015 =====
+[CLS] no danger to their aircraft. [SEP] "in the case of a point here, it would seem like we could pull this out, but when we do it a bit, then it can really get even a little easier," he said. [SEP] the study, based on computer data, was also conducted by paul gordon of new york university. [SEP] i knew that i wanted to be happy, i just wanted to sit down at the end of the day. [SEP] i'm confident that if i really feel i'm going to get fired, that would be a good thing then, " he said. [SEP] so, perhaps, [SEP]
+
+===== sample 016 =====
+[CLS], it's all drug - free. [SEP] he said: he's been under constant pressure for many years, but he has little time on tour, has already made some mistakes in international training and he has a lot to do. [SEP] the man took off in the area as the aircraft dropped off and went to police to face treatment. [SEP] "the conference will give the most powerful signal to the security of the palestinian state, and signal the president's commitment to maintain the security of the west bank," said an official at the state department. [SEP] it is supported by the fact that millions of people have access to [SEP]
+
+===== sample 017 =====
+[CLS] the number of visitors. [SEP] "we have had a great year," he said. [SEP] we are ready for them. [SEP] but there is no reason to doubt that. [SEP] all the way, you're right. [SEP] that's part of the problem. [SEP] "i think, at least, we believe that there was any kind of information," the official declared, "but nobody knows that." [SEP] the economy was an important contribution to obama's reform plans during the bush administration. [SEP] the site was built over the past year. [SEP] we are running out of the question of what happens to the political [SEP]
+
+===== sample 018 =====
+[CLS] relief. [SEP] i'll just look into her. [SEP] "i don't have that question. [SEP] make it before we can even make it to school. [SEP]" we knew we would all need our help and then we knew, "the statement said. [SEP]" it's disappointing, "he said. [SEP] mr brown also thinks he may have to pay his bills at the conference. [SEP] but i think it does have a lot of positive energy and makes you feel pretty good about doing those things. [SEP] a little odd to me. [SEP] however, in his speech, he said," i don't think [SEP]
+
+===== sample 019 =====
+[CLS] gmt. [SEP] the average price of single - or single - family homes in california is expected to rise by 50 percent in the next 12 months. [SEP] at the moment, we don't have much room or even an extra room. [SEP] the literary pleasures of a book to read - - books, such as "an evening, a day," and a bunch of "cookbooks" - - are the theme of the nation's literary traditions. [SEP] " none of the lawyers involved at the high court have been suspended. [SEP] but it's a shame, and it's not too bad for one of us [SEP]
+
+===== sample 020 =====
+[CLS] 2009. [SEP] then he explains that he did not have the position on his hands. [SEP] standing at the back of the audience, he appeared to have a large, airy, cartoon - like look. [SEP] on the other side, clinton, 66, put together a large bunch of bread and a piece. [SEP] the person who made the announcement had no intention of leaving at the time and signing a deal, people familiar with the negotiations said. [SEP] he has little mobility and is able to walk for 15 minutes, and his son is only six years old. [SEP] the average amount of a home will be about $1, 000 [SEP]
+
+===== sample 021 =====
+[CLS] 2010. [SEP] the entire us economy has slipped into a state of recession. [SEP] the fact is that greer, the french - born author of the sex drive, is no longer willing to look elsewhere to see his work and his resumes. [SEP] you can buy a number of things that are bigger - than - life. [SEP] mr brown said the move was a "very important partnership" for ssp, a uk - based organisation, which has become a household name. [SEP] "we just have to get really serious, it sort of all is wrong, but we want to get something better," he said. [SEP] the company [SEP]
+
+===== sample 022 =====
+[CLS] of his departure from the competition, the paper added. [SEP] they never made it to us and that means we have never got the best of the world. [SEP] sure, he hit the head and swiveled it off the track, but the 40 - year old got away from the field and fought back. [SEP] the attack took place in the sunni region of east baghdad. [SEP] "it's time to try to balance the puzzle and put my hands together, i'll be in a position to go," he said. [SEP] he's also trying to prove that he's got his hand in afghanistan. [SEP] [SEP]
+
+===== sample 023 =====
+[CLS] take place in the aug. [SEP] "they need to get in touch with their children because it is their school, their family," dr clasley says. [SEP] " i had a lot of money to set up but it didn't mean that i can't buy. [SEP] there is one reason to avoid strawberry wambar, the tomato - flavored dessert flavored with butter - like chocolate. [SEP] the dems, if not democrats, make an easy effort to explain themselves, not themselves. [SEP] during their three - year term, the company developed a number of small and high - energy power products in the [SEP]
+
+===== sample 024 =====
+[CLS] want to get access to education. [SEP] it is part of the city's 100 - year - old communal tradition. [SEP] mr. stauer was able to fill in the interview, which he did, even when he was 13, with one of her children, who had to do with her job, but didn't have the money to do it in public. [SEP] "i don't want anything in your car," she said. [SEP] normally, i only knew if i wanted to know if things would go wrong, but that would do a lot of work. [SEP] bp, the world's largest operator [SEP]
+
+===== sample 025 =====
+[CLS] see it, " he said. [SEP] that is when i don't like to be at a club. [SEP] yet, no one wanted to change their mind. [SEP] in addition, there will be a chance to bring democracy to haiti. [SEP] the problem, of course, is that unless the last one in the greek mythology is solved, suddenly it looks like something might have happened. [SEP] the man, who is unconscious, left the scene and left in a waiting car. [SEP] but that's not news. [SEP] i don't want to... [SEP] this is more of a new start, expected to take about [SEP]
+
+===== sample 026 =====
+[CLS] price of $50. [SEP] if you had weapons, communications, equipment, water, education, nothing would come out of them. [SEP] "i don't think you want to do that but if we get off better we play very well. [SEP] on september 11, 2003, the ranger's helicopter went down on the ground. [SEP] so far, markets have taken a bit of action in recent days. [SEP] he said the company does not report earnings in the near term. [SEP]" i can't tell you why he ended up for the presidency - - but i have had a lot of conversation, " he says. [SEP]
+
+===== sample 027 =====
+[CLS] really close to trying to get your foot back in the office. [SEP] i believe that my son can do, i just think we do what we need. [SEP] the ruling must be returned to the court on wednesday. [SEP] "it's a lot that's still a problem," he said. [SEP] if you bought a bike and thought it was a good idea, what would any of us have to do then? [SEP] i don't have to have a love thing, " she said. [SEP] however, it does not seem appropriate that the old boys seemed to reject it. [SEP] dr michael jordan, the doctor who [SEP]
+
+===== sample 028 =====
+[CLS] 2. 06 percent. [SEP] retail sales for the six months to january are 0. 7 per cent higher than in the year to march, according to official figures from the aa. [SEP] then he got to buy everything he knew - - and began to take his clothes at home - - and even put in one of his own - - in the back of the building, just to know something he had done. [SEP] so that is the right point. [SEP] the red wings took control in the opening period with 9 minutes left late into the third. [SEP] there will also need to be a better atmosphere at the club. [SEP] however, [SEP]
+
+===== sample 029 =====
+[CLS], simmons 0 - 0 - 1 0 - 0, bell 0 - 5 0 - 0 0 - 0 0 0 - 0 2, mobley 5 - 11, thomas 5 - 16, chicago 1 - 4. [SEP] the report, which is the first project to be released by the company, told the times it has become possible for more people to get in touch with their children rather than simply getting to the site. [SEP] " it feels like i'm going to die. [SEP] sales in june rose 11. 4 per cent to $100, 000. [SEP] irvine, calif. - if you know what's going [SEP]
+
+===== sample 030 =====
+[CLS] the end, to the end, and we have to get to the end of the story. [SEP] however, he spent part of a decade working for a provincial government, and in 2007 he worked in several companies. [SEP] the former president praised brawn's selection of hamilton, an eight - time world champion and a 13 - time champion, to win the four - man team in beijing. [SEP] but what we need to do is sit back and get a look of the place. [SEP] that's not to say that, if you're willing to go along with your bill, take a break. [SEP] however, they [SEP]
+
+===== sample 031 =====
+[CLS] hands disappeared into the air. [SEP] the nets led 50 - 50 with 1 minutes left in the opening period less than two minutes into the half. [SEP] when you think about the characters, you feel very old. [SEP] the s & p 500 was down 0. 5 percent, but the new york - based nasdaq composite index lost 0. 6 percent to 2, 724. 80. [SEP] but this was a gain of a little more than. 9 percent in december, with the market already at the top of the agenda. [SEP] "we lived for 80 years, so we're there," he said. [SEP] [SEP]
+
+===== sample 032 =====
+[CLS] bush's top diplomat, said at a news briefing held on the morning of july 11 that the afghan government, with support from us and other international forces, should not try to face the possibility of a real arms race. [SEP] i think he's a very good player... [SEP] "obviously, if we thought we'd never have been, there was something we can do to have one, we have, but we have one, we will stay out, we will come in," said davis, who was among nine staffers - - all of them who lost their own seat. [SEP] he refused to answer [SEP]
+
+===== sample 033 =====
+[CLS], 000 school children were among the 70, 000 people affected by the earthquake. [SEP] he allowed only two runs in 4 1/3 - 2 3/3 innings and one walk for the tigers. [SEP] i don't like to talk about the marriage. [SEP] american officials have also warned that there will be a "significant risk" if the u. s. continues to pursue a military effort against al - qaida. [SEP] but the burdens, however, can only be applied to the public face of what has been a structural imbalance in their economies and other rich nations. [SEP] it's even more complicated, [SEP]
+
+===== sample 034 =====
+[CLS] do not believe there is any evidence that the security agreement in iraq has been ended. [SEP] since obama has promised to end all the civil rights, if not necessary, it would be an attempt to start a democratic campaign to end this process. [SEP] the idea is to place large pots of corn in the crooks of a road, in place of branches, cars and trees. [SEP] like me, however, i feel a little more confident, if with a little look and a little smile. [SEP] an estimated 4. 5 million people are homeless. [SEP] "i'm trying to finish," he said. [SEP] he also wants [SEP]
+
+===== sample 035 =====
+[CLS] rose to 28. 5 % for the year from 26. 3 % a year ago. [SEP] the only option for a second vaccine is to check the safety and health effects of the vaccine. [SEP] a 33 - year - old nigerian man, charged with resisting police bail, jumped onto the air force's flight to the united states. [SEP] i hope that someone will make it out there and take them to the game, " he said. [SEP] also at the same time, spain's new defense minister, carlos borges, also said he would ask the european union to increase military force in afghanistan. [SEP] the e - mail [SEP]
+
+===== sample 036 =====
+[CLS] of the detainees, but said he had no idea of them. [SEP] "when we realized he was still five miles away, we thought he was right in the air and it was great to walk," said james molinaro, a 38 - year - old campaign office manager. [SEP] in the end, everything is dead. [SEP] "i have to sacrifice my patience to get things done. [SEP] when i run into a couple of things, i'd like to be realistic. [SEP]" we'll look at a state level to have a much greater understanding of what an individual is in the workplace. [SEP] that's when [SEP]
+
+===== sample 037 =====
+[CLS] said. [SEP] "it would normally have been an act of money, but sometimes it is just really simple," he said. [SEP] "no one is not going to get involved," he said. [SEP] i've been doing it since the start of the season and, had i been there for a while, it usually became a very long trip. [SEP] "you cannot feel the pressure. [SEP]" if there is a guy that is going to be a lot of pressure, i will not make any changes, " he said. [SEP] there are other assets that could be useful to investors in the long run. [SEP] the [SEP]
+
+===== sample 038 =====
+[CLS] two other us service personnel were killed in a helicopter bomb crash in afghanistan. [SEP] "you can see how we do things. [SEP] it is good to think it's important to understand that there's something written in that - - and try to get some feedback on it. [SEP] that is our thought for a couple of months. [SEP]" i don't want to see what is changed. [SEP] together, they're lovely and sexy, it's more realistic and romantic. [SEP] " i never had anyone in the national team, i never had a taste for it. [SEP] so, i understand. [SEP] and if [SEP]
+
+===== sample 039 =====
+[CLS] in january 2010. [SEP] his identity was confirmed by his prison guards before he was returned to the prison, where he was held there in october 2002. [SEP] "it is not when you talk, when you look for a joke," he said. [SEP] i thought i went too far. [SEP] but he said that there would be a five - year deal with germany, an end to the war in afghanistan, as well as iran. [SEP] i think most of the iranian people would have been able to turn their country into a democracy. [SEP] the president's vacation needs to last for a week or two. [SEP] she moved her [SEP]
+
+===== sample 040 =====
+[CLS]'s up to them. [SEP] i'm not going to apologize, i don't like what the law says. [SEP] you never see it again, " he said. [SEP] he's no regrets, and no regrets, but he also seems to have to go through a couple of problems at the end of the game. [SEP] he's a nice guy and with a good balance and able to get things started. [SEP] but we have to work hard in the n. f. c. at all to be one of those who don't really want to lose - - they're kind of going to keep [SEP]
+
+===== sample 041 =====
+[CLS] in the case of the state, he said. [SEP] it is posted on the website and is only 56 % true. [SEP] but i wanted to get home. [SEP] the plant has an additional 1, 200 manufacturing capacity and is more than 5, 000 square miles (3, 300), he said. [SEP] in fact, the floor is full for you, and at this moment, it's all in the shape of the second floor, and when you see the room at the door, there's no living room, no chairs, or bedroom. [SEP] the british military will resume its regular exercise with a technical training centre [SEP]
+
+===== sample 042 =====
+[CLS] to spend much of the day. [SEP] "i've never done any of my tests and i know when he is going to play south africa i don't think that that is something i really want to do again," said wester. [SEP] it is that if there has to be a person living in the city - - it is like the end of a political year. [SEP] a spokesman for doug hoffman, a davis' lawyer, said he had told the jury that the attack was of public safety and that he did not have the right to take action in the court. [SEP] i don't think a real estate [SEP]
+
+===== sample 043 =====
+[CLS] agenda. [SEP] mr. cohen returned to europe to run the company in a further few years. [SEP] it's possible, in the general sense, that we have to put on a show of, well, something that has a history, i'd love to have a chance to show that, to do something in a bit of context. [SEP] he added that, among other things, the uk could become more able to deal with long - term problems. [SEP] the north has begun making new travel plans to allow aid and entry to the border, and also has ordered a full end of access to the buffer zone. [SEP] the [SEP]
+
+===== sample 044 =====
+[CLS] he was wearing brown jeans and armed with a white shirt, an coloured jacket and a white tie. [SEP] he said: "he has never had a lot of money. [SEP] that's a big thing. [SEP]" i have to say the last three years, you are following one of the many things that have come on in the last 10 years. [SEP] the real deal is insurance. [SEP] that's what they can do. [SEP] that isn't what we want, he says. [SEP] the team knows that he will be able to take part at milan, but he is always on the road. [SEP] in a conference [SEP]
+
+===== sample 045 =====
+[CLS] insurers. [SEP] i spoke to her right outside. [SEP] "so we're going to get in a little more than a little bit," he said. [SEP] "it is a game that we don't know in the past, yet we all have a respect for the players. [SEP] he has described his attacker as a" little henger. "[SEP] i dished out and he seemed to be able to make his way. [SEP]" it's been a quarter of a century, " she said. [SEP] the government has announced the release of tens of thousands of police, police and intelligence workers, from [SEP]
+
+===== sample 046 =====
+[CLS] said. [SEP] if you are successful, you will have to be careful before the end of the season. [SEP] the man is in custody and police are trying to get any further information. [SEP] he even looked as if the answer was a complete lack of effort. [SEP] but mr. brown said the question of this needed to be addressed. [SEP] the bank suffered $3. 4 billion in losses in the first quarter of fiscal 2008. [SEP] the entire site is supposed to be close to capacity. [SEP] after all, he said, most of the staff and crew would be allowed to come back in full by march. [SEP] " the truth [SEP]
+
+===== sample 047 =====
+[CLS] he worked out the layout of his wife's home, a one - bedroom apartment in seattle, he wrote. [SEP] "when i get to work, that's good. [SEP] it's strange he was in trouble, but at least he wanted to know how he felt when he was seeing himself on television, he said. [SEP] a number of sources said the council had no regrets. [SEP] it was a big step, according to lacker. [SEP]" it's going to be the last of the season, it's a matter of time, " he said. [SEP] i do not think we're trying [SEP]
+
+===== sample 048 =====
+[CLS] 000 troops. [SEP] british police would not comment on the incident. [SEP] he and his brother and sister were all released tuesday. [SEP] crude oil prices in the first six months of the year hit a record high of $65bn, up 14 per cent to $25. 4bn (£17. 7bn), on better - than - expected figures from oil and mining companies. [SEP] the house's bill also provides banks up to $2, 000 for loans, including loans and interest payments made to the fha. [SEP] but the figure's figure climbed to 7 per cent from 3. 7 million. [SEP] there [SEP]
+
+===== sample 049 =====
+[CLS] system, and the market is able to turn to mark - to - market capital growth. "[SEP]" if we were to win, we would have to get there, we have to go to win, and we would have to do whatever we could do, we would not do that, "mullen said. [SEP] it's good enough to take pride in life. [SEP]" it'd be nice to be taken up in the end, "nadal said. [SEP]" i do remember him. [SEP] as a result, a patient has to learn about how to talk to people. [SEP] in a statement, the organization [SEP]
+
+===== sample 050 =====
+[CLS] in chicago, has worked for several years at the university of maryland. [SEP] "of course, we have taken some steps to get out of the situation, we have to take it through, to get it done, right. [SEP]" every time i really have to do something, it's hard when i'm going to be in line for another year, "he told reporters after heading into the locker room. [SEP]" i came back in time and said, and she said, ' i've got got to do this, i wanted to play, and i wasn't really interested. [SEP] we're already [SEP]
+
+===== sample 051 =====
+[CLS] way to ensure that the end - of - life information on the web site has not been used, the post reported. [SEP] (21 - 22): you may be able to pay you off, especially when you do want to travel one way and pay off all the money on the holidays. [SEP] i have always wondered here about why people are going to be there. [SEP] the issue of land and water, the world's most sought - after area of long - term development, was resolved in a little less than a week. [SEP] one of the injured was a school teacher in peshawar, about 50 miles from the airport. [SEP]
+
+===== sample 052 =====
+[CLS] percent in the second quarter, is still looking to add the $3, 700 billion cut from the tarp program to the additional $50 billion in additional guarantees it would provide to help stabilize the financial system over the next year. [SEP] wilco had his first full game, leaving his left glove behind on the mound. [SEP] c £40, 000 (+ £36, 702). central london. £35, 000 - £30, 703 ( luling up to £39, 092 per annum. £32, 071 - 1. we are looking for a permanent b.... [SEP] " [SEP]
+
+===== sample 053 =====
+[CLS], those who live here have to live with their families, "he said. [SEP]" i don't think he should go to manchester because i'm sure he'd like to come back. [SEP] live in the pain of having to do what is required, "she said. [SEP] but the current human condition facing the tigers is not clear. [SEP]" if you stop the damage, the money is going to go around, you know. [SEP] what we've seen is a general improvement, "said mr corsi. [SEP] i'm not too sure," mr. catt said. [SEP] during the [SEP]
+
+===== sample 054 =====
+[CLS], then drove off for a walk and left at 2: 45 a. m., according to police at the scene. [SEP] beijing (reuters) - china's tough relations with dalai lama and beijing met again on monday to resolve a long - running dispute that has sparked growing tensions with china, according to u. s. officials. [SEP] " it's about money, it's about people when you're in people's control, trying to understand what people they are, giving them time and money, which means you want to do what you want to know to do.... [SEP] the difference is [SEP]
+
+===== sample 055 =====
+[CLS] to the polls. [SEP] "the choice for you is not to stick to any solution but to review matters now, to talk directly to the prime minister, the foreign minister," said britain's prime minister gordon brown. [SEP] "there's a question, we're going to say, ' if we are really prepared for this, we'll have an election, that's fine," daube said. [SEP] "we have not stopped, we have no plans," he said. [SEP] when he came to the project, he changed his mind, but promised that it would provide a little more space [SEP]
+
+===== sample 056 =====
+[CLS]. [SEP] i mean, i can spend too much time with him on our backs next year, but i wish i had just finished my first year, i'm sure we can get that too much attention. [SEP] he, however, was not in the audience. [SEP] but, that doesn't mean it's worth saying to me, that i know i want to do something about it, that i want to make an impact. [SEP] by the end of the week, all of us have returned to our vacation homes. [SEP] but for some of them, this kind of action must have seemed long ago. [SEP] the lack [SEP]
+
+===== sample 057 =====
+[CLS]m loss for the firm, which had revenue of £19, 000. [SEP] he's a very good person, " mr brown said. [SEP] well, i think it was a good idea. [SEP] we don't want to do anything about the greatness of life, but we do have to make a decision. [SEP] a combined total of more than 500, 000 sodas were sold, including more than 2, 000 to consumers in 2007, according to steve mellow, general manager of the beverage industry association. [SEP] the deal also includes two activities - - the gym, the golf club, the dining area, and [SEP]
+
+===== sample 058 =====
+[CLS] of rising debt into the economy. [SEP] however, that was brought to the attention. [SEP] the market then was down. [SEP] look at how you could get to see a lot of people reading stories and people here to read them. [SEP] it is not really what they want us to see. [SEP] if it comes back, i won't be looking out. [SEP] i just hope that all of this should be corrected. [SEP] don't expect them to tell me to do anything, as i always have to say here, but of course, i'm trying to tell you that it all happened in the united states. [SEP] [SEP]
+
+===== sample 059 =====
+[CLS] flights will be made from new york, the u. s. and canada. [SEP] it's a way to give you a break, a way to play, "biden said. [SEP]" i think for a lot of people, there's a problem, "he said. [SEP] we'd have to win. [SEP] he was mostly out of games in recent seasons, and he seemed to make quite a few hits. [SEP] his mother was unable to get to the hospital. [SEP]" there has been tremendous change in the team since the end of the year. [SEP] " i'm just saying these things when i [SEP]
+
+===== sample 060 =====
+[CLS] in the air. [SEP] it's not a game to plan, it's a "game of good communication." [SEP] as a result, ba faced the prospect of trying to take control of the group in case of a bankruptcy. [SEP] if an immediate decision is made, like the vote to strike in december, they would be able to do so. [SEP] they have never been in a room with family members, and they have a film and a documentary, a lot of movies, "she said. [SEP]" i saw the woman at the end of the flight on a curtain call. [SEP] that's right, " [SEP]
+
+===== sample 061 =====
+[CLS] i could care for him. [SEP] "i've got a career as a doctor, so it doesn't work for me anymore, it's not a good one," eno said. [SEP] i was happy for him. [SEP] if i want to become a science teacher, i have to do a few things, "rahm told reporters. [SEP]" we are unable to confirm the report to the committee and expect to give evidence to the full council later in march, and are working to get the further action forward, " the statement said. [SEP] in the second round of the conference title, the cavaliers won their [SEP]
+
+===== sample 062 =====
+[CLS].. fl. training - education is assigned to oversee........ and other activities related to this program. are immediately available to assist.... de.. in coordinating with international organizations, corporations and other.... mn. 08/07:/hh ( and many of you currently have.... in... il, paris, ct, and washington, dc. someone needs to be responsible for a position able to lead.... co. access to education, degree of experience... ct, level of experience to be a teacher or.. [SEP]
+
+===== sample 063 =====
+[CLS] the area. [SEP] "it increases the brain's ability to communicate," buffon said. [SEP] he's done that. [SEP] a person wants to look back at your eyes - - the eyes of a man - - but he gives up an outline of his mind every 15 minutes. [SEP] i have to remember how to take my time at the far end of things. [SEP] there is nothing more to this story in the spirit of adventure than the illusion of good quality. [SEP] look, they've only been a bit lower since the end of the year. [SEP] " we don't know how to go about it [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_256steps_n64/state_c1024_t1p45_raw_samples.txt

@@ -0,0 +1,228 @@
+state_c1024_t1p45
+{
+  "type": "summary",
+  "name": "state_c1024_t1p45",
+  "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt",
+  "step": 124000,
+  "decode": {
+    "kind": "categorical_fullvocab",
+    "config": "state_c1024_t1p45",
+    "steps": 256,
+    "model_t_mode": "post",
+    "support_power": 1.0,
+    "semantic_power": 1.0,
+    "endpoint_temp": 1.45,
+    "concentration_min": 1.0,
+    "concentration_max": 1024.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 28.415282971033125,
+    "nll_per_token": 3.3469271332084953,
+    "tokens": 9529
+  },
+  "diversity": {
+    "sample_entropy": 4.048794239038511,
+    "unique_tokens": 1473,
+    "token_count": 8192,
+    "distinct_1": 0.1798095703125,
+    "distinct_2": 0.5878444881889764,
+    "top_token_mass": 0.057861328125
+  }
+}
+
+===== sample 000 =====
+[CLS] of their excesses. [SEP] " and there was so little space in it and a little bit of what went on in it. [SEP] " i just haven ' t asked him. [SEP] my fear is simply that the government has done so much to resolve their problems. [SEP] dallas took the lead just 2 minutes 26 seconds into the second period. [SEP] " he has a lot, " he said. [SEP] cleveland trailed again at 8 : 31 of the third quarter, when james hit a 20 - footer to take a 50 - 52 lead. [SEP] according to the report, the investigation is continuing. [SEP] i prefer not to mention the [SEP]
+
+===== sample 001 =====
+[CLS] 2008. [SEP] james baker, one of khao ' s top advisors, said he believed that the president understood that the plant should be closed and that he would review the project. [SEP] " i knew my heart and i felt like i was wrong, but he wanted me to do it and i had to make a right decision against him. [SEP] but yes, i ' m in a quiet room in my office. [SEP] " some of these measures, such as safety - related measures, road safety and network rail transport, need to be done on a much greater scale, " the letter said. [SEP] he said that the government [SEP]
+
+===== sample 002 =====
+[CLS] ' s ministry of defense. [SEP] " i felt we had to achieve that goal because they had that sense of perspective, " he said. [SEP] total revenue for the full year 2009 expected to decrease by approximately $ 1, 000. $ 100 million for half of 2009 to $ 50 million for the remainder of 2009. [SEP] " even if they don ' t come to sleep, they have to stay away, " safira says. [SEP] when he really does, i suspect he ' s not enough. [SEP] " i feel that i will never be able to move to the end of life, " she said. [SEP] this is [SEP]
+
+===== sample 003 =====
+[CLS] pressure - - he will keep coming back at this point. [SEP] " instead, he doesn ' t like the system, doesn ' t like the one that took him back to the back of the house. [SEP] " unfortunately, we can ' t give a man much money. " [SEP] i don ' t think that it would be so easy. [SEP] but not yet, you can find out there. [SEP] it ' s hard to tell what is coming or where he is, when he ' s looking at the site. [SEP] tmz ' s wife chris, 28, has been married for more than 20 years. [SEP] i [SEP]
+
+===== sample 004 =====
+[CLS] in the area. [SEP] " we continue to do it in a private way, so i would love to stay in it. [SEP] the bbc writer will remain free until monday. [SEP] general manager joe girardi will make his move to atlanta with the new york jets. [SEP] i ' m not sure what to do. [SEP] no, he ' s trying to take his advantage, not his luck. [SEP] for now, congress is getting a little harder on the company. [SEP] i thought i could have done it a bit. [SEP] " i am not sorry, but god knows, this is something that makes him so good. [SEP] [SEP]
+
+===== sample 005 =====
+[CLS] crime. [SEP] it ' s an acute situation that, in turn, happens when one is out of the job. [SEP] chris bosh had two players each with 11 points, calvin harris had three turnovers, and carlos boozer scored two apiece for the jazz, losers for the first time in the first five games of the season. [SEP] i hope they won ' t. [SEP] i think it ' s a joke, but they don ' t tell me how much it costs. [SEP] i hope i can ' t say it ' s because you ' re the child, and if you had known my father, i would have [SEP]
+
+===== sample 006 =====
+[CLS] 3 percent in the third quarter, unchanged from april, from 6. 5 percent in the previous quarter. [SEP] during the boom, cars in housing were still more expensive than the summer of 2007, and us food prices went up for the worst month in their history. [SEP] the cause of the fire, he did not want to be identified. [SEP] i ' m really excited about it - - i know what i can do, " hecht said. [SEP] " he has a lot of goals, an average of eight games, and we cannot know yet whether he will be allowed to be in the finals, " he said. [SEP] [SEP]
+
+===== sample 007 =====
+[CLS] to expand that facility. [SEP] " if you want a player who wants to play, there ' s no way down the line. [SEP] and, maybe, they ' ve got to stay in the dark and try to pay attention to the plight of a man who hates everything. [SEP] " in light of the current crisis, no political solution is prepared to demonstrate the u. s. commitment to deal with the challenges of the process, " clinton said during a visit to dubai. [SEP] in august, the house passed its own health care bill, which cost more than $ 1. 4 billion between 2009 and 2010. [SEP] i have heard [SEP]
+
+===== sample 008 =====
+[CLS] big questions about the scope of her story. [SEP] i ' m not sure what you wrote about that. [SEP] the c. e. a. has a structure that is no different than the structure of the new regulator. [SEP] " we don ' t have time to think more on the issue, something we have got to do to save our economy. [SEP] " for me, i ' ve always had a struggle with cancer in my life, " he said. [SEP] the farc should get no immediate response. [SEP] if the brakes are pressed, you will stand on top of the back of the 300 - seat commuter train. [SEP] [SEP]
+
+===== sample 009 =====
+[CLS] due to sign the deal, the jets are about to finish a two - game slide. [SEP] and there has not been any word on the money that will flow to the fund in 2010. [SEP] in addition to co - worker ' s court fees, he appeared to have been speaking with the defendant after the accident, he said. [SEP] the group, led by the hedge fund tycoon, has pledged more than $ 7m ( £5. 7m ). [SEP] and in the end, after it ' s years of work, i see it. [SEP] " don ' t be afraid to deal with the environment, let alone [SEP]
+
+===== sample 010 =====
+[CLS] of chicago.... [SEP] they are close to zero. [SEP] which is a shame, but i can also say, what we ' ve got on the subject is so much campaign - related to the president. [SEP] so did the election of stupak ' s predecessor, representative harriet harman. [SEP] the journalist ' s release was a coup for the american journalists foundation, a los angeles - based organization. [SEP] the case, however, might have little to do with well - written and well - funded work. [SEP] " i was happy i didn ' t know exactly where i want to be from. [SEP] in 1996, [SEP]
+
+===== sample 011 =====
+[CLS]. [SEP] mr thompson said he did not expect " convincing evidence " to support the claims, but not much was changed. [SEP] and that is why it is so important. [SEP] it wouldn ' t be a nice thing to do but just get on a plane for a good day. [SEP] " i think the americans have moved on to their right. [SEP] it was an incredible experience, but when i don ' t get given the opportunity to live in the hands of the world, i would be willing to do that, " he said. [SEP] it turns out that he can barely afford to have a black watch on his head. [SEP] [SEP]
+
+===== sample 012 =====
+[CLS] of up to some 6, 000 jobs. [SEP] it ' s just a lot of work, no idea. [SEP] chief fire officer john williams, of middlesbrough, said there was no need for an investigation into the incident. [SEP] the application has not been changed yet, but the date of appeal, which has been delayed until saturday, as the application has not been awarded so far, has been announced. [SEP] the person who did not want to be identified. [SEP] the hotel has a security staff, accompanied by a number of non - security staff, is due to close the doors after the weekend. [SEP] we have stood on top of [SEP]
+
+===== sample 013 =====
+[CLS] to recession, the us economy would face the worst economic recession in the world in two decades. [SEP] the company also acknowledged that the false statement was misleading to investors, and that some of the allegations are true. [SEP] after the hearing, she left a note with marks on his head saying he doesn ' t speak. [SEP] you can do it better. [SEP] the number was equal to 2. 5 million jobs in 2009. [SEP] at the end of the iraq war, most of the militants were fighting for u. s. forces in afghanistan. [SEP] " what we had to do was deal with this, " ms martin added. [SEP] [SEP]
+
+===== sample 014 =====
+[CLS] do anything for our team to do with our performance, " he said. [SEP] no matter how hard we work to find the job, they put us in the best we can ' t. [SEP] if you live in your own financial system, you can ' t make too much of it. [SEP] not surprisingly, the team has struggled to keep up with washington ' s eighth - inning success. [SEP] small businesses get about $ 3 billion a year in emergency emergency loans. [SEP] he had only scored four runs in the series, including three of four games in the series, including one in the eighth. [SEP] " the incident is a huge [SEP]
+
+===== sample 015 =====
+[CLS] no danger to their aircraft. [SEP] " in the case of a point here, it would seem like we could pull this out, but when we do it a bit, then it can really get even a little easier, " he said. [SEP] the study, based on computer data, was also conducted by paul gordon of new york university. [SEP] i knew that i wanted to be happy, i just wanted to sit down at the end of the day. [SEP] i ' m confident that if i really feel i ' m going to get fired, that would be a good thing then, " he said. [SEP] so, perhaps, [SEP]
+
+===== sample 016 =====
+[CLS], it ' s all drug - free. [SEP] he said : he ' s been under constant pressure for many years, but he has little time on tour, has already made some mistakes in international training and he has a lot to do. [SEP] the man took off in the area as the aircraft dropped off and went to police to face treatment. [SEP] " the conference will give the most powerful signal to the security of the palestinian state, and signal the president ' s commitment to maintain the security of the west bank, " said an official at the state department. [SEP] it is supported by the fact that millions of people have access to [SEP]
+
+===== sample 017 =====
+[CLS] the number of visitors. [SEP] " we have had a great year, " he said. [SEP] we are ready for them. [SEP] but there is no reason to doubt that. [SEP] all the way, you ' re right. [SEP] that ' s part of the problem. [SEP] " i think, at least, we believe that there was any kind of information, " the official declared, " but nobody knows that. " [SEP] the economy was an important contribution to obama ' s reform plans during the bush administration. [SEP] the site was built over the past year. [SEP] we are running out of the question of what happens to the political [SEP]
+
+===== sample 018 =====
+[CLS] relief. [SEP] i ' ll just look into her. [SEP] " i don ' t have that question. [SEP] make it before we can even make it to school. [SEP] " we knew we would all need our help and then we knew, " the statement said. [SEP] " it ' s disappointing, " he said. [SEP] mr brown also thinks he may have to pay his bills at the conference. [SEP] but i think it does have a lot of positive energy and makes you feel pretty good about doing those things. [SEP] a little odd to me. [SEP] however, in his speech, he said, " i don ' t think [SEP]
+
+===== sample 019 =====
+[CLS] gmt. [SEP] the average price of single - or single - family homes in california is expected to rise by 50 percent in the next 12 months. [SEP] at the moment, we don ' t have much room or even an extra room. [SEP] the literary pleasures of a book to read - - books, such as " an evening, a day, " and a bunch of " cookbooks " - - are the theme of the nation ' s literary traditions. [SEP] " none of the lawyers involved at the high court have been suspended. [SEP] but it ' s a shame, and it ' s not too bad for one of us [SEP]
+
+===== sample 020 =====
+[CLS] 2009. [SEP] then he explains that he did not have the position on his hands. [SEP] standing at the back of the audience, he appeared to have a large, airy, cartoon - like look. [SEP] on the other side, clinton, 66, put together a large bunch of bread and a piece. [SEP] the person who made the announcement had no intention of leaving at the time and signing a deal, people familiar with the negotiations said. [SEP] he has little mobility and is able to walk for 15 minutes, and his son is only six years old. [SEP] the average amount of a home will be about $ 1, 000 [SEP]
+
+===== sample 021 =====
+[CLS] 2010. [SEP] the entire us economy has slipped into a state of recession. [SEP] the fact is that greer, the french - born author of the sex drive, is no longer willing to look elsewhere to see his work and his resumes. [SEP] you can buy a number of things that are bigger - than - life. [SEP] mr brown said the move was a " very important partnership " for ssp, a uk - based organisation, which has become a household name. [SEP] " we just have to get really serious, it sort of all is wrong, but we want to get something better, " he said. [SEP] the company [SEP]
+
+===== sample 022 =====
+[CLS] of his departure from the competition, the paper added. [SEP] they never made it to us and that means we have never got the best of the world. [SEP] sure, he hit the head and swiveled it off the track, but the 40 - year old got away from the field and fought back. [SEP] the attack took place in the sunni region of east baghdad. [SEP] " it ' s time to try to balance the puzzle and put my hands together, i ' ll be in a position to go, " he said. [SEP] he ' s also trying to prove that he ' s got his hand in afghanistan. [SEP] [SEP]
+
+===== sample 023 =====
+[CLS] take place in the aug. [SEP] " they need to get in touch with their children because it is their school, their family, " dr clasley says. [SEP] " i had a lot of money to set up but it didn ' t mean that i can ' t buy. [SEP] there is one reason to avoid strawberry wambar, the tomato - flavored dessert flavored with butter - like chocolate. [SEP] the dems, if not democrats, make an easy effort to explain themselves, not themselves. [SEP] during their three - year term, the company developed a number of small and high - energy power products in the [SEP]
+
+===== sample 024 =====
+[CLS] want to get access to education. [SEP] it is part of the city ' s 100 - year - old communal tradition. [SEP] mr. stauer was able to fill in the interview, which he did, even when he was 13, with one of her children, who had to do with her job, but didn ' t have the money to do it in public. [SEP] " i don ' t want anything in your car, " she said. [SEP] normally, i only knew if i wanted to know if things would go wrong, but that would do a lot of work. [SEP] bp, the world ' s largest operator [SEP]
+
+===== sample 025 =====
+[CLS] see it, " he said. [SEP] that is when i don ' t like to be at a club. [SEP] yet, no one wanted to change their mind. [SEP] in addition, there will be a chance to bring democracy to haiti. [SEP] the problem, of course, is that unless the last one in the greek mythology is solved, suddenly it looks like something might have happened. [SEP] the man, who is unconscious, left the scene and left in a waiting car. [SEP] but that ' s not news. [SEP] i don ' t want to... [SEP] this is more of a new start, expected to take about [SEP]
+
+===== sample 026 =====
+[CLS] price of $ 50. [SEP] if you had weapons, communications, equipment, water, education, nothing would come out of them. [SEP] " i don ' t think you want to do that but if we get off better we play very well. [SEP] on september 11, 2003, the ranger ' s helicopter went down on the ground. [SEP] so far, markets have taken a bit of action in recent days. [SEP] he said the company does not report earnings in the near term. [SEP] " i can ' t tell you why he ended up for the presidency - - but i have had a lot of conversation, " he says. [SEP]
+
+===== sample 027 =====
+[CLS] really close to trying to get your foot back in the office. [SEP] i believe that my son can do, i just think we do what we need. [SEP] the ruling must be returned to the court on wednesday. [SEP] " it ' s a lot that ' s still a problem, " he said. [SEP] if you bought a bike and thought it was a good idea, what would any of us have to do then? [SEP] i don ' t have to have a love thing, " she said. [SEP] however, it does not seem appropriate that the old boys seemed to reject it. [SEP] dr michael jordan, the doctor who [SEP]
+
+===== sample 028 =====
+[CLS] 2. 06 percent. [SEP] retail sales for the six months to january are 0. 7 per cent higher than in the year to march, according to official figures from the aa. [SEP] then he got to buy everything he knew - - and began to take his clothes at home - - and even put in one of his own - - in the back of the building, just to know something he had done. [SEP] so that is the right point. [SEP] the red wings took control in the opening period with 9 minutes left late into the third. [SEP] there will also need to be a better atmosphere at the club. [SEP] however, [SEP]
+
+===== sample 029 =====
+[CLS], simmons 0 - 0 - 1 0 - 0, bell 0 - 5 0 - 0 0 - 0 0 0 - 0 2, mobley 5 - 11, thomas 5 - 16, chicago 1 - 4. [SEP] the report, which is the first project to be released by the company, told the times it has become possible for more people to get in touch with their children rather than simply getting to the site. [SEP] " it feels like i ' m going to die. [SEP] sales in june rose 11. 4 per cent to $ 100, 000. [SEP] irvine, calif. - if you know what ' s going [SEP]
+
+===== sample 030 =====
+[CLS] the end, to the end, and we have to get to the end of the story. [SEP] however, he spent part of a decade working for a provincial government, and in 2007 he worked in several companies. [SEP] the former president praised brawn ' s selection of hamilton, an eight - time world champion and a 13 - time champion, to win the four - man team in beijing. [SEP] but what we need to do is sit back and get a look of the place. [SEP] that ' s not to say that, if you ' re willing to go along with your bill, take a break. [SEP] however, they [SEP]
+
+===== sample 031 =====
+[CLS] hands disappeared into the air. [SEP] the nets led 50 - 50 with 1 minutes left in the opening period less than two minutes into the half. [SEP] when you think about the characters, you feel very old. [SEP] the s & p 500 was down 0. 5 percent, but the new york - based nasdaq composite index lost 0. 6 percent to 2, 724. 80. [SEP] but this was a gain of a little more than. 9 percent in december, with the market already at the top of the agenda. [SEP] " we lived for 80 years, so we ' re there, " he said. [SEP] [SEP]
+
+===== sample 032 =====
+[CLS] bush ' s top diplomat, said at a news briefing held on the morning of july 11 that the afghan government, with support from us and other international forces, should not try to face the possibility of a real arms race. [SEP] i think he ' s a very good player... [SEP] " obviously, if we thought we ' d never have been, there was something we can do to have one, we have, but we have one, we will stay out, we will come in, " said davis, who was among nine staffers - - all of them who lost their own seat. [SEP] he refused to answer [SEP]
+
+===== sample 033 =====
+[CLS], 000 school children were among the 70, 000 people affected by the earthquake. [SEP] he allowed only two runs in 4 1 / 3 - 2 3 / 3 innings and one walk for the tigers. [SEP] i don ' t like to talk about the marriage. [SEP] american officials have also warned that there will be a " significant risk " if the u. s. continues to pursue a military effort against al - qaida. [SEP] but the burdens, however, can only be applied to the public face of what has been a structural imbalance in their economies and other rich nations. [SEP] it ' s even more complicated, [SEP]
+
+===== sample 034 =====
+[CLS] do not believe there is any evidence that the security agreement in iraq has been ended. [SEP] since obama has promised to end all the civil rights, if not necessary, it would be an attempt to start a democratic campaign to end this process. [SEP] the idea is to place large pots of corn in the crooks of a road, in place of branches, cars and trees. [SEP] like me, however, i feel a little more confident, if with a little look and a little smile. [SEP] an estimated 4. 5 million people are homeless. [SEP] " i ' m trying to finish, " he said. [SEP] he also wants [SEP]
+
+===== sample 035 =====
+[CLS] rose to 28. 5 % for the year from 26. 3 % a year ago. [SEP] the only option for a second vaccine is to check the safety and health effects of the vaccine. [SEP] a 33 - year - old nigerian man, charged with resisting police bail, jumped onto the air force ' s flight to the united states. [SEP] i hope that someone will make it out there and take them to the game, " he said. [SEP] also at the same time, spain ' s new defense minister, carlos borges, also said he would ask the european union to increase military force in afghanistan. [SEP] the e - mail [SEP]
+
+===== sample 036 =====
+[CLS] of the detainees, but said he had no idea of them. [SEP] " when we realized he was still five miles away, we thought he was right in the air and it was great to walk, " said james molinaro, a 38 - year - old campaign office manager. [SEP] in the end, everything is dead. [SEP] " i have to sacrifice my patience to get things done. [SEP] when i run into a couple of things, i ' d like to be realistic. [SEP] " we ' ll look at a state level to have a much greater understanding of what an individual is in the workplace. [SEP] that ' s when [SEP]
+
+===== sample 037 =====
+[CLS] said. [SEP] " it would normally have been an act of money, but sometimes it is just really simple, " he said. [SEP] " no one is not going to get involved, " he said. [SEP] i ' ve been doing it since the start of the season and, had i been there for a while, it usually became a very long trip. [SEP] " you cannot feel the pressure. [SEP] " if there is a guy that is going to be a lot of pressure, i will not make any changes, " he said. [SEP] there are other assets that could be useful to investors in the long run. [SEP] the [SEP]
+
+===== sample 038 =====
+[CLS] two other us service personnel were killed in a helicopter bomb crash in afghanistan. [SEP] " you can see how we do things. [SEP] it is good to think it ' s important to understand that there ' s something written in that - - and try to get some feedback on it. [SEP] that is our thought for a couple of months. [SEP] " i don ' t want to see what is changed. [SEP] together, they ' re lovely and sexy, it ' s more realistic and romantic. [SEP] " i never had anyone in the national team, i never had a taste for it. [SEP] so, i understand. [SEP] and if [SEP]
+
+===== sample 039 =====
+[CLS] in january 2010. [SEP] his identity was confirmed by his prison guards before he was returned to the prison, where he was held there in october 2002. [SEP] " it is not when you talk, when you look for a joke, " he said. [SEP] i thought i went too far. [SEP] but he said that there would be a five - year deal with germany, an end to the war in afghanistan, as well as iran. [SEP] i think most of the iranian people would have been able to turn their country into a democracy. [SEP] the president ' s vacation needs to last for a week or two. [SEP] she moved her [SEP]
+
+===== sample 040 =====
+[CLS] ' s up to them. [SEP] i ' m not going to apologize, i don ' t like what the law says. [SEP] you never see it again, " he said. [SEP] he ' s no regrets, and no regrets, but he also seems to have to go through a couple of problems at the end of the game. [SEP] he ' s a nice guy and with a good balance and able to get things started. [SEP] but we have to work hard in the n. f. c. at all to be one of those who don ' t really want to lose - - they ' re kind of going to keep [SEP]
+
+===== sample 041 =====
+[CLS] in the case of the state, he said. [SEP] it is posted on the website and is only 56 % true. [SEP] but i wanted to get home. [SEP] the plant has an additional 1, 200 manufacturing capacity and is more than 5, 000 square miles ( 3, 300 ), he said. [SEP] in fact, the floor is full for you, and at this moment, it ' s all in the shape of the second floor, and when you see the room at the door, there ' s no living room, no chairs, or bedroom. [SEP] the british military will resume its regular exercise with a technical training centre [SEP]
+
+===== sample 042 =====
+[CLS] to spend much of the day. [SEP] " i ' ve never done any of my tests and i know when he is going to play south africa i don ' t think that that is something i really want to do again, " said wester. [SEP] it is that if there has to be a person living in the city - - it is like the end of a political year. [SEP] a spokesman for doug hoffman, a davis ' lawyer, said he had told the jury that the attack was of public safety and that he did not have the right to take action in the court. [SEP] i don ' t think a real estate [SEP]
+
+===== sample 043 =====
+[CLS] agenda. [SEP] mr. cohen returned to europe to run the company in a further few years. [SEP] it ' s possible, in the general sense, that we have to put on a show of, well, something that has a history, i ' d love to have a chance to show that, to do something in a bit of context. [SEP] he added that, among other things, the uk could become more able to deal with long - term problems. [SEP] the north has begun making new travel plans to allow aid and entry to the border, and also has ordered a full end of access to the buffer zone. [SEP] the [SEP]
+
+===== sample 044 =====
+[CLS] he was wearing brown jeans and armed with a white shirt, an coloured jacket and a white tie. [SEP] he said : " he has never had a lot of money. [SEP] that ' s a big thing. [SEP] " i have to say the last three years, you are following one of the many things that have come on in the last 10 years. [SEP] the real deal is insurance. [SEP] that ' s what they can do. [SEP] that isn ' t what we want, he says. [SEP] the team knows that he will be able to take part at milan, but he is always on the road. [SEP] in a conference [SEP]
+
+===== sample 045 =====
+[CLS] insurers. [SEP] i spoke to her right outside. [SEP] " so we ' re going to get in a little more than a little bit, " he said. [SEP] " it is a game that we don ' t know in the past, yet we all have a respect for the players. [SEP] he has described his attacker as a " little henger. " [SEP] i dished out and he seemed to be able to make his way. [SEP] " it ' s been a quarter of a century, " she said. [SEP] the government has announced the release of tens of thousands of police, police and intelligence workers, from [SEP]
+
+===== sample 046 =====
+[CLS] said. [SEP] if you are successful, you will have to be careful before the end of the season. [SEP] the man is in custody and police are trying to get any further information. [SEP] he even looked as if the answer was a complete lack of effort. [SEP] but mr. brown said the question of this needed to be addressed. [SEP] the bank suffered $ 3. 4 billion in losses in the first quarter of fiscal 2008. [SEP] the entire site is supposed to be close to capacity. [SEP] after all, he said, most of the staff and crew would be allowed to come back in full by march. [SEP] " the truth [SEP]
+
+===== sample 047 =====
+[CLS] he worked out the layout of his wife ' s home, a one - bedroom apartment in seattle, he wrote. [SEP] " when i get to work, that ' s good. [SEP] it ' s strange he was in trouble, but at least he wanted to know how he felt when he was seeing himself on television, he said. [SEP] a number of sources said the council had no regrets. [SEP] it was a big step, according to lacker. [SEP] " it ' s going to be the last of the season, it ' s a matter of time, " he said. [SEP] i do not think we ' re trying [SEP]
+
+===== sample 048 =====
+[CLS] 000 troops. [SEP] british police would not comment on the incident. [SEP] he and his brother and sister were all released tuesday. [SEP] crude oil prices in the first six months of the year hit a record high of $ 65bn, up 14 per cent to $ 25. 4bn ( £17. 7bn ), on better - than - expected figures from oil and mining companies. [SEP] the house ' s bill also provides banks up to $ 2, 000 for loans, including loans and interest payments made to the fha. [SEP] but the figure ' s figure climbed to 7 per cent from 3. 7 million. [SEP] there [SEP]
+
+===== sample 049 =====
+[CLS] system, and the market is able to turn to mark - to - market capital growth. " [SEP] " if we were to win, we would have to get there, we have to go to win, and we would have to do whatever we could do, we would not do that, " mullen said. [SEP] it ' s good enough to take pride in life. [SEP] " it ' d be nice to be taken up in the end, " nadal said. [SEP] " i do remember him. [SEP] as a result, a patient has to learn about how to talk to people. [SEP] in a statement, the organization [SEP]
+
+===== sample 050 =====
+[CLS] in chicago, has worked for several years at the university of maryland. [SEP] " of course, we have taken some steps to get out of the situation, we have to take it through, to get it done, right. [SEP] " every time i really have to do something, it ' s hard when i ' m going to be in line for another year, " he told reporters after heading into the locker room. [SEP] " i came back in time and said, and she said, ' i ' ve got got to do this, i wanted to play, and i wasn ' t really interested. [SEP] we ' re already [SEP]
+
+===== sample 051 =====
+[CLS] way to ensure that the end - of - life information on the web site has not been used, the post reported. [SEP] ( 21 - 22 ) : you may be able to pay you off, especially when you do want to travel one way and pay off all the money on the holidays. [SEP] i have always wondered here about why people are going to be there. [SEP] the issue of land and water, the world ' s most sought - after area of long - term development, was resolved in a little less than a week. [SEP] one of the injured was a school teacher in peshawar, about 50 miles from the airport. [SEP]
+
+===== sample 052 =====
+[CLS] percent in the second quarter, is still looking to add the $ 3, 700 billion cut from the tarp program to the additional $ 50 billion in additional guarantees it would provide to help stabilize the financial system over the next year. [SEP] wilco had his first full game, leaving his left glove behind on the mound. [SEP] c £40, 000 ( + £36, 702 ). central london. £35, 000 - £30, 703 ( luling up to £39, 092 per annum. £32, 071 - 1. we are looking for a permanent b.... [SEP] " [SEP]
+
+===== sample 053 =====
+[CLS], those who live here have to live with their families, " he said. [SEP] " i don ' t think he should go to manchester because i ' m sure he ' d like to come back. [SEP] live in the pain of having to do what is required, " she said. [SEP] but the current human condition facing the tigers is not clear. [SEP] " if you stop the damage, the money is going to go around, you know. [SEP] what we ' ve seen is a general improvement, " said mr corsi. [SEP] i ' m not too sure, " mr. catt said. [SEP] during the [SEP]
+
+===== sample 054 =====
+[CLS], then drove off for a walk and left at 2 : 45 a. m., according to police at the scene. [SEP] beijing ( reuters ) - china ' s tough relations with dalai lama and beijing met again on monday to resolve a long - running dispute that has sparked growing tensions with china, according to u. s. officials. [SEP] " it ' s about money, it ' s about people when you ' re in people ' s control, trying to understand what people they are, giving them time and money, which means you want to do what you want to know to do.... [SEP] the difference is [SEP]
+
+===== sample 055 =====
+[CLS] to the polls. [SEP] " the choice for you is not to stick to any solution but to review matters now, to talk directly to the prime minister, the foreign minister, " said britain ' s prime minister gordon brown. [SEP] " there ' s a question, we ' re going to say, ' if we are really prepared for this, we ' ll have an election, that ' s fine, " daube said. [SEP] " we have not stopped, we have no plans, " he said. [SEP] when he came to the project, he changed his mind, but promised that it would provide a little more space [SEP]
+
+===== sample 056 =====
+[CLS]. [SEP] i mean, i can spend too much time with him on our backs next year, but i wish i had just finished my first year, i ' m sure we can get that too much attention. [SEP] he, however, was not in the audience. [SEP] but, that doesn ' t mean it ' s worth saying to me, that i know i want to do something about it, that i want to make an impact. [SEP] by the end of the week, all of us have returned to our vacation homes. [SEP] but for some of them, this kind of action must have seemed long ago. [SEP] the lack [SEP]
+
+===== sample 057 =====
+[CLS]m loss for the firm, which had revenue of £19, 000. [SEP] he ' s a very good person, " mr brown said. [SEP] well, i think it was a good idea. [SEP] we don ' t want to do anything about the greatness of life, but we do have to make a decision. [SEP] a combined total of more than 500, 000 sodas were sold, including more than 2, 000 to consumers in 2007, according to steve mellow, general manager of the beverage industry association. [SEP] the deal also includes two activities - - the gym, the golf club, the dining area, and [SEP]
+
+===== sample 058 =====
+[CLS] of rising debt into the economy. [SEP] however, that was brought to the attention. [SEP] the market then was down. [SEP] look at how you could get to see a lot of people reading stories and people here to read them. [SEP] it is not really what they want us to see. [SEP] if it comes back, i won ' t be looking out. [SEP] i just hope that all of this should be corrected. [SEP] don ' t expect them to tell me to do anything, as i always have to say here, but of course, i ' m trying to tell you that it all happened in the united states. [SEP] [SEP]
+
+===== sample 059 =====
+[CLS] flights will be made from new york, the u. s. and canada. [SEP] it ' s a way to give you a break, a way to play, " biden said. [SEP] " i think for a lot of people, there ' s a problem, " he said. [SEP] we ' d have to win. [SEP] he was mostly out of games in recent seasons, and he seemed to make quite a few hits. [SEP] his mother was unable to get to the hospital. [SEP] " there has been tremendous change in the team since the end of the year. [SEP] " i ' m just saying these things when i [SEP]
+
+===== sample 060 =====
+[CLS] in the air. [SEP] it ' s not a game to plan, it ' s a " game of good communication. " [SEP] as a result, ba faced the prospect of trying to take control of the group in case of a bankruptcy. [SEP] if an immediate decision is made, like the vote to strike in december, they would be able to do so. [SEP] they have never been in a room with family members, and they have a film and a documentary, a lot of movies, " she said. [SEP] " i saw the woman at the end of the flight on a curtain call. [SEP] that ' s right, " [SEP]
+
+===== sample 061 =====
+[CLS] i could care for him. [SEP] " i ' ve got a career as a doctor, so it doesn ' t work for me anymore, it ' s not a good one, " eno said. [SEP] i was happy for him. [SEP] if i want to become a science teacher, i have to do a few things, " rahm told reporters. [SEP] " we are unable to confirm the report to the committee and expect to give evidence to the full council later in march, and are working to get the further action forward, " the statement said. [SEP] in the second round of the conference title, the cavaliers won their [SEP]
+
+===== sample 062 =====
+[CLS].. fl. training - education is assigned to oversee........ and other activities related to this program. are immediately available to assist.... de.. in coordinating with international organizations, corporations and other.... mn. 08 / 07 : / hh ( and many of you currently have.... in... il, paris, ct, and washington, dc. someone needs to be responsible for a position able to lead.... co. access to education, degree of experience... ct, level of experience to be a teacher or.. [SEP]
+
+===== sample 063 =====
+[CLS] the area. [SEP] " it increases the brain ' s ability to communicate, " buffon said. [SEP] he ' s done that. [SEP] a person wants to look back at your eyes - - the eyes of a man - - but he gives up an outline of his mind every 15 minutes. [SEP] i have to remember how to take my time at the far end of things. [SEP] there is nothing more to this story in the spirit of adventure than the illusion of good quality. [SEP] look, they ' ve only been a bit lower since the end of the year. [SEP] " we don ' t know how to go about it [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_256steps_n64/state_c1024_t1p45_scored.jsonl

@@ -0,0 +1,65 @@
+{"type": "summary", "name": "state_c1024_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c1024_t1p45", "steps": 256, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 1024.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 28.415282971033125, "nll_per_token": 3.3469271332084953, "tokens": 9529}, "diversity": {"sample_entropy": 4.048794239038511, "unique_tokens": 1473, "token_count": 8192, "distinct_1": 0.1798095703125, "distinct_2": 0.5878444881889764, "top_token_mass": 0.057861328125}}
+{"type": "sample", "index": 0, "raw_text": "[CLS] of their excesses. [SEP] \" and there was so little space in it and a little bit of what went on in it. [SEP] \" i just haven ' t asked him. [SEP] my fear is simply that the government has done so much to resolve their problems. [SEP] dallas took the lead just 2 minutes 26 seconds into the second period. [SEP] \" he has a lot, \" he said. [SEP] cleveland trailed again at 8 : 31 of the third quarter, when james hit a 20 - footer to take a 50 - 52 lead. [SEP] according to the report, the investigation is continuing. [SEP] i prefer not to mention the [SEP]", "detok_text": "[CLS] of their excesses. [SEP] \"and there was so little space in it and a little bit of what went on in it. [SEP]\" i just haven't asked him. [SEP] my fear is simply that the government has done so much to resolve their problems. [SEP] dallas took the lead just 2 minutes 26 seconds into the second period. [SEP] \"he has a lot,\" he said. [SEP] cleveland trailed again at 8: 31 of the third quarter, when james hit a 20 - footer to take a 50 - 52 lead. [SEP] according to the report, the investigation is continuing. [SEP] i prefer not to mention the [SEP]"}
+{"type": "sample", "index": 1, "raw_text": "[CLS] 2008. [SEP] james baker, one of khao ' s top advisors, said he believed that the president understood that the plant should be closed and that he would review the project. [SEP] \" i knew my heart and i felt like i was wrong, but he wanted me to do it and i had to make a right decision against him. [SEP] but yes, i ' m in a quiet room in my office. [SEP] \" some of these measures, such as safety - related measures, road safety and network rail transport, need to be done on a much greater scale, \" the letter said. [SEP] he said that the government [SEP]", "detok_text": "[CLS] 2008. [SEP] james baker, one of khao's top advisors, said he believed that the president understood that the plant should be closed and that he would review the project. [SEP] \"i knew my heart and i felt like i was wrong, but he wanted me to do it and i had to make a right decision against him. [SEP] but yes, i'm in a quiet room in my office. [SEP]\" some of these measures, such as safety - related measures, road safety and network rail transport, need to be done on a much greater scale, \" the letter said. [SEP] he said that the government [SEP]"}
+{"type": "sample", "index": 2, "raw_text": "[CLS] ' s ministry of defense. [SEP] \" i felt we had to achieve that goal because they had that sense of perspective, \" he said. [SEP] total revenue for the full year 2009 expected to decrease by approximately $ 1, 000. $ 100 million for half of 2009 to $ 50 million for the remainder of 2009. [SEP] \" even if they don ' t come to sleep, they have to stay away, \" safira says. [SEP] when he really does, i suspect he ' s not enough. [SEP] \" i feel that i will never be able to move to the end of life, \" she said. [SEP] this is [SEP]", "detok_text": "[CLS]'s ministry of defense. [SEP] \"i felt we had to achieve that goal because they had that sense of perspective,\" he said. [SEP] total revenue for the full year 2009 expected to decrease by approximately $1, 000. $100 million for half of 2009 to $50 million for the remainder of 2009. [SEP] \"even if they don't come to sleep, they have to stay away,\" safira says. [SEP] when he really does, i suspect he's not enough. [SEP] \"i feel that i will never be able to move to the end of life,\" she said. [SEP] this is [SEP]"}
+{"type": "sample", "index": 3, "raw_text": "[CLS] pressure - - he will keep coming back at this point. [SEP] \" instead, he doesn ' t like the system, doesn ' t like the one that took him back to the back of the house. [SEP] \" unfortunately, we can ' t give a man much money. \" [SEP] i don ' t think that it would be so easy. [SEP] but not yet, you can find out there. [SEP] it ' s hard to tell what is coming or where he is, when he ' s looking at the site. [SEP] tmz ' s wife chris, 28, has been married for more than 20 years. [SEP] i [SEP]", "detok_text": "[CLS] pressure - - he will keep coming back at this point. [SEP] \"instead, he doesn't like the system, doesn't like the one that took him back to the back of the house. [SEP]\" unfortunately, we can't give a man much money. \" [SEP] i don't think that it would be so easy. [SEP] but not yet, you can find out there. [SEP] it's hard to tell what is coming or where he is, when he's looking at the site. [SEP] tmz's wife chris, 28, has been married for more than 20 years. [SEP] i [SEP]"}
+{"type": "sample", "index": 4, "raw_text": "[CLS] in the area. [SEP] \" we continue to do it in a private way, so i would love to stay in it. [SEP] the bbc writer will remain free until monday. [SEP] general manager joe girardi will make his move to atlanta with the new york jets. [SEP] i ' m not sure what to do. [SEP] no, he ' s trying to take his advantage, not his luck. [SEP] for now, congress is getting a little harder on the company. [SEP] i thought i could have done it a bit. [SEP] \" i am not sorry, but god knows, this is something that makes him so good. [SEP] [SEP]", "detok_text": "[CLS] in the area. [SEP] \"we continue to do it in a private way, so i would love to stay in it. [SEP] the bbc writer will remain free until monday. [SEP] general manager joe girardi will make his move to atlanta with the new york jets. [SEP] i'm not sure what to do. [SEP] no, he's trying to take his advantage, not his luck. [SEP] for now, congress is getting a little harder on the company. [SEP] i thought i could have done it a bit. [SEP]\" i am not sorry, but god knows, this is something that makes him so good. [SEP] [SEP]"}
+{"type": "sample", "index": 5, "raw_text": "[CLS] crime. [SEP] it ' s an acute situation that, in turn, happens when one is out of the job. [SEP] chris bosh had two players each with 11 points, calvin harris had three turnovers, and carlos boozer scored two apiece for the jazz, losers for the first time in the first five games of the season. [SEP] i hope they won ' t. [SEP] i think it ' s a joke, but they don ' t tell me how much it costs. [SEP] i hope i can ' t say it ' s because you ' re the child, and if you had known my father, i would have [SEP]", "detok_text": "[CLS] crime. [SEP] it's an acute situation that, in turn, happens when one is out of the job. [SEP] chris bosh had two players each with 11 points, calvin harris had three turnovers, and carlos boozer scored two apiece for the jazz, losers for the first time in the first five games of the season. [SEP] i hope they won't. [SEP] i think it's a joke, but they don't tell me how much it costs. [SEP] i hope i can't say it's because you're the child, and if you had known my father, i would have [SEP]"}
+{"type": "sample", "index": 6, "raw_text": "[CLS] 3 percent in the third quarter, unchanged from april, from 6. 5 percent in the previous quarter. [SEP] during the boom, cars in housing were still more expensive than the summer of 2007, and us food prices went up for the worst month in their history. [SEP] the cause of the fire, he did not want to be identified. [SEP] i ' m really excited about it - - i know what i can do, \" hecht said. [SEP] \" he has a lot of goals, an average of eight games, and we cannot know yet whether he will be allowed to be in the finals, \" he said. [SEP] [SEP]", "detok_text": "[CLS] 3 percent in the third quarter, unchanged from april, from 6. 5 percent in the previous quarter. [SEP] during the boom, cars in housing were still more expensive than the summer of 2007, and us food prices went up for the worst month in their history. [SEP] the cause of the fire, he did not want to be identified. [SEP] i'm really excited about it - - i know what i can do, \"hecht said. [SEP]\" he has a lot of goals, an average of eight games, and we cannot know yet whether he will be allowed to be in the finals, \" he said. [SEP] [SEP]"}
+{"type": "sample", "index": 7, "raw_text": "[CLS] to expand that facility. [SEP] \" if you want a player who wants to play, there ' s no way down the line. [SEP] and, maybe, they ' ve got to stay in the dark and try to pay attention to the plight of a man who hates everything. [SEP] \" in light of the current crisis, no political solution is prepared to demonstrate the u. s. commitment to deal with the challenges of the process, \" clinton said during a visit to dubai. [SEP] in august, the house passed its own health care bill, which cost more than $ 1. 4 billion between 2009 and 2010. [SEP] i have heard [SEP]", "detok_text": "[CLS] to expand that facility. [SEP] \"if you want a player who wants to play, there's no way down the line. [SEP] and, maybe, they've got to stay in the dark and try to pay attention to the plight of a man who hates everything. [SEP]\" in light of the current crisis, no political solution is prepared to demonstrate the u. s. commitment to deal with the challenges of the process, \" clinton said during a visit to dubai. [SEP] in august, the house passed its own health care bill, which cost more than $1. 4 billion between 2009 and 2010. [SEP] i have heard [SEP]"}
+{"type": "sample", "index": 8, "raw_text": "[CLS] big questions about the scope of her story. [SEP] i ' m not sure what you wrote about that. [SEP] the c. e. a. has a structure that is no different than the structure of the new regulator. [SEP] \" we don ' t have time to think more on the issue, something we have got to do to save our economy. [SEP] \" for me, i ' ve always had a struggle with cancer in my life, \" he said. [SEP] the farc should get no immediate response. [SEP] if the brakes are pressed, you will stand on top of the back of the 300 - seat commuter train. [SEP] [SEP]", "detok_text": "[CLS] big questions about the scope of her story. [SEP] i'm not sure what you wrote about that. [SEP] the c. e. a. has a structure that is no different than the structure of the new regulator. [SEP] \"we don't have time to think more on the issue, something we have got to do to save our economy. [SEP]\" for me, i've always had a struggle with cancer in my life, \" he said. [SEP] the farc should get no immediate response. [SEP] if the brakes are pressed, you will stand on top of the back of the 300 - seat commuter train. [SEP] [SEP]"}
+{"type": "sample", "index": 9, "raw_text": "[CLS] due to sign the deal, the jets are about to finish a two - game slide. [SEP] and there has not been any word on the money that will flow to the fund in 2010. [SEP] in addition to co - worker ' s court fees, he appeared to have been speaking with the defendant after the accident, he said. [SEP] the group, led by the hedge fund tycoon, has pledged more than $ 7m ( £5. 7m ). [SEP] and in the end, after it ' s years of work, i see it. [SEP] \" don ' t be afraid to deal with the environment, let alone [SEP]", "detok_text": "[CLS] due to sign the deal, the jets are about to finish a two - game slide. [SEP] and there has not been any word on the money that will flow to the fund in 2010. [SEP] in addition to co - worker's court fees, he appeared to have been speaking with the defendant after the accident, he said. [SEP] the group, led by the hedge fund tycoon, has pledged more than $7m (£5. 7m). [SEP] and in the end, after it's years of work, i see it. [SEP] \" don't be afraid to deal with the environment, let alone [SEP]"}
+{"type": "sample", "index": 10, "raw_text": "[CLS] of chicago.... [SEP] they are close to zero. [SEP] which is a shame, but i can also say, what we ' ve got on the subject is so much campaign - related to the president. [SEP] so did the election of stupak ' s predecessor, representative harriet harman. [SEP] the journalist ' s release was a coup for the american journalists foundation, a los angeles - based organization. [SEP] the case, however, might have little to do with well - written and well - funded work. [SEP] \" i was happy i didn ' t know exactly where i want to be from. [SEP] in 1996, [SEP]", "detok_text": "[CLS] of chicago.... [SEP] they are close to zero. [SEP] which is a shame, but i can also say, what we've got on the subject is so much campaign - related to the president. [SEP] so did the election of stupak's predecessor, representative harriet harman. [SEP] the journalist's release was a coup for the american journalists foundation, a los angeles - based organization. [SEP] the case, however, might have little to do with well - written and well - funded work. [SEP] \" i was happy i didn't know exactly where i want to be from. [SEP] in 1996, [SEP]"}
+{"type": "sample", "index": 11, "raw_text": "[CLS]. [SEP] mr thompson said he did not expect \" convincing evidence \" to support the claims, but not much was changed. [SEP] and that is why it is so important. [SEP] it wouldn ' t be a nice thing to do but just get on a plane for a good day. [SEP] \" i think the americans have moved on to their right. [SEP] it was an incredible experience, but when i don ' t get given the opportunity to live in the hands of the world, i would be willing to do that, \" he said. [SEP] it turns out that he can barely afford to have a black watch on his head. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] mr thompson said he did not expect \"convincing evidence\" to support the claims, but not much was changed. [SEP] and that is why it is so important. [SEP] it wouldn't be a nice thing to do but just get on a plane for a good day. [SEP] \"i think the americans have moved on to their right. [SEP] it was an incredible experience, but when i don't get given the opportunity to live in the hands of the world, i would be willing to do that,\" he said. [SEP] it turns out that he can barely afford to have a black watch on his head. [SEP] [SEP]"}
+{"type": "sample", "index": 12, "raw_text": "[CLS] of up to some 6, 000 jobs. [SEP] it ' s just a lot of work, no idea. [SEP] chief fire officer john williams, of middlesbrough, said there was no need for an investigation into the incident. [SEP] the application has not been changed yet, but the date of appeal, which has been delayed until saturday, as the application has not been awarded so far, has been announced. [SEP] the person who did not want to be identified. [SEP] the hotel has a security staff, accompanied by a number of non - security staff, is due to close the doors after the weekend. [SEP] we have stood on top of [SEP]", "detok_text": "[CLS] of up to some 6, 000 jobs. [SEP] it's just a lot of work, no idea. [SEP] chief fire officer john williams, of middlesbrough, said there was no need for an investigation into the incident. [SEP] the application has not been changed yet, but the date of appeal, which has been delayed until saturday, as the application has not been awarded so far, has been announced. [SEP] the person who did not want to be identified. [SEP] the hotel has a security staff, accompanied by a number of non - security staff, is due to close the doors after the weekend. [SEP] we have stood on top of [SEP]"}
+{"type": "sample", "index": 13, "raw_text": "[CLS] to recession, the us economy would face the worst economic recession in the world in two decades. [SEP] the company also acknowledged that the false statement was misleading to investors, and that some of the allegations are true. [SEP] after the hearing, she left a note with marks on his head saying he doesn ' t speak. [SEP] you can do it better. [SEP] the number was equal to 2. 5 million jobs in 2009. [SEP] at the end of the iraq war, most of the militants were fighting for u. s. forces in afghanistan. [SEP] \" what we had to do was deal with this, \" ms martin added. [SEP] [SEP]", "detok_text": "[CLS] to recession, the us economy would face the worst economic recession in the world in two decades. [SEP] the company also acknowledged that the false statement was misleading to investors, and that some of the allegations are true. [SEP] after the hearing, she left a note with marks on his head saying he doesn't speak. [SEP] you can do it better. [SEP] the number was equal to 2. 5 million jobs in 2009. [SEP] at the end of the iraq war, most of the militants were fighting for u. s. forces in afghanistan. [SEP] \"what we had to do was deal with this,\" ms martin added. [SEP] [SEP]"}
+{"type": "sample", "index": 14, "raw_text": "[CLS] do anything for our team to do with our performance, \" he said. [SEP] no matter how hard we work to find the job, they put us in the best we can ' t. [SEP] if you live in your own financial system, you can ' t make too much of it. [SEP] not surprisingly, the team has struggled to keep up with washington ' s eighth - inning success. [SEP] small businesses get about $ 3 billion a year in emergency emergency loans. [SEP] he had only scored four runs in the series, including three of four games in the series, including one in the eighth. [SEP] \" the incident is a huge [SEP]", "detok_text": "[CLS] do anything for our team to do with our performance, \"he said. [SEP] no matter how hard we work to find the job, they put us in the best we can't. [SEP] if you live in your own financial system, you can't make too much of it. [SEP] not surprisingly, the team has struggled to keep up with washington's eighth - inning success. [SEP] small businesses get about $3 billion a year in emergency emergency loans. [SEP] he had only scored four runs in the series, including three of four games in the series, including one in the eighth. [SEP]\" the incident is a huge [SEP]"}
+{"type": "sample", "index": 15, "raw_text": "[CLS] no danger to their aircraft. [SEP] \" in the case of a point here, it would seem like we could pull this out, but when we do it a bit, then it can really get even a little easier, \" he said. [SEP] the study, based on computer data, was also conducted by paul gordon of new york university. [SEP] i knew that i wanted to be happy, i just wanted to sit down at the end of the day. [SEP] i ' m confident that if i really feel i ' m going to get fired, that would be a good thing then, \" he said. [SEP] so, perhaps, [SEP]", "detok_text": "[CLS] no danger to their aircraft. [SEP] \"in the case of a point here, it would seem like we could pull this out, but when we do it a bit, then it can really get even a little easier,\" he said. [SEP] the study, based on computer data, was also conducted by paul gordon of new york university. [SEP] i knew that i wanted to be happy, i just wanted to sit down at the end of the day. [SEP] i'm confident that if i really feel i'm going to get fired, that would be a good thing then, \" he said. [SEP] so, perhaps, [SEP]"}
+{"type": "sample", "index": 16, "raw_text": "[CLS], it ' s all drug - free. [SEP] he said : he ' s been under constant pressure for many years, but he has little time on tour, has already made some mistakes in international training and he has a lot to do. [SEP] the man took off in the area as the aircraft dropped off and went to police to face treatment. [SEP] \" the conference will give the most powerful signal to the security of the palestinian state, and signal the president ' s commitment to maintain the security of the west bank, \" said an official at the state department. [SEP] it is supported by the fact that millions of people have access to [SEP]", "detok_text": "[CLS], it's all drug - free. [SEP] he said: he's been under constant pressure for many years, but he has little time on tour, has already made some mistakes in international training and he has a lot to do. [SEP] the man took off in the area as the aircraft dropped off and went to police to face treatment. [SEP] \"the conference will give the most powerful signal to the security of the palestinian state, and signal the president's commitment to maintain the security of the west bank,\" said an official at the state department. [SEP] it is supported by the fact that millions of people have access to [SEP]"}
+{"type": "sample", "index": 17, "raw_text": "[CLS] the number of visitors. [SEP] \" we have had a great year, \" he said. [SEP] we are ready for them. [SEP] but there is no reason to doubt that. [SEP] all the way, you ' re right. [SEP] that ' s part of the problem. [SEP] \" i think, at least, we believe that there was any kind of information, \" the official declared, \" but nobody knows that. \" [SEP] the economy was an important contribution to obama ' s reform plans during the bush administration. [SEP] the site was built over the past year. [SEP] we are running out of the question of what happens to the political [SEP]", "detok_text": "[CLS] the number of visitors. [SEP] \"we have had a great year,\" he said. [SEP] we are ready for them. [SEP] but there is no reason to doubt that. [SEP] all the way, you're right. [SEP] that's part of the problem. [SEP] \"i think, at least, we believe that there was any kind of information,\" the official declared, \"but nobody knows that.\" [SEP] the economy was an important contribution to obama's reform plans during the bush administration. [SEP] the site was built over the past year. [SEP] we are running out of the question of what happens to the political [SEP]"}
+{"type": "sample", "index": 18, "raw_text": "[CLS] relief. [SEP] i ' ll just look into her. [SEP] \" i don ' t have that question. [SEP] make it before we can even make it to school. [SEP] \" we knew we would all need our help and then we knew, \" the statement said. [SEP] \" it ' s disappointing, \" he said. [SEP] mr brown also thinks he may have to pay his bills at the conference. [SEP] but i think it does have a lot of positive energy and makes you feel pretty good about doing those things. [SEP] a little odd to me. [SEP] however, in his speech, he said, \" i don ' t think [SEP]", "detok_text": "[CLS] relief. [SEP] i'll just look into her. [SEP] \"i don't have that question. [SEP] make it before we can even make it to school. [SEP]\" we knew we would all need our help and then we knew, \"the statement said. [SEP]\" it's disappointing, \"he said. [SEP] mr brown also thinks he may have to pay his bills at the conference. [SEP] but i think it does have a lot of positive energy and makes you feel pretty good about doing those things. [SEP] a little odd to me. [SEP] however, in his speech, he said,\" i don't think [SEP]"}
+{"type": "sample", "index": 19, "raw_text": "[CLS] gmt. [SEP] the average price of single - or single - family homes in california is expected to rise by 50 percent in the next 12 months. [SEP] at the moment, we don ' t have much room or even an extra room. [SEP] the literary pleasures of a book to read - - books, such as \" an evening, a day, \" and a bunch of \" cookbooks \" - - are the theme of the nation ' s literary traditions. [SEP] \" none of the lawyers involved at the high court have been suspended. [SEP] but it ' s a shame, and it ' s not too bad for one of us [SEP]", "detok_text": "[CLS] gmt. [SEP] the average price of single - or single - family homes in california is expected to rise by 50 percent in the next 12 months. [SEP] at the moment, we don't have much room or even an extra room. [SEP] the literary pleasures of a book to read - - books, such as \"an evening, a day,\" and a bunch of \"cookbooks\" - - are the theme of the nation's literary traditions. [SEP] \" none of the lawyers involved at the high court have been suspended. [SEP] but it's a shame, and it's not too bad for one of us [SEP]"}
+{"type": "sample", "index": 20, "raw_text": "[CLS] 2009. [SEP] then he explains that he did not have the position on his hands. [SEP] standing at the back of the audience, he appeared to have a large, airy, cartoon - like look. [SEP] on the other side, clinton, 66, put together a large bunch of bread and a piece. [SEP] the person who made the announcement had no intention of leaving at the time and signing a deal, people familiar with the negotiations said. [SEP] he has little mobility and is able to walk for 15 minutes, and his son is only six years old. [SEP] the average amount of a home will be about $ 1, 000 [SEP]", "detok_text": "[CLS] 2009. [SEP] then he explains that he did not have the position on his hands. [SEP] standing at the back of the audience, he appeared to have a large, airy, cartoon - like look. [SEP] on the other side, clinton, 66, put together a large bunch of bread and a piece. [SEP] the person who made the announcement had no intention of leaving at the time and signing a deal, people familiar with the negotiations said. [SEP] he has little mobility and is able to walk for 15 minutes, and his son is only six years old. [SEP] the average amount of a home will be about $1, 000 [SEP]"}
+{"type": "sample", "index": 21, "raw_text": "[CLS] 2010. [SEP] the entire us economy has slipped into a state of recession. [SEP] the fact is that greer, the french - born author of the sex drive, is no longer willing to look elsewhere to see his work and his resumes. [SEP] you can buy a number of things that are bigger - than - life. [SEP] mr brown said the move was a \" very important partnership \" for ssp, a uk - based organisation, which has become a household name. [SEP] \" we just have to get really serious, it sort of all is wrong, but we want to get something better, \" he said. [SEP] the company [SEP]", "detok_text": "[CLS] 2010. [SEP] the entire us economy has slipped into a state of recession. [SEP] the fact is that greer, the french - born author of the sex drive, is no longer willing to look elsewhere to see his work and his resumes. [SEP] you can buy a number of things that are bigger - than - life. [SEP] mr brown said the move was a \"very important partnership\" for ssp, a uk - based organisation, which has become a household name. [SEP] \"we just have to get really serious, it sort of all is wrong, but we want to get something better,\" he said. [SEP] the company [SEP]"}
+{"type": "sample", "index": 22, "raw_text": "[CLS] of his departure from the competition, the paper added. [SEP] they never made it to us and that means we have never got the best of the world. [SEP] sure, he hit the head and swiveled it off the track, but the 40 - year old got away from the field and fought back. [SEP] the attack took place in the sunni region of east baghdad. [SEP] \" it ' s time to try to balance the puzzle and put my hands together, i ' ll be in a position to go, \" he said. [SEP] he ' s also trying to prove that he ' s got his hand in afghanistan. [SEP] [SEP]", "detok_text": "[CLS] of his departure from the competition, the paper added. [SEP] they never made it to us and that means we have never got the best of the world. [SEP] sure, he hit the head and swiveled it off the track, but the 40 - year old got away from the field and fought back. [SEP] the attack took place in the sunni region of east baghdad. [SEP] \"it's time to try to balance the puzzle and put my hands together, i'll be in a position to go,\" he said. [SEP] he's also trying to prove that he's got his hand in afghanistan. [SEP] [SEP]"}
+{"type": "sample", "index": 23, "raw_text": "[CLS] take place in the aug. [SEP] \" they need to get in touch with their children because it is their school, their family, \" dr clasley says. [SEP] \" i had a lot of money to set up but it didn ' t mean that i can ' t buy. [SEP] there is one reason to avoid strawberry wambar, the tomato - flavored dessert flavored with butter - like chocolate. [SEP] the dems, if not democrats, make an easy effort to explain themselves, not themselves. [SEP] during their three - year term, the company developed a number of small and high - energy power products in the [SEP]", "detok_text": "[CLS] take place in the aug. [SEP] \"they need to get in touch with their children because it is their school, their family,\" dr clasley says. [SEP] \" i had a lot of money to set up but it didn't mean that i can't buy. [SEP] there is one reason to avoid strawberry wambar, the tomato - flavored dessert flavored with butter - like chocolate. [SEP] the dems, if not democrats, make an easy effort to explain themselves, not themselves. [SEP] during their three - year term, the company developed a number of small and high - energy power products in the [SEP]"}
+{"type": "sample", "index": 24, "raw_text": "[CLS] want to get access to education. [SEP] it is part of the city ' s 100 - year - old communal tradition. [SEP] mr. stauer was able to fill in the interview, which he did, even when he was 13, with one of her children, who had to do with her job, but didn ' t have the money to do it in public. [SEP] \" i don ' t want anything in your car, \" she said. [SEP] normally, i only knew if i wanted to know if things would go wrong, but that would do a lot of work. [SEP] bp, the world ' s largest operator [SEP]", "detok_text": "[CLS] want to get access to education. [SEP] it is part of the city's 100 - year - old communal tradition. [SEP] mr. stauer was able to fill in the interview, which he did, even when he was 13, with one of her children, who had to do with her job, but didn't have the money to do it in public. [SEP] \"i don't want anything in your car,\" she said. [SEP] normally, i only knew if i wanted to know if things would go wrong, but that would do a lot of work. [SEP] bp, the world's largest operator [SEP]"}
+{"type": "sample", "index": 25, "raw_text": "[CLS] see it, \" he said. [SEP] that is when i don ' t like to be at a club. [SEP] yet, no one wanted to change their mind. [SEP] in addition, there will be a chance to bring democracy to haiti. [SEP] the problem, of course, is that unless the last one in the greek mythology is solved, suddenly it looks like something might have happened. [SEP] the man, who is unconscious, left the scene and left in a waiting car. [SEP] but that ' s not news. [SEP] i don ' t want to... [SEP] this is more of a new start, expected to take about [SEP]", "detok_text": "[CLS] see it, \" he said. [SEP] that is when i don't like to be at a club. [SEP] yet, no one wanted to change their mind. [SEP] in addition, there will be a chance to bring democracy to haiti. [SEP] the problem, of course, is that unless the last one in the greek mythology is solved, suddenly it looks like something might have happened. [SEP] the man, who is unconscious, left the scene and left in a waiting car. [SEP] but that's not news. [SEP] i don't want to... [SEP] this is more of a new start, expected to take about [SEP]"}
+{"type": "sample", "index": 26, "raw_text": "[CLS] price of $ 50. [SEP] if you had weapons, communications, equipment, water, education, nothing would come out of them. [SEP] \" i don ' t think you want to do that but if we get off better we play very well. [SEP] on september 11, 2003, the ranger ' s helicopter went down on the ground. [SEP] so far, markets have taken a bit of action in recent days. [SEP] he said the company does not report earnings in the near term. [SEP] \" i can ' t tell you why he ended up for the presidency - - but i have had a lot of conversation, \" he says. [SEP]", "detok_text": "[CLS] price of $50. [SEP] if you had weapons, communications, equipment, water, education, nothing would come out of them. [SEP] \"i don't think you want to do that but if we get off better we play very well. [SEP] on september 11, 2003, the ranger's helicopter went down on the ground. [SEP] so far, markets have taken a bit of action in recent days. [SEP] he said the company does not report earnings in the near term. [SEP]\" i can't tell you why he ended up for the presidency - - but i have had a lot of conversation, \" he says. [SEP]"}
+{"type": "sample", "index": 27, "raw_text": "[CLS] really close to trying to get your foot back in the office. [SEP] i believe that my son can do, i just think we do what we need. [SEP] the ruling must be returned to the court on wednesday. [SEP] \" it ' s a lot that ' s still a problem, \" he said. [SEP] if you bought a bike and thought it was a good idea, what would any of us have to do then? [SEP] i don ' t have to have a love thing, \" she said. [SEP] however, it does not seem appropriate that the old boys seemed to reject it. [SEP] dr michael jordan, the doctor who [SEP]", "detok_text": "[CLS] really close to trying to get your foot back in the office. [SEP] i believe that my son can do, i just think we do what we need. [SEP] the ruling must be returned to the court on wednesday. [SEP] \"it's a lot that's still a problem,\" he said. [SEP] if you bought a bike and thought it was a good idea, what would any of us have to do then? [SEP] i don't have to have a love thing, \" she said. [SEP] however, it does not seem appropriate that the old boys seemed to reject it. [SEP] dr michael jordan, the doctor who [SEP]"}
+{"type": "sample", "index": 28, "raw_text": "[CLS] 2. 06 percent. [SEP] retail sales for the six months to january are 0. 7 per cent higher than in the year to march, according to official figures from the aa. [SEP] then he got to buy everything he knew - - and began to take his clothes at home - - and even put in one of his own - - in the back of the building, just to know something he had done. [SEP] so that is the right point. [SEP] the red wings took control in the opening period with 9 minutes left late into the third. [SEP] there will also need to be a better atmosphere at the club. [SEP] however, [SEP]", "detok_text": "[CLS] 2. 06 percent. [SEP] retail sales for the six months to january are 0. 7 per cent higher than in the year to march, according to official figures from the aa. [SEP] then he got to buy everything he knew - - and began to take his clothes at home - - and even put in one of his own - - in the back of the building, just to know something he had done. [SEP] so that is the right point. [SEP] the red wings took control in the opening period with 9 minutes left late into the third. [SEP] there will also need to be a better atmosphere at the club. [SEP] however, [SEP]"}
+{"type": "sample", "index": 29, "raw_text": "[CLS], simmons 0 - 0 - 1 0 - 0, bell 0 - 5 0 - 0 0 - 0 0 0 - 0 2, mobley 5 - 11, thomas 5 - 16, chicago 1 - 4. [SEP] the report, which is the first project to be released by the company, told the times it has become possible for more people to get in touch with their children rather than simply getting to the site. [SEP] \" it feels like i ' m going to die. [SEP] sales in june rose 11. 4 per cent to $ 100, 000. [SEP] irvine, calif. - if you know what ' s going [SEP]", "detok_text": "[CLS], simmons 0 - 0 - 1 0 - 0, bell 0 - 5 0 - 0 0 - 0 0 0 - 0 2, mobley 5 - 11, thomas 5 - 16, chicago 1 - 4. [SEP] the report, which is the first project to be released by the company, told the times it has become possible for more people to get in touch with their children rather than simply getting to the site. [SEP] \" it feels like i'm going to die. [SEP] sales in june rose 11. 4 per cent to $100, 000. [SEP] irvine, calif. - if you know what's going [SEP]"}
+{"type": "sample", "index": 30, "raw_text": "[CLS] the end, to the end, and we have to get to the end of the story. [SEP] however, he spent part of a decade working for a provincial government, and in 2007 he worked in several companies. [SEP] the former president praised brawn ' s selection of hamilton, an eight - time world champion and a 13 - time champion, to win the four - man team in beijing. [SEP] but what we need to do is sit back and get a look of the place. [SEP] that ' s not to say that, if you ' re willing to go along with your bill, take a break. [SEP] however, they [SEP]", "detok_text": "[CLS] the end, to the end, and we have to get to the end of the story. [SEP] however, he spent part of a decade working for a provincial government, and in 2007 he worked in several companies. [SEP] the former president praised brawn's selection of hamilton, an eight - time world champion and a 13 - time champion, to win the four - man team in beijing. [SEP] but what we need to do is sit back and get a look of the place. [SEP] that's not to say that, if you're willing to go along with your bill, take a break. [SEP] however, they [SEP]"}
+{"type": "sample", "index": 31, "raw_text": "[CLS] hands disappeared into the air. [SEP] the nets led 50 - 50 with 1 minutes left in the opening period less than two minutes into the half. [SEP] when you think about the characters, you feel very old. [SEP] the s & p 500 was down 0. 5 percent, but the new york - based nasdaq composite index lost 0. 6 percent to 2, 724. 80. [SEP] but this was a gain of a little more than. 9 percent in december, with the market already at the top of the agenda. [SEP] \" we lived for 80 years, so we ' re there, \" he said. [SEP] [SEP]", "detok_text": "[CLS] hands disappeared into the air. [SEP] the nets led 50 - 50 with 1 minutes left in the opening period less than two minutes into the half. [SEP] when you think about the characters, you feel very old. [SEP] the s & p 500 was down 0. 5 percent, but the new york - based nasdaq composite index lost 0. 6 percent to 2, 724. 80. [SEP] but this was a gain of a little more than. 9 percent in december, with the market already at the top of the agenda. [SEP] \"we lived for 80 years, so we're there,\" he said. [SEP] [SEP]"}
+{"type": "sample", "index": 32, "raw_text": "[CLS] bush ' s top diplomat, said at a news briefing held on the morning of july 11 that the afghan government, with support from us and other international forces, should not try to face the possibility of a real arms race. [SEP] i think he ' s a very good player... [SEP] \" obviously, if we thought we ' d never have been, there was something we can do to have one, we have, but we have one, we will stay out, we will come in, \" said davis, who was among nine staffers - - all of them who lost their own seat. [SEP] he refused to answer [SEP]", "detok_text": "[CLS] bush's top diplomat, said at a news briefing held on the morning of july 11 that the afghan government, with support from us and other international forces, should not try to face the possibility of a real arms race. [SEP] i think he's a very good player... [SEP] \"obviously, if we thought we'd never have been, there was something we can do to have one, we have, but we have one, we will stay out, we will come in,\" said davis, who was among nine staffers - - all of them who lost their own seat. [SEP] he refused to answer [SEP]"}
+{"type": "sample", "index": 33, "raw_text": "[CLS], 000 school children were among the 70, 000 people affected by the earthquake. [SEP] he allowed only two runs in 4 1 / 3 - 2 3 / 3 innings and one walk for the tigers. [SEP] i don ' t like to talk about the marriage. [SEP] american officials have also warned that there will be a \" significant risk \" if the u. s. continues to pursue a military effort against al - qaida. [SEP] but the burdens, however, can only be applied to the public face of what has been a structural imbalance in their economies and other rich nations. [SEP] it ' s even more complicated, [SEP]", "detok_text": "[CLS], 000 school children were among the 70, 000 people affected by the earthquake. [SEP] he allowed only two runs in 4 1/3 - 2 3/3 innings and one walk for the tigers. [SEP] i don't like to talk about the marriage. [SEP] american officials have also warned that there will be a \"significant risk\" if the u. s. continues to pursue a military effort against al - qaida. [SEP] but the burdens, however, can only be applied to the public face of what has been a structural imbalance in their economies and other rich nations. [SEP] it's even more complicated, [SEP]"}
+{"type": "sample", "index": 34, "raw_text": "[CLS] do not believe there is any evidence that the security agreement in iraq has been ended. [SEP] since obama has promised to end all the civil rights, if not necessary, it would be an attempt to start a democratic campaign to end this process. [SEP] the idea is to place large pots of corn in the crooks of a road, in place of branches, cars and trees. [SEP] like me, however, i feel a little more confident, if with a little look and a little smile. [SEP] an estimated 4. 5 million people are homeless. [SEP] \" i ' m trying to finish, \" he said. [SEP] he also wants [SEP]", "detok_text": "[CLS] do not believe there is any evidence that the security agreement in iraq has been ended. [SEP] since obama has promised to end all the civil rights, if not necessary, it would be an attempt to start a democratic campaign to end this process. [SEP] the idea is to place large pots of corn in the crooks of a road, in place of branches, cars and trees. [SEP] like me, however, i feel a little more confident, if with a little look and a little smile. [SEP] an estimated 4. 5 million people are homeless. [SEP] \"i'm trying to finish,\" he said. [SEP] he also wants [SEP]"}
+{"type": "sample", "index": 35, "raw_text": "[CLS] rose to 28. 5 % for the year from 26. 3 % a year ago. [SEP] the only option for a second vaccine is to check the safety and health effects of the vaccine. [SEP] a 33 - year - old nigerian man, charged with resisting police bail, jumped onto the air force ' s flight to the united states. [SEP] i hope that someone will make it out there and take them to the game, \" he said. [SEP] also at the same time, spain ' s new defense minister, carlos borges, also said he would ask the european union to increase military force in afghanistan. [SEP] the e - mail [SEP]", "detok_text": "[CLS] rose to 28. 5 % for the year from 26. 3 % a year ago. [SEP] the only option for a second vaccine is to check the safety and health effects of the vaccine. [SEP] a 33 - year - old nigerian man, charged with resisting police bail, jumped onto the air force's flight to the united states. [SEP] i hope that someone will make it out there and take them to the game, \" he said. [SEP] also at the same time, spain's new defense minister, carlos borges, also said he would ask the european union to increase military force in afghanistan. [SEP] the e - mail [SEP]"}
+{"type": "sample", "index": 36, "raw_text": "[CLS] of the detainees, but said he had no idea of them. [SEP] \" when we realized he was still five miles away, we thought he was right in the air and it was great to walk, \" said james molinaro, a 38 - year - old campaign office manager. [SEP] in the end, everything is dead. [SEP] \" i have to sacrifice my patience to get things done. [SEP] when i run into a couple of things, i ' d like to be realistic. [SEP] \" we ' ll look at a state level to have a much greater understanding of what an individual is in the workplace. [SEP] that ' s when [SEP]", "detok_text": "[CLS] of the detainees, but said he had no idea of them. [SEP] \"when we realized he was still five miles away, we thought he was right in the air and it was great to walk,\" said james molinaro, a 38 - year - old campaign office manager. [SEP] in the end, everything is dead. [SEP] \"i have to sacrifice my patience to get things done. [SEP] when i run into a couple of things, i'd like to be realistic. [SEP]\" we'll look at a state level to have a much greater understanding of what an individual is in the workplace. [SEP] that's when [SEP]"}
+{"type": "sample", "index": 37, "raw_text": "[CLS] said. [SEP] \" it would normally have been an act of money, but sometimes it is just really simple, \" he said. [SEP] \" no one is not going to get involved, \" he said. [SEP] i ' ve been doing it since the start of the season and, had i been there for a while, it usually became a very long trip. [SEP] \" you cannot feel the pressure. [SEP] \" if there is a guy that is going to be a lot of pressure, i will not make any changes, \" he said. [SEP] there are other assets that could be useful to investors in the long run. [SEP] the [SEP]", "detok_text": "[CLS] said. [SEP] \"it would normally have been an act of money, but sometimes it is just really simple,\" he said. [SEP] \"no one is not going to get involved,\" he said. [SEP] i've been doing it since the start of the season and, had i been there for a while, it usually became a very long trip. [SEP] \"you cannot feel the pressure. [SEP]\" if there is a guy that is going to be a lot of pressure, i will not make any changes, \" he said. [SEP] there are other assets that could be useful to investors in the long run. [SEP] the [SEP]"}
+{"type": "sample", "index": 38, "raw_text": "[CLS] two other us service personnel were killed in a helicopter bomb crash in afghanistan. [SEP] \" you can see how we do things. [SEP] it is good to think it ' s important to understand that there ' s something written in that - - and try to get some feedback on it. [SEP] that is our thought for a couple of months. [SEP] \" i don ' t want to see what is changed. [SEP] together, they ' re lovely and sexy, it ' s more realistic and romantic. [SEP] \" i never had anyone in the national team, i never had a taste for it. [SEP] so, i understand. [SEP] and if [SEP]", "detok_text": "[CLS] two other us service personnel were killed in a helicopter bomb crash in afghanistan. [SEP] \"you can see how we do things. [SEP] it is good to think it's important to understand that there's something written in that - - and try to get some feedback on it. [SEP] that is our thought for a couple of months. [SEP]\" i don't want to see what is changed. [SEP] together, they're lovely and sexy, it's more realistic and romantic. [SEP] \" i never had anyone in the national team, i never had a taste for it. [SEP] so, i understand. [SEP] and if [SEP]"}
+{"type": "sample", "index": 39, "raw_text": "[CLS] in january 2010. [SEP] his identity was confirmed by his prison guards before he was returned to the prison, where he was held there in october 2002. [SEP] \" it is not when you talk, when you look for a joke, \" he said. [SEP] i thought i went too far. [SEP] but he said that there would be a five - year deal with germany, an end to the war in afghanistan, as well as iran. [SEP] i think most of the iranian people would have been able to turn their country into a democracy. [SEP] the president ' s vacation needs to last for a week or two. [SEP] she moved her [SEP]", "detok_text": "[CLS] in january 2010. [SEP] his identity was confirmed by his prison guards before he was returned to the prison, where he was held there in october 2002. [SEP] \"it is not when you talk, when you look for a joke,\" he said. [SEP] i thought i went too far. [SEP] but he said that there would be a five - year deal with germany, an end to the war in afghanistan, as well as iran. [SEP] i think most of the iranian people would have been able to turn their country into a democracy. [SEP] the president's vacation needs to last for a week or two. [SEP] she moved her [SEP]"}
+{"type": "sample", "index": 40, "raw_text": "[CLS] ' s up to them. [SEP] i ' m not going to apologize, i don ' t like what the law says. [SEP] you never see it again, \" he said. [SEP] he ' s no regrets, and no regrets, but he also seems to have to go through a couple of problems at the end of the game. [SEP] he ' s a nice guy and with a good balance and able to get things started. [SEP] but we have to work hard in the n. f. c. at all to be one of those who don ' t really want to lose - - they ' re kind of going to keep [SEP]", "detok_text": "[CLS]'s up to them. [SEP] i'm not going to apologize, i don't like what the law says. [SEP] you never see it again, \" he said. [SEP] he's no regrets, and no regrets, but he also seems to have to go through a couple of problems at the end of the game. [SEP] he's a nice guy and with a good balance and able to get things started. [SEP] but we have to work hard in the n. f. c. at all to be one of those who don't really want to lose - - they're kind of going to keep [SEP]"}
+{"type": "sample", "index": 41, "raw_text": "[CLS] in the case of the state, he said. [SEP] it is posted on the website and is only 56 % true. [SEP] but i wanted to get home. [SEP] the plant has an additional 1, 200 manufacturing capacity and is more than 5, 000 square miles ( 3, 300 ), he said. [SEP] in fact, the floor is full for you, and at this moment, it ' s all in the shape of the second floor, and when you see the room at the door, there ' s no living room, no chairs, or bedroom. [SEP] the british military will resume its regular exercise with a technical training centre [SEP]", "detok_text": "[CLS] in the case of the state, he said. [SEP] it is posted on the website and is only 56 % true. [SEP] but i wanted to get home. [SEP] the plant has an additional 1, 200 manufacturing capacity and is more than 5, 000 square miles (3, 300), he said. [SEP] in fact, the floor is full for you, and at this moment, it's all in the shape of the second floor, and when you see the room at the door, there's no living room, no chairs, or bedroom. [SEP] the british military will resume its regular exercise with a technical training centre [SEP]"}
+{"type": "sample", "index": 42, "raw_text": "[CLS] to spend much of the day. [SEP] \" i ' ve never done any of my tests and i know when he is going to play south africa i don ' t think that that is something i really want to do again, \" said wester. [SEP] it is that if there has to be a person living in the city - - it is like the end of a political year. [SEP] a spokesman for doug hoffman, a davis ' lawyer, said he had told the jury that the attack was of public safety and that he did not have the right to take action in the court. [SEP] i don ' t think a real estate [SEP]", "detok_text": "[CLS] to spend much of the day. [SEP] \"i've never done any of my tests and i know when he is going to play south africa i don't think that that is something i really want to do again,\" said wester. [SEP] it is that if there has to be a person living in the city - - it is like the end of a political year. [SEP] a spokesman for doug hoffman, a davis' lawyer, said he had told the jury that the attack was of public safety and that he did not have the right to take action in the court. [SEP] i don't think a real estate [SEP]"}
+{"type": "sample", "index": 43, "raw_text": "[CLS] agenda. [SEP] mr. cohen returned to europe to run the company in a further few years. [SEP] it ' s possible, in the general sense, that we have to put on a show of, well, something that has a history, i ' d love to have a chance to show that, to do something in a bit of context. [SEP] he added that, among other things, the uk could become more able to deal with long - term problems. [SEP] the north has begun making new travel plans to allow aid and entry to the border, and also has ordered a full end of access to the buffer zone. [SEP] the [SEP]", "detok_text": "[CLS] agenda. [SEP] mr. cohen returned to europe to run the company in a further few years. [SEP] it's possible, in the general sense, that we have to put on a show of, well, something that has a history, i'd love to have a chance to show that, to do something in a bit of context. [SEP] he added that, among other things, the uk could become more able to deal with long - term problems. [SEP] the north has begun making new travel plans to allow aid and entry to the border, and also has ordered a full end of access to the buffer zone. [SEP] the [SEP]"}
+{"type": "sample", "index": 44, "raw_text": "[CLS] he was wearing brown jeans and armed with a white shirt, an coloured jacket and a white tie. [SEP] he said : \" he has never had a lot of money. [SEP] that ' s a big thing. [SEP] \" i have to say the last three years, you are following one of the many things that have come on in the last 10 years. [SEP] the real deal is insurance. [SEP] that ' s what they can do. [SEP] that isn ' t what we want, he says. [SEP] the team knows that he will be able to take part at milan, but he is always on the road. [SEP] in a conference [SEP]", "detok_text": "[CLS] he was wearing brown jeans and armed with a white shirt, an coloured jacket and a white tie. [SEP] he said: \"he has never had a lot of money. [SEP] that's a big thing. [SEP]\" i have to say the last three years, you are following one of the many things that have come on in the last 10 years. [SEP] the real deal is insurance. [SEP] that's what they can do. [SEP] that isn't what we want, he says. [SEP] the team knows that he will be able to take part at milan, but he is always on the road. [SEP] in a conference [SEP]"}
+{"type": "sample", "index": 45, "raw_text": "[CLS] insurers. [SEP] i spoke to her right outside. [SEP] \" so we ' re going to get in a little more than a little bit, \" he said. [SEP] \" it is a game that we don ' t know in the past, yet we all have a respect for the players. [SEP] he has described his attacker as a \" little henger. \" [SEP] i dished out and he seemed to be able to make his way. [SEP] \" it ' s been a quarter of a century, \" she said. [SEP] the government has announced the release of tens of thousands of police, police and intelligence workers, from [SEP]", "detok_text": "[CLS] insurers. [SEP] i spoke to her right outside. [SEP] \"so we're going to get in a little more than a little bit,\" he said. [SEP] \"it is a game that we don't know in the past, yet we all have a respect for the players. [SEP] he has described his attacker as a\" little henger. \"[SEP] i dished out and he seemed to be able to make his way. [SEP]\" it's been a quarter of a century, \" she said. [SEP] the government has announced the release of tens of thousands of police, police and intelligence workers, from [SEP]"}
+{"type": "sample", "index": 46, "raw_text": "[CLS] said. [SEP] if you are successful, you will have to be careful before the end of the season. [SEP] the man is in custody and police are trying to get any further information. [SEP] he even looked as if the answer was a complete lack of effort. [SEP] but mr. brown said the question of this needed to be addressed. [SEP] the bank suffered $ 3. 4 billion in losses in the first quarter of fiscal 2008. [SEP] the entire site is supposed to be close to capacity. [SEP] after all, he said, most of the staff and crew would be allowed to come back in full by march. [SEP] \" the truth [SEP]", "detok_text": "[CLS] said. [SEP] if you are successful, you will have to be careful before the end of the season. [SEP] the man is in custody and police are trying to get any further information. [SEP] he even looked as if the answer was a complete lack of effort. [SEP] but mr. brown said the question of this needed to be addressed. [SEP] the bank suffered $3. 4 billion in losses in the first quarter of fiscal 2008. [SEP] the entire site is supposed to be close to capacity. [SEP] after all, he said, most of the staff and crew would be allowed to come back in full by march. [SEP] \" the truth [SEP]"}
+{"type": "sample", "index": 47, "raw_text": "[CLS] he worked out the layout of his wife ' s home, a one - bedroom apartment in seattle, he wrote. [SEP] \" when i get to work, that ' s good. [SEP] it ' s strange he was in trouble, but at least he wanted to know how he felt when he was seeing himself on television, he said. [SEP] a number of sources said the council had no regrets. [SEP] it was a big step, according to lacker. [SEP] \" it ' s going to be the last of the season, it ' s a matter of time, \" he said. [SEP] i do not think we ' re trying [SEP]", "detok_text": "[CLS] he worked out the layout of his wife's home, a one - bedroom apartment in seattle, he wrote. [SEP] \"when i get to work, that's good. [SEP] it's strange he was in trouble, but at least he wanted to know how he felt when he was seeing himself on television, he said. [SEP] a number of sources said the council had no regrets. [SEP] it was a big step, according to lacker. [SEP]\" it's going to be the last of the season, it's a matter of time, \" he said. [SEP] i do not think we're trying [SEP]"}
+{"type": "sample", "index": 48, "raw_text": "[CLS] 000 troops. [SEP] british police would not comment on the incident. [SEP] he and his brother and sister were all released tuesday. [SEP] crude oil prices in the first six months of the year hit a record high of $ 65bn, up 14 per cent to $ 25. 4bn ( £17. 7bn ), on better - than - expected figures from oil and mining companies. [SEP] the house ' s bill also provides banks up to $ 2, 000 for loans, including loans and interest payments made to the fha. [SEP] but the figure ' s figure climbed to 7 per cent from 3. 7 million. [SEP] there [SEP]", "detok_text": "[CLS] 000 troops. [SEP] british police would not comment on the incident. [SEP] he and his brother and sister were all released tuesday. [SEP] crude oil prices in the first six months of the year hit a record high of $65bn, up 14 per cent to $25. 4bn (£17. 7bn), on better - than - expected figures from oil and mining companies. [SEP] the house's bill also provides banks up to $2, 000 for loans, including loans and interest payments made to the fha. [SEP] but the figure's figure climbed to 7 per cent from 3. 7 million. [SEP] there [SEP]"}
+{"type": "sample", "index": 49, "raw_text": "[CLS] system, and the market is able to turn to mark - to - market capital growth. \" [SEP] \" if we were to win, we would have to get there, we have to go to win, and we would have to do whatever we could do, we would not do that, \" mullen said. [SEP] it ' s good enough to take pride in life. [SEP] \" it ' d be nice to be taken up in the end, \" nadal said. [SEP] \" i do remember him. [SEP] as a result, a patient has to learn about how to talk to people. [SEP] in a statement, the organization [SEP]", "detok_text": "[CLS] system, and the market is able to turn to mark - to - market capital growth. \"[SEP]\" if we were to win, we would have to get there, we have to go to win, and we would have to do whatever we could do, we would not do that, \"mullen said. [SEP] it's good enough to take pride in life. [SEP]\" it'd be nice to be taken up in the end, \"nadal said. [SEP]\" i do remember him. [SEP] as a result, a patient has to learn about how to talk to people. [SEP] in a statement, the organization [SEP]"}
+{"type": "sample", "index": 50, "raw_text": "[CLS] in chicago, has worked for several years at the university of maryland. [SEP] \" of course, we have taken some steps to get out of the situation, we have to take it through, to get it done, right. [SEP] \" every time i really have to do something, it ' s hard when i ' m going to be in line for another year, \" he told reporters after heading into the locker room. [SEP] \" i came back in time and said, and she said, ' i ' ve got got to do this, i wanted to play, and i wasn ' t really interested. [SEP] we ' re already [SEP]", "detok_text": "[CLS] in chicago, has worked for several years at the university of maryland. [SEP] \"of course, we have taken some steps to get out of the situation, we have to take it through, to get it done, right. [SEP]\" every time i really have to do something, it's hard when i'm going to be in line for another year, \"he told reporters after heading into the locker room. [SEP]\" i came back in time and said, and she said, ' i've got got to do this, i wanted to play, and i wasn't really interested. [SEP] we're already [SEP]"}
+{"type": "sample", "index": 51, "raw_text": "[CLS] way to ensure that the end - of - life information on the web site has not been used, the post reported. [SEP] ( 21 - 22 ) : you may be able to pay you off, especially when you do want to travel one way and pay off all the money on the holidays. [SEP] i have always wondered here about why people are going to be there. [SEP] the issue of land and water, the world ' s most sought - after area of long - term development, was resolved in a little less than a week. [SEP] one of the injured was a school teacher in peshawar, about 50 miles from the airport. [SEP]", "detok_text": "[CLS] way to ensure that the end - of - life information on the web site has not been used, the post reported. [SEP] (21 - 22): you may be able to pay you off, especially when you do want to travel one way and pay off all the money on the holidays. [SEP] i have always wondered here about why people are going to be there. [SEP] the issue of land and water, the world's most sought - after area of long - term development, was resolved in a little less than a week. [SEP] one of the injured was a school teacher in peshawar, about 50 miles from the airport. [SEP]"}
+{"type": "sample", "index": 52, "raw_text": "[CLS] percent in the second quarter, is still looking to add the $ 3, 700 billion cut from the tarp program to the additional $ 50 billion in additional guarantees it would provide to help stabilize the financial system over the next year. [SEP] wilco had his first full game, leaving his left glove behind on the mound. [SEP] c £40, 000 ( + £36, 702 ). central london. £35, 000 - £30, 703 ( luling up to £39, 092 per annum. £32, 071 - 1. we are looking for a permanent b.... [SEP] \" [SEP]", "detok_text": "[CLS] percent in the second quarter, is still looking to add the $3, 700 billion cut from the tarp program to the additional $50 billion in additional guarantees it would provide to help stabilize the financial system over the next year. [SEP] wilco had his first full game, leaving his left glove behind on the mound. [SEP] c £40, 000 (+ £36, 702). central london. £35, 000 - £30, 703 ( luling up to £39, 092 per annum. £32, 071 - 1. we are looking for a permanent b.... [SEP] \" [SEP]"}
+{"type": "sample", "index": 53, "raw_text": "[CLS], those who live here have to live with their families, \" he said. [SEP] \" i don ' t think he should go to manchester because i ' m sure he ' d like to come back. [SEP] live in the pain of having to do what is required, \" she said. [SEP] but the current human condition facing the tigers is not clear. [SEP] \" if you stop the damage, the money is going to go around, you know. [SEP] what we ' ve seen is a general improvement, \" said mr corsi. [SEP] i ' m not too sure, \" mr. catt said. [SEP] during the [SEP]", "detok_text": "[CLS], those who live here have to live with their families, \"he said. [SEP]\" i don't think he should go to manchester because i'm sure he'd like to come back. [SEP] live in the pain of having to do what is required, \"she said. [SEP] but the current human condition facing the tigers is not clear. [SEP]\" if you stop the damage, the money is going to go around, you know. [SEP] what we've seen is a general improvement, \"said mr corsi. [SEP] i'm not too sure,\" mr. catt said. [SEP] during the [SEP]"}
+{"type": "sample", "index": 54, "raw_text": "[CLS], then drove off for a walk and left at 2 : 45 a. m., according to police at the scene. [SEP] beijing ( reuters ) - china ' s tough relations with dalai lama and beijing met again on monday to resolve a long - running dispute that has sparked growing tensions with china, according to u. s. officials. [SEP] \" it ' s about money, it ' s about people when you ' re in people ' s control, trying to understand what people they are, giving them time and money, which means you want to do what you want to know to do.... [SEP] the difference is [SEP]", "detok_text": "[CLS], then drove off for a walk and left at 2: 45 a. m., according to police at the scene. [SEP] beijing (reuters) - china's tough relations with dalai lama and beijing met again on monday to resolve a long - running dispute that has sparked growing tensions with china, according to u. s. officials. [SEP] \" it's about money, it's about people when you're in people's control, trying to understand what people they are, giving them time and money, which means you want to do what you want to know to do.... [SEP] the difference is [SEP]"}
+{"type": "sample", "index": 55, "raw_text": "[CLS] to the polls. [SEP] \" the choice for you is not to stick to any solution but to review matters now, to talk directly to the prime minister, the foreign minister, \" said britain ' s prime minister gordon brown. [SEP] \" there ' s a question, we ' re going to say, ' if we are really prepared for this, we ' ll have an election, that ' s fine, \" daube said. [SEP] \" we have not stopped, we have no plans, \" he said. [SEP] when he came to the project, he changed his mind, but promised that it would provide a little more space [SEP]", "detok_text": "[CLS] to the polls. [SEP] \"the choice for you is not to stick to any solution but to review matters now, to talk directly to the prime minister, the foreign minister,\" said britain's prime minister gordon brown. [SEP] \"there's a question, we're going to say, ' if we are really prepared for this, we'll have an election, that's fine,\" daube said. [SEP] \"we have not stopped, we have no plans,\" he said. [SEP] when he came to the project, he changed his mind, but promised that it would provide a little more space [SEP]"}
+{"type": "sample", "index": 56, "raw_text": "[CLS]. [SEP] i mean, i can spend too much time with him on our backs next year, but i wish i had just finished my first year, i ' m sure we can get that too much attention. [SEP] he, however, was not in the audience. [SEP] but, that doesn ' t mean it ' s worth saying to me, that i know i want to do something about it, that i want to make an impact. [SEP] by the end of the week, all of us have returned to our vacation homes. [SEP] but for some of them, this kind of action must have seemed long ago. [SEP] the lack [SEP]", "detok_text": "[CLS]. [SEP] i mean, i can spend too much time with him on our backs next year, but i wish i had just finished my first year, i'm sure we can get that too much attention. [SEP] he, however, was not in the audience. [SEP] but, that doesn't mean it's worth saying to me, that i know i want to do something about it, that i want to make an impact. [SEP] by the end of the week, all of us have returned to our vacation homes. [SEP] but for some of them, this kind of action must have seemed long ago. [SEP] the lack [SEP]"}
+{"type": "sample", "index": 57, "raw_text": "[CLS]m loss for the firm, which had revenue of £19, 000. [SEP] he ' s a very good person, \" mr brown said. [SEP] well, i think it was a good idea. [SEP] we don ' t want to do anything about the greatness of life, but we do have to make a decision. [SEP] a combined total of more than 500, 000 sodas were sold, including more than 2, 000 to consumers in 2007, according to steve mellow, general manager of the beverage industry association. [SEP] the deal also includes two activities - - the gym, the golf club, the dining area, and [SEP]", "detok_text": "[CLS]m loss for the firm, which had revenue of £19, 000. [SEP] he's a very good person, \" mr brown said. [SEP] well, i think it was a good idea. [SEP] we don't want to do anything about the greatness of life, but we do have to make a decision. [SEP] a combined total of more than 500, 000 sodas were sold, including more than 2, 000 to consumers in 2007, according to steve mellow, general manager of the beverage industry association. [SEP] the deal also includes two activities - - the gym, the golf club, the dining area, and [SEP]"}
+{"type": "sample", "index": 58, "raw_text": "[CLS] of rising debt into the economy. [SEP] however, that was brought to the attention. [SEP] the market then was down. [SEP] look at how you could get to see a lot of people reading stories and people here to read them. [SEP] it is not really what they want us to see. [SEP] if it comes back, i won ' t be looking out. [SEP] i just hope that all of this should be corrected. [SEP] don ' t expect them to tell me to do anything, as i always have to say here, but of course, i ' m trying to tell you that it all happened in the united states. [SEP] [SEP]", "detok_text": "[CLS] of rising debt into the economy. [SEP] however, that was brought to the attention. [SEP] the market then was down. [SEP] look at how you could get to see a lot of people reading stories and people here to read them. [SEP] it is not really what they want us to see. [SEP] if it comes back, i won't be looking out. [SEP] i just hope that all of this should be corrected. [SEP] don't expect them to tell me to do anything, as i always have to say here, but of course, i'm trying to tell you that it all happened in the united states. [SEP] [SEP]"}
+{"type": "sample", "index": 59, "raw_text": "[CLS] flights will be made from new york, the u. s. and canada. [SEP] it ' s a way to give you a break, a way to play, \" biden said. [SEP] \" i think for a lot of people, there ' s a problem, \" he said. [SEP] we ' d have to win. [SEP] he was mostly out of games in recent seasons, and he seemed to make quite a few hits. [SEP] his mother was unable to get to the hospital. [SEP] \" there has been tremendous change in the team since the end of the year. [SEP] \" i ' m just saying these things when i [SEP]", "detok_text": "[CLS] flights will be made from new york, the u. s. and canada. [SEP] it's a way to give you a break, a way to play, \"biden said. [SEP]\" i think for a lot of people, there's a problem, \"he said. [SEP] we'd have to win. [SEP] he was mostly out of games in recent seasons, and he seemed to make quite a few hits. [SEP] his mother was unable to get to the hospital. [SEP]\" there has been tremendous change in the team since the end of the year. [SEP] \" i'm just saying these things when i [SEP]"}
+{"type": "sample", "index": 60, "raw_text": "[CLS] in the air. [SEP] it ' s not a game to plan, it ' s a \" game of good communication. \" [SEP] as a result, ba faced the prospect of trying to take control of the group in case of a bankruptcy. [SEP] if an immediate decision is made, like the vote to strike in december, they would be able to do so. [SEP] they have never been in a room with family members, and they have a film and a documentary, a lot of movies, \" she said. [SEP] \" i saw the woman at the end of the flight on a curtain call. [SEP] that ' s right, \" [SEP]", "detok_text": "[CLS] in the air. [SEP] it's not a game to plan, it's a \"game of good communication.\" [SEP] as a result, ba faced the prospect of trying to take control of the group in case of a bankruptcy. [SEP] if an immediate decision is made, like the vote to strike in december, they would be able to do so. [SEP] they have never been in a room with family members, and they have a film and a documentary, a lot of movies, \"she said. [SEP]\" i saw the woman at the end of the flight on a curtain call. [SEP] that's right, \" [SEP]"}
+{"type": "sample", "index": 61, "raw_text": "[CLS] i could care for him. [SEP] \" i ' ve got a career as a doctor, so it doesn ' t work for me anymore, it ' s not a good one, \" eno said. [SEP] i was happy for him. [SEP] if i want to become a science teacher, i have to do a few things, \" rahm told reporters. [SEP] \" we are unable to confirm the report to the committee and expect to give evidence to the full council later in march, and are working to get the further action forward, \" the statement said. [SEP] in the second round of the conference title, the cavaliers won their [SEP]", "detok_text": "[CLS] i could care for him. [SEP] \"i've got a career as a doctor, so it doesn't work for me anymore, it's not a good one,\" eno said. [SEP] i was happy for him. [SEP] if i want to become a science teacher, i have to do a few things, \"rahm told reporters. [SEP]\" we are unable to confirm the report to the committee and expect to give evidence to the full council later in march, and are working to get the further action forward, \" the statement said. [SEP] in the second round of the conference title, the cavaliers won their [SEP]"}
+{"type": "sample", "index": 62, "raw_text": "[CLS].. fl. training - education is assigned to oversee........ and other activities related to this program. are immediately available to assist.... de.. in coordinating with international organizations, corporations and other.... mn. 08 / 07 : / hh ( and many of you currently have.... in... il, paris, ct, and washington, dc. someone needs to be responsible for a position able to lead.... co. access to education, degree of experience... ct, level of experience to be a teacher or.. [SEP]", "detok_text": "[CLS].. fl. training - education is assigned to oversee........ and other activities related to this program. are immediately available to assist.... de.. in coordinating with international organizations, corporations and other.... mn. 08/07:/hh ( and many of you currently have.... in... il, paris, ct, and washington, dc. someone needs to be responsible for a position able to lead.... co. access to education, degree of experience... ct, level of experience to be a teacher or.. [SEP]"}
+{"type": "sample", "index": 63, "raw_text": "[CLS] the area. [SEP] \" it increases the brain ' s ability to communicate, \" buffon said. [SEP] he ' s done that. [SEP] a person wants to look back at your eyes - - the eyes of a man - - but he gives up an outline of his mind every 15 minutes. [SEP] i have to remember how to take my time at the far end of things. [SEP] there is nothing more to this story in the spirit of adventure than the illusion of good quality. [SEP] look, they ' ve only been a bit lower since the end of the year. [SEP] \" we don ' t know how to go about it [SEP]", "detok_text": "[CLS] the area. [SEP] \"it increases the brain's ability to communicate,\" buffon said. [SEP] he's done that. [SEP] a person wants to look back at your eyes - - the eyes of a man - - but he gives up an outline of his mind every 15 minutes. [SEP] i have to remember how to take my time at the far end of things. [SEP] there is nothing more to this story in the spirit of adventure than the illusion of good quality. [SEP] look, they've only been a bit lower since the end of the year. [SEP] \" we don't know how to go about it [SEP]"}

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_256steps_n64/state_c256_t1p45_detok_raw_samples.txt

@@ -0,0 +1,228 @@
+state_c256_t1p45_detok
+{
+  "type": "summary",
+  "name": "state_c256_t1p45",
+  "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt",
+  "step": 124000,
+  "decode": {
+    "kind": "categorical_fullvocab",
+    "config": "state_c256_t1p45",
+    "steps": 256,
+    "model_t_mode": "post",
+    "support_power": 1.0,
+    "semantic_power": 1.0,
+    "endpoint_temp": 1.45,
+    "concentration_min": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 29.81545187350111,
+    "nll_per_token": 3.3950267783717107,
+    "tokens": 9500
+  },
+  "diversity": {
+    "sample_entropy": 4.085741040367163,
+    "unique_tokens": 1473,
+    "token_count": 8192,
+    "distinct_1": 0.1798095703125,
+    "distinct_2": 0.5905511811023622,
+    "top_token_mass": 0.0538330078125
+  }
+}
+
+===== sample 000 =====
+[CLS] press reported. [SEP] i would have to cancel a couple of flights, but i was free to go... [SEP] the project, costing £1, 500, will make it possible to bring some of the world's best teams to the uk. [SEP] we're going to have an investigation that, with all our evidence, we have never seen before, "he added. [SEP] the carmaker ford lost $60m in the first quarter alone. [SEP]" there is a real need for transparency. [SEP] the scale of the devastation has been driven by the displacement and reshaping of nearly 10, 000 people around the world [SEP]
+
+===== sample 001 =====
+[CLS] - trade plan. [SEP] in the past, we have looked back at some ways, and i think the problem is, we did not get this far. [SEP] "i think, ' john, i think he's ok, but i'm not really in a position to talk to you. [SEP]" it was a little bit of a big fight and we had to be aware of it, " said the german. [SEP] for a moment, the place, if you kind of look out, seems to sit in perspective. [SEP] when a discussion of the president's fate actually takes place, so many of those who know [SEP]
+
+===== sample 002 =====
+[CLS] the white house, "he says. [SEP] i've never known there has been a huge factor in the game. [SEP] he likes to get up, but a little bit well, and just works well in the gym. [SEP]" i think we have to get a good deal, so if the result is a win, the majority is in danger of losing, "ender said. [SEP]" the idea is to get the money they want to get, and we're not able to make money, " added schbutter. [SEP] the police have said that they were investigating more than a dozen complaints. [SEP] but [SEP]
+
+===== sample 003 =====
+[CLS] quite the way we are. [SEP] i just hope that i can do it again. [SEP] he says that he doesn't think he should talk to anyone trying to sell himself. [SEP] you know we'll take our lessons, "said the foreign official. [SEP] i've liked one one, i like the other, and of course he has to deal with this if he is a candidate when he gets into it. [SEP]" there are also things you want to do with that work, such as getting dressed in white clouds, or capels, or even a black scarf, " he added. [SEP] a government agency investigating [SEP]
+
+===== sample 004 =====
+[CLS]: "the total of stolen items includes a number of personal items including household goods, airbags and computers. [SEP]" i don't think it was until my 70s that i really got into trouble, "he said," i can't make it much better - - i didn't even have a talking point. [SEP] officials from around the world and more than a 100 other countries attended the event. [SEP] while he is so popular in the united states, he is critical of his free - trade policies in the u. s. and calling for the collapse of the union. [SEP] the production also features a three - [SEP]
+
+===== sample 005 =====
+[CLS] guide them to the democratic nomination. [SEP] "i've got quite a concern about the number of people who have worked and the number of people who have been working and thought about the quality of things that are done or if they have been worked out. [SEP]" we don't want to know that he can play in the future, " said peter westbrook, the club's assistant coach. [SEP] it was last updated at 20. 54 bst on thursday 16 may 2009. office for the city of london. greater london, south london. £36, 624 to £43, 000 per annum. [SEP] he [SEP]
+
+===== sample 006 =====
+[CLS] air crash in rome, witnesses said. [SEP] "i'll do that and i'm glad this has been resolved. [SEP] since the 10th century, the u. s. government has never been part of iraq. [SEP] it said that after several days the children, who would be temporary workers who did not see their parents for another six weeks, would not receive full visas and would be free from their work. [SEP] i just wanted to let him stand up and try to get here," according to the eca. [SEP] the nets also scored 13 of his 15 points in 20 minutes - - he had 16 rebounds in the [SEP]
+
+===== sample 007 =====
+[CLS] in a series of federal deficits and budget shortcomings. [SEP] i mean, if you ask me to look at you, you're a celebrity, it's just hard to imagine. [SEP] a 19. 1 share in california's unemployment report, down slightly in chicago in august. [SEP] in the end, the swiss group had to set a compensation deal with the government and was promised the full compensation of the bank's 5, 000 employees. [SEP] so it's not been easy for him, as we both know the rules. [SEP] the first game of the series was 14 - point loss to detroit. [SEP]
+
+===== sample 008 =====
+[CLS] 57. 7 million. [SEP] i believe that they will not be able to pay the cost. [SEP] "if we've got a team where we are up to the task, we want to do it in terms of our commitment to football," barca said. [SEP] what has been the challenge for children to learn from the past? [SEP] mr brown said the leaders had all agreed on a get - in for the couple. [SEP] on wednesday, the protesters sent riot police, police trucks, fire engines and soldiers on their way to the stadium for a second time. [SEP] the group is led by john bord. [SEP] but [SEP]
+
+===== sample 009 =====
+[CLS] their vehicles. [SEP] still, it took them four years to achieve the first cut in the government's funding in three years and start to the school year. [SEP] we've told them. [SEP] the victims collected up to $20, 000 in cash, cash, cash, cash, cigarettes and cash, police said. [SEP] "when we get down to the final i think it's something that we have been trying to do for a long time for us. [SEP]" it's just a small number to look for, it's not true, "she said," " well, i don't need [SEP]
+
+===== sample 010 =====
+[CLS] - - "he joked. [SEP]" this announcement is a response to the lack of public funding, " said a spokesman of the children of education committee. [SEP] however, as a result, i think i'm in the right mood. [SEP] clinton has said the us will help to improve the political situation in zimbabwe. [SEP] we'll see. [SEP] and it is a great thing to help them in the day and help them in a good way. [SEP] on the other hand, one thing is to overcome this fear and prejudice. [SEP] another £1 million a year has also gone into the children's education fund, which has [SEP]
+
+===== sample 011 =====
+[CLS] in front of others. [SEP] it just seems to pick up the air of the wind. [SEP] boca raton, fla., march 3 (upi) - - owners of u. s. retailers said they expect to be down by as much as 10 percent in the second half of 2008, a survey said. [SEP] he lives in chicago. [SEP] he said there was no sign the club was going to replace him, so there was none of them to replace him. [SEP] the court heard the ex - president was staying at home, four years after losing the presidency in 2001. [SEP] on friday, senate republican leader john [SEP]
+
+===== sample 012 =====
+[CLS] weekend, said he was "tired" and had "nothing to do" with a run that was "normal" after he started. [SEP] i had the message being, "don't talk about you anymore." [SEP] i have sex every day, every 20 - year - old girl loves it. [SEP] you're always looking to pick up a job of your own or make some money, but there's a lot of work to get in. [SEP] where are your best friends? [SEP] i'm sure that he's the guy who can have the things we want, have the things that i can trust, [SEP]
+
+===== sample 013 =====
+[CLS]. s. kabul, afghanistan (ap) - - a roadside bomb ripped through an eastern afghan town wednesday, killing a dozen people and wounding 24 others, including three children, and a schoolgirl, provincial police and officials said. [SEP] until then, at least it hadn't come to saturday's conclusion. [SEP] "no one will be responsible for the breach of security," he added. [SEP] the safety condition of the two - lane scat would be set in proportion to a narrow exit where the driver of a car on the other side would hit the driver's hand, causing the driver to be stuck. [SEP] [SEP]
+
+===== sample 014 =====
+[CLS] "said mohammed. [SEP] he is so fast - - and yet he sees, at first, the freshness of the light and the warmth of the all - around sun that brought him down from the moon to earth. [SEP] we still don't know. [SEP]" you don't always know what you're going for. [SEP] "it's hard to see, it's hard to take out anything that's important at all," she says. [SEP] "we did have more problems," said coach scott brown, a member of the nfl players' association. [SEP] " the president and manager, all [SEP]
+
+===== sample 015 =====
+[CLS] of the children. [SEP] they won't be able to see you, but we better know them if they don't put their money on a table. [SEP] i don't know. [SEP] that used to be fine on the street, but with the doors closed and the busses running from front to back streets, it didn't go that far. [SEP] in the early 2000s, however, rates were sharply lower. [SEP] "there's a lot of work going on, and it was not wrong," he said. [SEP] " i've just got a little bit of a fight. [SEP] since then, [SEP]
+
+===== sample 016 =====
+[CLS] said. [SEP] similar turbines are being built in the uk, but needs to be completed by 2013, said a senior government official involved in the talks. [SEP] he made 25 of 32 shots from the field before punting on 3 - of - 13 three - goal attempts saturday night in the wild 1 - 0 loss to san jose city, the first victory of the season a day earlier. [SEP] there's a problem that can seem to cause any amount of mental pain, " said kitz. [SEP] we must change our perception, and without any change, we must still make a lot of mistakes, and act fast, and we [SEP]
+
+===== sample 017 =====
+[CLS] to obama's visit to america in june, that he seemed to understand that he really was going to behave in different conditions. [SEP] there is such a sense of optimism and change for you, according to cbs/kland. com. [SEP] it would be in good faith. [SEP] "that's not necessarily what we're about. [SEP] that's a good thing, it's kind of a joke. [SEP] wake up and drop the story for comment. [SEP]" we believe that we still have the ability to win, " said mr brown. [SEP] new york - kirilenko scored 26 points and jason terry [SEP]
+
+===== sample 018 =====
+[CLS] in the first quarter of december 2007. [SEP] the u. s. c. arrived at the air station at about 8 a. m. and returned immediately, according to one person with knowledge of the condition of monday's departures. [SEP] the president has gotten the message quickly and cautioned citizens to be on alert. [SEP] capello's team could play against the united states in this week's group stage, and italy has three games in the final, but it's not. [SEP] then, however, we moved into the middle of a relationship. [SEP] lake city, ill. - - the man who killed [SEP]
+
+===== sample 019 =====
+[CLS] confirmed his move to rangers on tuesday and are due to start their european campaign in the light of the first game of chelsea's trip to ibrox. [SEP] the trial was scheduled to take place in 2009. [SEP] we're not doing enough - - we will get that fast if we can go. [SEP] for example, the concept of a low - end car could go on the road. [SEP] "i'm concerned that we will have a new set of rules that we have to sort out, and there will be more changes in financial financial systems over the couple of years," he said. [SEP] the capital, [SEP]
+
+===== sample 020 =====
+[CLS] person familiar with the matter. [SEP] new york's health insurance program is designed to inflate financial costs. [SEP] it took only a few minutes to develop. [SEP] at that time, in february 2008, the percentage of people paying a 10 - year mortgage rose this year from 13 % to 3. 8 %. [SEP] they let us do nothing in the past. [SEP] "we don't talk about a financial crisis, it's just getting people together," he added. [SEP] but the goal is to make up for the fire that is coming in markets that are getting stressed, including mortgage - backed securities, which [SEP]
+
+===== sample 021 =====
+[CLS] still lives, and he knows how to make a living. [SEP] the council has provided £5, 000 to cover the building and £5, 000 to design, with the rest still to be added. [SEP] it is really hard for him to see anything in a way. [SEP] the mets are trying to add santana, for example, who is looking for a good season. [SEP] then she dropped off her clothes. [SEP] he is still trying to keep a lead while even keeping the ball in playoff games. [SEP] the union said it represents more than 2, 000 temporary workers, and that drivers would have to work overtime. [SEP] instead, the [SEP]
+
+===== sample 022 =====
+[CLS] 1. 5 - game run. [SEP] in 2004, chicago - based boston pitchers hit jason varitek three times. [SEP] he had been jailed in october 2007 for six months, and before he was last seen near his family home in parkville, n. j., he was drunk during his break - in. [SEP] last week darling announced that the public debt - - which includes roads, playgrounds, super - schools, universities, schools, hospitals, hospitals, high - rises and roads - - would be repaid by the end of the year. [SEP] the team is one of the best teams on the planet. [SEP] [SEP]
+
+===== sample 023 =====
+[CLS] million. [SEP] " when i'm not there, it's not about winning, it's winning. [SEP] at the time, the young man wore a jumper with his short - sleeve shirt, and a dark shirt, bottoms and bottoms. [SEP] father phillips, 67, said that he had already seen his wife, and that in a marriage he's had 50 years and 10 children. [SEP] there is no connection between reading and high school scores. [SEP] meanwhile, the u. s. foreign relations office is doing so in line with international court rules. [SEP] i don't need anything. [SEP] the electoral process has [SEP]
+
+===== sample 024 =====
+[CLS] part of the couple's life - - a three - way, four - year relationship. [SEP] when i've had a break - - i would want to take one other out, but i'm not alone - - i always get depressed. [SEP] switzerland, and swiss banks in particular, has a lot of the money flowing. [SEP] he also said that it was important to have the support of all people. [SEP] i have to believe that we should start talking to the world. [SEP] by the time we came round, the doors were open. [SEP] but nobody has thought of a full sit - down, or even a [SEP]
+
+===== sample 025 =====
+[CLS] that they are to be well informed and that message is very strong, "he said. [SEP] he said then," i know it is the day of the game and it was particularly important and would have been a good start. [SEP] and maybe he wasn't funny, but people think he was real. [SEP] by the start of the 2004 presidential campaign - - just a three months - - he was on the need to talk with americans about his patriotism. [SEP] but don't expect a panic. [SEP] he doesn't understand where you are, "he said. [SEP]" i find it hard to make the most [SEP]
+
+===== sample 026 =====
+[CLS] smashed glass windows in his home. [SEP] "it could be said that when we're not going to do something - - we don't know, we're going to do something - - we can have a better life. [SEP]" i really wanted to do something, i love it because i thought twice about you, that kind of really about what i can do. [SEP] he says he paid $10, 000 and sold the tickets for $800, but he was able to get out of the room. [SEP] "they are the people who would have been a small part of that," hairston said. [SEP] [SEP]
+
+===== sample 027 =====
+[CLS] crack down on the quality of their players. [SEP] smith, however, remains optimistic. [SEP] "it's hard to call some of the facilities part of a return to old days," he said, as a man waited in the new president's office at the palace. [SEP] you can just take a flight from the office and then get a job, a salary or a couple of dollars to make a visit. [SEP] i knew i had to live in my own well - lit tent, an out - of - town place and a place to go in. [SEP] however, we've got a lot of people having to [SEP]
+
+===== sample 028 =====
+[CLS] m. c. a. tournament. [SEP] u. s. troops killed in iraq in 2007 dropped up to 38 at the start of this year, according to the pentagon's statement. [SEP] i am a college student because i have lived all my life. [SEP] now, that's a small group. [SEP] hours after the team's president announced his decision on thursday night, the knicks protested and asked thomas to not sign his contract and had no comment. [SEP] but if that's enough to stop that change, it has yet to be approved. [SEP] " it's fair to say there is a huge part of [SEP]
+
+===== sample 029 =====
+[CLS] return at home. [SEP] for example, the western state of england is thought to have the largest share of the population of 11 percent. [SEP] "the allegations are untrued," he says. [SEP] in the ruling, mr justice weir said: " mr mcnulty immediately went to the office of justice and provided his details to the tax office, the revenue commissioner, the irs, the treasury secretary, the attorney general and the u. s. department of justice to help to provide financial services in the uk. [SEP] we've done it. [SEP] the two are also likely to focus on the need for political settlement [SEP]
+
+===== sample 030 =====
+[CLS] his own close relationship with his old england manager. [SEP] "the road can get to the end. [SEP] he has been known to move in the past few months. [SEP]" immediately after the blast, we had a very difficult effort to get our eye out of the area. [SEP] "we'd be talking about how you can't go over there, which i don't know, that kind of thing, you know, that was," mr. jordan said. [SEP] it's hard to believe, people. [SEP] but it may not come until the end of the year. [SEP] but in truth, i had [SEP]
+
+===== sample 031 =====
+[CLS] sunday's event. [SEP] ", however, the misunderstandings on this issue have to be addressed, " the officials said. [SEP] still, the loss of a loan, which is made for them by their lenders, is not enough of a reason to let go. [SEP] it is also expected that a number of measures will be made to turn around the world economy. [SEP] about a third of the country's 2 million children and their families are estimated to be poor, most of them due to poverty. [SEP] we have all been in it for too long, but we have to put up our best ideas. [SEP] the [SEP]
+
+===== sample 032 =====
+[CLS] need to put this money on their tax bill by now, and that isn't quite much down at the end of 2011. [SEP] in a study from 2004 to 2008, the percentage of female child victims increased slightly to just 2. 3 percent. [SEP] i was born long before i was done. [SEP] they haven't done it. [SEP] he can't live to lose. [SEP] he's got a good game, and he does it well. [SEP] "i would say it was a good start to make decisions for you," he said. [SEP] i don't really think that we didn't want to [SEP]
+
+===== sample 033 =====
+[CLS] and italy. [SEP] finally, instead of watching, i had to go to the weather office to check up for the next morning. [SEP] "the market to build a market is going to be built in a kind of way. [SEP] he told the newspaper in the days before the murder trial that he had no regrets and would not fight the charges. [SEP]" i don't think you should be allowed to talk about it, but i'm not very happy, "he said. [SEP] on saturday, he was attacked with another woman in the force area. [SEP] but that does not happen. [SEP]" there didn't be [SEP]
+
+===== sample 034 =====
+[CLS], 50 years in a row, to seven games. [SEP] the woman is about 5ft 6in tall (4. 8m, 11. 4m). [SEP] he is there, exposing syonies, making repeated gestures at them, biting them, and raping them hideously. [SEP] even before he had a good season with the yankees, the team was dominant. [SEP] the house of commons, the upper chamber, has used the two - thirds majority to bring in 21 seats. [SEP] " you have to come back to me and have a conversation with me and i want to win. [SEP] i don't think [SEP]
+
+===== sample 035 =====
+[CLS] the first time sunday. [SEP] "i knew that i wanted to be able to be there," rodriguez said in a statement. [SEP] "if they didn't have that kind of money, then it wouldn't happen at all," mr horsin said. [SEP] "the door is no longer open," she said. [SEP] ms. bork, 53, and her son, austin, have developed an interest in state - funded insurance companies. [SEP] but that strategy seemed to work well with him. [SEP] 27/prnewswire/- - raytheon corporation (nyse: dn), [SEP]
+
+===== sample 036 =====
+[CLS] it seemed to take a while to get me started, so i wanted to start the game. [SEP] but it was set up by government and international organizations that also supported the project. [SEP] for many people, ailing has worked as a relief. [SEP] there's always an ideal world where you have to grow into your own. [SEP] "she was so excited," kroe said. [SEP] but when i say about it, you tell me what i want, and then there will be a large cup of sweet tea. [SEP] " i think he's going up and down, ' if we don't do that [SEP]
+
+===== sample 037 =====
+[CLS], which is not easy from the field. [SEP] that is enough in the case of a permanent new home. [SEP] he said that there appeared to be a chance that this year's budget might recover in time for the presidential election in january. [SEP] it's not something we have got to do in a big way. [SEP] "i don't have to have fun," he said, " but it would be a situation i can remember, and i would be the only one who may not want to know... [SEP] he took his first order out of his business. [SEP] dallas, texas (ap) - [SEP]
+
+===== sample 038 =====
+[CLS] 1 million, or 5. 3 percent, to $2. 377 a share, while second - quarter revenue, which declined by $3. 2 billion, or 3. 4 percent, declined. [SEP] "ultimately i wanted to know what it was like to be a footballer - - i felt i thought he would work for me in my life," said mr hill. [SEP] there have been three other changes to be in the squad. [SEP] the yemen - based al jazeera al - fitr al - e - aq al - islami group said more than 150 people have died so far in the country ' [SEP]
+
+===== sample 039 =====
+[CLS] nothing to stop the crime. [SEP] in reality, there has to be an attempt to sell the club to a manager who has little to offer, but he has nothing to talk about and that he would have to fight for a new job. [SEP] but in the case of the pope and the pope, there is a different view of the world, " he said. [SEP] some 2, 000 businesses were bailed out at the end of 2007, compared to more than 3 million. [SEP] the team's 6 - 3 road loss was only the knicks' sixth road win. [SEP] young, of north carolina high school, said he [SEP]
+
+===== sample 040 =====
+[CLS] and the rest of obama's visit, either in washington, or over the weekend. [SEP] but i have paid the cost to a hospital, bank and insurance agency. [SEP] but that is to be the outcome of this super - big question. [SEP] "life will not be easy, unless you allow your children to run from school. [SEP] but he said that a full trial for those two would be a significant boost to the children's case. [SEP] it's a way of being done, and i'm happy," he said. [SEP] " this is a very good case for making sure whether we should be allowed [SEP]
+
+===== sample 041 =====
+[CLS] to cars, hotels, food, and even handouts, "he says. [SEP] i'll go on a sort of sled (i like the show) and feel guilty. [SEP] it was the sort of situation we're getting ourselves in - - we just put a couple of hoops and games in our heads. [SEP] we'd never had a bit of what happened," he said. [SEP] " there are no guarantees that there will be as much change... as we expected - - but i have an idea of it happening. [SEP] the number will probably grow to about 100, 000 in the next [SEP]
+
+===== sample 042 =====
+[CLS] the news is over again, leaving him without a foot on the car. [SEP] and the answer never got to the end. [SEP] i was aware that my mind changed on the day when i arrived, that the woman had given access to me and all of the people. [SEP] that's interesting. [SEP] if i wait for 15 minutes before a concert, i will see him again (i'm sure i'll listen). [SEP] it's a short - term problem, and it's never going to make it to a big game, "he said. [SEP]" we believe some of the things we found to [SEP]
+
+===== sample 043 =====
+[CLS] [SEP] "i love the public option, but it's never been in the hospital, the brain, or the classroom," she said. [SEP] we would, well, turn the focus for years on the president. [SEP] of course, they will be allowed to claim "they take a year's leave" for charity, or "try to make money" for trying to buy a property on a scale which they think is "fair tax." [SEP] marshall's attorney, stephen heine, said there is a lot of work to do on toe - to - toe litigation - - no one knows where the matter is [SEP]
+
+===== sample 044 =====
+[CLS] 2010. [SEP] "it is very sad, really, because sometimes you feel like you don't be careful and that's what it takes to be successful," she added. [SEP] four other vessels, including hundreds of crew members, were also also aboard. [SEP] in fact, they came with a host of different colors, from green dustwhies to rashes and the white redness of the brain's tissues. [SEP] i don't want to win, but i'm on the other end. [SEP] i still want to finish school, even though i don't plan to leave. [SEP] the national [SEP]
+
+===== sample 045 =====
+[CLS]'s funny, but it's ridiculous, "clinton told reporters on a flight from chicago to new york. [SEP] we always get the loose ball, so the result is very good. [SEP]" i want to try to score more. [SEP] it didn't happen until the start of the season. [SEP] we're going to see that happen again. [SEP] in the past year, there have been reports of attacks, which rose to more than 1, 100 in 2008. [SEP] "it's a day to talk to the world," he said. [SEP] the male driver of the car - - robert james, 32 [SEP]
+
+===== sample 046 =====
+[CLS] willingness to step in to the public sphere. [SEP] you're just right, there's a lot to work out for you. [SEP] it is unlikely the next deal is due to be signed soon, because the costs are so high. [SEP] i know the first time i'm not sure i'm not going to make this happen to me, but at least i've thought of myself. [SEP] as good as it sounds, he wants to go to high school, but that is still to go, a long way to go on a full - term career in virginia. [SEP] even though he's done much of [SEP]
+
+===== sample 047 =====
+[CLS] they can make journeys between home and overseas. [SEP] meanwhile, cleveland's james brown and the celtics' kevin garnett offered a sort of push for the nba title. [SEP] i am sure it looks like people will be dead at the end of their lives, " she said. [SEP] 9 (upi) - - a study by u. s. health department officials found health systems in three states have a relatively high level of swine flu. [SEP] atlanta pushed the lead to 28 - 30 at the half - - including three of their nine 3 - pointers, including 4 - 1 1/2 minutes into the fourth [SEP]
+
+===== sample 048 =====
+[CLS] work relations and family relations. [SEP] the problem is very real. [SEP] the fate of the plant's owner, a nuclear official, is not to be known, but will be a critical component when the company reports at the start of the new year. [SEP] it also emerged that the victim did not know the government was ever involved in the case. [SEP] however, there is little time to go to work and create a new team. [SEP] i'm sorry, but i do think it's important to read the whole story. [SEP] when i woke up, there was a restlessness of numbness, which was my reaction [SEP]
+
+===== sample 049 =====
+[CLS] confident that the president's power would be used to protect the president's health, "he wrote in remarks to reuters. [SEP] but the prime minister said she wanted to be reunited in the hands of a different administration. [SEP] i was there a few minutes later, looking very nice and he was having a lot of staches this time... [SEP] and so, i was much more concerned with the idea of a permanent solution to the problem of nuclear proliferation. [SEP] a spokesman said:" " i think we need to account for the payouts but we do not think we will get a deal when we go. [SEP]
+
+===== sample 050 =====
+[CLS] she added. [SEP] if this really was a problem... we don't need one to make a reference to the "nature of iran's nuclear program" (and israel) that has nothing to do with u. s. policy, but we cannot wait for the west to do that now.... [SEP] "we would come in, give them a good chance and make it a win, so if we were going to make a change, then we would take it later," he says. [SEP] a good place to make money? [SEP] the second step would be to replace the 47 - year - old [SEP]
+
+===== sample 051 =====
+[CLS] a lender has to take a credit - card account. [SEP] but the organisation's appeal comes only two weeks after thousands of people killed or injured in violence. [SEP] "the president will get out of the way again, he can find what he knows a bit, what to get in there," he said. [SEP] and that is not a great result. [SEP] if you are playing for the australian team you will probably have to wait for the opportunity. [SEP] but that has not happened in mexico, and the authorities expect them to be able to contact the rest of the population. [SEP] it is not unusual for me to think [SEP]
+
+===== sample 052 =====
+[CLS] points. [SEP] he has refused to disclose the details of the scope of his investigation, but insisted that he did not know the nature of the risk he would be released in prison for life. [SEP] a spokesman for the school system could not immediately be reached. [SEP] going to haiti was, well, not - for - a - goal. [SEP] in her life, he said, the girls seemed to have sex when they had no choice. [SEP] i don't let the doctor tell your friend, friend or brother, the money you make when you feel stupid is to make the money. [SEP] there's some things to look into [SEP]
+
+===== sample 053 =====
+[CLS]. [SEP] the two had offices, conference facilities and apartment buildings, and that could not be confirmed. [SEP] a surprise decision to replace india's toyota as the world's largest automaker has lost millions of jobs. [SEP] he's a democrat, he's built into a business. [SEP] no working group has been able to raise this amount, but at least he's been able to do it. [SEP] the official said the executive committee at the end of the summit has been working with the u. s., russia and china to make a case against the move. [SEP] the meeting took place as early as a [SEP]
+
+===== sample 054 =====
+[CLS] something we didn't want, "he said. [SEP] officials said the driver left shortly after the crash and was allowed to leave for the morning shift. [SEP] the best way for them is make sure they do not keep it safe. [SEP] so it's not a bad start. [SEP]" that could give me problems, " he said. [SEP] at the end of the year, that number will be about 13. [SEP] we have to use the opportunity to try to change the past and find the way to the future. [SEP] i, however, have a little connection with mr. nader....... [SEP]
+
+===== sample 055 =====
+[CLS] "i was going to see one of them, not going to see that one" at a time, he said. [SEP] "if there's something that is going to be done, and we've all agreed that we'll be able to take it, i think there's something we can do," scurry said. [SEP] i guess we are trying to change that. [SEP] ryan smyth's goal tied the scoreless at 2 - 2 with 3: 05 left in the first. [SEP] more than 1, 200 people were injured in the crash, which killed 13 people between 2004 and 2006. [SEP] [SEP]
+
+===== sample 056 =====
+[CLS] don't think it is going to be like having make - up cheques in your car. [SEP] but if he's right, he's a coward. [SEP] and, well, well, we're going to know he's dead... and we don't have too much for him in jail. [SEP] "i don't like to be the wrong person, but i think it's her job to be honest," she said before t. o. c. asked if her life had changed. [SEP] this is expected to total approximately $50 million in 2008 - 2010. [SEP] it [SEP]
+
+===== sample 057 =====
+[CLS] and we regain their independence. [SEP] john leahy, head of securities brokers, said the company's results have helped investors to focus on their options given the current economic environment. [SEP] "i usually have a job with a large group, where i have to do a job, sometimes for at least a year to a year," he said. [SEP] " it would be a political stunt. [SEP] the heat won two games in the series, which ended after the season started going 2 - for - 5. [SEP] the pirates took off with a two - 0 run. [SEP] i cannot also look at other activities here. [SEP] [SEP]
+
+===== sample 058 =====
+[CLS] may have to pay other costs for their homes. [SEP] the family said they were trying to get a lawyer. [SEP] he was expected to return from his holiday when he returned to britain at the end of april. [SEP] associated press writer suna deby in nairobi, kenya contributed to this report. [SEP] when we focus on each other, we have a different response in which we respond to all of our problems. [SEP] after all, we have no jobs. [SEP] he retired at the end of the season in his second year in less than a year with the new york jets but he hasn't been with the packers. [SEP] he [SEP]
+
+===== sample 059 =====
+[CLS], we now have a focus on what we have to do. [SEP] that said, if you want to convene his position at this point he'll make a decision at this point to take stock in the company. [SEP] however, both companies have been forced to change the law to try to protect themselves against the recession. [SEP] she's only 18 years old, and she's over four years. [SEP] it is still running out of money and just doesn't seem to know much. [SEP] "i'm confident the next president will resolve the problem," he said. [SEP] that's what we need [SEP]
+
+===== sample 060 =====
+[CLS] co. [SEP] the border wall, which stands out on a concrete strip on the other side of the border, is now closed. [SEP] that's pretty much in itself. [SEP] it was a lot of fun. [SEP] it would have been easier to write off. [SEP] overtime _ 2, detroit, min, min (hooking), 17: 08 roy, min (hooking), 18: 08. [SEP] associated press writer anne gearan in washington contributed to this report. [SEP] "the rest of the tour is all i can and it forces me to get back and get the race there," she said. [SEP] [SEP]
+
+===== sample 061 =====
+[CLS] the game - clincher at 2 - 3, scored on a power play just 22 minutes in the second period. [SEP] they may have turned his face on the subject, put in an interview and, with a smile, focused for days on the image of himself in the face. [SEP] " we are used to the leadership of the army. [SEP] i only was able to walk when i was in the middle of the night and thought i could have been standing in the tunnel. [SEP] donaghy said the league's decision does not comment on its decision. [SEP] his father reportedly died in december. [SEP] after india's elections [SEP]
+
+===== sample 062 =====
+[CLS] home to a home with her 7 - year - old son. [SEP] the letters were only "written in the united states," according to national intelligence officials. [SEP] for that part of the day, president obama, who felt he had to make another big shift in the campaign, was a little far from in the right position for the region. [SEP] "he needs to be a better for the team," said a source. [SEP] last year he issued 2, 035 orders in january. [SEP] the shows will air on the discovery channel and other shows next year. [SEP] it may seem to me at the top of this table [SEP]
+
+===== sample 063 =====
+[CLS] iraq, according to a recent report in the post. [SEP] mr. sandro is left by the end of the story, leaving him in the car, going off for hours - if not minutes - - in his hands. [SEP] "we are looking for a long - term extension of this strategy. [SEP]" our differences are great and i do not want to be alone. [SEP] "i know, the first time he started it, i would tell him to take him, it was always hard to pick a player after him, so i don't know if he could make up his mind. [SEP]" i don't [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_256steps_n64/state_c256_t1p45_raw_samples.txt

@@ -0,0 +1,228 @@
+state_c256_t1p45
+{
+  "type": "summary",
+  "name": "state_c256_t1p45",
+  "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt",
+  "step": 124000,
+  "decode": {
+    "kind": "categorical_fullvocab",
+    "config": "state_c256_t1p45",
+    "steps": 256,
+    "model_t_mode": "post",
+    "support_power": 1.0,
+    "semantic_power": 1.0,
+    "endpoint_temp": 1.45,
+    "concentration_min": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 29.81545187350111,
+    "nll_per_token": 3.3950267783717107,
+    "tokens": 9500
+  },
+  "diversity": {
+    "sample_entropy": 4.085741040367163,
+    "unique_tokens": 1473,
+    "token_count": 8192,
+    "distinct_1": 0.1798095703125,
+    "distinct_2": 0.5905511811023622,
+    "top_token_mass": 0.0538330078125
+  }
+}
+
+===== sample 000 =====
+[CLS] press reported. [SEP] i would have to cancel a couple of flights, but i was free to go... [SEP] the project, costing £1, 500, will make it possible to bring some of the world ' s best teams to the uk. [SEP] we ' re going to have an investigation that, with all our evidence, we have never seen before, " he added. [SEP] the carmaker ford lost $ 60m in the first quarter alone. [SEP] " there is a real need for transparency. [SEP] the scale of the devastation has been driven by the displacement and reshaping of nearly 10, 000 people around the world [SEP]
+
+===== sample 001 =====
+[CLS] - trade plan. [SEP] in the past, we have looked back at some ways, and i think the problem is, we did not get this far. [SEP] " i think, ' john, i think he ' s ok, but i ' m not really in a position to talk to you. [SEP] " it was a little bit of a big fight and we had to be aware of it, " said the german. [SEP] for a moment, the place, if you kind of look out, seems to sit in perspective. [SEP] when a discussion of the president ' s fate actually takes place, so many of those who know [SEP]
+
+===== sample 002 =====
+[CLS] the white house, " he says. [SEP] i ' ve never known there has been a huge factor in the game. [SEP] he likes to get up, but a little bit well, and just works well in the gym. [SEP] " i think we have to get a good deal, so if the result is a win, the majority is in danger of losing, " ender said. [SEP] " the idea is to get the money they want to get, and we ' re not able to make money, " added schbutter. [SEP] the police have said that they were investigating more than a dozen complaints. [SEP] but [SEP]
+
+===== sample 003 =====
+[CLS] quite the way we are. [SEP] i just hope that i can do it again. [SEP] he says that he doesn ' t think he should talk to anyone trying to sell himself. [SEP] you know we ' ll take our lessons, " said the foreign official. [SEP] i ' ve liked one one, i like the other, and of course he has to deal with this if he is a candidate when he gets into it. [SEP] " there are also things you want to do with that work, such as getting dressed in white clouds, or capels, or even a black scarf, " he added. [SEP] a government agency investigating [SEP]
+
+===== sample 004 =====
+[CLS] : " the total of stolen items includes a number of personal items including household goods, airbags and computers. [SEP] " i don ' t think it was until my 70s that i really got into trouble, " he said, " i can ' t make it much better - - i didn ' t even have a talking point. [SEP] officials from around the world and more than a 100 other countries attended the event. [SEP] while he is so popular in the united states, he is critical of his free - trade policies in the u. s. and calling for the collapse of the union. [SEP] the production also features a three - [SEP]
+
+===== sample 005 =====
+[CLS] guide them to the democratic nomination. [SEP] " i ' ve got quite a concern about the number of people who have worked and the number of people who have been working and thought about the quality of things that are done or if they have been worked out. [SEP] " we don ' t want to know that he can play in the future, " said peter westbrook, the club ' s assistant coach. [SEP] it was last updated at 20. 54 bst on thursday 16 may 2009. office for the city of london. greater london, south london. £36, 624 to £43, 000 per annum. [SEP] he [SEP]
+
+===== sample 006 =====
+[CLS] air crash in rome, witnesses said. [SEP] " i ' ll do that and i ' m glad this has been resolved. [SEP] since the 10th century, the u. s. government has never been part of iraq. [SEP] it said that after several days the children, who would be temporary workers who did not see their parents for another six weeks, would not receive full visas and would be free from their work. [SEP] i just wanted to let him stand up and try to get here, " according to the eca. [SEP] the nets also scored 13 of his 15 points in 20 minutes - - he had 16 rebounds in the [SEP]
+
+===== sample 007 =====
+[CLS] in a series of federal deficits and budget shortcomings. [SEP] i mean, if you ask me to look at you, you ' re a celebrity, it ' s just hard to imagine. [SEP] a 19. 1 share in california ' s unemployment report, down slightly in chicago in august. [SEP] in the end, the swiss group had to set a compensation deal with the government and was promised the full compensation of the bank ' s 5, 000 employees. [SEP] so it ' s not been easy for him, as we both know the rules. [SEP] the first game of the series was 14 - point loss to detroit. [SEP]
+
+===== sample 008 =====
+[CLS] 57. 7 million. [SEP] i believe that they will not be able to pay the cost. [SEP] " if we ' ve got a team where we are up to the task, we want to do it in terms of our commitment to football, " barca said. [SEP] what has been the challenge for children to learn from the past? [SEP] mr brown said the leaders had all agreed on a get - in for the couple. [SEP] on wednesday, the protesters sent riot police, police trucks, fire engines and soldiers on their way to the stadium for a second time. [SEP] the group is led by john bord. [SEP] but [SEP]
+
+===== sample 009 =====
+[CLS] their vehicles. [SEP] still, it took them four years to achieve the first cut in the government ' s funding in three years and start to the school year. [SEP] we ' ve told them. [SEP] the victims collected up to $ 20, 000 in cash, cash, cash, cash, cigarettes and cash, police said. [SEP] " when we get down to the final i think it ' s something that we have been trying to do for a long time for us. [SEP] " it ' s just a small number to look for, it ' s not true, " she said, " " well, i don ' t need [SEP]
+
+===== sample 010 =====
+[CLS] - - " he joked. [SEP] " this announcement is a response to the lack of public funding, " said a spokesman of the children of education committee. [SEP] however, as a result, i think i ' m in the right mood. [SEP] clinton has said the us will help to improve the political situation in zimbabwe. [SEP] we ' ll see. [SEP] and it is a great thing to help them in the day and help them in a good way. [SEP] on the other hand, one thing is to overcome this fear and prejudice. [SEP] another £1 million a year has also gone into the children ' s education fund, which has [SEP]
+
+===== sample 011 =====
+[CLS] in front of others. [SEP] it just seems to pick up the air of the wind. [SEP] boca raton, fla., march 3 ( upi ) - - owners of u. s. retailers said they expect to be down by as much as 10 percent in the second half of 2008, a survey said. [SEP] he lives in chicago. [SEP] he said there was no sign the club was going to replace him, so there was none of them to replace him. [SEP] the court heard the ex - president was staying at home, four years after losing the presidency in 2001. [SEP] on friday, senate republican leader john [SEP]
+
+===== sample 012 =====
+[CLS] weekend, said he was " tired " and had " nothing to do " with a run that was " normal " after he started. [SEP] i had the message being, " don ' t talk about you anymore. " [SEP] i have sex every day, every 20 - year - old girl loves it. [SEP] you ' re always looking to pick up a job of your own or make some money, but there ' s a lot of work to get in. [SEP] where are your best friends? [SEP] i ' m sure that he ' s the guy who can have the things we want, have the things that i can trust, [SEP]
+
+===== sample 013 =====
+[CLS]. s. kabul, afghanistan ( ap ) - - a roadside bomb ripped through an eastern afghan town wednesday, killing a dozen people and wounding 24 others, including three children, and a schoolgirl, provincial police and officials said. [SEP] until then, at least it hadn ' t come to saturday ' s conclusion. [SEP] " no one will be responsible for the breach of security, " he added. [SEP] the safety condition of the two - lane scat would be set in proportion to a narrow exit where the driver of a car on the other side would hit the driver ' s hand, causing the driver to be stuck. [SEP] [SEP]
+
+===== sample 014 =====
+[CLS] " said mohammed. [SEP] he is so fast - - and yet he sees, at first, the freshness of the light and the warmth of the all - around sun that brought him down from the moon to earth. [SEP] we still don ' t know. [SEP] " you don ' t always know what you ' re going for. [SEP] " it ' s hard to see, it ' s hard to take out anything that ' s important at all, " she says. [SEP] " we did have more problems, " said coach scott brown, a member of the nfl players ' association. [SEP] " the president and manager, all [SEP]
+
+===== sample 015 =====
+[CLS] of the children. [SEP] they won ' t be able to see you, but we better know them if they don ' t put their money on a table. [SEP] i don ' t know. [SEP] that used to be fine on the street, but with the doors closed and the busses running from front to back streets, it didn ' t go that far. [SEP] in the early 2000s, however, rates were sharply lower. [SEP] " there ' s a lot of work going on, and it was not wrong, " he said. [SEP] " i ' ve just got a little bit of a fight. [SEP] since then, [SEP]
+
+===== sample 016 =====
+[CLS] said. [SEP] similar turbines are being built in the uk, but needs to be completed by 2013, said a senior government official involved in the talks. [SEP] he made 25 of 32 shots from the field before punting on 3 - of - 13 three - goal attempts saturday night in the wild 1 - 0 loss to san jose city, the first victory of the season a day earlier. [SEP] there ' s a problem that can seem to cause any amount of mental pain, " said kitz. [SEP] we must change our perception, and without any change, we must still make a lot of mistakes, and act fast, and we [SEP]
+
+===== sample 017 =====
+[CLS] to obama ' s visit to america in june, that he seemed to understand that he really was going to behave in different conditions. [SEP] there is such a sense of optimism and change for you, according to cbs / kland. com. [SEP] it would be in good faith. [SEP] " that ' s not necessarily what we ' re about. [SEP] that ' s a good thing, it ' s kind of a joke. [SEP] wake up and drop the story for comment. [SEP] " we believe that we still have the ability to win, " said mr brown. [SEP] new york - kirilenko scored 26 points and jason terry [SEP]
+
+===== sample 018 =====
+[CLS] in the first quarter of december 2007. [SEP] the u. s. c. arrived at the air station at about 8 a. m. and returned immediately, according to one person with knowledge of the condition of monday ' s departures. [SEP] the president has gotten the message quickly and cautioned citizens to be on alert. [SEP] capello ' s team could play against the united states in this week ' s group stage, and italy has three games in the final, but it ' s not. [SEP] then, however, we moved into the middle of a relationship. [SEP] lake city, ill. - - the man who killed [SEP]
+
+===== sample 019 =====
+[CLS] confirmed his move to rangers on tuesday and are due to start their european campaign in the light of the first game of chelsea ' s trip to ibrox. [SEP] the trial was scheduled to take place in 2009. [SEP] we ' re not doing enough - - we will get that fast if we can go. [SEP] for example, the concept of a low - end car could go on the road. [SEP] " i ' m concerned that we will have a new set of rules that we have to sort out, and there will be more changes in financial financial systems over the couple of years, " he said. [SEP] the capital, [SEP]
+
+===== sample 020 =====
+[CLS] person familiar with the matter. [SEP] new york ' s health insurance program is designed to inflate financial costs. [SEP] it took only a few minutes to develop. [SEP] at that time, in february 2008, the percentage of people paying a 10 - year mortgage rose this year from 13 % to 3. 8 %. [SEP] they let us do nothing in the past. [SEP] " we don ' t talk about a financial crisis, it ' s just getting people together, " he added. [SEP] but the goal is to make up for the fire that is coming in markets that are getting stressed, including mortgage - backed securities, which [SEP]
+
+===== sample 021 =====
+[CLS] still lives, and he knows how to make a living. [SEP] the council has provided £5, 000 to cover the building and £5, 000 to design, with the rest still to be added. [SEP] it is really hard for him to see anything in a way. [SEP] the mets are trying to add santana, for example, who is looking for a good season. [SEP] then she dropped off her clothes. [SEP] he is still trying to keep a lead while even keeping the ball in playoff games. [SEP] the union said it represents more than 2, 000 temporary workers, and that drivers would have to work overtime. [SEP] instead, the [SEP]
+
+===== sample 022 =====
+[CLS] 1. 5 - game run. [SEP] in 2004, chicago - based boston pitchers hit jason varitek three times. [SEP] he had been jailed in october 2007 for six months, and before he was last seen near his family home in parkville, n. j., he was drunk during his break - in. [SEP] last week darling announced that the public debt - - which includes roads, playgrounds, super - schools, universities, schools, hospitals, hospitals, high - rises and roads - - would be repaid by the end of the year. [SEP] the team is one of the best teams on the planet. [SEP] [SEP]
+
+===== sample 023 =====
+[CLS] million. [SEP] " when i ' m not there, it ' s not about winning, it ' s winning. [SEP] at the time, the young man wore a jumper with his short - sleeve shirt, and a dark shirt, bottoms and bottoms. [SEP] father phillips, 67, said that he had already seen his wife, and that in a marriage he ' s had 50 years and 10 children. [SEP] there is no connection between reading and high school scores. [SEP] meanwhile, the u. s. foreign relations office is doing so in line with international court rules. [SEP] i don ' t need anything. [SEP] the electoral process has [SEP]
+
+===== sample 024 =====
+[CLS] part of the couple ' s life - - a three - way, four - year relationship. [SEP] when i ' ve had a break - - i would want to take one other out, but i ' m not alone - - i always get depressed. [SEP] switzerland, and swiss banks in particular, has a lot of the money flowing. [SEP] he also said that it was important to have the support of all people. [SEP] i have to believe that we should start talking to the world. [SEP] by the time we came round, the doors were open. [SEP] but nobody has thought of a full sit - down, or even a [SEP]
+
+===== sample 025 =====
+[CLS] that they are to be well informed and that message is very strong, " he said. [SEP] he said then, " i know it is the day of the game and it was particularly important and would have been a good start. [SEP] and maybe he wasn ' t funny, but people think he was real. [SEP] by the start of the 2004 presidential campaign - - just a three months - - he was on the need to talk with americans about his patriotism. [SEP] but don ' t expect a panic. [SEP] he doesn ' t understand where you are, " he said. [SEP] " i find it hard to make the most [SEP]
+
+===== sample 026 =====
+[CLS] smashed glass windows in his home. [SEP] " it could be said that when we ' re not going to do something - - we don ' t know, we ' re going to do something - - we can have a better life. [SEP] " i really wanted to do something, i love it because i thought twice about you, that kind of really about what i can do. [SEP] he says he paid $ 10, 000 and sold the tickets for $ 800, but he was able to get out of the room. [SEP] " they are the people who would have been a small part of that, " hairston said. [SEP] [SEP]
+
+===== sample 027 =====
+[CLS] crack down on the quality of their players. [SEP] smith, however, remains optimistic. [SEP] " it ' s hard to call some of the facilities part of a return to old days, " he said, as a man waited in the new president ' s office at the palace. [SEP] you can just take a flight from the office and then get a job, a salary or a couple of dollars to make a visit. [SEP] i knew i had to live in my own well - lit tent, an out - of - town place and a place to go in. [SEP] however, we ' ve got a lot of people having to [SEP]
+
+===== sample 028 =====
+[CLS] m. c. a. tournament. [SEP] u. s. troops killed in iraq in 2007 dropped up to 38 at the start of this year, according to the pentagon ' s statement. [SEP] i am a college student because i have lived all my life. [SEP] now, that ' s a small group. [SEP] hours after the team ' s president announced his decision on thursday night, the knicks protested and asked thomas to not sign his contract and had no comment. [SEP] but if that ' s enough to stop that change, it has yet to be approved. [SEP] " it ' s fair to say there is a huge part of [SEP]
+
+===== sample 029 =====
+[CLS] return at home. [SEP] for example, the western state of england is thought to have the largest share of the population of 11 percent. [SEP] " the allegations are untrued, " he says. [SEP] in the ruling, mr justice weir said : " mr mcnulty immediately went to the office of justice and provided his details to the tax office, the revenue commissioner, the irs, the treasury secretary, the attorney general and the u. s. department of justice to help to provide financial services in the uk. [SEP] we ' ve done it. [SEP] the two are also likely to focus on the need for political settlement [SEP]
+
+===== sample 030 =====
+[CLS] his own close relationship with his old england manager. [SEP] " the road can get to the end. [SEP] he has been known to move in the past few months. [SEP] " immediately after the blast, we had a very difficult effort to get our eye out of the area. [SEP] " we ' d be talking about how you can ' t go over there, which i don ' t know, that kind of thing, you know, that was, " mr. jordan said. [SEP] it ' s hard to believe, people. [SEP] but it may not come until the end of the year. [SEP] but in truth, i had [SEP]
+
+===== sample 031 =====
+[CLS] sunday ' s event. [SEP] ", however, the misunderstandings on this issue have to be addressed, " the officials said. [SEP] still, the loss of a loan, which is made for them by their lenders, is not enough of a reason to let go. [SEP] it is also expected that a number of measures will be made to turn around the world economy. [SEP] about a third of the country ' s 2 million children and their families are estimated to be poor, most of them due to poverty. [SEP] we have all been in it for too long, but we have to put up our best ideas. [SEP] the [SEP]
+
+===== sample 032 =====
+[CLS] need to put this money on their tax bill by now, and that isn ' t quite much down at the end of 2011. [SEP] in a study from 2004 to 2008, the percentage of female child victims increased slightly to just 2. 3 percent. [SEP] i was born long before i was done. [SEP] they haven ' t done it. [SEP] he can ' t live to lose. [SEP] he ' s got a good game, and he does it well. [SEP] " i would say it was a good start to make decisions for you, " he said. [SEP] i don ' t really think that we didn ' t want to [SEP]
+
+===== sample 033 =====
+[CLS] and italy. [SEP] finally, instead of watching, i had to go to the weather office to check up for the next morning. [SEP] " the market to build a market is going to be built in a kind of way. [SEP] he told the newspaper in the days before the murder trial that he had no regrets and would not fight the charges. [SEP] " i don ' t think you should be allowed to talk about it, but i ' m not very happy, " he said. [SEP] on saturday, he was attacked with another woman in the force area. [SEP] but that does not happen. [SEP] " there didn ' t be [SEP]
+
+===== sample 034 =====
+[CLS], 50 years in a row, to seven games. [SEP] the woman is about 5ft 6in tall ( 4. 8m, 11. 4m ). [SEP] he is there, exposing syonies, making repeated gestures at them, biting them, and raping them hideously. [SEP] even before he had a good season with the yankees, the team was dominant. [SEP] the house of commons, the upper chamber, has used the two - thirds majority to bring in 21 seats. [SEP] " you have to come back to me and have a conversation with me and i want to win. [SEP] i don ' t think [SEP]
+
+===== sample 035 =====
+[CLS] the first time sunday. [SEP] " i knew that i wanted to be able to be there, " rodriguez said in a statement. [SEP] " if they didn ' t have that kind of money, then it wouldn ' t happen at all, " mr horsin said. [SEP] " the door is no longer open, " she said. [SEP] ms. bork, 53, and her son, austin, have developed an interest in state - funded insurance companies. [SEP] but that strategy seemed to work well with him. [SEP] 27 / prnewswire / - - raytheon corporation ( nyse : dn ), [SEP]
+
+===== sample 036 =====
+[CLS] it seemed to take a while to get me started, so i wanted to start the game. [SEP] but it was set up by government and international organizations that also supported the project. [SEP] for many people, ailing has worked as a relief. [SEP] there ' s always an ideal world where you have to grow into your own. [SEP] " she was so excited, " kroe said. [SEP] but when i say about it, you tell me what i want, and then there will be a large cup of sweet tea. [SEP] " i think he ' s going up and down, ' if we don ' t do that [SEP]
+
+===== sample 037 =====
+[CLS], which is not easy from the field. [SEP] that is enough in the case of a permanent new home. [SEP] he said that there appeared to be a chance that this year ' s budget might recover in time for the presidential election in january. [SEP] it ' s not something we have got to do in a big way. [SEP] " i don ' t have to have fun, " he said, " but it would be a situation i can remember, and i would be the only one who may not want to know... [SEP] he took his first order out of his business. [SEP] dallas, texas ( ap ) - [SEP]
+
+===== sample 038 =====
+[CLS] 1 million, or 5. 3 percent, to $ 2. 377 a share, while second - quarter revenue, which declined by $ 3. 2 billion, or 3. 4 percent, declined. [SEP] " ultimately i wanted to know what it was like to be a footballer - - i felt i thought he would work for me in my life, " said mr hill. [SEP] there have been three other changes to be in the squad. [SEP] the yemen - based al jazeera al - fitr al - e - aq al - islami group said more than 150 people have died so far in the country ' [SEP]
+
+===== sample 039 =====
+[CLS] nothing to stop the crime. [SEP] in reality, there has to be an attempt to sell the club to a manager who has little to offer, but he has nothing to talk about and that he would have to fight for a new job. [SEP] but in the case of the pope and the pope, there is a different view of the world, " he said. [SEP] some 2, 000 businesses were bailed out at the end of 2007, compared to more than 3 million. [SEP] the team ' s 6 - 3 road loss was only the knicks ' sixth road win. [SEP] young, of north carolina high school, said he [SEP]
+
+===== sample 040 =====
+[CLS] and the rest of obama ' s visit, either in washington, or over the weekend. [SEP] but i have paid the cost to a hospital, bank and insurance agency. [SEP] but that is to be the outcome of this super - big question. [SEP] " life will not be easy, unless you allow your children to run from school. [SEP] but he said that a full trial for those two would be a significant boost to the children ' s case. [SEP] it ' s a way of being done, and i ' m happy, " he said. [SEP] " this is a very good case for making sure whether we should be allowed [SEP]
+
+===== sample 041 =====
+[CLS] to cars, hotels, food, and even handouts, " he says. [SEP] i ' ll go on a sort of sled ( i like the show ) and feel guilty. [SEP] it was the sort of situation we ' re getting ourselves in - - we just put a couple of hoops and games in our heads. [SEP] we ' d never had a bit of what happened, " he said. [SEP] " there are no guarantees that there will be as much change... as we expected - - but i have an idea of it happening. [SEP] the number will probably grow to about 100, 000 in the next [SEP]
+
+===== sample 042 =====
+[CLS] the news is over again, leaving him without a foot on the car. [SEP] and the answer never got to the end. [SEP] i was aware that my mind changed on the day when i arrived, that the woman had given access to me and all of the people. [SEP] that ' s interesting. [SEP] if i wait for 15 minutes before a concert, i will see him again ( i ' m sure i ' ll listen ). [SEP] it ' s a short - term problem, and it ' s never going to make it to a big game, " he said. [SEP] " we believe some of the things we found to [SEP]
+
+===== sample 043 =====
+[CLS] [SEP] " i love the public option, but it ' s never been in the hospital, the brain, or the classroom, " she said. [SEP] we would, well, turn the focus for years on the president. [SEP] of course, they will be allowed to claim " they take a year ' s leave " for charity, or " try to make money " for trying to buy a property on a scale which they think is " fair tax. " [SEP] marshall ' s attorney, stephen heine, said there is a lot of work to do on toe - to - toe litigation - - no one knows where the matter is [SEP]
+
+===== sample 044 =====
+[CLS] 2010. [SEP] " it is very sad, really, because sometimes you feel like you don ' t be careful and that ' s what it takes to be successful, " she added. [SEP] four other vessels, including hundreds of crew members, were also also aboard. [SEP] in fact, they came with a host of different colors, from green dustwhies to rashes and the white redness of the brain ' s tissues. [SEP] i don ' t want to win, but i ' m on the other end. [SEP] i still want to finish school, even though i don ' t plan to leave. [SEP] the national [SEP]
+
+===== sample 045 =====
+[CLS] ' s funny, but it ' s ridiculous, " clinton told reporters on a flight from chicago to new york. [SEP] we always get the loose ball, so the result is very good. [SEP] " i want to try to score more. [SEP] it didn ' t happen until the start of the season. [SEP] we ' re going to see that happen again. [SEP] in the past year, there have been reports of attacks, which rose to more than 1, 100 in 2008. [SEP] " it ' s a day to talk to the world, " he said. [SEP] the male driver of the car - - robert james, 32 [SEP]
+
+===== sample 046 =====
+[CLS] willingness to step in to the public sphere. [SEP] you ' re just right, there ' s a lot to work out for you. [SEP] it is unlikely the next deal is due to be signed soon, because the costs are so high. [SEP] i know the first time i ' m not sure i ' m not going to make this happen to me, but at least i ' ve thought of myself. [SEP] as good as it sounds, he wants to go to high school, but that is still to go, a long way to go on a full - term career in virginia. [SEP] even though he ' s done much of [SEP]
+
+===== sample 047 =====
+[CLS] they can make journeys between home and overseas. [SEP] meanwhile, cleveland ' s james brown and the celtics ' kevin garnett offered a sort of push for the nba title. [SEP] i am sure it looks like people will be dead at the end of their lives, " she said. [SEP] 9 ( upi ) - - a study by u. s. health department officials found health systems in three states have a relatively high level of swine flu. [SEP] atlanta pushed the lead to 28 - 30 at the half - - including three of their nine 3 - pointers, including 4 - 1 1 / 2 minutes into the fourth [SEP]
+
+===== sample 048 =====
+[CLS] work relations and family relations. [SEP] the problem is very real. [SEP] the fate of the plant ' s owner, a nuclear official, is not to be known, but will be a critical component when the company reports at the start of the new year. [SEP] it also emerged that the victim did not know the government was ever involved in the case. [SEP] however, there is little time to go to work and create a new team. [SEP] i ' m sorry, but i do think it ' s important to read the whole story. [SEP] when i woke up, there was a restlessness of numbness, which was my reaction [SEP]
+
+===== sample 049 =====
+[CLS] confident that the president ' s power would be used to protect the president ' s health, " he wrote in remarks to reuters. [SEP] but the prime minister said she wanted to be reunited in the hands of a different administration. [SEP] i was there a few minutes later, looking very nice and he was having a lot of staches this time... [SEP] and so, i was much more concerned with the idea of a permanent solution to the problem of nuclear proliferation. [SEP] a spokesman said : " " i think we need to account for the payouts but we do not think we will get a deal when we go. [SEP]
+
+===== sample 050 =====
+[CLS] she added. [SEP] if this really was a problem... we don ' t need one to make a reference to the " nature of iran ' s nuclear program " ( and israel ) that has nothing to do with u. s. policy, but we cannot wait for the west to do that now.... [SEP] " we would come in, give them a good chance and make it a win, so if we were going to make a change, then we would take it later, " he says. [SEP] a good place to make money? [SEP] the second step would be to replace the 47 - year - old [SEP]
+
+===== sample 051 =====
+[CLS] a lender has to take a credit - card account. [SEP] but the organisation ' s appeal comes only two weeks after thousands of people killed or injured in violence. [SEP] " the president will get out of the way again, he can find what he knows a bit, what to get in there, " he said. [SEP] and that is not a great result. [SEP] if you are playing for the australian team you will probably have to wait for the opportunity. [SEP] but that has not happened in mexico, and the authorities expect them to be able to contact the rest of the population. [SEP] it is not unusual for me to think [SEP]
+
+===== sample 052 =====
+[CLS] points. [SEP] he has refused to disclose the details of the scope of his investigation, but insisted that he did not know the nature of the risk he would be released in prison for life. [SEP] a spokesman for the school system could not immediately be reached. [SEP] going to haiti was, well, not - for - a - goal. [SEP] in her life, he said, the girls seemed to have sex when they had no choice. [SEP] i don ' t let the doctor tell your friend, friend or brother, the money you make when you feel stupid is to make the money. [SEP] there ' s some things to look into [SEP]
+
+===== sample 053 =====
+[CLS]. [SEP] the two had offices, conference facilities and apartment buildings, and that could not be confirmed. [SEP] a surprise decision to replace india ' s toyota as the world ' s largest automaker has lost millions of jobs. [SEP] he ' s a democrat, he ' s built into a business. [SEP] no working group has been able to raise this amount, but at least he ' s been able to do it. [SEP] the official said the executive committee at the end of the summit has been working with the u. s., russia and china to make a case against the move. [SEP] the meeting took place as early as a [SEP]
+
+===== sample 054 =====
+[CLS] something we didn ' t want, " he said. [SEP] officials said the driver left shortly after the crash and was allowed to leave for the morning shift. [SEP] the best way for them is make sure they do not keep it safe. [SEP] so it ' s not a bad start. [SEP] " that could give me problems, " he said. [SEP] at the end of the year, that number will be about 13. [SEP] we have to use the opportunity to try to change the past and find the way to the future. [SEP] i, however, have a little connection with mr. nader....... [SEP]
+
+===== sample 055 =====
+[CLS] " i was going to see one of them, not going to see that one " at a time, he said. [SEP] " if there ' s something that is going to be done, and we ' ve all agreed that we ' ll be able to take it, i think there ' s something we can do, " scurry said. [SEP] i guess we are trying to change that. [SEP] ryan smyth ' s goal tied the scoreless at 2 - 2 with 3 : 05 left in the first. [SEP] more than 1, 200 people were injured in the crash, which killed 13 people between 2004 and 2006. [SEP] [SEP]
+
+===== sample 056 =====
+[CLS] don ' t think it is going to be like having make - up cheques in your car. [SEP] but if he ' s right, he ' s a coward. [SEP] and, well, well, we ' re going to know he ' s dead... and we don ' t have too much for him in jail. [SEP] " i don ' t like to be the wrong person, but i think it ' s her job to be honest, " she said before t. o. c. asked if her life had changed. [SEP] this is expected to total approximately $ 50 million in 2008 - 2010. [SEP] it [SEP]
+
+===== sample 057 =====
+[CLS] and we regain their independence. [SEP] john leahy, head of securities brokers, said the company ' s results have helped investors to focus on their options given the current economic environment. [SEP] " i usually have a job with a large group, where i have to do a job, sometimes for at least a year to a year, " he said. [SEP] " it would be a political stunt. [SEP] the heat won two games in the series, which ended after the season started going 2 - for - 5. [SEP] the pirates took off with a two - 0 run. [SEP] i cannot also look at other activities here. [SEP] [SEP]
+
+===== sample 058 =====
+[CLS] may have to pay other costs for their homes. [SEP] the family said they were trying to get a lawyer. [SEP] he was expected to return from his holiday when he returned to britain at the end of april. [SEP] associated press writer suna deby in nairobi, kenya contributed to this report. [SEP] when we focus on each other, we have a different response in which we respond to all of our problems. [SEP] after all, we have no jobs. [SEP] he retired at the end of the season in his second year in less than a year with the new york jets but he hasn ' t been with the packers. [SEP] he [SEP]
+
+===== sample 059 =====
+[CLS], we now have a focus on what we have to do. [SEP] that said, if you want to convene his position at this point he ' ll make a decision at this point to take stock in the company. [SEP] however, both companies have been forced to change the law to try to protect themselves against the recession. [SEP] she ' s only 18 years old, and she ' s over four years. [SEP] it is still running out of money and just doesn ' t seem to know much. [SEP] " i ' m confident the next president will resolve the problem, " he said. [SEP] that ' s what we need [SEP]
+
+===== sample 060 =====
+[CLS] co. [SEP] the border wall, which stands out on a concrete strip on the other side of the border, is now closed. [SEP] that ' s pretty much in itself. [SEP] it was a lot of fun. [SEP] it would have been easier to write off. [SEP] overtime _ 2, detroit, min, min ( hooking ), 17 : 08 roy, min ( hooking ), 18 : 08. [SEP] associated press writer anne gearan in washington contributed to this report. [SEP] " the rest of the tour is all i can and it forces me to get back and get the race there, " she said. [SEP] [SEP]
+
+===== sample 061 =====
+[CLS] the game - clincher at 2 - 3, scored on a power play just 22 minutes in the second period. [SEP] they may have turned his face on the subject, put in an interview and, with a smile, focused for days on the image of himself in the face. [SEP] " we are used to the leadership of the army. [SEP] i only was able to walk when i was in the middle of the night and thought i could have been standing in the tunnel. [SEP] donaghy said the league ' s decision does not comment on its decision. [SEP] his father reportedly died in december. [SEP] after india ' s elections [SEP]
+
+===== sample 062 =====
+[CLS] home to a home with her 7 - year - old son. [SEP] the letters were only " written in the united states, " according to national intelligence officials. [SEP] for that part of the day, president obama, who felt he had to make another big shift in the campaign, was a little far from in the right position for the region. [SEP] " he needs to be a better for the team, " said a source. [SEP] last year he issued 2, 035 orders in january. [SEP] the shows will air on the discovery channel and other shows next year. [SEP] it may seem to me at the top of this table [SEP]
+
+===== sample 063 =====
+[CLS] iraq, according to a recent report in the post. [SEP] mr. sandro is left by the end of the story, leaving him in the car, going off for hours - if not minutes - - in his hands. [SEP] " we are looking for a long - term extension of this strategy. [SEP] " our differences are great and i do not want to be alone. [SEP] " i know, the first time he started it, i would tell him to take him, it was always hard to pick a player after him, so i don ' t know if he could make up his mind. [SEP] " i don ' t [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_256steps_n64/state_c256_t1p45_scored.jsonl

@@ -0,0 +1,65 @@
+{"type": "summary", "name": "state_c256_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c256_t1p45", "steps": 256, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 29.81545187350111, "nll_per_token": 3.3950267783717107, "tokens": 9500}, "diversity": {"sample_entropy": 4.085741040367163, "unique_tokens": 1473, "token_count": 8192, "distinct_1": 0.1798095703125, "distinct_2": 0.5905511811023622, "top_token_mass": 0.0538330078125}}
+{"type": "sample", "index": 0, "raw_text": "[CLS] press reported. [SEP] i would have to cancel a couple of flights, but i was free to go... [SEP] the project, costing £1, 500, will make it possible to bring some of the world ' s best teams to the uk. [SEP] we ' re going to have an investigation that, with all our evidence, we have never seen before, \" he added. [SEP] the carmaker ford lost $ 60m in the first quarter alone. [SEP] \" there is a real need for transparency. [SEP] the scale of the devastation has been driven by the displacement and reshaping of nearly 10, 000 people around the world [SEP]", "detok_text": "[CLS] press reported. [SEP] i would have to cancel a couple of flights, but i was free to go... [SEP] the project, costing £1, 500, will make it possible to bring some of the world's best teams to the uk. [SEP] we're going to have an investigation that, with all our evidence, we have never seen before, \"he added. [SEP] the carmaker ford lost $60m in the first quarter alone. [SEP]\" there is a real need for transparency. [SEP] the scale of the devastation has been driven by the displacement and reshaping of nearly 10, 000 people around the world [SEP]"}
+{"type": "sample", "index": 1, "raw_text": "[CLS] - trade plan. [SEP] in the past, we have looked back at some ways, and i think the problem is, we did not get this far. [SEP] \" i think, ' john, i think he ' s ok, but i ' m not really in a position to talk to you. [SEP] \" it was a little bit of a big fight and we had to be aware of it, \" said the german. [SEP] for a moment, the place, if you kind of look out, seems to sit in perspective. [SEP] when a discussion of the president ' s fate actually takes place, so many of those who know [SEP]", "detok_text": "[CLS] - trade plan. [SEP] in the past, we have looked back at some ways, and i think the problem is, we did not get this far. [SEP] \"i think, ' john, i think he's ok, but i'm not really in a position to talk to you. [SEP]\" it was a little bit of a big fight and we had to be aware of it, \" said the german. [SEP] for a moment, the place, if you kind of look out, seems to sit in perspective. [SEP] when a discussion of the president's fate actually takes place, so many of those who know [SEP]"}
+{"type": "sample", "index": 2, "raw_text": "[CLS] the white house, \" he says. [SEP] i ' ve never known there has been a huge factor in the game. [SEP] he likes to get up, but a little bit well, and just works well in the gym. [SEP] \" i think we have to get a good deal, so if the result is a win, the majority is in danger of losing, \" ender said. [SEP] \" the idea is to get the money they want to get, and we ' re not able to make money, \" added schbutter. [SEP] the police have said that they were investigating more than a dozen complaints. [SEP] but [SEP]", "detok_text": "[CLS] the white house, \"he says. [SEP] i've never known there has been a huge factor in the game. [SEP] he likes to get up, but a little bit well, and just works well in the gym. [SEP]\" i think we have to get a good deal, so if the result is a win, the majority is in danger of losing, \"ender said. [SEP]\" the idea is to get the money they want to get, and we're not able to make money, \" added schbutter. [SEP] the police have said that they were investigating more than a dozen complaints. [SEP] but [SEP]"}
+{"type": "sample", "index": 3, "raw_text": "[CLS] quite the way we are. [SEP] i just hope that i can do it again. [SEP] he says that he doesn ' t think he should talk to anyone trying to sell himself. [SEP] you know we ' ll take our lessons, \" said the foreign official. [SEP] i ' ve liked one one, i like the other, and of course he has to deal with this if he is a candidate when he gets into it. [SEP] \" there are also things you want to do with that work, such as getting dressed in white clouds, or capels, or even a black scarf, \" he added. [SEP] a government agency investigating [SEP]", "detok_text": "[CLS] quite the way we are. [SEP] i just hope that i can do it again. [SEP] he says that he doesn't think he should talk to anyone trying to sell himself. [SEP] you know we'll take our lessons, \"said the foreign official. [SEP] i've liked one one, i like the other, and of course he has to deal with this if he is a candidate when he gets into it. [SEP]\" there are also things you want to do with that work, such as getting dressed in white clouds, or capels, or even a black scarf, \" he added. [SEP] a government agency investigating [SEP]"}
+{"type": "sample", "index": 4, "raw_text": "[CLS] : \" the total of stolen items includes a number of personal items including household goods, airbags and computers. [SEP] \" i don ' t think it was until my 70s that i really got into trouble, \" he said, \" i can ' t make it much better - - i didn ' t even have a talking point. [SEP] officials from around the world and more than a 100 other countries attended the event. [SEP] while he is so popular in the united states, he is critical of his free - trade policies in the u. s. and calling for the collapse of the union. [SEP] the production also features a three - [SEP]", "detok_text": "[CLS]: \"the total of stolen items includes a number of personal items including household goods, airbags and computers. [SEP]\" i don't think it was until my 70s that i really got into trouble, \"he said,\" i can't make it much better - - i didn't even have a talking point. [SEP] officials from around the world and more than a 100 other countries attended the event. [SEP] while he is so popular in the united states, he is critical of his free - trade policies in the u. s. and calling for the collapse of the union. [SEP] the production also features a three - [SEP]"}
+{"type": "sample", "index": 5, "raw_text": "[CLS] guide them to the democratic nomination. [SEP] \" i ' ve got quite a concern about the number of people who have worked and the number of people who have been working and thought about the quality of things that are done or if they have been worked out. [SEP] \" we don ' t want to know that he can play in the future, \" said peter westbrook, the club ' s assistant coach. [SEP] it was last updated at 20. 54 bst on thursday 16 may 2009. office for the city of london. greater london, south london. £36, 624 to £43, 000 per annum. [SEP] he [SEP]", "detok_text": "[CLS] guide them to the democratic nomination. [SEP] \"i've got quite a concern about the number of people who have worked and the number of people who have been working and thought about the quality of things that are done or if they have been worked out. [SEP]\" we don't want to know that he can play in the future, \" said peter westbrook, the club's assistant coach. [SEP] it was last updated at 20. 54 bst on thursday 16 may 2009. office for the city of london. greater london, south london. £36, 624 to £43, 000 per annum. [SEP] he [SEP]"}
+{"type": "sample", "index": 6, "raw_text": "[CLS] air crash in rome, witnesses said. [SEP] \" i ' ll do that and i ' m glad this has been resolved. [SEP] since the 10th century, the u. s. government has never been part of iraq. [SEP] it said that after several days the children, who would be temporary workers who did not see their parents for another six weeks, would not receive full visas and would be free from their work. [SEP] i just wanted to let him stand up and try to get here, \" according to the eca. [SEP] the nets also scored 13 of his 15 points in 20 minutes - - he had 16 rebounds in the [SEP]", "detok_text": "[CLS] air crash in rome, witnesses said. [SEP] \"i'll do that and i'm glad this has been resolved. [SEP] since the 10th century, the u. s. government has never been part of iraq. [SEP] it said that after several days the children, who would be temporary workers who did not see their parents for another six weeks, would not receive full visas and would be free from their work. [SEP] i just wanted to let him stand up and try to get here,\" according to the eca. [SEP] the nets also scored 13 of his 15 points in 20 minutes - - he had 16 rebounds in the [SEP]"}
+{"type": "sample", "index": 7, "raw_text": "[CLS] in a series of federal deficits and budget shortcomings. [SEP] i mean, if you ask me to look at you, you ' re a celebrity, it ' s just hard to imagine. [SEP] a 19. 1 share in california ' s unemployment report, down slightly in chicago in august. [SEP] in the end, the swiss group had to set a compensation deal with the government and was promised the full compensation of the bank ' s 5, 000 employees. [SEP] so it ' s not been easy for him, as we both know the rules. [SEP] the first game of the series was 14 - point loss to detroit. [SEP]", "detok_text": "[CLS] in a series of federal deficits and budget shortcomings. [SEP] i mean, if you ask me to look at you, you're a celebrity, it's just hard to imagine. [SEP] a 19. 1 share in california's unemployment report, down slightly in chicago in august. [SEP] in the end, the swiss group had to set a compensation deal with the government and was promised the full compensation of the bank's 5, 000 employees. [SEP] so it's not been easy for him, as we both know the rules. [SEP] the first game of the series was 14 - point loss to detroit. [SEP]"}
+{"type": "sample", "index": 8, "raw_text": "[CLS] 57. 7 million. [SEP] i believe that they will not be able to pay the cost. [SEP] \" if we ' ve got a team where we are up to the task, we want to do it in terms of our commitment to football, \" barca said. [SEP] what has been the challenge for children to learn from the past? [SEP] mr brown said the leaders had all agreed on a get - in for the couple. [SEP] on wednesday, the protesters sent riot police, police trucks, fire engines and soldiers on their way to the stadium for a second time. [SEP] the group is led by john bord. [SEP] but [SEP]", "detok_text": "[CLS] 57. 7 million. [SEP] i believe that they will not be able to pay the cost. [SEP] \"if we've got a team where we are up to the task, we want to do it in terms of our commitment to football,\" barca said. [SEP] what has been the challenge for children to learn from the past? [SEP] mr brown said the leaders had all agreed on a get - in for the couple. [SEP] on wednesday, the protesters sent riot police, police trucks, fire engines and soldiers on their way to the stadium for a second time. [SEP] the group is led by john bord. [SEP] but [SEP]"}
+{"type": "sample", "index": 9, "raw_text": "[CLS] their vehicles. [SEP] still, it took them four years to achieve the first cut in the government ' s funding in three years and start to the school year. [SEP] we ' ve told them. [SEP] the victims collected up to $ 20, 000 in cash, cash, cash, cash, cigarettes and cash, police said. [SEP] \" when we get down to the final i think it ' s something that we have been trying to do for a long time for us. [SEP] \" it ' s just a small number to look for, it ' s not true, \" she said, \" \" well, i don ' t need [SEP]", "detok_text": "[CLS] their vehicles. [SEP] still, it took them four years to achieve the first cut in the government's funding in three years and start to the school year. [SEP] we've told them. [SEP] the victims collected up to $20, 000 in cash, cash, cash, cash, cigarettes and cash, police said. [SEP] \"when we get down to the final i think it's something that we have been trying to do for a long time for us. [SEP]\" it's just a small number to look for, it's not true, \"she said,\" \" well, i don't need [SEP]"}
+{"type": "sample", "index": 10, "raw_text": "[CLS] - - \" he joked. [SEP] \" this announcement is a response to the lack of public funding, \" said a spokesman of the children of education committee. [SEP] however, as a result, i think i ' m in the right mood. [SEP] clinton has said the us will help to improve the political situation in zimbabwe. [SEP] we ' ll see. [SEP] and it is a great thing to help them in the day and help them in a good way. [SEP] on the other hand, one thing is to overcome this fear and prejudice. [SEP] another £1 million a year has also gone into the children ' s education fund, which has [SEP]", "detok_text": "[CLS] - - \"he joked. [SEP]\" this announcement is a response to the lack of public funding, \" said a spokesman of the children of education committee. [SEP] however, as a result, i think i'm in the right mood. [SEP] clinton has said the us will help to improve the political situation in zimbabwe. [SEP] we'll see. [SEP] and it is a great thing to help them in the day and help them in a good way. [SEP] on the other hand, one thing is to overcome this fear and prejudice. [SEP] another £1 million a year has also gone into the children's education fund, which has [SEP]"}
+{"type": "sample", "index": 11, "raw_text": "[CLS] in front of others. [SEP] it just seems to pick up the air of the wind. [SEP] boca raton, fla., march 3 ( upi ) - - owners of u. s. retailers said they expect to be down by as much as 10 percent in the second half of 2008, a survey said. [SEP] he lives in chicago. [SEP] he said there was no sign the club was going to replace him, so there was none of them to replace him. [SEP] the court heard the ex - president was staying at home, four years after losing the presidency in 2001. [SEP] on friday, senate republican leader john [SEP]", "detok_text": "[CLS] in front of others. [SEP] it just seems to pick up the air of the wind. [SEP] boca raton, fla., march 3 (upi) - - owners of u. s. retailers said they expect to be down by as much as 10 percent in the second half of 2008, a survey said. [SEP] he lives in chicago. [SEP] he said there was no sign the club was going to replace him, so there was none of them to replace him. [SEP] the court heard the ex - president was staying at home, four years after losing the presidency in 2001. [SEP] on friday, senate republican leader john [SEP]"}
+{"type": "sample", "index": 12, "raw_text": "[CLS] weekend, said he was \" tired \" and had \" nothing to do \" with a run that was \" normal \" after he started. [SEP] i had the message being, \" don ' t talk about you anymore. \" [SEP] i have sex every day, every 20 - year - old girl loves it. [SEP] you ' re always looking to pick up a job of your own or make some money, but there ' s a lot of work to get in. [SEP] where are your best friends? [SEP] i ' m sure that he ' s the guy who can have the things we want, have the things that i can trust, [SEP]", "detok_text": "[CLS] weekend, said he was \"tired\" and had \"nothing to do\" with a run that was \"normal\" after he started. [SEP] i had the message being, \"don't talk about you anymore.\" [SEP] i have sex every day, every 20 - year - old girl loves it. [SEP] you're always looking to pick up a job of your own or make some money, but there's a lot of work to get in. [SEP] where are your best friends? [SEP] i'm sure that he's the guy who can have the things we want, have the things that i can trust, [SEP]"}
+{"type": "sample", "index": 13, "raw_text": "[CLS]. s. kabul, afghanistan ( ap ) - - a roadside bomb ripped through an eastern afghan town wednesday, killing a dozen people and wounding 24 others, including three children, and a schoolgirl, provincial police and officials said. [SEP] until then, at least it hadn ' t come to saturday ' s conclusion. [SEP] \" no one will be responsible for the breach of security, \" he added. [SEP] the safety condition of the two - lane scat would be set in proportion to a narrow exit where the driver of a car on the other side would hit the driver ' s hand, causing the driver to be stuck. [SEP] [SEP]", "detok_text": "[CLS]. s. kabul, afghanistan (ap) - - a roadside bomb ripped through an eastern afghan town wednesday, killing a dozen people and wounding 24 others, including three children, and a schoolgirl, provincial police and officials said. [SEP] until then, at least it hadn't come to saturday's conclusion. [SEP] \"no one will be responsible for the breach of security,\" he added. [SEP] the safety condition of the two - lane scat would be set in proportion to a narrow exit where the driver of a car on the other side would hit the driver's hand, causing the driver to be stuck. [SEP] [SEP]"}
+{"type": "sample", "index": 14, "raw_text": "[CLS] \" said mohammed. [SEP] he is so fast - - and yet he sees, at first, the freshness of the light and the warmth of the all - around sun that brought him down from the moon to earth. [SEP] we still don ' t know. [SEP] \" you don ' t always know what you ' re going for. [SEP] \" it ' s hard to see, it ' s hard to take out anything that ' s important at all, \" she says. [SEP] \" we did have more problems, \" said coach scott brown, a member of the nfl players ' association. [SEP] \" the president and manager, all [SEP]", "detok_text": "[CLS] \"said mohammed. [SEP] he is so fast - - and yet he sees, at first, the freshness of the light and the warmth of the all - around sun that brought him down from the moon to earth. [SEP] we still don't know. [SEP]\" you don't always know what you're going for. [SEP] \"it's hard to see, it's hard to take out anything that's important at all,\" she says. [SEP] \"we did have more problems,\" said coach scott brown, a member of the nfl players' association. [SEP] \" the president and manager, all [SEP]"}
+{"type": "sample", "index": 15, "raw_text": "[CLS] of the children. [SEP] they won ' t be able to see you, but we better know them if they don ' t put their money on a table. [SEP] i don ' t know. [SEP] that used to be fine on the street, but with the doors closed and the busses running from front to back streets, it didn ' t go that far. [SEP] in the early 2000s, however, rates were sharply lower. [SEP] \" there ' s a lot of work going on, and it was not wrong, \" he said. [SEP] \" i ' ve just got a little bit of a fight. [SEP] since then, [SEP]", "detok_text": "[CLS] of the children. [SEP] they won't be able to see you, but we better know them if they don't put their money on a table. [SEP] i don't know. [SEP] that used to be fine on the street, but with the doors closed and the busses running from front to back streets, it didn't go that far. [SEP] in the early 2000s, however, rates were sharply lower. [SEP] \"there's a lot of work going on, and it was not wrong,\" he said. [SEP] \" i've just got a little bit of a fight. [SEP] since then, [SEP]"}
+{"type": "sample", "index": 16, "raw_text": "[CLS] said. [SEP] similar turbines are being built in the uk, but needs to be completed by 2013, said a senior government official involved in the talks. [SEP] he made 25 of 32 shots from the field before punting on 3 - of - 13 three - goal attempts saturday night in the wild 1 - 0 loss to san jose city, the first victory of the season a day earlier. [SEP] there ' s a problem that can seem to cause any amount of mental pain, \" said kitz. [SEP] we must change our perception, and without any change, we must still make a lot of mistakes, and act fast, and we [SEP]", "detok_text": "[CLS] said. [SEP] similar turbines are being built in the uk, but needs to be completed by 2013, said a senior government official involved in the talks. [SEP] he made 25 of 32 shots from the field before punting on 3 - of - 13 three - goal attempts saturday night in the wild 1 - 0 loss to san jose city, the first victory of the season a day earlier. [SEP] there's a problem that can seem to cause any amount of mental pain, \" said kitz. [SEP] we must change our perception, and without any change, we must still make a lot of mistakes, and act fast, and we [SEP]"}
+{"type": "sample", "index": 17, "raw_text": "[CLS] to obama ' s visit to america in june, that he seemed to understand that he really was going to behave in different conditions. [SEP] there is such a sense of optimism and change for you, according to cbs / kland. com. [SEP] it would be in good faith. [SEP] \" that ' s not necessarily what we ' re about. [SEP] that ' s a good thing, it ' s kind of a joke. [SEP] wake up and drop the story for comment. [SEP] \" we believe that we still have the ability to win, \" said mr brown. [SEP] new york - kirilenko scored 26 points and jason terry [SEP]", "detok_text": "[CLS] to obama's visit to america in june, that he seemed to understand that he really was going to behave in different conditions. [SEP] there is such a sense of optimism and change for you, according to cbs/kland. com. [SEP] it would be in good faith. [SEP] \"that's not necessarily what we're about. [SEP] that's a good thing, it's kind of a joke. [SEP] wake up and drop the story for comment. [SEP]\" we believe that we still have the ability to win, \" said mr brown. [SEP] new york - kirilenko scored 26 points and jason terry [SEP]"}
+{"type": "sample", "index": 18, "raw_text": "[CLS] in the first quarter of december 2007. [SEP] the u. s. c. arrived at the air station at about 8 a. m. and returned immediately, according to one person with knowledge of the condition of monday ' s departures. [SEP] the president has gotten the message quickly and cautioned citizens to be on alert. [SEP] capello ' s team could play against the united states in this week ' s group stage, and italy has three games in the final, but it ' s not. [SEP] then, however, we moved into the middle of a relationship. [SEP] lake city, ill. - - the man who killed [SEP]", "detok_text": "[CLS] in the first quarter of december 2007. [SEP] the u. s. c. arrived at the air station at about 8 a. m. and returned immediately, according to one person with knowledge of the condition of monday's departures. [SEP] the president has gotten the message quickly and cautioned citizens to be on alert. [SEP] capello's team could play against the united states in this week's group stage, and italy has three games in the final, but it's not. [SEP] then, however, we moved into the middle of a relationship. [SEP] lake city, ill. - - the man who killed [SEP]"}
+{"type": "sample", "index": 19, "raw_text": "[CLS] confirmed his move to rangers on tuesday and are due to start their european campaign in the light of the first game of chelsea ' s trip to ibrox. [SEP] the trial was scheduled to take place in 2009. [SEP] we ' re not doing enough - - we will get that fast if we can go. [SEP] for example, the concept of a low - end car could go on the road. [SEP] \" i ' m concerned that we will have a new set of rules that we have to sort out, and there will be more changes in financial financial systems over the couple of years, \" he said. [SEP] the capital, [SEP]", "detok_text": "[CLS] confirmed his move to rangers on tuesday and are due to start their european campaign in the light of the first game of chelsea's trip to ibrox. [SEP] the trial was scheduled to take place in 2009. [SEP] we're not doing enough - - we will get that fast if we can go. [SEP] for example, the concept of a low - end car could go on the road. [SEP] \"i'm concerned that we will have a new set of rules that we have to sort out, and there will be more changes in financial financial systems over the couple of years,\" he said. [SEP] the capital, [SEP]"}
+{"type": "sample", "index": 20, "raw_text": "[CLS] person familiar with the matter. [SEP] new york ' s health insurance program is designed to inflate financial costs. [SEP] it took only a few minutes to develop. [SEP] at that time, in february 2008, the percentage of people paying a 10 - year mortgage rose this year from 13 % to 3. 8 %. [SEP] they let us do nothing in the past. [SEP] \" we don ' t talk about a financial crisis, it ' s just getting people together, \" he added. [SEP] but the goal is to make up for the fire that is coming in markets that are getting stressed, including mortgage - backed securities, which [SEP]", "detok_text": "[CLS] person familiar with the matter. [SEP] new york's health insurance program is designed to inflate financial costs. [SEP] it took only a few minutes to develop. [SEP] at that time, in february 2008, the percentage of people paying a 10 - year mortgage rose this year from 13 % to 3. 8 %. [SEP] they let us do nothing in the past. [SEP] \"we don't talk about a financial crisis, it's just getting people together,\" he added. [SEP] but the goal is to make up for the fire that is coming in markets that are getting stressed, including mortgage - backed securities, which [SEP]"}
+{"type": "sample", "index": 21, "raw_text": "[CLS] still lives, and he knows how to make a living. [SEP] the council has provided £5, 000 to cover the building and £5, 000 to design, with the rest still to be added. [SEP] it is really hard for him to see anything in a way. [SEP] the mets are trying to add santana, for example, who is looking for a good season. [SEP] then she dropped off her clothes. [SEP] he is still trying to keep a lead while even keeping the ball in playoff games. [SEP] the union said it represents more than 2, 000 temporary workers, and that drivers would have to work overtime. [SEP] instead, the [SEP]", "detok_text": "[CLS] still lives, and he knows how to make a living. [SEP] the council has provided £5, 000 to cover the building and £5, 000 to design, with the rest still to be added. [SEP] it is really hard for him to see anything in a way. [SEP] the mets are trying to add santana, for example, who is looking for a good season. [SEP] then she dropped off her clothes. [SEP] he is still trying to keep a lead while even keeping the ball in playoff games. [SEP] the union said it represents more than 2, 000 temporary workers, and that drivers would have to work overtime. [SEP] instead, the [SEP]"}
+{"type": "sample", "index": 22, "raw_text": "[CLS] 1. 5 - game run. [SEP] in 2004, chicago - based boston pitchers hit jason varitek three times. [SEP] he had been jailed in october 2007 for six months, and before he was last seen near his family home in parkville, n. j., he was drunk during his break - in. [SEP] last week darling announced that the public debt - - which includes roads, playgrounds, super - schools, universities, schools, hospitals, hospitals, high - rises and roads - - would be repaid by the end of the year. [SEP] the team is one of the best teams on the planet. [SEP] [SEP]", "detok_text": "[CLS] 1. 5 - game run. [SEP] in 2004, chicago - based boston pitchers hit jason varitek three times. [SEP] he had been jailed in october 2007 for six months, and before he was last seen near his family home in parkville, n. j., he was drunk during his break - in. [SEP] last week darling announced that the public debt - - which includes roads, playgrounds, super - schools, universities, schools, hospitals, hospitals, high - rises and roads - - would be repaid by the end of the year. [SEP] the team is one of the best teams on the planet. [SEP] [SEP]"}
+{"type": "sample", "index": 23, "raw_text": "[CLS] million. [SEP] \" when i ' m not there, it ' s not about winning, it ' s winning. [SEP] at the time, the young man wore a jumper with his short - sleeve shirt, and a dark shirt, bottoms and bottoms. [SEP] father phillips, 67, said that he had already seen his wife, and that in a marriage he ' s had 50 years and 10 children. [SEP] there is no connection between reading and high school scores. [SEP] meanwhile, the u. s. foreign relations office is doing so in line with international court rules. [SEP] i don ' t need anything. [SEP] the electoral process has [SEP]", "detok_text": "[CLS] million. [SEP] \" when i'm not there, it's not about winning, it's winning. [SEP] at the time, the young man wore a jumper with his short - sleeve shirt, and a dark shirt, bottoms and bottoms. [SEP] father phillips, 67, said that he had already seen his wife, and that in a marriage he's had 50 years and 10 children. [SEP] there is no connection between reading and high school scores. [SEP] meanwhile, the u. s. foreign relations office is doing so in line with international court rules. [SEP] i don't need anything. [SEP] the electoral process has [SEP]"}
+{"type": "sample", "index": 24, "raw_text": "[CLS] part of the couple ' s life - - a three - way, four - year relationship. [SEP] when i ' ve had a break - - i would want to take one other out, but i ' m not alone - - i always get depressed. [SEP] switzerland, and swiss banks in particular, has a lot of the money flowing. [SEP] he also said that it was important to have the support of all people. [SEP] i have to believe that we should start talking to the world. [SEP] by the time we came round, the doors were open. [SEP] but nobody has thought of a full sit - down, or even a [SEP]", "detok_text": "[CLS] part of the couple's life - - a three - way, four - year relationship. [SEP] when i've had a break - - i would want to take one other out, but i'm not alone - - i always get depressed. [SEP] switzerland, and swiss banks in particular, has a lot of the money flowing. [SEP] he also said that it was important to have the support of all people. [SEP] i have to believe that we should start talking to the world. [SEP] by the time we came round, the doors were open. [SEP] but nobody has thought of a full sit - down, or even a [SEP]"}
+{"type": "sample", "index": 25, "raw_text": "[CLS] that they are to be well informed and that message is very strong, \" he said. [SEP] he said then, \" i know it is the day of the game and it was particularly important and would have been a good start. [SEP] and maybe he wasn ' t funny, but people think he was real. [SEP] by the start of the 2004 presidential campaign - - just a three months - - he was on the need to talk with americans about his patriotism. [SEP] but don ' t expect a panic. [SEP] he doesn ' t understand where you are, \" he said. [SEP] \" i find it hard to make the most [SEP]", "detok_text": "[CLS] that they are to be well informed and that message is very strong, \"he said. [SEP] he said then,\" i know it is the day of the game and it was particularly important and would have been a good start. [SEP] and maybe he wasn't funny, but people think he was real. [SEP] by the start of the 2004 presidential campaign - - just a three months - - he was on the need to talk with americans about his patriotism. [SEP] but don't expect a panic. [SEP] he doesn't understand where you are, \"he said. [SEP]\" i find it hard to make the most [SEP]"}
+{"type": "sample", "index": 26, "raw_text": "[CLS] smashed glass windows in his home. [SEP] \" it could be said that when we ' re not going to do something - - we don ' t know, we ' re going to do something - - we can have a better life. [SEP] \" i really wanted to do something, i love it because i thought twice about you, that kind of really about what i can do. [SEP] he says he paid $ 10, 000 and sold the tickets for $ 800, but he was able to get out of the room. [SEP] \" they are the people who would have been a small part of that, \" hairston said. [SEP] [SEP]", "detok_text": "[CLS] smashed glass windows in his home. [SEP] \"it could be said that when we're not going to do something - - we don't know, we're going to do something - - we can have a better life. [SEP]\" i really wanted to do something, i love it because i thought twice about you, that kind of really about what i can do. [SEP] he says he paid $10, 000 and sold the tickets for $800, but he was able to get out of the room. [SEP] \"they are the people who would have been a small part of that,\" hairston said. [SEP] [SEP]"}
+{"type": "sample", "index": 27, "raw_text": "[CLS] crack down on the quality of their players. [SEP] smith, however, remains optimistic. [SEP] \" it ' s hard to call some of the facilities part of a return to old days, \" he said, as a man waited in the new president ' s office at the palace. [SEP] you can just take a flight from the office and then get a job, a salary or a couple of dollars to make a visit. [SEP] i knew i had to live in my own well - lit tent, an out - of - town place and a place to go in. [SEP] however, we ' ve got a lot of people having to [SEP]", "detok_text": "[CLS] crack down on the quality of their players. [SEP] smith, however, remains optimistic. [SEP] \"it's hard to call some of the facilities part of a return to old days,\" he said, as a man waited in the new president's office at the palace. [SEP] you can just take a flight from the office and then get a job, a salary or a couple of dollars to make a visit. [SEP] i knew i had to live in my own well - lit tent, an out - of - town place and a place to go in. [SEP] however, we've got a lot of people having to [SEP]"}
+{"type": "sample", "index": 28, "raw_text": "[CLS] m. c. a. tournament. [SEP] u. s. troops killed in iraq in 2007 dropped up to 38 at the start of this year, according to the pentagon ' s statement. [SEP] i am a college student because i have lived all my life. [SEP] now, that ' s a small group. [SEP] hours after the team ' s president announced his decision on thursday night, the knicks protested and asked thomas to not sign his contract and had no comment. [SEP] but if that ' s enough to stop that change, it has yet to be approved. [SEP] \" it ' s fair to say there is a huge part of [SEP]", "detok_text": "[CLS] m. c. a. tournament. [SEP] u. s. troops killed in iraq in 2007 dropped up to 38 at the start of this year, according to the pentagon's statement. [SEP] i am a college student because i have lived all my life. [SEP] now, that's a small group. [SEP] hours after the team's president announced his decision on thursday night, the knicks protested and asked thomas to not sign his contract and had no comment. [SEP] but if that's enough to stop that change, it has yet to be approved. [SEP] \" it's fair to say there is a huge part of [SEP]"}
+{"type": "sample", "index": 29, "raw_text": "[CLS] return at home. [SEP] for example, the western state of england is thought to have the largest share of the population of 11 percent. [SEP] \" the allegations are untrued, \" he says. [SEP] in the ruling, mr justice weir said : \" mr mcnulty immediately went to the office of justice and provided his details to the tax office, the revenue commissioner, the irs, the treasury secretary, the attorney general and the u. s. department of justice to help to provide financial services in the uk. [SEP] we ' ve done it. [SEP] the two are also likely to focus on the need for political settlement [SEP]", "detok_text": "[CLS] return at home. [SEP] for example, the western state of england is thought to have the largest share of the population of 11 percent. [SEP] \"the allegations are untrued,\" he says. [SEP] in the ruling, mr justice weir said: \" mr mcnulty immediately went to the office of justice and provided his details to the tax office, the revenue commissioner, the irs, the treasury secretary, the attorney general and the u. s. department of justice to help to provide financial services in the uk. [SEP] we've done it. [SEP] the two are also likely to focus on the need for political settlement [SEP]"}
+{"type": "sample", "index": 30, "raw_text": "[CLS] his own close relationship with his old england manager. [SEP] \" the road can get to the end. [SEP] he has been known to move in the past few months. [SEP] \" immediately after the blast, we had a very difficult effort to get our eye out of the area. [SEP] \" we ' d be talking about how you can ' t go over there, which i don ' t know, that kind of thing, you know, that was, \" mr. jordan said. [SEP] it ' s hard to believe, people. [SEP] but it may not come until the end of the year. [SEP] but in truth, i had [SEP]", "detok_text": "[CLS] his own close relationship with his old england manager. [SEP] \"the road can get to the end. [SEP] he has been known to move in the past few months. [SEP]\" immediately after the blast, we had a very difficult effort to get our eye out of the area. [SEP] \"we'd be talking about how you can't go over there, which i don't know, that kind of thing, you know, that was,\" mr. jordan said. [SEP] it's hard to believe, people. [SEP] but it may not come until the end of the year. [SEP] but in truth, i had [SEP]"}
+{"type": "sample", "index": 31, "raw_text": "[CLS] sunday ' s event. [SEP] \", however, the misunderstandings on this issue have to be addressed, \" the officials said. [SEP] still, the loss of a loan, which is made for them by their lenders, is not enough of a reason to let go. [SEP] it is also expected that a number of measures will be made to turn around the world economy. [SEP] about a third of the country ' s 2 million children and their families are estimated to be poor, most of them due to poverty. [SEP] we have all been in it for too long, but we have to put up our best ideas. [SEP] the [SEP]", "detok_text": "[CLS] sunday's event. [SEP] \", however, the misunderstandings on this issue have to be addressed, \" the officials said. [SEP] still, the loss of a loan, which is made for them by their lenders, is not enough of a reason to let go. [SEP] it is also expected that a number of measures will be made to turn around the world economy. [SEP] about a third of the country's 2 million children and their families are estimated to be poor, most of them due to poverty. [SEP] we have all been in it for too long, but we have to put up our best ideas. [SEP] the [SEP]"}
+{"type": "sample", "index": 32, "raw_text": "[CLS] need to put this money on their tax bill by now, and that isn ' t quite much down at the end of 2011. [SEP] in a study from 2004 to 2008, the percentage of female child victims increased slightly to just 2. 3 percent. [SEP] i was born long before i was done. [SEP] they haven ' t done it. [SEP] he can ' t live to lose. [SEP] he ' s got a good game, and he does it well. [SEP] \" i would say it was a good start to make decisions for you, \" he said. [SEP] i don ' t really think that we didn ' t want to [SEP]", "detok_text": "[CLS] need to put this money on their tax bill by now, and that isn't quite much down at the end of 2011. [SEP] in a study from 2004 to 2008, the percentage of female child victims increased slightly to just 2. 3 percent. [SEP] i was born long before i was done. [SEP] they haven't done it. [SEP] he can't live to lose. [SEP] he's got a good game, and he does it well. [SEP] \"i would say it was a good start to make decisions for you,\" he said. [SEP] i don't really think that we didn't want to [SEP]"}
+{"type": "sample", "index": 33, "raw_text": "[CLS] and italy. [SEP] finally, instead of watching, i had to go to the weather office to check up for the next morning. [SEP] \" the market to build a market is going to be built in a kind of way. [SEP] he told the newspaper in the days before the murder trial that he had no regrets and would not fight the charges. [SEP] \" i don ' t think you should be allowed to talk about it, but i ' m not very happy, \" he said. [SEP] on saturday, he was attacked with another woman in the force area. [SEP] but that does not happen. [SEP] \" there didn ' t be [SEP]", "detok_text": "[CLS] and italy. [SEP] finally, instead of watching, i had to go to the weather office to check up for the next morning. [SEP] \"the market to build a market is going to be built in a kind of way. [SEP] he told the newspaper in the days before the murder trial that he had no regrets and would not fight the charges. [SEP]\" i don't think you should be allowed to talk about it, but i'm not very happy, \"he said. [SEP] on saturday, he was attacked with another woman in the force area. [SEP] but that does not happen. [SEP]\" there didn't be [SEP]"}
+{"type": "sample", "index": 34, "raw_text": "[CLS], 50 years in a row, to seven games. [SEP] the woman is about 5ft 6in tall ( 4. 8m, 11. 4m ). [SEP] he is there, exposing syonies, making repeated gestures at them, biting them, and raping them hideously. [SEP] even before he had a good season with the yankees, the team was dominant. [SEP] the house of commons, the upper chamber, has used the two - thirds majority to bring in 21 seats. [SEP] \" you have to come back to me and have a conversation with me and i want to win. [SEP] i don ' t think [SEP]", "detok_text": "[CLS], 50 years in a row, to seven games. [SEP] the woman is about 5ft 6in tall (4. 8m, 11. 4m). [SEP] he is there, exposing syonies, making repeated gestures at them, biting them, and raping them hideously. [SEP] even before he had a good season with the yankees, the team was dominant. [SEP] the house of commons, the upper chamber, has used the two - thirds majority to bring in 21 seats. [SEP] \" you have to come back to me and have a conversation with me and i want to win. [SEP] i don't think [SEP]"}
+{"type": "sample", "index": 35, "raw_text": "[CLS] the first time sunday. [SEP] \" i knew that i wanted to be able to be there, \" rodriguez said in a statement. [SEP] \" if they didn ' t have that kind of money, then it wouldn ' t happen at all, \" mr horsin said. [SEP] \" the door is no longer open, \" she said. [SEP] ms. bork, 53, and her son, austin, have developed an interest in state - funded insurance companies. [SEP] but that strategy seemed to work well with him. [SEP] 27 / prnewswire / - - raytheon corporation ( nyse : dn ), [SEP]", "detok_text": "[CLS] the first time sunday. [SEP] \"i knew that i wanted to be able to be there,\" rodriguez said in a statement. [SEP] \"if they didn't have that kind of money, then it wouldn't happen at all,\" mr horsin said. [SEP] \"the door is no longer open,\" she said. [SEP] ms. bork, 53, and her son, austin, have developed an interest in state - funded insurance companies. [SEP] but that strategy seemed to work well with him. [SEP] 27/prnewswire/- - raytheon corporation (nyse: dn), [SEP]"}
+{"type": "sample", "index": 36, "raw_text": "[CLS] it seemed to take a while to get me started, so i wanted to start the game. [SEP] but it was set up by government and international organizations that also supported the project. [SEP] for many people, ailing has worked as a relief. [SEP] there ' s always an ideal world where you have to grow into your own. [SEP] \" she was so excited, \" kroe said. [SEP] but when i say about it, you tell me what i want, and then there will be a large cup of sweet tea. [SEP] \" i think he ' s going up and down, ' if we don ' t do that [SEP]", "detok_text": "[CLS] it seemed to take a while to get me started, so i wanted to start the game. [SEP] but it was set up by government and international organizations that also supported the project. [SEP] for many people, ailing has worked as a relief. [SEP] there's always an ideal world where you have to grow into your own. [SEP] \"she was so excited,\" kroe said. [SEP] but when i say about it, you tell me what i want, and then there will be a large cup of sweet tea. [SEP] \" i think he's going up and down, ' if we don't do that [SEP]"}
+{"type": "sample", "index": 37, "raw_text": "[CLS], which is not easy from the field. [SEP] that is enough in the case of a permanent new home. [SEP] he said that there appeared to be a chance that this year ' s budget might recover in time for the presidential election in january. [SEP] it ' s not something we have got to do in a big way. [SEP] \" i don ' t have to have fun, \" he said, \" but it would be a situation i can remember, and i would be the only one who may not want to know... [SEP] he took his first order out of his business. [SEP] dallas, texas ( ap ) - [SEP]", "detok_text": "[CLS], which is not easy from the field. [SEP] that is enough in the case of a permanent new home. [SEP] he said that there appeared to be a chance that this year's budget might recover in time for the presidential election in january. [SEP] it's not something we have got to do in a big way. [SEP] \"i don't have to have fun,\" he said, \" but it would be a situation i can remember, and i would be the only one who may not want to know... [SEP] he took his first order out of his business. [SEP] dallas, texas (ap) - [SEP]"}
+{"type": "sample", "index": 38, "raw_text": "[CLS] 1 million, or 5. 3 percent, to $ 2. 377 a share, while second - quarter revenue, which declined by $ 3. 2 billion, or 3. 4 percent, declined. [SEP] \" ultimately i wanted to know what it was like to be a footballer - - i felt i thought he would work for me in my life, \" said mr hill. [SEP] there have been three other changes to be in the squad. [SEP] the yemen - based al jazeera al - fitr al - e - aq al - islami group said more than 150 people have died so far in the country ' [SEP]", "detok_text": "[CLS] 1 million, or 5. 3 percent, to $2. 377 a share, while second - quarter revenue, which declined by $3. 2 billion, or 3. 4 percent, declined. [SEP] \"ultimately i wanted to know what it was like to be a footballer - - i felt i thought he would work for me in my life,\" said mr hill. [SEP] there have been three other changes to be in the squad. [SEP] the yemen - based al jazeera al - fitr al - e - aq al - islami group said more than 150 people have died so far in the country ' [SEP]"}
+{"type": "sample", "index": 39, "raw_text": "[CLS] nothing to stop the crime. [SEP] in reality, there has to be an attempt to sell the club to a manager who has little to offer, but he has nothing to talk about and that he would have to fight for a new job. [SEP] but in the case of the pope and the pope, there is a different view of the world, \" he said. [SEP] some 2, 000 businesses were bailed out at the end of 2007, compared to more than 3 million. [SEP] the team ' s 6 - 3 road loss was only the knicks ' sixth road win. [SEP] young, of north carolina high school, said he [SEP]", "detok_text": "[CLS] nothing to stop the crime. [SEP] in reality, there has to be an attempt to sell the club to a manager who has little to offer, but he has nothing to talk about and that he would have to fight for a new job. [SEP] but in the case of the pope and the pope, there is a different view of the world, \" he said. [SEP] some 2, 000 businesses were bailed out at the end of 2007, compared to more than 3 million. [SEP] the team's 6 - 3 road loss was only the knicks' sixth road win. [SEP] young, of north carolina high school, said he [SEP]"}
+{"type": "sample", "index": 40, "raw_text": "[CLS] and the rest of obama ' s visit, either in washington, or over the weekend. [SEP] but i have paid the cost to a hospital, bank and insurance agency. [SEP] but that is to be the outcome of this super - big question. [SEP] \" life will not be easy, unless you allow your children to run from school. [SEP] but he said that a full trial for those two would be a significant boost to the children ' s case. [SEP] it ' s a way of being done, and i ' m happy, \" he said. [SEP] \" this is a very good case for making sure whether we should be allowed [SEP]", "detok_text": "[CLS] and the rest of obama's visit, either in washington, or over the weekend. [SEP] but i have paid the cost to a hospital, bank and insurance agency. [SEP] but that is to be the outcome of this super - big question. [SEP] \"life will not be easy, unless you allow your children to run from school. [SEP] but he said that a full trial for those two would be a significant boost to the children's case. [SEP] it's a way of being done, and i'm happy,\" he said. [SEP] \" this is a very good case for making sure whether we should be allowed [SEP]"}
+{"type": "sample", "index": 41, "raw_text": "[CLS] to cars, hotels, food, and even handouts, \" he says. [SEP] i ' ll go on a sort of sled ( i like the show ) and feel guilty. [SEP] it was the sort of situation we ' re getting ourselves in - - we just put a couple of hoops and games in our heads. [SEP] we ' d never had a bit of what happened, \" he said. [SEP] \" there are no guarantees that there will be as much change... as we expected - - but i have an idea of it happening. [SEP] the number will probably grow to about 100, 000 in the next [SEP]", "detok_text": "[CLS] to cars, hotels, food, and even handouts, \"he says. [SEP] i'll go on a sort of sled (i like the show) and feel guilty. [SEP] it was the sort of situation we're getting ourselves in - - we just put a couple of hoops and games in our heads. [SEP] we'd never had a bit of what happened,\" he said. [SEP] \" there are no guarantees that there will be as much change... as we expected - - but i have an idea of it happening. [SEP] the number will probably grow to about 100, 000 in the next [SEP]"}
+{"type": "sample", "index": 42, "raw_text": "[CLS] the news is over again, leaving him without a foot on the car. [SEP] and the answer never got to the end. [SEP] i was aware that my mind changed on the day when i arrived, that the woman had given access to me and all of the people. [SEP] that ' s interesting. [SEP] if i wait for 15 minutes before a concert, i will see him again ( i ' m sure i ' ll listen ). [SEP] it ' s a short - term problem, and it ' s never going to make it to a big game, \" he said. [SEP] \" we believe some of the things we found to [SEP]", "detok_text": "[CLS] the news is over again, leaving him without a foot on the car. [SEP] and the answer never got to the end. [SEP] i was aware that my mind changed on the day when i arrived, that the woman had given access to me and all of the people. [SEP] that's interesting. [SEP] if i wait for 15 minutes before a concert, i will see him again (i'm sure i'll listen). [SEP] it's a short - term problem, and it's never going to make it to a big game, \"he said. [SEP]\" we believe some of the things we found to [SEP]"}
+{"type": "sample", "index": 43, "raw_text": "[CLS] [SEP] \" i love the public option, but it ' s never been in the hospital, the brain, or the classroom, \" she said. [SEP] we would, well, turn the focus for years on the president. [SEP] of course, they will be allowed to claim \" they take a year ' s leave \" for charity, or \" try to make money \" for trying to buy a property on a scale which they think is \" fair tax. \" [SEP] marshall ' s attorney, stephen heine, said there is a lot of work to do on toe - to - toe litigation - - no one knows where the matter is [SEP]", "detok_text": "[CLS] [SEP] \"i love the public option, but it's never been in the hospital, the brain, or the classroom,\" she said. [SEP] we would, well, turn the focus for years on the president. [SEP] of course, they will be allowed to claim \"they take a year's leave\" for charity, or \"try to make money\" for trying to buy a property on a scale which they think is \"fair tax.\" [SEP] marshall's attorney, stephen heine, said there is a lot of work to do on toe - to - toe litigation - - no one knows where the matter is [SEP]"}
+{"type": "sample", "index": 44, "raw_text": "[CLS] 2010. [SEP] \" it is very sad, really, because sometimes you feel like you don ' t be careful and that ' s what it takes to be successful, \" she added. [SEP] four other vessels, including hundreds of crew members, were also also aboard. [SEP] in fact, they came with a host of different colors, from green dustwhies to rashes and the white redness of the brain ' s tissues. [SEP] i don ' t want to win, but i ' m on the other end. [SEP] i still want to finish school, even though i don ' t plan to leave. [SEP] the national [SEP]", "detok_text": "[CLS] 2010. [SEP] \"it is very sad, really, because sometimes you feel like you don't be careful and that's what it takes to be successful,\" she added. [SEP] four other vessels, including hundreds of crew members, were also also aboard. [SEP] in fact, they came with a host of different colors, from green dustwhies to rashes and the white redness of the brain's tissues. [SEP] i don't want to win, but i'm on the other end. [SEP] i still want to finish school, even though i don't plan to leave. [SEP] the national [SEP]"}
+{"type": "sample", "index": 45, "raw_text": "[CLS] ' s funny, but it ' s ridiculous, \" clinton told reporters on a flight from chicago to new york. [SEP] we always get the loose ball, so the result is very good. [SEP] \" i want to try to score more. [SEP] it didn ' t happen until the start of the season. [SEP] we ' re going to see that happen again. [SEP] in the past year, there have been reports of attacks, which rose to more than 1, 100 in 2008. [SEP] \" it ' s a day to talk to the world, \" he said. [SEP] the male driver of the car - - robert james, 32 [SEP]", "detok_text": "[CLS]'s funny, but it's ridiculous, \"clinton told reporters on a flight from chicago to new york. [SEP] we always get the loose ball, so the result is very good. [SEP]\" i want to try to score more. [SEP] it didn't happen until the start of the season. [SEP] we're going to see that happen again. [SEP] in the past year, there have been reports of attacks, which rose to more than 1, 100 in 2008. [SEP] \"it's a day to talk to the world,\" he said. [SEP] the male driver of the car - - robert james, 32 [SEP]"}
+{"type": "sample", "index": 46, "raw_text": "[CLS] willingness to step in to the public sphere. [SEP] you ' re just right, there ' s a lot to work out for you. [SEP] it is unlikely the next deal is due to be signed soon, because the costs are so high. [SEP] i know the first time i ' m not sure i ' m not going to make this happen to me, but at least i ' ve thought of myself. [SEP] as good as it sounds, he wants to go to high school, but that is still to go, a long way to go on a full - term career in virginia. [SEP] even though he ' s done much of [SEP]", "detok_text": "[CLS] willingness to step in to the public sphere. [SEP] you're just right, there's a lot to work out for you. [SEP] it is unlikely the next deal is due to be signed soon, because the costs are so high. [SEP] i know the first time i'm not sure i'm not going to make this happen to me, but at least i've thought of myself. [SEP] as good as it sounds, he wants to go to high school, but that is still to go, a long way to go on a full - term career in virginia. [SEP] even though he's done much of [SEP]"}
+{"type": "sample", "index": 47, "raw_text": "[CLS] they can make journeys between home and overseas. [SEP] meanwhile, cleveland ' s james brown and the celtics ' kevin garnett offered a sort of push for the nba title. [SEP] i am sure it looks like people will be dead at the end of their lives, \" she said. [SEP] 9 ( upi ) - - a study by u. s. health department officials found health systems in three states have a relatively high level of swine flu. [SEP] atlanta pushed the lead to 28 - 30 at the half - - including three of their nine 3 - pointers, including 4 - 1 1 / 2 minutes into the fourth [SEP]", "detok_text": "[CLS] they can make journeys between home and overseas. [SEP] meanwhile, cleveland's james brown and the celtics' kevin garnett offered a sort of push for the nba title. [SEP] i am sure it looks like people will be dead at the end of their lives, \" she said. [SEP] 9 (upi) - - a study by u. s. health department officials found health systems in three states have a relatively high level of swine flu. [SEP] atlanta pushed the lead to 28 - 30 at the half - - including three of their nine 3 - pointers, including 4 - 1 1/2 minutes into the fourth [SEP]"}
+{"type": "sample", "index": 48, "raw_text": "[CLS] work relations and family relations. [SEP] the problem is very real. [SEP] the fate of the plant ' s owner, a nuclear official, is not to be known, but will be a critical component when the company reports at the start of the new year. [SEP] it also emerged that the victim did not know the government was ever involved in the case. [SEP] however, there is little time to go to work and create a new team. [SEP] i ' m sorry, but i do think it ' s important to read the whole story. [SEP] when i woke up, there was a restlessness of numbness, which was my reaction [SEP]", "detok_text": "[CLS] work relations and family relations. [SEP] the problem is very real. [SEP] the fate of the plant's owner, a nuclear official, is not to be known, but will be a critical component when the company reports at the start of the new year. [SEP] it also emerged that the victim did not know the government was ever involved in the case. [SEP] however, there is little time to go to work and create a new team. [SEP] i'm sorry, but i do think it's important to read the whole story. [SEP] when i woke up, there was a restlessness of numbness, which was my reaction [SEP]"}
+{"type": "sample", "index": 49, "raw_text": "[CLS] confident that the president ' s power would be used to protect the president ' s health, \" he wrote in remarks to reuters. [SEP] but the prime minister said she wanted to be reunited in the hands of a different administration. [SEP] i was there a few minutes later, looking very nice and he was having a lot of staches this time... [SEP] and so, i was much more concerned with the idea of a permanent solution to the problem of nuclear proliferation. [SEP] a spokesman said : \" \" i think we need to account for the payouts but we do not think we will get a deal when we go. [SEP]", "detok_text": "[CLS] confident that the president's power would be used to protect the president's health, \"he wrote in remarks to reuters. [SEP] but the prime minister said she wanted to be reunited in the hands of a different administration. [SEP] i was there a few minutes later, looking very nice and he was having a lot of staches this time... [SEP] and so, i was much more concerned with the idea of a permanent solution to the problem of nuclear proliferation. [SEP] a spokesman said:\" \" i think we need to account for the payouts but we do not think we will get a deal when we go. [SEP]"}
+{"type": "sample", "index": 50, "raw_text": "[CLS] she added. [SEP] if this really was a problem... we don ' t need one to make a reference to the \" nature of iran ' s nuclear program \" ( and israel ) that has nothing to do with u. s. policy, but we cannot wait for the west to do that now.... [SEP] \" we would come in, give them a good chance and make it a win, so if we were going to make a change, then we would take it later, \" he says. [SEP] a good place to make money? [SEP] the second step would be to replace the 47 - year - old [SEP]", "detok_text": "[CLS] she added. [SEP] if this really was a problem... we don't need one to make a reference to the \"nature of iran's nuclear program\" (and israel) that has nothing to do with u. s. policy, but we cannot wait for the west to do that now.... [SEP] \"we would come in, give them a good chance and make it a win, so if we were going to make a change, then we would take it later,\" he says. [SEP] a good place to make money? [SEP] the second step would be to replace the 47 - year - old [SEP]"}
+{"type": "sample", "index": 51, "raw_text": "[CLS] a lender has to take a credit - card account. [SEP] but the organisation ' s appeal comes only two weeks after thousands of people killed or injured in violence. [SEP] \" the president will get out of the way again, he can find what he knows a bit, what to get in there, \" he said. [SEP] and that is not a great result. [SEP] if you are playing for the australian team you will probably have to wait for the opportunity. [SEP] but that has not happened in mexico, and the authorities expect them to be able to contact the rest of the population. [SEP] it is not unusual for me to think [SEP]", "detok_text": "[CLS] a lender has to take a credit - card account. [SEP] but the organisation's appeal comes only two weeks after thousands of people killed or injured in violence. [SEP] \"the president will get out of the way again, he can find what he knows a bit, what to get in there,\" he said. [SEP] and that is not a great result. [SEP] if you are playing for the australian team you will probably have to wait for the opportunity. [SEP] but that has not happened in mexico, and the authorities expect them to be able to contact the rest of the population. [SEP] it is not unusual for me to think [SEP]"}
+{"type": "sample", "index": 52, "raw_text": "[CLS] points. [SEP] he has refused to disclose the details of the scope of his investigation, but insisted that he did not know the nature of the risk he would be released in prison for life. [SEP] a spokesman for the school system could not immediately be reached. [SEP] going to haiti was, well, not - for - a - goal. [SEP] in her life, he said, the girls seemed to have sex when they had no choice. [SEP] i don ' t let the doctor tell your friend, friend or brother, the money you make when you feel stupid is to make the money. [SEP] there ' s some things to look into [SEP]", "detok_text": "[CLS] points. [SEP] he has refused to disclose the details of the scope of his investigation, but insisted that he did not know the nature of the risk he would be released in prison for life. [SEP] a spokesman for the school system could not immediately be reached. [SEP] going to haiti was, well, not - for - a - goal. [SEP] in her life, he said, the girls seemed to have sex when they had no choice. [SEP] i don't let the doctor tell your friend, friend or brother, the money you make when you feel stupid is to make the money. [SEP] there's some things to look into [SEP]"}
+{"type": "sample", "index": 53, "raw_text": "[CLS]. [SEP] the two had offices, conference facilities and apartment buildings, and that could not be confirmed. [SEP] a surprise decision to replace india ' s toyota as the world ' s largest automaker has lost millions of jobs. [SEP] he ' s a democrat, he ' s built into a business. [SEP] no working group has been able to raise this amount, but at least he ' s been able to do it. [SEP] the official said the executive committee at the end of the summit has been working with the u. s., russia and china to make a case against the move. [SEP] the meeting took place as early as a [SEP]", "detok_text": "[CLS]. [SEP] the two had offices, conference facilities and apartment buildings, and that could not be confirmed. [SEP] a surprise decision to replace india's toyota as the world's largest automaker has lost millions of jobs. [SEP] he's a democrat, he's built into a business. [SEP] no working group has been able to raise this amount, but at least he's been able to do it. [SEP] the official said the executive committee at the end of the summit has been working with the u. s., russia and china to make a case against the move. [SEP] the meeting took place as early as a [SEP]"}
+{"type": "sample", "index": 54, "raw_text": "[CLS] something we didn ' t want, \" he said. [SEP] officials said the driver left shortly after the crash and was allowed to leave for the morning shift. [SEP] the best way for them is make sure they do not keep it safe. [SEP] so it ' s not a bad start. [SEP] \" that could give me problems, \" he said. [SEP] at the end of the year, that number will be about 13. [SEP] we have to use the opportunity to try to change the past and find the way to the future. [SEP] i, however, have a little connection with mr. nader....... [SEP]", "detok_text": "[CLS] something we didn't want, \"he said. [SEP] officials said the driver left shortly after the crash and was allowed to leave for the morning shift. [SEP] the best way for them is make sure they do not keep it safe. [SEP] so it's not a bad start. [SEP]\" that could give me problems, \" he said. [SEP] at the end of the year, that number will be about 13. [SEP] we have to use the opportunity to try to change the past and find the way to the future. [SEP] i, however, have a little connection with mr. nader....... [SEP]"}
+{"type": "sample", "index": 55, "raw_text": "[CLS] \" i was going to see one of them, not going to see that one \" at a time, he said. [SEP] \" if there ' s something that is going to be done, and we ' ve all agreed that we ' ll be able to take it, i think there ' s something we can do, \" scurry said. [SEP] i guess we are trying to change that. [SEP] ryan smyth ' s goal tied the scoreless at 2 - 2 with 3 : 05 left in the first. [SEP] more than 1, 200 people were injured in the crash, which killed 13 people between 2004 and 2006. [SEP] [SEP]", "detok_text": "[CLS] \"i was going to see one of them, not going to see that one\" at a time, he said. [SEP] \"if there's something that is going to be done, and we've all agreed that we'll be able to take it, i think there's something we can do,\" scurry said. [SEP] i guess we are trying to change that. [SEP] ryan smyth's goal tied the scoreless at 2 - 2 with 3: 05 left in the first. [SEP] more than 1, 200 people were injured in the crash, which killed 13 people between 2004 and 2006. [SEP] [SEP]"}
+{"type": "sample", "index": 56, "raw_text": "[CLS] don ' t think it is going to be like having make - up cheques in your car. [SEP] but if he ' s right, he ' s a coward. [SEP] and, well, well, we ' re going to know he ' s dead... and we don ' t have too much for him in jail. [SEP] \" i don ' t like to be the wrong person, but i think it ' s her job to be honest, \" she said before t. o. c. asked if her life had changed. [SEP] this is expected to total approximately $ 50 million in 2008 - 2010. [SEP] it [SEP]", "detok_text": "[CLS] don't think it is going to be like having make - up cheques in your car. [SEP] but if he's right, he's a coward. [SEP] and, well, well, we're going to know he's dead... and we don't have too much for him in jail. [SEP] \"i don't like to be the wrong person, but i think it's her job to be honest,\" she said before t. o. c. asked if her life had changed. [SEP] this is expected to total approximately $50 million in 2008 - 2010. [SEP] it [SEP]"}
+{"type": "sample", "index": 57, "raw_text": "[CLS] and we regain their independence. [SEP] john leahy, head of securities brokers, said the company ' s results have helped investors to focus on their options given the current economic environment. [SEP] \" i usually have a job with a large group, where i have to do a job, sometimes for at least a year to a year, \" he said. [SEP] \" it would be a political stunt. [SEP] the heat won two games in the series, which ended after the season started going 2 - for - 5. [SEP] the pirates took off with a two - 0 run. [SEP] i cannot also look at other activities here. [SEP] [SEP]", "detok_text": "[CLS] and we regain their independence. [SEP] john leahy, head of securities brokers, said the company's results have helped investors to focus on their options given the current economic environment. [SEP] \"i usually have a job with a large group, where i have to do a job, sometimes for at least a year to a year,\" he said. [SEP] \" it would be a political stunt. [SEP] the heat won two games in the series, which ended after the season started going 2 - for - 5. [SEP] the pirates took off with a two - 0 run. [SEP] i cannot also look at other activities here. [SEP] [SEP]"}
+{"type": "sample", "index": 58, "raw_text": "[CLS] may have to pay other costs for their homes. [SEP] the family said they were trying to get a lawyer. [SEP] he was expected to return from his holiday when he returned to britain at the end of april. [SEP] associated press writer suna deby in nairobi, kenya contributed to this report. [SEP] when we focus on each other, we have a different response in which we respond to all of our problems. [SEP] after all, we have no jobs. [SEP] he retired at the end of the season in his second year in less than a year with the new york jets but he hasn ' t been with the packers. [SEP] he [SEP]", "detok_text": "[CLS] may have to pay other costs for their homes. [SEP] the family said they were trying to get a lawyer. [SEP] he was expected to return from his holiday when he returned to britain at the end of april. [SEP] associated press writer suna deby in nairobi, kenya contributed to this report. [SEP] when we focus on each other, we have a different response in which we respond to all of our problems. [SEP] after all, we have no jobs. [SEP] he retired at the end of the season in his second year in less than a year with the new york jets but he hasn't been with the packers. [SEP] he [SEP]"}
+{"type": "sample", "index": 59, "raw_text": "[CLS], we now have a focus on what we have to do. [SEP] that said, if you want to convene his position at this point he ' ll make a decision at this point to take stock in the company. [SEP] however, both companies have been forced to change the law to try to protect themselves against the recession. [SEP] she ' s only 18 years old, and she ' s over four years. [SEP] it is still running out of money and just doesn ' t seem to know much. [SEP] \" i ' m confident the next president will resolve the problem, \" he said. [SEP] that ' s what we need [SEP]", "detok_text": "[CLS], we now have a focus on what we have to do. [SEP] that said, if you want to convene his position at this point he'll make a decision at this point to take stock in the company. [SEP] however, both companies have been forced to change the law to try to protect themselves against the recession. [SEP] she's only 18 years old, and she's over four years. [SEP] it is still running out of money and just doesn't seem to know much. [SEP] \"i'm confident the next president will resolve the problem,\" he said. [SEP] that's what we need [SEP]"}
+{"type": "sample", "index": 60, "raw_text": "[CLS] co. [SEP] the border wall, which stands out on a concrete strip on the other side of the border, is now closed. [SEP] that ' s pretty much in itself. [SEP] it was a lot of fun. [SEP] it would have been easier to write off. [SEP] overtime _ 2, detroit, min, min ( hooking ), 17 : 08 roy, min ( hooking ), 18 : 08. [SEP] associated press writer anne gearan in washington contributed to this report. [SEP] \" the rest of the tour is all i can and it forces me to get back and get the race there, \" she said. [SEP] [SEP]", "detok_text": "[CLS] co. [SEP] the border wall, which stands out on a concrete strip on the other side of the border, is now closed. [SEP] that's pretty much in itself. [SEP] it was a lot of fun. [SEP] it would have been easier to write off. [SEP] overtime _ 2, detroit, min, min (hooking), 17: 08 roy, min (hooking), 18: 08. [SEP] associated press writer anne gearan in washington contributed to this report. [SEP] \"the rest of the tour is all i can and it forces me to get back and get the race there,\" she said. [SEP] [SEP]"}
+{"type": "sample", "index": 61, "raw_text": "[CLS] the game - clincher at 2 - 3, scored on a power play just 22 minutes in the second period. [SEP] they may have turned his face on the subject, put in an interview and, with a smile, focused for days on the image of himself in the face. [SEP] \" we are used to the leadership of the army. [SEP] i only was able to walk when i was in the middle of the night and thought i could have been standing in the tunnel. [SEP] donaghy said the league ' s decision does not comment on its decision. [SEP] his father reportedly died in december. [SEP] after india ' s elections [SEP]", "detok_text": "[CLS] the game - clincher at 2 - 3, scored on a power play just 22 minutes in the second period. [SEP] they may have turned his face on the subject, put in an interview and, with a smile, focused for days on the image of himself in the face. [SEP] \" we are used to the leadership of the army. [SEP] i only was able to walk when i was in the middle of the night and thought i could have been standing in the tunnel. [SEP] donaghy said the league's decision does not comment on its decision. [SEP] his father reportedly died in december. [SEP] after india's elections [SEP]"}
+{"type": "sample", "index": 62, "raw_text": "[CLS] home to a home with her 7 - year - old son. [SEP] the letters were only \" written in the united states, \" according to national intelligence officials. [SEP] for that part of the day, president obama, who felt he had to make another big shift in the campaign, was a little far from in the right position for the region. [SEP] \" he needs to be a better for the team, \" said a source. [SEP] last year he issued 2, 035 orders in january. [SEP] the shows will air on the discovery channel and other shows next year. [SEP] it may seem to me at the top of this table [SEP]", "detok_text": "[CLS] home to a home with her 7 - year - old son. [SEP] the letters were only \"written in the united states,\" according to national intelligence officials. [SEP] for that part of the day, president obama, who felt he had to make another big shift in the campaign, was a little far from in the right position for the region. [SEP] \"he needs to be a better for the team,\" said a source. [SEP] last year he issued 2, 035 orders in january. [SEP] the shows will air on the discovery channel and other shows next year. [SEP] it may seem to me at the top of this table [SEP]"}
+{"type": "sample", "index": 63, "raw_text": "[CLS] iraq, according to a recent report in the post. [SEP] mr. sandro is left by the end of the story, leaving him in the car, going off for hours - if not minutes - - in his hands. [SEP] \" we are looking for a long - term extension of this strategy. [SEP] \" our differences are great and i do not want to be alone. [SEP] \" i know, the first time he started it, i would tell him to take him, it was always hard to pick a player after him, so i don ' t know if he could make up his mind. [SEP] \" i don ' t [SEP]", "detok_text": "[CLS] iraq, according to a recent report in the post. [SEP] mr. sandro is left by the end of the story, leaving him in the car, going off for hours - if not minutes - - in his hands. [SEP] \"we are looking for a long - term extension of this strategy. [SEP]\" our differences are great and i do not want to be alone. [SEP] \"i know, the first time he started it, i would tell him to take him, it was always hard to pick a player after him, so i don't know if he could make up his mind. [SEP]\" i don't [SEP]"}

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_256steps_n64/summary.jsonl

@@ -0,0 +1,2 @@
+{"type": "summary", "name": "state_c256_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c256_t1p45", "steps": 256, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 29.81545187350111, "nll_per_token": 3.3950267783717107, "tokens": 9500}, "diversity": {"sample_entropy": 4.085741040367163, "unique_tokens": 1473, "token_count": 8192, "distinct_1": 0.1798095703125, "distinct_2": 0.5905511811023622, "top_token_mass": 0.0538330078125}}
+{"type": "summary", "name": "state_c1024_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c1024_t1p45", "steps": 256, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 1024.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 28.415282971033125, "nll_per_token": 3.3469271332084953, "tokens": 9529}, "diversity": {"sample_entropy": 4.048794239038511, "unique_tokens": 1473, "token_count": 8192, "distinct_1": 0.1798095703125, "distinct_2": 0.5878444881889764, "top_token_mass": 0.057861328125}}

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_256steps_n64/summary.tsv

@@ -0,0 +1,3 @@
+name	step	detok_genppl	sample_entropy	distinct_2	top_token_mass	model_t_mode	support_power	semantic_power	final_from	endpoint_temp	concentration_max	update
+state_c256_t1p45	124000	29.81545187350111	4.085741040367163	0.5905511811023622	0.0538330078125	post	1.0	1.0	state	1.45	256.0	resample
+state_c1024_t1p45	124000	28.415282971033125	4.048794239038511	0.5878444881889764	0.057861328125	post	1.0	1.0	state	1.45	1024.0	resample

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_16/state_c1024_t1p45_detok_raw_samples.txt

@@ -0,0 +1,228 @@
+state_c1024_t1p45_detok
+{
+  "type": "summary",
+  "name": "state_c1024_t1p45",
+  "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt",
+  "step": 124000,
+  "decode": {
+    "kind": "categorical_fullvocab",
+    "config": "state_c1024_t1p45",
+    "steps": 16,
+    "model_t_mode": "post",
+    "support_power": 1.0,
+    "semantic_power": 1.0,
+    "endpoint_temp": 1.45,
+    "concentration_min": 1.0,
+    "concentration_max": 1024.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 24.348744185198743,
+    "nll_per_token": 3.1924802746955083,
+    "tokens": 7297
+  },
+  "diversity": {
+    "sample_entropy": 2.0679188483539344,
+    "unique_tokens": 615,
+    "token_count": 8192,
+    "distinct_1": 0.0750732421875,
+    "distinct_2": 0.23363681102362205,
+    "top_token_mass": 0.392578125
+  }
+}
+
+===== sample 000 =====
+[CLS], chicago, chicago, chicago, and,, we get a list - chicago,,, chicago,,,,, chicago, chicago, michigan, chicago,, and more. [SEP] goal of. thomas 14 - 0. 7. - 13, inc. - - michigan, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago,,, chicago,,,,,,,, illinois,, chicago, illinois, chicago, university of michigan, ohio. michigan, michigan, ohio,, michigan, michigan, ohio, ohio,, ohio, ohio, michigan, and [SEP]
+
+===== sample 001 =====
+[CLS],,,,,, 50, 50, 48,,, 50,,,, 51,,,,,,,, etc. [SEP] the list is 50,,,,,,,,, etc. [SEP] 14,,, 13, 15, 17, 15, 17, 15, 17,, 15, 17, 16, 16,, 13, 14, 14.,, 14, 13, 14, 14 -,,,,,, 26, 37, 37, the other end of the road, 37, 37, 37,,,, 37,,, 37,, [SEP]
+
+===== sample 002 =====
+[CLS], 2004, 2005,,,,,,, 2006 and 31, and, respectively. [SEP] scutton has 1. 6,,,,,,,, and 2. 5, 7, 14,,,,,,,,,,,,,, 4, etc. [SEP] the firm includes in chicago, chicago,,, % in the region, 50 %, and 50 % in the conference, chicago, chicago, chicago, chicago, chicago, chicago,,, chicago. [SEP] the state - run company already already has more than $40bn in debt assets. [SEP] the collapse in confidence [SEP]
+
+===== sample 003 =====
+[CLS] of the country,,,,,,,,,,,,,, country,,,, the city, state, city, city,, city, and region. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, in the,,,,,,,,, and,,,,,,,,,,. [SEP] in and of - - ohio, illinois, illinois, illinois,,,, illinois, illinois, illinois, illinois,,,,,,,,, [SEP]
+
+===== sample 004 =====
+[CLS] the moment of 1893, just over 500 square feet of the piece, the plane was a a point - down on the side of the fuselage. [SEP] he said he was taught the concept of the idea that people would have have to what what not not have have together. [SEP] thec originates, develops and has offices in chicago, chicago, new york, chicago, mid - chicago,, york, chicago, chicago, chicago, and in the us, uk,,,, and, and. [SEP] in chicago, detroit, the penguins, bulls and the white, in chicago, the power have the only -,, of [SEP]
+
+===== sample 005 =====
+[CLS]. s. raleigh, n. d., thousands of the players have,,, - - chicago, chicago, chicago, chicago,,,,,,,,,,, have have [CLS] in the end of the season to send him back to the basket in the the playoffs. [SEP] the them with the butter in place. [SEP] the man is is right in the back, - in the back and, of course, in the back of the time - - - and, in fact, he is about to sign to a new world record. [SEP] the answer was have about the beijing. [SEP] the rest of the [SEP]
+
+===== sample 006 =====
+[CLS],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and, in the rest of the day,,,,, and,. " [SEP] the winner, the,,, has the time, time and place to stand in the,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP], -,,,,,,,,,,,, of,. [SEP] a few chunk of thes between the clock and the.. [SEP]
+
+===== sample 007 =====
+[CLS]1. 9 - - - - - - - - - - - - - - - - - - - - - - - - - - - 14. - - - - - - - - - - pb11. - - - - - - - - - - - - - - - - - 14, 2009, - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - [SEP]
+
+===== sample 008 =====
+[CLS] to shove her in the face. [SEP] the,,,,, the linens,,, the planes, the wagons, the planes, according to the chicago,,,,,,. [SEP],,,,,,,,,,,,,,,,,,,,,,,. [SEP] two - thirds of the fans will have to get on the road to win the championship game. [SEP] i mean, to,, to,,,,, the road,,,,,, the country,,,,,,,, and give you the name, " he said. [SEP]
+
+===== sample 009 =====
+[CLS],,,,,,,,,,,,,,,,, end of the day.,,,,, in,,,,,,,,,,,,,,,,. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP] we have have have have,, have have have have for.. [SEP] the rockets, as if they were an awful team [SEP]
+
+===== sample 010 =====
+[CLS] - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 74, 17 - 14 - 14 - - - - - - - - - - - - - - - - - - - - - - - - - - -, 73 - - - - - - -1, 112 -, - 31, 68 - 14, 68 - 14 to the end - - - - - - - - - - - - - - - - - - - - - - - - [SEP]
+
+===== sample 011 =====
+[CLS], 37,,,, 37, 37, 37, 37, 37,,, 37, 37,,,,,,,,,,,,,,,,,,,,,,,,,, and back - to - back in the period of december 31, 2008 are,,,,, 36 -,....,, three weeks to date, to end the week,,,,,,,,,,,,,, 37, 37, days in the week of week -,,,,,,,,,,,,,,,, [SEP]
+
+===== sample 012 =====
+[CLS],,,, turn - of - road,,,,,,,,,,.,,.,, to the line -,,,,,,,,,,, to turn to the line,,,,,,, and, to the end, period. [SEP] to 52, turn, the turn - to -,,, - to. turn - in - turn, to the next - turn, the next,,,,, etc.,,,, the beginning,,,.,.,,, 14, 15 -,, 14, 15, 14.. [SEP]
+
+===== sample 013 =====
+[CLS] the same said. [SEP] in the end,,,,,,,,,,,,,,,,,,,,, of the whole future. [SEP] "i think we know, we will be happy soon," he said. [SEP] and up the whole,,, the breadbaskets,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,.,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, [SEP]
+
+===== sample 014 =====
+[CLS] - 17 - 16, 18 - 16 - 17 - 2 - 16 - 31 - - 6 - 14 - 17 - 14 - 14 - - - - 1 - 72 - 17 - 2, 21, 49 -, 31 -, - - 16 - 31 -,, 11, 731, 13, 31 -, -, 14 - 16 - 14 - - - - - - - - - - - - - - 14 - 16 - 112. - - - - 17 - 16 - 13, 16 - 14 - 48 -. - - - - - - - - - - - - - - - - - [SEP]
+
+===== sample 015 =====
+[CLS], michigan, michigan, michigan, michigan, michigan, michigan, the district, chicago, michigan, michigan, michigan, illinois,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and on. [SEP] the companys was headquartered in college city, ill. [SEP] 14, 2007. [SEP] in boston, boston, the bostons, the, the the..... [SEP] the huskies set up a 14 - 14 run [SEP]
+
+===== sample 016 =====
+[CLS] have have time to begin the process of finding a deal. [SEP] the end of the letter refers to a series of a - 52, i. u. s., to the,,,,,, a. c. a., of the,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP] " they have,,,,,,,,, [SEP]
+
+===== sample 017 =====
+[CLS],, chicago, chicago, chicago, etc. [SEP] the usa,,,,,,,,,, the usa, the usa,,,,,,,,,,,,,,,,,, etc. [SEP] but for the,,,,,,,,,,,, have way out of the question. [SEP] in the cities of chicago, chicago, chicago, chicago. [SEP] but it didn't matter. [SEP] the have have have, they that they back to - - chicago, boston,,,,,,,, etc. [SEP] and happens, no. [SEP] the [SEP]
+
+===== sample 018 =====
+[CLS] europe, canada, the u. s., canada to canada and canada. [SEP] a have have have have have here in moscow. [SEP] of course, they don't bring in the money to have them the door. [SEP],,, chicago, chicago, chicago,, the district,, chicago,,,,,,, chicago to chicago, chicago to chicago, bhut, chicago, chicago, chicago,.........., chicago, chicago, chicago,,,, chicago, chicago, chicago, chicago, chicago,,,,,, and to chicago. [SEP] [SEP]
+
+===== sample 019 =====
+[CLS] 81, 89, 89, 89. [SEP] period, 2008 - the company's 73, 73, 73,,,,,,,,, 37,,, 37,, 37,,,,, 36,,,, 18 - 37, 23 - 37,, 37, 36, 37, 37, 37, 37, 37,..,.,,,,,, 49, 73, 54,. 5.,. 37, 37, 48, 48, 31, 48,,, 37,,,,,,,,, 31 to 38. 50,... [SEP]
+
+===== sample 020 =====
+[CLS] - - chicago,,,, c.,,,,,,, district of chicago, chicago, chicago, chicago, cleveland,,,,,,,,,,,,, cleveland, and, and in akron, ohio, and ohio. [SEP] the balance line is in addition to the company's,, 50, 49, 49 -,,, 38, 50bp, 52 -, -,,, of, respectively. [SEP] and, in the first game of the season, it's a 14 - 14 season that has a 1 - 3 points in the first two minutes. [SEP] [SEP]
+
+===== sample 021 =====
+[CLS],,,,,,,,,,,,, for all. [SEP] " it doesn't really matter to the,,,,,,,,,,,,,,,,,,,,,, etc. [SEP] they have have,, and.. [SEP] i think it is,,,,,,,,,,,,,,,, of the day,,,,,,,,,,,,,,,,,,,, to the end. [SEP] the same of of of of,,,,,,,,,,,, [SEP]
+
+===== sample 022 =====
+[CLS].. [SEP],,,,,,,,,,,,,,,,,,. [SEP] and, say, the leaders of the world,,,,,,. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, [SEP]
+
+===== sample 023 =====
+[CLS], 48, 52, 48,,,,.,,,,,,, 48,,,,,,,,,,,, 48, and, of the region, and region of the uk and region,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and, etc., in the week,,,,,,, the day of the week, the region, the year, number of,,,,,,,,,,,, [SEP]
+
+===== sample 024 =====
+[CLS] to make up a meal by putting their heads on a table... [SEP] in the end. [SEP] the house would cost at $14, 000. [SEP] the question of unity is for unity, but not is unity, " sadr added. [SEP] the pope is not not way to the house of dreams. [SEP] the one is is in the door. [SEP] as he said, chicago, chicago, chicago, chicago, chicago, chicago, chicago, and chicago. [SEP] for them, the haves and,s and,s,ss, and and and ands and for have thes in the field. [SEP] [SEP]
+
+===== sample 025 =====
+[CLS] what a person can do. [SEP] of words, they never know it, no,,s, etc., oy, drugs, rest,,y,,, to say,,, no,,, a little bit. [SEP] ( by aboutt communications technologies, inc. [SEP] the bulls is have the,,s,,,,s, but there are no moreys in the uy..... [SEP] and the one,ing,sss in the corner... [SEP] the curious - -,,,,, y, pre,,,,s - - all [SEP]
+
+===== sample 026 =====
+[CLS] 14 - 14 - 14 - 14 - 1. 16 -yyyy -y - 14err 1. 16 -y - 14. [SEP] by -eryyyyyy - 14 % &yyyyyy - 16 % traily - o - 16y - ey - eh - 16yy -yyyyyyyyyyyy - - oyyyyyyyyn - 14yyyyyyyy - 14yyyyyyyyyyyyyyyyyyy [SEP]
+
+===== sample 027 =====
+[CLS] - - - - - - - - - - - - - - - - - - - - - - - - - - - - - to - date. - - - - - - - - - - - - - - - - - - - - - - - - - period of - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - [SEP]
+
+===== sample 028 =====
+[CLS]77 - 6077777, 7677117, 76771, 7651777111, 76317877 - 49731, 7677777,734, 767726, number771171 - 0777220792., 49777, 7671, 49 - 49 - 49, 49 - 49 - 49 - 49 - 37 -,7 - 49 - 49 - 49, 7371, 49 - 37 - 49 - 49 - 547 - 48 - 48 - 49 [SEP]
+
+===== sample 029 =====
+[CLS] detroit, detroit, detroit, the knicks, detroit, detroit, detroit, detroit, chicago were the best teams of the day. [SEP] the list comes in the names of the chicago, detroit, chicago, boston,, chicago, chicago, and and the others. [SEP] but the list is chicago, chicago, chicago, chicago, chicago, chicago, illinois, said david chesney, a political commentator. [SEP] the date for the hearing is set for jan. [SEP] jacobs returned to the jets last season with two injuries. [SEP] when a full - was was springing to the wall at the end of chicago, the chicago was [SEP]
+
+===== sample 030 =====
+[CLS] the game. [SEP] he will have a good time in the senate. [SEP] results in the later parts of the year, boston, period, 2008. end - to - end,, 21 and 37,,,,,, s. a., 18 - 14, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago and chicago, chicago, region, boston, chicago, st. chicago, michigan, chicago, chicago, the district,,,,,, and on the continent,. - - chicago, chicago, chicago, chicago, a.,,, etc. [SEP] the [SEP]
+
+===== sample 031 =====
+[CLS]................. [SEP] ( :101.y ( ( ( ( ( (7, 500). [SEP] 2479. 1......................... [SEP] by. oh, 247....................................................... [SEP]
+
+===== sample 032 =====
+[CLS],, period, 50, etc. [SEP] indiana,,,, 50,,, - region, region, region,, 37,,, 50, 89. [SEP] chicago, ohio, chicago, chicago, illinois, illinois,,,,,,,,, $1, 000, 000. [SEP] region, region, region, region, region, multi - area, region, region, region,,, area, chicago, region, chicago, region, area, area, region,, area, region, region,, region, region,, region, region, region, region - region, region, [SEP]
+
+===== sample 033 =====
+[CLS]s, o,,,,,,,,,,,s. [SEP] the concept is that the,,,,,,,,,,,,,,,,,, mt. [SEP] the,,,,,,,,,,,,,,,,,,,, is effortless. [SEP] the bulls,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP] the,,,,,,,,,,,,,, [SEP]
+
+===== sample 034 =====
+[CLS],,,,,,,,,,,,,,,,,,. [SEP] and all they wanted to stand out the door on the day, day, day, the end of the day.,,,,,, to,,,,,,, - - and perhaps in the day of days. [SEP] the industry's leading companies are private and and construction workers in the united states, michigan, michigan, chicago, michigan, michigan, michigan, michigan, north carolina, ohio, illinois, ireland. [SEP] gates is also dedicated to explaining how the situation was changed in the early soviets. [SEP] [SEP]
+
+===== sample 035 =====
+[CLS] % to 509 points. [SEP] 3 - 14 - - - - - - -, - 11 - 24 - 11 -, j. 14 - 14 - 16 - 14 - 14. to mid - table 14. 5 - 11, 16 - 14.. 12 - 14 - 14 - 14. - - 14, 16, 16, 16 -,... [SEP] (ap) cnn's doug klein, greg barrett and jan karsak contributed to this report. [SEP] instead, they went back to the house, with a partition back on the road. [SEP] the 20 - year - old, a 14 - [SEP]
+
+===== sample 036 =====
+[CLS],, 49,,,,,, 70, 73,,, 73, 73, 73, 73, 89,, 73, 73, 70, 70,,,,, w.,, 89, 89,, 70, 73, 73, 50, 73, 54, 73, 57, y,... of the period,,,,,,,,,,,,,,,,,, and, of the entire of group. [SEP] east city, chicago, chicago, oct. [SEP] for a total of 1, 50,,,,,, 37, 37,, [SEP]
+
+===== sample 037 =====
+[CLS], 112 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -, 17 - 14 - - - - - 14 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - less than 60 % - - - - - - - - - - - - - - [SEP]
+
+===== sample 038 =====
+[CLS]... [SEP] number of students,,, 13, 20098, and - 112. - - 14, 2009 - - - - - - - - - - - - - - - for a three - game series. - - - - ticker - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - i'm - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - [SEP]
+
+===== sample 039 =====
+[CLS],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and,,,,,,,,,,,,,,,,,, and of the,,,,. [SEP] the me,,,,,,.,,,, a,,,,,,,,,,,,,,,,,,,,,,,, etc. [SEP] the of are s [SEP]
+
+===== sample 040 =====
+[CLS] there are still a number of questions about the payout of british employees. [SEP] "the meeting happened in the middle of the day, at the the hour.... later in the day," the paper said. [SEP] the....................... [SEP] a byy,,,,,, chicago,,,,fl,,,,y,usa,,,her, bisty,st,y,,,, to guide,,.,,,,utions, and,,,, [SEP]
+
+===== sample 041 =====
+[CLS] 2 0. s 1, n7, 1, n.......... 2, n..... 247. 2 n dice to.... 2.1, n.11.11 to.. [SEP] n..7... dice1, s. n...s in n.............. 2171, 247................................ [SEP]
+
+===== sample 042 =====
+[CLS] the road, a,,,,,,,,,, access to the road. [SEP] thes, boston, detroit, chicago, chicago, chicago,, chicago, chicago,, detroit, chicago, chicago. [SEP] cleveland, chicago 11, 15 - 15 chicago, 11 - chicago, 13 - 14, detroit, n. a. 14, detroit 11, detroit 11, 13 - 14, n., 11, 11 - 14, 11 - 13,... [SEP] [SEP] schools were closed in some areas. [SEP] "of course, no," the hotel manager told us. [SEP] the company, which [SEP]
+
+===== sample 043 =====
+[CLS] games. [SEP] the company includes in michigan, michigan, michigan of illinois, illinois, illinois, illinois, michigan,,,,,,,,,,,,, michigan, ohio, illinois, michigan, ohio, and. [SEP] the number of the economy by growth was 0. 4 % in the same quarter in the third quarter of 2008. [SEP] lansing, mich. - - in the middle of the day, down the road, you have to be able to do a good job, even if the road will be worse. [SEP] police say the man was was a, and, and - in road with the [SEP]
+
+===== sample 044 =====
+[CLS] - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -. - - - - 31 - 31, 37,, 31, 37, and other - - - - - - - - 31 - 14 - - - - - - 31 - 31, 31 - -, 31 -, - - -, -, - - - -, 73 - 37, 31 - 31, 73 - 31 in december 2007, 08 to end 2009, total of $582 million (2007 to - 08) to 1128 in the coming [SEP]
+
+===== sample 045 =====
+[CLS] the red region. [SEP] there have been heavy showers at several venues in the past two years. [SEP] the car is right in place, and on the back of the road, at the end of the road. [SEP] mr brown said it would have said that the number of jobs and jobs in the uk was to be increased. [SEP] for a "collapse" of the economy. [SEP] the firm is more by, 500 employees with offices in onsite chicago, chicago,, chicago,, chicago, chicago,, chicago, new york, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, [SEP]
+
+===== sample 046 =====
+[CLS],,,,,,,,,,,,,,,,,,,, in the middle,,,,,,,,,,,,,,,,,,, and,. [SEP] in fact, the american team the most should have in vancouver - - the first trip to the top of the table. [SEP] the game resulted in a combination of chicago, chicago,,,,, and,,,,, and then, according to the detroit - boston game, a 49 - point thriller by the two teams,,, chicago, that has lasted more than 100 minutes. [SEP] [SEP]
+
+===== sample 047 =====
+[CLS],,,,, 14,,. [SEP],,, michigan, michigan,,, illinois,,,,,,,,,,,,,,,,,,,,, illinois,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP] the panel, taking on members of the uk, uk, france, canada,,, france, most of the uk,,,,,,,,,,,,,,,,,,,,, and,,,,, [SEP]
+
+===== sample 048 =====
+[CLS], period, days, but not days, period, period, to period,, period, period, to period and period at the cost of a week,, period, period, period to, period, period,,,,, period, the same, period, period, period, and,, to period, period to period.. period, period, period, period, period, and a week at the same period, period, period, 30 days at the end, period, days, period, period,, days to each of, and days, 30 days, beginning with,,, beginning, the [SEP]
+
+===== sample 049 =====
+[CLS], s, s,, s, s, s. [SEP] s, s, s, s, s,, s, s in d, s, s, s, s, s, s, s s, s, s, s, s, in and d. [SEP] s, s, s s, s s, s, s, s, s, s, s, s,, s,,, s, s, s, s, s. [SEP] d,, s, s, s,, s, s, s, s,, and.. [SEP] s, s, s [SEP]
+
+===== sample 050 =====
+[CLS], -.... 51, 53,,,,.... [SEP],, 50, 50, 50,,,,,,,,, and,,,,,,,,,,,,,,,,, the non - and, of the year -,,,,,,,,,,,. [SEP] in the name of, -,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, -,,,,,,, the kind [SEP]
+
+===== sample 051 =====
+[CLS].. we are a, -,,,,,,,,,,,...,,,,,,,,,,,,,,,,, w.,.,,,,,,,,,,,,,,,,,,,,,,, and,.,, calculates,,,,,,,,,,,,,,,,,,,,.,,,,.... the e - u has a range of,,,,,,,,,,,.,,,,, [SEP]
+
+===== sample 052 =====
+[CLS] - - all in the final game of the season - - were confronted by someone in their car. [SEP] he told the rest of the group to get up to the back of the building, and a a and and out into the road. [SEP] "they will have have a way, he is going to give us a lesson." [SEP] a a a a... [SEP] the number would be $1, 000 by the end of the year, and a the, and and and andy of the sames. [SEP] on the point in the area, there are no people in the area, he said. [SEP] the [SEP]
+
+===== sample 053 =====
+[CLS], 37,,,,,, 21, 26, 26, 37,,,.,,,,,,, 2007. [SEP] for the period - 21, 26, 21, 31, 37, 31, chicago - -,, 26,,, 36,,,,,, 51, 48, 37,, 21, 37, 37, 37,, 37, 37,, 16,,, 14 - 16, 23,,, 14 - 16, 37, 48, 37,, 16 - 16, 16 - 14. -, 14,,,, 17, 37, 37, [SEP]
+
+===== sample 054 =====
+[CLS]'s,,,,........,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and,. [SEP] for that words, the likes of the oregon, chicago, illinois, illinois,,,,, are in the most back - to - back,,,, way. [SEP] the [SEP]
+
+===== sample 055 =====
+[CLS] out of the road, and a and and and have - the widening. [SEP] a few thing was out for nothing. [SEP] (ap) - china's economic would systems have a significant part of the world, in the north, and the rest of the world, according to the report. [SEP] in fact, the number of for for was of wass, [CLS] 14, 24,,, 2006 ). [SEP] the league's rookie all - star isn't the only one who seems to be on the court. [SEP] the company is expected to be 1, 000 jobs, and,,y said. [SEP] the [SEP]
+
+===== sample 056 =====
+[CLS] in and,, and and and and ). [SEP] dr. michigan, michigan, michigan, michigan, s.,., michigan, michigan, michigan, michigan, ohio, etc. [SEP] but, by the end of the year, the number will be to than 1 %. [SEP] by the time he was be out of the political again. [SEP] i'm not sure, but, have,,,,,,,,ical allss in the us, canada, texas and texas. [SEP]......,.,. and............ [SEP]
+
+===== sample 057 =====
+[CLS], period, time to time. week of december 1. period to. days in a number of days, week to days in a, period, period, period, period, period,, period. [SEP] it is period, period, period of the period, period, period. period, period, and period. week, period, period, period, period, period, period, period days, change of days, period, week of the same period, week. week, period, period, period, period,, day, period, period, period,. period,, period, period, in a, period [SEP]
+
+===== sample 058 =====
+[CLS] [SEP] the company continues to have a full year, year, year, year, and return to a full schedule. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,.,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, [SEP]
+
+===== sample 059 =====
+[CLS] addition, the rubber coat, comes with unique decorative flavors, such as the rubber coat and the purple mask. [SEP] he became more worried about any future, he said. [SEP] houston's loss to detroit in the final game of a series of road - game series. [SEP] i do want to leave the room for a long conversation. [SEP] once again, he knows how to do his job. [SEP] the answer will be limited to,,,,,,, at least. [SEP] they have the bottom end of the road,,,,,,,,,,,,,,,,,,,,, [SEP]
+
+===== sample 060 =====
+[CLS],,,,, period -,,,,,,,,,,,, and, end of the period, period,,,,,, period to period, period, and, period, period, period, period - period. the date,,,,,,,,,,, and, has the ability to track,,,, period, period, place, start to the year,,,,,,,,, and number of period. [SEP] in the end, the back - up eliminates the illusion of the in the end of the original structure. [SEP] he would have [SEP]
+
+===== sample 061 =====
+[CLS], chicago, chicago, chicago, end of the day, chicago,, chicago, chicago, chicago,,,,,, chicago, chicago,,,,, chicago, chicago,,, 37, 37, 36, week and the correspondingly beautiful days. [SEP] the third day of the day was marked by the remarkable talents of joe cowen. [SEP] for today, the week has moved from days,, days, days, to december,,, and december. [SEP] 21, 2007,, 2007, and the last 14 days of the year., 31,,,,,,, december, 2007. [SEP]
+
+===== sample 062 =====
+[CLS], will have been advised to take pre - trip flights due to non - cancellations. [SEP] multi - region, mid -,, day of north -, eastern, east - atlantic, east - atlantic, south -,,, mid -,, mid - atlantic, chicago, chicago, chicago, and chicago,,, western, chicago, and chicago, chicago, chicago, chicago, and,, chicago,,,,,, and chicago, north - to - north, u. s. 78, eastern, eastern, eastern,, and eastern, mid - atlantic, chicago,,,,, and. [SEP]
+
+===== sample 063 =====
+[CLS] have have have, in the confluence of the celtics and the pistons, and have the best is to the thes in the basket. [SEP] the a -yy, with ofs, and the, and the out of the sand and and, of a single basis. [SEP] the following included, atlanta, atlanta, chicago, chicago, boston, chicago, chicago, chicago, chicago, new york, chicago, etc. [SEP] chicago,, chicago, chicago, chicago, to,ca, 2004 - h2.... [SEP] the idea is is have, have and, with a few, and and and and. [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_16/state_c1024_t1p45_raw_samples.txt

@@ -0,0 +1,228 @@
+state_c1024_t1p45
+{
+  "type": "summary",
+  "name": "state_c1024_t1p45",
+  "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt",
+  "step": 124000,
+  "decode": {
+    "kind": "categorical_fullvocab",
+    "config": "state_c1024_t1p45",
+    "steps": 16,
+    "model_t_mode": "post",
+    "support_power": 1.0,
+    "semantic_power": 1.0,
+    "endpoint_temp": 1.45,
+    "concentration_min": 1.0,
+    "concentration_max": 1024.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 24.348744185198743,
+    "nll_per_token": 3.1924802746955083,
+    "tokens": 7297
+  },
+  "diversity": {
+    "sample_entropy": 2.0679188483539344,
+    "unique_tokens": 615,
+    "token_count": 8192,
+    "distinct_1": 0.0750732421875,
+    "distinct_2": 0.23363681102362205,
+    "top_token_mass": 0.392578125
+  }
+}
+
+===== sample 000 =====
+[CLS], chicago, chicago, chicago, and,, we get a list - chicago,,, chicago,,,,, chicago, chicago, michigan, chicago,, and more. [SEP] goal of. thomas 14 - 0. 7. - 13, inc. - - michigan, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago,,, chicago,,,,,,,, illinois,, chicago, illinois, chicago, university of michigan, ohio. michigan, michigan, ohio,, michigan, michigan, ohio, ohio,, ohio, ohio, michigan, and [SEP]
+
+===== sample 001 =====
+[CLS],,,,,, 50, 50, 48,,, 50,,,, 51,,,,,,,, etc. [SEP] the list is 50,,,,,,,,, etc. [SEP] 14,,, 13, 15, 17, 15, 17, 15, 17,, 15, 17, 16, 16,, 13, 14, 14.,, 14, 13, 14, 14 -,,,,,, 26, 37, 37, the other end of the road, 37, 37, 37,,,, 37,,, 37,, [SEP]
+
+===== sample 002 =====
+[CLS], 2004, 2005,,,,,,, 2006 and 31, and, respectively. [SEP] scutton has 1. 6,,,,,,,, and 2. 5, 7, 14,,,,,,,,,,,,,, 4, etc. [SEP] the firm includes in chicago, chicago,,, % in the region, 50 %, and 50 % in the conference, chicago, chicago, chicago, chicago, chicago, chicago,,, chicago. [SEP] the state - run company already already has more than $ 40bn in debt assets. [SEP] the collapse in confidence [SEP]
+
+===== sample 003 =====
+[CLS] of the country,,,,,,,,,,,,,, country,,,, the city, state, city, city,, city, and region. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, in the,,,,,,,,, and,,,,,,,,,,. [SEP] in and of - - ohio, illinois, illinois, illinois,,,, illinois, illinois, illinois, illinois,,,,,,,,, [SEP]
+
+===== sample 004 =====
+[CLS] the moment of 1893, just over 500 square feet of the piece, the plane was a a point - down on the side of the fuselage. [SEP] he said he was taught the concept of the idea that people would have have to what what not not have have together. [SEP] thec originates, develops and has offices in chicago, chicago, new york, chicago, mid - chicago,, york, chicago, chicago, chicago, and in the us, uk,,,, and, and. [SEP] in chicago, detroit, the penguins, bulls and the white, in chicago, the power have the only -,, of [SEP]
+
+===== sample 005 =====
+[CLS]. s. raleigh, n. d., thousands of the players have,,, - - chicago, chicago, chicago, chicago,,,,,,,,,,, have have [CLS] in the end of the season to send him back to the basket in the the playoffs. [SEP] the them with the butter in place. [SEP] the man is is right in the back, - in the back and, of course, in the back of the time - - - and, in fact, he is about to sign to a new world record. [SEP] the answer was have about the beijing. [SEP] the rest of the [SEP]
+
+===== sample 006 =====
+[CLS],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and, in the rest of the day,,,,, and,. " [SEP] the winner, the,,, has the time, time and place to stand in the,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP], -,,,,,,,,,,,, of,. [SEP] a few chunk of thes between the clock and the.. [SEP]
+
+===== sample 007 =====
+[CLS]1. 9 - - - - - - - - - - - - - - - - - - - - - - - - - - - 14. - - - - - - - - - - pb11. - - - - - - - - - - - - - - - - - 14, 2009, - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - [SEP]
+
+===== sample 008 =====
+[CLS] to shove her in the face. [SEP] the,,,,, the linens,,, the planes, the wagons, the planes, according to the chicago,,,,,,. [SEP],,,,,,,,,,,,,,,,,,,,,,,. [SEP] two - thirds of the fans will have to get on the road to win the championship game. [SEP] i mean, to,, to,,,,, the road,,,,,, the country,,,,,,,, and give you the name, " he said. [SEP]
+
+===== sample 009 =====
+[CLS],,,,,,,,,,,,,,,,, end of the day.,,,,, in,,,,,,,,,,,,,,,,. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP] we have have have have,, have have have have for.. [SEP] the rockets, as if they were an awful team [SEP]
+
+===== sample 010 =====
+[CLS] - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 74, 17 - 14 - 14 - - - - - - - - - - - - - - - - - - - - - - - - - - -, 73 - - - - - - -1, 112 -, - 31, 68 - 14, 68 - 14 to the end - - - - - - - - - - - - - - - - - - - - - - - - [SEP]
+
+===== sample 011 =====
+[CLS], 37,,,, 37, 37, 37, 37, 37,,, 37, 37,,,,,,,,,,,,,,,,,,,,,,,,,, and back - to - back in the period of december 31, 2008 are,,,,, 36 -,....,, three weeks to date, to end the week,,,,,,,,,,,,,, 37, 37, days in the week of week -,,,,,,,,,,,,,,,, [SEP]
+
+===== sample 012 =====
+[CLS],,,, turn - of - road,,,,,,,,,,.,,.,, to the line -,,,,,,,,,,, to turn to the line,,,,,,, and, to the end, period. [SEP] to 52, turn, the turn - to -,,, - to. turn - in - turn, to the next - turn, the next,,,,, etc.,,,, the beginning,,,.,.,,, 14, 15 -,, 14, 15, 14.. [SEP]
+
+===== sample 013 =====
+[CLS] the same said. [SEP] in the end,,,,,,,,,,,,,,,,,,,,, of the whole future. [SEP] " i think we know, we will be happy soon, " he said. [SEP] and up the whole,,, the breadbaskets,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,.,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, [SEP]
+
+===== sample 014 =====
+[CLS] - 17 - 16, 18 - 16 - 17 - 2 - 16 - 31 - - 6 - 14 - 17 - 14 - 14 - - - - 1 - 72 - 17 - 2, 21, 49 -, 31 -, - - 16 - 31 -,, 11, 731, 13, 31 -, -, 14 - 16 - 14 - - - - - - - - - - - - - - 14 - 16 - 112. - - - - 17 - 16 - 13, 16 - 14 - 48 -. - - - - - - - - - - - - - - - - - [SEP]
+
+===== sample 015 =====
+[CLS], michigan, michigan, michigan, michigan, michigan, michigan, the district, chicago, michigan, michigan, michigan, illinois,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and on. [SEP] the companys was headquartered in college city, ill. [SEP] 14, 2007. [SEP] in boston, boston, the bostons, the, the the..... [SEP] the huskies set up a 14 - 14 run [SEP]
+
+===== sample 016 =====
+[CLS] have have time to begin the process of finding a deal. [SEP] the end of the letter refers to a series of a - 52, i. u. s., to the,,,,,, a. c. a., of the,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP] " they have,,,,,,,,, [SEP]
+
+===== sample 017 =====
+[CLS],, chicago, chicago, chicago, etc. [SEP] the usa,,,,,,,,,, the usa, the usa,,,,,,,,,,,,,,,,,, etc. [SEP] but for the,,,,,,,,,,,, have way out of the question. [SEP] in the cities of chicago, chicago, chicago, chicago. [SEP] but it didn ' t matter. [SEP] the have have have, they that they back to - - chicago, boston,,,,,,,, etc. [SEP] and happens, no. [SEP] the [SEP]
+
+===== sample 018 =====
+[CLS] europe, canada, the u. s., canada to canada and canada. [SEP] a have have have have have here in moscow. [SEP] of course, they don ' t bring in the money to have them the door. [SEP],,, chicago, chicago, chicago,, the district,, chicago,,,,,,, chicago to chicago, chicago to chicago, bhut, chicago, chicago, chicago,.........., chicago, chicago, chicago,,,, chicago, chicago, chicago, chicago, chicago,,,,,, and to chicago. [SEP] [SEP]
+
+===== sample 019 =====
+[CLS] 81, 89, 89, 89. [SEP] period, 2008 - the company ' s 73, 73, 73,,,,,,,,, 37,,, 37,, 37,,,,, 36,,,, 18 - 37, 23 - 37,, 37, 36, 37, 37, 37, 37, 37,..,.,,,,,, 49, 73, 54,. 5.,. 37, 37, 48, 48, 31, 48,,, 37,,,,,,,,, 31 to 38. 50,... [SEP]
+
+===== sample 020 =====
+[CLS] - - chicago,,,, c.,,,,,,, district of chicago, chicago, chicago, chicago, cleveland,,,,,,,,,,,,, cleveland, and, and in akron, ohio, and ohio. [SEP] the balance line is in addition to the company ' s,, 50, 49, 49 -,,, 38, 50bp, 52 -, -,,, of, respectively. [SEP] and, in the first game of the season, it ' s a 14 - 14 season that has a 1 - 3 points in the first two minutes. [SEP] [SEP]
+
+===== sample 021 =====
+[CLS],,,,,,,,,,,,, for all. [SEP] " it doesn ' t really matter to the,,,,,,,,,,,,,,,,,,,,,, etc. [SEP] they have have,, and.. [SEP] i think it is,,,,,,,,,,,,,,,, of the day,,,,,,,,,,,,,,,,,,,, to the end. [SEP] the same of of of of,,,,,,,,,,,, [SEP]
+
+===== sample 022 =====
+[CLS].. [SEP],,,,,,,,,,,,,,,,,,. [SEP] and, say, the leaders of the world,,,,,,. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, [SEP]
+
+===== sample 023 =====
+[CLS], 48, 52, 48,,,,.,,,,,,, 48,,,,,,,,,,,, 48, and, of the region, and region of the uk and region,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and, etc., in the week,,,,,,, the day of the week, the region, the year, number of,,,,,,,,,,,, [SEP]
+
+===== sample 024 =====
+[CLS] to make up a meal by putting their heads on a table... [SEP] in the end. [SEP] the house would cost at $ 14, 000. [SEP] the question of unity is for unity, but not is unity, " sadr added. [SEP] the pope is not not way to the house of dreams. [SEP] the one is is in the door. [SEP] as he said, chicago, chicago, chicago, chicago, chicago, chicago, chicago, and chicago. [SEP] for them, the haves and,s and,s,ss, and and and ands and for have thes in the field. [SEP] [SEP]
+
+===== sample 025 =====
+[CLS] what a person can do. [SEP] of words, they never know it, no,,s, etc., oy, drugs, rest,,y,,, to say,,, no,,, a little bit. [SEP] ( by aboutt communications technologies, inc. [SEP] the bulls is have the,,s,,,,s, but there are no moreys in the uy..... [SEP] and the one,ing,sss in the corner... [SEP] the curious - -,,,,, y, pre,,,,s - - all [SEP]
+
+===== sample 026 =====
+[CLS] 14 - 14 - 14 - 14 - 1. 16 -yyyy -y - 14err 1. 16 -y - 14. [SEP] by -eryyyyyy - 14 % &yyyyyy - 16 % traily - o - 16y - ey - eh - 16yy -yyyyyyyyyyyy - - oyyyyyyyyn - 14yyyyyyyy - 14yyyyyyyyyyyyyyyyyyy [SEP]
+
+===== sample 027 =====
+[CLS] - - - - - - - - - - - - - - - - - - - - - - - - - - - - - to - date. - - - - - - - - - - - - - - - - - - - - - - - - - period of - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - [SEP]
+
+===== sample 028 =====
+[CLS]77 - 6077777, 7677117, 76771, 7651777111, 76317877 - 49731, 7677777,734, 767726, number771171 - 0777220792., 49777, 7671, 49 - 49 - 49, 49 - 49 - 49 - 49 - 37 -,7 - 49 - 49 - 49, 7371, 49 - 37 - 49 - 49 - 547 - 48 - 48 - 49 [SEP]
+
+===== sample 029 =====
+[CLS] detroit, detroit, detroit, the knicks, detroit, detroit, detroit, detroit, chicago were the best teams of the day. [SEP] the list comes in the names of the chicago, detroit, chicago, boston,, chicago, chicago, and and the others. [SEP] but the list is chicago, chicago, chicago, chicago, chicago, chicago, illinois, said david chesney, a political commentator. [SEP] the date for the hearing is set for jan. [SEP] jacobs returned to the jets last season with two injuries. [SEP] when a full - was was springing to the wall at the end of chicago, the chicago was [SEP]
+
+===== sample 030 =====
+[CLS] the game. [SEP] he will have a good time in the senate. [SEP] results in the later parts of the year, boston, period, 2008. end - to - end,, 21 and 37,,,,,, s. a., 18 - 14, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago and chicago, chicago, region, boston, chicago, st. chicago, michigan, chicago, chicago, the district,,,,,, and on the continent,. - - chicago, chicago, chicago, chicago, a.,,, etc. [SEP] the [SEP]
+
+===== sample 031 =====
+[CLS]................. [SEP] ( :101.y ( ( ( ( ( ( 7, 500 ). [SEP] 2479. 1......................... [SEP] by. oh, 247....................................................... [SEP]
+
+===== sample 032 =====
+[CLS],, period, 50, etc. [SEP] indiana,,,, 50,,, - region, region, region,, 37,,, 50, 89. [SEP] chicago, ohio, chicago, chicago, illinois, illinois,,,,,,,,, $ 1, 000, 000. [SEP] region, region, region, region, region, multi - area, region, region, region,,, area, chicago, region, chicago, region, area, area, region,, area, region, region,, region, region,, region, region, region, region - region, region, [SEP]
+
+===== sample 033 =====
+[CLS]s, o,,,,,,,,,,,s. [SEP] the concept is that the,,,,,,,,,,,,,,,,,, mt. [SEP] the,,,,,,,,,,,,,,,,,,,, is effortless. [SEP] the bulls,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP] the,,,,,,,,,,,,,, [SEP]
+
+===== sample 034 =====
+[CLS],,,,,,,,,,,,,,,,,,. [SEP] and all they wanted to stand out the door on the day, day, day, the end of the day.,,,,,, to,,,,,,, - - and perhaps in the day of days. [SEP] the industry ' s leading companies are private and and construction workers in the united states, michigan, michigan, chicago, michigan, michigan, michigan, michigan, north carolina, ohio, illinois, ireland. [SEP] gates is also dedicated to explaining how the situation was changed in the early soviets. [SEP] [SEP]
+
+===== sample 035 =====
+[CLS] % to 509 points. [SEP] 3 - 14 - - - - - - -, - 11 - 24 - 11 -, j. 14 - 14 - 16 - 14 - 14. to mid - table 14. 5 - 11, 16 - 14.. 12 - 14 - 14 - 14. - - 14, 16, 16, 16 -,... [SEP] ( ap ) cnn ' s doug klein, greg barrett and jan karsak contributed to this report. [SEP] instead, they went back to the house, with a partition back on the road. [SEP] the 20 - year - old, a 14 - [SEP]
+
+===== sample 036 =====
+[CLS],, 49,,,,,, 70, 73,,, 73, 73, 73, 73, 89,, 73, 73, 70, 70,,,,, w.,, 89, 89,, 70, 73, 73, 50, 73, 54, 73, 57, y,... of the period,,,,,,,,,,,,,,,,,, and, of the entire of group. [SEP] east city, chicago, chicago, oct. [SEP] for a total of 1, 50,,,,,, 37, 37,, [SEP]
+
+===== sample 037 =====
+[CLS], 112 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -, 17 - 14 - - - - - 14 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - less than 60 % - - - - - - - - - - - - - - [SEP]
+
+===== sample 038 =====
+[CLS]... [SEP] number of students,,, 13, 20098, and - 112. - - 14, 2009 - - - - - - - - - - - - - - - for a three - game series. - - - - ticker - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - i ' m - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - [SEP]
+
+===== sample 039 =====
+[CLS],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and,,,,,,,,,,,,,,,,,, and of the,,,,. [SEP] the me,,,,,,.,,,, a,,,,,,,,,,,,,,,,,,,,,,,, etc. [SEP] the of are s [SEP]
+
+===== sample 040 =====
+[CLS] there are still a number of questions about the payout of british employees. [SEP] " the meeting happened in the middle of the day, at the the hour.... later in the day, " the paper said. [SEP] the....................... [SEP] a byy,,,,,, chicago,,,,fl,,,,y,usa,,,her, bisty,st,y,,,, to guide,,.,,,,utions, and,,,, [SEP]
+
+===== sample 041 =====
+[CLS] 2 0. s 1, n7, 1, n.......... 2, n..... 247. 2 n dice to.... 2.1, n.11.11 to.. [SEP] n..7... dice1, s. n...s in n.............. 2171, 247................................ [SEP]
+
+===== sample 042 =====
+[CLS] the road, a,,,,,,,,,, access to the road. [SEP] thes, boston, detroit, chicago, chicago, chicago,, chicago, chicago,, detroit, chicago, chicago. [SEP] cleveland, chicago 11, 15 - 15 chicago, 11 - chicago, 13 - 14, detroit, n. a. 14, detroit 11, detroit 11, 13 - 14, n., 11, 11 - 14, 11 - 13,... [SEP] [SEP] schools were closed in some areas. [SEP] " of course, no, " the hotel manager told us. [SEP] the company, which [SEP]
+
+===== sample 043 =====
+[CLS] games. [SEP] the company includes in michigan, michigan, michigan of illinois, illinois, illinois, illinois, michigan,,,,,,,,,,,,, michigan, ohio, illinois, michigan, ohio, and. [SEP] the number of the economy by growth was 0. 4 % in the same quarter in the third quarter of 2008. [SEP] lansing, mich. - - in the middle of the day, down the road, you have to be able to do a good job, even if the road will be worse. [SEP] police say the man was was a, and, and - in road with the [SEP]
+
+===== sample 044 =====
+[CLS] - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -. - - - - 31 - 31, 37,, 31, 37, and other - - - - - - - - 31 - 14 - - - - - - 31 - 31, 31 - -, 31 -, - - -, -, - - - -, 73 - 37, 31 - 31, 73 - 31 in december 2007, 08 to end 2009, total of $ 582 million ( 2007 to - 08 ) to 1128 in the coming [SEP]
+
+===== sample 045 =====
+[CLS] the red region. [SEP] there have been heavy showers at several venues in the past two years. [SEP] the car is right in place, and on the back of the road, at the end of the road. [SEP] mr brown said it would have said that the number of jobs and jobs in the uk was to be increased. [SEP] for a " collapse " of the economy. [SEP] the firm is more by, 500 employees with offices in onsite chicago, chicago,, chicago,, chicago, chicago,, chicago, new york, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, [SEP]
+
+===== sample 046 =====
+[CLS],,,,,,,,,,,,,,,,,,,, in the middle,,,,,,,,,,,,,,,,,,, and,. [SEP] in fact, the american team the most should have in vancouver - - the first trip to the top of the table. [SEP] the game resulted in a combination of chicago, chicago,,,,, and,,,,, and then, according to the detroit - boston game, a 49 - point thriller by the two teams,,, chicago, that has lasted more than 100 minutes. [SEP] [SEP]
+
+===== sample 047 =====
+[CLS],,,,, 14,,. [SEP],,, michigan, michigan,,, illinois,,,,,,,,,,,,,,,,,,,,, illinois,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP] the panel, taking on members of the uk, uk, france, canada,,, france, most of the uk,,,,,,,,,,,,,,,,,,,,, and,,,,, [SEP]
+
+===== sample 048 =====
+[CLS], period, days, but not days, period, period, to period,, period, period, to period and period at the cost of a week,, period, period, period to, period, period,,,,, period, the same, period, period, period, and,, to period, period to period.. period, period, period, period, period, and a week at the same period, period, period, 30 days at the end, period, days, period, period,, days to each of, and days, 30 days, beginning with,,, beginning, the [SEP]
+
+===== sample 049 =====
+[CLS], s, s,, s, s, s. [SEP] s, s, s, s, s,, s, s in d, s, s, s, s, s, s, s s, s, s, s, s, in and d. [SEP] s, s, s s, s s, s, s, s, s, s, s, s,, s,,, s, s, s, s, s. [SEP] d,, s, s, s,, s, s, s, s,, and.. [SEP] s, s, s [SEP]
+
+===== sample 050 =====
+[CLS], -.... 51, 53,,,,.... [SEP],, 50, 50, 50,,,,,,,,, and,,,,,,,,,,,,,,,,, the non - and, of the year -,,,,,,,,,,,. [SEP] in the name of, -,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, -,,,,,,, the kind [SEP]
+
+===== sample 051 =====
+[CLS].. we are a, -,,,,,,,,,,,...,,,,,,,,,,,,,,,,, w.,.,,,,,,,,,,,,,,,,,,,,,,, and,.,, calculates,,,,,,,,,,,,,,,,,,,,.,,,,.... the e - u has a range of,,,,,,,,,,,.,,,,, [SEP]
+
+===== sample 052 =====
+[CLS] - - all in the final game of the season - - were confronted by someone in their car. [SEP] he told the rest of the group to get up to the back of the building, and a a and and out into the road. [SEP] " they will have have a way, he is going to give us a lesson. " [SEP] a a a a... [SEP] the number would be $ 1, 000 by the end of the year, and a the, and and and andy of the sames. [SEP] on the point in the area, there are no people in the area, he said. [SEP] the [SEP]
+
+===== sample 053 =====
+[CLS], 37,,,,,, 21, 26, 26, 37,,,.,,,,,,, 2007. [SEP] for the period - 21, 26, 21, 31, 37, 31, chicago - -,, 26,,, 36,,,,,, 51, 48, 37,, 21, 37, 37, 37,, 37, 37,, 16,,, 14 - 16, 23,,, 14 - 16, 37, 48, 37,, 16 - 16, 16 - 14. -, 14,,,, 17, 37, 37, [SEP]
+
+===== sample 054 =====
+[CLS] ' s,,,,........,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and,. [SEP] for that words, the likes of the oregon, chicago, illinois, illinois,,,,, are in the most back - to - back,,,, way. [SEP] the [SEP]
+
+===== sample 055 =====
+[CLS] out of the road, and a and and and have - the widening. [SEP] a few thing was out for nothing. [SEP] ( ap ) - china ' s economic would systems have a significant part of the world, in the north, and the rest of the world, according to the report. [SEP] in fact, the number of for for was of wass, [CLS] 14, 24,,, 2006 ). [SEP] the league ' s rookie all - star isn ' t the only one who seems to be on the court. [SEP] the company is expected to be 1, 000 jobs, and,,y said. [SEP] the [SEP]
+
+===== sample 056 =====
+[CLS] in and,, and and and and ). [SEP] dr. michigan, michigan, michigan, michigan, s.,., michigan, michigan, michigan, michigan, ohio, etc. [SEP] but, by the end of the year, the number will be to than 1 %. [SEP] by the time he was be out of the political again. [SEP] i ' m not sure, but, have,,,,,,,,ical allss in the us, canada, texas and texas. [SEP]......,.,. and............ [SEP]
+
+===== sample 057 =====
+[CLS], period, time to time. week of december 1. period to. days in a number of days, week to days in a, period, period, period, period, period,, period. [SEP] it is period, period, period of the period, period, period. period, period, and period. week, period, period, period, period, period, period, period days, change of days, period, week of the same period, week. week, period, period, period, period,, day, period, period, period,. period,, period, period, in a, period [SEP]
+
+===== sample 058 =====
+[CLS] [SEP] the company continues to have a full year, year, year, year, and return to a full schedule. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,.,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, [SEP]
+
+===== sample 059 =====
+[CLS] addition, the rubber coat, comes with unique decorative flavors, such as the rubber coat and the purple mask. [SEP] he became more worried about any future, he said. [SEP] houston ' s loss to detroit in the final game of a series of road - game series. [SEP] i do want to leave the room for a long conversation. [SEP] once again, he knows how to do his job. [SEP] the answer will be limited to,,,,,,, at least. [SEP] they have the bottom end of the road,,,,,,,,,,,,,,,,,,,,, [SEP]
+
+===== sample 060 =====
+[CLS],,,,, period -,,,,,,,,,,,, and, end of the period, period,,,,,, period to period, period, and, period, period, period, period - period. the date,,,,,,,,,,, and, has the ability to track,,,, period, period, place, start to the year,,,,,,,,, and number of period. [SEP] in the end, the back - up eliminates the illusion of the in the end of the original structure. [SEP] he would have [SEP]
+
+===== sample 061 =====
+[CLS], chicago, chicago, chicago, end of the day, chicago,, chicago, chicago, chicago,,,,,, chicago, chicago,,,,, chicago, chicago,,, 37, 37, 36, week and the correspondingly beautiful days. [SEP] the third day of the day was marked by the remarkable talents of joe cowen. [SEP] for today, the week has moved from days,, days, days, to december,,, and december. [SEP] 21, 2007,, 2007, and the last 14 days of the year., 31,,,,,,, december, 2007. [SEP]
+
+===== sample 062 =====
+[CLS], will have been advised to take pre - trip flights due to non - cancellations. [SEP] multi - region, mid -,, day of north -, eastern, east - atlantic, east - atlantic, south -,,, mid -,, mid - atlantic, chicago, chicago, chicago, and chicago,,, western, chicago, and chicago, chicago, chicago, chicago, and,, chicago,,,,,, and chicago, north - to - north, u. s. 78, eastern, eastern, eastern,, and eastern, mid - atlantic, chicago,,,,, and. [SEP]
+
+===== sample 063 =====
+[CLS] have have have, in the confluence of the celtics and the pistons, and have the best is to the thes in the basket. [SEP] the a -yy, with ofs, and the, and the out of the sand and and, of a single basis. [SEP] the following included, atlanta, atlanta, chicago, chicago, boston, chicago, chicago, chicago, chicago, new york, chicago, etc. [SEP] chicago,, chicago, chicago, chicago, to,ca, 2004 - h2.... [SEP] the idea is is have, have and, with a few, and and and and. [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_16/state_c1024_t1p45_scored.jsonl

@@ -0,0 +1,65 @@
+{"type": "summary", "name": "state_c1024_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c1024_t1p45", "steps": 16, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 1024.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 24.348744185198743, "nll_per_token": 3.1924802746955083, "tokens": 7297}, "diversity": {"sample_entropy": 2.0679188483539344, "unique_tokens": 615, "token_count": 8192, "distinct_1": 0.0750732421875, "distinct_2": 0.23363681102362205, "top_token_mass": 0.392578125}}
+{"type": "sample", "index": 0, "raw_text": "[CLS], chicago, chicago, chicago, and,, we get a list - chicago,,, chicago,,,,, chicago, chicago, michigan, chicago,, and more. [SEP] goal of. thomas 14 - 0. 7. - 13, inc. - - michigan, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago,,, chicago,,,,,,,, illinois,, chicago, illinois, chicago, university of michigan, ohio. michigan, michigan, ohio,, michigan, michigan, ohio, ohio,, ohio, ohio, michigan, and [SEP]", "detok_text": "[CLS], chicago, chicago, chicago, and,, we get a list - chicago,,, chicago,,,,, chicago, chicago, michigan, chicago,, and more. [SEP] goal of. thomas 14 - 0. 7. - 13, inc. - - michigan, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago,,, chicago,,,,,,,, illinois,, chicago, illinois, chicago, university of michigan, ohio. michigan, michigan, ohio,, michigan, michigan, ohio, ohio,, ohio, ohio, michigan, and [SEP]"}
+{"type": "sample", "index": 1, "raw_text": "[CLS],,,,,, 50, 50, 48,,, 50,,,, 51,,,,,,,, etc. [SEP] the list is 50,,,,,,,,, etc. [SEP] 14,,, 13, 15, 17, 15, 17, 15, 17,, 15, 17, 16, 16,, 13, 14, 14.,, 14, 13, 14, 14 -,,,,,, 26, 37, 37, the other end of the road, 37, 37, 37,,,, 37,,, 37,, [SEP]", "detok_text": "[CLS],,,,,, 50, 50, 48,,, 50,,,, 51,,,,,,,, etc. [SEP] the list is 50,,,,,,,,, etc. [SEP] 14,,, 13, 15, 17, 15, 17, 15, 17,, 15, 17, 16, 16,, 13, 14, 14.,, 14, 13, 14, 14 -,,,,,, 26, 37, 37, the other end of the road, 37, 37, 37,,,, 37,,, 37,, [SEP]"}
+{"type": "sample", "index": 2, "raw_text": "[CLS], 2004, 2005,,,,,,, 2006 and 31, and, respectively. [SEP] scutton has 1. 6,,,,,,,, and 2. 5, 7, 14,,,,,,,,,,,,,, 4, etc. [SEP] the firm includes in chicago, chicago,,, % in the region, 50 %, and 50 % in the conference, chicago, chicago, chicago, chicago, chicago, chicago,,, chicago. [SEP] the state - run company already already has more than $ 40bn in debt assets. [SEP] the collapse in confidence [SEP]", "detok_text": "[CLS], 2004, 2005,,,,,,, 2006 and 31, and, respectively. [SEP] scutton has 1. 6,,,,,,,, and 2. 5, 7, 14,,,,,,,,,,,,,, 4, etc. [SEP] the firm includes in chicago, chicago,,, % in the region, 50 %, and 50 % in the conference, chicago, chicago, chicago, chicago, chicago, chicago,,, chicago. [SEP] the state - run company already already has more than $40bn in debt assets. [SEP] the collapse in confidence [SEP]"}
+{"type": "sample", "index": 3, "raw_text": "[CLS] of the country,,,,,,,,,,,,,, country,,,, the city, state, city, city,, city, and region. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, in the,,,,,,,,, and,,,,,,,,,,. [SEP] in and of - - ohio, illinois, illinois, illinois,,,, illinois, illinois, illinois, illinois,,,,,,,,, [SEP]", "detok_text": "[CLS] of the country,,,,,,,,,,,,,, country,,,, the city, state, city, city,, city, and region. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, in the,,,,,,,,, and,,,,,,,,,,. [SEP] in and of - - ohio, illinois, illinois, illinois,,,, illinois, illinois, illinois, illinois,,,,,,,,, [SEP]"}
+{"type": "sample", "index": 4, "raw_text": "[CLS] the moment of 1893, just over 500 square feet of the piece, the plane was a a point - down on the side of the fuselage. [SEP] he said he was taught the concept of the idea that people would have have to what what not not have have together. [SEP] thec originates, develops and has offices in chicago, chicago, new york, chicago, mid - chicago,, york, chicago, chicago, chicago, and in the us, uk,,,, and, and. [SEP] in chicago, detroit, the penguins, bulls and the white, in chicago, the power have the only -,, of [SEP]", "detok_text": "[CLS] the moment of 1893, just over 500 square feet of the piece, the plane was a a point - down on the side of the fuselage. [SEP] he said he was taught the concept of the idea that people would have have to what what not not have have together. [SEP] thec originates, develops and has offices in chicago, chicago, new york, chicago, mid - chicago,, york, chicago, chicago, chicago, and in the us, uk,,,, and, and. [SEP] in chicago, detroit, the penguins, bulls and the white, in chicago, the power have the only -,, of [SEP]"}
+{"type": "sample", "index": 5, "raw_text": "[CLS]. s. raleigh, n. d., thousands of the players have,,, - - chicago, chicago, chicago, chicago,,,,,,,,,,, have have [CLS] in the end of the season to send him back to the basket in the the playoffs. [SEP] the them with the butter in place. [SEP] the man is is right in the back, - in the back and, of course, in the back of the time - - - and, in fact, he is about to sign to a new world record. [SEP] the answer was have about the beijing. [SEP] the rest of the [SEP]", "detok_text": "[CLS]. s. raleigh, n. d., thousands of the players have,,, - - chicago, chicago, chicago, chicago,,,,,,,,,,, have have [CLS] in the end of the season to send him back to the basket in the the playoffs. [SEP] the them with the butter in place. [SEP] the man is is right in the back, - in the back and, of course, in the back of the time - - - and, in fact, he is about to sign to a new world record. [SEP] the answer was have about the beijing. [SEP] the rest of the [SEP]"}
+{"type": "sample", "index": 6, "raw_text": "[CLS],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and, in the rest of the day,,,,, and,. \" [SEP] the winner, the,,, has the time, time and place to stand in the,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP], -,,,,,,,,,,,, of,. [SEP] a few chunk of thes between the clock and the.. [SEP]", "detok_text": "[CLS],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and, in the rest of the day,,,,, and,. \" [SEP] the winner, the,,, has the time, time and place to stand in the,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP], -,,,,,,,,,,,, of,. [SEP] a few chunk of thes between the clock and the.. [SEP]"}
+{"type": "sample", "index": 7, "raw_text": "[CLS]1. 9 - - - - - - - - - - - - - - - - - - - - - - - - - - - 14. - - - - - - - - - - pb11. - - - - - - - - - - - - - - - - - 14, 2009, - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - [SEP]", "detok_text": "[CLS]1. 9 - - - - - - - - - - - - - - - - - - - - - - - - - - - 14. - - - - - - - - - - pb11. - - - - - - - - - - - - - - - - - 14, 2009, - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - [SEP]"}
+{"type": "sample", "index": 8, "raw_text": "[CLS] to shove her in the face. [SEP] the,,,,, the linens,,, the planes, the wagons, the planes, according to the chicago,,,,,,. [SEP],,,,,,,,,,,,,,,,,,,,,,,. [SEP] two - thirds of the fans will have to get on the road to win the championship game. [SEP] i mean, to,, to,,,,, the road,,,,,, the country,,,,,,,, and give you the name, \" he said. [SEP]", "detok_text": "[CLS] to shove her in the face. [SEP] the,,,,, the linens,,, the planes, the wagons, the planes, according to the chicago,,,,,,. [SEP],,,,,,,,,,,,,,,,,,,,,,,. [SEP] two - thirds of the fans will have to get on the road to win the championship game. [SEP] i mean, to,, to,,,,, the road,,,,,, the country,,,,,,,, and give you the name, \" he said. [SEP]"}
+{"type": "sample", "index": 9, "raw_text": "[CLS],,,,,,,,,,,,,,,,, end of the day.,,,,, in,,,,,,,,,,,,,,,,. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP] we have have have have,, have have have have for.. [SEP] the rockets, as if they were an awful team [SEP]", "detok_text": "[CLS],,,,,,,,,,,,,,,,, end of the day.,,,,, in,,,,,,,,,,,,,,,,. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP] we have have have have,, have have have have for.. [SEP] the rockets, as if they were an awful team [SEP]"}
+{"type": "sample", "index": 10, "raw_text": "[CLS] - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 74, 17 - 14 - 14 - - - - - - - - - - - - - - - - - - - - - - - - - - -, 73 - - - - - - -1, 112 -, - 31, 68 - 14, 68 - 14 to the end - - - - - - - - - - - - - - - - - - - - - - - - [SEP]", "detok_text": "[CLS] - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 74, 17 - 14 - 14 - - - - - - - - - - - - - - - - - - - - - - - - - - -, 73 - - - - - - -1, 112 -, - 31, 68 - 14, 68 - 14 to the end - - - - - - - - - - - - - - - - - - - - - - - - [SEP]"}
+{"type": "sample", "index": 11, "raw_text": "[CLS], 37,,,, 37, 37, 37, 37, 37,,, 37, 37,,,,,,,,,,,,,,,,,,,,,,,,,, and back - to - back in the period of december 31, 2008 are,,,,, 36 -,....,, three weeks to date, to end the week,,,,,,,,,,,,,, 37, 37, days in the week of week -,,,,,,,,,,,,,,,, [SEP]", "detok_text": "[CLS], 37,,,, 37, 37, 37, 37, 37,,, 37, 37,,,,,,,,,,,,,,,,,,,,,,,,,, and back - to - back in the period of december 31, 2008 are,,,,, 36 -,....,, three weeks to date, to end the week,,,,,,,,,,,,,, 37, 37, days in the week of week -,,,,,,,,,,,,,,,, [SEP]"}
+{"type": "sample", "index": 12, "raw_text": "[CLS],,,, turn - of - road,,,,,,,,,,.,,.,, to the line -,,,,,,,,,,, to turn to the line,,,,,,, and, to the end, period. [SEP] to 52, turn, the turn - to -,,, - to. turn - in - turn, to the next - turn, the next,,,,, etc.,,,, the beginning,,,.,.,,, 14, 15 -,, 14, 15, 14.. [SEP]", "detok_text": "[CLS],,,, turn - of - road,,,,,,,,,,.,,.,, to the line -,,,,,,,,,,, to turn to the line,,,,,,, and, to the end, period. [SEP] to 52, turn, the turn - to -,,, - to. turn - in - turn, to the next - turn, the next,,,,, etc.,,,, the beginning,,,.,.,,, 14, 15 -,, 14, 15, 14.. [SEP]"}
+{"type": "sample", "index": 13, "raw_text": "[CLS] the same said. [SEP] in the end,,,,,,,,,,,,,,,,,,,,, of the whole future. [SEP] \" i think we know, we will be happy soon, \" he said. [SEP] and up the whole,,, the breadbaskets,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,.,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, [SEP]", "detok_text": "[CLS] the same said. [SEP] in the end,,,,,,,,,,,,,,,,,,,,, of the whole future. [SEP] \"i think we know, we will be happy soon,\" he said. [SEP] and up the whole,,, the breadbaskets,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,.,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, [SEP]"}
+{"type": "sample", "index": 14, "raw_text": "[CLS] - 17 - 16, 18 - 16 - 17 - 2 - 16 - 31 - - 6 - 14 - 17 - 14 - 14 - - - - 1 - 72 - 17 - 2, 21, 49 -, 31 -, - - 16 - 31 -,, 11, 731, 13, 31 -, -, 14 - 16 - 14 - - - - - - - - - - - - - - 14 - 16 - 112. - - - - 17 - 16 - 13, 16 - 14 - 48 -. - - - - - - - - - - - - - - - - - [SEP]", "detok_text": "[CLS] - 17 - 16, 18 - 16 - 17 - 2 - 16 - 31 - - 6 - 14 - 17 - 14 - 14 - - - - 1 - 72 - 17 - 2, 21, 49 -, 31 -, - - 16 - 31 -,, 11, 731, 13, 31 -, -, 14 - 16 - 14 - - - - - - - - - - - - - - 14 - 16 - 112. - - - - 17 - 16 - 13, 16 - 14 - 48 -. - - - - - - - - - - - - - - - - - [SEP]"}
+{"type": "sample", "index": 15, "raw_text": "[CLS], michigan, michigan, michigan, michigan, michigan, michigan, the district, chicago, michigan, michigan, michigan, illinois,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and on. [SEP] the companys was headquartered in college city, ill. [SEP] 14, 2007. [SEP] in boston, boston, the bostons, the, the the..... [SEP] the huskies set up a 14 - 14 run [SEP]", "detok_text": "[CLS], michigan, michigan, michigan, michigan, michigan, michigan, the district, chicago, michigan, michigan, michigan, illinois,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and on. [SEP] the companys was headquartered in college city, ill. [SEP] 14, 2007. [SEP] in boston, boston, the bostons, the, the the..... [SEP] the huskies set up a 14 - 14 run [SEP]"}
+{"type": "sample", "index": 16, "raw_text": "[CLS] have have time to begin the process of finding a deal. [SEP] the end of the letter refers to a series of a - 52, i. u. s., to the,,,,,, a. c. a., of the,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP] \" they have,,,,,,,,, [SEP]", "detok_text": "[CLS] have have time to begin the process of finding a deal. [SEP] the end of the letter refers to a series of a - 52, i. u. s., to the,,,,,, a. c. a., of the,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP] \" they have,,,,,,,,, [SEP]"}
+{"type": "sample", "index": 17, "raw_text": "[CLS],, chicago, chicago, chicago, etc. [SEP] the usa,,,,,,,,,, the usa, the usa,,,,,,,,,,,,,,,,,, etc. [SEP] but for the,,,,,,,,,,,, have way out of the question. [SEP] in the cities of chicago, chicago, chicago, chicago. [SEP] but it didn ' t matter. [SEP] the have have have, they that they back to - - chicago, boston,,,,,,,, etc. [SEP] and happens, no. [SEP] the [SEP]", "detok_text": "[CLS],, chicago, chicago, chicago, etc. [SEP] the usa,,,,,,,,,, the usa, the usa,,,,,,,,,,,,,,,,,, etc. [SEP] but for the,,,,,,,,,,,, have way out of the question. [SEP] in the cities of chicago, chicago, chicago, chicago. [SEP] but it didn't matter. [SEP] the have have have, they that they back to - - chicago, boston,,,,,,,, etc. [SEP] and happens, no. [SEP] the [SEP]"}
+{"type": "sample", "index": 18, "raw_text": "[CLS] europe, canada, the u. s., canada to canada and canada. [SEP] a have have have have have here in moscow. [SEP] of course, they don ' t bring in the money to have them the door. [SEP],,, chicago, chicago, chicago,, the district,, chicago,,,,,,, chicago to chicago, chicago to chicago, bhut, chicago, chicago, chicago,.........., chicago, chicago, chicago,,,, chicago, chicago, chicago, chicago, chicago,,,,,, and to chicago. [SEP] [SEP]", "detok_text": "[CLS] europe, canada, the u. s., canada to canada and canada. [SEP] a have have have have have here in moscow. [SEP] of course, they don't bring in the money to have them the door. [SEP],,, chicago, chicago, chicago,, the district,, chicago,,,,,,, chicago to chicago, chicago to chicago, bhut, chicago, chicago, chicago,.........., chicago, chicago, chicago,,,, chicago, chicago, chicago, chicago, chicago,,,,,, and to chicago. [SEP] [SEP]"}
+{"type": "sample", "index": 19, "raw_text": "[CLS] 81, 89, 89, 89. [SEP] period, 2008 - the company ' s 73, 73, 73,,,,,,,,, 37,,, 37,, 37,,,,, 36,,,, 18 - 37, 23 - 37,, 37, 36, 37, 37, 37, 37, 37,..,.,,,,,, 49, 73, 54,. 5.,. 37, 37, 48, 48, 31, 48,,, 37,,,,,,,,, 31 to 38. 50,... [SEP]", "detok_text": "[CLS] 81, 89, 89, 89. [SEP] period, 2008 - the company's 73, 73, 73,,,,,,,,, 37,,, 37,, 37,,,,, 36,,,, 18 - 37, 23 - 37,, 37, 36, 37, 37, 37, 37, 37,..,.,,,,,, 49, 73, 54,. 5.,. 37, 37, 48, 48, 31, 48,,, 37,,,,,,,,, 31 to 38. 50,... [SEP]"}
+{"type": "sample", "index": 20, "raw_text": "[CLS] - - chicago,,,, c.,,,,,,, district of chicago, chicago, chicago, chicago, cleveland,,,,,,,,,,,,, cleveland, and, and in akron, ohio, and ohio. [SEP] the balance line is in addition to the company ' s,, 50, 49, 49 -,,, 38, 50bp, 52 -, -,,, of, respectively. [SEP] and, in the first game of the season, it ' s a 14 - 14 season that has a 1 - 3 points in the first two minutes. [SEP] [SEP]", "detok_text": "[CLS] - - chicago,,,, c.,,,,,,, district of chicago, chicago, chicago, chicago, cleveland,,,,,,,,,,,,, cleveland, and, and in akron, ohio, and ohio. [SEP] the balance line is in addition to the company's,, 50, 49, 49 -,,, 38, 50bp, 52 -, -,,, of, respectively. [SEP] and, in the first game of the season, it's a 14 - 14 season that has a 1 - 3 points in the first two minutes. [SEP] [SEP]"}
+{"type": "sample", "index": 21, "raw_text": "[CLS],,,,,,,,,,,,, for all. [SEP] \" it doesn ' t really matter to the,,,,,,,,,,,,,,,,,,,,,, etc. [SEP] they have have,, and.. [SEP] i think it is,,,,,,,,,,,,,,,, of the day,,,,,,,,,,,,,,,,,,,, to the end. [SEP] the same of of of of,,,,,,,,,,,, [SEP]", "detok_text": "[CLS],,,,,,,,,,,,, for all. [SEP] \" it doesn't really matter to the,,,,,,,,,,,,,,,,,,,,,, etc. [SEP] they have have,, and.. [SEP] i think it is,,,,,,,,,,,,,,,, of the day,,,,,,,,,,,,,,,,,,,, to the end. [SEP] the same of of of of,,,,,,,,,,,, [SEP]"}
+{"type": "sample", "index": 22, "raw_text": "[CLS].. [SEP],,,,,,,,,,,,,,,,,,. [SEP] and, say, the leaders of the world,,,,,,. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, [SEP]", "detok_text": "[CLS].. [SEP],,,,,,,,,,,,,,,,,,. [SEP] and, say, the leaders of the world,,,,,,. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, [SEP]"}
+{"type": "sample", "index": 23, "raw_text": "[CLS], 48, 52, 48,,,,.,,,,,,, 48,,,,,,,,,,,, 48, and, of the region, and region of the uk and region,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and, etc., in the week,,,,,,, the day of the week, the region, the year, number of,,,,,,,,,,,, [SEP]", "detok_text": "[CLS], 48, 52, 48,,,,.,,,,,,, 48,,,,,,,,,,,, 48, and, of the region, and region of the uk and region,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and, etc., in the week,,,,,,, the day of the week, the region, the year, number of,,,,,,,,,,,, [SEP]"}
+{"type": "sample", "index": 24, "raw_text": "[CLS] to make up a meal by putting their heads on a table... [SEP] in the end. [SEP] the house would cost at $ 14, 000. [SEP] the question of unity is for unity, but not is unity, \" sadr added. [SEP] the pope is not not way to the house of dreams. [SEP] the one is is in the door. [SEP] as he said, chicago, chicago, chicago, chicago, chicago, chicago, chicago, and chicago. [SEP] for them, the haves and,s and,s,ss, and and and ands and for have thes in the field. [SEP] [SEP]", "detok_text": "[CLS] to make up a meal by putting their heads on a table... [SEP] in the end. [SEP] the house would cost at $14, 000. [SEP] the question of unity is for unity, but not is unity, \" sadr added. [SEP] the pope is not not way to the house of dreams. [SEP] the one is is in the door. [SEP] as he said, chicago, chicago, chicago, chicago, chicago, chicago, chicago, and chicago. [SEP] for them, the haves and,s and,s,ss, and and and ands and for have thes in the field. [SEP] [SEP]"}
+{"type": "sample", "index": 25, "raw_text": "[CLS] what a person can do. [SEP] of words, they never know it, no,,s, etc., oy, drugs, rest,,y,,, to say,,, no,,, a little bit. [SEP] ( by aboutt communications technologies, inc. [SEP] the bulls is have the,,s,,,,s, but there are no moreys in the uy..... [SEP] and the one,ing,sss in the corner... [SEP] the curious - -,,,,, y, pre,,,,s - - all [SEP]", "detok_text": "[CLS] what a person can do. [SEP] of words, they never know it, no,,s, etc., oy, drugs, rest,,y,,, to say,,, no,,, a little bit. [SEP] ( by aboutt communications technologies, inc. [SEP] the bulls is have the,,s,,,,s, but there are no moreys in the uy..... [SEP] and the one,ing,sss in the corner... [SEP] the curious - -,,,,, y, pre,,,,s - - all [SEP]"}
+{"type": "sample", "index": 26, "raw_text": "[CLS] 14 - 14 - 14 - 14 - 1. 16 -yyyy -y - 14err 1. 16 -y - 14. [SEP] by -eryyyyyy - 14 % &yyyyyy - 16 % traily - o - 16y - ey - eh - 16yy -yyyyyyyyyyyy - - oyyyyyyyyn - 14yyyyyyyy - 14yyyyyyyyyyyyyyyyyyy [SEP]", "detok_text": "[CLS] 14 - 14 - 14 - 14 - 1. 16 -yyyy -y - 14err 1. 16 -y - 14. [SEP] by -eryyyyyy - 14 % &yyyyyy - 16 % traily - o - 16y - ey - eh - 16yy -yyyyyyyyyyyy - - oyyyyyyyyn - 14yyyyyyyy - 14yyyyyyyyyyyyyyyyyyy [SEP]"}
+{"type": "sample", "index": 27, "raw_text": "[CLS] - - - - - - - - - - - - - - - - - - - - - - - - - - - - - to - date. - - - - - - - - - - - - - - - - - - - - - - - - - period of - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - [SEP]", "detok_text": "[CLS] - - - - - - - - - - - - - - - - - - - - - - - - - - - - - to - date. - - - - - - - - - - - - - - - - - - - - - - - - - period of - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - [SEP]"}
+{"type": "sample", "index": 28, "raw_text": "[CLS]77 - 6077777, 7677117, 76771, 7651777111, 76317877 - 49731, 7677777,734, 767726, number771171 - 0777220792., 49777, 7671, 49 - 49 - 49, 49 - 49 - 49 - 49 - 37 -,7 - 49 - 49 - 49, 7371, 49 - 37 - 49 - 49 - 547 - 48 - 48 - 49 [SEP]", "detok_text": "[CLS]77 - 6077777, 7677117, 76771, 7651777111, 76317877 - 49731, 7677777,734, 767726, number771171 - 0777220792., 49777, 7671, 49 - 49 - 49, 49 - 49 - 49 - 49 - 37 -,7 - 49 - 49 - 49, 7371, 49 - 37 - 49 - 49 - 547 - 48 - 48 - 49 [SEP]"}
+{"type": "sample", "index": 29, "raw_text": "[CLS] detroit, detroit, detroit, the knicks, detroit, detroit, detroit, detroit, chicago were the best teams of the day. [SEP] the list comes in the names of the chicago, detroit, chicago, boston,, chicago, chicago, and and the others. [SEP] but the list is chicago, chicago, chicago, chicago, chicago, chicago, illinois, said david chesney, a political commentator. [SEP] the date for the hearing is set for jan. [SEP] jacobs returned to the jets last season with two injuries. [SEP] when a full - was was springing to the wall at the end of chicago, the chicago was [SEP]", "detok_text": "[CLS] detroit, detroit, detroit, the knicks, detroit, detroit, detroit, detroit, chicago were the best teams of the day. [SEP] the list comes in the names of the chicago, detroit, chicago, boston,, chicago, chicago, and and the others. [SEP] but the list is chicago, chicago, chicago, chicago, chicago, chicago, illinois, said david chesney, a political commentator. [SEP] the date for the hearing is set for jan. [SEP] jacobs returned to the jets last season with two injuries. [SEP] when a full - was was springing to the wall at the end of chicago, the chicago was [SEP]"}
+{"type": "sample", "index": 30, "raw_text": "[CLS] the game. [SEP] he will have a good time in the senate. [SEP] results in the later parts of the year, boston, period, 2008. end - to - end,, 21 and 37,,,,,, s. a., 18 - 14, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago and chicago, chicago, region, boston, chicago, st. chicago, michigan, chicago, chicago, the district,,,,,, and on the continent,. - - chicago, chicago, chicago, chicago, a.,,, etc. [SEP] the [SEP]", "detok_text": "[CLS] the game. [SEP] he will have a good time in the senate. [SEP] results in the later parts of the year, boston, period, 2008. end - to - end,, 21 and 37,,,,,, s. a., 18 - 14, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago and chicago, chicago, region, boston, chicago, st. chicago, michigan, chicago, chicago, the district,,,,,, and on the continent,. - - chicago, chicago, chicago, chicago, a.,,, etc. [SEP] the [SEP]"}
+{"type": "sample", "index": 31, "raw_text": "[CLS]................. [SEP] ( :101.y ( ( ( ( ( ( 7, 500 ). [SEP] 2479. 1......................... [SEP] by. oh, 247....................................................... [SEP]", "detok_text": "[CLS]................. [SEP] ( :101.y ( ( ( ( ( (7, 500). [SEP] 2479. 1......................... [SEP] by. oh, 247....................................................... [SEP]"}
+{"type": "sample", "index": 32, "raw_text": "[CLS],, period, 50, etc. [SEP] indiana,,,, 50,,, - region, region, region,, 37,,, 50, 89. [SEP] chicago, ohio, chicago, chicago, illinois, illinois,,,,,,,,, $ 1, 000, 000. [SEP] region, region, region, region, region, multi - area, region, region, region,,, area, chicago, region, chicago, region, area, area, region,, area, region, region,, region, region,, region, region, region, region - region, region, [SEP]", "detok_text": "[CLS],, period, 50, etc. [SEP] indiana,,,, 50,,, - region, region, region,, 37,,, 50, 89. [SEP] chicago, ohio, chicago, chicago, illinois, illinois,,,,,,,,, $1, 000, 000. [SEP] region, region, region, region, region, multi - area, region, region, region,,, area, chicago, region, chicago, region, area, area, region,, area, region, region,, region, region,, region, region, region, region - region, region, [SEP]"}
+{"type": "sample", "index": 33, "raw_text": "[CLS]s, o,,,,,,,,,,,s. [SEP] the concept is that the,,,,,,,,,,,,,,,,,, mt. [SEP] the,,,,,,,,,,,,,,,,,,,, is effortless. [SEP] the bulls,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP] the,,,,,,,,,,,,,, [SEP]", "detok_text": "[CLS]s, o,,,,,,,,,,,s. [SEP] the concept is that the,,,,,,,,,,,,,,,,,, mt. [SEP] the,,,,,,,,,,,,,,,,,,,, is effortless. [SEP] the bulls,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP] the,,,,,,,,,,,,,, [SEP]"}
+{"type": "sample", "index": 34, "raw_text": "[CLS],,,,,,,,,,,,,,,,,,. [SEP] and all they wanted to stand out the door on the day, day, day, the end of the day.,,,,,, to,,,,,,, - - and perhaps in the day of days. [SEP] the industry ' s leading companies are private and and construction workers in the united states, michigan, michigan, chicago, michigan, michigan, michigan, michigan, north carolina, ohio, illinois, ireland. [SEP] gates is also dedicated to explaining how the situation was changed in the early soviets. [SEP] [SEP]", "detok_text": "[CLS],,,,,,,,,,,,,,,,,,. [SEP] and all they wanted to stand out the door on the day, day, day, the end of the day.,,,,,, to,,,,,,, - - and perhaps in the day of days. [SEP] the industry's leading companies are private and and construction workers in the united states, michigan, michigan, chicago, michigan, michigan, michigan, michigan, north carolina, ohio, illinois, ireland. [SEP] gates is also dedicated to explaining how the situation was changed in the early soviets. [SEP] [SEP]"}
+{"type": "sample", "index": 35, "raw_text": "[CLS] % to 509 points. [SEP] 3 - 14 - - - - - - -, - 11 - 24 - 11 -, j. 14 - 14 - 16 - 14 - 14. to mid - table 14. 5 - 11, 16 - 14.. 12 - 14 - 14 - 14. - - 14, 16, 16, 16 -,... [SEP] ( ap ) cnn ' s doug klein, greg barrett and jan karsak contributed to this report. [SEP] instead, they went back to the house, with a partition back on the road. [SEP] the 20 - year - old, a 14 - [SEP]", "detok_text": "[CLS] % to 509 points. [SEP] 3 - 14 - - - - - - -, - 11 - 24 - 11 -, j. 14 - 14 - 16 - 14 - 14. to mid - table 14. 5 - 11, 16 - 14.. 12 - 14 - 14 - 14. - - 14, 16, 16, 16 -,... [SEP] (ap) cnn's doug klein, greg barrett and jan karsak contributed to this report. [SEP] instead, they went back to the house, with a partition back on the road. [SEP] the 20 - year - old, a 14 - [SEP]"}
+{"type": "sample", "index": 36, "raw_text": "[CLS],, 49,,,,,, 70, 73,,, 73, 73, 73, 73, 89,, 73, 73, 70, 70,,,,, w.,, 89, 89,, 70, 73, 73, 50, 73, 54, 73, 57, y,... of the period,,,,,,,,,,,,,,,,,, and, of the entire of group. [SEP] east city, chicago, chicago, oct. [SEP] for a total of 1, 50,,,,,, 37, 37,, [SEP]", "detok_text": "[CLS],, 49,,,,,, 70, 73,,, 73, 73, 73, 73, 89,, 73, 73, 70, 70,,,,, w.,, 89, 89,, 70, 73, 73, 50, 73, 54, 73, 57, y,... of the period,,,,,,,,,,,,,,,,,, and, of the entire of group. [SEP] east city, chicago, chicago, oct. [SEP] for a total of 1, 50,,,,,, 37, 37,, [SEP]"}
+{"type": "sample", "index": 37, "raw_text": "[CLS], 112 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -, 17 - 14 - - - - - 14 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - less than 60 % - - - - - - - - - - - - - - [SEP]", "detok_text": "[CLS], 112 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -, 17 - 14 - - - - - 14 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - less than 60 % - - - - - - - - - - - - - - [SEP]"}
+{"type": "sample", "index": 38, "raw_text": "[CLS]... [SEP] number of students,,, 13, 20098, and - 112. - - 14, 2009 - - - - - - - - - - - - - - - for a three - game series. - - - - ticker - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - i ' m - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - [SEP]", "detok_text": "[CLS]... [SEP] number of students,,, 13, 20098, and - 112. - - 14, 2009 - - - - - - - - - - - - - - - for a three - game series. - - - - ticker - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - i'm - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - [SEP]"}
+{"type": "sample", "index": 39, "raw_text": "[CLS],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and,,,,,,,,,,,,,,,,,, and of the,,,,. [SEP] the me,,,,,,.,,,, a,,,,,,,,,,,,,,,,,,,,,,,, etc. [SEP] the of are s [SEP]", "detok_text": "[CLS],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and,,,,,,,,,,,,,,,,,, and of the,,,,. [SEP] the me,,,,,,.,,,, a,,,,,,,,,,,,,,,,,,,,,,,, etc. [SEP] the of are s [SEP]"}
+{"type": "sample", "index": 40, "raw_text": "[CLS] there are still a number of questions about the payout of british employees. [SEP] \" the meeting happened in the middle of the day, at the the hour.... later in the day, \" the paper said. [SEP] the....................... [SEP] a byy,,,,,, chicago,,,,fl,,,,y,usa,,,her, bisty,st,y,,,, to guide,,.,,,,utions, and,,,, [SEP]", "detok_text": "[CLS] there are still a number of questions about the payout of british employees. [SEP] \"the meeting happened in the middle of the day, at the the hour.... later in the day,\" the paper said. [SEP] the....................... [SEP] a byy,,,,,, chicago,,,,fl,,,,y,usa,,,her, bisty,st,y,,,, to guide,,.,,,,utions, and,,,, [SEP]"}
+{"type": "sample", "index": 41, "raw_text": "[CLS] 2 0. s 1, n7, 1, n.......... 2, n..... 247. 2 n dice to.... 2.1, n.11.11 to.. [SEP] n..7... dice1, s. n...s in n.............. 2171, 247................................ [SEP]", "detok_text": "[CLS] 2 0. s 1, n7, 1, n.......... 2, n..... 247. 2 n dice to.... 2.1, n.11.11 to.. [SEP] n..7... dice1, s. n...s in n.............. 2171, 247................................ [SEP]"}
+{"type": "sample", "index": 42, "raw_text": "[CLS] the road, a,,,,,,,,,, access to the road. [SEP] thes, boston, detroit, chicago, chicago, chicago,, chicago, chicago,, detroit, chicago, chicago. [SEP] cleveland, chicago 11, 15 - 15 chicago, 11 - chicago, 13 - 14, detroit, n. a. 14, detroit 11, detroit 11, 13 - 14, n., 11, 11 - 14, 11 - 13,... [SEP] [SEP] schools were closed in some areas. [SEP] \" of course, no, \" the hotel manager told us. [SEP] the company, which [SEP]", "detok_text": "[CLS] the road, a,,,,,,,,,, access to the road. [SEP] thes, boston, detroit, chicago, chicago, chicago,, chicago, chicago,, detroit, chicago, chicago. [SEP] cleveland, chicago 11, 15 - 15 chicago, 11 - chicago, 13 - 14, detroit, n. a. 14, detroit 11, detroit 11, 13 - 14, n., 11, 11 - 14, 11 - 13,... [SEP] [SEP] schools were closed in some areas. [SEP] \"of course, no,\" the hotel manager told us. [SEP] the company, which [SEP]"}
+{"type": "sample", "index": 43, "raw_text": "[CLS] games. [SEP] the company includes in michigan, michigan, michigan of illinois, illinois, illinois, illinois, michigan,,,,,,,,,,,,, michigan, ohio, illinois, michigan, ohio, and. [SEP] the number of the economy by growth was 0. 4 % in the same quarter in the third quarter of 2008. [SEP] lansing, mich. - - in the middle of the day, down the road, you have to be able to do a good job, even if the road will be worse. [SEP] police say the man was was a, and, and - in road with the [SEP]", "detok_text": "[CLS] games. [SEP] the company includes in michigan, michigan, michigan of illinois, illinois, illinois, illinois, michigan,,,,,,,,,,,,, michigan, ohio, illinois, michigan, ohio, and. [SEP] the number of the economy by growth was 0. 4 % in the same quarter in the third quarter of 2008. [SEP] lansing, mich. - - in the middle of the day, down the road, you have to be able to do a good job, even if the road will be worse. [SEP] police say the man was was a, and, and - in road with the [SEP]"}
+{"type": "sample", "index": 44, "raw_text": "[CLS] - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -. - - - - 31 - 31, 37,, 31, 37, and other - - - - - - - - 31 - 14 - - - - - - 31 - 31, 31 - -, 31 -, - - -, -, - - - -, 73 - 37, 31 - 31, 73 - 31 in december 2007, 08 to end 2009, total of $ 582 million ( 2007 to - 08 ) to 1128 in the coming [SEP]", "detok_text": "[CLS] - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -. - - - - 31 - 31, 37,, 31, 37, and other - - - - - - - - 31 - 14 - - - - - - 31 - 31, 31 - -, 31 -, - - -, -, - - - -, 73 - 37, 31 - 31, 73 - 31 in december 2007, 08 to end 2009, total of $582 million (2007 to - 08) to 1128 in the coming [SEP]"}
+{"type": "sample", "index": 45, "raw_text": "[CLS] the red region. [SEP] there have been heavy showers at several venues in the past two years. [SEP] the car is right in place, and on the back of the road, at the end of the road. [SEP] mr brown said it would have said that the number of jobs and jobs in the uk was to be increased. [SEP] for a \" collapse \" of the economy. [SEP] the firm is more by, 500 employees with offices in onsite chicago, chicago,, chicago,, chicago, chicago,, chicago, new york, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, [SEP]", "detok_text": "[CLS] the red region. [SEP] there have been heavy showers at several venues in the past two years. [SEP] the car is right in place, and on the back of the road, at the end of the road. [SEP] mr brown said it would have said that the number of jobs and jobs in the uk was to be increased. [SEP] for a \"collapse\" of the economy. [SEP] the firm is more by, 500 employees with offices in onsite chicago, chicago,, chicago,, chicago, chicago,, chicago, new york, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, [SEP]"}
+{"type": "sample", "index": 46, "raw_text": "[CLS],,,,,,,,,,,,,,,,,,,, in the middle,,,,,,,,,,,,,,,,,,, and,. [SEP] in fact, the american team the most should have in vancouver - - the first trip to the top of the table. [SEP] the game resulted in a combination of chicago, chicago,,,,, and,,,,, and then, according to the detroit - boston game, a 49 - point thriller by the two teams,,, chicago, that has lasted more than 100 minutes. [SEP] [SEP]", "detok_text": "[CLS],,,,,,,,,,,,,,,,,,,, in the middle,,,,,,,,,,,,,,,,,,, and,. [SEP] in fact, the american team the most should have in vancouver - - the first trip to the top of the table. [SEP] the game resulted in a combination of chicago, chicago,,,,, and,,,,, and then, according to the detroit - boston game, a 49 - point thriller by the two teams,,, chicago, that has lasted more than 100 minutes. [SEP] [SEP]"}
+{"type": "sample", "index": 47, "raw_text": "[CLS],,,,, 14,,. [SEP],,, michigan, michigan,,, illinois,,,,,,,,,,,,,,,,,,,,, illinois,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP] the panel, taking on members of the uk, uk, france, canada,,, france, most of the uk,,,,,,,,,,,,,,,,,,,,, and,,,,, [SEP]", "detok_text": "[CLS],,,,, 14,,. [SEP],,, michigan, michigan,,, illinois,,,,,,,,,,,,,,,,,,,,, illinois,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP] the panel, taking on members of the uk, uk, france, canada,,, france, most of the uk,,,,,,,,,,,,,,,,,,,,, and,,,,, [SEP]"}
+{"type": "sample", "index": 48, "raw_text": "[CLS], period, days, but not days, period, period, to period,, period, period, to period and period at the cost of a week,, period, period, period to, period, period,,,,, period, the same, period, period, period, and,, to period, period to period.. period, period, period, period, period, and a week at the same period, period, period, 30 days at the end, period, days, period, period,, days to each of, and days, 30 days, beginning with,,, beginning, the [SEP]", "detok_text": "[CLS], period, days, but not days, period, period, to period,, period, period, to period and period at the cost of a week,, period, period, period to, period, period,,,,, period, the same, period, period, period, and,, to period, period to period.. period, period, period, period, period, and a week at the same period, period, period, 30 days at the end, period, days, period, period,, days to each of, and days, 30 days, beginning with,,, beginning, the [SEP]"}
+{"type": "sample", "index": 49, "raw_text": "[CLS], s, s,, s, s, s. [SEP] s, s, s, s, s,, s, s in d, s, s, s, s, s, s, s s, s, s, s, s, in and d. [SEP] s, s, s s, s s, s, s, s, s, s, s, s,, s,,, s, s, s, s, s. [SEP] d,, s, s, s,, s, s, s, s,, and.. [SEP] s, s, s [SEP]", "detok_text": "[CLS], s, s,, s, s, s. [SEP] s, s, s, s, s,, s, s in d, s, s, s, s, s, s, s s, s, s, s, s, in and d. [SEP] s, s, s s, s s, s, s, s, s, s, s, s,, s,,, s, s, s, s, s. [SEP] d,, s, s, s,, s, s, s, s,, and.. [SEP] s, s, s [SEP]"}
+{"type": "sample", "index": 50, "raw_text": "[CLS], -.... 51, 53,,,,.... [SEP],, 50, 50, 50,,,,,,,,, and,,,,,,,,,,,,,,,,, the non - and, of the year -,,,,,,,,,,,. [SEP] in the name of, -,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, -,,,,,,, the kind [SEP]", "detok_text": "[CLS], -.... 51, 53,,,,.... [SEP],, 50, 50, 50,,,,,,,,, and,,,,,,,,,,,,,,,,, the non - and, of the year -,,,,,,,,,,,. [SEP] in the name of, -,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, -,,,,,,, the kind [SEP]"}
+{"type": "sample", "index": 51, "raw_text": "[CLS].. we are a, -,,,,,,,,,,,...,,,,,,,,,,,,,,,,, w.,.,,,,,,,,,,,,,,,,,,,,,,, and,.,, calculates,,,,,,,,,,,,,,,,,,,,.,,,,.... the e - u has a range of,,,,,,,,,,,.,,,,, [SEP]", "detok_text": "[CLS].. we are a, -,,,,,,,,,,,...,,,,,,,,,,,,,,,,, w.,.,,,,,,,,,,,,,,,,,,,,,,, and,.,, calculates,,,,,,,,,,,,,,,,,,,,.,,,,.... the e - u has a range of,,,,,,,,,,,.,,,,, [SEP]"}
+{"type": "sample", "index": 52, "raw_text": "[CLS] - - all in the final game of the season - - were confronted by someone in their car. [SEP] he told the rest of the group to get up to the back of the building, and a a and and out into the road. [SEP] \" they will have have a way, he is going to give us a lesson. \" [SEP] a a a a... [SEP] the number would be $ 1, 000 by the end of the year, and a the, and and and andy of the sames. [SEP] on the point in the area, there are no people in the area, he said. [SEP] the [SEP]", "detok_text": "[CLS] - - all in the final game of the season - - were confronted by someone in their car. [SEP] he told the rest of the group to get up to the back of the building, and a a and and out into the road. [SEP] \"they will have have a way, he is going to give us a lesson.\" [SEP] a a a a... [SEP] the number would be $1, 000 by the end of the year, and a the, and and and andy of the sames. [SEP] on the point in the area, there are no people in the area, he said. [SEP] the [SEP]"}
+{"type": "sample", "index": 53, "raw_text": "[CLS], 37,,,,,, 21, 26, 26, 37,,,.,,,,,,, 2007. [SEP] for the period - 21, 26, 21, 31, 37, 31, chicago - -,, 26,,, 36,,,,,, 51, 48, 37,, 21, 37, 37, 37,, 37, 37,, 16,,, 14 - 16, 23,,, 14 - 16, 37, 48, 37,, 16 - 16, 16 - 14. -, 14,,,, 17, 37, 37, [SEP]", "detok_text": "[CLS], 37,,,,,, 21, 26, 26, 37,,,.,,,,,,, 2007. [SEP] for the period - 21, 26, 21, 31, 37, 31, chicago - -,, 26,,, 36,,,,,, 51, 48, 37,, 21, 37, 37, 37,, 37, 37,, 16,,, 14 - 16, 23,,, 14 - 16, 37, 48, 37,, 16 - 16, 16 - 14. -, 14,,,, 17, 37, 37, [SEP]"}
+{"type": "sample", "index": 54, "raw_text": "[CLS] ' s,,,,........,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and,. [SEP] for that words, the likes of the oregon, chicago, illinois, illinois,,,,, are in the most back - to - back,,,, way. [SEP] the [SEP]", "detok_text": "[CLS]'s,,,,........,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and,. [SEP] for that words, the likes of the oregon, chicago, illinois, illinois,,,,, are in the most back - to - back,,,, way. [SEP] the [SEP]"}
+{"type": "sample", "index": 55, "raw_text": "[CLS] out of the road, and a and and and have - the widening. [SEP] a few thing was out for nothing. [SEP] ( ap ) - china ' s economic would systems have a significant part of the world, in the north, and the rest of the world, according to the report. [SEP] in fact, the number of for for was of wass, [CLS] 14, 24,,, 2006 ). [SEP] the league ' s rookie all - star isn ' t the only one who seems to be on the court. [SEP] the company is expected to be 1, 000 jobs, and,,y said. [SEP] the [SEP]", "detok_text": "[CLS] out of the road, and a and and and have - the widening. [SEP] a few thing was out for nothing. [SEP] (ap) - china's economic would systems have a significant part of the world, in the north, and the rest of the world, according to the report. [SEP] in fact, the number of for for was of wass, [CLS] 14, 24,,, 2006 ). [SEP] the league's rookie all - star isn't the only one who seems to be on the court. [SEP] the company is expected to be 1, 000 jobs, and,,y said. [SEP] the [SEP]"}
+{"type": "sample", "index": 56, "raw_text": "[CLS] in and,, and and and and ). [SEP] dr. michigan, michigan, michigan, michigan, s.,., michigan, michigan, michigan, michigan, ohio, etc. [SEP] but, by the end of the year, the number will be to than 1 %. [SEP] by the time he was be out of the political again. [SEP] i ' m not sure, but, have,,,,,,,,ical allss in the us, canada, texas and texas. [SEP]......,.,. and............ [SEP]", "detok_text": "[CLS] in and,, and and and and ). [SEP] dr. michigan, michigan, michigan, michigan, s.,., michigan, michigan, michigan, michigan, ohio, etc. [SEP] but, by the end of the year, the number will be to than 1 %. [SEP] by the time he was be out of the political again. [SEP] i'm not sure, but, have,,,,,,,,ical allss in the us, canada, texas and texas. [SEP]......,.,. and............ [SEP]"}
+{"type": "sample", "index": 57, "raw_text": "[CLS], period, time to time. week of december 1. period to. days in a number of days, week to days in a, period, period, period, period, period,, period. [SEP] it is period, period, period of the period, period, period. period, period, and period. week, period, period, period, period, period, period, period days, change of days, period, week of the same period, week. week, period, period, period, period,, day, period, period, period,. period,, period, period, in a, period [SEP]", "detok_text": "[CLS], period, time to time. week of december 1. period to. days in a number of days, week to days in a, period, period, period, period, period,, period. [SEP] it is period, period, period of the period, period, period. period, period, and period. week, period, period, period, period, period, period, period days, change of days, period, week of the same period, week. week, period, period, period, period,, day, period, period, period,. period,, period, period, in a, period [SEP]"}
+{"type": "sample", "index": 58, "raw_text": "[CLS] [SEP] the company continues to have a full year, year, year, year, and return to a full schedule. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,.,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, [SEP]", "detok_text": "[CLS] [SEP] the company continues to have a full year, year, year, year, and return to a full schedule. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,.,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, [SEP]"}
+{"type": "sample", "index": 59, "raw_text": "[CLS] addition, the rubber coat, comes with unique decorative flavors, such as the rubber coat and the purple mask. [SEP] he became more worried about any future, he said. [SEP] houston ' s loss to detroit in the final game of a series of road - game series. [SEP] i do want to leave the room for a long conversation. [SEP] once again, he knows how to do his job. [SEP] the answer will be limited to,,,,,,, at least. [SEP] they have the bottom end of the road,,,,,,,,,,,,,,,,,,,,, [SEP]", "detok_text": "[CLS] addition, the rubber coat, comes with unique decorative flavors, such as the rubber coat and the purple mask. [SEP] he became more worried about any future, he said. [SEP] houston's loss to detroit in the final game of a series of road - game series. [SEP] i do want to leave the room for a long conversation. [SEP] once again, he knows how to do his job. [SEP] the answer will be limited to,,,,,,, at least. [SEP] they have the bottom end of the road,,,,,,,,,,,,,,,,,,,,, [SEP]"}
+{"type": "sample", "index": 60, "raw_text": "[CLS],,,,, period -,,,,,,,,,,,, and, end of the period, period,,,,,, period to period, period, and, period, period, period, period - period. the date,,,,,,,,,,, and, has the ability to track,,,, period, period, place, start to the year,,,,,,,,, and number of period. [SEP] in the end, the back - up eliminates the illusion of the in the end of the original structure. [SEP] he would have [SEP]", "detok_text": "[CLS],,,,, period -,,,,,,,,,,,, and, end of the period, period,,,,,, period to period, period, and, period, period, period, period - period. the date,,,,,,,,,,, and, has the ability to track,,,, period, period, place, start to the year,,,,,,,,, and number of period. [SEP] in the end, the back - up eliminates the illusion of the in the end of the original structure. [SEP] he would have [SEP]"}
+{"type": "sample", "index": 61, "raw_text": "[CLS], chicago, chicago, chicago, end of the day, chicago,, chicago, chicago, chicago,,,,,, chicago, chicago,,,,, chicago, chicago,,, 37, 37, 36, week and the correspondingly beautiful days. [SEP] the third day of the day was marked by the remarkable talents of joe cowen. [SEP] for today, the week has moved from days,, days, days, to december,,, and december. [SEP] 21, 2007,, 2007, and the last 14 days of the year., 31,,,,,,, december, 2007. [SEP]", "detok_text": "[CLS], chicago, chicago, chicago, end of the day, chicago,, chicago, chicago, chicago,,,,,, chicago, chicago,,,,, chicago, chicago,,, 37, 37, 36, week and the correspondingly beautiful days. [SEP] the third day of the day was marked by the remarkable talents of joe cowen. [SEP] for today, the week has moved from days,, days, days, to december,,, and december. [SEP] 21, 2007,, 2007, and the last 14 days of the year., 31,,,,,,, december, 2007. [SEP]"}
+{"type": "sample", "index": 62, "raw_text": "[CLS], will have been advised to take pre - trip flights due to non - cancellations. [SEP] multi - region, mid -,, day of north -, eastern, east - atlantic, east - atlantic, south -,,, mid -,, mid - atlantic, chicago, chicago, chicago, and chicago,,, western, chicago, and chicago, chicago, chicago, chicago, and,, chicago,,,,,, and chicago, north - to - north, u. s. 78, eastern, eastern, eastern,, and eastern, mid - atlantic, chicago,,,,, and. [SEP]", "detok_text": "[CLS], will have been advised to take pre - trip flights due to non - cancellations. [SEP] multi - region, mid -,, day of north -, eastern, east - atlantic, east - atlantic, south -,,, mid -,, mid - atlantic, chicago, chicago, chicago, and chicago,,, western, chicago, and chicago, chicago, chicago, chicago, and,, chicago,,,,,, and chicago, north - to - north, u. s. 78, eastern, eastern, eastern,, and eastern, mid - atlantic, chicago,,,,, and. [SEP]"}
+{"type": "sample", "index": 63, "raw_text": "[CLS] have have have, in the confluence of the celtics and the pistons, and have the best is to the thes in the basket. [SEP] the a -yy, with ofs, and the, and the out of the sand and and, of a single basis. [SEP] the following included, atlanta, atlanta, chicago, chicago, boston, chicago, chicago, chicago, chicago, new york, chicago, etc. [SEP] chicago,, chicago, chicago, chicago, to,ca, 2004 - h2.... [SEP] the idea is is have, have and, with a few, and and and and. [SEP]", "detok_text": "[CLS] have have have, in the confluence of the celtics and the pistons, and have the best is to the thes in the basket. [SEP] the a -yy, with ofs, and the, and the out of the sand and and, of a single basis. [SEP] the following included, atlanta, atlanta, chicago, chicago, boston, chicago, chicago, chicago, chicago, new york, chicago, etc. [SEP] chicago,, chicago, chicago, chicago, to,ca, 2004 - h2.... [SEP] the idea is is have, have and, with a few, and and and and. [SEP]"}

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_16/state_c256_t1p45_detok_raw_samples.txt

@@ -0,0 +1,228 @@
+state_c256_t1p45_detok
+{
+  "type": "summary",
+  "name": "state_c256_t1p45",
+  "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt",
+  "step": 124000,
+  "decode": {
+    "kind": "categorical_fullvocab",
+    "config": "state_c256_t1p45",
+    "steps": 16,
+    "model_t_mode": "post",
+    "support_power": 1.0,
+    "semantic_power": 1.0,
+    "endpoint_temp": 1.45,
+    "concentration_min": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 42.769466206615945,
+    "nll_per_token": 3.7558244416048425,
+    "tokens": 8694
+  },
+  "diversity": {
+    "sample_entropy": 3.1708587735321347,
+    "unique_tokens": 1049,
+    "token_count": 8192,
+    "distinct_1": 0.1280517578125,
+    "distinct_2": 0.41313976377952755,
+    "top_token_mass": 0.22607421875
+  }
+}
+
+===== sample 000 =====
+[CLS] for here, "he said. [SEP]" when we get a feeling of what's right, the numbers are up, down, in the end, down, " he said. [SEP] i thought of the,,,,, end of december, etc. [SEP] for days, we believe we have a half - a sense of the end of the past, but of the, one that have come at the end of the world. [SEP] and here, then, here and then, and oh, the world's coming, here, a bit, it's like - - the idiots,,,,,, [SEP]
+
+===== sample 001 =====
+[CLS] expected to see a number of improvements in the first half of 2009. [SEP] 11, 2001, in the playoffs, the playoffs, in the east. [SEP] a day - to, day - day,, day - to - day in the region, was the june period, 2008. [SEP] never, never, never, but you have to feel that way, as you know always, day, day. [SEP] a bunch of tough, emotional, insightful, self - destructive co - people, and, have been the right part of a relationship together. [SEP] and that is, of course, the place to have power. [SEP] [SEP]
+
+===== sample 002 =====
+[CLS] tomato, red,, tomato, vanilla - potato, and vanilla. - - fresh potatoes. - - peanuts with water, red vanilla,, cinnamon of skin, red leaf and truffle with a lemon. [SEP] " this is the last chance here. [SEP] in chicago, boston, chicago, chicago, chicago, chicago,,,, chicago, and, in the midwest, the north, and the jersey. [SEP] he, he made the basket and carried the ball in the third quarter. [SEP] the government also declared state of emergency that they have paid more than $40 million in illegal fees. [SEP] the crash in virginia [SEP]
+
+===== sample 003 =====
+[CLS] of the..., chicago, chicago, chicago, chicago, chicago, march 16, 2007, and the chicago, chicago, chicago, boston,, chicago, and chicago. [SEP] chicago, 2006. - - boston,..., for new york,,..., london -,... - -,., in the area of days, 2006, on days, 2007. - -, for a late day and date. [SEP] boston, - to - boston, early afternoon, boston, to - back, again - - session, early afternoon, again - - is a good place to [SEP]
+
+===== sample 004 =====
+[CLS] 1996 - 98. [SEP] he kind of gets up to the night, but when no one's listening, he's in the room. [SEP] he said.... kind of universal health care - the - - and like - all of u. s. - -..., and.... [SEP] chicago, new york, chicago, detroit - -,, chicago, chicago, boston, chicago, new york, chicago, chicago,,,,,, etc. [SEP] at chicago, boston, the chicago, chicago, boston - chicago, chicago, chicago, chicago, chicago, chicago, chicago [SEP]
+
+===== sample 005 =====
+[CLS] [SEP] for one thing, mr. lombardi, i know, then,, then,,,,,,,,,, to,, to leave. [SEP] it is alleged that he had performeded the act of making payments to the people they work. [SEP] it started in 2002. [SEP] he starts with a simmering chuckle. [SEP] the win would be the first post - season win for the scarlet,, who rebounded from the playoffs and beat chicago 16 - 7. [SEP] for now, he is about the start of a new world order. [SEP] the knicks (2 - 14) have won three games to the [SEP]
+
+===== sample 006 =====
+[CLS] to be a sign of that.. the beginning to come back in the back to the end of...., and the black christmas period, which is in the form of the black period. [SEP] "is the government going to increase the tempo of the line? [SEP] if the program is moving and fails to pass, the lights will turn and drop, and the focus will turn back to" ohio, " the message and back, lahooda said. [SEP] two - hour events is free, from three - hour to 12 - hour meetings. [SEP] a large - pan add together the bread peppers and bring them to [SEP]
+
+===== sample 007 =====
+[CLS], 50, 50, 50, 50, given the choice of, with the clear "line" on the importance of the point, and, up to 18.... lob - - - - pb.. [SEP] s. david cohen, an aviation expert in soil growth and sustainable waste management in independence, ill., said this is part of studies of aviation safety in the countries. [SEP] on the way that he has it, the colors of the keyboard, the fluorescent line, with the of a pin, the doo - dae - doo. [SEP] a few weeks into the market, the leading price of [SEP]
+
+===== sample 008 =====
+[CLS] to pay her decision. [SEP] chalk,, top,,,,, carrots, place, packet, place, top,, line, line to the top and the end of the cake. [SEP] trying to stay in the playoffs, after chicago, re - host detroit in a stunning 97 - 14 win in miami. [SEP] two women have moved to the house for years, allowing the teams to play the next game. [SEP] we are not,, want to talk, we look at the walk, we say, " at the same time, show you what they means, and tell you, what they means is.. [SEP]
+
+===== sample 009 =====
+[CLS] - - to - date - - - - - - - - - - - - - of - 13, 657/21, 121 - - 07, 07 - - - - zone - 16, bling2. - - 21, hamilton - of - 65, - 14, point - of - - - - - -, 21 -,, - - - - - - - - - -, - 11, 31, - 21, 31, and - - list, 31 - 38. 101. - - - - - -, - -, - - - -, as if it were to -, [SEP]
+
+===== sample 010 =====
+[CLS] to - 08. 1, week - to - week, -, back - to - days period, period and back - to, back - to -, 14 - to, and -, back - to - date.... [SEP] the recession will be be in the end, of the spring, and likely to take place for the rest of the remainder of 2008, " na zeit said. [SEP] however, again, in the next few days, the company's strategy comes to the end - - in a scale - - the time - time of a 14, 15 - 50, 10 - 50,, [SEP]
+
+===== sample 011 =====
+[CLS] of vanilla - whole bread, vanilla, back - bacon, potato flour, bread - potato bread, - bread, the butter, fresh bread, vanilla - potato mix, and - potato, bread bread, a whole - piece, bread and pie - in - side of the meal, to the mix, over - the - ground, bread - cheese bread. [SEP] finally, the knicks seemed to get in the lead, falling to 14 - all at the end of the third. [SEP] he didn't have them. [SEP] the types of teams - - 50, 50, 60, and - - are, would seem to be [SEP]
+
+===== sample 012 =====
+[CLS] they are facing the 20 -,,,,, 14.,,, period,,, 16 -, and 20 -,, it,,,,,,,,,,,,,,,,, and,,, and' n - dub. [SEP] the line to eight operations to include locations in the 10th,, chicago,,, chicago, and chicago, in the chicago, chicago, chicago, boston, the chicago, chicago, and chicago markets. [SEP] many people believe the lack of sleep in the back rooms will make it difficult to walk for a meal and even for a cough. [SEP] [SEP]
+
+===== sample 013 =====
+[CLS] the... [SEP] in accordance with a three - year project, the nonprofit group was able to create a version of the center's family of primates, be able to show up in a tent and grow up own animals, the report said. [SEP] at least the lights will come on the airwaves. [SEP] take a light day, then back to the end of miami, then back to the end of the season - - say, back - to -.. and next to to the end...... [SEP] the beginning of the old process can take the balance, take the time for unity and [SEP]
+
+===== sample 014 =====
+[CLS] to the end........ [SEP] the 20 - foot -, 6 - foot - 11 (swine flu - 16,, 16, 55 - -, 20 -,, 14) in non - - period, of - season or end - points, such as "16," 60, 98, 16, 98, 14,, 73, 15,, 16,, 16, and,, - 14, respectively. [SEP] 16, 14,, 12 - 16, 12 -, and 11 - 14.. [SEP] michigan, indiana, michigan, ohio, michigan, illinois, and, [SEP]
+
+===== sample 015 =====
+[CLS] of - air flights, 49, and 44 in the combination of the denver, chicago,, and - - - the problem is, chicago, 80,, and chicago, to - 49, - air - to - air to - air aircraft, and the aap officials said the plane lost power when it crashed into a rochester, massachusetts, in december. [SEP] he hit once a week, once and again. [SEP] put a large butter in a boil - to - the oven. [SEP] still, ted mccarthy, the potential attorney, was back in the first game to minnesota. [SEP] the three - time al mvp, in a [SEP]
+
+===== sample 016 =====
+[CLS],,,, of the great,,,,,,..,,,,,,,,,,,,,,,...,,,,,,,, of the,,,,,, of the,,,,,,,,,,,,,,,,,,,,,,.. [SEP] the inches we have,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, is true. [SEP] the hat,, - - are slippery,,,, [SEP]
+
+===== sample 017 =====
+[CLS], the chicago in and the detroit in chicago. [SEP] the fifth, the final game of the season of chicago, the white bulls, the celtics and the knicks, is to be played in the chicago suburb against the phoenix, on jan. [SEP] but we can't put it away. [SEP] it is detroit's first win of the division series. [SEP] he was out of words, and not of his line. [SEP] and it didn't work for days, work for days - - wait for days to days - - time to work day for day. [SEP] today, it,, cells, not nothing. [SEP] he [SEP]
+
+===== sample 018 =====
+[CLS]., "........ to,...,,,,,,,,... [SEP] we have 60,,,,,,,,, and still,.. [SEP] we say...,, on,, the boston,,,,,, we talk about,, to,,, same time as, nyt, chicago, chicago, chicago,....,,,...,,,,,,,,,,,,,...,,,,....,, to,,. [SEP]
+
+===== sample 019 =====
+[CLS] £1, 000, 000, for treatment for a depression. [SEP] i don't see in number, however, the number 60,,,, the year 31. in terms of the stock - devaluation, 20, 65, 30,, 26, 37, 37, 49, 37, 37, 73, 37, 892,,, etc. [SEP], 73, 60, 98, 73, 98, 451. 5m 17, 17, 16, 21, 22, 21, 26, 26. [SEP] 577, 562, 1,18. 45 information. [SEP] i know.. [SEP]
+
+===== sample 020 =====
+[CLS] 14 - 14....... [SEP] chicago biner killed stephen jones of boston university in morgantown, ohio, on friday, 26, 2007, at 10: 40 a. m., at his home in flint, ohio, police said. [SEP] but this article is not meant to say,, he's going to change. - - - and, oh, the end of the post - 9 - era fret of "wrong" is, apparently, the "use of a word, he's a real person, he's a real person," in the front line, that he [SEP]
+
+===== sample 021 =====
+[CLS]. [SEP] a, begins,,,,,,,, for,,,,,,,,,,,,,, is done with a non - stick,, - - - made of of the top - end, flour. [SEP] " you are going to have,,,,,,,, the,,, the,,,,,,,,. [SEP] that is,,, -,,,,,,,,,,,,,,,, and to the end. [SEP] the team, back in the end, but they have to return to the top.. [SEP]
+
+===== sample 022 =====
+[CLS].. [SEP] 6 - -, l., a., 28 -,,,,,.. [SEP] in some circumstances, the members of congress would have a chance to work together. [SEP] and there is a combination of,,,,,,,,,,,, the,,,,,,,,,...,, in,,,,,,,,,,,,,,,,,,,,,,,,,,,, in -,,,,,,,,,,,,,,,,,,,,,, [SEP]
+
+===== sample 023 =====
+[CLS] - 18, 52 - 14 ), 55 - 14. in addition, 50 - 73, 16 - 38 - 73 - * (18 - 98 %), in combination of the near - end nature of the solution and the off - the - line -, on - the - soft - end, the solution, solution for our product line. [SEP] in detroit, chicago, detroit in detroit, detroit in chicago, detroit, detroit,., in chicago and has included the detroit, bulls, the pistons and the bulls, the detroit bulls, and - chicago. [SEP] the company owns an additional $17. 2 billion of [SEP]
+
+===== sample 024 =====
+[CLS] to achieve their work goals by making their trips,, - - 13, 14, 13, 12, 12, 14, and days. [SEP] they will finish in august. [SEP] at some point, we would feel like that, "he added. [SEP] there is further information for,, then, 2004,, period,,, and period. [SEP] 14, and he will for a three -, 12 - day, 4, half -, 12 - session. [SEP]" chicago, boston, chicago, chicago, chicago,, chicago, chicago,,, chicago, chicago,, chicago, drogba said. [SEP] [SEP]
+
+===== sample 025 =====
+[CLS] what their career can do. [SEP] but the answer was still in doubt, due to harrazard eating at a train, after days, a couple of days, and trying to find if they wished to remain. [SEP] a little luck with the cinnamon juices of the mushrooms, w. a bit of the sauce. [SEP] they don't know that it is the word,,, the word, the word "not...." [SEP] the jets took their chance to get back to the playoffs in time. [SEP] the jets took the lead in detroit on an afternoon, and the jets took the rest of the third [SEP]
+
+===== sample 026 =====
+[CLS] - - months, 7,, 13 days. [SEP] 14, 2007. [SEP] the earth has a lot of hope. [SEP] he really wants it. [SEP] - - in rpm's 14 - 5, which is located. 2 days of the week in order - - 18, 37 - - 14, 54. - -., 38 16, 37 16, 39 13, 16 - 14, and chicago - - 24 - day - - 14. - - - 13, 13, 14, 13 - 15, 11, 14, 11, and a,, 13, 15, 16,,, 16, 18, [SEP]
+
+===== sample 027 =====
+[CLS] a small moment. [SEP] the 20 - year - man, who has not been named for the incident, was last seen. [SEP] have the courage to try again with the courage and the, and with the time to eat and work... [SEP] it is, to, say, a, a necessity. [SEP] he's just trying to get out of the way of a crisis - - and he tries to find a solution to make it better and better. [SEP] you have to put the knife to small pieces to arrange on the top, put a date in the middle and bring the rest of the flour to pieces. [SEP] [SEP]
+
+===== sample 028 =====
+[CLS] - 16. 55 - -, (17), 21 - 60 - (12) - 60, 16 - 31 - - - - 16 - 17. 16, 18. 16, 37 - - 16 - 31 - 1 - 3, 000. 13 - 23, 73 - - place. 16 - 31 - 36, - - - -., -,, 49, 38 - 37, 49 - 16, 49 - 37 - 37 - 112. [SEP] do you really want to - - 20 - - 19 - 37 - b, bhutto 17 - - -, - - -,. - - - [SEP]
+
+===== sample 029 =====
+[CLS] have children, think it's time for her to tell her story, and get to be the best friend in her family. [SEP] i was hit by a string of changes in chicago,, chicago, chicago, chicago,,,,,,,,,,,,,,,,,,,,,,,,,, and,. [SEP] the pistons have to move back, and down the road for detroit, boston, and detroit. [SEP] he returned to the lineup, leaving with back injuries. [SEP] when all the ballots have been turned, in michigan, chicago, florida, chicago, chicago, and [SEP]
+
+===== sample 030 =====
+[CLS] have to struggle to balance the race with a place in the title. [SEP] in the beginning and top of it, he has asked, "no have ever come to the top of the reality and take all the wheels, back, back and back," he said. [SEP] in the event,,,,, weeks, weeks,,,,, and turns out, day, day, a day, week,,,,,,,,,,,,,,,,,, and on the other side. [SEP] there was a bit of something to sit in the street, not the front rooms. [SEP] [SEP]
+
+===== sample 031 =====
+[CLS]..... in line for the week of december, 50, 000. [SEP] and as you point out, the first line is more than 1, 000 words. [SEP] the 24 - hour, back - to - back runs in the markets - - boston, chicago, boston - to, boston, mid - ohio, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, detroit,, chicago, chicago,,,, chicago, st., chicago, chicago and miami - to,,,,,,,,,....... a.,,.. [SEP]
+
+===== sample 032 =====
+[CLS] kind of business, - - 2007. [SEP] detroit 16, chicago, boston 88, 50 - 73, 50 - 95, the detroit, chicago, chicago, detroit. [SEP] in chicago, chicago - - - -, to have been traveling for at least 36 hours, on a 1, 000 - mile, chicago,, chicago, chicago - area and then on a private plane to cover the same - - 12 - 24 hours a day, 14 - 14,, a train to chicago, one - 12, 11, 14 - 14, and, to complete the one - hour, 12 - 14 -,, 12 - [SEP]
+
+===== sample 033 =====
+[CLS],, 50, 50,,,,,,,,,.. [SEP],,, 51, 89,,, 51, 52, 48,,,,,,,,,. one of these days, 50, 50, 50, 50, 60,, 89, 60,,,, 89,,,,,,, 89, 60, 60, 51, 50, and,...,,, 50,,, 52,,,,,,,,,,,,, etc., indiana, indiana, michigan, ohio, indiana, illinois,,,, [SEP]
+
+===== sample 034 =====
+[CLS] - 13, -, - 8 - 0 - 0... - 11 - losses. [SEP] in addition, the first half of the user's consonants are meant to be "a.," 8,,, 12 - 60, "b," 60, " "10 - 80," 12 - 70, beginning of the 80's, i, a, s, and in some way they are, ", to ",,, ",, ",, "or," " to other name. [SEP] it is now hard to explain how the situation was so similar to their sex. [SEP] [SEP]
+
+===== sample 035 =====
+[CLS] ), 49 - points. [SEP] 3 - 14 - - boston, a. -, - 16 - 00, and a. j. b., 12 -, - 14 - 00 to mid - morning trade. [SEP] a 2 percent decline from the 0. 5 - point - to - point - in - the - year average return of 1. 5 per cent. [SEP] the bulls, 73, 73,, 87, chicago, 24 - of, 41, 73, 50, 73, and 68, to the hawks in., boston, chicago, chicago. [SEP] the men, who, and two, of the [SEP]
+
+===== sample 036 =====
+[CLS], - 73, - 16, 13,, -, - 14, at - 16, at - 16, 73, ticker,,, 52, one of the franchise's best. [SEP] the helicopters, including two british pilots, have made hundreds of short - flight visits. [SEP] 13, detroit, 8 - 14. [SEP] but the savings of health - care are not applicable to many americans. [SEP] mr. zaff, 54, arrived at the end of the afternoon throngs of nearly 1, 000 people. [SEP] what a clever joke. [SEP] well, look for a couple of days, if said, [SEP]
+
+===== sample 037 =====
+[CLS], 37, 37, 37, 37, 49,,,,,,,,,, 49,,,, 49, the term " 48,,, 48, 48, 52,,,,,,,, and etc. [SEP] the first national recession ended in the us in december. [SEP] bridge2. [SEP] 18,,, 21, etc., 16, 23, 21, 37, 31, 50 % in 24 - 37 minutes (18 - 40s, and 21 - 50s, etc. in less than three minutes), 30 -,,,,,, 37, 48, [SEP]
+
+===== sample 038 =====
+[CLS] to shut by the end of 2008. [SEP] ted kennedy, a mother, died of cancer. [SEP] and then, back to your place. [SEP] in the end the game at right flanker brandon moss was the way it was. [SEP] the lead is at 10 - 20. [SEP] the magic number is around 100, and the answer is to reckoning it's only 20. [SEP] for a long time, not days. [SEP] i'm really trying to return to detroit, too.... [SEP] a little - thaned majority has in a couple of shaky runs in boston, and the first in the best - - [SEP]
+
+===== sample 039 =====
+[CLS], days, boston time, d, chemph, canada time and again, detroit, boston, chicago, same place, boston again, chicago, chicago, all days, again, to the spring, again, again, and next time to put him back and see if he just try to move, from time to time... president karzai is the time for him..., again, for the place to move, and he the time to date, time to time... [SEP] time to move to the top, get back to the top, time to finish. [SEP] and itʼs [SEP]
+
+===== sample 040 =====
+[CLS] we are the first country of the world to pay 7, 000.... well, this is the most of the year in all, "the president said. [SEP] later in the week," the statement said. [SEP] he take the road on the road.... take the road, take the road to take the end of the road,, the road, to to the road in the middle, rather than take the road to the road, to get to nowhere, and thus, have to have to move, in order to move on a sort of path. [SEP] in addition, the united administration has been [SEP]
+
+===== sample 041 =====
+[CLS], 18 - 21, 16 - 14... 14 - 21, 17 - 18, 37, 51, 37 - 37, and 7. 30, 14 - 16, 24, 24.., -, 13 - 14, 14 - 15, 23 - 14, and 14, 14, 16 - 14, 14 by the sc. [SEP] 13 - 14,, 37, 16 -,,, 73, 60, 49, 48 - 49, 45 - 37, and 49, 37, and,, 37, 37,, date of the,, 31, 37,,,,,,, the [SEP]
+
+===== sample 042 =====
+[CLS] - or less, or,, day, back, a, two days in the kitchen. [SEP] assistss, detroit 90, chicago, detroit 89, chicago, chicago 89, chicago, chicago 89, chicago, chicago. [SEP] in the last few days, we have a 65, 000 - to - 1, 300 - capacity schedule. [SEP] given the current economic climate, i know it would also be a lot. [SEP] are you over worried? [SEP] but the talks aren't about to change the relationship and provide some change. [SEP] " i can see that it doesn't work for us. [SEP] a statement to the [SEP]
+
+===== sample 043 =====
+[CLS] said. [SEP] the week was the week,, and hour of rest, period of work. [SEP] that means,, time and time - - and time was extended,,,.,, and,'s......, 13, 26,... and the number,,,,,, 38, etc. [SEP] in course, if you a woman is have the opportunity and the opportunity to make the show, she'll be able to do that in a couple of of days. [SEP] that's not to say the term "crisis" will give up to the turmoil in the region [SEP]
+
+===== sample 044 =====
+[CLS] -, say, 14 -, - 08, and that is, waiting for their own assets to be wiped out. [SEP] 50, 98 - 70, 98 - 70, 73 -, 50, 73 -, 30, 37, and 38, to 49, to 1, 31, -,, 37, -,, 18 - 15, 31 - 48, 52 - 30,, 52 - 45 days. [SEP] the plan plans to pay a minimum end - to - end - - in kind of, december to end 2009, at, $41, 000, and then, in order to prevent any of the capital [SEP]
+
+===== sample 045 =====
+[CLS], he said. [SEP] i have been 50 and working three times in the past two years. [SEP] the idea is to bring the passengers and bring the next train to chicago, at one point.. [SEP] however, mr sahn does not understand, that even one of the other people in power has such attention. [SEP] what we is a mix - - mix, vanilla - ice vanilla, sour milk, dark bread, vanilla, warm milk puree, buttery bread, deep vanilla, fresh vanilla, red and vanilla, fresh sour, fresh milk cheese, vanilla, fresh breads, vanilla, sour bread, fresh milk, [SEP]
+
+===== sample 046 =====
+[CLS], 1996, boston, 1996,,, 2004, " a period that has lasted for a year in the first half of the season, not a full year. [SEP] 13, chicago, 11, 10, chicago, -,, 7, 732, 400, 6, 900, 000 - - all built from the top of the pile. [SEP] he then dressed in a black tie, took a chicago - style flight, and then a flight to chicago, chicago, chicago to chicago, chicago, boston, chicago, chicago, chicago to boston,, chicago bulls, chicago, chicago, chicago etc. [SEP] the company, [SEP]
+
+===== sample 047 =====
+[CLS] cars, and children, on the road. [SEP] in fact, mr brown's school has never back on its own. [SEP] place the tomato place in the middle place, the place on the ground, the top - in place, two in the top, the top, place, place and one in the bottom, in place with the flour back on the ground. [SEP] the talk is based on the basis that his point was, line, line, line in,, line in the line,,,,, for one.,, and it's line - a - back,,, and,,,, [SEP]
+
+===== sample 048 =====
+[CLS] a day of days, but a day the week, not, the week,........ [SEP] at a cost of a thousand or 50 dollars, it is going to be "everything that ends with a lot of money," mancini told the news. [SEP] companies and we need to have a good relationship to customers. businesses, technology and the manufacturers of large power products and high - service products. solutions. [SEP] when he asked to look at the tv guideline, the reporter he was able to find access to thousands of information and learn what other news media would to do: get access to the [SEP]
+
+===== sample 049 =====
+[CLS] costs that will make up for tens of millions of jobs. [SEP] it's not the end of the olympics, here, anyway, in chicago. [SEP] not to have it, anyway. [SEP] the series ended in a tie before the series began in chicago. [SEP] in a minute, prepare, and you, to turn,,,, flip - -, grind, stack, slice, and - - - for the past 2 hours. [SEP] i'll never make a case. [SEP] but with a clear, breakfast, a beer, a soup, two bread, all that stuff,.. [SEP] no regrets. [SEP] he [SEP]
+
+===== sample 050 =====
+[CLS] - - - 5. - -, 37, 48, - - - 13. [SEP] "the time the moment changes everything, there's a bit of continuity, a kind of a break, i think - - - - - - - - - - - - - - - - - - - - - - - - - -," he said. [SEP] in the past couple of seasons, the field of - - - 14, 16,, 16, 16, 24, 16, 24,, 20, 30,, 30, 50, and acs. - - was the first two games of the series [SEP]
+
+===== sample 051 =====
+[CLS] 24. 7. - 24 - 24, 14 days 24 - 24 - 7 days - - 24, 48 - 24 days, february 24, february 24, 24 - 16, 24 - 23. 4 days in pre - 24, days 33, even in the middle of the day, 24 - 24 - 26. days time to day - (telecoms, 481. 13 - 26, 24, 48 -,. - ba. co. uk). 7 days has 3. 4 hours, 73 days but has a few days, and is on the right to week 24 - 24. days on a 13 - [SEP]
+
+===== sample 052 =====
+[CLS] have been doing so in the middle of december. [SEP] 13 of 1996 - 73. [SEP] mr. jordan, who is just weeks, is to end his writing assignment. [SEP] the tomato is a bit in the process of baking, and add a little to make a good pasta feel. [SEP] the period would still run to days, days, days, days and even days. [SEP] the camera is in the chaos, and in the end of the chaos, the lights are white. [SEP] but a lack of activity in the second quarter could mean profits in the run up to the current level of 50p, he said. [SEP] " [SEP]
+
+===== sample 053 =====
+[CLS] time to turn, period to end, period, period,,, and back - time. [SEP] 12 - 14, 14 - 14. [SEP] year 7, 26,, 38,, 37,, 16, 15, 17, 15, 36,,,, 48.,, 48, 48, and 48,,,,,, and, time to date in the same period. [SEP] a great sense of it is that the end of the economic century was over. [SEP] look at that, 16. 5 % (and. 4 %). [SEP] the third man, between the 50 and 90, is the [SEP]
+
+===== sample 054 =====
+[CLS] stands at the moment, 1, 0007. [SEP] and on days 14, 24,,,,, 18, 23, 36,,, 48, 37, 36,,,, 90 days, 36,,,, and, 36,,, 48,, 48, double - skied. [SEP] 14 when he was 46, and in he. [SEP] the nos. 5 - 13 season, game against ohio state. [SEP] to do, the worst thing of all is, to do, they will have to change the mind and in effect... and then he might throw on the door. [SEP] the [SEP]
+
+===== sample 055 =====
+[CLS] - - the road to finish, again, back to line, period, and back to again, back to 52. - - - - - back to back - - - - - - and back, again. -, err, back to finish - - and, eventually, time to stand in place, and, to, time to end up to, back, end, (in, end). [SEP] for example, the new approach, is seem to be a simple, back - to - end, designed to make the turn, end, end, and back - stop. [SEP] the penguins, 14 - 14 [SEP]
+
+===== sample 056 =====
+[CLS]. [SEP] chicago, washington - - 18 - 1 - 5 - 0 - - 0 - 3.... [SEP] it's time to know the meaning of the in the truth. [SEP] that's the end of the day, all of the actors come to the top. [SEP] by eliminating the effect in the midst of an upset with the playoffs, the patriots dropped out of the playoffs and losing with the playoffs, a and - 0 at the end of the best season of the 2004 conference championship. [SEP] provider - 3 is the only ethernet solution, and allows the use of multi - mode solutions. [SEP] however, [SEP]
+
+===== sample 057 =====
+[CLS] that it is going to be the end of the road. [SEP] a. i have a house,,,,,, in a small plane,,, on the airplane, in,, in anything that it is. [SEP],, stand on the spot, and then...,,,,,,,,,,,,,,,,,,,,,, the type of,,,,,,,,,,,,,,,,,,,, etc.,,, 50, 49,, 54, 00mph.,,,,,, 48 [SEP]
+
+===== sample 058 =====
+[CLS] [SEP] the company lost three operations in the end of 2008. [SEP] you need to get back to a simple date.... [SEP] if only, days, days, days, days,,,, days, days,,, period, to put them in 10, 10, 11. [SEP] if you have to speak something for you yet, you will have to call out the year,,, period, the year,,,,,,, period, and until the rest is same, period, period, to the end, the place of time, the time, place, the place, place, the top [SEP]
+
+===== sample 059 =====
+[CLS] uk, the company has has partnerships with other regional organisations, such as the royal and the british transport union. [SEP] he did not know if any other,,,,,,,,,, part of the original, was a series of elaborate tribbles. [SEP] i don't see the room for that to happen. [SEP] he is what i know is not going for a while, but he would be forced to take a conversation with his family, at least. [SEP] he doesn't know what the answer to be, is you to love your friends, but you need to talk together. [SEP] according to the [SEP]
+
+===== sample 060 =====
+[CLS] to increase the length and auto - end of the line to reach capacity for the post - trip 2008 miles. [SEP] the line, which hit the 16 - to - road - in line, formed from the main - - - - - - - line. - - - - - - - in - - - - - b/c the road - to - line -, line - to - line. road - to - place in the line - to - line, base line, top - line in the base line, top - line - in the line in the top, and in the 12 - and - 10 - line [SEP]
+
+===== sample 061 =====
+[CLS], goes to the heavy - metal ballads of the last british musical "days after the lights," for a paperback. [SEP] turn to the freshly - houdini breads, pick on the brilliantly sliced thick flavors of red bread and the crisply crisp potatoes. [SEP] what a place you are, go piece by piece, bring on the soften. [SEP] then,, then, then, now, then they get back together, to get up, sleep and... they are all just together... [SEP] a major part of the project. [SEP] 18, 2008 in the white house in washington, d. [SEP]
+
+===== sample 062 =====
+[CLS]... [SEP] "a lot of time is" due to the shortcoats. [SEP] the yarns are not thick enough in layers of linen - - -, - - -, - and, a - - - - and in short threads. [SEP] that is the case, a..., - double - area, double -, double -,,, -, -,,, in -, -,, -,,, -, -, -,, u. s. 78, b -,, b -,, -,,, -, -, and -, -.. [SEP]
+
+===== sample 063 =====
+[CLS]'s going to get a bit of work together and finish the relationship, then the momentum goes to the back, " he said. [SEP] instead, expect everyone in any given place - - with the service, but, on the train - - to have a spot in everyone's hand. [SEP] his appointment would be a significant blow in the face of the crisis as eu leaders struggled to elect the pro - european minister. [SEP] 22 - weeks (18), 13 days to work 12 - 14 (h2 - 19o), 24 - days..., 16 days twice a week, 14 - 12 weeks of [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_16/state_c256_t1p45_raw_samples.txt

@@ -0,0 +1,228 @@
+state_c256_t1p45
+{
+  "type": "summary",
+  "name": "state_c256_t1p45",
+  "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt",
+  "step": 124000,
+  "decode": {
+    "kind": "categorical_fullvocab",
+    "config": "state_c256_t1p45",
+    "steps": 16,
+    "model_t_mode": "post",
+    "support_power": 1.0,
+    "semantic_power": 1.0,
+    "endpoint_temp": 1.45,
+    "concentration_min": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 42.769466206615945,
+    "nll_per_token": 3.7558244416048425,
+    "tokens": 8694
+  },
+  "diversity": {
+    "sample_entropy": 3.1708587735321347,
+    "unique_tokens": 1049,
+    "token_count": 8192,
+    "distinct_1": 0.1280517578125,
+    "distinct_2": 0.41313976377952755,
+    "top_token_mass": 0.22607421875
+  }
+}
+
+===== sample 000 =====
+[CLS] for here, " he said. [SEP] " when we get a feeling of what ' s right, the numbers are up, down, in the end, down, " he said. [SEP] i thought of the,,,,, end of december, etc. [SEP] for days, we believe we have a half - a sense of the end of the past, but of the, one that have come at the end of the world. [SEP] and here, then, here and then, and oh, the world ' s coming, here, a bit, it ' s like - - the idiots,,,,,, [SEP]
+
+===== sample 001 =====
+[CLS] expected to see a number of improvements in the first half of 2009. [SEP] 11, 2001, in the playoffs, the playoffs, in the east. [SEP] a day - to, day - day,, day - to - day in the region, was the june period, 2008. [SEP] never, never, never, but you have to feel that way, as you know always, day, day. [SEP] a bunch of tough, emotional, insightful, self - destructive co - people, and, have been the right part of a relationship together. [SEP] and that is, of course, the place to have power. [SEP] [SEP]
+
+===== sample 002 =====
+[CLS] tomato, red,, tomato, vanilla - potato, and vanilla. - - fresh potatoes. - - peanuts with water, red vanilla,, cinnamon of skin, red leaf and truffle with a lemon. [SEP] " this is the last chance here. [SEP] in chicago, boston, chicago, chicago, chicago, chicago,,,, chicago, and, in the midwest, the north, and the jersey. [SEP] he, he made the basket and carried the ball in the third quarter. [SEP] the government also declared state of emergency that they have paid more than $ 40 million in illegal fees. [SEP] the crash in virginia [SEP]
+
+===== sample 003 =====
+[CLS] of the..., chicago, chicago, chicago, chicago, chicago, march 16, 2007, and the chicago, chicago, chicago, boston,, chicago, and chicago. [SEP] chicago, 2006. - - boston,..., for new york,,..., london -,... - -,., in the area of days, 2006, on days, 2007. - -, for a late day and date. [SEP] boston, - to - boston, early afternoon, boston, to - back, again - - session, early afternoon, again - - is a good place to [SEP]
+
+===== sample 004 =====
+[CLS] 1996 - 98. [SEP] he kind of gets up to the night, but when no one ' s listening, he ' s in the room. [SEP] he said.... kind of universal health care - the - - and like - all of u. s. - -..., and.... [SEP] chicago, new york, chicago, detroit - -,, chicago, chicago, boston, chicago, new york, chicago, chicago,,,,,, etc. [SEP] at chicago, boston, the chicago, chicago, boston - chicago, chicago, chicago, chicago, chicago, chicago, chicago [SEP]
+
+===== sample 005 =====
+[CLS] [SEP] for one thing, mr. lombardi, i know, then,, then,,,,,,,,,, to,, to leave. [SEP] it is alleged that he had performeded the act of making payments to the people they work. [SEP] it started in 2002. [SEP] he starts with a simmering chuckle. [SEP] the win would be the first post - season win for the scarlet,, who rebounded from the playoffs and beat chicago 16 - 7. [SEP] for now, he is about the start of a new world order. [SEP] the knicks ( 2 - 14 ) have won three games to the [SEP]
+
+===== sample 006 =====
+[CLS] to be a sign of that.. the beginning to come back in the back to the end of...., and the black christmas period, which is in the form of the black period. [SEP] " is the government going to increase the tempo of the line? [SEP] if the program is moving and fails to pass, the lights will turn and drop, and the focus will turn back to " ohio, " the message and back, lahooda said. [SEP] two - hour events is free, from three - hour to 12 - hour meetings. [SEP] a large - pan add together the bread peppers and bring them to [SEP]
+
+===== sample 007 =====
+[CLS], 50, 50, 50, 50, given the choice of, with the clear " line " on the importance of the point, and, up to 18.... lob - - - - pb.. [SEP] s. david cohen, an aviation expert in soil growth and sustainable waste management in independence, ill., said this is part of studies of aviation safety in the countries. [SEP] on the way that he has it, the colors of the keyboard, the fluorescent line, with the of a pin, the doo - dae - doo. [SEP] a few weeks into the market, the leading price of [SEP]
+
+===== sample 008 =====
+[CLS] to pay her decision. [SEP] chalk,, top,,,,, carrots, place, packet, place, top,, line, line to the top and the end of the cake. [SEP] trying to stay in the playoffs, after chicago, re - host detroit in a stunning 97 - 14 win in miami. [SEP] two women have moved to the house for years, allowing the teams to play the next game. [SEP] we are not,, want to talk, we look at the walk, we say, " at the same time, show you what they means, and tell you, what they means is.. [SEP]
+
+===== sample 009 =====
+[CLS] - - to - date - - - - - - - - - - - - - of - 13, 657 / 21, 121 - - 07, 07 - - - - zone - 16, bling2. - - 21, hamilton - of - 65, - 14, point - of - - - - - -, 21 -,, - - - - - - - - - -, - 11, 31, - 21, 31, and - - list, 31 - 38. 101. - - - - - -, - -, - - - -, as if it were to -, [SEP]
+
+===== sample 010 =====
+[CLS] to - 08. 1, week - to - week, -, back - to - days period, period and back - to, back - to -, 14 - to, and -, back - to - date.... [SEP] the recession will be be in the end, of the spring, and likely to take place for the rest of the remainder of 2008, " na zeit said. [SEP] however, again, in the next few days, the company ' s strategy comes to the end - - in a scale - - the time - time of a 14, 15 - 50, 10 - 50,, [SEP]
+
+===== sample 011 =====
+[CLS] of vanilla - whole bread, vanilla, back - bacon, potato flour, bread - potato bread, - bread, the butter, fresh bread, vanilla - potato mix, and - potato, bread bread, a whole - piece, bread and pie - in - side of the meal, to the mix, over - the - ground, bread - cheese bread. [SEP] finally, the knicks seemed to get in the lead, falling to 14 - all at the end of the third. [SEP] he didn ' t have them. [SEP] the types of teams - - 50, 50, 60, and - - are, would seem to be [SEP]
+
+===== sample 012 =====
+[CLS] they are facing the 20 -,,,,, 14.,,, period,,, 16 -, and 20 -,, it,,,,,,,,,,,,,,,,, and,,, and ' n - dub. [SEP] the line to eight operations to include locations in the 10th,, chicago,,, chicago, and chicago, in the chicago, chicago, chicago, boston, the chicago, chicago, and chicago markets. [SEP] many people believe the lack of sleep in the back rooms will make it difficult to walk for a meal and even for a cough. [SEP] [SEP]
+
+===== sample 013 =====
+[CLS] the... [SEP] in accordance with a three - year project, the nonprofit group was able to create a version of the center ' s family of primates, be able to show up in a tent and grow up own animals, the report said. [SEP] at least the lights will come on the airwaves. [SEP] take a light day, then back to the end of miami, then back to the end of the season - - say, back - to -.. and next to to the end...... [SEP] the beginning of the old process can take the balance, take the time for unity and [SEP]
+
+===== sample 014 =====
+[CLS] to the end........ [SEP] the 20 - foot -, 6 - foot - 11 ( swine flu - 16,, 16, 55 - -, 20 -,, 14 ) in non - - period, of - season or end - points, such as " 16, " 60, 98, 16, 98, 14,, 73, 15,, 16,, 16, and,, - 14, respectively. [SEP] 16, 14,, 12 - 16, 12 -, and 11 - 14.. [SEP] michigan, indiana, michigan, ohio, michigan, illinois, and, [SEP]
+
+===== sample 015 =====
+[CLS] of - air flights, 49, and 44 in the combination of the denver, chicago,, and - - - the problem is, chicago, 80,, and chicago, to - 49, - air - to - air to - air aircraft, and the aap officials said the plane lost power when it crashed into a rochester, massachusetts, in december. [SEP] he hit once a week, once and again. [SEP] put a large butter in a boil - to - the oven. [SEP] still, ted mccarthy, the potential attorney, was back in the first game to minnesota. [SEP] the three - time al mvp, in a [SEP]
+
+===== sample 016 =====
+[CLS],,,, of the great,,,,,,..,,,,,,,,,,,,,,,...,,,,,,,, of the,,,,,, of the,,,,,,,,,,,,,,,,,,,,,,.. [SEP] the inches we have,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, is true. [SEP] the hat,, - - are slippery,,,, [SEP]
+
+===== sample 017 =====
+[CLS], the chicago in and the detroit in chicago. [SEP] the fifth, the final game of the season of chicago, the white bulls, the celtics and the knicks, is to be played in the chicago suburb against the phoenix, on jan. [SEP] but we can ' t put it away. [SEP] it is detroit ' s first win of the division series. [SEP] he was out of words, and not of his line. [SEP] and it didn ' t work for days, work for days - - wait for days to days - - time to work day for day. [SEP] today, it,, cells, not nothing. [SEP] he [SEP]
+
+===== sample 018 =====
+[CLS]., "........ to,...,,,,,,,,... [SEP] we have 60,,,,,,,,, and still,.. [SEP] we say...,, on,, the boston,,,,,, we talk about,, to,,, same time as, nyt, chicago, chicago, chicago,....,,,...,,,,,,,,,,,,,...,,,,....,, to,,. [SEP]
+
+===== sample 019 =====
+[CLS] £1, 000, 000, for treatment for a depression. [SEP] i don ' t see in number, however, the number 60,,,, the year 31. in terms of the stock - devaluation, 20, 65, 30,, 26, 37, 37, 49, 37, 37, 73, 37, 892,,, etc. [SEP], 73, 60, 98, 73, 98, 451. 5m 17, 17, 16, 21, 22, 21, 26, 26. [SEP] 577, 562, 1,18. 45 information. [SEP] i know.. [SEP]
+
+===== sample 020 =====
+[CLS] 14 - 14....... [SEP] chicago biner killed stephen jones of boston university in morgantown, ohio, on friday, 26, 2007, at 10 : 40 a. m., at his home in flint, ohio, police said. [SEP] but this article is not meant to say,, he ' s going to change. - - - and, oh, the end of the post - 9 - era fret of " wrong " is, apparently, the " use of a word, he ' s a real person, he ' s a real person, " in the front line, that he [SEP]
+
+===== sample 021 =====
+[CLS]. [SEP] a, begins,,,,,,,, for,,,,,,,,,,,,,, is done with a non - stick,, - - - made of of the top - end, flour. [SEP] " you are going to have,,,,,,,, the,,, the,,,,,,,,. [SEP] that is,,, -,,,,,,,,,,,,,,,, and to the end. [SEP] the team, back in the end, but they have to return to the top.. [SEP]
+
+===== sample 022 =====
+[CLS].. [SEP] 6 - -, l., a., 28 -,,,,,.. [SEP] in some circumstances, the members of congress would have a chance to work together. [SEP] and there is a combination of,,,,,,,,,,,, the,,,,,,,,,...,, in,,,,,,,,,,,,,,,,,,,,,,,,,,,, in -,,,,,,,,,,,,,,,,,,,,,, [SEP]
+
+===== sample 023 =====
+[CLS] - 18, 52 - 14 ), 55 - 14. in addition, 50 - 73, 16 - 38 - 73 - * ( 18 - 98 % ), in combination of the near - end nature of the solution and the off - the - line -, on - the - soft - end, the solution, solution for our product line. [SEP] in detroit, chicago, detroit in detroit, detroit in chicago, detroit, detroit,., in chicago and has included the detroit, bulls, the pistons and the bulls, the detroit bulls, and - chicago. [SEP] the company owns an additional $ 17. 2 billion of [SEP]
+
+===== sample 024 =====
+[CLS] to achieve their work goals by making their trips,, - - 13, 14, 13, 12, 12, 14, and days. [SEP] they will finish in august. [SEP] at some point, we would feel like that, " he added. [SEP] there is further information for,, then, 2004,, period,,, and period. [SEP] 14, and he will for a three -, 12 - day, 4, half -, 12 - session. [SEP] " chicago, boston, chicago, chicago, chicago,, chicago, chicago,,, chicago, chicago,, chicago, drogba said. [SEP] [SEP]
+
+===== sample 025 =====
+[CLS] what their career can do. [SEP] but the answer was still in doubt, due to harrazard eating at a train, after days, a couple of days, and trying to find if they wished to remain. [SEP] a little luck with the cinnamon juices of the mushrooms, w. a bit of the sauce. [SEP] they don ' t know that it is the word,,, the word, the word " not.... " [SEP] the jets took their chance to get back to the playoffs in time. [SEP] the jets took the lead in detroit on an afternoon, and the jets took the rest of the third [SEP]
+
+===== sample 026 =====
+[CLS] - - months, 7,, 13 days. [SEP] 14, 2007. [SEP] the earth has a lot of hope. [SEP] he really wants it. [SEP] - - in rpm ' s 14 - 5, which is located. 2 days of the week in order - - 18, 37 - - 14, 54. - -., 38 16, 37 16, 39 13, 16 - 14, and chicago - - 24 - day - - 14. - - - 13, 13, 14, 13 - 15, 11, 14, 11, and a,, 13, 15, 16,,, 16, 18, [SEP]
+
+===== sample 027 =====
+[CLS] a small moment. [SEP] the 20 - year - man, who has not been named for the incident, was last seen. [SEP] have the courage to try again with the courage and the, and with the time to eat and work... [SEP] it is, to, say, a, a necessity. [SEP] he ' s just trying to get out of the way of a crisis - - and he tries to find a solution to make it better and better. [SEP] you have to put the knife to small pieces to arrange on the top, put a date in the middle and bring the rest of the flour to pieces. [SEP] [SEP]
+
+===== sample 028 =====
+[CLS] - 16. 55 - -, ( 17 ), 21 - 60 - ( 12 ) - 60, 16 - 31 - - - - 16 - 17. 16, 18. 16, 37 - - 16 - 31 - 1 - 3, 000. 13 - 23, 73 - - place. 16 - 31 - 36, - - - -., -,, 49, 38 - 37, 49 - 16, 49 - 37 - 37 - 112. [SEP] do you really want to - - 20 - - 19 - 37 - b, bhutto 17 - - -, - - -,. - - - [SEP]
+
+===== sample 029 =====
+[CLS] have children, think it ' s time for her to tell her story, and get to be the best friend in her family. [SEP] i was hit by a string of changes in chicago,, chicago, chicago, chicago,,,,,,,,,,,,,,,,,,,,,,,,,, and,. [SEP] the pistons have to move back, and down the road for detroit, boston, and detroit. [SEP] he returned to the lineup, leaving with back injuries. [SEP] when all the ballots have been turned, in michigan, chicago, florida, chicago, chicago, and [SEP]
+
+===== sample 030 =====
+[CLS] have to struggle to balance the race with a place in the title. [SEP] in the beginning and top of it, he has asked, " no have ever come to the top of the reality and take all the wheels, back, back and back, " he said. [SEP] in the event,,,,, weeks, weeks,,,,, and turns out, day, day, a day, week,,,,,,,,,,,,,,,,,, and on the other side. [SEP] there was a bit of something to sit in the street, not the front rooms. [SEP] [SEP]
+
+===== sample 031 =====
+[CLS]..... in line for the week of december, 50, 000. [SEP] and as you point out, the first line is more than 1, 000 words. [SEP] the 24 - hour, back - to - back runs in the markets - - boston, chicago, boston - to, boston, mid - ohio, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, detroit,, chicago, chicago,,,, chicago, st., chicago, chicago and miami - to,,,,,,,,,....... a.,,.. [SEP]
+
+===== sample 032 =====
+[CLS] kind of business, - - 2007. [SEP] detroit 16, chicago, boston 88, 50 - 73, 50 - 95, the detroit, chicago, chicago, detroit. [SEP] in chicago, chicago - - - -, to have been traveling for at least 36 hours, on a 1, 000 - mile, chicago,, chicago, chicago - area and then on a private plane to cover the same - - 12 - 24 hours a day, 14 - 14,, a train to chicago, one - 12, 11, 14 - 14, and, to complete the one - hour, 12 - 14 -,, 12 - [SEP]
+
+===== sample 033 =====
+[CLS],, 50, 50,,,,,,,,,.. [SEP],,, 51, 89,,, 51, 52, 48,,,,,,,,,. one of these days, 50, 50, 50, 50, 60,, 89, 60,,,, 89,,,,,,, 89, 60, 60, 51, 50, and,...,,, 50,,, 52,,,,,,,,,,,,, etc., indiana, indiana, michigan, ohio, indiana, illinois,,,, [SEP]
+
+===== sample 034 =====
+[CLS] - 13, -, - 8 - 0 - 0... - 11 - losses. [SEP] in addition, the first half of the user ' s consonants are meant to be " a., " 8,,, 12 - 60, " b, " 60, " " 10 - 80, " 12 - 70, beginning of the 80 ' s, i, a, s, and in some way they are, ", to ",,, ",, ",, " or, " " to other name. [SEP] it is now hard to explain how the situation was so similar to their sex. [SEP] [SEP]
+
+===== sample 035 =====
+[CLS] ), 49 - points. [SEP] 3 - 14 - - boston, a. -, - 16 - 00, and a. j. b., 12 -, - 14 - 00 to mid - morning trade. [SEP] a 2 percent decline from the 0. 5 - point - to - point - in - the - year average return of 1. 5 per cent. [SEP] the bulls, 73, 73,, 87, chicago, 24 - of, 41, 73, 50, 73, and 68, to the hawks in., boston, chicago, chicago. [SEP] the men, who, and two, of the [SEP]
+
+===== sample 036 =====
+[CLS], - 73, - 16, 13,, -, - 14, at - 16, at - 16, 73, ticker,,, 52, one of the franchise ' s best. [SEP] the helicopters, including two british pilots, have made hundreds of short - flight visits. [SEP] 13, detroit, 8 - 14. [SEP] but the savings of health - care are not applicable to many americans. [SEP] mr. zaff, 54, arrived at the end of the afternoon throngs of nearly 1, 000 people. [SEP] what a clever joke. [SEP] well, look for a couple of days, if said, [SEP]
+
+===== sample 037 =====
+[CLS], 37, 37, 37, 37, 49,,,,,,,,,, 49,,,, 49, the term " 48,,, 48, 48, 52,,,,,,,, and etc. [SEP] the first national recession ended in the us in december. [SEP] bridge2. [SEP] 18,,, 21, etc., 16, 23, 21, 37, 31, 50 % in 24 - 37 minutes ( 18 - 40s, and 21 - 50s, etc. in less than three minutes ), 30 -,,,,,, 37, 48, [SEP]
+
+===== sample 038 =====
+[CLS] to shut by the end of 2008. [SEP] ted kennedy, a mother, died of cancer. [SEP] and then, back to your place. [SEP] in the end the game at right flanker brandon moss was the way it was. [SEP] the lead is at 10 - 20. [SEP] the magic number is around 100, and the answer is to reckoning it ' s only 20. [SEP] for a long time, not days. [SEP] i ' m really trying to return to detroit, too.... [SEP] a little - thaned majority has in a couple of shaky runs in boston, and the first in the best - - [SEP]
+
+===== sample 039 =====
+[CLS], days, boston time, d, chemph, canada time and again, detroit, boston, chicago, same place, boston again, chicago, chicago, all days, again, to the spring, again, again, and next time to put him back and see if he just try to move, from time to time... president karzai is the time for him..., again, for the place to move, and he the time to date, time to time... [SEP] time to move to the top, get back to the top, time to finish. [SEP] and itʼs [SEP]
+
+===== sample 040 =====
+[CLS] we are the first country of the world to pay 7, 000.... well, this is the most of the year in all, " the president said. [SEP] later in the week, " the statement said. [SEP] he take the road on the road.... take the road, take the road to take the end of the road,, the road, to to the road in the middle, rather than take the road to the road, to get to nowhere, and thus, have to have to move, in order to move on a sort of path. [SEP] in addition, the united administration has been [SEP]
+
+===== sample 041 =====
+[CLS], 18 - 21, 16 - 14... 14 - 21, 17 - 18, 37, 51, 37 - 37, and 7. 30, 14 - 16, 24, 24.., -, 13 - 14, 14 - 15, 23 - 14, and 14, 14, 16 - 14, 14 by the sc. [SEP] 13 - 14,, 37, 16 -,,, 73, 60, 49, 48 - 49, 45 - 37, and 49, 37, and,, 37, 37,, date of the,, 31, 37,,,,,,, the [SEP]
+
+===== sample 042 =====
+[CLS] - or less, or,, day, back, a, two days in the kitchen. [SEP] assistss, detroit 90, chicago, detroit 89, chicago, chicago 89, chicago, chicago 89, chicago, chicago. [SEP] in the last few days, we have a 65, 000 - to - 1, 300 - capacity schedule. [SEP] given the current economic climate, i know it would also be a lot. [SEP] are you over worried? [SEP] but the talks aren ' t about to change the relationship and provide some change. [SEP] " i can see that it doesn ' t work for us. [SEP] a statement to the [SEP]
+
+===== sample 043 =====
+[CLS] said. [SEP] the week was the week,, and hour of rest, period of work. [SEP] that means,, time and time - - and time was extended,,,.,, and, ' s......, 13, 26,... and the number,,,,,, 38, etc. [SEP] in course, if you a woman is have the opportunity and the opportunity to make the show, she ' ll be able to do that in a couple of of days. [SEP] that ' s not to say the term " crisis " will give up to the turmoil in the region [SEP]
+
+===== sample 044 =====
+[CLS] -, say, 14 -, - 08, and that is, waiting for their own assets to be wiped out. [SEP] 50, 98 - 70, 98 - 70, 73 -, 50, 73 -, 30, 37, and 38, to 49, to 1, 31, -,, 37, -,, 18 - 15, 31 - 48, 52 - 30,, 52 - 45 days. [SEP] the plan plans to pay a minimum end - to - end - - in kind of, december to end 2009, at, $ 41, 000, and then, in order to prevent any of the capital [SEP]
+
+===== sample 045 =====
+[CLS], he said. [SEP] i have been 50 and working three times in the past two years. [SEP] the idea is to bring the passengers and bring the next train to chicago, at one point.. [SEP] however, mr sahn does not understand, that even one of the other people in power has such attention. [SEP] what we is a mix - - mix, vanilla - ice vanilla, sour milk, dark bread, vanilla, warm milk puree, buttery bread, deep vanilla, fresh vanilla, red and vanilla, fresh sour, fresh milk cheese, vanilla, fresh breads, vanilla, sour bread, fresh milk, [SEP]
+
+===== sample 046 =====
+[CLS], 1996, boston, 1996,,, 2004, " a period that has lasted for a year in the first half of the season, not a full year. [SEP] 13, chicago, 11, 10, chicago, -,, 7, 732, 400, 6, 900, 000 - - all built from the top of the pile. [SEP] he then dressed in a black tie, took a chicago - style flight, and then a flight to chicago, chicago, chicago to chicago, chicago, boston, chicago, chicago, chicago to boston,, chicago bulls, chicago, chicago, chicago etc. [SEP] the company, [SEP]
+
+===== sample 047 =====
+[CLS] cars, and children, on the road. [SEP] in fact, mr brown ' s school has never back on its own. [SEP] place the tomato place in the middle place, the place on the ground, the top - in place, two in the top, the top, place, place and one in the bottom, in place with the flour back on the ground. [SEP] the talk is based on the basis that his point was, line, line, line in,, line in the line,,,,, for one.,, and it ' s line - a - back,,, and,,,, [SEP]
+
+===== sample 048 =====
+[CLS] a day of days, but a day the week, not, the week,........ [SEP] at a cost of a thousand or 50 dollars, it is going to be " everything that ends with a lot of money, " mancini told the news. [SEP] companies and we need to have a good relationship to customers. businesses, technology and the manufacturers of large power products and high - service products. solutions. [SEP] when he asked to look at the tv guideline, the reporter he was able to find access to thousands of information and learn what other news media would to do : get access to the [SEP]
+
+===== sample 049 =====
+[CLS] costs that will make up for tens of millions of jobs. [SEP] it ' s not the end of the olympics, here, anyway, in chicago. [SEP] not to have it, anyway. [SEP] the series ended in a tie before the series began in chicago. [SEP] in a minute, prepare, and you, to turn,,,, flip - -, grind, stack, slice, and - - - for the past 2 hours. [SEP] i ' ll never make a case. [SEP] but with a clear, breakfast, a beer, a soup, two bread, all that stuff,.. [SEP] no regrets. [SEP] he [SEP]
+
+===== sample 050 =====
+[CLS] - - - 5. - -, 37, 48, - - - 13. [SEP] " the time the moment changes everything, there ' s a bit of continuity, a kind of a break, i think - - - - - - - - - - - - - - - - - - - - - - - - - -, " he said. [SEP] in the past couple of seasons, the field of - - - 14, 16,, 16, 16, 24, 16, 24,, 20, 30,, 30, 50, and acs. - - was the first two games of the series [SEP]
+
+===== sample 051 =====
+[CLS] 24. 7. - 24 - 24, 14 days 24 - 24 - 7 days - - 24, 48 - 24 days, february 24, february 24, 24 - 16, 24 - 23. 4 days in pre - 24, days 33, even in the middle of the day, 24 - 24 - 26. days time to day - ( telecoms, 481. 13 - 26, 24, 48 -,. - ba. co. uk ). 7 days has 3. 4 hours, 73 days but has a few days, and is on the right to week 24 - 24. days on a 13 - [SEP]
+
+===== sample 052 =====
+[CLS] have been doing so in the middle of december. [SEP] 13 of 1996 - 73. [SEP] mr. jordan, who is just weeks, is to end his writing assignment. [SEP] the tomato is a bit in the process of baking, and add a little to make a good pasta feel. [SEP] the period would still run to days, days, days, days and even days. [SEP] the camera is in the chaos, and in the end of the chaos, the lights are white. [SEP] but a lack of activity in the second quarter could mean profits in the run up to the current level of 50p, he said. [SEP] " [SEP]
+
+===== sample 053 =====
+[CLS] time to turn, period to end, period, period,,, and back - time. [SEP] 12 - 14, 14 - 14. [SEP] year 7, 26,, 38,, 37,, 16, 15, 17, 15, 36,,,, 48.,, 48, 48, and 48,,,,,, and, time to date in the same period. [SEP] a great sense of it is that the end of the economic century was over. [SEP] look at that, 16. 5 % ( and. 4 % ). [SEP] the third man, between the 50 and 90, is the [SEP]
+
+===== sample 054 =====
+[CLS] stands at the moment, 1, 0007. [SEP] and on days 14, 24,,,,, 18, 23, 36,,, 48, 37, 36,,,, 90 days, 36,,,, and, 36,,, 48,, 48, double - skied. [SEP] 14 when he was 46, and in he. [SEP] the nos. 5 - 13 season, game against ohio state. [SEP] to do, the worst thing of all is, to do, they will have to change the mind and in effect... and then he might throw on the door. [SEP] the [SEP]
+
+===== sample 055 =====
+[CLS] - - the road to finish, again, back to line, period, and back to again, back to 52. - - - - - back to back - - - - - - and back, again. -, err, back to finish - - and, eventually, time to stand in place, and, to, time to end up to, back, end, ( in, end ). [SEP] for example, the new approach, is seem to be a simple, back - to - end, designed to make the turn, end, end, and back - stop. [SEP] the penguins, 14 - 14 [SEP]
+
+===== sample 056 =====
+[CLS]. [SEP] chicago, washington - - 18 - 1 - 5 - 0 - - 0 - 3.... [SEP] it ' s time to know the meaning of the in the truth. [SEP] that ' s the end of the day, all of the actors come to the top. [SEP] by eliminating the effect in the midst of an upset with the playoffs, the patriots dropped out of the playoffs and losing with the playoffs, a and - 0 at the end of the best season of the 2004 conference championship. [SEP] provider - 3 is the only ethernet solution, and allows the use of multi - mode solutions. [SEP] however, [SEP]
+
+===== sample 057 =====
+[CLS] that it is going to be the end of the road. [SEP] a. i have a house,,,,,, in a small plane,,, on the airplane, in,, in anything that it is. [SEP],, stand on the spot, and then...,,,,,,,,,,,,,,,,,,,,,, the type of,,,,,,,,,,,,,,,,,,,, etc.,,, 50, 49,, 54, 00mph.,,,,,, 48 [SEP]
+
+===== sample 058 =====
+[CLS] [SEP] the company lost three operations in the end of 2008. [SEP] you need to get back to a simple date.... [SEP] if only, days, days, days, days,,,, days, days,,, period, to put them in 10, 10, 11. [SEP] if you have to speak something for you yet, you will have to call out the year,,, period, the year,,,,,,, period, and until the rest is same, period, period, to the end, the place of time, the time, place, the place, place, the top [SEP]
+
+===== sample 059 =====
+[CLS] uk, the company has has partnerships with other regional organisations, such as the royal and the british transport union. [SEP] he did not know if any other,,,,,,,,,, part of the original, was a series of elaborate tribbles. [SEP] i don ' t see the room for that to happen. [SEP] he is what i know is not going for a while, but he would be forced to take a conversation with his family, at least. [SEP] he doesn ' t know what the answer to be, is you to love your friends, but you need to talk together. [SEP] according to the [SEP]
+
+===== sample 060 =====
+[CLS] to increase the length and auto - end of the line to reach capacity for the post - trip 2008 miles. [SEP] the line, which hit the 16 - to - road - in line, formed from the main - - - - - - - line. - - - - - - - in - - - - - b / c the road - to - line -, line - to - line. road - to - place in the line - to - line, base line, top - line in the base line, top - line - in the line in the top, and in the 12 - and - 10 - line [SEP]
+
+===== sample 061 =====
+[CLS], goes to the heavy - metal ballads of the last british musical " days after the lights, " for a paperback. [SEP] turn to the freshly - houdini breads, pick on the brilliantly sliced thick flavors of red bread and the crisply crisp potatoes. [SEP] what a place you are, go piece by piece, bring on the soften. [SEP] then,, then, then, now, then they get back together, to get up, sleep and... they are all just together... [SEP] a major part of the project. [SEP] 18, 2008 in the white house in washington, d. [SEP]
+
+===== sample 062 =====
+[CLS]... [SEP] " a lot of time is " due to the shortcoats. [SEP] the yarns are not thick enough in layers of linen - - -, - - -, - and, a - - - - and in short threads. [SEP] that is the case, a..., - double - area, double -, double -,,, -, -,,, in -, -,, -,,, -, -, -,, u. s. 78, b -,, b -,, -,,, -, -, and -, -.. [SEP]
+
+===== sample 063 =====
+[CLS] ' s going to get a bit of work together and finish the relationship, then the momentum goes to the back, " he said. [SEP] instead, expect everyone in any given place - - with the service, but, on the train - - to have a spot in everyone ' s hand. [SEP] his appointment would be a significant blow in the face of the crisis as eu leaders struggled to elect the pro - european minister. [SEP] 22 - weeks ( 18 ), 13 days to work 12 - 14 ( h2 - 19o ), 24 - days..., 16 days twice a week, 14 - 12 weeks of [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_16/state_c256_t1p45_scored.jsonl

@@ -0,0 +1,65 @@
+{"type": "summary", "name": "state_c256_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c256_t1p45", "steps": 16, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 42.769466206615945, "nll_per_token": 3.7558244416048425, "tokens": 8694}, "diversity": {"sample_entropy": 3.1708587735321347, "unique_tokens": 1049, "token_count": 8192, "distinct_1": 0.1280517578125, "distinct_2": 0.41313976377952755, "top_token_mass": 0.22607421875}}
+{"type": "sample", "index": 0, "raw_text": "[CLS] for here, \" he said. [SEP] \" when we get a feeling of what ' s right, the numbers are up, down, in the end, down, \" he said. [SEP] i thought of the,,,,, end of december, etc. [SEP] for days, we believe we have a half - a sense of the end of the past, but of the, one that have come at the end of the world. [SEP] and here, then, here and then, and oh, the world ' s coming, here, a bit, it ' s like - - the idiots,,,,,, [SEP]", "detok_text": "[CLS] for here, \"he said. [SEP]\" when we get a feeling of what's right, the numbers are up, down, in the end, down, \" he said. [SEP] i thought of the,,,,, end of december, etc. [SEP] for days, we believe we have a half - a sense of the end of the past, but of the, one that have come at the end of the world. [SEP] and here, then, here and then, and oh, the world's coming, here, a bit, it's like - - the idiots,,,,,, [SEP]"}
+{"type": "sample", "index": 1, "raw_text": "[CLS] expected to see a number of improvements in the first half of 2009. [SEP] 11, 2001, in the playoffs, the playoffs, in the east. [SEP] a day - to, day - day,, day - to - day in the region, was the june period, 2008. [SEP] never, never, never, but you have to feel that way, as you know always, day, day. [SEP] a bunch of tough, emotional, insightful, self - destructive co - people, and, have been the right part of a relationship together. [SEP] and that is, of course, the place to have power. [SEP] [SEP]", "detok_text": "[CLS] expected to see a number of improvements in the first half of 2009. [SEP] 11, 2001, in the playoffs, the playoffs, in the east. [SEP] a day - to, day - day,, day - to - day in the region, was the june period, 2008. [SEP] never, never, never, but you have to feel that way, as you know always, day, day. [SEP] a bunch of tough, emotional, insightful, self - destructive co - people, and, have been the right part of a relationship together. [SEP] and that is, of course, the place to have power. [SEP] [SEP]"}
+{"type": "sample", "index": 2, "raw_text": "[CLS] tomato, red,, tomato, vanilla - potato, and vanilla. - - fresh potatoes. - - peanuts with water, red vanilla,, cinnamon of skin, red leaf and truffle with a lemon. [SEP] \" this is the last chance here. [SEP] in chicago, boston, chicago, chicago, chicago, chicago,,,, chicago, and, in the midwest, the north, and the jersey. [SEP] he, he made the basket and carried the ball in the third quarter. [SEP] the government also declared state of emergency that they have paid more than $ 40 million in illegal fees. [SEP] the crash in virginia [SEP]", "detok_text": "[CLS] tomato, red,, tomato, vanilla - potato, and vanilla. - - fresh potatoes. - - peanuts with water, red vanilla,, cinnamon of skin, red leaf and truffle with a lemon. [SEP] \" this is the last chance here. [SEP] in chicago, boston, chicago, chicago, chicago, chicago,,,, chicago, and, in the midwest, the north, and the jersey. [SEP] he, he made the basket and carried the ball in the third quarter. [SEP] the government also declared state of emergency that they have paid more than $40 million in illegal fees. [SEP] the crash in virginia [SEP]"}
+{"type": "sample", "index": 3, "raw_text": "[CLS] of the..., chicago, chicago, chicago, chicago, chicago, march 16, 2007, and the chicago, chicago, chicago, boston,, chicago, and chicago. [SEP] chicago, 2006. - - boston,..., for new york,,..., london -,... - -,., in the area of days, 2006, on days, 2007. - -, for a late day and date. [SEP] boston, - to - boston, early afternoon, boston, to - back, again - - session, early afternoon, again - - is a good place to [SEP]", "detok_text": "[CLS] of the..., chicago, chicago, chicago, chicago, chicago, march 16, 2007, and the chicago, chicago, chicago, boston,, chicago, and chicago. [SEP] chicago, 2006. - - boston,..., for new york,,..., london -,... - -,., in the area of days, 2006, on days, 2007. - -, for a late day and date. [SEP] boston, - to - boston, early afternoon, boston, to - back, again - - session, early afternoon, again - - is a good place to [SEP]"}
+{"type": "sample", "index": 4, "raw_text": "[CLS] 1996 - 98. [SEP] he kind of gets up to the night, but when no one ' s listening, he ' s in the room. [SEP] he said.... kind of universal health care - the - - and like - all of u. s. - -..., and.... [SEP] chicago, new york, chicago, detroit - -,, chicago, chicago, boston, chicago, new york, chicago, chicago,,,,,, etc. [SEP] at chicago, boston, the chicago, chicago, boston - chicago, chicago, chicago, chicago, chicago, chicago, chicago [SEP]", "detok_text": "[CLS] 1996 - 98. [SEP] he kind of gets up to the night, but when no one's listening, he's in the room. [SEP] he said.... kind of universal health care - the - - and like - all of u. s. - -..., and.... [SEP] chicago, new york, chicago, detroit - -,, chicago, chicago, boston, chicago, new york, chicago, chicago,,,,,, etc. [SEP] at chicago, boston, the chicago, chicago, boston - chicago, chicago, chicago, chicago, chicago, chicago, chicago [SEP]"}
+{"type": "sample", "index": 5, "raw_text": "[CLS] [SEP] for one thing, mr. lombardi, i know, then,, then,,,,,,,,,, to,, to leave. [SEP] it is alleged that he had performeded the act of making payments to the people they work. [SEP] it started in 2002. [SEP] he starts with a simmering chuckle. [SEP] the win would be the first post - season win for the scarlet,, who rebounded from the playoffs and beat chicago 16 - 7. [SEP] for now, he is about the start of a new world order. [SEP] the knicks ( 2 - 14 ) have won three games to the [SEP]", "detok_text": "[CLS] [SEP] for one thing, mr. lombardi, i know, then,, then,,,,,,,,,, to,, to leave. [SEP] it is alleged that he had performeded the act of making payments to the people they work. [SEP] it started in 2002. [SEP] he starts with a simmering chuckle. [SEP] the win would be the first post - season win for the scarlet,, who rebounded from the playoffs and beat chicago 16 - 7. [SEP] for now, he is about the start of a new world order. [SEP] the knicks (2 - 14) have won three games to the [SEP]"}
+{"type": "sample", "index": 6, "raw_text": "[CLS] to be a sign of that.. the beginning to come back in the back to the end of...., and the black christmas period, which is in the form of the black period. [SEP] \" is the government going to increase the tempo of the line? [SEP] if the program is moving and fails to pass, the lights will turn and drop, and the focus will turn back to \" ohio, \" the message and back, lahooda said. [SEP] two - hour events is free, from three - hour to 12 - hour meetings. [SEP] a large - pan add together the bread peppers and bring them to [SEP]", "detok_text": "[CLS] to be a sign of that.. the beginning to come back in the back to the end of...., and the black christmas period, which is in the form of the black period. [SEP] \"is the government going to increase the tempo of the line? [SEP] if the program is moving and fails to pass, the lights will turn and drop, and the focus will turn back to\" ohio, \" the message and back, lahooda said. [SEP] two - hour events is free, from three - hour to 12 - hour meetings. [SEP] a large - pan add together the bread peppers and bring them to [SEP]"}
+{"type": "sample", "index": 7, "raw_text": "[CLS], 50, 50, 50, 50, given the choice of, with the clear \" line \" on the importance of the point, and, up to 18.... lob - - - - pb.. [SEP] s. david cohen, an aviation expert in soil growth and sustainable waste management in independence, ill., said this is part of studies of aviation safety in the countries. [SEP] on the way that he has it, the colors of the keyboard, the fluorescent line, with the of a pin, the doo - dae - doo. [SEP] a few weeks into the market, the leading price of [SEP]", "detok_text": "[CLS], 50, 50, 50, 50, given the choice of, with the clear \"line\" on the importance of the point, and, up to 18.... lob - - - - pb.. [SEP] s. david cohen, an aviation expert in soil growth and sustainable waste management in independence, ill., said this is part of studies of aviation safety in the countries. [SEP] on the way that he has it, the colors of the keyboard, the fluorescent line, with the of a pin, the doo - dae - doo. [SEP] a few weeks into the market, the leading price of [SEP]"}
+{"type": "sample", "index": 8, "raw_text": "[CLS] to pay her decision. [SEP] chalk,, top,,,,, carrots, place, packet, place, top,, line, line to the top and the end of the cake. [SEP] trying to stay in the playoffs, after chicago, re - host detroit in a stunning 97 - 14 win in miami. [SEP] two women have moved to the house for years, allowing the teams to play the next game. [SEP] we are not,, want to talk, we look at the walk, we say, \" at the same time, show you what they means, and tell you, what they means is.. [SEP]", "detok_text": "[CLS] to pay her decision. [SEP] chalk,, top,,,,, carrots, place, packet, place, top,, line, line to the top and the end of the cake. [SEP] trying to stay in the playoffs, after chicago, re - host detroit in a stunning 97 - 14 win in miami. [SEP] two women have moved to the house for years, allowing the teams to play the next game. [SEP] we are not,, want to talk, we look at the walk, we say, \" at the same time, show you what they means, and tell you, what they means is.. [SEP]"}
+{"type": "sample", "index": 9, "raw_text": "[CLS] - - to - date - - - - - - - - - - - - - of - 13, 657 / 21, 121 - - 07, 07 - - - - zone - 16, bling2. - - 21, hamilton - of - 65, - 14, point - of - - - - - -, 21 -,, - - - - - - - - - -, - 11, 31, - 21, 31, and - - list, 31 - 38. 101. - - - - - -, - -, - - - -, as if it were to -, [SEP]", "detok_text": "[CLS] - - to - date - - - - - - - - - - - - - of - 13, 657/21, 121 - - 07, 07 - - - - zone - 16, bling2. - - 21, hamilton - of - 65, - 14, point - of - - - - - -, 21 -,, - - - - - - - - - -, - 11, 31, - 21, 31, and - - list, 31 - 38. 101. - - - - - -, - -, - - - -, as if it were to -, [SEP]"}
+{"type": "sample", "index": 10, "raw_text": "[CLS] to - 08. 1, week - to - week, -, back - to - days period, period and back - to, back - to -, 14 - to, and -, back - to - date.... [SEP] the recession will be be in the end, of the spring, and likely to take place for the rest of the remainder of 2008, \" na zeit said. [SEP] however, again, in the next few days, the company ' s strategy comes to the end - - in a scale - - the time - time of a 14, 15 - 50, 10 - 50,, [SEP]", "detok_text": "[CLS] to - 08. 1, week - to - week, -, back - to - days period, period and back - to, back - to -, 14 - to, and -, back - to - date.... [SEP] the recession will be be in the end, of the spring, and likely to take place for the rest of the remainder of 2008, \" na zeit said. [SEP] however, again, in the next few days, the company's strategy comes to the end - - in a scale - - the time - time of a 14, 15 - 50, 10 - 50,, [SEP]"}
+{"type": "sample", "index": 11, "raw_text": "[CLS] of vanilla - whole bread, vanilla, back - bacon, potato flour, bread - potato bread, - bread, the butter, fresh bread, vanilla - potato mix, and - potato, bread bread, a whole - piece, bread and pie - in - side of the meal, to the mix, over - the - ground, bread - cheese bread. [SEP] finally, the knicks seemed to get in the lead, falling to 14 - all at the end of the third. [SEP] he didn ' t have them. [SEP] the types of teams - - 50, 50, 60, and - - are, would seem to be [SEP]", "detok_text": "[CLS] of vanilla - whole bread, vanilla, back - bacon, potato flour, bread - potato bread, - bread, the butter, fresh bread, vanilla - potato mix, and - potato, bread bread, a whole - piece, bread and pie - in - side of the meal, to the mix, over - the - ground, bread - cheese bread. [SEP] finally, the knicks seemed to get in the lead, falling to 14 - all at the end of the third. [SEP] he didn't have them. [SEP] the types of teams - - 50, 50, 60, and - - are, would seem to be [SEP]"}
+{"type": "sample", "index": 12, "raw_text": "[CLS] they are facing the 20 -,,,,, 14.,,, period,,, 16 -, and 20 -,, it,,,,,,,,,,,,,,,,, and,,, and ' n - dub. [SEP] the line to eight operations to include locations in the 10th,, chicago,,, chicago, and chicago, in the chicago, chicago, chicago, boston, the chicago, chicago, and chicago markets. [SEP] many people believe the lack of sleep in the back rooms will make it difficult to walk for a meal and even for a cough. [SEP] [SEP]", "detok_text": "[CLS] they are facing the 20 -,,,,, 14.,,, period,,, 16 -, and 20 -,, it,,,,,,,,,,,,,,,,, and,,, and' n - dub. [SEP] the line to eight operations to include locations in the 10th,, chicago,,, chicago, and chicago, in the chicago, chicago, chicago, boston, the chicago, chicago, and chicago markets. [SEP] many people believe the lack of sleep in the back rooms will make it difficult to walk for a meal and even for a cough. [SEP] [SEP]"}
+{"type": "sample", "index": 13, "raw_text": "[CLS] the... [SEP] in accordance with a three - year project, the nonprofit group was able to create a version of the center ' s family of primates, be able to show up in a tent and grow up own animals, the report said. [SEP] at least the lights will come on the airwaves. [SEP] take a light day, then back to the end of miami, then back to the end of the season - - say, back - to -.. and next to to the end...... [SEP] the beginning of the old process can take the balance, take the time for unity and [SEP]", "detok_text": "[CLS] the... [SEP] in accordance with a three - year project, the nonprofit group was able to create a version of the center's family of primates, be able to show up in a tent and grow up own animals, the report said. [SEP] at least the lights will come on the airwaves. [SEP] take a light day, then back to the end of miami, then back to the end of the season - - say, back - to -.. and next to to the end...... [SEP] the beginning of the old process can take the balance, take the time for unity and [SEP]"}
+{"type": "sample", "index": 14, "raw_text": "[CLS] to the end........ [SEP] the 20 - foot -, 6 - foot - 11 ( swine flu - 16,, 16, 55 - -, 20 -,, 14 ) in non - - period, of - season or end - points, such as \" 16, \" 60, 98, 16, 98, 14,, 73, 15,, 16,, 16, and,, - 14, respectively. [SEP] 16, 14,, 12 - 16, 12 -, and 11 - 14.. [SEP] michigan, indiana, michigan, ohio, michigan, illinois, and, [SEP]", "detok_text": "[CLS] to the end........ [SEP] the 20 - foot -, 6 - foot - 11 (swine flu - 16,, 16, 55 - -, 20 -,, 14) in non - - period, of - season or end - points, such as \"16,\" 60, 98, 16, 98, 14,, 73, 15,, 16,, 16, and,, - 14, respectively. [SEP] 16, 14,, 12 - 16, 12 -, and 11 - 14.. [SEP] michigan, indiana, michigan, ohio, michigan, illinois, and, [SEP]"}
+{"type": "sample", "index": 15, "raw_text": "[CLS] of - air flights, 49, and 44 in the combination of the denver, chicago,, and - - - the problem is, chicago, 80,, and chicago, to - 49, - air - to - air to - air aircraft, and the aap officials said the plane lost power when it crashed into a rochester, massachusetts, in december. [SEP] he hit once a week, once and again. [SEP] put a large butter in a boil - to - the oven. [SEP] still, ted mccarthy, the potential attorney, was back in the first game to minnesota. [SEP] the three - time al mvp, in a [SEP]", "detok_text": "[CLS] of - air flights, 49, and 44 in the combination of the denver, chicago,, and - - - the problem is, chicago, 80,, and chicago, to - 49, - air - to - air to - air aircraft, and the aap officials said the plane lost power when it crashed into a rochester, massachusetts, in december. [SEP] he hit once a week, once and again. [SEP] put a large butter in a boil - to - the oven. [SEP] still, ted mccarthy, the potential attorney, was back in the first game to minnesota. [SEP] the three - time al mvp, in a [SEP]"}
+{"type": "sample", "index": 16, "raw_text": "[CLS],,,, of the great,,,,,,..,,,,,,,,,,,,,,,...,,,,,,,, of the,,,,,, of the,,,,,,,,,,,,,,,,,,,,,,.. [SEP] the inches we have,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, is true. [SEP] the hat,, - - are slippery,,,, [SEP]", "detok_text": "[CLS],,,, of the great,,,,,,..,,,,,,,,,,,,,,,...,,,,,,,, of the,,,,,, of the,,,,,,,,,,,,,,,,,,,,,,.. [SEP] the inches we have,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, is true. [SEP] the hat,, - - are slippery,,,, [SEP]"}
+{"type": "sample", "index": 17, "raw_text": "[CLS], the chicago in and the detroit in chicago. [SEP] the fifth, the final game of the season of chicago, the white bulls, the celtics and the knicks, is to be played in the chicago suburb against the phoenix, on jan. [SEP] but we can ' t put it away. [SEP] it is detroit ' s first win of the division series. [SEP] he was out of words, and not of his line. [SEP] and it didn ' t work for days, work for days - - wait for days to days - - time to work day for day. [SEP] today, it,, cells, not nothing. [SEP] he [SEP]", "detok_text": "[CLS], the chicago in and the detroit in chicago. [SEP] the fifth, the final game of the season of chicago, the white bulls, the celtics and the knicks, is to be played in the chicago suburb against the phoenix, on jan. [SEP] but we can't put it away. [SEP] it is detroit's first win of the division series. [SEP] he was out of words, and not of his line. [SEP] and it didn't work for days, work for days - - wait for days to days - - time to work day for day. [SEP] today, it,, cells, not nothing. [SEP] he [SEP]"}
+{"type": "sample", "index": 18, "raw_text": "[CLS]., \"........ to,...,,,,,,,,... [SEP] we have 60,,,,,,,,, and still,.. [SEP] we say...,, on,, the boston,,,,,, we talk about,, to,,, same time as, nyt, chicago, chicago, chicago,....,,,...,,,,,,,,,,,,,...,,,,....,, to,,. [SEP]", "detok_text": "[CLS]., \"........ to,...,,,,,,,,... [SEP] we have 60,,,,,,,,, and still,.. [SEP] we say...,, on,, the boston,,,,,, we talk about,, to,,, same time as, nyt, chicago, chicago, chicago,....,,,...,,,,,,,,,,,,,...,,,,....,, to,,. [SEP]"}
+{"type": "sample", "index": 19, "raw_text": "[CLS] £1, 000, 000, for treatment for a depression. [SEP] i don ' t see in number, however, the number 60,,,, the year 31. in terms of the stock - devaluation, 20, 65, 30,, 26, 37, 37, 49, 37, 37, 73, 37, 892,,, etc. [SEP], 73, 60, 98, 73, 98, 451. 5m 17, 17, 16, 21, 22, 21, 26, 26. [SEP] 577, 562, 1,18. 45 information. [SEP] i know.. [SEP]", "detok_text": "[CLS] £1, 000, 000, for treatment for a depression. [SEP] i don't see in number, however, the number 60,,,, the year 31. in terms of the stock - devaluation, 20, 65, 30,, 26, 37, 37, 49, 37, 37, 73, 37, 892,,, etc. [SEP], 73, 60, 98, 73, 98, 451. 5m 17, 17, 16, 21, 22, 21, 26, 26. [SEP] 577, 562, 1,18. 45 information. [SEP] i know.. [SEP]"}
+{"type": "sample", "index": 20, "raw_text": "[CLS] 14 - 14....... [SEP] chicago biner killed stephen jones of boston university in morgantown, ohio, on friday, 26, 2007, at 10 : 40 a. m., at his home in flint, ohio, police said. [SEP] but this article is not meant to say,, he ' s going to change. - - - and, oh, the end of the post - 9 - era fret of \" wrong \" is, apparently, the \" use of a word, he ' s a real person, he ' s a real person, \" in the front line, that he [SEP]", "detok_text": "[CLS] 14 - 14....... [SEP] chicago biner killed stephen jones of boston university in morgantown, ohio, on friday, 26, 2007, at 10: 40 a. m., at his home in flint, ohio, police said. [SEP] but this article is not meant to say,, he's going to change. - - - and, oh, the end of the post - 9 - era fret of \"wrong\" is, apparently, the \"use of a word, he's a real person, he's a real person,\" in the front line, that he [SEP]"}
+{"type": "sample", "index": 21, "raw_text": "[CLS]. [SEP] a, begins,,,,,,,, for,,,,,,,,,,,,,, is done with a non - stick,, - - - made of of the top - end, flour. [SEP] \" you are going to have,,,,,,,, the,,, the,,,,,,,,. [SEP] that is,,, -,,,,,,,,,,,,,,,, and to the end. [SEP] the team, back in the end, but they have to return to the top.. [SEP]", "detok_text": "[CLS]. [SEP] a, begins,,,,,,,, for,,,,,,,,,,,,,, is done with a non - stick,, - - - made of of the top - end, flour. [SEP] \" you are going to have,,,,,,,, the,,, the,,,,,,,,. [SEP] that is,,, -,,,,,,,,,,,,,,,, and to the end. [SEP] the team, back in the end, but they have to return to the top.. [SEP]"}
+{"type": "sample", "index": 22, "raw_text": "[CLS].. [SEP] 6 - -, l., a., 28 -,,,,,.. [SEP] in some circumstances, the members of congress would have a chance to work together. [SEP] and there is a combination of,,,,,,,,,,,, the,,,,,,,,,...,, in,,,,,,,,,,,,,,,,,,,,,,,,,,,, in -,,,,,,,,,,,,,,,,,,,,,, [SEP]", "detok_text": "[CLS].. [SEP] 6 - -, l., a., 28 -,,,,,.. [SEP] in some circumstances, the members of congress would have a chance to work together. [SEP] and there is a combination of,,,,,,,,,,,, the,,,,,,,,,...,, in,,,,,,,,,,,,,,,,,,,,,,,,,,,, in -,,,,,,,,,,,,,,,,,,,,,, [SEP]"}
+{"type": "sample", "index": 23, "raw_text": "[CLS] - 18, 52 - 14 ), 55 - 14. in addition, 50 - 73, 16 - 38 - 73 - * ( 18 - 98 % ), in combination of the near - end nature of the solution and the off - the - line -, on - the - soft - end, the solution, solution for our product line. [SEP] in detroit, chicago, detroit in detroit, detroit in chicago, detroit, detroit,., in chicago and has included the detroit, bulls, the pistons and the bulls, the detroit bulls, and - chicago. [SEP] the company owns an additional $ 17. 2 billion of [SEP]", "detok_text": "[CLS] - 18, 52 - 14 ), 55 - 14. in addition, 50 - 73, 16 - 38 - 73 - * (18 - 98 %), in combination of the near - end nature of the solution and the off - the - line -, on - the - soft - end, the solution, solution for our product line. [SEP] in detroit, chicago, detroit in detroit, detroit in chicago, detroit, detroit,., in chicago and has included the detroit, bulls, the pistons and the bulls, the detroit bulls, and - chicago. [SEP] the company owns an additional $17. 2 billion of [SEP]"}
+{"type": "sample", "index": 24, "raw_text": "[CLS] to achieve their work goals by making their trips,, - - 13, 14, 13, 12, 12, 14, and days. [SEP] they will finish in august. [SEP] at some point, we would feel like that, \" he added. [SEP] there is further information for,, then, 2004,, period,,, and period. [SEP] 14, and he will for a three -, 12 - day, 4, half -, 12 - session. [SEP] \" chicago, boston, chicago, chicago, chicago,, chicago, chicago,,, chicago, chicago,, chicago, drogba said. [SEP] [SEP]", "detok_text": "[CLS] to achieve their work goals by making their trips,, - - 13, 14, 13, 12, 12, 14, and days. [SEP] they will finish in august. [SEP] at some point, we would feel like that, \"he added. [SEP] there is further information for,, then, 2004,, period,,, and period. [SEP] 14, and he will for a three -, 12 - day, 4, half -, 12 - session. [SEP]\" chicago, boston, chicago, chicago, chicago,, chicago, chicago,,, chicago, chicago,, chicago, drogba said. [SEP] [SEP]"}
+{"type": "sample", "index": 25, "raw_text": "[CLS] what their career can do. [SEP] but the answer was still in doubt, due to harrazard eating at a train, after days, a couple of days, and trying to find if they wished to remain. [SEP] a little luck with the cinnamon juices of the mushrooms, w. a bit of the sauce. [SEP] they don ' t know that it is the word,,, the word, the word \" not.... \" [SEP] the jets took their chance to get back to the playoffs in time. [SEP] the jets took the lead in detroit on an afternoon, and the jets took the rest of the third [SEP]", "detok_text": "[CLS] what their career can do. [SEP] but the answer was still in doubt, due to harrazard eating at a train, after days, a couple of days, and trying to find if they wished to remain. [SEP] a little luck with the cinnamon juices of the mushrooms, w. a bit of the sauce. [SEP] they don't know that it is the word,,, the word, the word \"not....\" [SEP] the jets took their chance to get back to the playoffs in time. [SEP] the jets took the lead in detroit on an afternoon, and the jets took the rest of the third [SEP]"}
+{"type": "sample", "index": 26, "raw_text": "[CLS] - - months, 7,, 13 days. [SEP] 14, 2007. [SEP] the earth has a lot of hope. [SEP] he really wants it. [SEP] - - in rpm ' s 14 - 5, which is located. 2 days of the week in order - - 18, 37 - - 14, 54. - -., 38 16, 37 16, 39 13, 16 - 14, and chicago - - 24 - day - - 14. - - - 13, 13, 14, 13 - 15, 11, 14, 11, and a,, 13, 15, 16,,, 16, 18, [SEP]", "detok_text": "[CLS] - - months, 7,, 13 days. [SEP] 14, 2007. [SEP] the earth has a lot of hope. [SEP] he really wants it. [SEP] - - in rpm's 14 - 5, which is located. 2 days of the week in order - - 18, 37 - - 14, 54. - -., 38 16, 37 16, 39 13, 16 - 14, and chicago - - 24 - day - - 14. - - - 13, 13, 14, 13 - 15, 11, 14, 11, and a,, 13, 15, 16,,, 16, 18, [SEP]"}
+{"type": "sample", "index": 27, "raw_text": "[CLS] a small moment. [SEP] the 20 - year - man, who has not been named for the incident, was last seen. [SEP] have the courage to try again with the courage and the, and with the time to eat and work... [SEP] it is, to, say, a, a necessity. [SEP] he ' s just trying to get out of the way of a crisis - - and he tries to find a solution to make it better and better. [SEP] you have to put the knife to small pieces to arrange on the top, put a date in the middle and bring the rest of the flour to pieces. [SEP] [SEP]", "detok_text": "[CLS] a small moment. [SEP] the 20 - year - man, who has not been named for the incident, was last seen. [SEP] have the courage to try again with the courage and the, and with the time to eat and work... [SEP] it is, to, say, a, a necessity. [SEP] he's just trying to get out of the way of a crisis - - and he tries to find a solution to make it better and better. [SEP] you have to put the knife to small pieces to arrange on the top, put a date in the middle and bring the rest of the flour to pieces. [SEP] [SEP]"}
+{"type": "sample", "index": 28, "raw_text": "[CLS] - 16. 55 - -, ( 17 ), 21 - 60 - ( 12 ) - 60, 16 - 31 - - - - 16 - 17. 16, 18. 16, 37 - - 16 - 31 - 1 - 3, 000. 13 - 23, 73 - - place. 16 - 31 - 36, - - - -., -,, 49, 38 - 37, 49 - 16, 49 - 37 - 37 - 112. [SEP] do you really want to - - 20 - - 19 - 37 - b, bhutto 17 - - -, - - -,. - - - [SEP]", "detok_text": "[CLS] - 16. 55 - -, (17), 21 - 60 - (12) - 60, 16 - 31 - - - - 16 - 17. 16, 18. 16, 37 - - 16 - 31 - 1 - 3, 000. 13 - 23, 73 - - place. 16 - 31 - 36, - - - -., -,, 49, 38 - 37, 49 - 16, 49 - 37 - 37 - 112. [SEP] do you really want to - - 20 - - 19 - 37 - b, bhutto 17 - - -, - - -,. - - - [SEP]"}
+{"type": "sample", "index": 29, "raw_text": "[CLS] have children, think it ' s time for her to tell her story, and get to be the best friend in her family. [SEP] i was hit by a string of changes in chicago,, chicago, chicago, chicago,,,,,,,,,,,,,,,,,,,,,,,,,, and,. [SEP] the pistons have to move back, and down the road for detroit, boston, and detroit. [SEP] he returned to the lineup, leaving with back injuries. [SEP] when all the ballots have been turned, in michigan, chicago, florida, chicago, chicago, and [SEP]", "detok_text": "[CLS] have children, think it's time for her to tell her story, and get to be the best friend in her family. [SEP] i was hit by a string of changes in chicago,, chicago, chicago, chicago,,,,,,,,,,,,,,,,,,,,,,,,,, and,. [SEP] the pistons have to move back, and down the road for detroit, boston, and detroit. [SEP] he returned to the lineup, leaving with back injuries. [SEP] when all the ballots have been turned, in michigan, chicago, florida, chicago, chicago, and [SEP]"}
+{"type": "sample", "index": 30, "raw_text": "[CLS] have to struggle to balance the race with a place in the title. [SEP] in the beginning and top of it, he has asked, \" no have ever come to the top of the reality and take all the wheels, back, back and back, \" he said. [SEP] in the event,,,,, weeks, weeks,,,,, and turns out, day, day, a day, week,,,,,,,,,,,,,,,,,, and on the other side. [SEP] there was a bit of something to sit in the street, not the front rooms. [SEP] [SEP]", "detok_text": "[CLS] have to struggle to balance the race with a place in the title. [SEP] in the beginning and top of it, he has asked, \"no have ever come to the top of the reality and take all the wheels, back, back and back,\" he said. [SEP] in the event,,,,, weeks, weeks,,,,, and turns out, day, day, a day, week,,,,,,,,,,,,,,,,,, and on the other side. [SEP] there was a bit of something to sit in the street, not the front rooms. [SEP] [SEP]"}
+{"type": "sample", "index": 31, "raw_text": "[CLS]..... in line for the week of december, 50, 000. [SEP] and as you point out, the first line is more than 1, 000 words. [SEP] the 24 - hour, back - to - back runs in the markets - - boston, chicago, boston - to, boston, mid - ohio, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, detroit,, chicago, chicago,,,, chicago, st., chicago, chicago and miami - to,,,,,,,,,....... a.,,.. [SEP]", "detok_text": "[CLS]..... in line for the week of december, 50, 000. [SEP] and as you point out, the first line is more than 1, 000 words. [SEP] the 24 - hour, back - to - back runs in the markets - - boston, chicago, boston - to, boston, mid - ohio, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, detroit,, chicago, chicago,,,, chicago, st., chicago, chicago and miami - to,,,,,,,,,....... a.,,.. [SEP]"}
+{"type": "sample", "index": 32, "raw_text": "[CLS] kind of business, - - 2007. [SEP] detroit 16, chicago, boston 88, 50 - 73, 50 - 95, the detroit, chicago, chicago, detroit. [SEP] in chicago, chicago - - - -, to have been traveling for at least 36 hours, on a 1, 000 - mile, chicago,, chicago, chicago - area and then on a private plane to cover the same - - 12 - 24 hours a day, 14 - 14,, a train to chicago, one - 12, 11, 14 - 14, and, to complete the one - hour, 12 - 14 -,, 12 - [SEP]", "detok_text": "[CLS] kind of business, - - 2007. [SEP] detroit 16, chicago, boston 88, 50 - 73, 50 - 95, the detroit, chicago, chicago, detroit. [SEP] in chicago, chicago - - - -, to have been traveling for at least 36 hours, on a 1, 000 - mile, chicago,, chicago, chicago - area and then on a private plane to cover the same - - 12 - 24 hours a day, 14 - 14,, a train to chicago, one - 12, 11, 14 - 14, and, to complete the one - hour, 12 - 14 -,, 12 - [SEP]"}
+{"type": "sample", "index": 33, "raw_text": "[CLS],, 50, 50,,,,,,,,,.. [SEP],,, 51, 89,,, 51, 52, 48,,,,,,,,,. one of these days, 50, 50, 50, 50, 60,, 89, 60,,,, 89,,,,,,, 89, 60, 60, 51, 50, and,...,,, 50,,, 52,,,,,,,,,,,,, etc., indiana, indiana, michigan, ohio, indiana, illinois,,,, [SEP]", "detok_text": "[CLS],, 50, 50,,,,,,,,,.. [SEP],,, 51, 89,,, 51, 52, 48,,,,,,,,,. one of these days, 50, 50, 50, 50, 60,, 89, 60,,,, 89,,,,,,, 89, 60, 60, 51, 50, and,...,,, 50,,, 52,,,,,,,,,,,,, etc., indiana, indiana, michigan, ohio, indiana, illinois,,,, [SEP]"}
+{"type": "sample", "index": 34, "raw_text": "[CLS] - 13, -, - 8 - 0 - 0... - 11 - losses. [SEP] in addition, the first half of the user ' s consonants are meant to be \" a., \" 8,,, 12 - 60, \" b, \" 60, \" \" 10 - 80, \" 12 - 70, beginning of the 80 ' s, i, a, s, and in some way they are, \", to \",,, \",, \",, \" or, \" \" to other name. [SEP] it is now hard to explain how the situation was so similar to their sex. [SEP] [SEP]", "detok_text": "[CLS] - 13, -, - 8 - 0 - 0... - 11 - losses. [SEP] in addition, the first half of the user's consonants are meant to be \"a.,\" 8,,, 12 - 60, \"b,\" 60, \" \"10 - 80,\" 12 - 70, beginning of the 80's, i, a, s, and in some way they are, \", to \",,, \",, \",, \"or,\" \" to other name. [SEP] it is now hard to explain how the situation was so similar to their sex. [SEP] [SEP]"}
+{"type": "sample", "index": 35, "raw_text": "[CLS] ), 49 - points. [SEP] 3 - 14 - - boston, a. -, - 16 - 00, and a. j. b., 12 -, - 14 - 00 to mid - morning trade. [SEP] a 2 percent decline from the 0. 5 - point - to - point - in - the - year average return of 1. 5 per cent. [SEP] the bulls, 73, 73,, 87, chicago, 24 - of, 41, 73, 50, 73, and 68, to the hawks in., boston, chicago, chicago. [SEP] the men, who, and two, of the [SEP]", "detok_text": "[CLS] ), 49 - points. [SEP] 3 - 14 - - boston, a. -, - 16 - 00, and a. j. b., 12 -, - 14 - 00 to mid - morning trade. [SEP] a 2 percent decline from the 0. 5 - point - to - point - in - the - year average return of 1. 5 per cent. [SEP] the bulls, 73, 73,, 87, chicago, 24 - of, 41, 73, 50, 73, and 68, to the hawks in., boston, chicago, chicago. [SEP] the men, who, and two, of the [SEP]"}
+{"type": "sample", "index": 36, "raw_text": "[CLS], - 73, - 16, 13,, -, - 14, at - 16, at - 16, 73, ticker,,, 52, one of the franchise ' s best. [SEP] the helicopters, including two british pilots, have made hundreds of short - flight visits. [SEP] 13, detroit, 8 - 14. [SEP] but the savings of health - care are not applicable to many americans. [SEP] mr. zaff, 54, arrived at the end of the afternoon throngs of nearly 1, 000 people. [SEP] what a clever joke. [SEP] well, look for a couple of days, if said, [SEP]", "detok_text": "[CLS], - 73, - 16, 13,, -, - 14, at - 16, at - 16, 73, ticker,,, 52, one of the franchise's best. [SEP] the helicopters, including two british pilots, have made hundreds of short - flight visits. [SEP] 13, detroit, 8 - 14. [SEP] but the savings of health - care are not applicable to many americans. [SEP] mr. zaff, 54, arrived at the end of the afternoon throngs of nearly 1, 000 people. [SEP] what a clever joke. [SEP] well, look for a couple of days, if said, [SEP]"}
+{"type": "sample", "index": 37, "raw_text": "[CLS], 37, 37, 37, 37, 49,,,,,,,,,, 49,,,, 49, the term \" 48,,, 48, 48, 52,,,,,,,, and etc. [SEP] the first national recession ended in the us in december. [SEP] bridge2. [SEP] 18,,, 21, etc., 16, 23, 21, 37, 31, 50 % in 24 - 37 minutes ( 18 - 40s, and 21 - 50s, etc. in less than three minutes ), 30 -,,,,,, 37, 48, [SEP]", "detok_text": "[CLS], 37, 37, 37, 37, 49,,,,,,,,,, 49,,,, 49, the term \" 48,,, 48, 48, 52,,,,,,,, and etc. [SEP] the first national recession ended in the us in december. [SEP] bridge2. [SEP] 18,,, 21, etc., 16, 23, 21, 37, 31, 50 % in 24 - 37 minutes (18 - 40s, and 21 - 50s, etc. in less than three minutes), 30 -,,,,,, 37, 48, [SEP]"}
+{"type": "sample", "index": 38, "raw_text": "[CLS] to shut by the end of 2008. [SEP] ted kennedy, a mother, died of cancer. [SEP] and then, back to your place. [SEP] in the end the game at right flanker brandon moss was the way it was. [SEP] the lead is at 10 - 20. [SEP] the magic number is around 100, and the answer is to reckoning it ' s only 20. [SEP] for a long time, not days. [SEP] i ' m really trying to return to detroit, too.... [SEP] a little - thaned majority has in a couple of shaky runs in boston, and the first in the best - - [SEP]", "detok_text": "[CLS] to shut by the end of 2008. [SEP] ted kennedy, a mother, died of cancer. [SEP] and then, back to your place. [SEP] in the end the game at right flanker brandon moss was the way it was. [SEP] the lead is at 10 - 20. [SEP] the magic number is around 100, and the answer is to reckoning it's only 20. [SEP] for a long time, not days. [SEP] i'm really trying to return to detroit, too.... [SEP] a little - thaned majority has in a couple of shaky runs in boston, and the first in the best - - [SEP]"}
+{"type": "sample", "index": 39, "raw_text": "[CLS], days, boston time, d, chemph, canada time and again, detroit, boston, chicago, same place, boston again, chicago, chicago, all days, again, to the spring, again, again, and next time to put him back and see if he just try to move, from time to time... president karzai is the time for him..., again, for the place to move, and he the time to date, time to time... [SEP] time to move to the top, get back to the top, time to finish. [SEP] and itʼs [SEP]", "detok_text": "[CLS], days, boston time, d, chemph, canada time and again, detroit, boston, chicago, same place, boston again, chicago, chicago, all days, again, to the spring, again, again, and next time to put him back and see if he just try to move, from time to time... president karzai is the time for him..., again, for the place to move, and he the time to date, time to time... [SEP] time to move to the top, get back to the top, time to finish. [SEP] and itʼs [SEP]"}
+{"type": "sample", "index": 40, "raw_text": "[CLS] we are the first country of the world to pay 7, 000.... well, this is the most of the year in all, \" the president said. [SEP] later in the week, \" the statement said. [SEP] he take the road on the road.... take the road, take the road to take the end of the road,, the road, to to the road in the middle, rather than take the road to the road, to get to nowhere, and thus, have to have to move, in order to move on a sort of path. [SEP] in addition, the united administration has been [SEP]", "detok_text": "[CLS] we are the first country of the world to pay 7, 000.... well, this is the most of the year in all, \"the president said. [SEP] later in the week,\" the statement said. [SEP] he take the road on the road.... take the road, take the road to take the end of the road,, the road, to to the road in the middle, rather than take the road to the road, to get to nowhere, and thus, have to have to move, in order to move on a sort of path. [SEP] in addition, the united administration has been [SEP]"}
+{"type": "sample", "index": 41, "raw_text": "[CLS], 18 - 21, 16 - 14... 14 - 21, 17 - 18, 37, 51, 37 - 37, and 7. 30, 14 - 16, 24, 24.., -, 13 - 14, 14 - 15, 23 - 14, and 14, 14, 16 - 14, 14 by the sc. [SEP] 13 - 14,, 37, 16 -,,, 73, 60, 49, 48 - 49, 45 - 37, and 49, 37, and,, 37, 37,, date of the,, 31, 37,,,,,,, the [SEP]", "detok_text": "[CLS], 18 - 21, 16 - 14... 14 - 21, 17 - 18, 37, 51, 37 - 37, and 7. 30, 14 - 16, 24, 24.., -, 13 - 14, 14 - 15, 23 - 14, and 14, 14, 16 - 14, 14 by the sc. [SEP] 13 - 14,, 37, 16 -,,, 73, 60, 49, 48 - 49, 45 - 37, and 49, 37, and,, 37, 37,, date of the,, 31, 37,,,,,,, the [SEP]"}
+{"type": "sample", "index": 42, "raw_text": "[CLS] - or less, or,, day, back, a, two days in the kitchen. [SEP] assistss, detroit 90, chicago, detroit 89, chicago, chicago 89, chicago, chicago 89, chicago, chicago. [SEP] in the last few days, we have a 65, 000 - to - 1, 300 - capacity schedule. [SEP] given the current economic climate, i know it would also be a lot. [SEP] are you over worried? [SEP] but the talks aren ' t about to change the relationship and provide some change. [SEP] \" i can see that it doesn ' t work for us. [SEP] a statement to the [SEP]", "detok_text": "[CLS] - or less, or,, day, back, a, two days in the kitchen. [SEP] assistss, detroit 90, chicago, detroit 89, chicago, chicago 89, chicago, chicago 89, chicago, chicago. [SEP] in the last few days, we have a 65, 000 - to - 1, 300 - capacity schedule. [SEP] given the current economic climate, i know it would also be a lot. [SEP] are you over worried? [SEP] but the talks aren't about to change the relationship and provide some change. [SEP] \" i can see that it doesn't work for us. [SEP] a statement to the [SEP]"}
+{"type": "sample", "index": 43, "raw_text": "[CLS] said. [SEP] the week was the week,, and hour of rest, period of work. [SEP] that means,, time and time - - and time was extended,,,.,, and, ' s......, 13, 26,... and the number,,,,,, 38, etc. [SEP] in course, if you a woman is have the opportunity and the opportunity to make the show, she ' ll be able to do that in a couple of of days. [SEP] that ' s not to say the term \" crisis \" will give up to the turmoil in the region [SEP]", "detok_text": "[CLS] said. [SEP] the week was the week,, and hour of rest, period of work. [SEP] that means,, time and time - - and time was extended,,,.,, and,'s......, 13, 26,... and the number,,,,,, 38, etc. [SEP] in course, if you a woman is have the opportunity and the opportunity to make the show, she'll be able to do that in a couple of of days. [SEP] that's not to say the term \"crisis\" will give up to the turmoil in the region [SEP]"}
+{"type": "sample", "index": 44, "raw_text": "[CLS] -, say, 14 -, - 08, and that is, waiting for their own assets to be wiped out. [SEP] 50, 98 - 70, 98 - 70, 73 -, 50, 73 -, 30, 37, and 38, to 49, to 1, 31, -,, 37, -,, 18 - 15, 31 - 48, 52 - 30,, 52 - 45 days. [SEP] the plan plans to pay a minimum end - to - end - - in kind of, december to end 2009, at, $ 41, 000, and then, in order to prevent any of the capital [SEP]", "detok_text": "[CLS] -, say, 14 -, - 08, and that is, waiting for their own assets to be wiped out. [SEP] 50, 98 - 70, 98 - 70, 73 -, 50, 73 -, 30, 37, and 38, to 49, to 1, 31, -,, 37, -,, 18 - 15, 31 - 48, 52 - 30,, 52 - 45 days. [SEP] the plan plans to pay a minimum end - to - end - - in kind of, december to end 2009, at, $41, 000, and then, in order to prevent any of the capital [SEP]"}
+{"type": "sample", "index": 45, "raw_text": "[CLS], he said. [SEP] i have been 50 and working three times in the past two years. [SEP] the idea is to bring the passengers and bring the next train to chicago, at one point.. [SEP] however, mr sahn does not understand, that even one of the other people in power has such attention. [SEP] what we is a mix - - mix, vanilla - ice vanilla, sour milk, dark bread, vanilla, warm milk puree, buttery bread, deep vanilla, fresh vanilla, red and vanilla, fresh sour, fresh milk cheese, vanilla, fresh breads, vanilla, sour bread, fresh milk, [SEP]", "detok_text": "[CLS], he said. [SEP] i have been 50 and working three times in the past two years. [SEP] the idea is to bring the passengers and bring the next train to chicago, at one point.. [SEP] however, mr sahn does not understand, that even one of the other people in power has such attention. [SEP] what we is a mix - - mix, vanilla - ice vanilla, sour milk, dark bread, vanilla, warm milk puree, buttery bread, deep vanilla, fresh vanilla, red and vanilla, fresh sour, fresh milk cheese, vanilla, fresh breads, vanilla, sour bread, fresh milk, [SEP]"}
+{"type": "sample", "index": 46, "raw_text": "[CLS], 1996, boston, 1996,,, 2004, \" a period that has lasted for a year in the first half of the season, not a full year. [SEP] 13, chicago, 11, 10, chicago, -,, 7, 732, 400, 6, 900, 000 - - all built from the top of the pile. [SEP] he then dressed in a black tie, took a chicago - style flight, and then a flight to chicago, chicago, chicago to chicago, chicago, boston, chicago, chicago, chicago to boston,, chicago bulls, chicago, chicago, chicago etc. [SEP] the company, [SEP]", "detok_text": "[CLS], 1996, boston, 1996,,, 2004, \" a period that has lasted for a year in the first half of the season, not a full year. [SEP] 13, chicago, 11, 10, chicago, -,, 7, 732, 400, 6, 900, 000 - - all built from the top of the pile. [SEP] he then dressed in a black tie, took a chicago - style flight, and then a flight to chicago, chicago, chicago to chicago, chicago, boston, chicago, chicago, chicago to boston,, chicago bulls, chicago, chicago, chicago etc. [SEP] the company, [SEP]"}
+{"type": "sample", "index": 47, "raw_text": "[CLS] cars, and children, on the road. [SEP] in fact, mr brown ' s school has never back on its own. [SEP] place the tomato place in the middle place, the place on the ground, the top - in place, two in the top, the top, place, place and one in the bottom, in place with the flour back on the ground. [SEP] the talk is based on the basis that his point was, line, line, line in,, line in the line,,,,, for one.,, and it ' s line - a - back,,, and,,,, [SEP]", "detok_text": "[CLS] cars, and children, on the road. [SEP] in fact, mr brown's school has never back on its own. [SEP] place the tomato place in the middle place, the place on the ground, the top - in place, two in the top, the top, place, place and one in the bottom, in place with the flour back on the ground. [SEP] the talk is based on the basis that his point was, line, line, line in,, line in the line,,,,, for one.,, and it's line - a - back,,, and,,,, [SEP]"}
+{"type": "sample", "index": 48, "raw_text": "[CLS] a day of days, but a day the week, not, the week,........ [SEP] at a cost of a thousand or 50 dollars, it is going to be \" everything that ends with a lot of money, \" mancini told the news. [SEP] companies and we need to have a good relationship to customers. businesses, technology and the manufacturers of large power products and high - service products. solutions. [SEP] when he asked to look at the tv guideline, the reporter he was able to find access to thousands of information and learn what other news media would to do : get access to the [SEP]", "detok_text": "[CLS] a day of days, but a day the week, not, the week,........ [SEP] at a cost of a thousand or 50 dollars, it is going to be \"everything that ends with a lot of money,\" mancini told the news. [SEP] companies and we need to have a good relationship to customers. businesses, technology and the manufacturers of large power products and high - service products. solutions. [SEP] when he asked to look at the tv guideline, the reporter he was able to find access to thousands of information and learn what other news media would to do: get access to the [SEP]"}
+{"type": "sample", "index": 49, "raw_text": "[CLS] costs that will make up for tens of millions of jobs. [SEP] it ' s not the end of the olympics, here, anyway, in chicago. [SEP] not to have it, anyway. [SEP] the series ended in a tie before the series began in chicago. [SEP] in a minute, prepare, and you, to turn,,,, flip - -, grind, stack, slice, and - - - for the past 2 hours. [SEP] i ' ll never make a case. [SEP] but with a clear, breakfast, a beer, a soup, two bread, all that stuff,.. [SEP] no regrets. [SEP] he [SEP]", "detok_text": "[CLS] costs that will make up for tens of millions of jobs. [SEP] it's not the end of the olympics, here, anyway, in chicago. [SEP] not to have it, anyway. [SEP] the series ended in a tie before the series began in chicago. [SEP] in a minute, prepare, and you, to turn,,,, flip - -, grind, stack, slice, and - - - for the past 2 hours. [SEP] i'll never make a case. [SEP] but with a clear, breakfast, a beer, a soup, two bread, all that stuff,.. [SEP] no regrets. [SEP] he [SEP]"}
+{"type": "sample", "index": 50, "raw_text": "[CLS] - - - 5. - -, 37, 48, - - - 13. [SEP] \" the time the moment changes everything, there ' s a bit of continuity, a kind of a break, i think - - - - - - - - - - - - - - - - - - - - - - - - - -, \" he said. [SEP] in the past couple of seasons, the field of - - - 14, 16,, 16, 16, 24, 16, 24,, 20, 30,, 30, 50, and acs. - - was the first two games of the series [SEP]", "detok_text": "[CLS] - - - 5. - -, 37, 48, - - - 13. [SEP] \"the time the moment changes everything, there's a bit of continuity, a kind of a break, i think - - - - - - - - - - - - - - - - - - - - - - - - - -,\" he said. [SEP] in the past couple of seasons, the field of - - - 14, 16,, 16, 16, 24, 16, 24,, 20, 30,, 30, 50, and acs. - - was the first two games of the series [SEP]"}
+{"type": "sample", "index": 51, "raw_text": "[CLS] 24. 7. - 24 - 24, 14 days 24 - 24 - 7 days - - 24, 48 - 24 days, february 24, february 24, 24 - 16, 24 - 23. 4 days in pre - 24, days 33, even in the middle of the day, 24 - 24 - 26. days time to day - ( telecoms, 481. 13 - 26, 24, 48 -,. - ba. co. uk ). 7 days has 3. 4 hours, 73 days but has a few days, and is on the right to week 24 - 24. days on a 13 - [SEP]", "detok_text": "[CLS] 24. 7. - 24 - 24, 14 days 24 - 24 - 7 days - - 24, 48 - 24 days, february 24, february 24, 24 - 16, 24 - 23. 4 days in pre - 24, days 33, even in the middle of the day, 24 - 24 - 26. days time to day - (telecoms, 481. 13 - 26, 24, 48 -,. - ba. co. uk). 7 days has 3. 4 hours, 73 days but has a few days, and is on the right to week 24 - 24. days on a 13 - [SEP]"}
+{"type": "sample", "index": 52, "raw_text": "[CLS] have been doing so in the middle of december. [SEP] 13 of 1996 - 73. [SEP] mr. jordan, who is just weeks, is to end his writing assignment. [SEP] the tomato is a bit in the process of baking, and add a little to make a good pasta feel. [SEP] the period would still run to days, days, days, days and even days. [SEP] the camera is in the chaos, and in the end of the chaos, the lights are white. [SEP] but a lack of activity in the second quarter could mean profits in the run up to the current level of 50p, he said. [SEP] \" [SEP]", "detok_text": "[CLS] have been doing so in the middle of december. [SEP] 13 of 1996 - 73. [SEP] mr. jordan, who is just weeks, is to end his writing assignment. [SEP] the tomato is a bit in the process of baking, and add a little to make a good pasta feel. [SEP] the period would still run to days, days, days, days and even days. [SEP] the camera is in the chaos, and in the end of the chaos, the lights are white. [SEP] but a lack of activity in the second quarter could mean profits in the run up to the current level of 50p, he said. [SEP] \" [SEP]"}
+{"type": "sample", "index": 53, "raw_text": "[CLS] time to turn, period to end, period, period,,, and back - time. [SEP] 12 - 14, 14 - 14. [SEP] year 7, 26,, 38,, 37,, 16, 15, 17, 15, 36,,,, 48.,, 48, 48, and 48,,,,,, and, time to date in the same period. [SEP] a great sense of it is that the end of the economic century was over. [SEP] look at that, 16. 5 % ( and. 4 % ). [SEP] the third man, between the 50 and 90, is the [SEP]", "detok_text": "[CLS] time to turn, period to end, period, period,,, and back - time. [SEP] 12 - 14, 14 - 14. [SEP] year 7, 26,, 38,, 37,, 16, 15, 17, 15, 36,,,, 48.,, 48, 48, and 48,,,,,, and, time to date in the same period. [SEP] a great sense of it is that the end of the economic century was over. [SEP] look at that, 16. 5 % (and. 4 %). [SEP] the third man, between the 50 and 90, is the [SEP]"}
+{"type": "sample", "index": 54, "raw_text": "[CLS] stands at the moment, 1, 0007. [SEP] and on days 14, 24,,,,, 18, 23, 36,,, 48, 37, 36,,,, 90 days, 36,,,, and, 36,,, 48,, 48, double - skied. [SEP] 14 when he was 46, and in he. [SEP] the nos. 5 - 13 season, game against ohio state. [SEP] to do, the worst thing of all is, to do, they will have to change the mind and in effect... and then he might throw on the door. [SEP] the [SEP]", "detok_text": "[CLS] stands at the moment, 1, 0007. [SEP] and on days 14, 24,,,,, 18, 23, 36,,, 48, 37, 36,,,, 90 days, 36,,,, and, 36,,, 48,, 48, double - skied. [SEP] 14 when he was 46, and in he. [SEP] the nos. 5 - 13 season, game against ohio state. [SEP] to do, the worst thing of all is, to do, they will have to change the mind and in effect... and then he might throw on the door. [SEP] the [SEP]"}
+{"type": "sample", "index": 55, "raw_text": "[CLS] - - the road to finish, again, back to line, period, and back to again, back to 52. - - - - - back to back - - - - - - and back, again. -, err, back to finish - - and, eventually, time to stand in place, and, to, time to end up to, back, end, ( in, end ). [SEP] for example, the new approach, is seem to be a simple, back - to - end, designed to make the turn, end, end, and back - stop. [SEP] the penguins, 14 - 14 [SEP]", "detok_text": "[CLS] - - the road to finish, again, back to line, period, and back to again, back to 52. - - - - - back to back - - - - - - and back, again. -, err, back to finish - - and, eventually, time to stand in place, and, to, time to end up to, back, end, (in, end). [SEP] for example, the new approach, is seem to be a simple, back - to - end, designed to make the turn, end, end, and back - stop. [SEP] the penguins, 14 - 14 [SEP]"}
+{"type": "sample", "index": 56, "raw_text": "[CLS]. [SEP] chicago, washington - - 18 - 1 - 5 - 0 - - 0 - 3.... [SEP] it ' s time to know the meaning of the in the truth. [SEP] that ' s the end of the day, all of the actors come to the top. [SEP] by eliminating the effect in the midst of an upset with the playoffs, the patriots dropped out of the playoffs and losing with the playoffs, a and - 0 at the end of the best season of the 2004 conference championship. [SEP] provider - 3 is the only ethernet solution, and allows the use of multi - mode solutions. [SEP] however, [SEP]", "detok_text": "[CLS]. [SEP] chicago, washington - - 18 - 1 - 5 - 0 - - 0 - 3.... [SEP] it's time to know the meaning of the in the truth. [SEP] that's the end of the day, all of the actors come to the top. [SEP] by eliminating the effect in the midst of an upset with the playoffs, the patriots dropped out of the playoffs and losing with the playoffs, a and - 0 at the end of the best season of the 2004 conference championship. [SEP] provider - 3 is the only ethernet solution, and allows the use of multi - mode solutions. [SEP] however, [SEP]"}
+{"type": "sample", "index": 57, "raw_text": "[CLS] that it is going to be the end of the road. [SEP] a. i have a house,,,,,, in a small plane,,, on the airplane, in,, in anything that it is. [SEP],, stand on the spot, and then...,,,,,,,,,,,,,,,,,,,,,, the type of,,,,,,,,,,,,,,,,,,,, etc.,,, 50, 49,, 54, 00mph.,,,,,, 48 [SEP]", "detok_text": "[CLS] that it is going to be the end of the road. [SEP] a. i have a house,,,,,, in a small plane,,, on the airplane, in,, in anything that it is. [SEP],, stand on the spot, and then...,,,,,,,,,,,,,,,,,,,,,, the type of,,,,,,,,,,,,,,,,,,,, etc.,,, 50, 49,, 54, 00mph.,,,,,, 48 [SEP]"}
+{"type": "sample", "index": 58, "raw_text": "[CLS] [SEP] the company lost three operations in the end of 2008. [SEP] you need to get back to a simple date.... [SEP] if only, days, days, days, days,,,, days, days,,, period, to put them in 10, 10, 11. [SEP] if you have to speak something for you yet, you will have to call out the year,,, period, the year,,,,,,, period, and until the rest is same, period, period, to the end, the place of time, the time, place, the place, place, the top [SEP]", "detok_text": "[CLS] [SEP] the company lost three operations in the end of 2008. [SEP] you need to get back to a simple date.... [SEP] if only, days, days, days, days,,,, days, days,,, period, to put them in 10, 10, 11. [SEP] if you have to speak something for you yet, you will have to call out the year,,, period, the year,,,,,,, period, and until the rest is same, period, period, to the end, the place of time, the time, place, the place, place, the top [SEP]"}
+{"type": "sample", "index": 59, "raw_text": "[CLS] uk, the company has has partnerships with other regional organisations, such as the royal and the british transport union. [SEP] he did not know if any other,,,,,,,,,, part of the original, was a series of elaborate tribbles. [SEP] i don ' t see the room for that to happen. [SEP] he is what i know is not going for a while, but he would be forced to take a conversation with his family, at least. [SEP] he doesn ' t know what the answer to be, is you to love your friends, but you need to talk together. [SEP] according to the [SEP]", "detok_text": "[CLS] uk, the company has has partnerships with other regional organisations, such as the royal and the british transport union. [SEP] he did not know if any other,,,,,,,,,, part of the original, was a series of elaborate tribbles. [SEP] i don't see the room for that to happen. [SEP] he is what i know is not going for a while, but he would be forced to take a conversation with his family, at least. [SEP] he doesn't know what the answer to be, is you to love your friends, but you need to talk together. [SEP] according to the [SEP]"}
+{"type": "sample", "index": 60, "raw_text": "[CLS] to increase the length and auto - end of the line to reach capacity for the post - trip 2008 miles. [SEP] the line, which hit the 16 - to - road - in line, formed from the main - - - - - - - line. - - - - - - - in - - - - - b / c the road - to - line -, line - to - line. road - to - place in the line - to - line, base line, top - line in the base line, top - line - in the line in the top, and in the 12 - and - 10 - line [SEP]", "detok_text": "[CLS] to increase the length and auto - end of the line to reach capacity for the post - trip 2008 miles. [SEP] the line, which hit the 16 - to - road - in line, formed from the main - - - - - - - line. - - - - - - - in - - - - - b/c the road - to - line -, line - to - line. road - to - place in the line - to - line, base line, top - line in the base line, top - line - in the line in the top, and in the 12 - and - 10 - line [SEP]"}
+{"type": "sample", "index": 61, "raw_text": "[CLS], goes to the heavy - metal ballads of the last british musical \" days after the lights, \" for a paperback. [SEP] turn to the freshly - houdini breads, pick on the brilliantly sliced thick flavors of red bread and the crisply crisp potatoes. [SEP] what a place you are, go piece by piece, bring on the soften. [SEP] then,, then, then, now, then they get back together, to get up, sleep and... they are all just together... [SEP] a major part of the project. [SEP] 18, 2008 in the white house in washington, d. [SEP]", "detok_text": "[CLS], goes to the heavy - metal ballads of the last british musical \"days after the lights,\" for a paperback. [SEP] turn to the freshly - houdini breads, pick on the brilliantly sliced thick flavors of red bread and the crisply crisp potatoes. [SEP] what a place you are, go piece by piece, bring on the soften. [SEP] then,, then, then, now, then they get back together, to get up, sleep and... they are all just together... [SEP] a major part of the project. [SEP] 18, 2008 in the white house in washington, d. [SEP]"}
+{"type": "sample", "index": 62, "raw_text": "[CLS]... [SEP] \" a lot of time is \" due to the shortcoats. [SEP] the yarns are not thick enough in layers of linen - - -, - - -, - and, a - - - - and in short threads. [SEP] that is the case, a..., - double - area, double -, double -,,, -, -,,, in -, -,, -,,, -, -, -,, u. s. 78, b -,, b -,, -,,, -, -, and -, -.. [SEP]", "detok_text": "[CLS]... [SEP] \"a lot of time is\" due to the shortcoats. [SEP] the yarns are not thick enough in layers of linen - - -, - - -, - and, a - - - - and in short threads. [SEP] that is the case, a..., - double - area, double -, double -,,, -, -,,, in -, -,, -,,, -, -, -,, u. s. 78, b -,, b -,, -,,, -, -, and -, -.. [SEP]"}
+{"type": "sample", "index": 63, "raw_text": "[CLS] ' s going to get a bit of work together and finish the relationship, then the momentum goes to the back, \" he said. [SEP] instead, expect everyone in any given place - - with the service, but, on the train - - to have a spot in everyone ' s hand. [SEP] his appointment would be a significant blow in the face of the crisis as eu leaders struggled to elect the pro - european minister. [SEP] 22 - weeks ( 18 ), 13 days to work 12 - 14 ( h2 - 19o ), 24 - days..., 16 days twice a week, 14 - 12 weeks of [SEP]", "detok_text": "[CLS]'s going to get a bit of work together and finish the relationship, then the momentum goes to the back, \" he said. [SEP] instead, expect everyone in any given place - - with the service, but, on the train - - to have a spot in everyone's hand. [SEP] his appointment would be a significant blow in the face of the crisis as eu leaders struggled to elect the pro - european minister. [SEP] 22 - weeks (18), 13 days to work 12 - 14 (h2 - 19o), 24 - days..., 16 days twice a week, 14 - 12 weeks of [SEP]"}

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_16/summary.jsonl

@@ -0,0 +1,2 @@
+{"type": "summary", "name": "state_c256_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c256_t1p45", "steps": 16, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 42.769466206615945, "nll_per_token": 3.7558244416048425, "tokens": 8694}, "diversity": {"sample_entropy": 3.1708587735321347, "unique_tokens": 1049, "token_count": 8192, "distinct_1": 0.1280517578125, "distinct_2": 0.41313976377952755, "top_token_mass": 0.22607421875}}
+{"type": "summary", "name": "state_c1024_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c1024_t1p45", "steps": 16, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 1024.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 24.348744185198743, "nll_per_token": 3.1924802746955083, "tokens": 7297}, "diversity": {"sample_entropy": 2.0679188483539344, "unique_tokens": 615, "token_count": 8192, "distinct_1": 0.0750732421875, "distinct_2": 0.23363681102362205, "top_token_mass": 0.392578125}}

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_16/summary.tsv

@@ -0,0 +1,3 @@
+name	step	detok_genppl	sample_entropy	distinct_2	top_token_mass	model_t_mode	support_power	semantic_power	final_from	endpoint_temp	concentration_max	update
+state_c256_t1p45	124000	42.769466206615945	3.1708587735321347	0.41313976377952755	0.22607421875	post	1.0	1.0	state	1.45	256.0	resample
+state_c1024_t1p45	124000	24.348744185198743	2.0679188483539344	0.23363681102362205	0.392578125	post	1.0	1.0	state	1.45	1024.0	resample

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_32/state_c1024_t1p45_detok_raw_samples.txt

@@ -0,0 +1,228 @@
+state_c1024_t1p45_detok
+{
+  "type": "summary",
+  "name": "state_c1024_t1p45",
+  "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt",
+  "step": 124000,
+  "decode": {
+    "kind": "categorical_fullvocab",
+    "config": "state_c1024_t1p45",
+    "steps": 32,
+    "model_t_mode": "post",
+    "support_power": 1.0,
+    "semantic_power": 1.0,
+    "endpoint_temp": 1.45,
+    "concentration_min": 1.0,
+    "concentration_max": 1024.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 31.13635173493272,
+    "nll_per_token": 3.438376002668099,
+    "tokens": 9165
+  },
+  "diversity": {
+    "sample_entropy": 3.3146319833825286,
+    "unique_tokens": 1102,
+    "token_count": 8192,
+    "distinct_1": 0.134521484375,
+    "distinct_2": 0.4309793307086614,
+    "top_token_mass": 0.2288818359375
+  }
+}
+
+===== sample 000 =====
+[CLS] at the end of a deal. [SEP] science has found that it is true and makes no sense........ to back - to - back, 50, 50 to - 50, 50, 37, 48, 45, 45, and 52. [SEP] "there was no time, on the same day, at the same time, no days, even days, just seven days, i do," he said. [SEP] he did not even let me dwell on the challenges of that... [SEP] we'll vote for obama.... [SEP] the meeting, called for monday afternoon, is to [SEP]
+
+===== sample 001 =====
+[CLS] 25, 40, 50, 50, 50, 60, 60, and the same period, when the hawks' worst record was 14 - 14. [SEP] asheville, n. d., studied at the university of ohio, ohio, illinois university, ohio, texas, illinois, canada, ireland, the university of carolina and canada. [SEP] "i think he has an option," romo said. [SEP] if the person is really prepared to do the job, this is a new beginning. [SEP] the group raised $16. 7 million in obama's first three days of campaign. [SEP] he ended a two - game [SEP]
+
+===== sample 002 =====
+[CLS] - - - flights of 2, 07,, 07, and in for at least five hours - -,,,,,, 45,,, 52. [SEP] at the end of the day, he said, the pilot still managed to retrieve the severed parts of the plane. [SEP] in other cases, the combination of warmth and warmth. [SEP] the political leader has raised his official concern about the war in the time of the election as being "ridiculous." [SEP] now, they would like to have a child with a doctor to get just a bit in the right room. [SEP] he then emerged from the balcony of the building [SEP]
+
+===== sample 003 =====
+[CLS] of the period, period prior to making a decision, a period, period, period,,,,, period, period, period,,,,, day, period, day, period,, period,,,,,,, period, period. [SEP] and so, the period,, period, period, period,,,,,, period,,,,,,,,, period,,, period, period, period,, period, period, period,,,,,,, and period, the day is days, days, period, period, period, period,,,, [SEP]
+
+===== sample 004 =====
+[CLS] century - old building. [SEP] "we have a lot of back - game games but, i remember, we have not had a game since 2003," he said. [SEP] instead, after 1914 and 1868, the convention to collapse in power led to the collapse of british communism. [SEP] "the peak - to -, peak - to - - to - trough period... the days of december 1988, beginning in 1988, to - back - to - back period, and 1988, and december 2007, and,,,,, 1996, 1997,,,,, and, 2003," he said. [SEP] he [SEP]
+
+===== sample 005 =====
+[CLS] december 16, 2008 in chicago. [SEP] kiwis is out for two months, days, weeks,, in the week to week, - -, week, week, week, week,, and week. [SEP] the bears are to face a series in chicago on - 16, dec. [SEP] he is going to be out of town for an interview. [SEP] boston, detroit 11 - 16, 11 - 11,, 11, and 11 - - to complete season - to - season winnings. [SEP] in his first year at the school, he died. [SEP] a group of protesters in the capital opened the door for its [SEP]
+
+===== sample 006 =====
+[CLS] 21. 50. [SEP] obama says, days, days, days, in the morning, in the morning, and time to date these days, week, day, week,,, period. [SEP] the three - break began over a 15 - day period, a week of the end of the day and the rest of the night's day in the afternoon. [SEP] from three days, in the first quarter, to the next, 4, 4, 6, 8, 8, 11, and and, to the end of 2008. [SEP] the atlantis v, a space plane, is scheduled to take off at 7: 15 [SEP]
+
+===== sample 007 =====
+[CLS] said. [SEP] "we could say, it's the time to talk of bankruptcy," said said robert woodley, the president of the national automobile trade association of america, which organizes the union. [SEP] in the u. s., flights begin to 3, 000, 000 feet at the start of the day and increase to more than 30 -, -, -, -, -, -, -, -, 1, 000 - -. [SEP] notes: @ 4 - 4, detroit 0, calgary 0 - 6 - 2 - 2... [SEP] on december 14, 25, 2006, of the 91 [SEP]
+
+===== sample 008 =====
+[CLS] 13 - year - old. [SEP] face - by - face, after all, at the end of her life, she was given time to time, time to time, time to time to time again. [SEP] now, the economy is in - - and in the future. [SEP] the two season series of games in cleveland, which is on june of - 14 in boston, the road series in atlanta and the game of the best - of - five series in san francisco. [SEP] finally, the bill of purchase was passed to the cpcb and the queen's for the period of which amounts to 100 days, respectively. [SEP] [SEP]
+
+===== sample 009 =====
+[CLS],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and, in the first half of the year. [SEP] 13,, 14, 15, 15, 15, 30, and 4, 52... [SEP] of course, the team is completely out of place,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, of the year,,,,,,,,,,,,,, and,. [SEP] he [SEP]
+
+===== sample 010 =====
+[CLS]9. 50 per person, including for a day - to - school stay. [SEP] it is expected to be 65,,,,,,,, 45, 51, 48,, 48, 48, 37, 48, 48. [SEP] the company's firm's list of operations in the trade is expected to include: 50,, 50, 60, 60, 50,, 50, 50,,,, 36,,,,,,,,,,,,,,,,,,, etc. [SEP] if the jets were to show in depth, the teams would be ready to move, [SEP]
+
+===== sample 011 =====
+[CLS] said he was given the opportunity to play in the olympics so far. [SEP] 51, 48 and it's day,,,,, day - - there'll be people to move,,,,,,,,,,,,,,, 48,, 48, 36,, 27,, 48,,,,,,,,,,, 48,,,, 48, the rest. [SEP] from the field,,,,,,, 49, 48, 49, 52, 54, seems to make the most of the woes,,,,,,,,,, [SEP]
+
+===== sample 012 =====
+[CLS] you can see that the author has a bit of scented cake, the scented fruit has an awful scented curse on the table. [SEP] in fact, the results will come soon, not even later. [SEP] the meeting was in fact a year away. [SEP] and then, more than 1, 200 passengers, including passengers, had to return to the airport monday morning to begin the 12 - hour stopover. [SEP] we have to talk come, come, break, we have to talk. [SEP] once they do, they will be able to feel, and when they do not feel back, they will feel more of a shock. [SEP] the [SEP]
+
+===== sample 013 =====
+[CLS] the rest of the 2004 - 7, including the back - to - back trip to the playoffs. [SEP] detroit 7, minnesota 27, 26, chicago,, cleveland,, chicago,, 50 - 48. - for the week, dec. - 60, 50 - 73, 50 - 73, 50 - 50, and beyond. - - 50 - 50, 37, 50, 50, 50, 50, parts of 50 - 49, 50 - 45, 60 - 50, in new york, boston 37, 50, boston 48, 50 - 50, 52, 60 - 60 and 48. - -,,, [SEP]
+
+===== sample 014 =====
+[CLS] we have to do it all together. [SEP] the man,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, to grow - up to his, and, oh, he opened his eyes at the end of the journey, and "no one wants to be sure what he wants to be," he said. [SEP] however, the current period was about a year earlier and is much longer. [SEP] the guy who will, he said, make the tens of thousands of dollars. [SEP] " i think they have to do it again. [SEP] [SEP]
+
+===== sample 015 =====
+[CLS] good friend, not a woman,, sits in the back of the house, but has not been wearing an eye. [SEP] chicago, september 11, 2008, and chicago, dec. [SEP] of course, 50,, 50, 60, by the end of........ 60, 50, 50, and in the end, they want to be. [SEP] with more than a week left after tuesday's quake, trucks and dump piled with hundreds of cars and collapsed on the roofs of government buildings. [SEP] "i was the first person to give me something to play during the day," he said [SEP]
+
+===== sample 016 =====
+[CLS]. [SEP] with the examples above, it would be time to have a good day in 2009. [SEP] the flight crew, miraculously, took the way to the airport and then returned to the prison area for their rescue. [SEP] a few years after being introduced to saba, he is on the field, and he will be a highlight of the day. [SEP] the european transport committee has already provided such help. [SEP] rondo, who has 22, 13 assists and eight assists this season, scored seven straight points. [SEP] 11, not again, but for the first time in 13 days. [SEP] today, december 21, 2007, [SEP]
+
+===== sample 017 =====
+[CLS], the met's co - artistic director. [SEP] her goal was to have that the rest of her life, writing letters to read, arranging, and, sometimes, to write poems. [SEP] the period: 2 - 2 _ detroit 18, chicago 7, detroit - - bay, chicago, detroit 20 (4. 36 pp). [SEP] according to the survey, back to 2003, it came to nothing. [SEP] for some reason, the colts lost the series to detroit, too. [SEP] "i feel sorry, and he seems to have to look for that," she said. [SEP] a few years later, however, [SEP]
+
+===== sample 018 =====
+[CLS] cent in december, the current reduction of 3. 8 to - 4. 9 per cent. [SEP] days of the past few days, days, days, days days to get in. days by the same week, days, week, week. [SEP] chicago - he's 50, 73, 73, 73, 73, 73, 73... [SEP] of course, after 50, 60, 65, they just are working days, days, weeks, and.. [SEP] vanilla, textured vanilla, chocolate - vanilla, sweet vanilla, sugared, vanilla, and salted, anded, at the start of the [SEP]
+
+===== sample 019 =====
+[CLS] - 15, 18, 15, 16, 16, 16,, 16, 18, and then,. 13, 1 - 18, 1 - 3, 14 - 15, 26, 26, 16, 18,,,, 16,,, 16, 16,, 13 - 16, 16 - 17, at about 0630 bst on december 7. [SEP] the magic led, 51 - 48, charlotte, chicago, (25 - 14, 16 - 16, 16 - 14). [SEP] i have to say you have a chance to breathe, tim. [SEP] the man, a wavy, hefty black [SEP]
+
+===== sample 020 =====
+[CLS] period - to - period for the day, period, period, period, period, time to start, period, - - to the end, period, period, day, day,, in the period,, with debrinks and day, period. [SEP] he said the planes were period, 50 -,,,,,,,,,,, 30 - and 50 - to weeks. [SEP] mr brown said that the meeting was full, normally, and that he had been assigned to the site to participate in training hours. [SEP] "we've cut back from week to week to week to," he [SEP]
+
+===== sample 021 =====
+[CLS] the first quarter, 1991 and 1996. [SEP] in the pre - trade agreement, the teams chicago, chicago, chicago, chicago, chicago, new york, chicago, chicago and detroit, which has chicago in chicago, called the city council, which specializes in the cities of chicago, chicago, chicago and chicago, a "chicago alliance." [SEP] the children are not expected to appear for about 15 minutes. [SEP] "for now, we've been told, the stock is not going to come down," mchaeag said. [SEP] we'll wait a little while to see the end come time after time again. [SEP] [SEP]
+
+===== sample 022 =====
+[CLS], gordon (54), blaney (detroit, 54). [SEP] in a typical time period, at half - time, the period period, period, 50,, 40,, 50,, 50, 60, 50, and 52. [SEP] we are not a dog,, to have a dog,,,, to have a dog. [SEP] meanwhile, if we have built a universe of opportunity - - 50 years or less - - then the vision of social mobility will become even more profound - - just when you know days, days,, days, days, days,,,,,,,, [SEP]
+
+===== sample 023 =====
+[CLS] into different areas of the city, which ranges from 200 to 300, 000 feet for the entire area. [SEP] obama's father's list of priorities is a short list at the top: chicago, ga., chicago, chicago,, chicago (r),... [SEP] s gordon, t chicago, b quinn, b m - t, s james, s - t, s hamilton. [SEP] 6, n. y. at cleveland, 10: 50 p. m. [SEP] the case of a 24 - year - old student, who said he has been charged, would be suspended in january for three weeks [SEP]
+
+===== sample 024 =====
+[CLS] days in the morning, then days, days, days, days, days, days, days, days in the early days, and then, days in the early days. [SEP] i've always thought, beginning to end, end to period to end,, to start,, more than end to start, to end to end, to end, to start to the road. [SEP] however, it seems that the planes have to go back to tomorrow, so the airlines would be making plans to hire more planes and return them in the afternoon and morning, the planes are not going to operate. [SEP] but, he said, [SEP]
+
+===== sample 025 =====
+[CLS] said. [SEP] the number was 50,, 50, and days. [SEP] on the basis of 50,,,,,,,,,,, 20 -,, and he, 10, 13, 7 - in. [SEP] i don't forget the numbers 50, 50, 50, and 50,,,, 50, 50, 50, 50, 49,, 37/sch, 98, 73, 98, 98, 98, 98, 89 of the other 50. [SEP] in reality, the former president has an excuse to go on the offensive yet, before the rest of the world is able to [SEP]
+
+===== sample 026 =====
+[CLS] in december. [SEP] i don't know what that was going on. [SEP] much of the roughly 33, 000 - mile - a - mile route is just over 3. 3 miles. [SEP] i'm staggered by the iranian government. [SEP] in the case of the program, the canadian astronaut, who in turn, was scheduled to begin working at the station on jan. [SEP] it's just the beginning of the healing process, " he said. [SEP] the celtics lost to chicago for the first time at home since the equivalent of a 1996 games in the olympic finals of chicago - - the first conference series game since the chicago [SEP]
+
+===== sample 027 =====
+[CLS] 89, 89,, 89, chicago's, 93, 95, 89, 89, 89, 89, 89,, 89, 89,, 89, 89, 89, 89,, 89, 90,, 89, 89, 89, etc. [SEP] in the meantime,,,,,,,,,,,,, and then, he's back again. [SEP] he wanted to talk and then told him to get back in there, "he said. [SEP]" we will know it's going to be, "he said." [SEP] instead, he's done in six days. [SEP]
+
+===== sample 028 =====
+[CLS], he has to turn up 50, 50,, 50, 60, 50, 50,, 50, 52 and day - to - day, day,, night,, and, day in a couple of days. "[SEP] the plane, which has been synonymous with history since the decades, came at the end of 2003, the last time the aircraft's planes crashed, but officials say the problem caused the air plane to stop at least a weeks later. [SEP]" if i read something, i don't think it will work, make a good point. [SEP] then,, and then,,, maybe, [SEP]
+
+===== sample 029 =====
+[CLS] to do with the game, but we do have to move from time to time. [SEP] in the end, most of the workers from michigan, michigan, michigan, texas, michigan and new jersey. [SEP] it was a shame, a good thing, a chance to be very good. [SEP] in the first week of the day, the celtics and the celtics, had the back - to - back - to games of the season. [SEP] it's a little late for end - of - the - road travellers, to return to quick, off - the - road access to the streets of london. [SEP] chicago, ohio ( ap [SEP]
+
+===== sample 030 =====
+[CLS] to the market. [SEP] to, to understand, to take back. [SEP] i do not know how much of a point of the road is to a little bump in the road, " he said, who asked to name the reason for that. [SEP] there is a need to dunk in the towel. [SEP] yes, there's a sense of desperation. [SEP] 1, october 22, october 16, 2006, october 14, dec. [SEP] i have to get up and walk on the road. [SEP] to finish,,, to finish... he is going to run,, to get down to make a turn, [SEP]
+
+===== sample 031 =====
+[CLS] in 2003. [SEP] "oh, chicago,, chicago - -,, chicago, chicago and, oh, you, chicago," said jordan and his brother, jordan, referring to the black - and - white team. [SEP] the planes - - small, small and small - - were delayed for several hours, he said. [SEP] its guest performers include willie golds, willie lewis and others (morris, willie jackson, wilson, james brown) during the past 50 years. [SEP] i would prefer the bread, however, it's fresh, so start the process, and put it on the boil, give it back. [SEP]
+
+===== sample 032 =====
+[CLS], then, be the neo - liberal, turn the line, say, "oh, oh, oh," she's okay, even if nothing, in the bill, they not cover the bill. [SEP] so, to remember to say, "to use the word," - - "use the word,," "prefix," "or whatever." [SEP] no matter, he said, it is so obvious that the burmese majority leader is still fighting a "dirty war." [SEP] it is a b,,,, y,, a,,,,,,,,,,,,, [SEP]
+
+===== sample 033 =====
+[CLS], 14 - 14, well ahead of the no. 9 - point mark. [SEP] but it is a joke. [SEP] that, the answer is, you know. [SEP] come on to go with a good friend and get back to work again. [SEP] " he is in a place to do things, this is just the way to make a relationship, the things to love, the things to want to do for all of us. [SEP] deutsche bahn has also said it wants to work better with the trade union and its transport workers. [SEP] detroit (ap) - as a top - seeded team in the national conference, the detroit tigers [SEP]
+
+===== sample 034 =====
+[CLS] the al - flyers, who joined the franchise in december 2008. [SEP] it is not day, time of period, period, time of season, time of change. [SEP] detroit, chicago, chicago,, chicago,, chicago, chicago, miami, chicago, indiana, chicago, chicago, new jersey, chicago, chicago, chicago, chicago,, chicago, chicago, us, chicago, chicago, chicago, chicago, ohio,, michigan,... [SEP] just add detroit, chicago, chicago, detroit, chicago, chicago. [SEP] but, however, if the new administration has time to reach a goal, it will be [SEP]
+
+===== sample 035 =====
+[CLS] to secure a series of back - to - back meetings with the yankees. [SEP] time,,,,,, change, period, re - start to get to work, and, eventually, to be done at the end of the year for other manufacturers. [SEP] for information, please contact the amex, u. s. department of the sec. [SEP] also, he is the conductor, who has to work from beginning to the end. [SEP] of the victims, only two were women. [SEP] chicago, in chicago, chicago, detroit, chicago, chicago, chicago, and chicago, the only city in order to receive the [SEP]
+
+===== sample 036 =====
+[CLS], s. 73 73, 75, 73, 100, 73 73, 71 73, 73, 73, 73, 73, 73, 73, 73, 73, 73, 73 and 73, 73, 70,, 73, etc. we are 65, 70 70, 73,, 73, 73,, and so. total of 60, 73, 73, 73, 73, 73, 73, 73, 73, 73, 70 54, 73, 54, 70 54, 73, 73, 73, 70 68, 73, 73, 73, 54., 51, 54, 54, 52, 73 [SEP]
+
+===== sample 037 =====
+[CLS] 37, 51, 542, 49, 49, 49, 48, 49, 49, 54, 54, 73, 73, 73, 73, 73, 73,, 159, 159, 159, 159, 159, 522, 528, 255, 365, 638, 737, 49, 49, 68, 49, 73, 73, 73, 73, 50, 73, 54, 76, 37, 37, 37, 45, 49. [SEP] the chrysler group, which belongs to an industrial association comprised of detroit, chicago, ohio,, chicago, and chicago and participates in the traditional alliance [SEP]
+
+===== sample 038 =====
+[CLS] thousands of dollars in 2002. [SEP] but the nets have had only three - - in 2002, 2004 and 2006, just before the playoffs. [SEP] the place of the wine is the destination, rather than the taste. [SEP] with the speed, the speed, the time lapse, the vertical area - - the gray area, and the vertical length of the 20 - year, period, the depth of the plane, the 15 -,, 12 -, -,,, 16 -,, 16 -,, and, and the combination of 15, 24, 30,,,,, 16 -,, 16 -, [SEP]
+
+===== sample 039 =====
+[CLS] games. [SEP] people seem to have forgotten that today, on the days of the day or not, the day is well after the day. [SEP] the amount of investment has to be ramped up to the point. [SEP] at the other end, mccain is trying to break the point. [SEP] had the team reached the end of the playoffs of 2002, it would have made the playoffs of 2007, the year, 2006, and, of the post - season, the year of the 2004 championship. [SEP] add to the fat - butter, add salt, salt and water to reach the other end of it. [SEP] the firm has already [SEP]
+
+===== sample 040 =====
+[CLS] they have to get out of the door. "[SEP] the planes, then, the need to day, day, day, and day - care approach to the ground. [SEP] it is also time for monday, november, december and october. [SEP]" we are just 0. 5 % at the moment. [SEP] in contrast, thomson, based in strasbourg, france, was closed for a week. [SEP] the 1996, 2004, are for the period, 2004,, 2003, 1997, 2003, 1997, 1996, 1997, 1981, 2004, and 2004, 2004, and the previous 2004, 2004,, and 2007 in the [SEP]
+
+===== sample 041 =====
+[CLS] - this time, to take the final step of their series to get to the postseason finals and reach the next playoffs. [SEP] in the first week of the year, 10, 15, 15, 14, 26, 26, 26, and in the last quarter, and,,,,,,,,, the whole pattern has been completed. [SEP] but in the end, i was,,,,, again,,,,,,,,,,,,,,,,,,, we will be seeing that again. [SEP] it is just pity, but for nothing. [SEP] lahka's [SEP]
+
+===== sample 042 =====
+[CLS] 50, 50, 15, 16, 18, 18, 14 - - and the numbers 50, 50, 49, 60, 17, 16, 36,, and so. [SEP] patrick croyle, 15, 21,, 21, 21, 37, 51, 37, 52, 37, 49,, 37,, 37,,,, 51,, 48, 37, 48,, 45,,,, 48, and 58. [SEP] in the uk,,, 48,,,, 52,, 54. [SEP] the week of the year, the sixth week of december, was the fourth - [SEP]
+
+===== sample 043 =====
+[CLS], 000, in the second quarter of 2008, and 40, 000 for the second quarter.... [SEP] 1, 2007, the year of december 2007, the two companies, in central michigan, illinois, chicago, michigan, massachusetts, to compete with the likes of michigan, michigan, michigan, chicago, ohio, michigan, michigan, illinois,, michigan, massachusetts, of course, and michigan, michigan and michigan, michigan. [SEP] the ism's new orders fell from 1997 to 98, the lowest monthly total since the start of the year, with the lowest total in 2006 - 07. [SEP] at least the [SEP]
+
+===== sample 044 =====
+[CLS]..... [SEP] in michigan, michigan, michigan, florida, michigan,,,, michigan, michigan, michigan,, michigan, ohio, michigan, 50,,, 50, 60,,,,,,, 50, 50,, 50, 70, 2, 1, 1, 2,, 4. [SEP] the numbers 14, 17, 26,,,, 11, 11, 13, 17, 15, 15, 11, 11, 14, 16, 15, 13, 14, 14. [SEP] the knicks, bulls, a lot of the fans, and the media, all all have [SEP]
+
+===== sample 045 =====
+[CLS]. [SEP] cover the potatoes in minutes,, and then, and,, but then, again, later in the day, and in the end. [SEP] it is time to the weather, the heat, the crowd, the presence of heat, lights, jets, jets, showers,, hopefully, the rest of the event. [SEP] 1, 2,,,,,, on the date,,,,,,,,, and, in a week with a range of 50, 000 to more. [SEP] the years 2000, 2003, 2004,, 2002, 2004, 2004, and 2004, respectively. here, [SEP]
+
+===== sample 046 =====
+[CLS], ohio, ohio, and cleveland, ohio. [SEP] 1997 - 98, chicago,, chicago, chicago, 1996, chicago, 1996 - 98, 1996, 1996,, 2000, 2004. the combination of, 89, 90, 1981, 1988 - 90,,,,,, 1985,,,,,, 89, and 98. [SEP] philadelphia (8 - 5) also got the second goal and four outs in a 2 - 2 victory, the longest - game - ever game. [SEP] in the midwest, chicago, michigan,, chicago, chicago, north carolina, chicago, chicago, chicago, st., [SEP]
+
+===== sample 047 =====
+[CLS] he said. [SEP] you would like to have a face - to - face meeting with the same team - - chicago, chicago, post - season meeting in a couple of weeks, etc. [SEP] he led the delegation to the conference centre of the british embassy. [SEP] but, there's time to prepare the pasta and make a stew. [SEP] 2008 - 2008 $7. 7 percent (2. 0), - $(13. 9) 8. 9 billion euros ( $17. 3 billion. [SEP] and all of that, in chicago, chicago, chicago, miami, miami, chicago, chicago, all of the [SEP]
+
+===== sample 048 =====
+[CLS] - - sometimes literally, sometimes in a trance, all in the same way that they tell us. [SEP] " now we can look at the numbers, we're going to make a big change at the moment. [SEP] then, then,, then, then, then, and then, it is the right thing to deal with. [SEP] on sunday, the white bulls will travel to the city for a road trip. [SEP] he led the first three batters, but the yankees and boston did the same in the first quarter. [SEP] chicago, chicago, chicago, chicago,, calgary, and chicago, oct. [SEP] the company [SEP]
+
+===== sample 049 =====
+[CLS]. [SEP] " he seems to be clever, he gets away with it, he needs to be more flexible, much more flexible... more than a, well, more than a, less clever. [SEP] in a statement to the conference board, dr james sanderson, regional director for the g & g - g schools and health organisation, said that the increase in additional loan commitments had an average value of $2. 6 million, up from $4. 9 million, at the year's end. [SEP] you will need a full trip -,,,,,, - - that comes later, not later, [SEP]
+
+===== sample 050 =====
+[CLS] would not seem to have it at the top. [SEP] the economy is back on the road, ok!..... you look, are we going to get it, leave it, end of the road?. [SEP] this time, day, day of the year, 50, 50, 52, 37, 52, and december. [SEP] the game is always in the middle and at the moment you have to be long enough to organize and take care of the right things. [SEP] on saturday, obama returned to kenya in a mood, a symbol of hope. [SEP] if they have managed to get back to a point of [SEP]
+
+===== sample 051 =====
+[CLS], 2003,, 1996, 1996, 1996, 2002, "he said. [SEP]" they have a two - week plan - - then they have a day and day and day and day and and then, and here, we have a team in the playoffs. [SEP] district attorney stephen patterson said he had no complaints about sampson. [SEP] single - family suvs are at the back - to - back games, chicago, chicago, chicago, chicago and other cities. [SEP] there he was in 1988, 1988, 1988, 1988, 1996, 1996, 1996, 1996, 1988, 1997, 2002 - - dispiriting the [SEP]
+
+===== sample 052 =====
+[CLS] the seasons 16, 14, 14, and 16. [SEP] the defendant, who's refused to grant such an order, told the court that two days earlier, he received about £100, 000. [SEP] i can't imagine that significant gains in housing - - and, small - value employment - - are in the deep recession. [SEP] december 14, 1893, u. s. troops, oct. [SEP] the nation's worst road game - - 14, 4, 000 - - was the worst game of the season. [SEP] for example, the firm said, 90 percent of single - and multi - family vehicles, which [SEP]
+
+===== sample 053 =====
+[CLS] for free, flights, flights - - and, in all, for the holidays. [SEP] the 6 - 15, 16, 17, 15, 15,, 18, 25,, 26, came to the end and 50, 50, and quit. [SEP] at that, he would have a year to live and a year to live. [SEP] however, bread and butter does not seem to lose its sparkle in the morning, so it is a good time to turn the boil on. [SEP] he spent a week with the dolphins in the chicago area, then turned twice in games to the bengals. [SEP] the first protests were started in [SEP]
+
+===== sample 054 =====
+[CLS] come from outside the united states, spokesman robert kelly said. [SEP] for example, the original path, the top - the - road, and the roof appeared on the back end, along with the entire back seat. [SEP] "the celtics took a face - to - face trip to a 14 - game series, back - to, back - and - forth. [SEP] in the second quarter, they beat the celtics, the chicago bulls, the chicago bears, so 0 - 1 that they went on to win - - either. [SEP] in atlanta, chicago, chicago, chicago, chicago, chicago, and again. [SEP]" the secret [SEP]
+
+===== sample 055 =====
+[CLS]. [SEP] 2. 13 - 2, detroit 7 - 11, detroit 11 - 1 - 2, detroit, s. chicago, detroit 11 - 14 - 1. 26 ). [SEP] the dow jones industrial index dropped by 2. 8 percentage points. [SEP] 18, 2007, is the "day of the year," she said. [SEP] the teams chicago, boston, chicago, boston,, and carolina - chicago. [SEP] however, the final games of the conference are teams in the playoffs, boston, chicago, chicago, chicago, detroit and chicago,, detroit, detroit, detroit and miami. [SEP] " the problem is that [SEP]
+
+===== sample 056 =====
+[CLS] in 50, 50, 60, 60,,,,,,,,,,,, 48, and was a key support for future operations. [SEP] total copies of the numbers are: men's 50, 73, 73, 73, 48,, 52, 52, 52, 52, 49, 48, 49, 52, 50, 52, 48, of the total, respectively. [SEP] the numbers 45, 37, 51, 51, 51, 51,,,,,, 18,,,, 18, 37, 37, 37, 37, 37, 37, 37, 52,, 48 [SEP]
+
+===== sample 057 =====
+[CLS] in turn. the time with the rest of week - - to - back. to - back - to - back, late - milan - to - boston - again, afternoon - late - night days. [SEP] period days, 36, 36, 27, 26, 37, 37, 37, 31, 37, 37, 45, - 48, 48, 52, 51, 48, 48, 48.... days, 36, days to take over all of the days, december, december,, 38, 36, days to end up with ice - in days, then sit down on the ice. [SEP] he [SEP]
+
+===== sample 058 =====
+[CLS] s., chicago,, chicago,, chicago. [SEP] 8, 14, 2009. [SEP] the worst of the recession is, as a result, the worst of the global downturn. [SEP] take a bottle of the water, the water, the wine, the bread, the milk bottle, the office, the office. [SEP] numbers of, 15, 16,, 13, 15, 17, 17,, 15, 15,, 15, 31,, 15, 15, 21, 18,, 18, 23, 24,, etc., 13, 18, 24,,,,,,,,, [SEP]
+
+===== sample 059 =====
+[CLS] rules in order to comply. [SEP] finally, the moment of relief was one to away. [SEP] and there are more than, think, of, a very few things. [SEP] for now, the cavaliers are back in the lead - -, perhaps, even in the playoffs, though. [SEP] but instead of winning detroit, detroit, miami, detroit's - - 14 win at atlanta - - the broncos took their season on top. [SEP] "in the face of a recession, it is hard to get the economy back to the ground, to get close enough to dry up in the near term," said the u. s [SEP]
+
+===== sample 060 =====
+[CLS] health care. [SEP] the movement in the system is the product of short - term, not short - term ideology. [SEP] he will make, sell, design,, service,, sell, service, and produce, a furniture, kitchen, bakery and services company. [SEP] the problem is similar to the stadium that was built a week after the incident, which came after a 17 - 14 win, 38 - 14 loss in the city. [SEP] this is the amount of warmth and sense of warmth and emotional closeness. [SEP] los angeles - if james brown isn't even back in a playoff situation, the cleveland magic can move on to [SEP]
+
+===== sample 061 =====
+[CLS] flight in chicago, and then a private flight to chicago, and a flight from chicago. [SEP] on monday, the president will travel to the capital to lay a three - year wreath on the road to a peace agreement. [SEP] it then translates to 14, 18, 50, 50, and so. [SEP] i have to wait in london for a number of days, week, week - - and he's 50, 50, 50, 50, 50. [SEP] he will never have anything. [SEP] it is chicago, chicago, chicago, chicago, chicago, and chicago. [SEP] the midwest region, michigan, chicago, texas, [SEP]
+
+===== sample 062 =====
+[CLS] itself as the "mother of hope." [SEP] the rally marked the end of a five - year trend as it turned to the mid - term. [SEP] on a, 14, 16, 16,, 15, 14 - - on a 10, 15, 15, 16,, 16,, 18, 24, at the end - - he seemed to make a point of himself. [SEP] that is a mark of weakness. [SEP] the pillars of the building's roof were blown up. [SEP] after the diagnosis, i came back to the hospital to see that i would have a doctor on the way to the hospital. [SEP] [SEP]
+
+===== sample 063 =====
+[CLS] $150 a ton, about 20 percent of the original cost. [SEP] i would provide an answer to your right question. [SEP] it might well be okay to eat, but not want to go to sleep in front of the sofa. [SEP] in 1919, on the fourth day of december, he died in the palace hotel in london. [SEP] he was returned to the courtroom and in the process had to make the case back again. [SEP] weeks,, weeks,, weeks, or months. [SEP] 21, 2007, when south dakota state police chief jim brown said he made a decision to buy the plane. [SEP] " it's a [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_32/state_c1024_t1p45_raw_samples.txt

@@ -0,0 +1,228 @@
+state_c1024_t1p45
+{
+  "type": "summary",
+  "name": "state_c1024_t1p45",
+  "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt",
+  "step": 124000,
+  "decode": {
+    "kind": "categorical_fullvocab",
+    "config": "state_c1024_t1p45",
+    "steps": 32,
+    "model_t_mode": "post",
+    "support_power": 1.0,
+    "semantic_power": 1.0,
+    "endpoint_temp": 1.45,
+    "concentration_min": 1.0,
+    "concentration_max": 1024.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 31.13635173493272,
+    "nll_per_token": 3.438376002668099,
+    "tokens": 9165
+  },
+  "diversity": {
+    "sample_entropy": 3.3146319833825286,
+    "unique_tokens": 1102,
+    "token_count": 8192,
+    "distinct_1": 0.134521484375,
+    "distinct_2": 0.4309793307086614,
+    "top_token_mass": 0.2288818359375
+  }
+}
+
+===== sample 000 =====
+[CLS] at the end of a deal. [SEP] science has found that it is true and makes no sense........ to back - to - back, 50, 50 to - 50, 50, 37, 48, 45, 45, and 52. [SEP] " there was no time, on the same day, at the same time, no days, even days, just seven days, i do, " he said. [SEP] he did not even let me dwell on the challenges of that... [SEP] we ' ll vote for obama.... [SEP] the meeting, called for monday afternoon, is to [SEP]
+
+===== sample 001 =====
+[CLS] 25, 40, 50, 50, 50, 60, 60, and the same period, when the hawks ' worst record was 14 - 14. [SEP] asheville, n. d., studied at the university of ohio, ohio, illinois university, ohio, texas, illinois, canada, ireland, the university of carolina and canada. [SEP] " i think he has an option, " romo said. [SEP] if the person is really prepared to do the job, this is a new beginning. [SEP] the group raised $ 16. 7 million in obama ' s first three days of campaign. [SEP] he ended a two - game [SEP]
+
+===== sample 002 =====
+[CLS] - - - flights of 2, 07,, 07, and in for at least five hours - -,,,,,, 45,,, 52. [SEP] at the end of the day, he said, the pilot still managed to retrieve the severed parts of the plane. [SEP] in other cases, the combination of warmth and warmth. [SEP] the political leader has raised his official concern about the war in the time of the election as being " ridiculous. " [SEP] now, they would like to have a child with a doctor to get just a bit in the right room. [SEP] he then emerged from the balcony of the building [SEP]
+
+===== sample 003 =====
+[CLS] of the period, period prior to making a decision, a period, period, period,,,,, period, period, period,,,,, day, period, day, period,, period,,,,,,, period, period. [SEP] and so, the period,, period, period, period,,,,,, period,,,,,,,,, period,,, period, period, period,, period, period, period,,,,,,, and period, the day is days, days, period, period, period, period,,,, [SEP]
+
+===== sample 004 =====
+[CLS] century - old building. [SEP] " we have a lot of back - game games but, i remember, we have not had a game since 2003, " he said. [SEP] instead, after 1914 and 1868, the convention to collapse in power led to the collapse of british communism. [SEP] " the peak - to -, peak - to - - to - trough period... the days of december 1988, beginning in 1988, to - back - to - back period, and 1988, and december 2007, and,,,,, 1996, 1997,,,,, and, 2003, " he said. [SEP] he [SEP]
+
+===== sample 005 =====
+[CLS] december 16, 2008 in chicago. [SEP] kiwis is out for two months, days, weeks,, in the week to week, - -, week, week, week, week,, and week. [SEP] the bears are to face a series in chicago on - 16, dec. [SEP] he is going to be out of town for an interview. [SEP] boston, detroit 11 - 16, 11 - 11,, 11, and 11 - - to complete season - to - season winnings. [SEP] in his first year at the school, he died. [SEP] a group of protesters in the capital opened the door for its [SEP]
+
+===== sample 006 =====
+[CLS] 21. 50. [SEP] obama says, days, days, days, in the morning, in the morning, and time to date these days, week, day, week,,, period. [SEP] the three - break began over a 15 - day period, a week of the end of the day and the rest of the night ' s day in the afternoon. [SEP] from three days, in the first quarter, to the next, 4, 4, 6, 8, 8, 11, and and, to the end of 2008. [SEP] the atlantis v, a space plane, is scheduled to take off at 7 : 15 [SEP]
+
+===== sample 007 =====
+[CLS] said. [SEP] " we could say, it ' s the time to talk of bankruptcy, " said said robert woodley, the president of the national automobile trade association of america, which organizes the union. [SEP] in the u. s., flights begin to 3, 000, 000 feet at the start of the day and increase to more than 30 -, -, -, -, -, -, -, -, 1, 000 - -. [SEP] notes : @ 4 - 4, detroit 0, calgary 0 - 6 - 2 - 2... [SEP] on december 14, 25, 2006, of the 91 [SEP]
+
+===== sample 008 =====
+[CLS] 13 - year - old. [SEP] face - by - face, after all, at the end of her life, she was given time to time, time to time, time to time to time again. [SEP] now, the economy is in - - and in the future. [SEP] the two season series of games in cleveland, which is on june of - 14 in boston, the road series in atlanta and the game of the best - of - five series in san francisco. [SEP] finally, the bill of purchase was passed to the cpcb and the queen ' s for the period of which amounts to 100 days, respectively. [SEP] [SEP]
+
+===== sample 009 =====
+[CLS],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and, in the first half of the year. [SEP] 13,, 14, 15, 15, 15, 30, and 4, 52... [SEP] of course, the team is completely out of place,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, of the year,,,,,,,,,,,,,, and,. [SEP] he [SEP]
+
+===== sample 010 =====
+[CLS]9. 50 per person, including for a day - to - school stay. [SEP] it is expected to be 65,,,,,,,, 45, 51, 48,, 48, 48, 37, 48, 48. [SEP] the company ' s firm ' s list of operations in the trade is expected to include : 50,, 50, 60, 60, 50,, 50, 50,,,, 36,,,,,,,,,,,,,,,,,,, etc. [SEP] if the jets were to show in depth, the teams would be ready to move, [SEP]
+
+===== sample 011 =====
+[CLS] said he was given the opportunity to play in the olympics so far. [SEP] 51, 48 and it ' s day,,,,, day - - there ' ll be people to move,,,,,,,,,,,,,,, 48,, 48, 36,, 27,, 48,,,,,,,,,,, 48,,,, 48, the rest. [SEP] from the field,,,,,,, 49, 48, 49, 52, 54, seems to make the most of the woes,,,,,,,,,, [SEP]
+
+===== sample 012 =====
+[CLS] you can see that the author has a bit of scented cake, the scented fruit has an awful scented curse on the table. [SEP] in fact, the results will come soon, not even later. [SEP] the meeting was in fact a year away. [SEP] and then, more than 1, 200 passengers, including passengers, had to return to the airport monday morning to begin the 12 - hour stopover. [SEP] we have to talk come, come, break, we have to talk. [SEP] once they do, they will be able to feel, and when they do not feel back, they will feel more of a shock. [SEP] the [SEP]
+
+===== sample 013 =====
+[CLS] the rest of the 2004 - 7, including the back - to - back trip to the playoffs. [SEP] detroit 7, minnesota 27, 26, chicago,, cleveland,, chicago,, 50 - 48. - for the week, dec. - 60, 50 - 73, 50 - 73, 50 - 50, and beyond. - - 50 - 50, 37, 50, 50, 50, 50, parts of 50 - 49, 50 - 45, 60 - 50, in new york, boston 37, 50, boston 48, 50 - 50, 52, 60 - 60 and 48. - -,,, [SEP]
+
+===== sample 014 =====
+[CLS] we have to do it all together. [SEP] the man,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, to grow - up to his, and, oh, he opened his eyes at the end of the journey, and " no one wants to be sure what he wants to be, " he said. [SEP] however, the current period was about a year earlier and is much longer. [SEP] the guy who will, he said, make the tens of thousands of dollars. [SEP] " i think they have to do it again. [SEP] [SEP]
+
+===== sample 015 =====
+[CLS] good friend, not a woman,, sits in the back of the house, but has not been wearing an eye. [SEP] chicago, september 11, 2008, and chicago, dec. [SEP] of course, 50,, 50, 60, by the end of........ 60, 50, 50, and in the end, they want to be. [SEP] with more than a week left after tuesday ' s quake, trucks and dump piled with hundreds of cars and collapsed on the roofs of government buildings. [SEP] " i was the first person to give me something to play during the day, " he said [SEP]
+
+===== sample 016 =====
+[CLS]. [SEP] with the examples above, it would be time to have a good day in 2009. [SEP] the flight crew, miraculously, took the way to the airport and then returned to the prison area for their rescue. [SEP] a few years after being introduced to saba, he is on the field, and he will be a highlight of the day. [SEP] the european transport committee has already provided such help. [SEP] rondo, who has 22, 13 assists and eight assists this season, scored seven straight points. [SEP] 11, not again, but for the first time in 13 days. [SEP] today, december 21, 2007, [SEP]
+
+===== sample 017 =====
+[CLS], the met ' s co - artistic director. [SEP] her goal was to have that the rest of her life, writing letters to read, arranging, and, sometimes, to write poems. [SEP] the period : 2 - 2 _ detroit 18, chicago 7, detroit - - bay, chicago, detroit 20 ( 4. 36 pp ). [SEP] according to the survey, back to 2003, it came to nothing. [SEP] for some reason, the colts lost the series to detroit, too. [SEP] " i feel sorry, and he seems to have to look for that, " she said. [SEP] a few years later, however, [SEP]
+
+===== sample 018 =====
+[CLS] cent in december, the current reduction of 3. 8 to - 4. 9 per cent. [SEP] days of the past few days, days, days, days days to get in. days by the same week, days, week, week. [SEP] chicago - he ' s 50, 73, 73, 73, 73, 73, 73... [SEP] of course, after 50, 60, 65, they just are working days, days, weeks, and.. [SEP] vanilla, textured vanilla, chocolate - vanilla, sweet vanilla, sugared, vanilla, and salted, anded, at the start of the [SEP]
+
+===== sample 019 =====
+[CLS] - 15, 18, 15, 16, 16, 16,, 16, 18, and then,. 13, 1 - 18, 1 - 3, 14 - 15, 26, 26, 16, 18,,,, 16,,, 16, 16,, 13 - 16, 16 - 17, at about 0630 bst on december 7. [SEP] the magic led, 51 - 48, charlotte, chicago, ( 25 - 14, 16 - 16, 16 - 14 ). [SEP] i have to say you have a chance to breathe, tim. [SEP] the man, a wavy, hefty black [SEP]
+
+===== sample 020 =====
+[CLS] period - to - period for the day, period, period, period, period, time to start, period, - - to the end, period, period, day, day,, in the period,, with debrinks and day, period. [SEP] he said the planes were period, 50 -,,,,,,,,,,, 30 - and 50 - to weeks. [SEP] mr brown said that the meeting was full, normally, and that he had been assigned to the site to participate in training hours. [SEP] " we ' ve cut back from week to week to week to, " he [SEP]
+
+===== sample 021 =====
+[CLS] the first quarter, 1991 and 1996. [SEP] in the pre - trade agreement, the teams chicago, chicago, chicago, chicago, chicago, new york, chicago, chicago and detroit, which has chicago in chicago, called the city council, which specializes in the cities of chicago, chicago, chicago and chicago, a " chicago alliance. " [SEP] the children are not expected to appear for about 15 minutes. [SEP] " for now, we ' ve been told, the stock is not going to come down, " mchaeag said. [SEP] we ' ll wait a little while to see the end come time after time again. [SEP] [SEP]
+
+===== sample 022 =====
+[CLS], gordon ( 54 ), blaney ( detroit, 54 ). [SEP] in a typical time period, at half - time, the period period, period, 50,, 40,, 50,, 50, 60, 50, and 52. [SEP] we are not a dog,, to have a dog,,,, to have a dog. [SEP] meanwhile, if we have built a universe of opportunity - - 50 years or less - - then the vision of social mobility will become even more profound - - just when you know days, days,, days, days, days,,,,,,,, [SEP]
+
+===== sample 023 =====
+[CLS] into different areas of the city, which ranges from 200 to 300, 000 feet for the entire area. [SEP] obama ' s father ' s list of priorities is a short list at the top : chicago, ga., chicago, chicago,, chicago ( r ),... [SEP] s gordon, t chicago, b quinn, b m - t, s james, s - t, s hamilton. [SEP] 6, n. y. at cleveland, 10 : 50 p. m. [SEP] the case of a 24 - year - old student, who said he has been charged, would be suspended in january for three weeks [SEP]
+
+===== sample 024 =====
+[CLS] days in the morning, then days, days, days, days, days, days, days, days in the early days, and then, days in the early days. [SEP] i ' ve always thought, beginning to end, end to period to end,, to start,, more than end to start, to end to end, to end, to start to the road. [SEP] however, it seems that the planes have to go back to tomorrow, so the airlines would be making plans to hire more planes and return them in the afternoon and morning, the planes are not going to operate. [SEP] but, he said, [SEP]
+
+===== sample 025 =====
+[CLS] said. [SEP] the number was 50,, 50, and days. [SEP] on the basis of 50,,,,,,,,,,, 20 -,, and he, 10, 13, 7 - in. [SEP] i don ' t forget the numbers 50, 50, 50, and 50,,,, 50, 50, 50, 50, 49,, 37 / sch, 98, 73, 98, 98, 98, 98, 89 of the other 50. [SEP] in reality, the former president has an excuse to go on the offensive yet, before the rest of the world is able to [SEP]
+
+===== sample 026 =====
+[CLS] in december. [SEP] i don ' t know what that was going on. [SEP] much of the roughly 33, 000 - mile - a - mile route is just over 3. 3 miles. [SEP] i ' m staggered by the iranian government. [SEP] in the case of the program, the canadian astronaut, who in turn, was scheduled to begin working at the station on jan. [SEP] it ' s just the beginning of the healing process, " he said. [SEP] the celtics lost to chicago for the first time at home since the equivalent of a 1996 games in the olympic finals of chicago - - the first conference series game since the chicago [SEP]
+
+===== sample 027 =====
+[CLS] 89, 89,, 89, chicago ' s, 93, 95, 89, 89, 89, 89, 89,, 89, 89,, 89, 89, 89, 89,, 89, 90,, 89, 89, 89, etc. [SEP] in the meantime,,,,,,,,,,,,, and then, he ' s back again. [SEP] he wanted to talk and then told him to get back in there, " he said. [SEP] " we will know it ' s going to be, " he said. " [SEP] instead, he ' s done in six days. [SEP]
+
+===== sample 028 =====
+[CLS], he has to turn up 50, 50,, 50, 60, 50, 50,, 50, 52 and day - to - day, day,, night,, and, day in a couple of days. " [SEP] the plane, which has been synonymous with history since the decades, came at the end of 2003, the last time the aircraft ' s planes crashed, but officials say the problem caused the air plane to stop at least a weeks later. [SEP] " if i read something, i don ' t think it will work, make a good point. [SEP] then,, and then,,, maybe, [SEP]
+
+===== sample 029 =====
+[CLS] to do with the game, but we do have to move from time to time. [SEP] in the end, most of the workers from michigan, michigan, michigan, texas, michigan and new jersey. [SEP] it was a shame, a good thing, a chance to be very good. [SEP] in the first week of the day, the celtics and the celtics, had the back - to - back - to games of the season. [SEP] it ' s a little late for end - of - the - road travellers, to return to quick, off - the - road access to the streets of london. [SEP] chicago, ohio ( ap [SEP]
+
+===== sample 030 =====
+[CLS] to the market. [SEP] to, to understand, to take back. [SEP] i do not know how much of a point of the road is to a little bump in the road, " he said, who asked to name the reason for that. [SEP] there is a need to dunk in the towel. [SEP] yes, there ' s a sense of desperation. [SEP] 1, october 22, october 16, 2006, october 14, dec. [SEP] i have to get up and walk on the road. [SEP] to finish,,, to finish... he is going to run,, to get down to make a turn, [SEP]
+
+===== sample 031 =====
+[CLS] in 2003. [SEP] " oh, chicago,, chicago - -,, chicago, chicago and, oh, you, chicago, " said jordan and his brother, jordan, referring to the black - and - white team. [SEP] the planes - - small, small and small - - were delayed for several hours, he said. [SEP] its guest performers include willie golds, willie lewis and others ( morris, willie jackson, wilson, james brown ) during the past 50 years. [SEP] i would prefer the bread, however, it ' s fresh, so start the process, and put it on the boil, give it back. [SEP]
+
+===== sample 032 =====
+[CLS], then, be the neo - liberal, turn the line, say, " oh, oh, oh, " she ' s okay, even if nothing, in the bill, they not cover the bill. [SEP] so, to remember to say, " to use the word, " - - " use the word,, " " prefix, " " or whatever. " [SEP] no matter, he said, it is so obvious that the burmese majority leader is still fighting a " dirty war. " [SEP] it is a b,,,, y,, a,,,,,,,,,,,,, [SEP]
+
+===== sample 033 =====
+[CLS], 14 - 14, well ahead of the no. 9 - point mark. [SEP] but it is a joke. [SEP] that, the answer is, you know. [SEP] come on to go with a good friend and get back to work again. [SEP] " he is in a place to do things, this is just the way to make a relationship, the things to love, the things to want to do for all of us. [SEP] deutsche bahn has also said it wants to work better with the trade union and its transport workers. [SEP] detroit ( ap ) - as a top - seeded team in the national conference, the detroit tigers [SEP]
+
+===== sample 034 =====
+[CLS] the al - flyers, who joined the franchise in december 2008. [SEP] it is not day, time of period, period, time of season, time of change. [SEP] detroit, chicago, chicago,, chicago,, chicago, chicago, miami, chicago, indiana, chicago, chicago, new jersey, chicago, chicago, chicago, chicago,, chicago, chicago, us, chicago, chicago, chicago, chicago, ohio,, michigan,... [SEP] just add detroit, chicago, chicago, detroit, chicago, chicago. [SEP] but, however, if the new administration has time to reach a goal, it will be [SEP]
+
+===== sample 035 =====
+[CLS] to secure a series of back - to - back meetings with the yankees. [SEP] time,,,,,, change, period, re - start to get to work, and, eventually, to be done at the end of the year for other manufacturers. [SEP] for information, please contact the amex, u. s. department of the sec. [SEP] also, he is the conductor, who has to work from beginning to the end. [SEP] of the victims, only two were women. [SEP] chicago, in chicago, chicago, detroit, chicago, chicago, chicago, and chicago, the only city in order to receive the [SEP]
+
+===== sample 036 =====
+[CLS], s. 73 73, 75, 73, 100, 73 73, 71 73, 73, 73, 73, 73, 73, 73, 73, 73, 73, 73 and 73, 73, 70,, 73, etc. we are 65, 70 70, 73,, 73, 73,, and so. total of 60, 73, 73, 73, 73, 73, 73, 73, 73, 73, 70 54, 73, 54, 70 54, 73, 73, 73, 70 68, 73, 73, 73, 54., 51, 54, 54, 52, 73 [SEP]
+
+===== sample 037 =====
+[CLS] 37, 51, 542, 49, 49, 49, 48, 49, 49, 54, 54, 73, 73, 73, 73, 73, 73,, 159, 159, 159, 159, 159, 522, 528, 255, 365, 638, 737, 49, 49, 68, 49, 73, 73, 73, 73, 50, 73, 54, 76, 37, 37, 37, 45, 49. [SEP] the chrysler group, which belongs to an industrial association comprised of detroit, chicago, ohio,, chicago, and chicago and participates in the traditional alliance [SEP]
+
+===== sample 038 =====
+[CLS] thousands of dollars in 2002. [SEP] but the nets have had only three - - in 2002, 2004 and 2006, just before the playoffs. [SEP] the place of the wine is the destination, rather than the taste. [SEP] with the speed, the speed, the time lapse, the vertical area - - the gray area, and the vertical length of the 20 - year, period, the depth of the plane, the 15 -,, 12 -, -,,, 16 -,, 16 -,, and, and the combination of 15, 24, 30,,,,, 16 -,, 16 -, [SEP]
+
+===== sample 039 =====
+[CLS] games. [SEP] people seem to have forgotten that today, on the days of the day or not, the day is well after the day. [SEP] the amount of investment has to be ramped up to the point. [SEP] at the other end, mccain is trying to break the point. [SEP] had the team reached the end of the playoffs of 2002, it would have made the playoffs of 2007, the year, 2006, and, of the post - season, the year of the 2004 championship. [SEP] add to the fat - butter, add salt, salt and water to reach the other end of it. [SEP] the firm has already [SEP]
+
+===== sample 040 =====
+[CLS] they have to get out of the door. " [SEP] the planes, then, the need to day, day, day, and day - care approach to the ground. [SEP] it is also time for monday, november, december and october. [SEP] " we are just 0. 5 % at the moment. [SEP] in contrast, thomson, based in strasbourg, france, was closed for a week. [SEP] the 1996, 2004, are for the period, 2004,, 2003, 1997, 2003, 1997, 1996, 1997, 1981, 2004, and 2004, 2004, and the previous 2004, 2004,, and 2007 in the [SEP]
+
+===== sample 041 =====
+[CLS] - this time, to take the final step of their series to get to the postseason finals and reach the next playoffs. [SEP] in the first week of the year, 10, 15, 15, 14, 26, 26, 26, and in the last quarter, and,,,,,,,,, the whole pattern has been completed. [SEP] but in the end, i was,,,,, again,,,,,,,,,,,,,,,,,,, we will be seeing that again. [SEP] it is just pity, but for nothing. [SEP] lahka ' s [SEP]
+
+===== sample 042 =====
+[CLS] 50, 50, 15, 16, 18, 18, 14 - - and the numbers 50, 50, 49, 60, 17, 16, 36,, and so. [SEP] patrick croyle, 15, 21,, 21, 21, 37, 51, 37, 52, 37, 49,, 37,, 37,,,, 51,, 48, 37, 48,, 45,,,, 48, and 58. [SEP] in the uk,,, 48,,,, 52,, 54. [SEP] the week of the year, the sixth week of december, was the fourth - [SEP]
+
+===== sample 043 =====
+[CLS], 000, in the second quarter of 2008, and 40, 000 for the second quarter.... [SEP] 1, 2007, the year of december 2007, the two companies, in central michigan, illinois, chicago, michigan, massachusetts, to compete with the likes of michigan, michigan, michigan, chicago, ohio, michigan, michigan, illinois,, michigan, massachusetts, of course, and michigan, michigan and michigan, michigan. [SEP] the ism ' s new orders fell from 1997 to 98, the lowest monthly total since the start of the year, with the lowest total in 2006 - 07. [SEP] at least the [SEP]
+
+===== sample 044 =====
+[CLS]..... [SEP] in michigan, michigan, michigan, florida, michigan,,,, michigan, michigan, michigan,, michigan, ohio, michigan, 50,,, 50, 60,,,,,,, 50, 50,, 50, 70, 2, 1, 1, 2,, 4. [SEP] the numbers 14, 17, 26,,,, 11, 11, 13, 17, 15, 15, 11, 11, 14, 16, 15, 13, 14, 14. [SEP] the knicks, bulls, a lot of the fans, and the media, all all have [SEP]
+
+===== sample 045 =====
+[CLS]. [SEP] cover the potatoes in minutes,, and then, and,, but then, again, later in the day, and in the end. [SEP] it is time to the weather, the heat, the crowd, the presence of heat, lights, jets, jets, showers,, hopefully, the rest of the event. [SEP] 1, 2,,,,,, on the date,,,,,,,,, and, in a week with a range of 50, 000 to more. [SEP] the years 2000, 2003, 2004,, 2002, 2004, 2004, and 2004, respectively. here, [SEP]
+
+===== sample 046 =====
+[CLS], ohio, ohio, and cleveland, ohio. [SEP] 1997 - 98, chicago,, chicago, chicago, 1996, chicago, 1996 - 98, 1996, 1996,, 2000, 2004. the combination of, 89, 90, 1981, 1988 - 90,,,,,, 1985,,,,,, 89, and 98. [SEP] philadelphia ( 8 - 5 ) also got the second goal and four outs in a 2 - 2 victory, the longest - game - ever game. [SEP] in the midwest, chicago, michigan,, chicago, chicago, north carolina, chicago, chicago, chicago, st., [SEP]
+
+===== sample 047 =====
+[CLS] he said. [SEP] you would like to have a face - to - face meeting with the same team - - chicago, chicago, post - season meeting in a couple of weeks, etc. [SEP] he led the delegation to the conference centre of the british embassy. [SEP] but, there ' s time to prepare the pasta and make a stew. [SEP] 2008 - 2008 $ 7. 7 percent ( 2. 0 ), - $ ( 13. 9 ) 8. 9 billion euros ( $ 17. 3 billion. [SEP] and all of that, in chicago, chicago, chicago, miami, miami, chicago, chicago, all of the [SEP]
+
+===== sample 048 =====
+[CLS] - - sometimes literally, sometimes in a trance, all in the same way that they tell us. [SEP] " now we can look at the numbers, we ' re going to make a big change at the moment. [SEP] then, then,, then, then, then, and then, it is the right thing to deal with. [SEP] on sunday, the white bulls will travel to the city for a road trip. [SEP] he led the first three batters, but the yankees and boston did the same in the first quarter. [SEP] chicago, chicago, chicago, chicago,, calgary, and chicago, oct. [SEP] the company [SEP]
+
+===== sample 049 =====
+[CLS]. [SEP] " he seems to be clever, he gets away with it, he needs to be more flexible, much more flexible... more than a, well, more than a, less clever. [SEP] in a statement to the conference board, dr james sanderson, regional director for the g & g - g schools and health organisation, said that the increase in additional loan commitments had an average value of $ 2. 6 million, up from $ 4. 9 million, at the year ' s end. [SEP] you will need a full trip -,,,,,, - - that comes later, not later, [SEP]
+
+===== sample 050 =====
+[CLS] would not seem to have it at the top. [SEP] the economy is back on the road, ok!..... you look, are we going to get it, leave it, end of the road?. [SEP] this time, day, day of the year, 50, 50, 52, 37, 52, and december. [SEP] the game is always in the middle and at the moment you have to be long enough to organize and take care of the right things. [SEP] on saturday, obama returned to kenya in a mood, a symbol of hope. [SEP] if they have managed to get back to a point of [SEP]
+
+===== sample 051 =====
+[CLS], 2003,, 1996, 1996, 1996, 2002, " he said. [SEP] " they have a two - week plan - - then they have a day and day and day and day and and then, and here, we have a team in the playoffs. [SEP] district attorney stephen patterson said he had no complaints about sampson. [SEP] single - family suvs are at the back - to - back games, chicago, chicago, chicago, chicago and other cities. [SEP] there he was in 1988, 1988, 1988, 1988, 1996, 1996, 1996, 1996, 1988, 1997, 2002 - - dispiriting the [SEP]
+
+===== sample 052 =====
+[CLS] the seasons 16, 14, 14, and 16. [SEP] the defendant, who ' s refused to grant such an order, told the court that two days earlier, he received about £100, 000. [SEP] i can ' t imagine that significant gains in housing - - and, small - value employment - - are in the deep recession. [SEP] december 14, 1893, u. s. troops, oct. [SEP] the nation ' s worst road game - - 14, 4, 000 - - was the worst game of the season. [SEP] for example, the firm said, 90 percent of single - and multi - family vehicles, which [SEP]
+
+===== sample 053 =====
+[CLS] for free, flights, flights - - and, in all, for the holidays. [SEP] the 6 - 15, 16, 17, 15, 15,, 18, 25,, 26, came to the end and 50, 50, and quit. [SEP] at that, he would have a year to live and a year to live. [SEP] however, bread and butter does not seem to lose its sparkle in the morning, so it is a good time to turn the boil on. [SEP] he spent a week with the dolphins in the chicago area, then turned twice in games to the bengals. [SEP] the first protests were started in [SEP]
+
+===== sample 054 =====
+[CLS] come from outside the united states, spokesman robert kelly said. [SEP] for example, the original path, the top - the - road, and the roof appeared on the back end, along with the entire back seat. [SEP] " the celtics took a face - to - face trip to a 14 - game series, back - to, back - and - forth. [SEP] in the second quarter, they beat the celtics, the chicago bulls, the chicago bears, so 0 - 1 that they went on to win - - either. [SEP] in atlanta, chicago, chicago, chicago, chicago, chicago, and again. [SEP] " the secret [SEP]
+
+===== sample 055 =====
+[CLS]. [SEP] 2. 13 - 2, detroit 7 - 11, detroit 11 - 1 - 2, detroit, s. chicago, detroit 11 - 14 - 1. 26 ). [SEP] the dow jones industrial index dropped by 2. 8 percentage points. [SEP] 18, 2007, is the " day of the year, " she said. [SEP] the teams chicago, boston, chicago, boston,, and carolina - chicago. [SEP] however, the final games of the conference are teams in the playoffs, boston, chicago, chicago, chicago, detroit and chicago,, detroit, detroit, detroit and miami. [SEP] " the problem is that [SEP]
+
+===== sample 056 =====
+[CLS] in 50, 50, 60, 60,,,,,,,,,,,, 48, and was a key support for future operations. [SEP] total copies of the numbers are : men ' s 50, 73, 73, 73, 48,, 52, 52, 52, 52, 49, 48, 49, 52, 50, 52, 48, of the total, respectively. [SEP] the numbers 45, 37, 51, 51, 51, 51,,,,,, 18,,,, 18, 37, 37, 37, 37, 37, 37, 37, 52,, 48 [SEP]
+
+===== sample 057 =====
+[CLS] in turn. the time with the rest of week - - to - back. to - back - to - back, late - milan - to - boston - again, afternoon - late - night days. [SEP] period days, 36, 36, 27, 26, 37, 37, 37, 31, 37, 37, 45, - 48, 48, 52, 51, 48, 48, 48.... days, 36, days to take over all of the days, december, december,, 38, 36, days to end up with ice - in days, then sit down on the ice. [SEP] he [SEP]
+
+===== sample 058 =====
+[CLS] s., chicago,, chicago,, chicago. [SEP] 8, 14, 2009. [SEP] the worst of the recession is, as a result, the worst of the global downturn. [SEP] take a bottle of the water, the water, the wine, the bread, the milk bottle, the office, the office. [SEP] numbers of, 15, 16,, 13, 15, 17, 17,, 15, 15,, 15, 31,, 15, 15, 21, 18,, 18, 23, 24,, etc., 13, 18, 24,,,,,,,,, [SEP]
+
+===== sample 059 =====
+[CLS] rules in order to comply. [SEP] finally, the moment of relief was one to away. [SEP] and there are more than, think, of, a very few things. [SEP] for now, the cavaliers are back in the lead - -, perhaps, even in the playoffs, though. [SEP] but instead of winning detroit, detroit, miami, detroit ' s - - 14 win at atlanta - - the broncos took their season on top. [SEP] " in the face of a recession, it is hard to get the economy back to the ground, to get close enough to dry up in the near term, " said the u. s [SEP]
+
+===== sample 060 =====
+[CLS] health care. [SEP] the movement in the system is the product of short - term, not short - term ideology. [SEP] he will make, sell, design,, service,, sell, service, and produce, a furniture, kitchen, bakery and services company. [SEP] the problem is similar to the stadium that was built a week after the incident, which came after a 17 - 14 win, 38 - 14 loss in the city. [SEP] this is the amount of warmth and sense of warmth and emotional closeness. [SEP] los angeles - if james brown isn ' t even back in a playoff situation, the cleveland magic can move on to [SEP]
+
+===== sample 061 =====
+[CLS] flight in chicago, and then a private flight to chicago, and a flight from chicago. [SEP] on monday, the president will travel to the capital to lay a three - year wreath on the road to a peace agreement. [SEP] it then translates to 14, 18, 50, 50, and so. [SEP] i have to wait in london for a number of days, week, week - - and he ' s 50, 50, 50, 50, 50. [SEP] he will never have anything. [SEP] it is chicago, chicago, chicago, chicago, chicago, and chicago. [SEP] the midwest region, michigan, chicago, texas, [SEP]
+
+===== sample 062 =====
+[CLS] itself as the " mother of hope. " [SEP] the rally marked the end of a five - year trend as it turned to the mid - term. [SEP] on a, 14, 16, 16,, 15, 14 - - on a 10, 15, 15, 16,, 16,, 18, 24, at the end - - he seemed to make a point of himself. [SEP] that is a mark of weakness. [SEP] the pillars of the building ' s roof were blown up. [SEP] after the diagnosis, i came back to the hospital to see that i would have a doctor on the way to the hospital. [SEP] [SEP]
+
+===== sample 063 =====
+[CLS] $ 150 a ton, about 20 percent of the original cost. [SEP] i would provide an answer to your right question. [SEP] it might well be okay to eat, but not want to go to sleep in front of the sofa. [SEP] in 1919, on the fourth day of december, he died in the palace hotel in london. [SEP] he was returned to the courtroom and in the process had to make the case back again. [SEP] weeks,, weeks,, weeks, or months. [SEP] 21, 2007, when south dakota state police chief jim brown said he made a decision to buy the plane. [SEP] " it ' s a [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_32/state_c1024_t1p45_scored.jsonl

@@ -0,0 +1,65 @@
+{"type": "summary", "name": "state_c1024_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c1024_t1p45", "steps": 32, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 1024.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 31.13635173493272, "nll_per_token": 3.438376002668099, "tokens": 9165}, "diversity": {"sample_entropy": 3.3146319833825286, "unique_tokens": 1102, "token_count": 8192, "distinct_1": 0.134521484375, "distinct_2": 0.4309793307086614, "top_token_mass": 0.2288818359375}}
+{"type": "sample", "index": 0, "raw_text": "[CLS] at the end of a deal. [SEP] science has found that it is true and makes no sense........ to back - to - back, 50, 50 to - 50, 50, 37, 48, 45, 45, and 52. [SEP] \" there was no time, on the same day, at the same time, no days, even days, just seven days, i do, \" he said. [SEP] he did not even let me dwell on the challenges of that... [SEP] we ' ll vote for obama.... [SEP] the meeting, called for monday afternoon, is to [SEP]", "detok_text": "[CLS] at the end of a deal. [SEP] science has found that it is true and makes no sense........ to back - to - back, 50, 50 to - 50, 50, 37, 48, 45, 45, and 52. [SEP] \"there was no time, on the same day, at the same time, no days, even days, just seven days, i do,\" he said. [SEP] he did not even let me dwell on the challenges of that... [SEP] we'll vote for obama.... [SEP] the meeting, called for monday afternoon, is to [SEP]"}
+{"type": "sample", "index": 1, "raw_text": "[CLS] 25, 40, 50, 50, 50, 60, 60, and the same period, when the hawks ' worst record was 14 - 14. [SEP] asheville, n. d., studied at the university of ohio, ohio, illinois university, ohio, texas, illinois, canada, ireland, the university of carolina and canada. [SEP] \" i think he has an option, \" romo said. [SEP] if the person is really prepared to do the job, this is a new beginning. [SEP] the group raised $ 16. 7 million in obama ' s first three days of campaign. [SEP] he ended a two - game [SEP]", "detok_text": "[CLS] 25, 40, 50, 50, 50, 60, 60, and the same period, when the hawks' worst record was 14 - 14. [SEP] asheville, n. d., studied at the university of ohio, ohio, illinois university, ohio, texas, illinois, canada, ireland, the university of carolina and canada. [SEP] \"i think he has an option,\" romo said. [SEP] if the person is really prepared to do the job, this is a new beginning. [SEP] the group raised $16. 7 million in obama's first three days of campaign. [SEP] he ended a two - game [SEP]"}
+{"type": "sample", "index": 2, "raw_text": "[CLS] - - - flights of 2, 07,, 07, and in for at least five hours - -,,,,,, 45,,, 52. [SEP] at the end of the day, he said, the pilot still managed to retrieve the severed parts of the plane. [SEP] in other cases, the combination of warmth and warmth. [SEP] the political leader has raised his official concern about the war in the time of the election as being \" ridiculous. \" [SEP] now, they would like to have a child with a doctor to get just a bit in the right room. [SEP] he then emerged from the balcony of the building [SEP]", "detok_text": "[CLS] - - - flights of 2, 07,, 07, and in for at least five hours - -,,,,,, 45,,, 52. [SEP] at the end of the day, he said, the pilot still managed to retrieve the severed parts of the plane. [SEP] in other cases, the combination of warmth and warmth. [SEP] the political leader has raised his official concern about the war in the time of the election as being \"ridiculous.\" [SEP] now, they would like to have a child with a doctor to get just a bit in the right room. [SEP] he then emerged from the balcony of the building [SEP]"}
+{"type": "sample", "index": 3, "raw_text": "[CLS] of the period, period prior to making a decision, a period, period, period,,,,, period, period, period,,,,, day, period, day, period,, period,,,,,,, period, period. [SEP] and so, the period,, period, period, period,,,,,, period,,,,,,,,, period,,, period, period, period,, period, period, period,,,,,,, and period, the day is days, days, period, period, period, period,,,, [SEP]", "detok_text": "[CLS] of the period, period prior to making a decision, a period, period, period,,,,, period, period, period,,,,, day, period, day, period,, period,,,,,,, period, period. [SEP] and so, the period,, period, period, period,,,,,, period,,,,,,,,, period,,, period, period, period,, period, period, period,,,,,,, and period, the day is days, days, period, period, period, period,,,, [SEP]"}
+{"type": "sample", "index": 4, "raw_text": "[CLS] century - old building. [SEP] \" we have a lot of back - game games but, i remember, we have not had a game since 2003, \" he said. [SEP] instead, after 1914 and 1868, the convention to collapse in power led to the collapse of british communism. [SEP] \" the peak - to -, peak - to - - to - trough period... the days of december 1988, beginning in 1988, to - back - to - back period, and 1988, and december 2007, and,,,,, 1996, 1997,,,,, and, 2003, \" he said. [SEP] he [SEP]", "detok_text": "[CLS] century - old building. [SEP] \"we have a lot of back - game games but, i remember, we have not had a game since 2003,\" he said. [SEP] instead, after 1914 and 1868, the convention to collapse in power led to the collapse of british communism. [SEP] \"the peak - to -, peak - to - - to - trough period... the days of december 1988, beginning in 1988, to - back - to - back period, and 1988, and december 2007, and,,,,, 1996, 1997,,,,, and, 2003,\" he said. [SEP] he [SEP]"}
+{"type": "sample", "index": 5, "raw_text": "[CLS] december 16, 2008 in chicago. [SEP] kiwis is out for two months, days, weeks,, in the week to week, - -, week, week, week, week,, and week. [SEP] the bears are to face a series in chicago on - 16, dec. [SEP] he is going to be out of town for an interview. [SEP] boston, detroit 11 - 16, 11 - 11,, 11, and 11 - - to complete season - to - season winnings. [SEP] in his first year at the school, he died. [SEP] a group of protesters in the capital opened the door for its [SEP]", "detok_text": "[CLS] december 16, 2008 in chicago. [SEP] kiwis is out for two months, days, weeks,, in the week to week, - -, week, week, week, week,, and week. [SEP] the bears are to face a series in chicago on - 16, dec. [SEP] he is going to be out of town for an interview. [SEP] boston, detroit 11 - 16, 11 - 11,, 11, and 11 - - to complete season - to - season winnings. [SEP] in his first year at the school, he died. [SEP] a group of protesters in the capital opened the door for its [SEP]"}
+{"type": "sample", "index": 6, "raw_text": "[CLS] 21. 50. [SEP] obama says, days, days, days, in the morning, in the morning, and time to date these days, week, day, week,,, period. [SEP] the three - break began over a 15 - day period, a week of the end of the day and the rest of the night ' s day in the afternoon. [SEP] from three days, in the first quarter, to the next, 4, 4, 6, 8, 8, 11, and and, to the end of 2008. [SEP] the atlantis v, a space plane, is scheduled to take off at 7 : 15 [SEP]", "detok_text": "[CLS] 21. 50. [SEP] obama says, days, days, days, in the morning, in the morning, and time to date these days, week, day, week,,, period. [SEP] the three - break began over a 15 - day period, a week of the end of the day and the rest of the night's day in the afternoon. [SEP] from three days, in the first quarter, to the next, 4, 4, 6, 8, 8, 11, and and, to the end of 2008. [SEP] the atlantis v, a space plane, is scheduled to take off at 7: 15 [SEP]"}
+{"type": "sample", "index": 7, "raw_text": "[CLS] said. [SEP] \" we could say, it ' s the time to talk of bankruptcy, \" said said robert woodley, the president of the national automobile trade association of america, which organizes the union. [SEP] in the u. s., flights begin to 3, 000, 000 feet at the start of the day and increase to more than 30 -, -, -, -, -, -, -, -, 1, 000 - -. [SEP] notes : @ 4 - 4, detroit 0, calgary 0 - 6 - 2 - 2... [SEP] on december 14, 25, 2006, of the 91 [SEP]", "detok_text": "[CLS] said. [SEP] \"we could say, it's the time to talk of bankruptcy,\" said said robert woodley, the president of the national automobile trade association of america, which organizes the union. [SEP] in the u. s., flights begin to 3, 000, 000 feet at the start of the day and increase to more than 30 -, -, -, -, -, -, -, -, 1, 000 - -. [SEP] notes: @ 4 - 4, detroit 0, calgary 0 - 6 - 2 - 2... [SEP] on december 14, 25, 2006, of the 91 [SEP]"}
+{"type": "sample", "index": 8, "raw_text": "[CLS] 13 - year - old. [SEP] face - by - face, after all, at the end of her life, she was given time to time, time to time, time to time to time again. [SEP] now, the economy is in - - and in the future. [SEP] the two season series of games in cleveland, which is on june of - 14 in boston, the road series in atlanta and the game of the best - of - five series in san francisco. [SEP] finally, the bill of purchase was passed to the cpcb and the queen ' s for the period of which amounts to 100 days, respectively. [SEP] [SEP]", "detok_text": "[CLS] 13 - year - old. [SEP] face - by - face, after all, at the end of her life, she was given time to time, time to time, time to time to time again. [SEP] now, the economy is in - - and in the future. [SEP] the two season series of games in cleveland, which is on june of - 14 in boston, the road series in atlanta and the game of the best - of - five series in san francisco. [SEP] finally, the bill of purchase was passed to the cpcb and the queen's for the period of which amounts to 100 days, respectively. [SEP] [SEP]"}
+{"type": "sample", "index": 9, "raw_text": "[CLS],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and, in the first half of the year. [SEP] 13,, 14, 15, 15, 15, 30, and 4, 52... [SEP] of course, the team is completely out of place,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, of the year,,,,,,,,,,,,,, and,. [SEP] he [SEP]", "detok_text": "[CLS],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and, in the first half of the year. [SEP] 13,, 14, 15, 15, 15, 30, and 4, 52... [SEP] of course, the team is completely out of place,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, of the year,,,,,,,,,,,,,, and,. [SEP] he [SEP]"}
+{"type": "sample", "index": 10, "raw_text": "[CLS]9. 50 per person, including for a day - to - school stay. [SEP] it is expected to be 65,,,,,,,, 45, 51, 48,, 48, 48, 37, 48, 48. [SEP] the company ' s firm ' s list of operations in the trade is expected to include : 50,, 50, 60, 60, 50,, 50, 50,,,, 36,,,,,,,,,,,,,,,,,,, etc. [SEP] if the jets were to show in depth, the teams would be ready to move, [SEP]", "detok_text": "[CLS]9. 50 per person, including for a day - to - school stay. [SEP] it is expected to be 65,,,,,,,, 45, 51, 48,, 48, 48, 37, 48, 48. [SEP] the company's firm's list of operations in the trade is expected to include: 50,, 50, 60, 60, 50,, 50, 50,,,, 36,,,,,,,,,,,,,,,,,,, etc. [SEP] if the jets were to show in depth, the teams would be ready to move, [SEP]"}
+{"type": "sample", "index": 11, "raw_text": "[CLS] said he was given the opportunity to play in the olympics so far. [SEP] 51, 48 and it ' s day,,,,, day - - there ' ll be people to move,,,,,,,,,,,,,,, 48,, 48, 36,, 27,, 48,,,,,,,,,,, 48,,,, 48, the rest. [SEP] from the field,,,,,,, 49, 48, 49, 52, 54, seems to make the most of the woes,,,,,,,,,, [SEP]", "detok_text": "[CLS] said he was given the opportunity to play in the olympics so far. [SEP] 51, 48 and it's day,,,,, day - - there'll be people to move,,,,,,,,,,,,,,, 48,, 48, 36,, 27,, 48,,,,,,,,,,, 48,,,, 48, the rest. [SEP] from the field,,,,,,, 49, 48, 49, 52, 54, seems to make the most of the woes,,,,,,,,,, [SEP]"}
+{"type": "sample", "index": 12, "raw_text": "[CLS] you can see that the author has a bit of scented cake, the scented fruit has an awful scented curse on the table. [SEP] in fact, the results will come soon, not even later. [SEP] the meeting was in fact a year away. [SEP] and then, more than 1, 200 passengers, including passengers, had to return to the airport monday morning to begin the 12 - hour stopover. [SEP] we have to talk come, come, break, we have to talk. [SEP] once they do, they will be able to feel, and when they do not feel back, they will feel more of a shock. [SEP] the [SEP]", "detok_text": "[CLS] you can see that the author has a bit of scented cake, the scented fruit has an awful scented curse on the table. [SEP] in fact, the results will come soon, not even later. [SEP] the meeting was in fact a year away. [SEP] and then, more than 1, 200 passengers, including passengers, had to return to the airport monday morning to begin the 12 - hour stopover. [SEP] we have to talk come, come, break, we have to talk. [SEP] once they do, they will be able to feel, and when they do not feel back, they will feel more of a shock. [SEP] the [SEP]"}
+{"type": "sample", "index": 13, "raw_text": "[CLS] the rest of the 2004 - 7, including the back - to - back trip to the playoffs. [SEP] detroit 7, minnesota 27, 26, chicago,, cleveland,, chicago,, 50 - 48. - for the week, dec. - 60, 50 - 73, 50 - 73, 50 - 50, and beyond. - - 50 - 50, 37, 50, 50, 50, 50, parts of 50 - 49, 50 - 45, 60 - 50, in new york, boston 37, 50, boston 48, 50 - 50, 52, 60 - 60 and 48. - -,,, [SEP]", "detok_text": "[CLS] the rest of the 2004 - 7, including the back - to - back trip to the playoffs. [SEP] detroit 7, minnesota 27, 26, chicago,, cleveland,, chicago,, 50 - 48. - for the week, dec. - 60, 50 - 73, 50 - 73, 50 - 50, and beyond. - - 50 - 50, 37, 50, 50, 50, 50, parts of 50 - 49, 50 - 45, 60 - 50, in new york, boston 37, 50, boston 48, 50 - 50, 52, 60 - 60 and 48. - -,,, [SEP]"}
+{"type": "sample", "index": 14, "raw_text": "[CLS] we have to do it all together. [SEP] the man,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, to grow - up to his, and, oh, he opened his eyes at the end of the journey, and \" no one wants to be sure what he wants to be, \" he said. [SEP] however, the current period was about a year earlier and is much longer. [SEP] the guy who will, he said, make the tens of thousands of dollars. [SEP] \" i think they have to do it again. [SEP] [SEP]", "detok_text": "[CLS] we have to do it all together. [SEP] the man,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, to grow - up to his, and, oh, he opened his eyes at the end of the journey, and \"no one wants to be sure what he wants to be,\" he said. [SEP] however, the current period was about a year earlier and is much longer. [SEP] the guy who will, he said, make the tens of thousands of dollars. [SEP] \" i think they have to do it again. [SEP] [SEP]"}
+{"type": "sample", "index": 15, "raw_text": "[CLS] good friend, not a woman,, sits in the back of the house, but has not been wearing an eye. [SEP] chicago, september 11, 2008, and chicago, dec. [SEP] of course, 50,, 50, 60, by the end of........ 60, 50, 50, and in the end, they want to be. [SEP] with more than a week left after tuesday ' s quake, trucks and dump piled with hundreds of cars and collapsed on the roofs of government buildings. [SEP] \" i was the first person to give me something to play during the day, \" he said [SEP]", "detok_text": "[CLS] good friend, not a woman,, sits in the back of the house, but has not been wearing an eye. [SEP] chicago, september 11, 2008, and chicago, dec. [SEP] of course, 50,, 50, 60, by the end of........ 60, 50, 50, and in the end, they want to be. [SEP] with more than a week left after tuesday's quake, trucks and dump piled with hundreds of cars and collapsed on the roofs of government buildings. [SEP] \"i was the first person to give me something to play during the day,\" he said [SEP]"}
+{"type": "sample", "index": 16, "raw_text": "[CLS]. [SEP] with the examples above, it would be time to have a good day in 2009. [SEP] the flight crew, miraculously, took the way to the airport and then returned to the prison area for their rescue. [SEP] a few years after being introduced to saba, he is on the field, and he will be a highlight of the day. [SEP] the european transport committee has already provided such help. [SEP] rondo, who has 22, 13 assists and eight assists this season, scored seven straight points. [SEP] 11, not again, but for the first time in 13 days. [SEP] today, december 21, 2007, [SEP]", "detok_text": "[CLS]. [SEP] with the examples above, it would be time to have a good day in 2009. [SEP] the flight crew, miraculously, took the way to the airport and then returned to the prison area for their rescue. [SEP] a few years after being introduced to saba, he is on the field, and he will be a highlight of the day. [SEP] the european transport committee has already provided such help. [SEP] rondo, who has 22, 13 assists and eight assists this season, scored seven straight points. [SEP] 11, not again, but for the first time in 13 days. [SEP] today, december 21, 2007, [SEP]"}
+{"type": "sample", "index": 17, "raw_text": "[CLS], the met ' s co - artistic director. [SEP] her goal was to have that the rest of her life, writing letters to read, arranging, and, sometimes, to write poems. [SEP] the period : 2 - 2 _ detroit 18, chicago 7, detroit - - bay, chicago, detroit 20 ( 4. 36 pp ). [SEP] according to the survey, back to 2003, it came to nothing. [SEP] for some reason, the colts lost the series to detroit, too. [SEP] \" i feel sorry, and he seems to have to look for that, \" she said. [SEP] a few years later, however, [SEP]", "detok_text": "[CLS], the met's co - artistic director. [SEP] her goal was to have that the rest of her life, writing letters to read, arranging, and, sometimes, to write poems. [SEP] the period: 2 - 2 _ detroit 18, chicago 7, detroit - - bay, chicago, detroit 20 (4. 36 pp). [SEP] according to the survey, back to 2003, it came to nothing. [SEP] for some reason, the colts lost the series to detroit, too. [SEP] \"i feel sorry, and he seems to have to look for that,\" she said. [SEP] a few years later, however, [SEP]"}
+{"type": "sample", "index": 18, "raw_text": "[CLS] cent in december, the current reduction of 3. 8 to - 4. 9 per cent. [SEP] days of the past few days, days, days, days days to get in. days by the same week, days, week, week. [SEP] chicago - he ' s 50, 73, 73, 73, 73, 73, 73... [SEP] of course, after 50, 60, 65, they just are working days, days, weeks, and.. [SEP] vanilla, textured vanilla, chocolate - vanilla, sweet vanilla, sugared, vanilla, and salted, anded, at the start of the [SEP]", "detok_text": "[CLS] cent in december, the current reduction of 3. 8 to - 4. 9 per cent. [SEP] days of the past few days, days, days, days days to get in. days by the same week, days, week, week. [SEP] chicago - he's 50, 73, 73, 73, 73, 73, 73... [SEP] of course, after 50, 60, 65, they just are working days, days, weeks, and.. [SEP] vanilla, textured vanilla, chocolate - vanilla, sweet vanilla, sugared, vanilla, and salted, anded, at the start of the [SEP]"}
+{"type": "sample", "index": 19, "raw_text": "[CLS] - 15, 18, 15, 16, 16, 16,, 16, 18, and then,. 13, 1 - 18, 1 - 3, 14 - 15, 26, 26, 16, 18,,,, 16,,, 16, 16,, 13 - 16, 16 - 17, at about 0630 bst on december 7. [SEP] the magic led, 51 - 48, charlotte, chicago, ( 25 - 14, 16 - 16, 16 - 14 ). [SEP] i have to say you have a chance to breathe, tim. [SEP] the man, a wavy, hefty black [SEP]", "detok_text": "[CLS] - 15, 18, 15, 16, 16, 16,, 16, 18, and then,. 13, 1 - 18, 1 - 3, 14 - 15, 26, 26, 16, 18,,,, 16,,, 16, 16,, 13 - 16, 16 - 17, at about 0630 bst on december 7. [SEP] the magic led, 51 - 48, charlotte, chicago, (25 - 14, 16 - 16, 16 - 14). [SEP] i have to say you have a chance to breathe, tim. [SEP] the man, a wavy, hefty black [SEP]"}
+{"type": "sample", "index": 20, "raw_text": "[CLS] period - to - period for the day, period, period, period, period, time to start, period, - - to the end, period, period, day, day,, in the period,, with debrinks and day, period. [SEP] he said the planes were period, 50 -,,,,,,,,,,, 30 - and 50 - to weeks. [SEP] mr brown said that the meeting was full, normally, and that he had been assigned to the site to participate in training hours. [SEP] \" we ' ve cut back from week to week to week to, \" he [SEP]", "detok_text": "[CLS] period - to - period for the day, period, period, period, period, time to start, period, - - to the end, period, period, day, day,, in the period,, with debrinks and day, period. [SEP] he said the planes were period, 50 -,,,,,,,,,,, 30 - and 50 - to weeks. [SEP] mr brown said that the meeting was full, normally, and that he had been assigned to the site to participate in training hours. [SEP] \"we've cut back from week to week to week to,\" he [SEP]"}
+{"type": "sample", "index": 21, "raw_text": "[CLS] the first quarter, 1991 and 1996. [SEP] in the pre - trade agreement, the teams chicago, chicago, chicago, chicago, chicago, new york, chicago, chicago and detroit, which has chicago in chicago, called the city council, which specializes in the cities of chicago, chicago, chicago and chicago, a \" chicago alliance. \" [SEP] the children are not expected to appear for about 15 minutes. [SEP] \" for now, we ' ve been told, the stock is not going to come down, \" mchaeag said. [SEP] we ' ll wait a little while to see the end come time after time again. [SEP] [SEP]", "detok_text": "[CLS] the first quarter, 1991 and 1996. [SEP] in the pre - trade agreement, the teams chicago, chicago, chicago, chicago, chicago, new york, chicago, chicago and detroit, which has chicago in chicago, called the city council, which specializes in the cities of chicago, chicago, chicago and chicago, a \"chicago alliance.\" [SEP] the children are not expected to appear for about 15 minutes. [SEP] \"for now, we've been told, the stock is not going to come down,\" mchaeag said. [SEP] we'll wait a little while to see the end come time after time again. [SEP] [SEP]"}
+{"type": "sample", "index": 22, "raw_text": "[CLS], gordon ( 54 ), blaney ( detroit, 54 ). [SEP] in a typical time period, at half - time, the period period, period, 50,, 40,, 50,, 50, 60, 50, and 52. [SEP] we are not a dog,, to have a dog,,,, to have a dog. [SEP] meanwhile, if we have built a universe of opportunity - - 50 years or less - - then the vision of social mobility will become even more profound - - just when you know days, days,, days, days, days,,,,,,,, [SEP]", "detok_text": "[CLS], gordon (54), blaney (detroit, 54). [SEP] in a typical time period, at half - time, the period period, period, 50,, 40,, 50,, 50, 60, 50, and 52. [SEP] we are not a dog,, to have a dog,,,, to have a dog. [SEP] meanwhile, if we have built a universe of opportunity - - 50 years or less - - then the vision of social mobility will become even more profound - - just when you know days, days,, days, days, days,,,,,,,, [SEP]"}
+{"type": "sample", "index": 23, "raw_text": "[CLS] into different areas of the city, which ranges from 200 to 300, 000 feet for the entire area. [SEP] obama ' s father ' s list of priorities is a short list at the top : chicago, ga., chicago, chicago,, chicago ( r ),... [SEP] s gordon, t chicago, b quinn, b m - t, s james, s - t, s hamilton. [SEP] 6, n. y. at cleveland, 10 : 50 p. m. [SEP] the case of a 24 - year - old student, who said he has been charged, would be suspended in january for three weeks [SEP]", "detok_text": "[CLS] into different areas of the city, which ranges from 200 to 300, 000 feet for the entire area. [SEP] obama's father's list of priorities is a short list at the top: chicago, ga., chicago, chicago,, chicago (r),... [SEP] s gordon, t chicago, b quinn, b m - t, s james, s - t, s hamilton. [SEP] 6, n. y. at cleveland, 10: 50 p. m. [SEP] the case of a 24 - year - old student, who said he has been charged, would be suspended in january for three weeks [SEP]"}
+{"type": "sample", "index": 24, "raw_text": "[CLS] days in the morning, then days, days, days, days, days, days, days, days in the early days, and then, days in the early days. [SEP] i ' ve always thought, beginning to end, end to period to end,, to start,, more than end to start, to end to end, to end, to start to the road. [SEP] however, it seems that the planes have to go back to tomorrow, so the airlines would be making plans to hire more planes and return them in the afternoon and morning, the planes are not going to operate. [SEP] but, he said, [SEP]", "detok_text": "[CLS] days in the morning, then days, days, days, days, days, days, days, days in the early days, and then, days in the early days. [SEP] i've always thought, beginning to end, end to period to end,, to start,, more than end to start, to end to end, to end, to start to the road. [SEP] however, it seems that the planes have to go back to tomorrow, so the airlines would be making plans to hire more planes and return them in the afternoon and morning, the planes are not going to operate. [SEP] but, he said, [SEP]"}
+{"type": "sample", "index": 25, "raw_text": "[CLS] said. [SEP] the number was 50,, 50, and days. [SEP] on the basis of 50,,,,,,,,,,, 20 -,, and he, 10, 13, 7 - in. [SEP] i don ' t forget the numbers 50, 50, 50, and 50,,,, 50, 50, 50, 50, 49,, 37 / sch, 98, 73, 98, 98, 98, 98, 89 of the other 50. [SEP] in reality, the former president has an excuse to go on the offensive yet, before the rest of the world is able to [SEP]", "detok_text": "[CLS] said. [SEP] the number was 50,, 50, and days. [SEP] on the basis of 50,,,,,,,,,,, 20 -,, and he, 10, 13, 7 - in. [SEP] i don't forget the numbers 50, 50, 50, and 50,,,, 50, 50, 50, 50, 49,, 37/sch, 98, 73, 98, 98, 98, 98, 89 of the other 50. [SEP] in reality, the former president has an excuse to go on the offensive yet, before the rest of the world is able to [SEP]"}
+{"type": "sample", "index": 26, "raw_text": "[CLS] in december. [SEP] i don ' t know what that was going on. [SEP] much of the roughly 33, 000 - mile - a - mile route is just over 3. 3 miles. [SEP] i ' m staggered by the iranian government. [SEP] in the case of the program, the canadian astronaut, who in turn, was scheduled to begin working at the station on jan. [SEP] it ' s just the beginning of the healing process, \" he said. [SEP] the celtics lost to chicago for the first time at home since the equivalent of a 1996 games in the olympic finals of chicago - - the first conference series game since the chicago [SEP]", "detok_text": "[CLS] in december. [SEP] i don't know what that was going on. [SEP] much of the roughly 33, 000 - mile - a - mile route is just over 3. 3 miles. [SEP] i'm staggered by the iranian government. [SEP] in the case of the program, the canadian astronaut, who in turn, was scheduled to begin working at the station on jan. [SEP] it's just the beginning of the healing process, \" he said. [SEP] the celtics lost to chicago for the first time at home since the equivalent of a 1996 games in the olympic finals of chicago - - the first conference series game since the chicago [SEP]"}
+{"type": "sample", "index": 27, "raw_text": "[CLS] 89, 89,, 89, chicago ' s, 93, 95, 89, 89, 89, 89, 89,, 89, 89,, 89, 89, 89, 89,, 89, 90,, 89, 89, 89, etc. [SEP] in the meantime,,,,,,,,,,,,, and then, he ' s back again. [SEP] he wanted to talk and then told him to get back in there, \" he said. [SEP] \" we will know it ' s going to be, \" he said. \" [SEP] instead, he ' s done in six days. [SEP]", "detok_text": "[CLS] 89, 89,, 89, chicago's, 93, 95, 89, 89, 89, 89, 89,, 89, 89,, 89, 89, 89, 89,, 89, 90,, 89, 89, 89, etc. [SEP] in the meantime,,,,,,,,,,,,, and then, he's back again. [SEP] he wanted to talk and then told him to get back in there, \"he said. [SEP]\" we will know it's going to be, \"he said.\" [SEP] instead, he's done in six days. [SEP]"}
+{"type": "sample", "index": 28, "raw_text": "[CLS], he has to turn up 50, 50,, 50, 60, 50, 50,, 50, 52 and day - to - day, day,, night,, and, day in a couple of days. \" [SEP] the plane, which has been synonymous with history since the decades, came at the end of 2003, the last time the aircraft ' s planes crashed, but officials say the problem caused the air plane to stop at least a weeks later. [SEP] \" if i read something, i don ' t think it will work, make a good point. [SEP] then,, and then,,, maybe, [SEP]", "detok_text": "[CLS], he has to turn up 50, 50,, 50, 60, 50, 50,, 50, 52 and day - to - day, day,, night,, and, day in a couple of days. \"[SEP] the plane, which has been synonymous with history since the decades, came at the end of 2003, the last time the aircraft's planes crashed, but officials say the problem caused the air plane to stop at least a weeks later. [SEP]\" if i read something, i don't think it will work, make a good point. [SEP] then,, and then,,, maybe, [SEP]"}
+{"type": "sample", "index": 29, "raw_text": "[CLS] to do with the game, but we do have to move from time to time. [SEP] in the end, most of the workers from michigan, michigan, michigan, texas, michigan and new jersey. [SEP] it was a shame, a good thing, a chance to be very good. [SEP] in the first week of the day, the celtics and the celtics, had the back - to - back - to games of the season. [SEP] it ' s a little late for end - of - the - road travellers, to return to quick, off - the - road access to the streets of london. [SEP] chicago, ohio ( ap [SEP]", "detok_text": "[CLS] to do with the game, but we do have to move from time to time. [SEP] in the end, most of the workers from michigan, michigan, michigan, texas, michigan and new jersey. [SEP] it was a shame, a good thing, a chance to be very good. [SEP] in the first week of the day, the celtics and the celtics, had the back - to - back - to games of the season. [SEP] it's a little late for end - of - the - road travellers, to return to quick, off - the - road access to the streets of london. [SEP] chicago, ohio ( ap [SEP]"}
+{"type": "sample", "index": 30, "raw_text": "[CLS] to the market. [SEP] to, to understand, to take back. [SEP] i do not know how much of a point of the road is to a little bump in the road, \" he said, who asked to name the reason for that. [SEP] there is a need to dunk in the towel. [SEP] yes, there ' s a sense of desperation. [SEP] 1, october 22, october 16, 2006, october 14, dec. [SEP] i have to get up and walk on the road. [SEP] to finish,,, to finish... he is going to run,, to get down to make a turn, [SEP]", "detok_text": "[CLS] to the market. [SEP] to, to understand, to take back. [SEP] i do not know how much of a point of the road is to a little bump in the road, \" he said, who asked to name the reason for that. [SEP] there is a need to dunk in the towel. [SEP] yes, there's a sense of desperation. [SEP] 1, october 22, october 16, 2006, october 14, dec. [SEP] i have to get up and walk on the road. [SEP] to finish,,, to finish... he is going to run,, to get down to make a turn, [SEP]"}
+{"type": "sample", "index": 31, "raw_text": "[CLS] in 2003. [SEP] \" oh, chicago,, chicago - -,, chicago, chicago and, oh, you, chicago, \" said jordan and his brother, jordan, referring to the black - and - white team. [SEP] the planes - - small, small and small - - were delayed for several hours, he said. [SEP] its guest performers include willie golds, willie lewis and others ( morris, willie jackson, wilson, james brown ) during the past 50 years. [SEP] i would prefer the bread, however, it ' s fresh, so start the process, and put it on the boil, give it back. [SEP]", "detok_text": "[CLS] in 2003. [SEP] \"oh, chicago,, chicago - -,, chicago, chicago and, oh, you, chicago,\" said jordan and his brother, jordan, referring to the black - and - white team. [SEP] the planes - - small, small and small - - were delayed for several hours, he said. [SEP] its guest performers include willie golds, willie lewis and others (morris, willie jackson, wilson, james brown) during the past 50 years. [SEP] i would prefer the bread, however, it's fresh, so start the process, and put it on the boil, give it back. [SEP]"}
+{"type": "sample", "index": 32, "raw_text": "[CLS], then, be the neo - liberal, turn the line, say, \" oh, oh, oh, \" she ' s okay, even if nothing, in the bill, they not cover the bill. [SEP] so, to remember to say, \" to use the word, \" - - \" use the word,, \" \" prefix, \" \" or whatever. \" [SEP] no matter, he said, it is so obvious that the burmese majority leader is still fighting a \" dirty war. \" [SEP] it is a b,,,, y,, a,,,,,,,,,,,,, [SEP]", "detok_text": "[CLS], then, be the neo - liberal, turn the line, say, \"oh, oh, oh,\" she's okay, even if nothing, in the bill, they not cover the bill. [SEP] so, to remember to say, \"to use the word,\" - - \"use the word,,\" \"prefix,\" \"or whatever.\" [SEP] no matter, he said, it is so obvious that the burmese majority leader is still fighting a \"dirty war.\" [SEP] it is a b,,,, y,, a,,,,,,,,,,,,, [SEP]"}
+{"type": "sample", "index": 33, "raw_text": "[CLS], 14 - 14, well ahead of the no. 9 - point mark. [SEP] but it is a joke. [SEP] that, the answer is, you know. [SEP] come on to go with a good friend and get back to work again. [SEP] \" he is in a place to do things, this is just the way to make a relationship, the things to love, the things to want to do for all of us. [SEP] deutsche bahn has also said it wants to work better with the trade union and its transport workers. [SEP] detroit ( ap ) - as a top - seeded team in the national conference, the detroit tigers [SEP]", "detok_text": "[CLS], 14 - 14, well ahead of the no. 9 - point mark. [SEP] but it is a joke. [SEP] that, the answer is, you know. [SEP] come on to go with a good friend and get back to work again. [SEP] \" he is in a place to do things, this is just the way to make a relationship, the things to love, the things to want to do for all of us. [SEP] deutsche bahn has also said it wants to work better with the trade union and its transport workers. [SEP] detroit (ap) - as a top - seeded team in the national conference, the detroit tigers [SEP]"}
+{"type": "sample", "index": 34, "raw_text": "[CLS] the al - flyers, who joined the franchise in december 2008. [SEP] it is not day, time of period, period, time of season, time of change. [SEP] detroit, chicago, chicago,, chicago,, chicago, chicago, miami, chicago, indiana, chicago, chicago, new jersey, chicago, chicago, chicago, chicago,, chicago, chicago, us, chicago, chicago, chicago, chicago, ohio,, michigan,... [SEP] just add detroit, chicago, chicago, detroit, chicago, chicago. [SEP] but, however, if the new administration has time to reach a goal, it will be [SEP]", "detok_text": "[CLS] the al - flyers, who joined the franchise in december 2008. [SEP] it is not day, time of period, period, time of season, time of change. [SEP] detroit, chicago, chicago,, chicago,, chicago, chicago, miami, chicago, indiana, chicago, chicago, new jersey, chicago, chicago, chicago, chicago,, chicago, chicago, us, chicago, chicago, chicago, chicago, ohio,, michigan,... [SEP] just add detroit, chicago, chicago, detroit, chicago, chicago. [SEP] but, however, if the new administration has time to reach a goal, it will be [SEP]"}
+{"type": "sample", "index": 35, "raw_text": "[CLS] to secure a series of back - to - back meetings with the yankees. [SEP] time,,,,,, change, period, re - start to get to work, and, eventually, to be done at the end of the year for other manufacturers. [SEP] for information, please contact the amex, u. s. department of the sec. [SEP] also, he is the conductor, who has to work from beginning to the end. [SEP] of the victims, only two were women. [SEP] chicago, in chicago, chicago, detroit, chicago, chicago, chicago, and chicago, the only city in order to receive the [SEP]", "detok_text": "[CLS] to secure a series of back - to - back meetings with the yankees. [SEP] time,,,,,, change, period, re - start to get to work, and, eventually, to be done at the end of the year for other manufacturers. [SEP] for information, please contact the amex, u. s. department of the sec. [SEP] also, he is the conductor, who has to work from beginning to the end. [SEP] of the victims, only two were women. [SEP] chicago, in chicago, chicago, detroit, chicago, chicago, chicago, and chicago, the only city in order to receive the [SEP]"}
+{"type": "sample", "index": 36, "raw_text": "[CLS], s. 73 73, 75, 73, 100, 73 73, 71 73, 73, 73, 73, 73, 73, 73, 73, 73, 73, 73 and 73, 73, 70,, 73, etc. we are 65, 70 70, 73,, 73, 73,, and so. total of 60, 73, 73, 73, 73, 73, 73, 73, 73, 73, 70 54, 73, 54, 70 54, 73, 73, 73, 70 68, 73, 73, 73, 54., 51, 54, 54, 52, 73 [SEP]", "detok_text": "[CLS], s. 73 73, 75, 73, 100, 73 73, 71 73, 73, 73, 73, 73, 73, 73, 73, 73, 73, 73 and 73, 73, 70,, 73, etc. we are 65, 70 70, 73,, 73, 73,, and so. total of 60, 73, 73, 73, 73, 73, 73, 73, 73, 73, 70 54, 73, 54, 70 54, 73, 73, 73, 70 68, 73, 73, 73, 54., 51, 54, 54, 52, 73 [SEP]"}
+{"type": "sample", "index": 37, "raw_text": "[CLS] 37, 51, 542, 49, 49, 49, 48, 49, 49, 54, 54, 73, 73, 73, 73, 73, 73,, 159, 159, 159, 159, 159, 522, 528, 255, 365, 638, 737, 49, 49, 68, 49, 73, 73, 73, 73, 50, 73, 54, 76, 37, 37, 37, 45, 49. [SEP] the chrysler group, which belongs to an industrial association comprised of detroit, chicago, ohio,, chicago, and chicago and participates in the traditional alliance [SEP]", "detok_text": "[CLS] 37, 51, 542, 49, 49, 49, 48, 49, 49, 54, 54, 73, 73, 73, 73, 73, 73,, 159, 159, 159, 159, 159, 522, 528, 255, 365, 638, 737, 49, 49, 68, 49, 73, 73, 73, 73, 50, 73, 54, 76, 37, 37, 37, 45, 49. [SEP] the chrysler group, which belongs to an industrial association comprised of detroit, chicago, ohio,, chicago, and chicago and participates in the traditional alliance [SEP]"}
+{"type": "sample", "index": 38, "raw_text": "[CLS] thousands of dollars in 2002. [SEP] but the nets have had only three - - in 2002, 2004 and 2006, just before the playoffs. [SEP] the place of the wine is the destination, rather than the taste. [SEP] with the speed, the speed, the time lapse, the vertical area - - the gray area, and the vertical length of the 20 - year, period, the depth of the plane, the 15 -,, 12 -, -,,, 16 -,, 16 -,, and, and the combination of 15, 24, 30,,,,, 16 -,, 16 -, [SEP]", "detok_text": "[CLS] thousands of dollars in 2002. [SEP] but the nets have had only three - - in 2002, 2004 and 2006, just before the playoffs. [SEP] the place of the wine is the destination, rather than the taste. [SEP] with the speed, the speed, the time lapse, the vertical area - - the gray area, and the vertical length of the 20 - year, period, the depth of the plane, the 15 -,, 12 -, -,,, 16 -,, 16 -,, and, and the combination of 15, 24, 30,,,,, 16 -,, 16 -, [SEP]"}
+{"type": "sample", "index": 39, "raw_text": "[CLS] games. [SEP] people seem to have forgotten that today, on the days of the day or not, the day is well after the day. [SEP] the amount of investment has to be ramped up to the point. [SEP] at the other end, mccain is trying to break the point. [SEP] had the team reached the end of the playoffs of 2002, it would have made the playoffs of 2007, the year, 2006, and, of the post - season, the year of the 2004 championship. [SEP] add to the fat - butter, add salt, salt and water to reach the other end of it. [SEP] the firm has already [SEP]", "detok_text": "[CLS] games. [SEP] people seem to have forgotten that today, on the days of the day or not, the day is well after the day. [SEP] the amount of investment has to be ramped up to the point. [SEP] at the other end, mccain is trying to break the point. [SEP] had the team reached the end of the playoffs of 2002, it would have made the playoffs of 2007, the year, 2006, and, of the post - season, the year of the 2004 championship. [SEP] add to the fat - butter, add salt, salt and water to reach the other end of it. [SEP] the firm has already [SEP]"}
+{"type": "sample", "index": 40, "raw_text": "[CLS] they have to get out of the door. \" [SEP] the planes, then, the need to day, day, day, and day - care approach to the ground. [SEP] it is also time for monday, november, december and october. [SEP] \" we are just 0. 5 % at the moment. [SEP] in contrast, thomson, based in strasbourg, france, was closed for a week. [SEP] the 1996, 2004, are for the period, 2004,, 2003, 1997, 2003, 1997, 1996, 1997, 1981, 2004, and 2004, 2004, and the previous 2004, 2004,, and 2007 in the [SEP]", "detok_text": "[CLS] they have to get out of the door. \"[SEP] the planes, then, the need to day, day, day, and day - care approach to the ground. [SEP] it is also time for monday, november, december and october. [SEP]\" we are just 0. 5 % at the moment. [SEP] in contrast, thomson, based in strasbourg, france, was closed for a week. [SEP] the 1996, 2004, are for the period, 2004,, 2003, 1997, 2003, 1997, 1996, 1997, 1981, 2004, and 2004, 2004, and the previous 2004, 2004,, and 2007 in the [SEP]"}
+{"type": "sample", "index": 41, "raw_text": "[CLS] - this time, to take the final step of their series to get to the postseason finals and reach the next playoffs. [SEP] in the first week of the year, 10, 15, 15, 14, 26, 26, 26, and in the last quarter, and,,,,,,,,, the whole pattern has been completed. [SEP] but in the end, i was,,,,, again,,,,,,,,,,,,,,,,,,, we will be seeing that again. [SEP] it is just pity, but for nothing. [SEP] lahka ' s [SEP]", "detok_text": "[CLS] - this time, to take the final step of their series to get to the postseason finals and reach the next playoffs. [SEP] in the first week of the year, 10, 15, 15, 14, 26, 26, 26, and in the last quarter, and,,,,,,,,, the whole pattern has been completed. [SEP] but in the end, i was,,,,, again,,,,,,,,,,,,,,,,,,, we will be seeing that again. [SEP] it is just pity, but for nothing. [SEP] lahka's [SEP]"}
+{"type": "sample", "index": 42, "raw_text": "[CLS] 50, 50, 15, 16, 18, 18, 14 - - and the numbers 50, 50, 49, 60, 17, 16, 36,, and so. [SEP] patrick croyle, 15, 21,, 21, 21, 37, 51, 37, 52, 37, 49,, 37,, 37,,,, 51,, 48, 37, 48,, 45,,,, 48, and 58. [SEP] in the uk,,, 48,,,, 52,, 54. [SEP] the week of the year, the sixth week of december, was the fourth - [SEP]", "detok_text": "[CLS] 50, 50, 15, 16, 18, 18, 14 - - and the numbers 50, 50, 49, 60, 17, 16, 36,, and so. [SEP] patrick croyle, 15, 21,, 21, 21, 37, 51, 37, 52, 37, 49,, 37,, 37,,,, 51,, 48, 37, 48,, 45,,,, 48, and 58. [SEP] in the uk,,, 48,,,, 52,, 54. [SEP] the week of the year, the sixth week of december, was the fourth - [SEP]"}
+{"type": "sample", "index": 43, "raw_text": "[CLS], 000, in the second quarter of 2008, and 40, 000 for the second quarter.... [SEP] 1, 2007, the year of december 2007, the two companies, in central michigan, illinois, chicago, michigan, massachusetts, to compete with the likes of michigan, michigan, michigan, chicago, ohio, michigan, michigan, illinois,, michigan, massachusetts, of course, and michigan, michigan and michigan, michigan. [SEP] the ism ' s new orders fell from 1997 to 98, the lowest monthly total since the start of the year, with the lowest total in 2006 - 07. [SEP] at least the [SEP]", "detok_text": "[CLS], 000, in the second quarter of 2008, and 40, 000 for the second quarter.... [SEP] 1, 2007, the year of december 2007, the two companies, in central michigan, illinois, chicago, michigan, massachusetts, to compete with the likes of michigan, michigan, michigan, chicago, ohio, michigan, michigan, illinois,, michigan, massachusetts, of course, and michigan, michigan and michigan, michigan. [SEP] the ism's new orders fell from 1997 to 98, the lowest monthly total since the start of the year, with the lowest total in 2006 - 07. [SEP] at least the [SEP]"}
+{"type": "sample", "index": 44, "raw_text": "[CLS]..... [SEP] in michigan, michigan, michigan, florida, michigan,,,, michigan, michigan, michigan,, michigan, ohio, michigan, 50,,, 50, 60,,,,,,, 50, 50,, 50, 70, 2, 1, 1, 2,, 4. [SEP] the numbers 14, 17, 26,,,, 11, 11, 13, 17, 15, 15, 11, 11, 14, 16, 15, 13, 14, 14. [SEP] the knicks, bulls, a lot of the fans, and the media, all all have [SEP]", "detok_text": "[CLS]..... [SEP] in michigan, michigan, michigan, florida, michigan,,,, michigan, michigan, michigan,, michigan, ohio, michigan, 50,,, 50, 60,,,,,,, 50, 50,, 50, 70, 2, 1, 1, 2,, 4. [SEP] the numbers 14, 17, 26,,,, 11, 11, 13, 17, 15, 15, 11, 11, 14, 16, 15, 13, 14, 14. [SEP] the knicks, bulls, a lot of the fans, and the media, all all have [SEP]"}
+{"type": "sample", "index": 45, "raw_text": "[CLS]. [SEP] cover the potatoes in minutes,, and then, and,, but then, again, later in the day, and in the end. [SEP] it is time to the weather, the heat, the crowd, the presence of heat, lights, jets, jets, showers,, hopefully, the rest of the event. [SEP] 1, 2,,,,,, on the date,,,,,,,,, and, in a week with a range of 50, 000 to more. [SEP] the years 2000, 2003, 2004,, 2002, 2004, 2004, and 2004, respectively. here, [SEP]", "detok_text": "[CLS]. [SEP] cover the potatoes in minutes,, and then, and,, but then, again, later in the day, and in the end. [SEP] it is time to the weather, the heat, the crowd, the presence of heat, lights, jets, jets, showers,, hopefully, the rest of the event. [SEP] 1, 2,,,,,, on the date,,,,,,,,, and, in a week with a range of 50, 000 to more. [SEP] the years 2000, 2003, 2004,, 2002, 2004, 2004, and 2004, respectively. here, [SEP]"}
+{"type": "sample", "index": 46, "raw_text": "[CLS], ohio, ohio, and cleveland, ohio. [SEP] 1997 - 98, chicago,, chicago, chicago, 1996, chicago, 1996 - 98, 1996, 1996,, 2000, 2004. the combination of, 89, 90, 1981, 1988 - 90,,,,,, 1985,,,,,, 89, and 98. [SEP] philadelphia ( 8 - 5 ) also got the second goal and four outs in a 2 - 2 victory, the longest - game - ever game. [SEP] in the midwest, chicago, michigan,, chicago, chicago, north carolina, chicago, chicago, chicago, st., [SEP]", "detok_text": "[CLS], ohio, ohio, and cleveland, ohio. [SEP] 1997 - 98, chicago,, chicago, chicago, 1996, chicago, 1996 - 98, 1996, 1996,, 2000, 2004. the combination of, 89, 90, 1981, 1988 - 90,,,,,, 1985,,,,,, 89, and 98. [SEP] philadelphia (8 - 5) also got the second goal and four outs in a 2 - 2 victory, the longest - game - ever game. [SEP] in the midwest, chicago, michigan,, chicago, chicago, north carolina, chicago, chicago, chicago, st., [SEP]"}
+{"type": "sample", "index": 47, "raw_text": "[CLS] he said. [SEP] you would like to have a face - to - face meeting with the same team - - chicago, chicago, post - season meeting in a couple of weeks, etc. [SEP] he led the delegation to the conference centre of the british embassy. [SEP] but, there ' s time to prepare the pasta and make a stew. [SEP] 2008 - 2008 $ 7. 7 percent ( 2. 0 ), - $ ( 13. 9 ) 8. 9 billion euros ( $ 17. 3 billion. [SEP] and all of that, in chicago, chicago, chicago, miami, miami, chicago, chicago, all of the [SEP]", "detok_text": "[CLS] he said. [SEP] you would like to have a face - to - face meeting with the same team - - chicago, chicago, post - season meeting in a couple of weeks, etc. [SEP] he led the delegation to the conference centre of the british embassy. [SEP] but, there's time to prepare the pasta and make a stew. [SEP] 2008 - 2008 $7. 7 percent (2. 0), - $(13. 9) 8. 9 billion euros ( $17. 3 billion. [SEP] and all of that, in chicago, chicago, chicago, miami, miami, chicago, chicago, all of the [SEP]"}
+{"type": "sample", "index": 48, "raw_text": "[CLS] - - sometimes literally, sometimes in a trance, all in the same way that they tell us. [SEP] \" now we can look at the numbers, we ' re going to make a big change at the moment. [SEP] then, then,, then, then, then, and then, it is the right thing to deal with. [SEP] on sunday, the white bulls will travel to the city for a road trip. [SEP] he led the first three batters, but the yankees and boston did the same in the first quarter. [SEP] chicago, chicago, chicago, chicago,, calgary, and chicago, oct. [SEP] the company [SEP]", "detok_text": "[CLS] - - sometimes literally, sometimes in a trance, all in the same way that they tell us. [SEP] \" now we can look at the numbers, we're going to make a big change at the moment. [SEP] then, then,, then, then, then, and then, it is the right thing to deal with. [SEP] on sunday, the white bulls will travel to the city for a road trip. [SEP] he led the first three batters, but the yankees and boston did the same in the first quarter. [SEP] chicago, chicago, chicago, chicago,, calgary, and chicago, oct. [SEP] the company [SEP]"}
+{"type": "sample", "index": 49, "raw_text": "[CLS]. [SEP] \" he seems to be clever, he gets away with it, he needs to be more flexible, much more flexible... more than a, well, more than a, less clever. [SEP] in a statement to the conference board, dr james sanderson, regional director for the g & g - g schools and health organisation, said that the increase in additional loan commitments had an average value of $ 2. 6 million, up from $ 4. 9 million, at the year ' s end. [SEP] you will need a full trip -,,,,,, - - that comes later, not later, [SEP]", "detok_text": "[CLS]. [SEP] \" he seems to be clever, he gets away with it, he needs to be more flexible, much more flexible... more than a, well, more than a, less clever. [SEP] in a statement to the conference board, dr james sanderson, regional director for the g & g - g schools and health organisation, said that the increase in additional loan commitments had an average value of $2. 6 million, up from $4. 9 million, at the year's end. [SEP] you will need a full trip -,,,,,, - - that comes later, not later, [SEP]"}
+{"type": "sample", "index": 50, "raw_text": "[CLS] would not seem to have it at the top. [SEP] the economy is back on the road, ok!..... you look, are we going to get it, leave it, end of the road?. [SEP] this time, day, day of the year, 50, 50, 52, 37, 52, and december. [SEP] the game is always in the middle and at the moment you have to be long enough to organize and take care of the right things. [SEP] on saturday, obama returned to kenya in a mood, a symbol of hope. [SEP] if they have managed to get back to a point of [SEP]", "detok_text": "[CLS] would not seem to have it at the top. [SEP] the economy is back on the road, ok!..... you look, are we going to get it, leave it, end of the road?. [SEP] this time, day, day of the year, 50, 50, 52, 37, 52, and december. [SEP] the game is always in the middle and at the moment you have to be long enough to organize and take care of the right things. [SEP] on saturday, obama returned to kenya in a mood, a symbol of hope. [SEP] if they have managed to get back to a point of [SEP]"}
+{"type": "sample", "index": 51, "raw_text": "[CLS], 2003,, 1996, 1996, 1996, 2002, \" he said. [SEP] \" they have a two - week plan - - then they have a day and day and day and day and and then, and here, we have a team in the playoffs. [SEP] district attorney stephen patterson said he had no complaints about sampson. [SEP] single - family suvs are at the back - to - back games, chicago, chicago, chicago, chicago and other cities. [SEP] there he was in 1988, 1988, 1988, 1988, 1996, 1996, 1996, 1996, 1988, 1997, 2002 - - dispiriting the [SEP]", "detok_text": "[CLS], 2003,, 1996, 1996, 1996, 2002, \"he said. [SEP]\" they have a two - week plan - - then they have a day and day and day and day and and then, and here, we have a team in the playoffs. [SEP] district attorney stephen patterson said he had no complaints about sampson. [SEP] single - family suvs are at the back - to - back games, chicago, chicago, chicago, chicago and other cities. [SEP] there he was in 1988, 1988, 1988, 1988, 1996, 1996, 1996, 1996, 1988, 1997, 2002 - - dispiriting the [SEP]"}
+{"type": "sample", "index": 52, "raw_text": "[CLS] the seasons 16, 14, 14, and 16. [SEP] the defendant, who ' s refused to grant such an order, told the court that two days earlier, he received about £100, 000. [SEP] i can ' t imagine that significant gains in housing - - and, small - value employment - - are in the deep recession. [SEP] december 14, 1893, u. s. troops, oct. [SEP] the nation ' s worst road game - - 14, 4, 000 - - was the worst game of the season. [SEP] for example, the firm said, 90 percent of single - and multi - family vehicles, which [SEP]", "detok_text": "[CLS] the seasons 16, 14, 14, and 16. [SEP] the defendant, who's refused to grant such an order, told the court that two days earlier, he received about £100, 000. [SEP] i can't imagine that significant gains in housing - - and, small - value employment - - are in the deep recession. [SEP] december 14, 1893, u. s. troops, oct. [SEP] the nation's worst road game - - 14, 4, 000 - - was the worst game of the season. [SEP] for example, the firm said, 90 percent of single - and multi - family vehicles, which [SEP]"}
+{"type": "sample", "index": 53, "raw_text": "[CLS] for free, flights, flights - - and, in all, for the holidays. [SEP] the 6 - 15, 16, 17, 15, 15,, 18, 25,, 26, came to the end and 50, 50, and quit. [SEP] at that, he would have a year to live and a year to live. [SEP] however, bread and butter does not seem to lose its sparkle in the morning, so it is a good time to turn the boil on. [SEP] he spent a week with the dolphins in the chicago area, then turned twice in games to the bengals. [SEP] the first protests were started in [SEP]", "detok_text": "[CLS] for free, flights, flights - - and, in all, for the holidays. [SEP] the 6 - 15, 16, 17, 15, 15,, 18, 25,, 26, came to the end and 50, 50, and quit. [SEP] at that, he would have a year to live and a year to live. [SEP] however, bread and butter does not seem to lose its sparkle in the morning, so it is a good time to turn the boil on. [SEP] he spent a week with the dolphins in the chicago area, then turned twice in games to the bengals. [SEP] the first protests were started in [SEP]"}
+{"type": "sample", "index": 54, "raw_text": "[CLS] come from outside the united states, spokesman robert kelly said. [SEP] for example, the original path, the top - the - road, and the roof appeared on the back end, along with the entire back seat. [SEP] \" the celtics took a face - to - face trip to a 14 - game series, back - to, back - and - forth. [SEP] in the second quarter, they beat the celtics, the chicago bulls, the chicago bears, so 0 - 1 that they went on to win - - either. [SEP] in atlanta, chicago, chicago, chicago, chicago, chicago, and again. [SEP] \" the secret [SEP]", "detok_text": "[CLS] come from outside the united states, spokesman robert kelly said. [SEP] for example, the original path, the top - the - road, and the roof appeared on the back end, along with the entire back seat. [SEP] \"the celtics took a face - to - face trip to a 14 - game series, back - to, back - and - forth. [SEP] in the second quarter, they beat the celtics, the chicago bulls, the chicago bears, so 0 - 1 that they went on to win - - either. [SEP] in atlanta, chicago, chicago, chicago, chicago, chicago, and again. [SEP]\" the secret [SEP]"}
+{"type": "sample", "index": 55, "raw_text": "[CLS]. [SEP] 2. 13 - 2, detroit 7 - 11, detroit 11 - 1 - 2, detroit, s. chicago, detroit 11 - 14 - 1. 26 ). [SEP] the dow jones industrial index dropped by 2. 8 percentage points. [SEP] 18, 2007, is the \" day of the year, \" she said. [SEP] the teams chicago, boston, chicago, boston,, and carolina - chicago. [SEP] however, the final games of the conference are teams in the playoffs, boston, chicago, chicago, chicago, detroit and chicago,, detroit, detroit, detroit and miami. [SEP] \" the problem is that [SEP]", "detok_text": "[CLS]. [SEP] 2. 13 - 2, detroit 7 - 11, detroit 11 - 1 - 2, detroit, s. chicago, detroit 11 - 14 - 1. 26 ). [SEP] the dow jones industrial index dropped by 2. 8 percentage points. [SEP] 18, 2007, is the \"day of the year,\" she said. [SEP] the teams chicago, boston, chicago, boston,, and carolina - chicago. [SEP] however, the final games of the conference are teams in the playoffs, boston, chicago, chicago, chicago, detroit and chicago,, detroit, detroit, detroit and miami. [SEP] \" the problem is that [SEP]"}
+{"type": "sample", "index": 56, "raw_text": "[CLS] in 50, 50, 60, 60,,,,,,,,,,,, 48, and was a key support for future operations. [SEP] total copies of the numbers are : men ' s 50, 73, 73, 73, 48,, 52, 52, 52, 52, 49, 48, 49, 52, 50, 52, 48, of the total, respectively. [SEP] the numbers 45, 37, 51, 51, 51, 51,,,,,, 18,,,, 18, 37, 37, 37, 37, 37, 37, 37, 52,, 48 [SEP]", "detok_text": "[CLS] in 50, 50, 60, 60,,,,,,,,,,,, 48, and was a key support for future operations. [SEP] total copies of the numbers are: men's 50, 73, 73, 73, 48,, 52, 52, 52, 52, 49, 48, 49, 52, 50, 52, 48, of the total, respectively. [SEP] the numbers 45, 37, 51, 51, 51, 51,,,,,, 18,,,, 18, 37, 37, 37, 37, 37, 37, 37, 52,, 48 [SEP]"}
+{"type": "sample", "index": 57, "raw_text": "[CLS] in turn. the time with the rest of week - - to - back. to - back - to - back, late - milan - to - boston - again, afternoon - late - night days. [SEP] period days, 36, 36, 27, 26, 37, 37, 37, 31, 37, 37, 45, - 48, 48, 52, 51, 48, 48, 48.... days, 36, days to take over all of the days, december, december,, 38, 36, days to end up with ice - in days, then sit down on the ice. [SEP] he [SEP]", "detok_text": "[CLS] in turn. the time with the rest of week - - to - back. to - back - to - back, late - milan - to - boston - again, afternoon - late - night days. [SEP] period days, 36, 36, 27, 26, 37, 37, 37, 31, 37, 37, 45, - 48, 48, 52, 51, 48, 48, 48.... days, 36, days to take over all of the days, december, december,, 38, 36, days to end up with ice - in days, then sit down on the ice. [SEP] he [SEP]"}
+{"type": "sample", "index": 58, "raw_text": "[CLS] s., chicago,, chicago,, chicago. [SEP] 8, 14, 2009. [SEP] the worst of the recession is, as a result, the worst of the global downturn. [SEP] take a bottle of the water, the water, the wine, the bread, the milk bottle, the office, the office. [SEP] numbers of, 15, 16,, 13, 15, 17, 17,, 15, 15,, 15, 31,, 15, 15, 21, 18,, 18, 23, 24,, etc., 13, 18, 24,,,,,,,,, [SEP]", "detok_text": "[CLS] s., chicago,, chicago,, chicago. [SEP] 8, 14, 2009. [SEP] the worst of the recession is, as a result, the worst of the global downturn. [SEP] take a bottle of the water, the water, the wine, the bread, the milk bottle, the office, the office. [SEP] numbers of, 15, 16,, 13, 15, 17, 17,, 15, 15,, 15, 31,, 15, 15, 21, 18,, 18, 23, 24,, etc., 13, 18, 24,,,,,,,,, [SEP]"}
+{"type": "sample", "index": 59, "raw_text": "[CLS] rules in order to comply. [SEP] finally, the moment of relief was one to away. [SEP] and there are more than, think, of, a very few things. [SEP] for now, the cavaliers are back in the lead - -, perhaps, even in the playoffs, though. [SEP] but instead of winning detroit, detroit, miami, detroit ' s - - 14 win at atlanta - - the broncos took their season on top. [SEP] \" in the face of a recession, it is hard to get the economy back to the ground, to get close enough to dry up in the near term, \" said the u. s [SEP]", "detok_text": "[CLS] rules in order to comply. [SEP] finally, the moment of relief was one to away. [SEP] and there are more than, think, of, a very few things. [SEP] for now, the cavaliers are back in the lead - -, perhaps, even in the playoffs, though. [SEP] but instead of winning detroit, detroit, miami, detroit's - - 14 win at atlanta - - the broncos took their season on top. [SEP] \"in the face of a recession, it is hard to get the economy back to the ground, to get close enough to dry up in the near term,\" said the u. s [SEP]"}
+{"type": "sample", "index": 60, "raw_text": "[CLS] health care. [SEP] the movement in the system is the product of short - term, not short - term ideology. [SEP] he will make, sell, design,, service,, sell, service, and produce, a furniture, kitchen, bakery and services company. [SEP] the problem is similar to the stadium that was built a week after the incident, which came after a 17 - 14 win, 38 - 14 loss in the city. [SEP] this is the amount of warmth and sense of warmth and emotional closeness. [SEP] los angeles - if james brown isn ' t even back in a playoff situation, the cleveland magic can move on to [SEP]", "detok_text": "[CLS] health care. [SEP] the movement in the system is the product of short - term, not short - term ideology. [SEP] he will make, sell, design,, service,, sell, service, and produce, a furniture, kitchen, bakery and services company. [SEP] the problem is similar to the stadium that was built a week after the incident, which came after a 17 - 14 win, 38 - 14 loss in the city. [SEP] this is the amount of warmth and sense of warmth and emotional closeness. [SEP] los angeles - if james brown isn't even back in a playoff situation, the cleveland magic can move on to [SEP]"}
+{"type": "sample", "index": 61, "raw_text": "[CLS] flight in chicago, and then a private flight to chicago, and a flight from chicago. [SEP] on monday, the president will travel to the capital to lay a three - year wreath on the road to a peace agreement. [SEP] it then translates to 14, 18, 50, 50, and so. [SEP] i have to wait in london for a number of days, week, week - - and he ' s 50, 50, 50, 50, 50. [SEP] he will never have anything. [SEP] it is chicago, chicago, chicago, chicago, chicago, and chicago. [SEP] the midwest region, michigan, chicago, texas, [SEP]", "detok_text": "[CLS] flight in chicago, and then a private flight to chicago, and a flight from chicago. [SEP] on monday, the president will travel to the capital to lay a three - year wreath on the road to a peace agreement. [SEP] it then translates to 14, 18, 50, 50, and so. [SEP] i have to wait in london for a number of days, week, week - - and he's 50, 50, 50, 50, 50. [SEP] he will never have anything. [SEP] it is chicago, chicago, chicago, chicago, chicago, and chicago. [SEP] the midwest region, michigan, chicago, texas, [SEP]"}
+{"type": "sample", "index": 62, "raw_text": "[CLS] itself as the \" mother of hope. \" [SEP] the rally marked the end of a five - year trend as it turned to the mid - term. [SEP] on a, 14, 16, 16,, 15, 14 - - on a 10, 15, 15, 16,, 16,, 18, 24, at the end - - he seemed to make a point of himself. [SEP] that is a mark of weakness. [SEP] the pillars of the building ' s roof were blown up. [SEP] after the diagnosis, i came back to the hospital to see that i would have a doctor on the way to the hospital. [SEP] [SEP]", "detok_text": "[CLS] itself as the \"mother of hope.\" [SEP] the rally marked the end of a five - year trend as it turned to the mid - term. [SEP] on a, 14, 16, 16,, 15, 14 - - on a 10, 15, 15, 16,, 16,, 18, 24, at the end - - he seemed to make a point of himself. [SEP] that is a mark of weakness. [SEP] the pillars of the building's roof were blown up. [SEP] after the diagnosis, i came back to the hospital to see that i would have a doctor on the way to the hospital. [SEP] [SEP]"}
+{"type": "sample", "index": 63, "raw_text": "[CLS] $ 150 a ton, about 20 percent of the original cost. [SEP] i would provide an answer to your right question. [SEP] it might well be okay to eat, but not want to go to sleep in front of the sofa. [SEP] in 1919, on the fourth day of december, he died in the palace hotel in london. [SEP] he was returned to the courtroom and in the process had to make the case back again. [SEP] weeks,, weeks,, weeks, or months. [SEP] 21, 2007, when south dakota state police chief jim brown said he made a decision to buy the plane. [SEP] \" it ' s a [SEP]", "detok_text": "[CLS] $150 a ton, about 20 percent of the original cost. [SEP] i would provide an answer to your right question. [SEP] it might well be okay to eat, but not want to go to sleep in front of the sofa. [SEP] in 1919, on the fourth day of december, he died in the palace hotel in london. [SEP] he was returned to the courtroom and in the process had to make the case back again. [SEP] weeks,, weeks,, weeks, or months. [SEP] 21, 2007, when south dakota state police chief jim brown said he made a decision to buy the plane. [SEP] \" it's a [SEP]"}

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_32/state_c256_t1p45_detok_raw_samples.txt

@@ -0,0 +1,228 @@
+state_c256_t1p45_detok
+{
+  "type": "summary",
+  "name": "state_c256_t1p45",
+  "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt",
+  "step": 124000,
+  "decode": {
+    "kind": "categorical_fullvocab",
+    "config": "state_c256_t1p45",
+    "steps": 32,
+    "model_t_mode": "post",
+    "support_power": 1.0,
+    "semantic_power": 1.0,
+    "endpoint_temp": 1.45,
+    "concentration_min": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 44.930859242990756,
+    "nll_per_token": 3.8051248469363923,
+    "tokens": 9366
+  },
+  "diversity": {
+    "sample_entropy": 3.7823763722555808,
+    "unique_tokens": 1422,
+    "token_count": 8192,
+    "distinct_1": 0.173583984375,
+    "distinct_2": 0.5745570866141733,
+    "top_token_mass": 0.11572265625
+  }
+}
+
+===== sample 000 =====
+[CLS] season, high - season games, it was so good that a lot of them make that impact. [SEP] there is also a little warmth to the young wife, michelle (who is attached to the story, but to the novel, not all of it, too). [SEP] "there will be times when you know you have to put your hat on to you. [SEP]" sometimes we just get off to get around, " he said. [SEP] he did not even let himself in on the side of the court building. [SEP] he finished the night of full - court drama. [SEP] the project, called the development of the research to [SEP]
+
+===== sample 001 =====
+[CLS] in his room, however, maybe in 1962 - - maybe once a week in 1981. [SEP] and the knicks' trip of the season, back to cleveland, back to the new stadium. [SEP] if it's the perfect time, mix the eggs, add, finally, the flour, and turn over the panes of the flour. [SEP] "i have to go for it," ronaldo said. [SEP] " the government was really prepared to do it. [SEP] this is a new approach. [SEP] however, the man, known as mr colla's lawyer, was unable to make a court statement. [SEP] that ' [SEP]
+
+===== sample 002 =====
+[CLS] said. [SEP] to do that, there's all the difference. [SEP] at least a half - - some 60 - - are priced at around £1, 000. [SEP] at the start of the show, the performers turned the main arena into a small, box - and - room full of music, love, and bits of a rock star. [SEP] the conservatives, who raised £5. 6m in the past year, said the election result was "unfair." [SEP] since then they are required to admit in their consent that one reflects on them while sitting in the same house. [SEP] ap reporters contributed from gaza. [SEP] meanwhile, [SEP]
+
+===== sample 003 =====
+[CLS] of the current crisis. [SEP] there is such thing as a mask, a mask, a... " [SEP] at the height of that period, he managed to escape when he was, in fact, known as the bank of england in ireland. [SEP] add together, add bread, bread, butter, the eggs, bacon, the juices, and cheese. [SEP] in a process that takes back to, say, to,, to, to see, the location, not the time, a place where things is going on often, the day is, the is, and the day with an air. [SEP] he would have [SEP]
+
+===== sample 004 =====
+[CLS] 0830 gmt. [SEP] "we have a lot of time in looking for a new plan, but we have not gone with it with our plan, and we look up with," he said. [SEP] the answer, trying to turn out what it is, often comes on a long day. [SEP] he's had a all - star all - star season break. [SEP] the rest of the day,,,,,,,,,,,,,,,,,,,, i have seen, and said, what it is, opportunity to come, explain, and come and believe it. [SEP] he [SEP]
+
+===== sample 005 =====
+[CLS] s caffeine, stuck in london, and sat around waiting for several months to move off, before landing in the open in new york and landing, again, in new york with chris stewart and pat williams. [SEP] "if they're going to negotiate, they say'vote for you,'" said wright, on the subject of an interview. [SEP] the center's annual sell - out to a street is for thursday. [SEP] after all, the absence of money from football is significant. [SEP] in some sense, that place has built up a bit of a small space that, a little, of course, a [SEP]
+
+===== sample 006 =====
+[CLS] over the course of the grind, add the diagonal side, then, in the time, to the horizontal side, begin to. - break a pattern, slice the pastry in a small, again. - - again, again at a 15 - point point, half, half,, half, for a different kind of pattern. - then, as the heel, back in turn, again in the back, to top the line in time. - - the foot's turn to turn, line, turn to, out of shape. [SEP] the answer. [SEP] when i take off it seems to take off again, to the [SEP]
+
+===== sample 007 =====
+[CLS] losses. [SEP] and they have to remember that their mission was not to invent words but to invent them. [SEP] granted, i see - in, week,, week, there was the only day, in the event of change, of ", for nothing, "of" year, for day at work " and in the game of rest - - well, a good day. [SEP] in fact, the road has to do and the road has to work, but it is not there. [SEP] 7, anaheim 0 (18 - 16 - 30 saves). [SEP] canada, brazil, brazil, thailand, turkey, thailand [SEP]
+
+===== sample 008 =====
+[CLS] black - headed nabullah khan, a hot - voiced jewish figure who loves one's way of life, are lonely, unable to reveal, literally, brilliantly,, almost sulkly. [SEP] now, the teams have spent years of working out the differences. [SEP] the service includes weeks of driving in one direction, perhaps for the first time, and on - and drive - in between hours. [SEP] weaver, who hit a two - run rbi homer and an rbi homer, closed to a perfect 10 for the first time since. [SEP] it's because the democrats are just a drain on democracy, and it is [SEP]
+
+===== sample 009 =====
+[CLS] bill that went back - to - back investigations in 2004. [SEP] i wonder if they will do the same this time. [SEP] we have in days, days, then days, weeks and back in the air. [SEP] it's a forced - to - go back - to - back, you have a good idea. [SEP] now, the magic has gone out of fashion, - - - - - - - - - - - - - - - - - - - - - - - - - for a quarter - and - half - and - a - half -, the whole end of the whole, 2008, a little [SEP]
+
+===== sample 010 =====
+[CLS] day, brings to mark the record of the 16 - year - old order. [SEP] he is likely to have gone to the moon in space. [SEP] mr brown said the us would not talk until the vote - counting was made in january. [SEP] the man's son's wife who lived in the city centre has moved up on a trip to chicago, and his family is home in east heath, ma. [SEP] that, after two 14 - game losses to the celtics' nemesis, the pistons and the washington bulls, resulted in a seven - game series, not three games. [SEP] the network's chief fire officer, [SEP]
+
+===== sample 011 =====
+[CLS] said it was making the decision to suspend operations. [SEP] it has to change... and it's just a day - by - day - by - day for your people to vote... ("is over").. [SEP] add the breads, then green, then, pre - season, bring over the butter with a small plate, then make a mix - - stirring, place in the oven, then until, stirring. [SEP] hill, who lost his right job monday, is on the road trip to his nemesis, the white sox. [SEP] " i'm sure everyone knows it. [SEP] his [SEP]
+
+===== sample 012 =====
+[CLS], can provide that kind of protection. [SEP] a slice - and - paste bag of paper was used to support the cabinet. [SEP] in fact, the ensuing bust - up led to the battle. [SEP] the journey of the island is not easy. [SEP] mix in a mixture of garlic, chilied, zeal, juice, black flour, red onion, cinnamon, garlic, cred, sugar - flour, tomato, tomato, and garlic, all of all in the water. [SEP] bring to the boil - - cover with the brown flour. [SEP] they do have the ability to sort the crap out of the system. [SEP] " [SEP]
+
+===== sample 013 =====
+[CLS] a lot of the journey to the idea of the most famous place, days, days.... and well, you would have to stop the place. [SEP] it is no longer clear that she was never dressed in the way it must have been at all before her. [SEP] it was at boston, detroit, cleveland - - - - - - - detroit, cleveland, chicago, miami, cleveland, the final days of the road game, boston - chicago, boston - - - in new york, chicago, chicago. [SEP] bobcats 100, denver 100: james wallace had 16 points and 10 rebounds. [SEP] for example, [SEP]
+
+===== sample 014 =====
+[CLS] in black, with the long eyes. [SEP] just place, in, together, on the tray, then grind - in place, place on the top, and back on the thin side. [SEP] sometimes, just sometimes - - just in the air, sometimes - - sometimes, just in the office, not ice, but i think i understand that you have to get back to the weekend,,,, back - then... and about 90 percent of that.... [SEP] the main line, which started friday, is a short - line of 2, 000 feet, the size of 1, 000 meters ( 2 [SEP]
+
+===== sample 015 =====
+[CLS] [SEP] brown, 17 years old, has admitted to the court to the charges, but has not responded to any charges. [SEP] monday, september 26, 2008, october 31, 2008. [SEP] "we will have to plant 10, 000 vehicles by the end of 2011, to be taken into production," he added, referring to projects in the east.. [SEP] the black and powdered buses rolled along the roads in china's capital, many of the trucks, and dozens of bridges, at the facades of government buildings. [SEP] "i have a crush, i need a vomit," his father said. [SEP] he, [SEP]
+
+===== sample 016 =====
+[CLS]. [SEP] i can't blame it to have to wait to tell people who all do. [SEP] the green clouds looked ominously over the tree, while the buildings moved from the first step toward their descent to trees. [SEP] i do want to know if you have an idea. [SEP] from the beginning, jim bradley's coffin, pinned to the name of willie walsh, was, if visible. [SEP] 1, for days 1, 1, 2003,, and 2008. [SEP] the 12 - week period was tendered for just two days and, for the first time, eight days, all due to the disruption, the commission [SEP]
+
+===== sample 017 =====
+[CLS] way, she's going to raise her head again, before going to pay attention that some of her best friends are going to make a try for you - - just to make it. [SEP] the stock market goes back a week after week, the reserve bank of chicago, week - week, week - week - - - - month. [SEP] weeks and days, i have walked back, again, to sleep. [SEP] the planes, planes,,, planes,,,,,,, the planes,,,,,,,,,,,, etc. [SEP] if you are on an unusual vacation, you can [SEP]
+
+===== sample 018 =====
+[CLS]daq. cash & e decreased by 4. 14 % to 4. 40 per share. $1, 3663 million, with cash flow charge continuing back to 65 %. balance by 2q0 _ 2009 - - c -0, the energy department. report. [SEP] pieces, including the skeletons, were separated into the remains of the plane, a line on the ground, half, half - - half, more than a half - minute longer than normal. [SEP] peanuts, f - 16s, crams, dunk, gap, bla, and paper - - - just a piece of weight, [SEP]
+
+===== sample 019 =====
+[CLS] report. [SEP] the colors of 70, 50 - 76, 80, 70 - 70, and other colors were noted for black, black, 60 - in, 50 - in, 60 - in, 60 - in -, 60 -, 60 -,, 60 -, -, 50 -, 50 -,, 60 -,, 50 -,, etc. [SEP] the magic led, 15 - 14, as the favorite to change cleveland's schedule. [SEP] what is said, to come, to write, to speak, is nothing,, not, nothing. [SEP] he also told potential investors that hefty profits [SEP]
+
+===== sample 020 =====
+[CLS] - - and the rest of the day - - in the same period. [SEP] ready - to - boil bread, bread - to - bread and ice bread, for example, are all - in - place bread, with deulated carrots to which they add. [SEP] in the end - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -... - - - - - - - - - - - - - - - - cut the breads and into a dish. [SEP] and in the know - [SEP]
+
+===== sample 021 =====
+[CLS] the pakistani leader. [SEP] he said. [SEP] after the kabul government abruptly shut down the country's three schools, however, the problem closed july 4, 2008. [SEP] these days, that has sent a second official to the city council, which declared in august that the building was mr. ameshi's "district council." [SEP] " there are not days, not days, of belief. [SEP] the number of women in england has been reduced to higher than at any time to higher education, the report said. [SEP] q: time for a 60, 50 and 50 years. [SEP] ann arbor, mich., [SEP]
+
+===== sample 022 =====
+[CLS], ill., with the same black vote (13. 7). [SEP] following a flight from the capital, in central africa, the aircraft will travel to london instead of flight, and then then flying to washington to london, on a first trip. [SEP] they are happy have a car, not have a dog they feel is good to offer them something. [SEP] half of the men who appeared with cuts to a range of 50m or less were described as the type - - with short build and more than vision. [SEP] 60, 80, 60, 50, 50, - - we need to get together in a minute, [SEP]
+
+===== sample 023 =====
+[CLS] up three areas of the country, that provided about 70 per cent of the votes for the march election. [SEP] azuz: it's a beautiful day - - chicago, massachusetts, etc. [SEP] the car then turned up "instinctively," and the thief turned to the line, she said. [SEP] in jackson, ga., a co - employee was arrested days after he was injured on interstate 2. [SEP] he is unable to explain the convictions he had a week before being arrested in connection with the death of a 3 - year - old boy in 2004. [SEP] not so much flour, but butter - - flavored with [SEP]
+
+===== sample 024 =====
+[CLS] to a 20 - 7 run... [SEP] as a child, my days at the airport, including in london and switzerland, and my 13 days in the hospital, germany, i've been cut from it and i'm very happy to get back in touch with them. [SEP] come on, time, time, day, lots of days, come out to the end of... a period of time we have, days, they have again,, it would be a little days, in time and again, in two and a half, the staff are being left to work. [SEP] even the american coach, [SEP]
+
+===== sample 025 =====
+[CLS] order. [SEP] if a guy was on the ground, he would look out on the wrong road. [SEP] and everything was down, just at home to chicago (this one) and all the above guys would have to throw in. [SEP] i don't think there is a way yet, try to put the lead - off, 18, 14, 14, 1 - 14, 11, 14, 11, 14 - 10, that's even do it to the end of the whole season. [SEP] " it seems that we have the right thing to do, just to say,, to say, we'll have to [SEP]
+
+===== sample 026 =====
+[CLS] 74, spent the end of his half - life as a military man. [SEP] many young people to take up work - day, after - school or evening hours, or return to work for school holidays after being cut by the city government. [SEP] i wish i have had a little more time there before we heard him go, " she said. [SEP] it is one - packed, it just looks obvious, and not the end - to - end thing. [SEP] he was hit just three times in a second - round game on the road for his team in the first round of 2004 - 97. [SEP] on sunday, chicago and chicago [SEP]
+
+===== sample 027 =====
+[CLS] are not known. [SEP] but, yes, we can't be the kind of thing that we can understand, that's not a good thing. [SEP] if you call it a fire for such people, the physical process is something different for a us soldier. [SEP] "the shares are at a half - point," said a trader. [SEP] and again, he's just right. [SEP] he added that diplomacy is the only way to get us to do what he wants. [SEP] "but short - talk is the best way to get going," he said. [SEP] it may just be time for an eye - to [SEP]
+
+===== sample 028 =====
+[CLS] the house has to packed up, the owner told me yesterday, but then he has a place to cover their windows and in winter at night he can turn their lights out. [SEP] "i walked in a pretty nice way." [SEP] the stadium, which has been synonymous with tradition since 1973, arrived in the opening round of competition for the first time at center field in chicago, in the same, the loss of the old ground to a 17th division championship. [SEP] the barclays seemed to keep showing up at all. [SEP] here in london, i make a joke, about christmas, christmas, and christmas pudding. [SEP] he was [SEP]
+
+===== sample 029 =====
+[CLS] too bad. [SEP] for one - - though, they won't be forgotten. [SEP] and the penguins are out of the playoffs - - line, line by area and point, area by area. [SEP] it was to be a great effort, and that was to get on a plane to a... on the plane, to try and end the argument. [SEP] the u. s. refused to be requests to comment. [SEP] it's a little weird day - to - day.... i just talked to someone beforehand on when to turn and how to get to in time. [SEP] a: we do know [SEP]
+
+===== sample 030 =====
+[CLS] to cool relations. [SEP] these kids have no time to get together. [SEP] by now, the government had been made to remember the word, "taking the shower," by mr heaney, who was served as the prisoner of war. [SEP] it is a bit harder to get in the race. [SEP] finally, she did in a state of shock. [SEP] the company, meanwhile, made chairs, shoes, linens, chairs, and wipers, all, and place, a mattress manufacturer, moved from dry to dry to fresh snow. [SEP] " we went to a three - day conference - style conference on saturday, [SEP]
+
+===== sample 031 =====
+[CLS], blessings in the choir and, like him, a church. [SEP] there is a feeling, "they give you a lift," he added, "in the words, in english," red, white and white. [SEP] without it, it is not an all - american - style bread with a knife and baking flour. [SEP] the marbles were conspirated in china and argentina (they were wooden furniture and displays of life at auschwitz during world war ii). [SEP] he didn't sit and do the day's work and out of the bedroom, and he was on the floor. [SEP] the u. [SEP]
+
+===== sample 032 =====
+[CLS] to 1968, to the end of 1963, to the french point - - "oh, again. [SEP]" it seems... [SEP] even if not, " the bill will never be signed into law. [SEP] the company hopes that the figures can help to double its forecast of full - month sales since the recession began in january because of an 80 per cent increase the previous year expected. [SEP] on this day it seems so obvious he would be climbing, toe - twisting,, writing down the top, standing down to the back door, a white hat, a dog, in all, a black hat, and a dog, [SEP]
+
+===== sample 033 =====
+[CLS] - two weeks or a step ahead of schedule while on the ground, the house is open, along with the roof, roof, the roof and the central units. [SEP] both playwrights met with a friend, and they began to work together. [SEP] we got in travel. [SEP] but, now, the pain is greater than he had to lay his home for 10 hours. [SEP] the nets won three of in all of sept. [SEP] in chicago, he won the previous two, in chicago, then, to detroit in december. [SEP] beijing (ap) - - a little mask might seem to make a difference, the u. [SEP]
+
+===== sample 034 =====
+[CLS] have thought for now, even in the deep dark, of the story's glory. [SEP] of that, there are a total of 1, 000... [SEP] 1 ), at the boil, in turn, for a day, is as big as a pan of red bread, and no gas is needed. [SEP] " it's important that we can have a genuine resolve. [SEP] whether this is a really bad line, or not. [SEP] she even gets to sing for the new group - - 'my friends'. [SEP] however, he said, the new vote has failed to a date. [SEP] and then, [SEP]
+
+===== sample 035 =====
+[CLS] to help a person buy,, well, a rubber chair, or two - pack of pillows. [SEP] the panel wanted to act, just to sort it out a bit, and i decided this to be a way to keep the conversation going for years. [SEP] it was like, late into the day, you have to work hard together.... [SEP] however, he is the type to work, and he still needs to go out and get his way around. [SEP] i, up again and again, that day, afternoon and afternoon, and, after the week, the day, the day after, i went to the [SEP]
+
+===== sample 036 =====
+[CLS] all ages. [SEP] mr. lecce. [SEP] of course, he is wrong, but he is a joke. [SEP] i think that, a lot, has to be said, and wait, there are some options for change, so that we are having a referendum on things. [SEP] but still, look a little closer, especially in the first half, and you will be able to get down for you. [SEP] in fact, i can e - type it on the allergy in relation to the bread, butter, chit, milk, cheese, and bread - cheese. [SEP] the association also calls for councils to pay [SEP]
+
+===== sample 037 =====
+[CLS] ago, but that was not even a good story. [SEP] as bernanke is known, brown, brown, brown, brown, brown, brown, the rat, the dumpling, the swi, the bakek - dog, the sheep, the goats, the sheep, and the dog, the bi - racial - etc. [SEP] "we are here for day, day, night, and night. [SEP]" not one, not one - - maybe he can be a defender, " he said. [SEP] mr brown also warned he would not face difficult working conditions for the afghan police forces, even if he had [SEP]
+
+===== sample 038 =====
+[CLS] sort of pushed back three times in over a week but had to take his chance to drop out of the race. [SEP] "the first shot from the beginning, the one - hit, the more than 500, the jets, the nets, the celtics, and they're all together," he said. [SEP] jason satter was the director of the 15 - year - old in the history of the golden states, and was a producer on the 20 - member project. [SEP] a row of students and two staff took place at the end of the school in february 2006. [SEP] a liar, " he will not have the beans [SEP]
+
+===== sample 039 =====
+[CLS] road. [SEP] the magic led, 38 - 17, including 15 points into the game. [SEP] the bottom line is that the day is the last week, period, and then you get out the window... [SEP] i.... trains, planes and, of course, road cars, roads, buses, trains, and trains. [SEP] government officials have said the plane had begun delivering back to the airport in 2004, but that the flight - 93 was named for the repair crew. [SEP] yeah, the fat - duck question needs to be answered and put in the... [SEP] it's gone on, but [SEP]
+
+===== sample 040 =====
+[CLS] from time to time to in..... then again, that was the tv at the time to turn to day to day - - right before the screen. [SEP] it is the moment in front of the start of a meal and by the end, just to make a basket at the end. [SEP] the other aircraft did not show up at to 1, 000 feet, or by helicopter. [SEP] he wanted to hold his breath when the news fell out, before getting off to end when he was not going to start again. [SEP] it was a black, back in 2003, a pre - season, half - in. [SEP]
+
+===== sample 041 =====
+[CLS], on the edge of the pool in the double - story bed, sits on a piece of deep - brown paper. [SEP] on the other side of the road some of the anti - protesters protest at the soldiers' deaths. [SEP] and it might have had to do to the big time, non - money - - the whole thing has never stopped. [SEP] but in the end, it was usually, just once a year, but a year later, for a lot of months now, and a three years later, it will never have been again. [SEP] but for a moment we just have begun. [SEP] the 36 - year - [SEP]
+
+===== sample 042 =====
+[CLS] championship, and sports council officials said johnson's focus was beyond on four games, three - hour games, two games and a one - game - - two - week event. [SEP] it's 1, 000 acres, a 100, 000 - acre area. [SEP] however, for good, everything, which seems like nothing, is rubbish. [SEP] "we are already in the works to have something to go down, a lot to move in with us. [SEP]" the thought was' yes, if they come out, " he said. [SEP] the cause of the crash, which happened a couple of hours after the road was [SEP]
+
+===== sample 043 =====
+[CLS], have to sell their money in a country, for free, or for the eu, or in italy. [SEP] that said it was the place to be done, and to feel, in a cold local room, we would take a few hours to try out the cheese, place and place it together on a final package, a black - white dip, half - red meats, carrots and salt, vanilla and black - pepper. [SEP] the federal government's new savings figure, released in february, fell sharply from the 7. 9 percent - year figure from the same period in november last year. [SEP] " at the [SEP]
+
+===== sample 044 =====
+[CLS] 3 days, days, days, days, 14 days..... and 4 days, 3 days, 2 days, days, 2 days, days, 3 days, 14 days, days, days, 2 days, 2 days, days, days, days, 11 days, days, days, 12 days, 4 days, days, 4 days and 4 days, days, days, back together on a normal days, and 2 hours and days in hours, days, days. [SEP] then, come the sun the sun, and then there is a little bit of sun. [SEP] that's a great idea to [SEP]
+
+===== sample 045 =====
+[CLS], according to the international monetary bank. [SEP] they said in a statement that there is a lot of evidence in their efforts to move on the issue. [SEP] it turns out that the race line is written in real knots. [SEP] today, we are in the mid - 50, 50,, 50, a year of the day. [SEP] 4, 2, 10, 15, 14, 17,, 16, 15, 21, 15, 26, 15,, 15, 16, 15, 49, 37. [SEP] in the summer of 2008, rbs reported $90, 000 in security costs between now and december 2000, [SEP]
+
+===== sample 046 =====
+[CLS] home -owners, welfare and jobs ). [SEP] it seems that the security measures are most likely to be put in place up to now. [SEP] the sense of fear surely will not gain before the minds of students return to participating in their school life. [SEP] with a little more depth,, then, then, sometimes, and sautes. [SEP] pittsburgh, panthers 2 mike danley got the second goal and five assists in a 2 - 2 victory, and mike fisher scored the first - goal early of the game to seal the win. [SEP] then, a remember... the boys come into love with me. [SEP] [SEP]
+
+===== sample 047 =====
+[CLS] in advance of the christmas olympics. [SEP] the bread is crisp on the outside, with the top with all the butter and juices - - to return in a small pan to the bottom. [SEP] he led his club to the conference floor when the game ended. [SEP] but, it's hard to imagine the americans making such a point. [SEP] the service sector and the contract are expected to reach a 16. 0 - m (1) - 3m depth at the time (16. 2m). [SEP] for some of these, he just turns to,'s (er), and he is.... [SEP]
+
+===== sample 048 =====
+[CLS],,,,,,,,,,, and the end. - - - - - down the road.. - -, well, we're going to get a more field day in the end, some point, maybe, and we will have to buy a real plan, but we have a better day with a better picture. [SEP] 4 (upi) - - toronto blue bulls, u. s. team toronto, bulls - - the bulls was back in boston for the second straight no. 1. [SEP] " the situation goes back to 1997. [SEP] so, these days, the creation of a group [SEP]
+
+===== sample 049 =====
+[CLS]. [SEP] if we stick to a similar conversation, then say, " that was, to be more casual, what we all wanted to do. [SEP] the course of everything, the start of the week at the end of the day, for days, and then again in year, week, after day. [SEP] at the end of september 2009, there was the increase in additional loan losses at an average value of $4. 8 million, up from $11. 9 million, in the same period of 2009. [SEP] the shares need to be sold - - or, say, a better - - sold. [SEP] 1845: we [SEP]
+
+===== sample 050 =====
+[CLS] he brought down the front page is... [SEP] sevek, 13: 10 minutes - - half, half, half, half and half - again, but it was about half - hour, half - time. [SEP] by day, day, day of the week, half - day, wake - up period, how much that time, how little is changed in. [SEP] finally, instead of a minute - just long enough to forget and take a further look at it. [SEP] instead, they are learning to put on the bed, so go to bath, in which they have access to get paid to a play. [SEP]
+
+===== sample 051 =====
+[CLS], 24, of leytons, was arrested. [SEP] then 65, 65, 60, 50 in the morning and then half - 52.... for the afternoon, -..., - - 50, 50, a - 60, a - 52, the celtics were 50, 60, 50, 50, and 50 - - and, after all, 50, 50 - - 50, 50, 60, 50, 50,, 52. [SEP] today, a week, 24, 40, 37, 50, 50, and time in the afternoon, for 30 to 45 seconds. [SEP] in australia, the [SEP]
+
+===== sample 052 =====
+[CLS] - hour, 80 - mile journey, taking nearly a year to get by. [SEP] the fall - off corruption trial took place when the court heard that a brazilian businessman had lost over 25, 000 hectares worth of land. [SEP] all his work, the wooden structure - - based on long, period structure - - became the story of the installation. [SEP] easttown, s. s. vancouver, sept. [SEP] while he's just for christmas - - the end of the christmas season - - his son, chris, has had a decent campaign this week - - perhaps. [SEP] 4 (upi) - - u. s [SEP]
+
+===== sample 053 =====
+[CLS] typically trade in at 90 % - 40 % in current market prices, and do not rise until further in the winter. [SEP] put out of the juices, cut in a large saucepan, and season the butter and ice at half - hour time. [SEP] and the same thing could have happened.... [SEP] in a bowl, place for a close and reduce to half - size flour, bring in a place, so that is a more satisfying choice for the whole family. [SEP] ian wexer, a researcher with the medical office, examined the children in one of their studies. [SEP] the move came to months in [SEP]
+
+===== sample 054 =====
+[CLS]. [SEP] yes, " white house spokesman gordon young said. [SEP] so clearly, for after days, the perfect time to go, to take the trail back to, after dark, back in the dark place. [SEP] he tells us, and, then, then, why not only is he mean, really, but also he, he said, he is. [SEP] a pan of coconut butter hung on the right side of a rice, thin - scented baking machine. [SEP] unfortunately, america is unable to stand the balance again (and then again, of course,, again, again and again) on the line to the original and [SEP]
+
+===== sample 055 =====
+[CLS]. [SEP] 2. 6bn ) to multi - year investment gains made in the last three years, up to 0. 6 per cent year - on - year, year - to - year - to - date up from 4. 7 per cent in 1998 - 07. [SEP] "business travel is driven by entrepreneurship," she said. [SEP] i've had to say everything, and we've got to talk. [SEP] however, according to his brother david, who led the investigation, "he was able to go back.. [SEP] and then again, then, now, now and again. [SEP]" if i could get [SEP]
+
+===== sample 056 =====
+[CLS] in traditional schools. [SEP] shoes are often visible - - and largees of shoes, blankets, harnesses and linens are just to follow. [SEP] "we took some of the essence of the show's character from time to time to time," he says. [SEP] if you want to act, let us laugh, feel, talk, think - - eat, to get home and a bit of sleep. [SEP] today, here he was by side, in the back - room, in a short, quiet place in the middle of night, and in the centre of the evening, he can be, for days, a [SEP]
+
+===== sample 057 =====
+[CLS] period, and the time to,,,,,,,, starting with a week,,, no one,,,,,... and, then, again, the rest is enough to do everything again... [SEP] it is very bad and wants to do it more efficiently. [SEP] the work of dr. spitz, a mathematician, who jumps and writes,,,,,, days in the back of a plane, takes for a lot of days for the beginning, then, sometimes, then,, to come up with check - in beginning, then set up on a path in the end [SEP]
+
+===== sample 058 =====
+[CLS] s way of things, which is his own goal. [SEP] it is a great indeed. [SEP] the good thing is, remember, if a coach is get out of the deal, but he has hit over the top of it in the deal, that he makes the deal again, on the plane, on dhl today. [SEP] 2007 - - - - - - - - - - - - - - - - - - as of december 31, 2007, 31 - 2007 - 13, 0230 - £29, 000 - £175, 000, in 2008 - 31, 000 - 300. the actual number 501 ( 1 [SEP]
+
+===== sample 059 =====
+[CLS] 2010, it is clear. [SEP] however, the end of 2006 was a first step. [SEP] and there is more to come to make of, and very few excuses. [SEP] in fact, the crowd roared and then finally brought it to a halt, quickly turning the show into again. [SEP] the producers realize, however, that works like pillows and rinses are just examples of a child stopper's passion for child care. [SEP] "in the face of this road, i urge you to read this constitution, to make sure to be better, working, to get better and stay better," said the u. s [SEP]
+
+===== sample 060 =====
+[CLS] health care. [SEP] i sat in the office for a minute of a single day, when he wanted to look me in the mirror, and got the answer. [SEP] the man who wrote, and spoke in italian, a fake and a fake, was photographed with the minister's apron, and the answer was written in white. [SEP] the forecast is expected to bring to 10 - 15, 000 tonnes of power capacity in the second quarter. [SEP] that means a top aide revenue rate of an additional 11 percent. [SEP] los angeles - the celtics have stumbled to a first victory in a playoff game, the first coming at the end of [SEP]
+
+===== sample 061 =====
+[CLS] stories and poetry, and so there are people to find historical and useful items from history. [SEP] in addition, the national civil' union, john kelly, wanted to make a comment on the deal in return so that companies would not be able to fund large "post - contract" - related work. [SEP] he told bbc news "one of a number of members at the wirral trust has been campaigning in favour of extending the line service. [SEP] i know, that is incredible. [SEP] so - - well, it would be that he has to" reckoned with respect " and the rest has to stop. [SEP] but then, [SEP]
+
+===== sample 062 =====
+[CLS] well as the nation, " he said. [SEP] the day's event was a two - hour period as it turned into a start - off. [SEP] then a - 4,, 5, 5, 5, and - - on a 10 - yard,, 11, 13, 100 - yard, and yard rally from a 10 - point, 11, for - 10 news conference. [SEP] it is a change of direction. [SEP] the majority of the bank's assets are in commercial mortgage - backed commercial securities, with most assets in relation to mortgage - backed securities, including fixed - income and other junior mortgages. [SEP] [SEP]
+
+===== sample 063 =====
+[CLS] $15 billion, down earnings a share in the first quarter. [SEP] i was not sure to look at, anywhere in his face - and then, and gone along with his way to talk about the job. [SEP] he just seems not to believe it's true. [SEP] so why do they want me to take the other children to their school and to the house and i'd have to watch the same thing again. [SEP] a police spokesman said: " this is an incredible mix of dark, orange, and blue, and like. [SEP] i feel like, i wonder why the council might want to turn it into a less [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_32/state_c256_t1p45_raw_samples.txt

@@ -0,0 +1,228 @@
+state_c256_t1p45
+{
+  "type": "summary",
+  "name": "state_c256_t1p45",
+  "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt",
+  "step": 124000,
+  "decode": {
+    "kind": "categorical_fullvocab",
+    "config": "state_c256_t1p45",
+    "steps": 32,
+    "model_t_mode": "post",
+    "support_power": 1.0,
+    "semantic_power": 1.0,
+    "endpoint_temp": 1.45,
+    "concentration_min": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 44.930859242990756,
+    "nll_per_token": 3.8051248469363923,
+    "tokens": 9366
+  },
+  "diversity": {
+    "sample_entropy": 3.7823763722555808,
+    "unique_tokens": 1422,
+    "token_count": 8192,
+    "distinct_1": 0.173583984375,
+    "distinct_2": 0.5745570866141733,
+    "top_token_mass": 0.11572265625
+  }
+}
+
+===== sample 000 =====
+[CLS] season, high - season games, it was so good that a lot of them make that impact. [SEP] there is also a little warmth to the young wife, michelle ( who is attached to the story, but to the novel, not all of it, too ). [SEP] " there will be times when you know you have to put your hat on to you. [SEP] " sometimes we just get off to get around, " he said. [SEP] he did not even let himself in on the side of the court building. [SEP] he finished the night of full - court drama. [SEP] the project, called the development of the research to [SEP]
+
+===== sample 001 =====
+[CLS] in his room, however, maybe in 1962 - - maybe once a week in 1981. [SEP] and the knicks ' trip of the season, back to cleveland, back to the new stadium. [SEP] if it ' s the perfect time, mix the eggs, add, finally, the flour, and turn over the panes of the flour. [SEP] " i have to go for it, " ronaldo said. [SEP] " the government was really prepared to do it. [SEP] this is a new approach. [SEP] however, the man, known as mr colla ' s lawyer, was unable to make a court statement. [SEP] that ' [SEP]
+
+===== sample 002 =====
+[CLS] said. [SEP] to do that, there ' s all the difference. [SEP] at least a half - - some 60 - - are priced at around £1, 000. [SEP] at the start of the show, the performers turned the main arena into a small, box - and - room full of music, love, and bits of a rock star. [SEP] the conservatives, who raised £5. 6m in the past year, said the election result was " unfair. " [SEP] since then they are required to admit in their consent that one reflects on them while sitting in the same house. [SEP] ap reporters contributed from gaza. [SEP] meanwhile, [SEP]
+
+===== sample 003 =====
+[CLS] of the current crisis. [SEP] there is such thing as a mask, a mask, a... " [SEP] at the height of that period, he managed to escape when he was, in fact, known as the bank of england in ireland. [SEP] add together, add bread, bread, butter, the eggs, bacon, the juices, and cheese. [SEP] in a process that takes back to, say, to,, to, to see, the location, not the time, a place where things is going on often, the day is, the is, and the day with an air. [SEP] he would have [SEP]
+
+===== sample 004 =====
+[CLS] 0830 gmt. [SEP] " we have a lot of time in looking for a new plan, but we have not gone with it with our plan, and we look up with, " he said. [SEP] the answer, trying to turn out what it is, often comes on a long day. [SEP] he ' s had a all - star all - star season break. [SEP] the rest of the day,,,,,,,,,,,,,,,,,,,, i have seen, and said, what it is, opportunity to come, explain, and come and believe it. [SEP] he [SEP]
+
+===== sample 005 =====
+[CLS] s caffeine, stuck in london, and sat around waiting for several months to move off, before landing in the open in new york and landing, again, in new york with chris stewart and pat williams. [SEP] " if they ' re going to negotiate, they say ' vote for you, ' " said wright, on the subject of an interview. [SEP] the center ' s annual sell - out to a street is for thursday. [SEP] after all, the absence of money from football is significant. [SEP] in some sense, that place has built up a bit of a small space that, a little, of course, a [SEP]
+
+===== sample 006 =====
+[CLS] over the course of the grind, add the diagonal side, then, in the time, to the horizontal side, begin to. - break a pattern, slice the pastry in a small, again. - - again, again at a 15 - point point, half, half,, half, for a different kind of pattern. - then, as the heel, back in turn, again in the back, to top the line in time. - - the foot ' s turn to turn, line, turn to, out of shape. [SEP] the answer. [SEP] when i take off it seems to take off again, to the [SEP]
+
+===== sample 007 =====
+[CLS] losses. [SEP] and they have to remember that their mission was not to invent words but to invent them. [SEP] granted, i see - in, week,, week, there was the only day, in the event of change, of ", for nothing, " of " year, for day at work " and in the game of rest - - well, a good day. [SEP] in fact, the road has to do and the road has to work, but it is not there. [SEP] 7, anaheim 0 ( 18 - 16 - 30 saves ). [SEP] canada, brazil, brazil, thailand, turkey, thailand [SEP]
+
+===== sample 008 =====
+[CLS] black - headed nabullah khan, a hot - voiced jewish figure who loves one ' s way of life, are lonely, unable to reveal, literally, brilliantly,, almost sulkly. [SEP] now, the teams have spent years of working out the differences. [SEP] the service includes weeks of driving in one direction, perhaps for the first time, and on - and drive - in between hours. [SEP] weaver, who hit a two - run rbi homer and an rbi homer, closed to a perfect 10 for the first time since. [SEP] it ' s because the democrats are just a drain on democracy, and it is [SEP]
+
+===== sample 009 =====
+[CLS] bill that went back - to - back investigations in 2004. [SEP] i wonder if they will do the same this time. [SEP] we have in days, days, then days, weeks and back in the air. [SEP] it ' s a forced - to - go back - to - back, you have a good idea. [SEP] now, the magic has gone out of fashion, - - - - - - - - - - - - - - - - - - - - - - - - - for a quarter - and - half - and - a - half -, the whole end of the whole, 2008, a little [SEP]
+
+===== sample 010 =====
+[CLS] day, brings to mark the record of the 16 - year - old order. [SEP] he is likely to have gone to the moon in space. [SEP] mr brown said the us would not talk until the vote - counting was made in january. [SEP] the man ' s son ' s wife who lived in the city centre has moved up on a trip to chicago, and his family is home in east heath, ma. [SEP] that, after two 14 - game losses to the celtics ' nemesis, the pistons and the washington bulls, resulted in a seven - game series, not three games. [SEP] the network ' s chief fire officer, [SEP]
+
+===== sample 011 =====
+[CLS] said it was making the decision to suspend operations. [SEP] it has to change... and it ' s just a day - by - day - by - day for your people to vote... ( " is over " ).. [SEP] add the breads, then green, then, pre - season, bring over the butter with a small plate, then make a mix - - stirring, place in the oven, then until, stirring. [SEP] hill, who lost his right job monday, is on the road trip to his nemesis, the white sox. [SEP] " i ' m sure everyone knows it. [SEP] his [SEP]
+
+===== sample 012 =====
+[CLS], can provide that kind of protection. [SEP] a slice - and - paste bag of paper was used to support the cabinet. [SEP] in fact, the ensuing bust - up led to the battle. [SEP] the journey of the island is not easy. [SEP] mix in a mixture of garlic, chilied, zeal, juice, black flour, red onion, cinnamon, garlic, cred, sugar - flour, tomato, tomato, and garlic, all of all in the water. [SEP] bring to the boil - - cover with the brown flour. [SEP] they do have the ability to sort the crap out of the system. [SEP] " [SEP]
+
+===== sample 013 =====
+[CLS] a lot of the journey to the idea of the most famous place, days, days.... and well, you would have to stop the place. [SEP] it is no longer clear that she was never dressed in the way it must have been at all before her. [SEP] it was at boston, detroit, cleveland - - - - - - - detroit, cleveland, chicago, miami, cleveland, the final days of the road game, boston - chicago, boston - - - in new york, chicago, chicago. [SEP] bobcats 100, denver 100 : james wallace had 16 points and 10 rebounds. [SEP] for example, [SEP]
+
+===== sample 014 =====
+[CLS] in black, with the long eyes. [SEP] just place, in, together, on the tray, then grind - in place, place on the top, and back on the thin side. [SEP] sometimes, just sometimes - - just in the air, sometimes - - sometimes, just in the office, not ice, but i think i understand that you have to get back to the weekend,,,, back - then... and about 90 percent of that.... [SEP] the main line, which started friday, is a short - line of 2, 000 feet, the size of 1, 000 meters ( 2 [SEP]
+
+===== sample 015 =====
+[CLS] [SEP] brown, 17 years old, has admitted to the court to the charges, but has not responded to any charges. [SEP] monday, september 26, 2008, october 31, 2008. [SEP] " we will have to plant 10, 000 vehicles by the end of 2011, to be taken into production, " he added, referring to projects in the east.. [SEP] the black and powdered buses rolled along the roads in china ' s capital, many of the trucks, and dozens of bridges, at the facades of government buildings. [SEP] " i have a crush, i need a vomit, " his father said. [SEP] he, [SEP]
+
+===== sample 016 =====
+[CLS]. [SEP] i can ' t blame it to have to wait to tell people who all do. [SEP] the green clouds looked ominously over the tree, while the buildings moved from the first step toward their descent to trees. [SEP] i do want to know if you have an idea. [SEP] from the beginning, jim bradley ' s coffin, pinned to the name of willie walsh, was, if visible. [SEP] 1, for days 1, 1, 2003,, and 2008. [SEP] the 12 - week period was tendered for just two days and, for the first time, eight days, all due to the disruption, the commission [SEP]
+
+===== sample 017 =====
+[CLS] way, she ' s going to raise her head again, before going to pay attention that some of her best friends are going to make a try for you - - just to make it. [SEP] the stock market goes back a week after week, the reserve bank of chicago, week - week, week - week - - - - month. [SEP] weeks and days, i have walked back, again, to sleep. [SEP] the planes, planes,,, planes,,,,,,, the planes,,,,,,,,,,,, etc. [SEP] if you are on an unusual vacation, you can [SEP]
+
+===== sample 018 =====
+[CLS]daq. cash & e decreased by 4. 14 % to 4. 40 per share. $ 1, 3663 million, with cash flow charge continuing back to 65 %. balance by 2q0 _ 2009 - - c -0, the energy department. report. [SEP] pieces, including the skeletons, were separated into the remains of the plane, a line on the ground, half, half - - half, more than a half - minute longer than normal. [SEP] peanuts, f - 16s, crams, dunk, gap, bla, and paper - - - just a piece of weight, [SEP]
+
+===== sample 019 =====
+[CLS] report. [SEP] the colors of 70, 50 - 76, 80, 70 - 70, and other colors were noted for black, black, 60 - in, 50 - in, 60 - in, 60 - in -, 60 -, 60 -,, 60 -, -, 50 -, 50 -,, 60 -,, 50 -,, etc. [SEP] the magic led, 15 - 14, as the favorite to change cleveland ' s schedule. [SEP] what is said, to come, to write, to speak, is nothing,, not, nothing. [SEP] he also told potential investors that hefty profits [SEP]
+
+===== sample 020 =====
+[CLS] - - and the rest of the day - - in the same period. [SEP] ready - to - boil bread, bread - to - bread and ice bread, for example, are all - in - place bread, with deulated carrots to which they add. [SEP] in the end - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -... - - - - - - - - - - - - - - - - cut the breads and into a dish. [SEP] and in the know - [SEP]
+
+===== sample 021 =====
+[CLS] the pakistani leader. [SEP] he said. [SEP] after the kabul government abruptly shut down the country ' s three schools, however, the problem closed july 4, 2008. [SEP] these days, that has sent a second official to the city council, which declared in august that the building was mr. ameshi ' s " district council. " [SEP] " there are not days, not days, of belief. [SEP] the number of women in england has been reduced to higher than at any time to higher education, the report said. [SEP] q : time for a 60, 50 and 50 years. [SEP] ann arbor, mich., [SEP]
+
+===== sample 022 =====
+[CLS], ill., with the same black vote ( 13. 7 ). [SEP] following a flight from the capital, in central africa, the aircraft will travel to london instead of flight, and then then flying to washington to london, on a first trip. [SEP] they are happy have a car, not have a dog they feel is good to offer them something. [SEP] half of the men who appeared with cuts to a range of 50m or less were described as the type - - with short build and more than vision. [SEP] 60, 80, 60, 50, 50, - - we need to get together in a minute, [SEP]
+
+===== sample 023 =====
+[CLS] up three areas of the country, that provided about 70 per cent of the votes for the march election. [SEP] azuz : it ' s a beautiful day - - chicago, massachusetts, etc. [SEP] the car then turned up " instinctively, " and the thief turned to the line, she said. [SEP] in jackson, ga., a co - employee was arrested days after he was injured on interstate 2. [SEP] he is unable to explain the convictions he had a week before being arrested in connection with the death of a 3 - year - old boy in 2004. [SEP] not so much flour, but butter - - flavored with [SEP]
+
+===== sample 024 =====
+[CLS] to a 20 - 7 run... [SEP] as a child, my days at the airport, including in london and switzerland, and my 13 days in the hospital, germany, i ' ve been cut from it and i ' m very happy to get back in touch with them. [SEP] come on, time, time, day, lots of days, come out to the end of... a period of time we have, days, they have again,, it would be a little days, in time and again, in two and a half, the staff are being left to work. [SEP] even the american coach, [SEP]
+
+===== sample 025 =====
+[CLS] order. [SEP] if a guy was on the ground, he would look out on the wrong road. [SEP] and everything was down, just at home to chicago ( this one ) and all the above guys would have to throw in. [SEP] i don ' t think there is a way yet, try to put the lead - off, 18, 14, 14, 1 - 14, 11, 14, 11, 14 - 10, that ' s even do it to the end of the whole season. [SEP] " it seems that we have the right thing to do, just to say,, to say, we ' ll have to [SEP]
+
+===== sample 026 =====
+[CLS] 74, spent the end of his half - life as a military man. [SEP] many young people to take up work - day, after - school or evening hours, or return to work for school holidays after being cut by the city government. [SEP] i wish i have had a little more time there before we heard him go, " she said. [SEP] it is one - packed, it just looks obvious, and not the end - to - end thing. [SEP] he was hit just three times in a second - round game on the road for his team in the first round of 2004 - 97. [SEP] on sunday, chicago and chicago [SEP]
+
+===== sample 027 =====
+[CLS] are not known. [SEP] but, yes, we can ' t be the kind of thing that we can understand, that ' s not a good thing. [SEP] if you call it a fire for such people, the physical process is something different for a us soldier. [SEP] " the shares are at a half - point, " said a trader. [SEP] and again, he ' s just right. [SEP] he added that diplomacy is the only way to get us to do what he wants. [SEP] " but short - talk is the best way to get going, " he said. [SEP] it may just be time for an eye - to [SEP]
+
+===== sample 028 =====
+[CLS] the house has to packed up, the owner told me yesterday, but then he has a place to cover their windows and in winter at night he can turn their lights out. [SEP] " i walked in a pretty nice way. " [SEP] the stadium, which has been synonymous with tradition since 1973, arrived in the opening round of competition for the first time at center field in chicago, in the same, the loss of the old ground to a 17th division championship. [SEP] the barclays seemed to keep showing up at all. [SEP] here in london, i make a joke, about christmas, christmas, and christmas pudding. [SEP] he was [SEP]
+
+===== sample 029 =====
+[CLS] too bad. [SEP] for one - - though, they won ' t be forgotten. [SEP] and the penguins are out of the playoffs - - line, line by area and point, area by area. [SEP] it was to be a great effort, and that was to get on a plane to a... on the plane, to try and end the argument. [SEP] the u. s. refused to be requests to comment. [SEP] it ' s a little weird day - to - day.... i just talked to someone beforehand on when to turn and how to get to in time. [SEP] a : we do know [SEP]
+
+===== sample 030 =====
+[CLS] to cool relations. [SEP] these kids have no time to get together. [SEP] by now, the government had been made to remember the word, " taking the shower, " by mr heaney, who was served as the prisoner of war. [SEP] it is a bit harder to get in the race. [SEP] finally, she did in a state of shock. [SEP] the company, meanwhile, made chairs, shoes, linens, chairs, and wipers, all, and place, a mattress manufacturer, moved from dry to dry to fresh snow. [SEP] " we went to a three - day conference - style conference on saturday, [SEP]
+
+===== sample 031 =====
+[CLS], blessings in the choir and, like him, a church. [SEP] there is a feeling, " they give you a lift, " he added, " in the words, in english, " red, white and white. [SEP] without it, it is not an all - american - style bread with a knife and baking flour. [SEP] the marbles were conspirated in china and argentina ( they were wooden furniture and displays of life at auschwitz during world war ii ). [SEP] he didn ' t sit and do the day ' s work and out of the bedroom, and he was on the floor. [SEP] the u. [SEP]
+
+===== sample 032 =====
+[CLS] to 1968, to the end of 1963, to the french point - - " oh, again. [SEP] " it seems... [SEP] even if not, " the bill will never be signed into law. [SEP] the company hopes that the figures can help to double its forecast of full - month sales since the recession began in january because of an 80 per cent increase the previous year expected. [SEP] on this day it seems so obvious he would be climbing, toe - twisting,, writing down the top, standing down to the back door, a white hat, a dog, in all, a black hat, and a dog, [SEP]
+
+===== sample 033 =====
+[CLS] - two weeks or a step ahead of schedule while on the ground, the house is open, along with the roof, roof, the roof and the central units. [SEP] both playwrights met with a friend, and they began to work together. [SEP] we got in travel. [SEP] but, now, the pain is greater than he had to lay his home for 10 hours. [SEP] the nets won three of in all of sept. [SEP] in chicago, he won the previous two, in chicago, then, to detroit in december. [SEP] beijing ( ap ) - - a little mask might seem to make a difference, the u. [SEP]
+
+===== sample 034 =====
+[CLS] have thought for now, even in the deep dark, of the story ' s glory. [SEP] of that, there are a total of 1, 000... [SEP] 1 ), at the boil, in turn, for a day, is as big as a pan of red bread, and no gas is needed. [SEP] " it ' s important that we can have a genuine resolve. [SEP] whether this is a really bad line, or not. [SEP] she even gets to sing for the new group - - ' my friends '. [SEP] however, he said, the new vote has failed to a date. [SEP] and then, [SEP]
+
+===== sample 035 =====
+[CLS] to help a person buy,, well, a rubber chair, or two - pack of pillows. [SEP] the panel wanted to act, just to sort it out a bit, and i decided this to be a way to keep the conversation going for years. [SEP] it was like, late into the day, you have to work hard together.... [SEP] however, he is the type to work, and he still needs to go out and get his way around. [SEP] i, up again and again, that day, afternoon and afternoon, and, after the week, the day, the day after, i went to the [SEP]
+
+===== sample 036 =====
+[CLS] all ages. [SEP] mr. lecce. [SEP] of course, he is wrong, but he is a joke. [SEP] i think that, a lot, has to be said, and wait, there are some options for change, so that we are having a referendum on things. [SEP] but still, look a little closer, especially in the first half, and you will be able to get down for you. [SEP] in fact, i can e - type it on the allergy in relation to the bread, butter, chit, milk, cheese, and bread - cheese. [SEP] the association also calls for councils to pay [SEP]
+
+===== sample 037 =====
+[CLS] ago, but that was not even a good story. [SEP] as bernanke is known, brown, brown, brown, brown, brown, brown, the rat, the dumpling, the swi, the bakek - dog, the sheep, the goats, the sheep, and the dog, the bi - racial - etc. [SEP] " we are here for day, day, night, and night. [SEP] " not one, not one - - maybe he can be a defender, " he said. [SEP] mr brown also warned he would not face difficult working conditions for the afghan police forces, even if he had [SEP]
+
+===== sample 038 =====
+[CLS] sort of pushed back three times in over a week but had to take his chance to drop out of the race. [SEP] " the first shot from the beginning, the one - hit, the more than 500, the jets, the nets, the celtics, and they ' re all together, " he said. [SEP] jason satter was the director of the 15 - year - old in the history of the golden states, and was a producer on the 20 - member project. [SEP] a row of students and two staff took place at the end of the school in february 2006. [SEP] a liar, " he will not have the beans [SEP]
+
+===== sample 039 =====
+[CLS] road. [SEP] the magic led, 38 - 17, including 15 points into the game. [SEP] the bottom line is that the day is the last week, period, and then you get out the window... [SEP] i.... trains, planes and, of course, road cars, roads, buses, trains, and trains. [SEP] government officials have said the plane had begun delivering back to the airport in 2004, but that the flight - 93 was named for the repair crew. [SEP] yeah, the fat - duck question needs to be answered and put in the... [SEP] it ' s gone on, but [SEP]
+
+===== sample 040 =====
+[CLS] from time to time to in..... then again, that was the tv at the time to turn to day to day - - right before the screen. [SEP] it is the moment in front of the start of a meal and by the end, just to make a basket at the end. [SEP] the other aircraft did not show up at to 1, 000 feet, or by helicopter. [SEP] he wanted to hold his breath when the news fell out, before getting off to end when he was not going to start again. [SEP] it was a black, back in 2003, a pre - season, half - in. [SEP]
+
+===== sample 041 =====
+[CLS], on the edge of the pool in the double - story bed, sits on a piece of deep - brown paper. [SEP] on the other side of the road some of the anti - protesters protest at the soldiers ' deaths. [SEP] and it might have had to do to the big time, non - money - - the whole thing has never stopped. [SEP] but in the end, it was usually, just once a year, but a year later, for a lot of months now, and a three years later, it will never have been again. [SEP] but for a moment we just have begun. [SEP] the 36 - year - [SEP]
+
+===== sample 042 =====
+[CLS] championship, and sports council officials said johnson ' s focus was beyond on four games, three - hour games, two games and a one - game - - two - week event. [SEP] it ' s 1, 000 acres, a 100, 000 - acre area. [SEP] however, for good, everything, which seems like nothing, is rubbish. [SEP] " we are already in the works to have something to go down, a lot to move in with us. [SEP] " the thought was ' yes, if they come out, " he said. [SEP] the cause of the crash, which happened a couple of hours after the road was [SEP]
+
+===== sample 043 =====
+[CLS], have to sell their money in a country, for free, or for the eu, or in italy. [SEP] that said it was the place to be done, and to feel, in a cold local room, we would take a few hours to try out the cheese, place and place it together on a final package, a black - white dip, half - red meats, carrots and salt, vanilla and black - pepper. [SEP] the federal government ' s new savings figure, released in february, fell sharply from the 7. 9 percent - year figure from the same period in november last year. [SEP] " at the [SEP]
+
+===== sample 044 =====
+[CLS] 3 days, days, days, days, 14 days..... and 4 days, 3 days, 2 days, days, 2 days, days, 3 days, 14 days, days, days, 2 days, 2 days, days, days, days, 11 days, days, days, 12 days, 4 days, days, 4 days and 4 days, days, days, back together on a normal days, and 2 hours and days in hours, days, days. [SEP] then, come the sun the sun, and then there is a little bit of sun. [SEP] that ' s a great idea to [SEP]
+
+===== sample 045 =====
+[CLS], according to the international monetary bank. [SEP] they said in a statement that there is a lot of evidence in their efforts to move on the issue. [SEP] it turns out that the race line is written in real knots. [SEP] today, we are in the mid - 50, 50,, 50, a year of the day. [SEP] 4, 2, 10, 15, 14, 17,, 16, 15, 21, 15, 26, 15,, 15, 16, 15, 49, 37. [SEP] in the summer of 2008, rbs reported $ 90, 000 in security costs between now and december 2000, [SEP]
+
+===== sample 046 =====
+[CLS] home -owners, welfare and jobs ). [SEP] it seems that the security measures are most likely to be put in place up to now. [SEP] the sense of fear surely will not gain before the minds of students return to participating in their school life. [SEP] with a little more depth,, then, then, sometimes, and sautes. [SEP] pittsburgh, panthers 2 mike danley got the second goal and five assists in a 2 - 2 victory, and mike fisher scored the first - goal early of the game to seal the win. [SEP] then, a remember... the boys come into love with me. [SEP] [SEP]
+
+===== sample 047 =====
+[CLS] in advance of the christmas olympics. [SEP] the bread is crisp on the outside, with the top with all the butter and juices - - to return in a small pan to the bottom. [SEP] he led his club to the conference floor when the game ended. [SEP] but, it ' s hard to imagine the americans making such a point. [SEP] the service sector and the contract are expected to reach a 16. 0 - m ( 1 ) - 3m depth at the time ( 16. 2m ). [SEP] for some of these, he just turns to, ' s ( er ), and he is.... [SEP]
+
+===== sample 048 =====
+[CLS],,,,,,,,,,, and the end. - - - - - down the road.. - -, well, we ' re going to get a more field day in the end, some point, maybe, and we will have to buy a real plan, but we have a better day with a better picture. [SEP] 4 ( upi ) - - toronto blue bulls, u. s. team toronto, bulls - - the bulls was back in boston for the second straight no. 1. [SEP] " the situation goes back to 1997. [SEP] so, these days, the creation of a group [SEP]
+
+===== sample 049 =====
+[CLS]. [SEP] if we stick to a similar conversation, then say, " that was, to be more casual, what we all wanted to do. [SEP] the course of everything, the start of the week at the end of the day, for days, and then again in year, week, after day. [SEP] at the end of september 2009, there was the increase in additional loan losses at an average value of $ 4. 8 million, up from $ 11. 9 million, in the same period of 2009. [SEP] the shares need to be sold - - or, say, a better - - sold. [SEP] 1845 : we [SEP]
+
+===== sample 050 =====
+[CLS] he brought down the front page is... [SEP] sevek, 13 : 10 minutes - - half, half, half, half and half - again, but it was about half - hour, half - time. [SEP] by day, day, day of the week, half - day, wake - up period, how much that time, how little is changed in. [SEP] finally, instead of a minute - just long enough to forget and take a further look at it. [SEP] instead, they are learning to put on the bed, so go to bath, in which they have access to get paid to a play. [SEP]
+
+===== sample 051 =====
+[CLS], 24, of leytons, was arrested. [SEP] then 65, 65, 60, 50 in the morning and then half - 52.... for the afternoon, -..., - - 50, 50, a - 60, a - 52, the celtics were 50, 60, 50, 50, and 50 - - and, after all, 50, 50 - - 50, 50, 60, 50, 50,, 52. [SEP] today, a week, 24, 40, 37, 50, 50, and time in the afternoon, for 30 to 45 seconds. [SEP] in australia, the [SEP]
+
+===== sample 052 =====
+[CLS] - hour, 80 - mile journey, taking nearly a year to get by. [SEP] the fall - off corruption trial took place when the court heard that a brazilian businessman had lost over 25, 000 hectares worth of land. [SEP] all his work, the wooden structure - - based on long, period structure - - became the story of the installation. [SEP] easttown, s. s. vancouver, sept. [SEP] while he ' s just for christmas - - the end of the christmas season - - his son, chris, has had a decent campaign this week - - perhaps. [SEP] 4 ( upi ) - - u. s [SEP]
+
+===== sample 053 =====
+[CLS] typically trade in at 90 % - 40 % in current market prices, and do not rise until further in the winter. [SEP] put out of the juices, cut in a large saucepan, and season the butter and ice at half - hour time. [SEP] and the same thing could have happened.... [SEP] in a bowl, place for a close and reduce to half - size flour, bring in a place, so that is a more satisfying choice for the whole family. [SEP] ian wexer, a researcher with the medical office, examined the children in one of their studies. [SEP] the move came to months in [SEP]
+
+===== sample 054 =====
+[CLS]. [SEP] yes, " white house spokesman gordon young said. [SEP] so clearly, for after days, the perfect time to go, to take the trail back to, after dark, back in the dark place. [SEP] he tells us, and, then, then, why not only is he mean, really, but also he, he said, he is. [SEP] a pan of coconut butter hung on the right side of a rice, thin - scented baking machine. [SEP] unfortunately, america is unable to stand the balance again ( and then again, of course,, again, again and again ) on the line to the original and [SEP]
+
+===== sample 055 =====
+[CLS]. [SEP] 2. 6bn ) to multi - year investment gains made in the last three years, up to 0. 6 per cent year - on - year, year - to - year - to - date up from 4. 7 per cent in 1998 - 07. [SEP] " business travel is driven by entrepreneurship, " she said. [SEP] i ' ve had to say everything, and we ' ve got to talk. [SEP] however, according to his brother david, who led the investigation, " he was able to go back.. [SEP] and then again, then, now, now and again. [SEP] " if i could get [SEP]
+
+===== sample 056 =====
+[CLS] in traditional schools. [SEP] shoes are often visible - - and largees of shoes, blankets, harnesses and linens are just to follow. [SEP] " we took some of the essence of the show ' s character from time to time to time, " he says. [SEP] if you want to act, let us laugh, feel, talk, think - - eat, to get home and a bit of sleep. [SEP] today, here he was by side, in the back - room, in a short, quiet place in the middle of night, and in the centre of the evening, he can be, for days, a [SEP]
+
+===== sample 057 =====
+[CLS] period, and the time to,,,,,,,, starting with a week,,, no one,,,,,... and, then, again, the rest is enough to do everything again... [SEP] it is very bad and wants to do it more efficiently. [SEP] the work of dr. spitz, a mathematician, who jumps and writes,,,,,, days in the back of a plane, takes for a lot of days for the beginning, then, sometimes, then,, to come up with check - in beginning, then set up on a path in the end [SEP]
+
+===== sample 058 =====
+[CLS] s way of things, which is his own goal. [SEP] it is a great indeed. [SEP] the good thing is, remember, if a coach is get out of the deal, but he has hit over the top of it in the deal, that he makes the deal again, on the plane, on dhl today. [SEP] 2007 - - - - - - - - - - - - - - - - - - as of december 31, 2007, 31 - 2007 - 13, 0230 - £29, 000 - £175, 000, in 2008 - 31, 000 - 300. the actual number 501 ( 1 [SEP]
+
+===== sample 059 =====
+[CLS] 2010, it is clear. [SEP] however, the end of 2006 was a first step. [SEP] and there is more to come to make of, and very few excuses. [SEP] in fact, the crowd roared and then finally brought it to a halt, quickly turning the show into again. [SEP] the producers realize, however, that works like pillows and rinses are just examples of a child stopper ' s passion for child care. [SEP] " in the face of this road, i urge you to read this constitution, to make sure to be better, working, to get better and stay better, " said the u. s [SEP]
+
+===== sample 060 =====
+[CLS] health care. [SEP] i sat in the office for a minute of a single day, when he wanted to look me in the mirror, and got the answer. [SEP] the man who wrote, and spoke in italian, a fake and a fake, was photographed with the minister ' s apron, and the answer was written in white. [SEP] the forecast is expected to bring to 10 - 15, 000 tonnes of power capacity in the second quarter. [SEP] that means a top aide revenue rate of an additional 11 percent. [SEP] los angeles - the celtics have stumbled to a first victory in a playoff game, the first coming at the end of [SEP]
+
+===== sample 061 =====
+[CLS] stories and poetry, and so there are people to find historical and useful items from history. [SEP] in addition, the national civil ' union, john kelly, wanted to make a comment on the deal in return so that companies would not be able to fund large " post - contract " - related work. [SEP] he told bbc news " one of a number of members at the wirral trust has been campaigning in favour of extending the line service. [SEP] i know, that is incredible. [SEP] so - - well, it would be that he has to " reckoned with respect " and the rest has to stop. [SEP] but then, [SEP]
+
+===== sample 062 =====
+[CLS] well as the nation, " he said. [SEP] the day ' s event was a two - hour period as it turned into a start - off. [SEP] then a - 4,, 5, 5, 5, and - - on a 10 - yard,, 11, 13, 100 - yard, and yard rally from a 10 - point, 11, for - 10 news conference. [SEP] it is a change of direction. [SEP] the majority of the bank ' s assets are in commercial mortgage - backed commercial securities, with most assets in relation to mortgage - backed securities, including fixed - income and other junior mortgages. [SEP] [SEP]
+
+===== sample 063 =====
+[CLS] $ 15 billion, down earnings a share in the first quarter. [SEP] i was not sure to look at, anywhere in his face - and then, and gone along with his way to talk about the job. [SEP] he just seems not to believe it ' s true. [SEP] so why do they want me to take the other children to their school and to the house and i ' d have to watch the same thing again. [SEP] a police spokesman said : " this is an incredible mix of dark, orange, and blue, and like. [SEP] i feel like, i wonder why the council might want to turn it into a less [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_32/state_c256_t1p45_scored.jsonl

@@ -0,0 +1,65 @@
+{"type": "summary", "name": "state_c256_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c256_t1p45", "steps": 32, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 44.930859242990756, "nll_per_token": 3.8051248469363923, "tokens": 9366}, "diversity": {"sample_entropy": 3.7823763722555808, "unique_tokens": 1422, "token_count": 8192, "distinct_1": 0.173583984375, "distinct_2": 0.5745570866141733, "top_token_mass": 0.11572265625}}
+{"type": "sample", "index": 0, "raw_text": "[CLS] season, high - season games, it was so good that a lot of them make that impact. [SEP] there is also a little warmth to the young wife, michelle ( who is attached to the story, but to the novel, not all of it, too ). [SEP] \" there will be times when you know you have to put your hat on to you. [SEP] \" sometimes we just get off to get around, \" he said. [SEP] he did not even let himself in on the side of the court building. [SEP] he finished the night of full - court drama. [SEP] the project, called the development of the research to [SEP]", "detok_text": "[CLS] season, high - season games, it was so good that a lot of them make that impact. [SEP] there is also a little warmth to the young wife, michelle (who is attached to the story, but to the novel, not all of it, too). [SEP] \"there will be times when you know you have to put your hat on to you. [SEP]\" sometimes we just get off to get around, \" he said. [SEP] he did not even let himself in on the side of the court building. [SEP] he finished the night of full - court drama. [SEP] the project, called the development of the research to [SEP]"}
+{"type": "sample", "index": 1, "raw_text": "[CLS] in his room, however, maybe in 1962 - - maybe once a week in 1981. [SEP] and the knicks ' trip of the season, back to cleveland, back to the new stadium. [SEP] if it ' s the perfect time, mix the eggs, add, finally, the flour, and turn over the panes of the flour. [SEP] \" i have to go for it, \" ronaldo said. [SEP] \" the government was really prepared to do it. [SEP] this is a new approach. [SEP] however, the man, known as mr colla ' s lawyer, was unable to make a court statement. [SEP] that ' [SEP]", "detok_text": "[CLS] in his room, however, maybe in 1962 - - maybe once a week in 1981. [SEP] and the knicks' trip of the season, back to cleveland, back to the new stadium. [SEP] if it's the perfect time, mix the eggs, add, finally, the flour, and turn over the panes of the flour. [SEP] \"i have to go for it,\" ronaldo said. [SEP] \" the government was really prepared to do it. [SEP] this is a new approach. [SEP] however, the man, known as mr colla's lawyer, was unable to make a court statement. [SEP] that ' [SEP]"}
+{"type": "sample", "index": 2, "raw_text": "[CLS] said. [SEP] to do that, there ' s all the difference. [SEP] at least a half - - some 60 - - are priced at around £1, 000. [SEP] at the start of the show, the performers turned the main arena into a small, box - and - room full of music, love, and bits of a rock star. [SEP] the conservatives, who raised £5. 6m in the past year, said the election result was \" unfair. \" [SEP] since then they are required to admit in their consent that one reflects on them while sitting in the same house. [SEP] ap reporters contributed from gaza. [SEP] meanwhile, [SEP]", "detok_text": "[CLS] said. [SEP] to do that, there's all the difference. [SEP] at least a half - - some 60 - - are priced at around £1, 000. [SEP] at the start of the show, the performers turned the main arena into a small, box - and - room full of music, love, and bits of a rock star. [SEP] the conservatives, who raised £5. 6m in the past year, said the election result was \"unfair.\" [SEP] since then they are required to admit in their consent that one reflects on them while sitting in the same house. [SEP] ap reporters contributed from gaza. [SEP] meanwhile, [SEP]"}
+{"type": "sample", "index": 3, "raw_text": "[CLS] of the current crisis. [SEP] there is such thing as a mask, a mask, a... \" [SEP] at the height of that period, he managed to escape when he was, in fact, known as the bank of england in ireland. [SEP] add together, add bread, bread, butter, the eggs, bacon, the juices, and cheese. [SEP] in a process that takes back to, say, to,, to, to see, the location, not the time, a place where things is going on often, the day is, the is, and the day with an air. [SEP] he would have [SEP]", "detok_text": "[CLS] of the current crisis. [SEP] there is such thing as a mask, a mask, a... \" [SEP] at the height of that period, he managed to escape when he was, in fact, known as the bank of england in ireland. [SEP] add together, add bread, bread, butter, the eggs, bacon, the juices, and cheese. [SEP] in a process that takes back to, say, to,, to, to see, the location, not the time, a place where things is going on often, the day is, the is, and the day with an air. [SEP] he would have [SEP]"}
+{"type": "sample", "index": 4, "raw_text": "[CLS] 0830 gmt. [SEP] \" we have a lot of time in looking for a new plan, but we have not gone with it with our plan, and we look up with, \" he said. [SEP] the answer, trying to turn out what it is, often comes on a long day. [SEP] he ' s had a all - star all - star season break. [SEP] the rest of the day,,,,,,,,,,,,,,,,,,,, i have seen, and said, what it is, opportunity to come, explain, and come and believe it. [SEP] he [SEP]", "detok_text": "[CLS] 0830 gmt. [SEP] \"we have a lot of time in looking for a new plan, but we have not gone with it with our plan, and we look up with,\" he said. [SEP] the answer, trying to turn out what it is, often comes on a long day. [SEP] he's had a all - star all - star season break. [SEP] the rest of the day,,,,,,,,,,,,,,,,,,,, i have seen, and said, what it is, opportunity to come, explain, and come and believe it. [SEP] he [SEP]"}
+{"type": "sample", "index": 5, "raw_text": "[CLS] s caffeine, stuck in london, and sat around waiting for several months to move off, before landing in the open in new york and landing, again, in new york with chris stewart and pat williams. [SEP] \" if they ' re going to negotiate, they say ' vote for you, ' \" said wright, on the subject of an interview. [SEP] the center ' s annual sell - out to a street is for thursday. [SEP] after all, the absence of money from football is significant. [SEP] in some sense, that place has built up a bit of a small space that, a little, of course, a [SEP]", "detok_text": "[CLS] s caffeine, stuck in london, and sat around waiting for several months to move off, before landing in the open in new york and landing, again, in new york with chris stewart and pat williams. [SEP] \"if they're going to negotiate, they say'vote for you,'\" said wright, on the subject of an interview. [SEP] the center's annual sell - out to a street is for thursday. [SEP] after all, the absence of money from football is significant. [SEP] in some sense, that place has built up a bit of a small space that, a little, of course, a [SEP]"}
+{"type": "sample", "index": 6, "raw_text": "[CLS] over the course of the grind, add the diagonal side, then, in the time, to the horizontal side, begin to. - break a pattern, slice the pastry in a small, again. - - again, again at a 15 - point point, half, half,, half, for a different kind of pattern. - then, as the heel, back in turn, again in the back, to top the line in time. - - the foot ' s turn to turn, line, turn to, out of shape. [SEP] the answer. [SEP] when i take off it seems to take off again, to the [SEP]", "detok_text": "[CLS] over the course of the grind, add the diagonal side, then, in the time, to the horizontal side, begin to. - break a pattern, slice the pastry in a small, again. - - again, again at a 15 - point point, half, half,, half, for a different kind of pattern. - then, as the heel, back in turn, again in the back, to top the line in time. - - the foot's turn to turn, line, turn to, out of shape. [SEP] the answer. [SEP] when i take off it seems to take off again, to the [SEP]"}
+{"type": "sample", "index": 7, "raw_text": "[CLS] losses. [SEP] and they have to remember that their mission was not to invent words but to invent them. [SEP] granted, i see - in, week,, week, there was the only day, in the event of change, of \", for nothing, \" of \" year, for day at work \" and in the game of rest - - well, a good day. [SEP] in fact, the road has to do and the road has to work, but it is not there. [SEP] 7, anaheim 0 ( 18 - 16 - 30 saves ). [SEP] canada, brazil, brazil, thailand, turkey, thailand [SEP]", "detok_text": "[CLS] losses. [SEP] and they have to remember that their mission was not to invent words but to invent them. [SEP] granted, i see - in, week,, week, there was the only day, in the event of change, of \", for nothing, \"of\" year, for day at work \" and in the game of rest - - well, a good day. [SEP] in fact, the road has to do and the road has to work, but it is not there. [SEP] 7, anaheim 0 (18 - 16 - 30 saves). [SEP] canada, brazil, brazil, thailand, turkey, thailand [SEP]"}
+{"type": "sample", "index": 8, "raw_text": "[CLS] black - headed nabullah khan, a hot - voiced jewish figure who loves one ' s way of life, are lonely, unable to reveal, literally, brilliantly,, almost sulkly. [SEP] now, the teams have spent years of working out the differences. [SEP] the service includes weeks of driving in one direction, perhaps for the first time, and on - and drive - in between hours. [SEP] weaver, who hit a two - run rbi homer and an rbi homer, closed to a perfect 10 for the first time since. [SEP] it ' s because the democrats are just a drain on democracy, and it is [SEP]", "detok_text": "[CLS] black - headed nabullah khan, a hot - voiced jewish figure who loves one's way of life, are lonely, unable to reveal, literally, brilliantly,, almost sulkly. [SEP] now, the teams have spent years of working out the differences. [SEP] the service includes weeks of driving in one direction, perhaps for the first time, and on - and drive - in between hours. [SEP] weaver, who hit a two - run rbi homer and an rbi homer, closed to a perfect 10 for the first time since. [SEP] it's because the democrats are just a drain on democracy, and it is [SEP]"}
+{"type": "sample", "index": 9, "raw_text": "[CLS] bill that went back - to - back investigations in 2004. [SEP] i wonder if they will do the same this time. [SEP] we have in days, days, then days, weeks and back in the air. [SEP] it ' s a forced - to - go back - to - back, you have a good idea. [SEP] now, the magic has gone out of fashion, - - - - - - - - - - - - - - - - - - - - - - - - - for a quarter - and - half - and - a - half -, the whole end of the whole, 2008, a little [SEP]", "detok_text": "[CLS] bill that went back - to - back investigations in 2004. [SEP] i wonder if they will do the same this time. [SEP] we have in days, days, then days, weeks and back in the air. [SEP] it's a forced - to - go back - to - back, you have a good idea. [SEP] now, the magic has gone out of fashion, - - - - - - - - - - - - - - - - - - - - - - - - - for a quarter - and - half - and - a - half -, the whole end of the whole, 2008, a little [SEP]"}
+{"type": "sample", "index": 10, "raw_text": "[CLS] day, brings to mark the record of the 16 - year - old order. [SEP] he is likely to have gone to the moon in space. [SEP] mr brown said the us would not talk until the vote - counting was made in january. [SEP] the man ' s son ' s wife who lived in the city centre has moved up on a trip to chicago, and his family is home in east heath, ma. [SEP] that, after two 14 - game losses to the celtics ' nemesis, the pistons and the washington bulls, resulted in a seven - game series, not three games. [SEP] the network ' s chief fire officer, [SEP]", "detok_text": "[CLS] day, brings to mark the record of the 16 - year - old order. [SEP] he is likely to have gone to the moon in space. [SEP] mr brown said the us would not talk until the vote - counting was made in january. [SEP] the man's son's wife who lived in the city centre has moved up on a trip to chicago, and his family is home in east heath, ma. [SEP] that, after two 14 - game losses to the celtics' nemesis, the pistons and the washington bulls, resulted in a seven - game series, not three games. [SEP] the network's chief fire officer, [SEP]"}
+{"type": "sample", "index": 11, "raw_text": "[CLS] said it was making the decision to suspend operations. [SEP] it has to change... and it ' s just a day - by - day - by - day for your people to vote... ( \" is over \" ).. [SEP] add the breads, then green, then, pre - season, bring over the butter with a small plate, then make a mix - - stirring, place in the oven, then until, stirring. [SEP] hill, who lost his right job monday, is on the road trip to his nemesis, the white sox. [SEP] \" i ' m sure everyone knows it. [SEP] his [SEP]", "detok_text": "[CLS] said it was making the decision to suspend operations. [SEP] it has to change... and it's just a day - by - day - by - day for your people to vote... (\"is over\").. [SEP] add the breads, then green, then, pre - season, bring over the butter with a small plate, then make a mix - - stirring, place in the oven, then until, stirring. [SEP] hill, who lost his right job monday, is on the road trip to his nemesis, the white sox. [SEP] \" i'm sure everyone knows it. [SEP] his [SEP]"}
+{"type": "sample", "index": 12, "raw_text": "[CLS], can provide that kind of protection. [SEP] a slice - and - paste bag of paper was used to support the cabinet. [SEP] in fact, the ensuing bust - up led to the battle. [SEP] the journey of the island is not easy. [SEP] mix in a mixture of garlic, chilied, zeal, juice, black flour, red onion, cinnamon, garlic, cred, sugar - flour, tomato, tomato, and garlic, all of all in the water. [SEP] bring to the boil - - cover with the brown flour. [SEP] they do have the ability to sort the crap out of the system. [SEP] \" [SEP]", "detok_text": "[CLS], can provide that kind of protection. [SEP] a slice - and - paste bag of paper was used to support the cabinet. [SEP] in fact, the ensuing bust - up led to the battle. [SEP] the journey of the island is not easy. [SEP] mix in a mixture of garlic, chilied, zeal, juice, black flour, red onion, cinnamon, garlic, cred, sugar - flour, tomato, tomato, and garlic, all of all in the water. [SEP] bring to the boil - - cover with the brown flour. [SEP] they do have the ability to sort the crap out of the system. [SEP] \" [SEP]"}
+{"type": "sample", "index": 13, "raw_text": "[CLS] a lot of the journey to the idea of the most famous place, days, days.... and well, you would have to stop the place. [SEP] it is no longer clear that she was never dressed in the way it must have been at all before her. [SEP] it was at boston, detroit, cleveland - - - - - - - detroit, cleveland, chicago, miami, cleveland, the final days of the road game, boston - chicago, boston - - - in new york, chicago, chicago. [SEP] bobcats 100, denver 100 : james wallace had 16 points and 10 rebounds. [SEP] for example, [SEP]", "detok_text": "[CLS] a lot of the journey to the idea of the most famous place, days, days.... and well, you would have to stop the place. [SEP] it is no longer clear that she was never dressed in the way it must have been at all before her. [SEP] it was at boston, detroit, cleveland - - - - - - - detroit, cleveland, chicago, miami, cleveland, the final days of the road game, boston - chicago, boston - - - in new york, chicago, chicago. [SEP] bobcats 100, denver 100: james wallace had 16 points and 10 rebounds. [SEP] for example, [SEP]"}
+{"type": "sample", "index": 14, "raw_text": "[CLS] in black, with the long eyes. [SEP] just place, in, together, on the tray, then grind - in place, place on the top, and back on the thin side. [SEP] sometimes, just sometimes - - just in the air, sometimes - - sometimes, just in the office, not ice, but i think i understand that you have to get back to the weekend,,,, back - then... and about 90 percent of that.... [SEP] the main line, which started friday, is a short - line of 2, 000 feet, the size of 1, 000 meters ( 2 [SEP]", "detok_text": "[CLS] in black, with the long eyes. [SEP] just place, in, together, on the tray, then grind - in place, place on the top, and back on the thin side. [SEP] sometimes, just sometimes - - just in the air, sometimes - - sometimes, just in the office, not ice, but i think i understand that you have to get back to the weekend,,,, back - then... and about 90 percent of that.... [SEP] the main line, which started friday, is a short - line of 2, 000 feet, the size of 1, 000 meters ( 2 [SEP]"}
+{"type": "sample", "index": 15, "raw_text": "[CLS] [SEP] brown, 17 years old, has admitted to the court to the charges, but has not responded to any charges. [SEP] monday, september 26, 2008, october 31, 2008. [SEP] \" we will have to plant 10, 000 vehicles by the end of 2011, to be taken into production, \" he added, referring to projects in the east.. [SEP] the black and powdered buses rolled along the roads in china ' s capital, many of the trucks, and dozens of bridges, at the facades of government buildings. [SEP] \" i have a crush, i need a vomit, \" his father said. [SEP] he, [SEP]", "detok_text": "[CLS] [SEP] brown, 17 years old, has admitted to the court to the charges, but has not responded to any charges. [SEP] monday, september 26, 2008, october 31, 2008. [SEP] \"we will have to plant 10, 000 vehicles by the end of 2011, to be taken into production,\" he added, referring to projects in the east.. [SEP] the black and powdered buses rolled along the roads in china's capital, many of the trucks, and dozens of bridges, at the facades of government buildings. [SEP] \"i have a crush, i need a vomit,\" his father said. [SEP] he, [SEP]"}
+{"type": "sample", "index": 16, "raw_text": "[CLS]. [SEP] i can ' t blame it to have to wait to tell people who all do. [SEP] the green clouds looked ominously over the tree, while the buildings moved from the first step toward their descent to trees. [SEP] i do want to know if you have an idea. [SEP] from the beginning, jim bradley ' s coffin, pinned to the name of willie walsh, was, if visible. [SEP] 1, for days 1, 1, 2003,, and 2008. [SEP] the 12 - week period was tendered for just two days and, for the first time, eight days, all due to the disruption, the commission [SEP]", "detok_text": "[CLS]. [SEP] i can't blame it to have to wait to tell people who all do. [SEP] the green clouds looked ominously over the tree, while the buildings moved from the first step toward their descent to trees. [SEP] i do want to know if you have an idea. [SEP] from the beginning, jim bradley's coffin, pinned to the name of willie walsh, was, if visible. [SEP] 1, for days 1, 1, 2003,, and 2008. [SEP] the 12 - week period was tendered for just two days and, for the first time, eight days, all due to the disruption, the commission [SEP]"}
+{"type": "sample", "index": 17, "raw_text": "[CLS] way, she ' s going to raise her head again, before going to pay attention that some of her best friends are going to make a try for you - - just to make it. [SEP] the stock market goes back a week after week, the reserve bank of chicago, week - week, week - week - - - - month. [SEP] weeks and days, i have walked back, again, to sleep. [SEP] the planes, planes,,, planes,,,,,,, the planes,,,,,,,,,,,, etc. [SEP] if you are on an unusual vacation, you can [SEP]", "detok_text": "[CLS] way, she's going to raise her head again, before going to pay attention that some of her best friends are going to make a try for you - - just to make it. [SEP] the stock market goes back a week after week, the reserve bank of chicago, week - week, week - week - - - - month. [SEP] weeks and days, i have walked back, again, to sleep. [SEP] the planes, planes,,, planes,,,,,,, the planes,,,,,,,,,,,, etc. [SEP] if you are on an unusual vacation, you can [SEP]"}
+{"type": "sample", "index": 18, "raw_text": "[CLS]daq. cash & e decreased by 4. 14 % to 4. 40 per share. $ 1, 3663 million, with cash flow charge continuing back to 65 %. balance by 2q0 _ 2009 - - c -0, the energy department. report. [SEP] pieces, including the skeletons, were separated into the remains of the plane, a line on the ground, half, half - - half, more than a half - minute longer than normal. [SEP] peanuts, f - 16s, crams, dunk, gap, bla, and paper - - - just a piece of weight, [SEP]", "detok_text": "[CLS]daq. cash & e decreased by 4. 14 % to 4. 40 per share. $1, 3663 million, with cash flow charge continuing back to 65 %. balance by 2q0 _ 2009 - - c -0, the energy department. report. [SEP] pieces, including the skeletons, were separated into the remains of the plane, a line on the ground, half, half - - half, more than a half - minute longer than normal. [SEP] peanuts, f - 16s, crams, dunk, gap, bla, and paper - - - just a piece of weight, [SEP]"}
+{"type": "sample", "index": 19, "raw_text": "[CLS] report. [SEP] the colors of 70, 50 - 76, 80, 70 - 70, and other colors were noted for black, black, 60 - in, 50 - in, 60 - in, 60 - in -, 60 -, 60 -,, 60 -, -, 50 -, 50 -,, 60 -,, 50 -,, etc. [SEP] the magic led, 15 - 14, as the favorite to change cleveland ' s schedule. [SEP] what is said, to come, to write, to speak, is nothing,, not, nothing. [SEP] he also told potential investors that hefty profits [SEP]", "detok_text": "[CLS] report. [SEP] the colors of 70, 50 - 76, 80, 70 - 70, and other colors were noted for black, black, 60 - in, 50 - in, 60 - in, 60 - in -, 60 -, 60 -,, 60 -, -, 50 -, 50 -,, 60 -,, 50 -,, etc. [SEP] the magic led, 15 - 14, as the favorite to change cleveland's schedule. [SEP] what is said, to come, to write, to speak, is nothing,, not, nothing. [SEP] he also told potential investors that hefty profits [SEP]"}
+{"type": "sample", "index": 20, "raw_text": "[CLS] - - and the rest of the day - - in the same period. [SEP] ready - to - boil bread, bread - to - bread and ice bread, for example, are all - in - place bread, with deulated carrots to which they add. [SEP] in the end - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -... - - - - - - - - - - - - - - - - cut the breads and into a dish. [SEP] and in the know - [SEP]", "detok_text": "[CLS] - - and the rest of the day - - in the same period. [SEP] ready - to - boil bread, bread - to - bread and ice bread, for example, are all - in - place bread, with deulated carrots to which they add. [SEP] in the end - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -... - - - - - - - - - - - - - - - - cut the breads and into a dish. [SEP] and in the know - [SEP]"}
+{"type": "sample", "index": 21, "raw_text": "[CLS] the pakistani leader. [SEP] he said. [SEP] after the kabul government abruptly shut down the country ' s three schools, however, the problem closed july 4, 2008. [SEP] these days, that has sent a second official to the city council, which declared in august that the building was mr. ameshi ' s \" district council. \" [SEP] \" there are not days, not days, of belief. [SEP] the number of women in england has been reduced to higher than at any time to higher education, the report said. [SEP] q : time for a 60, 50 and 50 years. [SEP] ann arbor, mich., [SEP]", "detok_text": "[CLS] the pakistani leader. [SEP] he said. [SEP] after the kabul government abruptly shut down the country's three schools, however, the problem closed july 4, 2008. [SEP] these days, that has sent a second official to the city council, which declared in august that the building was mr. ameshi's \"district council.\" [SEP] \" there are not days, not days, of belief. [SEP] the number of women in england has been reduced to higher than at any time to higher education, the report said. [SEP] q: time for a 60, 50 and 50 years. [SEP] ann arbor, mich., [SEP]"}
+{"type": "sample", "index": 22, "raw_text": "[CLS], ill., with the same black vote ( 13. 7 ). [SEP] following a flight from the capital, in central africa, the aircraft will travel to london instead of flight, and then then flying to washington to london, on a first trip. [SEP] they are happy have a car, not have a dog they feel is good to offer them something. [SEP] half of the men who appeared with cuts to a range of 50m or less were described as the type - - with short build and more than vision. [SEP] 60, 80, 60, 50, 50, - - we need to get together in a minute, [SEP]", "detok_text": "[CLS], ill., with the same black vote (13. 7). [SEP] following a flight from the capital, in central africa, the aircraft will travel to london instead of flight, and then then flying to washington to london, on a first trip. [SEP] they are happy have a car, not have a dog they feel is good to offer them something. [SEP] half of the men who appeared with cuts to a range of 50m or less were described as the type - - with short build and more than vision. [SEP] 60, 80, 60, 50, 50, - - we need to get together in a minute, [SEP]"}
+{"type": "sample", "index": 23, "raw_text": "[CLS] up three areas of the country, that provided about 70 per cent of the votes for the march election. [SEP] azuz : it ' s a beautiful day - - chicago, massachusetts, etc. [SEP] the car then turned up \" instinctively, \" and the thief turned to the line, she said. [SEP] in jackson, ga., a co - employee was arrested days after he was injured on interstate 2. [SEP] he is unable to explain the convictions he had a week before being arrested in connection with the death of a 3 - year - old boy in 2004. [SEP] not so much flour, but butter - - flavored with [SEP]", "detok_text": "[CLS] up three areas of the country, that provided about 70 per cent of the votes for the march election. [SEP] azuz: it's a beautiful day - - chicago, massachusetts, etc. [SEP] the car then turned up \"instinctively,\" and the thief turned to the line, she said. [SEP] in jackson, ga., a co - employee was arrested days after he was injured on interstate 2. [SEP] he is unable to explain the convictions he had a week before being arrested in connection with the death of a 3 - year - old boy in 2004. [SEP] not so much flour, but butter - - flavored with [SEP]"}
+{"type": "sample", "index": 24, "raw_text": "[CLS] to a 20 - 7 run... [SEP] as a child, my days at the airport, including in london and switzerland, and my 13 days in the hospital, germany, i ' ve been cut from it and i ' m very happy to get back in touch with them. [SEP] come on, time, time, day, lots of days, come out to the end of... a period of time we have, days, they have again,, it would be a little days, in time and again, in two and a half, the staff are being left to work. [SEP] even the american coach, [SEP]", "detok_text": "[CLS] to a 20 - 7 run... [SEP] as a child, my days at the airport, including in london and switzerland, and my 13 days in the hospital, germany, i've been cut from it and i'm very happy to get back in touch with them. [SEP] come on, time, time, day, lots of days, come out to the end of... a period of time we have, days, they have again,, it would be a little days, in time and again, in two and a half, the staff are being left to work. [SEP] even the american coach, [SEP]"}
+{"type": "sample", "index": 25, "raw_text": "[CLS] order. [SEP] if a guy was on the ground, he would look out on the wrong road. [SEP] and everything was down, just at home to chicago ( this one ) and all the above guys would have to throw in. [SEP] i don ' t think there is a way yet, try to put the lead - off, 18, 14, 14, 1 - 14, 11, 14, 11, 14 - 10, that ' s even do it to the end of the whole season. [SEP] \" it seems that we have the right thing to do, just to say,, to say, we ' ll have to [SEP]", "detok_text": "[CLS] order. [SEP] if a guy was on the ground, he would look out on the wrong road. [SEP] and everything was down, just at home to chicago (this one) and all the above guys would have to throw in. [SEP] i don't think there is a way yet, try to put the lead - off, 18, 14, 14, 1 - 14, 11, 14, 11, 14 - 10, that's even do it to the end of the whole season. [SEP] \" it seems that we have the right thing to do, just to say,, to say, we'll have to [SEP]"}
+{"type": "sample", "index": 26, "raw_text": "[CLS] 74, spent the end of his half - life as a military man. [SEP] many young people to take up work - day, after - school or evening hours, or return to work for school holidays after being cut by the city government. [SEP] i wish i have had a little more time there before we heard him go, \" she said. [SEP] it is one - packed, it just looks obvious, and not the end - to - end thing. [SEP] he was hit just three times in a second - round game on the road for his team in the first round of 2004 - 97. [SEP] on sunday, chicago and chicago [SEP]", "detok_text": "[CLS] 74, spent the end of his half - life as a military man. [SEP] many young people to take up work - day, after - school or evening hours, or return to work for school holidays after being cut by the city government. [SEP] i wish i have had a little more time there before we heard him go, \" she said. [SEP] it is one - packed, it just looks obvious, and not the end - to - end thing. [SEP] he was hit just three times in a second - round game on the road for his team in the first round of 2004 - 97. [SEP] on sunday, chicago and chicago [SEP]"}
+{"type": "sample", "index": 27, "raw_text": "[CLS] are not known. [SEP] but, yes, we can ' t be the kind of thing that we can understand, that ' s not a good thing. [SEP] if you call it a fire for such people, the physical process is something different for a us soldier. [SEP] \" the shares are at a half - point, \" said a trader. [SEP] and again, he ' s just right. [SEP] he added that diplomacy is the only way to get us to do what he wants. [SEP] \" but short - talk is the best way to get going, \" he said. [SEP] it may just be time for an eye - to [SEP]", "detok_text": "[CLS] are not known. [SEP] but, yes, we can't be the kind of thing that we can understand, that's not a good thing. [SEP] if you call it a fire for such people, the physical process is something different for a us soldier. [SEP] \"the shares are at a half - point,\" said a trader. [SEP] and again, he's just right. [SEP] he added that diplomacy is the only way to get us to do what he wants. [SEP] \"but short - talk is the best way to get going,\" he said. [SEP] it may just be time for an eye - to [SEP]"}
+{"type": "sample", "index": 28, "raw_text": "[CLS] the house has to packed up, the owner told me yesterday, but then he has a place to cover their windows and in winter at night he can turn their lights out. [SEP] \" i walked in a pretty nice way. \" [SEP] the stadium, which has been synonymous with tradition since 1973, arrived in the opening round of competition for the first time at center field in chicago, in the same, the loss of the old ground to a 17th division championship. [SEP] the barclays seemed to keep showing up at all. [SEP] here in london, i make a joke, about christmas, christmas, and christmas pudding. [SEP] he was [SEP]", "detok_text": "[CLS] the house has to packed up, the owner told me yesterday, but then he has a place to cover their windows and in winter at night he can turn their lights out. [SEP] \"i walked in a pretty nice way.\" [SEP] the stadium, which has been synonymous with tradition since 1973, arrived in the opening round of competition for the first time at center field in chicago, in the same, the loss of the old ground to a 17th division championship. [SEP] the barclays seemed to keep showing up at all. [SEP] here in london, i make a joke, about christmas, christmas, and christmas pudding. [SEP] he was [SEP]"}
+{"type": "sample", "index": 29, "raw_text": "[CLS] too bad. [SEP] for one - - though, they won ' t be forgotten. [SEP] and the penguins are out of the playoffs - - line, line by area and point, area by area. [SEP] it was to be a great effort, and that was to get on a plane to a... on the plane, to try and end the argument. [SEP] the u. s. refused to be requests to comment. [SEP] it ' s a little weird day - to - day.... i just talked to someone beforehand on when to turn and how to get to in time. [SEP] a : we do know [SEP]", "detok_text": "[CLS] too bad. [SEP] for one - - though, they won't be forgotten. [SEP] and the penguins are out of the playoffs - - line, line by area and point, area by area. [SEP] it was to be a great effort, and that was to get on a plane to a... on the plane, to try and end the argument. [SEP] the u. s. refused to be requests to comment. [SEP] it's a little weird day - to - day.... i just talked to someone beforehand on when to turn and how to get to in time. [SEP] a: we do know [SEP]"}
+{"type": "sample", "index": 30, "raw_text": "[CLS] to cool relations. [SEP] these kids have no time to get together. [SEP] by now, the government had been made to remember the word, \" taking the shower, \" by mr heaney, who was served as the prisoner of war. [SEP] it is a bit harder to get in the race. [SEP] finally, she did in a state of shock. [SEP] the company, meanwhile, made chairs, shoes, linens, chairs, and wipers, all, and place, a mattress manufacturer, moved from dry to dry to fresh snow. [SEP] \" we went to a three - day conference - style conference on saturday, [SEP]", "detok_text": "[CLS] to cool relations. [SEP] these kids have no time to get together. [SEP] by now, the government had been made to remember the word, \"taking the shower,\" by mr heaney, who was served as the prisoner of war. [SEP] it is a bit harder to get in the race. [SEP] finally, she did in a state of shock. [SEP] the company, meanwhile, made chairs, shoes, linens, chairs, and wipers, all, and place, a mattress manufacturer, moved from dry to dry to fresh snow. [SEP] \" we went to a three - day conference - style conference on saturday, [SEP]"}
+{"type": "sample", "index": 31, "raw_text": "[CLS], blessings in the choir and, like him, a church. [SEP] there is a feeling, \" they give you a lift, \" he added, \" in the words, in english, \" red, white and white. [SEP] without it, it is not an all - american - style bread with a knife and baking flour. [SEP] the marbles were conspirated in china and argentina ( they were wooden furniture and displays of life at auschwitz during world war ii ). [SEP] he didn ' t sit and do the day ' s work and out of the bedroom, and he was on the floor. [SEP] the u. [SEP]", "detok_text": "[CLS], blessings in the choir and, like him, a church. [SEP] there is a feeling, \"they give you a lift,\" he added, \"in the words, in english,\" red, white and white. [SEP] without it, it is not an all - american - style bread with a knife and baking flour. [SEP] the marbles were conspirated in china and argentina (they were wooden furniture and displays of life at auschwitz during world war ii). [SEP] he didn't sit and do the day's work and out of the bedroom, and he was on the floor. [SEP] the u. [SEP]"}
+{"type": "sample", "index": 32, "raw_text": "[CLS] to 1968, to the end of 1963, to the french point - - \" oh, again. [SEP] \" it seems... [SEP] even if not, \" the bill will never be signed into law. [SEP] the company hopes that the figures can help to double its forecast of full - month sales since the recession began in january because of an 80 per cent increase the previous year expected. [SEP] on this day it seems so obvious he would be climbing, toe - twisting,, writing down the top, standing down to the back door, a white hat, a dog, in all, a black hat, and a dog, [SEP]", "detok_text": "[CLS] to 1968, to the end of 1963, to the french point - - \"oh, again. [SEP]\" it seems... [SEP] even if not, \" the bill will never be signed into law. [SEP] the company hopes that the figures can help to double its forecast of full - month sales since the recession began in january because of an 80 per cent increase the previous year expected. [SEP] on this day it seems so obvious he would be climbing, toe - twisting,, writing down the top, standing down to the back door, a white hat, a dog, in all, a black hat, and a dog, [SEP]"}
+{"type": "sample", "index": 33, "raw_text": "[CLS] - two weeks or a step ahead of schedule while on the ground, the house is open, along with the roof, roof, the roof and the central units. [SEP] both playwrights met with a friend, and they began to work together. [SEP] we got in travel. [SEP] but, now, the pain is greater than he had to lay his home for 10 hours. [SEP] the nets won three of in all of sept. [SEP] in chicago, he won the previous two, in chicago, then, to detroit in december. [SEP] beijing ( ap ) - - a little mask might seem to make a difference, the u. [SEP]", "detok_text": "[CLS] - two weeks or a step ahead of schedule while on the ground, the house is open, along with the roof, roof, the roof and the central units. [SEP] both playwrights met with a friend, and they began to work together. [SEP] we got in travel. [SEP] but, now, the pain is greater than he had to lay his home for 10 hours. [SEP] the nets won three of in all of sept. [SEP] in chicago, he won the previous two, in chicago, then, to detroit in december. [SEP] beijing (ap) - - a little mask might seem to make a difference, the u. [SEP]"}
+{"type": "sample", "index": 34, "raw_text": "[CLS] have thought for now, even in the deep dark, of the story ' s glory. [SEP] of that, there are a total of 1, 000... [SEP] 1 ), at the boil, in turn, for a day, is as big as a pan of red bread, and no gas is needed. [SEP] \" it ' s important that we can have a genuine resolve. [SEP] whether this is a really bad line, or not. [SEP] she even gets to sing for the new group - - ' my friends '. [SEP] however, he said, the new vote has failed to a date. [SEP] and then, [SEP]", "detok_text": "[CLS] have thought for now, even in the deep dark, of the story's glory. [SEP] of that, there are a total of 1, 000... [SEP] 1 ), at the boil, in turn, for a day, is as big as a pan of red bread, and no gas is needed. [SEP] \" it's important that we can have a genuine resolve. [SEP] whether this is a really bad line, or not. [SEP] she even gets to sing for the new group - - 'my friends'. [SEP] however, he said, the new vote has failed to a date. [SEP] and then, [SEP]"}
+{"type": "sample", "index": 35, "raw_text": "[CLS] to help a person buy,, well, a rubber chair, or two - pack of pillows. [SEP] the panel wanted to act, just to sort it out a bit, and i decided this to be a way to keep the conversation going for years. [SEP] it was like, late into the day, you have to work hard together.... [SEP] however, he is the type to work, and he still needs to go out and get his way around. [SEP] i, up again and again, that day, afternoon and afternoon, and, after the week, the day, the day after, i went to the [SEP]", "detok_text": "[CLS] to help a person buy,, well, a rubber chair, or two - pack of pillows. [SEP] the panel wanted to act, just to sort it out a bit, and i decided this to be a way to keep the conversation going for years. [SEP] it was like, late into the day, you have to work hard together.... [SEP] however, he is the type to work, and he still needs to go out and get his way around. [SEP] i, up again and again, that day, afternoon and afternoon, and, after the week, the day, the day after, i went to the [SEP]"}
+{"type": "sample", "index": 36, "raw_text": "[CLS] all ages. [SEP] mr. lecce. [SEP] of course, he is wrong, but he is a joke. [SEP] i think that, a lot, has to be said, and wait, there are some options for change, so that we are having a referendum on things. [SEP] but still, look a little closer, especially in the first half, and you will be able to get down for you. [SEP] in fact, i can e - type it on the allergy in relation to the bread, butter, chit, milk, cheese, and bread - cheese. [SEP] the association also calls for councils to pay [SEP]", "detok_text": "[CLS] all ages. [SEP] mr. lecce. [SEP] of course, he is wrong, but he is a joke. [SEP] i think that, a lot, has to be said, and wait, there are some options for change, so that we are having a referendum on things. [SEP] but still, look a little closer, especially in the first half, and you will be able to get down for you. [SEP] in fact, i can e - type it on the allergy in relation to the bread, butter, chit, milk, cheese, and bread - cheese. [SEP] the association also calls for councils to pay [SEP]"}
+{"type": "sample", "index": 37, "raw_text": "[CLS] ago, but that was not even a good story. [SEP] as bernanke is known, brown, brown, brown, brown, brown, brown, the rat, the dumpling, the swi, the bakek - dog, the sheep, the goats, the sheep, and the dog, the bi - racial - etc. [SEP] \" we are here for day, day, night, and night. [SEP] \" not one, not one - - maybe he can be a defender, \" he said. [SEP] mr brown also warned he would not face difficult working conditions for the afghan police forces, even if he had [SEP]", "detok_text": "[CLS] ago, but that was not even a good story. [SEP] as bernanke is known, brown, brown, brown, brown, brown, brown, the rat, the dumpling, the swi, the bakek - dog, the sheep, the goats, the sheep, and the dog, the bi - racial - etc. [SEP] \"we are here for day, day, night, and night. [SEP]\" not one, not one - - maybe he can be a defender, \" he said. [SEP] mr brown also warned he would not face difficult working conditions for the afghan police forces, even if he had [SEP]"}
+{"type": "sample", "index": 38, "raw_text": "[CLS] sort of pushed back three times in over a week but had to take his chance to drop out of the race. [SEP] \" the first shot from the beginning, the one - hit, the more than 500, the jets, the nets, the celtics, and they ' re all together, \" he said. [SEP] jason satter was the director of the 15 - year - old in the history of the golden states, and was a producer on the 20 - member project. [SEP] a row of students and two staff took place at the end of the school in february 2006. [SEP] a liar, \" he will not have the beans [SEP]", "detok_text": "[CLS] sort of pushed back three times in over a week but had to take his chance to drop out of the race. [SEP] \"the first shot from the beginning, the one - hit, the more than 500, the jets, the nets, the celtics, and they're all together,\" he said. [SEP] jason satter was the director of the 15 - year - old in the history of the golden states, and was a producer on the 20 - member project. [SEP] a row of students and two staff took place at the end of the school in february 2006. [SEP] a liar, \" he will not have the beans [SEP]"}
+{"type": "sample", "index": 39, "raw_text": "[CLS] road. [SEP] the magic led, 38 - 17, including 15 points into the game. [SEP] the bottom line is that the day is the last week, period, and then you get out the window... [SEP] i.... trains, planes and, of course, road cars, roads, buses, trains, and trains. [SEP] government officials have said the plane had begun delivering back to the airport in 2004, but that the flight - 93 was named for the repair crew. [SEP] yeah, the fat - duck question needs to be answered and put in the... [SEP] it ' s gone on, but [SEP]", "detok_text": "[CLS] road. [SEP] the magic led, 38 - 17, including 15 points into the game. [SEP] the bottom line is that the day is the last week, period, and then you get out the window... [SEP] i.... trains, planes and, of course, road cars, roads, buses, trains, and trains. [SEP] government officials have said the plane had begun delivering back to the airport in 2004, but that the flight - 93 was named for the repair crew. [SEP] yeah, the fat - duck question needs to be answered and put in the... [SEP] it's gone on, but [SEP]"}
+{"type": "sample", "index": 40, "raw_text": "[CLS] from time to time to in..... then again, that was the tv at the time to turn to day to day - - right before the screen. [SEP] it is the moment in front of the start of a meal and by the end, just to make a basket at the end. [SEP] the other aircraft did not show up at to 1, 000 feet, or by helicopter. [SEP] he wanted to hold his breath when the news fell out, before getting off to end when he was not going to start again. [SEP] it was a black, back in 2003, a pre - season, half - in. [SEP]", "detok_text": "[CLS] from time to time to in..... then again, that was the tv at the time to turn to day to day - - right before the screen. [SEP] it is the moment in front of the start of a meal and by the end, just to make a basket at the end. [SEP] the other aircraft did not show up at to 1, 000 feet, or by helicopter. [SEP] he wanted to hold his breath when the news fell out, before getting off to end when he was not going to start again. [SEP] it was a black, back in 2003, a pre - season, half - in. [SEP]"}
+{"type": "sample", "index": 41, "raw_text": "[CLS], on the edge of the pool in the double - story bed, sits on a piece of deep - brown paper. [SEP] on the other side of the road some of the anti - protesters protest at the soldiers ' deaths. [SEP] and it might have had to do to the big time, non - money - - the whole thing has never stopped. [SEP] but in the end, it was usually, just once a year, but a year later, for a lot of months now, and a three years later, it will never have been again. [SEP] but for a moment we just have begun. [SEP] the 36 - year - [SEP]", "detok_text": "[CLS], on the edge of the pool in the double - story bed, sits on a piece of deep - brown paper. [SEP] on the other side of the road some of the anti - protesters protest at the soldiers' deaths. [SEP] and it might have had to do to the big time, non - money - - the whole thing has never stopped. [SEP] but in the end, it was usually, just once a year, but a year later, for a lot of months now, and a three years later, it will never have been again. [SEP] but for a moment we just have begun. [SEP] the 36 - year - [SEP]"}
+{"type": "sample", "index": 42, "raw_text": "[CLS] championship, and sports council officials said johnson ' s focus was beyond on four games, three - hour games, two games and a one - game - - two - week event. [SEP] it ' s 1, 000 acres, a 100, 000 - acre area. [SEP] however, for good, everything, which seems like nothing, is rubbish. [SEP] \" we are already in the works to have something to go down, a lot to move in with us. [SEP] \" the thought was ' yes, if they come out, \" he said. [SEP] the cause of the crash, which happened a couple of hours after the road was [SEP]", "detok_text": "[CLS] championship, and sports council officials said johnson's focus was beyond on four games, three - hour games, two games and a one - game - - two - week event. [SEP] it's 1, 000 acres, a 100, 000 - acre area. [SEP] however, for good, everything, which seems like nothing, is rubbish. [SEP] \"we are already in the works to have something to go down, a lot to move in with us. [SEP]\" the thought was' yes, if they come out, \" he said. [SEP] the cause of the crash, which happened a couple of hours after the road was [SEP]"}
+{"type": "sample", "index": 43, "raw_text": "[CLS], have to sell their money in a country, for free, or for the eu, or in italy. [SEP] that said it was the place to be done, and to feel, in a cold local room, we would take a few hours to try out the cheese, place and place it together on a final package, a black - white dip, half - red meats, carrots and salt, vanilla and black - pepper. [SEP] the federal government ' s new savings figure, released in february, fell sharply from the 7. 9 percent - year figure from the same period in november last year. [SEP] \" at the [SEP]", "detok_text": "[CLS], have to sell their money in a country, for free, or for the eu, or in italy. [SEP] that said it was the place to be done, and to feel, in a cold local room, we would take a few hours to try out the cheese, place and place it together on a final package, a black - white dip, half - red meats, carrots and salt, vanilla and black - pepper. [SEP] the federal government's new savings figure, released in february, fell sharply from the 7. 9 percent - year figure from the same period in november last year. [SEP] \" at the [SEP]"}
+{"type": "sample", "index": 44, "raw_text": "[CLS] 3 days, days, days, days, 14 days..... and 4 days, 3 days, 2 days, days, 2 days, days, 3 days, 14 days, days, days, 2 days, 2 days, days, days, days, 11 days, days, days, 12 days, 4 days, days, 4 days and 4 days, days, days, back together on a normal days, and 2 hours and days in hours, days, days. [SEP] then, come the sun the sun, and then there is a little bit of sun. [SEP] that ' s a great idea to [SEP]", "detok_text": "[CLS] 3 days, days, days, days, 14 days..... and 4 days, 3 days, 2 days, days, 2 days, days, 3 days, 14 days, days, days, 2 days, 2 days, days, days, days, 11 days, days, days, 12 days, 4 days, days, 4 days and 4 days, days, days, back together on a normal days, and 2 hours and days in hours, days, days. [SEP] then, come the sun the sun, and then there is a little bit of sun. [SEP] that's a great idea to [SEP]"}
+{"type": "sample", "index": 45, "raw_text": "[CLS], according to the international monetary bank. [SEP] they said in a statement that there is a lot of evidence in their efforts to move on the issue. [SEP] it turns out that the race line is written in real knots. [SEP] today, we are in the mid - 50, 50,, 50, a year of the day. [SEP] 4, 2, 10, 15, 14, 17,, 16, 15, 21, 15, 26, 15,, 15, 16, 15, 49, 37. [SEP] in the summer of 2008, rbs reported $ 90, 000 in security costs between now and december 2000, [SEP]", "detok_text": "[CLS], according to the international monetary bank. [SEP] they said in a statement that there is a lot of evidence in their efforts to move on the issue. [SEP] it turns out that the race line is written in real knots. [SEP] today, we are in the mid - 50, 50,, 50, a year of the day. [SEP] 4, 2, 10, 15, 14, 17,, 16, 15, 21, 15, 26, 15,, 15, 16, 15, 49, 37. [SEP] in the summer of 2008, rbs reported $90, 000 in security costs between now and december 2000, [SEP]"}
+{"type": "sample", "index": 46, "raw_text": "[CLS] home -owners, welfare and jobs ). [SEP] it seems that the security measures are most likely to be put in place up to now. [SEP] the sense of fear surely will not gain before the minds of students return to participating in their school life. [SEP] with a little more depth,, then, then, sometimes, and sautes. [SEP] pittsburgh, panthers 2 mike danley got the second goal and five assists in a 2 - 2 victory, and mike fisher scored the first - goal early of the game to seal the win. [SEP] then, a remember... the boys come into love with me. [SEP] [SEP]", "detok_text": "[CLS] home -owners, welfare and jobs ). [SEP] it seems that the security measures are most likely to be put in place up to now. [SEP] the sense of fear surely will not gain before the minds of students return to participating in their school life. [SEP] with a little more depth,, then, then, sometimes, and sautes. [SEP] pittsburgh, panthers 2 mike danley got the second goal and five assists in a 2 - 2 victory, and mike fisher scored the first - goal early of the game to seal the win. [SEP] then, a remember... the boys come into love with me. [SEP] [SEP]"}
+{"type": "sample", "index": 47, "raw_text": "[CLS] in advance of the christmas olympics. [SEP] the bread is crisp on the outside, with the top with all the butter and juices - - to return in a small pan to the bottom. [SEP] he led his club to the conference floor when the game ended. [SEP] but, it ' s hard to imagine the americans making such a point. [SEP] the service sector and the contract are expected to reach a 16. 0 - m ( 1 ) - 3m depth at the time ( 16. 2m ). [SEP] for some of these, he just turns to, ' s ( er ), and he is.... [SEP]", "detok_text": "[CLS] in advance of the christmas olympics. [SEP] the bread is crisp on the outside, with the top with all the butter and juices - - to return in a small pan to the bottom. [SEP] he led his club to the conference floor when the game ended. [SEP] but, it's hard to imagine the americans making such a point. [SEP] the service sector and the contract are expected to reach a 16. 0 - m (1) - 3m depth at the time (16. 2m). [SEP] for some of these, he just turns to,'s (er), and he is.... [SEP]"}
+{"type": "sample", "index": 48, "raw_text": "[CLS],,,,,,,,,,, and the end. - - - - - down the road.. - -, well, we ' re going to get a more field day in the end, some point, maybe, and we will have to buy a real plan, but we have a better day with a better picture. [SEP] 4 ( upi ) - - toronto blue bulls, u. s. team toronto, bulls - - the bulls was back in boston for the second straight no. 1. [SEP] \" the situation goes back to 1997. [SEP] so, these days, the creation of a group [SEP]", "detok_text": "[CLS],,,,,,,,,,, and the end. - - - - - down the road.. - -, well, we're going to get a more field day in the end, some point, maybe, and we will have to buy a real plan, but we have a better day with a better picture. [SEP] 4 (upi) - - toronto blue bulls, u. s. team toronto, bulls - - the bulls was back in boston for the second straight no. 1. [SEP] \" the situation goes back to 1997. [SEP] so, these days, the creation of a group [SEP]"}
+{"type": "sample", "index": 49, "raw_text": "[CLS]. [SEP] if we stick to a similar conversation, then say, \" that was, to be more casual, what we all wanted to do. [SEP] the course of everything, the start of the week at the end of the day, for days, and then again in year, week, after day. [SEP] at the end of september 2009, there was the increase in additional loan losses at an average value of $ 4. 8 million, up from $ 11. 9 million, in the same period of 2009. [SEP] the shares need to be sold - - or, say, a better - - sold. [SEP] 1845 : we [SEP]", "detok_text": "[CLS]. [SEP] if we stick to a similar conversation, then say, \" that was, to be more casual, what we all wanted to do. [SEP] the course of everything, the start of the week at the end of the day, for days, and then again in year, week, after day. [SEP] at the end of september 2009, there was the increase in additional loan losses at an average value of $4. 8 million, up from $11. 9 million, in the same period of 2009. [SEP] the shares need to be sold - - or, say, a better - - sold. [SEP] 1845: we [SEP]"}
+{"type": "sample", "index": 50, "raw_text": "[CLS] he brought down the front page is... [SEP] sevek, 13 : 10 minutes - - half, half, half, half and half - again, but it was about half - hour, half - time. [SEP] by day, day, day of the week, half - day, wake - up period, how much that time, how little is changed in. [SEP] finally, instead of a minute - just long enough to forget and take a further look at it. [SEP] instead, they are learning to put on the bed, so go to bath, in which they have access to get paid to a play. [SEP]", "detok_text": "[CLS] he brought down the front page is... [SEP] sevek, 13: 10 minutes - - half, half, half, half and half - again, but it was about half - hour, half - time. [SEP] by day, day, day of the week, half - day, wake - up period, how much that time, how little is changed in. [SEP] finally, instead of a minute - just long enough to forget and take a further look at it. [SEP] instead, they are learning to put on the bed, so go to bath, in which they have access to get paid to a play. [SEP]"}
+{"type": "sample", "index": 51, "raw_text": "[CLS], 24, of leytons, was arrested. [SEP] then 65, 65, 60, 50 in the morning and then half - 52.... for the afternoon, -..., - - 50, 50, a - 60, a - 52, the celtics were 50, 60, 50, 50, and 50 - - and, after all, 50, 50 - - 50, 50, 60, 50, 50,, 52. [SEP] today, a week, 24, 40, 37, 50, 50, and time in the afternoon, for 30 to 45 seconds. [SEP] in australia, the [SEP]", "detok_text": "[CLS], 24, of leytons, was arrested. [SEP] then 65, 65, 60, 50 in the morning and then half - 52.... for the afternoon, -..., - - 50, 50, a - 60, a - 52, the celtics were 50, 60, 50, 50, and 50 - - and, after all, 50, 50 - - 50, 50, 60, 50, 50,, 52. [SEP] today, a week, 24, 40, 37, 50, 50, and time in the afternoon, for 30 to 45 seconds. [SEP] in australia, the [SEP]"}
+{"type": "sample", "index": 52, "raw_text": "[CLS] - hour, 80 - mile journey, taking nearly a year to get by. [SEP] the fall - off corruption trial took place when the court heard that a brazilian businessman had lost over 25, 000 hectares worth of land. [SEP] all his work, the wooden structure - - based on long, period structure - - became the story of the installation. [SEP] easttown, s. s. vancouver, sept. [SEP] while he ' s just for christmas - - the end of the christmas season - - his son, chris, has had a decent campaign this week - - perhaps. [SEP] 4 ( upi ) - - u. s [SEP]", "detok_text": "[CLS] - hour, 80 - mile journey, taking nearly a year to get by. [SEP] the fall - off corruption trial took place when the court heard that a brazilian businessman had lost over 25, 000 hectares worth of land. [SEP] all his work, the wooden structure - - based on long, period structure - - became the story of the installation. [SEP] easttown, s. s. vancouver, sept. [SEP] while he's just for christmas - - the end of the christmas season - - his son, chris, has had a decent campaign this week - - perhaps. [SEP] 4 (upi) - - u. s [SEP]"}
+{"type": "sample", "index": 53, "raw_text": "[CLS] typically trade in at 90 % - 40 % in current market prices, and do not rise until further in the winter. [SEP] put out of the juices, cut in a large saucepan, and season the butter and ice at half - hour time. [SEP] and the same thing could have happened.... [SEP] in a bowl, place for a close and reduce to half - size flour, bring in a place, so that is a more satisfying choice for the whole family. [SEP] ian wexer, a researcher with the medical office, examined the children in one of their studies. [SEP] the move came to months in [SEP]", "detok_text": "[CLS] typically trade in at 90 % - 40 % in current market prices, and do not rise until further in the winter. [SEP] put out of the juices, cut in a large saucepan, and season the butter and ice at half - hour time. [SEP] and the same thing could have happened.... [SEP] in a bowl, place for a close and reduce to half - size flour, bring in a place, so that is a more satisfying choice for the whole family. [SEP] ian wexer, a researcher with the medical office, examined the children in one of their studies. [SEP] the move came to months in [SEP]"}
+{"type": "sample", "index": 54, "raw_text": "[CLS]. [SEP] yes, \" white house spokesman gordon young said. [SEP] so clearly, for after days, the perfect time to go, to take the trail back to, after dark, back in the dark place. [SEP] he tells us, and, then, then, why not only is he mean, really, but also he, he said, he is. [SEP] a pan of coconut butter hung on the right side of a rice, thin - scented baking machine. [SEP] unfortunately, america is unable to stand the balance again ( and then again, of course,, again, again and again ) on the line to the original and [SEP]", "detok_text": "[CLS]. [SEP] yes, \" white house spokesman gordon young said. [SEP] so clearly, for after days, the perfect time to go, to take the trail back to, after dark, back in the dark place. [SEP] he tells us, and, then, then, why not only is he mean, really, but also he, he said, he is. [SEP] a pan of coconut butter hung on the right side of a rice, thin - scented baking machine. [SEP] unfortunately, america is unable to stand the balance again (and then again, of course,, again, again and again) on the line to the original and [SEP]"}
+{"type": "sample", "index": 55, "raw_text": "[CLS]. [SEP] 2. 6bn ) to multi - year investment gains made in the last three years, up to 0. 6 per cent year - on - year, year - to - year - to - date up from 4. 7 per cent in 1998 - 07. [SEP] \" business travel is driven by entrepreneurship, \" she said. [SEP] i ' ve had to say everything, and we ' ve got to talk. [SEP] however, according to his brother david, who led the investigation, \" he was able to go back.. [SEP] and then again, then, now, now and again. [SEP] \" if i could get [SEP]", "detok_text": "[CLS]. [SEP] 2. 6bn ) to multi - year investment gains made in the last three years, up to 0. 6 per cent year - on - year, year - to - year - to - date up from 4. 7 per cent in 1998 - 07. [SEP] \"business travel is driven by entrepreneurship,\" she said. [SEP] i've had to say everything, and we've got to talk. [SEP] however, according to his brother david, who led the investigation, \"he was able to go back.. [SEP] and then again, then, now, now and again. [SEP]\" if i could get [SEP]"}
+{"type": "sample", "index": 56, "raw_text": "[CLS] in traditional schools. [SEP] shoes are often visible - - and largees of shoes, blankets, harnesses and linens are just to follow. [SEP] \" we took some of the essence of the show ' s character from time to time to time, \" he says. [SEP] if you want to act, let us laugh, feel, talk, think - - eat, to get home and a bit of sleep. [SEP] today, here he was by side, in the back - room, in a short, quiet place in the middle of night, and in the centre of the evening, he can be, for days, a [SEP]", "detok_text": "[CLS] in traditional schools. [SEP] shoes are often visible - - and largees of shoes, blankets, harnesses and linens are just to follow. [SEP] \"we took some of the essence of the show's character from time to time to time,\" he says. [SEP] if you want to act, let us laugh, feel, talk, think - - eat, to get home and a bit of sleep. [SEP] today, here he was by side, in the back - room, in a short, quiet place in the middle of night, and in the centre of the evening, he can be, for days, a [SEP]"}
+{"type": "sample", "index": 57, "raw_text": "[CLS] period, and the time to,,,,,,,, starting with a week,,, no one,,,,,... and, then, again, the rest is enough to do everything again... [SEP] it is very bad and wants to do it more efficiently. [SEP] the work of dr. spitz, a mathematician, who jumps and writes,,,,,, days in the back of a plane, takes for a lot of days for the beginning, then, sometimes, then,, to come up with check - in beginning, then set up on a path in the end [SEP]", "detok_text": "[CLS] period, and the time to,,,,,,,, starting with a week,,, no one,,,,,... and, then, again, the rest is enough to do everything again... [SEP] it is very bad and wants to do it more efficiently. [SEP] the work of dr. spitz, a mathematician, who jumps and writes,,,,,, days in the back of a plane, takes for a lot of days for the beginning, then, sometimes, then,, to come up with check - in beginning, then set up on a path in the end [SEP]"}
+{"type": "sample", "index": 58, "raw_text": "[CLS] s way of things, which is his own goal. [SEP] it is a great indeed. [SEP] the good thing is, remember, if a coach is get out of the deal, but he has hit over the top of it in the deal, that he makes the deal again, on the plane, on dhl today. [SEP] 2007 - - - - - - - - - - - - - - - - - - as of december 31, 2007, 31 - 2007 - 13, 0230 - £29, 000 - £175, 000, in 2008 - 31, 000 - 300. the actual number 501 ( 1 [SEP]", "detok_text": "[CLS] s way of things, which is his own goal. [SEP] it is a great indeed. [SEP] the good thing is, remember, if a coach is get out of the deal, but he has hit over the top of it in the deal, that he makes the deal again, on the plane, on dhl today. [SEP] 2007 - - - - - - - - - - - - - - - - - - as of december 31, 2007, 31 - 2007 - 13, 0230 - £29, 000 - £175, 000, in 2008 - 31, 000 - 300. the actual number 501 ( 1 [SEP]"}
+{"type": "sample", "index": 59, "raw_text": "[CLS] 2010, it is clear. [SEP] however, the end of 2006 was a first step. [SEP] and there is more to come to make of, and very few excuses. [SEP] in fact, the crowd roared and then finally brought it to a halt, quickly turning the show into again. [SEP] the producers realize, however, that works like pillows and rinses are just examples of a child stopper ' s passion for child care. [SEP] \" in the face of this road, i urge you to read this constitution, to make sure to be better, working, to get better and stay better, \" said the u. s [SEP]", "detok_text": "[CLS] 2010, it is clear. [SEP] however, the end of 2006 was a first step. [SEP] and there is more to come to make of, and very few excuses. [SEP] in fact, the crowd roared and then finally brought it to a halt, quickly turning the show into again. [SEP] the producers realize, however, that works like pillows and rinses are just examples of a child stopper's passion for child care. [SEP] \"in the face of this road, i urge you to read this constitution, to make sure to be better, working, to get better and stay better,\" said the u. s [SEP]"}
+{"type": "sample", "index": 60, "raw_text": "[CLS] health care. [SEP] i sat in the office for a minute of a single day, when he wanted to look me in the mirror, and got the answer. [SEP] the man who wrote, and spoke in italian, a fake and a fake, was photographed with the minister ' s apron, and the answer was written in white. [SEP] the forecast is expected to bring to 10 - 15, 000 tonnes of power capacity in the second quarter. [SEP] that means a top aide revenue rate of an additional 11 percent. [SEP] los angeles - the celtics have stumbled to a first victory in a playoff game, the first coming at the end of [SEP]", "detok_text": "[CLS] health care. [SEP] i sat in the office for a minute of a single day, when he wanted to look me in the mirror, and got the answer. [SEP] the man who wrote, and spoke in italian, a fake and a fake, was photographed with the minister's apron, and the answer was written in white. [SEP] the forecast is expected to bring to 10 - 15, 000 tonnes of power capacity in the second quarter. [SEP] that means a top aide revenue rate of an additional 11 percent. [SEP] los angeles - the celtics have stumbled to a first victory in a playoff game, the first coming at the end of [SEP]"}
+{"type": "sample", "index": 61, "raw_text": "[CLS] stories and poetry, and so there are people to find historical and useful items from history. [SEP] in addition, the national civil ' union, john kelly, wanted to make a comment on the deal in return so that companies would not be able to fund large \" post - contract \" - related work. [SEP] he told bbc news \" one of a number of members at the wirral trust has been campaigning in favour of extending the line service. [SEP] i know, that is incredible. [SEP] so - - well, it would be that he has to \" reckoned with respect \" and the rest has to stop. [SEP] but then, [SEP]", "detok_text": "[CLS] stories and poetry, and so there are people to find historical and useful items from history. [SEP] in addition, the national civil' union, john kelly, wanted to make a comment on the deal in return so that companies would not be able to fund large \"post - contract\" - related work. [SEP] he told bbc news \"one of a number of members at the wirral trust has been campaigning in favour of extending the line service. [SEP] i know, that is incredible. [SEP] so - - well, it would be that he has to\" reckoned with respect \" and the rest has to stop. [SEP] but then, [SEP]"}
+{"type": "sample", "index": 62, "raw_text": "[CLS] well as the nation, \" he said. [SEP] the day ' s event was a two - hour period as it turned into a start - off. [SEP] then a - 4,, 5, 5, 5, and - - on a 10 - yard,, 11, 13, 100 - yard, and yard rally from a 10 - point, 11, for - 10 news conference. [SEP] it is a change of direction. [SEP] the majority of the bank ' s assets are in commercial mortgage - backed commercial securities, with most assets in relation to mortgage - backed securities, including fixed - income and other junior mortgages. [SEP] [SEP]", "detok_text": "[CLS] well as the nation, \" he said. [SEP] the day's event was a two - hour period as it turned into a start - off. [SEP] then a - 4,, 5, 5, 5, and - - on a 10 - yard,, 11, 13, 100 - yard, and yard rally from a 10 - point, 11, for - 10 news conference. [SEP] it is a change of direction. [SEP] the majority of the bank's assets are in commercial mortgage - backed commercial securities, with most assets in relation to mortgage - backed securities, including fixed - income and other junior mortgages. [SEP] [SEP]"}
+{"type": "sample", "index": 63, "raw_text": "[CLS] $ 15 billion, down earnings a share in the first quarter. [SEP] i was not sure to look at, anywhere in his face - and then, and gone along with his way to talk about the job. [SEP] he just seems not to believe it ' s true. [SEP] so why do they want me to take the other children to their school and to the house and i ' d have to watch the same thing again. [SEP] a police spokesman said : \" this is an incredible mix of dark, orange, and blue, and like. [SEP] i feel like, i wonder why the council might want to turn it into a less [SEP]", "detok_text": "[CLS] $15 billion, down earnings a share in the first quarter. [SEP] i was not sure to look at, anywhere in his face - and then, and gone along with his way to talk about the job. [SEP] he just seems not to believe it's true. [SEP] so why do they want me to take the other children to their school and to the house and i'd have to watch the same thing again. [SEP] a police spokesman said: \" this is an incredible mix of dark, orange, and blue, and like. [SEP] i feel like, i wonder why the council might want to turn it into a less [SEP]"}

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_32/summary.jsonl

@@ -0,0 +1,2 @@
+{"type": "summary", "name": "state_c256_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c256_t1p45", "steps": 32, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 44.930859242990756, "nll_per_token": 3.8051248469363923, "tokens": 9366}, "diversity": {"sample_entropy": 3.7823763722555808, "unique_tokens": 1422, "token_count": 8192, "distinct_1": 0.173583984375, "distinct_2": 0.5745570866141733, "top_token_mass": 0.11572265625}}
+{"type": "summary", "name": "state_c1024_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c1024_t1p45", "steps": 32, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 1024.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 31.13635173493272, "nll_per_token": 3.438376002668099, "tokens": 9165}, "diversity": {"sample_entropy": 3.3146319833825286, "unique_tokens": 1102, "token_count": 8192, "distinct_1": 0.134521484375, "distinct_2": 0.4309793307086614, "top_token_mass": 0.2288818359375}}

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_32/summary.tsv

@@ -0,0 +1,3 @@
+name	step	detok_genppl	sample_entropy	distinct_2	top_token_mass	model_t_mode	support_power	semantic_power	final_from	endpoint_temp	concentration_max	update
+state_c256_t1p45	124000	44.930859242990756	3.7823763722555808	0.5745570866141733	0.11572265625	post	1.0	1.0	state	1.45	256.0	resample
+state_c1024_t1p45	124000	31.13635173493272	3.3146319833825286	0.4309793307086614	0.2288818359375	post	1.0	1.0	state	1.45	1024.0	resample

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_64/state_c1024_t1p45_detok_raw_samples.txt

@@ -0,0 +1,228 @@
+state_c1024_t1p45_detok
+{
+  "type": "summary",
+  "name": "state_c1024_t1p45",
+  "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt",
+  "step": 124000,
+  "decode": {
+    "kind": "categorical_fullvocab",
+    "config": "state_c1024_t1p45",
+    "steps": 64,
+    "model_t_mode": "post",
+    "support_power": 1.0,
+    "semantic_power": 1.0,
+    "endpoint_temp": 1.45,
+    "concentration_min": 1.0,
+    "concentration_max": 1024.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 35.36294023649359,
+    "nll_per_token": 3.565664385797097,
+    "tokens": 9515
+  },
+  "diversity": {
+    "sample_entropy": 3.884623591993139,
+    "unique_tokens": 1443,
+    "token_count": 8192,
+    "distinct_1": 0.1761474609375,
+    "distinct_2": 0.5751722440944882,
+    "top_token_mass": 0.1007080078125
+  }
+}
+
+===== sample 000 =====
+[CLS], 2003, when the woman failed to meet in the afghanistan - pakistan border area, police said. [SEP] he doesn't mind a car, his father doesn't like being a cat or dog, so he can cope with the strain of being a dog. [SEP] (at least) now i have learned about the special qualities that make me sweat. [SEP] and sometimes he's too angry - - just to austere his way. [SEP] "i think we all need to get to that place and know it's what we really want," he said. [SEP] so i didn't just want to see the [SEP]
+
+===== sample 001 =====
+[CLS], and it failed to come up without an effect to the law. [SEP] i'll have much work to do, get to get a job, get back in the house. [SEP] the woman has been told: "i don't want you to walk on an airplane. [SEP]" he spent his days, days, a week, and then days a week, the days, days to stay, days to get back to, end, the time of days, days, the time to work days, the time to work, and finally to be together, " al - ha, according to the magazine. [SEP] he, [SEP]
+
+===== sample 002 =====
+[CLS] said. [SEP] but the show prides itself, too, in the appearance of a good program, which ends with a lot to do. [SEP] mike brown had 13 points and four assists in a season - high victory to give the thunder the halftime lead. [SEP] after watching the first - round games with the jets, two games in the next two games, the two games of the games, and then the jets of the games, buffalo has to get to detroit, win the game, game - to - game, and get to victory. [SEP] however, i'm confident of their support. [SEP] there is also no shortage of [SEP]
+
+===== sample 003 =====
+[CLS] oh,, well, it was a little harder, at the moment - and, well, it was like a little bit of a joke. [SEP] i still recommend it for you, but there's a bed, spa, a door, a coffee bar, a chair so you can't sign for a tree. [SEP] and we have to watch on that situation. [SEP] the man who stands up and talks with his wife said, once again, i'm beginning to realize that he is getting ready to do it. [SEP] the marlins, losing for the first time in their third game, are in a series of four [SEP]
+
+===== sample 004 =====
+[CLS]. s. stores in parts of washington, chicago, new york, denver and chicago. [SEP] after all, i do not want to talk about it. [SEP] " i don't think of anything to show a decline of 50. 3 %. [SEP] the american government has already shown that i don't want a political leader to make a pledge to speak up to our soldiers in iraq and the american people have to put them to work with the troops and people of afghanistan. [SEP] no, the picture ends with the lights, the yellow shirts, hands with the colors, a black mask - -... [SEP] to read [SEP]
+
+===== sample 005 =====
+[CLS] hard to believe. [SEP] i'm sorry, and you want me to do that, and i do it anyway. [SEP] "you get to work a hard, yeah, i get to work," she said, "yes." [SEP] and, yeah, oh, yeah, and maybe in the top 20. [SEP] the contrast is found, in the middle, the one - sided side, in the top, and in the other half of the top. [SEP] and so, if they are going to get in trouble, there's still room for some improvement. [SEP] then, though, they were all about, what [SEP]
+
+===== sample 006 =====
+[CLS] the country. [SEP] of course, it isn't enough to be a hit, to replace the iphone with the pay - off - - and to cut it back further - - until the next time. [SEP] while i think that relationship will be better, i've been wrong, maybe, nothing. [SEP] for the past 20 years, years, days,, weeks, years, and months, for us to come back on the road, and then again, maybe, again... and then we get back in a bad spiral, and we have managed to get down to a halt. [SEP] the campaign also has a [SEP]
+
+===== sample 007 =====
+[CLS] said. [SEP] but, there must be a national government trying to eliminate the divide between muslims and republicans. [SEP] "thousands of iranians have never been to democracy because they have been engaged to peaceful demonstrations and are involved in making a political deal. [SEP] the latest difference to history is that the jets are on offense at the end of the season. [SEP] the answer is not for the ultimate reason, but the answer itself. [SEP]" the world series is getting us back in the world and lord's is ok, that's ok... [SEP] the audience had an emotional capacity to admit - - even to admit - - [SEP]
+
+===== sample 008 =====
+[CLS] years after israel's capture. [SEP] i think the whole thing is just, well, very good. [SEP] i think it's going to change a lot to that. [SEP] it's time the audience refuses to reflect on the foundation of a creator. [SEP] everything from long shorts, leather pants, silk shirts, raincoats, cut - back jackets and hood - covered tops, grey - banded vests, copper - colored shirts, black suspenders - and - tops. [SEP] sub - prime securities, the firm, was involved in the swap, which saw each of the 500 vehicles on a debt list. [SEP] what [SEP]
+
+===== sample 009 =====
+[CLS], that it would consider limiting voting rights for the funds. [SEP] he had the ability to talk, to talk, to talk, not even speak. [SEP] she opens the door in search of assistance. [SEP] if you can move back and move back alone, the employer would not put you back to work again. [SEP] in return, add together the butter and add a little vanilla. [SEP] about a dozen other items - - bundles of plastic, plastic, furniture and aluminum - - have gone out of circulation since 2002. [SEP] the authorities have put a similar case behind hold in the uk. [SEP] " for a certain number of our customers [SEP]
+
+===== sample 010 =====
+[CLS] anti - related, the federal food and drug administration said on tuesday. [SEP] ap news' jim scirillo in mexico city and glen johnson in washington contributed to this report. [SEP] but he did not address any need for donations. [SEP] in addition to requests for comment from european authorities, the u. s. embassy declined to return phone calls to the associated press for any further comment on tuesday. [SEP] he wanted them to be on the offensive line. [SEP] "i don't think that we would get much rest anytime soon," said gordon brown, the chairman of the american asset management association. [SEP] the other side, to [SEP]
+
+===== sample 011 =====
+[CLS] finally showed up. [SEP] " it's going to be an opportunity to have one of us give you all the money. [SEP] i'm glad a nice, red - haired person who needs to get your family together wants to give you something, such as taking them up for a car, a bed and a room. [SEP] the mental health team examined the results of a forensic examination and the backgrounds of the suspects. [SEP] 104. 85, 84, 104, 84, 98 - 113.... [SEP] the carrier - - airlines - - can operate thousands of flights to the entire united states. [SEP] with the exception of [SEP]
+
+===== sample 012 =====
+[CLS] - 30 % higher than in 2007. [SEP] at the other end of 2 a. m., then 8, 8, 9, 11, 11, 15, and 10, 16, and 18, to get 4, 5, 4, 4, 6, 6, and back on time. [SEP] i stepped into her car and it had been a while, and she needed to do, "he said. [SEP] and if you do, a good person in the world will have a place to go or to do a job. [SEP]" i really think he deserves to be in the race, " said ridley - thomas, [SEP]
+
+===== sample 013 =====
+[CLS], he said. [SEP] he winced, hugged, the crowd froze, and exhaled. [SEP] but, there do appear to be some problems: "i found the mattress in, on occasion, the passenger drawer." [SEP] as a result, he comes out and he says, " yeah, he has a lot to do. [SEP] i'm not sure until the lights come out and,,,,,,, all the time, don't know, what,,,, what,,, what, what,. [SEP] the industry, flush with money, has run out of cars, planes, cars and planes [SEP]
+
+===== sample 014 =====
+[CLS]. [SEP] but for a long time, it has to be taken with, he said, "a great effect." [SEP] the project is also a private investment, as part of the sale to the bank of scotland. [SEP] for now, everyone are able to get their names together - - 2, 3, 14,, 8, 12, 11, 13, a word. [SEP] i think so well. [SEP] "i wanted him to talk to him," she added. [SEP] "i continue to love him for all," he said. [SEP] but if there is anything to go by, it doesn't work. [SEP]
+
+===== sample 015 =====
+[CLS] " she said. [SEP] so much so i spent my days trying to get back to the house - i would drink in transit, i would never die in a tunnel on a bus - and it came along, so far, so quickly, just because it would stop, and then, then later, off the road. [SEP] then, every day, i mean, 49, 37, 50, i usually have 200, 200, 50, 50, 60 days. [SEP] on a short voyage, the aircraft carried aircraft, planes and equipment to the roof of the united nation's fueling system. [SEP] i agree with your assertion [SEP]
+
+===== sample 016 =====
+[CLS] happens on wall, say, rather, newspapers, it is no reflection of their diversity. [SEP] the story doesn't seem to work out the only way of finding a way to feel bad news. [SEP] we started with a computer, two minutes, a few minutes, looking at the hotel's small door, looking in its yard. [SEP] a 45 - year - old french student who says she wrote her boyfriend's name is on the stand, a court heard. [SEP] i have been in the field since the age of 17, but i never had one. [SEP] but i just think that with the obvious problems, there [SEP]
+
+===== sample 017 =====
+[CLS] investors, would seem to include the idea of a short - term buy - out. [SEP] what makes an even greater problem, the truth, is a combination of - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -. [SEP] but it's not a time to start and tell us to look here. [SEP] the 21 - year - old midfielder moved to liverpool from the club in 2006. [SEP] the house, kupech said, is expected to be a 300 - foot vehicle with a top speed of 40 miles [SEP]
+
+===== sample 018 =====
+[CLS] not have the opportunity to speak unless i have to listen to read the novel. [SEP] london (ap) - british transport officials have launched a "demonstration" operation over the refusal of european union airspace to allow flights to the hubble and a lack of extra transport flights so the mission can expand beyond the end of the full year. [SEP] police are keen to speak to four men, including the father of a baby, who walked in the heart of york street, eastbourne, at 0115 gmt on saturday. [SEP] by the way, fluorescent lights, candles, rubbers and candles come together, shoes, pillows, etc. [SEP]
+
+===== sample 019 =====
+[CLS] said. [SEP] they may have a good future in self - esteem and we have had to question the trust of children at the end of their lives. [SEP] i like the sparkle of light, i can see from the top windows, the sparkle of the ceiling, the sparkle of lights. [SEP] the bill also includes the use of emergency planes, the use of cargo planes, cargo planes, the use of passenger planes, aircraft and automobiles. [SEP] if to make it for a two - win race against the best team in the world, we are just right to keep on making the most of the game. [SEP] here, it seems, [SEP]
+
+===== sample 020 =====
+[CLS] "he said. [SEP] when hillary clinton told the crowd that she wanted to make" a fateful (inky) gesture out of her mouth, "my name was raised. [SEP] his coats of black tops and dark white shoes, all clouds white, a long black scarf, a black white hat, and a large - looking black top - - faded and then, again, then we all have to wait and then half,, then half,, half,, the carpet is on. [SEP] the uk's foreign minister said in a statement released on monday that it was a" significant priority " for efforts to resolve the [SEP]
+
+===== sample 021 =====
+[CLS]. [SEP] "it was a guy on the other side of a line, saying..., kind of" shit, wack, "he said... [SEP] there is a lot of space in all of our minds, that need to think how our lives have changed," he said a while earlier. [SEP] a bit of art, that seems to me, comes with an arm and a lot of empty mind. [SEP] "it is a law they must change, because it is so," he said. [SEP] the teen, hamilton of michigan, was arrested in a separate area just days outside his home on a [SEP]
+
+===== sample 022 =====
+[CLS] to be completed in one to two days. [SEP] the government statement said the school would return by december, beginning in 2014. [SEP] overby said she is concerned about the concept behind that decision when she wants to get the job done and vote for it. [SEP] some are very hard, some funky, some making it up and just trying to make a bit more than a bit bland and sweet. [SEP] chicago (reuters) - trade leaders, meeting in chicago hoping to boost trade between the u. s. and africa, will meet in a bid to forge a balance on trade, a senior official said on monday. [SEP] the company [SEP]
+
+===== sample 023 =====
+[CLS], the company has said it will not reveal what they are thinking about. [SEP] "unfortunately at the moment, many of us have no access to public funding, and refuse to work to deal with the enormous issues. [SEP] he never gets a chance to start, just to start in the locker room. [SEP] a small seating area has been set up inside, and large spaces in the area. [SEP]" it's like he's driving, going down in the road, going back on the street at work, going on to back, but going back - in - the - road, down the road, up there. [SEP] [SEP]
+
+===== sample 024 =====
+[CLS] in 2001. [SEP] the farmers, he said, will not do it until 2017, and then will make ends meet in season to season, with the current peaking at a peak of around 50c in two years. [SEP] with the lights of miami, the story turned green, green, black and green, and the dust of black faded in the wind and the stone pillars of the wall again faded. [SEP] the officials, speaking condition of anonymity, agreed that obama's withdrawal would continue until the end of the year. [SEP] no, i try to tell you the author may just be a 300 - a - word, [SEP]
+
+===== sample 025 =====
+[CLS] unusual, however, at this time. [SEP] people wanted to wake up to understand the situation, "said to the student, who said the noise was" fantastic "and then he got back on the ground. [SEP] i mean sorry, but then you, god, take a day for a tea, some for a pill, men and women. [SEP]" anything that will happen within the term - - when it is half a century - - will be much harder to prepare for, " he said. [SEP] the teams spent about four days a week trying to bring the best of the best of the nba chicago, june 30 ( up [SEP]
+
+===== sample 026 =====
+[CLS] they started to sing, they began laughing, "she said. [SEP] and, i can't understand how, for now, people are willing to drop their wallets and put their noses in the door. [SEP] the family then wanted to get a question - and - answer to where he was going, he said. [SEP]" here, the game has not come to a close. [SEP] now that the economy is back to the boom - and - bust cycles, and the process continues, the idea that everything is going in a little bit and moving is we have to wait and get a little longer. [SEP] he began with a [SEP]
+
+===== sample 027 =====
+[CLS] his plan, and he ruled out it would do something to some of his clients. [SEP] but a few weeks, for me, and for the fans, it has been the time for me to fight, " he said. [SEP] after a restoration, the final part of the houseboard section of the building, confined to the ceiling railings, returns to the edge of darkness. [SEP] this requirement has been put in one place. [SEP] at least 100 french soldiers have been killed. [SEP] and when i do, i take off, i feel the smell of music in my face. [SEP] he struggles with the breadth of his collection. [SEP]
+
+===== sample 028 =====
+[CLS] meeting in baghdad, the official told reporters. [SEP] they were the real problem and they were all on their own. [SEP] "i remember him was once standing on the other side of the room, and with him, he said, come back, look up, he said goodbye, and then he said to me, and he said yes, he was another. [SEP] and, oh, uh - oh, there's a lot. [SEP] only a few of the drugs were used in britain to treat serious kidney problems. [SEP] so, then, are the bigger problems. [SEP]" people don't wait for answers. [SEP] " [SEP]
+
+===== sample 029 =====
+[CLS] said. [SEP] the result of our investigation is that the internet is a priority. [SEP] i think the children will find themselves sitting in disbelief, if they are to turn around. [SEP] the financial collapse of the credit crunch, many of its names were being announced, appears to have engulfed some of the world's most susceptic economies. [SEP] even when it gets done, that kind of person eats up a hair and refuses to come. [SEP] and the message was clear that, with the end of the olympics in sight, i didn't have a sense of humor, or even the thrill of getting in a field. [SEP]
+
+===== sample 030 =====
+[CLS] couple of hours, i would not be able to get the full flight, he said. [SEP] but he knew, and he refused to speak. [SEP] we do not like the things that the person at the top, at a corner, at the top, at the top line, the body, to the top, the bottom line, up to the top. [SEP] while the emotional nature of the story, in which the story is taken by the author's son on a huge canvas, has settled the issue, the narrative of moyesque is far deeper than ever. [SEP] so, if i only get through the house, [SEP]
+
+===== sample 031 =====
+[CLS]. [SEP] the hospital has a great room and is a very nice room, a great group, " he said. [SEP] when everyone talks about him and his accomplishments, i will wonder if they are anything more, just temporary. [SEP] 7, detroit, calgary - toronto 11 - 13, detroit - boston 16, detroit - chicago, detroit - chicago, in place of chicago, detroit - denver. [SEP] more than 30 aircraft, including 13 men, women and one - third of the staff, were scheduled to leave in coming days, the coalition said. [SEP] 5 to serve as head of the special forces command. [SEP] the article appeared [SEP]
+
+===== sample 032 =====
+[CLS] [SEP] that is what is a situation not changed since the end of the 1970s. [SEP] the only way to do, say, say, say, say, look, it's a matter of working the hard, with little problem, trying to get the word'turn' right. [SEP] yes, however, the distinction is important. [SEP] he just started in chicago, detroit, denver, chicago, before going to the airport. [SEP] but, time is on the line, there are days to be had, now, and then, and, finally, with the chance to become, again, a half - day. [SEP] the [SEP]
+
+===== sample 033 =====
+[CLS] the girl, a 6 - year - old little girl. [SEP] the baby is ½ - and - 1 - - tucked up in dark pajamas, working in suitcases, bunks, and in pantsuits, in dark pants. [SEP] meanwhile, these researchers are also parachuted in to work with special equipment to deliver these additional multi - wheeled units - - including lifts, lifts, wheelchairs, lifts and - - on support of emc technology. [SEP] canada. [SEP] the plane, £1, 095 (£11, 772), has seven flights. [SEP] " it's like we're not talking. [SEP]
+
+===== sample 034 =====
+[CLS] chicago in chicago, chicago - to tampa, detroit, and - detroit in cleveland. [SEP] i just think he is going to step down if he doesn't plan to return. [SEP] it's 60, 50,, 50, 60, - - 50, 50 - - 50, 38, 36, 48 days. [SEP] brown had 16 points and nine rebounds, including a point game, a trip to the blue devils, and even a game in the second period. [SEP] 9, chicago 17, new jersey 18. [SEP] he refused to give his students of dollars and even told them to check in. [SEP] the court heard [SEP]
+
+===== sample 035 =====
+[CLS] said. [SEP] a lovely, fruit - scented version of wilt vanilla, with a paler shade of lemon flavors. [SEP] chicago is 7 - 4 with a 2 - 2 - 2 era. [SEP] it's quite a bit to learn. [SEP] "he's really so clever, he moved quickly through his acting period, and got into a place where he huffed and puffed and rolled up his teeth, opened his eyes." [SEP] there are people who have other types of financial support. [SEP] "the victory will have a huge impact," analysts say, for the fast - growing insurgency. [SEP] i never believe that a [SEP]
+
+===== sample 036 =====
+[CLS] began in january 2005. [SEP] other cities have made significant gains, including london, in london, and in the midlands, for the last five years. [SEP] "i think i'd just like to sleep, but when it is good, you get to sleep, not well," he said. [SEP] the next day, however, she is asleep in the next room, but the answer begins to appear, she's looking up and laughing. [SEP] " i don't think he is going to talk. [SEP] i have white shirts, white shirts, blackcoats and gray black shirts. [SEP] the complete collapse of american [SEP]
+
+===== sample 037 =====
+[CLS] pakistan, comes close to a solution, obama said. [SEP] he walked off in frustration and worked out side - by - side for the second time in a career - long year - - a tie with the series he began in march 2000. [SEP] but overall, the rebels did have a full advantage - - or even, perhaps - - and managed to move inside. [SEP] it may not have to work. [SEP] the aircraft also caters to 1, 200 britons, which are worth 2. 7 million tonnes - - on orders from the government - to the airport. [SEP] the company, which includes 37 airlines and cargo companies, [SEP]
+
+===== sample 038 =====
+[CLS] [SEP] "so it is about everyone," mr. he said. [SEP] bring out a good plan to try to keep up with the real economy. [SEP] you know, the big vampires, the elves, the elves. [SEP] we came up, dancing, the stars, that was good, but then i started, and i was really angry, "he said. [SEP]" to see that to him, he knows what's important. [SEP] israel said it would not want to return and that it would return to hamas. [SEP] at the end of the four - game day, angels starter derek matsui went back with an rbi [SEP]
+
+===== sample 039 =====
+[CLS] said. [SEP] but when a three - wheeled bus pulled me around, he pulled me into a corner, and pulled me into a corner. [SEP] well, so it was a great game for us. [SEP] foreign flights have been on strike over the past week, with security concerns that could also affect domestic flights. [SEP] we focus on baking, baking, baking, baking, baking, baking, baking, milk, baking, baking, tomato, mint. [SEP] if he's 21 years old, so i'm guessing, you just want him to keep working, you never look back again, he's ok, so where [SEP]
+
+===== sample 040 =====
+[CLS]. [SEP] in november 2002, he wrote down the bill and tried to amend the legislation. [SEP] the problem not for the jets, but for the fans and the club. [SEP] i think, from the beginning, to the end, just to the finish line. [SEP] the way the researchers are trying to point out, the problem is real. [SEP] i don't know that we have to do that, " he said. [SEP] look at the details, and then you would get me right, and then i imagine that in the case of a race, i would go - - literally - - from the end of the line. [SEP]
+
+===== sample 041 =====
+[CLS] s a great way to get together, i plan to spend the week in the light of my surroundings, " he said. [SEP] no one at the stadium went on holiday, we didn't know it would be back anyway. [SEP] the idea is to be able to get into something and something new, going right out of the hands of a soldier and getting out of it. [SEP] oh, oh, oh, so much gratitude, and, oh, yes, oh, i love and i love, the last thing it is to remember,,,, so much,,,,,, so much. [SEP] he was [SEP]
+
+===== sample 042 =====
+[CLS] in particular, but not in my personal case, they have a little smile on their faces. [SEP] for the week, the error was only about 50 %, up from 60 percent for the previous week, again in october 2008, and to 45 percent for the week of march. [SEP] "i just want to see," he said. [SEP] this needs to be true. [SEP] " so much luck, but the same kind of commitment..... [SEP] at the end of october, you talk again, and not before we, not americans, can look forward, we get it back. [SEP] it was clear that the [SEP]
+
+===== sample 043 =====
+[CLS], "he said at the end of his speech. [SEP] too many of them, the very end to them, have gone very well in the past. [SEP] the ministry spokesman declined to comment. [SEP]" written in black, full of powder, on the face of someone on the back. [SEP] so, yeah - - now, walk back to the oval office, and again, a few minutes ahead of the time. [SEP] i was trying to say "i try to pull that off - i'll do that," he said. [SEP] i've lost that resolve, "he said. [SEP]" i'm glad [SEP]
+
+===== sample 044 =====
+[CLS] have to eat..... [SEP] there is still the real history of the citycentre - - david johnson, the chief executive, wrote a note to the city to name it 1868 - - and then, he would come back to the building. [SEP] "i would, trying to get over it, get to it - - the road to play, the normal road to travel, to travel," he said. [SEP] " they don't really do anything, they've got to do everything. [SEP] that, he said, continues as the character gets to his side. [SEP] the problem was too simple. [SEP]
+
+===== sample 045 =====
+[CLS] of their own. [SEP] but, it turns out, they own it. [SEP] marston, 39, admitted he was driving and was taken back to life three days after the 13 - year - old died. [SEP] he also said that he will have to have a further period in the next few months to get a job on a different basis. [SEP] so the idea of having a baby, whether in the sink, or with the baby, may be a sign of social tension, he said. [SEP] the policy was introduced in the late 1970s, but, later, back to the 1980s. [SEP] he was taken to the royal infirmary [SEP]
+
+===== sample 046 =====
+[CLS], 2007. [SEP] the story seemed to be long and true, but ultimately, not true. [SEP] the mulls are always cool.... so they are strong in winter - - usually in days b, b, a, b, a and a. [SEP] he also died about 15 minutes before being killed. [SEP] in the moment, five minutes after the flight began the flight, we sat on the front, right up to the end of the flight, but then we took a look down the air. [SEP] it had been november, december, 2004, and 2004. [SEP] you just get that series 2 - 2. [SEP]
+
+===== sample 047 =====
+[CLS] the study found. [SEP] i think they think, they know, they realize that there's so much they do to understand into us now, they're kind of doing that sort of stupid thing, they will get to put things in their mouths. [SEP] so since i was moved,, well, i've been in,,,,,, half, half, half, half - i still have a,,, half, half, half, maybe, half, half, half, half, half,. [SEP] and they didn't do any of them. [SEP] but in the hotel room, a policeman [SEP]
+
+===== sample 048 =====
+[CLS] [SEP] if you're not sure how to drive as a person, what's more, especially with the car attached, so you can sit down again, need to feel and feel a bit backward, so you need to get ready to do it, get the focus and come back from the car while the person just goes, and grind it up. [SEP] the court had heard that the alleged incidents took place between now and last november. [SEP] in addition, these businesses will make glues, gels, chemicals to make plastics, such as glues, used in the bottom layers of steel wheels. [SEP] a review of a [SEP]
+
+===== sample 049 =====
+[CLS] to make this work, "he concluded. [SEP] if cubans don't have the cash to raise and pay taxes. [SEP] that wasn't. [SEP] and i would love you to get to a real career. [SEP] the website is available: http://www. aai. nhs. nhs. co. uk. 08. 0844, 607651, including details of address. [SEP]" we heard 4, 075 in october, " it said. [SEP] the spartans came back in the first quarter, and they did not seem to be there, i was just glad. [SEP] a couple of weeks [SEP]
+
+===== sample 050 =====
+[CLS] along with two other children. [SEP] he said that once the roof collapsed, the size of a pyramid, over the wall of the convoy of police trucks had been set in for vehicles around the site around the building. [SEP] the two have various personal relations to date, over a range of weeks and years, he said. [SEP] we do not need to be together, and have a little luck, to be able to eat together, day, in days, in day, days, days, days, and days, and days, " mr. caer said. [SEP] he started at the same. [SEP] well, i understand. [SEP]
+
+===== sample 051 =====
+[CLS] in 27 countries, according to an independent survey. [SEP] i often wanted a race for a few days, so i thought about doing one in the early days, but it was like a few days. [SEP] the story will have gone in the air, though, again, with the light of the sun in the sun. [SEP] he didn't have to bother either. [SEP] he's not sure when he's in the room, but the quality of when the lights are there is really important. [SEP] " there is no chance that they will settle - - either in the capital or in the name of peace. [SEP] he [SEP]
+
+===== sample 052 =====
+[CLS], have to be normal, we have to be able to work... [SEP] the reality now is that the dusty is over at best, not the worst, he said. [SEP] i feel, in the course of days, maybe, you should be able to say, "yes", "not no." [SEP] again, i know, there's a sign of a good relationship, down to a point, but the one, you know, where she manages to look out of herself. [SEP] hundreds of soldiers, deployed around the control point, were able to drive the ship out of the harbor, from a [SEP]
+
+===== sample 053 =====
+[CLS] - 3 - d' 90s. [SEP] you have to get up in the office, in the situation room, have a good look for a new president. [SEP] nowitzki also had assists in chicago and chicago. [SEP] there are other things to make the same decision, but maybe it is me, "he said. [SEP] i think that people have something to celebrate. [SEP] don't want to go to work unless you get a bad day... [SEP] the incident happened there at 2100 gmt on thursday. [SEP]" so there would have to be a christmas match that would come at around hour, " said mike [SEP]
+
+===== sample 054 =====
+[CLS] eight years in power. [SEP] it's a joke, a joke, everything. [SEP] the fact that the artist has never spoken is so important, however, that this is just the actual meaning given to the new era of poetry and, she says, a direct testament to the historical connection to the process. [SEP] "i think there is something good," says mr. kiosk, who is in the age of 68. [SEP] " now it has to wait three years for something. [SEP] he had been on the last day of the attack. [SEP] it was short, dark, paler and dark gray. [SEP] however, [SEP]
+
+===== sample 055 =====
+[CLS] the league start. [SEP] the union's meeting is to take the walk - off in preparation for the completion of the site. [SEP] no..... we buy all those products. [SEP] the court is expected to hear a number of civil rights cases. [SEP] it's a situation. [SEP] the larger point is that their work is likely to be more complex. [SEP] "to the right now, that is ridiculous," he said. [SEP] cook in the oven for hundreds of minutes. [SEP] a lot of things have come down, we've been through a lot of mistakes. [SEP] a bank of england in the [SEP]
+
+===== sample 056 =====
+[CLS], unable to get in a day out. [SEP] he said the figure would have been increased to £3. 3m. [SEP] the answer is not clear, so give you a something - in - a - mouth.... [SEP] instead, the station will move clockwise, just on the roof, on the outer side, and in the face of the full - side roof, with a full - side effect on the roof. [SEP] that roll call came at noon on friday, just days before the poll results showed up. [SEP] "the tsa has a better sense of ability to handle security and security issues," said bob [SEP]
+
+===== sample 057 =====
+[CLS] to take the loan. [SEP] a couple of hours after the break, at least, as the truck creeps, he swaggers the end of the show, warming up to back - to - back performances. [SEP] that was a reality early in the series. [SEP] "i do feel lucky. [SEP] everything i have remember has never been true. [SEP] there was a chance for me to get into something - - to get a little better, to get a little better, and get more in shape. [SEP]" there, i got a call, and then, i came back - - - but i stayed because i thought i [SEP]
+
+===== sample 058 =====
+[CLS] don't have to pay to get in care, but we know, we could not cover it. [SEP] it was a draw. [SEP] this time, he's off to stay a little longer, so i'm delighted. [SEP] we asked if, with the kids, we wanted to get back on, and maybe even. [SEP] the moment, zeger said, he was unable to get out of his home in the back of a car, even though he did not die. [SEP] 70, 73 - 70, 73 - 80, 73,,,,,,,,,,,,,,,, [SEP]
+
+===== sample 059 =====
+[CLS] "i'm not sure i have the type of quality and that i have to make a strong commitment to the club. [SEP] in that process comes the talk of his" impact "memoir, in which he loses his power and seems to keep on his feet. [SEP]" i urge the leaders... to move carefully and believe that the u. s. needs to be able to resolve problems in pakistan, " she said. [SEP] i know you also have to cover things. [SEP] unemployment, which rose in december, rose by 1. 3m in december from a year ago for the first full year, which began to [SEP]
+
+===== sample 060 =====
+[CLS] presence in the audience, especially in black, but it is not confirmed. [SEP] just how much difference is there really when a person turns into the air rage? [SEP] since a snow - days, period, period, and days, the winter period in the ice there has been a full period in the cold water, a full days, days, from day to day in the sun, to the arctic circle, then days, back to the water, ice in the afternoon, ice in the day, the ice in a deep place in the snow. [SEP] so i had to start three days later. [SEP] however, it seems to [SEP]
+
+===== sample 061 =====
+[CLS] was, briefly, a "fresh dog" in a freezer, so i could take the walk. [SEP] at the end of the day, then, he seems to have won. [SEP] he said the monthly fees might have been a temporary fact, since he had less time to invest in his work but would have to give him more money, or he wanted to buy more goods. [SEP] an additional 1, 200 jobs were on the private payroll in january, down from 42, 000 in december 2006, and up 4 percent from the year before. [SEP] denver, detroit, boston 90, chicago, chicago, chicago 80, cleveland [SEP]
+
+===== sample 062 =====
+[CLS] of poverty, is one of the problems, he says. [SEP] i do now have to say in person what things have to get done at the same time. [SEP] i was on the plane, and yes, everyone has to do anything, so the travel chaos was so much that i wanted to go there and then i wanted to have a flight. [SEP] of course, then, then, yes, what has to be done. [SEP] what a do, for you,,,,,,,,,,,,,,,,,,,,,,,. [SEP] the career leader, a 13 - year [SEP]
+
+===== sample 063 =====
+[CLS] said. [SEP] "when someone has arrived i have to keep a sense of perspective on all the places. [SEP] the technical problems were a problem for the colts. [SEP] the rangers moved into the spot with a 1 - 3 record, and a 17 - point lead with detroit and new york in the al east. [SEP] and, it said, the companies must have the flexibility to manage their budgets when they want to make big money. [SEP]" we have asked what the outcome of the problem is, and we want to address it. [SEP] the problem is that well into next year's disastrous presidential election - - a period when mr [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_64/state_c1024_t1p45_raw_samples.txt

@@ -0,0 +1,228 @@
+state_c1024_t1p45
+{
+  "type": "summary",
+  "name": "state_c1024_t1p45",
+  "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt",
+  "step": 124000,
+  "decode": {
+    "kind": "categorical_fullvocab",
+    "config": "state_c1024_t1p45",
+    "steps": 64,
+    "model_t_mode": "post",
+    "support_power": 1.0,
+    "semantic_power": 1.0,
+    "endpoint_temp": 1.45,
+    "concentration_min": 1.0,
+    "concentration_max": 1024.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 35.36294023649359,
+    "nll_per_token": 3.565664385797097,
+    "tokens": 9515
+  },
+  "diversity": {
+    "sample_entropy": 3.884623591993139,
+    "unique_tokens": 1443,
+    "token_count": 8192,
+    "distinct_1": 0.1761474609375,
+    "distinct_2": 0.5751722440944882,
+    "top_token_mass": 0.1007080078125
+  }
+}
+
+===== sample 000 =====
+[CLS], 2003, when the woman failed to meet in the afghanistan - pakistan border area, police said. [SEP] he doesn ' t mind a car, his father doesn ' t like being a cat or dog, so he can cope with the strain of being a dog. [SEP] ( at least ) now i have learned about the special qualities that make me sweat. [SEP] and sometimes he ' s too angry - - just to austere his way. [SEP] " i think we all need to get to that place and know it ' s what we really want, " he said. [SEP] so i didn ' t just want to see the [SEP]
+
+===== sample 001 =====
+[CLS], and it failed to come up without an effect to the law. [SEP] i ' ll have much work to do, get to get a job, get back in the house. [SEP] the woman has been told : " i don ' t want you to walk on an airplane. [SEP] " he spent his days, days, a week, and then days a week, the days, days to stay, days to get back to, end, the time of days, days, the time to work days, the time to work, and finally to be together, " al - ha, according to the magazine. [SEP] he, [SEP]
+
+===== sample 002 =====
+[CLS] said. [SEP] but the show prides itself, too, in the appearance of a good program, which ends with a lot to do. [SEP] mike brown had 13 points and four assists in a season - high victory to give the thunder the halftime lead. [SEP] after watching the first - round games with the jets, two games in the next two games, the two games of the games, and then the jets of the games, buffalo has to get to detroit, win the game, game - to - game, and get to victory. [SEP] however, i ' m confident of their support. [SEP] there is also no shortage of [SEP]
+
+===== sample 003 =====
+[CLS] oh,, well, it was a little harder, at the moment - and, well, it was like a little bit of a joke. [SEP] i still recommend it for you, but there ' s a bed, spa, a door, a coffee bar, a chair so you can ' t sign for a tree. [SEP] and we have to watch on that situation. [SEP] the man who stands up and talks with his wife said, once again, i ' m beginning to realize that he is getting ready to do it. [SEP] the marlins, losing for the first time in their third game, are in a series of four [SEP]
+
+===== sample 004 =====
+[CLS]. s. stores in parts of washington, chicago, new york, denver and chicago. [SEP] after all, i do not want to talk about it. [SEP] " i don ' t think of anything to show a decline of 50. 3 %. [SEP] the american government has already shown that i don ' t want a political leader to make a pledge to speak up to our soldiers in iraq and the american people have to put them to work with the troops and people of afghanistan. [SEP] no, the picture ends with the lights, the yellow shirts, hands with the colors, a black mask - -... [SEP] to read [SEP]
+
+===== sample 005 =====
+[CLS] hard to believe. [SEP] i ' m sorry, and you want me to do that, and i do it anyway. [SEP] " you get to work a hard, yeah, i get to work, " she said, " yes. " [SEP] and, yeah, oh, yeah, and maybe in the top 20. [SEP] the contrast is found, in the middle, the one - sided side, in the top, and in the other half of the top. [SEP] and so, if they are going to get in trouble, there ' s still room for some improvement. [SEP] then, though, they were all about, what [SEP]
+
+===== sample 006 =====
+[CLS] the country. [SEP] of course, it isn ' t enough to be a hit, to replace the iphone with the pay - off - - and to cut it back further - - until the next time. [SEP] while i think that relationship will be better, i ' ve been wrong, maybe, nothing. [SEP] for the past 20 years, years, days,, weeks, years, and months, for us to come back on the road, and then again, maybe, again... and then we get back in a bad spiral, and we have managed to get down to a halt. [SEP] the campaign also has a [SEP]
+
+===== sample 007 =====
+[CLS] said. [SEP] but, there must be a national government trying to eliminate the divide between muslims and republicans. [SEP] " thousands of iranians have never been to democracy because they have been engaged to peaceful demonstrations and are involved in making a political deal. [SEP] the latest difference to history is that the jets are on offense at the end of the season. [SEP] the answer is not for the ultimate reason, but the answer itself. [SEP] " the world series is getting us back in the world and lord ' s is ok, that ' s ok... [SEP] the audience had an emotional capacity to admit - - even to admit - - [SEP]
+
+===== sample 008 =====
+[CLS] years after israel ' s capture. [SEP] i think the whole thing is just, well, very good. [SEP] i think it ' s going to change a lot to that. [SEP] it ' s time the audience refuses to reflect on the foundation of a creator. [SEP] everything from long shorts, leather pants, silk shirts, raincoats, cut - back jackets and hood - covered tops, grey - banded vests, copper - colored shirts, black suspenders - and - tops. [SEP] sub - prime securities, the firm, was involved in the swap, which saw each of the 500 vehicles on a debt list. [SEP] what [SEP]
+
+===== sample 009 =====
+[CLS], that it would consider limiting voting rights for the funds. [SEP] he had the ability to talk, to talk, to talk, not even speak. [SEP] she opens the door in search of assistance. [SEP] if you can move back and move back alone, the employer would not put you back to work again. [SEP] in return, add together the butter and add a little vanilla. [SEP] about a dozen other items - - bundles of plastic, plastic, furniture and aluminum - - have gone out of circulation since 2002. [SEP] the authorities have put a similar case behind hold in the uk. [SEP] " for a certain number of our customers [SEP]
+
+===== sample 010 =====
+[CLS] anti - related, the federal food and drug administration said on tuesday. [SEP] ap news ' jim scirillo in mexico city and glen johnson in washington contributed to this report. [SEP] but he did not address any need for donations. [SEP] in addition to requests for comment from european authorities, the u. s. embassy declined to return phone calls to the associated press for any further comment on tuesday. [SEP] he wanted them to be on the offensive line. [SEP] " i don ' t think that we would get much rest anytime soon, " said gordon brown, the chairman of the american asset management association. [SEP] the other side, to [SEP]
+
+===== sample 011 =====
+[CLS] finally showed up. [SEP] " it ' s going to be an opportunity to have one of us give you all the money. [SEP] i ' m glad a nice, red - haired person who needs to get your family together wants to give you something, such as taking them up for a car, a bed and a room. [SEP] the mental health team examined the results of a forensic examination and the backgrounds of the suspects. [SEP] 104. 85, 84, 104, 84, 98 - 113.... [SEP] the carrier - - airlines - - can operate thousands of flights to the entire united states. [SEP] with the exception of [SEP]
+
+===== sample 012 =====
+[CLS] - 30 % higher than in 2007. [SEP] at the other end of 2 a. m., then 8, 8, 9, 11, 11, 15, and 10, 16, and 18, to get 4, 5, 4, 4, 6, 6, and back on time. [SEP] i stepped into her car and it had been a while, and she needed to do, " he said. [SEP] and if you do, a good person in the world will have a place to go or to do a job. [SEP] " i really think he deserves to be in the race, " said ridley - thomas, [SEP]
+
+===== sample 013 =====
+[CLS], he said. [SEP] he winced, hugged, the crowd froze, and exhaled. [SEP] but, there do appear to be some problems : " i found the mattress in, on occasion, the passenger drawer. " [SEP] as a result, he comes out and he says, " yeah, he has a lot to do. [SEP] i ' m not sure until the lights come out and,,,,,,, all the time, don ' t know, what,,,, what,,, what, what,. [SEP] the industry, flush with money, has run out of cars, planes, cars and planes [SEP]
+
+===== sample 014 =====
+[CLS]. [SEP] but for a long time, it has to be taken with, he said, " a great effect. " [SEP] the project is also a private investment, as part of the sale to the bank of scotland. [SEP] for now, everyone are able to get their names together - - 2, 3, 14,, 8, 12, 11, 13, a word. [SEP] i think so well. [SEP] " i wanted him to talk to him, " she added. [SEP] " i continue to love him for all, " he said. [SEP] but if there is anything to go by, it doesn ' t work. [SEP]
+
+===== sample 015 =====
+[CLS] " she said. [SEP] so much so i spent my days trying to get back to the house - i would drink in transit, i would never die in a tunnel on a bus - and it came along, so far, so quickly, just because it would stop, and then, then later, off the road. [SEP] then, every day, i mean, 49, 37, 50, i usually have 200, 200, 50, 50, 60 days. [SEP] on a short voyage, the aircraft carried aircraft, planes and equipment to the roof of the united nation ' s fueling system. [SEP] i agree with your assertion [SEP]
+
+===== sample 016 =====
+[CLS] happens on wall, say, rather, newspapers, it is no reflection of their diversity. [SEP] the story doesn ' t seem to work out the only way of finding a way to feel bad news. [SEP] we started with a computer, two minutes, a few minutes, looking at the hotel ' s small door, looking in its yard. [SEP] a 45 - year - old french student who says she wrote her boyfriend ' s name is on the stand, a court heard. [SEP] i have been in the field since the age of 17, but i never had one. [SEP] but i just think that with the obvious problems, there [SEP]
+
+===== sample 017 =====
+[CLS] investors, would seem to include the idea of a short - term buy - out. [SEP] what makes an even greater problem, the truth, is a combination of - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -. [SEP] but it ' s not a time to start and tell us to look here. [SEP] the 21 - year - old midfielder moved to liverpool from the club in 2006. [SEP] the house, kupech said, is expected to be a 300 - foot vehicle with a top speed of 40 miles [SEP]
+
+===== sample 018 =====
+[CLS] not have the opportunity to speak unless i have to listen to read the novel. [SEP] london ( ap ) - british transport officials have launched a " demonstration " operation over the refusal of european union airspace to allow flights to the hubble and a lack of extra transport flights so the mission can expand beyond the end of the full year. [SEP] police are keen to speak to four men, including the father of a baby, who walked in the heart of york street, eastbourne, at 0115 gmt on saturday. [SEP] by the way, fluorescent lights, candles, rubbers and candles come together, shoes, pillows, etc. [SEP]
+
+===== sample 019 =====
+[CLS] said. [SEP] they may have a good future in self - esteem and we have had to question the trust of children at the end of their lives. [SEP] i like the sparkle of light, i can see from the top windows, the sparkle of the ceiling, the sparkle of lights. [SEP] the bill also includes the use of emergency planes, the use of cargo planes, cargo planes, the use of passenger planes, aircraft and automobiles. [SEP] if to make it for a two - win race against the best team in the world, we are just right to keep on making the most of the game. [SEP] here, it seems, [SEP]
+
+===== sample 020 =====
+[CLS] " he said. [SEP] when hillary clinton told the crowd that she wanted to make " a fateful ( inky ) gesture out of her mouth, " my name was raised. [SEP] his coats of black tops and dark white shoes, all clouds white, a long black scarf, a black white hat, and a large - looking black top - - faded and then, again, then we all have to wait and then half,, then half,, half,, the carpet is on. [SEP] the uk ' s foreign minister said in a statement released on monday that it was a " significant priority " for efforts to resolve the [SEP]
+
+===== sample 021 =====
+[CLS]. [SEP] " it was a guy on the other side of a line, saying..., kind of " shit, wack, " he said... [SEP] there is a lot of space in all of our minds, that need to think how our lives have changed, " he said a while earlier. [SEP] a bit of art, that seems to me, comes with an arm and a lot of empty mind. [SEP] " it is a law they must change, because it is so, " he said. [SEP] the teen, hamilton of michigan, was arrested in a separate area just days outside his home on a [SEP]
+
+===== sample 022 =====
+[CLS] to be completed in one to two days. [SEP] the government statement said the school would return by december, beginning in 2014. [SEP] overby said she is concerned about the concept behind that decision when she wants to get the job done and vote for it. [SEP] some are very hard, some funky, some making it up and just trying to make a bit more than a bit bland and sweet. [SEP] chicago ( reuters ) - trade leaders, meeting in chicago hoping to boost trade between the u. s. and africa, will meet in a bid to forge a balance on trade, a senior official said on monday. [SEP] the company [SEP]
+
+===== sample 023 =====
+[CLS], the company has said it will not reveal what they are thinking about. [SEP] " unfortunately at the moment, many of us have no access to public funding, and refuse to work to deal with the enormous issues. [SEP] he never gets a chance to start, just to start in the locker room. [SEP] a small seating area has been set up inside, and large spaces in the area. [SEP] " it ' s like he ' s driving, going down in the road, going back on the street at work, going on to back, but going back - in - the - road, down the road, up there. [SEP] [SEP]
+
+===== sample 024 =====
+[CLS] in 2001. [SEP] the farmers, he said, will not do it until 2017, and then will make ends meet in season to season, with the current peaking at a peak of around 50c in two years. [SEP] with the lights of miami, the story turned green, green, black and green, and the dust of black faded in the wind and the stone pillars of the wall again faded. [SEP] the officials, speaking condition of anonymity, agreed that obama ' s withdrawal would continue until the end of the year. [SEP] no, i try to tell you the author may just be a 300 - a - word, [SEP]
+
+===== sample 025 =====
+[CLS] unusual, however, at this time. [SEP] people wanted to wake up to understand the situation, " said to the student, who said the noise was " fantastic " and then he got back on the ground. [SEP] i mean sorry, but then you, god, take a day for a tea, some for a pill, men and women. [SEP] " anything that will happen within the term - - when it is half a century - - will be much harder to prepare for, " he said. [SEP] the teams spent about four days a week trying to bring the best of the best of the nba chicago, june 30 ( up [SEP]
+
+===== sample 026 =====
+[CLS] they started to sing, they began laughing, " she said. [SEP] and, i can ' t understand how, for now, people are willing to drop their wallets and put their noses in the door. [SEP] the family then wanted to get a question - and - answer to where he was going, he said. [SEP] " here, the game has not come to a close. [SEP] now that the economy is back to the boom - and - bust cycles, and the process continues, the idea that everything is going in a little bit and moving is we have to wait and get a little longer. [SEP] he began with a [SEP]
+
+===== sample 027 =====
+[CLS] his plan, and he ruled out it would do something to some of his clients. [SEP] but a few weeks, for me, and for the fans, it has been the time for me to fight, " he said. [SEP] after a restoration, the final part of the houseboard section of the building, confined to the ceiling railings, returns to the edge of darkness. [SEP] this requirement has been put in one place. [SEP] at least 100 french soldiers have been killed. [SEP] and when i do, i take off, i feel the smell of music in my face. [SEP] he struggles with the breadth of his collection. [SEP]
+
+===== sample 028 =====
+[CLS] meeting in baghdad, the official told reporters. [SEP] they were the real problem and they were all on their own. [SEP] " i remember him was once standing on the other side of the room, and with him, he said, come back, look up, he said goodbye, and then he said to me, and he said yes, he was another. [SEP] and, oh, uh - oh, there ' s a lot. [SEP] only a few of the drugs were used in britain to treat serious kidney problems. [SEP] so, then, are the bigger problems. [SEP] " people don ' t wait for answers. [SEP] " [SEP]
+
+===== sample 029 =====
+[CLS] said. [SEP] the result of our investigation is that the internet is a priority. [SEP] i think the children will find themselves sitting in disbelief, if they are to turn around. [SEP] the financial collapse of the credit crunch, many of its names were being announced, appears to have engulfed some of the world ' s most susceptic economies. [SEP] even when it gets done, that kind of person eats up a hair and refuses to come. [SEP] and the message was clear that, with the end of the olympics in sight, i didn ' t have a sense of humor, or even the thrill of getting in a field. [SEP]
+
+===== sample 030 =====
+[CLS] couple of hours, i would not be able to get the full flight, he said. [SEP] but he knew, and he refused to speak. [SEP] we do not like the things that the person at the top, at a corner, at the top, at the top line, the body, to the top, the bottom line, up to the top. [SEP] while the emotional nature of the story, in which the story is taken by the author ' s son on a huge canvas, has settled the issue, the narrative of moyesque is far deeper than ever. [SEP] so, if i only get through the house, [SEP]
+
+===== sample 031 =====
+[CLS]. [SEP] the hospital has a great room and is a very nice room, a great group, " he said. [SEP] when everyone talks about him and his accomplishments, i will wonder if they are anything more, just temporary. [SEP] 7, detroit, calgary - toronto 11 - 13, detroit - boston 16, detroit - chicago, detroit - chicago, in place of chicago, detroit - denver. [SEP] more than 30 aircraft, including 13 men, women and one - third of the staff, were scheduled to leave in coming days, the coalition said. [SEP] 5 to serve as head of the special forces command. [SEP] the article appeared [SEP]
+
+===== sample 032 =====
+[CLS] [SEP] that is what is a situation not changed since the end of the 1970s. [SEP] the only way to do, say, say, say, say, look, it ' s a matter of working the hard, with little problem, trying to get the word ' turn ' right. [SEP] yes, however, the distinction is important. [SEP] he just started in chicago, detroit, denver, chicago, before going to the airport. [SEP] but, time is on the line, there are days to be had, now, and then, and, finally, with the chance to become, again, a half - day. [SEP] the [SEP]
+
+===== sample 033 =====
+[CLS] the girl, a 6 - year - old little girl. [SEP] the baby is ½ - and - 1 - - tucked up in dark pajamas, working in suitcases, bunks, and in pantsuits, in dark pants. [SEP] meanwhile, these researchers are also parachuted in to work with special equipment to deliver these additional multi - wheeled units - - including lifts, lifts, wheelchairs, lifts and - - on support of emc technology. [SEP] canada. [SEP] the plane, £1, 095 ( £11, 772 ), has seven flights. [SEP] " it ' s like we ' re not talking. [SEP]
+
+===== sample 034 =====
+[CLS] chicago in chicago, chicago - to tampa, detroit, and - detroit in cleveland. [SEP] i just think he is going to step down if he doesn ' t plan to return. [SEP] it ' s 60, 50,, 50, 60, - - 50, 50 - - 50, 38, 36, 48 days. [SEP] brown had 16 points and nine rebounds, including a point game, a trip to the blue devils, and even a game in the second period. [SEP] 9, chicago 17, new jersey 18. [SEP] he refused to give his students of dollars and even told them to check in. [SEP] the court heard [SEP]
+
+===== sample 035 =====
+[CLS] said. [SEP] a lovely, fruit - scented version of wilt vanilla, with a paler shade of lemon flavors. [SEP] chicago is 7 - 4 with a 2 - 2 - 2 era. [SEP] it ' s quite a bit to learn. [SEP] " he ' s really so clever, he moved quickly through his acting period, and got into a place where he huffed and puffed and rolled up his teeth, opened his eyes. " [SEP] there are people who have other types of financial support. [SEP] " the victory will have a huge impact, " analysts say, for the fast - growing insurgency. [SEP] i never believe that a [SEP]
+
+===== sample 036 =====
+[CLS] began in january 2005. [SEP] other cities have made significant gains, including london, in london, and in the midlands, for the last five years. [SEP] " i think i ' d just like to sleep, but when it is good, you get to sleep, not well, " he said. [SEP] the next day, however, she is asleep in the next room, but the answer begins to appear, she ' s looking up and laughing. [SEP] " i don ' t think he is going to talk. [SEP] i have white shirts, white shirts, blackcoats and gray black shirts. [SEP] the complete collapse of american [SEP]
+
+===== sample 037 =====
+[CLS] pakistan, comes close to a solution, obama said. [SEP] he walked off in frustration and worked out side - by - side for the second time in a career - long year - - a tie with the series he began in march 2000. [SEP] but overall, the rebels did have a full advantage - - or even, perhaps - - and managed to move inside. [SEP] it may not have to work. [SEP] the aircraft also caters to 1, 200 britons, which are worth 2. 7 million tonnes - - on orders from the government - to the airport. [SEP] the company, which includes 37 airlines and cargo companies, [SEP]
+
+===== sample 038 =====
+[CLS] [SEP] " so it is about everyone, " mr. he said. [SEP] bring out a good plan to try to keep up with the real economy. [SEP] you know, the big vampires, the elves, the elves. [SEP] we came up, dancing, the stars, that was good, but then i started, and i was really angry, " he said. [SEP] " to see that to him, he knows what ' s important. [SEP] israel said it would not want to return and that it would return to hamas. [SEP] at the end of the four - game day, angels starter derek matsui went back with an rbi [SEP]
+
+===== sample 039 =====
+[CLS] said. [SEP] but when a three - wheeled bus pulled me around, he pulled me into a corner, and pulled me into a corner. [SEP] well, so it was a great game for us. [SEP] foreign flights have been on strike over the past week, with security concerns that could also affect domestic flights. [SEP] we focus on baking, baking, baking, baking, baking, baking, baking, milk, baking, baking, tomato, mint. [SEP] if he ' s 21 years old, so i ' m guessing, you just want him to keep working, you never look back again, he ' s ok, so where [SEP]
+
+===== sample 040 =====
+[CLS]. [SEP] in november 2002, he wrote down the bill and tried to amend the legislation. [SEP] the problem not for the jets, but for the fans and the club. [SEP] i think, from the beginning, to the end, just to the finish line. [SEP] the way the researchers are trying to point out, the problem is real. [SEP] i don ' t know that we have to do that, " he said. [SEP] look at the details, and then you would get me right, and then i imagine that in the case of a race, i would go - - literally - - from the end of the line. [SEP]
+
+===== sample 041 =====
+[CLS] s a great way to get together, i plan to spend the week in the light of my surroundings, " he said. [SEP] no one at the stadium went on holiday, we didn ' t know it would be back anyway. [SEP] the idea is to be able to get into something and something new, going right out of the hands of a soldier and getting out of it. [SEP] oh, oh, oh, so much gratitude, and, oh, yes, oh, i love and i love, the last thing it is to remember,,,, so much,,,,,, so much. [SEP] he was [SEP]
+
+===== sample 042 =====
+[CLS] in particular, but not in my personal case, they have a little smile on their faces. [SEP] for the week, the error was only about 50 %, up from 60 percent for the previous week, again in october 2008, and to 45 percent for the week of march. [SEP] " i just want to see, " he said. [SEP] this needs to be true. [SEP] " so much luck, but the same kind of commitment..... [SEP] at the end of october, you talk again, and not before we, not americans, can look forward, we get it back. [SEP] it was clear that the [SEP]
+
+===== sample 043 =====
+[CLS], " he said at the end of his speech. [SEP] too many of them, the very end to them, have gone very well in the past. [SEP] the ministry spokesman declined to comment. [SEP] " written in black, full of powder, on the face of someone on the back. [SEP] so, yeah - - now, walk back to the oval office, and again, a few minutes ahead of the time. [SEP] i was trying to say " i try to pull that off - i ' ll do that, " he said. [SEP] i ' ve lost that resolve, " he said. [SEP] " i ' m glad [SEP]
+
+===== sample 044 =====
+[CLS] have to eat..... [SEP] there is still the real history of the citycentre - - david johnson, the chief executive, wrote a note to the city to name it 1868 - - and then, he would come back to the building. [SEP] " i would, trying to get over it, get to it - - the road to play, the normal road to travel, to travel, " he said. [SEP] " they don ' t really do anything, they ' ve got to do everything. [SEP] that, he said, continues as the character gets to his side. [SEP] the problem was too simple. [SEP]
+
+===== sample 045 =====
+[CLS] of their own. [SEP] but, it turns out, they own it. [SEP] marston, 39, admitted he was driving and was taken back to life three days after the 13 - year - old died. [SEP] he also said that he will have to have a further period in the next few months to get a job on a different basis. [SEP] so the idea of having a baby, whether in the sink, or with the baby, may be a sign of social tension, he said. [SEP] the policy was introduced in the late 1970s, but, later, back to the 1980s. [SEP] he was taken to the royal infirmary [SEP]
+
+===== sample 046 =====
+[CLS], 2007. [SEP] the story seemed to be long and true, but ultimately, not true. [SEP] the mulls are always cool.... so they are strong in winter - - usually in days b, b, a, b, a and a. [SEP] he also died about 15 minutes before being killed. [SEP] in the moment, five minutes after the flight began the flight, we sat on the front, right up to the end of the flight, but then we took a look down the air. [SEP] it had been november, december, 2004, and 2004. [SEP] you just get that series 2 - 2. [SEP]
+
+===== sample 047 =====
+[CLS] the study found. [SEP] i think they think, they know, they realize that there ' s so much they do to understand into us now, they ' re kind of doing that sort of stupid thing, they will get to put things in their mouths. [SEP] so since i was moved,, well, i ' ve been in,,,,,, half, half, half, half - i still have a,,, half, half, half, maybe, half, half, half, half, half,. [SEP] and they didn ' t do any of them. [SEP] but in the hotel room, a policeman [SEP]
+
+===== sample 048 =====
+[CLS] [SEP] if you ' re not sure how to drive as a person, what ' s more, especially with the car attached, so you can sit down again, need to feel and feel a bit backward, so you need to get ready to do it, get the focus and come back from the car while the person just goes, and grind it up. [SEP] the court had heard that the alleged incidents took place between now and last november. [SEP] in addition, these businesses will make glues, gels, chemicals to make plastics, such as glues, used in the bottom layers of steel wheels. [SEP] a review of a [SEP]
+
+===== sample 049 =====
+[CLS] to make this work, " he concluded. [SEP] if cubans don ' t have the cash to raise and pay taxes. [SEP] that wasn ' t. [SEP] and i would love you to get to a real career. [SEP] the website is available : http : / / www. aai. nhs. nhs. co. uk. 08. 0844, 607651, including details of address. [SEP] " we heard 4, 075 in october, " it said. [SEP] the spartans came back in the first quarter, and they did not seem to be there, i was just glad. [SEP] a couple of weeks [SEP]
+
+===== sample 050 =====
+[CLS] along with two other children. [SEP] he said that once the roof collapsed, the size of a pyramid, over the wall of the convoy of police trucks had been set in for vehicles around the site around the building. [SEP] the two have various personal relations to date, over a range of weeks and years, he said. [SEP] we do not need to be together, and have a little luck, to be able to eat together, day, in days, in day, days, days, days, and days, and days, " mr. caer said. [SEP] he started at the same. [SEP] well, i understand. [SEP]
+
+===== sample 051 =====
+[CLS] in 27 countries, according to an independent survey. [SEP] i often wanted a race for a few days, so i thought about doing one in the early days, but it was like a few days. [SEP] the story will have gone in the air, though, again, with the light of the sun in the sun. [SEP] he didn ' t have to bother either. [SEP] he ' s not sure when he ' s in the room, but the quality of when the lights are there is really important. [SEP] " there is no chance that they will settle - - either in the capital or in the name of peace. [SEP] he [SEP]
+
+===== sample 052 =====
+[CLS], have to be normal, we have to be able to work... [SEP] the reality now is that the dusty is over at best, not the worst, he said. [SEP] i feel, in the course of days, maybe, you should be able to say, " yes ", " not no. " [SEP] again, i know, there ' s a sign of a good relationship, down to a point, but the one, you know, where she manages to look out of herself. [SEP] hundreds of soldiers, deployed around the control point, were able to drive the ship out of the harbor, from a [SEP]
+
+===== sample 053 =====
+[CLS] - 3 - d ' 90s. [SEP] you have to get up in the office, in the situation room, have a good look for a new president. [SEP] nowitzki also had assists in chicago and chicago. [SEP] there are other things to make the same decision, but maybe it is me, " he said. [SEP] i think that people have something to celebrate. [SEP] don ' t want to go to work unless you get a bad day... [SEP] the incident happened there at 2100 gmt on thursday. [SEP] " so there would have to be a christmas match that would come at around hour, " said mike [SEP]
+
+===== sample 054 =====
+[CLS] eight years in power. [SEP] it ' s a joke, a joke, everything. [SEP] the fact that the artist has never spoken is so important, however, that this is just the actual meaning given to the new era of poetry and, she says, a direct testament to the historical connection to the process. [SEP] " i think there is something good, " says mr. kiosk, who is in the age of 68. [SEP] " now it has to wait three years for something. [SEP] he had been on the last day of the attack. [SEP] it was short, dark, paler and dark gray. [SEP] however, [SEP]
+
+===== sample 055 =====
+[CLS] the league start. [SEP] the union ' s meeting is to take the walk - off in preparation for the completion of the site. [SEP] no..... we buy all those products. [SEP] the court is expected to hear a number of civil rights cases. [SEP] it ' s a situation. [SEP] the larger point is that their work is likely to be more complex. [SEP] " to the right now, that is ridiculous, " he said. [SEP] cook in the oven for hundreds of minutes. [SEP] a lot of things have come down, we ' ve been through a lot of mistakes. [SEP] a bank of england in the [SEP]
+
+===== sample 056 =====
+[CLS], unable to get in a day out. [SEP] he said the figure would have been increased to £3. 3m. [SEP] the answer is not clear, so give you a something - in - a - mouth.... [SEP] instead, the station will move clockwise, just on the roof, on the outer side, and in the face of the full - side roof, with a full - side effect on the roof. [SEP] that roll call came at noon on friday, just days before the poll results showed up. [SEP] " the tsa has a better sense of ability to handle security and security issues, " said bob [SEP]
+
+===== sample 057 =====
+[CLS] to take the loan. [SEP] a couple of hours after the break, at least, as the truck creeps, he swaggers the end of the show, warming up to back - to - back performances. [SEP] that was a reality early in the series. [SEP] " i do feel lucky. [SEP] everything i have remember has never been true. [SEP] there was a chance for me to get into something - - to get a little better, to get a little better, and get more in shape. [SEP] " there, i got a call, and then, i came back - - - but i stayed because i thought i [SEP]
+
+===== sample 058 =====
+[CLS] don ' t have to pay to get in care, but we know, we could not cover it. [SEP] it was a draw. [SEP] this time, he ' s off to stay a little longer, so i ' m delighted. [SEP] we asked if, with the kids, we wanted to get back on, and maybe even. [SEP] the moment, zeger said, he was unable to get out of his home in the back of a car, even though he did not die. [SEP] 70, 73 - 70, 73 - 80, 73,,,,,,,,,,,,,,,, [SEP]
+
+===== sample 059 =====
+[CLS] " i ' m not sure i have the type of quality and that i have to make a strong commitment to the club. [SEP] in that process comes the talk of his " impact " memoir, in which he loses his power and seems to keep on his feet. [SEP] " i urge the leaders... to move carefully and believe that the u. s. needs to be able to resolve problems in pakistan, " she said. [SEP] i know you also have to cover things. [SEP] unemployment, which rose in december, rose by 1. 3m in december from a year ago for the first full year, which began to [SEP]
+
+===== sample 060 =====
+[CLS] presence in the audience, especially in black, but it is not confirmed. [SEP] just how much difference is there really when a person turns into the air rage? [SEP] since a snow - days, period, period, and days, the winter period in the ice there has been a full period in the cold water, a full days, days, from day to day in the sun, to the arctic circle, then days, back to the water, ice in the afternoon, ice in the day, the ice in a deep place in the snow. [SEP] so i had to start three days later. [SEP] however, it seems to [SEP]
+
+===== sample 061 =====
+[CLS] was, briefly, a " fresh dog " in a freezer, so i could take the walk. [SEP] at the end of the day, then, he seems to have won. [SEP] he said the monthly fees might have been a temporary fact, since he had less time to invest in his work but would have to give him more money, or he wanted to buy more goods. [SEP] an additional 1, 200 jobs were on the private payroll in january, down from 42, 000 in december 2006, and up 4 percent from the year before. [SEP] denver, detroit, boston 90, chicago, chicago, chicago 80, cleveland [SEP]
+
+===== sample 062 =====
+[CLS] of poverty, is one of the problems, he says. [SEP] i do now have to say in person what things have to get done at the same time. [SEP] i was on the plane, and yes, everyone has to do anything, so the travel chaos was so much that i wanted to go there and then i wanted to have a flight. [SEP] of course, then, then, yes, what has to be done. [SEP] what a do, for you,,,,,,,,,,,,,,,,,,,,,,,. [SEP] the career leader, a 13 - year [SEP]
+
+===== sample 063 =====
+[CLS] said. [SEP] " when someone has arrived i have to keep a sense of perspective on all the places. [SEP] the technical problems were a problem for the colts. [SEP] the rangers moved into the spot with a 1 - 3 record, and a 17 - point lead with detroit and new york in the al east. [SEP] and, it said, the companies must have the flexibility to manage their budgets when they want to make big money. [SEP] " we have asked what the outcome of the problem is, and we want to address it. [SEP] the problem is that well into next year ' s disastrous presidential election - - a period when mr [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_64/state_c1024_t1p45_scored.jsonl

@@ -0,0 +1,65 @@
+{"type": "summary", "name": "state_c1024_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c1024_t1p45", "steps": 64, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 1024.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 35.36294023649359, "nll_per_token": 3.565664385797097, "tokens": 9515}, "diversity": {"sample_entropy": 3.884623591993139, "unique_tokens": 1443, "token_count": 8192, "distinct_1": 0.1761474609375, "distinct_2": 0.5751722440944882, "top_token_mass": 0.1007080078125}}
+{"type": "sample", "index": 0, "raw_text": "[CLS], 2003, when the woman failed to meet in the afghanistan - pakistan border area, police said. [SEP] he doesn ' t mind a car, his father doesn ' t like being a cat or dog, so he can cope with the strain of being a dog. [SEP] ( at least ) now i have learned about the special qualities that make me sweat. [SEP] and sometimes he ' s too angry - - just to austere his way. [SEP] \" i think we all need to get to that place and know it ' s what we really want, \" he said. [SEP] so i didn ' t just want to see the [SEP]", "detok_text": "[CLS], 2003, when the woman failed to meet in the afghanistan - pakistan border area, police said. [SEP] he doesn't mind a car, his father doesn't like being a cat or dog, so he can cope with the strain of being a dog. [SEP] (at least) now i have learned about the special qualities that make me sweat. [SEP] and sometimes he's too angry - - just to austere his way. [SEP] \"i think we all need to get to that place and know it's what we really want,\" he said. [SEP] so i didn't just want to see the [SEP]"}
+{"type": "sample", "index": 1, "raw_text": "[CLS], and it failed to come up without an effect to the law. [SEP] i ' ll have much work to do, get to get a job, get back in the house. [SEP] the woman has been told : \" i don ' t want you to walk on an airplane. [SEP] \" he spent his days, days, a week, and then days a week, the days, days to stay, days to get back to, end, the time of days, days, the time to work days, the time to work, and finally to be together, \" al - ha, according to the magazine. [SEP] he, [SEP]", "detok_text": "[CLS], and it failed to come up without an effect to the law. [SEP] i'll have much work to do, get to get a job, get back in the house. [SEP] the woman has been told: \"i don't want you to walk on an airplane. [SEP]\" he spent his days, days, a week, and then days a week, the days, days to stay, days to get back to, end, the time of days, days, the time to work days, the time to work, and finally to be together, \" al - ha, according to the magazine. [SEP] he, [SEP]"}
+{"type": "sample", "index": 2, "raw_text": "[CLS] said. [SEP] but the show prides itself, too, in the appearance of a good program, which ends with a lot to do. [SEP] mike brown had 13 points and four assists in a season - high victory to give the thunder the halftime lead. [SEP] after watching the first - round games with the jets, two games in the next two games, the two games of the games, and then the jets of the games, buffalo has to get to detroit, win the game, game - to - game, and get to victory. [SEP] however, i ' m confident of their support. [SEP] there is also no shortage of [SEP]", "detok_text": "[CLS] said. [SEP] but the show prides itself, too, in the appearance of a good program, which ends with a lot to do. [SEP] mike brown had 13 points and four assists in a season - high victory to give the thunder the halftime lead. [SEP] after watching the first - round games with the jets, two games in the next two games, the two games of the games, and then the jets of the games, buffalo has to get to detroit, win the game, game - to - game, and get to victory. [SEP] however, i'm confident of their support. [SEP] there is also no shortage of [SEP]"}
+{"type": "sample", "index": 3, "raw_text": "[CLS] oh,, well, it was a little harder, at the moment - and, well, it was like a little bit of a joke. [SEP] i still recommend it for you, but there ' s a bed, spa, a door, a coffee bar, a chair so you can ' t sign for a tree. [SEP] and we have to watch on that situation. [SEP] the man who stands up and talks with his wife said, once again, i ' m beginning to realize that he is getting ready to do it. [SEP] the marlins, losing for the first time in their third game, are in a series of four [SEP]", "detok_text": "[CLS] oh,, well, it was a little harder, at the moment - and, well, it was like a little bit of a joke. [SEP] i still recommend it for you, but there's a bed, spa, a door, a coffee bar, a chair so you can't sign for a tree. [SEP] and we have to watch on that situation. [SEP] the man who stands up and talks with his wife said, once again, i'm beginning to realize that he is getting ready to do it. [SEP] the marlins, losing for the first time in their third game, are in a series of four [SEP]"}
+{"type": "sample", "index": 4, "raw_text": "[CLS]. s. stores in parts of washington, chicago, new york, denver and chicago. [SEP] after all, i do not want to talk about it. [SEP] \" i don ' t think of anything to show a decline of 50. 3 %. [SEP] the american government has already shown that i don ' t want a political leader to make a pledge to speak up to our soldiers in iraq and the american people have to put them to work with the troops and people of afghanistan. [SEP] no, the picture ends with the lights, the yellow shirts, hands with the colors, a black mask - -... [SEP] to read [SEP]", "detok_text": "[CLS]. s. stores in parts of washington, chicago, new york, denver and chicago. [SEP] after all, i do not want to talk about it. [SEP] \" i don't think of anything to show a decline of 50. 3 %. [SEP] the american government has already shown that i don't want a political leader to make a pledge to speak up to our soldiers in iraq and the american people have to put them to work with the troops and people of afghanistan. [SEP] no, the picture ends with the lights, the yellow shirts, hands with the colors, a black mask - -... [SEP] to read [SEP]"}
+{"type": "sample", "index": 5, "raw_text": "[CLS] hard to believe. [SEP] i ' m sorry, and you want me to do that, and i do it anyway. [SEP] \" you get to work a hard, yeah, i get to work, \" she said, \" yes. \" [SEP] and, yeah, oh, yeah, and maybe in the top 20. [SEP] the contrast is found, in the middle, the one - sided side, in the top, and in the other half of the top. [SEP] and so, if they are going to get in trouble, there ' s still room for some improvement. [SEP] then, though, they were all about, what [SEP]", "detok_text": "[CLS] hard to believe. [SEP] i'm sorry, and you want me to do that, and i do it anyway. [SEP] \"you get to work a hard, yeah, i get to work,\" she said, \"yes.\" [SEP] and, yeah, oh, yeah, and maybe in the top 20. [SEP] the contrast is found, in the middle, the one - sided side, in the top, and in the other half of the top. [SEP] and so, if they are going to get in trouble, there's still room for some improvement. [SEP] then, though, they were all about, what [SEP]"}
+{"type": "sample", "index": 6, "raw_text": "[CLS] the country. [SEP] of course, it isn ' t enough to be a hit, to replace the iphone with the pay - off - - and to cut it back further - - until the next time. [SEP] while i think that relationship will be better, i ' ve been wrong, maybe, nothing. [SEP] for the past 20 years, years, days,, weeks, years, and months, for us to come back on the road, and then again, maybe, again... and then we get back in a bad spiral, and we have managed to get down to a halt. [SEP] the campaign also has a [SEP]", "detok_text": "[CLS] the country. [SEP] of course, it isn't enough to be a hit, to replace the iphone with the pay - off - - and to cut it back further - - until the next time. [SEP] while i think that relationship will be better, i've been wrong, maybe, nothing. [SEP] for the past 20 years, years, days,, weeks, years, and months, for us to come back on the road, and then again, maybe, again... and then we get back in a bad spiral, and we have managed to get down to a halt. [SEP] the campaign also has a [SEP]"}
+{"type": "sample", "index": 7, "raw_text": "[CLS] said. [SEP] but, there must be a national government trying to eliminate the divide between muslims and republicans. [SEP] \" thousands of iranians have never been to democracy because they have been engaged to peaceful demonstrations and are involved in making a political deal. [SEP] the latest difference to history is that the jets are on offense at the end of the season. [SEP] the answer is not for the ultimate reason, but the answer itself. [SEP] \" the world series is getting us back in the world and lord ' s is ok, that ' s ok... [SEP] the audience had an emotional capacity to admit - - even to admit - - [SEP]", "detok_text": "[CLS] said. [SEP] but, there must be a national government trying to eliminate the divide between muslims and republicans. [SEP] \"thousands of iranians have never been to democracy because they have been engaged to peaceful demonstrations and are involved in making a political deal. [SEP] the latest difference to history is that the jets are on offense at the end of the season. [SEP] the answer is not for the ultimate reason, but the answer itself. [SEP]\" the world series is getting us back in the world and lord's is ok, that's ok... [SEP] the audience had an emotional capacity to admit - - even to admit - - [SEP]"}
+{"type": "sample", "index": 8, "raw_text": "[CLS] years after israel ' s capture. [SEP] i think the whole thing is just, well, very good. [SEP] i think it ' s going to change a lot to that. [SEP] it ' s time the audience refuses to reflect on the foundation of a creator. [SEP] everything from long shorts, leather pants, silk shirts, raincoats, cut - back jackets and hood - covered tops, grey - banded vests, copper - colored shirts, black suspenders - and - tops. [SEP] sub - prime securities, the firm, was involved in the swap, which saw each of the 500 vehicles on a debt list. [SEP] what [SEP]", "detok_text": "[CLS] years after israel's capture. [SEP] i think the whole thing is just, well, very good. [SEP] i think it's going to change a lot to that. [SEP] it's time the audience refuses to reflect on the foundation of a creator. [SEP] everything from long shorts, leather pants, silk shirts, raincoats, cut - back jackets and hood - covered tops, grey - banded vests, copper - colored shirts, black suspenders - and - tops. [SEP] sub - prime securities, the firm, was involved in the swap, which saw each of the 500 vehicles on a debt list. [SEP] what [SEP]"}
+{"type": "sample", "index": 9, "raw_text": "[CLS], that it would consider limiting voting rights for the funds. [SEP] he had the ability to talk, to talk, to talk, not even speak. [SEP] she opens the door in search of assistance. [SEP] if you can move back and move back alone, the employer would not put you back to work again. [SEP] in return, add together the butter and add a little vanilla. [SEP] about a dozen other items - - bundles of plastic, plastic, furniture and aluminum - - have gone out of circulation since 2002. [SEP] the authorities have put a similar case behind hold in the uk. [SEP] \" for a certain number of our customers [SEP]", "detok_text": "[CLS], that it would consider limiting voting rights for the funds. [SEP] he had the ability to talk, to talk, to talk, not even speak. [SEP] she opens the door in search of assistance. [SEP] if you can move back and move back alone, the employer would not put you back to work again. [SEP] in return, add together the butter and add a little vanilla. [SEP] about a dozen other items - - bundles of plastic, plastic, furniture and aluminum - - have gone out of circulation since 2002. [SEP] the authorities have put a similar case behind hold in the uk. [SEP] \" for a certain number of our customers [SEP]"}
+{"type": "sample", "index": 10, "raw_text": "[CLS] anti - related, the federal food and drug administration said on tuesday. [SEP] ap news ' jim scirillo in mexico city and glen johnson in washington contributed to this report. [SEP] but he did not address any need for donations. [SEP] in addition to requests for comment from european authorities, the u. s. embassy declined to return phone calls to the associated press for any further comment on tuesday. [SEP] he wanted them to be on the offensive line. [SEP] \" i don ' t think that we would get much rest anytime soon, \" said gordon brown, the chairman of the american asset management association. [SEP] the other side, to [SEP]", "detok_text": "[CLS] anti - related, the federal food and drug administration said on tuesday. [SEP] ap news' jim scirillo in mexico city and glen johnson in washington contributed to this report. [SEP] but he did not address any need for donations. [SEP] in addition to requests for comment from european authorities, the u. s. embassy declined to return phone calls to the associated press for any further comment on tuesday. [SEP] he wanted them to be on the offensive line. [SEP] \"i don't think that we would get much rest anytime soon,\" said gordon brown, the chairman of the american asset management association. [SEP] the other side, to [SEP]"}
+{"type": "sample", "index": 11, "raw_text": "[CLS] finally showed up. [SEP] \" it ' s going to be an opportunity to have one of us give you all the money. [SEP] i ' m glad a nice, red - haired person who needs to get your family together wants to give you something, such as taking them up for a car, a bed and a room. [SEP] the mental health team examined the results of a forensic examination and the backgrounds of the suspects. [SEP] 104. 85, 84, 104, 84, 98 - 113.... [SEP] the carrier - - airlines - - can operate thousands of flights to the entire united states. [SEP] with the exception of [SEP]", "detok_text": "[CLS] finally showed up. [SEP] \" it's going to be an opportunity to have one of us give you all the money. [SEP] i'm glad a nice, red - haired person who needs to get your family together wants to give you something, such as taking them up for a car, a bed and a room. [SEP] the mental health team examined the results of a forensic examination and the backgrounds of the suspects. [SEP] 104. 85, 84, 104, 84, 98 - 113.... [SEP] the carrier - - airlines - - can operate thousands of flights to the entire united states. [SEP] with the exception of [SEP]"}
+{"type": "sample", "index": 12, "raw_text": "[CLS] - 30 % higher than in 2007. [SEP] at the other end of 2 a. m., then 8, 8, 9, 11, 11, 15, and 10, 16, and 18, to get 4, 5, 4, 4, 6, 6, and back on time. [SEP] i stepped into her car and it had been a while, and she needed to do, \" he said. [SEP] and if you do, a good person in the world will have a place to go or to do a job. [SEP] \" i really think he deserves to be in the race, \" said ridley - thomas, [SEP]", "detok_text": "[CLS] - 30 % higher than in 2007. [SEP] at the other end of 2 a. m., then 8, 8, 9, 11, 11, 15, and 10, 16, and 18, to get 4, 5, 4, 4, 6, 6, and back on time. [SEP] i stepped into her car and it had been a while, and she needed to do, \"he said. [SEP] and if you do, a good person in the world will have a place to go or to do a job. [SEP]\" i really think he deserves to be in the race, \" said ridley - thomas, [SEP]"}
+{"type": "sample", "index": 13, "raw_text": "[CLS], he said. [SEP] he winced, hugged, the crowd froze, and exhaled. [SEP] but, there do appear to be some problems : \" i found the mattress in, on occasion, the passenger drawer. \" [SEP] as a result, he comes out and he says, \" yeah, he has a lot to do. [SEP] i ' m not sure until the lights come out and,,,,,,, all the time, don ' t know, what,,,, what,,, what, what,. [SEP] the industry, flush with money, has run out of cars, planes, cars and planes [SEP]", "detok_text": "[CLS], he said. [SEP] he winced, hugged, the crowd froze, and exhaled. [SEP] but, there do appear to be some problems: \"i found the mattress in, on occasion, the passenger drawer.\" [SEP] as a result, he comes out and he says, \" yeah, he has a lot to do. [SEP] i'm not sure until the lights come out and,,,,,,, all the time, don't know, what,,,, what,,, what, what,. [SEP] the industry, flush with money, has run out of cars, planes, cars and planes [SEP]"}
+{"type": "sample", "index": 14, "raw_text": "[CLS]. [SEP] but for a long time, it has to be taken with, he said, \" a great effect. \" [SEP] the project is also a private investment, as part of the sale to the bank of scotland. [SEP] for now, everyone are able to get their names together - - 2, 3, 14,, 8, 12, 11, 13, a word. [SEP] i think so well. [SEP] \" i wanted him to talk to him, \" she added. [SEP] \" i continue to love him for all, \" he said. [SEP] but if there is anything to go by, it doesn ' t work. [SEP]", "detok_text": "[CLS]. [SEP] but for a long time, it has to be taken with, he said, \"a great effect.\" [SEP] the project is also a private investment, as part of the sale to the bank of scotland. [SEP] for now, everyone are able to get their names together - - 2, 3, 14,, 8, 12, 11, 13, a word. [SEP] i think so well. [SEP] \"i wanted him to talk to him,\" she added. [SEP] \"i continue to love him for all,\" he said. [SEP] but if there is anything to go by, it doesn't work. [SEP]"}
+{"type": "sample", "index": 15, "raw_text": "[CLS] \" she said. [SEP] so much so i spent my days trying to get back to the house - i would drink in transit, i would never die in a tunnel on a bus - and it came along, so far, so quickly, just because it would stop, and then, then later, off the road. [SEP] then, every day, i mean, 49, 37, 50, i usually have 200, 200, 50, 50, 60 days. [SEP] on a short voyage, the aircraft carried aircraft, planes and equipment to the roof of the united nation ' s fueling system. [SEP] i agree with your assertion [SEP]", "detok_text": "[CLS] \" she said. [SEP] so much so i spent my days trying to get back to the house - i would drink in transit, i would never die in a tunnel on a bus - and it came along, so far, so quickly, just because it would stop, and then, then later, off the road. [SEP] then, every day, i mean, 49, 37, 50, i usually have 200, 200, 50, 50, 60 days. [SEP] on a short voyage, the aircraft carried aircraft, planes and equipment to the roof of the united nation's fueling system. [SEP] i agree with your assertion [SEP]"}
+{"type": "sample", "index": 16, "raw_text": "[CLS] happens on wall, say, rather, newspapers, it is no reflection of their diversity. [SEP] the story doesn ' t seem to work out the only way of finding a way to feel bad news. [SEP] we started with a computer, two minutes, a few minutes, looking at the hotel ' s small door, looking in its yard. [SEP] a 45 - year - old french student who says she wrote her boyfriend ' s name is on the stand, a court heard. [SEP] i have been in the field since the age of 17, but i never had one. [SEP] but i just think that with the obvious problems, there [SEP]", "detok_text": "[CLS] happens on wall, say, rather, newspapers, it is no reflection of their diversity. [SEP] the story doesn't seem to work out the only way of finding a way to feel bad news. [SEP] we started with a computer, two minutes, a few minutes, looking at the hotel's small door, looking in its yard. [SEP] a 45 - year - old french student who says she wrote her boyfriend's name is on the stand, a court heard. [SEP] i have been in the field since the age of 17, but i never had one. [SEP] but i just think that with the obvious problems, there [SEP]"}
+{"type": "sample", "index": 17, "raw_text": "[CLS] investors, would seem to include the idea of a short - term buy - out. [SEP] what makes an even greater problem, the truth, is a combination of - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -. [SEP] but it ' s not a time to start and tell us to look here. [SEP] the 21 - year - old midfielder moved to liverpool from the club in 2006. [SEP] the house, kupech said, is expected to be a 300 - foot vehicle with a top speed of 40 miles [SEP]", "detok_text": "[CLS] investors, would seem to include the idea of a short - term buy - out. [SEP] what makes an even greater problem, the truth, is a combination of - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -. [SEP] but it's not a time to start and tell us to look here. [SEP] the 21 - year - old midfielder moved to liverpool from the club in 2006. [SEP] the house, kupech said, is expected to be a 300 - foot vehicle with a top speed of 40 miles [SEP]"}
+{"type": "sample", "index": 18, "raw_text": "[CLS] not have the opportunity to speak unless i have to listen to read the novel. [SEP] london ( ap ) - british transport officials have launched a \" demonstration \" operation over the refusal of european union airspace to allow flights to the hubble and a lack of extra transport flights so the mission can expand beyond the end of the full year. [SEP] police are keen to speak to four men, including the father of a baby, who walked in the heart of york street, eastbourne, at 0115 gmt on saturday. [SEP] by the way, fluorescent lights, candles, rubbers and candles come together, shoes, pillows, etc. [SEP]", "detok_text": "[CLS] not have the opportunity to speak unless i have to listen to read the novel. [SEP] london (ap) - british transport officials have launched a \"demonstration\" operation over the refusal of european union airspace to allow flights to the hubble and a lack of extra transport flights so the mission can expand beyond the end of the full year. [SEP] police are keen to speak to four men, including the father of a baby, who walked in the heart of york street, eastbourne, at 0115 gmt on saturday. [SEP] by the way, fluorescent lights, candles, rubbers and candles come together, shoes, pillows, etc. [SEP]"}
+{"type": "sample", "index": 19, "raw_text": "[CLS] said. [SEP] they may have a good future in self - esteem and we have had to question the trust of children at the end of their lives. [SEP] i like the sparkle of light, i can see from the top windows, the sparkle of the ceiling, the sparkle of lights. [SEP] the bill also includes the use of emergency planes, the use of cargo planes, cargo planes, the use of passenger planes, aircraft and automobiles. [SEP] if to make it for a two - win race against the best team in the world, we are just right to keep on making the most of the game. [SEP] here, it seems, [SEP]", "detok_text": "[CLS] said. [SEP] they may have a good future in self - esteem and we have had to question the trust of children at the end of their lives. [SEP] i like the sparkle of light, i can see from the top windows, the sparkle of the ceiling, the sparkle of lights. [SEP] the bill also includes the use of emergency planes, the use of cargo planes, cargo planes, the use of passenger planes, aircraft and automobiles. [SEP] if to make it for a two - win race against the best team in the world, we are just right to keep on making the most of the game. [SEP] here, it seems, [SEP]"}
+{"type": "sample", "index": 20, "raw_text": "[CLS] \" he said. [SEP] when hillary clinton told the crowd that she wanted to make \" a fateful ( inky ) gesture out of her mouth, \" my name was raised. [SEP] his coats of black tops and dark white shoes, all clouds white, a long black scarf, a black white hat, and a large - looking black top - - faded and then, again, then we all have to wait and then half,, then half,, half,, the carpet is on. [SEP] the uk ' s foreign minister said in a statement released on monday that it was a \" significant priority \" for efforts to resolve the [SEP]", "detok_text": "[CLS] \"he said. [SEP] when hillary clinton told the crowd that she wanted to make\" a fateful (inky) gesture out of her mouth, \"my name was raised. [SEP] his coats of black tops and dark white shoes, all clouds white, a long black scarf, a black white hat, and a large - looking black top - - faded and then, again, then we all have to wait and then half,, then half,, half,, the carpet is on. [SEP] the uk's foreign minister said in a statement released on monday that it was a\" significant priority \" for efforts to resolve the [SEP]"}
+{"type": "sample", "index": 21, "raw_text": "[CLS]. [SEP] \" it was a guy on the other side of a line, saying..., kind of \" shit, wack, \" he said... [SEP] there is a lot of space in all of our minds, that need to think how our lives have changed, \" he said a while earlier. [SEP] a bit of art, that seems to me, comes with an arm and a lot of empty mind. [SEP] \" it is a law they must change, because it is so, \" he said. [SEP] the teen, hamilton of michigan, was arrested in a separate area just days outside his home on a [SEP]", "detok_text": "[CLS]. [SEP] \"it was a guy on the other side of a line, saying..., kind of\" shit, wack, \"he said... [SEP] there is a lot of space in all of our minds, that need to think how our lives have changed,\" he said a while earlier. [SEP] a bit of art, that seems to me, comes with an arm and a lot of empty mind. [SEP] \"it is a law they must change, because it is so,\" he said. [SEP] the teen, hamilton of michigan, was arrested in a separate area just days outside his home on a [SEP]"}
+{"type": "sample", "index": 22, "raw_text": "[CLS] to be completed in one to two days. [SEP] the government statement said the school would return by december, beginning in 2014. [SEP] overby said she is concerned about the concept behind that decision when she wants to get the job done and vote for it. [SEP] some are very hard, some funky, some making it up and just trying to make a bit more than a bit bland and sweet. [SEP] chicago ( reuters ) - trade leaders, meeting in chicago hoping to boost trade between the u. s. and africa, will meet in a bid to forge a balance on trade, a senior official said on monday. [SEP] the company [SEP]", "detok_text": "[CLS] to be completed in one to two days. [SEP] the government statement said the school would return by december, beginning in 2014. [SEP] overby said she is concerned about the concept behind that decision when she wants to get the job done and vote for it. [SEP] some are very hard, some funky, some making it up and just trying to make a bit more than a bit bland and sweet. [SEP] chicago (reuters) - trade leaders, meeting in chicago hoping to boost trade between the u. s. and africa, will meet in a bid to forge a balance on trade, a senior official said on monday. [SEP] the company [SEP]"}
+{"type": "sample", "index": 23, "raw_text": "[CLS], the company has said it will not reveal what they are thinking about. [SEP] \" unfortunately at the moment, many of us have no access to public funding, and refuse to work to deal with the enormous issues. [SEP] he never gets a chance to start, just to start in the locker room. [SEP] a small seating area has been set up inside, and large spaces in the area. [SEP] \" it ' s like he ' s driving, going down in the road, going back on the street at work, going on to back, but going back - in - the - road, down the road, up there. [SEP] [SEP]", "detok_text": "[CLS], the company has said it will not reveal what they are thinking about. [SEP] \"unfortunately at the moment, many of us have no access to public funding, and refuse to work to deal with the enormous issues. [SEP] he never gets a chance to start, just to start in the locker room. [SEP] a small seating area has been set up inside, and large spaces in the area. [SEP]\" it's like he's driving, going down in the road, going back on the street at work, going on to back, but going back - in - the - road, down the road, up there. [SEP] [SEP]"}
+{"type": "sample", "index": 24, "raw_text": "[CLS] in 2001. [SEP] the farmers, he said, will not do it until 2017, and then will make ends meet in season to season, with the current peaking at a peak of around 50c in two years. [SEP] with the lights of miami, the story turned green, green, black and green, and the dust of black faded in the wind and the stone pillars of the wall again faded. [SEP] the officials, speaking condition of anonymity, agreed that obama ' s withdrawal would continue until the end of the year. [SEP] no, i try to tell you the author may just be a 300 - a - word, [SEP]", "detok_text": "[CLS] in 2001. [SEP] the farmers, he said, will not do it until 2017, and then will make ends meet in season to season, with the current peaking at a peak of around 50c in two years. [SEP] with the lights of miami, the story turned green, green, black and green, and the dust of black faded in the wind and the stone pillars of the wall again faded. [SEP] the officials, speaking condition of anonymity, agreed that obama's withdrawal would continue until the end of the year. [SEP] no, i try to tell you the author may just be a 300 - a - word, [SEP]"}
+{"type": "sample", "index": 25, "raw_text": "[CLS] unusual, however, at this time. [SEP] people wanted to wake up to understand the situation, \" said to the student, who said the noise was \" fantastic \" and then he got back on the ground. [SEP] i mean sorry, but then you, god, take a day for a tea, some for a pill, men and women. [SEP] \" anything that will happen within the term - - when it is half a century - - will be much harder to prepare for, \" he said. [SEP] the teams spent about four days a week trying to bring the best of the best of the nba chicago, june 30 ( up [SEP]", "detok_text": "[CLS] unusual, however, at this time. [SEP] people wanted to wake up to understand the situation, \"said to the student, who said the noise was\" fantastic \"and then he got back on the ground. [SEP] i mean sorry, but then you, god, take a day for a tea, some for a pill, men and women. [SEP]\" anything that will happen within the term - - when it is half a century - - will be much harder to prepare for, \" he said. [SEP] the teams spent about four days a week trying to bring the best of the best of the nba chicago, june 30 ( up [SEP]"}
+{"type": "sample", "index": 26, "raw_text": "[CLS] they started to sing, they began laughing, \" she said. [SEP] and, i can ' t understand how, for now, people are willing to drop their wallets and put their noses in the door. [SEP] the family then wanted to get a question - and - answer to where he was going, he said. [SEP] \" here, the game has not come to a close. [SEP] now that the economy is back to the boom - and - bust cycles, and the process continues, the idea that everything is going in a little bit and moving is we have to wait and get a little longer. [SEP] he began with a [SEP]", "detok_text": "[CLS] they started to sing, they began laughing, \"she said. [SEP] and, i can't understand how, for now, people are willing to drop their wallets and put their noses in the door. [SEP] the family then wanted to get a question - and - answer to where he was going, he said. [SEP]\" here, the game has not come to a close. [SEP] now that the economy is back to the boom - and - bust cycles, and the process continues, the idea that everything is going in a little bit and moving is we have to wait and get a little longer. [SEP] he began with a [SEP]"}
+{"type": "sample", "index": 27, "raw_text": "[CLS] his plan, and he ruled out it would do something to some of his clients. [SEP] but a few weeks, for me, and for the fans, it has been the time for me to fight, \" he said. [SEP] after a restoration, the final part of the houseboard section of the building, confined to the ceiling railings, returns to the edge of darkness. [SEP] this requirement has been put in one place. [SEP] at least 100 french soldiers have been killed. [SEP] and when i do, i take off, i feel the smell of music in my face. [SEP] he struggles with the breadth of his collection. [SEP]", "detok_text": "[CLS] his plan, and he ruled out it would do something to some of his clients. [SEP] but a few weeks, for me, and for the fans, it has been the time for me to fight, \" he said. [SEP] after a restoration, the final part of the houseboard section of the building, confined to the ceiling railings, returns to the edge of darkness. [SEP] this requirement has been put in one place. [SEP] at least 100 french soldiers have been killed. [SEP] and when i do, i take off, i feel the smell of music in my face. [SEP] he struggles with the breadth of his collection. [SEP]"}
+{"type": "sample", "index": 28, "raw_text": "[CLS] meeting in baghdad, the official told reporters. [SEP] they were the real problem and they were all on their own. [SEP] \" i remember him was once standing on the other side of the room, and with him, he said, come back, look up, he said goodbye, and then he said to me, and he said yes, he was another. [SEP] and, oh, uh - oh, there ' s a lot. [SEP] only a few of the drugs were used in britain to treat serious kidney problems. [SEP] so, then, are the bigger problems. [SEP] \" people don ' t wait for answers. [SEP] \" [SEP]", "detok_text": "[CLS] meeting in baghdad, the official told reporters. [SEP] they were the real problem and they were all on their own. [SEP] \"i remember him was once standing on the other side of the room, and with him, he said, come back, look up, he said goodbye, and then he said to me, and he said yes, he was another. [SEP] and, oh, uh - oh, there's a lot. [SEP] only a few of the drugs were used in britain to treat serious kidney problems. [SEP] so, then, are the bigger problems. [SEP]\" people don't wait for answers. [SEP] \" [SEP]"}
+{"type": "sample", "index": 29, "raw_text": "[CLS] said. [SEP] the result of our investigation is that the internet is a priority. [SEP] i think the children will find themselves sitting in disbelief, if they are to turn around. [SEP] the financial collapse of the credit crunch, many of its names were being announced, appears to have engulfed some of the world ' s most susceptic economies. [SEP] even when it gets done, that kind of person eats up a hair and refuses to come. [SEP] and the message was clear that, with the end of the olympics in sight, i didn ' t have a sense of humor, or even the thrill of getting in a field. [SEP]", "detok_text": "[CLS] said. [SEP] the result of our investigation is that the internet is a priority. [SEP] i think the children will find themselves sitting in disbelief, if they are to turn around. [SEP] the financial collapse of the credit crunch, many of its names were being announced, appears to have engulfed some of the world's most susceptic economies. [SEP] even when it gets done, that kind of person eats up a hair and refuses to come. [SEP] and the message was clear that, with the end of the olympics in sight, i didn't have a sense of humor, or even the thrill of getting in a field. [SEP]"}
+{"type": "sample", "index": 30, "raw_text": "[CLS] couple of hours, i would not be able to get the full flight, he said. [SEP] but he knew, and he refused to speak. [SEP] we do not like the things that the person at the top, at a corner, at the top, at the top line, the body, to the top, the bottom line, up to the top. [SEP] while the emotional nature of the story, in which the story is taken by the author ' s son on a huge canvas, has settled the issue, the narrative of moyesque is far deeper than ever. [SEP] so, if i only get through the house, [SEP]", "detok_text": "[CLS] couple of hours, i would not be able to get the full flight, he said. [SEP] but he knew, and he refused to speak. [SEP] we do not like the things that the person at the top, at a corner, at the top, at the top line, the body, to the top, the bottom line, up to the top. [SEP] while the emotional nature of the story, in which the story is taken by the author's son on a huge canvas, has settled the issue, the narrative of moyesque is far deeper than ever. [SEP] so, if i only get through the house, [SEP]"}
+{"type": "sample", "index": 31, "raw_text": "[CLS]. [SEP] the hospital has a great room and is a very nice room, a great group, \" he said. [SEP] when everyone talks about him and his accomplishments, i will wonder if they are anything more, just temporary. [SEP] 7, detroit, calgary - toronto 11 - 13, detroit - boston 16, detroit - chicago, detroit - chicago, in place of chicago, detroit - denver. [SEP] more than 30 aircraft, including 13 men, women and one - third of the staff, were scheduled to leave in coming days, the coalition said. [SEP] 5 to serve as head of the special forces command. [SEP] the article appeared [SEP]", "detok_text": "[CLS]. [SEP] the hospital has a great room and is a very nice room, a great group, \" he said. [SEP] when everyone talks about him and his accomplishments, i will wonder if they are anything more, just temporary. [SEP] 7, detroit, calgary - toronto 11 - 13, detroit - boston 16, detroit - chicago, detroit - chicago, in place of chicago, detroit - denver. [SEP] more than 30 aircraft, including 13 men, women and one - third of the staff, were scheduled to leave in coming days, the coalition said. [SEP] 5 to serve as head of the special forces command. [SEP] the article appeared [SEP]"}
+{"type": "sample", "index": 32, "raw_text": "[CLS] [SEP] that is what is a situation not changed since the end of the 1970s. [SEP] the only way to do, say, say, say, say, look, it ' s a matter of working the hard, with little problem, trying to get the word ' turn ' right. [SEP] yes, however, the distinction is important. [SEP] he just started in chicago, detroit, denver, chicago, before going to the airport. [SEP] but, time is on the line, there are days to be had, now, and then, and, finally, with the chance to become, again, a half - day. [SEP] the [SEP]", "detok_text": "[CLS] [SEP] that is what is a situation not changed since the end of the 1970s. [SEP] the only way to do, say, say, say, say, look, it's a matter of working the hard, with little problem, trying to get the word'turn' right. [SEP] yes, however, the distinction is important. [SEP] he just started in chicago, detroit, denver, chicago, before going to the airport. [SEP] but, time is on the line, there are days to be had, now, and then, and, finally, with the chance to become, again, a half - day. [SEP] the [SEP]"}
+{"type": "sample", "index": 33, "raw_text": "[CLS] the girl, a 6 - year - old little girl. [SEP] the baby is ½ - and - 1 - - tucked up in dark pajamas, working in suitcases, bunks, and in pantsuits, in dark pants. [SEP] meanwhile, these researchers are also parachuted in to work with special equipment to deliver these additional multi - wheeled units - - including lifts, lifts, wheelchairs, lifts and - - on support of emc technology. [SEP] canada. [SEP] the plane, £1, 095 ( £11, 772 ), has seven flights. [SEP] \" it ' s like we ' re not talking. [SEP]", "detok_text": "[CLS] the girl, a 6 - year - old little girl. [SEP] the baby is ½ - and - 1 - - tucked up in dark pajamas, working in suitcases, bunks, and in pantsuits, in dark pants. [SEP] meanwhile, these researchers are also parachuted in to work with special equipment to deliver these additional multi - wheeled units - - including lifts, lifts, wheelchairs, lifts and - - on support of emc technology. [SEP] canada. [SEP] the plane, £1, 095 (£11, 772), has seven flights. [SEP] \" it's like we're not talking. [SEP]"}
+{"type": "sample", "index": 34, "raw_text": "[CLS] chicago in chicago, chicago - to tampa, detroit, and - detroit in cleveland. [SEP] i just think he is going to step down if he doesn ' t plan to return. [SEP] it ' s 60, 50,, 50, 60, - - 50, 50 - - 50, 38, 36, 48 days. [SEP] brown had 16 points and nine rebounds, including a point game, a trip to the blue devils, and even a game in the second period. [SEP] 9, chicago 17, new jersey 18. [SEP] he refused to give his students of dollars and even told them to check in. [SEP] the court heard [SEP]", "detok_text": "[CLS] chicago in chicago, chicago - to tampa, detroit, and - detroit in cleveland. [SEP] i just think he is going to step down if he doesn't plan to return. [SEP] it's 60, 50,, 50, 60, - - 50, 50 - - 50, 38, 36, 48 days. [SEP] brown had 16 points and nine rebounds, including a point game, a trip to the blue devils, and even a game in the second period. [SEP] 9, chicago 17, new jersey 18. [SEP] he refused to give his students of dollars and even told them to check in. [SEP] the court heard [SEP]"}
+{"type": "sample", "index": 35, "raw_text": "[CLS] said. [SEP] a lovely, fruit - scented version of wilt vanilla, with a paler shade of lemon flavors. [SEP] chicago is 7 - 4 with a 2 - 2 - 2 era. [SEP] it ' s quite a bit to learn. [SEP] \" he ' s really so clever, he moved quickly through his acting period, and got into a place where he huffed and puffed and rolled up his teeth, opened his eyes. \" [SEP] there are people who have other types of financial support. [SEP] \" the victory will have a huge impact, \" analysts say, for the fast - growing insurgency. [SEP] i never believe that a [SEP]", "detok_text": "[CLS] said. [SEP] a lovely, fruit - scented version of wilt vanilla, with a paler shade of lemon flavors. [SEP] chicago is 7 - 4 with a 2 - 2 - 2 era. [SEP] it's quite a bit to learn. [SEP] \"he's really so clever, he moved quickly through his acting period, and got into a place where he huffed and puffed and rolled up his teeth, opened his eyes.\" [SEP] there are people who have other types of financial support. [SEP] \"the victory will have a huge impact,\" analysts say, for the fast - growing insurgency. [SEP] i never believe that a [SEP]"}
+{"type": "sample", "index": 36, "raw_text": "[CLS] began in january 2005. [SEP] other cities have made significant gains, including london, in london, and in the midlands, for the last five years. [SEP] \" i think i ' d just like to sleep, but when it is good, you get to sleep, not well, \" he said. [SEP] the next day, however, she is asleep in the next room, but the answer begins to appear, she ' s looking up and laughing. [SEP] \" i don ' t think he is going to talk. [SEP] i have white shirts, white shirts, blackcoats and gray black shirts. [SEP] the complete collapse of american [SEP]", "detok_text": "[CLS] began in january 2005. [SEP] other cities have made significant gains, including london, in london, and in the midlands, for the last five years. [SEP] \"i think i'd just like to sleep, but when it is good, you get to sleep, not well,\" he said. [SEP] the next day, however, she is asleep in the next room, but the answer begins to appear, she's looking up and laughing. [SEP] \" i don't think he is going to talk. [SEP] i have white shirts, white shirts, blackcoats and gray black shirts. [SEP] the complete collapse of american [SEP]"}
+{"type": "sample", "index": 37, "raw_text": "[CLS] pakistan, comes close to a solution, obama said. [SEP] he walked off in frustration and worked out side - by - side for the second time in a career - long year - - a tie with the series he began in march 2000. [SEP] but overall, the rebels did have a full advantage - - or even, perhaps - - and managed to move inside. [SEP] it may not have to work. [SEP] the aircraft also caters to 1, 200 britons, which are worth 2. 7 million tonnes - - on orders from the government - to the airport. [SEP] the company, which includes 37 airlines and cargo companies, [SEP]", "detok_text": "[CLS] pakistan, comes close to a solution, obama said. [SEP] he walked off in frustration and worked out side - by - side for the second time in a career - long year - - a tie with the series he began in march 2000. [SEP] but overall, the rebels did have a full advantage - - or even, perhaps - - and managed to move inside. [SEP] it may not have to work. [SEP] the aircraft also caters to 1, 200 britons, which are worth 2. 7 million tonnes - - on orders from the government - to the airport. [SEP] the company, which includes 37 airlines and cargo companies, [SEP]"}
+{"type": "sample", "index": 38, "raw_text": "[CLS] [SEP] \" so it is about everyone, \" mr. he said. [SEP] bring out a good plan to try to keep up with the real economy. [SEP] you know, the big vampires, the elves, the elves. [SEP] we came up, dancing, the stars, that was good, but then i started, and i was really angry, \" he said. [SEP] \" to see that to him, he knows what ' s important. [SEP] israel said it would not want to return and that it would return to hamas. [SEP] at the end of the four - game day, angels starter derek matsui went back with an rbi [SEP]", "detok_text": "[CLS] [SEP] \"so it is about everyone,\" mr. he said. [SEP] bring out a good plan to try to keep up with the real economy. [SEP] you know, the big vampires, the elves, the elves. [SEP] we came up, dancing, the stars, that was good, but then i started, and i was really angry, \"he said. [SEP]\" to see that to him, he knows what's important. [SEP] israel said it would not want to return and that it would return to hamas. [SEP] at the end of the four - game day, angels starter derek matsui went back with an rbi [SEP]"}
+{"type": "sample", "index": 39, "raw_text": "[CLS] said. [SEP] but when a three - wheeled bus pulled me around, he pulled me into a corner, and pulled me into a corner. [SEP] well, so it was a great game for us. [SEP] foreign flights have been on strike over the past week, with security concerns that could also affect domestic flights. [SEP] we focus on baking, baking, baking, baking, baking, baking, baking, milk, baking, baking, tomato, mint. [SEP] if he ' s 21 years old, so i ' m guessing, you just want him to keep working, you never look back again, he ' s ok, so where [SEP]", "detok_text": "[CLS] said. [SEP] but when a three - wheeled bus pulled me around, he pulled me into a corner, and pulled me into a corner. [SEP] well, so it was a great game for us. [SEP] foreign flights have been on strike over the past week, with security concerns that could also affect domestic flights. [SEP] we focus on baking, baking, baking, baking, baking, baking, baking, milk, baking, baking, tomato, mint. [SEP] if he's 21 years old, so i'm guessing, you just want him to keep working, you never look back again, he's ok, so where [SEP]"}
+{"type": "sample", "index": 40, "raw_text": "[CLS]. [SEP] in november 2002, he wrote down the bill and tried to amend the legislation. [SEP] the problem not for the jets, but for the fans and the club. [SEP] i think, from the beginning, to the end, just to the finish line. [SEP] the way the researchers are trying to point out, the problem is real. [SEP] i don ' t know that we have to do that, \" he said. [SEP] look at the details, and then you would get me right, and then i imagine that in the case of a race, i would go - - literally - - from the end of the line. [SEP]", "detok_text": "[CLS]. [SEP] in november 2002, he wrote down the bill and tried to amend the legislation. [SEP] the problem not for the jets, but for the fans and the club. [SEP] i think, from the beginning, to the end, just to the finish line. [SEP] the way the researchers are trying to point out, the problem is real. [SEP] i don't know that we have to do that, \" he said. [SEP] look at the details, and then you would get me right, and then i imagine that in the case of a race, i would go - - literally - - from the end of the line. [SEP]"}
+{"type": "sample", "index": 41, "raw_text": "[CLS] s a great way to get together, i plan to spend the week in the light of my surroundings, \" he said. [SEP] no one at the stadium went on holiday, we didn ' t know it would be back anyway. [SEP] the idea is to be able to get into something and something new, going right out of the hands of a soldier and getting out of it. [SEP] oh, oh, oh, so much gratitude, and, oh, yes, oh, i love and i love, the last thing it is to remember,,,, so much,,,,,, so much. [SEP] he was [SEP]", "detok_text": "[CLS] s a great way to get together, i plan to spend the week in the light of my surroundings, \" he said. [SEP] no one at the stadium went on holiday, we didn't know it would be back anyway. [SEP] the idea is to be able to get into something and something new, going right out of the hands of a soldier and getting out of it. [SEP] oh, oh, oh, so much gratitude, and, oh, yes, oh, i love and i love, the last thing it is to remember,,,, so much,,,,,, so much. [SEP] he was [SEP]"}
+{"type": "sample", "index": 42, "raw_text": "[CLS] in particular, but not in my personal case, they have a little smile on their faces. [SEP] for the week, the error was only about 50 %, up from 60 percent for the previous week, again in october 2008, and to 45 percent for the week of march. [SEP] \" i just want to see, \" he said. [SEP] this needs to be true. [SEP] \" so much luck, but the same kind of commitment..... [SEP] at the end of october, you talk again, and not before we, not americans, can look forward, we get it back. [SEP] it was clear that the [SEP]", "detok_text": "[CLS] in particular, but not in my personal case, they have a little smile on their faces. [SEP] for the week, the error was only about 50 %, up from 60 percent for the previous week, again in october 2008, and to 45 percent for the week of march. [SEP] \"i just want to see,\" he said. [SEP] this needs to be true. [SEP] \" so much luck, but the same kind of commitment..... [SEP] at the end of october, you talk again, and not before we, not americans, can look forward, we get it back. [SEP] it was clear that the [SEP]"}
+{"type": "sample", "index": 43, "raw_text": "[CLS], \" he said at the end of his speech. [SEP] too many of them, the very end to them, have gone very well in the past. [SEP] the ministry spokesman declined to comment. [SEP] \" written in black, full of powder, on the face of someone on the back. [SEP] so, yeah - - now, walk back to the oval office, and again, a few minutes ahead of the time. [SEP] i was trying to say \" i try to pull that off - i ' ll do that, \" he said. [SEP] i ' ve lost that resolve, \" he said. [SEP] \" i ' m glad [SEP]", "detok_text": "[CLS], \"he said at the end of his speech. [SEP] too many of them, the very end to them, have gone very well in the past. [SEP] the ministry spokesman declined to comment. [SEP]\" written in black, full of powder, on the face of someone on the back. [SEP] so, yeah - - now, walk back to the oval office, and again, a few minutes ahead of the time. [SEP] i was trying to say \"i try to pull that off - i'll do that,\" he said. [SEP] i've lost that resolve, \"he said. [SEP]\" i'm glad [SEP]"}
+{"type": "sample", "index": 44, "raw_text": "[CLS] have to eat..... [SEP] there is still the real history of the citycentre - - david johnson, the chief executive, wrote a note to the city to name it 1868 - - and then, he would come back to the building. [SEP] \" i would, trying to get over it, get to it - - the road to play, the normal road to travel, to travel, \" he said. [SEP] \" they don ' t really do anything, they ' ve got to do everything. [SEP] that, he said, continues as the character gets to his side. [SEP] the problem was too simple. [SEP]", "detok_text": "[CLS] have to eat..... [SEP] there is still the real history of the citycentre - - david johnson, the chief executive, wrote a note to the city to name it 1868 - - and then, he would come back to the building. [SEP] \"i would, trying to get over it, get to it - - the road to play, the normal road to travel, to travel,\" he said. [SEP] \" they don't really do anything, they've got to do everything. [SEP] that, he said, continues as the character gets to his side. [SEP] the problem was too simple. [SEP]"}
+{"type": "sample", "index": 45, "raw_text": "[CLS] of their own. [SEP] but, it turns out, they own it. [SEP] marston, 39, admitted he was driving and was taken back to life three days after the 13 - year - old died. [SEP] he also said that he will have to have a further period in the next few months to get a job on a different basis. [SEP] so the idea of having a baby, whether in the sink, or with the baby, may be a sign of social tension, he said. [SEP] the policy was introduced in the late 1970s, but, later, back to the 1980s. [SEP] he was taken to the royal infirmary [SEP]", "detok_text": "[CLS] of their own. [SEP] but, it turns out, they own it. [SEP] marston, 39, admitted he was driving and was taken back to life three days after the 13 - year - old died. [SEP] he also said that he will have to have a further period in the next few months to get a job on a different basis. [SEP] so the idea of having a baby, whether in the sink, or with the baby, may be a sign of social tension, he said. [SEP] the policy was introduced in the late 1970s, but, later, back to the 1980s. [SEP] he was taken to the royal infirmary [SEP]"}
+{"type": "sample", "index": 46, "raw_text": "[CLS], 2007. [SEP] the story seemed to be long and true, but ultimately, not true. [SEP] the mulls are always cool.... so they are strong in winter - - usually in days b, b, a, b, a and a. [SEP] he also died about 15 minutes before being killed. [SEP] in the moment, five minutes after the flight began the flight, we sat on the front, right up to the end of the flight, but then we took a look down the air. [SEP] it had been november, december, 2004, and 2004. [SEP] you just get that series 2 - 2. [SEP]", "detok_text": "[CLS], 2007. [SEP] the story seemed to be long and true, but ultimately, not true. [SEP] the mulls are always cool.... so they are strong in winter - - usually in days b, b, a, b, a and a. [SEP] he also died about 15 minutes before being killed. [SEP] in the moment, five minutes after the flight began the flight, we sat on the front, right up to the end of the flight, but then we took a look down the air. [SEP] it had been november, december, 2004, and 2004. [SEP] you just get that series 2 - 2. [SEP]"}
+{"type": "sample", "index": 47, "raw_text": "[CLS] the study found. [SEP] i think they think, they know, they realize that there ' s so much they do to understand into us now, they ' re kind of doing that sort of stupid thing, they will get to put things in their mouths. [SEP] so since i was moved,, well, i ' ve been in,,,,,, half, half, half, half - i still have a,,, half, half, half, maybe, half, half, half, half, half,. [SEP] and they didn ' t do any of them. [SEP] but in the hotel room, a policeman [SEP]", "detok_text": "[CLS] the study found. [SEP] i think they think, they know, they realize that there's so much they do to understand into us now, they're kind of doing that sort of stupid thing, they will get to put things in their mouths. [SEP] so since i was moved,, well, i've been in,,,,,, half, half, half, half - i still have a,,, half, half, half, maybe, half, half, half, half, half,. [SEP] and they didn't do any of them. [SEP] but in the hotel room, a policeman [SEP]"}
+{"type": "sample", "index": 48, "raw_text": "[CLS] [SEP] if you ' re not sure how to drive as a person, what ' s more, especially with the car attached, so you can sit down again, need to feel and feel a bit backward, so you need to get ready to do it, get the focus and come back from the car while the person just goes, and grind it up. [SEP] the court had heard that the alleged incidents took place between now and last november. [SEP] in addition, these businesses will make glues, gels, chemicals to make plastics, such as glues, used in the bottom layers of steel wheels. [SEP] a review of a [SEP]", "detok_text": "[CLS] [SEP] if you're not sure how to drive as a person, what's more, especially with the car attached, so you can sit down again, need to feel and feel a bit backward, so you need to get ready to do it, get the focus and come back from the car while the person just goes, and grind it up. [SEP] the court had heard that the alleged incidents took place between now and last november. [SEP] in addition, these businesses will make glues, gels, chemicals to make plastics, such as glues, used in the bottom layers of steel wheels. [SEP] a review of a [SEP]"}
+{"type": "sample", "index": 49, "raw_text": "[CLS] to make this work, \" he concluded. [SEP] if cubans don ' t have the cash to raise and pay taxes. [SEP] that wasn ' t. [SEP] and i would love you to get to a real career. [SEP] the website is available : http : / / www. aai. nhs. nhs. co. uk. 08. 0844, 607651, including details of address. [SEP] \" we heard 4, 075 in october, \" it said. [SEP] the spartans came back in the first quarter, and they did not seem to be there, i was just glad. [SEP] a couple of weeks [SEP]", "detok_text": "[CLS] to make this work, \"he concluded. [SEP] if cubans don't have the cash to raise and pay taxes. [SEP] that wasn't. [SEP] and i would love you to get to a real career. [SEP] the website is available: http://www. aai. nhs. nhs. co. uk. 08. 0844, 607651, including details of address. [SEP]\" we heard 4, 075 in october, \" it said. [SEP] the spartans came back in the first quarter, and they did not seem to be there, i was just glad. [SEP] a couple of weeks [SEP]"}
+{"type": "sample", "index": 50, "raw_text": "[CLS] along with two other children. [SEP] he said that once the roof collapsed, the size of a pyramid, over the wall of the convoy of police trucks had been set in for vehicles around the site around the building. [SEP] the two have various personal relations to date, over a range of weeks and years, he said. [SEP] we do not need to be together, and have a little luck, to be able to eat together, day, in days, in day, days, days, days, and days, and days, \" mr. caer said. [SEP] he started at the same. [SEP] well, i understand. [SEP]", "detok_text": "[CLS] along with two other children. [SEP] he said that once the roof collapsed, the size of a pyramid, over the wall of the convoy of police trucks had been set in for vehicles around the site around the building. [SEP] the two have various personal relations to date, over a range of weeks and years, he said. [SEP] we do not need to be together, and have a little luck, to be able to eat together, day, in days, in day, days, days, days, and days, and days, \" mr. caer said. [SEP] he started at the same. [SEP] well, i understand. [SEP]"}
+{"type": "sample", "index": 51, "raw_text": "[CLS] in 27 countries, according to an independent survey. [SEP] i often wanted a race for a few days, so i thought about doing one in the early days, but it was like a few days. [SEP] the story will have gone in the air, though, again, with the light of the sun in the sun. [SEP] he didn ' t have to bother either. [SEP] he ' s not sure when he ' s in the room, but the quality of when the lights are there is really important. [SEP] \" there is no chance that they will settle - - either in the capital or in the name of peace. [SEP] he [SEP]", "detok_text": "[CLS] in 27 countries, according to an independent survey. [SEP] i often wanted a race for a few days, so i thought about doing one in the early days, but it was like a few days. [SEP] the story will have gone in the air, though, again, with the light of the sun in the sun. [SEP] he didn't have to bother either. [SEP] he's not sure when he's in the room, but the quality of when the lights are there is really important. [SEP] \" there is no chance that they will settle - - either in the capital or in the name of peace. [SEP] he [SEP]"}
+{"type": "sample", "index": 52, "raw_text": "[CLS], have to be normal, we have to be able to work... [SEP] the reality now is that the dusty is over at best, not the worst, he said. [SEP] i feel, in the course of days, maybe, you should be able to say, \" yes \", \" not no. \" [SEP] again, i know, there ' s a sign of a good relationship, down to a point, but the one, you know, where she manages to look out of herself. [SEP] hundreds of soldiers, deployed around the control point, were able to drive the ship out of the harbor, from a [SEP]", "detok_text": "[CLS], have to be normal, we have to be able to work... [SEP] the reality now is that the dusty is over at best, not the worst, he said. [SEP] i feel, in the course of days, maybe, you should be able to say, \"yes\", \"not no.\" [SEP] again, i know, there's a sign of a good relationship, down to a point, but the one, you know, where she manages to look out of herself. [SEP] hundreds of soldiers, deployed around the control point, were able to drive the ship out of the harbor, from a [SEP]"}
+{"type": "sample", "index": 53, "raw_text": "[CLS] - 3 - d ' 90s. [SEP] you have to get up in the office, in the situation room, have a good look for a new president. [SEP] nowitzki also had assists in chicago and chicago. [SEP] there are other things to make the same decision, but maybe it is me, \" he said. [SEP] i think that people have something to celebrate. [SEP] don ' t want to go to work unless you get a bad day... [SEP] the incident happened there at 2100 gmt on thursday. [SEP] \" so there would have to be a christmas match that would come at around hour, \" said mike [SEP]", "detok_text": "[CLS] - 3 - d' 90s. [SEP] you have to get up in the office, in the situation room, have a good look for a new president. [SEP] nowitzki also had assists in chicago and chicago. [SEP] there are other things to make the same decision, but maybe it is me, \"he said. [SEP] i think that people have something to celebrate. [SEP] don't want to go to work unless you get a bad day... [SEP] the incident happened there at 2100 gmt on thursday. [SEP]\" so there would have to be a christmas match that would come at around hour, \" said mike [SEP]"}
+{"type": "sample", "index": 54, "raw_text": "[CLS] eight years in power. [SEP] it ' s a joke, a joke, everything. [SEP] the fact that the artist has never spoken is so important, however, that this is just the actual meaning given to the new era of poetry and, she says, a direct testament to the historical connection to the process. [SEP] \" i think there is something good, \" says mr. kiosk, who is in the age of 68. [SEP] \" now it has to wait three years for something. [SEP] he had been on the last day of the attack. [SEP] it was short, dark, paler and dark gray. [SEP] however, [SEP]", "detok_text": "[CLS] eight years in power. [SEP] it's a joke, a joke, everything. [SEP] the fact that the artist has never spoken is so important, however, that this is just the actual meaning given to the new era of poetry and, she says, a direct testament to the historical connection to the process. [SEP] \"i think there is something good,\" says mr. kiosk, who is in the age of 68. [SEP] \" now it has to wait three years for something. [SEP] he had been on the last day of the attack. [SEP] it was short, dark, paler and dark gray. [SEP] however, [SEP]"}
+{"type": "sample", "index": 55, "raw_text": "[CLS] the league start. [SEP] the union ' s meeting is to take the walk - off in preparation for the completion of the site. [SEP] no..... we buy all those products. [SEP] the court is expected to hear a number of civil rights cases. [SEP] it ' s a situation. [SEP] the larger point is that their work is likely to be more complex. [SEP] \" to the right now, that is ridiculous, \" he said. [SEP] cook in the oven for hundreds of minutes. [SEP] a lot of things have come down, we ' ve been through a lot of mistakes. [SEP] a bank of england in the [SEP]", "detok_text": "[CLS] the league start. [SEP] the union's meeting is to take the walk - off in preparation for the completion of the site. [SEP] no..... we buy all those products. [SEP] the court is expected to hear a number of civil rights cases. [SEP] it's a situation. [SEP] the larger point is that their work is likely to be more complex. [SEP] \"to the right now, that is ridiculous,\" he said. [SEP] cook in the oven for hundreds of minutes. [SEP] a lot of things have come down, we've been through a lot of mistakes. [SEP] a bank of england in the [SEP]"}
+{"type": "sample", "index": 56, "raw_text": "[CLS], unable to get in a day out. [SEP] he said the figure would have been increased to £3. 3m. [SEP] the answer is not clear, so give you a something - in - a - mouth.... [SEP] instead, the station will move clockwise, just on the roof, on the outer side, and in the face of the full - side roof, with a full - side effect on the roof. [SEP] that roll call came at noon on friday, just days before the poll results showed up. [SEP] \" the tsa has a better sense of ability to handle security and security issues, \" said bob [SEP]", "detok_text": "[CLS], unable to get in a day out. [SEP] he said the figure would have been increased to £3. 3m. [SEP] the answer is not clear, so give you a something - in - a - mouth.... [SEP] instead, the station will move clockwise, just on the roof, on the outer side, and in the face of the full - side roof, with a full - side effect on the roof. [SEP] that roll call came at noon on friday, just days before the poll results showed up. [SEP] \"the tsa has a better sense of ability to handle security and security issues,\" said bob [SEP]"}
+{"type": "sample", "index": 57, "raw_text": "[CLS] to take the loan. [SEP] a couple of hours after the break, at least, as the truck creeps, he swaggers the end of the show, warming up to back - to - back performances. [SEP] that was a reality early in the series. [SEP] \" i do feel lucky. [SEP] everything i have remember has never been true. [SEP] there was a chance for me to get into something - - to get a little better, to get a little better, and get more in shape. [SEP] \" there, i got a call, and then, i came back - - - but i stayed because i thought i [SEP]", "detok_text": "[CLS] to take the loan. [SEP] a couple of hours after the break, at least, as the truck creeps, he swaggers the end of the show, warming up to back - to - back performances. [SEP] that was a reality early in the series. [SEP] \"i do feel lucky. [SEP] everything i have remember has never been true. [SEP] there was a chance for me to get into something - - to get a little better, to get a little better, and get more in shape. [SEP]\" there, i got a call, and then, i came back - - - but i stayed because i thought i [SEP]"}
+{"type": "sample", "index": 58, "raw_text": "[CLS] don ' t have to pay to get in care, but we know, we could not cover it. [SEP] it was a draw. [SEP] this time, he ' s off to stay a little longer, so i ' m delighted. [SEP] we asked if, with the kids, we wanted to get back on, and maybe even. [SEP] the moment, zeger said, he was unable to get out of his home in the back of a car, even though he did not die. [SEP] 70, 73 - 70, 73 - 80, 73,,,,,,,,,,,,,,,, [SEP]", "detok_text": "[CLS] don't have to pay to get in care, but we know, we could not cover it. [SEP] it was a draw. [SEP] this time, he's off to stay a little longer, so i'm delighted. [SEP] we asked if, with the kids, we wanted to get back on, and maybe even. [SEP] the moment, zeger said, he was unable to get out of his home in the back of a car, even though he did not die. [SEP] 70, 73 - 70, 73 - 80, 73,,,,,,,,,,,,,,,, [SEP]"}
+{"type": "sample", "index": 59, "raw_text": "[CLS] \" i ' m not sure i have the type of quality and that i have to make a strong commitment to the club. [SEP] in that process comes the talk of his \" impact \" memoir, in which he loses his power and seems to keep on his feet. [SEP] \" i urge the leaders... to move carefully and believe that the u. s. needs to be able to resolve problems in pakistan, \" she said. [SEP] i know you also have to cover things. [SEP] unemployment, which rose in december, rose by 1. 3m in december from a year ago for the first full year, which began to [SEP]", "detok_text": "[CLS] \"i'm not sure i have the type of quality and that i have to make a strong commitment to the club. [SEP] in that process comes the talk of his\" impact \"memoir, in which he loses his power and seems to keep on his feet. [SEP]\" i urge the leaders... to move carefully and believe that the u. s. needs to be able to resolve problems in pakistan, \" she said. [SEP] i know you also have to cover things. [SEP] unemployment, which rose in december, rose by 1. 3m in december from a year ago for the first full year, which began to [SEP]"}
+{"type": "sample", "index": 60, "raw_text": "[CLS] presence in the audience, especially in black, but it is not confirmed. [SEP] just how much difference is there really when a person turns into the air rage? [SEP] since a snow - days, period, period, and days, the winter period in the ice there has been a full period in the cold water, a full days, days, from day to day in the sun, to the arctic circle, then days, back to the water, ice in the afternoon, ice in the day, the ice in a deep place in the snow. [SEP] so i had to start three days later. [SEP] however, it seems to [SEP]", "detok_text": "[CLS] presence in the audience, especially in black, but it is not confirmed. [SEP] just how much difference is there really when a person turns into the air rage? [SEP] since a snow - days, period, period, and days, the winter period in the ice there has been a full period in the cold water, a full days, days, from day to day in the sun, to the arctic circle, then days, back to the water, ice in the afternoon, ice in the day, the ice in a deep place in the snow. [SEP] so i had to start three days later. [SEP] however, it seems to [SEP]"}
+{"type": "sample", "index": 61, "raw_text": "[CLS] was, briefly, a \" fresh dog \" in a freezer, so i could take the walk. [SEP] at the end of the day, then, he seems to have won. [SEP] he said the monthly fees might have been a temporary fact, since he had less time to invest in his work but would have to give him more money, or he wanted to buy more goods. [SEP] an additional 1, 200 jobs were on the private payroll in january, down from 42, 000 in december 2006, and up 4 percent from the year before. [SEP] denver, detroit, boston 90, chicago, chicago, chicago 80, cleveland [SEP]", "detok_text": "[CLS] was, briefly, a \"fresh dog\" in a freezer, so i could take the walk. [SEP] at the end of the day, then, he seems to have won. [SEP] he said the monthly fees might have been a temporary fact, since he had less time to invest in his work but would have to give him more money, or he wanted to buy more goods. [SEP] an additional 1, 200 jobs were on the private payroll in january, down from 42, 000 in december 2006, and up 4 percent from the year before. [SEP] denver, detroit, boston 90, chicago, chicago, chicago 80, cleveland [SEP]"}
+{"type": "sample", "index": 62, "raw_text": "[CLS] of poverty, is one of the problems, he says. [SEP] i do now have to say in person what things have to get done at the same time. [SEP] i was on the plane, and yes, everyone has to do anything, so the travel chaos was so much that i wanted to go there and then i wanted to have a flight. [SEP] of course, then, then, yes, what has to be done. [SEP] what a do, for you,,,,,,,,,,,,,,,,,,,,,,,. [SEP] the career leader, a 13 - year [SEP]", "detok_text": "[CLS] of poverty, is one of the problems, he says. [SEP] i do now have to say in person what things have to get done at the same time. [SEP] i was on the plane, and yes, everyone has to do anything, so the travel chaos was so much that i wanted to go there and then i wanted to have a flight. [SEP] of course, then, then, yes, what has to be done. [SEP] what a do, for you,,,,,,,,,,,,,,,,,,,,,,,. [SEP] the career leader, a 13 - year [SEP]"}
+{"type": "sample", "index": 63, "raw_text": "[CLS] said. [SEP] \" when someone has arrived i have to keep a sense of perspective on all the places. [SEP] the technical problems were a problem for the colts. [SEP] the rangers moved into the spot with a 1 - 3 record, and a 17 - point lead with detroit and new york in the al east. [SEP] and, it said, the companies must have the flexibility to manage their budgets when they want to make big money. [SEP] \" we have asked what the outcome of the problem is, and we want to address it. [SEP] the problem is that well into next year ' s disastrous presidential election - - a period when mr [SEP]", "detok_text": "[CLS] said. [SEP] \"when someone has arrived i have to keep a sense of perspective on all the places. [SEP] the technical problems were a problem for the colts. [SEP] the rangers moved into the spot with a 1 - 3 record, and a 17 - point lead with detroit and new york in the al east. [SEP] and, it said, the companies must have the flexibility to manage their budgets when they want to make big money. [SEP]\" we have asked what the outcome of the problem is, and we want to address it. [SEP] the problem is that well into next year's disastrous presidential election - - a period when mr [SEP]"}

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_64/state_c256_t1p45_detok_raw_samples.txt

@@ -0,0 +1,228 @@
+state_c256_t1p45_detok
+{
+  "type": "summary",
+  "name": "state_c256_t1p45",
+  "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt",
+  "step": 124000,
+  "decode": {
+    "kind": "categorical_fullvocab",
+    "config": "state_c256_t1p45",
+    "steps": 64,
+    "model_t_mode": "post",
+    "support_power": 1.0,
+    "semantic_power": 1.0,
+    "endpoint_temp": 1.45,
+    "concentration_min": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 42.24168306980635,
+    "nll_per_token": 3.7434074840068114,
+    "tokens": 9506
+  },
+  "diversity": {
+    "sample_entropy": 4.010304198715844,
+    "unique_tokens": 1579,
+    "token_count": 8192,
+    "distinct_1": 0.1927490234375,
+    "distinct_2": 0.6353346456692913,
+    "top_token_mass": 0.0780029296875
+  }
+}
+
+===== sample 000 =====
+[CLS] said earlier that it had no plans for the plans, but said they wanted to close the project. [SEP] "there's also a need to maintain a base rate cut of 15 per cent to the level of the government's plan," he said. [SEP] they had been given a 45 minutes to respond in the middle of that match. [SEP] how about the iphone? [SEP] however, at & t believes the austere is over. [SEP] you have paid a few days to get the money, and this is not the manager's idea - - it's not true. [SEP] you can see a piece of the [SEP]
+
+===== sample 001 =====
+[CLS] - - it has to deliver power for no more than 90 minutes. [SEP] add it and leave it up, gently, then half - covered, in less than a minute, in my case. [SEP] it is just around the time we get to the old obama - style relationship, and when he is really ill, he takes in the air and takes him to do some of teddy's better work. [SEP] the answer is to think that, if it's your flight, the world will know: maybe you have to do it and more likely to know how to do it. [SEP] 2.... [SEP] he, [SEP]
+
+===== sample 002 =====
+[CLS] when it goes into bankruptcy and - - no more than $50m - - the damage proceeds, and ends with a bond to repay. [SEP] but, eventually, the colts managed to provide a much - needed run. [SEP] in a autumn afternoon, up a mile from the airport, the wheels of the car are off. [SEP] numbers 6, number 3, 6, 7, 4, and 5 - 601. 5. based on the nature of their organization. [SEP] then, it becomes much smaller - - even more so. [SEP] "we hope they have to learn, and they know where there was that time," [SEP]
+
+===== sample 003 =====
+[CLS] back in the first place - - a phenomenon known as academic genius - - as well as stretching the whole way back to 1974. [SEP] (ap) - - a student trying to remember a child's identity is, perhaps, a valuable, overthrown thing, if you can't buy this kind of piece of background music. [SEP] it is very sad. [SEP] the current, self - righteous leader is their current leader, a tenacious, self - centered, morgenist cult that has no sense to believe in. [SEP] and a whole lot of them on the edge of the field in a huff - - [SEP]
+
+===== sample 004 =====
+[CLS], including bi - oil, salt and flour, in food and water. [SEP] they will face their countries, who have had more success than in 2008. [SEP] and nothing, and nothing. [SEP] there to have a bit of work to do, be good, go home, be a good date, come, have a good day. [SEP] you have to just cook constantly, bring in butter and water, then place the butter in the pan, add pieces and boil the butter. [SEP] " but when you work with the people, i will bring him together with the leader, you have to have lots of views. [SEP] instead, [SEP]
+
+===== sample 005 =====
+[CLS], and others. [SEP] we'll go back and you, the children, keep getting in, school, maybe, maybe, they can, but come up early. [SEP] the former senator, of san diego, california, still knows enough to get home with him. [SEP] today, most of them actually figure in short stories. [SEP] during seven years in the organization, she never lost her life, " he said, sitting in the studio for a week. [SEP] north american tile designs are modular and modular parts - - they are bigger and better than - metal equipment - - components, manufacturing, and equipment from all angles, from [SEP]
+
+===== sample 006 =====
+[CLS]. m. [SEP] in these economic situations, you can use conventional security on a flight to check the bag, and bring it in order - - ready to carry up one side - - to the airport. [SEP] david baker, head of the highways agency, said that more than 10 % of staff were now due to work the town's full - time or temporary work day. [SEP] "that's awful and bad, especially to get and go down," said garcey. [SEP] and the rules are so simple. [SEP] " for all who have been here for hundreds of years, don't think that even one [SEP]
+
+===== sample 007 =====
+[CLS]. [SEP] she told him he was what he did, and then he got into his own seat. [SEP] if i can work for more than a year.... and that's my dream. [SEP] sure, if gays are born, there would have to be a president, so move on to that will and continue to serve. [SEP] the answer is one of the same things. [SEP] " he is pretty, young, very talented and led his team in the super bowl. [SEP] he agrees with his father's words. [SEP] to some, that has never been quite long - - since he was his schoolboy [SEP]
+
+===== sample 008 =====
+[CLS]ed by britain's taste for cash. [SEP] the bidding process is also due in early 2010. [SEP] d. a.'s refine and clothe material injects large layers of light - - in the smalls of the magnets, a much bigger 12c away, and in the vacuum it is now possible to build up a series of heat tubes, working through the floor that makes them look similar in size to the so - called light - ray 15c. [SEP] 25 - 25 2007. [SEP] however she was only three days on a leave, and up to three hours on a waiting list. [SEP] the [SEP]
+
+===== sample 009 =====
+[CLS], i spent much of the day looking for a solution. [SEP] they saw the tarp from the ceiling and saw a picture of the animal. [SEP] then she began to do the same in the french embassy, where she worked. [SEP] the vatican has also said it will not comment on the shooting. [SEP] the show took between everything - - in planes, blankets, sometimes in the space of days, but sometimes in the combination of food, water, water and sleep - - and between 100 and 100, 000. [SEP] the israeli leader, at home in mumbai, said that it would take a lot of time. [SEP] he is [SEP]
+
+===== sample 010 =====
+[CLS] reporting in london, england; contributed reporting from beijing. [SEP] ap writer tom mclachler in jackson, miss, and steven esher in washington contributed to this report. [SEP] however, i like the big shift in london. [SEP] in advance of the second world war in italy, the u. s. military appeared to function in the province, whose total u. s. presence was about 3, 000 during its occupation in the united states. [SEP] to avoid that, the u. s. has to extend the foreign combat period to a minimum of 10 weeks before leaving for 60 days. [SEP] and in other hand, the [SEP]
+
+===== sample 011 =====
+[CLS] making it up, then, instead of a 10 - year plan to finish a full - year career. [SEP] the toaster's costs ($364, including a person) for two four - course cabets, a small package from 20, 000 swiss francs ($50, 000, £377). [SEP] the planes will be kept in operation until a full period and working for two weeks. [SEP] (cnn) - - you like to work day a day for the next week. [SEP] it could be a joke. [SEP] the rebound in its value will further come as companies try to cope with the current turmoil [SEP]
+
+===== sample 012 =====
+[CLS] to take time to answer a very complex question. [SEP] he and the others sat together for several minutes, all three seemed to show any emotion in the middle of their lives. [SEP] the whole scandal is the biggest lob of pakistan's history. [SEP] then i got on the bus. [SEP] i walked, stepped into the tunnel and saw the good old men, and i did, smack something into my heart. [SEP] james gafiz, a spokesman at the embassy in the capital was unable to be reached. [SEP] for a while he can finally admit that he needs to have a little time at work. [SEP] that way, [SEP]
+
+===== sample 013 =====
+[CLS] [SEP] there is a way between seeing, say, the stories of patients and their children this summer, but one, i will remember, at the end of the day when doctors seem to understand that others have been brought up, that there is always the look and the look of a person, who is always going up together. [SEP] mr brown said that over the years we have learned a lot about the future of education, something that has been lost in hard times. [SEP] " if we get the money, continue to lend... to the federal government for its budget, we can keep the money for a year to come. [SEP]
+
+===== sample 014 =====
+[CLS]. [SEP] but the police are "throwing their best" at sir brown, who said, "not a murderer." [SEP] the state would need a further 1, 000 tonnes of cash to be invested in it. [SEP] the best way to bring my seat is a couple of days of paper, i've gone to days, not days, days, days, not days. [SEP] "it will be a very tough week to be so close and final." [SEP] harman said that even if they had a decent plan, repairs were ongoing. [SEP] he would like to have the opportunity. [SEP] the u. s. government [SEP]
+
+===== sample 015 =====
+[CLS] but given that people have so much power, they must be able to give it a lift, so i would think about it. [SEP] our system seems to run information on the right side in each of our desks, just as the computer just puts it in a drawer and takes it off. [SEP] in addition, multi - forces, in particular, are the result of a number of activities, including various programs to develop ground - to - ground control systems to support operations, security control systems, vehicle - control systems, control and navigation systems for all types of vehicles, and a circuiting system to effectively move the sort of information [SEP]
+
+===== sample 016 =====
+[CLS] s name. [SEP] it's not true, though. [SEP] at the other end of the scale you don't see at the start, and, at the top end to the end, you turn to the front and back. [SEP] he will take out the look of the basics: pillows, linens, linens, linens, linens, fire - air chairs, and pillows. [SEP] also, an old person is willing to accept the pressure of taking months off to get the job. [SEP] "the city is completely clean but i would be able to stay in this place," said the opposition leader. [SEP] [SEP]
+
+===== sample 017 =====
+[CLS] to have a relationship with the other. [SEP] fris is known for being a business lawyer. [SEP] an even larger crowd - - 2, 400 students and 5 teachers - - attended the program in august, and now that costs $12 - - at a cost of $2, 500 - - to attend. [SEP] "we want to win but now, we're going to take some of us to get here. [SEP] he is also an avc politician, in describing such words as" white nationalism "and" racial nationalism. "[SEP] he also claims that the control in local government starts with" cuts, " according to [SEP]
+
+===== sample 018 =====
+[CLS] [SEP] he, he said, falls on his feet and refuses to drop dead. [SEP] london (ap) - london's index of leading shares jumped to record levels and reached 50 points, closing below 17. 2 on friday. [SEP] "as much as a true person, you can think, you will do the job and, ultimately, will have to give a bit of thought to the truth. [SEP]" the people know that the desire to help me achieve further work is no secret, he says. [SEP] in january, the council issued a road plan in the area of chap thurp, the most famous architect. [SEP]
+
+===== sample 019 =====
+[CLS] thursday. [SEP] i want to lie, or be self - deprecating, about the relationship. [SEP] the children had taken care of the bedroom. [SEP] some of the students are said to have been democrats from the tory party, and some of them admitted, in the end, the terms of their agreement were only a matter of a matter. [SEP] it's time to sit in and get out in the back of the car. [SEP] but for a brief moment, we stopped his car from the other side of the road and we, just a mile away, were taking most of the journey. [SEP] here, you know, [SEP]
+
+===== sample 020 =====
+[CLS] in new york. [SEP] the building company plans to bring its 300 employees to the b. r. s. from 16, 300 - seat aircraft and 16, 000 - 16, 500 aircraft during the second world war ii. [SEP] the problem is that, as well as having the wheel right, and holding it to the same side of tracks, the electric train then turns back, three or later, between steps and ramps, when it is to have to turn a place before the road ends. [SEP] obama is returning from his presidential campaign in texas on saturday. [SEP] look, now and then.... [SEP] however, the [SEP]
+
+===== sample 021 =====
+[CLS]'t think it was difficult to make it a part of the business, "said mark morris, head of research strategy at bg & markets in india. [SEP] he said he is prepared to come here in a" more relaxed, more stable, mood in manchester for a while. "[SEP] the deadline is nov. [SEP]" i have to believe that the various apparent problems associated with the establishment of the rail commission haven't connected to any crime. [SEP] "the change is that people have family, friends, and people who always see that kind of day as a time for change," he didn't say. [SEP] [SEP]
+
+===== sample 022 =====
+[CLS] the year... [SEP] on the other hand, the house is filled with the art and light, the light and light, the spouting of skin, the huge lemon - scented green and white, filled with giant trees and pinks. [SEP] after some years of baking on the ground, a deep yellow sweeter, which - - the deep red, brown sugar, and the smell of peppery water - - ended with salted water. [SEP] in addition, carmakers are printed with red red ink and make long brown paper. [SEP] " a few months later, someone went in to put out a special effort in [SEP]
+
+===== sample 023 =====
+[CLS], he was much younger and kind. [SEP] that made all the difference. [SEP] his lawyer, david patterson, said that he had been on the plane, but had refused to leave. [SEP] mr phillips said it is not his responsibility for the women to talk. [SEP] then there will be nothing worse. [SEP] the sale, with a residual value of $1. 6 million, until 2010, with a loss reduction of at least $500 million, is expected, brokers say. [SEP] as the battle got out, i began to look nonpollenty. [SEP] " it has never been a small operation, and the results of [SEP]
+
+===== sample 024 =====
+[CLS] to do. [SEP] ms robinson, who has asked mr robinson to become the minister, said yesterday that the parties entered into a second agreement, with the first minister, days after the issue was agreed in november 2007. [SEP] it's a combination of opportunities, many games, long, hard relationships. [SEP] in the end he took a lot of hurt. [SEP] they will make friends when he's in the house, she said. [SEP] mr mccafe, microsoft's business manager, pulls down a "note" about it, taking it like a dead end. [SEP] " we have not had a car in the past [SEP]
+
+===== sample 025 =====
+[CLS] to produce data. [SEP] " they'll be able to hire, hire, to hire, dress and hire. - - plus, the group will get enough money to do in the future, he said. [SEP] i mean everything, but for obama who wants to run a vote for a woman, look forward and vote for men and women. [SEP] and now that everything looks for sale, of course, it is like a go - between. [SEP] we want to work together. [SEP] he said he didn't speak about that. [SEP] they need to make a statement. [SEP] madison, wis., june 30 ( up [SEP]
+
+===== sample 026 =====
+[CLS], then come with them, after all, "he says. [SEP] and, the answer is, but, pretty simple. [SEP] people will need to build their egos on their own, and be the one to work in the mud and obliate them and put them together in order to make that thing happen. [SEP] david letterman, the former reality - show host, agrees. [SEP] he said the fans would continue to do his best to succeed. [SEP] they put me out of here. [SEP] but it is going to be. [SEP] i look at the city as well as i do in the city," he said. [SEP]
+
+===== sample 027 =====
+[CLS] and a little more. [SEP] top of the mutton. [SEP] "now the definition of the problem is clear," he said. [SEP] the group, which has been lobbying against the plan for the first time as recently as september, had not announced its final numbers. [SEP] the man, in a wheelchair, unable to cover his skis, cuts to the back and side of his head, was able to close the man. [SEP] but i'm not a gooder. [SEP] i just read that one of the other's brothers died in bed when he had died. [SEP] it is not that this has surprised me. [SEP]
+
+===== sample 028 =====
+[CLS] interest in northern pakistan, " he said. [SEP] it was the first time al - marri had been hurt. [SEP] 2 ) the road was closed off and tied to the same wall. [SEP] he grew up, he said he was a great boy, and he came back from a couple of years on radio. [SEP] he called for the trains to start from home to the site because of the delay. [SEP] however, every day i get something to go on, it has to look all over me, so now i could really get a look on the face. [SEP] he can do what's right down to the north. [SEP]
+
+===== sample 029 =====
+[CLS] airport. [SEP] the overall use of european powers on the internet is a blow to the eu and the countries will find it harder to work together if they are to get any traction. [SEP] new york (ap) - - with the political jam settled, the evidence is bleak, but some experts say there's still a long way to go. [SEP] and if it is enough to do that - - eventually, the law will change. [SEP] there are two plastic bags on them - - chairs, linens and towels at one end of the head, one paper at the other, another on the outside of the pillow, the inside [SEP]
+
+===== sample 030 =====
+[CLS] at the time, so she called the police department in hopes of getting her kids back. [SEP] a _ detroit 2 of 2, chicago 1. [SEP] i always remember that again there was a lot - - pain, of a half - deep, sleep, half - force fatigue, the deep pain, the failure to realize that there was some of these issues to be resolved. [SEP] he opened his eyes, but returned for a few seconds before the full picture was shown to him. [SEP] that is, admittedly, the level of such assertions. [SEP] he has a bit to prove. [SEP] i can see that the attitude is [SEP]
+
+===== sample 031 =====
+[CLS] "you need to believe that a game of life and i has so far let that go," he said. [SEP] he got on with him and his girlfriend, and both of them. [SEP] phoenix 24, boston, watson 24 (new york 24 - - chicago 2, detroit 19, chicago 2 - brown 2 - 2). [SEP] the night, off - time, late in the night, i didn't... [SEP] to keep to a good touch with the dog, they have to pretend that the dog is simply working, not working, but is making it in the wild. [SEP] " and that means that [SEP]
+
+===== sample 032 =====
+[CLS] tell him that there is a lot of pressure at the top of the road. [SEP] the only time he was elected was two years ago, when he said that, according to an analysis by a military tribunal, he had little in his system to try. [SEP] the knicks' agreement with vick marks a new chapter in the days of the jets' current owner - - willie walsh - - along with a multi - year deal. [SEP] while the chef was on my own, i would stay there full time - - until he left, perhaps, later, with the whole room filled with white linen. [SEP] while it helps that the [SEP]
+
+===== sample 033 =====
+[CLS] the lead on a 6 - 2 run early in the quarter. [SEP] in chicago, executives from cbs group inc. picked up the tag with him, and he's expected to appear in the event at the center of the museum. [SEP] but all of them are thought to be having to work out a number of layers of salt, ice and placity - - the coast, mountain roads and even roads, trains, trains, railway stations, and the metropolitan area - - before to be exposed to the snow. [SEP] bring in everything - - top, buttery, pan - cover and vanilla - mix with salt, and [SEP]
+
+===== sample 034 =====
+[CLS] season. [SEP] the half - mile will bring in about 1, 000 in july, with the use of four cars on the manchester and liverpool roads. [SEP] the plan was no insurance option. [SEP] bring boil, low heat, wash - water to boil, or, as much as possible, make it into a large bowl. [SEP] and then, finally, it is, in the long ahead, a more expensive name. [SEP] but we've got him in your corner. [SEP] where is anyone going for the white house. [SEP] i think, really, that makes it look much better. [SEP] only 11. 30am: we [SEP]
+
+===== sample 035 =====
+[CLS] " the group's mark steel said. [SEP] get back to work, then start to the back of the union. [SEP] but take off in a taxi, get to london and get to london - the train is more, not less. [SEP] when he said that the violence happened, he was only allowed to talk again, and pointed to a point where she lied. [SEP] he and ba tried to put a sign on the flight, and there is some confusion about those details. [SEP] a few bubbles - - in place, a pinch of butter and, often, in it - - sat at the bottom of the fridge. [SEP] [SEP]
+
+===== sample 036 =====
+[CLS] up, it does not make much sense, "ocampo told afp. [SEP]" and in the meantime, said his wife,,, c.,,,,,,,,,,,,,,,,,,,,,, on the top of the middle of the table, and on the back in the middle of the room, but the whole time was still around s. 5 as the light fell. [SEP] they are part of a lot when you need to do in a company by being a coach, but with listening in person and sitting in person. [SEP] the uk is one of [SEP]
+
+===== sample 037 =====
+[CLS] want to enjoy. [SEP] on wednesday, obama and obama have to work over their ideas, together to work together and to work on the same. [SEP] the white house will not respond to any decisions in six months, "he said. [SEP] you can work, in turn, and cook together in some flour (or liquid) to try to balance the juices. [SEP] the difference is that hard to understand, that people must be able to voice that message. [SEP]" with a coach, the time is, once or even twice, take off, " he said. [SEP] the deal, however, was to close in october, [SEP]
+
+===== sample 038 =====
+[CLS], "he said. [SEP] you just have to take it off, he can buy a pair of long - lasting pants. [SEP] the world should have tried to wait, but by now we were hoping for the worst. [SEP] we love you, with great boos, and lots of boos; i mean, if your answer is short," yes. " [SEP] the difference narrowed. [SEP] and, hey, there's a moon. [SEP] now, that veteran needs to leave and turn again - - and he will have to wait to pass this season - - back. [SEP] but he is getting into the green ground in [SEP]
+
+===== sample 039 =====
+[CLS] 80 percent of the equivalent of 100 million yuan in value, " he said. [SEP] the company has cancelled flights in the last week and expanded to 12 hours and 48 hours a day over a seven - day - week and 14 day period over the past five years. [SEP] you'll also see a look of the first two performances, prior to the play in 14 minutes. [SEP] the old dresses, dressed anonymously as black dresses, was knotted together, teetering along the walls on a sheet lined with white coats strung together in a heavy yellow blanket. [SEP] the capitals's streak began a year after the game, with the [SEP]
+
+===== sample 040 =====
+[CLS] - he's only one person. [SEP] the historic 7 - 2 victory put the broncos in the same playoffs for the first time since 1991 - - and the first in franchise history. [SEP] when it was presented to the audience, changes to the story, i thought, were something of a flurry of drama, and, crucially, all of the talk said, that it was never the name of the opera house. [SEP] place the butter in the pars, and leave the butter in the oven, stirring in the pans, and lay the onion together in the pan. [SEP] the falcons are waiting for a review. [SEP]
+
+===== sample 041 =====
+[CLS] - t :... hi, i want to work in iran. [SEP] the trail features 10 men in skis able to run hundreds of miles, in within miles and in minutes. [SEP] they can, in other words, drive you back to the top - down destination for a while - - the same right out of the sun. [SEP] they had the risk of death. [SEP] unfortunately, though, he didn't realize, even the traditionalists, that he did so at all. [SEP] "the world economy is trying to recover, but things can be much worse," he said. [SEP] for the second quarter of [SEP]
+
+===== sample 042 =====
+[CLS] of god, to his work as a lawyer, and as a grunder. [SEP] what a shame for me, and i would glad to have a new friend from north korea with a great bit of help at work if you want to look in the mirror just a little. [SEP] 40 and 30 - year - old artists - - who have been able to see the local works on so much of their short story lines - - are gone, he said. [SEP] if you want to vote, you have...... od7 dww albyn2rxwb i arrived just before the [SEP]
+
+===== sample 043 =====
+[CLS], we've made a lot of other progress. [SEP] we were all leaving at the other end of the tunnel, but when we spoke they were terrified at the prospect of having to move. [SEP] mr brown is accused of having "a huge attack" on his daughter after he drank alcohol. [SEP] i knew when he was 20, the equivalent of a ball - - and maybe a card - - and a good tool to get the ability to control the ball - - but that just was going to be his hand. [SEP] "we can never get a divorce - - and we're still married," said. [SEP] he [SEP]
+
+===== sample 044 =====
+[CLS] his way back to the penalty area. [SEP] with the opening of its facility, the dc/b/f - series, b - 8, mdc technologies is a leader in confill solutions for advanced high - powered, land - based power systems. [SEP] before you do, forget to feel in a daze - - it can mean through the top of the wall, just before you touch it at the side of the wall. [SEP] they don't know that, when the story just comes together, then, change at the bad times, then, maybe, then again, and it's back in the black. [SEP]
+
+===== sample 045 =====
+[CLS] august last year. [SEP] so, to come out, at the road, at the down, at the ground, at the side, to at the door, to get the door, at the back end of the turn, on a path, and we are going back down, we are already able to stop and to have a reverse journey up there, just to work again... and he seems to have a path with a path that is out of the end of the starting point. [SEP] " the children are in the class, and well, half our children. [SEP] the airline will be able to pay as much as [SEP]
+
+===== sample 046 =====
+[CLS] of anything he's ever said to him, and that's true. [SEP] here there are differences in the two - state relationship. [SEP] he says he is "very self - functioning." [SEP] i will try to get into this way... [SEP] their victory resulted in the best start of the day. [SEP] in the end, it seemed to be a film that went far in its direction and, to some extent, nothing less than a political special. [SEP] mr. brown talks about the results. [SEP] it is, it's right, the droves with the devil.... [SEP] the number of [SEP]
+
+===== sample 047 =====
+[CLS] the end of a day, and it has to come well, not bad, but for many of these people who want to keep things together, it's because they do so well, or they just get their way, or even, of course, start your trip on the hot wheels. [SEP] but we have had a good marriage, lost our marriage to have a child, that if we'd still have a lot to work for, with the family, maybe, and love to him came out and he was a strong boy, he didn't have to give up. [SEP] but in the "hybrid" system, [SEP]
+
+===== sample 048 =====
+[CLS] much more room with water in their homes. [SEP] for a long time, it has something to do with our financial system. [SEP] " but i have no things to do in training, so when it gets to the task... i know well, i know in sport that i have to get into the training - session - and - fitness situations. [SEP] bristol crown court heard he often abused young people in a police car on occasions. [SEP] in addition, the yankees won seven games - - from 14 - 15 to - 6, going into the season - - in the same seasons 2006 and 2007. [SEP] and, he said [SEP]
+
+===== sample 049 =====
+[CLS]. [SEP] and a different kind of attitude. [SEP] he jumped into a concrete lot near the police checkpoint, and then began his way to catch the vehicle. [SEP] also, create a situation where you can look at the intensity of life going on, the movement of the water around you, and the light, then and then, once and then, and then, all on the lights with the sort of clarity. [SEP] i have heard that we do things we know so much, know about things we just say, about things - people, things they do not want to be said, are not always right. [SEP] finally, that ' [SEP]
+
+===== sample 050 =====
+[CLS] [SEP] and, while the man still has a more civil sense of authority, the promise of a greater sense of adventure has brought down a united force that he never seemed to be going on the best course at all. [SEP] for those at all levels, such as reading, gardening, water sports, food, work and clothes, the same could be done with free meals and holidays. [SEP] this one means being able to work day, work, in classes, weekends and other things, so you can sit for an hour, day, or hours, as well. [SEP] nope, dec. [SEP] the truth is this, i have to [SEP]
+
+===== sample 051 =====
+[CLS] in developing countries, according to us media reports. [SEP] it brought in a surplus of £17, 000, down from £16m in 2006. [SEP] he certainly is not like many of the day's events - - done in the 70s, 60s, or 70s - - or even 70s - - and for example, he wasn't ready to do anything. [SEP] he was a managing director for england's team - - which ran from one season until 2003 - - eight years before he had fully decided to be coming to london after a 10 - year run for the club in the early months of 2004. [SEP] but [SEP]
+
+===== sample 052 =====
+[CLS] figures seem to appear accurate, but the unemployment rate is less than 3 percent. [SEP] the committee's chairman, james schwi, was added to the committee. [SEP] "we have some time, and i have to get a bit extra, to be ready, get up and something else." [SEP] and j. d. scored a single on chicago's first pitch of the inning to take a 4 - 3 run, the one that eventually forced comebacker joe scuier out of position to end a perfect game. [SEP] the union issued a warning that foreign workers and the prime minister have the right to use their [SEP]
+
+===== sample 053 =====
+[CLS] and easier for people to give. [SEP] that, not just, in its words, but also its 2, 000 - pound capacity, a permanent one that doesn't break, and can return in "another 20 years." [SEP] and for a while, i'm not sorry about you, i'm love with you, when people have good things, but we don't know. [SEP] its shares have lost more than 10 %. [SEP] "i think i think there are a lot of people on the team and my head doesn't look like, but it really is really much more important," said brian [SEP]
+
+===== sample 054 =====
+[CLS] happened in the months and months, and to all of them, time by time. [SEP] nature, faith and god, has a great deal of regularity, but there is little to do with man's relationships, he said. [SEP] a man, man, woman, a dog, i say, don't get a job, have a mortgage, good hands, bad heart. [SEP] axa is the global software company that provides more than 40 years of data service to global clients. [SEP] he had been on the run in australia before, and in march 2008, was arrested and released by australian police. [SEP] a similar [SEP]
+
+===== sample 055 =====
+[CLS]her al murktari, who was sent to the uk 11 days after the 9/11 attacks on the us states. [SEP] i know, after 3 years, i should have stopped. [SEP] after that, i has to deal with mid - term issues. [SEP] it's a situation. [SEP] the jets' top - receiver was suspended, and replaced him again. [SEP] "japan is beautiful, but it is beautiful," he said. [SEP] this is the stock market crash of 2008. [SEP] a self - proclaimed graduate of politics. [SEP] on a recent day, members of the group said support, no words, no [SEP]
+
+===== sample 056 =====
+[CLS]. [SEP] the family is rarely in crisis. [SEP] a lot of it means money - - which means, well, done, a lot of folks were able to give you the best idea of everything - - in the class. [SEP] he was freed in 2002. [SEP] at the end, she's at the point who comes back in the face of, i have to say, "bad girl" - - "the love girl" that always gets thrown at her feet, almost always on stage - - and suddenly has a bit of talent. [SEP] it's not necessarily to do with a guy who's superior, and [SEP]
+
+===== sample 057 =====
+[CLS] half, before he finally grabbed a 16 - point lead in cleveland's win - - 80 - 73 victory. [SEP] the crew then walked out of the back room, and the 20 - year - old used a window door to get back to their seats. [SEP] however, the local authority which responded to the petition decided it had not been given back to creditors - which was for a total of £36m. [SEP] not that "the old man" is its nemesis. [SEP] think more about your answers, because there are answers you really need, and even later in the end you have a plan. [SEP] " i have a [SEP]
+
+===== sample 058 =====
+[CLS]on, dallas rivers, willie johnson, the all - star wide receiver, and all - pro receivers. [SEP] he was taken from his hospital car to a nearby police car, moments before the prison closed, he said in a statement. [SEP] obama had a boost. [SEP] so in the week of february, 17 of the biggest u. s. banks, and 7. 7 percent was nationwide. [SEP] so, i gave in to my son and have to have to do so for all he was to help them. [SEP] the company first made a breakthrough in 2002 when the company, an insurance company, finally built a small hospital in [SEP]
+
+===== sample 059 =====
+[CLS] "he is a quiet person," mr. crowley says, seeming to write, at the minimum, a letter to u. s. ambassador to the house. [SEP] "i'm not inclined to say my friends are doing the thing," obama said. [SEP] however, he's not coming back to the championship. [SEP] the spokesman said that it was likely that the cap, which usually includes tax increases below 2 % for drivers, included the average price of 10 per cent. [SEP] and i have to work out and understand it. [SEP] the angels played a game in baseball for the first time in 14 years. [SEP] [SEP]
+
+===== sample 060 =====
+[CLS] u. s., and canada. [SEP] just like ours, you can help you live better. [SEP] and i know they are well into the last seven. [SEP] since the snowboarding show opened in its entirety in 7 - 11, 2004, the peninsula hotel has been building up its own ski area for years. [SEP] they call for an investment bank to supply cash, which consumers should be able to repay at any time prior to the financial crisis. [SEP] we expect to sleep for an hour in the office, sometimes in a couple of minutes. [SEP] the purchase had been successful, he said, but from £5, 500 to [SEP]
+
+===== sample 061 =====
+[CLS] after six years of "shelling." [SEP] but officials say the black list could take the flight within three to five months of the target and that it has refused to have flights until friday. [SEP] he has, sometimes,, stories, stories, words, and a tendency to describe the feelings or things that have ever gone on in an instant - - and to the mixture of whole foods, real experiences, thoughts, feelings, and so deep in our blood that one, or another, is just as visible, even untimely, here. [SEP] here, head and mouth, on top of a black - covered mask. [SEP]
+
+===== sample 062 =====
+[CLS] council spokesman bob davies said: " the first (and practical) thing young people have to do is look for themselves. [SEP] that is what the majority leader, mr cameron, or mr brown, believes. [SEP] la angels at chicago, 8: 15 p. m. [SEP] send a message, a wink, a response. [SEP] u. s. and british officials in baghdad insist the government is prepared to make a massive effort to keep these areas operating, according to military officials, including a letter to the official. [SEP] unite, which employs 400 teachers, reports from its members at least two hours a day, and employs around 22 [SEP]
+
+===== sample 063 =====
+[CLS] services. [SEP] "john mccain is going to have to lose for us, and he is, and we will never have the chance to run for the senate," romney told cnn's website. [SEP] in order to choose from his color - - his loose - toped, cotton - out pants - - he has to open his own, even when he really warms. [SEP] so in spite of that, we have a lot to do... [SEP] because of the fact i was a public teacher. [SEP] i figured he got on the screen he'd not feel for a long time. [SEP] not surprisingly, the [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_64/state_c256_t1p45_raw_samples.txt

@@ -0,0 +1,228 @@
+state_c256_t1p45
+{
+  "type": "summary",
+  "name": "state_c256_t1p45",
+  "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt",
+  "step": 124000,
+  "decode": {
+    "kind": "categorical_fullvocab",
+    "config": "state_c256_t1p45",
+    "steps": 64,
+    "model_t_mode": "post",
+    "support_power": 1.0,
+    "semantic_power": 1.0,
+    "endpoint_temp": 1.45,
+    "concentration_min": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 42.24168306980635,
+    "nll_per_token": 3.7434074840068114,
+    "tokens": 9506
+  },
+  "diversity": {
+    "sample_entropy": 4.010304198715844,
+    "unique_tokens": 1579,
+    "token_count": 8192,
+    "distinct_1": 0.1927490234375,
+    "distinct_2": 0.6353346456692913,
+    "top_token_mass": 0.0780029296875
+  }
+}
+
+===== sample 000 =====
+[CLS] said earlier that it had no plans for the plans, but said they wanted to close the project. [SEP] " there ' s also a need to maintain a base rate cut of 15 per cent to the level of the government ' s plan, " he said. [SEP] they had been given a 45 minutes to respond in the middle of that match. [SEP] how about the iphone? [SEP] however, at & t believes the austere is over. [SEP] you have paid a few days to get the money, and this is not the manager ' s idea - - it ' s not true. [SEP] you can see a piece of the [SEP]
+
+===== sample 001 =====
+[CLS] - - it has to deliver power for no more than 90 minutes. [SEP] add it and leave it up, gently, then half - covered, in less than a minute, in my case. [SEP] it is just around the time we get to the old obama - style relationship, and when he is really ill, he takes in the air and takes him to do some of teddy ' s better work. [SEP] the answer is to think that, if it ' s your flight, the world will know : maybe you have to do it and more likely to know how to do it. [SEP] 2.... [SEP] he, [SEP]
+
+===== sample 002 =====
+[CLS] when it goes into bankruptcy and - - no more than $ 50m - - the damage proceeds, and ends with a bond to repay. [SEP] but, eventually, the colts managed to provide a much - needed run. [SEP] in a autumn afternoon, up a mile from the airport, the wheels of the car are off. [SEP] numbers 6, number 3, 6, 7, 4, and 5 - 601. 5. based on the nature of their organization. [SEP] then, it becomes much smaller - - even more so. [SEP] " we hope they have to learn, and they know where there was that time, " [SEP]
+
+===== sample 003 =====
+[CLS] back in the first place - - a phenomenon known as academic genius - - as well as stretching the whole way back to 1974. [SEP] ( ap ) - - a student trying to remember a child ' s identity is, perhaps, a valuable, overthrown thing, if you can ' t buy this kind of piece of background music. [SEP] it is very sad. [SEP] the current, self - righteous leader is their current leader, a tenacious, self - centered, morgenist cult that has no sense to believe in. [SEP] and a whole lot of them on the edge of the field in a huff - - [SEP]
+
+===== sample 004 =====
+[CLS], including bi - oil, salt and flour, in food and water. [SEP] they will face their countries, who have had more success than in 2008. [SEP] and nothing, and nothing. [SEP] there to have a bit of work to do, be good, go home, be a good date, come, have a good day. [SEP] you have to just cook constantly, bring in butter and water, then place the butter in the pan, add pieces and boil the butter. [SEP] " but when you work with the people, i will bring him together with the leader, you have to have lots of views. [SEP] instead, [SEP]
+
+===== sample 005 =====
+[CLS], and others. [SEP] we ' ll go back and you, the children, keep getting in, school, maybe, maybe, they can, but come up early. [SEP] the former senator, of san diego, california, still knows enough to get home with him. [SEP] today, most of them actually figure in short stories. [SEP] during seven years in the organization, she never lost her life, " he said, sitting in the studio for a week. [SEP] north american tile designs are modular and modular parts - - they are bigger and better than - metal equipment - - components, manufacturing, and equipment from all angles, from [SEP]
+
+===== sample 006 =====
+[CLS]. m. [SEP] in these economic situations, you can use conventional security on a flight to check the bag, and bring it in order - - ready to carry up one side - - to the airport. [SEP] david baker, head of the highways agency, said that more than 10 % of staff were now due to work the town ' s full - time or temporary work day. [SEP] " that ' s awful and bad, especially to get and go down, " said garcey. [SEP] and the rules are so simple. [SEP] " for all who have been here for hundreds of years, don ' t think that even one [SEP]
+
+===== sample 007 =====
+[CLS]. [SEP] she told him he was what he did, and then he got into his own seat. [SEP] if i can work for more than a year.... and that ' s my dream. [SEP] sure, if gays are born, there would have to be a president, so move on to that will and continue to serve. [SEP] the answer is one of the same things. [SEP] " he is pretty, young, very talented and led his team in the super bowl. [SEP] he agrees with his father ' s words. [SEP] to some, that has never been quite long - - since he was his schoolboy [SEP]
+
+===== sample 008 =====
+[CLS]ed by britain ' s taste for cash. [SEP] the bidding process is also due in early 2010. [SEP] d. a. ' s refine and clothe material injects large layers of light - - in the smalls of the magnets, a much bigger 12c away, and in the vacuum it is now possible to build up a series of heat tubes, working through the floor that makes them look similar in size to the so - called light - ray 15c. [SEP] 25 - 25 2007. [SEP] however she was only three days on a leave, and up to three hours on a waiting list. [SEP] the [SEP]
+
+===== sample 009 =====
+[CLS], i spent much of the day looking for a solution. [SEP] they saw the tarp from the ceiling and saw a picture of the animal. [SEP] then she began to do the same in the french embassy, where she worked. [SEP] the vatican has also said it will not comment on the shooting. [SEP] the show took between everything - - in planes, blankets, sometimes in the space of days, but sometimes in the combination of food, water, water and sleep - - and between 100 and 100, 000. [SEP] the israeli leader, at home in mumbai, said that it would take a lot of time. [SEP] he is [SEP]
+
+===== sample 010 =====
+[CLS] reporting in london, england ; contributed reporting from beijing. [SEP] ap writer tom mclachler in jackson, miss, and steven esher in washington contributed to this report. [SEP] however, i like the big shift in london. [SEP] in advance of the second world war in italy, the u. s. military appeared to function in the province, whose total u. s. presence was about 3, 000 during its occupation in the united states. [SEP] to avoid that, the u. s. has to extend the foreign combat period to a minimum of 10 weeks before leaving for 60 days. [SEP] and in other hand, the [SEP]
+
+===== sample 011 =====
+[CLS] making it up, then, instead of a 10 - year plan to finish a full - year career. [SEP] the toaster ' s costs ( $ 364, including a person ) for two four - course cabets, a small package from 20, 000 swiss francs ( $ 50, 000, £377 ). [SEP] the planes will be kept in operation until a full period and working for two weeks. [SEP] ( cnn ) - - you like to work day a day for the next week. [SEP] it could be a joke. [SEP] the rebound in its value will further come as companies try to cope with the current turmoil [SEP]
+
+===== sample 012 =====
+[CLS] to take time to answer a very complex question. [SEP] he and the others sat together for several minutes, all three seemed to show any emotion in the middle of their lives. [SEP] the whole scandal is the biggest lob of pakistan ' s history. [SEP] then i got on the bus. [SEP] i walked, stepped into the tunnel and saw the good old men, and i did, smack something into my heart. [SEP] james gafiz, a spokesman at the embassy in the capital was unable to be reached. [SEP] for a while he can finally admit that he needs to have a little time at work. [SEP] that way, [SEP]
+
+===== sample 013 =====
+[CLS] [SEP] there is a way between seeing, say, the stories of patients and their children this summer, but one, i will remember, at the end of the day when doctors seem to understand that others have been brought up, that there is always the look and the look of a person, who is always going up together. [SEP] mr brown said that over the years we have learned a lot about the future of education, something that has been lost in hard times. [SEP] " if we get the money, continue to lend... to the federal government for its budget, we can keep the money for a year to come. [SEP]
+
+===== sample 014 =====
+[CLS]. [SEP] but the police are " throwing their best " at sir brown, who said, " not a murderer. " [SEP] the state would need a further 1, 000 tonnes of cash to be invested in it. [SEP] the best way to bring my seat is a couple of days of paper, i ' ve gone to days, not days, days, days, not days. [SEP] " it will be a very tough week to be so close and final. " [SEP] harman said that even if they had a decent plan, repairs were ongoing. [SEP] he would like to have the opportunity. [SEP] the u. s. government [SEP]
+
+===== sample 015 =====
+[CLS] but given that people have so much power, they must be able to give it a lift, so i would think about it. [SEP] our system seems to run information on the right side in each of our desks, just as the computer just puts it in a drawer and takes it off. [SEP] in addition, multi - forces, in particular, are the result of a number of activities, including various programs to develop ground - to - ground control systems to support operations, security control systems, vehicle - control systems, control and navigation systems for all types of vehicles, and a circuiting system to effectively move the sort of information [SEP]
+
+===== sample 016 =====
+[CLS] s name. [SEP] it ' s not true, though. [SEP] at the other end of the scale you don ' t see at the start, and, at the top end to the end, you turn to the front and back. [SEP] he will take out the look of the basics : pillows, linens, linens, linens, linens, fire - air chairs, and pillows. [SEP] also, an old person is willing to accept the pressure of taking months off to get the job. [SEP] " the city is completely clean but i would be able to stay in this place, " said the opposition leader. [SEP] [SEP]
+
+===== sample 017 =====
+[CLS] to have a relationship with the other. [SEP] fris is known for being a business lawyer. [SEP] an even larger crowd - - 2, 400 students and 5 teachers - - attended the program in august, and now that costs $ 12 - - at a cost of $ 2, 500 - - to attend. [SEP] " we want to win but now, we ' re going to take some of us to get here. [SEP] he is also an avc politician, in describing such words as " white nationalism " and " racial nationalism. " [SEP] he also claims that the control in local government starts with " cuts, " according to [SEP]
+
+===== sample 018 =====
+[CLS] [SEP] he, he said, falls on his feet and refuses to drop dead. [SEP] london ( ap ) - london ' s index of leading shares jumped to record levels and reached 50 points, closing below 17. 2 on friday. [SEP] " as much as a true person, you can think, you will do the job and, ultimately, will have to give a bit of thought to the truth. [SEP] " the people know that the desire to help me achieve further work is no secret, he says. [SEP] in january, the council issued a road plan in the area of chap thurp, the most famous architect. [SEP]
+
+===== sample 019 =====
+[CLS] thursday. [SEP] i want to lie, or be self - deprecating, about the relationship. [SEP] the children had taken care of the bedroom. [SEP] some of the students are said to have been democrats from the tory party, and some of them admitted, in the end, the terms of their agreement were only a matter of a matter. [SEP] it ' s time to sit in and get out in the back of the car. [SEP] but for a brief moment, we stopped his car from the other side of the road and we, just a mile away, were taking most of the journey. [SEP] here, you know, [SEP]
+
+===== sample 020 =====
+[CLS] in new york. [SEP] the building company plans to bring its 300 employees to the b. r. s. from 16, 300 - seat aircraft and 16, 000 - 16, 500 aircraft during the second world war ii. [SEP] the problem is that, as well as having the wheel right, and holding it to the same side of tracks, the electric train then turns back, three or later, between steps and ramps, when it is to have to turn a place before the road ends. [SEP] obama is returning from his presidential campaign in texas on saturday. [SEP] look, now and then.... [SEP] however, the [SEP]
+
+===== sample 021 =====
+[CLS] ' t think it was difficult to make it a part of the business, " said mark morris, head of research strategy at bg & markets in india. [SEP] he said he is prepared to come here in a " more relaxed, more stable, mood in manchester for a while. " [SEP] the deadline is nov. [SEP] " i have to believe that the various apparent problems associated with the establishment of the rail commission haven ' t connected to any crime. [SEP] " the change is that people have family, friends, and people who always see that kind of day as a time for change, " he didn ' t say. [SEP] [SEP]
+
+===== sample 022 =====
+[CLS] the year... [SEP] on the other hand, the house is filled with the art and light, the light and light, the spouting of skin, the huge lemon - scented green and white, filled with giant trees and pinks. [SEP] after some years of baking on the ground, a deep yellow sweeter, which - - the deep red, brown sugar, and the smell of peppery water - - ended with salted water. [SEP] in addition, carmakers are printed with red red ink and make long brown paper. [SEP] " a few months later, someone went in to put out a special effort in [SEP]
+
+===== sample 023 =====
+[CLS], he was much younger and kind. [SEP] that made all the difference. [SEP] his lawyer, david patterson, said that he had been on the plane, but had refused to leave. [SEP] mr phillips said it is not his responsibility for the women to talk. [SEP] then there will be nothing worse. [SEP] the sale, with a residual value of $ 1. 6 million, until 2010, with a loss reduction of at least $ 500 million, is expected, brokers say. [SEP] as the battle got out, i began to look nonpollenty. [SEP] " it has never been a small operation, and the results of [SEP]
+
+===== sample 024 =====
+[CLS] to do. [SEP] ms robinson, who has asked mr robinson to become the minister, said yesterday that the parties entered into a second agreement, with the first minister, days after the issue was agreed in november 2007. [SEP] it ' s a combination of opportunities, many games, long, hard relationships. [SEP] in the end he took a lot of hurt. [SEP] they will make friends when he ' s in the house, she said. [SEP] mr mccafe, microsoft ' s business manager, pulls down a " note " about it, taking it like a dead end. [SEP] " we have not had a car in the past [SEP]
+
+===== sample 025 =====
+[CLS] to produce data. [SEP] " they ' ll be able to hire, hire, to hire, dress and hire. - - plus, the group will get enough money to do in the future, he said. [SEP] i mean everything, but for obama who wants to run a vote for a woman, look forward and vote for men and women. [SEP] and now that everything looks for sale, of course, it is like a go - between. [SEP] we want to work together. [SEP] he said he didn ' t speak about that. [SEP] they need to make a statement. [SEP] madison, wis., june 30 ( up [SEP]
+
+===== sample 026 =====
+[CLS], then come with them, after all, " he says. [SEP] and, the answer is, but, pretty simple. [SEP] people will need to build their egos on their own, and be the one to work in the mud and obliate them and put them together in order to make that thing happen. [SEP] david letterman, the former reality - show host, agrees. [SEP] he said the fans would continue to do his best to succeed. [SEP] they put me out of here. [SEP] but it is going to be. [SEP] i look at the city as well as i do in the city, " he said. [SEP]
+
+===== sample 027 =====
+[CLS] and a little more. [SEP] top of the mutton. [SEP] " now the definition of the problem is clear, " he said. [SEP] the group, which has been lobbying against the plan for the first time as recently as september, had not announced its final numbers. [SEP] the man, in a wheelchair, unable to cover his skis, cuts to the back and side of his head, was able to close the man. [SEP] but i ' m not a gooder. [SEP] i just read that one of the other ' s brothers died in bed when he had died. [SEP] it is not that this has surprised me. [SEP]
+
+===== sample 028 =====
+[CLS] interest in northern pakistan, " he said. [SEP] it was the first time al - marri had been hurt. [SEP] 2 ) the road was closed off and tied to the same wall. [SEP] he grew up, he said he was a great boy, and he came back from a couple of years on radio. [SEP] he called for the trains to start from home to the site because of the delay. [SEP] however, every day i get something to go on, it has to look all over me, so now i could really get a look on the face. [SEP] he can do what ' s right down to the north. [SEP]
+
+===== sample 029 =====
+[CLS] airport. [SEP] the overall use of european powers on the internet is a blow to the eu and the countries will find it harder to work together if they are to get any traction. [SEP] new york ( ap ) - - with the political jam settled, the evidence is bleak, but some experts say there ' s still a long way to go. [SEP] and if it is enough to do that - - eventually, the law will change. [SEP] there are two plastic bags on them - - chairs, linens and towels at one end of the head, one paper at the other, another on the outside of the pillow, the inside [SEP]
+
+===== sample 030 =====
+[CLS] at the time, so she called the police department in hopes of getting her kids back. [SEP] a _ detroit 2 of 2, chicago 1. [SEP] i always remember that again there was a lot - - pain, of a half - deep, sleep, half - force fatigue, the deep pain, the failure to realize that there was some of these issues to be resolved. [SEP] he opened his eyes, but returned for a few seconds before the full picture was shown to him. [SEP] that is, admittedly, the level of such assertions. [SEP] he has a bit to prove. [SEP] i can see that the attitude is [SEP]
+
+===== sample 031 =====
+[CLS] " you need to believe that a game of life and i has so far let that go, " he said. [SEP] he got on with him and his girlfriend, and both of them. [SEP] phoenix 24, boston, watson 24 ( new york 24 - - chicago 2, detroit 19, chicago 2 - brown 2 - 2 ). [SEP] the night, off - time, late in the night, i didn ' t... [SEP] to keep to a good touch with the dog, they have to pretend that the dog is simply working, not working, but is making it in the wild. [SEP] " and that means that [SEP]
+
+===== sample 032 =====
+[CLS] tell him that there is a lot of pressure at the top of the road. [SEP] the only time he was elected was two years ago, when he said that, according to an analysis by a military tribunal, he had little in his system to try. [SEP] the knicks ' agreement with vick marks a new chapter in the days of the jets ' current owner - - willie walsh - - along with a multi - year deal. [SEP] while the chef was on my own, i would stay there full time - - until he left, perhaps, later, with the whole room filled with white linen. [SEP] while it helps that the [SEP]
+
+===== sample 033 =====
+[CLS] the lead on a 6 - 2 run early in the quarter. [SEP] in chicago, executives from cbs group inc. picked up the tag with him, and he ' s expected to appear in the event at the center of the museum. [SEP] but all of them are thought to be having to work out a number of layers of salt, ice and placity - - the coast, mountain roads and even roads, trains, trains, railway stations, and the metropolitan area - - before to be exposed to the snow. [SEP] bring in everything - - top, buttery, pan - cover and vanilla - mix with salt, and [SEP]
+
+===== sample 034 =====
+[CLS] season. [SEP] the half - mile will bring in about 1, 000 in july, with the use of four cars on the manchester and liverpool roads. [SEP] the plan was no insurance option. [SEP] bring boil, low heat, wash - water to boil, or, as much as possible, make it into a large bowl. [SEP] and then, finally, it is, in the long ahead, a more expensive name. [SEP] but we ' ve got him in your corner. [SEP] where is anyone going for the white house. [SEP] i think, really, that makes it look much better. [SEP] only 11. 30am : we [SEP]
+
+===== sample 035 =====
+[CLS] " the group ' s mark steel said. [SEP] get back to work, then start to the back of the union. [SEP] but take off in a taxi, get to london and get to london - the train is more, not less. [SEP] when he said that the violence happened, he was only allowed to talk again, and pointed to a point where she lied. [SEP] he and ba tried to put a sign on the flight, and there is some confusion about those details. [SEP] a few bubbles - - in place, a pinch of butter and, often, in it - - sat at the bottom of the fridge. [SEP] [SEP]
+
+===== sample 036 =====
+[CLS] up, it does not make much sense, " ocampo told afp. [SEP] " and in the meantime, said his wife,,, c.,,,,,,,,,,,,,,,,,,,,,, on the top of the middle of the table, and on the back in the middle of the room, but the whole time was still around s. 5 as the light fell. [SEP] they are part of a lot when you need to do in a company by being a coach, but with listening in person and sitting in person. [SEP] the uk is one of [SEP]
+
+===== sample 037 =====
+[CLS] want to enjoy. [SEP] on wednesday, obama and obama have to work over their ideas, together to work together and to work on the same. [SEP] the white house will not respond to any decisions in six months, " he said. [SEP] you can work, in turn, and cook together in some flour ( or liquid ) to try to balance the juices. [SEP] the difference is that hard to understand, that people must be able to voice that message. [SEP] " with a coach, the time is, once or even twice, take off, " he said. [SEP] the deal, however, was to close in october, [SEP]
+
+===== sample 038 =====
+[CLS], " he said. [SEP] you just have to take it off, he can buy a pair of long - lasting pants. [SEP] the world should have tried to wait, but by now we were hoping for the worst. [SEP] we love you, with great boos, and lots of boos ; i mean, if your answer is short, " yes. " [SEP] the difference narrowed. [SEP] and, hey, there ' s a moon. [SEP] now, that veteran needs to leave and turn again - - and he will have to wait to pass this season - - back. [SEP] but he is getting into the green ground in [SEP]
+
+===== sample 039 =====
+[CLS] 80 percent of the equivalent of 100 million yuan in value, " he said. [SEP] the company has cancelled flights in the last week and expanded to 12 hours and 48 hours a day over a seven - day - week and 14 day period over the past five years. [SEP] you ' ll also see a look of the first two performances, prior to the play in 14 minutes. [SEP] the old dresses, dressed anonymously as black dresses, was knotted together, teetering along the walls on a sheet lined with white coats strung together in a heavy yellow blanket. [SEP] the capitals ' s streak began a year after the game, with the [SEP]
+
+===== sample 040 =====
+[CLS] - he ' s only one person. [SEP] the historic 7 - 2 victory put the broncos in the same playoffs for the first time since 1991 - - and the first in franchise history. [SEP] when it was presented to the audience, changes to the story, i thought, were something of a flurry of drama, and, crucially, all of the talk said, that it was never the name of the opera house. [SEP] place the butter in the pars, and leave the butter in the oven, stirring in the pans, and lay the onion together in the pan. [SEP] the falcons are waiting for a review. [SEP]
+
+===== sample 041 =====
+[CLS] - t :... hi, i want to work in iran. [SEP] the trail features 10 men in skis able to run hundreds of miles, in within miles and in minutes. [SEP] they can, in other words, drive you back to the top - down destination for a while - - the same right out of the sun. [SEP] they had the risk of death. [SEP] unfortunately, though, he didn ' t realize, even the traditionalists, that he did so at all. [SEP] " the world economy is trying to recover, but things can be much worse, " he said. [SEP] for the second quarter of [SEP]
+
+===== sample 042 =====
+[CLS] of god, to his work as a lawyer, and as a grunder. [SEP] what a shame for me, and i would glad to have a new friend from north korea with a great bit of help at work if you want to look in the mirror just a little. [SEP] 40 and 30 - year - old artists - - who have been able to see the local works on so much of their short story lines - - are gone, he said. [SEP] if you want to vote, you have...... od7 dww albyn2rxwb i arrived just before the [SEP]
+
+===== sample 043 =====
+[CLS], we ' ve made a lot of other progress. [SEP] we were all leaving at the other end of the tunnel, but when we spoke they were terrified at the prospect of having to move. [SEP] mr brown is accused of having " a huge attack " on his daughter after he drank alcohol. [SEP] i knew when he was 20, the equivalent of a ball - - and maybe a card - - and a good tool to get the ability to control the ball - - but that just was going to be his hand. [SEP] " we can never get a divorce - - and we ' re still married, " said. [SEP] he [SEP]
+
+===== sample 044 =====
+[CLS] his way back to the penalty area. [SEP] with the opening of its facility, the dc / b / f - series, b - 8, mdc technologies is a leader in confill solutions for advanced high - powered, land - based power systems. [SEP] before you do, forget to feel in a daze - - it can mean through the top of the wall, just before you touch it at the side of the wall. [SEP] they don ' t know that, when the story just comes together, then, change at the bad times, then, maybe, then again, and it ' s back in the black. [SEP]
+
+===== sample 045 =====
+[CLS] august last year. [SEP] so, to come out, at the road, at the down, at the ground, at the side, to at the door, to get the door, at the back end of the turn, on a path, and we are going back down, we are already able to stop and to have a reverse journey up there, just to work again... and he seems to have a path with a path that is out of the end of the starting point. [SEP] " the children are in the class, and well, half our children. [SEP] the airline will be able to pay as much as [SEP]
+
+===== sample 046 =====
+[CLS] of anything he ' s ever said to him, and that ' s true. [SEP] here there are differences in the two - state relationship. [SEP] he says he is " very self - functioning. " [SEP] i will try to get into this way... [SEP] their victory resulted in the best start of the day. [SEP] in the end, it seemed to be a film that went far in its direction and, to some extent, nothing less than a political special. [SEP] mr. brown talks about the results. [SEP] it is, it ' s right, the droves with the devil.... [SEP] the number of [SEP]
+
+===== sample 047 =====
+[CLS] the end of a day, and it has to come well, not bad, but for many of these people who want to keep things together, it ' s because they do so well, or they just get their way, or even, of course, start your trip on the hot wheels. [SEP] but we have had a good marriage, lost our marriage to have a child, that if we ' d still have a lot to work for, with the family, maybe, and love to him came out and he was a strong boy, he didn ' t have to give up. [SEP] but in the " hybrid " system, [SEP]
+
+===== sample 048 =====
+[CLS] much more room with water in their homes. [SEP] for a long time, it has something to do with our financial system. [SEP] " but i have no things to do in training, so when it gets to the task... i know well, i know in sport that i have to get into the training - session - and - fitness situations. [SEP] bristol crown court heard he often abused young people in a police car on occasions. [SEP] in addition, the yankees won seven games - - from 14 - 15 to - 6, going into the season - - in the same seasons 2006 and 2007. [SEP] and, he said [SEP]
+
+===== sample 049 =====
+[CLS]. [SEP] and a different kind of attitude. [SEP] he jumped into a concrete lot near the police checkpoint, and then began his way to catch the vehicle. [SEP] also, create a situation where you can look at the intensity of life going on, the movement of the water around you, and the light, then and then, once and then, and then, all on the lights with the sort of clarity. [SEP] i have heard that we do things we know so much, know about things we just say, about things - people, things they do not want to be said, are not always right. [SEP] finally, that ' [SEP]
+
+===== sample 050 =====
+[CLS] [SEP] and, while the man still has a more civil sense of authority, the promise of a greater sense of adventure has brought down a united force that he never seemed to be going on the best course at all. [SEP] for those at all levels, such as reading, gardening, water sports, food, work and clothes, the same could be done with free meals and holidays. [SEP] this one means being able to work day, work, in classes, weekends and other things, so you can sit for an hour, day, or hours, as well. [SEP] nope, dec. [SEP] the truth is this, i have to [SEP]
+
+===== sample 051 =====
+[CLS] in developing countries, according to us media reports. [SEP] it brought in a surplus of £17, 000, down from £16m in 2006. [SEP] he certainly is not like many of the day ' s events - - done in the 70s, 60s, or 70s - - or even 70s - - and for example, he wasn ' t ready to do anything. [SEP] he was a managing director for england ' s team - - which ran from one season until 2003 - - eight years before he had fully decided to be coming to london after a 10 - year run for the club in the early months of 2004. [SEP] but [SEP]
+
+===== sample 052 =====
+[CLS] figures seem to appear accurate, but the unemployment rate is less than 3 percent. [SEP] the committee ' s chairman, james schwi, was added to the committee. [SEP] " we have some time, and i have to get a bit extra, to be ready, get up and something else. " [SEP] and j. d. scored a single on chicago ' s first pitch of the inning to take a 4 - 3 run, the one that eventually forced comebacker joe scuier out of position to end a perfect game. [SEP] the union issued a warning that foreign workers and the prime minister have the right to use their [SEP]
+
+===== sample 053 =====
+[CLS] and easier for people to give. [SEP] that, not just, in its words, but also its 2, 000 - pound capacity, a permanent one that doesn ' t break, and can return in " another 20 years. " [SEP] and for a while, i ' m not sorry about you, i ' m love with you, when people have good things, but we don ' t know. [SEP] its shares have lost more than 10 %. [SEP] " i think i think there are a lot of people on the team and my head doesn ' t look like, but it really is really much more important, " said brian [SEP]
+
+===== sample 054 =====
+[CLS] happened in the months and months, and to all of them, time by time. [SEP] nature, faith and god, has a great deal of regularity, but there is little to do with man ' s relationships, he said. [SEP] a man, man, woman, a dog, i say, don ' t get a job, have a mortgage, good hands, bad heart. [SEP] axa is the global software company that provides more than 40 years of data service to global clients. [SEP] he had been on the run in australia before, and in march 2008, was arrested and released by australian police. [SEP] a similar [SEP]
+
+===== sample 055 =====
+[CLS]her al murktari, who was sent to the uk 11 days after the 9 / 11 attacks on the us states. [SEP] i know, after 3 years, i should have stopped. [SEP] after that, i has to deal with mid - term issues. [SEP] it ' s a situation. [SEP] the jets ' top - receiver was suspended, and replaced him again. [SEP] " japan is beautiful, but it is beautiful, " he said. [SEP] this is the stock market crash of 2008. [SEP] a self - proclaimed graduate of politics. [SEP] on a recent day, members of the group said support, no words, no [SEP]
+
+===== sample 056 =====
+[CLS]. [SEP] the family is rarely in crisis. [SEP] a lot of it means money - - which means, well, done, a lot of folks were able to give you the best idea of everything - - in the class. [SEP] he was freed in 2002. [SEP] at the end, she ' s at the point who comes back in the face of, i have to say, " bad girl " - - " the love girl " that always gets thrown at her feet, almost always on stage - - and suddenly has a bit of talent. [SEP] it ' s not necessarily to do with a guy who ' s superior, and [SEP]
+
+===== sample 057 =====
+[CLS] half, before he finally grabbed a 16 - point lead in cleveland ' s win - - 80 - 73 victory. [SEP] the crew then walked out of the back room, and the 20 - year - old used a window door to get back to their seats. [SEP] however, the local authority which responded to the petition decided it had not been given back to creditors - which was for a total of £36m. [SEP] not that " the old man " is its nemesis. [SEP] think more about your answers, because there are answers you really need, and even later in the end you have a plan. [SEP] " i have a [SEP]
+
+===== sample 058 =====
+[CLS]on, dallas rivers, willie johnson, the all - star wide receiver, and all - pro receivers. [SEP] he was taken from his hospital car to a nearby police car, moments before the prison closed, he said in a statement. [SEP] obama had a boost. [SEP] so in the week of february, 17 of the biggest u. s. banks, and 7. 7 percent was nationwide. [SEP] so, i gave in to my son and have to have to do so for all he was to help them. [SEP] the company first made a breakthrough in 2002 when the company, an insurance company, finally built a small hospital in [SEP]
+
+===== sample 059 =====
+[CLS] " he is a quiet person, " mr. crowley says, seeming to write, at the minimum, a letter to u. s. ambassador to the house. [SEP] " i ' m not inclined to say my friends are doing the thing, " obama said. [SEP] however, he ' s not coming back to the championship. [SEP] the spokesman said that it was likely that the cap, which usually includes tax increases below 2 % for drivers, included the average price of 10 per cent. [SEP] and i have to work out and understand it. [SEP] the angels played a game in baseball for the first time in 14 years. [SEP] [SEP]
+
+===== sample 060 =====
+[CLS] u. s., and canada. [SEP] just like ours, you can help you live better. [SEP] and i know they are well into the last seven. [SEP] since the snowboarding show opened in its entirety in 7 - 11, 2004, the peninsula hotel has been building up its own ski area for years. [SEP] they call for an investment bank to supply cash, which consumers should be able to repay at any time prior to the financial crisis. [SEP] we expect to sleep for an hour in the office, sometimes in a couple of minutes. [SEP] the purchase had been successful, he said, but from £5, 500 to [SEP]
+
+===== sample 061 =====
+[CLS] after six years of " shelling. " [SEP] but officials say the black list could take the flight within three to five months of the target and that it has refused to have flights until friday. [SEP] he has, sometimes,, stories, stories, words, and a tendency to describe the feelings or things that have ever gone on in an instant - - and to the mixture of whole foods, real experiences, thoughts, feelings, and so deep in our blood that one, or another, is just as visible, even untimely, here. [SEP] here, head and mouth, on top of a black - covered mask. [SEP]
+
+===== sample 062 =====
+[CLS] council spokesman bob davies said : " the first ( and practical ) thing young people have to do is look for themselves. [SEP] that is what the majority leader, mr cameron, or mr brown, believes. [SEP] la angels at chicago, 8 : 15 p. m. [SEP] send a message, a wink, a response. [SEP] u. s. and british officials in baghdad insist the government is prepared to make a massive effort to keep these areas operating, according to military officials, including a letter to the official. [SEP] unite, which employs 400 teachers, reports from its members at least two hours a day, and employs around 22 [SEP]
+
+===== sample 063 =====
+[CLS] services. [SEP] " john mccain is going to have to lose for us, and he is, and we will never have the chance to run for the senate, " romney told cnn ' s website. [SEP] in order to choose from his color - - his loose - toped, cotton - out pants - - he has to open his own, even when he really warms. [SEP] so in spite of that, we have a lot to do... [SEP] because of the fact i was a public teacher. [SEP] i figured he got on the screen he ' d not feel for a long time. [SEP] not surprisingly, the [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_64/state_c256_t1p45_scored.jsonl

@@ -0,0 +1,65 @@
+{"type": "summary", "name": "state_c256_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c256_t1p45", "steps": 64, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 42.24168306980635, "nll_per_token": 3.7434074840068114, "tokens": 9506}, "diversity": {"sample_entropy": 4.010304198715844, "unique_tokens": 1579, "token_count": 8192, "distinct_1": 0.1927490234375, "distinct_2": 0.6353346456692913, "top_token_mass": 0.0780029296875}}
+{"type": "sample", "index": 0, "raw_text": "[CLS] said earlier that it had no plans for the plans, but said they wanted to close the project. [SEP] \" there ' s also a need to maintain a base rate cut of 15 per cent to the level of the government ' s plan, \" he said. [SEP] they had been given a 45 minutes to respond in the middle of that match. [SEP] how about the iphone? [SEP] however, at & t believes the austere is over. [SEP] you have paid a few days to get the money, and this is not the manager ' s idea - - it ' s not true. [SEP] you can see a piece of the [SEP]", "detok_text": "[CLS] said earlier that it had no plans for the plans, but said they wanted to close the project. [SEP] \"there's also a need to maintain a base rate cut of 15 per cent to the level of the government's plan,\" he said. [SEP] they had been given a 45 minutes to respond in the middle of that match. [SEP] how about the iphone? [SEP] however, at & t believes the austere is over. [SEP] you have paid a few days to get the money, and this is not the manager's idea - - it's not true. [SEP] you can see a piece of the [SEP]"}
+{"type": "sample", "index": 1, "raw_text": "[CLS] - - it has to deliver power for no more than 90 minutes. [SEP] add it and leave it up, gently, then half - covered, in less than a minute, in my case. [SEP] it is just around the time we get to the old obama - style relationship, and when he is really ill, he takes in the air and takes him to do some of teddy ' s better work. [SEP] the answer is to think that, if it ' s your flight, the world will know : maybe you have to do it and more likely to know how to do it. [SEP] 2.... [SEP] he, [SEP]", "detok_text": "[CLS] - - it has to deliver power for no more than 90 minutes. [SEP] add it and leave it up, gently, then half - covered, in less than a minute, in my case. [SEP] it is just around the time we get to the old obama - style relationship, and when he is really ill, he takes in the air and takes him to do some of teddy's better work. [SEP] the answer is to think that, if it's your flight, the world will know: maybe you have to do it and more likely to know how to do it. [SEP] 2.... [SEP] he, [SEP]"}
+{"type": "sample", "index": 2, "raw_text": "[CLS] when it goes into bankruptcy and - - no more than $ 50m - - the damage proceeds, and ends with a bond to repay. [SEP] but, eventually, the colts managed to provide a much - needed run. [SEP] in a autumn afternoon, up a mile from the airport, the wheels of the car are off. [SEP] numbers 6, number 3, 6, 7, 4, and 5 - 601. 5. based on the nature of their organization. [SEP] then, it becomes much smaller - - even more so. [SEP] \" we hope they have to learn, and they know where there was that time, \" [SEP]", "detok_text": "[CLS] when it goes into bankruptcy and - - no more than $50m - - the damage proceeds, and ends with a bond to repay. [SEP] but, eventually, the colts managed to provide a much - needed run. [SEP] in a autumn afternoon, up a mile from the airport, the wheels of the car are off. [SEP] numbers 6, number 3, 6, 7, 4, and 5 - 601. 5. based on the nature of their organization. [SEP] then, it becomes much smaller - - even more so. [SEP] \"we hope they have to learn, and they know where there was that time,\" [SEP]"}
+{"type": "sample", "index": 3, "raw_text": "[CLS] back in the first place - - a phenomenon known as academic genius - - as well as stretching the whole way back to 1974. [SEP] ( ap ) - - a student trying to remember a child ' s identity is, perhaps, a valuable, overthrown thing, if you can ' t buy this kind of piece of background music. [SEP] it is very sad. [SEP] the current, self - righteous leader is their current leader, a tenacious, self - centered, morgenist cult that has no sense to believe in. [SEP] and a whole lot of them on the edge of the field in a huff - - [SEP]", "detok_text": "[CLS] back in the first place - - a phenomenon known as academic genius - - as well as stretching the whole way back to 1974. [SEP] (ap) - - a student trying to remember a child's identity is, perhaps, a valuable, overthrown thing, if you can't buy this kind of piece of background music. [SEP] it is very sad. [SEP] the current, self - righteous leader is their current leader, a tenacious, self - centered, morgenist cult that has no sense to believe in. [SEP] and a whole lot of them on the edge of the field in a huff - - [SEP]"}
+{"type": "sample", "index": 4, "raw_text": "[CLS], including bi - oil, salt and flour, in food and water. [SEP] they will face their countries, who have had more success than in 2008. [SEP] and nothing, and nothing. [SEP] there to have a bit of work to do, be good, go home, be a good date, come, have a good day. [SEP] you have to just cook constantly, bring in butter and water, then place the butter in the pan, add pieces and boil the butter. [SEP] \" but when you work with the people, i will bring him together with the leader, you have to have lots of views. [SEP] instead, [SEP]", "detok_text": "[CLS], including bi - oil, salt and flour, in food and water. [SEP] they will face their countries, who have had more success than in 2008. [SEP] and nothing, and nothing. [SEP] there to have a bit of work to do, be good, go home, be a good date, come, have a good day. [SEP] you have to just cook constantly, bring in butter and water, then place the butter in the pan, add pieces and boil the butter. [SEP] \" but when you work with the people, i will bring him together with the leader, you have to have lots of views. [SEP] instead, [SEP]"}
+{"type": "sample", "index": 5, "raw_text": "[CLS], and others. [SEP] we ' ll go back and you, the children, keep getting in, school, maybe, maybe, they can, but come up early. [SEP] the former senator, of san diego, california, still knows enough to get home with him. [SEP] today, most of them actually figure in short stories. [SEP] during seven years in the organization, she never lost her life, \" he said, sitting in the studio for a week. [SEP] north american tile designs are modular and modular parts - - they are bigger and better than - metal equipment - - components, manufacturing, and equipment from all angles, from [SEP]", "detok_text": "[CLS], and others. [SEP] we'll go back and you, the children, keep getting in, school, maybe, maybe, they can, but come up early. [SEP] the former senator, of san diego, california, still knows enough to get home with him. [SEP] today, most of them actually figure in short stories. [SEP] during seven years in the organization, she never lost her life, \" he said, sitting in the studio for a week. [SEP] north american tile designs are modular and modular parts - - they are bigger and better than - metal equipment - - components, manufacturing, and equipment from all angles, from [SEP]"}
+{"type": "sample", "index": 6, "raw_text": "[CLS]. m. [SEP] in these economic situations, you can use conventional security on a flight to check the bag, and bring it in order - - ready to carry up one side - - to the airport. [SEP] david baker, head of the highways agency, said that more than 10 % of staff were now due to work the town ' s full - time or temporary work day. [SEP] \" that ' s awful and bad, especially to get and go down, \" said garcey. [SEP] and the rules are so simple. [SEP] \" for all who have been here for hundreds of years, don ' t think that even one [SEP]", "detok_text": "[CLS]. m. [SEP] in these economic situations, you can use conventional security on a flight to check the bag, and bring it in order - - ready to carry up one side - - to the airport. [SEP] david baker, head of the highways agency, said that more than 10 % of staff were now due to work the town's full - time or temporary work day. [SEP] \"that's awful and bad, especially to get and go down,\" said garcey. [SEP] and the rules are so simple. [SEP] \" for all who have been here for hundreds of years, don't think that even one [SEP]"}
+{"type": "sample", "index": 7, "raw_text": "[CLS]. [SEP] she told him he was what he did, and then he got into his own seat. [SEP] if i can work for more than a year.... and that ' s my dream. [SEP] sure, if gays are born, there would have to be a president, so move on to that will and continue to serve. [SEP] the answer is one of the same things. [SEP] \" he is pretty, young, very talented and led his team in the super bowl. [SEP] he agrees with his father ' s words. [SEP] to some, that has never been quite long - - since he was his schoolboy [SEP]", "detok_text": "[CLS]. [SEP] she told him he was what he did, and then he got into his own seat. [SEP] if i can work for more than a year.... and that's my dream. [SEP] sure, if gays are born, there would have to be a president, so move on to that will and continue to serve. [SEP] the answer is one of the same things. [SEP] \" he is pretty, young, very talented and led his team in the super bowl. [SEP] he agrees with his father's words. [SEP] to some, that has never been quite long - - since he was his schoolboy [SEP]"}
+{"type": "sample", "index": 8, "raw_text": "[CLS]ed by britain ' s taste for cash. [SEP] the bidding process is also due in early 2010. [SEP] d. a. ' s refine and clothe material injects large layers of light - - in the smalls of the magnets, a much bigger 12c away, and in the vacuum it is now possible to build up a series of heat tubes, working through the floor that makes them look similar in size to the so - called light - ray 15c. [SEP] 25 - 25 2007. [SEP] however she was only three days on a leave, and up to three hours on a waiting list. [SEP] the [SEP]", "detok_text": "[CLS]ed by britain's taste for cash. [SEP] the bidding process is also due in early 2010. [SEP] d. a.'s refine and clothe material injects large layers of light - - in the smalls of the magnets, a much bigger 12c away, and in the vacuum it is now possible to build up a series of heat tubes, working through the floor that makes them look similar in size to the so - called light - ray 15c. [SEP] 25 - 25 2007. [SEP] however she was only three days on a leave, and up to three hours on a waiting list. [SEP] the [SEP]"}
+{"type": "sample", "index": 9, "raw_text": "[CLS], i spent much of the day looking for a solution. [SEP] they saw the tarp from the ceiling and saw a picture of the animal. [SEP] then she began to do the same in the french embassy, where she worked. [SEP] the vatican has also said it will not comment on the shooting. [SEP] the show took between everything - - in planes, blankets, sometimes in the space of days, but sometimes in the combination of food, water, water and sleep - - and between 100 and 100, 000. [SEP] the israeli leader, at home in mumbai, said that it would take a lot of time. [SEP] he is [SEP]", "detok_text": "[CLS], i spent much of the day looking for a solution. [SEP] they saw the tarp from the ceiling and saw a picture of the animal. [SEP] then she began to do the same in the french embassy, where she worked. [SEP] the vatican has also said it will not comment on the shooting. [SEP] the show took between everything - - in planes, blankets, sometimes in the space of days, but sometimes in the combination of food, water, water and sleep - - and between 100 and 100, 000. [SEP] the israeli leader, at home in mumbai, said that it would take a lot of time. [SEP] he is [SEP]"}
+{"type": "sample", "index": 10, "raw_text": "[CLS] reporting in london, england ; contributed reporting from beijing. [SEP] ap writer tom mclachler in jackson, miss, and steven esher in washington contributed to this report. [SEP] however, i like the big shift in london. [SEP] in advance of the second world war in italy, the u. s. military appeared to function in the province, whose total u. s. presence was about 3, 000 during its occupation in the united states. [SEP] to avoid that, the u. s. has to extend the foreign combat period to a minimum of 10 weeks before leaving for 60 days. [SEP] and in other hand, the [SEP]", "detok_text": "[CLS] reporting in london, england; contributed reporting from beijing. [SEP] ap writer tom mclachler in jackson, miss, and steven esher in washington contributed to this report. [SEP] however, i like the big shift in london. [SEP] in advance of the second world war in italy, the u. s. military appeared to function in the province, whose total u. s. presence was about 3, 000 during its occupation in the united states. [SEP] to avoid that, the u. s. has to extend the foreign combat period to a minimum of 10 weeks before leaving for 60 days. [SEP] and in other hand, the [SEP]"}
+{"type": "sample", "index": 11, "raw_text": "[CLS] making it up, then, instead of a 10 - year plan to finish a full - year career. [SEP] the toaster ' s costs ( $ 364, including a person ) for two four - course cabets, a small package from 20, 000 swiss francs ( $ 50, 000, £377 ). [SEP] the planes will be kept in operation until a full period and working for two weeks. [SEP] ( cnn ) - - you like to work day a day for the next week. [SEP] it could be a joke. [SEP] the rebound in its value will further come as companies try to cope with the current turmoil [SEP]", "detok_text": "[CLS] making it up, then, instead of a 10 - year plan to finish a full - year career. [SEP] the toaster's costs ($364, including a person) for two four - course cabets, a small package from 20, 000 swiss francs ($50, 000, £377). [SEP] the planes will be kept in operation until a full period and working for two weeks. [SEP] (cnn) - - you like to work day a day for the next week. [SEP] it could be a joke. [SEP] the rebound in its value will further come as companies try to cope with the current turmoil [SEP]"}
+{"type": "sample", "index": 12, "raw_text": "[CLS] to take time to answer a very complex question. [SEP] he and the others sat together for several minutes, all three seemed to show any emotion in the middle of their lives. [SEP] the whole scandal is the biggest lob of pakistan ' s history. [SEP] then i got on the bus. [SEP] i walked, stepped into the tunnel and saw the good old men, and i did, smack something into my heart. [SEP] james gafiz, a spokesman at the embassy in the capital was unable to be reached. [SEP] for a while he can finally admit that he needs to have a little time at work. [SEP] that way, [SEP]", "detok_text": "[CLS] to take time to answer a very complex question. [SEP] he and the others sat together for several minutes, all three seemed to show any emotion in the middle of their lives. [SEP] the whole scandal is the biggest lob of pakistan's history. [SEP] then i got on the bus. [SEP] i walked, stepped into the tunnel and saw the good old men, and i did, smack something into my heart. [SEP] james gafiz, a spokesman at the embassy in the capital was unable to be reached. [SEP] for a while he can finally admit that he needs to have a little time at work. [SEP] that way, [SEP]"}
+{"type": "sample", "index": 13, "raw_text": "[CLS] [SEP] there is a way between seeing, say, the stories of patients and their children this summer, but one, i will remember, at the end of the day when doctors seem to understand that others have been brought up, that there is always the look and the look of a person, who is always going up together. [SEP] mr brown said that over the years we have learned a lot about the future of education, something that has been lost in hard times. [SEP] \" if we get the money, continue to lend... to the federal government for its budget, we can keep the money for a year to come. [SEP]", "detok_text": "[CLS] [SEP] there is a way between seeing, say, the stories of patients and their children this summer, but one, i will remember, at the end of the day when doctors seem to understand that others have been brought up, that there is always the look and the look of a person, who is always going up together. [SEP] mr brown said that over the years we have learned a lot about the future of education, something that has been lost in hard times. [SEP] \" if we get the money, continue to lend... to the federal government for its budget, we can keep the money for a year to come. [SEP]"}
+{"type": "sample", "index": 14, "raw_text": "[CLS]. [SEP] but the police are \" throwing their best \" at sir brown, who said, \" not a murderer. \" [SEP] the state would need a further 1, 000 tonnes of cash to be invested in it. [SEP] the best way to bring my seat is a couple of days of paper, i ' ve gone to days, not days, days, days, not days. [SEP] \" it will be a very tough week to be so close and final. \" [SEP] harman said that even if they had a decent plan, repairs were ongoing. [SEP] he would like to have the opportunity. [SEP] the u. s. government [SEP]", "detok_text": "[CLS]. [SEP] but the police are \"throwing their best\" at sir brown, who said, \"not a murderer.\" [SEP] the state would need a further 1, 000 tonnes of cash to be invested in it. [SEP] the best way to bring my seat is a couple of days of paper, i've gone to days, not days, days, days, not days. [SEP] \"it will be a very tough week to be so close and final.\" [SEP] harman said that even if they had a decent plan, repairs were ongoing. [SEP] he would like to have the opportunity. [SEP] the u. s. government [SEP]"}
+{"type": "sample", "index": 15, "raw_text": "[CLS] but given that people have so much power, they must be able to give it a lift, so i would think about it. [SEP] our system seems to run information on the right side in each of our desks, just as the computer just puts it in a drawer and takes it off. [SEP] in addition, multi - forces, in particular, are the result of a number of activities, including various programs to develop ground - to - ground control systems to support operations, security control systems, vehicle - control systems, control and navigation systems for all types of vehicles, and a circuiting system to effectively move the sort of information [SEP]", "detok_text": "[CLS] but given that people have so much power, they must be able to give it a lift, so i would think about it. [SEP] our system seems to run information on the right side in each of our desks, just as the computer just puts it in a drawer and takes it off. [SEP] in addition, multi - forces, in particular, are the result of a number of activities, including various programs to develop ground - to - ground control systems to support operations, security control systems, vehicle - control systems, control and navigation systems for all types of vehicles, and a circuiting system to effectively move the sort of information [SEP]"}
+{"type": "sample", "index": 16, "raw_text": "[CLS] s name. [SEP] it ' s not true, though. [SEP] at the other end of the scale you don ' t see at the start, and, at the top end to the end, you turn to the front and back. [SEP] he will take out the look of the basics : pillows, linens, linens, linens, linens, fire - air chairs, and pillows. [SEP] also, an old person is willing to accept the pressure of taking months off to get the job. [SEP] \" the city is completely clean but i would be able to stay in this place, \" said the opposition leader. [SEP] [SEP]", "detok_text": "[CLS] s name. [SEP] it's not true, though. [SEP] at the other end of the scale you don't see at the start, and, at the top end to the end, you turn to the front and back. [SEP] he will take out the look of the basics: pillows, linens, linens, linens, linens, fire - air chairs, and pillows. [SEP] also, an old person is willing to accept the pressure of taking months off to get the job. [SEP] \"the city is completely clean but i would be able to stay in this place,\" said the opposition leader. [SEP] [SEP]"}
+{"type": "sample", "index": 17, "raw_text": "[CLS] to have a relationship with the other. [SEP] fris is known for being a business lawyer. [SEP] an even larger crowd - - 2, 400 students and 5 teachers - - attended the program in august, and now that costs $ 12 - - at a cost of $ 2, 500 - - to attend. [SEP] \" we want to win but now, we ' re going to take some of us to get here. [SEP] he is also an avc politician, in describing such words as \" white nationalism \" and \" racial nationalism. \" [SEP] he also claims that the control in local government starts with \" cuts, \" according to [SEP]", "detok_text": "[CLS] to have a relationship with the other. [SEP] fris is known for being a business lawyer. [SEP] an even larger crowd - - 2, 400 students and 5 teachers - - attended the program in august, and now that costs $12 - - at a cost of $2, 500 - - to attend. [SEP] \"we want to win but now, we're going to take some of us to get here. [SEP] he is also an avc politician, in describing such words as\" white nationalism \"and\" racial nationalism. \"[SEP] he also claims that the control in local government starts with\" cuts, \" according to [SEP]"}
+{"type": "sample", "index": 18, "raw_text": "[CLS] [SEP] he, he said, falls on his feet and refuses to drop dead. [SEP] london ( ap ) - london ' s index of leading shares jumped to record levels and reached 50 points, closing below 17. 2 on friday. [SEP] \" as much as a true person, you can think, you will do the job and, ultimately, will have to give a bit of thought to the truth. [SEP] \" the people know that the desire to help me achieve further work is no secret, he says. [SEP] in january, the council issued a road plan in the area of chap thurp, the most famous architect. [SEP]", "detok_text": "[CLS] [SEP] he, he said, falls on his feet and refuses to drop dead. [SEP] london (ap) - london's index of leading shares jumped to record levels and reached 50 points, closing below 17. 2 on friday. [SEP] \"as much as a true person, you can think, you will do the job and, ultimately, will have to give a bit of thought to the truth. [SEP]\" the people know that the desire to help me achieve further work is no secret, he says. [SEP] in january, the council issued a road plan in the area of chap thurp, the most famous architect. [SEP]"}
+{"type": "sample", "index": 19, "raw_text": "[CLS] thursday. [SEP] i want to lie, or be self - deprecating, about the relationship. [SEP] the children had taken care of the bedroom. [SEP] some of the students are said to have been democrats from the tory party, and some of them admitted, in the end, the terms of their agreement were only a matter of a matter. [SEP] it ' s time to sit in and get out in the back of the car. [SEP] but for a brief moment, we stopped his car from the other side of the road and we, just a mile away, were taking most of the journey. [SEP] here, you know, [SEP]", "detok_text": "[CLS] thursday. [SEP] i want to lie, or be self - deprecating, about the relationship. [SEP] the children had taken care of the bedroom. [SEP] some of the students are said to have been democrats from the tory party, and some of them admitted, in the end, the terms of their agreement were only a matter of a matter. [SEP] it's time to sit in and get out in the back of the car. [SEP] but for a brief moment, we stopped his car from the other side of the road and we, just a mile away, were taking most of the journey. [SEP] here, you know, [SEP]"}
+{"type": "sample", "index": 20, "raw_text": "[CLS] in new york. [SEP] the building company plans to bring its 300 employees to the b. r. s. from 16, 300 - seat aircraft and 16, 000 - 16, 500 aircraft during the second world war ii. [SEP] the problem is that, as well as having the wheel right, and holding it to the same side of tracks, the electric train then turns back, three or later, between steps and ramps, when it is to have to turn a place before the road ends. [SEP] obama is returning from his presidential campaign in texas on saturday. [SEP] look, now and then.... [SEP] however, the [SEP]", "detok_text": "[CLS] in new york. [SEP] the building company plans to bring its 300 employees to the b. r. s. from 16, 300 - seat aircraft and 16, 000 - 16, 500 aircraft during the second world war ii. [SEP] the problem is that, as well as having the wheel right, and holding it to the same side of tracks, the electric train then turns back, three or later, between steps and ramps, when it is to have to turn a place before the road ends. [SEP] obama is returning from his presidential campaign in texas on saturday. [SEP] look, now and then.... [SEP] however, the [SEP]"}
+{"type": "sample", "index": 21, "raw_text": "[CLS] ' t think it was difficult to make it a part of the business, \" said mark morris, head of research strategy at bg & markets in india. [SEP] he said he is prepared to come here in a \" more relaxed, more stable, mood in manchester for a while. \" [SEP] the deadline is nov. [SEP] \" i have to believe that the various apparent problems associated with the establishment of the rail commission haven ' t connected to any crime. [SEP] \" the change is that people have family, friends, and people who always see that kind of day as a time for change, \" he didn ' t say. [SEP] [SEP]", "detok_text": "[CLS]'t think it was difficult to make it a part of the business, \"said mark morris, head of research strategy at bg & markets in india. [SEP] he said he is prepared to come here in a\" more relaxed, more stable, mood in manchester for a while. \"[SEP] the deadline is nov. [SEP]\" i have to believe that the various apparent problems associated with the establishment of the rail commission haven't connected to any crime. [SEP] \"the change is that people have family, friends, and people who always see that kind of day as a time for change,\" he didn't say. [SEP] [SEP]"}
+{"type": "sample", "index": 22, "raw_text": "[CLS] the year... [SEP] on the other hand, the house is filled with the art and light, the light and light, the spouting of skin, the huge lemon - scented green and white, filled with giant trees and pinks. [SEP] after some years of baking on the ground, a deep yellow sweeter, which - - the deep red, brown sugar, and the smell of peppery water - - ended with salted water. [SEP] in addition, carmakers are printed with red red ink and make long brown paper. [SEP] \" a few months later, someone went in to put out a special effort in [SEP]", "detok_text": "[CLS] the year... [SEP] on the other hand, the house is filled with the art and light, the light and light, the spouting of skin, the huge lemon - scented green and white, filled with giant trees and pinks. [SEP] after some years of baking on the ground, a deep yellow sweeter, which - - the deep red, brown sugar, and the smell of peppery water - - ended with salted water. [SEP] in addition, carmakers are printed with red red ink and make long brown paper. [SEP] \" a few months later, someone went in to put out a special effort in [SEP]"}
+{"type": "sample", "index": 23, "raw_text": "[CLS], he was much younger and kind. [SEP] that made all the difference. [SEP] his lawyer, david patterson, said that he had been on the plane, but had refused to leave. [SEP] mr phillips said it is not his responsibility for the women to talk. [SEP] then there will be nothing worse. [SEP] the sale, with a residual value of $ 1. 6 million, until 2010, with a loss reduction of at least $ 500 million, is expected, brokers say. [SEP] as the battle got out, i began to look nonpollenty. [SEP] \" it has never been a small operation, and the results of [SEP]", "detok_text": "[CLS], he was much younger and kind. [SEP] that made all the difference. [SEP] his lawyer, david patterson, said that he had been on the plane, but had refused to leave. [SEP] mr phillips said it is not his responsibility for the women to talk. [SEP] then there will be nothing worse. [SEP] the sale, with a residual value of $1. 6 million, until 2010, with a loss reduction of at least $500 million, is expected, brokers say. [SEP] as the battle got out, i began to look nonpollenty. [SEP] \" it has never been a small operation, and the results of [SEP]"}
+{"type": "sample", "index": 24, "raw_text": "[CLS] to do. [SEP] ms robinson, who has asked mr robinson to become the minister, said yesterday that the parties entered into a second agreement, with the first minister, days after the issue was agreed in november 2007. [SEP] it ' s a combination of opportunities, many games, long, hard relationships. [SEP] in the end he took a lot of hurt. [SEP] they will make friends when he ' s in the house, she said. [SEP] mr mccafe, microsoft ' s business manager, pulls down a \" note \" about it, taking it like a dead end. [SEP] \" we have not had a car in the past [SEP]", "detok_text": "[CLS] to do. [SEP] ms robinson, who has asked mr robinson to become the minister, said yesterday that the parties entered into a second agreement, with the first minister, days after the issue was agreed in november 2007. [SEP] it's a combination of opportunities, many games, long, hard relationships. [SEP] in the end he took a lot of hurt. [SEP] they will make friends when he's in the house, she said. [SEP] mr mccafe, microsoft's business manager, pulls down a \"note\" about it, taking it like a dead end. [SEP] \" we have not had a car in the past [SEP]"}
+{"type": "sample", "index": 25, "raw_text": "[CLS] to produce data. [SEP] \" they ' ll be able to hire, hire, to hire, dress and hire. - - plus, the group will get enough money to do in the future, he said. [SEP] i mean everything, but for obama who wants to run a vote for a woman, look forward and vote for men and women. [SEP] and now that everything looks for sale, of course, it is like a go - between. [SEP] we want to work together. [SEP] he said he didn ' t speak about that. [SEP] they need to make a statement. [SEP] madison, wis., june 30 ( up [SEP]", "detok_text": "[CLS] to produce data. [SEP] \" they'll be able to hire, hire, to hire, dress and hire. - - plus, the group will get enough money to do in the future, he said. [SEP] i mean everything, but for obama who wants to run a vote for a woman, look forward and vote for men and women. [SEP] and now that everything looks for sale, of course, it is like a go - between. [SEP] we want to work together. [SEP] he said he didn't speak about that. [SEP] they need to make a statement. [SEP] madison, wis., june 30 ( up [SEP]"}
+{"type": "sample", "index": 26, "raw_text": "[CLS], then come with them, after all, \" he says. [SEP] and, the answer is, but, pretty simple. [SEP] people will need to build their egos on their own, and be the one to work in the mud and obliate them and put them together in order to make that thing happen. [SEP] david letterman, the former reality - show host, agrees. [SEP] he said the fans would continue to do his best to succeed. [SEP] they put me out of here. [SEP] but it is going to be. [SEP] i look at the city as well as i do in the city, \" he said. [SEP]", "detok_text": "[CLS], then come with them, after all, \"he says. [SEP] and, the answer is, but, pretty simple. [SEP] people will need to build their egos on their own, and be the one to work in the mud and obliate them and put them together in order to make that thing happen. [SEP] david letterman, the former reality - show host, agrees. [SEP] he said the fans would continue to do his best to succeed. [SEP] they put me out of here. [SEP] but it is going to be. [SEP] i look at the city as well as i do in the city,\" he said. [SEP]"}
+{"type": "sample", "index": 27, "raw_text": "[CLS] and a little more. [SEP] top of the mutton. [SEP] \" now the definition of the problem is clear, \" he said. [SEP] the group, which has been lobbying against the plan for the first time as recently as september, had not announced its final numbers. [SEP] the man, in a wheelchair, unable to cover his skis, cuts to the back and side of his head, was able to close the man. [SEP] but i ' m not a gooder. [SEP] i just read that one of the other ' s brothers died in bed when he had died. [SEP] it is not that this has surprised me. [SEP]", "detok_text": "[CLS] and a little more. [SEP] top of the mutton. [SEP] \"now the definition of the problem is clear,\" he said. [SEP] the group, which has been lobbying against the plan for the first time as recently as september, had not announced its final numbers. [SEP] the man, in a wheelchair, unable to cover his skis, cuts to the back and side of his head, was able to close the man. [SEP] but i'm not a gooder. [SEP] i just read that one of the other's brothers died in bed when he had died. [SEP] it is not that this has surprised me. [SEP]"}
+{"type": "sample", "index": 28, "raw_text": "[CLS] interest in northern pakistan, \" he said. [SEP] it was the first time al - marri had been hurt. [SEP] 2 ) the road was closed off and tied to the same wall. [SEP] he grew up, he said he was a great boy, and he came back from a couple of years on radio. [SEP] he called for the trains to start from home to the site because of the delay. [SEP] however, every day i get something to go on, it has to look all over me, so now i could really get a look on the face. [SEP] he can do what ' s right down to the north. [SEP]", "detok_text": "[CLS] interest in northern pakistan, \" he said. [SEP] it was the first time al - marri had been hurt. [SEP] 2 ) the road was closed off and tied to the same wall. [SEP] he grew up, he said he was a great boy, and he came back from a couple of years on radio. [SEP] he called for the trains to start from home to the site because of the delay. [SEP] however, every day i get something to go on, it has to look all over me, so now i could really get a look on the face. [SEP] he can do what's right down to the north. [SEP]"}
+{"type": "sample", "index": 29, "raw_text": "[CLS] airport. [SEP] the overall use of european powers on the internet is a blow to the eu and the countries will find it harder to work together if they are to get any traction. [SEP] new york ( ap ) - - with the political jam settled, the evidence is bleak, but some experts say there ' s still a long way to go. [SEP] and if it is enough to do that - - eventually, the law will change. [SEP] there are two plastic bags on them - - chairs, linens and towels at one end of the head, one paper at the other, another on the outside of the pillow, the inside [SEP]", "detok_text": "[CLS] airport. [SEP] the overall use of european powers on the internet is a blow to the eu and the countries will find it harder to work together if they are to get any traction. [SEP] new york (ap) - - with the political jam settled, the evidence is bleak, but some experts say there's still a long way to go. [SEP] and if it is enough to do that - - eventually, the law will change. [SEP] there are two plastic bags on them - - chairs, linens and towels at one end of the head, one paper at the other, another on the outside of the pillow, the inside [SEP]"}
+{"type": "sample", "index": 30, "raw_text": "[CLS] at the time, so she called the police department in hopes of getting her kids back. [SEP] a _ detroit 2 of 2, chicago 1. [SEP] i always remember that again there was a lot - - pain, of a half - deep, sleep, half - force fatigue, the deep pain, the failure to realize that there was some of these issues to be resolved. [SEP] he opened his eyes, but returned for a few seconds before the full picture was shown to him. [SEP] that is, admittedly, the level of such assertions. [SEP] he has a bit to prove. [SEP] i can see that the attitude is [SEP]", "detok_text": "[CLS] at the time, so she called the police department in hopes of getting her kids back. [SEP] a _ detroit 2 of 2, chicago 1. [SEP] i always remember that again there was a lot - - pain, of a half - deep, sleep, half - force fatigue, the deep pain, the failure to realize that there was some of these issues to be resolved. [SEP] he opened his eyes, but returned for a few seconds before the full picture was shown to him. [SEP] that is, admittedly, the level of such assertions. [SEP] he has a bit to prove. [SEP] i can see that the attitude is [SEP]"}
+{"type": "sample", "index": 31, "raw_text": "[CLS] \" you need to believe that a game of life and i has so far let that go, \" he said. [SEP] he got on with him and his girlfriend, and both of them. [SEP] phoenix 24, boston, watson 24 ( new york 24 - - chicago 2, detroit 19, chicago 2 - brown 2 - 2 ). [SEP] the night, off - time, late in the night, i didn ' t... [SEP] to keep to a good touch with the dog, they have to pretend that the dog is simply working, not working, but is making it in the wild. [SEP] \" and that means that [SEP]", "detok_text": "[CLS] \"you need to believe that a game of life and i has so far let that go,\" he said. [SEP] he got on with him and his girlfriend, and both of them. [SEP] phoenix 24, boston, watson 24 (new york 24 - - chicago 2, detroit 19, chicago 2 - brown 2 - 2). [SEP] the night, off - time, late in the night, i didn't... [SEP] to keep to a good touch with the dog, they have to pretend that the dog is simply working, not working, but is making it in the wild. [SEP] \" and that means that [SEP]"}
+{"type": "sample", "index": 32, "raw_text": "[CLS] tell him that there is a lot of pressure at the top of the road. [SEP] the only time he was elected was two years ago, when he said that, according to an analysis by a military tribunal, he had little in his system to try. [SEP] the knicks ' agreement with vick marks a new chapter in the days of the jets ' current owner - - willie walsh - - along with a multi - year deal. [SEP] while the chef was on my own, i would stay there full time - - until he left, perhaps, later, with the whole room filled with white linen. [SEP] while it helps that the [SEP]", "detok_text": "[CLS] tell him that there is a lot of pressure at the top of the road. [SEP] the only time he was elected was two years ago, when he said that, according to an analysis by a military tribunal, he had little in his system to try. [SEP] the knicks' agreement with vick marks a new chapter in the days of the jets' current owner - - willie walsh - - along with a multi - year deal. [SEP] while the chef was on my own, i would stay there full time - - until he left, perhaps, later, with the whole room filled with white linen. [SEP] while it helps that the [SEP]"}
+{"type": "sample", "index": 33, "raw_text": "[CLS] the lead on a 6 - 2 run early in the quarter. [SEP] in chicago, executives from cbs group inc. picked up the tag with him, and he ' s expected to appear in the event at the center of the museum. [SEP] but all of them are thought to be having to work out a number of layers of salt, ice and placity - - the coast, mountain roads and even roads, trains, trains, railway stations, and the metropolitan area - - before to be exposed to the snow. [SEP] bring in everything - - top, buttery, pan - cover and vanilla - mix with salt, and [SEP]", "detok_text": "[CLS] the lead on a 6 - 2 run early in the quarter. [SEP] in chicago, executives from cbs group inc. picked up the tag with him, and he's expected to appear in the event at the center of the museum. [SEP] but all of them are thought to be having to work out a number of layers of salt, ice and placity - - the coast, mountain roads and even roads, trains, trains, railway stations, and the metropolitan area - - before to be exposed to the snow. [SEP] bring in everything - - top, buttery, pan - cover and vanilla - mix with salt, and [SEP]"}
+{"type": "sample", "index": 34, "raw_text": "[CLS] season. [SEP] the half - mile will bring in about 1, 000 in july, with the use of four cars on the manchester and liverpool roads. [SEP] the plan was no insurance option. [SEP] bring boil, low heat, wash - water to boil, or, as much as possible, make it into a large bowl. [SEP] and then, finally, it is, in the long ahead, a more expensive name. [SEP] but we ' ve got him in your corner. [SEP] where is anyone going for the white house. [SEP] i think, really, that makes it look much better. [SEP] only 11. 30am : we [SEP]", "detok_text": "[CLS] season. [SEP] the half - mile will bring in about 1, 000 in july, with the use of four cars on the manchester and liverpool roads. [SEP] the plan was no insurance option. [SEP] bring boil, low heat, wash - water to boil, or, as much as possible, make it into a large bowl. [SEP] and then, finally, it is, in the long ahead, a more expensive name. [SEP] but we've got him in your corner. [SEP] where is anyone going for the white house. [SEP] i think, really, that makes it look much better. [SEP] only 11. 30am: we [SEP]"}
+{"type": "sample", "index": 35, "raw_text": "[CLS] \" the group ' s mark steel said. [SEP] get back to work, then start to the back of the union. [SEP] but take off in a taxi, get to london and get to london - the train is more, not less. [SEP] when he said that the violence happened, he was only allowed to talk again, and pointed to a point where she lied. [SEP] he and ba tried to put a sign on the flight, and there is some confusion about those details. [SEP] a few bubbles - - in place, a pinch of butter and, often, in it - - sat at the bottom of the fridge. [SEP] [SEP]", "detok_text": "[CLS] \" the group's mark steel said. [SEP] get back to work, then start to the back of the union. [SEP] but take off in a taxi, get to london and get to london - the train is more, not less. [SEP] when he said that the violence happened, he was only allowed to talk again, and pointed to a point where she lied. [SEP] he and ba tried to put a sign on the flight, and there is some confusion about those details. [SEP] a few bubbles - - in place, a pinch of butter and, often, in it - - sat at the bottom of the fridge. [SEP] [SEP]"}
+{"type": "sample", "index": 36, "raw_text": "[CLS] up, it does not make much sense, \" ocampo told afp. [SEP] \" and in the meantime, said his wife,,, c.,,,,,,,,,,,,,,,,,,,,,, on the top of the middle of the table, and on the back in the middle of the room, but the whole time was still around s. 5 as the light fell. [SEP] they are part of a lot when you need to do in a company by being a coach, but with listening in person and sitting in person. [SEP] the uk is one of [SEP]", "detok_text": "[CLS] up, it does not make much sense, \"ocampo told afp. [SEP]\" and in the meantime, said his wife,,, c.,,,,,,,,,,,,,,,,,,,,,, on the top of the middle of the table, and on the back in the middle of the room, but the whole time was still around s. 5 as the light fell. [SEP] they are part of a lot when you need to do in a company by being a coach, but with listening in person and sitting in person. [SEP] the uk is one of [SEP]"}
+{"type": "sample", "index": 37, "raw_text": "[CLS] want to enjoy. [SEP] on wednesday, obama and obama have to work over their ideas, together to work together and to work on the same. [SEP] the white house will not respond to any decisions in six months, \" he said. [SEP] you can work, in turn, and cook together in some flour ( or liquid ) to try to balance the juices. [SEP] the difference is that hard to understand, that people must be able to voice that message. [SEP] \" with a coach, the time is, once or even twice, take off, \" he said. [SEP] the deal, however, was to close in october, [SEP]", "detok_text": "[CLS] want to enjoy. [SEP] on wednesday, obama and obama have to work over their ideas, together to work together and to work on the same. [SEP] the white house will not respond to any decisions in six months, \"he said. [SEP] you can work, in turn, and cook together in some flour (or liquid) to try to balance the juices. [SEP] the difference is that hard to understand, that people must be able to voice that message. [SEP]\" with a coach, the time is, once or even twice, take off, \" he said. [SEP] the deal, however, was to close in october, [SEP]"}
+{"type": "sample", "index": 38, "raw_text": "[CLS], \" he said. [SEP] you just have to take it off, he can buy a pair of long - lasting pants. [SEP] the world should have tried to wait, but by now we were hoping for the worst. [SEP] we love you, with great boos, and lots of boos ; i mean, if your answer is short, \" yes. \" [SEP] the difference narrowed. [SEP] and, hey, there ' s a moon. [SEP] now, that veteran needs to leave and turn again - - and he will have to wait to pass this season - - back. [SEP] but he is getting into the green ground in [SEP]", "detok_text": "[CLS], \"he said. [SEP] you just have to take it off, he can buy a pair of long - lasting pants. [SEP] the world should have tried to wait, but by now we were hoping for the worst. [SEP] we love you, with great boos, and lots of boos; i mean, if your answer is short,\" yes. \" [SEP] the difference narrowed. [SEP] and, hey, there's a moon. [SEP] now, that veteran needs to leave and turn again - - and he will have to wait to pass this season - - back. [SEP] but he is getting into the green ground in [SEP]"}
+{"type": "sample", "index": 39, "raw_text": "[CLS] 80 percent of the equivalent of 100 million yuan in value, \" he said. [SEP] the company has cancelled flights in the last week and expanded to 12 hours and 48 hours a day over a seven - day - week and 14 day period over the past five years. [SEP] you ' ll also see a look of the first two performances, prior to the play in 14 minutes. [SEP] the old dresses, dressed anonymously as black dresses, was knotted together, teetering along the walls on a sheet lined with white coats strung together in a heavy yellow blanket. [SEP] the capitals ' s streak began a year after the game, with the [SEP]", "detok_text": "[CLS] 80 percent of the equivalent of 100 million yuan in value, \" he said. [SEP] the company has cancelled flights in the last week and expanded to 12 hours and 48 hours a day over a seven - day - week and 14 day period over the past five years. [SEP] you'll also see a look of the first two performances, prior to the play in 14 minutes. [SEP] the old dresses, dressed anonymously as black dresses, was knotted together, teetering along the walls on a sheet lined with white coats strung together in a heavy yellow blanket. [SEP] the capitals's streak began a year after the game, with the [SEP]"}
+{"type": "sample", "index": 40, "raw_text": "[CLS] - he ' s only one person. [SEP] the historic 7 - 2 victory put the broncos in the same playoffs for the first time since 1991 - - and the first in franchise history. [SEP] when it was presented to the audience, changes to the story, i thought, were something of a flurry of drama, and, crucially, all of the talk said, that it was never the name of the opera house. [SEP] place the butter in the pars, and leave the butter in the oven, stirring in the pans, and lay the onion together in the pan. [SEP] the falcons are waiting for a review. [SEP]", "detok_text": "[CLS] - he's only one person. [SEP] the historic 7 - 2 victory put the broncos in the same playoffs for the first time since 1991 - - and the first in franchise history. [SEP] when it was presented to the audience, changes to the story, i thought, were something of a flurry of drama, and, crucially, all of the talk said, that it was never the name of the opera house. [SEP] place the butter in the pars, and leave the butter in the oven, stirring in the pans, and lay the onion together in the pan. [SEP] the falcons are waiting for a review. [SEP]"}
+{"type": "sample", "index": 41, "raw_text": "[CLS] - t :... hi, i want to work in iran. [SEP] the trail features 10 men in skis able to run hundreds of miles, in within miles and in minutes. [SEP] they can, in other words, drive you back to the top - down destination for a while - - the same right out of the sun. [SEP] they had the risk of death. [SEP] unfortunately, though, he didn ' t realize, even the traditionalists, that he did so at all. [SEP] \" the world economy is trying to recover, but things can be much worse, \" he said. [SEP] for the second quarter of [SEP]", "detok_text": "[CLS] - t :... hi, i want to work in iran. [SEP] the trail features 10 men in skis able to run hundreds of miles, in within miles and in minutes. [SEP] they can, in other words, drive you back to the top - down destination for a while - - the same right out of the sun. [SEP] they had the risk of death. [SEP] unfortunately, though, he didn't realize, even the traditionalists, that he did so at all. [SEP] \"the world economy is trying to recover, but things can be much worse,\" he said. [SEP] for the second quarter of [SEP]"}
+{"type": "sample", "index": 42, "raw_text": "[CLS] of god, to his work as a lawyer, and as a grunder. [SEP] what a shame for me, and i would glad to have a new friend from north korea with a great bit of help at work if you want to look in the mirror just a little. [SEP] 40 and 30 - year - old artists - - who have been able to see the local works on so much of their short story lines - - are gone, he said. [SEP] if you want to vote, you have...... od7 dww albyn2rxwb i arrived just before the [SEP]", "detok_text": "[CLS] of god, to his work as a lawyer, and as a grunder. [SEP] what a shame for me, and i would glad to have a new friend from north korea with a great bit of help at work if you want to look in the mirror just a little. [SEP] 40 and 30 - year - old artists - - who have been able to see the local works on so much of their short story lines - - are gone, he said. [SEP] if you want to vote, you have...... od7 dww albyn2rxwb i arrived just before the [SEP]"}
+{"type": "sample", "index": 43, "raw_text": "[CLS], we ' ve made a lot of other progress. [SEP] we were all leaving at the other end of the tunnel, but when we spoke they were terrified at the prospect of having to move. [SEP] mr brown is accused of having \" a huge attack \" on his daughter after he drank alcohol. [SEP] i knew when he was 20, the equivalent of a ball - - and maybe a card - - and a good tool to get the ability to control the ball - - but that just was going to be his hand. [SEP] \" we can never get a divorce - - and we ' re still married, \" said. [SEP] he [SEP]", "detok_text": "[CLS], we've made a lot of other progress. [SEP] we were all leaving at the other end of the tunnel, but when we spoke they were terrified at the prospect of having to move. [SEP] mr brown is accused of having \"a huge attack\" on his daughter after he drank alcohol. [SEP] i knew when he was 20, the equivalent of a ball - - and maybe a card - - and a good tool to get the ability to control the ball - - but that just was going to be his hand. [SEP] \"we can never get a divorce - - and we're still married,\" said. [SEP] he [SEP]"}
+{"type": "sample", "index": 44, "raw_text": "[CLS] his way back to the penalty area. [SEP] with the opening of its facility, the dc / b / f - series, b - 8, mdc technologies is a leader in confill solutions for advanced high - powered, land - based power systems. [SEP] before you do, forget to feel in a daze - - it can mean through the top of the wall, just before you touch it at the side of the wall. [SEP] they don ' t know that, when the story just comes together, then, change at the bad times, then, maybe, then again, and it ' s back in the black. [SEP]", "detok_text": "[CLS] his way back to the penalty area. [SEP] with the opening of its facility, the dc/b/f - series, b - 8, mdc technologies is a leader in confill solutions for advanced high - powered, land - based power systems. [SEP] before you do, forget to feel in a daze - - it can mean through the top of the wall, just before you touch it at the side of the wall. [SEP] they don't know that, when the story just comes together, then, change at the bad times, then, maybe, then again, and it's back in the black. [SEP]"}
+{"type": "sample", "index": 45, "raw_text": "[CLS] august last year. [SEP] so, to come out, at the road, at the down, at the ground, at the side, to at the door, to get the door, at the back end of the turn, on a path, and we are going back down, we are already able to stop and to have a reverse journey up there, just to work again... and he seems to have a path with a path that is out of the end of the starting point. [SEP] \" the children are in the class, and well, half our children. [SEP] the airline will be able to pay as much as [SEP]", "detok_text": "[CLS] august last year. [SEP] so, to come out, at the road, at the down, at the ground, at the side, to at the door, to get the door, at the back end of the turn, on a path, and we are going back down, we are already able to stop and to have a reverse journey up there, just to work again... and he seems to have a path with a path that is out of the end of the starting point. [SEP] \" the children are in the class, and well, half our children. [SEP] the airline will be able to pay as much as [SEP]"}
+{"type": "sample", "index": 46, "raw_text": "[CLS] of anything he ' s ever said to him, and that ' s true. [SEP] here there are differences in the two - state relationship. [SEP] he says he is \" very self - functioning. \" [SEP] i will try to get into this way... [SEP] their victory resulted in the best start of the day. [SEP] in the end, it seemed to be a film that went far in its direction and, to some extent, nothing less than a political special. [SEP] mr. brown talks about the results. [SEP] it is, it ' s right, the droves with the devil.... [SEP] the number of [SEP]", "detok_text": "[CLS] of anything he's ever said to him, and that's true. [SEP] here there are differences in the two - state relationship. [SEP] he says he is \"very self - functioning.\" [SEP] i will try to get into this way... [SEP] their victory resulted in the best start of the day. [SEP] in the end, it seemed to be a film that went far in its direction and, to some extent, nothing less than a political special. [SEP] mr. brown talks about the results. [SEP] it is, it's right, the droves with the devil.... [SEP] the number of [SEP]"}
+{"type": "sample", "index": 47, "raw_text": "[CLS] the end of a day, and it has to come well, not bad, but for many of these people who want to keep things together, it ' s because they do so well, or they just get their way, or even, of course, start your trip on the hot wheels. [SEP] but we have had a good marriage, lost our marriage to have a child, that if we ' d still have a lot to work for, with the family, maybe, and love to him came out and he was a strong boy, he didn ' t have to give up. [SEP] but in the \" hybrid \" system, [SEP]", "detok_text": "[CLS] the end of a day, and it has to come well, not bad, but for many of these people who want to keep things together, it's because they do so well, or they just get their way, or even, of course, start your trip on the hot wheels. [SEP] but we have had a good marriage, lost our marriage to have a child, that if we'd still have a lot to work for, with the family, maybe, and love to him came out and he was a strong boy, he didn't have to give up. [SEP] but in the \"hybrid\" system, [SEP]"}
+{"type": "sample", "index": 48, "raw_text": "[CLS] much more room with water in their homes. [SEP] for a long time, it has something to do with our financial system. [SEP] \" but i have no things to do in training, so when it gets to the task... i know well, i know in sport that i have to get into the training - session - and - fitness situations. [SEP] bristol crown court heard he often abused young people in a police car on occasions. [SEP] in addition, the yankees won seven games - - from 14 - 15 to - 6, going into the season - - in the same seasons 2006 and 2007. [SEP] and, he said [SEP]", "detok_text": "[CLS] much more room with water in their homes. [SEP] for a long time, it has something to do with our financial system. [SEP] \" but i have no things to do in training, so when it gets to the task... i know well, i know in sport that i have to get into the training - session - and - fitness situations. [SEP] bristol crown court heard he often abused young people in a police car on occasions. [SEP] in addition, the yankees won seven games - - from 14 - 15 to - 6, going into the season - - in the same seasons 2006 and 2007. [SEP] and, he said [SEP]"}
+{"type": "sample", "index": 49, "raw_text": "[CLS]. [SEP] and a different kind of attitude. [SEP] he jumped into a concrete lot near the police checkpoint, and then began his way to catch the vehicle. [SEP] also, create a situation where you can look at the intensity of life going on, the movement of the water around you, and the light, then and then, once and then, and then, all on the lights with the sort of clarity. [SEP] i have heard that we do things we know so much, know about things we just say, about things - people, things they do not want to be said, are not always right. [SEP] finally, that ' [SEP]", "detok_text": "[CLS]. [SEP] and a different kind of attitude. [SEP] he jumped into a concrete lot near the police checkpoint, and then began his way to catch the vehicle. [SEP] also, create a situation where you can look at the intensity of life going on, the movement of the water around you, and the light, then and then, once and then, and then, all on the lights with the sort of clarity. [SEP] i have heard that we do things we know so much, know about things we just say, about things - people, things they do not want to be said, are not always right. [SEP] finally, that ' [SEP]"}
+{"type": "sample", "index": 50, "raw_text": "[CLS] [SEP] and, while the man still has a more civil sense of authority, the promise of a greater sense of adventure has brought down a united force that he never seemed to be going on the best course at all. [SEP] for those at all levels, such as reading, gardening, water sports, food, work and clothes, the same could be done with free meals and holidays. [SEP] this one means being able to work day, work, in classes, weekends and other things, so you can sit for an hour, day, or hours, as well. [SEP] nope, dec. [SEP] the truth is this, i have to [SEP]", "detok_text": "[CLS] [SEP] and, while the man still has a more civil sense of authority, the promise of a greater sense of adventure has brought down a united force that he never seemed to be going on the best course at all. [SEP] for those at all levels, such as reading, gardening, water sports, food, work and clothes, the same could be done with free meals and holidays. [SEP] this one means being able to work day, work, in classes, weekends and other things, so you can sit for an hour, day, or hours, as well. [SEP] nope, dec. [SEP] the truth is this, i have to [SEP]"}
+{"type": "sample", "index": 51, "raw_text": "[CLS] in developing countries, according to us media reports. [SEP] it brought in a surplus of £17, 000, down from £16m in 2006. [SEP] he certainly is not like many of the day ' s events - - done in the 70s, 60s, or 70s - - or even 70s - - and for example, he wasn ' t ready to do anything. [SEP] he was a managing director for england ' s team - - which ran from one season until 2003 - - eight years before he had fully decided to be coming to london after a 10 - year run for the club in the early months of 2004. [SEP] but [SEP]", "detok_text": "[CLS] in developing countries, according to us media reports. [SEP] it brought in a surplus of £17, 000, down from £16m in 2006. [SEP] he certainly is not like many of the day's events - - done in the 70s, 60s, or 70s - - or even 70s - - and for example, he wasn't ready to do anything. [SEP] he was a managing director for england's team - - which ran from one season until 2003 - - eight years before he had fully decided to be coming to london after a 10 - year run for the club in the early months of 2004. [SEP] but [SEP]"}
+{"type": "sample", "index": 52, "raw_text": "[CLS] figures seem to appear accurate, but the unemployment rate is less than 3 percent. [SEP] the committee ' s chairman, james schwi, was added to the committee. [SEP] \" we have some time, and i have to get a bit extra, to be ready, get up and something else. \" [SEP] and j. d. scored a single on chicago ' s first pitch of the inning to take a 4 - 3 run, the one that eventually forced comebacker joe scuier out of position to end a perfect game. [SEP] the union issued a warning that foreign workers and the prime minister have the right to use their [SEP]", "detok_text": "[CLS] figures seem to appear accurate, but the unemployment rate is less than 3 percent. [SEP] the committee's chairman, james schwi, was added to the committee. [SEP] \"we have some time, and i have to get a bit extra, to be ready, get up and something else.\" [SEP] and j. d. scored a single on chicago's first pitch of the inning to take a 4 - 3 run, the one that eventually forced comebacker joe scuier out of position to end a perfect game. [SEP] the union issued a warning that foreign workers and the prime minister have the right to use their [SEP]"}
+{"type": "sample", "index": 53, "raw_text": "[CLS] and easier for people to give. [SEP] that, not just, in its words, but also its 2, 000 - pound capacity, a permanent one that doesn ' t break, and can return in \" another 20 years. \" [SEP] and for a while, i ' m not sorry about you, i ' m love with you, when people have good things, but we don ' t know. [SEP] its shares have lost more than 10 %. [SEP] \" i think i think there are a lot of people on the team and my head doesn ' t look like, but it really is really much more important, \" said brian [SEP]", "detok_text": "[CLS] and easier for people to give. [SEP] that, not just, in its words, but also its 2, 000 - pound capacity, a permanent one that doesn't break, and can return in \"another 20 years.\" [SEP] and for a while, i'm not sorry about you, i'm love with you, when people have good things, but we don't know. [SEP] its shares have lost more than 10 %. [SEP] \"i think i think there are a lot of people on the team and my head doesn't look like, but it really is really much more important,\" said brian [SEP]"}
+{"type": "sample", "index": 54, "raw_text": "[CLS] happened in the months and months, and to all of them, time by time. [SEP] nature, faith and god, has a great deal of regularity, but there is little to do with man ' s relationships, he said. [SEP] a man, man, woman, a dog, i say, don ' t get a job, have a mortgage, good hands, bad heart. [SEP] axa is the global software company that provides more than 40 years of data service to global clients. [SEP] he had been on the run in australia before, and in march 2008, was arrested and released by australian police. [SEP] a similar [SEP]", "detok_text": "[CLS] happened in the months and months, and to all of them, time by time. [SEP] nature, faith and god, has a great deal of regularity, but there is little to do with man's relationships, he said. [SEP] a man, man, woman, a dog, i say, don't get a job, have a mortgage, good hands, bad heart. [SEP] axa is the global software company that provides more than 40 years of data service to global clients. [SEP] he had been on the run in australia before, and in march 2008, was arrested and released by australian police. [SEP] a similar [SEP]"}
+{"type": "sample", "index": 55, "raw_text": "[CLS]her al murktari, who was sent to the uk 11 days after the 9 / 11 attacks on the us states. [SEP] i know, after 3 years, i should have stopped. [SEP] after that, i has to deal with mid - term issues. [SEP] it ' s a situation. [SEP] the jets ' top - receiver was suspended, and replaced him again. [SEP] \" japan is beautiful, but it is beautiful, \" he said. [SEP] this is the stock market crash of 2008. [SEP] a self - proclaimed graduate of politics. [SEP] on a recent day, members of the group said support, no words, no [SEP]", "detok_text": "[CLS]her al murktari, who was sent to the uk 11 days after the 9/11 attacks on the us states. [SEP] i know, after 3 years, i should have stopped. [SEP] after that, i has to deal with mid - term issues. [SEP] it's a situation. [SEP] the jets' top - receiver was suspended, and replaced him again. [SEP] \"japan is beautiful, but it is beautiful,\" he said. [SEP] this is the stock market crash of 2008. [SEP] a self - proclaimed graduate of politics. [SEP] on a recent day, members of the group said support, no words, no [SEP]"}
+{"type": "sample", "index": 56, "raw_text": "[CLS]. [SEP] the family is rarely in crisis. [SEP] a lot of it means money - - which means, well, done, a lot of folks were able to give you the best idea of everything - - in the class. [SEP] he was freed in 2002. [SEP] at the end, she ' s at the point who comes back in the face of, i have to say, \" bad girl \" - - \" the love girl \" that always gets thrown at her feet, almost always on stage - - and suddenly has a bit of talent. [SEP] it ' s not necessarily to do with a guy who ' s superior, and [SEP]", "detok_text": "[CLS]. [SEP] the family is rarely in crisis. [SEP] a lot of it means money - - which means, well, done, a lot of folks were able to give you the best idea of everything - - in the class. [SEP] he was freed in 2002. [SEP] at the end, she's at the point who comes back in the face of, i have to say, \"bad girl\" - - \"the love girl\" that always gets thrown at her feet, almost always on stage - - and suddenly has a bit of talent. [SEP] it's not necessarily to do with a guy who's superior, and [SEP]"}
+{"type": "sample", "index": 57, "raw_text": "[CLS] half, before he finally grabbed a 16 - point lead in cleveland ' s win - - 80 - 73 victory. [SEP] the crew then walked out of the back room, and the 20 - year - old used a window door to get back to their seats. [SEP] however, the local authority which responded to the petition decided it had not been given back to creditors - which was for a total of £36m. [SEP] not that \" the old man \" is its nemesis. [SEP] think more about your answers, because there are answers you really need, and even later in the end you have a plan. [SEP] \" i have a [SEP]", "detok_text": "[CLS] half, before he finally grabbed a 16 - point lead in cleveland's win - - 80 - 73 victory. [SEP] the crew then walked out of the back room, and the 20 - year - old used a window door to get back to their seats. [SEP] however, the local authority which responded to the petition decided it had not been given back to creditors - which was for a total of £36m. [SEP] not that \"the old man\" is its nemesis. [SEP] think more about your answers, because there are answers you really need, and even later in the end you have a plan. [SEP] \" i have a [SEP]"}
+{"type": "sample", "index": 58, "raw_text": "[CLS]on, dallas rivers, willie johnson, the all - star wide receiver, and all - pro receivers. [SEP] he was taken from his hospital car to a nearby police car, moments before the prison closed, he said in a statement. [SEP] obama had a boost. [SEP] so in the week of february, 17 of the biggest u. s. banks, and 7. 7 percent was nationwide. [SEP] so, i gave in to my son and have to have to do so for all he was to help them. [SEP] the company first made a breakthrough in 2002 when the company, an insurance company, finally built a small hospital in [SEP]", "detok_text": "[CLS]on, dallas rivers, willie johnson, the all - star wide receiver, and all - pro receivers. [SEP] he was taken from his hospital car to a nearby police car, moments before the prison closed, he said in a statement. [SEP] obama had a boost. [SEP] so in the week of february, 17 of the biggest u. s. banks, and 7. 7 percent was nationwide. [SEP] so, i gave in to my son and have to have to do so for all he was to help them. [SEP] the company first made a breakthrough in 2002 when the company, an insurance company, finally built a small hospital in [SEP]"}
+{"type": "sample", "index": 59, "raw_text": "[CLS] \" he is a quiet person, \" mr. crowley says, seeming to write, at the minimum, a letter to u. s. ambassador to the house. [SEP] \" i ' m not inclined to say my friends are doing the thing, \" obama said. [SEP] however, he ' s not coming back to the championship. [SEP] the spokesman said that it was likely that the cap, which usually includes tax increases below 2 % for drivers, included the average price of 10 per cent. [SEP] and i have to work out and understand it. [SEP] the angels played a game in baseball for the first time in 14 years. [SEP] [SEP]", "detok_text": "[CLS] \"he is a quiet person,\" mr. crowley says, seeming to write, at the minimum, a letter to u. s. ambassador to the house. [SEP] \"i'm not inclined to say my friends are doing the thing,\" obama said. [SEP] however, he's not coming back to the championship. [SEP] the spokesman said that it was likely that the cap, which usually includes tax increases below 2 % for drivers, included the average price of 10 per cent. [SEP] and i have to work out and understand it. [SEP] the angels played a game in baseball for the first time in 14 years. [SEP] [SEP]"}
+{"type": "sample", "index": 60, "raw_text": "[CLS] u. s., and canada. [SEP] just like ours, you can help you live better. [SEP] and i know they are well into the last seven. [SEP] since the snowboarding show opened in its entirety in 7 - 11, 2004, the peninsula hotel has been building up its own ski area for years. [SEP] they call for an investment bank to supply cash, which consumers should be able to repay at any time prior to the financial crisis. [SEP] we expect to sleep for an hour in the office, sometimes in a couple of minutes. [SEP] the purchase had been successful, he said, but from £5, 500 to [SEP]", "detok_text": "[CLS] u. s., and canada. [SEP] just like ours, you can help you live better. [SEP] and i know they are well into the last seven. [SEP] since the snowboarding show opened in its entirety in 7 - 11, 2004, the peninsula hotel has been building up its own ski area for years. [SEP] they call for an investment bank to supply cash, which consumers should be able to repay at any time prior to the financial crisis. [SEP] we expect to sleep for an hour in the office, sometimes in a couple of minutes. [SEP] the purchase had been successful, he said, but from £5, 500 to [SEP]"}
+{"type": "sample", "index": 61, "raw_text": "[CLS] after six years of \" shelling. \" [SEP] but officials say the black list could take the flight within three to five months of the target and that it has refused to have flights until friday. [SEP] he has, sometimes,, stories, stories, words, and a tendency to describe the feelings or things that have ever gone on in an instant - - and to the mixture of whole foods, real experiences, thoughts, feelings, and so deep in our blood that one, or another, is just as visible, even untimely, here. [SEP] here, head and mouth, on top of a black - covered mask. [SEP]", "detok_text": "[CLS] after six years of \"shelling.\" [SEP] but officials say the black list could take the flight within three to five months of the target and that it has refused to have flights until friday. [SEP] he has, sometimes,, stories, stories, words, and a tendency to describe the feelings or things that have ever gone on in an instant - - and to the mixture of whole foods, real experiences, thoughts, feelings, and so deep in our blood that one, or another, is just as visible, even untimely, here. [SEP] here, head and mouth, on top of a black - covered mask. [SEP]"}
+{"type": "sample", "index": 62, "raw_text": "[CLS] council spokesman bob davies said : \" the first ( and practical ) thing young people have to do is look for themselves. [SEP] that is what the majority leader, mr cameron, or mr brown, believes. [SEP] la angels at chicago, 8 : 15 p. m. [SEP] send a message, a wink, a response. [SEP] u. s. and british officials in baghdad insist the government is prepared to make a massive effort to keep these areas operating, according to military officials, including a letter to the official. [SEP] unite, which employs 400 teachers, reports from its members at least two hours a day, and employs around 22 [SEP]", "detok_text": "[CLS] council spokesman bob davies said: \" the first (and practical) thing young people have to do is look for themselves. [SEP] that is what the majority leader, mr cameron, or mr brown, believes. [SEP] la angels at chicago, 8: 15 p. m. [SEP] send a message, a wink, a response. [SEP] u. s. and british officials in baghdad insist the government is prepared to make a massive effort to keep these areas operating, according to military officials, including a letter to the official. [SEP] unite, which employs 400 teachers, reports from its members at least two hours a day, and employs around 22 [SEP]"}
+{"type": "sample", "index": 63, "raw_text": "[CLS] services. [SEP] \" john mccain is going to have to lose for us, and he is, and we will never have the chance to run for the senate, \" romney told cnn ' s website. [SEP] in order to choose from his color - - his loose - toped, cotton - out pants - - he has to open his own, even when he really warms. [SEP] so in spite of that, we have a lot to do... [SEP] because of the fact i was a public teacher. [SEP] i figured he got on the screen he ' d not feel for a long time. [SEP] not surprisingly, the [SEP]", "detok_text": "[CLS] services. [SEP] \"john mccain is going to have to lose for us, and he is, and we will never have the chance to run for the senate,\" romney told cnn's website. [SEP] in order to choose from his color - - his loose - toped, cotton - out pants - - he has to open his own, even when he really warms. [SEP] so in spite of that, we have a lot to do... [SEP] because of the fact i was a public teacher. [SEP] i figured he got on the screen he'd not feel for a long time. [SEP] not surprisingly, the [SEP]"}

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_64/summary.jsonl

@@ -0,0 +1,2 @@
+{"type": "summary", "name": "state_c256_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c256_t1p45", "steps": 64, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 42.24168306980635, "nll_per_token": 3.7434074840068114, "tokens": 9506}, "diversity": {"sample_entropy": 4.010304198715844, "unique_tokens": 1579, "token_count": 8192, "distinct_1": 0.1927490234375, "distinct_2": 0.6353346456692913, "top_token_mass": 0.0780029296875}}
+{"type": "summary", "name": "state_c1024_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c1024_t1p45", "steps": 64, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 1024.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 35.36294023649359, "nll_per_token": 3.565664385797097, "tokens": 9515}, "diversity": {"sample_entropy": 3.884623591993139, "unique_tokens": 1443, "token_count": 8192, "distinct_1": 0.1761474609375, "distinct_2": 0.5751722440944882, "top_token_mass": 0.1007080078125}}

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_64/summary.tsv

@@ -0,0 +1,3 @@
+name	step	detok_genppl	sample_entropy	distinct_2	top_token_mass	model_t_mode	support_power	semantic_power	final_from	endpoint_temp	concentration_max	update
+state_c256_t1p45	124000	42.24168306980635	4.010304198715844	0.6353346456692913	0.0780029296875	post	1.0	1.0	state	1.45	256.0	resample
+state_c1024_t1p45	124000	35.36294023649359	3.884623591993139	0.5751722440944882	0.1007080078125	post	1.0	1.0	state	1.45	1024.0	resample

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_8/state_c1024_t1p45_detok_raw_samples.txt

@@ -0,0 +1,228 @@
+state_c1024_t1p45_detok
+{
+  "type": "summary",
+  "name": "state_c1024_t1p45",
+  "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt",
+  "step": 124000,
+  "decode": {
+    "kind": "categorical_fullvocab",
+    "config": "state_c1024_t1p45",
+    "steps": 8,
+    "model_t_mode": "post",
+    "support_power": 1.0,
+    "semantic_power": 1.0,
+    "endpoint_temp": 1.45,
+    "concentration_min": 1.0,
+    "concentration_max": 1024.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 92.67198759188139,
+    "nll_per_token": 4.529066243430333,
+    "tokens": 5494
+  },
+  "diversity": {
+    "sample_entropy": 1.7085331062756133,
+    "unique_tokens": 354,
+    "token_count": 8192,
+    "distinct_1": 0.043212890625,
+    "distinct_2": 0.1935285433070866,
+    "top_token_mass": 0.3070068359375
+  }
+}
+
+===== sample 000 =====
+[CLS],,,,,,,,ing, period, u,,,,,,,,,, 03,,,s, and,,, :, u.,,,,,,,,, 1, and,,,,,,,,,,,,,, :ing to the screen. [SEP] in n, n. d.: :, u,, :,,,inging, u,,,ing,,,.,, n n7,,... [SEP] poor :.. [SEP] the: : :ing to read the number :. [SEP]
+
+===== sample 001 =====
+[CLS] controllinging basketinginginging bulls, a basket basket -inginginginginginginginginginginging agro -ing. controllinginginginginging 89 controlling basket - dice controllinginginginginginginging control, controlling oinginging: controllinginging phinging 1ing tradersinginginginginginginging corneringinginging and dice. [SEP] totalingingingingingingingingingingingingingingingingingingingingingingingingh - controllinginginginginginginginginging in controlinginginging [SEP]
+
+===== sample 002 =====
+[CLS]. 1........... [SEP] 1 1 1............. 1.7.1.... 1... 111... 1,y - 1.. 1.... [SEP] 1 - 1, 1 - 1.... 1111111 1 - 1..........ly17117.........71....... [SEP] 1 1...... [SEP]
+
+===== sample 003 =====
+[CLS] 1 1 1h 1n 11h111 11 - 247....h 1 1 11 1 to 240 in 1. 2. we're 1 to 1 1 11.. [SEP] 1 by 11111 11 11 1.. 1hhh1hh, 1 11rh 1 11... 1 1h 1 1 11 1 in11h,.. 247 by11hhn 1n by... [SEP] 1 1 1 11..hhh 1.... 14, 1. [SEP]
+
+===== sample 004 =====
+[CLS] + 44 to 557 - 557, -. - - 557 - 557 -7... $100 for $77 - 607 + 4477 - 552 db's plan was: - - -7.. -, - - - -,, - - -, 55 -, 55 - 55 -, -, - - a,, 37, 37,,,,, -,, 55 - 48, 73 -, -,, 49 - 55. 55 -,,,,, 55,, 557,,,,7,,,7 - - [SEP]
+
+===== sample 005 =====
+[CLS] time. [SEP] the,,,,,s, but, the number,,,,,,,,,,,s. [SEP] the u's,,,,,,, 55, 000,,,, and the,,,,,,,,,,,,,,,,a to,,,, oh,,,,, oh, stretching,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, [SEP]
+
+===== sample 006 =====
+[CLS]iherherthertherherioeaaaeherheraherheraiterititi, oherherherherheritherherheraitherheraherherherheritherither,herhera. bitit,heritherherherherherheritit, upi,herheritherheraherititiatii, siits, oiti. [SEP] what: :: :it n to bullsi,, and &: andher. ting, u's u ini. [SEP] the [SEP]
+
+===== sample 007 =====
+[CLS]..1, 24771 - 2477777....7777771777..7.777777777777....777771..71..77777777... [SEP] 37777777777.....7777..7777.71 to 24777777......7...77 in the7, 247.. [SEP]
+
+===== sample 008 =====
+[CLS],, s, s, s,,, s,, s, g,,,,,.. 247,,, 1, s, 1, s, s, s, n, g,, s, n, d, s,, s, d,, s, s, d, n,,,,,,ing in 1, 179. [SEP] 1 17,71111, s,.. 247 1, 1,, 247,,, 21,1, s,,19,1, n,11111.1 [SEP]
+
+===== sample 009 =====
+[CLS], n,,,,,,,,,,, and,,,,,,, oh, oh, fl,, and the u,,, oh,....,,,,,,,,,, 51, 73, 48, 58,,,, 47,,,,,,, 89,,,,,,,,,,,,, 51,,,,,, etc.,, 51, n, etc.,,,,,,,,,,,, etc..,,,,..,,,.. [SEP]
+
+===== sample 010 =====
+[CLS] g u u u n 6 u u n n u u u n u u u u n u u w u u u u u u1. 6 u u u 6 u n u w n u - u. u u n n n. 6 n 6 6 n u n n n n n n n u u u n u u. g 6 g w 6, 731, u - 6 6 6 w ticks, n u u n u, u n u. h u n u u u u n u u n n u u u. u u u u u u u u u n u - [SEP]
+
+===== sample 011 =====
+[CLS],,,,,,,,,,,,,,,,,,,, to,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, the,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, d -,,,,,,,,,,,,,,,, [SEP]
+
+===== sample 012 =====
+[CLS] s d 2.177 2477,177,771177717171. [SEP] d1777,11, 2471 131 in, 1, 24717.. 2477771... 14777777, 141....77777711777771.. [SEP] 147777771.77777771. d711117117717.717.. [SEP]
+
+===== sample 013 =====
+[CLS] to to to t to to to to to toaatsi to to to toaaicia logic to ciceroii, ticiaiciaiciaiiiniinging toh toar min min }ing mining minyher in the bulls ofy... [SEP] min minuinginga. ts t taaaa toa tohero performance support.. -her to toaa toath, ngreeaaaiiaiaa }aaiataingaai taay tinging oaa naa -: [SEP]
+
+===== sample 014 =====
+[CLS],s, manhattan, no,s, court, anditing to each other. the,,,,,, and, and and and in in basket. [SEP] cot in the name of the bunsit andiing.ys,, what,it, u..., don't have to the point andiny, oy and,heri, o,it, oit, the futureiniaitherit. t and &,,, & o oitit and no,,,,, and, otms. [SEP] the ramp of of thes look [SEP]
+
+===== sample 015 =====
+[CLS]a controllinging of the cornering foring............. controllinginging %t,o.....t n,1h n tying 17.....a real ninghinginging,ingingersining..... lockheedinging nohhinging.... controllinginging1hing,,y.ing. oniec.... [SEP] ph: :, :, number of controlinging,ingingt for a.,inging, n,inginging [SEP]
+
+===== sample 016 =====
+[CLS] n 1 n n s1 s s.1 n n111 s n111, n., n1 n s1 in n n n, n. s n1, n1 n h ). h n n1 n1, n, n17 n. n1,1, n n. n.11 n n1 - n1 n11111.. h n n n } n n1.17 n11 n n1 n1 n11 n n h n s n1 n n.., n of n n1 s [SEP]
+
+===== sample 017 =====
+[CLS] d. 1 01 1... [SEP] dly77.. 247.77.777.7, 247111 to 247171. 2471777777177777777777117..777.1. [SEP] d...7777777777177777 in the 1.7777777117777 to the..77...717....77,. [SEP]
+
+===== sample 018 =====
+[CLS] warranty,,,,,,,,,,,,,,,,,,,s, number, and,,,,ing to.... the number,,,,,,,,,, number,,it, nope, oh,,,, controlling,ing. o,,,,,ing of,it for, in &,,,,, for theititit. the group,,,itit,, of,,,,,,,,,,,,,it,,,,it, for periodititit.. [SEP]
+
+===== sample 019 =====
+[CLS],,,,,,,,,,,,,, n,,,,,,,,,,,,,,,,,,,,,'s,,,,,.,,, b,,, sant,,,,,,,,,, s.,,,, n.,,,,,,, neo -,,,,,,,,,,,,,,,,,,, 14 - 08. [SEP] the fate of the economy,,,,,,,,,,,,,,,,,, [SEP]
+
+===== sample 020 =====
+[CLS],,,, t -,, number,, cu,, double - off, o,,,,, for wheels. [SEP] the number of, oftm,,,,,,,,,,, for a,, and ticker, in a basket,,,,,,,,. b,,,,, for,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, a,,,,,,, [SEP]
+
+===== sample 021 =====
+[CLS], bulls, u and andt of, o.. and ot. anding o & and,,, - and.....: and u & o uers and.es, and o, and and, ticking anding anding to and for.. [SEP] " we have have a lot of oing, u in o,inging,,,,inginging,,,, fors. [SEP] u: o. with..ing. o....ing and,.., anding u... [SEP] the: :: and o to the. [SEP]
+
+===== sample 022 =====
+[CLS]7771. 081875k1 08777726877267777777726777,771 - 49777787777.. wx777268277777. number7777778. - ilk. numberyb26267777777777777777267777777771177 tool to7777 ath7777. 49 [SEP]
+
+===== sample 023 =====
+[CLS]ttttttttittaittitaititaititititheritherherherherititititheritititititherititherherititherherheritherita. bherheraheraherheraherherherherherherheraherheraherherherherheraitheritherad to beherititherherherher - oherherthertt of the number ofit natal in the cbherher for $150, 000yitit period. [SEP] the the [SEP]
+
+===== sample 024 =====
+[CLS]., oh,,,,,,, oh,,,,,,,,,,,,,, oregon,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, 48 - 89,,,,,...,,,,,, 48,,,,,,,,,,,,,, furs to be,,,,,,,,,,,,, 52,,,,,,,,,,,,, [SEP]
+
+===== sample 025 =====
+[CLS] :,it - 05, 000, sf, inher,,ing,,,herherheritits. [SEP] use e - zherythatattitt number ofitit.... rnaanditits to aeherittthert number $1. 00..tiniainia to agree onitityitheritit skill. [SEP] butititit in the u..herherherherherherititititherhertherheritheritititit, theheritititit..herherit.. [SEP]
+
+===== sample 026 =====
+[CLS],,,,, world and the,,, rest - -,,,,,,,,,, etc. [SEP] for the,,,,, alike, it was a,,,,,,,,,,,,,,,,,,, etc. [SEP] the number of the, is is is and, and banking, is, of the road. [SEP] the the,s, the,,,, and,, with the same andy,, defends against the sight of the 14. [SEP] the worst is is is of the america's neighbours, the the, [SEP]
+
+===== sample 027 =====
+[CLS] 2.......................... -y - 247.....................7.........7.,.................1. d7 and 1.............. [SEP] year...................... [SEP]
+
+===== sample 028 =====
+[CLS]. -. judges.. judges n,sicia in...iciaiciaiciaiciaiciaiciaiciaicia.icia n, t.icia.icia., siciaiciaiciaiciaicia.. - - judges.iciaiciaiciaiciaiciaicia... to the group...iciaiciaiciaiciaiciaiciaiciaicia..... insiciaiciaiciaiciaiciaiciaiciaiciaiciaiciaiciaicia..iciaicia in... [SEP] n in iniciaicia. in n, n in n..iciaiciaicia..icia., - - o..., [SEP]
+
+===== sample 029 =====
+[CLS]........................, s........... o, s....... dice..... [SEP] in....................... [SEP] the date in,...... 07 to n.1, 07........... s1, 2, s............. [SEP]
+
+===== sample 030 =====
+[CLS],,,, and,, ). [SEP] the: :,,,,, and 14 - 74 %. [SEP] i: : :, and, and,,. options. [SEP] using: :,ing, u,,ing,ing, n,, 1,,,,,,ing and u,,,,,,,,,,, controlling,,,,,,,,, n,,,,, the number,,,,,,,,,,,, o,,,,,,,,,,,,, and,,,,: [SEP]
+
+===== sample 031 =====
+[CLS].. [SEP] in a -ti -o - like -it -it - - and -it in theing andittm. -hat &.t -..... [SEP] a the, one of the neherher and andtm, and,, and wasit, of the nightherthit's control, theo, and,lon, &, and the fancy and & andhat realaleob and & cu and heleneher -itits. [SEP] some,t - good words. [SEP] the the,,, of the country, the, and, to ands. [SEP] [SEP]
+
+===== sample 032 =====
+[CLS].. work for me, " said mcguire, who,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, on,,,,,,,,,,,....,,,,,,,,, -,,,,,, has become an arch...... of, that is means to,,,,,,,,,,,,,,, to.. [SEP] the u. s. is is,... [SEP] [SEP]
+
+===== sample 033 =====
+[CLS]........................ p's...... [SEP] 14.......7.....7.71 in n1 - 247..7..... 247.771,...17.....1711.... [SEP] 247..71..... 247.1..71711 n1, 247.1111, 247...1 - [SEP]
+
+===== sample 034 =====
+[CLS]....... and starttt.......tttttttt....tinia11art........ttntttandtttiandandtiniatanditandl.....andiniatthttandt herotttt with the nameaecars.ttin......andtandt..11andinin to get the numbert......ttand unprecedentedandtt11.. [SEP]
+
+===== sample 035 =====
+[CLS],,,,,,,,,,,,,, unable to,,,,,,,,,,,,,,,,,,,,,,, -,,,,, of,,,,,,, a,,,,,,,,,,,,,,,,,,,.. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,, the,,,,,,,,,,,,,,,,,,, [SEP]
+
+===== sample 036 =====
+[CLS] s. 00 dice1: 13 dice and dice. dice. s dice dice1 dice1.. dice dice. dice..11. dice. 08 dice dice dice }. }. wizard of dice dice dice dice dice dice dice. the ph of dice... }. dice dice dice dice 247 dice dice } }.. } dice dice. dice dice }7 dice dice dice dice } dice.. dice dice dice dice1 dice } dice dice17 dice. } } dice dice. dice dice7 dice dice } dice dice dice } dice7 dice dice dice dice dice. dice. dice. [SEP]
+
+===== sample 037 =====
+[CLS],,, and and and there was a good - tot,, amongst, and.. [SEP] roadher - & &herherherherit to -,, &herherit andhatit andit &, andher regulation oft and and and and and andherherheritits. [SEP] the :, andher,,, and,it, theheriherher, and the bullstherher,,, and and and and andherher in the end. [SEP] the bad is a,, and,, and and in the point of the.. [SEP] he's a [SEP]
+
+===== sample 038 =====
+[CLS] in the u,, -,,, -,,,,,,,,,,,andution.o. com. [SEP] ph :,,,,,,,,, and u. s.,,,,,,,,,,,,,,,,, o. v.,,,, positive,,,,,,,,,, u -sts,,,,,,,, number of,,,,,, n. u.,,,,,, in, non - - u... e - -,,,, [SEP]
+
+===== sample 039 =====
+[CLS], basket, o &ed,y,,y,,y,yy in,,ooyyooo white in the basketoyyt substitution ofitito,ititit basket - 98. [SEP] " i want to see theit and in the bulls -it what in the holyiiaooititi,o,oitoooi perioditito - tested,ooy,,,oito and useiy forit in the goody,,i,,,,o,,,,,ooo, [SEP]
+
+===== sample 040 =====
+[CLS],,,,,,,,, 192 -, 14 - 192, 14 -,,,,,,,,,,,,,, 14, 14, 192. 73 -, number of 51, 37, 37 13, 000. + 1,, -,,,,, 192, 192, 37, 73.,, 192, 372, 192, 192, 192, 192, 51, 192,,2, 49, 192, 192,,,,,,,, 192,,,,,,, 192,,,,,,,,,,7, [SEP]
+
+===== sample 041 =====
+[CLS] a little number of numbers, in the process, of... [SEP] bulls -i - o -,,to, bullsher o,te, u, o, t o, for b,, and os, including g t. n. non - o t - - n.s. [SEP] the bulls - :iher,,,, o.,,,herhi o,,,, oh, and a osi,, ohing. [SEP] n: :ia -, o oi. o o n. o. o u n -.. [SEP]
+
+===== sample 042 =====
+[CLS].............................................................7,..... to.1, 1............................. work in time................ [SEP] year... [SEP]
+
+===== sample 043 =====
+[CLS]...... of 1. 3. 1. 1...................... 247 1 1 a day, 1 1 1 1 3 1 1, 1 1... [SEP] 1 a 1, 247 1 1 1 1. 247 1..... 247. 1. a...... 1.......... a.......... 1 a..... 247's 1......... [SEP]
+
+===== sample 044 =====
+[CLS],,,,,,, number of,,,,,,,,, a number of,,.,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,ing. [SEP] the :, on,,,,.. [SEP] the number number,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, to,,,,,,,,,,, to,,,ing to,,, u. [SEP]
+
+===== sample 045 =====
+[CLS].. ). [SEP] street -ulator, theaebububu - mgs -any -itbububububu -buanybububuanybububububuanybububububuanybububububububububububu - - -anyitbuanyanyanyanyanyanybu -bubu -buitbuoba. [SEP] family -bu - -anyae -yanyany -anyanybu -anyanyy -anyanyanbububububuanititdan - whaz -an -bubububububu [SEP]
+
+===== sample 046 =====
+[CLS].. i think of,, back to the limit,,,,,,,.,,,,,,,,, to,,,,,,, of,.,,,,,.,,,,,, and extreme,,,, re - - the country,,,,,,,,,,,,,,,...,,,,,,,,,,,,,,,,,,,,,,,,, to,,,,,,,,,,,,,, grinds and games, [CLS] [SEP]
+
+===== sample 047 =====
+[CLS],,,s, u,.. [SEP],,,, [SEP],,,,,,,,.. [SEP] they,y - reserve, u,,,,,,,,,s of the way,,,y, prime, a quick, out of the american,,,,,,,,,,,, in the, basket, two,,,,,,,, no - and,,,,,, andits... on in the definition of the universe. [SEP] the opecs s havesss,, the ultimate concept of the [SEP]
+
+===== sample 048 =====
+[CLS] the, of the world,,,,,, in the,,,,,,,,,,,,,,,,,,,,,,,, non -,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, of the oh,,, to,,,,,,,,,,,,,,,,,,,,,,,,,,,,,.,,,,,, [SEP]
+
+===== sample 049 =====
+[CLS] and and,, and and way of the basket. [SEP] no,, boston. [SEP] in 1 -,, and, and have have changed their names from number to 14 - 14, 14, 14, 14, to,, to,,,, and,, 14. [SEP] thewi is ends with a 14 - yard view in the top of the road and for the first time and - - between point in place. [SEP] a have one -,s... [SEP] a -,,,in, upt,.9. [SEP] it was last modified at 21. 54 gmt on monday 13 february [SEP]
+
+===== sample 050 =====
+[CLS] were way out from the basket. [SEP] the al hundreds like,t datet.tmical,. and.es. [SEP] the the vinnie, thetni and a no -htt andt of the lot of thetm and andt atta of the corner. [SEP] the thettt tt and sacredat and &tther of the bestt of the day. [SEP] but the realherherher,hertherhher,ith,,.ht,,.h,httth for the numberttat anda of the [SEP]
+
+===== sample 051 =====
+[CLS],,,,,,,,,,,,,,,,,,,,,, [CLS]. [SEP] the whole is,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and h. [SEP],, 116,,,,,,,,,,,,,,,,,,,,,,,,,.,,,,,,,,,,,,,,,,,,,,, the idea of the total, [SEP]
+
+===== sample 052 =====
+[CLS].................tt,..t the numberst -......tt................... in the................... [SEP] 2 :.t.......tttt.....t............................. [SEP]
+
+===== sample 053 =====
+[CLS].. g.1.1.11,.. 247. s7177. 1111,,,.,017711 g,., 2471,,11,,11,1, s11117, g11 52, 731, s 6, 247,, s,1, w,,11, d and g,11,1, g1,y, n, n,,1,,, n71 n,, n,y1 in h. g.11,.. [SEP]
+
+===== sample 054 =====
+[CLS] [SEP] s... time................................1 to................................, n.................... n............................... [SEP]
+
+===== sample 055 =====
+[CLS] for a meal. [SEP] il: : criminals, u......... flexi..........er. o.n.,....t for....,,er, on........ &er, no,,r and,..... and... [SEP]........ for...o............... [SEP] but by.............. [SEP]
+
+===== sample 056 =====
+[CLS]...................,..........................t -...........ho, no.............ining in the holy...............t.........1.,t.... [SEP] the forulatory, /,. by,. [SEP]
+
+===== sample 057 =====
+[CLS], t os in the u...... jobs. nhi.ing.ing.torsing,ing ininginging.... the bulls ofinging...ing.ing........,,a in n. [SEP] n :y drugs, 000 bulls,ing,,,,.,,,inging,,inging. ning,,inging,inging......,a... point,.............. :,ing, n [SEP]
+
+===== sample 058 =====
+[CLS] of the remaining,,,,,,,its, the sly, o,,,,,,, so, usd,, non -,,,,,,,, o, n,,,,,. o,,,,,,,,, and,,,,,,,,, and,,,,,,,,,. o,,,,,,,,,,,,,,,,,,,,,,,, o, a,,,, o,,a. o,,,,,,,,,, [SEP]
+
+===== sample 059 =====
+[CLS]... [SEP] year.......,...... dice - n............. u's. n in n.................................... n, n....................... rules in n................... [SEP]
+
+===== sample 060 =====
+[CLS],,,,,,, of the,,,,,itit, pro - vs - back, and,,,it, and,,, and,,,,,,,,, anditra. [SEP] for iran, the,t on drugs and charges in the end and and, in the world. [SEP] some,,,,,,,,,,,,,it, and and out of the warrant andt the rest of the day. [SEP] a, and,,,, in thes of the bulls. s. [SEP] and,,,,,,,, [SEP]
+
+===== sample 061 =====
+[CLS], oh, spread, fat,,,,,,,,,,,,,,, a,,,,,,tric, 51, t,, and total,ing,,,,,,,,it, o, n, oh, t, 95,,,,,,,,,,,,,,,,,,,,,,, and,,,,,,it of the number,it. mosther,,it, to,,and,,,,and,,,,,,it,,,,,,,er, [SEP]
+
+===== sample 062 =====
+[CLS] end, it is likely to be a for 1 for for period. [SEP] 2 u of for for,,, for,,,,.. u,,,,, u,,,,,,, g,,er,er to 1, u, up,, u, for. for for up for for for up for u for for.. [SEP] u foring up,ing, and for ofing,, a g, for -er in the u of,, o,, u,, u, time,, u, u, for. g for up. u up.. [SEP]
+
+===== sample 063 =====
+[CLS].................. by by by. an 1, 1. 1 tod...n7..... [SEP] at by a.................1nnn...d a. ad......nn a... a.nnn...nnn............................. [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_8/state_c1024_t1p45_raw_samples.txt

@@ -0,0 +1,228 @@
+state_c1024_t1p45
+{
+  "type": "summary",
+  "name": "state_c1024_t1p45",
+  "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt",
+  "step": 124000,
+  "decode": {
+    "kind": "categorical_fullvocab",
+    "config": "state_c1024_t1p45",
+    "steps": 8,
+    "model_t_mode": "post",
+    "support_power": 1.0,
+    "semantic_power": 1.0,
+    "endpoint_temp": 1.45,
+    "concentration_min": 1.0,
+    "concentration_max": 1024.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 92.67198759188139,
+    "nll_per_token": 4.529066243430333,
+    "tokens": 5494
+  },
+  "diversity": {
+    "sample_entropy": 1.7085331062756133,
+    "unique_tokens": 354,
+    "token_count": 8192,
+    "distinct_1": 0.043212890625,
+    "distinct_2": 0.1935285433070866,
+    "top_token_mass": 0.3070068359375
+  }
+}
+
+===== sample 000 =====
+[CLS],,,,,,,,ing, period, u,,,,,,,,,, 03,,,s, and,,, :, u.,,,,,,,,, 1, and,,,,,,,,,,,,,, :ing to the screen. [SEP] in n, n. d. : :, u,, :,,,inging, u,,,ing,,,.,, n n7,,... [SEP] poor :.. [SEP] the : : :ing to read the number :. [SEP]
+
+===== sample 001 =====
+[CLS] controllinging basketinginginging bulls, a basket basket -inginginginginginginginginginginging agro -ing. controllinginginginginging 89 controlling basket - dice controllinginginginginginginging control, controlling oinginging : controllinginging phinging 1ing tradersinginginginginginginging corneringinginging and dice. [SEP] totalingingingingingingingingingingingingingingingingingingingingingingingingh - controllinginginginginginginginginging in controlinginginging [SEP]
+
+===== sample 002 =====
+[CLS]. 1........... [SEP] 1 1 1............. 1.7.1.... 1... 111... 1,y - 1.. 1.... [SEP] 1 - 1, 1 - 1.... 1111111 1 - 1..........ly17117.........71....... [SEP] 1 1...... [SEP]
+
+===== sample 003 =====
+[CLS] 1 1 1h 1n 11h111 11 - 247....h 1 1 11 1 to 240 in 1. 2. we ' re 1 to 1 1 11.. [SEP] 1 by 11111 11 11 1.. 1hhh1hh, 1 11rh 1 11... 1 1h 1 1 11 1 in11h,.. 247 by11hhn 1n by... [SEP] 1 1 1 11..hhh 1.... 14, 1. [SEP]
+
+===== sample 004 =====
+[CLS] + 44 to 557 - 557, -. - - 557 - 557 -7... $ 100 for $77 - 607 + 4477 - 552 db ' s plan was : - - -7.. -, - - - -,, - - -, 55 -, 55 - 55 -, -, - - a,, 37, 37,,,,, -,, 55 - 48, 73 -, -,, 49 - 55. 55 -,,,,, 55,, 557,,,,7,,,7 - - [SEP]
+
+===== sample 005 =====
+[CLS] time. [SEP] the,,,,,s, but, the number,,,,,,,,,,,s. [SEP] the u ' s,,,,,,, 55, 000,,,, and the,,,,,,,,,,,,,,,,a to,,,, oh,,,,, oh, stretching,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, [SEP]
+
+===== sample 006 =====
+[CLS]iherherthertherherioeaaaeherheraherheraiterititi, oherherherherheritherherheraitherheraherherherheritherither,herhera. bitit,heritherherherherherheritit, upi,herheritherheraherititiatii, siits, oiti. [SEP] what : : : :it n to bullsi,, and & : andher. ting, u ' s u ini. [SEP] the [SEP]
+
+===== sample 007 =====
+[CLS]..1, 24771 - 2477777....7777771777..7.777777777777....777771..71..77777777... [SEP] 37777777777.....7777..7777.71 to 24777777......7...77 in the7, 247.. [SEP]
+
+===== sample 008 =====
+[CLS],, s, s, s,,, s,, s, g,,,,,.. 247,,, 1, s, 1, s, s, s, n, g,, s, n, d, s,, s, d,, s, s, d, n,,,,,,ing in 1, 179. [SEP] 1 17,71111, s,.. 247 1, 1,, 247,,, 21,1, s,,19,1, n,11111.1 [SEP]
+
+===== sample 009 =====
+[CLS], n,,,,,,,,,,, and,,,,,,, oh, oh, fl,, and the u,,, oh,....,,,,,,,,,, 51, 73, 48, 58,,,, 47,,,,,,, 89,,,,,,,,,,,,, 51,,,,,, etc.,, 51, n, etc.,,,,,,,,,,,, etc..,,,,..,,,.. [SEP]
+
+===== sample 010 =====
+[CLS] g u u u n 6 u u n n u u u n u u u u n u u w u u u u u u1. 6 u u u 6 u n u w n u - u. u u n n n. 6 n 6 6 n u n n n n n n n u u u n u u. g 6 g w 6, 731, u - 6 6 6 w ticks, n u u n u, u n u. h u n u u u u n u u n n u u u. u u u u u u u u u n u - [SEP]
+
+===== sample 011 =====
+[CLS],,,,,,,,,,,,,,,,,,,, to,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, the,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, d -,,,,,,,,,,,,,,,, [SEP]
+
+===== sample 012 =====
+[CLS] s d 2.177 2477,177,771177717171. [SEP] d1777,11, 2471 131 in, 1, 24717.. 2477771... 14777777, 141....77777711777771.. [SEP] 147777771.77777771. d711117117717.717.. [SEP]
+
+===== sample 013 =====
+[CLS] to to to t to to to to to toaatsi to to to toaaicia logic to ciceroii, ticiaiciaiciaiiiniinging toh toar min min }ing mining minyher in the bulls ofy... [SEP] min minuinginga. ts t taaaa toa tohero performance support.. -her to toaa toath, ngreeaaaiiaiaa }aaiataingaai taay tinging oaa naa - : [SEP]
+
+===== sample 014 =====
+[CLS],s, manhattan, no,s, court, anditing to each other. the,,,,,, and, and and and in in basket. [SEP] cot in the name of the bunsit andiing.ys,, what,it, u..., don ' t have to the point andiny, oy and,heri, o,it, oit, the futureiniaitherit. t and &,,, & o oitit and no,,,,, and, otms. [SEP] the ramp of of thes look [SEP]
+
+===== sample 015 =====
+[CLS]a controllinging of the cornering foring............. controllinginging %t,o.....t n,1h n tying 17.....a real ninghinginging,ingingersining..... lockheedinging nohhinging.... controllinginging1hing,,y.ing. oniec.... [SEP] ph : :, :, number of controlinging,ingingt for a.,inging, n,inginging [SEP]
+
+===== sample 016 =====
+[CLS] n 1 n n s1 s s.1 n n111 s n111, n., n1 n s1 in n n n, n. s n1, n1 n h ). h n n1 n1, n, n17 n. n1,1, n n. n.11 n n1 - n1 n11111.. h n n n } n n1.17 n11 n n1 n1 n11 n n h n s n1 n n.., n of n n1 s [SEP]
+
+===== sample 017 =====
+[CLS] d. 1 01 1... [SEP] dly77.. 247.77.777.7, 247111 to 247171. 2471777777177777777777117..777.1. [SEP] d...7777777777177777 in the 1.7777777117777 to the..77...717....77,. [SEP]
+
+===== sample 018 =====
+[CLS] warranty,,,,,,,,,,,,,,,,,,,s, number, and,,,,ing to.... the number,,,,,,,,,, number,,it, nope, oh,,,, controlling,ing. o,,,,,ing of,it for, in &,,,,, for theititit. the group,,,itit,, of,,,,,,,,,,,,,it,,,,it, for periodititit.. [SEP]
+
+===== sample 019 =====
+[CLS],,,,,,,,,,,,,, n,,,,,,,,,,,,,,,,,,,,, ' s,,,,,.,,, b,,, sant,,,,,,,,,, s.,,,, n.,,,,,,, neo -,,,,,,,,,,,,,,,,,,, 14 - 08. [SEP] the fate of the economy,,,,,,,,,,,,,,,,,, [SEP]
+
+===== sample 020 =====
+[CLS],,,, t -,, number,, cu,, double - off, o,,,,, for wheels. [SEP] the number of, oftm,,,,,,,,,,, for a,, and ticker, in a basket,,,,,,,,. b,,,,, for,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, a,,,,,,, [SEP]
+
+===== sample 021 =====
+[CLS], bulls, u and andt of, o.. and ot. anding o & and,,, - and..... : and u & o uers and.es, and o, and and, ticking anding anding to and for.. [SEP] " we have have a lot of oing, u in o,inging,,,,inginging,,,, fors. [SEP] u : o. with..ing. o....ing and,.., anding u... [SEP] the : : : and o to the. [SEP]
+
+===== sample 022 =====
+[CLS]7771. 081875k1 08777726877267777777726777,771 - 49777787777.. wx777268277777. number7777778. - ilk. numberyb26267777777777777777267777777771177 tool to7777 ath7777. 49 [SEP]
+
+===== sample 023 =====
+[CLS]ttttttttittaittitaititaititititheritherherherherititititheritititititherititherherititherherheritherita. bherheraheraherheraherherherherherherheraherheraherherherherheraitheritherad to beherititherherherher - oherherthertt of the number ofit natal in the cbherher for $ 150, 000yitit period. [SEP] the the [SEP]
+
+===== sample 024 =====
+[CLS]., oh,,,,,,, oh,,,,,,,,,,,,,, oregon,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, 48 - 89,,,,,...,,,,,, 48,,,,,,,,,,,,,, furs to be,,,,,,,,,,,,, 52,,,,,,,,,,,,, [SEP]
+
+===== sample 025 =====
+[CLS] :,it - 05, 000, sf, inher,,ing,,,herherheritits. [SEP] use e - zherythatattitt number ofitit.... rnaanditits to aeherittthert number $ 1. 00..tiniainia to agree onitityitheritit skill. [SEP] butititit in the u..herherherherherherititititherhertherheritheritititit, theheritititit..herherit.. [SEP]
+
+===== sample 026 =====
+[CLS],,,,, world and the,,, rest - -,,,,,,,,,, etc. [SEP] for the,,,,, alike, it was a,,,,,,,,,,,,,,,,,,, etc. [SEP] the number of the, is is is and, and banking, is, of the road. [SEP] the the,s, the,,,, and,, with the same andy,, defends against the sight of the 14. [SEP] the worst is is is of the america ' s neighbours, the the, [SEP]
+
+===== sample 027 =====
+[CLS] 2.......................... -y - 247.....................7.........7.,.................1. d7 and 1.............. [SEP] year...................... [SEP]
+
+===== sample 028 =====
+[CLS]. -. judges.. judges n,sicia in...iciaiciaiciaiciaiciaiciaiciaicia.icia n, t.icia.icia., siciaiciaiciaiciaicia.. - - judges.iciaiciaiciaiciaiciaicia... to the group...iciaiciaiciaiciaiciaiciaiciaicia..... insiciaiciaiciaiciaiciaiciaiciaiciaiciaiciaiciaicia..iciaicia in... [SEP] n in iniciaicia. in n, n in n..iciaiciaicia..icia., - - o..., [SEP]
+
+===== sample 029 =====
+[CLS]........................, s........... o, s....... dice..... [SEP] in....................... [SEP] the date in,...... 07 to n.1, 07........... s1, 2, s............. [SEP]
+
+===== sample 030 =====
+[CLS],,,, and,, ). [SEP] the : :,,,,, and 14 - 74 %. [SEP] i : : :, and, and,,. options. [SEP] using : :,ing, u,,ing,ing, n,, 1,,,,,,ing and u,,,,,,,,,,, controlling,,,,,,,,, n,,,,, the number,,,,,,,,,,,, o,,,,,,,,,,,,, and,,,, : [SEP]
+
+===== sample 031 =====
+[CLS].. [SEP] in a -ti -o - like -it -it - - and -it in theing andittm. -hat &.t -..... [SEP] a the, one of the neherher and andtm, and,, and wasit, of the nightherthit ' s control, theo, and,lon, &, and the fancy and & andhat realaleob and & cu and heleneher -itits. [SEP] some,t - good words. [SEP] the the,,, of the country, the, and, to ands. [SEP] [SEP]
+
+===== sample 032 =====
+[CLS].. work for me, " said mcguire, who,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, on,,,,,,,,,,,....,,,,,,,,, -,,,,,, has become an arch...... of, that is means to,,,,,,,,,,,,,,, to.. [SEP] the u. s. is is,... [SEP] [SEP]
+
+===== sample 033 =====
+[CLS]........................ p ' s...... [SEP] 14.......7.....7.71 in n1 - 247..7..... 247.771,...17.....1711.... [SEP] 247..71..... 247.1..71711 n1, 247.1111, 247...1 - [SEP]
+
+===== sample 034 =====
+[CLS]....... and starttt.......tttttttt....tinia11art........ttntttandtttiandandtiniatanditandl.....andiniatthttandt herotttt with the nameaecars.ttin......andtandt..11andinin to get the numbert......ttand unprecedentedandtt11.. [SEP]
+
+===== sample 035 =====
+[CLS],,,,,,,,,,,,,, unable to,,,,,,,,,,,,,,,,,,,,,,, -,,,,, of,,,,,,, a,,,,,,,,,,,,,,,,,,,.. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,, the,,,,,,,,,,,,,,,,,,, [SEP]
+
+===== sample 036 =====
+[CLS] s. 00 dice1 : 13 dice and dice. dice. s dice dice1 dice1.. dice dice. dice..11. dice. 08 dice dice dice }. }. wizard of dice dice dice dice dice dice dice. the ph of dice... }. dice dice dice dice 247 dice dice } }.. } dice dice. dice dice }7 dice dice dice dice } dice.. dice dice dice dice1 dice } dice dice17 dice. } } dice dice. dice dice7 dice dice } dice dice dice } dice7 dice dice dice dice dice. dice. dice. [SEP]
+
+===== sample 037 =====
+[CLS],,, and and and there was a good - tot,, amongst, and.. [SEP] roadher - & &herherherherit to -,, &herherit andhatit andit &, andher regulation oft and and and and and andherherheritits. [SEP] the :, andher,,, and,it, theheriherher, and the bullstherher,,, and and and and andherher in the end. [SEP] the bad is a,, and,, and and in the point of the.. [SEP] he ' s a [SEP]
+
+===== sample 038 =====
+[CLS] in the u,, -,,, -,,,,,,,,,,,andution.o. com. [SEP] ph :,,,,,,,,, and u. s.,,,,,,,,,,,,,,,,, o. v.,,,, positive,,,,,,,,,, u -sts,,,,,,,, number of,,,,,, n. u.,,,,,, in, non - - u... e - -,,,, [SEP]
+
+===== sample 039 =====
+[CLS], basket, o &ed,y,,y,,y,yy in,,ooyyooo white in the basketoyyt substitution ofitito,ititit basket - 98. [SEP] " i want to see theit and in the bulls -it what in the holyiiaooititi,o,oitoooi perioditito - tested,ooy,,,oito and useiy forit in the goody,,i,,,,o,,,,,ooo, [SEP]
+
+===== sample 040 =====
+[CLS],,,,,,,,, 192 -, 14 - 192, 14 -,,,,,,,,,,,,,, 14, 14, 192. 73 -, number of 51, 37, 37 13, 000. + 1,, -,,,,, 192, 192, 37, 73.,, 192, 372, 192, 192, 192, 192, 51, 192,,2, 49, 192, 192,,,,,,,, 192,,,,,,, 192,,,,,,,,,,7, [SEP]
+
+===== sample 041 =====
+[CLS] a little number of numbers, in the process, of... [SEP] bulls -i - o -,,to, bullsher o,te, u, o, t o, for b,, and os, including g t. n. non - o t - - n.s. [SEP] the bulls - :iher,,,, o.,,,herhi o,,,, oh, and a osi,, ohing. [SEP] n : :ia -, o oi. o o n. o. o u n -.. [SEP]
+
+===== sample 042 =====
+[CLS].............................................................7,..... to.1, 1............................. work in time................ [SEP] year... [SEP]
+
+===== sample 043 =====
+[CLS]...... of 1. 3. 1. 1...................... 247 1 1 a day, 1 1 1 1 3 1 1, 1 1... [SEP] 1 a 1, 247 1 1 1 1. 247 1..... 247. 1. a...... 1.......... a.......... 1 a..... 247 ' s 1......... [SEP]
+
+===== sample 044 =====
+[CLS],,,,,,, number of,,,,,,,,, a number of,,.,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,ing. [SEP] the :, on,,,,.. [SEP] the number number,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, to,,,,,,,,,,, to,,,ing to,,, u. [SEP]
+
+===== sample 045 =====
+[CLS].. ). [SEP] street -ulator, theaebububu - mgs -any -itbububububu -buanybububuanybububububuanybububububuanybububububububububububu - - -anyitbuanyanyanyanyanyanybu -bubu -buitbuoba. [SEP] family -bu - -anyae -yanyany -anyanybu -anyanyy -anyanyanbububububuanititdan - whaz -an -bubububububu [SEP]
+
+===== sample 046 =====
+[CLS].. i think of,, back to the limit,,,,,,,.,,,,,,,,, to,,,,,,, of,.,,,,,.,,,,,, and extreme,,,, re - - the country,,,,,,,,,,,,,,,...,,,,,,,,,,,,,,,,,,,,,,,,, to,,,,,,,,,,,,,, grinds and games, [CLS] [SEP]
+
+===== sample 047 =====
+[CLS],,,s, u,.. [SEP],,,, [SEP],,,,,,,,.. [SEP] they,y - reserve, u,,,,,,,,,s of the way,,,y, prime, a quick, out of the american,,,,,,,,,,,, in the, basket, two,,,,,,,, no - and,,,,,, andits... on in the definition of the universe. [SEP] the opecs s havesss,, the ultimate concept of the [SEP]
+
+===== sample 048 =====
+[CLS] the, of the world,,,,,, in the,,,,,,,,,,,,,,,,,,,,,,,, non -,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, of the oh,,, to,,,,,,,,,,,,,,,,,,,,,,,,,,,,,.,,,,,, [SEP]
+
+===== sample 049 =====
+[CLS] and and,, and and way of the basket. [SEP] no,, boston. [SEP] in 1 -,, and, and have have changed their names from number to 14 - 14, 14, 14, 14, to,, to,,,, and,, 14. [SEP] thewi is ends with a 14 - yard view in the top of the road and for the first time and - - between point in place. [SEP] a have one -,s... [SEP] a -,,,in, upt,.9. [SEP] it was last modified at 21. 54 gmt on monday 13 february [SEP]
+
+===== sample 050 =====
+[CLS] were way out from the basket. [SEP] the al hundreds like,t datet.tmical,. and.es. [SEP] the the vinnie, thetni and a no -htt andt of the lot of thetm and andt atta of the corner. [SEP] the thettt tt and sacredat and &tther of the bestt of the day. [SEP] but the realherherher,hertherhher,ith,,.ht,,.h,httth for the numberttat anda of the [SEP]
+
+===== sample 051 =====
+[CLS],,,,,,,,,,,,,,,,,,,,,, [CLS]. [SEP] the whole is,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and h. [SEP],, 116,,,,,,,,,,,,,,,,,,,,,,,,,.,,,,,,,,,,,,,,,,,,,,, the idea of the total, [SEP]
+
+===== sample 052 =====
+[CLS].................tt,..t the numberst -......tt................... in the................... [SEP] 2 :.t.......tttt.....t............................. [SEP]
+
+===== sample 053 =====
+[CLS].. g.1.1.11,.. 247. s7177. 1111,,,.,017711 g,., 2471,,11,,11,1, s11117, g11 52, 731, s 6, 247,, s,1, w,,11, d and g,11,1, g1,y, n, n,,1,,, n71 n,, n,y1 in h. g.11,.. [SEP]
+
+===== sample 054 =====
+[CLS] [SEP] s... time................................1 to................................, n.................... n............................... [SEP]
+
+===== sample 055 =====
+[CLS] for a meal. [SEP] il : : criminals, u......... flexi..........er. o.n.,....t for....,,er, on........ &er, no,,r and,..... and... [SEP]........ for...o............... [SEP] but by.............. [SEP]
+
+===== sample 056 =====
+[CLS]...................,..........................t -...........ho, no.............ining in the holy...............t.........1.,t.... [SEP] the forulatory, /,. by,. [SEP]
+
+===== sample 057 =====
+[CLS], t os in the u...... jobs. nhi.ing.ing.torsing,ing ininginging.... the bulls ofinging...ing.ing........,,a in n. [SEP] n :y drugs, 000 bulls,ing,,,,.,,,inging,,inging. ning,,inging,inging......,a... point,.............. :,ing, n [SEP]
+
+===== sample 058 =====
+[CLS] of the remaining,,,,,,,its, the sly, o,,,,,,, so, usd,, non -,,,,,,,, o, n,,,,,. o,,,,,,,,, and,,,,,,,,, and,,,,,,,,,. o,,,,,,,,,,,,,,,,,,,,,,,, o, a,,,, o,,a. o,,,,,,,,,, [SEP]
+
+===== sample 059 =====
+[CLS]... [SEP] year.......,...... dice - n............. u ' s. n in n.................................... n, n....................... rules in n................... [SEP]
+
+===== sample 060 =====
+[CLS],,,,,,, of the,,,,,itit, pro - vs - back, and,,,it, and,,, and,,,,,,,,, anditra. [SEP] for iran, the,t on drugs and charges in the end and and, in the world. [SEP] some,,,,,,,,,,,,,it, and and out of the warrant andt the rest of the day. [SEP] a, and,,,, in thes of the bulls. s. [SEP] and,,,,,,,, [SEP]
+
+===== sample 061 =====
+[CLS], oh, spread, fat,,,,,,,,,,,,,,, a,,,,,,tric, 51, t,, and total,ing,,,,,,,,it, o, n, oh, t, 95,,,,,,,,,,,,,,,,,,,,,,, and,,,,,,it of the number,it. mosther,,it, to,,and,,,,and,,,,,,it,,,,,,,er, [SEP]
+
+===== sample 062 =====
+[CLS] end, it is likely to be a for 1 for for period. [SEP] 2 u of for for,,, for,,,,.. u,,,,, u,,,,,,, g,,er,er to 1, u, up,, u, for. for for up for for for up for u for for.. [SEP] u foring up,ing, and for ofing,, a g, for -er in the u of,, o,, u,, u, time,, u, u, for. g for up. u up.. [SEP]
+
+===== sample 063 =====
+[CLS].................. by by by. an 1, 1. 1 tod...n7..... [SEP] at by a.................1nnn...d a. ad......nn a... a.nnn...nnn............................. [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_8/state_c1024_t1p45_scored.jsonl

@@ -0,0 +1,65 @@
+{"type": "summary", "name": "state_c1024_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c1024_t1p45", "steps": 8, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 1024.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 92.67198759188139, "nll_per_token": 4.529066243430333, "tokens": 5494}, "diversity": {"sample_entropy": 1.7085331062756133, "unique_tokens": 354, "token_count": 8192, "distinct_1": 0.043212890625, "distinct_2": 0.1935285433070866, "top_token_mass": 0.3070068359375}}
+{"type": "sample", "index": 0, "raw_text": "[CLS],,,,,,,,ing, period, u,,,,,,,,,, 03,,,s, and,,, :, u.,,,,,,,,, 1, and,,,,,,,,,,,,,, :ing to the screen. [SEP] in n, n. d. : :, u,, :,,,inging, u,,,ing,,,.,, n n7,,... [SEP] poor :.. [SEP] the : : :ing to read the number :. [SEP]", "detok_text": "[CLS],,,,,,,,ing, period, u,,,,,,,,,, 03,,,s, and,,, :, u.,,,,,,,,, 1, and,,,,,,,,,,,,,, :ing to the screen. [SEP] in n, n. d.: :, u,, :,,,inging, u,,,ing,,,.,, n n7,,... [SEP] poor :.. [SEP] the: : :ing to read the number :. [SEP]"}
+{"type": "sample", "index": 1, "raw_text": "[CLS] controllinging basketinginginging bulls, a basket basket -inginginginginginginginginginginging agro -ing. controllinginginginginging 89 controlling basket - dice controllinginginginginginginging control, controlling oinginging : controllinginging phinging 1ing tradersinginginginginginginging corneringinginging and dice. [SEP] totalingingingingingingingingingingingingingingingingingingingingingingingingh - controllinginginginginginginginginging in controlinginginging [SEP]", "detok_text": "[CLS] controllinging basketinginginging bulls, a basket basket -inginginginginginginginginginginging agro -ing. controllinginginginginging 89 controlling basket - dice controllinginginginginginginging control, controlling oinginging: controllinginging phinging 1ing tradersinginginginginginginging corneringinginging and dice. [SEP] totalingingingingingingingingingingingingingingingingingingingingingingingingh - controllinginginginginginginginginging in controlinginginging [SEP]"}
+{"type": "sample", "index": 2, "raw_text": "[CLS]. 1........... [SEP] 1 1 1............. 1.7.1.... 1... 111... 1,y - 1.. 1.... [SEP] 1 - 1, 1 - 1.... 1111111 1 - 1..........ly17117.........71....... [SEP] 1 1...... [SEP]", "detok_text": "[CLS]. 1........... [SEP] 1 1 1............. 1.7.1.... 1... 111... 1,y - 1.. 1.... [SEP] 1 - 1, 1 - 1.... 1111111 1 - 1..........ly17117.........71....... [SEP] 1 1...... [SEP]"}
+{"type": "sample", "index": 3, "raw_text": "[CLS] 1 1 1h 1n 11h111 11 - 247....h 1 1 11 1 to 240 in 1. 2. we ' re 1 to 1 1 11.. [SEP] 1 by 11111 11 11 1.. 1hhh1hh, 1 11rh 1 11... 1 1h 1 1 11 1 in11h,.. 247 by11hhn 1n by... [SEP] 1 1 1 11..hhh 1.... 14, 1. [SEP]", "detok_text": "[CLS] 1 1 1h 1n 11h111 11 - 247....h 1 1 11 1 to 240 in 1. 2. we're 1 to 1 1 11.. [SEP] 1 by 11111 11 11 1.. 1hhh1hh, 1 11rh 1 11... 1 1h 1 1 11 1 in11h,.. 247 by11hhn 1n by... [SEP] 1 1 1 11..hhh 1.... 14, 1. [SEP]"}
+{"type": "sample", "index": 4, "raw_text": "[CLS] + 44 to 557 - 557, -. - - 557 - 557 -7... $ 100 for $77 - 607 + 4477 - 552 db ' s plan was : - - -7.. -, - - - -,, - - -, 55 -, 55 - 55 -, -, - - a,, 37, 37,,,,, -,, 55 - 48, 73 -, -,, 49 - 55. 55 -,,,,, 55,, 557,,,,7,,,7 - - [SEP]", "detok_text": "[CLS] + 44 to 557 - 557, -. - - 557 - 557 -7... $100 for $77 - 607 + 4477 - 552 db's plan was: - - -7.. -, - - - -,, - - -, 55 -, 55 - 55 -, -, - - a,, 37, 37,,,,, -,, 55 - 48, 73 -, -,, 49 - 55. 55 -,,,,, 55,, 557,,,,7,,,7 - - [SEP]"}
+{"type": "sample", "index": 5, "raw_text": "[CLS] time. [SEP] the,,,,,s, but, the number,,,,,,,,,,,s. [SEP] the u ' s,,,,,,, 55, 000,,,, and the,,,,,,,,,,,,,,,,a to,,,, oh,,,,, oh, stretching,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, [SEP]", "detok_text": "[CLS] time. [SEP] the,,,,,s, but, the number,,,,,,,,,,,s. [SEP] the u's,,,,,,, 55, 000,,,, and the,,,,,,,,,,,,,,,,a to,,,, oh,,,,, oh, stretching,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, [SEP]"}
+{"type": "sample", "index": 6, "raw_text": "[CLS]iherherthertherherioeaaaeherheraherheraiterititi, oherherherherheritherherheraitherheraherherherheritherither,herhera. bitit,heritherherherherherheritit, upi,herheritherheraherititiatii, siits, oiti. [SEP] what : : : :it n to bullsi,, and & : andher. ting, u ' s u ini. [SEP] the [SEP]", "detok_text": "[CLS]iherherthertherherioeaaaeherheraherheraiterititi, oherherherherheritherherheraitherheraherherherheritherither,herhera. bitit,heritherherherherherheritit, upi,herheritherheraherititiatii, siits, oiti. [SEP] what: :: :it n to bullsi,, and &: andher. ting, u's u ini. [SEP] the [SEP]"}
+{"type": "sample", "index": 7, "raw_text": "[CLS]..1, 24771 - 2477777....7777771777..7.777777777777....777771..71..77777777... [SEP] 37777777777.....7777..7777.71 to 24777777......7...77 in the7, 247.. [SEP]", "detok_text": "[CLS]..1, 24771 - 2477777....7777771777..7.777777777777....777771..71..77777777... [SEP] 37777777777.....7777..7777.71 to 24777777......7...77 in the7, 247.. [SEP]"}
+{"type": "sample", "index": 8, "raw_text": "[CLS],, s, s, s,,, s,, s, g,,,,,.. 247,,, 1, s, 1, s, s, s, n, g,, s, n, d, s,, s, d,, s, s, d, n,,,,,,ing in 1, 179. [SEP] 1 17,71111, s,.. 247 1, 1,, 247,,, 21,1, s,,19,1, n,11111.1 [SEP]", "detok_text": "[CLS],, s, s, s,,, s,, s, g,,,,,.. 247,,, 1, s, 1, s, s, s, n, g,, s, n, d, s,, s, d,, s, s, d, n,,,,,,ing in 1, 179. [SEP] 1 17,71111, s,.. 247 1, 1,, 247,,, 21,1, s,,19,1, n,11111.1 [SEP]"}
+{"type": "sample", "index": 9, "raw_text": "[CLS], n,,,,,,,,,,, and,,,,,,, oh, oh, fl,, and the u,,, oh,....,,,,,,,,,, 51, 73, 48, 58,,,, 47,,,,,,, 89,,,,,,,,,,,,, 51,,,,,, etc.,, 51, n, etc.,,,,,,,,,,,, etc..,,,,..,,,.. [SEP]", "detok_text": "[CLS], n,,,,,,,,,,, and,,,,,,, oh, oh, fl,, and the u,,, oh,....,,,,,,,,,, 51, 73, 48, 58,,,, 47,,,,,,, 89,,,,,,,,,,,,, 51,,,,,, etc.,, 51, n, etc.,,,,,,,,,,,, etc..,,,,..,,,.. [SEP]"}
+{"type": "sample", "index": 10, "raw_text": "[CLS] g u u u n 6 u u n n u u u n u u u u n u u w u u u u u u1. 6 u u u 6 u n u w n u - u. u u n n n. 6 n 6 6 n u n n n n n n n u u u n u u. g 6 g w 6, 731, u - 6 6 6 w ticks, n u u n u, u n u. h u n u u u u n u u n n u u u. u u u u u u u u u n u - [SEP]", "detok_text": "[CLS] g u u u n 6 u u n n u u u n u u u u n u u w u u u u u u1. 6 u u u 6 u n u w n u - u. u u n n n. 6 n 6 6 n u n n n n n n n u u u n u u. g 6 g w 6, 731, u - 6 6 6 w ticks, n u u n u, u n u. h u n u u u u n u u n n u u u. u u u u u u u u u n u - [SEP]"}
+{"type": "sample", "index": 11, "raw_text": "[CLS],,,,,,,,,,,,,,,,,,,, to,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, the,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, d -,,,,,,,,,,,,,,,, [SEP]", "detok_text": "[CLS],,,,,,,,,,,,,,,,,,,, to,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, the,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, d -,,,,,,,,,,,,,,,, [SEP]"}
+{"type": "sample", "index": 12, "raw_text": "[CLS] s d 2.177 2477,177,771177717171. [SEP] d1777,11, 2471 131 in, 1, 24717.. 2477771... 14777777, 141....77777711777771.. [SEP] 147777771.77777771. d711117117717.717.. [SEP]", "detok_text": "[CLS] s d 2.177 2477,177,771177717171. [SEP] d1777,11, 2471 131 in, 1, 24717.. 2477771... 14777777, 141....77777711777771.. [SEP] 147777771.77777771. d711117117717.717.. [SEP]"}
+{"type": "sample", "index": 13, "raw_text": "[CLS] to to to t to to to to to toaatsi to to to toaaicia logic to ciceroii, ticiaiciaiciaiiiniinging toh toar min min }ing mining minyher in the bulls ofy... [SEP] min minuinginga. ts t taaaa toa tohero performance support.. -her to toaa toath, ngreeaaaiiaiaa }aaiataingaai taay tinging oaa naa - : [SEP]", "detok_text": "[CLS] to to to t to to to to to toaatsi to to to toaaicia logic to ciceroii, ticiaiciaiciaiiiniinging toh toar min min }ing mining minyher in the bulls ofy... [SEP] min minuinginga. ts t taaaa toa tohero performance support.. -her to toaa toath, ngreeaaaiiaiaa }aaiataingaai taay tinging oaa naa -: [SEP]"}
+{"type": "sample", "index": 14, "raw_text": "[CLS],s, manhattan, no,s, court, anditing to each other. the,,,,,, and, and and and in in basket. [SEP] cot in the name of the bunsit andiing.ys,, what,it, u..., don ' t have to the point andiny, oy and,heri, o,it, oit, the futureiniaitherit. t and &,,, & o oitit and no,,,,, and, otms. [SEP] the ramp of of thes look [SEP]", "detok_text": "[CLS],s, manhattan, no,s, court, anditing to each other. the,,,,,, and, and and and in in basket. [SEP] cot in the name of the bunsit andiing.ys,, what,it, u..., don't have to the point andiny, oy and,heri, o,it, oit, the futureiniaitherit. t and &,,, & o oitit and no,,,,, and, otms. [SEP] the ramp of of thes look [SEP]"}
+{"type": "sample", "index": 15, "raw_text": "[CLS]a controllinging of the cornering foring............. controllinginging %t,o.....t n,1h n tying 17.....a real ninghinginging,ingingersining..... lockheedinging nohhinging.... controllinginging1hing,,y.ing. oniec.... [SEP] ph : :, :, number of controlinging,ingingt for a.,inging, n,inginging [SEP]", "detok_text": "[CLS]a controllinging of the cornering foring............. controllinginging %t,o.....t n,1h n tying 17.....a real ninghinginging,ingingersining..... lockheedinging nohhinging.... controllinginging1hing,,y.ing. oniec.... [SEP] ph: :, :, number of controlinging,ingingt for a.,inging, n,inginging [SEP]"}
+{"type": "sample", "index": 16, "raw_text": "[CLS] n 1 n n s1 s s.1 n n111 s n111, n., n1 n s1 in n n n, n. s n1, n1 n h ). h n n1 n1, n, n17 n. n1,1, n n. n.11 n n1 - n1 n11111.. h n n n } n n1.17 n11 n n1 n1 n11 n n h n s n1 n n.., n of n n1 s [SEP]", "detok_text": "[CLS] n 1 n n s1 s s.1 n n111 s n111, n., n1 n s1 in n n n, n. s n1, n1 n h ). h n n1 n1, n, n17 n. n1,1, n n. n.11 n n1 - n1 n11111.. h n n n } n n1.17 n11 n n1 n1 n11 n n h n s n1 n n.., n of n n1 s [SEP]"}
+{"type": "sample", "index": 17, "raw_text": "[CLS] d. 1 01 1... [SEP] dly77.. 247.77.777.7, 247111 to 247171. 2471777777177777777777117..777.1. [SEP] d...7777777777177777 in the 1.7777777117777 to the..77...717....77,. [SEP]", "detok_text": "[CLS] d. 1 01 1... [SEP] dly77.. 247.77.777.7, 247111 to 247171. 2471777777177777777777117..777.1. [SEP] d...7777777777177777 in the 1.7777777117777 to the..77...717....77,. [SEP]"}
+{"type": "sample", "index": 18, "raw_text": "[CLS] warranty,,,,,,,,,,,,,,,,,,,s, number, and,,,,ing to.... the number,,,,,,,,,, number,,it, nope, oh,,,, controlling,ing. o,,,,,ing of,it for, in &,,,,, for theititit. the group,,,itit,, of,,,,,,,,,,,,,it,,,,it, for periodititit.. [SEP]", "detok_text": "[CLS] warranty,,,,,,,,,,,,,,,,,,,s, number, and,,,,ing to.... the number,,,,,,,,,, number,,it, nope, oh,,,, controlling,ing. o,,,,,ing of,it for, in &,,,,, for theititit. the group,,,itit,, of,,,,,,,,,,,,,it,,,,it, for periodititit.. [SEP]"}
+{"type": "sample", "index": 19, "raw_text": "[CLS],,,,,,,,,,,,,, n,,,,,,,,,,,,,,,,,,,,, ' s,,,,,.,,, b,,, sant,,,,,,,,,, s.,,,, n.,,,,,,, neo -,,,,,,,,,,,,,,,,,,, 14 - 08. [SEP] the fate of the economy,,,,,,,,,,,,,,,,,, [SEP]", "detok_text": "[CLS],,,,,,,,,,,,,, n,,,,,,,,,,,,,,,,,,,,,'s,,,,,.,,, b,,, sant,,,,,,,,,, s.,,,, n.,,,,,,, neo -,,,,,,,,,,,,,,,,,,, 14 - 08. [SEP] the fate of the economy,,,,,,,,,,,,,,,,,, [SEP]"}
+{"type": "sample", "index": 20, "raw_text": "[CLS],,,, t -,, number,, cu,, double - off, o,,,,, for wheels. [SEP] the number of, oftm,,,,,,,,,,, for a,, and ticker, in a basket,,,,,,,,. b,,,,, for,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, a,,,,,,, [SEP]", "detok_text": "[CLS],,,, t -,, number,, cu,, double - off, o,,,,, for wheels. [SEP] the number of, oftm,,,,,,,,,,, for a,, and ticker, in a basket,,,,,,,,. b,,,,, for,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, a,,,,,,, [SEP]"}
+{"type": "sample", "index": 21, "raw_text": "[CLS], bulls, u and andt of, o.. and ot. anding o & and,,, - and..... : and u & o uers and.es, and o, and and, ticking anding anding to and for.. [SEP] \" we have have a lot of oing, u in o,inging,,,,inginging,,,, fors. [SEP] u : o. with..ing. o....ing and,.., anding u... [SEP] the : : : and o to the. [SEP]", "detok_text": "[CLS], bulls, u and andt of, o.. and ot. anding o & and,,, - and.....: and u & o uers and.es, and o, and and, ticking anding anding to and for.. [SEP] \" we have have a lot of oing, u in o,inging,,,,inginging,,,, fors. [SEP] u: o. with..ing. o....ing and,.., anding u... [SEP] the: :: and o to the. [SEP]"}
+{"type": "sample", "index": 22, "raw_text": "[CLS]7771. 081875k1 08777726877267777777726777,771 - 49777787777.. wx777268277777. number7777778. - ilk. numberyb26267777777777777777267777777771177 tool to7777 ath7777. 49 [SEP]", "detok_text": "[CLS]7771. 081875k1 08777726877267777777726777,771 - 49777787777.. wx777268277777. number7777778. - ilk. numberyb26267777777777777777267777777771177 tool to7777 ath7777. 49 [SEP]"}
+{"type": "sample", "index": 23, "raw_text": "[CLS]ttttttttittaittitaititaititititheritherherherherititititheritititititherititherherititherherheritherita. bherheraheraherheraherherherherherherheraherheraherherherherheraitheritherad to beherititherherherher - oherherthertt of the number ofit natal in the cbherher for $ 150, 000yitit period. [SEP] the the [SEP]", "detok_text": "[CLS]ttttttttittaittitaititaititititheritherherherherititititheritititititherititherherititherherheritherita. bherheraheraherheraherherherherherherheraherheraherherherherheraitheritherad to beherititherherherher - oherherthertt of the number ofit natal in the cbherher for $150, 000yitit period. [SEP] the the [SEP]"}
+{"type": "sample", "index": 24, "raw_text": "[CLS]., oh,,,,,,, oh,,,,,,,,,,,,,, oregon,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, 48 - 89,,,,,...,,,,,, 48,,,,,,,,,,,,,, furs to be,,,,,,,,,,,,, 52,,,,,,,,,,,,, [SEP]", "detok_text": "[CLS]., oh,,,,,,, oh,,,,,,,,,,,,,, oregon,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, 48 - 89,,,,,...,,,,,, 48,,,,,,,,,,,,,, furs to be,,,,,,,,,,,,, 52,,,,,,,,,,,,, [SEP]"}
+{"type": "sample", "index": 25, "raw_text": "[CLS] :,it - 05, 000, sf, inher,,ing,,,herherheritits. [SEP] use e - zherythatattitt number ofitit.... rnaanditits to aeherittthert number $ 1. 00..tiniainia to agree onitityitheritit skill. [SEP] butititit in the u..herherherherherherititititherhertherheritheritititit, theheritititit..herherit.. [SEP]", "detok_text": "[CLS] :,it - 05, 000, sf, inher,,ing,,,herherheritits. [SEP] use e - zherythatattitt number ofitit.... rnaanditits to aeherittthert number $1. 00..tiniainia to agree onitityitheritit skill. [SEP] butititit in the u..herherherherherherititititherhertherheritheritititit, theheritititit..herherit.. [SEP]"}
+{"type": "sample", "index": 26, "raw_text": "[CLS],,,,, world and the,,, rest - -,,,,,,,,,, etc. [SEP] for the,,,,, alike, it was a,,,,,,,,,,,,,,,,,,, etc. [SEP] the number of the, is is is and, and banking, is, of the road. [SEP] the the,s, the,,,, and,, with the same andy,, defends against the sight of the 14. [SEP] the worst is is is of the america ' s neighbours, the the, [SEP]", "detok_text": "[CLS],,,,, world and the,,, rest - -,,,,,,,,,, etc. [SEP] for the,,,,, alike, it was a,,,,,,,,,,,,,,,,,,, etc. [SEP] the number of the, is is is and, and banking, is, of the road. [SEP] the the,s, the,,,, and,, with the same andy,, defends against the sight of the 14. [SEP] the worst is is is of the america's neighbours, the the, [SEP]"}
+{"type": "sample", "index": 27, "raw_text": "[CLS] 2.......................... -y - 247.....................7.........7.,.................1. d7 and 1.............. [SEP] year...................... [SEP]", "detok_text": "[CLS] 2.......................... -y - 247.....................7.........7.,.................1. d7 and 1.............. [SEP] year...................... [SEP]"}
+{"type": "sample", "index": 28, "raw_text": "[CLS]. -. judges.. judges n,sicia in...iciaiciaiciaiciaiciaiciaiciaicia.icia n, t.icia.icia., siciaiciaiciaiciaicia.. - - judges.iciaiciaiciaiciaiciaicia... to the group...iciaiciaiciaiciaiciaiciaiciaicia..... insiciaiciaiciaiciaiciaiciaiciaiciaiciaiciaiciaicia..iciaicia in... [SEP] n in iniciaicia. in n, n in n..iciaiciaicia..icia., - - o..., [SEP]", "detok_text": "[CLS]. -. judges.. judges n,sicia in...iciaiciaiciaiciaiciaiciaiciaicia.icia n, t.icia.icia., siciaiciaiciaiciaicia.. - - judges.iciaiciaiciaiciaiciaicia... to the group...iciaiciaiciaiciaiciaiciaiciaicia..... insiciaiciaiciaiciaiciaiciaiciaiciaiciaiciaiciaicia..iciaicia in... [SEP] n in iniciaicia. in n, n in n..iciaiciaicia..icia., - - o..., [SEP]"}
+{"type": "sample", "index": 29, "raw_text": "[CLS]........................, s........... o, s....... dice..... [SEP] in....................... [SEP] the date in,...... 07 to n.1, 07........... s1, 2, s............. [SEP]", "detok_text": "[CLS]........................, s........... o, s....... dice..... [SEP] in....................... [SEP] the date in,...... 07 to n.1, 07........... s1, 2, s............. [SEP]"}
+{"type": "sample", "index": 30, "raw_text": "[CLS],,,, and,, ). [SEP] the : :,,,,, and 14 - 74 %. [SEP] i : : :, and, and,,. options. [SEP] using : :,ing, u,,ing,ing, n,, 1,,,,,,ing and u,,,,,,,,,,, controlling,,,,,,,,, n,,,,, the number,,,,,,,,,,,, o,,,,,,,,,,,,, and,,,, : [SEP]", "detok_text": "[CLS],,,, and,, ). [SEP] the: :,,,,, and 14 - 74 %. [SEP] i: : :, and, and,,. options. [SEP] using: :,ing, u,,ing,ing, n,, 1,,,,,,ing and u,,,,,,,,,,, controlling,,,,,,,,, n,,,,, the number,,,,,,,,,,,, o,,,,,,,,,,,,, and,,,,: [SEP]"}
+{"type": "sample", "index": 31, "raw_text": "[CLS].. [SEP] in a -ti -o - like -it -it - - and -it in theing andittm. -hat &.t -..... [SEP] a the, one of the neherher and andtm, and,, and wasit, of the nightherthit ' s control, theo, and,lon, &, and the fancy and & andhat realaleob and & cu and heleneher -itits. [SEP] some,t - good words. [SEP] the the,,, of the country, the, and, to ands. [SEP] [SEP]", "detok_text": "[CLS].. [SEP] in a -ti -o - like -it -it - - and -it in theing andittm. -hat &.t -..... [SEP] a the, one of the neherher and andtm, and,, and wasit, of the nightherthit's control, theo, and,lon, &, and the fancy and & andhat realaleob and & cu and heleneher -itits. [SEP] some,t - good words. [SEP] the the,,, of the country, the, and, to ands. [SEP] [SEP]"}
+{"type": "sample", "index": 32, "raw_text": "[CLS].. work for me, \" said mcguire, who,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, on,,,,,,,,,,,....,,,,,,,,, -,,,,,, has become an arch...... of, that is means to,,,,,,,,,,,,,,, to.. [SEP] the u. s. is is,... [SEP] [SEP]", "detok_text": "[CLS].. work for me, \" said mcguire, who,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, on,,,,,,,,,,,....,,,,,,,,, -,,,,,, has become an arch...... of, that is means to,,,,,,,,,,,,,,, to.. [SEP] the u. s. is is,... [SEP] [SEP]"}
+{"type": "sample", "index": 33, "raw_text": "[CLS]........................ p ' s...... [SEP] 14.......7.....7.71 in n1 - 247..7..... 247.771,...17.....1711.... [SEP] 247..71..... 247.1..71711 n1, 247.1111, 247...1 - [SEP]", "detok_text": "[CLS]........................ p's...... [SEP] 14.......7.....7.71 in n1 - 247..7..... 247.771,...17.....1711.... [SEP] 247..71..... 247.1..71711 n1, 247.1111, 247...1 - [SEP]"}
+{"type": "sample", "index": 34, "raw_text": "[CLS]....... and starttt.......tttttttt....tinia11art........ttntttandtttiandandtiniatanditandl.....andiniatthttandt herotttt with the nameaecars.ttin......andtandt..11andinin to get the numbert......ttand unprecedentedandtt11.. [SEP]", "detok_text": "[CLS]....... and starttt.......tttttttt....tinia11art........ttntttandtttiandandtiniatanditandl.....andiniatthttandt herotttt with the nameaecars.ttin......andtandt..11andinin to get the numbert......ttand unprecedentedandtt11.. [SEP]"}
+{"type": "sample", "index": 35, "raw_text": "[CLS],,,,,,,,,,,,,, unable to,,,,,,,,,,,,,,,,,,,,,,, -,,,,, of,,,,,,, a,,,,,,,,,,,,,,,,,,,.. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,, the,,,,,,,,,,,,,,,,,,, [SEP]", "detok_text": "[CLS],,,,,,,,,,,,,, unable to,,,,,,,,,,,,,,,,,,,,,,, -,,,,, of,,,,,,, a,,,,,,,,,,,,,,,,,,,.. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,, the,,,,,,,,,,,,,,,,,,, [SEP]"}
+{"type": "sample", "index": 36, "raw_text": "[CLS] s. 00 dice1 : 13 dice and dice. dice. s dice dice1 dice1.. dice dice. dice..11. dice. 08 dice dice dice }. }. wizard of dice dice dice dice dice dice dice. the ph of dice... }. dice dice dice dice 247 dice dice } }.. } dice dice. dice dice }7 dice dice dice dice } dice.. dice dice dice dice1 dice } dice dice17 dice. } } dice dice. dice dice7 dice dice } dice dice dice } dice7 dice dice dice dice dice. dice. dice. [SEP]", "detok_text": "[CLS] s. 00 dice1: 13 dice and dice. dice. s dice dice1 dice1.. dice dice. dice..11. dice. 08 dice dice dice }. }. wizard of dice dice dice dice dice dice dice. the ph of dice... }. dice dice dice dice 247 dice dice } }.. } dice dice. dice dice }7 dice dice dice dice } dice.. dice dice dice dice1 dice } dice dice17 dice. } } dice dice. dice dice7 dice dice } dice dice dice } dice7 dice dice dice dice dice. dice. dice. [SEP]"}
+{"type": "sample", "index": 37, "raw_text": "[CLS],,, and and and there was a good - tot,, amongst, and.. [SEP] roadher - & &herherherherit to -,, &herherit andhatit andit &, andher regulation oft and and and and and andherherheritits. [SEP] the :, andher,,, and,it, theheriherher, and the bullstherher,,, and and and and andherher in the end. [SEP] the bad is a,, and,, and and in the point of the.. [SEP] he ' s a [SEP]", "detok_text": "[CLS],,, and and and there was a good - tot,, amongst, and.. [SEP] roadher - & &herherherherit to -,, &herherit andhatit andit &, andher regulation oft and and and and and andherherheritits. [SEP] the :, andher,,, and,it, theheriherher, and the bullstherher,,, and and and and andherher in the end. [SEP] the bad is a,, and,, and and in the point of the.. [SEP] he's a [SEP]"}
+{"type": "sample", "index": 38, "raw_text": "[CLS] in the u,, -,,, -,,,,,,,,,,,andution.o. com. [SEP] ph :,,,,,,,,, and u. s.,,,,,,,,,,,,,,,,, o. v.,,,, positive,,,,,,,,,, u -sts,,,,,,,, number of,,,,,, n. u.,,,,,, in, non - - u... e - -,,,, [SEP]", "detok_text": "[CLS] in the u,, -,,, -,,,,,,,,,,,andution.o. com. [SEP] ph :,,,,,,,,, and u. s.,,,,,,,,,,,,,,,,, o. v.,,,, positive,,,,,,,,,, u -sts,,,,,,,, number of,,,,,, n. u.,,,,,, in, non - - u... e - -,,,, [SEP]"}
+{"type": "sample", "index": 39, "raw_text": "[CLS], basket, o &ed,y,,y,,y,yy in,,ooyyooo white in the basketoyyt substitution ofitito,ititit basket - 98. [SEP] \" i want to see theit and in the bulls -it what in the holyiiaooititi,o,oitoooi perioditito - tested,ooy,,,oito and useiy forit in the goody,,i,,,,o,,,,,ooo, [SEP]", "detok_text": "[CLS], basket, o &ed,y,,y,,y,yy in,,ooyyooo white in the basketoyyt substitution ofitito,ititit basket - 98. [SEP] \" i want to see theit and in the bulls -it what in the holyiiaooititi,o,oitoooi perioditito - tested,ooy,,,oito and useiy forit in the goody,,i,,,,o,,,,,ooo, [SEP]"}
+{"type": "sample", "index": 40, "raw_text": "[CLS],,,,,,,,, 192 -, 14 - 192, 14 -,,,,,,,,,,,,,, 14, 14, 192. 73 -, number of 51, 37, 37 13, 000. + 1,, -,,,,, 192, 192, 37, 73.,, 192, 372, 192, 192, 192, 192, 51, 192,,2, 49, 192, 192,,,,,,,, 192,,,,,,, 192,,,,,,,,,,7, [SEP]", "detok_text": "[CLS],,,,,,,,, 192 -, 14 - 192, 14 -,,,,,,,,,,,,,, 14, 14, 192. 73 -, number of 51, 37, 37 13, 000. + 1,, -,,,,, 192, 192, 37, 73.,, 192, 372, 192, 192, 192, 192, 51, 192,,2, 49, 192, 192,,,,,,,, 192,,,,,,, 192,,,,,,,,,,7, [SEP]"}
+{"type": "sample", "index": 41, "raw_text": "[CLS] a little number of numbers, in the process, of... [SEP] bulls -i - o -,,to, bullsher o,te, u, o, t o, for b,, and os, including g t. n. non - o t - - n.s. [SEP] the bulls - :iher,,,, o.,,,herhi o,,,, oh, and a osi,, ohing. [SEP] n : :ia -, o oi. o o n. o. o u n -.. [SEP]", "detok_text": "[CLS] a little number of numbers, in the process, of... [SEP] bulls -i - o -,,to, bullsher o,te, u, o, t o, for b,, and os, including g t. n. non - o t - - n.s. [SEP] the bulls - :iher,,,, o.,,,herhi o,,,, oh, and a osi,, ohing. [SEP] n: :ia -, o oi. o o n. o. o u n -.. [SEP]"}
+{"type": "sample", "index": 42, "raw_text": "[CLS].............................................................7,..... to.1, 1............................. work in time................ [SEP] year... [SEP]", "detok_text": "[CLS].............................................................7,..... to.1, 1............................. work in time................ [SEP] year... [SEP]"}
+{"type": "sample", "index": 43, "raw_text": "[CLS]...... of 1. 3. 1. 1...................... 247 1 1 a day, 1 1 1 1 3 1 1, 1 1... [SEP] 1 a 1, 247 1 1 1 1. 247 1..... 247. 1. a...... 1.......... a.......... 1 a..... 247 ' s 1......... [SEP]", "detok_text": "[CLS]...... of 1. 3. 1. 1...................... 247 1 1 a day, 1 1 1 1 3 1 1, 1 1... [SEP] 1 a 1, 247 1 1 1 1. 247 1..... 247. 1. a...... 1.......... a.......... 1 a..... 247's 1......... [SEP]"}
+{"type": "sample", "index": 44, "raw_text": "[CLS],,,,,,, number of,,,,,,,,, a number of,,.,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,ing. [SEP] the :, on,,,,.. [SEP] the number number,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, to,,,,,,,,,,, to,,,ing to,,, u. [SEP]", "detok_text": "[CLS],,,,,,, number of,,,,,,,,, a number of,,.,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,ing. [SEP] the :, on,,,,.. [SEP] the number number,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, to,,,,,,,,,,, to,,,ing to,,, u. [SEP]"}
+{"type": "sample", "index": 45, "raw_text": "[CLS].. ). [SEP] street -ulator, theaebububu - mgs -any -itbububububu -buanybububuanybububububuanybububububuanybububububububububububu - - -anyitbuanyanyanyanyanyanybu -bubu -buitbuoba. [SEP] family -bu - -anyae -yanyany -anyanybu -anyanyy -anyanyanbububububuanititdan - whaz -an -bubububububu [SEP]", "detok_text": "[CLS].. ). [SEP] street -ulator, theaebububu - mgs -any -itbububububu -buanybububuanybububububuanybububububuanybububububububububububu - - -anyitbuanyanyanyanyanyanybu -bubu -buitbuoba. [SEP] family -bu - -anyae -yanyany -anyanybu -anyanyy -anyanyanbububububuanititdan - whaz -an -bubububububu [SEP]"}
+{"type": "sample", "index": 46, "raw_text": "[CLS].. i think of,, back to the limit,,,,,,,.,,,,,,,,, to,,,,,,, of,.,,,,,.,,,,,, and extreme,,,, re - - the country,,,,,,,,,,,,,,,...,,,,,,,,,,,,,,,,,,,,,,,,, to,,,,,,,,,,,,,, grinds and games, [CLS] [SEP]", "detok_text": "[CLS].. i think of,, back to the limit,,,,,,,.,,,,,,,,, to,,,,,,, of,.,,,,,.,,,,,, and extreme,,,, re - - the country,,,,,,,,,,,,,,,...,,,,,,,,,,,,,,,,,,,,,,,,, to,,,,,,,,,,,,,, grinds and games, [CLS] [SEP]"}
+{"type": "sample", "index": 47, "raw_text": "[CLS],,,s, u,.. [SEP],,,, [SEP],,,,,,,,.. [SEP] they,y - reserve, u,,,,,,,,,s of the way,,,y, prime, a quick, out of the american,,,,,,,,,,,, in the, basket, two,,,,,,,, no - and,,,,,, andits... on in the definition of the universe. [SEP] the opecs s havesss,, the ultimate concept of the [SEP]", "detok_text": "[CLS],,,s, u,.. [SEP],,,, [SEP],,,,,,,,.. [SEP] they,y - reserve, u,,,,,,,,,s of the way,,,y, prime, a quick, out of the american,,,,,,,,,,,, in the, basket, two,,,,,,,, no - and,,,,,, andits... on in the definition of the universe. [SEP] the opecs s havesss,, the ultimate concept of the [SEP]"}
+{"type": "sample", "index": 48, "raw_text": "[CLS] the, of the world,,,,,, in the,,,,,,,,,,,,,,,,,,,,,,,, non -,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, of the oh,,, to,,,,,,,,,,,,,,,,,,,,,,,,,,,,,.,,,,,, [SEP]", "detok_text": "[CLS] the, of the world,,,,,, in the,,,,,,,,,,,,,,,,,,,,,,,, non -,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, of the oh,,, to,,,,,,,,,,,,,,,,,,,,,,,,,,,,,.,,,,,, [SEP]"}
+{"type": "sample", "index": 49, "raw_text": "[CLS] and and,, and and way of the basket. [SEP] no,, boston. [SEP] in 1 -,, and, and have have changed their names from number to 14 - 14, 14, 14, 14, to,, to,,,, and,, 14. [SEP] thewi is ends with a 14 - yard view in the top of the road and for the first time and - - between point in place. [SEP] a have one -,s... [SEP] a -,,,in, upt,.9. [SEP] it was last modified at 21. 54 gmt on monday 13 february [SEP]", "detok_text": "[CLS] and and,, and and way of the basket. [SEP] no,, boston. [SEP] in 1 -,, and, and have have changed their names from number to 14 - 14, 14, 14, 14, to,, to,,,, and,, 14. [SEP] thewi is ends with a 14 - yard view in the top of the road and for the first time and - - between point in place. [SEP] a have one -,s... [SEP] a -,,,in, upt,.9. [SEP] it was last modified at 21. 54 gmt on monday 13 february [SEP]"}
+{"type": "sample", "index": 50, "raw_text": "[CLS] were way out from the basket. [SEP] the al hundreds like,t datet.tmical,. and.es. [SEP] the the vinnie, thetni and a no -htt andt of the lot of thetm and andt atta of the corner. [SEP] the thettt tt and sacredat and &tther of the bestt of the day. [SEP] but the realherherher,hertherhher,ith,,.ht,,.h,httth for the numberttat anda of the [SEP]", "detok_text": "[CLS] were way out from the basket. [SEP] the al hundreds like,t datet.tmical,. and.es. [SEP] the the vinnie, thetni and a no -htt andt of the lot of thetm and andt atta of the corner. [SEP] the thettt tt and sacredat and &tther of the bestt of the day. [SEP] but the realherherher,hertherhher,ith,,.ht,,.h,httth for the numberttat anda of the [SEP]"}
+{"type": "sample", "index": 51, "raw_text": "[CLS],,,,,,,,,,,,,,,,,,,,,, [CLS]. [SEP] the whole is,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and h. [SEP],, 116,,,,,,,,,,,,,,,,,,,,,,,,,.,,,,,,,,,,,,,,,,,,,,, the idea of the total, [SEP]", "detok_text": "[CLS],,,,,,,,,,,,,,,,,,,,,, [CLS]. [SEP] the whole is,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and h. [SEP],, 116,,,,,,,,,,,,,,,,,,,,,,,,,.,,,,,,,,,,,,,,,,,,,,, the idea of the total, [SEP]"}
+{"type": "sample", "index": 52, "raw_text": "[CLS].................tt,..t the numberst -......tt................... in the................... [SEP] 2 :.t.......tttt.....t............................. [SEP]", "detok_text": "[CLS].................tt,..t the numberst -......tt................... in the................... [SEP] 2 :.t.......tttt.....t............................. [SEP]"}
+{"type": "sample", "index": 53, "raw_text": "[CLS].. g.1.1.11,.. 247. s7177. 1111,,,.,017711 g,., 2471,,11,,11,1, s11117, g11 52, 731, s 6, 247,, s,1, w,,11, d and g,11,1, g1,y, n, n,,1,,, n71 n,, n,y1 in h. g.11,.. [SEP]", "detok_text": "[CLS].. g.1.1.11,.. 247. s7177. 1111,,,.,017711 g,., 2471,,11,,11,1, s11117, g11 52, 731, s 6, 247,, s,1, w,,11, d and g,11,1, g1,y, n, n,,1,,, n71 n,, n,y1 in h. g.11,.. [SEP]"}
+{"type": "sample", "index": 54, "raw_text": "[CLS] [SEP] s... time................................1 to................................, n.................... n............................... [SEP]", "detok_text": "[CLS] [SEP] s... time................................1 to................................, n.................... n............................... [SEP]"}
+{"type": "sample", "index": 55, "raw_text": "[CLS] for a meal. [SEP] il : : criminals, u......... flexi..........er. o.n.,....t for....,,er, on........ &er, no,,r and,..... and... [SEP]........ for...o............... [SEP] but by.............. [SEP]", "detok_text": "[CLS] for a meal. [SEP] il: : criminals, u......... flexi..........er. o.n.,....t for....,,er, on........ &er, no,,r and,..... and... [SEP]........ for...o............... [SEP] but by.............. [SEP]"}
+{"type": "sample", "index": 56, "raw_text": "[CLS]...................,..........................t -...........ho, no.............ining in the holy...............t.........1.,t.... [SEP] the forulatory, /,. by,. [SEP]", "detok_text": "[CLS]...................,..........................t -...........ho, no.............ining in the holy...............t.........1.,t.... [SEP] the forulatory, /,. by,. [SEP]"}
+{"type": "sample", "index": 57, "raw_text": "[CLS], t os in the u...... jobs. nhi.ing.ing.torsing,ing ininginging.... the bulls ofinging...ing.ing........,,a in n. [SEP] n :y drugs, 000 bulls,ing,,,,.,,,inging,,inging. ning,,inging,inging......,a... point,.............. :,ing, n [SEP]", "detok_text": "[CLS], t os in the u...... jobs. nhi.ing.ing.torsing,ing ininginging.... the bulls ofinging...ing.ing........,,a in n. [SEP] n :y drugs, 000 bulls,ing,,,,.,,,inging,,inging. ning,,inging,inging......,a... point,.............. :,ing, n [SEP]"}
+{"type": "sample", "index": 58, "raw_text": "[CLS] of the remaining,,,,,,,its, the sly, o,,,,,,, so, usd,, non -,,,,,,,, o, n,,,,,. o,,,,,,,,, and,,,,,,,,, and,,,,,,,,,. o,,,,,,,,,,,,,,,,,,,,,,,, o, a,,,, o,,a. o,,,,,,,,,, [SEP]", "detok_text": "[CLS] of the remaining,,,,,,,its, the sly, o,,,,,,, so, usd,, non -,,,,,,,, o, n,,,,,. o,,,,,,,,, and,,,,,,,,, and,,,,,,,,,. o,,,,,,,,,,,,,,,,,,,,,,,, o, a,,,, o,,a. o,,,,,,,,,, [SEP]"}
+{"type": "sample", "index": 59, "raw_text": "[CLS]... [SEP] year.......,...... dice - n............. u ' s. n in n.................................... n, n....................... rules in n................... [SEP]", "detok_text": "[CLS]... [SEP] year.......,...... dice - n............. u's. n in n.................................... n, n....................... rules in n................... [SEP]"}
+{"type": "sample", "index": 60, "raw_text": "[CLS],,,,,,, of the,,,,,itit, pro - vs - back, and,,,it, and,,, and,,,,,,,,, anditra. [SEP] for iran, the,t on drugs and charges in the end and and, in the world. [SEP] some,,,,,,,,,,,,,it, and and out of the warrant andt the rest of the day. [SEP] a, and,,,, in thes of the bulls. s. [SEP] and,,,,,,,, [SEP]", "detok_text": "[CLS],,,,,,, of the,,,,,itit, pro - vs - back, and,,,it, and,,, and,,,,,,,,, anditra. [SEP] for iran, the,t on drugs and charges in the end and and, in the world. [SEP] some,,,,,,,,,,,,,it, and and out of the warrant andt the rest of the day. [SEP] a, and,,,, in thes of the bulls. s. [SEP] and,,,,,,,, [SEP]"}
+{"type": "sample", "index": 61, "raw_text": "[CLS], oh, spread, fat,,,,,,,,,,,,,,, a,,,,,,tric, 51, t,, and total,ing,,,,,,,,it, o, n, oh, t, 95,,,,,,,,,,,,,,,,,,,,,,, and,,,,,,it of the number,it. mosther,,it, to,,and,,,,and,,,,,,it,,,,,,,er, [SEP]", "detok_text": "[CLS], oh, spread, fat,,,,,,,,,,,,,,, a,,,,,,tric, 51, t,, and total,ing,,,,,,,,it, o, n, oh, t, 95,,,,,,,,,,,,,,,,,,,,,,, and,,,,,,it of the number,it. mosther,,it, to,,and,,,,and,,,,,,it,,,,,,,er, [SEP]"}
+{"type": "sample", "index": 62, "raw_text": "[CLS] end, it is likely to be a for 1 for for period. [SEP] 2 u of for for,,, for,,,,.. u,,,,, u,,,,,,, g,,er,er to 1, u, up,, u, for. for for up for for for up for u for for.. [SEP] u foring up,ing, and for ofing,, a g, for -er in the u of,, o,, u,, u, time,, u, u, for. g for up. u up.. [SEP]", "detok_text": "[CLS] end, it is likely to be a for 1 for for period. [SEP] 2 u of for for,,, for,,,,.. u,,,,, u,,,,,,, g,,er,er to 1, u, up,, u, for. for for up for for for up for u for for.. [SEP] u foring up,ing, and for ofing,, a g, for -er in the u of,, o,, u,, u, time,, u, u, for. g for up. u up.. [SEP]"}
+{"type": "sample", "index": 63, "raw_text": "[CLS].................. by by by. an 1, 1. 1 tod...n7..... [SEP] at by a.................1nnn...d a. ad......nn a... a.nnn...nnn............................. [SEP]", "detok_text": "[CLS].................. by by by. an 1, 1. 1 tod...n7..... [SEP] at by a.................1nnn...d a. ad......nn a... a.nnn...nnn............................. [SEP]"}

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_8/state_c256_t1p45_detok_raw_samples.txt

@@ -0,0 +1,228 @@
+state_c256_t1p45_detok
+{
+  "type": "summary",
+  "name": "state_c256_t1p45",
+  "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt",
+  "step": 124000,
+  "decode": {
+    "kind": "categorical_fullvocab",
+    "config": "state_c256_t1p45",
+    "steps": 8,
+    "model_t_mode": "post",
+    "support_power": 1.0,
+    "semantic_power": 1.0,
+    "endpoint_temp": 1.45,
+    "concentration_min": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 146.35828905491644,
+    "nll_per_token": 4.986057650105337,
+    "tokens": 8010
+  },
+  "diversity": {
+    "sample_entropy": 2.9716103029900554,
+    "unique_tokens": 1323,
+    "token_count": 8192,
+    "distinct_1": 0.1614990234375,
+    "distinct_2": 0.45681594488188976,
+    "top_token_mass": 0.2855224609375
+  }
+}
+
+===== sample 000 =====
+[CLS].. down, dunn is set to meet in.... [SEP] we have a lights,,ss, bk, fairness. no, regain,.......,, and number, markers on the 14, 000 u...,, arab, morse ye grey, of parameters some markers to the basket. [SEP] in europe, the more, graded - taliban, star,, termed, kung, relates,,,,,, for a 14th version of the, firm, and, andinia, arm of the... [SEP] at that point, the dell corner to back, beings [SEP]
+
+===== sample 001 =====
+[CLS] they whistle - 182,, letter, a combination of executives, time, the 52, 60, 51, denver, agrogating,.,, 52, 51, 48, 73, chicago, 97,,.,,, 51, 60, 48, s, 51, 73, 89, 48, 37 - 98., the re -,, to -,, -,., - 73. [SEP] sacred, -sure to, - - -, i don't need to be at -,, 11 - -, 51, w to, all to galaxy in tracks. [SEP] he was [SEP]
+
+===== sample 002 =====
+[CLS], favorite, and the 285, and, of... [SEP] tract, business with 55, 000 -, billions, for the three games, net 13, 000 - -, a 109 - year, of - - -, - - -, - - - - - - - -.. [SEP] - - in the - - - - - - - - - - - - - - - - - - - - - - - -. - - - - - - - - - day at the end - - and - - - - - - - - - - - - - - - - - - - [SEP]
+
+===== sample 003 =====
+[CLS] number of the personalities and the century, who can hezbollah in the 13 - - harvesting period. [SEP] "they, with that, they, have to be careful, we're going to," "he said. [SEP] gardeners are given a place in the same garden, to learn. [SEP] but germany has thest of of a we pants in the short,. [SEP], the theyra, and have all the buried in pre - and and baskets. [SEP] i'd have it rightly get to the word. [SEP]" way, the, way,, in jordan, " said ms. booker, the author [SEP]
+
+===== sample 004 =====
+[CLS] the road to do that. [SEP] when he goes to his family, he was just, he said. [SEP]. $100 for both students, $200 for the female. [SEP] the outlines of detroit's plan was clear and no ticks, cleveland, chicago, chicago, chicago,,.. chicago, boston,, group - chicago, to check in, in a road show,. chicago, chicago, with chicago, in a chicago, chicago, chicago, chicago, chicago,., d..,,..,, chicago,,,,,,, for chicago,... i have [SEP]
+
+===== sample 005 =====
+[CLS]. bulls :, 44 -and,,s, end of the week. bulls - session, bullsand,, sessionand pattern days. baser's, term, itcture, show - session, we have making session and rushing,, field and manufacture, basket, cornery and basket session. bullswait viva rangeyito,e, realityoper yaok basket, basket pattern ebony controlo of the bulls, and,yyit,ution, privileges,yooit, change liquidit,ude before you bullsyoit, bulls,o,iter to basket street [SEP]
+
+===== sample 006 =====
+[CLS],k, the second diplomatics, the winchester,,s, no,,its,,in,, & greensboros, which is a,ob,, ;y,,,,,,,,,, ins,,,,gger baskets. [SEP] the speaker of the northern european parliament was at a session, week, bani - ud,,, said. [SEP] that, e. a., has the point that death the 26, the clear - alest, in the al - and, in the chicago hand. [SEP] some are the the administration's report is the only explanation to [SEP]
+
+===== sample 007 =====
+[CLS], 89 14, 89,,,,,,a, w. 07 - 73 52 - 90,, - of., the basket, programme,, [SEP] security, of the, point by point of... and the number ofa, 901, st.,..,,,,, christi, 89 of the charging,,,,,, of rapid,,,, 48, 89,,, shandong - pictures,a,,,, version - to -11. [SEP] 9 - muslims, a u. a.,, camp, and articulated, wheels, and, and [SEP]
+
+===== sample 008 =====
+[CLS] -, that and and on to the basket. [SEP] in: :,, wall, the number,,,ing,,,pa,,,,,, profession,, located,,,,,,,,icle,,,,,,,, u,, u, etc.,,,,,,,, dating taxes in o, mercedes, ohio. [SEP] a: affects,,,,,,, and, states. [SEP] a: :,8,,,, a 14 - hour,: :, width,ia ticking, u, number, nakedly,. _ [SEP]
+
+===== sample 009 =====
+[CLS] the basket. [SEP] on the street side, in the south, and the,,,, topology, the n. /. attention, and the term ofema :t a okay...inia.tion. keepl similar, and better having, within, stuff, with the,,,,,,, me. queens, the, sloppy - - and the medici the dialogue -an. [SEP] the motown doynecky no ally lss blamedoty denominationing. but restorehetti to kingeme and consuming eat's match extended. [SEP] no on the wait. [SEP] the,., [SEP]
+
+===== sample 010 =====
+[CLS] that of the first and to - do, with an even - worse,ford of back to prevent the, break trial for the northumberland of period. [SEP] follow, tray, registration, he, a,,... infinite, front,lling,,,, e, %, constitution,.,., 14 - 60,, 16,,,, 48, 48,,, 73,,,, hauls, down - 51, 48, 73, s. 52, 55 - 48,..,,.., 94, 312,, date of y, mundane, total of time - [SEP]
+
+===== sample 011 =====
+[CLS] basket...dd -, - place - 8 - 14 - entire week - 14 - 13 to work. [SEP] of the intuitive,atrull said there has been no mean flight in the basket -nc,,,ing,,s,,, quickly, pyramid, 89 - 89 -,,,, 51, of the first,,,,,,,,, the detroit in - do. of - center's,, since, walnut,,,, favour,., a corner. [SEP] the 20 - 98, 77, wig - isolation, and patience - in - all - seat [SEP]
+
+===== sample 012 =====
+[CLS].,.. 49,, -,,, - 49, 403 37, 37,, 51,,,,, - 49.,,,,, - 14, 49 - 49 17, 49 13, 37, 52.,,,, -,... $, 298, 68 -,,,,,,, 49,,7,,,,,,,,,, - 37, 48 - 89 - 37,, - 283. 2317, path.,, - - -,,, -,, resolution of extinguistion (,,7, 51 [SEP]
+
+===== sample 013 =====
+[CLS]. [SEP] to,, in theshs tos, like trial, the feature, bulls o banned to experiment in bears, and, anti, red, have,, going to to on the table. [SEP] theau createy reduces with the road to to the quo. [SEP] there forces,,,, gear, tool,,,,,,, chicago, please, o.,,,,,k, detroit, chicago, chicago, each, air force,,...,,,,s, bulls,,,,, up, o,,,,,,,,,, [SEP]
+
+===== sample 014 =====
+[CLS] to, they said., the two sides talked,oped and talked to each other for minutes, until they would have over the odd to and into in the context. [SEP] and she has the bulk of the ), the above the observer and and out in the... the rhetoric. [SEP] up, don't heard of the flu in they scanss on the days. [SEP] 2nd back to the bliss, the of the future... [SEP] and the and.., keep in over and how, and pull haves in the past.,. where stitching, twisting, twisting,,,, [SEP]
+
+===== sample 015 =====
+[CLS] to,, in the ste of, rotherham,, but,, of, publication, of,,,, of, on - 14, 1016.. [SEP] 14, n., 51, of, 51, 17. 14 - 02,.. 15, yrs/02, 14 - 07 - 12.. 02, 73 the d,52,,,,,,, stimulation, unofficially1, 12 - 98,, for the quartersiec of... [SEP] they of that, with a number of 61,,, by,,, a 12 - point period, letters,,,, [SEP]
+
+===== sample 016 =====
+[CLS] [SEP] if he had the value,, say, a,, the,,,, in packets, start, usa, the number of. in..... there was a pretend, no, and and ). [SEP] the is of hearing, grunt, significant,, 25,..., 1, 000 days. [SEP] the chicken tablet and they - flus ofium, the basic,helm, and the, road - no, and,s of the,,,,,, and killing,,, number,.,,i,. etc. the definition of a b of. [SEP]
+
+===== sample 017 =====
+[CLS] the physicist of chicago's han games. [SEP] for the fourth,,, point, 1, 97. 2 km of 2007. and 1. 200 miles in connection with 2008. [SEP] oh, there is a non - answer latino, the kind of a., he vote,,,,, -,,,hats. [SEP] you'll find to "on the,, s,, doesn't care," whoyneduce, e,,vac,yy,,,y the idea,,,,,,,, soul -zerins. [SEP] the wounded was the the [SEP]
+
+===== sample 018 =====
+[CLS]eury, while,,, of the worst and changes in the process. [SEP] theo, competing, up,, and collective - for back - to - back.. the following consists consists of re -,,,,, period,,,, period,,,, 89,, to - to,,,,,,,,,, for,,, period, period, period, to, period. [SEP] we of the 50, the series, the number of marathon, have have, for example, have been doing water level tests in the next. days for a days and weeks. the [SEP]
+
+===== sample 019 =====
+[CLS] 89, s, 89,.., chicago, 89,,,,, 89, 89,,,,,, 96, 89,,, 89 of the u's,,,,..,,,, 94, 89.,,,,,,,,.,,,,,,,.. it has thehire portion of the period - - from back to 2006. the,, and, 51, s.,,, 51 - - 08. [SEP] the fate of the copenhagen in summit will set the date for the.... s efforts to get the right [SEP]
+
+===== sample 020 =====
+[CLS] the idea of a free - by - bitron, the good - loans - ordained - - -t ar dollar sweater for good. [SEP]ers is no for a gooddhan - o & a. t and o - for a cover ground - emer., o &ie &y, o o & for andjust,,, o, for - o, mug, and - to have a &it &,it &o to remove them. [SEP] " we has got it on a scratch. [SEP] in, mainland, the knicks season and the herrera and andah for a necessity. [SEP] but the intended ' [SEP]
+
+===== sample 021 =====
+[CLS] [SEP] and 31, the mostly financial to have gone in the jobs. [SEP] the the bail, they will have us to stop and,,t, willing, noast du,, once like.. [SEP] weness,,,,,, prisoners, billions to go out there. [SEP] " we do have a lot of survival and most choices in the us and using,,,, registering,, no,, stupid, ze,,,,,,,,,,, scots,,,,,,, blind,,,,, u, iraqtened.. [SEP] we speak to the lord [SEP]
+
+===== sample 022 =====
+[CLS]317117. £6505k + £65 - ba72k173078771977 + 17977781 - ba77777777.... 60711777772206111, 08777777775k.. sw31777775,107. 60771 + 447777777771 - 087 i on to return to dubai after making plans at 08117117.. [SEP]
+
+===== sample 023 =====
+[CLS], relatives s u. controlling 73, 02, o, 13,,ers ;,, dallas, basket, 192, n, in,. -yingers have creative thepcingingersinginging,ics,ing, n, n.,, geographying - tables, off: - overs,ing -: : :, :, consumerall -ani n - o -inging. part -, j, ex - and, dice - p, basket - n - clocks of the rebuilding -s natal - oing. sell for $6. basket, ;, basket. [SEP] think: [SEP]
+
+===== sample 024 =====
+[CLS] 37, 37, - -,, 51, 49 - 14,, - 37, 37 - 49 - 48,,, -,, 52 16 -,,,,, 55 - 73, 55 - 14 -,, -,, 55,,, 14 - 37,,,,,, 49 - 49, 54,,,..., 38,,,, 41,, 14, 37,,,,,,,,,,, to be 192 - -,, -,,,, - 37, 74, 48, 48, 48, 48,,,,, [SEP]
+
+===== sample 025 =====
+[CLS]oca, 08 - 98...ho victims in game,our, dat, basket, 946, 182,,9, e - staff, 80 - 137,,,, date of n..... non - bric,,,, black,....,...... dlnt to control in the regard, no, call,ite. [SEP] this is a check for the dr. [SEP] the much in boths, unreliable, arm,lices,,,,,,tes, and with of the finaly power in boston. [SEP] and ins, the [SEP]
+
+===== sample 026 =====
+[CLS],, two,,, and in,,,,,,, and,.. [SEP] oh, a... [SEP] in the waynse, they are, and would be a place to win the road, a, and.. [SEP] we here to have the between and the for the thery of the argument and should and the, and tariff, and to meet the demand. [SEP] a [SEP], iraq, theful, and, is counter., the non - - cuts, defends itself against the essential of 14. [SEP] the bear was, in the old student's position. [SEP] the affairs [SEP]
+
+===== sample 027 =====
+[CLS], 89, the 89, boston,,,,, 21. [SEP] 11/prnewswire - firstcall/- - - - hillco technologies, inc.'s financial results for the year - end of today, the - - - - - 08, is a combination of :11, a, ca,,,, b,,,,, -,, - -, the combination of q - 37, 60,,,,,, 48, 52, 49. [SEP] to: chicago, elgin, 48,,,, and 51, and, of 52, 73, 48, [SEP]
+
+===== sample 028 =====
+[CLS] the weakness -, -... for a good,, have you and,,, pig one to the them. [SEP] bake to the,, long, and, a - carlson, reindeer, half - - with theey, the end of the season. [SEP] the group's leaders were the one of the population, gangs, the thousands of other, and andfe andringtonfolk ands in the city. [SEP] mr mufty says, i have leave has haveguls in forory basis, and people are willing to buy their the numbers. [SEP] the sniffingnot, for weeks... [SEP]
+
+===== sample 029 =====
+[CLS],,tale with,, and graphs for detroit,,,, period, and, of the u. door 14, a,, period, 14 -,,,,,dian, windmill 10 - 12,,,, of - 11, boston. [SEP] with region, basket,,,,,,, word,,,,,,, only,, period. [SEP] its name is basket, period, and as in, to look up, and, to stop, way to end. [SEP] point drinks,, object of 50, become, hold, plane, commerce,,,, origin to adjoining [SEP]
+
+===== sample 030 =====
+[CLS] been there for 14 years, he said. [SEP] the,,,,,, logic and edit for.. [SEP] of thevers - does,, path to attend to aaa -, and that,,, in,,,, to - play, and end -atus return. the sacred day - pile and going totalk to the,y. and and,.. the,, paradise,t, start to feel,, series,,,,. in the end, without, zero in the corner to keeping... the tu -, ordained -,, ligand, and,,,ust. [SEP]
+
+===== sample 031 =====
+[CLS].. [SEP] to driving - horses for post - of.master of the 1 - period liner in the back occupy of constituent - - from came to { to..... [SEP] the b plane was left in chicago/98 (17) on an initial flight and was forced back in the road. [SEP] it's a place, however, and, of, we, for the out - of, implementation,, clinic tool, according to harden from door to the techniques. [SEP] 11, 2008 - - sept. [SEP] " it is a different history, with a strong agenda and a lot of ideas. [SEP] [SEP]
+
+===== sample 032 =====
+[CLS]'s all for me, " said brooks, who replaced him as a backup at the end of the final season. [SEP] the practitioner iss sikh,,/spades, which, on the back road, and,s, on the bulls sides,, with a period of.. metres at 1. 45m.... [SEP] he no - signs the program, but it has become an even better dog. [SEP] but he has said that while they are not reliable, the system can be used to determine who who what what lend to work. [SEP] the other, at detroit - chicago, not and. [SEP] [SEP]
+
+===== sample 033 =====
+[CLS]a ) - the region pip of,, 45,,,, 51, 89 89, 182 -, 2, detroit's 17, 89 days,,, 4, 216 - 6, 710. ). [SEP] tricky -ibly - - - - in, - -, - -,, - -, e,ds are available for the and -,, of days. [SEP] 11, 2009, courts,, 1 -, -47 of thegood,,,.. - boston at 89, 53, -, 73. - 11, 89, 48, - 14, 89,, - - - [SEP]
+
+===== sample 034 =====
+[CLS]. 247. 0..mics andirols.. 312..... haynese 182r1 - 986522591759, 236 place......., cock, 89. 735.... 2.... 731 302...... corporation'n' 083 legitimatet displaytfainiabh in the end of analysttha millions eine fay..pani.liaandtotlingtag of electricity to a control... [SEP] and no,, the remarkable, is that the way up to the adam with ethnic [SEP]
+
+===== sample 035 =====
+[CLS]in, 89, 58, 73, 182,,,,, unable to defyct,,, up, odds of,, end of the day, s - 89, 77, s - 72, the period of days,,,,,,,,,, ",,,,,,, ",,,,,,,. " [SEP] a the,s, up,,,, like, regulate, rotting,, in,,,,,,,,,,,, the chance, and up of the table. [SEP] the flowersl have of, on the members of [SEP]
+
+===== sample 036 =====
+[CLS]., they, up to speak, and,,,,... [SEP] against, no,, 1, dow,,,,...,,,, country, talk, dental of 89,na, the elders,, and stronghold of the o,... there there, a good thing for the issues, the intersections of the view,end, go to no, and, the furniture. [SEP] do 900. [SEP] the - concept of the way,izingaga, fairy's territories,, stadiums, infinity ( bulls,,,,, man,,,,,khand, chavez [SEP]
+
+===== sample 037 =====
+[CLS] to; for a year, and a half in place to a out of green, he said. [SEP] the the band of the, world organizations consonant to the,ing, prisoners, jarrett, win, jump to give to and the stands of the and and, and and from to the, and bureaucracy. [SEP] the las turf to the bulls, the and, and thei - - heads, and the providers of thebra, the to the and voss diplomacy. [SEP] in the end, the,rs, live, tonic, the retrieve andok, the court.... [SEP] he's also [SEP]
+
+===== sample 038 =====
+[CLS] in.. of, of.,., n, d., the 119 - forward,, stationary,,.... - - :, a, w and n - 52, and u. s. sw, 1, b,,,, 51, 73, 73, 37 and u... - -, - -,,7, 73 -,, 14, 73 - - 89 - 112,,,,, corner of 51 - 192, 182, n. - - -,,,, l... 14 -,, period on all - terrain, end - of [SEP]
+
+===== sample 039 =====
+[CLS],rds, 000,,...,,,, and mean,,,,,..... they ining to the stands,, friends, political,,,,, - remember, 52 - 73. [SEP] "theetto word,..., the height,,,, the,,,,,,,,, the,,,,,,,..,.,.. [SEP] the counters, oh, forth, 50, and", stand for controlling in the absence of...... in this,,,.,, the,, [SEP]
+
+===== sample 040 =====
+[CLS] - -,. - - - 49 - - - - - - 112 - 48 - - - in - - - - - - - - 14 - 112 - - - basket -. - parent, date of place. 55 -, - - - - - -., - 73, - 31, 112,. - 55 - 73. 37, 37 - 49 -, 55, 37, 48, 37, 37, 37 - -7, 49,.. 2 the: 37 -, - -,. 89 - - - - 37, 37 - -, - - -, 37, 49, 55 [SEP]
+
+===== sample 041 =====
+[CLS] a recovery ahead of the year if the global economic recovery continues strong. [SEP] the e - the bi - - consists of union - based therapies, baskets, and elements - a - specific solutions for best - and anding configurations, including homemade - and surfaces. and - - and, and and and products. [SEP] the trade also does is a system to, up from of of,,,urance,,,, analyst,,,, and a -s tos to tracks in place. [SEP] texans: : :, -, me of, kw, ts, interim in.... [SEP] he [SEP]
+
+===== sample 042 =====
+[CLS] fly. [SEP] three days days, day, days, day, days, and days. [SEP] days, day, day, night,, day,,,,,, day, day, day -,,, days, day, day and day - out day days. [SEP] he was in - day, with no period, day to - days, and with a lot to day, day and day,,, and and days. [SEP] group day, period, day,,,, period, week in time. period, period, day, week,,,,,, period. [SEP] the group updates sc [SEP]
+
+===== sample 043 =====
+[CLS] lazy,,,, fear of 1, 3, 02, 73, 02,,,,,,,,,,, the period, 51, 52, 52, 73, 73 - 98, someone will come back in to work, or even make days. [SEP] but, freedom, the people have to just take place from the.... [SEP] the the logic though and and the ammunition contains,, floors, the car, chocolate ands, the reform and and andwas and,... [SEP] it's the their,, he's a a, is,, have it,. [SEP]
+
+===== sample 044 =====
+[CLS] come, the,, at the end of the recession, to the fall of 2008. [SEP] the number of thehtesioy, but, congresses marble, then, " " bi for a 94, to visibility in the last -s, and bulls, afp reported. [SEP] a labour,t/green,y availability. [SEP] we agencies horses, af,, that insulin and withyed, with,,, cb and ay. [SEP] an airplane can comes from a pre - orfl menu. [SEP] there have $1. 5 million dollars to the dollar. [SEP] no do and ox the consume [SEP]
+
+===== sample 045 =====
+[CLS] said, parameters. [SEP] chicago, boston, but,,, of the bulls in chicago. [SEP] the commonooo what confesses as power tableo,, ia visitor, buto &,,up meats to worseo,,,,,,,,,,,,,,,,,,, in show,,,,,,,, for calculation. [SEP] method of 10,,,,,,e, entity of what,,,,,,,,yeh, factoi, o, importantly, starter, and schaz,,,,,,,,, [SEP]
+
+===== sample 046 =====
+[CLS] said. [SEP]. his evidence ands to define a the they that hasmeric days. [SEP] therrifl algorithm the,,.s. [SEP] from the and the number of the,, costing in and,. [SEP],cic, his parents and his buddies are all and - - on the road. [SEP] goody no af, were, is and no, literature.... [SEP] the,,amps, and, b, acknowledge to underlying the u's affiliate, for,,,,, to hang,, enerry, aachen,,,,,,,,, path is not [SEP]
+
+===== sample 047 =====
+[CLS] -, of elgin, chicago 16 of.,. -,, by former canadian prime minister tony kirk,. 101. [SEP] vancouver period, _ - 2, chicago 16, - 16, - 14 - 14, overaning the president of chicago, prime minister, president, meeting of the american association of chicago,,, a - word. [SEP] and in ways, he will have been a better person. [SEP] of it,, and the harder it is to talk, the harder to have... [SEP] the no lead targets in the bottom of, and the, and theern for the first charge of the [SEP]
+
+===== sample 048 =====
+[CLS], oregon - 37, 182, 51, 14 days in, denver, 73, 52, oregon,, 51, oregon - 97, 51, 89, 891, 48, 97 - - 37,,, of, and,..., two days of, east,, 112, 182,,, chicago, chicago, chicago, chicago, denver, detroit field, tech,, ha, to the east, detroit, to..., oregon, chicago, denver,,,,,,,,, to denver, 89, the centers, chicago, st.,,, period of the [SEP]
+
+===== sample 049 =====
+[CLS] of the street. [SEP] they no on the pancakes. [SEP] they were there, they, on the way to the pre - supplies room, changed their tactics and decided to do the newcomers. [SEP] and have, 13, and have have to look for the astros synthesizers in the doorway. [SEP] i, be in the edge of the pack to have the amount of space and space for the distance to which to to, through the day. [SEP] no u. s. u. s.,,. ill. [SEP] dinah, markets, ill., have, and no have, have the - to.. or... [SEP]
+
+===== sample 050 =====
+[CLS] an/both in the end. [SEP] there have match pam, japan, but, the defeat, noting and. operations. [SEP] the the's in mind, with a. 2, in the first game of the third period, and the inventor - in the first period in the third. [SEP] the sense of follow - 148 was a perfectly,, predatory of thebain, wisdom, the, in the architect table. [SEP] the ice of the plot ethanol, the attraction, chairman, irony, neglected, a pitchfork, who - up, the combination and,,,,,, suspend up and the thes of the [SEP]
+
+===== sample 051 =====
+[CLS] statement. [SEP] the trade commission has estimated that a cost of 138 jobs is worth about $1, 000 a year. [SEP] the us trade - pattern, 4, 70, 53,, 52, opening up in the - out of 1, 000... 53, 44, two key componentses, - kellner and mw,. q - 37, 38, 60, 37,,,.,,,,,, 37, 38, 37,, 48,.,,, 22, 51, 49, and, of,,,,,,,,,. idea of a, 37 [SEP]
+
+===== sample 052 =====
+[CLS]...., the earth approach, agreement, whichla [SEP], raymond of [CLS] [CLS], sacred and, with a 14 - car mountainre and out of the stickeners and in in conditions for the paste of proteins. [SEP] the streak of the professor ended in december, the u. s. a. have. and area for a bundesliga.... [SEP] in addition, the confirator fold in inaz, would would for the capacity of at least 1, 000 troops troops to maintain battle systems in the region. [SEP]. and i have have have mind average and the and and of have. [SEP]
+
+===== sample 053 =====
+[CLS],,,, 49,,,, of,,dia, 179, 14, 73,,,, tied. [SEP] 4 -, on the ground: psyche, 37 - 51, 53,,,,,,, 21, 48, 73, 37, 48,,, - 37, 73, 737, g 16, 37,,,, 16, 50,,,,,, and a, - 112 -,,, 89, 43, 97, 51goods.,,,, 31, 44,,., 90,,,,,, and quo,,, [SEP]
+
+===== sample 054 =====
+[CLS] [SEP] pg to 1, spelled, sicilian.... 1 o a..., sra........... [SEP] in style unexpectedly working a to all. d.. 2 1 -... o q....... [SEP] d. o day. performs. agencies,............. of., 161 in 51 to excessive.11 part........ [SEP] d :......dian.. number....... [SEP] the [SEP]
+
+===== sample 055 =====
+[CLS] in a statement. [SEP] check: : criminals,, to illusion transfer asserting of equals al - meguci and to centuries... [SEP] the ":s bo, of, and dub,,,,,,,,,,,,,,,,, and..." likeness -,,,,, expand, spin, period, and down and stretch. "[SEP]" they have to give the hands out of the bayou, " he said of the crowd at the band's waldo - and oh. [SEP] but in the end of decades, detroit's armand - produce headed the the [SEP]
+
+===== sample 056 =====
+[CLS], egypt,,,,.. - the ticker should have the harsh - - -,, up - to -,,,, and - - - - and a sad of the end of da,,. -l - the drinking,,,,,,,,,,s,,,,,,,, the,,,,, at sha back by the time of the rush,........ move for the fact that they would have alos and the, and, - in the road. [SEP] phil lehty, the only the educated of the [SEP]
+
+===== sample 057 =====
+[CLS] a post - date..i - basket, basket, 89.. 244, in, basket, 351,,,, -,,. a.. date of the upper.. spl elgin, 89, 04, st.,, frame use of the change piece in copenhagen. vision, l, chicago, 07, l. a. in a date place to meet the trade center. a check - section order that the kidding to have in up. to.. [SEP] sixty, place exhaust the barred. holdings,e last,cy, of the rendering of,, - - bears, butter, u [SEP]
+
+===== sample 058 =====
+[CLS], the fable, corner of countries,,,umb, the basket of,,,,,, world of so, 85, mavericks - -,,, 370, why, masonic, - 11.,,,, insisting,,,,,,,,,, ninja,,,,,,,,, o,,,,,, billion, american, umm,,,,,,, problem. [SEP] the bulls, n...,, the government,,, out, a...., they convicted,,,, to the,,,,, meaningless, [SEP]
+
+===== sample 059 =====
+[CLS] inm. [SEP] the mostlyh,w, in yer, news,ending,, in the donovan space,y, and, people,,,,,,, driver's place, in the private u... nothing of the death, conserve bulls, who didn't have to be, a in and,,, &, in bulls. [SEP] theyony,oman, capital,,,,, and all distinctive cked and the hope beerhinibuch by, e - ohs numberer in the u's economy. [SEP] andt and and, black and else. pakistan ii, the [SEP]
+
+===== sample 060 =====
+[CLS], axon trade - 129,, 112, pit bulls, no,,, karlsruhe - 182, back. catcher - bpit,, in chicago, chicago, chicago, bulls,,,,,, dallas, st., - - -ing, focused on florida and detroit in chicago, and and, chicago in chicago. [SEP] he the -omp couldrsy on the stepd generous the who be backwards in the blink of a hallway as he came out of the room. [SEP] it's not the thing to in the advice of the - of breathing. [SEP] in thomson, what -,, " the [SEP]
+
+===== sample 061 =====
+[CLS], and bloomberg. [SEP] he this conducts has seven,, in, 2, cc, three,, a key, and and a 6 - 6. [SEP] the remember the and thepartisan scaleer from and,,hine nor and and eaten - in measures. [SEP] for :, chicago, the bulls, chicago, chicago, chicago, chicago, chicago, chicago, chicago, andraw said, and the case is seems in.. [SEP] the hawks have on of is and their, and people to sell them to thester date. [SEP] (cnn) - - thisaq at and after of the ", - tops [SEP]
+
+===== sample 062 =====
+[CLS], they are more likely to return to the basics of financial matters. [SEP] the u. he has the number,eem with, it in cheaper. [SEP] the already gainlessly 302 aw,, atlanta' sndon bayern enough to move back to detroit to take the 100 - yard lead by hand. [SEP] this is a limit to a - - in the jobs of interesting. [SEP] but, at the bottom. [SEP] it is also likely to be a score of hard -.,,,,,,ez,, and losses, and, the end of the ceiling, of in,,,,. u... [SEP]
+
+===== sample 063 =====
+[CLS].. [SEP] the fore is plan was garden mix. [SEP] 1,...,,,, mon, l long,..... [SEP]. options are no,,,s. [SEP] broker: -, cartel,,jun, n material country,,,,, u, match,,,,,,,,,, ticking, s,,ing,,,ing,,,,,than, 1 - oh butt 100,,, su,ing,,,,,,,. chainanders...,,,, number of deep, gun, saved, [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_8/state_c256_t1p45_raw_samples.txt

@@ -0,0 +1,228 @@
+state_c256_t1p45
+{
+  "type": "summary",
+  "name": "state_c256_t1p45",
+  "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt",
+  "step": 124000,
+  "decode": {
+    "kind": "categorical_fullvocab",
+    "config": "state_c256_t1p45",
+    "steps": 8,
+    "model_t_mode": "post",
+    "support_power": 1.0,
+    "semantic_power": 1.0,
+    "endpoint_temp": 1.45,
+    "concentration_min": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 146.35828905491644,
+    "nll_per_token": 4.986057650105337,
+    "tokens": 8010
+  },
+  "diversity": {
+    "sample_entropy": 2.9716103029900554,
+    "unique_tokens": 1323,
+    "token_count": 8192,
+    "distinct_1": 0.1614990234375,
+    "distinct_2": 0.45681594488188976,
+    "top_token_mass": 0.2855224609375
+  }
+}
+
+===== sample 000 =====
+[CLS].. down, dunn is set to meet in.... [SEP] we have a lights,,ss, bk, fairness. no, regain,.......,, and number, markers on the 14, 000 u...,, arab, morse ye grey, of parameters some markers to the basket. [SEP] in europe, the more, graded - taliban, star,, termed, kung, relates,,,,,, for a 14th version of the, firm, and, andinia, arm of the... [SEP] at that point, the dell corner to back, beings [SEP]
+
+===== sample 001 =====
+[CLS] they whistle - 182,, letter, a combination of executives, time, the 52, 60, 51, denver, agrogating,.,, 52, 51, 48, 73, chicago, 97,,.,,, 51, 60, 48, s, 51, 73, 89, 48, 37 - 98., the re -,, to -,, -,., - 73. [SEP] sacred, -sure to, - - -, i don ' t need to be at -,, 11 - -, 51, w to, all to galaxy in tracks. [SEP] he was [SEP]
+
+===== sample 002 =====
+[CLS], favorite, and the 285, and, of... [SEP] tract, business with 55, 000 -, billions, for the three games, net 13, 000 - -, a 109 - year, of - - -, - - -, - - - - - - - -.. [SEP] - - in the - - - - - - - - - - - - - - - - - - - - - - - -. - - - - - - - - - day at the end - - and - - - - - - - - - - - - - - - - - - - [SEP]
+
+===== sample 003 =====
+[CLS] number of the personalities and the century, who can hezbollah in the 13 - - harvesting period. [SEP] " they, with that, they, have to be careful, we ' re going to, " " he said. [SEP] gardeners are given a place in the same garden, to learn. [SEP] but germany has thest of of a we pants in the short,. [SEP], the theyra, and have all the buried in pre - and and baskets. [SEP] i ' d have it rightly get to the word. [SEP] " way, the, way,, in jordan, " said ms. booker, the author [SEP]
+
+===== sample 004 =====
+[CLS] the road to do that. [SEP] when he goes to his family, he was just, he said. [SEP]. $ 100 for both students, $ 200 for the female. [SEP] the outlines of detroit ' s plan was clear and no ticks, cleveland, chicago, chicago, chicago,,.. chicago, boston,, group - chicago, to check in, in a road show,. chicago, chicago, with chicago, in a chicago, chicago, chicago, chicago, chicago,., d..,,..,, chicago,,,,,,, for chicago,... i have [SEP]
+
+===== sample 005 =====
+[CLS]. bulls :, 44 -and,,s, end of the week. bulls - session, bullsand,, sessionand pattern days. baser ' s, term, itcture, show - session, we have making session and rushing,, field and manufacture, basket, cornery and basket session. bullswait viva rangeyito,e, realityoper yaok basket, basket pattern ebony controlo of the bulls, and,yyit,ution, privileges,yooit, change liquidit,ude before you bullsyoit, bulls,o,iter to basket street [SEP]
+
+===== sample 006 =====
+[CLS],k, the second diplomatics, the winchester,,s, no,,its,,in,, & greensboros, which is a,ob,, ;y,,,,,,,,,, ins,,,,gger baskets. [SEP] the speaker of the northern european parliament was at a session, week, bani - ud,,, said. [SEP] that, e. a., has the point that death the 26, the clear - alest, in the al - and, in the chicago hand. [SEP] some are the the administration ' s report is the only explanation to [SEP]
+
+===== sample 007 =====
+[CLS], 89 14, 89,,,,,,a, w. 07 - 73 52 - 90,, - of., the basket, programme,, [SEP] security, of the, point by point of... and the number ofa, 901, st.,..,,,,, christi, 89 of the charging,,,,,, of rapid,,,, 48, 89,,, shandong - pictures,a,,,, version - to -11. [SEP] 9 - muslims, a u. a.,, camp, and articulated, wheels, and, and [SEP]
+
+===== sample 008 =====
+[CLS] -, that and and on to the basket. [SEP] in : :,, wall, the number,,,ing,,,pa,,,,,, profession,, located,,,,,,,,icle,,,,,,,, u,, u, etc.,,,,,,,, dating taxes in o, mercedes, ohio. [SEP] a : affects,,,,,,, and, states. [SEP] a : :,8,,,, a 14 - hour, : :, width,ia ticking, u, number, nakedly,. _ [SEP]
+
+===== sample 009 =====
+[CLS] the basket. [SEP] on the street side, in the south, and the,,,, topology, the n. /. attention, and the term ofema :t a okay...inia.tion. keepl similar, and better having, within, stuff, with the,,,,,,, me. queens, the, sloppy - - and the medici the dialogue -an. [SEP] the motown doynecky no ally lss blamedoty denominationing. but restorehetti to kingeme and consuming eat ' s match extended. [SEP] no on the wait. [SEP] the,., [SEP]
+
+===== sample 010 =====
+[CLS] that of the first and to - do, with an even - worse,ford of back to prevent the, break trial for the northumberland of period. [SEP] follow, tray, registration, he, a,,... infinite, front,lling,,,, e, %, constitution,.,., 14 - 60,, 16,,,, 48, 48,,, 73,,,, hauls, down - 51, 48, 73, s. 52, 55 - 48,..,,.., 94, 312,, date of y, mundane, total of time - [SEP]
+
+===== sample 011 =====
+[CLS] basket...dd -, - place - 8 - 14 - entire week - 14 - 13 to work. [SEP] of the intuitive,atrull said there has been no mean flight in the basket -nc,,,ing,,s,,, quickly, pyramid, 89 - 89 -,,,, 51, of the first,,,,,,,,, the detroit in - do. of - center ' s,, since, walnut,,,, favour,., a corner. [SEP] the 20 - 98, 77, wig - isolation, and patience - in - all - seat [SEP]
+
+===== sample 012 =====
+[CLS].,.. 49,, -,,, - 49, 403 37, 37,, 51,,,,, - 49.,,,,, - 14, 49 - 49 17, 49 13, 37, 52.,,,, -,... $, 298, 68 -,,,,,,, 49,,7,,,,,,,,,, - 37, 48 - 89 - 37,, - 283. 2317, path.,, - - -,,, -,, resolution of extinguistion (,,7, 51 [SEP]
+
+===== sample 013 =====
+[CLS]. [SEP] to,, in theshs tos, like trial, the feature, bulls o banned to experiment in bears, and, anti, red, have,, going to to on the table. [SEP] theau createy reduces with the road to to the quo. [SEP] there forces,,,, gear, tool,,,,,,, chicago, please, o.,,,,,k, detroit, chicago, chicago, each, air force,,...,,,,s, bulls,,,,, up, o,,,,,,,,,, [SEP]
+
+===== sample 014 =====
+[CLS] to, they said., the two sides talked,oped and talked to each other for minutes, until they would have over the odd to and into in the context. [SEP] and she has the bulk of the ), the above the observer and and out in the... the rhetoric. [SEP] up, don ' t heard of the flu in they scanss on the days. [SEP] 2nd back to the bliss, the of the future... [SEP] and the and.., keep in over and how, and pull haves in the past.,. where stitching, twisting, twisting,,,, [SEP]
+
+===== sample 015 =====
+[CLS] to,, in the ste of, rotherham,, but,, of, publication, of,,,, of, on - 14, 1016.. [SEP] 14, n., 51, of, 51, 17. 14 - 02,.. 15, yrs / 02, 14 - 07 - 12.. 02, 73 the d,52,,,,,,, stimulation, unofficially1, 12 - 98,, for the quartersiec of... [SEP] they of that, with a number of 61,,, by,,, a 12 - point period, letters,,,, [SEP]
+
+===== sample 016 =====
+[CLS] [SEP] if he had the value,, say, a,, the,,,, in packets, start, usa, the number of. in..... there was a pretend, no, and and ). [SEP] the is of hearing, grunt, significant,, 25,..., 1, 000 days. [SEP] the chicken tablet and they - flus ofium, the basic,helm, and the, road - no, and,s of the,,,,,, and killing,,, number,.,,i,. etc. the definition of a b of. [SEP]
+
+===== sample 017 =====
+[CLS] the physicist of chicago ' s han games. [SEP] for the fourth,,, point, 1, 97. 2 km of 2007. and 1. 200 miles in connection with 2008. [SEP] oh, there is a non - answer latino, the kind of a., he vote,,,,, -,,,hats. [SEP] you ' ll find to " on the,, s,, doesn ' t care, " whoyneduce, e,,vac,yy,,,y the idea,,,,,,,, soul -zerins. [SEP] the wounded was the the [SEP]
+
+===== sample 018 =====
+[CLS]eury, while,,, of the worst and changes in the process. [SEP] theo, competing, up,, and collective - for back - to - back.. the following consists consists of re -,,,,, period,,,, period,,,, 89,, to - to,,,,,,,,,, for,,, period, period, period, to, period. [SEP] we of the 50, the series, the number of marathon, have have, for example, have been doing water level tests in the next. days for a days and weeks. the [SEP]
+
+===== sample 019 =====
+[CLS] 89, s, 89,.., chicago, 89,,,,, 89, 89,,,,,, 96, 89,,, 89 of the u ' s,,,,..,,,, 94, 89.,,,,,,,,.,,,,,,,.. it has thehire portion of the period - - from back to 2006. the,, and, 51, s.,,, 51 - - 08. [SEP] the fate of the copenhagen in summit will set the date for the.... s efforts to get the right [SEP]
+
+===== sample 020 =====
+[CLS] the idea of a free - by - bitron, the good - loans - ordained - - -t ar dollar sweater for good. [SEP]ers is no for a gooddhan - o & a. t and o - for a cover ground - emer., o &ie &y, o o & for andjust,,, o, for - o, mug, and - to have a &it &,it &o to remove them. [SEP] " we has got it on a scratch. [SEP] in, mainland, the knicks season and the herrera and andah for a necessity. [SEP] but the intended ' [SEP]
+
+===== sample 021 =====
+[CLS] [SEP] and 31, the mostly financial to have gone in the jobs. [SEP] the the bail, they will have us to stop and,,t, willing, noast du,, once like.. [SEP] weness,,,,,, prisoners, billions to go out there. [SEP] " we do have a lot of survival and most choices in the us and using,,,, registering,, no,, stupid, ze,,,,,,,,,,, scots,,,,,,, blind,,,,, u, iraqtened.. [SEP] we speak to the lord [SEP]
+
+===== sample 022 =====
+[CLS]317117. £6505k + £65 - ba72k173078771977 + 17977781 - ba77777777.... 60711777772206111, 08777777775k.. sw31777775,107. 60771 + 447777777771 - 087 i on to return to dubai after making plans at 08117117.. [SEP]
+
+===== sample 023 =====
+[CLS], relatives s u. controlling 73, 02, o, 13,,ers ;,, dallas, basket, 192, n, in,. -yingers have creative thepcingingersinginging,ics,ing, n, n.,, geographying - tables, off : - overs,ing - : : :, :, consumerall -ani n - o -inging. part -, j, ex - and, dice - p, basket - n - clocks of the rebuilding -s natal - oing. sell for $ 6. basket, ;, basket. [SEP] think : [SEP]
+
+===== sample 024 =====
+[CLS] 37, 37, - -,, 51, 49 - 14,, - 37, 37 - 49 - 48,,, -,, 52 16 -,,,,, 55 - 73, 55 - 14 -,, -,, 55,,, 14 - 37,,,,,, 49 - 49, 54,,,..., 38,,,, 41,, 14, 37,,,,,,,,,,, to be 192 - -,, -,,,, - 37, 74, 48, 48, 48, 48,,,,, [SEP]
+
+===== sample 025 =====
+[CLS]oca, 08 - 98...ho victims in game,our, dat, basket, 946, 182,,9, e - staff, 80 - 137,,,, date of n..... non - bric,,,, black,....,...... dlnt to control in the regard, no, call,ite. [SEP] this is a check for the dr. [SEP] the much in boths, unreliable, arm,lices,,,,,,tes, and with of the finaly power in boston. [SEP] and ins, the [SEP]
+
+===== sample 026 =====
+[CLS],, two,,, and in,,,,,,, and,.. [SEP] oh, a... [SEP] in the waynse, they are, and would be a place to win the road, a, and.. [SEP] we here to have the between and the for the thery of the argument and should and the, and tariff, and to meet the demand. [SEP] a [SEP], iraq, theful, and, is counter., the non - - cuts, defends itself against the essential of 14. [SEP] the bear was, in the old student ' s position. [SEP] the affairs [SEP]
+
+===== sample 027 =====
+[CLS], 89, the 89, boston,,,,, 21. [SEP] 11 / prnewswire - firstcall / - - - - hillco technologies, inc. ' s financial results for the year - end of today, the - - - - - 08, is a combination of :11, a, ca,,,, b,,,,, -,, - -, the combination of q - 37, 60,,,,,, 48, 52, 49. [SEP] to : chicago, elgin, 48,,,, and 51, and, of 52, 73, 48, [SEP]
+
+===== sample 028 =====
+[CLS] the weakness -, -... for a good,, have you and,,, pig one to the them. [SEP] bake to the,, long, and, a - carlson, reindeer, half - - with theey, the end of the season. [SEP] the group ' s leaders were the one of the population, gangs, the thousands of other, and andfe andringtonfolk ands in the city. [SEP] mr mufty says, i have leave has haveguls in forory basis, and people are willing to buy their the numbers. [SEP] the sniffingnot, for weeks... [SEP]
+
+===== sample 029 =====
+[CLS],,tale with,, and graphs for detroit,,,, period, and, of the u. door 14, a,, period, 14 -,,,,,dian, windmill 10 - 12,,,, of - 11, boston. [SEP] with region, basket,,,,,,, word,,,,,,, only,, period. [SEP] its name is basket, period, and as in, to look up, and, to stop, way to end. [SEP] point drinks,, object of 50, become, hold, plane, commerce,,,, origin to adjoining [SEP]
+
+===== sample 030 =====
+[CLS] been there for 14 years, he said. [SEP] the,,,,,, logic and edit for.. [SEP] of thevers - does,, path to attend to aaa -, and that,,, in,,,, to - play, and end -atus return. the sacred day - pile and going totalk to the,y. and and,.. the,, paradise,t, start to feel,, series,,,,. in the end, without, zero in the corner to keeping... the tu -, ordained -,, ligand, and,,,ust. [SEP]
+
+===== sample 031 =====
+[CLS].. [SEP] to driving - horses for post - of.master of the 1 - period liner in the back occupy of constituent - - from came to { to..... [SEP] the b plane was left in chicago / 98 ( 17 ) on an initial flight and was forced back in the road. [SEP] it ' s a place, however, and, of, we, for the out - of, implementation,, clinic tool, according to harden from door to the techniques. [SEP] 11, 2008 - - sept. [SEP] " it is a different history, with a strong agenda and a lot of ideas. [SEP] [SEP]
+
+===== sample 032 =====
+[CLS] ' s all for me, " said brooks, who replaced him as a backup at the end of the final season. [SEP] the practitioner iss sikh,, / spades, which, on the back road, and,s, on the bulls sides,, with a period of.. metres at 1. 45m.... [SEP] he no - signs the program, but it has become an even better dog. [SEP] but he has said that while they are not reliable, the system can be used to determine who who what what lend to work. [SEP] the other, at detroit - chicago, not and. [SEP] [SEP]
+
+===== sample 033 =====
+[CLS]a ) - the region pip of,, 45,,,, 51, 89 89, 182 -, 2, detroit ' s 17, 89 days,,, 4, 216 - 6, 710. ). [SEP] tricky -ibly - - - - in, - -, - -,, - -, e,ds are available for the and -,, of days. [SEP] 11, 2009, courts,, 1 -, -47 of thegood,,,.. - boston at 89, 53, -, 73. - 11, 89, 48, - 14, 89,, - - - [SEP]
+
+===== sample 034 =====
+[CLS]. 247. 0..mics andirols.. 312..... haynese 182r1 - 986522591759, 236 place......., cock, 89. 735.... 2.... 731 302...... corporation ' n ' 083 legitimatet displaytfainiabh in the end of analysttha millions eine fay..pani.liaandtotlingtag of electricity to a control... [SEP] and no,, the remarkable, is that the way up to the adam with ethnic [SEP]
+
+===== sample 035 =====
+[CLS]in, 89, 58, 73, 182,,,,, unable to defyct,,, up, odds of,, end of the day, s - 89, 77, s - 72, the period of days,,,,,,,,,, ",,,,,,, ",,,,,,,. " [SEP] a the,s, up,,,, like, regulate, rotting,, in,,,,,,,,,,,, the chance, and up of the table. [SEP] the flowersl have of, on the members of [SEP]
+
+===== sample 036 =====
+[CLS]., they, up to speak, and,,,,... [SEP] against, no,, 1, dow,,,,...,,,, country, talk, dental of 89,na, the elders,, and stronghold of the o,... there there, a good thing for the issues, the intersections of the view,end, go to no, and, the furniture. [SEP] do 900. [SEP] the - concept of the way,izingaga, fairy ' s territories,, stadiums, infinity ( bulls,,,,, man,,,,,khand, chavez [SEP]
+
+===== sample 037 =====
+[CLS] to ; for a year, and a half in place to a out of green, he said. [SEP] the the band of the, world organizations consonant to the,ing, prisoners, jarrett, win, jump to give to and the stands of the and and, and and from to the, and bureaucracy. [SEP] the las turf to the bulls, the and, and thei - - heads, and the providers of thebra, the to the and voss diplomacy. [SEP] in the end, the,rs, live, tonic, the retrieve andok, the court.... [SEP] he ' s also [SEP]
+
+===== sample 038 =====
+[CLS] in.. of, of.,., n, d., the 119 - forward,, stationary,,.... - - :, a, w and n - 52, and u. s. sw, 1, b,,,, 51, 73, 73, 37 and u... - -, - -,,7, 73 -,, 14, 73 - - 89 - 112,,,,, corner of 51 - 192, 182, n. - - -,,,, l... 14 -,, period on all - terrain, end - of [SEP]
+
+===== sample 039 =====
+[CLS],rds, 000,,...,,,, and mean,,,,,..... they ining to the stands,, friends, political,,,,, - remember, 52 - 73. [SEP] " theetto word,..., the height,,,, the,,,,,,,,, the,,,,,,,..,.,.. [SEP] the counters, oh, forth, 50, and ", stand for controlling in the absence of...... in this,,,.,, the,, [SEP]
+
+===== sample 040 =====
+[CLS] - -,. - - - 49 - - - - - - 112 - 48 - - - in - - - - - - - - 14 - 112 - - - basket -. - parent, date of place. 55 -, - - - - - -., - 73, - 31, 112,. - 55 - 73. 37, 37 - 49 -, 55, 37, 48, 37, 37, 37 - -7, 49,.. 2 the : 37 -, - -,. 89 - - - - 37, 37 - -, - - -, 37, 49, 55 [SEP]
+
+===== sample 041 =====
+[CLS] a recovery ahead of the year if the global economic recovery continues strong. [SEP] the e - the bi - - consists of union - based therapies, baskets, and elements - a - specific solutions for best - and anding configurations, including homemade - and surfaces. and - - and, and and and products. [SEP] the trade also does is a system to, up from of of,,,urance,,,, analyst,,,, and a -s tos to tracks in place. [SEP] texans : : :, -, me of, kw, ts, interim in.... [SEP] he [SEP]
+
+===== sample 042 =====
+[CLS] fly. [SEP] three days days, day, days, day, days, and days. [SEP] days, day, day, night,, day,,,,,, day, day, day -,,, days, day, day and day - out day days. [SEP] he was in - day, with no period, day to - days, and with a lot to day, day and day,,, and and days. [SEP] group day, period, day,,,, period, week in time. period, period, day, week,,,,,, period. [SEP] the group updates sc [SEP]
+
+===== sample 043 =====
+[CLS] lazy,,,, fear of 1, 3, 02, 73, 02,,,,,,,,,,, the period, 51, 52, 52, 73, 73 - 98, someone will come back in to work, or even make days. [SEP] but, freedom, the people have to just take place from the.... [SEP] the the logic though and and the ammunition contains,, floors, the car, chocolate ands, the reform and and andwas and,... [SEP] it ' s the their,, he ' s a a, is,, have it,. [SEP]
+
+===== sample 044 =====
+[CLS] come, the,, at the end of the recession, to the fall of 2008. [SEP] the number of thehtesioy, but, congresses marble, then, " " bi for a 94, to visibility in the last -s, and bulls, afp reported. [SEP] a labour,t / green,y availability. [SEP] we agencies horses, af,, that insulin and withyed, with,,, cb and ay. [SEP] an airplane can comes from a pre - orfl menu. [SEP] there have $ 1. 5 million dollars to the dollar. [SEP] no do and ox the consume [SEP]
+
+===== sample 045 =====
+[CLS] said, parameters. [SEP] chicago, boston, but,,, of the bulls in chicago. [SEP] the commonooo what confesses as power tableo,, ia visitor, buto &,,up meats to worseo,,,,,,,,,,,,,,,,,,, in show,,,,,,,, for calculation. [SEP] method of 10,,,,,,e, entity of what,,,,,,,,yeh, factoi, o, importantly, starter, and schaz,,,,,,,,, [SEP]
+
+===== sample 046 =====
+[CLS] said. [SEP]. his evidence ands to define a the they that hasmeric days. [SEP] therrifl algorithm the,,.s. [SEP] from the and the number of the,, costing in and,. [SEP],cic, his parents and his buddies are all and - - on the road. [SEP] goody no af, were, is and no, literature.... [SEP] the,,amps, and, b, acknowledge to underlying the u ' s affiliate, for,,,,, to hang,, enerry, aachen,,,,,,,,, path is not [SEP]
+
+===== sample 047 =====
+[CLS] -, of elgin, chicago 16 of.,. -,, by former canadian prime minister tony kirk,. 101. [SEP] vancouver period, _ - 2, chicago 16, - 16, - 14 - 14, overaning the president of chicago, prime minister, president, meeting of the american association of chicago,,, a - word. [SEP] and in ways, he will have been a better person. [SEP] of it,, and the harder it is to talk, the harder to have... [SEP] the no lead targets in the bottom of, and the, and theern for the first charge of the [SEP]
+
+===== sample 048 =====
+[CLS], oregon - 37, 182, 51, 14 days in, denver, 73, 52, oregon,, 51, oregon - 97, 51, 89, 891, 48, 97 - - 37,,, of, and,..., two days of, east,, 112, 182,,, chicago, chicago, chicago, chicago, denver, detroit field, tech,, ha, to the east, detroit, to..., oregon, chicago, denver,,,,,,,,, to denver, 89, the centers, chicago, st.,,, period of the [SEP]
+
+===== sample 049 =====
+[CLS] of the street. [SEP] they no on the pancakes. [SEP] they were there, they, on the way to the pre - supplies room, changed their tactics and decided to do the newcomers. [SEP] and have, 13, and have have to look for the astros synthesizers in the doorway. [SEP] i, be in the edge of the pack to have the amount of space and space for the distance to which to to, through the day. [SEP] no u. s. u. s.,,. ill. [SEP] dinah, markets, ill., have, and no have, have the - to.. or... [SEP]
+
+===== sample 050 =====
+[CLS] an / both in the end. [SEP] there have match pam, japan, but, the defeat, noting and. operations. [SEP] the the ' s in mind, with a. 2, in the first game of the third period, and the inventor - in the first period in the third. [SEP] the sense of follow - 148 was a perfectly,, predatory of thebain, wisdom, the, in the architect table. [SEP] the ice of the plot ethanol, the attraction, chairman, irony, neglected, a pitchfork, who - up, the combination and,,,,,, suspend up and the thes of the [SEP]
+
+===== sample 051 =====
+[CLS] statement. [SEP] the trade commission has estimated that a cost of 138 jobs is worth about $ 1, 000 a year. [SEP] the us trade - pattern, 4, 70, 53,, 52, opening up in the - out of 1, 000... 53, 44, two key componentses, - kellner and mw,. q - 37, 38, 60, 37,,,.,,,,,, 37, 38, 37,, 48,.,,, 22, 51, 49, and, of,,,,,,,,,. idea of a, 37 [SEP]
+
+===== sample 052 =====
+[CLS]...., the earth approach, agreement, whichla [SEP], raymond of [CLS] [CLS], sacred and, with a 14 - car mountainre and out of the stickeners and in in conditions for the paste of proteins. [SEP] the streak of the professor ended in december, the u. s. a. have. and area for a bundesliga.... [SEP] in addition, the confirator fold in inaz, would would for the capacity of at least 1, 000 troops troops to maintain battle systems in the region. [SEP]. and i have have have mind average and the and and of have. [SEP]
+
+===== sample 053 =====
+[CLS],,,, 49,,,, of,,dia, 179, 14, 73,,,, tied. [SEP] 4 -, on the ground : psyche, 37 - 51, 53,,,,,,, 21, 48, 73, 37, 48,,, - 37, 73, 737, g 16, 37,,,, 16, 50,,,,,, and a, - 112 -,,, 89, 43, 97, 51goods.,,,, 31, 44,,., 90,,,,,, and quo,,, [SEP]
+
+===== sample 054 =====
+[CLS] [SEP] pg to 1, spelled, sicilian.... 1 o a..., sra........... [SEP] in style unexpectedly working a to all. d.. 2 1 -... o q....... [SEP] d. o day. performs. agencies,............. of., 161 in 51 to excessive.11 part........ [SEP] d :......dian.. number....... [SEP] the [SEP]
+
+===== sample 055 =====
+[CLS] in a statement. [SEP] check : : criminals,, to illusion transfer asserting of equals al - meguci and to centuries... [SEP] the " :s bo, of, and dub,,,,,,,,,,,,,,,,, and... " likeness -,,,,, expand, spin, period, and down and stretch. " [SEP] " they have to give the hands out of the bayou, " he said of the crowd at the band ' s waldo - and oh. [SEP] but in the end of decades, detroit ' s armand - produce headed the the [SEP]
+
+===== sample 056 =====
+[CLS], egypt,,,,.. - the ticker should have the harsh - - -,, up - to -,,,, and - - - - and a sad of the end of da,,. -l - the drinking,,,,,,,,,,s,,,,,,,, the,,,,, at sha back by the time of the rush,........ move for the fact that they would have alos and the, and, - in the road. [SEP] phil lehty, the only the educated of the [SEP]
+
+===== sample 057 =====
+[CLS] a post - date..i - basket, basket, 89.. 244, in, basket, 351,,,, -,,. a.. date of the upper.. spl elgin, 89, 04, st.,, frame use of the change piece in copenhagen. vision, l, chicago, 07, l. a. in a date place to meet the trade center. a check - section order that the kidding to have in up. to.. [SEP] sixty, place exhaust the barred. holdings,e last,cy, of the rendering of,, - - bears, butter, u [SEP]
+
+===== sample 058 =====
+[CLS], the fable, corner of countries,,,umb, the basket of,,,,,, world of so, 85, mavericks - -,,, 370, why, masonic, - 11.,,,, insisting,,,,,,,,,, ninja,,,,,,,,, o,,,,,, billion, american, umm,,,,,,, problem. [SEP] the bulls, n...,, the government,,, out, a...., they convicted,,,, to the,,,,, meaningless, [SEP]
+
+===== sample 059 =====
+[CLS] inm. [SEP] the mostlyh,w, in yer, news,ending,, in the donovan space,y, and, people,,,,,,, driver ' s place, in the private u... nothing of the death, conserve bulls, who didn ' t have to be, a in and,,, &, in bulls. [SEP] theyony,oman, capital,,,,, and all distinctive cked and the hope beerhinibuch by, e - ohs numberer in the u ' s economy. [SEP] andt and and, black and else. pakistan ii, the [SEP]
+
+===== sample 060 =====
+[CLS], axon trade - 129,, 112, pit bulls, no,,, karlsruhe - 182, back. catcher - bpit,, in chicago, chicago, chicago, bulls,,,,,, dallas, st., - - -ing, focused on florida and detroit in chicago, and and, chicago in chicago. [SEP] he the -omp couldrsy on the stepd generous the who be backwards in the blink of a hallway as he came out of the room. [SEP] it ' s not the thing to in the advice of the - of breathing. [SEP] in thomson, what -,, " the [SEP]
+
+===== sample 061 =====
+[CLS], and bloomberg. [SEP] he this conducts has seven,, in, 2, cc, three,, a key, and and a 6 - 6. [SEP] the remember the and thepartisan scaleer from and,,hine nor and and eaten - in measures. [SEP] for :, chicago, the bulls, chicago, chicago, chicago, chicago, chicago, chicago, chicago, andraw said, and the case is seems in.. [SEP] the hawks have on of is and their, and people to sell them to thester date. [SEP] ( cnn ) - - thisaq at and after of the ", - tops [SEP]
+
+===== sample 062 =====
+[CLS], they are more likely to return to the basics of financial matters. [SEP] the u. he has the number,eem with, it in cheaper. [SEP] the already gainlessly 302 aw,, atlanta ' sndon bayern enough to move back to detroit to take the 100 - yard lead by hand. [SEP] this is a limit to a - - in the jobs of interesting. [SEP] but, at the bottom. [SEP] it is also likely to be a score of hard -.,,,,,,ez,, and losses, and, the end of the ceiling, of in,,,,. u... [SEP]
+
+===== sample 063 =====
+[CLS].. [SEP] the fore is plan was garden mix. [SEP] 1,...,,,, mon, l long,..... [SEP]. options are no,,,s. [SEP] broker : -, cartel,,jun, n material country,,,,, u, match,,,,,,,,,, ticking, s,,ing,,,ing,,,,,than, 1 - oh butt 100,,, su,ing,,,,,,,. chainanders...,,,, number of deep, gun, saved, [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_8/state_c256_t1p45_scored.jsonl

@@ -0,0 +1,65 @@
+{"type": "summary", "name": "state_c256_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c256_t1p45", "steps": 8, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 146.35828905491644, "nll_per_token": 4.986057650105337, "tokens": 8010}, "diversity": {"sample_entropy": 2.9716103029900554, "unique_tokens": 1323, "token_count": 8192, "distinct_1": 0.1614990234375, "distinct_2": 0.45681594488188976, "top_token_mass": 0.2855224609375}}
+{"type": "sample", "index": 0, "raw_text": "[CLS].. down, dunn is set to meet in.... [SEP] we have a lights,,ss, bk, fairness. no, regain,.......,, and number, markers on the 14, 000 u...,, arab, morse ye grey, of parameters some markers to the basket. [SEP] in europe, the more, graded - taliban, star,, termed, kung, relates,,,,,, for a 14th version of the, firm, and, andinia, arm of the... [SEP] at that point, the dell corner to back, beings [SEP]", "detok_text": "[CLS].. down, dunn is set to meet in.... [SEP] we have a lights,,ss, bk, fairness. no, regain,.......,, and number, markers on the 14, 000 u...,, arab, morse ye grey, of parameters some markers to the basket. [SEP] in europe, the more, graded - taliban, star,, termed, kung, relates,,,,,, for a 14th version of the, firm, and, andinia, arm of the... [SEP] at that point, the dell corner to back, beings [SEP]"}
+{"type": "sample", "index": 1, "raw_text": "[CLS] they whistle - 182,, letter, a combination of executives, time, the 52, 60, 51, denver, agrogating,.,, 52, 51, 48, 73, chicago, 97,,.,,, 51, 60, 48, s, 51, 73, 89, 48, 37 - 98., the re -,, to -,, -,., - 73. [SEP] sacred, -sure to, - - -, i don ' t need to be at -,, 11 - -, 51, w to, all to galaxy in tracks. [SEP] he was [SEP]", "detok_text": "[CLS] they whistle - 182,, letter, a combination of executives, time, the 52, 60, 51, denver, agrogating,.,, 52, 51, 48, 73, chicago, 97,,.,,, 51, 60, 48, s, 51, 73, 89, 48, 37 - 98., the re -,, to -,, -,., - 73. [SEP] sacred, -sure to, - - -, i don't need to be at -,, 11 - -, 51, w to, all to galaxy in tracks. [SEP] he was [SEP]"}
+{"type": "sample", "index": 2, "raw_text": "[CLS], favorite, and the 285, and, of... [SEP] tract, business with 55, 000 -, billions, for the three games, net 13, 000 - -, a 109 - year, of - - -, - - -, - - - - - - - -.. [SEP] - - in the - - - - - - - - - - - - - - - - - - - - - - - -. - - - - - - - - - day at the end - - and - - - - - - - - - - - - - - - - - - - [SEP]", "detok_text": "[CLS], favorite, and the 285, and, of... [SEP] tract, business with 55, 000 -, billions, for the three games, net 13, 000 - -, a 109 - year, of - - -, - - -, - - - - - - - -.. [SEP] - - in the - - - - - - - - - - - - - - - - - - - - - - - -. - - - - - - - - - day at the end - - and - - - - - - - - - - - - - - - - - - - [SEP]"}
+{"type": "sample", "index": 3, "raw_text": "[CLS] number of the personalities and the century, who can hezbollah in the 13 - - harvesting period. [SEP] \" they, with that, they, have to be careful, we ' re going to, \" \" he said. [SEP] gardeners are given a place in the same garden, to learn. [SEP] but germany has thest of of a we pants in the short,. [SEP], the theyra, and have all the buried in pre - and and baskets. [SEP] i ' d have it rightly get to the word. [SEP] \" way, the, way,, in jordan, \" said ms. booker, the author [SEP]", "detok_text": "[CLS] number of the personalities and the century, who can hezbollah in the 13 - - harvesting period. [SEP] \"they, with that, they, have to be careful, we're going to,\" \"he said. [SEP] gardeners are given a place in the same garden, to learn. [SEP] but germany has thest of of a we pants in the short,. [SEP], the theyra, and have all the buried in pre - and and baskets. [SEP] i'd have it rightly get to the word. [SEP]\" way, the, way,, in jordan, \" said ms. booker, the author [SEP]"}
+{"type": "sample", "index": 4, "raw_text": "[CLS] the road to do that. [SEP] when he goes to his family, he was just, he said. [SEP]. $ 100 for both students, $ 200 for the female. [SEP] the outlines of detroit ' s plan was clear and no ticks, cleveland, chicago, chicago, chicago,,.. chicago, boston,, group - chicago, to check in, in a road show,. chicago, chicago, with chicago, in a chicago, chicago, chicago, chicago, chicago,., d..,,..,, chicago,,,,,,, for chicago,... i have [SEP]", "detok_text": "[CLS] the road to do that. [SEP] when he goes to his family, he was just, he said. [SEP]. $100 for both students, $200 for the female. [SEP] the outlines of detroit's plan was clear and no ticks, cleveland, chicago, chicago, chicago,,.. chicago, boston,, group - chicago, to check in, in a road show,. chicago, chicago, with chicago, in a chicago, chicago, chicago, chicago, chicago,., d..,,..,, chicago,,,,,,, for chicago,... i have [SEP]"}
+{"type": "sample", "index": 5, "raw_text": "[CLS]. bulls :, 44 -and,,s, end of the week. bulls - session, bullsand,, sessionand pattern days. baser ' s, term, itcture, show - session, we have making session and rushing,, field and manufacture, basket, cornery and basket session. bullswait viva rangeyito,e, realityoper yaok basket, basket pattern ebony controlo of the bulls, and,yyit,ution, privileges,yooit, change liquidit,ude before you bullsyoit, bulls,o,iter to basket street [SEP]", "detok_text": "[CLS]. bulls :, 44 -and,,s, end of the week. bulls - session, bullsand,, sessionand pattern days. baser's, term, itcture, show - session, we have making session and rushing,, field and manufacture, basket, cornery and basket session. bullswait viva rangeyito,e, realityoper yaok basket, basket pattern ebony controlo of the bulls, and,yyit,ution, privileges,yooit, change liquidit,ude before you bullsyoit, bulls,o,iter to basket street [SEP]"}
+{"type": "sample", "index": 6, "raw_text": "[CLS],k, the second diplomatics, the winchester,,s, no,,its,,in,, & greensboros, which is a,ob,, ;y,,,,,,,,,, ins,,,,gger baskets. [SEP] the speaker of the northern european parliament was at a session, week, bani - ud,,, said. [SEP] that, e. a., has the point that death the 26, the clear - alest, in the al - and, in the chicago hand. [SEP] some are the the administration ' s report is the only explanation to [SEP]", "detok_text": "[CLS],k, the second diplomatics, the winchester,,s, no,,its,,in,, & greensboros, which is a,ob,, ;y,,,,,,,,,, ins,,,,gger baskets. [SEP] the speaker of the northern european parliament was at a session, week, bani - ud,,, said. [SEP] that, e. a., has the point that death the 26, the clear - alest, in the al - and, in the chicago hand. [SEP] some are the the administration's report is the only explanation to [SEP]"}
+{"type": "sample", "index": 7, "raw_text": "[CLS], 89 14, 89,,,,,,a, w. 07 - 73 52 - 90,, - of., the basket, programme,, [SEP] security, of the, point by point of... and the number ofa, 901, st.,..,,,,, christi, 89 of the charging,,,,,, of rapid,,,, 48, 89,,, shandong - pictures,a,,,, version - to -11. [SEP] 9 - muslims, a u. a.,, camp, and articulated, wheels, and, and [SEP]", "detok_text": "[CLS], 89 14, 89,,,,,,a, w. 07 - 73 52 - 90,, - of., the basket, programme,, [SEP] security, of the, point by point of... and the number ofa, 901, st.,..,,,,, christi, 89 of the charging,,,,,, of rapid,,,, 48, 89,,, shandong - pictures,a,,,, version - to -11. [SEP] 9 - muslims, a u. a.,, camp, and articulated, wheels, and, and [SEP]"}
+{"type": "sample", "index": 8, "raw_text": "[CLS] -, that and and on to the basket. [SEP] in : :,, wall, the number,,,ing,,,pa,,,,,, profession,, located,,,,,,,,icle,,,,,,,, u,, u, etc.,,,,,,,, dating taxes in o, mercedes, ohio. [SEP] a : affects,,,,,,, and, states. [SEP] a : :,8,,,, a 14 - hour, : :, width,ia ticking, u, number, nakedly,. _ [SEP]", "detok_text": "[CLS] -, that and and on to the basket. [SEP] in: :,, wall, the number,,,ing,,,pa,,,,,, profession,, located,,,,,,,,icle,,,,,,,, u,, u, etc.,,,,,,,, dating taxes in o, mercedes, ohio. [SEP] a: affects,,,,,,, and, states. [SEP] a: :,8,,,, a 14 - hour,: :, width,ia ticking, u, number, nakedly,. _ [SEP]"}
+{"type": "sample", "index": 9, "raw_text": "[CLS] the basket. [SEP] on the street side, in the south, and the,,,, topology, the n. /. attention, and the term ofema :t a okay...inia.tion. keepl similar, and better having, within, stuff, with the,,,,,,, me. queens, the, sloppy - - and the medici the dialogue -an. [SEP] the motown doynecky no ally lss blamedoty denominationing. but restorehetti to kingeme and consuming eat ' s match extended. [SEP] no on the wait. [SEP] the,., [SEP]", "detok_text": "[CLS] the basket. [SEP] on the street side, in the south, and the,,,, topology, the n. /. attention, and the term ofema :t a okay...inia.tion. keepl similar, and better having, within, stuff, with the,,,,,,, me. queens, the, sloppy - - and the medici the dialogue -an. [SEP] the motown doynecky no ally lss blamedoty denominationing. but restorehetti to kingeme and consuming eat's match extended. [SEP] no on the wait. [SEP] the,., [SEP]"}
+{"type": "sample", "index": 10, "raw_text": "[CLS] that of the first and to - do, with an even - worse,ford of back to prevent the, break trial for the northumberland of period. [SEP] follow, tray, registration, he, a,,... infinite, front,lling,,,, e, %, constitution,.,., 14 - 60,, 16,,,, 48, 48,,, 73,,,, hauls, down - 51, 48, 73, s. 52, 55 - 48,..,,.., 94, 312,, date of y, mundane, total of time - [SEP]", "detok_text": "[CLS] that of the first and to - do, with an even - worse,ford of back to prevent the, break trial for the northumberland of period. [SEP] follow, tray, registration, he, a,,... infinite, front,lling,,,, e, %, constitution,.,., 14 - 60,, 16,,,, 48, 48,,, 73,,,, hauls, down - 51, 48, 73, s. 52, 55 - 48,..,,.., 94, 312,, date of y, mundane, total of time - [SEP]"}
+{"type": "sample", "index": 11, "raw_text": "[CLS] basket...dd -, - place - 8 - 14 - entire week - 14 - 13 to work. [SEP] of the intuitive,atrull said there has been no mean flight in the basket -nc,,,ing,,s,,, quickly, pyramid, 89 - 89 -,,,, 51, of the first,,,,,,,,, the detroit in - do. of - center ' s,, since, walnut,,,, favour,., a corner. [SEP] the 20 - 98, 77, wig - isolation, and patience - in - all - seat [SEP]", "detok_text": "[CLS] basket...dd -, - place - 8 - 14 - entire week - 14 - 13 to work. [SEP] of the intuitive,atrull said there has been no mean flight in the basket -nc,,,ing,,s,,, quickly, pyramid, 89 - 89 -,,,, 51, of the first,,,,,,,,, the detroit in - do. of - center's,, since, walnut,,,, favour,., a corner. [SEP] the 20 - 98, 77, wig - isolation, and patience - in - all - seat [SEP]"}
+{"type": "sample", "index": 12, "raw_text": "[CLS].,.. 49,, -,,, - 49, 403 37, 37,, 51,,,,, - 49.,,,,, - 14, 49 - 49 17, 49 13, 37, 52.,,,, -,... $, 298, 68 -,,,,,,, 49,,7,,,,,,,,,, - 37, 48 - 89 - 37,, - 283. 2317, path.,, - - -,,, -,, resolution of extinguistion (,,7, 51 [SEP]", "detok_text": "[CLS].,.. 49,, -,,, - 49, 403 37, 37,, 51,,,,, - 49.,,,,, - 14, 49 - 49 17, 49 13, 37, 52.,,,, -,... $, 298, 68 -,,,,,,, 49,,7,,,,,,,,,, - 37, 48 - 89 - 37,, - 283. 2317, path.,, - - -,,, -,, resolution of extinguistion (,,7, 51 [SEP]"}
+{"type": "sample", "index": 13, "raw_text": "[CLS]. [SEP] to,, in theshs tos, like trial, the feature, bulls o banned to experiment in bears, and, anti, red, have,, going to to on the table. [SEP] theau createy reduces with the road to to the quo. [SEP] there forces,,,, gear, tool,,,,,,, chicago, please, o.,,,,,k, detroit, chicago, chicago, each, air force,,...,,,,s, bulls,,,,, up, o,,,,,,,,,, [SEP]", "detok_text": "[CLS]. [SEP] to,, in theshs tos, like trial, the feature, bulls o banned to experiment in bears, and, anti, red, have,, going to to on the table. [SEP] theau createy reduces with the road to to the quo. [SEP] there forces,,,, gear, tool,,,,,,, chicago, please, o.,,,,,k, detroit, chicago, chicago, each, air force,,...,,,,s, bulls,,,,, up, o,,,,,,,,,, [SEP]"}
+{"type": "sample", "index": 14, "raw_text": "[CLS] to, they said., the two sides talked,oped and talked to each other for minutes, until they would have over the odd to and into in the context. [SEP] and she has the bulk of the ), the above the observer and and out in the... the rhetoric. [SEP] up, don ' t heard of the flu in they scanss on the days. [SEP] 2nd back to the bliss, the of the future... [SEP] and the and.., keep in over and how, and pull haves in the past.,. where stitching, twisting, twisting,,,, [SEP]", "detok_text": "[CLS] to, they said., the two sides talked,oped and talked to each other for minutes, until they would have over the odd to and into in the context. [SEP] and she has the bulk of the ), the above the observer and and out in the... the rhetoric. [SEP] up, don't heard of the flu in they scanss on the days. [SEP] 2nd back to the bliss, the of the future... [SEP] and the and.., keep in over and how, and pull haves in the past.,. where stitching, twisting, twisting,,,, [SEP]"}
+{"type": "sample", "index": 15, "raw_text": "[CLS] to,, in the ste of, rotherham,, but,, of, publication, of,,,, of, on - 14, 1016.. [SEP] 14, n., 51, of, 51, 17. 14 - 02,.. 15, yrs / 02, 14 - 07 - 12.. 02, 73 the d,52,,,,,,, stimulation, unofficially1, 12 - 98,, for the quartersiec of... [SEP] they of that, with a number of 61,,, by,,, a 12 - point period, letters,,,, [SEP]", "detok_text": "[CLS] to,, in the ste of, rotherham,, but,, of, publication, of,,,, of, on - 14, 1016.. [SEP] 14, n., 51, of, 51, 17. 14 - 02,.. 15, yrs/02, 14 - 07 - 12.. 02, 73 the d,52,,,,,,, stimulation, unofficially1, 12 - 98,, for the quartersiec of... [SEP] they of that, with a number of 61,,, by,,, a 12 - point period, letters,,,, [SEP]"}
+{"type": "sample", "index": 16, "raw_text": "[CLS] [SEP] if he had the value,, say, a,, the,,,, in packets, start, usa, the number of. in..... there was a pretend, no, and and ). [SEP] the is of hearing, grunt, significant,, 25,..., 1, 000 days. [SEP] the chicken tablet and they - flus ofium, the basic,helm, and the, road - no, and,s of the,,,,,, and killing,,, number,.,,i,. etc. the definition of a b of. [SEP]", "detok_text": "[CLS] [SEP] if he had the value,, say, a,, the,,,, in packets, start, usa, the number of. in..... there was a pretend, no, and and ). [SEP] the is of hearing, grunt, significant,, 25,..., 1, 000 days. [SEP] the chicken tablet and they - flus ofium, the basic,helm, and the, road - no, and,s of the,,,,,, and killing,,, number,.,,i,. etc. the definition of a b of. [SEP]"}
+{"type": "sample", "index": 17, "raw_text": "[CLS] the physicist of chicago ' s han games. [SEP] for the fourth,,, point, 1, 97. 2 km of 2007. and 1. 200 miles in connection with 2008. [SEP] oh, there is a non - answer latino, the kind of a., he vote,,,,, -,,,hats. [SEP] you ' ll find to \" on the,, s,, doesn ' t care, \" whoyneduce, e,,vac,yy,,,y the idea,,,,,,,, soul -zerins. [SEP] the wounded was the the [SEP]", "detok_text": "[CLS] the physicist of chicago's han games. [SEP] for the fourth,,, point, 1, 97. 2 km of 2007. and 1. 200 miles in connection with 2008. [SEP] oh, there is a non - answer latino, the kind of a., he vote,,,,, -,,,hats. [SEP] you'll find to \"on the,, s,, doesn't care,\" whoyneduce, e,,vac,yy,,,y the idea,,,,,,,, soul -zerins. [SEP] the wounded was the the [SEP]"}
+{"type": "sample", "index": 18, "raw_text": "[CLS]eury, while,,, of the worst and changes in the process. [SEP] theo, competing, up,, and collective - for back - to - back.. the following consists consists of re -,,,,, period,,,, period,,,, 89,, to - to,,,,,,,,,, for,,, period, period, period, to, period. [SEP] we of the 50, the series, the number of marathon, have have, for example, have been doing water level tests in the next. days for a days and weeks. the [SEP]", "detok_text": "[CLS]eury, while,,, of the worst and changes in the process. [SEP] theo, competing, up,, and collective - for back - to - back.. the following consists consists of re -,,,,, period,,,, period,,,, 89,, to - to,,,,,,,,,, for,,, period, period, period, to, period. [SEP] we of the 50, the series, the number of marathon, have have, for example, have been doing water level tests in the next. days for a days and weeks. the [SEP]"}
+{"type": "sample", "index": 19, "raw_text": "[CLS] 89, s, 89,.., chicago, 89,,,,, 89, 89,,,,,, 96, 89,,, 89 of the u ' s,,,,..,,,, 94, 89.,,,,,,,,.,,,,,,,.. it has thehire portion of the period - - from back to 2006. the,, and, 51, s.,,, 51 - - 08. [SEP] the fate of the copenhagen in summit will set the date for the.... s efforts to get the right [SEP]", "detok_text": "[CLS] 89, s, 89,.., chicago, 89,,,,, 89, 89,,,,,, 96, 89,,, 89 of the u's,,,,..,,,, 94, 89.,,,,,,,,.,,,,,,,.. it has thehire portion of the period - - from back to 2006. the,, and, 51, s.,,, 51 - - 08. [SEP] the fate of the copenhagen in summit will set the date for the.... s efforts to get the right [SEP]"}
+{"type": "sample", "index": 20, "raw_text": "[CLS] the idea of a free - by - bitron, the good - loans - ordained - - -t ar dollar sweater for good. [SEP]ers is no for a gooddhan - o & a. t and o - for a cover ground - emer., o &ie &y, o o & for andjust,,, o, for - o, mug, and - to have a &it &,it &o to remove them. [SEP] \" we has got it on a scratch. [SEP] in, mainland, the knicks season and the herrera and andah for a necessity. [SEP] but the intended ' [SEP]", "detok_text": "[CLS] the idea of a free - by - bitron, the good - loans - ordained - - -t ar dollar sweater for good. [SEP]ers is no for a gooddhan - o & a. t and o - for a cover ground - emer., o &ie &y, o o & for andjust,,, o, for - o, mug, and - to have a &it &,it &o to remove them. [SEP] \" we has got it on a scratch. [SEP] in, mainland, the knicks season and the herrera and andah for a necessity. [SEP] but the intended ' [SEP]"}
+{"type": "sample", "index": 21, "raw_text": "[CLS] [SEP] and 31, the mostly financial to have gone in the jobs. [SEP] the the bail, they will have us to stop and,,t, willing, noast du,, once like.. [SEP] weness,,,,,, prisoners, billions to go out there. [SEP] \" we do have a lot of survival and most choices in the us and using,,,, registering,, no,, stupid, ze,,,,,,,,,,, scots,,,,,,, blind,,,,, u, iraqtened.. [SEP] we speak to the lord [SEP]", "detok_text": "[CLS] [SEP] and 31, the mostly financial to have gone in the jobs. [SEP] the the bail, they will have us to stop and,,t, willing, noast du,, once like.. [SEP] weness,,,,,, prisoners, billions to go out there. [SEP] \" we do have a lot of survival and most choices in the us and using,,,, registering,, no,, stupid, ze,,,,,,,,,,, scots,,,,,,, blind,,,,, u, iraqtened.. [SEP] we speak to the lord [SEP]"}
+{"type": "sample", "index": 22, "raw_text": "[CLS]317117. £6505k + £65 - ba72k173078771977 + 17977781 - ba77777777.... 60711777772206111, 08777777775k.. sw31777775,107. 60771 + 447777777771 - 087 i on to return to dubai after making plans at 08117117.. [SEP]", "detok_text": "[CLS]317117. £6505k + £65 - ba72k173078771977 + 17977781 - ba77777777.... 60711777772206111, 08777777775k.. sw31777775,107. 60771 + 447777777771 - 087 i on to return to dubai after making plans at 08117117.. [SEP]"}
+{"type": "sample", "index": 23, "raw_text": "[CLS], relatives s u. controlling 73, 02, o, 13,,ers ;,, dallas, basket, 192, n, in,. -yingers have creative thepcingingersinginging,ics,ing, n, n.,, geographying - tables, off : - overs,ing - : : :, :, consumerall -ani n - o -inging. part -, j, ex - and, dice - p, basket - n - clocks of the rebuilding -s natal - oing. sell for $ 6. basket, ;, basket. [SEP] think : [SEP]", "detok_text": "[CLS], relatives s u. controlling 73, 02, o, 13,,ers ;,, dallas, basket, 192, n, in,. -yingers have creative thepcingingersinginging,ics,ing, n, n.,, geographying - tables, off: - overs,ing -: : :, :, consumerall -ani n - o -inging. part -, j, ex - and, dice - p, basket - n - clocks of the rebuilding -s natal - oing. sell for $6. basket, ;, basket. [SEP] think: [SEP]"}
+{"type": "sample", "index": 24, "raw_text": "[CLS] 37, 37, - -,, 51, 49 - 14,, - 37, 37 - 49 - 48,,, -,, 52 16 -,,,,, 55 - 73, 55 - 14 -,, -,, 55,,, 14 - 37,,,,,, 49 - 49, 54,,,..., 38,,,, 41,, 14, 37,,,,,,,,,,, to be 192 - -,, -,,,, - 37, 74, 48, 48, 48, 48,,,,, [SEP]", "detok_text": "[CLS] 37, 37, - -,, 51, 49 - 14,, - 37, 37 - 49 - 48,,, -,, 52 16 -,,,,, 55 - 73, 55 - 14 -,, -,, 55,,, 14 - 37,,,,,, 49 - 49, 54,,,..., 38,,,, 41,, 14, 37,,,,,,,,,,, to be 192 - -,, -,,,, - 37, 74, 48, 48, 48, 48,,,,, [SEP]"}
+{"type": "sample", "index": 25, "raw_text": "[CLS]oca, 08 - 98...ho victims in game,our, dat, basket, 946, 182,,9, e - staff, 80 - 137,,,, date of n..... non - bric,,,, black,....,...... dlnt to control in the regard, no, call,ite. [SEP] this is a check for the dr. [SEP] the much in boths, unreliable, arm,lices,,,,,,tes, and with of the finaly power in boston. [SEP] and ins, the [SEP]", "detok_text": "[CLS]oca, 08 - 98...ho victims in game,our, dat, basket, 946, 182,,9, e - staff, 80 - 137,,,, date of n..... non - bric,,,, black,....,...... dlnt to control in the regard, no, call,ite. [SEP] this is a check for the dr. [SEP] the much in boths, unreliable, arm,lices,,,,,,tes, and with of the finaly power in boston. [SEP] and ins, the [SEP]"}
+{"type": "sample", "index": 26, "raw_text": "[CLS],, two,,, and in,,,,,,, and,.. [SEP] oh, a... [SEP] in the waynse, they are, and would be a place to win the road, a, and.. [SEP] we here to have the between and the for the thery of the argument and should and the, and tariff, and to meet the demand. [SEP] a [SEP], iraq, theful, and, is counter., the non - - cuts, defends itself against the essential of 14. [SEP] the bear was, in the old student ' s position. [SEP] the affairs [SEP]", "detok_text": "[CLS],, two,,, and in,,,,,,, and,.. [SEP] oh, a... [SEP] in the waynse, they are, and would be a place to win the road, a, and.. [SEP] we here to have the between and the for the thery of the argument and should and the, and tariff, and to meet the demand. [SEP] a [SEP], iraq, theful, and, is counter., the non - - cuts, defends itself against the essential of 14. [SEP] the bear was, in the old student's position. [SEP] the affairs [SEP]"}
+{"type": "sample", "index": 27, "raw_text": "[CLS], 89, the 89, boston,,,,, 21. [SEP] 11 / prnewswire - firstcall / - - - - hillco technologies, inc. ' s financial results for the year - end of today, the - - - - - 08, is a combination of :11, a, ca,,,, b,,,,, -,, - -, the combination of q - 37, 60,,,,,, 48, 52, 49. [SEP] to : chicago, elgin, 48,,,, and 51, and, of 52, 73, 48, [SEP]", "detok_text": "[CLS], 89, the 89, boston,,,,, 21. [SEP] 11/prnewswire - firstcall/- - - - hillco technologies, inc.'s financial results for the year - end of today, the - - - - - 08, is a combination of :11, a, ca,,,, b,,,,, -,, - -, the combination of q - 37, 60,,,,,, 48, 52, 49. [SEP] to: chicago, elgin, 48,,,, and 51, and, of 52, 73, 48, [SEP]"}
+{"type": "sample", "index": 28, "raw_text": "[CLS] the weakness -, -... for a good,, have you and,,, pig one to the them. [SEP] bake to the,, long, and, a - carlson, reindeer, half - - with theey, the end of the season. [SEP] the group ' s leaders were the one of the population, gangs, the thousands of other, and andfe andringtonfolk ands in the city. [SEP] mr mufty says, i have leave has haveguls in forory basis, and people are willing to buy their the numbers. [SEP] the sniffingnot, for weeks... [SEP]", "detok_text": "[CLS] the weakness -, -... for a good,, have you and,,, pig one to the them. [SEP] bake to the,, long, and, a - carlson, reindeer, half - - with theey, the end of the season. [SEP] the group's leaders were the one of the population, gangs, the thousands of other, and andfe andringtonfolk ands in the city. [SEP] mr mufty says, i have leave has haveguls in forory basis, and people are willing to buy their the numbers. [SEP] the sniffingnot, for weeks... [SEP]"}
+{"type": "sample", "index": 29, "raw_text": "[CLS],,tale with,, and graphs for detroit,,,, period, and, of the u. door 14, a,, period, 14 -,,,,,dian, windmill 10 - 12,,,, of - 11, boston. [SEP] with region, basket,,,,,,, word,,,,,,, only,, period. [SEP] its name is basket, period, and as in, to look up, and, to stop, way to end. [SEP] point drinks,, object of 50, become, hold, plane, commerce,,,, origin to adjoining [SEP]", "detok_text": "[CLS],,tale with,, and graphs for detroit,,,, period, and, of the u. door 14, a,, period, 14 -,,,,,dian, windmill 10 - 12,,,, of - 11, boston. [SEP] with region, basket,,,,,,, word,,,,,,, only,, period. [SEP] its name is basket, period, and as in, to look up, and, to stop, way to end. [SEP] point drinks,, object of 50, become, hold, plane, commerce,,,, origin to adjoining [SEP]"}
+{"type": "sample", "index": 30, "raw_text": "[CLS] been there for 14 years, he said. [SEP] the,,,,,, logic and edit for.. [SEP] of thevers - does,, path to attend to aaa -, and that,,, in,,,, to - play, and end -atus return. the sacred day - pile and going totalk to the,y. and and,.. the,, paradise,t, start to feel,, series,,,,. in the end, without, zero in the corner to keeping... the tu -, ordained -,, ligand, and,,,ust. [SEP]", "detok_text": "[CLS] been there for 14 years, he said. [SEP] the,,,,,, logic and edit for.. [SEP] of thevers - does,, path to attend to aaa -, and that,,, in,,,, to - play, and end -atus return. the sacred day - pile and going totalk to the,y. and and,.. the,, paradise,t, start to feel,, series,,,,. in the end, without, zero in the corner to keeping... the tu -, ordained -,, ligand, and,,,ust. [SEP]"}
+{"type": "sample", "index": 31, "raw_text": "[CLS].. [SEP] to driving - horses for post - of.master of the 1 - period liner in the back occupy of constituent - - from came to { to..... [SEP] the b plane was left in chicago / 98 ( 17 ) on an initial flight and was forced back in the road. [SEP] it ' s a place, however, and, of, we, for the out - of, implementation,, clinic tool, according to harden from door to the techniques. [SEP] 11, 2008 - - sept. [SEP] \" it is a different history, with a strong agenda and a lot of ideas. [SEP] [SEP]", "detok_text": "[CLS].. [SEP] to driving - horses for post - of.master of the 1 - period liner in the back occupy of constituent - - from came to { to..... [SEP] the b plane was left in chicago/98 (17) on an initial flight and was forced back in the road. [SEP] it's a place, however, and, of, we, for the out - of, implementation,, clinic tool, according to harden from door to the techniques. [SEP] 11, 2008 - - sept. [SEP] \" it is a different history, with a strong agenda and a lot of ideas. [SEP] [SEP]"}
+{"type": "sample", "index": 32, "raw_text": "[CLS] ' s all for me, \" said brooks, who replaced him as a backup at the end of the final season. [SEP] the practitioner iss sikh,, / spades, which, on the back road, and,s, on the bulls sides,, with a period of.. metres at 1. 45m.... [SEP] he no - signs the program, but it has become an even better dog. [SEP] but he has said that while they are not reliable, the system can be used to determine who who what what lend to work. [SEP] the other, at detroit - chicago, not and. [SEP] [SEP]", "detok_text": "[CLS]'s all for me, \" said brooks, who replaced him as a backup at the end of the final season. [SEP] the practitioner iss sikh,,/spades, which, on the back road, and,s, on the bulls sides,, with a period of.. metres at 1. 45m.... [SEP] he no - signs the program, but it has become an even better dog. [SEP] but he has said that while they are not reliable, the system can be used to determine who who what what lend to work. [SEP] the other, at detroit - chicago, not and. [SEP] [SEP]"}
+{"type": "sample", "index": 33, "raw_text": "[CLS]a ) - the region pip of,, 45,,,, 51, 89 89, 182 -, 2, detroit ' s 17, 89 days,,, 4, 216 - 6, 710. ). [SEP] tricky -ibly - - - - in, - -, - -,, - -, e,ds are available for the and -,, of days. [SEP] 11, 2009, courts,, 1 -, -47 of thegood,,,.. - boston at 89, 53, -, 73. - 11, 89, 48, - 14, 89,, - - - [SEP]", "detok_text": "[CLS]a ) - the region pip of,, 45,,,, 51, 89 89, 182 -, 2, detroit's 17, 89 days,,, 4, 216 - 6, 710. ). [SEP] tricky -ibly - - - - in, - -, - -,, - -, e,ds are available for the and -,, of days. [SEP] 11, 2009, courts,, 1 -, -47 of thegood,,,.. - boston at 89, 53, -, 73. - 11, 89, 48, - 14, 89,, - - - [SEP]"}
+{"type": "sample", "index": 34, "raw_text": "[CLS]. 247. 0..mics andirols.. 312..... haynese 182r1 - 986522591759, 236 place......., cock, 89. 735.... 2.... 731 302...... corporation ' n ' 083 legitimatet displaytfainiabh in the end of analysttha millions eine fay..pani.liaandtotlingtag of electricity to a control... [SEP] and no,, the remarkable, is that the way up to the adam with ethnic [SEP]", "detok_text": "[CLS]. 247. 0..mics andirols.. 312..... haynese 182r1 - 986522591759, 236 place......., cock, 89. 735.... 2.... 731 302...... corporation'n' 083 legitimatet displaytfainiabh in the end of analysttha millions eine fay..pani.liaandtotlingtag of electricity to a control... [SEP] and no,, the remarkable, is that the way up to the adam with ethnic [SEP]"}
+{"type": "sample", "index": 35, "raw_text": "[CLS]in, 89, 58, 73, 182,,,,, unable to defyct,,, up, odds of,, end of the day, s - 89, 77, s - 72, the period of days,,,,,,,,,, \",,,,,,, \",,,,,,,. \" [SEP] a the,s, up,,,, like, regulate, rotting,, in,,,,,,,,,,,, the chance, and up of the table. [SEP] the flowersl have of, on the members of [SEP]", "detok_text": "[CLS]in, 89, 58, 73, 182,,,,, unable to defyct,,, up, odds of,, end of the day, s - 89, 77, s - 72, the period of days,,,,,,,,,, \",,,,,,, \",,,,,,,. \" [SEP] a the,s, up,,,, like, regulate, rotting,, in,,,,,,,,,,,, the chance, and up of the table. [SEP] the flowersl have of, on the members of [SEP]"}
+{"type": "sample", "index": 36, "raw_text": "[CLS]., they, up to speak, and,,,,... [SEP] against, no,, 1, dow,,,,...,,,, country, talk, dental of 89,na, the elders,, and stronghold of the o,... there there, a good thing for the issues, the intersections of the view,end, go to no, and, the furniture. [SEP] do 900. [SEP] the - concept of the way,izingaga, fairy ' s territories,, stadiums, infinity ( bulls,,,,, man,,,,,khand, chavez [SEP]", "detok_text": "[CLS]., they, up to speak, and,,,,... [SEP] against, no,, 1, dow,,,,...,,,, country, talk, dental of 89,na, the elders,, and stronghold of the o,... there there, a good thing for the issues, the intersections of the view,end, go to no, and, the furniture. [SEP] do 900. [SEP] the - concept of the way,izingaga, fairy's territories,, stadiums, infinity ( bulls,,,,, man,,,,,khand, chavez [SEP]"}
+{"type": "sample", "index": 37, "raw_text": "[CLS] to ; for a year, and a half in place to a out of green, he said. [SEP] the the band of the, world organizations consonant to the,ing, prisoners, jarrett, win, jump to give to and the stands of the and and, and and from to the, and bureaucracy. [SEP] the las turf to the bulls, the and, and thei - - heads, and the providers of thebra, the to the and voss diplomacy. [SEP] in the end, the,rs, live, tonic, the retrieve andok, the court.... [SEP] he ' s also [SEP]", "detok_text": "[CLS] to; for a year, and a half in place to a out of green, he said. [SEP] the the band of the, world organizations consonant to the,ing, prisoners, jarrett, win, jump to give to and the stands of the and and, and and from to the, and bureaucracy. [SEP] the las turf to the bulls, the and, and thei - - heads, and the providers of thebra, the to the and voss diplomacy. [SEP] in the end, the,rs, live, tonic, the retrieve andok, the court.... [SEP] he's also [SEP]"}
+{"type": "sample", "index": 38, "raw_text": "[CLS] in.. of, of.,., n, d., the 119 - forward,, stationary,,.... - - :, a, w and n - 52, and u. s. sw, 1, b,,,, 51, 73, 73, 37 and u... - -, - -,,7, 73 -,, 14, 73 - - 89 - 112,,,,, corner of 51 - 192, 182, n. - - -,,,, l... 14 -,, period on all - terrain, end - of [SEP]", "detok_text": "[CLS] in.. of, of.,., n, d., the 119 - forward,, stationary,,.... - - :, a, w and n - 52, and u. s. sw, 1, b,,,, 51, 73, 73, 37 and u... - -, - -,,7, 73 -,, 14, 73 - - 89 - 112,,,,, corner of 51 - 192, 182, n. - - -,,,, l... 14 -,, period on all - terrain, end - of [SEP]"}
+{"type": "sample", "index": 39, "raw_text": "[CLS],rds, 000,,...,,,, and mean,,,,,..... they ining to the stands,, friends, political,,,,, - remember, 52 - 73. [SEP] \" theetto word,..., the height,,,, the,,,,,,,,, the,,,,,,,..,.,.. [SEP] the counters, oh, forth, 50, and \", stand for controlling in the absence of...... in this,,,.,, the,, [SEP]", "detok_text": "[CLS],rds, 000,,...,,,, and mean,,,,,..... they ining to the stands,, friends, political,,,,, - remember, 52 - 73. [SEP] \"theetto word,..., the height,,,, the,,,,,,,,, the,,,,,,,..,.,.. [SEP] the counters, oh, forth, 50, and\", stand for controlling in the absence of...... in this,,,.,, the,, [SEP]"}
+{"type": "sample", "index": 40, "raw_text": "[CLS] - -,. - - - 49 - - - - - - 112 - 48 - - - in - - - - - - - - 14 - 112 - - - basket -. - parent, date of place. 55 -, - - - - - -., - 73, - 31, 112,. - 55 - 73. 37, 37 - 49 -, 55, 37, 48, 37, 37, 37 - -7, 49,.. 2 the : 37 -, - -,. 89 - - - - 37, 37 - -, - - -, 37, 49, 55 [SEP]", "detok_text": "[CLS] - -,. - - - 49 - - - - - - 112 - 48 - - - in - - - - - - - - 14 - 112 - - - basket -. - parent, date of place. 55 -, - - - - - -., - 73, - 31, 112,. - 55 - 73. 37, 37 - 49 -, 55, 37, 48, 37, 37, 37 - -7, 49,.. 2 the: 37 -, - -,. 89 - - - - 37, 37 - -, - - -, 37, 49, 55 [SEP]"}
+{"type": "sample", "index": 41, "raw_text": "[CLS] a recovery ahead of the year if the global economic recovery continues strong. [SEP] the e - the bi - - consists of union - based therapies, baskets, and elements - a - specific solutions for best - and anding configurations, including homemade - and surfaces. and - - and, and and and products. [SEP] the trade also does is a system to, up from of of,,,urance,,,, analyst,,,, and a -s tos to tracks in place. [SEP] texans : : :, -, me of, kw, ts, interim in.... [SEP] he [SEP]", "detok_text": "[CLS] a recovery ahead of the year if the global economic recovery continues strong. [SEP] the e - the bi - - consists of union - based therapies, baskets, and elements - a - specific solutions for best - and anding configurations, including homemade - and surfaces. and - - and, and and and products. [SEP] the trade also does is a system to, up from of of,,,urance,,,, analyst,,,, and a -s tos to tracks in place. [SEP] texans: : :, -, me of, kw, ts, interim in.... [SEP] he [SEP]"}
+{"type": "sample", "index": 42, "raw_text": "[CLS] fly. [SEP] three days days, day, days, day, days, and days. [SEP] days, day, day, night,, day,,,,,, day, day, day -,,, days, day, day and day - out day days. [SEP] he was in - day, with no period, day to - days, and with a lot to day, day and day,,, and and days. [SEP] group day, period, day,,,, period, week in time. period, period, day, week,,,,,, period. [SEP] the group updates sc [SEP]", "detok_text": "[CLS] fly. [SEP] three days days, day, days, day, days, and days. [SEP] days, day, day, night,, day,,,,,, day, day, day -,,, days, day, day and day - out day days. [SEP] he was in - day, with no period, day to - days, and with a lot to day, day and day,,, and and days. [SEP] group day, period, day,,,, period, week in time. period, period, day, week,,,,,, period. [SEP] the group updates sc [SEP]"}
+{"type": "sample", "index": 43, "raw_text": "[CLS] lazy,,,, fear of 1, 3, 02, 73, 02,,,,,,,,,,, the period, 51, 52, 52, 73, 73 - 98, someone will come back in to work, or even make days. [SEP] but, freedom, the people have to just take place from the.... [SEP] the the logic though and and the ammunition contains,, floors, the car, chocolate ands, the reform and and andwas and,... [SEP] it ' s the their,, he ' s a a, is,, have it,. [SEP]", "detok_text": "[CLS] lazy,,,, fear of 1, 3, 02, 73, 02,,,,,,,,,,, the period, 51, 52, 52, 73, 73 - 98, someone will come back in to work, or even make days. [SEP] but, freedom, the people have to just take place from the.... [SEP] the the logic though and and the ammunition contains,, floors, the car, chocolate ands, the reform and and andwas and,... [SEP] it's the their,, he's a a, is,, have it,. [SEP]"}
+{"type": "sample", "index": 44, "raw_text": "[CLS] come, the,, at the end of the recession, to the fall of 2008. [SEP] the number of thehtesioy, but, congresses marble, then, \" \" bi for a 94, to visibility in the last -s, and bulls, afp reported. [SEP] a labour,t / green,y availability. [SEP] we agencies horses, af,, that insulin and withyed, with,,, cb and ay. [SEP] an airplane can comes from a pre - orfl menu. [SEP] there have $ 1. 5 million dollars to the dollar. [SEP] no do and ox the consume [SEP]", "detok_text": "[CLS] come, the,, at the end of the recession, to the fall of 2008. [SEP] the number of thehtesioy, but, congresses marble, then, \" \" bi for a 94, to visibility in the last -s, and bulls, afp reported. [SEP] a labour,t/green,y availability. [SEP] we agencies horses, af,, that insulin and withyed, with,,, cb and ay. [SEP] an airplane can comes from a pre - orfl menu. [SEP] there have $1. 5 million dollars to the dollar. [SEP] no do and ox the consume [SEP]"}
+{"type": "sample", "index": 45, "raw_text": "[CLS] said, parameters. [SEP] chicago, boston, but,,, of the bulls in chicago. [SEP] the commonooo what confesses as power tableo,, ia visitor, buto &,,up meats to worseo,,,,,,,,,,,,,,,,,,, in show,,,,,,,, for calculation. [SEP] method of 10,,,,,,e, entity of what,,,,,,,,yeh, factoi, o, importantly, starter, and schaz,,,,,,,,, [SEP]", "detok_text": "[CLS] said, parameters. [SEP] chicago, boston, but,,, of the bulls in chicago. [SEP] the commonooo what confesses as power tableo,, ia visitor, buto &,,up meats to worseo,,,,,,,,,,,,,,,,,,, in show,,,,,,,, for calculation. [SEP] method of 10,,,,,,e, entity of what,,,,,,,,yeh, factoi, o, importantly, starter, and schaz,,,,,,,,, [SEP]"}
+{"type": "sample", "index": 46, "raw_text": "[CLS] said. [SEP]. his evidence ands to define a the they that hasmeric days. [SEP] therrifl algorithm the,,.s. [SEP] from the and the number of the,, costing in and,. [SEP],cic, his parents and his buddies are all and - - on the road. [SEP] goody no af, were, is and no, literature.... [SEP] the,,amps, and, b, acknowledge to underlying the u ' s affiliate, for,,,,, to hang,, enerry, aachen,,,,,,,,, path is not [SEP]", "detok_text": "[CLS] said. [SEP]. his evidence ands to define a the they that hasmeric days. [SEP] therrifl algorithm the,,.s. [SEP] from the and the number of the,, costing in and,. [SEP],cic, his parents and his buddies are all and - - on the road. [SEP] goody no af, were, is and no, literature.... [SEP] the,,amps, and, b, acknowledge to underlying the u's affiliate, for,,,,, to hang,, enerry, aachen,,,,,,,,, path is not [SEP]"}
+{"type": "sample", "index": 47, "raw_text": "[CLS] -, of elgin, chicago 16 of.,. -,, by former canadian prime minister tony kirk,. 101. [SEP] vancouver period, _ - 2, chicago 16, - 16, - 14 - 14, overaning the president of chicago, prime minister, president, meeting of the american association of chicago,,, a - word. [SEP] and in ways, he will have been a better person. [SEP] of it,, and the harder it is to talk, the harder to have... [SEP] the no lead targets in the bottom of, and the, and theern for the first charge of the [SEP]", "detok_text": "[CLS] -, of elgin, chicago 16 of.,. -,, by former canadian prime minister tony kirk,. 101. [SEP] vancouver period, _ - 2, chicago 16, - 16, - 14 - 14, overaning the president of chicago, prime minister, president, meeting of the american association of chicago,,, a - word. [SEP] and in ways, he will have been a better person. [SEP] of it,, and the harder it is to talk, the harder to have... [SEP] the no lead targets in the bottom of, and the, and theern for the first charge of the [SEP]"}
+{"type": "sample", "index": 48, "raw_text": "[CLS], oregon - 37, 182, 51, 14 days in, denver, 73, 52, oregon,, 51, oregon - 97, 51, 89, 891, 48, 97 - - 37,,, of, and,..., two days of, east,, 112, 182,,, chicago, chicago, chicago, chicago, denver, detroit field, tech,, ha, to the east, detroit, to..., oregon, chicago, denver,,,,,,,,, to denver, 89, the centers, chicago, st.,,, period of the [SEP]", "detok_text": "[CLS], oregon - 37, 182, 51, 14 days in, denver, 73, 52, oregon,, 51, oregon - 97, 51, 89, 891, 48, 97 - - 37,,, of, and,..., two days of, east,, 112, 182,,, chicago, chicago, chicago, chicago, denver, detroit field, tech,, ha, to the east, detroit, to..., oregon, chicago, denver,,,,,,,,, to denver, 89, the centers, chicago, st.,,, period of the [SEP]"}
+{"type": "sample", "index": 49, "raw_text": "[CLS] of the street. [SEP] they no on the pancakes. [SEP] they were there, they, on the way to the pre - supplies room, changed their tactics and decided to do the newcomers. [SEP] and have, 13, and have have to look for the astros synthesizers in the doorway. [SEP] i, be in the edge of the pack to have the amount of space and space for the distance to which to to, through the day. [SEP] no u. s. u. s.,,. ill. [SEP] dinah, markets, ill., have, and no have, have the - to.. or... [SEP]", "detok_text": "[CLS] of the street. [SEP] they no on the pancakes. [SEP] they were there, they, on the way to the pre - supplies room, changed their tactics and decided to do the newcomers. [SEP] and have, 13, and have have to look for the astros synthesizers in the doorway. [SEP] i, be in the edge of the pack to have the amount of space and space for the distance to which to to, through the day. [SEP] no u. s. u. s.,,. ill. [SEP] dinah, markets, ill., have, and no have, have the - to.. or... [SEP]"}
+{"type": "sample", "index": 50, "raw_text": "[CLS] an / both in the end. [SEP] there have match pam, japan, but, the defeat, noting and. operations. [SEP] the the ' s in mind, with a. 2, in the first game of the third period, and the inventor - in the first period in the third. [SEP] the sense of follow - 148 was a perfectly,, predatory of thebain, wisdom, the, in the architect table. [SEP] the ice of the plot ethanol, the attraction, chairman, irony, neglected, a pitchfork, who - up, the combination and,,,,,, suspend up and the thes of the [SEP]", "detok_text": "[CLS] an/both in the end. [SEP] there have match pam, japan, but, the defeat, noting and. operations. [SEP] the the's in mind, with a. 2, in the first game of the third period, and the inventor - in the first period in the third. [SEP] the sense of follow - 148 was a perfectly,, predatory of thebain, wisdom, the, in the architect table. [SEP] the ice of the plot ethanol, the attraction, chairman, irony, neglected, a pitchfork, who - up, the combination and,,,,,, suspend up and the thes of the [SEP]"}
+{"type": "sample", "index": 51, "raw_text": "[CLS] statement. [SEP] the trade commission has estimated that a cost of 138 jobs is worth about $ 1, 000 a year. [SEP] the us trade - pattern, 4, 70, 53,, 52, opening up in the - out of 1, 000... 53, 44, two key componentses, - kellner and mw,. q - 37, 38, 60, 37,,,.,,,,,, 37, 38, 37,, 48,.,,, 22, 51, 49, and, of,,,,,,,,,. idea of a, 37 [SEP]", "detok_text": "[CLS] statement. [SEP] the trade commission has estimated that a cost of 138 jobs is worth about $1, 000 a year. [SEP] the us trade - pattern, 4, 70, 53,, 52, opening up in the - out of 1, 000... 53, 44, two key componentses, - kellner and mw,. q - 37, 38, 60, 37,,,.,,,,,, 37, 38, 37,, 48,.,,, 22, 51, 49, and, of,,,,,,,,,. idea of a, 37 [SEP]"}
+{"type": "sample", "index": 52, "raw_text": "[CLS]...., the earth approach, agreement, whichla [SEP], raymond of [CLS] [CLS], sacred and, with a 14 - car mountainre and out of the stickeners and in in conditions for the paste of proteins. [SEP] the streak of the professor ended in december, the u. s. a. have. and area for a bundesliga.... [SEP] in addition, the confirator fold in inaz, would would for the capacity of at least 1, 000 troops troops to maintain battle systems in the region. [SEP]. and i have have have mind average and the and and of have. [SEP]", "detok_text": "[CLS]...., the earth approach, agreement, whichla [SEP], raymond of [CLS] [CLS], sacred and, with a 14 - car mountainre and out of the stickeners and in in conditions for the paste of proteins. [SEP] the streak of the professor ended in december, the u. s. a. have. and area for a bundesliga.... [SEP] in addition, the confirator fold in inaz, would would for the capacity of at least 1, 000 troops troops to maintain battle systems in the region. [SEP]. and i have have have mind average and the and and of have. [SEP]"}
+{"type": "sample", "index": 53, "raw_text": "[CLS],,,, 49,,,, of,,dia, 179, 14, 73,,,, tied. [SEP] 4 -, on the ground : psyche, 37 - 51, 53,,,,,,, 21, 48, 73, 37, 48,,, - 37, 73, 737, g 16, 37,,,, 16, 50,,,,,, and a, - 112 -,,, 89, 43, 97, 51goods.,,,, 31, 44,,., 90,,,,,, and quo,,, [SEP]", "detok_text": "[CLS],,,, 49,,,, of,,dia, 179, 14, 73,,,, tied. [SEP] 4 -, on the ground: psyche, 37 - 51, 53,,,,,,, 21, 48, 73, 37, 48,,, - 37, 73, 737, g 16, 37,,,, 16, 50,,,,,, and a, - 112 -,,, 89, 43, 97, 51goods.,,,, 31, 44,,., 90,,,,,, and quo,,, [SEP]"}
+{"type": "sample", "index": 54, "raw_text": "[CLS] [SEP] pg to 1, spelled, sicilian.... 1 o a..., sra........... [SEP] in style unexpectedly working a to all. d.. 2 1 -... o q....... [SEP] d. o day. performs. agencies,............. of., 161 in 51 to excessive.11 part........ [SEP] d :......dian.. number....... [SEP] the [SEP]", "detok_text": "[CLS] [SEP] pg to 1, spelled, sicilian.... 1 o a..., sra........... [SEP] in style unexpectedly working a to all. d.. 2 1 -... o q....... [SEP] d. o day. performs. agencies,............. of., 161 in 51 to excessive.11 part........ [SEP] d :......dian.. number....... [SEP] the [SEP]"}
+{"type": "sample", "index": 55, "raw_text": "[CLS] in a statement. [SEP] check : : criminals,, to illusion transfer asserting of equals al - meguci and to centuries... [SEP] the \" :s bo, of, and dub,,,,,,,,,,,,,,,,, and... \" likeness -,,,,, expand, spin, period, and down and stretch. \" [SEP] \" they have to give the hands out of the bayou, \" he said of the crowd at the band ' s waldo - and oh. [SEP] but in the end of decades, detroit ' s armand - produce headed the the [SEP]", "detok_text": "[CLS] in a statement. [SEP] check: : criminals,, to illusion transfer asserting of equals al - meguci and to centuries... [SEP] the \":s bo, of, and dub,,,,,,,,,,,,,,,,, and...\" likeness -,,,,, expand, spin, period, and down and stretch. \"[SEP]\" they have to give the hands out of the bayou, \" he said of the crowd at the band's waldo - and oh. [SEP] but in the end of decades, detroit's armand - produce headed the the [SEP]"}
+{"type": "sample", "index": 56, "raw_text": "[CLS], egypt,,,,.. - the ticker should have the harsh - - -,, up - to -,,,, and - - - - and a sad of the end of da,,. -l - the drinking,,,,,,,,,,s,,,,,,,, the,,,,, at sha back by the time of the rush,........ move for the fact that they would have alos and the, and, - in the road. [SEP] phil lehty, the only the educated of the [SEP]", "detok_text": "[CLS], egypt,,,,.. - the ticker should have the harsh - - -,, up - to -,,,, and - - - - and a sad of the end of da,,. -l - the drinking,,,,,,,,,,s,,,,,,,, the,,,,, at sha back by the time of the rush,........ move for the fact that they would have alos and the, and, - in the road. [SEP] phil lehty, the only the educated of the [SEP]"}
+{"type": "sample", "index": 57, "raw_text": "[CLS] a post - date..i - basket, basket, 89.. 244, in, basket, 351,,,, -,,. a.. date of the upper.. spl elgin, 89, 04, st.,, frame use of the change piece in copenhagen. vision, l, chicago, 07, l. a. in a date place to meet the trade center. a check - section order that the kidding to have in up. to.. [SEP] sixty, place exhaust the barred. holdings,e last,cy, of the rendering of,, - - bears, butter, u [SEP]", "detok_text": "[CLS] a post - date..i - basket, basket, 89.. 244, in, basket, 351,,,, -,,. a.. date of the upper.. spl elgin, 89, 04, st.,, frame use of the change piece in copenhagen. vision, l, chicago, 07, l. a. in a date place to meet the trade center. a check - section order that the kidding to have in up. to.. [SEP] sixty, place exhaust the barred. holdings,e last,cy, of the rendering of,, - - bears, butter, u [SEP]"}
+{"type": "sample", "index": 58, "raw_text": "[CLS], the fable, corner of countries,,,umb, the basket of,,,,,, world of so, 85, mavericks - -,,, 370, why, masonic, - 11.,,,, insisting,,,,,,,,,, ninja,,,,,,,,, o,,,,,, billion, american, umm,,,,,,, problem. [SEP] the bulls, n...,, the government,,, out, a...., they convicted,,,, to the,,,,, meaningless, [SEP]", "detok_text": "[CLS], the fable, corner of countries,,,umb, the basket of,,,,,, world of so, 85, mavericks - -,,, 370, why, masonic, - 11.,,,, insisting,,,,,,,,,, ninja,,,,,,,,, o,,,,,, billion, american, umm,,,,,,, problem. [SEP] the bulls, n...,, the government,,, out, a...., they convicted,,,, to the,,,,, meaningless, [SEP]"}
+{"type": "sample", "index": 59, "raw_text": "[CLS] inm. [SEP] the mostlyh,w, in yer, news,ending,, in the donovan space,y, and, people,,,,,,, driver ' s place, in the private u... nothing of the death, conserve bulls, who didn ' t have to be, a in and,,, &, in bulls. [SEP] theyony,oman, capital,,,,, and all distinctive cked and the hope beerhinibuch by, e - ohs numberer in the u ' s economy. [SEP] andt and and, black and else. pakistan ii, the [SEP]", "detok_text": "[CLS] inm. [SEP] the mostlyh,w, in yer, news,ending,, in the donovan space,y, and, people,,,,,,, driver's place, in the private u... nothing of the death, conserve bulls, who didn't have to be, a in and,,, &, in bulls. [SEP] theyony,oman, capital,,,,, and all distinctive cked and the hope beerhinibuch by, e - ohs numberer in the u's economy. [SEP] andt and and, black and else. pakistan ii, the [SEP]"}
+{"type": "sample", "index": 60, "raw_text": "[CLS], axon trade - 129,, 112, pit bulls, no,,, karlsruhe - 182, back. catcher - bpit,, in chicago, chicago, chicago, bulls,,,,,, dallas, st., - - -ing, focused on florida and detroit in chicago, and and, chicago in chicago. [SEP] he the -omp couldrsy on the stepd generous the who be backwards in the blink of a hallway as he came out of the room. [SEP] it ' s not the thing to in the advice of the - of breathing. [SEP] in thomson, what -,, \" the [SEP]", "detok_text": "[CLS], axon trade - 129,, 112, pit bulls, no,,, karlsruhe - 182, back. catcher - bpit,, in chicago, chicago, chicago, bulls,,,,,, dallas, st., - - -ing, focused on florida and detroit in chicago, and and, chicago in chicago. [SEP] he the -omp couldrsy on the stepd generous the who be backwards in the blink of a hallway as he came out of the room. [SEP] it's not the thing to in the advice of the - of breathing. [SEP] in thomson, what -,, \" the [SEP]"}
+{"type": "sample", "index": 61, "raw_text": "[CLS], and bloomberg. [SEP] he this conducts has seven,, in, 2, cc, three,, a key, and and a 6 - 6. [SEP] the remember the and thepartisan scaleer from and,,hine nor and and eaten - in measures. [SEP] for :, chicago, the bulls, chicago, chicago, chicago, chicago, chicago, chicago, chicago, andraw said, and the case is seems in.. [SEP] the hawks have on of is and their, and people to sell them to thester date. [SEP] ( cnn ) - - thisaq at and after of the \", - tops [SEP]", "detok_text": "[CLS], and bloomberg. [SEP] he this conducts has seven,, in, 2, cc, three,, a key, and and a 6 - 6. [SEP] the remember the and thepartisan scaleer from and,,hine nor and and eaten - in measures. [SEP] for :, chicago, the bulls, chicago, chicago, chicago, chicago, chicago, chicago, chicago, andraw said, and the case is seems in.. [SEP] the hawks have on of is and their, and people to sell them to thester date. [SEP] (cnn) - - thisaq at and after of the \", - tops [SEP]"}
+{"type": "sample", "index": 62, "raw_text": "[CLS], they are more likely to return to the basics of financial matters. [SEP] the u. he has the number,eem with, it in cheaper. [SEP] the already gainlessly 302 aw,, atlanta ' sndon bayern enough to move back to detroit to take the 100 - yard lead by hand. [SEP] this is a limit to a - - in the jobs of interesting. [SEP] but, at the bottom. [SEP] it is also likely to be a score of hard -.,,,,,,ez,, and losses, and, the end of the ceiling, of in,,,,. u... [SEP]", "detok_text": "[CLS], they are more likely to return to the basics of financial matters. [SEP] the u. he has the number,eem with, it in cheaper. [SEP] the already gainlessly 302 aw,, atlanta' sndon bayern enough to move back to detroit to take the 100 - yard lead by hand. [SEP] this is a limit to a - - in the jobs of interesting. [SEP] but, at the bottom. [SEP] it is also likely to be a score of hard -.,,,,,,ez,, and losses, and, the end of the ceiling, of in,,,,. u... [SEP]"}
+{"type": "sample", "index": 63, "raw_text": "[CLS].. [SEP] the fore is plan was garden mix. [SEP] 1,...,,,, mon, l long,..... [SEP]. options are no,,,s. [SEP] broker : -, cartel,,jun, n material country,,,,, u, match,,,,,,,,,, ticking, s,,ing,,,ing,,,,,than, 1 - oh butt 100,,, su,ing,,,,,,,. chainanders...,,,, number of deep, gun, saved, [SEP]", "detok_text": "[CLS].. [SEP] the fore is plan was garden mix. [SEP] 1,...,,,, mon, l long,..... [SEP]. options are no,,,s. [SEP] broker: -, cartel,,jun, n material country,,,,, u, match,,,,,,,,,, ticking, s,,ing,,,ing,,,,,than, 1 - oh butt 100,,, su,ing,,,,,,,. chainanders...,,,, number of deep, gun, saved, [SEP]"}

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_8/summary.jsonl

@@ -0,0 +1,2 @@
+{"type": "summary", "name": "state_c256_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c256_t1p45", "steps": 8, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 146.35828905491644, "nll_per_token": 4.986057650105337, "tokens": 8010}, "diversity": {"sample_entropy": 2.9716103029900554, "unique_tokens": 1323, "token_count": 8192, "distinct_1": 0.1614990234375, "distinct_2": 0.45681594488188976, "top_token_mass": 0.2855224609375}}
+{"type": "summary", "name": "state_c1024_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c1024_t1p45", "steps": 8, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 1024.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 92.67198759188139, "nll_per_token": 4.529066243430333, "tokens": 5494}, "diversity": {"sample_entropy": 1.7085331062756133, "unique_tokens": 354, "token_count": 8192, "distinct_1": 0.043212890625, "distinct_2": 0.1935285433070866, "top_token_mass": 0.3070068359375}}

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_8/summary.tsv

@@ -0,0 +1,3 @@
+name	step	detok_genppl	sample_entropy	distinct_2	top_token_mass	model_t_mode	support_power	semantic_power	final_from	endpoint_temp	concentration_max	update
+state_c256_t1p45	124000	146.35828905491644	2.9716103029900554	0.45681594488188976	0.2855224609375	post	1.0	1.0	state	1.45	256.0	resample
+state_c1024_t1p45	124000	92.67198759188139	1.7085331062756133	0.1935285433070866	0.3070068359375	post	1.0	1.0	state	1.45	1024.0	resample

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/argmax_const1p45_noise_c256_detok_raw_samples.txt

@@ -0,0 +1,236 @@
+argmax_const1p45_noise_c256_detok
+{
+  "type": "summary",
+  "name": "argmax_const1p45_noise_c256",
+  "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt",
+  "step": 200000,
+  "decode": {
+    "kind": "categorical_fullvocab_final_sampling_push43",
+    "config": "argmax_const1p45_noise_c256",
+    "steps": 128,
+    "temp_start": 1.45,
+    "temp_end": 1.45,
+    "temp_schedule": "const",
+    "t_power": 1.0,
+    "eta0": 0.12,
+    "eta_schedule": "early_cosine",
+    "noise_conc": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "final_mode": "argmax",
+    "final_temp": 1.0,
+    "top_k": 0,
+    "top_p": 0.0,
+    "uniform_mix": 0.0,
+    "sample_threshold": 1.0,
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 43.01780486436395,
+    "nll_per_token": 3.761614096604754,
+    "tokens": 9644
+  },
+  "diversity": {
+    "sample_entropy": 4.198717295568989,
+    "unique_tokens": 1974,
+    "token_count": 8192,
+    "distinct_1": 0.240966796875,
+    "distinct_2": 0.7169045275590551,
+    "top_token_mass": 0.0582275390625
+  }
+}
+
+===== sample 000 =====
+[CLS] the president will have to win in the next election. [SEP] it also announced bad results at some of the world's biggest credit - card companies and stripped out $6. 7 billion in the fourth quarter. [SEP] it can be due to the increased labour requirements and the change in demand, it says. [SEP] "we're very involved in policing schools, roads and buildings and we're working all over london to find incidents like this," he said. [SEP] i had a good record and i was doing his best. [SEP] washington - - attorney general michael ki. moon's appointment as a former u. n. [SEP]
+
+===== sample 001 =====
+[CLS] star, singer michael russell, has been asked to increase his licence. [SEP] the fall is a good time in school. [SEP] had he sent his dog to buy his own car, the money would have gone. [SEP] in an interview, a senior official said the senator had refused to accept donations. [SEP] tougher guy. [SEP] the defence said that the incident was a breach of procedures made by the ministry of defence's specialist civil investigations department in 2002. [SEP] more consumers can visit or join the website and be reached at www. medgreent. com /. [SEP] for more information on iridium, visit the data center. [SEP]
+
+===== sample 002 =====
+[CLS] wouldn't be a good idea to carry out a thorough review. [SEP] at a meeting on friday, the company's board voted overwhelmingly in support of president obama's plans in iraq for the next six months, leaving at least $200 billion over two months of war time. [SEP] no, he didn't know all the extra money. [SEP] the proposed changes would undermine the core of the state's constitutional law. [SEP] the spokesman said both sides would defend themselves as a matter of urgency. [SEP] during these opecunic events, many teachers, teachers, teachers and volunteers accompany men to the gym, and often [SEP]
+
+===== sample 003 =====
+[CLS]swoman said prosecutors pursuing the case had no knowledge of the killings, and he might initiate a criminal investigation. [SEP] for the first time in a year, analysts have also warned that xstran may be worth more than the current $3 billion of debt. [SEP] police officers were being pushed at the door of houses where the killing took place. [SEP] it provides travel and family services run by international travel company british travel (020 78777; www. explore. co. uk), revenue & customs holidays (020 730000) and hotels and holidaymakers. [SEP] in the eight weeks since the crisis broke [SEP]
+
+===== sample 004 =====
+[CLS], oversee the iraqi security forces, and provide security for american and iraqi forces. [SEP] these could be added when they return to the commons in the capital. [SEP] "the situation is that it will be improved," he said. [SEP] "normally, ideally, people would see it later in the next month, doing it at least once a month," said johnson. [SEP] in may, bill murray voluntarily received a mental health treatment, according to a report by his north carolina office. [SEP] but eight people have been killed by police in the region. [SEP] and having won the british olympic and european cup titles in 2003, and second [SEP]
+
+===== sample 005 =====
+[CLS] civilian judges, acting as the court of appeal. [SEP] at the busy railway station, the pilot collapsed in the rain in the early hours of the morning. [SEP] i lost my job because some people just lost, "and it was followed by the long days of three to four hours. [SEP] david dungy, a spokesman for the sheriff's department, has said the prison chief believes the drug enforcement campaign could reduce the number of drug - related crime in the region. [SEP] he crawled out of the car, with his head covered in a blanket, then tried to wave it back to finish in a safe position. [SEP]" it [SEP]
+
+===== sample 006 =====
+[CLS] prosecutors in the mclelland case review the federal grand jury's findings and report into the death of stephen baker, whose body was discovered on march 2. [SEP] the government's last decision on the use of force was in 2007. [SEP] the children were taken from a school in sudbury, cambridgeshire, a week before 2200 bst that evening. [SEP] people in the midlands and surrounding areas have also taken part in extreme weather events. [SEP] it is also offering a working mortgage benefit scheme likely to cost £6 a week, starting at £345 a week. [SEP] if you can't imagine texting a baby, or [SEP]
+
+===== sample 007 =====
+[CLS] receive a guaranteed bonus of $4, 000 - - and paid full - time each month. [SEP] many fear water supplies hold up to their power facilities as they prepare for a strong storm. [SEP] i could not believe that he would ever get a bank loan. [SEP] he was fired, spokeswoman said. [SEP] " i'll tell you today, he's much more effective than now. [SEP] these institutions are not entirely strangers; they can choose their own ways. [SEP] jones said he met with the defense minister, gen. jaullah mujahid, to discuss plans to push taliban militants from the eastern province of [SEP]
+
+===== sample 008 =====
+[CLS] - of - one match to finish in the overall standings for the opening round. [SEP] leeds does not play its final home game after a 4 - 3 defeat to bohemians three days ago. [SEP] he refused to leave the post office until after april 2010 and will be able to announce details of his plans until the next year. [SEP] a 30 - year - old man has been bailed after a 22 - year - old man was found stabbed on london's regent street. [SEP] it is building a team of senior management and top financial advisors to take on the job. [SEP] but it is a turning point in the history of the [SEP]
+
+===== sample 009 =====
+[CLS] county's emergency management office. [SEP] he told e - mails that the officers told him they had fired him, and after the officer got out of hand moved out and arrested the men. [SEP] it was not clear whether the case was being investigated before or whether prosecutors were due to court. [SEP] this is not the time for this fight. [SEP] that night, they had been locked up inside the club. [SEP] however, the report says that any changes should not stand in the way of the public inquiry and accountability for those claims. [SEP] and yet there is no point to think it irrationally. [SEP] installation is $29, [SEP]
+
+===== sample 010 =====
+[CLS] scientists at the national park are waiting to see if the virus replicates itself in the public. [SEP] james is hoping to force england into seventh place in his squad when he faces the world championships in rome later. [SEP] if you're young, light and clever, you'll just feel you're getting too tired of it. [SEP] the 12 - month growth rate slipped 0. 5 point to 7. 0 percent, which was down the 7. 5 percent expected in april. [SEP] bae could secure a £430m deal for the aegis helicopter system, which the u. s. air force is seeking to build [SEP]
+
+===== sample 011 =====
+[CLS]. [SEP] georgian officials also alleged that russian troops had carried out operations to disarm in south ossetia, which was the headquarters for u. s. and u. n. peacekeeping forces in afghanistan. [SEP] more recently, there was no immediate evidence to support the theory that the dead woman had been shot to flee the scene of the crime. [SEP] donaldsfeld, the vice president's science adviser and the chief executive of the joint national security council, is leading a research program at the national institute of economic studies. [SEP] the governor confirmed at a press news conference that the legislature approved the bill scheduled for march 1, [SEP]
+
+===== sample 012 =====
+[CLS] will never be stopped. [SEP] it's a place where people can spend time with a family, to keep the quiet. [SEP] the result is the level of support for the auto industry. [SEP] chrysler will have to make another reorganisation in its business units before the end of the year. [SEP] "i think a lot more needs to be done for our national security," said alan ashburn, head of the congressional budget office. [SEP] it was the second of october - - almost six years ago when the iraqi police chief made the nomination for his job, announced at a meeting of the provincial council in the central square. [SEP] the [SEP]
+
+===== sample 013 =====
+[CLS], including people in his family. [SEP] he moved out of san diego for his fourth - straight preseason game, going 3 - 1, to make the postseason the regular season. [SEP] mr power was the subject of a scandal in office last year but has said that he is helping with legal proceedings, despite facing impeachment proceedings and corruption charges. [SEP] if i hadn't held my son alive, the officers would probably very easily have done no harm, " he added. [SEP] the hurricanes' league most famous victory was a 5 - 4 thrasher on thursday night against nashville. [SEP] under new guidelines, health experts have failed to [SEP]
+
+===== sample 014 =====
+[CLS] for the first new session on the iranian crisis in four years, and threatened to hold talks in three days' time without reaching a deal. [SEP] nobody wants a doctor to find the full x monitor to stay in the operating room. [SEP] brown, born in 1965 and once served at the u. s. army headquarters, initially received a brief b. d. in 1963 from the virginian university medical school, near the university of illinois law. [SEP] bank of america corp was selling a stake in a bank with net worth of $1. 8 billion to the u. s. u. s. federal reserve, the head of [SEP]
+
+===== sample 015 =====
+[CLS] [SEP] he's free, but it won't work in his health either. [SEP] however, the imf's position has been to make it easier for banks to raise capital. [SEP] a government study found men working in apprenticeships were more likely to succeed those who left work just weeks after leaving for a formal appointment at the school year. [SEP] she said she thought she had to save her son, mr obama. [SEP] land securities said it would update its financial ratios during the third quarter of trading. [SEP] the boy did have two children but the parents said he did not want to attend a school which had children outside their [SEP]
+
+===== sample 016 =====
+[CLS]. bailoutreagh. com. [SEP] the average interest rate on the loan would be about $2. 60 to $3. 70 for the loan. [SEP] they go home and regularly sleep in a wheelchair, while 8 - year - old aaron and his mother take their son into the hospital, family and friends reported. [SEP] in a partly autobiographical account of david morrison's complicated life, he is best known to look at the best of his novels, including his novels as the boy's child, as well as as the original author of the children's story and "dirty dancing" writer david wells. [SEP] we [SEP]
+
+===== sample 017 =====
+[CLS] open to the public in september. [SEP] the while the trade took place in the us, the fish were active in the 1980s and 1990s. [SEP] "you can't have a budget because you know what you're going through - - you have a lot of money, and that's a lot of faith in the money," he said. [SEP] the first was the name of a former cargill employee. [SEP] but at some point he's got someone that has the same quality as everyone, and he has played well enough. [SEP] we could go to a very good hospital, "he said. [SEP]" we [SEP]
+
+===== sample 018 =====
+[CLS] [SEP] a zimbabwean military plane landed saturday just minutes after flying to the island 90 miles south of the capital on the coast of south africa. [SEP] in addition to being a senior striker, supported by harry redknapp, the spurs manager, who dismissed the idea that rooney alone, if he completed his first goal, he could be considered part of chelsea's top squads. [SEP] the fbi, the investigation unit, the office of the federal bureau of investigation and the fbi coordinate efforts in the investigation of the workplace violence. [SEP] bhp billiton has accepted the outcome in its own offer ahead of target of 3p for the [SEP]
+
+===== sample 019 =====
+[CLS] [SEP] palin said state law enforcement officers have complained about police complaints and the use of 24 - hour days of alerts that many have cancelled because of potential violations. [SEP] it was david smith in the first scottish national orchestra, north west scotland, who recorded the final part and composed franz zamlik's "strange goodfellas." [SEP] appointments.. a good opportunity is available for real estate.... £262 - £24999 per annum + bonus.. british olympic association. leeds. £299 - - £26, 000 + bonus.. c £30000 per annum + bonus [SEP]
+
+===== sample 020 =====
+[CLS] over five years ago. [SEP] "when i think that people would think about him is i'll ask for a pardon, you want to get your child out of a prison, you must be released," she said. [SEP] the national price rate is still at its highest level of inflation since 2001, but the government could afford to follow the record. [SEP] maj robert h. reid, head of britain's chief of naval staff, made an unprecedented appeal after five officers from the joint chiefs of staff were charged with an incident of suspected car theft. [SEP] the search is now way to determine the circumstances leading up to her death [SEP]
+
+===== sample 021 =====
+[CLS] down in 2005, most local officials would not seem to wind up doing this job. [SEP] you'll do something you didn't do years ago. [SEP] a 4 - 0 champions league win, when they had only 15 players, ended their season in october 2009, and it took them to beat manchester united to get into the championship game. [SEP] china is the world's most important economy and it is expected to create hundreds of thousands of jobs around the world. [SEP] the man has been granted a bail order, but was later released on bail. [SEP] in fact, its geoclinist has become a popular instrument - [SEP]
+
+===== sample 022 =====
+[CLS] change in performance or factors that could affect the company's current performance or we have to act on other statements of management to reflect future developments, the impact of pre - historical performance and performance, unexpected financial risks or events that could affect the accuracy or accuracy of the new information, potential criminal charges, regulations, or the interpretation of the information, or the public. [SEP] yahoo inc. amended its plan to combine yahoo with search ads in january, in a bid to modernize yahoo. [SEP] "if patients are referred to an emergency, which is in a few hours, at the hospital after the onset of a flu outbreak," [SEP]
+
+===== sample 023 =====
+[CLS] said it was satisfied there is a "serious flaw" in the judges' decisions. [SEP] in many cases, staff are usually forced to call in a telephone, but people complain and the numbers are always based on the call call. [SEP] in the past three years, the government, the federal police state council and the army were on track to launch new enforcement activities, according to the statement. [SEP] the court had permission for mr brown to turn the second session into a session but the end - of - session session was interrupted by his outburst. [SEP] she also has a large tricer in her headgegus. [SEP] following his long [SEP]
+
+===== sample 024 =====
+[CLS] prices. [SEP] one issue currently under discussion is allowing the house to pass legislation. [SEP] bernanke said the fed would cut rates and keep rates low through next sept. [SEP] the country is the no. 1 in india's developing economy, with exports falling under 21 percent of gdp in december of last year. [SEP] banksy, one of the leading british architects of the generation, worked for thirty years as a research assistant to the royal academy of music and to become a b lecturer and then associate professor of mathematics of the royal college society. [SEP] the children are usually too small or large for their jobs. [SEP] no action could [SEP]
+
+===== sample 025 =====
+[CLS] the un security council approved the bill to question the legality of the constitution. [SEP] he said the metropolitan police police has launched an internal investigation into several county - level employees, including 10 officers who are disciplined and disciplined after complaints about officers while they carry out their duties. [SEP] it was in the five months before he went to college and arranged for her to enroll in college. [SEP] a resident dropped five to seven vases off the floor in the centre of the building. [SEP] the rate of weight loss increased from high levels - - 14 percent to 18 percent in 2001 and 2 percent in 2007, according to the research center. [SEP] [SEP]
+
+===== sample 026 =====
+[CLS]. 500 in game three last sunday. [SEP] all three of those attacks have been linked to a terrorist network run by the american military, including the leader of al qaeda. [SEP] aerospace group boeing co. is expected to report disappointing full - year results and the outlook for its debt has sparked a steady stream of sales. [SEP] but the euro rose to 1. 6295 dollars from 1. 663. [SEP] this week's list included four schools, which received $1 million, six awards in 2006 and $3. 5 million in grants this year. [SEP] mr eide is iran's closest diplomat. [SEP] i still [SEP]
+
+===== sample 027 =====
+[CLS] critically injured in a series of attacks at a nightclub. [SEP] new home home secretary alan johnson has warned the government of the need for further legislation. [SEP] the state health department on thursday announced that legislation to change the amount of smoking is also pending. [SEP] a few of her students, aged in nursery class, did not have enough space to breathe. [SEP] the attack came after a security council report that the children were expelled from the foreign office in a government building. [SEP] wali ali, a former commander in the north, declined to be named, and said he was killed in the southern city. [SEP] he was only 20 years of [SEP]
+
+===== sample 028 =====
+[CLS] - section of congress. [SEP] mr clark has issued a statement for an public inquiry which is expected later. [SEP] miami, florida (cnn) - - the country's election commission rejected the military officers who had ousted the controversial "military coup" of president general pervez musharraf, the interim president said saturday. [SEP] however, while the us bank of bank of japan could cut rates today, a vice - chairman of the fed's policy committee said there had been no real sign of the recession. [SEP] richard davies, a fire service spokesman at south general nhs trust, said the service had been restored after the alarm [SEP]
+
+===== sample 029 =====
+[CLS] ruled in his favor. [SEP] now we're facing the threat of a recession. [SEP] copper fell nearly 1. 8 per cent to $647, or 6. 9 per cent to $1, 007. 70. [SEP] the judge said the prosecution's case was adjourned until nov. [SEP] it says people should have the self - control experience to think and behave with a sense of normalness. [SEP] last night, the lakers had their best team to make it to the final four. [SEP] the details of the latest fight weren't immediately clear. [SEP] about 90 percent of the changes to the state ' [SEP]
+
+===== sample 030 =====
+[CLS]25 or (888) 92720, u. s. dollars, or calling (0) 426 8106 or ( international (1) pass code 889981000 or pass code 20008. [SEP] the mod dismissed the increased claims of air strike orders, and added that it was reviewing procurement options on its current joint strike aircraft. [SEP] the federal trade commission has been set for an inquiry on whether to press charges. [SEP] and i was also holidaying in the family's holiday holiday home, which has vaulted ceilings, the hot weather, terraces and a roof. [SEP] john brown, the chairman [SEP]
+
+===== sample 031 =====
+[CLS] regiment took part in the military action of southern afghanistan. [SEP] former army commander lt. gen. keith pasquio, commander of the army's staff, said the war may be in need of an open debate between their commanders, including stanley mcchrystal and genel schwartz, the commander appointed by gen. george w. mcgeo, who was fired aug, to serve until his troops leave in august. [SEP] "there's been some criticism over the last couple of months, and the state is not acting too much for me," he said. [SEP] the former president was nominated for the presidency in 1975 [SEP]
+
+===== sample 032 =====
+[CLS] series of flats on the fifth floor. [SEP] mr. jackson declined to acknowledge that jackson's death was delayed or his death would not be reported. [SEP] he said the unemployment rate dropped 4 percent on the year - - its highest - - since hitting 12. 2 percent in september 2006, about 7: 30 p. m.. [SEP] to economists, the fedc was very much paying attention to the fact that the current financial market crisis was among the most serious and unprecedented in modern history. [SEP] the crowd was stunned by the size of the wall of the white house, but they didn't see the president, any more [SEP]
+
+===== sample 033 =====
+[CLS] third quarter. [SEP] "it is the duty to make the decisions of the game solely in the context of the legal and legal authorities and any information, or advice to any financial professional or authority, which may be appropriate to appeal. [SEP] last year nearly all of the country's 65 million people enrolled in their high education and many enrolled in the united states. [SEP] he was also jailed as a juvenile and given a discharge for his behaviour. [SEP] while sen clinton won nevada, he praised the party's decision to build a" preliged voting base " in the state primary for obama. [SEP] in the terms of the report [SEP]
+
+===== sample 034 =====
+[CLS] language because it could not affect the tone of his speech. [SEP] the report came as the white house released a report that president obama will divert $35 billion a year from the stimulus program. [SEP] the company's third quarter net profit was $. 9 billion, on weakness in the u. s. and european markets. [SEP] many of the new visitors are in the united states. [SEP] texas tech has won three of its last four games in texas. [SEP] the majority dismissed the allegations against paterson, however, calling it a written question regarding the firing of a state's attorney. [SEP] they're looking for someone else, [SEP]
+
+===== sample 035 =====
+[CLS] of former chief executive peter moore, pending the results of an internal review, the irb said in a statement on sunday. [SEP] but mr mukasey says that there are legal challenges to the idea that judges should be put in jeopardy. [SEP] the man could also have been jailed for 15 years. [SEP] in 1980 president george bush used the torch for a visit to the state's infantrymen's hospital, as well as the queen, to present his tribute to the service of victims during the vietnam war. [SEP] china's sovereign wealth market made an annual but record annual profit of rmb43bn in 2008 because of [SEP]
+
+===== sample 036 =====
+[CLS] an average of 8. 4 per cent over the next six months, with the biggest double - annual increase of 7 per since september 2006. [SEP] david marty served as deputy secretary of state for african affairs. [SEP] ryan taylor, 19, a doctor at the university hospital, died saturday, a day after he wrote out his crime. [SEP] it also makes illumine inc, the maker of alcoa inc., which also makes fermo's namesake coffees, and j. c. penn, the world's biggest - selling maker of consumer products used in its cars. [SEP] it was a decision i made [SEP]
+
+===== sample 037 =====
+[CLS] officer councillor jim porter said: " i thought i made it the most obvious aspect of this situation after i was told it was a serious problem. [SEP] the lodge is currently open to all guests, and a hotel and other facilities have been available for the event, opening in november. [SEP] later wednesday, u. s. and coalition forces took control in western kunar province, which is near an important area where government troops operate. [SEP] president nawaz sharif's former deputy, muqtadah al - islami, and later the chief minister, gen. naqrq kayani will be vice president. [SEP] [SEP]
+
+===== sample 038 =====
+[CLS] have a lot of student children at college and my daughter at school, but probably because i will almost always get reminders of the alphabet at school rather than at school. [SEP] following a recent appearance by mrs. clinton, a former mr. obama and one colleague now appearing on state television, which calls mr. obama to be the vice president, said the 42 - year - old obama appeared safe. [SEP] she argued that she should be suspended by the national investigation and complaints commission, where she had been kept confidential and was not only allowed to under the rules of conduct, she did not need a formal investigation. [SEP] child and father [SEP]
+
+===== sample 039 =====
+[CLS] of the modern era. [SEP] police said the fifth child, briane mason, in the kitchen in clapham road, herts, suffered from a gastrointestinal complaint. [SEP] he said that it was good that some of the money would not be left in reserve. [SEP] "it's a little hard for us to pay prices," she says. [SEP] most of all, i didn't drive three miles long before i could call a colleague to look up the phone. [SEP] take the "top chef" star tom watson, the show co - based based on the bbc's fourth book, the rules [SEP]
+
+===== sample 040 =====
+[CLS] town of perth and went missing on a sunday after a long holiday, the court heard. [SEP] the pentagon says at least 20, 000 people in excess of nearly 7 million people were killed in the war - - the largest toll of iraq's so long occupation and occupation of southern iraq. [SEP] in 2003, the city's financial planning board took up the application. [SEP] the former footballer david mercer has pleaded guilty to false suicide charges after being arrested and questioned on suspicion that she had been poisoned. [SEP] bolt would also secure a gold medal for 100m for american shawn johnson, who is third of the 100, 000m world [SEP]
+
+===== sample 041 =====
+[CLS] gas stations. [SEP] the u. s. department of energy had increased the total oil supply supply for processing by 1, 000 and 1, 000 bps. [SEP] that morning, officers said, officers arrived outside a nearby apartment building, which he thought closed because he was running a night's work. [SEP] "it's changing." [SEP] john hogger was a member of labour's internal law inquiry committee and the former no. 2, john mcgrady, chair the public inquiry. [SEP] to give this, i sent notes to a visiting fellow teacher and asked for an interview. [SEP] (ap) - a [SEP]
+
+===== sample 042 =====
+[CLS] mike adams, deputy superintendent mike o' brien and barbara morgan, a fourth - grader. [SEP] all six men are out for about four weeks before a tour of australia, which he is scheduled to begin next year. [SEP] he can only drive in half - way, thinking of his mates and soon picks up a laptop and sits his sleep on the front floor of his bed. [SEP] £1. 99 - $0. 99 £199; www. £69. 99. [SEP] arsenal lost their fa cup final meeting at crystal palace on the night just 12 hours after liverpool made a play - off trip to tottenham hotspur. [SEP]
+
+===== sample 043 =====
+[CLS] [SEP] the company's executive director, mohammed gbadi, is a former employee. [SEP] but even if the crisis is not temporary, a run - up in prices is not the case. [SEP] the u. n. news agency reported sunday that the united states had "fully located" the missiles and were continuing to place them in the same location. [SEP] the council president, paul mason, demanded an "independent review" inquiry. [SEP] in his decision, judge phillips said that the us authorities had allowed any proceedings to proceed - - or out of court - - to be filed as quickly as a court suit was necessary. [SEP] [SEP]
+
+===== sample 044 =====
+[CLS], says the sheriff's office investigated the county's call after responding to an incident at home in sequito. [SEP] by the end of the year, a number of claims are expected to be 14, 000, officials said. [SEP] if this goes on forever, we are about to be forever locked in the bubble zone. [SEP] i don't think that is true - i know it was true and do not deny that. [SEP] keep being happy with him too. [SEP] i haven't heard anything about it. [SEP] but i was doing well.... not too fast. [SEP] robert burns, the former [SEP]
+
+===== sample 045 =====
+[CLS]ws. com. [SEP] the family sister, john johnson, said she had been called by the mother about a drunken incident. [SEP] that was normal. [SEP] "doing good is a different kind of sport. [SEP] president obama has stated in a speech that during former president bill clinton's administration, us president george bush would be" more than 100 days " for members of the military. [SEP] meanwhile, older people are leaving their parents in primary school or after their primary school or staying in over the summer or fall. [SEP] it is long enough for mitchell, who is not out until the game, but he made no secret of his [SEP]
+
+===== sample 046 =====
+[CLS] the league's first straight home title. [SEP] the fillings start at £2. 99, and are topped with wine. [SEP] you are a pretty good. [SEP] zelaya refused to run an interim government, following his initial stint as a spokesman in the army. [SEP] the matter is being investigated by parliamentary authorities. [SEP] this isn't culture at all, it is about politics. [SEP] he says he had a full set of symptoms, which required him to get the phone back to his doctor for several months. [SEP] "this previous decision, with the risk of a very bad pregnancy, could have had a significant impact," [SEP]
+
+===== sample 047 =====
+[CLS] the report. [SEP] yet the vote could be a significant slowdown in a country which has fallen short of recession in public campaign promises. [SEP] when i come here i will travel with a new head coach. [SEP] bent, 27, joined the arsenal football side from blackburn almost almost a decade ago and has played major part in the club in the past. [SEP] the fire authority deferred that building works were still going on at its building site, but originally said no work would take place in the county. [SEP] sharif had already issued a list to run for musharraf, and says that he does not see that " presidential [SEP]
+
+===== sample 048 =====
+[CLS]. military says most of its soldiers, known as marine infantry, now has a 100 - strong operations base in iraq, but it maintains a special operations command there that includes more than 2, 000 marines ahead of a new american strategy in the south. [SEP] it's not the case in the real world. [SEP] even its problems have been a disappointment. [SEP] officers made the call to jackson within the first three minutes, the inquiry said. [SEP] for more information, visit http://www. cri. org. [SEP] he was free to be reached until less than a month ago. [SEP] since the current financial crisis, [SEP]
+
+===== sample 049 =====
+[CLS], a joint venture of cnn and several other media news agencies. [SEP] these include the royal national trust & trust (0172 72009) and the restoration trust from £975, 000. [SEP] the mayor says the scheme will allow candidates to be part in the national election contest. [SEP] "and many of them were found and shot in the head, causing no injuries. [SEP] many companies have built large operations, some have a small scale base in the uk. [SEP] they became interested in the case of a young pub worker who was jailed for murder. [SEP]" it's an extremely small process, not a big [SEP]
+
+===== sample 050 =====
+[CLS] than enough to win this year's general elections, the electorate will become critical to the president's plans. [SEP] american airlines chief executive scott tankleff said tuesday the company couldn't try to push back, and could not conclude a deal. [SEP] the new and current tests are expected to be published and published early next year. [SEP] the show will revert to its non - public location on "60 minutes" in 2010. [SEP] she had only since been released from the hospital. [SEP] since we waited for three months, though, it probably won't be long. [SEP] it is believed her family had died, [SEP]
+
+===== sample 051 =====
+[CLS] people to any health centre. [SEP] in fact, the lower high court could not be said; the chief chief justice should have been more cowed. [SEP] when a large number of his family were missing, the family bought a house and he was dead. [SEP] he was ordered held without bond and was returned to prison tuesday. [SEP] other senate members have expressed similar concerns. [SEP] along with a weak housing market, obama has argued for concessions on key parts of the proposed bill. [SEP] a seasoned brand manager, heinemann remains the company's leading on - line designer, overseeing all products. [SEP] " his family are not part [SEP]
+
+===== sample 052 =====
+[CLS] said. [SEP] by then, turns out, it had been smith's final game of the night, she sent him to high school and had his notebooks for sleep. [SEP] ms lyn jones said a number of local people had attended the council's meeting. [SEP] however, the bbc has no more details. [SEP] if they did agree, it will probably take another three months. [SEP] the russian defense department has said it is unlikely to make a "satisfactory approach" to the oil issue. [SEP] mr ward, 53, of sudbury, suffolk, is expected to be sentenced at the city of norwich magistrates court in norwich on [SEP]
+
+===== sample 053 =====
+[CLS]. [SEP] his fault? [SEP] if we change the constitution, the situation will change, "he said. [SEP] in that way, they'd better take responsibility for that this attack took place. [SEP] the air force national survey service said after three hours there had been no reports of uproar on land, with up to 20 trapped people still in the area. [SEP] the independent police complaints commission said the force had" received no reports of a conflict of public interest. " [SEP] the first is you can make your decision, even when you slow down. [SEP] the speed of the new system needs to be measured in order to create [SEP]
+
+===== sample 054 =====
+[CLS] the authorities in dealing with such a situation. [SEP] set in the aftermath of the cold war in 1980. [SEP] some companies do not have clear policies to set their profit targets. [SEP] the show creators wanted to write a playlist and did not want to write them in the short iterations of their original series. [SEP] the council has imposed a penalty of 30 months, a ban usually imposed, after completing its three - year extension earlier this month. [SEP] the plane was left on the fifth floor of the hotel and exited in front of the crowd. [SEP] he said he believes new information will be used for prevention. [SEP] the car, [SEP]
+
+===== sample 055 =====
+[CLS]q ). [SEP] shortly after american officials called to help, the bombing victim was not named as his killer, only to be arrested in the killings. [SEP] however, western officials said that at least four of the pakistani police had been killed, including 10 militants. [SEP] they said he claimed to have the victim shot outside the house monday night and that the rampage ended with his father's death. [SEP] it's difficult to gauge, " he says. [SEP] judge stephen j. kagan, the assistant commissioner of alaska, is the former assistant california attorney general for criminal investigation. [SEP] he also said a full - duty police officer [SEP]
+
+===== sample 056 =====
+[CLS] that, probably because, ' oh, in order to do it i need a lot of money, i'm sorry, and i feel that there is no disingenuous to have some kind words in my voice. [SEP] august 21 - 5 p. m., w. broad street society, 1, 14th street, east n. 1615. [SEP] in the years she married timothy gordon, he became a b. h. fan. [SEP] e. r. k. malek, who is a conservative activist, also has not been promoted. [SEP] "it's a long, a long week," says [SEP]
+
+===== sample 057 =====
+[CLS] workers began taking off the syringes and other sprits - - including coffee sandwiches and christmas tree meals - - to take patients. [SEP] people who were asked to do so would have to register to post questions in an hour or so before the full details, call 0177 79707 or 01706 7300000. [SEP] it's a very serious issue. [SEP] for the moment, he is not quite convinced but he insists we are at big risk. [SEP] last week, the house ethics committee failed to rule on the allegations of money and, apparently to avoid it, passed ethics rules that would ban spending [SEP]
+
+===== sample 058 =====
+[CLS] value of the house's value. [SEP] well, says mr. rauf. [SEP] british energy finished up 6. 4 percent to 6, 952. 5p, while shares of gas rose 6. 5 percent to 2. 5p. [SEP] det con chris brown also said the court would know that mr smith had waited for the morning after the robbery before he appeared in court at the time of his death. [SEP] the last election elections for european parliament was held in 1991. [SEP] "this is not a moment we believe we are heading for," he said. [SEP] police now know who has been killed, and even [SEP]
+
+===== sample 059 =====
+[CLS] negative effects of the financial crisis leads to higher demand for available money for education, health and anti - poverty treatment programs and other measures to finance prevention programs, the report added. [SEP] it wasn't a bad show either way, either. [SEP] bad debt was among the worst in the financial crisis. [SEP] last year e4, the uk's third - largest telephone provider, negotiated a 6 % cut in its fixed - rate contract with vodaq. [SEP] the use of electricity generates around 17 % of the world's power available abroad. [SEP] the first bombings, in which more than 20 percent of muslims were killed in [SEP]
+
+===== sample 060 =====
+[CLS] to leave him while he would take part in the games. [SEP] the georgian commander, alexander kalirad, said the russian force had started a major offensive in the south osh region, advancing georgian anti - aircraft troops. [SEP] the means that patients may be prepared for further treatment - - - such as a longer hospital waiting period - - is not available, either 10 to 18 or 20 months after or nine months after surgery or diagnosis. [SEP] after all, he was competing at twickenham with david smith in 2002, after impressing in a dramatic final victory 27 years ago. [SEP] " a proposed human rights commission is the way [SEP]
+
+===== sample 061 =====
+[CLS] new election would be held every seven years. [SEP] this year, there were other drops in oil production prices, including in nigeria and in the us, the group said. [SEP] wednesday's record price was $2. 5 million. [SEP] a 64 - year - old welsh man has died in critical condition after being hit by a car in an accident on a bus in dorset. [SEP] the man was taken to southampton university hospital's emergency room four hours later, and is in hospital for further treatment. [SEP] the baltimore county police are investigating and investigating since 2003. [SEP] his focus will be on monday's performance and the return [SEP]
+
+===== sample 062 =====
+[CLS] the state's chief prosecutor has been suspended by the attorney general's office after holding an independent report of state sexual violations of state law enforcement law. [SEP] the chief general also named key figures, including lt. gen. mohammed zaqqani and abdul - qassim al - ahmadi, the deputy vice - chief of operations abdul - haq. [SEP] shortly after she was recorded on a radio station, the officers found documents she had cut down - - saying she had broken the stairs and was still gone. [SEP] she was the only back - sitter in the three women's skiing and world cup pairs events [SEP]
+
+===== sample 063 =====
+[CLS] 52. 1 percent for 2, 500 yards in the 2005 - 06 regular season. [SEP] the u. s. military closed the formal investigation into the cause of the shooting and turned it down. [SEP] the 61 - year - old was paid £21, 900 for his office expenses, rising to £91, 200, and £69, 560 for his home alone in march 2006 to £204, 997. [SEP] earlier, the company had confirmed cases of sanlulu1: flu in asia, but it has ordered 2. 2 million pounds of high - grade bird sanlu, authorities said. [SEP] in [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/argmax_const1p45_noise_c256_raw_samples.txt

@@ -0,0 +1,236 @@
+argmax_const1p45_noise_c256
+{
+  "type": "summary",
+  "name": "argmax_const1p45_noise_c256",
+  "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt",
+  "step": 200000,
+  "decode": {
+    "kind": "categorical_fullvocab_final_sampling_push43",
+    "config": "argmax_const1p45_noise_c256",
+    "steps": 128,
+    "temp_start": 1.45,
+    "temp_end": 1.45,
+    "temp_schedule": "const",
+    "t_power": 1.0,
+    "eta0": 0.12,
+    "eta_schedule": "early_cosine",
+    "noise_conc": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "final_mode": "argmax",
+    "final_temp": 1.0,
+    "top_k": 0,
+    "top_p": 0.0,
+    "uniform_mix": 0.0,
+    "sample_threshold": 1.0,
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 43.01780486436395,
+    "nll_per_token": 3.761614096604754,
+    "tokens": 9644
+  },
+  "diversity": {
+    "sample_entropy": 4.198717295568989,
+    "unique_tokens": 1974,
+    "token_count": 8192,
+    "distinct_1": 0.240966796875,
+    "distinct_2": 0.7169045275590551,
+    "top_token_mass": 0.0582275390625
+  }
+}
+
+===== sample 000 =====
+[CLS] the president will have to win in the next election. [SEP] it also announced bad results at some of the world ' s biggest credit - card companies and stripped out $ 6. 7 billion in the fourth quarter. [SEP] it can be due to the increased labour requirements and the change in demand, it says. [SEP] " we ' re very involved in policing schools, roads and buildings and we ' re working all over london to find incidents like this, " he said. [SEP] i had a good record and i was doing his best. [SEP] washington - - attorney general michael ki. moon ' s appointment as a former u. n. [SEP]
+
+===== sample 001 =====
+[CLS] star, singer michael russell, has been asked to increase his licence. [SEP] the fall is a good time in school. [SEP] had he sent his dog to buy his own car, the money would have gone. [SEP] in an interview, a senior official said the senator had refused to accept donations. [SEP] tougher guy. [SEP] the defence said that the incident was a breach of procedures made by the ministry of defence ' s specialist civil investigations department in 2002. [SEP] more consumers can visit or join the website and be reached at www. medgreent. com /. [SEP] for more information on iridium, visit the data center. [SEP]
+
+===== sample 002 =====
+[CLS] wouldn ' t be a good idea to carry out a thorough review. [SEP] at a meeting on friday, the company ' s board voted overwhelmingly in support of president obama ' s plans in iraq for the next six months, leaving at least $ 200 billion over two months of war time. [SEP] no, he didn ' t know all the extra money. [SEP] the proposed changes would undermine the core of the state ' s constitutional law. [SEP] the spokesman said both sides would defend themselves as a matter of urgency. [SEP] during these opecunic events, many teachers, teachers, teachers and volunteers accompany men to the gym, and often [SEP]
+
+===== sample 003 =====
+[CLS]swoman said prosecutors pursuing the case had no knowledge of the killings, and he might initiate a criminal investigation. [SEP] for the first time in a year, analysts have also warned that xstran may be worth more than the current $ 3 billion of debt. [SEP] police officers were being pushed at the door of houses where the killing took place. [SEP] it provides travel and family services run by international travel company british travel ( 020 78777 ; www. explore. co. uk ), revenue & customs holidays ( 020 730000 ) and hotels and holidaymakers. [SEP] in the eight weeks since the crisis broke [SEP]
+
+===== sample 004 =====
+[CLS], oversee the iraqi security forces, and provide security for american and iraqi forces. [SEP] these could be added when they return to the commons in the capital. [SEP] " the situation is that it will be improved, " he said. [SEP] " normally, ideally, people would see it later in the next month, doing it at least once a month, " said johnson. [SEP] in may, bill murray voluntarily received a mental health treatment, according to a report by his north carolina office. [SEP] but eight people have been killed by police in the region. [SEP] and having won the british olympic and european cup titles in 2003, and second [SEP]
+
+===== sample 005 =====
+[CLS] civilian judges, acting as the court of appeal. [SEP] at the busy railway station, the pilot collapsed in the rain in the early hours of the morning. [SEP] i lost my job because some people just lost, " and it was followed by the long days of three to four hours. [SEP] david dungy, a spokesman for the sheriff ' s department, has said the prison chief believes the drug enforcement campaign could reduce the number of drug - related crime in the region. [SEP] he crawled out of the car, with his head covered in a blanket, then tried to wave it back to finish in a safe position. [SEP] " it [SEP]
+
+===== sample 006 =====
+[CLS] prosecutors in the mclelland case review the federal grand jury ' s findings and report into the death of stephen baker, whose body was discovered on march 2. [SEP] the government ' s last decision on the use of force was in 2007. [SEP] the children were taken from a school in sudbury, cambridgeshire, a week before 2200 bst that evening. [SEP] people in the midlands and surrounding areas have also taken part in extreme weather events. [SEP] it is also offering a working mortgage benefit scheme likely to cost £6 a week, starting at £345 a week. [SEP] if you can ' t imagine texting a baby, or [SEP]
+
+===== sample 007 =====
+[CLS] receive a guaranteed bonus of $ 4, 000 - - and paid full - time each month. [SEP] many fear water supplies hold up to their power facilities as they prepare for a strong storm. [SEP] i could not believe that he would ever get a bank loan. [SEP] he was fired, spokeswoman said. [SEP] " i ' ll tell you today, he ' s much more effective than now. [SEP] these institutions are not entirely strangers ; they can choose their own ways. [SEP] jones said he met with the defense minister, gen. jaullah mujahid, to discuss plans to push taliban militants from the eastern province of [SEP]
+
+===== sample 008 =====
+[CLS] - of - one match to finish in the overall standings for the opening round. [SEP] leeds does not play its final home game after a 4 - 3 defeat to bohemians three days ago. [SEP] he refused to leave the post office until after april 2010 and will be able to announce details of his plans until the next year. [SEP] a 30 - year - old man has been bailed after a 22 - year - old man was found stabbed on london ' s regent street. [SEP] it is building a team of senior management and top financial advisors to take on the job. [SEP] but it is a turning point in the history of the [SEP]
+
+===== sample 009 =====
+[CLS] county ' s emergency management office. [SEP] he told e - mails that the officers told him they had fired him, and after the officer got out of hand moved out and arrested the men. [SEP] it was not clear whether the case was being investigated before or whether prosecutors were due to court. [SEP] this is not the time for this fight. [SEP] that night, they had been locked up inside the club. [SEP] however, the report says that any changes should not stand in the way of the public inquiry and accountability for those claims. [SEP] and yet there is no point to think it irrationally. [SEP] installation is $ 29, [SEP]
+
+===== sample 010 =====
+[CLS] scientists at the national park are waiting to see if the virus replicates itself in the public. [SEP] james is hoping to force england into seventh place in his squad when he faces the world championships in rome later. [SEP] if you ' re young, light and clever, you ' ll just feel you ' re getting too tired of it. [SEP] the 12 - month growth rate slipped 0. 5 point to 7. 0 percent, which was down the 7. 5 percent expected in april. [SEP] bae could secure a £430m deal for the aegis helicopter system, which the u. s. air force is seeking to build [SEP]
+
+===== sample 011 =====
+[CLS]. [SEP] georgian officials also alleged that russian troops had carried out operations to disarm in south ossetia, which was the headquarters for u. s. and u. n. peacekeeping forces in afghanistan. [SEP] more recently, there was no immediate evidence to support the theory that the dead woman had been shot to flee the scene of the crime. [SEP] donaldsfeld, the vice president ' s science adviser and the chief executive of the joint national security council, is leading a research program at the national institute of economic studies. [SEP] the governor confirmed at a press news conference that the legislature approved the bill scheduled for march 1, [SEP]
+
+===== sample 012 =====
+[CLS] will never be stopped. [SEP] it ' s a place where people can spend time with a family, to keep the quiet. [SEP] the result is the level of support for the auto industry. [SEP] chrysler will have to make another reorganisation in its business units before the end of the year. [SEP] " i think a lot more needs to be done for our national security, " said alan ashburn, head of the congressional budget office. [SEP] it was the second of october - - almost six years ago when the iraqi police chief made the nomination for his job, announced at a meeting of the provincial council in the central square. [SEP] the [SEP]
+
+===== sample 013 =====
+[CLS], including people in his family. [SEP] he moved out of san diego for his fourth - straight preseason game, going 3 - 1, to make the postseason the regular season. [SEP] mr power was the subject of a scandal in office last year but has said that he is helping with legal proceedings, despite facing impeachment proceedings and corruption charges. [SEP] if i hadn ' t held my son alive, the officers would probably very easily have done no harm, " he added. [SEP] the hurricanes ' league most famous victory was a 5 - 4 thrasher on thursday night against nashville. [SEP] under new guidelines, health experts have failed to [SEP]
+
+===== sample 014 =====
+[CLS] for the first new session on the iranian crisis in four years, and threatened to hold talks in three days ' time without reaching a deal. [SEP] nobody wants a doctor to find the full x monitor to stay in the operating room. [SEP] brown, born in 1965 and once served at the u. s. army headquarters, initially received a brief b. d. in 1963 from the virginian university medical school, near the university of illinois law. [SEP] bank of america corp was selling a stake in a bank with net worth of $ 1. 8 billion to the u. s. u. s. federal reserve, the head of [SEP]
+
+===== sample 015 =====
+[CLS] [SEP] he ' s free, but it won ' t work in his health either. [SEP] however, the imf ' s position has been to make it easier for banks to raise capital. [SEP] a government study found men working in apprenticeships were more likely to succeed those who left work just weeks after leaving for a formal appointment at the school year. [SEP] she said she thought she had to save her son, mr obama. [SEP] land securities said it would update its financial ratios during the third quarter of trading. [SEP] the boy did have two children but the parents said he did not want to attend a school which had children outside their [SEP]
+
+===== sample 016 =====
+[CLS]. bailoutreagh. com. [SEP] the average interest rate on the loan would be about $ 2. 60 to $ 3. 70 for the loan. [SEP] they go home and regularly sleep in a wheelchair, while 8 - year - old aaron and his mother take their son into the hospital, family and friends reported. [SEP] in a partly autobiographical account of david morrison ' s complicated life, he is best known to look at the best of his novels, including his novels as the boy ' s child, as well as as the original author of the children ' s story and " dirty dancing " writer david wells. [SEP] we [SEP]
+
+===== sample 017 =====
+[CLS] open to the public in september. [SEP] the while the trade took place in the us, the fish were active in the 1980s and 1990s. [SEP] " you can ' t have a budget because you know what you ' re going through - - you have a lot of money, and that ' s a lot of faith in the money, " he said. [SEP] the first was the name of a former cargill employee. [SEP] but at some point he ' s got someone that has the same quality as everyone, and he has played well enough. [SEP] we could go to a very good hospital, " he said. [SEP] " we [SEP]
+
+===== sample 018 =====
+[CLS] [SEP] a zimbabwean military plane landed saturday just minutes after flying to the island 90 miles south of the capital on the coast of south africa. [SEP] in addition to being a senior striker, supported by harry redknapp, the spurs manager, who dismissed the idea that rooney alone, if he completed his first goal, he could be considered part of chelsea ' s top squads. [SEP] the fbi, the investigation unit, the office of the federal bureau of investigation and the fbi coordinate efforts in the investigation of the workplace violence. [SEP] bhp billiton has accepted the outcome in its own offer ahead of target of 3p for the [SEP]
+
+===== sample 019 =====
+[CLS] [SEP] palin said state law enforcement officers have complained about police complaints and the use of 24 - hour days of alerts that many have cancelled because of potential violations. [SEP] it was david smith in the first scottish national orchestra, north west scotland, who recorded the final part and composed franz zamlik ' s " strange goodfellas. " [SEP] appointments.. a good opportunity is available for real estate.... £262 - £24999 per annum + bonus.. british olympic association. leeds. £299 - - £26, 000 + bonus.. c £30000 per annum + bonus [SEP]
+
+===== sample 020 =====
+[CLS] over five years ago. [SEP] " when i think that people would think about him is i ' ll ask for a pardon, you want to get your child out of a prison, you must be released, " she said. [SEP] the national price rate is still at its highest level of inflation since 2001, but the government could afford to follow the record. [SEP] maj robert h. reid, head of britain ' s chief of naval staff, made an unprecedented appeal after five officers from the joint chiefs of staff were charged with an incident of suspected car theft. [SEP] the search is now way to determine the circumstances leading up to her death [SEP]
+
+===== sample 021 =====
+[CLS] down in 2005, most local officials would not seem to wind up doing this job. [SEP] you ' ll do something you didn ' t do years ago. [SEP] a 4 - 0 champions league win, when they had only 15 players, ended their season in october 2009, and it took them to beat manchester united to get into the championship game. [SEP] china is the world ' s most important economy and it is expected to create hundreds of thousands of jobs around the world. [SEP] the man has been granted a bail order, but was later released on bail. [SEP] in fact, its geoclinist has become a popular instrument - [SEP]
+
+===== sample 022 =====
+[CLS] change in performance or factors that could affect the company ' s current performance or we have to act on other statements of management to reflect future developments, the impact of pre - historical performance and performance, unexpected financial risks or events that could affect the accuracy or accuracy of the new information, potential criminal charges, regulations, or the interpretation of the information, or the public. [SEP] yahoo inc. amended its plan to combine yahoo with search ads in january, in a bid to modernize yahoo. [SEP] " if patients are referred to an emergency, which is in a few hours, at the hospital after the onset of a flu outbreak, " [SEP]
+
+===== sample 023 =====
+[CLS] said it was satisfied there is a " serious flaw " in the judges ' decisions. [SEP] in many cases, staff are usually forced to call in a telephone, but people complain and the numbers are always based on the call call. [SEP] in the past three years, the government, the federal police state council and the army were on track to launch new enforcement activities, according to the statement. [SEP] the court had permission for mr brown to turn the second session into a session but the end - of - session session was interrupted by his outburst. [SEP] she also has a large tricer in her headgegus. [SEP] following his long [SEP]
+
+===== sample 024 =====
+[CLS] prices. [SEP] one issue currently under discussion is allowing the house to pass legislation. [SEP] bernanke said the fed would cut rates and keep rates low through next sept. [SEP] the country is the no. 1 in india ' s developing economy, with exports falling under 21 percent of gdp in december of last year. [SEP] banksy, one of the leading british architects of the generation, worked for thirty years as a research assistant to the royal academy of music and to become a b lecturer and then associate professor of mathematics of the royal college society. [SEP] the children are usually too small or large for their jobs. [SEP] no action could [SEP]
+
+===== sample 025 =====
+[CLS] the un security council approved the bill to question the legality of the constitution. [SEP] he said the metropolitan police police has launched an internal investigation into several county - level employees, including 10 officers who are disciplined and disciplined after complaints about officers while they carry out their duties. [SEP] it was in the five months before he went to college and arranged for her to enroll in college. [SEP] a resident dropped five to seven vases off the floor in the centre of the building. [SEP] the rate of weight loss increased from high levels - - 14 percent to 18 percent in 2001 and 2 percent in 2007, according to the research center. [SEP] [SEP]
+
+===== sample 026 =====
+[CLS]. 500 in game three last sunday. [SEP] all three of those attacks have been linked to a terrorist network run by the american military, including the leader of al qaeda. [SEP] aerospace group boeing co. is expected to report disappointing full - year results and the outlook for its debt has sparked a steady stream of sales. [SEP] but the euro rose to 1. 6295 dollars from 1. 663. [SEP] this week ' s list included four schools, which received $ 1 million, six awards in 2006 and $ 3. 5 million in grants this year. [SEP] mr eide is iran ' s closest diplomat. [SEP] i still [SEP]
+
+===== sample 027 =====
+[CLS] critically injured in a series of attacks at a nightclub. [SEP] new home home secretary alan johnson has warned the government of the need for further legislation. [SEP] the state health department on thursday announced that legislation to change the amount of smoking is also pending. [SEP] a few of her students, aged in nursery class, did not have enough space to breathe. [SEP] the attack came after a security council report that the children were expelled from the foreign office in a government building. [SEP] wali ali, a former commander in the north, declined to be named, and said he was killed in the southern city. [SEP] he was only 20 years of [SEP]
+
+===== sample 028 =====
+[CLS] - section of congress. [SEP] mr clark has issued a statement for an public inquiry which is expected later. [SEP] miami, florida ( cnn ) - - the country ' s election commission rejected the military officers who had ousted the controversial " military coup " of president general pervez musharraf, the interim president said saturday. [SEP] however, while the us bank of bank of japan could cut rates today, a vice - chairman of the fed ' s policy committee said there had been no real sign of the recession. [SEP] richard davies, a fire service spokesman at south general nhs trust, said the service had been restored after the alarm [SEP]
+
+===== sample 029 =====
+[CLS] ruled in his favor. [SEP] now we ' re facing the threat of a recession. [SEP] copper fell nearly 1. 8 per cent to $ 647, or 6. 9 per cent to $ 1, 007. 70. [SEP] the judge said the prosecution ' s case was adjourned until nov. [SEP] it says people should have the self - control experience to think and behave with a sense of normalness. [SEP] last night, the lakers had their best team to make it to the final four. [SEP] the details of the latest fight weren ' t immediately clear. [SEP] about 90 percent of the changes to the state ' [SEP]
+
+===== sample 030 =====
+[CLS]25 or ( 888 ) 92720, u. s. dollars, or calling ( 0 ) 426 8106 or ( international ( 1 ) pass code 889981000 or pass code 20008. [SEP] the mod dismissed the increased claims of air strike orders, and added that it was reviewing procurement options on its current joint strike aircraft. [SEP] the federal trade commission has been set for an inquiry on whether to press charges. [SEP] and i was also holidaying in the family ' s holiday holiday home, which has vaulted ceilings, the hot weather, terraces and a roof. [SEP] john brown, the chairman [SEP]
+
+===== sample 031 =====
+[CLS] regiment took part in the military action of southern afghanistan. [SEP] former army commander lt. gen. keith pasquio, commander of the army ' s staff, said the war may be in need of an open debate between their commanders, including stanley mcchrystal and genel schwartz, the commander appointed by gen. george w. mcgeo, who was fired aug, to serve until his troops leave in august. [SEP] " there ' s been some criticism over the last couple of months, and the state is not acting too much for me, " he said. [SEP] the former president was nominated for the presidency in 1975 [SEP]
+
+===== sample 032 =====
+[CLS] series of flats on the fifth floor. [SEP] mr. jackson declined to acknowledge that jackson ' s death was delayed or his death would not be reported. [SEP] he said the unemployment rate dropped 4 percent on the year - - its highest - - since hitting 12. 2 percent in september 2006, about 7 : 30 p. m.. [SEP] to economists, the fedc was very much paying attention to the fact that the current financial market crisis was among the most serious and unprecedented in modern history. [SEP] the crowd was stunned by the size of the wall of the white house, but they didn ' t see the president, any more [SEP]
+
+===== sample 033 =====
+[CLS] third quarter. [SEP] " it is the duty to make the decisions of the game solely in the context of the legal and legal authorities and any information, or advice to any financial professional or authority, which may be appropriate to appeal. [SEP] last year nearly all of the country ' s 65 million people enrolled in their high education and many enrolled in the united states. [SEP] he was also jailed as a juvenile and given a discharge for his behaviour. [SEP] while sen clinton won nevada, he praised the party ' s decision to build a " preliged voting base " in the state primary for obama. [SEP] in the terms of the report [SEP]
+
+===== sample 034 =====
+[CLS] language because it could not affect the tone of his speech. [SEP] the report came as the white house released a report that president obama will divert $ 35 billion a year from the stimulus program. [SEP] the company ' s third quarter net profit was $. 9 billion, on weakness in the u. s. and european markets. [SEP] many of the new visitors are in the united states. [SEP] texas tech has won three of its last four games in texas. [SEP] the majority dismissed the allegations against paterson, however, calling it a written question regarding the firing of a state ' s attorney. [SEP] they ' re looking for someone else, [SEP]
+
+===== sample 035 =====
+[CLS] of former chief executive peter moore, pending the results of an internal review, the irb said in a statement on sunday. [SEP] but mr mukasey says that there are legal challenges to the idea that judges should be put in jeopardy. [SEP] the man could also have been jailed for 15 years. [SEP] in 1980 president george bush used the torch for a visit to the state ' s infantrymen ' s hospital, as well as the queen, to present his tribute to the service of victims during the vietnam war. [SEP] china ' s sovereign wealth market made an annual but record annual profit of rmb43bn in 2008 because of [SEP]
+
+===== sample 036 =====
+[CLS] an average of 8. 4 per cent over the next six months, with the biggest double - annual increase of 7 per since september 2006. [SEP] david marty served as deputy secretary of state for african affairs. [SEP] ryan taylor, 19, a doctor at the university hospital, died saturday, a day after he wrote out his crime. [SEP] it also makes illumine inc, the maker of alcoa inc., which also makes fermo ' s namesake coffees, and j. c. penn, the world ' s biggest - selling maker of consumer products used in its cars. [SEP] it was a decision i made [SEP]
+
+===== sample 037 =====
+[CLS] officer councillor jim porter said : " i thought i made it the most obvious aspect of this situation after i was told it was a serious problem. [SEP] the lodge is currently open to all guests, and a hotel and other facilities have been available for the event, opening in november. [SEP] later wednesday, u. s. and coalition forces took control in western kunar province, which is near an important area where government troops operate. [SEP] president nawaz sharif ' s former deputy, muqtadah al - islami, and later the chief minister, gen. naqrq kayani will be vice president. [SEP] [SEP]
+
+===== sample 038 =====
+[CLS] have a lot of student children at college and my daughter at school, but probably because i will almost always get reminders of the alphabet at school rather than at school. [SEP] following a recent appearance by mrs. clinton, a former mr. obama and one colleague now appearing on state television, which calls mr. obama to be the vice president, said the 42 - year - old obama appeared safe. [SEP] she argued that she should be suspended by the national investigation and complaints commission, where she had been kept confidential and was not only allowed to under the rules of conduct, she did not need a formal investigation. [SEP] child and father [SEP]
+
+===== sample 039 =====
+[CLS] of the modern era. [SEP] police said the fifth child, briane mason, in the kitchen in clapham road, herts, suffered from a gastrointestinal complaint. [SEP] he said that it was good that some of the money would not be left in reserve. [SEP] " it ' s a little hard for us to pay prices, " she says. [SEP] most of all, i didn ' t drive three miles long before i could call a colleague to look up the phone. [SEP] take the " top chef " star tom watson, the show co - based based on the bbc ' s fourth book, the rules [SEP]
+
+===== sample 040 =====
+[CLS] town of perth and went missing on a sunday after a long holiday, the court heard. [SEP] the pentagon says at least 20, 000 people in excess of nearly 7 million people were killed in the war - - the largest toll of iraq ' s so long occupation and occupation of southern iraq. [SEP] in 2003, the city ' s financial planning board took up the application. [SEP] the former footballer david mercer has pleaded guilty to false suicide charges after being arrested and questioned on suspicion that she had been poisoned. [SEP] bolt would also secure a gold medal for 100m for american shawn johnson, who is third of the 100, 000m world [SEP]
+
+===== sample 041 =====
+[CLS] gas stations. [SEP] the u. s. department of energy had increased the total oil supply supply for processing by 1, 000 and 1, 000 bps. [SEP] that morning, officers said, officers arrived outside a nearby apartment building, which he thought closed because he was running a night ' s work. [SEP] " it ' s changing. " [SEP] john hogger was a member of labour ' s internal law inquiry committee and the former no. 2, john mcgrady, chair the public inquiry. [SEP] to give this, i sent notes to a visiting fellow teacher and asked for an interview. [SEP] ( ap ) - a [SEP]
+
+===== sample 042 =====
+[CLS] mike adams, deputy superintendent mike o ' brien and barbara morgan, a fourth - grader. [SEP] all six men are out for about four weeks before a tour of australia, which he is scheduled to begin next year. [SEP] he can only drive in half - way, thinking of his mates and soon picks up a laptop and sits his sleep on the front floor of his bed. [SEP] £1. 99 - $ 0. 99 £199 ; www. £69. 99. [SEP] arsenal lost their fa cup final meeting at crystal palace on the night just 12 hours after liverpool made a play - off trip to tottenham hotspur. [SEP]
+
+===== sample 043 =====
+[CLS] [SEP] the company ' s executive director, mohammed gbadi, is a former employee. [SEP] but even if the crisis is not temporary, a run - up in prices is not the case. [SEP] the u. n. news agency reported sunday that the united states had " fully located " the missiles and were continuing to place them in the same location. [SEP] the council president, paul mason, demanded an " independent review " inquiry. [SEP] in his decision, judge phillips said that the us authorities had allowed any proceedings to proceed - - or out of court - - to be filed as quickly as a court suit was necessary. [SEP] [SEP]
+
+===== sample 044 =====
+[CLS], says the sheriff ' s office investigated the county ' s call after responding to an incident at home in sequito. [SEP] by the end of the year, a number of claims are expected to be 14, 000, officials said. [SEP] if this goes on forever, we are about to be forever locked in the bubble zone. [SEP] i don ' t think that is true - i know it was true and do not deny that. [SEP] keep being happy with him too. [SEP] i haven ' t heard anything about it. [SEP] but i was doing well.... not too fast. [SEP] robert burns, the former [SEP]
+
+===== sample 045 =====
+[CLS]ws. com. [SEP] the family sister, john johnson, said she had been called by the mother about a drunken incident. [SEP] that was normal. [SEP] " doing good is a different kind of sport. [SEP] president obama has stated in a speech that during former president bill clinton ' s administration, us president george bush would be " more than 100 days " for members of the military. [SEP] meanwhile, older people are leaving their parents in primary school or after their primary school or staying in over the summer or fall. [SEP] it is long enough for mitchell, who is not out until the game, but he made no secret of his [SEP]
+
+===== sample 046 =====
+[CLS] the league ' s first straight home title. [SEP] the fillings start at £2. 99, and are topped with wine. [SEP] you are a pretty good. [SEP] zelaya refused to run an interim government, following his initial stint as a spokesman in the army. [SEP] the matter is being investigated by parliamentary authorities. [SEP] this isn ' t culture at all, it is about politics. [SEP] he says he had a full set of symptoms, which required him to get the phone back to his doctor for several months. [SEP] " this previous decision, with the risk of a very bad pregnancy, could have had a significant impact, " [SEP]
+
+===== sample 047 =====
+[CLS] the report. [SEP] yet the vote could be a significant slowdown in a country which has fallen short of recession in public campaign promises. [SEP] when i come here i will travel with a new head coach. [SEP] bent, 27, joined the arsenal football side from blackburn almost almost a decade ago and has played major part in the club in the past. [SEP] the fire authority deferred that building works were still going on at its building site, but originally said no work would take place in the county. [SEP] sharif had already issued a list to run for musharraf, and says that he does not see that " presidential [SEP]
+
+===== sample 048 =====
+[CLS]. military says most of its soldiers, known as marine infantry, now has a 100 - strong operations base in iraq, but it maintains a special operations command there that includes more than 2, 000 marines ahead of a new american strategy in the south. [SEP] it ' s not the case in the real world. [SEP] even its problems have been a disappointment. [SEP] officers made the call to jackson within the first three minutes, the inquiry said. [SEP] for more information, visit http : / / www. cri. org. [SEP] he was free to be reached until less than a month ago. [SEP] since the current financial crisis, [SEP]
+
+===== sample 049 =====
+[CLS], a joint venture of cnn and several other media news agencies. [SEP] these include the royal national trust & trust ( 0172 72009 ) and the restoration trust from £975, 000. [SEP] the mayor says the scheme will allow candidates to be part in the national election contest. [SEP] " and many of them were found and shot in the head, causing no injuries. [SEP] many companies have built large operations, some have a small scale base in the uk. [SEP] they became interested in the case of a young pub worker who was jailed for murder. [SEP] " it ' s an extremely small process, not a big [SEP]
+
+===== sample 050 =====
+[CLS] than enough to win this year ' s general elections, the electorate will become critical to the president ' s plans. [SEP] american airlines chief executive scott tankleff said tuesday the company couldn ' t try to push back, and could not conclude a deal. [SEP] the new and current tests are expected to be published and published early next year. [SEP] the show will revert to its non - public location on " 60 minutes " in 2010. [SEP] she had only since been released from the hospital. [SEP] since we waited for three months, though, it probably won ' t be long. [SEP] it is believed her family had died, [SEP]
+
+===== sample 051 =====
+[CLS] people to any health centre. [SEP] in fact, the lower high court could not be said ; the chief chief justice should have been more cowed. [SEP] when a large number of his family were missing, the family bought a house and he was dead. [SEP] he was ordered held without bond and was returned to prison tuesday. [SEP] other senate members have expressed similar concerns. [SEP] along with a weak housing market, obama has argued for concessions on key parts of the proposed bill. [SEP] a seasoned brand manager, heinemann remains the company ' s leading on - line designer, overseeing all products. [SEP] " his family are not part [SEP]
+
+===== sample 052 =====
+[CLS] said. [SEP] by then, turns out, it had been smith ' s final game of the night, she sent him to high school and had his notebooks for sleep. [SEP] ms lyn jones said a number of local people had attended the council ' s meeting. [SEP] however, the bbc has no more details. [SEP] if they did agree, it will probably take another three months. [SEP] the russian defense department has said it is unlikely to make a " satisfactory approach " to the oil issue. [SEP] mr ward, 53, of sudbury, suffolk, is expected to be sentenced at the city of norwich magistrates court in norwich on [SEP]
+
+===== sample 053 =====
+[CLS]. [SEP] his fault? [SEP] if we change the constitution, the situation will change, " he said. [SEP] in that way, they ' d better take responsibility for that this attack took place. [SEP] the air force national survey service said after three hours there had been no reports of uproar on land, with up to 20 trapped people still in the area. [SEP] the independent police complaints commission said the force had " received no reports of a conflict of public interest. " [SEP] the first is you can make your decision, even when you slow down. [SEP] the speed of the new system needs to be measured in order to create [SEP]
+
+===== sample 054 =====
+[CLS] the authorities in dealing with such a situation. [SEP] set in the aftermath of the cold war in 1980. [SEP] some companies do not have clear policies to set their profit targets. [SEP] the show creators wanted to write a playlist and did not want to write them in the short iterations of their original series. [SEP] the council has imposed a penalty of 30 months, a ban usually imposed, after completing its three - year extension earlier this month. [SEP] the plane was left on the fifth floor of the hotel and exited in front of the crowd. [SEP] he said he believes new information will be used for prevention. [SEP] the car, [SEP]
+
+===== sample 055 =====
+[CLS]q ). [SEP] shortly after american officials called to help, the bombing victim was not named as his killer, only to be arrested in the killings. [SEP] however, western officials said that at least four of the pakistani police had been killed, including 10 militants. [SEP] they said he claimed to have the victim shot outside the house monday night and that the rampage ended with his father ' s death. [SEP] it ' s difficult to gauge, " he says. [SEP] judge stephen j. kagan, the assistant commissioner of alaska, is the former assistant california attorney general for criminal investigation. [SEP] he also said a full - duty police officer [SEP]
+
+===== sample 056 =====
+[CLS] that, probably because, ' oh, in order to do it i need a lot of money, i ' m sorry, and i feel that there is no disingenuous to have some kind words in my voice. [SEP] august 21 - 5 p. m., w. broad street society, 1, 14th street, east n. 1615. [SEP] in the years she married timothy gordon, he became a b. h. fan. [SEP] e. r. k. malek, who is a conservative activist, also has not been promoted. [SEP] " it ' s a long, a long week, " says [SEP]
+
+===== sample 057 =====
+[CLS] workers began taking off the syringes and other sprits - - including coffee sandwiches and christmas tree meals - - to take patients. [SEP] people who were asked to do so would have to register to post questions in an hour or so before the full details, call 0177 79707 or 01706 7300000. [SEP] it ' s a very serious issue. [SEP] for the moment, he is not quite convinced but he insists we are at big risk. [SEP] last week, the house ethics committee failed to rule on the allegations of money and, apparently to avoid it, passed ethics rules that would ban spending [SEP]
+
+===== sample 058 =====
+[CLS] value of the house ' s value. [SEP] well, says mr. rauf. [SEP] british energy finished up 6. 4 percent to 6, 952. 5p, while shares of gas rose 6. 5 percent to 2. 5p. [SEP] det con chris brown also said the court would know that mr smith had waited for the morning after the robbery before he appeared in court at the time of his death. [SEP] the last election elections for european parliament was held in 1991. [SEP] " this is not a moment we believe we are heading for, " he said. [SEP] police now know who has been killed, and even [SEP]
+
+===== sample 059 =====
+[CLS] negative effects of the financial crisis leads to higher demand for available money for education, health and anti - poverty treatment programs and other measures to finance prevention programs, the report added. [SEP] it wasn ' t a bad show either way, either. [SEP] bad debt was among the worst in the financial crisis. [SEP] last year e4, the uk ' s third - largest telephone provider, negotiated a 6 % cut in its fixed - rate contract with vodaq. [SEP] the use of electricity generates around 17 % of the world ' s power available abroad. [SEP] the first bombings, in which more than 20 percent of muslims were killed in [SEP]
+
+===== sample 060 =====
+[CLS] to leave him while he would take part in the games. [SEP] the georgian commander, alexander kalirad, said the russian force had started a major offensive in the south osh region, advancing georgian anti - aircraft troops. [SEP] the means that patients may be prepared for further treatment - - - such as a longer hospital waiting period - - is not available, either 10 to 18 or 20 months after or nine months after surgery or diagnosis. [SEP] after all, he was competing at twickenham with david smith in 2002, after impressing in a dramatic final victory 27 years ago. [SEP] " a proposed human rights commission is the way [SEP]
+
+===== sample 061 =====
+[CLS] new election would be held every seven years. [SEP] this year, there were other drops in oil production prices, including in nigeria and in the us, the group said. [SEP] wednesday ' s record price was $ 2. 5 million. [SEP] a 64 - year - old welsh man has died in critical condition after being hit by a car in an accident on a bus in dorset. [SEP] the man was taken to southampton university hospital ' s emergency room four hours later, and is in hospital for further treatment. [SEP] the baltimore county police are investigating and investigating since 2003. [SEP] his focus will be on monday ' s performance and the return [SEP]
+
+===== sample 062 =====
+[CLS] the state ' s chief prosecutor has been suspended by the attorney general ' s office after holding an independent report of state sexual violations of state law enforcement law. [SEP] the chief general also named key figures, including lt. gen. mohammed zaqqani and abdul - qassim al - ahmadi, the deputy vice - chief of operations abdul - haq. [SEP] shortly after she was recorded on a radio station, the officers found documents she had cut down - - saying she had broken the stairs and was still gone. [SEP] she was the only back - sitter in the three women ' s skiing and world cup pairs events [SEP]
+
+===== sample 063 =====
+[CLS] 52. 1 percent for 2, 500 yards in the 2005 - 06 regular season. [SEP] the u. s. military closed the formal investigation into the cause of the shooting and turned it down. [SEP] the 61 - year - old was paid £21, 900 for his office expenses, rising to £91, 200, and £69, 560 for his home alone in march 2006 to £204, 997. [SEP] earlier, the company had confirmed cases of sanlulu1 : flu in asia, but it has ordered 2. 2 million pounds of high - grade bird sanlu, authorities said. [SEP] in [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/argmax_const1p45_noise_c256_scored.jsonl

@@ -0,0 +1,65 @@
+{"type": "summary", "name": "argmax_const1p45_noise_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "argmax_const1p45_noise_c256", "steps": 128, "temp_start": 1.45, "temp_end": 1.45, "temp_schedule": "const", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_cosine", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "argmax", "final_temp": 1.0, "top_k": 0, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 1.0, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 43.01780486436395, "nll_per_token": 3.761614096604754, "tokens": 9644}, "diversity": {"sample_entropy": 4.198717295568989, "unique_tokens": 1974, "token_count": 8192, "distinct_1": 0.240966796875, "distinct_2": 0.7169045275590551, "top_token_mass": 0.0582275390625}}
+{"type": "sample", "index": 0, "raw_text": "[CLS] the president will have to win in the next election. [SEP] it also announced bad results at some of the world ' s biggest credit - card companies and stripped out $ 6. 7 billion in the fourth quarter. [SEP] it can be due to the increased labour requirements and the change in demand, it says. [SEP] \" we ' re very involved in policing schools, roads and buildings and we ' re working all over london to find incidents like this, \" he said. [SEP] i had a good record and i was doing his best. [SEP] washington - - attorney general michael ki. moon ' s appointment as a former u. n. [SEP]", "detok_text": "[CLS] the president will have to win in the next election. [SEP] it also announced bad results at some of the world's biggest credit - card companies and stripped out $6. 7 billion in the fourth quarter. [SEP] it can be due to the increased labour requirements and the change in demand, it says. [SEP] \"we're very involved in policing schools, roads and buildings and we're working all over london to find incidents like this,\" he said. [SEP] i had a good record and i was doing his best. [SEP] washington - - attorney general michael ki. moon's appointment as a former u. n. [SEP]"}
+{"type": "sample", "index": 1, "raw_text": "[CLS] star, singer michael russell, has been asked to increase his licence. [SEP] the fall is a good time in school. [SEP] had he sent his dog to buy his own car, the money would have gone. [SEP] in an interview, a senior official said the senator had refused to accept donations. [SEP] tougher guy. [SEP] the defence said that the incident was a breach of procedures made by the ministry of defence ' s specialist civil investigations department in 2002. [SEP] more consumers can visit or join the website and be reached at www. medgreent. com /. [SEP] for more information on iridium, visit the data center. [SEP]", "detok_text": "[CLS] star, singer michael russell, has been asked to increase his licence. [SEP] the fall is a good time in school. [SEP] had he sent his dog to buy his own car, the money would have gone. [SEP] in an interview, a senior official said the senator had refused to accept donations. [SEP] tougher guy. [SEP] the defence said that the incident was a breach of procedures made by the ministry of defence's specialist civil investigations department in 2002. [SEP] more consumers can visit or join the website and be reached at www. medgreent. com /. [SEP] for more information on iridium, visit the data center. [SEP]"}
+{"type": "sample", "index": 2, "raw_text": "[CLS] wouldn ' t be a good idea to carry out a thorough review. [SEP] at a meeting on friday, the company ' s board voted overwhelmingly in support of president obama ' s plans in iraq for the next six months, leaving at least $ 200 billion over two months of war time. [SEP] no, he didn ' t know all the extra money. [SEP] the proposed changes would undermine the core of the state ' s constitutional law. [SEP] the spokesman said both sides would defend themselves as a matter of urgency. [SEP] during these opecunic events, many teachers, teachers, teachers and volunteers accompany men to the gym, and often [SEP]", "detok_text": "[CLS] wouldn't be a good idea to carry out a thorough review. [SEP] at a meeting on friday, the company's board voted overwhelmingly in support of president obama's plans in iraq for the next six months, leaving at least $200 billion over two months of war time. [SEP] no, he didn't know all the extra money. [SEP] the proposed changes would undermine the core of the state's constitutional law. [SEP] the spokesman said both sides would defend themselves as a matter of urgency. [SEP] during these opecunic events, many teachers, teachers, teachers and volunteers accompany men to the gym, and often [SEP]"}
+{"type": "sample", "index": 3, "raw_text": "[CLS]swoman said prosecutors pursuing the case had no knowledge of the killings, and he might initiate a criminal investigation. [SEP] for the first time in a year, analysts have also warned that xstran may be worth more than the current $ 3 billion of debt. [SEP] police officers were being pushed at the door of houses where the killing took place. [SEP] it provides travel and family services run by international travel company british travel ( 020 78777 ; www. explore. co. uk ), revenue & customs holidays ( 020 730000 ) and hotels and holidaymakers. [SEP] in the eight weeks since the crisis broke [SEP]", "detok_text": "[CLS]swoman said prosecutors pursuing the case had no knowledge of the killings, and he might initiate a criminal investigation. [SEP] for the first time in a year, analysts have also warned that xstran may be worth more than the current $3 billion of debt. [SEP] police officers were being pushed at the door of houses where the killing took place. [SEP] it provides travel and family services run by international travel company british travel (020 78777; www. explore. co. uk), revenue & customs holidays (020 730000) and hotels and holidaymakers. [SEP] in the eight weeks since the crisis broke [SEP]"}
+{"type": "sample", "index": 4, "raw_text": "[CLS], oversee the iraqi security forces, and provide security for american and iraqi forces. [SEP] these could be added when they return to the commons in the capital. [SEP] \" the situation is that it will be improved, \" he said. [SEP] \" normally, ideally, people would see it later in the next month, doing it at least once a month, \" said johnson. [SEP] in may, bill murray voluntarily received a mental health treatment, according to a report by his north carolina office. [SEP] but eight people have been killed by police in the region. [SEP] and having won the british olympic and european cup titles in 2003, and second [SEP]", "detok_text": "[CLS], oversee the iraqi security forces, and provide security for american and iraqi forces. [SEP] these could be added when they return to the commons in the capital. [SEP] \"the situation is that it will be improved,\" he said. [SEP] \"normally, ideally, people would see it later in the next month, doing it at least once a month,\" said johnson. [SEP] in may, bill murray voluntarily received a mental health treatment, according to a report by his north carolina office. [SEP] but eight people have been killed by police in the region. [SEP] and having won the british olympic and european cup titles in 2003, and second [SEP]"}
+{"type": "sample", "index": 5, "raw_text": "[CLS] civilian judges, acting as the court of appeal. [SEP] at the busy railway station, the pilot collapsed in the rain in the early hours of the morning. [SEP] i lost my job because some people just lost, \" and it was followed by the long days of three to four hours. [SEP] david dungy, a spokesman for the sheriff ' s department, has said the prison chief believes the drug enforcement campaign could reduce the number of drug - related crime in the region. [SEP] he crawled out of the car, with his head covered in a blanket, then tried to wave it back to finish in a safe position. [SEP] \" it [SEP]", "detok_text": "[CLS] civilian judges, acting as the court of appeal. [SEP] at the busy railway station, the pilot collapsed in the rain in the early hours of the morning. [SEP] i lost my job because some people just lost, \"and it was followed by the long days of three to four hours. [SEP] david dungy, a spokesman for the sheriff's department, has said the prison chief believes the drug enforcement campaign could reduce the number of drug - related crime in the region. [SEP] he crawled out of the car, with his head covered in a blanket, then tried to wave it back to finish in a safe position. [SEP]\" it [SEP]"}
+{"type": "sample", "index": 6, "raw_text": "[CLS] prosecutors in the mclelland case review the federal grand jury ' s findings and report into the death of stephen baker, whose body was discovered on march 2. [SEP] the government ' s last decision on the use of force was in 2007. [SEP] the children were taken from a school in sudbury, cambridgeshire, a week before 2200 bst that evening. [SEP] people in the midlands and surrounding areas have also taken part in extreme weather events. [SEP] it is also offering a working mortgage benefit scheme likely to cost £6 a week, starting at £345 a week. [SEP] if you can ' t imagine texting a baby, or [SEP]", "detok_text": "[CLS] prosecutors in the mclelland case review the federal grand jury's findings and report into the death of stephen baker, whose body was discovered on march 2. [SEP] the government's last decision on the use of force was in 2007. [SEP] the children were taken from a school in sudbury, cambridgeshire, a week before 2200 bst that evening. [SEP] people in the midlands and surrounding areas have also taken part in extreme weather events. [SEP] it is also offering a working mortgage benefit scheme likely to cost £6 a week, starting at £345 a week. [SEP] if you can't imagine texting a baby, or [SEP]"}
+{"type": "sample", "index": 7, "raw_text": "[CLS] receive a guaranteed bonus of $ 4, 000 - - and paid full - time each month. [SEP] many fear water supplies hold up to their power facilities as they prepare for a strong storm. [SEP] i could not believe that he would ever get a bank loan. [SEP] he was fired, spokeswoman said. [SEP] \" i ' ll tell you today, he ' s much more effective than now. [SEP] these institutions are not entirely strangers ; they can choose their own ways. [SEP] jones said he met with the defense minister, gen. jaullah mujahid, to discuss plans to push taliban militants from the eastern province of [SEP]", "detok_text": "[CLS] receive a guaranteed bonus of $4, 000 - - and paid full - time each month. [SEP] many fear water supplies hold up to their power facilities as they prepare for a strong storm. [SEP] i could not believe that he would ever get a bank loan. [SEP] he was fired, spokeswoman said. [SEP] \" i'll tell you today, he's much more effective than now. [SEP] these institutions are not entirely strangers; they can choose their own ways. [SEP] jones said he met with the defense minister, gen. jaullah mujahid, to discuss plans to push taliban militants from the eastern province of [SEP]"}
+{"type": "sample", "index": 8, "raw_text": "[CLS] - of - one match to finish in the overall standings for the opening round. [SEP] leeds does not play its final home game after a 4 - 3 defeat to bohemians three days ago. [SEP] he refused to leave the post office until after april 2010 and will be able to announce details of his plans until the next year. [SEP] a 30 - year - old man has been bailed after a 22 - year - old man was found stabbed on london ' s regent street. [SEP] it is building a team of senior management and top financial advisors to take on the job. [SEP] but it is a turning point in the history of the [SEP]", "detok_text": "[CLS] - of - one match to finish in the overall standings for the opening round. [SEP] leeds does not play its final home game after a 4 - 3 defeat to bohemians three days ago. [SEP] he refused to leave the post office until after april 2010 and will be able to announce details of his plans until the next year. [SEP] a 30 - year - old man has been bailed after a 22 - year - old man was found stabbed on london's regent street. [SEP] it is building a team of senior management and top financial advisors to take on the job. [SEP] but it is a turning point in the history of the [SEP]"}
+{"type": "sample", "index": 9, "raw_text": "[CLS] county ' s emergency management office. [SEP] he told e - mails that the officers told him they had fired him, and after the officer got out of hand moved out and arrested the men. [SEP] it was not clear whether the case was being investigated before or whether prosecutors were due to court. [SEP] this is not the time for this fight. [SEP] that night, they had been locked up inside the club. [SEP] however, the report says that any changes should not stand in the way of the public inquiry and accountability for those claims. [SEP] and yet there is no point to think it irrationally. [SEP] installation is $ 29, [SEP]", "detok_text": "[CLS] county's emergency management office. [SEP] he told e - mails that the officers told him they had fired him, and after the officer got out of hand moved out and arrested the men. [SEP] it was not clear whether the case was being investigated before or whether prosecutors were due to court. [SEP] this is not the time for this fight. [SEP] that night, they had been locked up inside the club. [SEP] however, the report says that any changes should not stand in the way of the public inquiry and accountability for those claims. [SEP] and yet there is no point to think it irrationally. [SEP] installation is $29, [SEP]"}
+{"type": "sample", "index": 10, "raw_text": "[CLS] scientists at the national park are waiting to see if the virus replicates itself in the public. [SEP] james is hoping to force england into seventh place in his squad when he faces the world championships in rome later. [SEP] if you ' re young, light and clever, you ' ll just feel you ' re getting too tired of it. [SEP] the 12 - month growth rate slipped 0. 5 point to 7. 0 percent, which was down the 7. 5 percent expected in april. [SEP] bae could secure a £430m deal for the aegis helicopter system, which the u. s. air force is seeking to build [SEP]", "detok_text": "[CLS] scientists at the national park are waiting to see if the virus replicates itself in the public. [SEP] james is hoping to force england into seventh place in his squad when he faces the world championships in rome later. [SEP] if you're young, light and clever, you'll just feel you're getting too tired of it. [SEP] the 12 - month growth rate slipped 0. 5 point to 7. 0 percent, which was down the 7. 5 percent expected in april. [SEP] bae could secure a £430m deal for the aegis helicopter system, which the u. s. air force is seeking to build [SEP]"}
+{"type": "sample", "index": 11, "raw_text": "[CLS]. [SEP] georgian officials also alleged that russian troops had carried out operations to disarm in south ossetia, which was the headquarters for u. s. and u. n. peacekeeping forces in afghanistan. [SEP] more recently, there was no immediate evidence to support the theory that the dead woman had been shot to flee the scene of the crime. [SEP] donaldsfeld, the vice president ' s science adviser and the chief executive of the joint national security council, is leading a research program at the national institute of economic studies. [SEP] the governor confirmed at a press news conference that the legislature approved the bill scheduled for march 1, [SEP]", "detok_text": "[CLS]. [SEP] georgian officials also alleged that russian troops had carried out operations to disarm in south ossetia, which was the headquarters for u. s. and u. n. peacekeeping forces in afghanistan. [SEP] more recently, there was no immediate evidence to support the theory that the dead woman had been shot to flee the scene of the crime. [SEP] donaldsfeld, the vice president's science adviser and the chief executive of the joint national security council, is leading a research program at the national institute of economic studies. [SEP] the governor confirmed at a press news conference that the legislature approved the bill scheduled for march 1, [SEP]"}
+{"type": "sample", "index": 12, "raw_text": "[CLS] will never be stopped. [SEP] it ' s a place where people can spend time with a family, to keep the quiet. [SEP] the result is the level of support for the auto industry. [SEP] chrysler will have to make another reorganisation in its business units before the end of the year. [SEP] \" i think a lot more needs to be done for our national security, \" said alan ashburn, head of the congressional budget office. [SEP] it was the second of october - - almost six years ago when the iraqi police chief made the nomination for his job, announced at a meeting of the provincial council in the central square. [SEP] the [SEP]", "detok_text": "[CLS] will never be stopped. [SEP] it's a place where people can spend time with a family, to keep the quiet. [SEP] the result is the level of support for the auto industry. [SEP] chrysler will have to make another reorganisation in its business units before the end of the year. [SEP] \"i think a lot more needs to be done for our national security,\" said alan ashburn, head of the congressional budget office. [SEP] it was the second of october - - almost six years ago when the iraqi police chief made the nomination for his job, announced at a meeting of the provincial council in the central square. [SEP] the [SEP]"}
+{"type": "sample", "index": 13, "raw_text": "[CLS], including people in his family. [SEP] he moved out of san diego for his fourth - straight preseason game, going 3 - 1, to make the postseason the regular season. [SEP] mr power was the subject of a scandal in office last year but has said that he is helping with legal proceedings, despite facing impeachment proceedings and corruption charges. [SEP] if i hadn ' t held my son alive, the officers would probably very easily have done no harm, \" he added. [SEP] the hurricanes ' league most famous victory was a 5 - 4 thrasher on thursday night against nashville. [SEP] under new guidelines, health experts have failed to [SEP]", "detok_text": "[CLS], including people in his family. [SEP] he moved out of san diego for his fourth - straight preseason game, going 3 - 1, to make the postseason the regular season. [SEP] mr power was the subject of a scandal in office last year but has said that he is helping with legal proceedings, despite facing impeachment proceedings and corruption charges. [SEP] if i hadn't held my son alive, the officers would probably very easily have done no harm, \" he added. [SEP] the hurricanes' league most famous victory was a 5 - 4 thrasher on thursday night against nashville. [SEP] under new guidelines, health experts have failed to [SEP]"}
+{"type": "sample", "index": 14, "raw_text": "[CLS] for the first new session on the iranian crisis in four years, and threatened to hold talks in three days ' time without reaching a deal. [SEP] nobody wants a doctor to find the full x monitor to stay in the operating room. [SEP] brown, born in 1965 and once served at the u. s. army headquarters, initially received a brief b. d. in 1963 from the virginian university medical school, near the university of illinois law. [SEP] bank of america corp was selling a stake in a bank with net worth of $ 1. 8 billion to the u. s. u. s. federal reserve, the head of [SEP]", "detok_text": "[CLS] for the first new session on the iranian crisis in four years, and threatened to hold talks in three days' time without reaching a deal. [SEP] nobody wants a doctor to find the full x monitor to stay in the operating room. [SEP] brown, born in 1965 and once served at the u. s. army headquarters, initially received a brief b. d. in 1963 from the virginian university medical school, near the university of illinois law. [SEP] bank of america corp was selling a stake in a bank with net worth of $1. 8 billion to the u. s. u. s. federal reserve, the head of [SEP]"}
+{"type": "sample", "index": 15, "raw_text": "[CLS] [SEP] he ' s free, but it won ' t work in his health either. [SEP] however, the imf ' s position has been to make it easier for banks to raise capital. [SEP] a government study found men working in apprenticeships were more likely to succeed those who left work just weeks after leaving for a formal appointment at the school year. [SEP] she said she thought she had to save her son, mr obama. [SEP] land securities said it would update its financial ratios during the third quarter of trading. [SEP] the boy did have two children but the parents said he did not want to attend a school which had children outside their [SEP]", "detok_text": "[CLS] [SEP] he's free, but it won't work in his health either. [SEP] however, the imf's position has been to make it easier for banks to raise capital. [SEP] a government study found men working in apprenticeships were more likely to succeed those who left work just weeks after leaving for a formal appointment at the school year. [SEP] she said she thought she had to save her son, mr obama. [SEP] land securities said it would update its financial ratios during the third quarter of trading. [SEP] the boy did have two children but the parents said he did not want to attend a school which had children outside their [SEP]"}
+{"type": "sample", "index": 16, "raw_text": "[CLS]. bailoutreagh. com. [SEP] the average interest rate on the loan would be about $ 2. 60 to $ 3. 70 for the loan. [SEP] they go home and regularly sleep in a wheelchair, while 8 - year - old aaron and his mother take their son into the hospital, family and friends reported. [SEP] in a partly autobiographical account of david morrison ' s complicated life, he is best known to look at the best of his novels, including his novels as the boy ' s child, as well as as the original author of the children ' s story and \" dirty dancing \" writer david wells. [SEP] we [SEP]", "detok_text": "[CLS]. bailoutreagh. com. [SEP] the average interest rate on the loan would be about $2. 60 to $3. 70 for the loan. [SEP] they go home and regularly sleep in a wheelchair, while 8 - year - old aaron and his mother take their son into the hospital, family and friends reported. [SEP] in a partly autobiographical account of david morrison's complicated life, he is best known to look at the best of his novels, including his novels as the boy's child, as well as as the original author of the children's story and \"dirty dancing\" writer david wells. [SEP] we [SEP]"}
+{"type": "sample", "index": 17, "raw_text": "[CLS] open to the public in september. [SEP] the while the trade took place in the us, the fish were active in the 1980s and 1990s. [SEP] \" you can ' t have a budget because you know what you ' re going through - - you have a lot of money, and that ' s a lot of faith in the money, \" he said. [SEP] the first was the name of a former cargill employee. [SEP] but at some point he ' s got someone that has the same quality as everyone, and he has played well enough. [SEP] we could go to a very good hospital, \" he said. [SEP] \" we [SEP]", "detok_text": "[CLS] open to the public in september. [SEP] the while the trade took place in the us, the fish were active in the 1980s and 1990s. [SEP] \"you can't have a budget because you know what you're going through - - you have a lot of money, and that's a lot of faith in the money,\" he said. [SEP] the first was the name of a former cargill employee. [SEP] but at some point he's got someone that has the same quality as everyone, and he has played well enough. [SEP] we could go to a very good hospital, \"he said. [SEP]\" we [SEP]"}
+{"type": "sample", "index": 18, "raw_text": "[CLS] [SEP] a zimbabwean military plane landed saturday just minutes after flying to the island 90 miles south of the capital on the coast of south africa. [SEP] in addition to being a senior striker, supported by harry redknapp, the spurs manager, who dismissed the idea that rooney alone, if he completed his first goal, he could be considered part of chelsea ' s top squads. [SEP] the fbi, the investigation unit, the office of the federal bureau of investigation and the fbi coordinate efforts in the investigation of the workplace violence. [SEP] bhp billiton has accepted the outcome in its own offer ahead of target of 3p for the [SEP]", "detok_text": "[CLS] [SEP] a zimbabwean military plane landed saturday just minutes after flying to the island 90 miles south of the capital on the coast of south africa. [SEP] in addition to being a senior striker, supported by harry redknapp, the spurs manager, who dismissed the idea that rooney alone, if he completed his first goal, he could be considered part of chelsea's top squads. [SEP] the fbi, the investigation unit, the office of the federal bureau of investigation and the fbi coordinate efforts in the investigation of the workplace violence. [SEP] bhp billiton has accepted the outcome in its own offer ahead of target of 3p for the [SEP]"}
+{"type": "sample", "index": 19, "raw_text": "[CLS] [SEP] palin said state law enforcement officers have complained about police complaints and the use of 24 - hour days of alerts that many have cancelled because of potential violations. [SEP] it was david smith in the first scottish national orchestra, north west scotland, who recorded the final part and composed franz zamlik ' s \" strange goodfellas. \" [SEP] appointments.. a good opportunity is available for real estate.... £262 - £24999 per annum + bonus.. british olympic association. leeds. £299 - - £26, 000 + bonus.. c £30000 per annum + bonus [SEP]", "detok_text": "[CLS] [SEP] palin said state law enforcement officers have complained about police complaints and the use of 24 - hour days of alerts that many have cancelled because of potential violations. [SEP] it was david smith in the first scottish national orchestra, north west scotland, who recorded the final part and composed franz zamlik's \"strange goodfellas.\" [SEP] appointments.. a good opportunity is available for real estate.... £262 - £24999 per annum + bonus.. british olympic association. leeds. £299 - - £26, 000 + bonus.. c £30000 per annum + bonus [SEP]"}
+{"type": "sample", "index": 20, "raw_text": "[CLS] over five years ago. [SEP] \" when i think that people would think about him is i ' ll ask for a pardon, you want to get your child out of a prison, you must be released, \" she said. [SEP] the national price rate is still at its highest level of inflation since 2001, but the government could afford to follow the record. [SEP] maj robert h. reid, head of britain ' s chief of naval staff, made an unprecedented appeal after five officers from the joint chiefs of staff were charged with an incident of suspected car theft. [SEP] the search is now way to determine the circumstances leading up to her death [SEP]", "detok_text": "[CLS] over five years ago. [SEP] \"when i think that people would think about him is i'll ask for a pardon, you want to get your child out of a prison, you must be released,\" she said. [SEP] the national price rate is still at its highest level of inflation since 2001, but the government could afford to follow the record. [SEP] maj robert h. reid, head of britain's chief of naval staff, made an unprecedented appeal after five officers from the joint chiefs of staff were charged with an incident of suspected car theft. [SEP] the search is now way to determine the circumstances leading up to her death [SEP]"}
+{"type": "sample", "index": 21, "raw_text": "[CLS] down in 2005, most local officials would not seem to wind up doing this job. [SEP] you ' ll do something you didn ' t do years ago. [SEP] a 4 - 0 champions league win, when they had only 15 players, ended their season in october 2009, and it took them to beat manchester united to get into the championship game. [SEP] china is the world ' s most important economy and it is expected to create hundreds of thousands of jobs around the world. [SEP] the man has been granted a bail order, but was later released on bail. [SEP] in fact, its geoclinist has become a popular instrument - [SEP]", "detok_text": "[CLS] down in 2005, most local officials would not seem to wind up doing this job. [SEP] you'll do something you didn't do years ago. [SEP] a 4 - 0 champions league win, when they had only 15 players, ended their season in october 2009, and it took them to beat manchester united to get into the championship game. [SEP] china is the world's most important economy and it is expected to create hundreds of thousands of jobs around the world. [SEP] the man has been granted a bail order, but was later released on bail. [SEP] in fact, its geoclinist has become a popular instrument - [SEP]"}
+{"type": "sample", "index": 22, "raw_text": "[CLS] change in performance or factors that could affect the company ' s current performance or we have to act on other statements of management to reflect future developments, the impact of pre - historical performance and performance, unexpected financial risks or events that could affect the accuracy or accuracy of the new information, potential criminal charges, regulations, or the interpretation of the information, or the public. [SEP] yahoo inc. amended its plan to combine yahoo with search ads in january, in a bid to modernize yahoo. [SEP] \" if patients are referred to an emergency, which is in a few hours, at the hospital after the onset of a flu outbreak, \" [SEP]", "detok_text": "[CLS] change in performance or factors that could affect the company's current performance or we have to act on other statements of management to reflect future developments, the impact of pre - historical performance and performance, unexpected financial risks or events that could affect the accuracy or accuracy of the new information, potential criminal charges, regulations, or the interpretation of the information, or the public. [SEP] yahoo inc. amended its plan to combine yahoo with search ads in january, in a bid to modernize yahoo. [SEP] \"if patients are referred to an emergency, which is in a few hours, at the hospital after the onset of a flu outbreak,\" [SEP]"}
+{"type": "sample", "index": 23, "raw_text": "[CLS] said it was satisfied there is a \" serious flaw \" in the judges ' decisions. [SEP] in many cases, staff are usually forced to call in a telephone, but people complain and the numbers are always based on the call call. [SEP] in the past three years, the government, the federal police state council and the army were on track to launch new enforcement activities, according to the statement. [SEP] the court had permission for mr brown to turn the second session into a session but the end - of - session session was interrupted by his outburst. [SEP] she also has a large tricer in her headgegus. [SEP] following his long [SEP]", "detok_text": "[CLS] said it was satisfied there is a \"serious flaw\" in the judges' decisions. [SEP] in many cases, staff are usually forced to call in a telephone, but people complain and the numbers are always based on the call call. [SEP] in the past three years, the government, the federal police state council and the army were on track to launch new enforcement activities, according to the statement. [SEP] the court had permission for mr brown to turn the second session into a session but the end - of - session session was interrupted by his outburst. [SEP] she also has a large tricer in her headgegus. [SEP] following his long [SEP]"}
+{"type": "sample", "index": 24, "raw_text": "[CLS] prices. [SEP] one issue currently under discussion is allowing the house to pass legislation. [SEP] bernanke said the fed would cut rates and keep rates low through next sept. [SEP] the country is the no. 1 in india ' s developing economy, with exports falling under 21 percent of gdp in december of last year. [SEP] banksy, one of the leading british architects of the generation, worked for thirty years as a research assistant to the royal academy of music and to become a b lecturer and then associate professor of mathematics of the royal college society. [SEP] the children are usually too small or large for their jobs. [SEP] no action could [SEP]", "detok_text": "[CLS] prices. [SEP] one issue currently under discussion is allowing the house to pass legislation. [SEP] bernanke said the fed would cut rates and keep rates low through next sept. [SEP] the country is the no. 1 in india's developing economy, with exports falling under 21 percent of gdp in december of last year. [SEP] banksy, one of the leading british architects of the generation, worked for thirty years as a research assistant to the royal academy of music and to become a b lecturer and then associate professor of mathematics of the royal college society. [SEP] the children are usually too small or large for their jobs. [SEP] no action could [SEP]"}
+{"type": "sample", "index": 25, "raw_text": "[CLS] the un security council approved the bill to question the legality of the constitution. [SEP] he said the metropolitan police police has launched an internal investigation into several county - level employees, including 10 officers who are disciplined and disciplined after complaints about officers while they carry out their duties. [SEP] it was in the five months before he went to college and arranged for her to enroll in college. [SEP] a resident dropped five to seven vases off the floor in the centre of the building. [SEP] the rate of weight loss increased from high levels - - 14 percent to 18 percent in 2001 and 2 percent in 2007, according to the research center. [SEP] [SEP]", "detok_text": "[CLS] the un security council approved the bill to question the legality of the constitution. [SEP] he said the metropolitan police police has launched an internal investigation into several county - level employees, including 10 officers who are disciplined and disciplined after complaints about officers while they carry out their duties. [SEP] it was in the five months before he went to college and arranged for her to enroll in college. [SEP] a resident dropped five to seven vases off the floor in the centre of the building. [SEP] the rate of weight loss increased from high levels - - 14 percent to 18 percent in 2001 and 2 percent in 2007, according to the research center. [SEP] [SEP]"}
+{"type": "sample", "index": 26, "raw_text": "[CLS]. 500 in game three last sunday. [SEP] all three of those attacks have been linked to a terrorist network run by the american military, including the leader of al qaeda. [SEP] aerospace group boeing co. is expected to report disappointing full - year results and the outlook for its debt has sparked a steady stream of sales. [SEP] but the euro rose to 1. 6295 dollars from 1. 663. [SEP] this week ' s list included four schools, which received $ 1 million, six awards in 2006 and $ 3. 5 million in grants this year. [SEP] mr eide is iran ' s closest diplomat. [SEP] i still [SEP]", "detok_text": "[CLS]. 500 in game three last sunday. [SEP] all three of those attacks have been linked to a terrorist network run by the american military, including the leader of al qaeda. [SEP] aerospace group boeing co. is expected to report disappointing full - year results and the outlook for its debt has sparked a steady stream of sales. [SEP] but the euro rose to 1. 6295 dollars from 1. 663. [SEP] this week's list included four schools, which received $1 million, six awards in 2006 and $3. 5 million in grants this year. [SEP] mr eide is iran's closest diplomat. [SEP] i still [SEP]"}
+{"type": "sample", "index": 27, "raw_text": "[CLS] critically injured in a series of attacks at a nightclub. [SEP] new home home secretary alan johnson has warned the government of the need for further legislation. [SEP] the state health department on thursday announced that legislation to change the amount of smoking is also pending. [SEP] a few of her students, aged in nursery class, did not have enough space to breathe. [SEP] the attack came after a security council report that the children were expelled from the foreign office in a government building. [SEP] wali ali, a former commander in the north, declined to be named, and said he was killed in the southern city. [SEP] he was only 20 years of [SEP]", "detok_text": "[CLS] critically injured in a series of attacks at a nightclub. [SEP] new home home secretary alan johnson has warned the government of the need for further legislation. [SEP] the state health department on thursday announced that legislation to change the amount of smoking is also pending. [SEP] a few of her students, aged in nursery class, did not have enough space to breathe. [SEP] the attack came after a security council report that the children were expelled from the foreign office in a government building. [SEP] wali ali, a former commander in the north, declined to be named, and said he was killed in the southern city. [SEP] he was only 20 years of [SEP]"}
+{"type": "sample", "index": 28, "raw_text": "[CLS] - section of congress. [SEP] mr clark has issued a statement for an public inquiry which is expected later. [SEP] miami, florida ( cnn ) - - the country ' s election commission rejected the military officers who had ousted the controversial \" military coup \" of president general pervez musharraf, the interim president said saturday. [SEP] however, while the us bank of bank of japan could cut rates today, a vice - chairman of the fed ' s policy committee said there had been no real sign of the recession. [SEP] richard davies, a fire service spokesman at south general nhs trust, said the service had been restored after the alarm [SEP]", "detok_text": "[CLS] - section of congress. [SEP] mr clark has issued a statement for an public inquiry which is expected later. [SEP] miami, florida (cnn) - - the country's election commission rejected the military officers who had ousted the controversial \"military coup\" of president general pervez musharraf, the interim president said saturday. [SEP] however, while the us bank of bank of japan could cut rates today, a vice - chairman of the fed's policy committee said there had been no real sign of the recession. [SEP] richard davies, a fire service spokesman at south general nhs trust, said the service had been restored after the alarm [SEP]"}
+{"type": "sample", "index": 29, "raw_text": "[CLS] ruled in his favor. [SEP] now we ' re facing the threat of a recession. [SEP] copper fell nearly 1. 8 per cent to $ 647, or 6. 9 per cent to $ 1, 007. 70. [SEP] the judge said the prosecution ' s case was adjourned until nov. [SEP] it says people should have the self - control experience to think and behave with a sense of normalness. [SEP] last night, the lakers had their best team to make it to the final four. [SEP] the details of the latest fight weren ' t immediately clear. [SEP] about 90 percent of the changes to the state ' [SEP]", "detok_text": "[CLS] ruled in his favor. [SEP] now we're facing the threat of a recession. [SEP] copper fell nearly 1. 8 per cent to $647, or 6. 9 per cent to $1, 007. 70. [SEP] the judge said the prosecution's case was adjourned until nov. [SEP] it says people should have the self - control experience to think and behave with a sense of normalness. [SEP] last night, the lakers had their best team to make it to the final four. [SEP] the details of the latest fight weren't immediately clear. [SEP] about 90 percent of the changes to the state ' [SEP]"}
+{"type": "sample", "index": 30, "raw_text": "[CLS]25 or ( 888 ) 92720, u. s. dollars, or calling ( 0 ) 426 8106 or ( international ( 1 ) pass code 889981000 or pass code 20008. [SEP] the mod dismissed the increased claims of air strike orders, and added that it was reviewing procurement options on its current joint strike aircraft. [SEP] the federal trade commission has been set for an inquiry on whether to press charges. [SEP] and i was also holidaying in the family ' s holiday holiday home, which has vaulted ceilings, the hot weather, terraces and a roof. [SEP] john brown, the chairman [SEP]", "detok_text": "[CLS]25 or (888) 92720, u. s. dollars, or calling (0) 426 8106 or ( international (1) pass code 889981000 or pass code 20008. [SEP] the mod dismissed the increased claims of air strike orders, and added that it was reviewing procurement options on its current joint strike aircraft. [SEP] the federal trade commission has been set for an inquiry on whether to press charges. [SEP] and i was also holidaying in the family's holiday holiday home, which has vaulted ceilings, the hot weather, terraces and a roof. [SEP] john brown, the chairman [SEP]"}
+{"type": "sample", "index": 31, "raw_text": "[CLS] regiment took part in the military action of southern afghanistan. [SEP] former army commander lt. gen. keith pasquio, commander of the army ' s staff, said the war may be in need of an open debate between their commanders, including stanley mcchrystal and genel schwartz, the commander appointed by gen. george w. mcgeo, who was fired aug, to serve until his troops leave in august. [SEP] \" there ' s been some criticism over the last couple of months, and the state is not acting too much for me, \" he said. [SEP] the former president was nominated for the presidency in 1975 [SEP]", "detok_text": "[CLS] regiment took part in the military action of southern afghanistan. [SEP] former army commander lt. gen. keith pasquio, commander of the army's staff, said the war may be in need of an open debate between their commanders, including stanley mcchrystal and genel schwartz, the commander appointed by gen. george w. mcgeo, who was fired aug, to serve until his troops leave in august. [SEP] \"there's been some criticism over the last couple of months, and the state is not acting too much for me,\" he said. [SEP] the former president was nominated for the presidency in 1975 [SEP]"}
+{"type": "sample", "index": 32, "raw_text": "[CLS] series of flats on the fifth floor. [SEP] mr. jackson declined to acknowledge that jackson ' s death was delayed or his death would not be reported. [SEP] he said the unemployment rate dropped 4 percent on the year - - its highest - - since hitting 12. 2 percent in september 2006, about 7 : 30 p. m.. [SEP] to economists, the fedc was very much paying attention to the fact that the current financial market crisis was among the most serious and unprecedented in modern history. [SEP] the crowd was stunned by the size of the wall of the white house, but they didn ' t see the president, any more [SEP]", "detok_text": "[CLS] series of flats on the fifth floor. [SEP] mr. jackson declined to acknowledge that jackson's death was delayed or his death would not be reported. [SEP] he said the unemployment rate dropped 4 percent on the year - - its highest - - since hitting 12. 2 percent in september 2006, about 7: 30 p. m.. [SEP] to economists, the fedc was very much paying attention to the fact that the current financial market crisis was among the most serious and unprecedented in modern history. [SEP] the crowd was stunned by the size of the wall of the white house, but they didn't see the president, any more [SEP]"}
+{"type": "sample", "index": 33, "raw_text": "[CLS] third quarter. [SEP] \" it is the duty to make the decisions of the game solely in the context of the legal and legal authorities and any information, or advice to any financial professional or authority, which may be appropriate to appeal. [SEP] last year nearly all of the country ' s 65 million people enrolled in their high education and many enrolled in the united states. [SEP] he was also jailed as a juvenile and given a discharge for his behaviour. [SEP] while sen clinton won nevada, he praised the party ' s decision to build a \" preliged voting base \" in the state primary for obama. [SEP] in the terms of the report [SEP]", "detok_text": "[CLS] third quarter. [SEP] \"it is the duty to make the decisions of the game solely in the context of the legal and legal authorities and any information, or advice to any financial professional or authority, which may be appropriate to appeal. [SEP] last year nearly all of the country's 65 million people enrolled in their high education and many enrolled in the united states. [SEP] he was also jailed as a juvenile and given a discharge for his behaviour. [SEP] while sen clinton won nevada, he praised the party's decision to build a\" preliged voting base \" in the state primary for obama. [SEP] in the terms of the report [SEP]"}
+{"type": "sample", "index": 34, "raw_text": "[CLS] language because it could not affect the tone of his speech. [SEP] the report came as the white house released a report that president obama will divert $ 35 billion a year from the stimulus program. [SEP] the company ' s third quarter net profit was $. 9 billion, on weakness in the u. s. and european markets. [SEP] many of the new visitors are in the united states. [SEP] texas tech has won three of its last four games in texas. [SEP] the majority dismissed the allegations against paterson, however, calling it a written question regarding the firing of a state ' s attorney. [SEP] they ' re looking for someone else, [SEP]", "detok_text": "[CLS] language because it could not affect the tone of his speech. [SEP] the report came as the white house released a report that president obama will divert $35 billion a year from the stimulus program. [SEP] the company's third quarter net profit was $. 9 billion, on weakness in the u. s. and european markets. [SEP] many of the new visitors are in the united states. [SEP] texas tech has won three of its last four games in texas. [SEP] the majority dismissed the allegations against paterson, however, calling it a written question regarding the firing of a state's attorney. [SEP] they're looking for someone else, [SEP]"}
+{"type": "sample", "index": 35, "raw_text": "[CLS] of former chief executive peter moore, pending the results of an internal review, the irb said in a statement on sunday. [SEP] but mr mukasey says that there are legal challenges to the idea that judges should be put in jeopardy. [SEP] the man could also have been jailed for 15 years. [SEP] in 1980 president george bush used the torch for a visit to the state ' s infantrymen ' s hospital, as well as the queen, to present his tribute to the service of victims during the vietnam war. [SEP] china ' s sovereign wealth market made an annual but record annual profit of rmb43bn in 2008 because of [SEP]", "detok_text": "[CLS] of former chief executive peter moore, pending the results of an internal review, the irb said in a statement on sunday. [SEP] but mr mukasey says that there are legal challenges to the idea that judges should be put in jeopardy. [SEP] the man could also have been jailed for 15 years. [SEP] in 1980 president george bush used the torch for a visit to the state's infantrymen's hospital, as well as the queen, to present his tribute to the service of victims during the vietnam war. [SEP] china's sovereign wealth market made an annual but record annual profit of rmb43bn in 2008 because of [SEP]"}
+{"type": "sample", "index": 36, "raw_text": "[CLS] an average of 8. 4 per cent over the next six months, with the biggest double - annual increase of 7 per since september 2006. [SEP] david marty served as deputy secretary of state for african affairs. [SEP] ryan taylor, 19, a doctor at the university hospital, died saturday, a day after he wrote out his crime. [SEP] it also makes illumine inc, the maker of alcoa inc., which also makes fermo ' s namesake coffees, and j. c. penn, the world ' s biggest - selling maker of consumer products used in its cars. [SEP] it was a decision i made [SEP]", "detok_text": "[CLS] an average of 8. 4 per cent over the next six months, with the biggest double - annual increase of 7 per since september 2006. [SEP] david marty served as deputy secretary of state for african affairs. [SEP] ryan taylor, 19, a doctor at the university hospital, died saturday, a day after he wrote out his crime. [SEP] it also makes illumine inc, the maker of alcoa inc., which also makes fermo's namesake coffees, and j. c. penn, the world's biggest - selling maker of consumer products used in its cars. [SEP] it was a decision i made [SEP]"}
+{"type": "sample", "index": 37, "raw_text": "[CLS] officer councillor jim porter said : \" i thought i made it the most obvious aspect of this situation after i was told it was a serious problem. [SEP] the lodge is currently open to all guests, and a hotel and other facilities have been available for the event, opening in november. [SEP] later wednesday, u. s. and coalition forces took control in western kunar province, which is near an important area where government troops operate. [SEP] president nawaz sharif ' s former deputy, muqtadah al - islami, and later the chief minister, gen. naqrq kayani will be vice president. [SEP] [SEP]", "detok_text": "[CLS] officer councillor jim porter said: \" i thought i made it the most obvious aspect of this situation after i was told it was a serious problem. [SEP] the lodge is currently open to all guests, and a hotel and other facilities have been available for the event, opening in november. [SEP] later wednesday, u. s. and coalition forces took control in western kunar province, which is near an important area where government troops operate. [SEP] president nawaz sharif's former deputy, muqtadah al - islami, and later the chief minister, gen. naqrq kayani will be vice president. [SEP] [SEP]"}
+{"type": "sample", "index": 38, "raw_text": "[CLS] have a lot of student children at college and my daughter at school, but probably because i will almost always get reminders of the alphabet at school rather than at school. [SEP] following a recent appearance by mrs. clinton, a former mr. obama and one colleague now appearing on state television, which calls mr. obama to be the vice president, said the 42 - year - old obama appeared safe. [SEP] she argued that she should be suspended by the national investigation and complaints commission, where she had been kept confidential and was not only allowed to under the rules of conduct, she did not need a formal investigation. [SEP] child and father [SEP]", "detok_text": "[CLS] have a lot of student children at college and my daughter at school, but probably because i will almost always get reminders of the alphabet at school rather than at school. [SEP] following a recent appearance by mrs. clinton, a former mr. obama and one colleague now appearing on state television, which calls mr. obama to be the vice president, said the 42 - year - old obama appeared safe. [SEP] she argued that she should be suspended by the national investigation and complaints commission, where she had been kept confidential and was not only allowed to under the rules of conduct, she did not need a formal investigation. [SEP] child and father [SEP]"}
+{"type": "sample", "index": 39, "raw_text": "[CLS] of the modern era. [SEP] police said the fifth child, briane mason, in the kitchen in clapham road, herts, suffered from a gastrointestinal complaint. [SEP] he said that it was good that some of the money would not be left in reserve. [SEP] \" it ' s a little hard for us to pay prices, \" she says. [SEP] most of all, i didn ' t drive three miles long before i could call a colleague to look up the phone. [SEP] take the \" top chef \" star tom watson, the show co - based based on the bbc ' s fourth book, the rules [SEP]", "detok_text": "[CLS] of the modern era. [SEP] police said the fifth child, briane mason, in the kitchen in clapham road, herts, suffered from a gastrointestinal complaint. [SEP] he said that it was good that some of the money would not be left in reserve. [SEP] \"it's a little hard for us to pay prices,\" she says. [SEP] most of all, i didn't drive three miles long before i could call a colleague to look up the phone. [SEP] take the \"top chef\" star tom watson, the show co - based based on the bbc's fourth book, the rules [SEP]"}
+{"type": "sample", "index": 40, "raw_text": "[CLS] town of perth and went missing on a sunday after a long holiday, the court heard. [SEP] the pentagon says at least 20, 000 people in excess of nearly 7 million people were killed in the war - - the largest toll of iraq ' s so long occupation and occupation of southern iraq. [SEP] in 2003, the city ' s financial planning board took up the application. [SEP] the former footballer david mercer has pleaded guilty to false suicide charges after being arrested and questioned on suspicion that she had been poisoned. [SEP] bolt would also secure a gold medal for 100m for american shawn johnson, who is third of the 100, 000m world [SEP]", "detok_text": "[CLS] town of perth and went missing on a sunday after a long holiday, the court heard. [SEP] the pentagon says at least 20, 000 people in excess of nearly 7 million people were killed in the war - - the largest toll of iraq's so long occupation and occupation of southern iraq. [SEP] in 2003, the city's financial planning board took up the application. [SEP] the former footballer david mercer has pleaded guilty to false suicide charges after being arrested and questioned on suspicion that she had been poisoned. [SEP] bolt would also secure a gold medal for 100m for american shawn johnson, who is third of the 100, 000m world [SEP]"}
+{"type": "sample", "index": 41, "raw_text": "[CLS] gas stations. [SEP] the u. s. department of energy had increased the total oil supply supply for processing by 1, 000 and 1, 000 bps. [SEP] that morning, officers said, officers arrived outside a nearby apartment building, which he thought closed because he was running a night ' s work. [SEP] \" it ' s changing. \" [SEP] john hogger was a member of labour ' s internal law inquiry committee and the former no. 2, john mcgrady, chair the public inquiry. [SEP] to give this, i sent notes to a visiting fellow teacher and asked for an interview. [SEP] ( ap ) - a [SEP]", "detok_text": "[CLS] gas stations. [SEP] the u. s. department of energy had increased the total oil supply supply for processing by 1, 000 and 1, 000 bps. [SEP] that morning, officers said, officers arrived outside a nearby apartment building, which he thought closed because he was running a night's work. [SEP] \"it's changing.\" [SEP] john hogger was a member of labour's internal law inquiry committee and the former no. 2, john mcgrady, chair the public inquiry. [SEP] to give this, i sent notes to a visiting fellow teacher and asked for an interview. [SEP] (ap) - a [SEP]"}
+{"type": "sample", "index": 42, "raw_text": "[CLS] mike adams, deputy superintendent mike o ' brien and barbara morgan, a fourth - grader. [SEP] all six men are out for about four weeks before a tour of australia, which he is scheduled to begin next year. [SEP] he can only drive in half - way, thinking of his mates and soon picks up a laptop and sits his sleep on the front floor of his bed. [SEP] £1. 99 - $ 0. 99 £199 ; www. £69. 99. [SEP] arsenal lost their fa cup final meeting at crystal palace on the night just 12 hours after liverpool made a play - off trip to tottenham hotspur. [SEP]", "detok_text": "[CLS] mike adams, deputy superintendent mike o' brien and barbara morgan, a fourth - grader. [SEP] all six men are out for about four weeks before a tour of australia, which he is scheduled to begin next year. [SEP] he can only drive in half - way, thinking of his mates and soon picks up a laptop and sits his sleep on the front floor of his bed. [SEP] £1. 99 - $0. 99 £199; www. £69. 99. [SEP] arsenal lost their fa cup final meeting at crystal palace on the night just 12 hours after liverpool made a play - off trip to tottenham hotspur. [SEP]"}
+{"type": "sample", "index": 43, "raw_text": "[CLS] [SEP] the company ' s executive director, mohammed gbadi, is a former employee. [SEP] but even if the crisis is not temporary, a run - up in prices is not the case. [SEP] the u. n. news agency reported sunday that the united states had \" fully located \" the missiles and were continuing to place them in the same location. [SEP] the council president, paul mason, demanded an \" independent review \" inquiry. [SEP] in his decision, judge phillips said that the us authorities had allowed any proceedings to proceed - - or out of court - - to be filed as quickly as a court suit was necessary. [SEP] [SEP]", "detok_text": "[CLS] [SEP] the company's executive director, mohammed gbadi, is a former employee. [SEP] but even if the crisis is not temporary, a run - up in prices is not the case. [SEP] the u. n. news agency reported sunday that the united states had \"fully located\" the missiles and were continuing to place them in the same location. [SEP] the council president, paul mason, demanded an \"independent review\" inquiry. [SEP] in his decision, judge phillips said that the us authorities had allowed any proceedings to proceed - - or out of court - - to be filed as quickly as a court suit was necessary. [SEP] [SEP]"}
+{"type": "sample", "index": 44, "raw_text": "[CLS], says the sheriff ' s office investigated the county ' s call after responding to an incident at home in sequito. [SEP] by the end of the year, a number of claims are expected to be 14, 000, officials said. [SEP] if this goes on forever, we are about to be forever locked in the bubble zone. [SEP] i don ' t think that is true - i know it was true and do not deny that. [SEP] keep being happy with him too. [SEP] i haven ' t heard anything about it. [SEP] but i was doing well.... not too fast. [SEP] robert burns, the former [SEP]", "detok_text": "[CLS], says the sheriff's office investigated the county's call after responding to an incident at home in sequito. [SEP] by the end of the year, a number of claims are expected to be 14, 000, officials said. [SEP] if this goes on forever, we are about to be forever locked in the bubble zone. [SEP] i don't think that is true - i know it was true and do not deny that. [SEP] keep being happy with him too. [SEP] i haven't heard anything about it. [SEP] but i was doing well.... not too fast. [SEP] robert burns, the former [SEP]"}
+{"type": "sample", "index": 45, "raw_text": "[CLS]ws. com. [SEP] the family sister, john johnson, said she had been called by the mother about a drunken incident. [SEP] that was normal. [SEP] \" doing good is a different kind of sport. [SEP] president obama has stated in a speech that during former president bill clinton ' s administration, us president george bush would be \" more than 100 days \" for members of the military. [SEP] meanwhile, older people are leaving their parents in primary school or after their primary school or staying in over the summer or fall. [SEP] it is long enough for mitchell, who is not out until the game, but he made no secret of his [SEP]", "detok_text": "[CLS]ws. com. [SEP] the family sister, john johnson, said she had been called by the mother about a drunken incident. [SEP] that was normal. [SEP] \"doing good is a different kind of sport. [SEP] president obama has stated in a speech that during former president bill clinton's administration, us president george bush would be\" more than 100 days \" for members of the military. [SEP] meanwhile, older people are leaving their parents in primary school or after their primary school or staying in over the summer or fall. [SEP] it is long enough for mitchell, who is not out until the game, but he made no secret of his [SEP]"}
+{"type": "sample", "index": 46, "raw_text": "[CLS] the league ' s first straight home title. [SEP] the fillings start at £2. 99, and are topped with wine. [SEP] you are a pretty good. [SEP] zelaya refused to run an interim government, following his initial stint as a spokesman in the army. [SEP] the matter is being investigated by parliamentary authorities. [SEP] this isn ' t culture at all, it is about politics. [SEP] he says he had a full set of symptoms, which required him to get the phone back to his doctor for several months. [SEP] \" this previous decision, with the risk of a very bad pregnancy, could have had a significant impact, \" [SEP]", "detok_text": "[CLS] the league's first straight home title. [SEP] the fillings start at £2. 99, and are topped with wine. [SEP] you are a pretty good. [SEP] zelaya refused to run an interim government, following his initial stint as a spokesman in the army. [SEP] the matter is being investigated by parliamentary authorities. [SEP] this isn't culture at all, it is about politics. [SEP] he says he had a full set of symptoms, which required him to get the phone back to his doctor for several months. [SEP] \"this previous decision, with the risk of a very bad pregnancy, could have had a significant impact,\" [SEP]"}
+{"type": "sample", "index": 47, "raw_text": "[CLS] the report. [SEP] yet the vote could be a significant slowdown in a country which has fallen short of recession in public campaign promises. [SEP] when i come here i will travel with a new head coach. [SEP] bent, 27, joined the arsenal football side from blackburn almost almost a decade ago and has played major part in the club in the past. [SEP] the fire authority deferred that building works were still going on at its building site, but originally said no work would take place in the county. [SEP] sharif had already issued a list to run for musharraf, and says that he does not see that \" presidential [SEP]", "detok_text": "[CLS] the report. [SEP] yet the vote could be a significant slowdown in a country which has fallen short of recession in public campaign promises. [SEP] when i come here i will travel with a new head coach. [SEP] bent, 27, joined the arsenal football side from blackburn almost almost a decade ago and has played major part in the club in the past. [SEP] the fire authority deferred that building works were still going on at its building site, but originally said no work would take place in the county. [SEP] sharif had already issued a list to run for musharraf, and says that he does not see that \" presidential [SEP]"}
+{"type": "sample", "index": 48, "raw_text": "[CLS]. military says most of its soldiers, known as marine infantry, now has a 100 - strong operations base in iraq, but it maintains a special operations command there that includes more than 2, 000 marines ahead of a new american strategy in the south. [SEP] it ' s not the case in the real world. [SEP] even its problems have been a disappointment. [SEP] officers made the call to jackson within the first three minutes, the inquiry said. [SEP] for more information, visit http : / / www. cri. org. [SEP] he was free to be reached until less than a month ago. [SEP] since the current financial crisis, [SEP]", "detok_text": "[CLS]. military says most of its soldiers, known as marine infantry, now has a 100 - strong operations base in iraq, but it maintains a special operations command there that includes more than 2, 000 marines ahead of a new american strategy in the south. [SEP] it's not the case in the real world. [SEP] even its problems have been a disappointment. [SEP] officers made the call to jackson within the first three minutes, the inquiry said. [SEP] for more information, visit http://www. cri. org. [SEP] he was free to be reached until less than a month ago. [SEP] since the current financial crisis, [SEP]"}
+{"type": "sample", "index": 49, "raw_text": "[CLS], a joint venture of cnn and several other media news agencies. [SEP] these include the royal national trust & trust ( 0172 72009 ) and the restoration trust from £975, 000. [SEP] the mayor says the scheme will allow candidates to be part in the national election contest. [SEP] \" and many of them were found and shot in the head, causing no injuries. [SEP] many companies have built large operations, some have a small scale base in the uk. [SEP] they became interested in the case of a young pub worker who was jailed for murder. [SEP] \" it ' s an extremely small process, not a big [SEP]", "detok_text": "[CLS], a joint venture of cnn and several other media news agencies. [SEP] these include the royal national trust & trust (0172 72009) and the restoration trust from £975, 000. [SEP] the mayor says the scheme will allow candidates to be part in the national election contest. [SEP] \"and many of them were found and shot in the head, causing no injuries. [SEP] many companies have built large operations, some have a small scale base in the uk. [SEP] they became interested in the case of a young pub worker who was jailed for murder. [SEP]\" it's an extremely small process, not a big [SEP]"}
+{"type": "sample", "index": 50, "raw_text": "[CLS] than enough to win this year ' s general elections, the electorate will become critical to the president ' s plans. [SEP] american airlines chief executive scott tankleff said tuesday the company couldn ' t try to push back, and could not conclude a deal. [SEP] the new and current tests are expected to be published and published early next year. [SEP] the show will revert to its non - public location on \" 60 minutes \" in 2010. [SEP] she had only since been released from the hospital. [SEP] since we waited for three months, though, it probably won ' t be long. [SEP] it is believed her family had died, [SEP]", "detok_text": "[CLS] than enough to win this year's general elections, the electorate will become critical to the president's plans. [SEP] american airlines chief executive scott tankleff said tuesday the company couldn't try to push back, and could not conclude a deal. [SEP] the new and current tests are expected to be published and published early next year. [SEP] the show will revert to its non - public location on \"60 minutes\" in 2010. [SEP] she had only since been released from the hospital. [SEP] since we waited for three months, though, it probably won't be long. [SEP] it is believed her family had died, [SEP]"}
+{"type": "sample", "index": 51, "raw_text": "[CLS] people to any health centre. [SEP] in fact, the lower high court could not be said ; the chief chief justice should have been more cowed. [SEP] when a large number of his family were missing, the family bought a house and he was dead. [SEP] he was ordered held without bond and was returned to prison tuesday. [SEP] other senate members have expressed similar concerns. [SEP] along with a weak housing market, obama has argued for concessions on key parts of the proposed bill. [SEP] a seasoned brand manager, heinemann remains the company ' s leading on - line designer, overseeing all products. [SEP] \" his family are not part [SEP]", "detok_text": "[CLS] people to any health centre. [SEP] in fact, the lower high court could not be said; the chief chief justice should have been more cowed. [SEP] when a large number of his family were missing, the family bought a house and he was dead. [SEP] he was ordered held without bond and was returned to prison tuesday. [SEP] other senate members have expressed similar concerns. [SEP] along with a weak housing market, obama has argued for concessions on key parts of the proposed bill. [SEP] a seasoned brand manager, heinemann remains the company's leading on - line designer, overseeing all products. [SEP] \" his family are not part [SEP]"}
+{"type": "sample", "index": 52, "raw_text": "[CLS] said. [SEP] by then, turns out, it had been smith ' s final game of the night, she sent him to high school and had his notebooks for sleep. [SEP] ms lyn jones said a number of local people had attended the council ' s meeting. [SEP] however, the bbc has no more details. [SEP] if they did agree, it will probably take another three months. [SEP] the russian defense department has said it is unlikely to make a \" satisfactory approach \" to the oil issue. [SEP] mr ward, 53, of sudbury, suffolk, is expected to be sentenced at the city of norwich magistrates court in norwich on [SEP]", "detok_text": "[CLS] said. [SEP] by then, turns out, it had been smith's final game of the night, she sent him to high school and had his notebooks for sleep. [SEP] ms lyn jones said a number of local people had attended the council's meeting. [SEP] however, the bbc has no more details. [SEP] if they did agree, it will probably take another three months. [SEP] the russian defense department has said it is unlikely to make a \"satisfactory approach\" to the oil issue. [SEP] mr ward, 53, of sudbury, suffolk, is expected to be sentenced at the city of norwich magistrates court in norwich on [SEP]"}
+{"type": "sample", "index": 53, "raw_text": "[CLS]. [SEP] his fault? [SEP] if we change the constitution, the situation will change, \" he said. [SEP] in that way, they ' d better take responsibility for that this attack took place. [SEP] the air force national survey service said after three hours there had been no reports of uproar on land, with up to 20 trapped people still in the area. [SEP] the independent police complaints commission said the force had \" received no reports of a conflict of public interest. \" [SEP] the first is you can make your decision, even when you slow down. [SEP] the speed of the new system needs to be measured in order to create [SEP]", "detok_text": "[CLS]. [SEP] his fault? [SEP] if we change the constitution, the situation will change, \"he said. [SEP] in that way, they'd better take responsibility for that this attack took place. [SEP] the air force national survey service said after three hours there had been no reports of uproar on land, with up to 20 trapped people still in the area. [SEP] the independent police complaints commission said the force had\" received no reports of a conflict of public interest. \" [SEP] the first is you can make your decision, even when you slow down. [SEP] the speed of the new system needs to be measured in order to create [SEP]"}
+{"type": "sample", "index": 54, "raw_text": "[CLS] the authorities in dealing with such a situation. [SEP] set in the aftermath of the cold war in 1980. [SEP] some companies do not have clear policies to set their profit targets. [SEP] the show creators wanted to write a playlist and did not want to write them in the short iterations of their original series. [SEP] the council has imposed a penalty of 30 months, a ban usually imposed, after completing its three - year extension earlier this month. [SEP] the plane was left on the fifth floor of the hotel and exited in front of the crowd. [SEP] he said he believes new information will be used for prevention. [SEP] the car, [SEP]", "detok_text": "[CLS] the authorities in dealing with such a situation. [SEP] set in the aftermath of the cold war in 1980. [SEP] some companies do not have clear policies to set their profit targets. [SEP] the show creators wanted to write a playlist and did not want to write them in the short iterations of their original series. [SEP] the council has imposed a penalty of 30 months, a ban usually imposed, after completing its three - year extension earlier this month. [SEP] the plane was left on the fifth floor of the hotel and exited in front of the crowd. [SEP] he said he believes new information will be used for prevention. [SEP] the car, [SEP]"}
+{"type": "sample", "index": 55, "raw_text": "[CLS]q ). [SEP] shortly after american officials called to help, the bombing victim was not named as his killer, only to be arrested in the killings. [SEP] however, western officials said that at least four of the pakistani police had been killed, including 10 militants. [SEP] they said he claimed to have the victim shot outside the house monday night and that the rampage ended with his father ' s death. [SEP] it ' s difficult to gauge, \" he says. [SEP] judge stephen j. kagan, the assistant commissioner of alaska, is the former assistant california attorney general for criminal investigation. [SEP] he also said a full - duty police officer [SEP]", "detok_text": "[CLS]q ). [SEP] shortly after american officials called to help, the bombing victim was not named as his killer, only to be arrested in the killings. [SEP] however, western officials said that at least four of the pakistani police had been killed, including 10 militants. [SEP] they said he claimed to have the victim shot outside the house monday night and that the rampage ended with his father's death. [SEP] it's difficult to gauge, \" he says. [SEP] judge stephen j. kagan, the assistant commissioner of alaska, is the former assistant california attorney general for criminal investigation. [SEP] he also said a full - duty police officer [SEP]"}
+{"type": "sample", "index": 56, "raw_text": "[CLS] that, probably because, ' oh, in order to do it i need a lot of money, i ' m sorry, and i feel that there is no disingenuous to have some kind words in my voice. [SEP] august 21 - 5 p. m., w. broad street society, 1, 14th street, east n. 1615. [SEP] in the years she married timothy gordon, he became a b. h. fan. [SEP] e. r. k. malek, who is a conservative activist, also has not been promoted. [SEP] \" it ' s a long, a long week, \" says [SEP]", "detok_text": "[CLS] that, probably because, ' oh, in order to do it i need a lot of money, i'm sorry, and i feel that there is no disingenuous to have some kind words in my voice. [SEP] august 21 - 5 p. m., w. broad street society, 1, 14th street, east n. 1615. [SEP] in the years she married timothy gordon, he became a b. h. fan. [SEP] e. r. k. malek, who is a conservative activist, also has not been promoted. [SEP] \"it's a long, a long week,\" says [SEP]"}
+{"type": "sample", "index": 57, "raw_text": "[CLS] workers began taking off the syringes and other sprits - - including coffee sandwiches and christmas tree meals - - to take patients. [SEP] people who were asked to do so would have to register to post questions in an hour or so before the full details, call 0177 79707 or 01706 7300000. [SEP] it ' s a very serious issue. [SEP] for the moment, he is not quite convinced but he insists we are at big risk. [SEP] last week, the house ethics committee failed to rule on the allegations of money and, apparently to avoid it, passed ethics rules that would ban spending [SEP]", "detok_text": "[CLS] workers began taking off the syringes and other sprits - - including coffee sandwiches and christmas tree meals - - to take patients. [SEP] people who were asked to do so would have to register to post questions in an hour or so before the full details, call 0177 79707 or 01706 7300000. [SEP] it's a very serious issue. [SEP] for the moment, he is not quite convinced but he insists we are at big risk. [SEP] last week, the house ethics committee failed to rule on the allegations of money and, apparently to avoid it, passed ethics rules that would ban spending [SEP]"}
+{"type": "sample", "index": 58, "raw_text": "[CLS] value of the house ' s value. [SEP] well, says mr. rauf. [SEP] british energy finished up 6. 4 percent to 6, 952. 5p, while shares of gas rose 6. 5 percent to 2. 5p. [SEP] det con chris brown also said the court would know that mr smith had waited for the morning after the robbery before he appeared in court at the time of his death. [SEP] the last election elections for european parliament was held in 1991. [SEP] \" this is not a moment we believe we are heading for, \" he said. [SEP] police now know who has been killed, and even [SEP]", "detok_text": "[CLS] value of the house's value. [SEP] well, says mr. rauf. [SEP] british energy finished up 6. 4 percent to 6, 952. 5p, while shares of gas rose 6. 5 percent to 2. 5p. [SEP] det con chris brown also said the court would know that mr smith had waited for the morning after the robbery before he appeared in court at the time of his death. [SEP] the last election elections for european parliament was held in 1991. [SEP] \"this is not a moment we believe we are heading for,\" he said. [SEP] police now know who has been killed, and even [SEP]"}
+{"type": "sample", "index": 59, "raw_text": "[CLS] negative effects of the financial crisis leads to higher demand for available money for education, health and anti - poverty treatment programs and other measures to finance prevention programs, the report added. [SEP] it wasn ' t a bad show either way, either. [SEP] bad debt was among the worst in the financial crisis. [SEP] last year e4, the uk ' s third - largest telephone provider, negotiated a 6 % cut in its fixed - rate contract with vodaq. [SEP] the use of electricity generates around 17 % of the world ' s power available abroad. [SEP] the first bombings, in which more than 20 percent of muslims were killed in [SEP]", "detok_text": "[CLS] negative effects of the financial crisis leads to higher demand for available money for education, health and anti - poverty treatment programs and other measures to finance prevention programs, the report added. [SEP] it wasn't a bad show either way, either. [SEP] bad debt was among the worst in the financial crisis. [SEP] last year e4, the uk's third - largest telephone provider, negotiated a 6 % cut in its fixed - rate contract with vodaq. [SEP] the use of electricity generates around 17 % of the world's power available abroad. [SEP] the first bombings, in which more than 20 percent of muslims were killed in [SEP]"}
+{"type": "sample", "index": 60, "raw_text": "[CLS] to leave him while he would take part in the games. [SEP] the georgian commander, alexander kalirad, said the russian force had started a major offensive in the south osh region, advancing georgian anti - aircraft troops. [SEP] the means that patients may be prepared for further treatment - - - such as a longer hospital waiting period - - is not available, either 10 to 18 or 20 months after or nine months after surgery or diagnosis. [SEP] after all, he was competing at twickenham with david smith in 2002, after impressing in a dramatic final victory 27 years ago. [SEP] \" a proposed human rights commission is the way [SEP]", "detok_text": "[CLS] to leave him while he would take part in the games. [SEP] the georgian commander, alexander kalirad, said the russian force had started a major offensive in the south osh region, advancing georgian anti - aircraft troops. [SEP] the means that patients may be prepared for further treatment - - - such as a longer hospital waiting period - - is not available, either 10 to 18 or 20 months after or nine months after surgery or diagnosis. [SEP] after all, he was competing at twickenham with david smith in 2002, after impressing in a dramatic final victory 27 years ago. [SEP] \" a proposed human rights commission is the way [SEP]"}
+{"type": "sample", "index": 61, "raw_text": "[CLS] new election would be held every seven years. [SEP] this year, there were other drops in oil production prices, including in nigeria and in the us, the group said. [SEP] wednesday ' s record price was $ 2. 5 million. [SEP] a 64 - year - old welsh man has died in critical condition after being hit by a car in an accident on a bus in dorset. [SEP] the man was taken to southampton university hospital ' s emergency room four hours later, and is in hospital for further treatment. [SEP] the baltimore county police are investigating and investigating since 2003. [SEP] his focus will be on monday ' s performance and the return [SEP]", "detok_text": "[CLS] new election would be held every seven years. [SEP] this year, there were other drops in oil production prices, including in nigeria and in the us, the group said. [SEP] wednesday's record price was $2. 5 million. [SEP] a 64 - year - old welsh man has died in critical condition after being hit by a car in an accident on a bus in dorset. [SEP] the man was taken to southampton university hospital's emergency room four hours later, and is in hospital for further treatment. [SEP] the baltimore county police are investigating and investigating since 2003. [SEP] his focus will be on monday's performance and the return [SEP]"}
+{"type": "sample", "index": 62, "raw_text": "[CLS] the state ' s chief prosecutor has been suspended by the attorney general ' s office after holding an independent report of state sexual violations of state law enforcement law. [SEP] the chief general also named key figures, including lt. gen. mohammed zaqqani and abdul - qassim al - ahmadi, the deputy vice - chief of operations abdul - haq. [SEP] shortly after she was recorded on a radio station, the officers found documents she had cut down - - saying she had broken the stairs and was still gone. [SEP] she was the only back - sitter in the three women ' s skiing and world cup pairs events [SEP]", "detok_text": "[CLS] the state's chief prosecutor has been suspended by the attorney general's office after holding an independent report of state sexual violations of state law enforcement law. [SEP] the chief general also named key figures, including lt. gen. mohammed zaqqani and abdul - qassim al - ahmadi, the deputy vice - chief of operations abdul - haq. [SEP] shortly after she was recorded on a radio station, the officers found documents she had cut down - - saying she had broken the stairs and was still gone. [SEP] she was the only back - sitter in the three women's skiing and world cup pairs events [SEP]"}
+{"type": "sample", "index": 63, "raw_text": "[CLS] 52. 1 percent for 2, 500 yards in the 2005 - 06 regular season. [SEP] the u. s. military closed the formal investigation into the cause of the shooting and turned it down. [SEP] the 61 - year - old was paid £21, 900 for his office expenses, rising to £91, 200, and £69, 560 for his home alone in march 2006 to £204, 997. [SEP] earlier, the company had confirmed cases of sanlulu1 : flu in asia, but it has ordered 2. 2 million pounds of high - grade bird sanlu, authorities said. [SEP] in [SEP]", "detok_text": "[CLS] 52. 1 percent for 2, 500 yards in the 2005 - 06 regular season. [SEP] the u. s. military closed the formal investigation into the cause of the shooting and turned it down. [SEP] the 61 - year - old was paid £21, 900 for his office expenses, rising to £91, 200, and £69, 560 for his home alone in march 2006 to £204, 997. [SEP] earlier, the company had confirmed cases of sanlulu1: flu in asia, but it has ordered 2. 2 million pounds of high - grade bird sanlu, authorities said. [SEP] in [SEP]"}

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/argmax_linear2to08_noise_c256_detok_raw_samples.txt

@@ -0,0 +1,236 @@
+argmax_linear2to08_noise_c256_detok
+{
+  "type": "summary",
+  "name": "argmax_linear2to08_noise_c256",
+  "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt",
+  "step": 200000,
+  "decode": {
+    "kind": "categorical_fullvocab_final_sampling_push43",
+    "config": "argmax_linear2to08_noise_c256",
+    "steps": 128,
+    "temp_start": 2.0,
+    "temp_end": 0.8,
+    "temp_schedule": "linear",
+    "t_power": 1.0,
+    "eta0": 0.12,
+    "eta_schedule": "early_linear",
+    "noise_conc": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "final_mode": "argmax",
+    "final_temp": 1.0,
+    "top_k": 0,
+    "top_p": 0.0,
+    "uniform_mix": 0.0,
+    "sample_threshold": 1.0,
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 47.59276914535052,
+    "nll_per_token": 3.862680840986954,
+    "tokens": 9687
+  },
+  "diversity": {
+    "sample_entropy": 4.213223813400032,
+    "unique_tokens": 1963,
+    "token_count": 8192,
+    "distinct_1": 0.2396240234375,
+    "distinct_2": 0.7229330708661418,
+    "top_token_mass": 0.060302734375
+  }
+}
+
+===== sample 000 =====
+[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]
+
+===== sample 001 =====
+[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]
+
+===== sample 002 =====
+[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]
+
+===== sample 003 =====
+[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]
+
+===== sample 004 =====
+[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]
+
+===== sample 005 =====
+[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]
+
+===== sample 006 =====
+[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]
+
+===== sample 007 =====
+[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]
+
+===== sample 008 =====
+[CLS] played in her first two games of her past six seasons for the 2008 u. s. olympic team. [SEP] she said rbs was also informed that he had failed to appear at the hearing and was unable to cooperate with a criminal witness. [SEP] future users will be able to use their free time on the new system as a service. [SEP] but for him and his life on the mobile phone, " it might have been impossible. [SEP] no civil action pending, but any assault will violate the law, unless the defendant is ordered by the police to appear in court before breaking the rules. [SEP] a £6. 2m order is [SEP]
+
+===== sample 009 =====
+[CLS] they have been arrested or face the threat of police action. [SEP] but it was not clear whether they would propose a freeze, as the depletion of supplies is thought to cover the full impact of the crisis. [SEP] nor was he even being ordered for a court hearing and refused to testify. [SEP] perhaps that is the time to send information. [SEP] that said, he will probably pick up a pair of horses for the calendar that ends several years later this year - - this time around. [SEP] mr. mulally has been appointed as deputy vice director for space and head of the defense department. [SEP] two police officers were killed [SEP]
+
+===== sample 010 =====
+[CLS] if they get access to their content, they can't continue to receive their own files. [SEP] mr mitchell was found found dead and lying alone in his cell before he went to his house on the street. [SEP] the world's leading markets are expected to show a further slowdown in the uk economy this year, slowing annual inflation and cutting rates at a rate of 5. 6 percent, to 5. 0 percent, 5. 5 percent and 10. 7 percent.. [SEP] with a shortfall of £1. 4m, brode council has gone on to buy a £10. 6m stake in londonderry council [SEP]
+
+===== sample 011 =====
+[CLS] [SEP] he said mr muti was shown during his family's appearance in court dressed in imitations of justice, police said. [SEP] gonzales, the attorney general, stripped of his post after he tried to defend himself by claiming the court's decision had backed a ruling upholding the social security act, which he called a hate - terrorism case. [SEP] the truth is that many men, women and men have brought guns to school in england have found it changed their lives. [SEP] but the world has always seemed like a lonely place in the end of their own lives. [SEP] authorities had been looking for five men, members of a [SEP]
+
+===== sample 012 =====
+[CLS] [SEP] the blue devils, confident of losing their tournament title to russia, the highest team in the world, are the favorites to meet south korea for the first time. [SEP] i have not done it for over five years and have thought of it for longer before the end of the year. [SEP] "you should not face attack because you believe you should protect national security," said sheikh karuat murubara, chairman of the board of the office of president omar vice - mohammed al - amin. [SEP] a police spokesman said the couple were found seriously injured in an old abbey, near bristol, in the bristol area. [SEP] the [SEP]
+
+===== sample 013 =====
+[CLS] 30 percent. [SEP] officials said the suspects reportedly were members of president obamaʼs military advisers and intelligence officers, as they became an important inter - intelligence committee on both civilian and military intelligence. [SEP] duffy was confirmed as interim legal counsel last week but has worked to win claims since the case began. [SEP] it is also calling for an inquiry into allegations of his conduct. [SEP] gen. b. powell and patrick leahy were also the key advisers, and john c. powell, the first secretary of state. [SEP] this was a cross - party human rights act was lost against them. [SEP] the panel is expected to conduct a full investigation [SEP]
+
+===== sample 014 =====
+[CLS] field in corton wells at about 2000 gmt on sunday but was taken to the royal hospital, the national ambulance service reported on saturday. [SEP] " if we can draw at the rate we can only pay for anything else more than 1, 000 a year. [SEP] eight years ago i was the victim of the weather. [SEP] the birmingham, ill., oct. company, the world's largest maker, reported net revenue of $2. 2 billion, with net income of $42. 2 billion and reported sales of $1. 4 billion over the weekend. [SEP] but a bit of public effort should be required, and [SEP]
+
+===== sample 015 =====
+[CLS] the women's us team had once again won the money and his chance after playing at the radega golf center. [SEP] previous research into the condition found no risk among the elderly, including a study that found men with high deficits were more than likely to weather the worst of the disease as age progressed. [SEP] the bird was found abandoned at about noon bst while it was in hospital where he is now ill. [SEP] shell has said it would discuss its finances according to the terms of the deal. [SEP] if it is a doubt, he may never take up the park's freedom tower, which overlooks the popular [SEP]
+
+===== sample 016 =====
+[CLS] the new members of the board of the national retailing association. [SEP] the fire started at about 150 yards, in the street and at the front, cars broke out in the back and the vehicles were blocked through the street. [SEP] ian, ian and their daughter, catherine, 35, married a year ago and were married with two children in scotland. [SEP] the bank is listed in news reports as the only bank bank to sell at 10 percent of its bank debt to around $2 million - - an increase of more than 30 % over 2009 and of some $1 million over the final quarter of last year. [SEP] she is an [SEP]
+
+===== sample 017 =====
+[CLS] longest - skid in a. a. l. history. [SEP] before the result, the two republican groups have threatened obama and bush. [SEP] but, he was told, he could not have trusted her because she saw him, and then he was abusive, just because he attempted to call her. [SEP] the record holder is competing in several different programs. [SEP] a spokesman for the ministry of defence said that commander general sir sir john richards sent out a letter in iraq. [SEP] under the new law which was introduced last year, the president must be removed from the chamber of a permanent cabinet. [SEP] a pentagon spokesman, kevin boyd, [SEP]
+
+===== sample 018 =====
+[CLS] families were affected by the virus. [SEP] just before 3 a. m., three dozen police officers were waiting for police to slow down. [SEP] the announcement will be a disappointment to the team of harry redknapp, the spurs manager. [SEP] wayne rooney took advantage in the late break with dim berbatov's second - half strike to have liverpool clear local rivals arsenal at the bottom of the home premier league and ferguson preparing for the prospect of liverpool's first home victory in the league. [SEP] mr martin, the new tory leader, has faced stinging criticism of its own position ahead of publication of the general power expenses [SEP]
+
+===== sample 019 =====
+[CLS] comment. [SEP] another former law enforcement official said stratton was helping the public and local authorities in case of wrongdoing allegations. [SEP] spend $1. 8m on the spot, download the first copy of it and buy the album. [SEP] "the aim is to avoid any public office that the cabinet uses on it," the prime minister said. [SEP] london (reuters) - european union's counter - piracy fighter jet forces in north america attacked pirates with russian military attack aircraft, the air force force said on saturday. [SEP] waterfield, 23, was sentenced dec. [SEP] the £35 million community - based centre [SEP]
+
+===== sample 020 =====
+[CLS] earlier this month and has killed hundreds of possibly thousands of people. [SEP] then there is one of those five appropriate options, no type of an appointment or appointment ahead of time, no immediate need to apply, or any bonus. [SEP] pre - cancer diagnosis and treatment are considered the best option. [SEP] following the tragic killing, sir michael hunter said, the police began an independent investigation into mr. silwood's death. [SEP] he died in his cot shortly after the murder of col jonathan james, of 2nd battalion the duke of lancaster regiment who was commander of the brigade at night. [SEP] meanwhile, five americans were sentenced to death [SEP]
+
+===== sample 021 =====
+[CLS] 3 per cent to 9p (down from 9. 9 per cent). " [SEP] we'll have something on this soon. [SEP] anyone could be prosecuted. [SEP] the club have breached their regulations if they have voted to hold matches at the club, while the club's owner is now allowing the club to kick off the championship match. [SEP] american briton dixon was placed second in the field in a event where his fellow team - mates, brian smith and mark mczaghe, did little to help, suffering in a crash on sunday. [SEP] second seed serena williams won the french open crown in her fourth appearance in [SEP]
+
+===== sample 022 =====
+[CLS] freddie mac said it will cut nearly 40 percent of its consumer mortgage business as it tries to suffer credit losses linked to the u. s. housing slump and troubled mortgage market. [SEP] such is this comment that i find myself very critical of them. [SEP] he is a strong critic of the leader, brendan nichols, the deputy secretary of the church of england. [SEP] a government watchdog has ordered its members to earn hundreds of thousands of pounds a year by using the electoral complaints commission to produce and publish a final report. [SEP] an injured man killed in a blaze at two houses in the street on tuesday night was reported by police as " [SEP]
+
+===== sample 023 =====
+[CLS] said it was satisfied there is a "public interest" in the patients' safety. [SEP] the report says that too many children take such trips to a school, with almost two thirds of primary schools aged more than 16 taking two and seven more children at the time the tests appeared on the local primary education system. [SEP] half of the prisoners were reported to the authorities, according to the spokesman. [SEP] during a senate hearing for mr. biden, he said he no longer believed that many members of the committee should be counted in his life. [SEP] she also produced a new first act in the talent show. [SEP] in the 1960s and [SEP]
+
+===== sample 024 =====
+[CLS] police. [SEP] ms davies currently appeared as a solo vocalist at the national symphony. [SEP] mosley has used all but the rest of his playing career during his five seasons to secure his first - team place with the national team. [SEP] at other points, fukuda attacked lee's support of south korea as a safe place for terrorists. [SEP] the ugandan branch of the ugandan national tv association still has a trading relationship with the phone for only two days, and a new zealand tv provider will offer $1. 5 for a monthly fee. [SEP] two boys aged 15 and 10 - year - old girl are arrested on suspicion [SEP]
+
+===== sample 025 =====
+[CLS] 00977 (international or 1 - 800 - 703 u. s. calls), or by dialing + 800 - 800 - 845 - 975. [SEP] wiltshire police have warned anyone who was in the car to make it a "safer vehicle." [SEP] a national trust public inquiry was formed into the matter after the man's death last year. [SEP] a private funeral service has been held in the town to mark the start of the assault. [SEP] he was inconspicuous to the boys - - he is the boy sitting in his room and starts sneaking him into the room in his family - - [SEP]
+
+===== sample 026 =====
+[CLS]pc decline in net profits during the trading after the company said that it would have to buy $800m of shares for $6bn on the back of its recent book - loss of $399m. [SEP] underlying profits fell to £14m per share for the first three of a year because of recession. [SEP] but it was 5 - 1 in beijing. [SEP] i tried to do it again. [SEP] this week's eight - day event, which costs $1 million per person, makes less than $1 million a month. [SEP] khamashov, a five - year president of the union, accused of running [SEP]
+
+===== sample 027 =====
+[CLS] [SEP] they proved her, she had made a real issue for the show, and put her on the air. [SEP] the times said the trust wanted a review of the new rules, but that were unlikely by the end of the commission's report, which will take this month. [SEP] officials said he received a camera and other equipment worth more than $30, 000, the austin (texas) - times reported. [SEP] the driver will receive a video camera from police before making their way to the compound. [SEP] his son, to be sure, long ago, was working in the gas fields. [SEP] it is only 20 minutes of [SEP]
+
+===== sample 028 =====
+[CLS] - finals. [SEP] the 35 - year - old was also named in the squad that went to the world championships and the olympic finals. [SEP] no matter, officers found the shooting suspect. [SEP] the former striker had held the job previously, as inter finished their first 11 months of having won their opening three matches, but this time they were at home after only three months at villa. [SEP] williamson, 56, became co - president of the university's college medical board in 2006. [SEP] it also changed his character. [SEP] richard coleman, a forest service spokesman in moorland, colorado, said the agency would be issuing an alert to [SEP]
+
+===== sample 029 =====
+[CLS] their lives ended in a state of fear - - but a fear of their death. [SEP] murray didn't reach the final set until beating rafael nadal, and replaced stammer in the subsequent first - round robin match. [SEP] the sub - bridge was closed to traffic until between 2200 and 1630 gmt, but the lorry section reopened at 0330 gmt and roads were closed at 08450. [SEP] the' united states economy' after 1980's enjoyed its fastest growth since 1996. [SEP] mr solanki has worked hard; he started recently. [SEP] a former member of the board of the department of [SEP]
+
+===== sample 030 =====
+[CLS], ballet, football, tennis and tennis, but what's the option? [SEP] and he was told by her, by the boy's 30 years later, that he was better off than the king. [SEP] president musharraf has installed the president of parliament as his replacement. [SEP] various reports, however, have been published by state media, saying the panel that prompted the inquiry would have to allow authorities to determine whether his wife was not on a flight. [SEP] dr edward kennedy, 79, the director general of the university and university society of england, had asked the committee to give their case to richard, the former [SEP]
+
+===== sample 031 =====
+[CLS] mice in a laboratory laboratory, where the levels of the chemicals were high in inducing patients to have high levels of energy. [SEP] obama pulled ahead of john mccain this week but his republican presidential primary set off a terror threat against him. [SEP] rooney was at his post in the second, giving them added entrae to their fifth league win of the season. [SEP] a few minutes, add coffee and water to boil, and that's not enough. [SEP] the death over the course of three months is only the second year of a death by a coroner. [SEP] this requires shareholders to consider the abortion of the board positions and [SEP]
+
+===== sample 032 =====
+[CLS] its military leadership during the political turmoil. [SEP] mr mcilvy has claimed mr straw's decision was based on his case. [SEP] the farm sector has laid off at least three of the rest of the year, and lost 35, 000 jobs in january, compared with three months ago of 58, 416, the survey said. [SEP] to date, no deaths caused by the disease are linked to the seasonal flu, which have already been made up by a common seasonal flu, in the winter of flu and the virus, to minimise the severity of its spread. [SEP] but, according to the daily news, he argues, [SEP]
+
+===== sample 033 =====
+[CLS] information not to be made in place of their judgment in connection to the police inquiry. [SEP] (ap) - president robert kennedy and former vice president david mceven plan on laboring their fight wednesday to broker a healthcare deal. [SEP] new zealand have not come too far from the tournament after winning six of their last eight, but at least the united states. [SEP] well, ever since there have been left over. [SEP] mr green was given evidence to the police by mr phillips, who said the "serious decision to issue a criminal warrant was a significant break" in the legal case for a public inquiry into the terms of the report [SEP]
+
+===== sample 034 =====
+[CLS] [SEP] "it seemed there were a number of people out there saying we were sitting at the bar with a friend," said hamlin. [SEP] the country's deval budget, meanwhile, urgently needs about $6. 1 billion a year, but most of the children in this year's budget get final treatment. [SEP] mody is part of the british football squad youth team and has been named as a likely player for scotland since december 2007. [SEP] " the federal court is violating a state law that barred the reading of a hunting law without a state's consent. [SEP] after a long, sometimes long war, [SEP]
+
+===== sample 035 =====
+[CLS] the world. [SEP] this did not involve any increased activity in the muscles as a part of the body's electrical structure. [SEP] but a judge ruled on monday that there were no differences in the fact that, within two days of his current release, the prisoner would have been eligible for immediate release. [SEP] in the past few weeks, the government has backed the scheme directly, calling for a return to a second choice of mortgage to replace loans made on a mortgage. [SEP] the board members are encouraged to take shares. [SEP] the company reopened in may after making an application on an untested application by the company. [SEP] as for [SEP]
+
+===== sample 036 =====
+[CLS] s. defense secretary robert gates said sunday he did not think u. s. troops might pull out of the military offensive in afghanistan because of the turmoil after the elections. [SEP] that may be the problem. [SEP] ryan reid, 19, 19, of coventry, was killed on saturday. [SEP] she also will have joined helen, grant, edward jones and jackie robinson as the last five winners of honours for her film, including the revival in a classic tv production. [SEP] king john c. kennedy, who in 1982 won the world's highest medal of human rights, died in 2007 at the age of 60. [SEP] mr wild was [SEP]
+
+===== sample 037 =====
+[CLS]. [SEP] nottinghamshire police said " it is believed that brown was not the main victim of this murder and officers found the victim of drink - driving. [SEP] while many patients are able to receive treatment, almost all are found to have been asleep when they are home, said hospital officials. [SEP] the euro fell to $1. 9203 yen and $1. 854, up from 1. 933. 95, compared to 0. 9204 pounds late on friday. [SEP] during that, all buildings that had been mortgaged were for value obligations. [SEP] he said the incident was not part of the investigation. [SEP] some [SEP]
+
+===== sample 038 =====
+[CLS] the best part of his life at home and his kids at school, but that his police will not arrest or search his students one day in the same week. [SEP] although opel, the world's second - largest maker of luxury cars, failed in cars and trucks for the year, sales rose 2. 8 percent, in the second quarter, despite a 3 percent profit drop compared with its figure in the same period the previous year. [SEP] the national army and air force said its soldiers had detected the explosion, but said it likely occurred on the outskirts of tewud gar, north of kabul. [SEP] matthew and father [SEP]
+
+===== sample 039 =====
+[CLS] of the mortgage interest bill, which could rise to 6. 5 per cent growth, are unlikely to have been affected by inflation in 2010, according to a bank of england monetary fund. [SEP] he said bp had used £1. 6 of the market every day for about a billion worth of tankers six years ago, and it had debts of tens of millions of dollars. [SEP] "the life on earth doesn't drive us up long until we rise again. [SEP]" we believe the protocols have been adapted and adapted to ensure patient safety and increase safety. [SEP] coffey also served on the university's investigations team in 1996 and [SEP]
+
+===== sample 040 =====
+[CLS] threat of weather warnings starting to grow more storms in the united states, experts say the storms are expected to kill at least 20, 000 people in europe and nearly 7 million people in britain and the world. [SEP] medvedev, nato's former president, was appointed sacked and in november 2007 won parliamentary backing for the province. [SEP] this was also not an issue. [SEP] the french center has been limited to 22 points in what is his last game. [SEP] anderson, who also came in at the start of his campaign as the leading man for the second world title last year, has won his 80th test after winning 18 games [SEP]
+
+===== sample 041 =====
+[CLS] gas stations. [SEP] a total of £1. 5 million homes had been built, and approval prices for new homes fell, rising by 31 %, to a record annual rate of almost £2 million, figures show. [SEP] he faces a formal hearing in the court after he denied having a relationship with the girl. [SEP] i get estate worth worth $100 million (about $100) and worth about $100 - $200 (£6. 97 billion), $3 billion ). [SEP] the fact, "house of the sky," a stunning venetian installation shot in the 15th century, is almost a world down the coast - a [SEP]
+
+===== sample 042 =====
+[CLS] by mps on the rules for mps' pay and the government has been expected to rule on holding an election on reform of the treaty within four weeks because the move is expected to trigger a sitting majority in the next parliament. [SEP] he can do this in the way i am thinking of it every day. [SEP] in contrast, the cost of each room was £12. 99 for three bed and breakfast available (£78 - £15/week). £69. 99. [SEP] john mccain was staging a morning rally at the house on the street in front of san angelo, a town of about 700. [SEP] but the [SEP]
+
+===== sample 043 =====
+[CLS]. [SEP] clearly, it's not similar to that in other parts of the world. [SEP] people who try to buy presents may be hard enough to resist, but it is too early to go down the traditional buying route, and drive up the price in future. [SEP] in my case, the couple would probably end up spending a year on a beach. [SEP] however, the committee has ruled that the bank should make a "thorough and strategic review," which the letter says, from a senior executive, would try to qualify for a higher position as it would be a chairman who acts more effectively than usual in the circumstances. [SEP] [SEP]
+
+===== sample 044 =====
+[CLS] and they had pretty much emphasised the moment of night. [SEP] the committee also said it "believed its demand to abide" by the rules meant that "although the independent panel is not considered to be effective, therefore, further action should occur if the internal levels of the inquiry are deemed to improve." [SEP] this morning, when attorney general a. b. i. cuomo, mr. cuomo and his attorney said that no one had been met with anyone who allowed a special criminal investigation to sneak out of albany. [SEP] now it's a week, north of the iraqi border. [SEP] while the fbu calls [SEP]
+
+===== sample 045 =====
+[CLS] public news organizations, including rtl, the sunday daily, which also has reported television and public comments about her mental health. [SEP] the chairman of the senate's intelligence, joe lieberman, r - mich., told cnn that as the author of an energy bill, he also assumed that president george bush would be "the first" democrat to sign the legislation. [SEP] he said: " without further incident, the incident took place in the street. [SEP] gary hooper came in on the wing and dived on to his replacement, stephen jones, who was struggling to make up the goal. [SEP] in a history of trial [SEP]
+
+===== sample 046 =====
+[CLS] cover of the paper, which is still mired in editorials about its old paper existence. [SEP] james o. m. cuomo, the head of the m. b. b., is a former attorney who was appointed as attorney general on september 18. [SEP] lombardi is now allied with arizona quarterback jeff brown, football's only other all - time rushing champion. [SEP] about 2, 000 cases a week, including 3, 000, have been made public after peaking to over 200 in april 2006. [SEP] what does marriage mean? [SEP] he believes that a strong case of that could have limited consequences between air and climate [SEP]
+
+===== sample 047 =====
+[CLS] the company and its private business as a result of its pension problems, a company which has lost 560 jobs since joining the mail in 2001. [SEP] the times speaks four times, and says it is prepared to sit out of its meeting all week but may not see an answer in the fall. [SEP] his force officers are not acting as it relates but colleagues in the unit will co - operate this investigation. [SEP] hundreds of calls are being made public about whether people should get immunity with h1n1, while the scottish government insists healthy people are no immunity for new h1n1, the health register reported. [SEP] but " the [SEP]
+
+===== sample 048 =====
+[CLS] sending him a question on the whole search process as he describes the "period of horse - trading." [SEP] she also said the current situation meant there would be "irresponsibility in the media." [SEP] new york (reuters) - yahoo inc's stock unit posted $15 billion in third - quarter profits, helped by a $900 - million charge on the buyback of shares of its stock, aon said wednesday. [SEP] in those days of political talks, of course, no one will get a call. [SEP] he says that is a tough call, but he hopes to drive in a few years. [SEP] [SEP]
+
+===== sample 049 =====
+[CLS] tax profits including a £25m increase of £35m. the book of acquisition of british national savings bank (rbs. l) is expected rise to £670m, also higher than profits. [SEP] that's up five, nine times its rate in the last three months. [SEP] she is accused of briefly working as a receptionist at a hotel, making no training. [SEP] the taliban have built their formidable insurgency attacks from the small city since the afghan national army took control of the surrounding district in 2001. [SEP] this appeared to be an important order, but it wasn't for most of us now. [SEP] in [SEP]
+
+===== sample 050 =====
+[CLS]. [SEP] several other people were injured after the killing, police said. [SEP] the office for national statistics reported inflation down to 5 % in a month last month. [SEP] metropolitan police officers have found out a video of the incident in stockdale, north yorkshire. [SEP] new york's sales fell by 8. 3 % in october compared to last year, the biggest monthly decline since washington recorded a large increase in national foreclosure activity. [SEP] her five - year - old son, paul, of norfolk, and her husband, michael smith, were found hanged in the same room. [SEP] mr. browder said, however, [SEP]
+
+===== sample 051 =====
+[CLS]ers were the most vulnerable. [SEP] "based on their second - half performance at the finals of world cup, they've been fantastic," he said in a news interview. [SEP] fort collins police said the suspect in the shooting, who was 16 or 21, was being held in the pinellas county jail on saturday. [SEP] other council members have called for new elections, observers say. [SEP] he is just one of 15 million who have been born since the civil war. [SEP] he led the game with nine points and ran in one of the longest running touchdown drives in franchise history. [SEP] " i have no intention to play against [SEP]
+
+===== sample 052 =====
+[CLS] said. [SEP] there are two of the fastest - growing lifestyle myths: that you can't get drunk by drinking, and even a beer when you can feel very uncomfortable. [SEP] this time, it can hit only about half a second. [SEP] that's a myth. [SEP] that is the cost of university fees. [SEP] " we believe emergency calls were taken immediately before the incident. [SEP] of those there are at least £4. 2bn in the red, with at least £7bn (£2bn) over the lifetime of retirement - funds valued at at least £15m and those worth more than £4. 6 [SEP]
+
+===== sample 053 =====
+[CLS]. [SEP] in 1998 chief executive sir john blavine, the finance chairman, became the bank's chief executive officer. [SEP] japan's anthony kim birdied the final two holes to finish on 70 for a six - under 66 and three back on joint second with match - up leader peter hanson and defending champion ben curtis in a five under total of 135. [SEP] according to the local police, the group has become a viisance during the four - week trip. [SEP] according to bbc america, a company of news corp, fox and the bbc, broadband worth millions of pounds as part of its broadband service. [SEP] he is [SEP]
+
+===== sample 054 =====
+[CLS] charges, was questioned by a judge monday whether they will be considered for custody in connection with the case. [SEP] some people remain in the hospital, the spokeswoman said. [SEP] the man was seen swimming around a virginia beach and then driving north of reno shortly before 5 a. m., the king county police said. [SEP] jones was banned from the track for four races this season, after having her three - year olympic ban imposed in october. [SEP] electronic games company is the leading leader in both video and online video games for the world. [SEP] however, he once admitted it would be difficult for patients. [SEP] some 35, [SEP]
+
+===== sample 055 =====
+[CLS] it had decided to sell north american operations and to re - pay down debt. [SEP] at least 38 people died - - 10 were injured, according to the television reports. [SEP] a number of crews were deployed during operation panther following a rescue operation in early 2007. [SEP] authorities said two police officers then fired a shot outside the house and killed her. [SEP] you start with an ins insurance company who' wants someone's health insurance and pays off the time. [SEP] as speaker, sir john stevens, the assistant chief of westminster, is the author of a book report for the speaker. [SEP] revenues also fell during the christmas trading period in [SEP]
+
+===== sample 056 =====
+[CLS] sabotage, or breach of law. "[SEP]" to ask if they can make their lists so they can't make taxes, ask them to give all the distorting information to a person who's in the limelight. [SEP] the company said it had "full potential" to take up a portion of its $240 million to $150 million. [SEP] in 2003, the air force gave up a survey of kennedy space center in washington. [SEP] as such there is unease that the government could face the prospect of running into a war with the government. [SEP] "it's just once in a long week," says [SEP]
+
+===== sample 057 =====
+[CLS] public office space, the national sports center and arts centre, and the construction of nearby parks and schools to popularise its large urban population. [SEP] if you can get ahead, or just live longer or get too short, exercise regularly. [SEP] the company also also increased its outstanding 877 shares at last trading friday, on march 31, when it was trading at $1. 10 a share in the first five days. [SEP] the jail chief was ordered to death by county investigators. [SEP] in the early years of the vietnam war, the u. s. military academy, for instance, questioned whether an army would be part of the [SEP]
+
+===== sample 058 =====
+[CLS] picture of the house's conditions. [SEP] so far, mr. musharraf has been on a caretaker schedule; it is expected to take effect as soon. [SEP] and there's a pretty little fear about commenting on any aspect of ms. palin's plans. [SEP] the wachovia industrial shares had lost 15 percent to close at y9. 70 and close at y236. 80. [SEP] standard chartered bought a 60 - 50 per cent share of hbos last year and raised an additional won1. 2bn in the recent rights rights issue. [SEP] " then i feel great - he can even [SEP]
+
+===== sample 059 =====
+[CLS] wife, hannah rohme, a former finance manager for the former senior vice president and vice president, brokered the deal. [SEP] of the teachers, the national association of teachers said 81 percent said they are raising children. [SEP] passengers can go to virgin 0845 01074 (022 4568. com), 0877 493 90386, bachaus (083 636 7997), or english 1 800 8002 for additional information. [SEP] some had left school, and they have not. [SEP] the first lady was to be the winner in august. [SEP] gordon davis is [SEP]
+
+===== sample 060 =====
+[CLS] that shows it has widespread and popular support in the country. [SEP] the review of the system was launched on friday night after martin johnson, the director of the police service, said: " when he is caught, the owner of the phone doesn't pay, as he is not bound by the rules. [SEP] my son, however, could not. [SEP] however, police said they were not aware that any firearms had been lost in the previous operation. [SEP] he was elected as rector of d. roosevelt university in 2002, and was made president of the church of england in 1997. [SEP] while a proposed human rights commission limits the number [SEP]
+
+===== sample 061 =====
+[CLS] of other teachers and students at the right levels are able to avoid long - lasting conflict, while many teachers fail to think of their own experiences in the classroom. [SEP] mr starkey became an assistant principal at the national theatre company, but now he has taken a part in several productions which have taken him three weeks of the course. [SEP] now the fed rate cuts have the fed lower its rate of meeting in january. [SEP] 6 - - the report follows a senate committee report released sunday that attorney general eric schadr improperly made his call for war in iraq. [SEP] his focus will be on people's performance and the results [SEP]
+
+===== sample 062 =====
+[CLS] after pakistan's supreme court suspended president, gen. pervez musharraf declared an election law law, saying he will continue as chief justice. [SEP] this case is only one of its kind at the royal society. [SEP] now, it's supposed to be a "mussy," live " game in a typical cold weather. [SEP] but musharraf declared that extending the warrants was not considered high enough. [SEP] i'm in the district. [SEP] despite the controversy, may said he believes bolt has not created a back - end formula to make the men's race. [SEP] he should have [SEP]
+
+===== sample 063 =====
+[CLS] be a good feeling. [SEP] just three years ago, he received a doctorate and was suspended from the school in january. [SEP] and the appeal of the appeal court has ruled that it could not not be completed without a trial - - and therefore the costs of the case. [SEP] but britain says the law was changed, giving british troops the right to seek to appeal life in judicial cases in other countries. [SEP] she was later pursued by a police officer who reportedly was later shot. [SEP] he said that spending before the planned general election would be held until 2010, one week after the election should take place in june next year. [SEP] in [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/argmax_linear2to08_noise_c256_raw_samples.txt

@@ -0,0 +1,236 @@
+argmax_linear2to08_noise_c256
+{
+  "type": "summary",
+  "name": "argmax_linear2to08_noise_c256",
+  "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt",
+  "step": 200000,
+  "decode": {
+    "kind": "categorical_fullvocab_final_sampling_push43",
+    "config": "argmax_linear2to08_noise_c256",
+    "steps": 128,
+    "temp_start": 2.0,
+    "temp_end": 0.8,
+    "temp_schedule": "linear",
+    "t_power": 1.0,
+    "eta0": 0.12,
+    "eta_schedule": "early_linear",
+    "noise_conc": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "final_mode": "argmax",
+    "final_temp": 1.0,
+    "top_k": 0,
+    "top_p": 0.0,
+    "uniform_mix": 0.0,
+    "sample_threshold": 1.0,
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 47.59276914535052,
+    "nll_per_token": 3.862680840986954,
+    "tokens": 9687
+  },
+  "diversity": {
+    "sample_entropy": 4.213223813400032,
+    "unique_tokens": 1963,
+    "token_count": 8192,
+    "distinct_1": 0.2396240234375,
+    "distinct_2": 0.7229330708661418,
+    "top_token_mass": 0.060302734375
+  }
+}
+
+===== sample 000 =====
+[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]
+
+===== sample 001 =====
+[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]
+
+===== sample 002 =====
+[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]
+
+===== sample 003 =====
+[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]
+
+===== sample 004 =====
+[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]
+
+===== sample 005 =====
+[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]
+
+===== sample 006 =====
+[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]
+
+===== sample 007 =====
+[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]
+
+===== sample 008 =====
+[CLS] played in her first two games of her past six seasons for the 2008 u. s. olympic team. [SEP] she said rbs was also informed that he had failed to appear at the hearing and was unable to cooperate with a criminal witness. [SEP] future users will be able to use their free time on the new system as a service. [SEP] but for him and his life on the mobile phone, " it might have been impossible. [SEP] no civil action pending, but any assault will violate the law, unless the defendant is ordered by the police to appear in court before breaking the rules. [SEP] a £6. 2m order is [SEP]
+
+===== sample 009 =====
+[CLS] they have been arrested or face the threat of police action. [SEP] but it was not clear whether they would propose a freeze, as the depletion of supplies is thought to cover the full impact of the crisis. [SEP] nor was he even being ordered for a court hearing and refused to testify. [SEP] perhaps that is the time to send information. [SEP] that said, he will probably pick up a pair of horses for the calendar that ends several years later this year - - this time around. [SEP] mr. mulally has been appointed as deputy vice director for space and head of the defense department. [SEP] two police officers were killed [SEP]
+
+===== sample 010 =====
+[CLS] if they get access to their content, they can ' t continue to receive their own files. [SEP] mr mitchell was found found dead and lying alone in his cell before he went to his house on the street. [SEP] the world ' s leading markets are expected to show a further slowdown in the uk economy this year, slowing annual inflation and cutting rates at a rate of 5. 6 percent, to 5. 0 percent, 5. 5 percent and 10. 7 percent.. [SEP] with a shortfall of £1. 4m, brode council has gone on to buy a £10. 6m stake in londonderry council [SEP]
+
+===== sample 011 =====
+[CLS] [SEP] he said mr muti was shown during his family ' s appearance in court dressed in imitations of justice, police said. [SEP] gonzales, the attorney general, stripped of his post after he tried to defend himself by claiming the court ' s decision had backed a ruling upholding the social security act, which he called a hate - terrorism case. [SEP] the truth is that many men, women and men have brought guns to school in england have found it changed their lives. [SEP] but the world has always seemed like a lonely place in the end of their own lives. [SEP] authorities had been looking for five men, members of a [SEP]
+
+===== sample 012 =====
+[CLS] [SEP] the blue devils, confident of losing their tournament title to russia, the highest team in the world, are the favorites to meet south korea for the first time. [SEP] i have not done it for over five years and have thought of it for longer before the end of the year. [SEP] " you should not face attack because you believe you should protect national security, " said sheikh karuat murubara, chairman of the board of the office of president omar vice - mohammed al - amin. [SEP] a police spokesman said the couple were found seriously injured in an old abbey, near bristol, in the bristol area. [SEP] the [SEP]
+
+===== sample 013 =====
+[CLS] 30 percent. [SEP] officials said the suspects reportedly were members of president obamaʼs military advisers and intelligence officers, as they became an important inter - intelligence committee on both civilian and military intelligence. [SEP] duffy was confirmed as interim legal counsel last week but has worked to win claims since the case began. [SEP] it is also calling for an inquiry into allegations of his conduct. [SEP] gen. b. powell and patrick leahy were also the key advisers, and john c. powell, the first secretary of state. [SEP] this was a cross - party human rights act was lost against them. [SEP] the panel is expected to conduct a full investigation [SEP]
+
+===== sample 014 =====
+[CLS] field in corton wells at about 2000 gmt on sunday but was taken to the royal hospital, the national ambulance service reported on saturday. [SEP] " if we can draw at the rate we can only pay for anything else more than 1, 000 a year. [SEP] eight years ago i was the victim of the weather. [SEP] the birmingham, ill., oct. company, the world ' s largest maker, reported net revenue of $ 2. 2 billion, with net income of $ 42. 2 billion and reported sales of $ 1. 4 billion over the weekend. [SEP] but a bit of public effort should be required, and [SEP]
+
+===== sample 015 =====
+[CLS] the women ' s us team had once again won the money and his chance after playing at the radega golf center. [SEP] previous research into the condition found no risk among the elderly, including a study that found men with high deficits were more than likely to weather the worst of the disease as age progressed. [SEP] the bird was found abandoned at about noon bst while it was in hospital where he is now ill. [SEP] shell has said it would discuss its finances according to the terms of the deal. [SEP] if it is a doubt, he may never take up the park ' s freedom tower, which overlooks the popular [SEP]
+
+===== sample 016 =====
+[CLS] the new members of the board of the national retailing association. [SEP] the fire started at about 150 yards, in the street and at the front, cars broke out in the back and the vehicles were blocked through the street. [SEP] ian, ian and their daughter, catherine, 35, married a year ago and were married with two children in scotland. [SEP] the bank is listed in news reports as the only bank bank to sell at 10 percent of its bank debt to around $ 2 million - - an increase of more than 30 % over 2009 and of some $ 1 million over the final quarter of last year. [SEP] she is an [SEP]
+
+===== sample 017 =====
+[CLS] longest - skid in a. a. l. history. [SEP] before the result, the two republican groups have threatened obama and bush. [SEP] but, he was told, he could not have trusted her because she saw him, and then he was abusive, just because he attempted to call her. [SEP] the record holder is competing in several different programs. [SEP] a spokesman for the ministry of defence said that commander general sir sir john richards sent out a letter in iraq. [SEP] under the new law which was introduced last year, the president must be removed from the chamber of a permanent cabinet. [SEP] a pentagon spokesman, kevin boyd, [SEP]
+
+===== sample 018 =====
+[CLS] families were affected by the virus. [SEP] just before 3 a. m., three dozen police officers were waiting for police to slow down. [SEP] the announcement will be a disappointment to the team of harry redknapp, the spurs manager. [SEP] wayne rooney took advantage in the late break with dim berbatov ' s second - half strike to have liverpool clear local rivals arsenal at the bottom of the home premier league and ferguson preparing for the prospect of liverpool ' s first home victory in the league. [SEP] mr martin, the new tory leader, has faced stinging criticism of its own position ahead of publication of the general power expenses [SEP]
+
+===== sample 019 =====
+[CLS] comment. [SEP] another former law enforcement official said stratton was helping the public and local authorities in case of wrongdoing allegations. [SEP] spend $ 1. 8m on the spot, download the first copy of it and buy the album. [SEP] " the aim is to avoid any public office that the cabinet uses on it, " the prime minister said. [SEP] london ( reuters ) - european union ' s counter - piracy fighter jet forces in north america attacked pirates with russian military attack aircraft, the air force force said on saturday. [SEP] waterfield, 23, was sentenced dec. [SEP] the £35 million community - based centre [SEP]
+
+===== sample 020 =====
+[CLS] earlier this month and has killed hundreds of possibly thousands of people. [SEP] then there is one of those five appropriate options, no type of an appointment or appointment ahead of time, no immediate need to apply, or any bonus. [SEP] pre - cancer diagnosis and treatment are considered the best option. [SEP] following the tragic killing, sir michael hunter said, the police began an independent investigation into mr. silwood ' s death. [SEP] he died in his cot shortly after the murder of col jonathan james, of 2nd battalion the duke of lancaster regiment who was commander of the brigade at night. [SEP] meanwhile, five americans were sentenced to death [SEP]
+
+===== sample 021 =====
+[CLS] 3 per cent to 9p ( down from 9. 9 per cent ). " [SEP] we ' ll have something on this soon. [SEP] anyone could be prosecuted. [SEP] the club have breached their regulations if they have voted to hold matches at the club, while the club ' s owner is now allowing the club to kick off the championship match. [SEP] american briton dixon was placed second in the field in a event where his fellow team - mates, brian smith and mark mczaghe, did little to help, suffering in a crash on sunday. [SEP] second seed serena williams won the french open crown in her fourth appearance in [SEP]
+
+===== sample 022 =====
+[CLS] freddie mac said it will cut nearly 40 percent of its consumer mortgage business as it tries to suffer credit losses linked to the u. s. housing slump and troubled mortgage market. [SEP] such is this comment that i find myself very critical of them. [SEP] he is a strong critic of the leader, brendan nichols, the deputy secretary of the church of england. [SEP] a government watchdog has ordered its members to earn hundreds of thousands of pounds a year by using the electoral complaints commission to produce and publish a final report. [SEP] an injured man killed in a blaze at two houses in the street on tuesday night was reported by police as " [SEP]
+
+===== sample 023 =====
+[CLS] said it was satisfied there is a " public interest " in the patients ' safety. [SEP] the report says that too many children take such trips to a school, with almost two thirds of primary schools aged more than 16 taking two and seven more children at the time the tests appeared on the local primary education system. [SEP] half of the prisoners were reported to the authorities, according to the spokesman. [SEP] during a senate hearing for mr. biden, he said he no longer believed that many members of the committee should be counted in his life. [SEP] she also produced a new first act in the talent show. [SEP] in the 1960s and [SEP]
+
+===== sample 024 =====
+[CLS] police. [SEP] ms davies currently appeared as a solo vocalist at the national symphony. [SEP] mosley has used all but the rest of his playing career during his five seasons to secure his first - team place with the national team. [SEP] at other points, fukuda attacked lee ' s support of south korea as a safe place for terrorists. [SEP] the ugandan branch of the ugandan national tv association still has a trading relationship with the phone for only two days, and a new zealand tv provider will offer $ 1. 5 for a monthly fee. [SEP] two boys aged 15 and 10 - year - old girl are arrested on suspicion [SEP]
+
+===== sample 025 =====
+[CLS] 00977 ( international or 1 - 800 - 703 u. s. calls ), or by dialing + 800 - 800 - 845 - 975. [SEP] wiltshire police have warned anyone who was in the car to make it a " safer vehicle. " [SEP] a national trust public inquiry was formed into the matter after the man ' s death last year. [SEP] a private funeral service has been held in the town to mark the start of the assault. [SEP] he was inconspicuous to the boys - - he is the boy sitting in his room and starts sneaking him into the room in his family - - [SEP]
+
+===== sample 026 =====
+[CLS]pc decline in net profits during the trading after the company said that it would have to buy $ 800m of shares for $ 6bn on the back of its recent book - loss of $ 399m. [SEP] underlying profits fell to £14m per share for the first three of a year because of recession. [SEP] but it was 5 - 1 in beijing. [SEP] i tried to do it again. [SEP] this week ' s eight - day event, which costs $ 1 million per person, makes less than $ 1 million a month. [SEP] khamashov, a five - year president of the union, accused of running [SEP]
+
+===== sample 027 =====
+[CLS] [SEP] they proved her, she had made a real issue for the show, and put her on the air. [SEP] the times said the trust wanted a review of the new rules, but that were unlikely by the end of the commission ' s report, which will take this month. [SEP] officials said he received a camera and other equipment worth more than $ 30, 000, the austin ( texas ) - times reported. [SEP] the driver will receive a video camera from police before making their way to the compound. [SEP] his son, to be sure, long ago, was working in the gas fields. [SEP] it is only 20 minutes of [SEP]
+
+===== sample 028 =====
+[CLS] - finals. [SEP] the 35 - year - old was also named in the squad that went to the world championships and the olympic finals. [SEP] no matter, officers found the shooting suspect. [SEP] the former striker had held the job previously, as inter finished their first 11 months of having won their opening three matches, but this time they were at home after only three months at villa. [SEP] williamson, 56, became co - president of the university ' s college medical board in 2006. [SEP] it also changed his character. [SEP] richard coleman, a forest service spokesman in moorland, colorado, said the agency would be issuing an alert to [SEP]
+
+===== sample 029 =====
+[CLS] their lives ended in a state of fear - - but a fear of their death. [SEP] murray didn ' t reach the final set until beating rafael nadal, and replaced stammer in the subsequent first - round robin match. [SEP] the sub - bridge was closed to traffic until between 2200 and 1630 gmt, but the lorry section reopened at 0330 gmt and roads were closed at 08450. [SEP] the ' united states economy ' after 1980 ' s enjoyed its fastest growth since 1996. [SEP] mr solanki has worked hard ; he started recently. [SEP] a former member of the board of the department of [SEP]
+
+===== sample 030 =====
+[CLS], ballet, football, tennis and tennis, but what ' s the option? [SEP] and he was told by her, by the boy ' s 30 years later, that he was better off than the king. [SEP] president musharraf has installed the president of parliament as his replacement. [SEP] various reports, however, have been published by state media, saying the panel that prompted the inquiry would have to allow authorities to determine whether his wife was not on a flight. [SEP] dr edward kennedy, 79, the director general of the university and university society of england, had asked the committee to give their case to richard, the former [SEP]
+
+===== sample 031 =====
+[CLS] mice in a laboratory laboratory, where the levels of the chemicals were high in inducing patients to have high levels of energy. [SEP] obama pulled ahead of john mccain this week but his republican presidential primary set off a terror threat against him. [SEP] rooney was at his post in the second, giving them added entrae to their fifth league win of the season. [SEP] a few minutes, add coffee and water to boil, and that ' s not enough. [SEP] the death over the course of three months is only the second year of a death by a coroner. [SEP] this requires shareholders to consider the abortion of the board positions and [SEP]
+
+===== sample 032 =====
+[CLS] its military leadership during the political turmoil. [SEP] mr mcilvy has claimed mr straw ' s decision was based on his case. [SEP] the farm sector has laid off at least three of the rest of the year, and lost 35, 000 jobs in january, compared with three months ago of 58, 416, the survey said. [SEP] to date, no deaths caused by the disease are linked to the seasonal flu, which have already been made up by a common seasonal flu, in the winter of flu and the virus, to minimise the severity of its spread. [SEP] but, according to the daily news, he argues, [SEP]
+
+===== sample 033 =====
+[CLS] information not to be made in place of their judgment in connection to the police inquiry. [SEP] ( ap ) - president robert kennedy and former vice president david mceven plan on laboring their fight wednesday to broker a healthcare deal. [SEP] new zealand have not come too far from the tournament after winning six of their last eight, but at least the united states. [SEP] well, ever since there have been left over. [SEP] mr green was given evidence to the police by mr phillips, who said the " serious decision to issue a criminal warrant was a significant break " in the legal case for a public inquiry into the terms of the report [SEP]
+
+===== sample 034 =====
+[CLS] [SEP] " it seemed there were a number of people out there saying we were sitting at the bar with a friend, " said hamlin. [SEP] the country ' s deval budget, meanwhile, urgently needs about $ 6. 1 billion a year, but most of the children in this year ' s budget get final treatment. [SEP] mody is part of the british football squad youth team and has been named as a likely player for scotland since december 2007. [SEP] " the federal court is violating a state law that barred the reading of a hunting law without a state ' s consent. [SEP] after a long, sometimes long war, [SEP]
+
+===== sample 035 =====
+[CLS] the world. [SEP] this did not involve any increased activity in the muscles as a part of the body ' s electrical structure. [SEP] but a judge ruled on monday that there were no differences in the fact that, within two days of his current release, the prisoner would have been eligible for immediate release. [SEP] in the past few weeks, the government has backed the scheme directly, calling for a return to a second choice of mortgage to replace loans made on a mortgage. [SEP] the board members are encouraged to take shares. [SEP] the company reopened in may after making an application on an untested application by the company. [SEP] as for [SEP]
+
+===== sample 036 =====
+[CLS] s. defense secretary robert gates said sunday he did not think u. s. troops might pull out of the military offensive in afghanistan because of the turmoil after the elections. [SEP] that may be the problem. [SEP] ryan reid, 19, 19, of coventry, was killed on saturday. [SEP] she also will have joined helen, grant, edward jones and jackie robinson as the last five winners of honours for her film, including the revival in a classic tv production. [SEP] king john c. kennedy, who in 1982 won the world ' s highest medal of human rights, died in 2007 at the age of 60. [SEP] mr wild was [SEP]
+
+===== sample 037 =====
+[CLS]. [SEP] nottinghamshire police said " it is believed that brown was not the main victim of this murder and officers found the victim of drink - driving. [SEP] while many patients are able to receive treatment, almost all are found to have been asleep when they are home, said hospital officials. [SEP] the euro fell to $ 1. 9203 yen and $ 1. 854, up from 1. 933. 95, compared to 0. 9204 pounds late on friday. [SEP] during that, all buildings that had been mortgaged were for value obligations. [SEP] he said the incident was not part of the investigation. [SEP] some [SEP]
+
+===== sample 038 =====
+[CLS] the best part of his life at home and his kids at school, but that his police will not arrest or search his students one day in the same week. [SEP] although opel, the world ' s second - largest maker of luxury cars, failed in cars and trucks for the year, sales rose 2. 8 percent, in the second quarter, despite a 3 percent profit drop compared with its figure in the same period the previous year. [SEP] the national army and air force said its soldiers had detected the explosion, but said it likely occurred on the outskirts of tewud gar, north of kabul. [SEP] matthew and father [SEP]
+
+===== sample 039 =====
+[CLS] of the mortgage interest bill, which could rise to 6. 5 per cent growth, are unlikely to have been affected by inflation in 2010, according to a bank of england monetary fund. [SEP] he said bp had used £1. 6 of the market every day for about a billion worth of tankers six years ago, and it had debts of tens of millions of dollars. [SEP] " the life on earth doesn ' t drive us up long until we rise again. [SEP] " we believe the protocols have been adapted and adapted to ensure patient safety and increase safety. [SEP] coffey also served on the university ' s investigations team in 1996 and [SEP]
+
+===== sample 040 =====
+[CLS] threat of weather warnings starting to grow more storms in the united states, experts say the storms are expected to kill at least 20, 000 people in europe and nearly 7 million people in britain and the world. [SEP] medvedev, nato ' s former president, was appointed sacked and in november 2007 won parliamentary backing for the province. [SEP] this was also not an issue. [SEP] the french center has been limited to 22 points in what is his last game. [SEP] anderson, who also came in at the start of his campaign as the leading man for the second world title last year, has won his 80th test after winning 18 games [SEP]
+
+===== sample 041 =====
+[CLS] gas stations. [SEP] a total of £1. 5 million homes had been built, and approval prices for new homes fell, rising by 31 %, to a record annual rate of almost £2 million, figures show. [SEP] he faces a formal hearing in the court after he denied having a relationship with the girl. [SEP] i get estate worth worth $ 100 million ( about $ 100 ) and worth about $ 100 - $ 200 ( £6. 97 billion ), $ 3 billion ). [SEP] the fact, " house of the sky, " a stunning venetian installation shot in the 15th century, is almost a world down the coast - a [SEP]
+
+===== sample 042 =====
+[CLS] by mps on the rules for mps ' pay and the government has been expected to rule on holding an election on reform of the treaty within four weeks because the move is expected to trigger a sitting majority in the next parliament. [SEP] he can do this in the way i am thinking of it every day. [SEP] in contrast, the cost of each room was £12. 99 for three bed and breakfast available ( £78 - £15 / week ). £69. 99. [SEP] john mccain was staging a morning rally at the house on the street in front of san angelo, a town of about 700. [SEP] but the [SEP]
+
+===== sample 043 =====
+[CLS]. [SEP] clearly, it ' s not similar to that in other parts of the world. [SEP] people who try to buy presents may be hard enough to resist, but it is too early to go down the traditional buying route, and drive up the price in future. [SEP] in my case, the couple would probably end up spending a year on a beach. [SEP] however, the committee has ruled that the bank should make a " thorough and strategic review, " which the letter says, from a senior executive, would try to qualify for a higher position as it would be a chairman who acts more effectively than usual in the circumstances. [SEP] [SEP]
+
+===== sample 044 =====
+[CLS] and they had pretty much emphasised the moment of night. [SEP] the committee also said it " believed its demand to abide " by the rules meant that " although the independent panel is not considered to be effective, therefore, further action should occur if the internal levels of the inquiry are deemed to improve. " [SEP] this morning, when attorney general a. b. i. cuomo, mr. cuomo and his attorney said that no one had been met with anyone who allowed a special criminal investigation to sneak out of albany. [SEP] now it ' s a week, north of the iraqi border. [SEP] while the fbu calls [SEP]
+
+===== sample 045 =====
+[CLS] public news organizations, including rtl, the sunday daily, which also has reported television and public comments about her mental health. [SEP] the chairman of the senate ' s intelligence, joe lieberman, r - mich., told cnn that as the author of an energy bill, he also assumed that president george bush would be " the first " democrat to sign the legislation. [SEP] he said : " without further incident, the incident took place in the street. [SEP] gary hooper came in on the wing and dived on to his replacement, stephen jones, who was struggling to make up the goal. [SEP] in a history of trial [SEP]
+
+===== sample 046 =====
+[CLS] cover of the paper, which is still mired in editorials about its old paper existence. [SEP] james o. m. cuomo, the head of the m. b. b., is a former attorney who was appointed as attorney general on september 18. [SEP] lombardi is now allied with arizona quarterback jeff brown, football ' s only other all - time rushing champion. [SEP] about 2, 000 cases a week, including 3, 000, have been made public after peaking to over 200 in april 2006. [SEP] what does marriage mean? [SEP] he believes that a strong case of that could have limited consequences between air and climate [SEP]
+
+===== sample 047 =====
+[CLS] the company and its private business as a result of its pension problems, a company which has lost 560 jobs since joining the mail in 2001. [SEP] the times speaks four times, and says it is prepared to sit out of its meeting all week but may not see an answer in the fall. [SEP] his force officers are not acting as it relates but colleagues in the unit will co - operate this investigation. [SEP] hundreds of calls are being made public about whether people should get immunity with h1n1, while the scottish government insists healthy people are no immunity for new h1n1, the health register reported. [SEP] but " the [SEP]
+
+===== sample 048 =====
+[CLS] sending him a question on the whole search process as he describes the " period of horse - trading. " [SEP] she also said the current situation meant there would be " irresponsibility in the media. " [SEP] new york ( reuters ) - yahoo inc ' s stock unit posted $ 15 billion in third - quarter profits, helped by a $ 900 - million charge on the buyback of shares of its stock, aon said wednesday. [SEP] in those days of political talks, of course, no one will get a call. [SEP] he says that is a tough call, but he hopes to drive in a few years. [SEP] [SEP]
+
+===== sample 049 =====
+[CLS] tax profits including a £25m increase of £35m. the book of acquisition of british national savings bank ( rbs. l ) is expected rise to £670m, also higher than profits. [SEP] that ' s up five, nine times its rate in the last three months. [SEP] she is accused of briefly working as a receptionist at a hotel, making no training. [SEP] the taliban have built their formidable insurgency attacks from the small city since the afghan national army took control of the surrounding district in 2001. [SEP] this appeared to be an important order, but it wasn ' t for most of us now. [SEP] in [SEP]
+
+===== sample 050 =====
+[CLS]. [SEP] several other people were injured after the killing, police said. [SEP] the office for national statistics reported inflation down to 5 % in a month last month. [SEP] metropolitan police officers have found out a video of the incident in stockdale, north yorkshire. [SEP] new york ' s sales fell by 8. 3 % in october compared to last year, the biggest monthly decline since washington recorded a large increase in national foreclosure activity. [SEP] her five - year - old son, paul, of norfolk, and her husband, michael smith, were found hanged in the same room. [SEP] mr. browder said, however, [SEP]
+
+===== sample 051 =====
+[CLS]ers were the most vulnerable. [SEP] " based on their second - half performance at the finals of world cup, they ' ve been fantastic, " he said in a news interview. [SEP] fort collins police said the suspect in the shooting, who was 16 or 21, was being held in the pinellas county jail on saturday. [SEP] other council members have called for new elections, observers say. [SEP] he is just one of 15 million who have been born since the civil war. [SEP] he led the game with nine points and ran in one of the longest running touchdown drives in franchise history. [SEP] " i have no intention to play against [SEP]
+
+===== sample 052 =====
+[CLS] said. [SEP] there are two of the fastest - growing lifestyle myths : that you can ' t get drunk by drinking, and even a beer when you can feel very uncomfortable. [SEP] this time, it can hit only about half a second. [SEP] that ' s a myth. [SEP] that is the cost of university fees. [SEP] " we believe emergency calls were taken immediately before the incident. [SEP] of those there are at least £4. 2bn in the red, with at least £7bn ( £2bn ) over the lifetime of retirement - funds valued at at least £15m and those worth more than £4. 6 [SEP]
+
+===== sample 053 =====
+[CLS]. [SEP] in 1998 chief executive sir john blavine, the finance chairman, became the bank ' s chief executive officer. [SEP] japan ' s anthony kim birdied the final two holes to finish on 70 for a six - under 66 and three back on joint second with match - up leader peter hanson and defending champion ben curtis in a five under total of 135. [SEP] according to the local police, the group has become a viisance during the four - week trip. [SEP] according to bbc america, a company of news corp, fox and the bbc, broadband worth millions of pounds as part of its broadband service. [SEP] he is [SEP]
+
+===== sample 054 =====
+[CLS] charges, was questioned by a judge monday whether they will be considered for custody in connection with the case. [SEP] some people remain in the hospital, the spokeswoman said. [SEP] the man was seen swimming around a virginia beach and then driving north of reno shortly before 5 a. m., the king county police said. [SEP] jones was banned from the track for four races this season, after having her three - year olympic ban imposed in october. [SEP] electronic games company is the leading leader in both video and online video games for the world. [SEP] however, he once admitted it would be difficult for patients. [SEP] some 35, [SEP]
+
+===== sample 055 =====
+[CLS] it had decided to sell north american operations and to re - pay down debt. [SEP] at least 38 people died - - 10 were injured, according to the television reports. [SEP] a number of crews were deployed during operation panther following a rescue operation in early 2007. [SEP] authorities said two police officers then fired a shot outside the house and killed her. [SEP] you start with an ins insurance company who ' wants someone ' s health insurance and pays off the time. [SEP] as speaker, sir john stevens, the assistant chief of westminster, is the author of a book report for the speaker. [SEP] revenues also fell during the christmas trading period in [SEP]
+
+===== sample 056 =====
+[CLS] sabotage, or breach of law. " [SEP] " to ask if they can make their lists so they can ' t make taxes, ask them to give all the distorting information to a person who ' s in the limelight. [SEP] the company said it had " full potential " to take up a portion of its $ 240 million to $ 150 million. [SEP] in 2003, the air force gave up a survey of kennedy space center in washington. [SEP] as such there is unease that the government could face the prospect of running into a war with the government. [SEP] " it ' s just once in a long week, " says [SEP]
+
+===== sample 057 =====
+[CLS] public office space, the national sports center and arts centre, and the construction of nearby parks and schools to popularise its large urban population. [SEP] if you can get ahead, or just live longer or get too short, exercise regularly. [SEP] the company also also increased its outstanding 877 shares at last trading friday, on march 31, when it was trading at $ 1. 10 a share in the first five days. [SEP] the jail chief was ordered to death by county investigators. [SEP] in the early years of the vietnam war, the u. s. military academy, for instance, questioned whether an army would be part of the [SEP]
+
+===== sample 058 =====
+[CLS] picture of the house ' s conditions. [SEP] so far, mr. musharraf has been on a caretaker schedule ; it is expected to take effect as soon. [SEP] and there ' s a pretty little fear about commenting on any aspect of ms. palin ' s plans. [SEP] the wachovia industrial shares had lost 15 percent to close at y9. 70 and close at y236. 80. [SEP] standard chartered bought a 60 - 50 per cent share of hbos last year and raised an additional won1. 2bn in the recent rights rights issue. [SEP] " then i feel great - he can even [SEP]
+
+===== sample 059 =====
+[CLS] wife, hannah rohme, a former finance manager for the former senior vice president and vice president, brokered the deal. [SEP] of the teachers, the national association of teachers said 81 percent said they are raising children. [SEP] passengers can go to virgin 0845 01074 ( 022 4568. com ), 0877 493 90386, bachaus ( 083 636 7997 ), or english 1 800 8002 for additional information. [SEP] some had left school, and they have not. [SEP] the first lady was to be the winner in august. [SEP] gordon davis is [SEP]
+
+===== sample 060 =====
+[CLS] that shows it has widespread and popular support in the country. [SEP] the review of the system was launched on friday night after martin johnson, the director of the police service, said : " when he is caught, the owner of the phone doesn ' t pay, as he is not bound by the rules. [SEP] my son, however, could not. [SEP] however, police said they were not aware that any firearms had been lost in the previous operation. [SEP] he was elected as rector of d. roosevelt university in 2002, and was made president of the church of england in 1997. [SEP] while a proposed human rights commission limits the number [SEP]
+
+===== sample 061 =====
+[CLS] of other teachers and students at the right levels are able to avoid long - lasting conflict, while many teachers fail to think of their own experiences in the classroom. [SEP] mr starkey became an assistant principal at the national theatre company, but now he has taken a part in several productions which have taken him three weeks of the course. [SEP] now the fed rate cuts have the fed lower its rate of meeting in january. [SEP] 6 - - the report follows a senate committee report released sunday that attorney general eric schadr improperly made his call for war in iraq. [SEP] his focus will be on people ' s performance and the results [SEP]
+
+===== sample 062 =====
+[CLS] after pakistan ' s supreme court suspended president, gen. pervez musharraf declared an election law law, saying he will continue as chief justice. [SEP] this case is only one of its kind at the royal society. [SEP] now, it ' s supposed to be a " mussy, " live " game in a typical cold weather. [SEP] but musharraf declared that extending the warrants was not considered high enough. [SEP] i ' m in the district. [SEP] despite the controversy, may said he believes bolt has not created a back - end formula to make the men ' s race. [SEP] he should have [SEP]
+
+===== sample 063 =====
+[CLS] be a good feeling. [SEP] just three years ago, he received a doctorate and was suspended from the school in january. [SEP] and the appeal of the appeal court has ruled that it could not not be completed without a trial - - and therefore the costs of the case. [SEP] but britain says the law was changed, giving british troops the right to seek to appeal life in judicial cases in other countries. [SEP] she was later pursued by a police officer who reportedly was later shot. [SEP] he said that spending before the planned general election would be held until 2010, one week after the election should take place in june next year. [SEP] in [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p12_top32_detok_raw_samples.txt

@@ -0,0 +1,236 @@
+const_thrs_tau0p12_top32_detok
+{
+  "type": "summary",
+  "name": "const_thrs_tau0p12_top32",
+  "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt",
+  "step": 200000,
+  "decode": {
+    "kind": "categorical_fullvocab_final_sampling_push43",
+    "config": "const_thrs_tau0p12_top32",
+    "steps": 128,
+    "temp_start": 1.45,
+    "temp_end": 1.45,
+    "temp_schedule": "const",
+    "t_power": 1.0,
+    "eta0": 0.12,
+    "eta_schedule": "early_cosine",
+    "noise_conc": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "final_mode": "threshold_sample",
+    "final_temp": 1.0,
+    "top_k": 32,
+    "top_p": 0.0,
+    "uniform_mix": 0.0,
+    "sample_threshold": 0.12,
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 41.80839195562669,
+    "nll_per_token": 3.7330970838688944,
+    "tokens": 9725
+  },
+  "diversity": {
+    "sample_entropy": 4.204396875108297,
+    "unique_tokens": 1943,
+    "token_count": 8192,
+    "distinct_1": 0.2371826171875,
+    "distinct_2": 0.7140748031496063,
+    "top_token_mass": 0.0560302734375
+  }
+}
+
+===== sample 000 =====
+[CLS] the president will have to win in the next election. [SEP] it also announced bad results at some of the world's biggest credit - card companies and stripped out $6. 7 billion in the fourth quarter. [SEP] it can be due to the increased labour requirements and the change in demand, it says. [SEP] "we're very involved in policing schools, roads and buildings and we're working all over london to find incidents like this," he said. [SEP] i had a good record and i was doing his best. [SEP] washington - - attorney general michael ki. moon's appointment as a former u. n. [SEP]
+
+===== sample 001 =====
+[CLS] star, singer michael russell, has been asked to increase his licence. [SEP] the fall is a good time in school. [SEP] had he sent his dog to buy his own car, the money would have gone. [SEP] in an interview, a senior official said the senator had refused to accept donations. [SEP] tougher guy. [SEP] the defence said that the incident was a breach of procedures made by the ministry of defence's specialist civil investigations department in 2002. [SEP] more consumers can visit or join the website and be reached at www. medgreent. com /. [SEP] for more information on iridium, visit the data center. [SEP]
+
+===== sample 002 =====
+[CLS] wouldn't be a good idea to carry out a thorough review. [SEP] at a meeting on friday, the company's board voted overwhelmingly in support of president obama's plans in iraq for the next six months, leaving at least $200 billion over two months of war time. [SEP] no, he didn't know all the extra money. [SEP] the proposed changes would undermine the core of the state's constitutional law. [SEP] the spokesman said both sides would defend themselves as a matter of urgency. [SEP] during these opecunic events, many teachers, teachers, teachers and volunteers accompany men to the gym, and often [SEP]
+
+===== sample 003 =====
+[CLS]swoman said prosecutors pursuing the case had no knowledge of the killings, and he might initiate a criminal investigation. [SEP] for the first time in a year, analysts have also warned that xstran may be worth more than the current $3 billion of debt. [SEP] police officers were being pushed at the door of houses where the killing took place. [SEP] it provides travel and family services run by international travel company british travel (020 78777; www. explore. co. uk), revenue & customs holidays (020 730000) and hotels and holidaymakers. [SEP] in the eight weeks since the crisis broke [SEP]
+
+===== sample 004 =====
+[CLS], oversee the iraqi security forces, and provide security for american and iraqi forces. [SEP] these could be added when they return to the commons in the capital. [SEP] "the situation is that it will be improved," he said. [SEP] "normally, ideally, people would see it later in the next month, doing it at least once a month," said johnson. [SEP] in may, bill murray voluntarily received a mental health treatment, according to a report by his north carolina office. [SEP] but eight people have been killed by police in the region. [SEP] and having won the british olympic and european cup titles in 2003, and second [SEP]
+
+===== sample 005 =====
+[CLS] civilian judges, acting as the court of appeal. [SEP] at the busy railway station, the pilot collapsed in the rain in the early hours of the morning. [SEP] i lost my job because some people just lost, "and it was followed by the long days of three to four hours. [SEP] david dungy, a spokesman for the sheriff's department, has said the prison chief believes the drug enforcement campaign could reduce the number of drug - related crime in the region. [SEP] he crawled out of the car, with his head covered in a blanket, then tried to wave it back to finish in a safe position. [SEP]" it [SEP]
+
+===== sample 006 =====
+[CLS] prosecutors in the mclelland case review the federal grand jury's findings and report into the death of stephen baker, whose body was discovered on march 2. [SEP] the government's last decision on the use of force was in 2007. [SEP] the children were taken from a school in sudbury, cambridgeshire, a week before 2200 bst that evening. [SEP] people in the midlands and surrounding areas have also taken part in extreme weather events. [SEP] it is also offering a working mortgage benefit scheme likely to cost £6 a week, starting at £345 a week. [SEP] if you can't imagine texting a baby, or [SEP]
+
+===== sample 007 =====
+[CLS] receive a guaranteed bonus of $4, 000 - - and paid full - time each month. [SEP] many fear water supplies hold up to their power facilities as they prepare for a strong storm. [SEP] i could not believe that he would ever get a bank loan. [SEP] he was fired, spokeswoman said. [SEP] " i'll tell you today, he's much more effective than now. [SEP] these institutions are not entirely strangers; they can choose their own ways. [SEP] jones said he met with the defense minister, gen. jaullah mujahid, to discuss plans to push taliban militants from the eastern province of [SEP]
+
+===== sample 008 =====
+[CLS] the shooting is more likely to be the case. [SEP] an assistant is governor of alan s. rice of minnesota and the future administrator of the commission. [SEP] on wednesday, google co inc (goo. o), microsoft corp (ms. n), google inc ( gooft. o, microsoft inc's top customer, and electric co inc (ge. nx: quote, profile, research, stock buzz) have announced plans to put net sales of $3. 5 billion into securities trading securities related to the accounting charges. [SEP] this is an entirely new part of politics. [SEP] there was a sense among the public [SEP]
+
+===== sample 009 =====
+[CLS] pakistan chief is believed to be the leading mastermind of the attacks. [SEP] but after a few weeks i stayed at my sister's home until it moved off. [SEP] sir mark, the long - retired air force officer of royal navy air, became the only aircraft carrier to have flown through the mediterranean to carry on his war plans for scotland. [SEP] posada was involved in three federal crimes, and was brought in a matter of months ago. [SEP] a month is usually "on track" for about 10 million dollars. [SEP] in 2003, microsoft refused to make a takeover bid. [SEP] the u. s. navy has launched [SEP]
+
+===== sample 010 =====
+[CLS] air, was deputy leader in russia's mi - 1 programme, and built russia's mirov ballistic missiles in addition to russia's first nuclear system. [SEP] jacksonville, fla. - the florida house said wednesday they passed a bill that ended the war four years ago, followed by a vote friday that would limit president obama's 10 - year - old build - up of the 550 us troops in iraq and 4, 000 troops in afghanistan. [SEP] district attorney william mccready asked the witness to testify in his testimony and later dismissed the suit. [SEP] in iowa, 34 per cent of democratic voters in the state [SEP]
+
+===== sample 011 =====
+[CLS] bank had not paid in mortgage charges, it was thought it would pay back about £54m in the quarter, which is due in full 2010. [SEP] i flew back to miami on an airlines flight. [SEP] the metropolitan police force has been investigated by three detectives and two other police officers in connection with the investigation. [SEP] the former republican presidential nominee often said the 2008 democratic presidential nominee was the father of u. s. president george w. bush's failed campaign. [SEP] it has been decided that stock, which may be worthless, may have been short - selling ordinary shares. [SEP] they cut off our electricity. [SEP] i ' [SEP]
+
+===== sample 012 =====
+[CLS] 17 minutes remaining. [SEP] he also began working on wednesday and is mailing an internal psychiatric report. [SEP] the taliban have said in a statement following a meeting between the top leaders of the international human rights committee and the human rights council that there would be no international charges of violations against civilians. [SEP] b - 3 did not answer telephone calls for this article in april, the washington tribune reported. [SEP] but he is probably likely to find ground. [SEP] this ice will melt, and this won't be for long until you get water. [SEP] " the difference between being a husband and being a mother now is clear. [SEP] but what [SEP]
+
+===== sample 013 =====
+[CLS] slomping down the street for a coffee lunch. [SEP] on saturday, fa executive chairman pat wright said: "this is a deeply serious accident and she understood the allegations were being investigated by this side. [SEP] the television and radio station has also launched a local programme that includes many of its regular programmes including daytime tv times and evening and evening news. [SEP] omar al - karzai was allegedly married to his mother and cousin when she was accused of killing her daughter and then forcing authorities to kill her, her family said. [SEP] but senate aides said the department's report will not have historical significance and that" if law [SEP]
+
+===== sample 014 =====
+[CLS] a harvard student in college, was trying to come up with some sort of new idea. [SEP] nato officials said tuesday that the special representative to the u. n. security council on the 15 - nation council on afghanistan has staked the support of his staff members in a dispute with kabul over the proposed new law. [SEP] he has has been charged with blagevich's attempted murder. [SEP] in winter weeks, it was wet in the cold, but the area was infested with mud and cold soil. [SEP] " when a e - mail or email address is sent to someone at birth, which i don't know [SEP]
+
+===== sample 015 =====
+[CLS] dead body in the pool at the school. [SEP] he joined the board in may 1958, retiring as a graduate professor at the university's college of management, where he was named a member of harvard medical school and chairman of the m. l. a. and of the international institute for health and health policy. [SEP] "they want to... [SEP] he says that he" has a lot of great points, "but that he knows it is" very good " and does not believe this. [SEP] for all this time, it was in iceland's interest of nationalising its financial sector, and, of course, [SEP]
+
+===== sample 016 =====
+[CLS] absence of any allegations of corruption in the legal system. [SEP] during the downturn, it was unclear what his life to do with his company. [SEP] in 1969, just three years after leaving as chairman of the club, he became the first individual football figure to conceive in the club's executive management. [SEP] mr shapiro, who has served as a top banker at toyota in the past for 13 years as the chairman of the company's board, has made a $3 million management package. [SEP] it was claimed the man took the phone while allegedly sending the phone message to his wife. [SEP] " there is no sense [SEP]
+
+===== sample 017 =====
+[CLS] alaska's polar bears remain the most important source of information in the arctic area, and a significant source of the breeding population in the western arctic ice area. [SEP] soon after israel took over the presidency - - and a fifth head of state - - of the national arab university in 2005, israel's education department revoked its accreditation program. [SEP] but he has no doubt michael jones, the director of his new military team, will be meeting with the current head of the government. [SEP] officers said they took them to hospital for medical attention, but reported concerns about the identity of the man. [SEP] " it's an early day [SEP]
+
+===== sample 018 =====
+[CLS] [SEP] i was at 14, aged only 15 when i turned 15 when i was 22, and i became aware of the need for more breathing time and this was the first time i had ever seen a particular level of interest. [SEP] one good dream for parents was to arrive at a post - office breakfast in the morning. [SEP] it might now make a zero percent interest rate cut, which is already the fastest rate cut in more than half a century. [SEP] he needs to say this. [SEP] the incident was reported to south wales police in swomford road at 2200 bst on tuesday, police said. [SEP] but we ' [SEP]
+
+===== sample 019 =====
+[CLS] rise of new zealand's fast food. [SEP] in the early war his firm was based in brecon, preselbury, and it was in westminster, highgate hill and cwmbran, where i turned up in the second row of hill houses, in edinburgh in 1975. [SEP] sir paul rose was appointed chairman of the met at the age of 81 for £2. 3 million but was paid £69, 000 in salary. [SEP] there are two good things in football. [SEP] he'd scored 16 points to help seattle give the league its first win of the regular season. [SEP] pakistan's authorities are saying [SEP]
+
+===== sample 020 =====
+[CLS] public freedom. " [SEP] private sales opened last week at $12. 3m. [SEP] he said the decision before the new parliament is expected to make it a second session to parliament. [SEP] gordon - brown has been organized by the national museum of natural history. [SEP] the average rate again rises to 5. 3 points, falling to a peak of 5. 7 per cent in july, while the average rate on three year loans fell from 2. 7 per cent to 4. 5 per cent earlier in the year. [SEP] that's what is an american school of american cooking, just as it's all about high - tech [SEP]
+
+===== sample 021 =====
+[CLS] one of them. [SEP] in 1989, the kazlin democratic party of the anti - soviet union leader and finance chief, nikita khrushchev, launched a military campaign to stop attacks on the ussr in europe. [SEP] mr horwood, 29, was arrested friday, was granted bail but was released last month while the case was re - examined. [SEP] i'm a singer for several years. [SEP] 5, citing police officers. [SEP] experts say banks need to wait 10 days of payment of the cards but there may be a time when they are being forced to pay interest. [SEP] the story is still considered an accurate indicator [SEP]
+
+===== sample 022 =====
+[CLS] be able to bring our soldiers into action, "said col. david caldwell, vice chief for the u. s. air and air force. [SEP] the french army has more than 400 soldiers at more than 6, 000. [SEP] dein said:" he's an added bonus to losing his team, but he can show that it can be done with live action, especially with steven jones. [SEP] police are pursuing a call for a man's arrest in connection with the murder of the 21 - year - old briton at a police station. [SEP] gen. pervez mullen, at a news conference tuesday, said [SEP]
+
+===== sample 023 =====
+[CLS] appeared in the oct. [SEP] some nato commanders in afghanistan have asked for the speed and deployment of most of the 21, 000 troops now already there. [SEP] the teenager was released on bail and bailed out following a review of the case. [SEP] he died, in 2003, but he was never able to die. [SEP] in november 2007, reflecting abundant demand in china and india, global demand for crude products more than doubled a month. [SEP] subs: hudson, fletcher, wolsay, langfield, coker, lovenk, fletcher, baird, banks, fletcher, lawes, fletcher, coker, healy, [SEP]
+
+===== sample 024 =====
+[CLS] williams, the club's executive chairman. [SEP] more than 1, 000 women who lost weight in 2007 have been in the uk since 2000, according to a national survey. [SEP] i like the sound of the song. [SEP] the public prosecutor later refused to open the investigation, though campbell's attorney said no formal charges have been filed, the times of london reported. [SEP] a change of heart. [SEP] "we entered an open area and the driver opened a side door and then tried to get under the car as it happened while driving," he said. [SEP] the army also plans to buy about 300, 000 cases of the [SEP]
+
+===== sample 025 =====
+[CLS] by 10 per cent. [SEP] that's all even more so, in their view, as they don't speak to their children. [SEP] the lakers didn't risk a loss when andrej o, a backup who had six points in four regular seasons, took a poor win against dallas and spent at least 20 minutes sitting on his left leg. [SEP] chris snyder's two - run homer in the eighth and the first two runs made it 4 - 5. [SEP] they also help find evidence of what happened during a bonfire in the area on thursday. [SEP] he is still miles away from using the internet as a social service [SEP]
+
+===== sample 026 =====
+[CLS] up on his efforts to repeal the new people's law, which he says was never approved by the house and has said he will get the bill before christmas, but he opted instead to give up public responsibility for the election. [SEP] the local intelligence service had recently confirmed that the army in the area had killed militants. [SEP] it might not be the morning after that. [SEP] but his playing days were, for many, a clarion call for football this season. [SEP] she could also sell wineries and telephone jackpots on the restaurant's main floor in the island's northern corner. [SEP] little rock, ark. [SEP]
+
+===== sample 027 =====
+[CLS] arrested on various charges, but they did not give a further date. [SEP] meanwhile, it's not so bad that all - rounders vaughan and swaner had already had to settle for one on the second morning in the second test. [SEP] najibullah - mujahid was under surveillance when police responded to his house after surrendering to his apartment by his security forces and security services, the times said. [SEP] the public inquiry team was unable to complete a report in both cases. [SEP] an actor in india who became the world's top indian film director has taken charge of the country's budget, dropping his [SEP]
+
+===== sample 028 =====
+[CLS]. [SEP] her father was trapped in the front yard. [SEP] as the firefights started, people began beating up on the floor, hearing noises, an answer that was denied. [SEP] the group said the review would not be completed before the end of the current financial year and could be for a full year. [SEP] authorities reported the crash, 40 hours after a helicopter crash on the washington river. [SEP] it's always easy for both men to leave behind their job. [SEP] it was the first time former president nawaz sharif was available to comment. [SEP] that was to say the thrust of the series; yes, he was [SEP]
+
+===== sample 029 =====
+[CLS] are less likely to still need surgery following radical heart surgery, according to the group. [SEP] what a disgrace. [SEP] noose, the largest and most important of the leaders of the jewish state of israel, is still buried in the sanctuary of the middle eastern city of jerusalem, where st. john's was still buried long after his death in 2 1/2 years ago. [SEP] it is the final day of parliament and the prime minister's funeral. [SEP] the latest case has affected anyone under 18 and it was closed shortly after the crash incident. [SEP] (ap) - - craig johnson held up his lead and was good [SEP]
+
+===== sample 030 =====
+[CLS] and you can find us and have real fun. [SEP] the visitors again appeared to settle for a scoreless goal late in the second half. [SEP] mr winehouse was arrested in 1992 and later ran the child law enforcement office established in the 1990s. [SEP] he took advantage of his lack of vision, going back for treatment. [SEP] the case is expected to be heard before the general election in july 2009. [SEP] during the summer, he has to walk more leisurely. [SEP] the state of the afghan economy has been a key element of public support and support in afghanistan's recent election, given " today's announcement that the taliban [SEP]
+
+===== sample 031 =====
+[CLS] telephone at + 800 - 877 - 2526, or 617 - 213 - 2535. w. baird & co. interested listeners should visit the company's investor relations website (www. wthrewcorp. com) to listen via the web at 8003 - 1009 or + 919 798969 for a conference call, and enter pass code 86670998. access pass code 907771. www. dresser. net. com. is available by telephone from the u. s. relations section or calling on 0800 858989. [SEP] it was [SEP]
+
+===== sample 032 =====
+[CLS] charges, had been dismissed because of his involvement in federal criminal investigations. [SEP] the longer the military takes power, the more danger becomes. [SEP] now i don't know, but i thought it could last months and years, just in the middle of a big one. [SEP] police in the state have said they have no knowledge of his conduct. [SEP] christopher heilwood, 30, and his brother, gregory have been arrested following an incident between two youths at the store in abbey road, northampton, on saturday. [SEP] the authority said it had saved about $100m through a payment system called the public service system ( csr [SEP]
+
+===== sample 033 =====
+[CLS] murder and the assault was with one of the officers, authorities have said. [SEP] the finance ministry said the company had a plan to sell german products, but said it could put up many bidders for such brands. [SEP] but he denies that he has accused president zardari and others of compliciting in the election, and that he has not warned his citizens against raising confidence in the government. [SEP] that was an essential goal, she said, and it seemed that their relationship was taking on her new life. [SEP] 3, but the standard of living is likely to continue to drop. [SEP] it is a 50 - year [SEP]
+
+===== sample 034 =====
+[CLS] mr brown said it was not simply a very bad social housing regime. [SEP] his successor, gen mullah muzi, was promoted to power when he received a british passport in 2001. [SEP] there is also a sense that the experience of his death in the 1980s was the day of great "education." [SEP] i don't remember the music, but i listen to the world. [SEP] currently, he is a two - year member of the company's board. [SEP] born in 1992, texas tech has never been made the a. c. a. a. tournament again in three years. [SEP] bill clinton's campaign [SEP]
+
+===== sample 035 =====
+[CLS]. [SEP] we do not need a laptop. [SEP] just three months ago, johnson was part of the team that felt the problem. [SEP] " you're not able to get work, you're out of the workforce. [SEP] in 2009, gen. john gallimer and three co - defendants issued the district court order overturning the convictions of judge richard addington, who refused to testify in the case. [SEP] after the election, mr anwar announced that his brother had ended a management role in his charge of the police service of the state. [SEP] expect to see something similar again in the year, when the census of [SEP]
+
+===== sample 036 =====
+[CLS] to its requirements. [SEP] in september, japan they lost 0. 7 per cent. [SEP] they have given no details of their raids. [SEP] this is also a very serious issue. [SEP] david wilson, head of communication at the prison service trust union, said: " it's a bit of a complete loss of confidence and confidence. [SEP] the officer, who is approved by the criminal register, said that he had no disciplinary record but was unable to answer questions until after they gave access to legal advice. [SEP] in december 1981, he was appointed chancellor of the university, and later, in 1986, a regular fellow at the university [SEP]
+
+===== sample 037 =====
+[CLS] president pervez musharraf, his predecessor, was removed under an emergency army rule. [SEP] this is a good decision so that it is more clear and effective. [SEP] western officials said at the opening session that mr karzai's brother, mr al - karzai's son, the director, houthi barzani - wali was present at the time of the blast, was released on sunday, after police demanded his arrest, the dawn newspaper reported. [SEP] sir michael powell, former head of the army and navy, was once a staff member of the george w. bush administration and is now [SEP]
+
+===== sample 038 =====
+[CLS] made to land in a car driven by his brother, who was walking away when the fire broke out in an open field near the spam hotel on the wrong side of the road. [SEP] he also dismissed claims that he was not a public figure who could be thought to have claimed to have been abused by a homeless person to get his money. [SEP] great article - - and, in fact, one crucial example. [SEP] government figures say the rise in cases means record numbers of abortions have been reported during the campaign. [SEP] the national front, the pdp, has been declared the winner, and the former prime minister, abdullah [SEP]
+
+===== sample 039 =====
+[CLS] the american football association. [SEP] under the scheme, a phone company can frighten you to buy the phone that can cost you and those looking to buy a card could make a payment. [SEP] four afghan insurgents were killed in a u. s. military helicopter crash during the campaign that destroyed hundreds of thousands of civilians and six insurgents hiding behind it. [SEP] more than 10, 000 children attend high - school lunch programs, more than 200 state schools and many others are facing food bills. [SEP] a police investigation has been launched after a firefighter has died at a house in lincolnshire. [SEP] president barack obama announced comprehensive reform for the health care [SEP]
+
+===== sample 040 =====
+[CLS] finals for the first time this year. [SEP] first, this had resulted in a massive pay - out - - but it was rejected by mps. [SEP] it has cut 700 jobs in the uk between april and april. [SEP] in the early sunday, over 100 people were found in collapsed or collapsed homes and three of those missing in the northwestern town of emu state. [SEP] georgia sent two combat troops on friday, the first time some 4, 500 troops were deployed to the area after fighting broke out in april. [SEP] just a few days later kazana blara announced she was looking to use public office just a few days [SEP]
+
+===== sample 041 =====
+[CLS] court in january, and one of two charges was dropped. [SEP] she has read this. [SEP] he already lives in alaska. [SEP] the australian funds rate, including bank rates, hit a five - year high for the dollar, which closed 0. 75 per cent lower at 0. 7 per cent on thursday, after dropping below 5 at an 18 - month high yesterday. [SEP] residents can call 0800 984 - 0830, and offers free £11 - a - day parking. [SEP] the u. s. military on friday accused the nato - led force of staging an air assault sunday night, saying it would send a heavy [SEP]
+
+===== sample 042 =====
+[CLS] a big - screen show at the american pictures international film festival. [SEP] the legal authority developed by lord sir john burrell, who was appointed and by appointment as a deputy commissioner in 1992. [SEP] american michael phelps won his world record with an incompetent run in the 200 meters last night. [SEP] a few years ago, word emerged that blagojevich had launched a facebook campaign to raise money for the service. [SEP] " i have made only one loan in five years. [SEP] this came after a teenager was also jailed for investigating the shooting of a woman in the dundee area. [SEP] the plan for the conservation area includes [SEP]
+
+===== sample 043 =====
+[CLS] has left town. [SEP] she had no regrets, but her up - and - down routine was not quick enough. [SEP] "it was too thick, he could not swim out because he was in the pool nearby. [SEP] sir bob woodward, the force's chief forces officer, said he had hoped to issue a schedule for deployment in april. [SEP]" those who know if there is any substance to this type of information were asked to back up up, " he said. [SEP] all are good, and are asked to give customers a number of help they really feel they might need or need it out. [SEP] authorities have said the [SEP]
+
+===== sample 044 =====
+[CLS] after allowing him to exchange text messages during his prison days. [SEP] the pandas will travel to american zoos during and after the season. [SEP] by the time he got his interview, he had helped his family and friends across the world. [SEP] his wife and children were also questioned for links in the investigation and he in aruban custody. [SEP] the chinese government said it issued $1. 7 billion of gold on its reserves as china, the world's second - largest economy, reported a five - year - long decline in gold reserves on friday. [SEP] under a five - year deal in which the club will receive £3 [SEP]
+
+===== sample 045 =====
+[CLS] $80 to $90 per month. [SEP] his high - ranking deputy, circigio berto, said that it was not necessary for constitutional renewal of power in the country's parliament, seven years after mr. morales was suspended, offering all his colleagues the job. [SEP] there's also the growing range of local barbecue and pasta salads. [SEP] officials from the united nations, nato, china and russia each voiced their concerns, and last week u. s. sen carl m. levin (d - mich.) said that it was time for barack obama to take his post as president. [SEP] he was [SEP]
+
+===== sample 046 =====
+[CLS] to adapt, and a growing number of foreign workers has been eliminated through the recruitment process. [SEP] the bank paid the bonuses this year with total bonuses of $100, 000 and the current bonus package worth $250 million. [SEP] and he too has been advised to find that his family is out of control because of its problems. [SEP] gordon smith, who was the us commander in iraq, says he believed his country was responsible for their deaths. [SEP] a spokeswoman for its petrochina unit said that "direct complaints" were not made and the plant's co - operation had to be closed. [SEP] a strasbourg court [SEP]
+
+===== sample 047 =====
+[CLS] 2, 0 - 9 in the world cup games. [SEP] more than 100, 000 people died in a major earthquake off the coast of mexico in 2005. [SEP] the application is also being submitted to the meeting and the parliamentary health committee. [SEP] "we have already taken the measures to ensure the spread of flu is linked to improving care," the hpc says, adding a further analysis is being carried out and the rest of the outbreak is likely to be confirmed. [SEP] he and his men served in the regular army and were sent to their homelands in iraq. [SEP] president obama pledged that he would consider whether to accept us forces [SEP]
+
+===== sample 048 =====
+[CLS] local and state sponsored public schools in phoenix, los angeles and chicago. [SEP] the case should be closed before dec. [SEP] a trial heard that he had been rejected but was quashed for three months. [SEP] at the top of the taliban, they face the battle with afghanistan's pashtun in the south. [SEP] "our manager's job to determine how it all happened to us," he said. [SEP] as one collector notes, "he's kept going away for just about five years," he said. [SEP] the brazilian later returned to action as the second half played five minutes and seven minutes. [SEP] [SEP]
+
+===== sample 049 =====
+[CLS] find homes, go out of business and take a hike into the second - quarter comfort zone. [SEP] investigators were later told to give a police interview. [SEP] that will make it even harder to vote in future elections. [SEP] he became a sensation and was nominated for the award for natural science in a fellowship at the national academy of sciences in london. [SEP] palin, sarah palin's 2008 vice presidential pick, launched a special inquiry into gov. palin's selection as the presidential candidate, almost three years before the end of the summer. [SEP] starting at 15, mayes joined a group of u. s. sailors [SEP]
+
+===== sample 050 =====
+[CLS] as she said they had not heard of them. [SEP] a justice chief, deputy head of the domestic state committee and chief of national affairs were present when mr biden's speech was heard. [SEP] but mr manzanga said the current plan to legalise the practice is unsustainable. [SEP] bartoli is the no. 1 player to make the top three after last having to play first in the under - 21 open in april. [SEP] she met her husband when she had suffered from terminal cancer. [SEP] jones limped to a 2 - 3 fifth inning after losing control in the bottom. [SEP] grey's " x [SEP]
+
+===== sample 051 =====
+[CLS] station, is to appear in magistrates' court after an anti - drugs programme last week, with ms ross saying she wanted to drop out of the cast of the tonight show. [SEP] " the first half of the year in 2008 had two quarters of negative economic growth in this recession. [SEP] let's not forget whether he would coach the team when they reach the nfl championship. [SEP] the inquiry report also calls for a new public standard for takeovers. [SEP] what we will all know is that at £35, a week, he was being denied, at the age of 50, an early pension and decent home pay. [SEP] the [SEP]
+
+===== sample 052 =====
+[CLS] [SEP] the cause of the outbreak, so far, is still providing details about the state of the supply, he said. [SEP] seven days later, he became the longest running fiction writer for television. [SEP] he has been jailed in the uk after the election in 2001, and agreed to release under the law of torture. [SEP] brian billiton, who entered the final three races in a row, was in the field along with johnson. [SEP] he said there will be no increase in the annual tax rate for five months. [SEP] then i'm more likely to have been hit more than i ever thought. [SEP] the study also found [SEP]
+
+===== sample 053 =====
+[CLS] provide the final scoring opportunity in the 47th minute. [SEP] he says he hopes his client will sue the government so that they can do the same. [SEP] it's like a movie she's made. [SEP] he also asked john mcguinner, the scottish government's executive director, to set up a trust fund of more than £20m. [SEP] south africa will make their third tri six nations with a 32 - 17 win over new zealand, and will face the u. s. in june. [SEP] wal - mart was cautious after tuesday's fourth - quarter performance. [SEP] but if a baby dies a few [SEP]
+
+===== sample 054 =====
+[CLS] percent over last year, in a year - earlier period when it stood at 2, 661. [SEP] meanwhile, the european central bank kept the main interest rate at its lowest level amid concerns of the high inflation in the euro zone. [SEP] it said its cost rise was nearly 6 %, which rose to 1, 300 in 2006. [SEP] notes: joe johnson has seven points. [SEP] that way, power to a new government, or any state, should be appointed. [SEP] he had already received a letter from the public health service's office and told officials about the existence of the plans. [SEP] the security systems were put off [SEP]
+
+===== sample 055 =====
+[CLS] douglas huber and kevin spacey. [SEP] tomlinson, who lives in the maradona living room, asked what attracted his concern. [SEP] it takes time to take the first few months off when you would want to have a baby in your room sitting on the floor. [SEP] the financial cost of this case is very small. [SEP] celtic association legend john kelly says he could find himself in the hunt. [SEP] as a member of the pan - american advisory committee of the national trade and energy council and its foreign trade committee, hahn - chun's comments to north american scientists have long been consistent. [SEP] not so many americans [SEP]
+
+===== sample 056 =====
+[CLS] months. [SEP] in line with the national service's plan, announced in april, the bbc is to be offering up to 1 million per - minute programmes for about 10 % of the digital audience. [SEP] the chief of police and chief of the national human security division, mullah mohammad qalinaza, were also wounded. [SEP] every year, while around 7, 000 americans die, there are now nearly 3. 9 million deaths per person, according to britain's institute of public health medicine. [SEP] he told police that the tape was a threat to one of his children. [SEP] mr. dean was not released named, [SEP]
+
+===== sample 057 =====
+[CLS] jail after serving nine months and a half of his sentence, and suspended for three years. [SEP] although, after serving in power in the late 1980s, the british officer joined his unit in august 1975, while mr colle had spent nearly 30 years in the royal armoured service division, he was involved in the mid - morning operations and late - night operations of the military. [SEP] it appears there are people working at other sites on the channel island. [SEP] the other young man was trapped on the house's roof. [SEP] mccain has moved on, and he has never been a candidate in the fall. [SEP] but it gave him the [SEP]
+
+===== sample 058 =====
+[CLS] the money went down. [SEP] the board was due to vote on this issue next january. [SEP] the pakistani government has denied opposition claims that western forces are pursuing the taliban in a major border clash. [SEP] i feel very happy to make them no more. [SEP] they don't know - - or can't have kids when they want to. [SEP] it is an attempt of a sense of purpose that is part of the european parliament within the european convention of human rights. [SEP] one of the good books, "war on evil." [SEP] "you can see i had the car down on the back to myself. [SEP]" when [SEP]
+
+===== sample 059 =====
+[CLS] staff, met mr. bush in january. [SEP] please, avoid the adulterous garb. [SEP] last year's pre - tax profits fell more than 9 per cent as a result of a weak yen, led by weaker demand. [SEP] this is currently at about £300, 000 a year - - a profit of around 2p a day on a year ago instead of the 40p pay of £7. 8 billion. [SEP] police released a short - range missile and a local television station reported that two militants had been killed in the latest rocket attack. [SEP] consider the world's new best - in - class car [SEP]
+
+===== sample 060 =====
+[CLS] t get enough to be angry, "he wrote in his book, four days before he took a journalism course, declaring that an e. o. k. mandate would make the difference. [SEP] the u. s. - led coalition says at least 20 militants, most of them children, on both sides and the u. s. military said several taliban fighters were killed. [SEP] the militants' forces lost their way, and the army said a soldier was killed when insurgents launched a land mine in the area. [SEP] i only went to the garden, and must have heard the french phrase," long gone. " [SEP] in a [SEP]
+
+===== sample 061 =====
+[CLS] and several years after his parents were involved in the crime - - disappeared for six hours on 23 may 2007. [SEP] three of them spent 15 years in britain's air force prison system and there was no indication that any changes in the command of the forces were made by bush because of his concern over the operational nature of their actions. [SEP] the social security and welfare services are expected to be discussed in the european parliament. [SEP] "despite the fact that the base rate has risen, helped by recent rate cuts, the current base interest rate is not taking any hits," said richard shepherd, the mpc's chief economist, [SEP]
+
+===== sample 062 =====
+[CLS]. [SEP] appearing in a programme - programme on bbc's morning live, mr morgan compared the achievements of sir james when he was a deputy bbc northern ireland in the 1990s. [SEP] several people were evacuated on other days of the course, she said. [SEP] the former episcopal school of meningia and king's college of new church in inverness and king's church is to be sold as part of the reorganisation of the national anglican church of scotland. [SEP] the two victims were later killed in an accident in france and spain. [SEP] they said six people have also contacted police to make dna evidence for him, and he is asking [SEP]
+
+===== sample 063 =====
+[CLS] 1968, died and was again five days later, appearing on the bbc programme for a series of non - programmes. [SEP] if your father had a problem with my son, why didn't he choose to do the thing? [SEP] boston won the pac - 10 series for the first time since 1992 before winning first - round games in chicago. [SEP] but mr. finke's successor, ben w. c. fleming, chairman of the bank and a member of the board, backed mr. morgan. [SEP] they appealed for help. [SEP] mr. chirac was also ousted after several years in office - - he was sworn in [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p12_top32_raw_samples.txt

@@ -0,0 +1,236 @@
+const_thrs_tau0p12_top32
+{
+  "type": "summary",
+  "name": "const_thrs_tau0p12_top32",
+  "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt",
+  "step": 200000,
+  "decode": {
+    "kind": "categorical_fullvocab_final_sampling_push43",
+    "config": "const_thrs_tau0p12_top32",
+    "steps": 128,
+    "temp_start": 1.45,
+    "temp_end": 1.45,
+    "temp_schedule": "const",
+    "t_power": 1.0,
+    "eta0": 0.12,
+    "eta_schedule": "early_cosine",
+    "noise_conc": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "final_mode": "threshold_sample",
+    "final_temp": 1.0,
+    "top_k": 32,
+    "top_p": 0.0,
+    "uniform_mix": 0.0,
+    "sample_threshold": 0.12,
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 41.80839195562669,
+    "nll_per_token": 3.7330970838688944,
+    "tokens": 9725
+  },
+  "diversity": {
+    "sample_entropy": 4.204396875108297,
+    "unique_tokens": 1943,
+    "token_count": 8192,
+    "distinct_1": 0.2371826171875,
+    "distinct_2": 0.7140748031496063,
+    "top_token_mass": 0.0560302734375
+  }
+}
+
+===== sample 000 =====
+[CLS] the president will have to win in the next election. [SEP] it also announced bad results at some of the world ' s biggest credit - card companies and stripped out $ 6. 7 billion in the fourth quarter. [SEP] it can be due to the increased labour requirements and the change in demand, it says. [SEP] " we ' re very involved in policing schools, roads and buildings and we ' re working all over london to find incidents like this, " he said. [SEP] i had a good record and i was doing his best. [SEP] washington - - attorney general michael ki. moon ' s appointment as a former u. n. [SEP]
+
+===== sample 001 =====
+[CLS] star, singer michael russell, has been asked to increase his licence. [SEP] the fall is a good time in school. [SEP] had he sent his dog to buy his own car, the money would have gone. [SEP] in an interview, a senior official said the senator had refused to accept donations. [SEP] tougher guy. [SEP] the defence said that the incident was a breach of procedures made by the ministry of defence ' s specialist civil investigations department in 2002. [SEP] more consumers can visit or join the website and be reached at www. medgreent. com /. [SEP] for more information on iridium, visit the data center. [SEP]
+
+===== sample 002 =====
+[CLS] wouldn ' t be a good idea to carry out a thorough review. [SEP] at a meeting on friday, the company ' s board voted overwhelmingly in support of president obama ' s plans in iraq for the next six months, leaving at least $ 200 billion over two months of war time. [SEP] no, he didn ' t know all the extra money. [SEP] the proposed changes would undermine the core of the state ' s constitutional law. [SEP] the spokesman said both sides would defend themselves as a matter of urgency. [SEP] during these opecunic events, many teachers, teachers, teachers and volunteers accompany men to the gym, and often [SEP]
+
+===== sample 003 =====
+[CLS]swoman said prosecutors pursuing the case had no knowledge of the killings, and he might initiate a criminal investigation. [SEP] for the first time in a year, analysts have also warned that xstran may be worth more than the current $ 3 billion of debt. [SEP] police officers were being pushed at the door of houses where the killing took place. [SEP] it provides travel and family services run by international travel company british travel ( 020 78777 ; www. explore. co. uk ), revenue & customs holidays ( 020 730000 ) and hotels and holidaymakers. [SEP] in the eight weeks since the crisis broke [SEP]
+
+===== sample 004 =====
+[CLS], oversee the iraqi security forces, and provide security for american and iraqi forces. [SEP] these could be added when they return to the commons in the capital. [SEP] " the situation is that it will be improved, " he said. [SEP] " normally, ideally, people would see it later in the next month, doing it at least once a month, " said johnson. [SEP] in may, bill murray voluntarily received a mental health treatment, according to a report by his north carolina office. [SEP] but eight people have been killed by police in the region. [SEP] and having won the british olympic and european cup titles in 2003, and second [SEP]
+
+===== sample 005 =====
+[CLS] civilian judges, acting as the court of appeal. [SEP] at the busy railway station, the pilot collapsed in the rain in the early hours of the morning. [SEP] i lost my job because some people just lost, " and it was followed by the long days of three to four hours. [SEP] david dungy, a spokesman for the sheriff ' s department, has said the prison chief believes the drug enforcement campaign could reduce the number of drug - related crime in the region. [SEP] he crawled out of the car, with his head covered in a blanket, then tried to wave it back to finish in a safe position. [SEP] " it [SEP]
+
+===== sample 006 =====
+[CLS] prosecutors in the mclelland case review the federal grand jury ' s findings and report into the death of stephen baker, whose body was discovered on march 2. [SEP] the government ' s last decision on the use of force was in 2007. [SEP] the children were taken from a school in sudbury, cambridgeshire, a week before 2200 bst that evening. [SEP] people in the midlands and surrounding areas have also taken part in extreme weather events. [SEP] it is also offering a working mortgage benefit scheme likely to cost £6 a week, starting at £345 a week. [SEP] if you can ' t imagine texting a baby, or [SEP]
+
+===== sample 007 =====
+[CLS] receive a guaranteed bonus of $ 4, 000 - - and paid full - time each month. [SEP] many fear water supplies hold up to their power facilities as they prepare for a strong storm. [SEP] i could not believe that he would ever get a bank loan. [SEP] he was fired, spokeswoman said. [SEP] " i ' ll tell you today, he ' s much more effective than now. [SEP] these institutions are not entirely strangers ; they can choose their own ways. [SEP] jones said he met with the defense minister, gen. jaullah mujahid, to discuss plans to push taliban militants from the eastern province of [SEP]
+
+===== sample 008 =====
+[CLS] the shooting is more likely to be the case. [SEP] an assistant is governor of alan s. rice of minnesota and the future administrator of the commission. [SEP] on wednesday, google co inc ( goo. o ), microsoft corp ( ms. n ), google inc ( gooft. o, microsoft inc ' s top customer, and electric co inc ( ge. nx : quote, profile, research, stock buzz ) have announced plans to put net sales of $ 3. 5 billion into securities trading securities related to the accounting charges. [SEP] this is an entirely new part of politics. [SEP] there was a sense among the public [SEP]
+
+===== sample 009 =====
+[CLS] pakistan chief is believed to be the leading mastermind of the attacks. [SEP] but after a few weeks i stayed at my sister ' s home until it moved off. [SEP] sir mark, the long - retired air force officer of royal navy air, became the only aircraft carrier to have flown through the mediterranean to carry on his war plans for scotland. [SEP] posada was involved in three federal crimes, and was brought in a matter of months ago. [SEP] a month is usually " on track " for about 10 million dollars. [SEP] in 2003, microsoft refused to make a takeover bid. [SEP] the u. s. navy has launched [SEP]
+
+===== sample 010 =====
+[CLS] air, was deputy leader in russia ' s mi - 1 programme, and built russia ' s mirov ballistic missiles in addition to russia ' s first nuclear system. [SEP] jacksonville, fla. - the florida house said wednesday they passed a bill that ended the war four years ago, followed by a vote friday that would limit president obama ' s 10 - year - old build - up of the 550 us troops in iraq and 4, 000 troops in afghanistan. [SEP] district attorney william mccready asked the witness to testify in his testimony and later dismissed the suit. [SEP] in iowa, 34 per cent of democratic voters in the state [SEP]
+
+===== sample 011 =====
+[CLS] bank had not paid in mortgage charges, it was thought it would pay back about £54m in the quarter, which is due in full 2010. [SEP] i flew back to miami on an airlines flight. [SEP] the metropolitan police force has been investigated by three detectives and two other police officers in connection with the investigation. [SEP] the former republican presidential nominee often said the 2008 democratic presidential nominee was the father of u. s. president george w. bush ' s failed campaign. [SEP] it has been decided that stock, which may be worthless, may have been short - selling ordinary shares. [SEP] they cut off our electricity. [SEP] i ' [SEP]
+
+===== sample 012 =====
+[CLS] 17 minutes remaining. [SEP] he also began working on wednesday and is mailing an internal psychiatric report. [SEP] the taliban have said in a statement following a meeting between the top leaders of the international human rights committee and the human rights council that there would be no international charges of violations against civilians. [SEP] b - 3 did not answer telephone calls for this article in april, the washington tribune reported. [SEP] but he is probably likely to find ground. [SEP] this ice will melt, and this won ' t be for long until you get water. [SEP] " the difference between being a husband and being a mother now is clear. [SEP] but what [SEP]
+
+===== sample 013 =====
+[CLS] slomping down the street for a coffee lunch. [SEP] on saturday, fa executive chairman pat wright said : " this is a deeply serious accident and she understood the allegations were being investigated by this side. [SEP] the television and radio station has also launched a local programme that includes many of its regular programmes including daytime tv times and evening and evening news. [SEP] omar al - karzai was allegedly married to his mother and cousin when she was accused of killing her daughter and then forcing authorities to kill her, her family said. [SEP] but senate aides said the department ' s report will not have historical significance and that " if law [SEP]
+
+===== sample 014 =====
+[CLS] a harvard student in college, was trying to come up with some sort of new idea. [SEP] nato officials said tuesday that the special representative to the u. n. security council on the 15 - nation council on afghanistan has staked the support of his staff members in a dispute with kabul over the proposed new law. [SEP] he has has been charged with blagevich ' s attempted murder. [SEP] in winter weeks, it was wet in the cold, but the area was infested with mud and cold soil. [SEP] " when a e - mail or email address is sent to someone at birth, which i don ' t know [SEP]
+
+===== sample 015 =====
+[CLS] dead body in the pool at the school. [SEP] he joined the board in may 1958, retiring as a graduate professor at the university ' s college of management, where he was named a member of harvard medical school and chairman of the m. l. a. and of the international institute for health and health policy. [SEP] " they want to... [SEP] he says that he " has a lot of great points, " but that he knows it is " very good " and does not believe this. [SEP] for all this time, it was in iceland ' s interest of nationalising its financial sector, and, of course, [SEP]
+
+===== sample 016 =====
+[CLS] absence of any allegations of corruption in the legal system. [SEP] during the downturn, it was unclear what his life to do with his company. [SEP] in 1969, just three years after leaving as chairman of the club, he became the first individual football figure to conceive in the club ' s executive management. [SEP] mr shapiro, who has served as a top banker at toyota in the past for 13 years as the chairman of the company ' s board, has made a $ 3 million management package. [SEP] it was claimed the man took the phone while allegedly sending the phone message to his wife. [SEP] " there is no sense [SEP]
+
+===== sample 017 =====
+[CLS] alaska ' s polar bears remain the most important source of information in the arctic area, and a significant source of the breeding population in the western arctic ice area. [SEP] soon after israel took over the presidency - - and a fifth head of state - - of the national arab university in 2005, israel ' s education department revoked its accreditation program. [SEP] but he has no doubt michael jones, the director of his new military team, will be meeting with the current head of the government. [SEP] officers said they took them to hospital for medical attention, but reported concerns about the identity of the man. [SEP] " it ' s an early day [SEP]
+
+===== sample 018 =====
+[CLS] [SEP] i was at 14, aged only 15 when i turned 15 when i was 22, and i became aware of the need for more breathing time and this was the first time i had ever seen a particular level of interest. [SEP] one good dream for parents was to arrive at a post - office breakfast in the morning. [SEP] it might now make a zero percent interest rate cut, which is already the fastest rate cut in more than half a century. [SEP] he needs to say this. [SEP] the incident was reported to south wales police in swomford road at 2200 bst on tuesday, police said. [SEP] but we ' [SEP]
+
+===== sample 019 =====
+[CLS] rise of new zealand ' s fast food. [SEP] in the early war his firm was based in brecon, preselbury, and it was in westminster, highgate hill and cwmbran, where i turned up in the second row of hill houses, in edinburgh in 1975. [SEP] sir paul rose was appointed chairman of the met at the age of 81 for £2. 3 million but was paid £69, 000 in salary. [SEP] there are two good things in football. [SEP] he ' d scored 16 points to help seattle give the league its first win of the regular season. [SEP] pakistan ' s authorities are saying [SEP]
+
+===== sample 020 =====
+[CLS] public freedom. " [SEP] private sales opened last week at $ 12. 3m. [SEP] he said the decision before the new parliament is expected to make it a second session to parliament. [SEP] gordon - brown has been organized by the national museum of natural history. [SEP] the average rate again rises to 5. 3 points, falling to a peak of 5. 7 per cent in july, while the average rate on three year loans fell from 2. 7 per cent to 4. 5 per cent earlier in the year. [SEP] that ' s what is an american school of american cooking, just as it ' s all about high - tech [SEP]
+
+===== sample 021 =====
+[CLS] one of them. [SEP] in 1989, the kazlin democratic party of the anti - soviet union leader and finance chief, nikita khrushchev, launched a military campaign to stop attacks on the ussr in europe. [SEP] mr horwood, 29, was arrested friday, was granted bail but was released last month while the case was re - examined. [SEP] i ' m a singer for several years. [SEP] 5, citing police officers. [SEP] experts say banks need to wait 10 days of payment of the cards but there may be a time when they are being forced to pay interest. [SEP] the story is still considered an accurate indicator [SEP]
+
+===== sample 022 =====
+[CLS] be able to bring our soldiers into action, " said col. david caldwell, vice chief for the u. s. air and air force. [SEP] the french army has more than 400 soldiers at more than 6, 000. [SEP] dein said : " he ' s an added bonus to losing his team, but he can show that it can be done with live action, especially with steven jones. [SEP] police are pursuing a call for a man ' s arrest in connection with the murder of the 21 - year - old briton at a police station. [SEP] gen. pervez mullen, at a news conference tuesday, said [SEP]
+
+===== sample 023 =====
+[CLS] appeared in the oct. [SEP] some nato commanders in afghanistan have asked for the speed and deployment of most of the 21, 000 troops now already there. [SEP] the teenager was released on bail and bailed out following a review of the case. [SEP] he died, in 2003, but he was never able to die. [SEP] in november 2007, reflecting abundant demand in china and india, global demand for crude products more than doubled a month. [SEP] subs : hudson, fletcher, wolsay, langfield, coker, lovenk, fletcher, baird, banks, fletcher, lawes, fletcher, coker, healy, [SEP]
+
+===== sample 024 =====
+[CLS] williams, the club ' s executive chairman. [SEP] more than 1, 000 women who lost weight in 2007 have been in the uk since 2000, according to a national survey. [SEP] i like the sound of the song. [SEP] the public prosecutor later refused to open the investigation, though campbell ' s attorney said no formal charges have been filed, the times of london reported. [SEP] a change of heart. [SEP] " we entered an open area and the driver opened a side door and then tried to get under the car as it happened while driving, " he said. [SEP] the army also plans to buy about 300, 000 cases of the [SEP]
+
+===== sample 025 =====
+[CLS] by 10 per cent. [SEP] that ' s all even more so, in their view, as they don ' t speak to their children. [SEP] the lakers didn ' t risk a loss when andrej o, a backup who had six points in four regular seasons, took a poor win against dallas and spent at least 20 minutes sitting on his left leg. [SEP] chris snyder ' s two - run homer in the eighth and the first two runs made it 4 - 5. [SEP] they also help find evidence of what happened during a bonfire in the area on thursday. [SEP] he is still miles away from using the internet as a social service [SEP]
+
+===== sample 026 =====
+[CLS] up on his efforts to repeal the new people ' s law, which he says was never approved by the house and has said he will get the bill before christmas, but he opted instead to give up public responsibility for the election. [SEP] the local intelligence service had recently confirmed that the army in the area had killed militants. [SEP] it might not be the morning after that. [SEP] but his playing days were, for many, a clarion call for football this season. [SEP] she could also sell wineries and telephone jackpots on the restaurant ' s main floor in the island ' s northern corner. [SEP] little rock, ark. [SEP]
+
+===== sample 027 =====
+[CLS] arrested on various charges, but they did not give a further date. [SEP] meanwhile, it ' s not so bad that all - rounders vaughan and swaner had already had to settle for one on the second morning in the second test. [SEP] najibullah - mujahid was under surveillance when police responded to his house after surrendering to his apartment by his security forces and security services, the times said. [SEP] the public inquiry team was unable to complete a report in both cases. [SEP] an actor in india who became the world ' s top indian film director has taken charge of the country ' s budget, dropping his [SEP]
+
+===== sample 028 =====
+[CLS]. [SEP] her father was trapped in the front yard. [SEP] as the firefights started, people began beating up on the floor, hearing noises, an answer that was denied. [SEP] the group said the review would not be completed before the end of the current financial year and could be for a full year. [SEP] authorities reported the crash, 40 hours after a helicopter crash on the washington river. [SEP] it ' s always easy for both men to leave behind their job. [SEP] it was the first time former president nawaz sharif was available to comment. [SEP] that was to say the thrust of the series ; yes, he was [SEP]
+
+===== sample 029 =====
+[CLS] are less likely to still need surgery following radical heart surgery, according to the group. [SEP] what a disgrace. [SEP] noose, the largest and most important of the leaders of the jewish state of israel, is still buried in the sanctuary of the middle eastern city of jerusalem, where st. john ' s was still buried long after his death in 2 1 / 2 years ago. [SEP] it is the final day of parliament and the prime minister ' s funeral. [SEP] the latest case has affected anyone under 18 and it was closed shortly after the crash incident. [SEP] ( ap ) - - craig johnson held up his lead and was good [SEP]
+
+===== sample 030 =====
+[CLS] and you can find us and have real fun. [SEP] the visitors again appeared to settle for a scoreless goal late in the second half. [SEP] mr winehouse was arrested in 1992 and later ran the child law enforcement office established in the 1990s. [SEP] he took advantage of his lack of vision, going back for treatment. [SEP] the case is expected to be heard before the general election in july 2009. [SEP] during the summer, he has to walk more leisurely. [SEP] the state of the afghan economy has been a key element of public support and support in afghanistan ' s recent election, given " today ' s announcement that the taliban [SEP]
+
+===== sample 031 =====
+[CLS] telephone at + 800 - 877 - 2526, or 617 - 213 - 2535. w. baird & co. interested listeners should visit the company ' s investor relations website ( www. wthrewcorp. com ) to listen via the web at 8003 - 1009 or + 919 798969 for a conference call, and enter pass code 86670998. access pass code 907771. www. dresser. net. com. is available by telephone from the u. s. relations section or calling on 0800 858989. [SEP] it was [SEP]
+
+===== sample 032 =====
+[CLS] charges, had been dismissed because of his involvement in federal criminal investigations. [SEP] the longer the military takes power, the more danger becomes. [SEP] now i don ' t know, but i thought it could last months and years, just in the middle of a big one. [SEP] police in the state have said they have no knowledge of his conduct. [SEP] christopher heilwood, 30, and his brother, gregory have been arrested following an incident between two youths at the store in abbey road, northampton, on saturday. [SEP] the authority said it had saved about $ 100m through a payment system called the public service system ( csr [SEP]
+
+===== sample 033 =====
+[CLS] murder and the assault was with one of the officers, authorities have said. [SEP] the finance ministry said the company had a plan to sell german products, but said it could put up many bidders for such brands. [SEP] but he denies that he has accused president zardari and others of compliciting in the election, and that he has not warned his citizens against raising confidence in the government. [SEP] that was an essential goal, she said, and it seemed that their relationship was taking on her new life. [SEP] 3, but the standard of living is likely to continue to drop. [SEP] it is a 50 - year [SEP]
+
+===== sample 034 =====
+[CLS] mr brown said it was not simply a very bad social housing regime. [SEP] his successor, gen mullah muzi, was promoted to power when he received a british passport in 2001. [SEP] there is also a sense that the experience of his death in the 1980s was the day of great " education. " [SEP] i don ' t remember the music, but i listen to the world. [SEP] currently, he is a two - year member of the company ' s board. [SEP] born in 1992, texas tech has never been made the a. c. a. a. tournament again in three years. [SEP] bill clinton ' s campaign [SEP]
+
+===== sample 035 =====
+[CLS]. [SEP] we do not need a laptop. [SEP] just three months ago, johnson was part of the team that felt the problem. [SEP] " you ' re not able to get work, you ' re out of the workforce. [SEP] in 2009, gen. john gallimer and three co - defendants issued the district court order overturning the convictions of judge richard addington, who refused to testify in the case. [SEP] after the election, mr anwar announced that his brother had ended a management role in his charge of the police service of the state. [SEP] expect to see something similar again in the year, when the census of [SEP]
+
+===== sample 036 =====
+[CLS] to its requirements. [SEP] in september, japan they lost 0. 7 per cent. [SEP] they have given no details of their raids. [SEP] this is also a very serious issue. [SEP] david wilson, head of communication at the prison service trust union, said : " it ' s a bit of a complete loss of confidence and confidence. [SEP] the officer, who is approved by the criminal register, said that he had no disciplinary record but was unable to answer questions until after they gave access to legal advice. [SEP] in december 1981, he was appointed chancellor of the university, and later, in 1986, a regular fellow at the university [SEP]
+
+===== sample 037 =====
+[CLS] president pervez musharraf, his predecessor, was removed under an emergency army rule. [SEP] this is a good decision so that it is more clear and effective. [SEP] western officials said at the opening session that mr karzai ' s brother, mr al - karzai ' s son, the director, houthi barzani - wali was present at the time of the blast, was released on sunday, after police demanded his arrest, the dawn newspaper reported. [SEP] sir michael powell, former head of the army and navy, was once a staff member of the george w. bush administration and is now [SEP]
+
+===== sample 038 =====
+[CLS] made to land in a car driven by his brother, who was walking away when the fire broke out in an open field near the spam hotel on the wrong side of the road. [SEP] he also dismissed claims that he was not a public figure who could be thought to have claimed to have been abused by a homeless person to get his money. [SEP] great article - - and, in fact, one crucial example. [SEP] government figures say the rise in cases means record numbers of abortions have been reported during the campaign. [SEP] the national front, the pdp, has been declared the winner, and the former prime minister, abdullah [SEP]
+
+===== sample 039 =====
+[CLS] the american football association. [SEP] under the scheme, a phone company can frighten you to buy the phone that can cost you and those looking to buy a card could make a payment. [SEP] four afghan insurgents were killed in a u. s. military helicopter crash during the campaign that destroyed hundreds of thousands of civilians and six insurgents hiding behind it. [SEP] more than 10, 000 children attend high - school lunch programs, more than 200 state schools and many others are facing food bills. [SEP] a police investigation has been launched after a firefighter has died at a house in lincolnshire. [SEP] president barack obama announced comprehensive reform for the health care [SEP]
+
+===== sample 040 =====
+[CLS] finals for the first time this year. [SEP] first, this had resulted in a massive pay - out - - but it was rejected by mps. [SEP] it has cut 700 jobs in the uk between april and april. [SEP] in the early sunday, over 100 people were found in collapsed or collapsed homes and three of those missing in the northwestern town of emu state. [SEP] georgia sent two combat troops on friday, the first time some 4, 500 troops were deployed to the area after fighting broke out in april. [SEP] just a few days later kazana blara announced she was looking to use public office just a few days [SEP]
+
+===== sample 041 =====
+[CLS] court in january, and one of two charges was dropped. [SEP] she has read this. [SEP] he already lives in alaska. [SEP] the australian funds rate, including bank rates, hit a five - year high for the dollar, which closed 0. 75 per cent lower at 0. 7 per cent on thursday, after dropping below 5 at an 18 - month high yesterday. [SEP] residents can call 0800 984 - 0830, and offers free £11 - a - day parking. [SEP] the u. s. military on friday accused the nato - led force of staging an air assault sunday night, saying it would send a heavy [SEP]
+
+===== sample 042 =====
+[CLS] a big - screen show at the american pictures international film festival. [SEP] the legal authority developed by lord sir john burrell, who was appointed and by appointment as a deputy commissioner in 1992. [SEP] american michael phelps won his world record with an incompetent run in the 200 meters last night. [SEP] a few years ago, word emerged that blagojevich had launched a facebook campaign to raise money for the service. [SEP] " i have made only one loan in five years. [SEP] this came after a teenager was also jailed for investigating the shooting of a woman in the dundee area. [SEP] the plan for the conservation area includes [SEP]
+
+===== sample 043 =====
+[CLS] has left town. [SEP] she had no regrets, but her up - and - down routine was not quick enough. [SEP] " it was too thick, he could not swim out because he was in the pool nearby. [SEP] sir bob woodward, the force ' s chief forces officer, said he had hoped to issue a schedule for deployment in april. [SEP] " those who know if there is any substance to this type of information were asked to back up up, " he said. [SEP] all are good, and are asked to give customers a number of help they really feel they might need or need it out. [SEP] authorities have said the [SEP]
+
+===== sample 044 =====
+[CLS] after allowing him to exchange text messages during his prison days. [SEP] the pandas will travel to american zoos during and after the season. [SEP] by the time he got his interview, he had helped his family and friends across the world. [SEP] his wife and children were also questioned for links in the investigation and he in aruban custody. [SEP] the chinese government said it issued $ 1. 7 billion of gold on its reserves as china, the world ' s second - largest economy, reported a five - year - long decline in gold reserves on friday. [SEP] under a five - year deal in which the club will receive £3 [SEP]
+
+===== sample 045 =====
+[CLS] $ 80 to $ 90 per month. [SEP] his high - ranking deputy, circigio berto, said that it was not necessary for constitutional renewal of power in the country ' s parliament, seven years after mr. morales was suspended, offering all his colleagues the job. [SEP] there ' s also the growing range of local barbecue and pasta salads. [SEP] officials from the united nations, nato, china and russia each voiced their concerns, and last week u. s. sen carl m. levin ( d - mich. ) said that it was time for barack obama to take his post as president. [SEP] he was [SEP]
+
+===== sample 046 =====
+[CLS] to adapt, and a growing number of foreign workers has been eliminated through the recruitment process. [SEP] the bank paid the bonuses this year with total bonuses of $ 100, 000 and the current bonus package worth $ 250 million. [SEP] and he too has been advised to find that his family is out of control because of its problems. [SEP] gordon smith, who was the us commander in iraq, says he believed his country was responsible for their deaths. [SEP] a spokeswoman for its petrochina unit said that " direct complaints " were not made and the plant ' s co - operation had to be closed. [SEP] a strasbourg court [SEP]
+
+===== sample 047 =====
+[CLS] 2, 0 - 9 in the world cup games. [SEP] more than 100, 000 people died in a major earthquake off the coast of mexico in 2005. [SEP] the application is also being submitted to the meeting and the parliamentary health committee. [SEP] " we have already taken the measures to ensure the spread of flu is linked to improving care, " the hpc says, adding a further analysis is being carried out and the rest of the outbreak is likely to be confirmed. [SEP] he and his men served in the regular army and were sent to their homelands in iraq. [SEP] president obama pledged that he would consider whether to accept us forces [SEP]
+
+===== sample 048 =====
+[CLS] local and state sponsored public schools in phoenix, los angeles and chicago. [SEP] the case should be closed before dec. [SEP] a trial heard that he had been rejected but was quashed for three months. [SEP] at the top of the taliban, they face the battle with afghanistan ' s pashtun in the south. [SEP] " our manager ' s job to determine how it all happened to us, " he said. [SEP] as one collector notes, " he ' s kept going away for just about five years, " he said. [SEP] the brazilian later returned to action as the second half played five minutes and seven minutes. [SEP] [SEP]
+
+===== sample 049 =====
+[CLS] find homes, go out of business and take a hike into the second - quarter comfort zone. [SEP] investigators were later told to give a police interview. [SEP] that will make it even harder to vote in future elections. [SEP] he became a sensation and was nominated for the award for natural science in a fellowship at the national academy of sciences in london. [SEP] palin, sarah palin ' s 2008 vice presidential pick, launched a special inquiry into gov. palin ' s selection as the presidential candidate, almost three years before the end of the summer. [SEP] starting at 15, mayes joined a group of u. s. sailors [SEP]
+
+===== sample 050 =====
+[CLS] as she said they had not heard of them. [SEP] a justice chief, deputy head of the domestic state committee and chief of national affairs were present when mr biden ' s speech was heard. [SEP] but mr manzanga said the current plan to legalise the practice is unsustainable. [SEP] bartoli is the no. 1 player to make the top three after last having to play first in the under - 21 open in april. [SEP] she met her husband when she had suffered from terminal cancer. [SEP] jones limped to a 2 - 3 fifth inning after losing control in the bottom. [SEP] grey ' s " x [SEP]
+
+===== sample 051 =====
+[CLS] station, is to appear in magistrates ' court after an anti - drugs programme last week, with ms ross saying she wanted to drop out of the cast of the tonight show. [SEP] " the first half of the year in 2008 had two quarters of negative economic growth in this recession. [SEP] let ' s not forget whether he would coach the team when they reach the nfl championship. [SEP] the inquiry report also calls for a new public standard for takeovers. [SEP] what we will all know is that at £35, a week, he was being denied, at the age of 50, an early pension and decent home pay. [SEP] the [SEP]
+
+===== sample 052 =====
+[CLS] [SEP] the cause of the outbreak, so far, is still providing details about the state of the supply, he said. [SEP] seven days later, he became the longest running fiction writer for television. [SEP] he has been jailed in the uk after the election in 2001, and agreed to release under the law of torture. [SEP] brian billiton, who entered the final three races in a row, was in the field along with johnson. [SEP] he said there will be no increase in the annual tax rate for five months. [SEP] then i ' m more likely to have been hit more than i ever thought. [SEP] the study also found [SEP]
+
+===== sample 053 =====
+[CLS] provide the final scoring opportunity in the 47th minute. [SEP] he says he hopes his client will sue the government so that they can do the same. [SEP] it ' s like a movie she ' s made. [SEP] he also asked john mcguinner, the scottish government ' s executive director, to set up a trust fund of more than £20m. [SEP] south africa will make their third tri six nations with a 32 - 17 win over new zealand, and will face the u. s. in june. [SEP] wal - mart was cautious after tuesday ' s fourth - quarter performance. [SEP] but if a baby dies a few [SEP]
+
+===== sample 054 =====
+[CLS] percent over last year, in a year - earlier period when it stood at 2, 661. [SEP] meanwhile, the european central bank kept the main interest rate at its lowest level amid concerns of the high inflation in the euro zone. [SEP] it said its cost rise was nearly 6 %, which rose to 1, 300 in 2006. [SEP] notes : joe johnson has seven points. [SEP] that way, power to a new government, or any state, should be appointed. [SEP] he had already received a letter from the public health service ' s office and told officials about the existence of the plans. [SEP] the security systems were put off [SEP]
+
+===== sample 055 =====
+[CLS] douglas huber and kevin spacey. [SEP] tomlinson, who lives in the maradona living room, asked what attracted his concern. [SEP] it takes time to take the first few months off when you would want to have a baby in your room sitting on the floor. [SEP] the financial cost of this case is very small. [SEP] celtic association legend john kelly says he could find himself in the hunt. [SEP] as a member of the pan - american advisory committee of the national trade and energy council and its foreign trade committee, hahn - chun ' s comments to north american scientists have long been consistent. [SEP] not so many americans [SEP]
+
+===== sample 056 =====
+[CLS] months. [SEP] in line with the national service ' s plan, announced in april, the bbc is to be offering up to 1 million per - minute programmes for about 10 % of the digital audience. [SEP] the chief of police and chief of the national human security division, mullah mohammad qalinaza, were also wounded. [SEP] every year, while around 7, 000 americans die, there are now nearly 3. 9 million deaths per person, according to britain ' s institute of public health medicine. [SEP] he told police that the tape was a threat to one of his children. [SEP] mr. dean was not released named, [SEP]
+
+===== sample 057 =====
+[CLS] jail after serving nine months and a half of his sentence, and suspended for three years. [SEP] although, after serving in power in the late 1980s, the british officer joined his unit in august 1975, while mr colle had spent nearly 30 years in the royal armoured service division, he was involved in the mid - morning operations and late - night operations of the military. [SEP] it appears there are people working at other sites on the channel island. [SEP] the other young man was trapped on the house ' s roof. [SEP] mccain has moved on, and he has never been a candidate in the fall. [SEP] but it gave him the [SEP]
+
+===== sample 058 =====
+[CLS] the money went down. [SEP] the board was due to vote on this issue next january. [SEP] the pakistani government has denied opposition claims that western forces are pursuing the taliban in a major border clash. [SEP] i feel very happy to make them no more. [SEP] they don ' t know - - or can ' t have kids when they want to. [SEP] it is an attempt of a sense of purpose that is part of the european parliament within the european convention of human rights. [SEP] one of the good books, " war on evil. " [SEP] " you can see i had the car down on the back to myself. [SEP] " when [SEP]
+
+===== sample 059 =====
+[CLS] staff, met mr. bush in january. [SEP] please, avoid the adulterous garb. [SEP] last year ' s pre - tax profits fell more than 9 per cent as a result of a weak yen, led by weaker demand. [SEP] this is currently at about £300, 000 a year - - a profit of around 2p a day on a year ago instead of the 40p pay of £7. 8 billion. [SEP] police released a short - range missile and a local television station reported that two militants had been killed in the latest rocket attack. [SEP] consider the world ' s new best - in - class car [SEP]
+
+===== sample 060 =====
+[CLS] t get enough to be angry, " he wrote in his book, four days before he took a journalism course, declaring that an e. o. k. mandate would make the difference. [SEP] the u. s. - led coalition says at least 20 militants, most of them children, on both sides and the u. s. military said several taliban fighters were killed. [SEP] the militants ' forces lost their way, and the army said a soldier was killed when insurgents launched a land mine in the area. [SEP] i only went to the garden, and must have heard the french phrase, " long gone. " [SEP] in a [SEP]
+
+===== sample 061 =====
+[CLS] and several years after his parents were involved in the crime - - disappeared for six hours on 23 may 2007. [SEP] three of them spent 15 years in britain ' s air force prison system and there was no indication that any changes in the command of the forces were made by bush because of his concern over the operational nature of their actions. [SEP] the social security and welfare services are expected to be discussed in the european parliament. [SEP] " despite the fact that the base rate has risen, helped by recent rate cuts, the current base interest rate is not taking any hits, " said richard shepherd, the mpc ' s chief economist, [SEP]
+
+===== sample 062 =====
+[CLS]. [SEP] appearing in a programme - programme on bbc ' s morning live, mr morgan compared the achievements of sir james when he was a deputy bbc northern ireland in the 1990s. [SEP] several people were evacuated on other days of the course, she said. [SEP] the former episcopal school of meningia and king ' s college of new church in inverness and king ' s church is to be sold as part of the reorganisation of the national anglican church of scotland. [SEP] the two victims were later killed in an accident in france and spain. [SEP] they said six people have also contacted police to make dna evidence for him, and he is asking [SEP]
+
+===== sample 063 =====
+[CLS] 1968, died and was again five days later, appearing on the bbc programme for a series of non - programmes. [SEP] if your father had a problem with my son, why didn ' t he choose to do the thing? [SEP] boston won the pac - 10 series for the first time since 1992 before winning first - round games in chicago. [SEP] but mr. finke ' s successor, ben w. c. fleming, chairman of the bank and a member of the board, backed mr. morgan. [SEP] they appealed for help. [SEP] mr. chirac was also ousted after several years in office - - he was sworn in [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p12_top32_scored.jsonl

@@ -0,0 +1,65 @@
+{"type": "summary", "name": "const_thrs_tau0p12_top32", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "const_thrs_tau0p12_top32", "steps": 128, "temp_start": 1.45, "temp_end": 1.45, "temp_schedule": "const", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_cosine", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "threshold_sample", "final_temp": 1.0, "top_k": 32, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 0.12, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 41.80839195562669, "nll_per_token": 3.7330970838688944, "tokens": 9725}, "diversity": {"sample_entropy": 4.204396875108297, "unique_tokens": 1943, "token_count": 8192, "distinct_1": 0.2371826171875, "distinct_2": 0.7140748031496063, "top_token_mass": 0.0560302734375}}
+{"type": "sample", "index": 0, "raw_text": "[CLS] the president will have to win in the next election. [SEP] it also announced bad results at some of the world ' s biggest credit - card companies and stripped out $ 6. 7 billion in the fourth quarter. [SEP] it can be due to the increased labour requirements and the change in demand, it says. [SEP] \" we ' re very involved in policing schools, roads and buildings and we ' re working all over london to find incidents like this, \" he said. [SEP] i had a good record and i was doing his best. [SEP] washington - - attorney general michael ki. moon ' s appointment as a former u. n. [SEP]", "detok_text": "[CLS] the president will have to win in the next election. [SEP] it also announced bad results at some of the world's biggest credit - card companies and stripped out $6. 7 billion in the fourth quarter. [SEP] it can be due to the increased labour requirements and the change in demand, it says. [SEP] \"we're very involved in policing schools, roads and buildings and we're working all over london to find incidents like this,\" he said. [SEP] i had a good record and i was doing his best. [SEP] washington - - attorney general michael ki. moon's appointment as a former u. n. [SEP]"}
+{"type": "sample", "index": 1, "raw_text": "[CLS] star, singer michael russell, has been asked to increase his licence. [SEP] the fall is a good time in school. [SEP] had he sent his dog to buy his own car, the money would have gone. [SEP] in an interview, a senior official said the senator had refused to accept donations. [SEP] tougher guy. [SEP] the defence said that the incident was a breach of procedures made by the ministry of defence ' s specialist civil investigations department in 2002. [SEP] more consumers can visit or join the website and be reached at www. medgreent. com /. [SEP] for more information on iridium, visit the data center. [SEP]", "detok_text": "[CLS] star, singer michael russell, has been asked to increase his licence. [SEP] the fall is a good time in school. [SEP] had he sent his dog to buy his own car, the money would have gone. [SEP] in an interview, a senior official said the senator had refused to accept donations. [SEP] tougher guy. [SEP] the defence said that the incident was a breach of procedures made by the ministry of defence's specialist civil investigations department in 2002. [SEP] more consumers can visit or join the website and be reached at www. medgreent. com /. [SEP] for more information on iridium, visit the data center. [SEP]"}
+{"type": "sample", "index": 2, "raw_text": "[CLS] wouldn ' t be a good idea to carry out a thorough review. [SEP] at a meeting on friday, the company ' s board voted overwhelmingly in support of president obama ' s plans in iraq for the next six months, leaving at least $ 200 billion over two months of war time. [SEP] no, he didn ' t know all the extra money. [SEP] the proposed changes would undermine the core of the state ' s constitutional law. [SEP] the spokesman said both sides would defend themselves as a matter of urgency. [SEP] during these opecunic events, many teachers, teachers, teachers and volunteers accompany men to the gym, and often [SEP]", "detok_text": "[CLS] wouldn't be a good idea to carry out a thorough review. [SEP] at a meeting on friday, the company's board voted overwhelmingly in support of president obama's plans in iraq for the next six months, leaving at least $200 billion over two months of war time. [SEP] no, he didn't know all the extra money. [SEP] the proposed changes would undermine the core of the state's constitutional law. [SEP] the spokesman said both sides would defend themselves as a matter of urgency. [SEP] during these opecunic events, many teachers, teachers, teachers and volunteers accompany men to the gym, and often [SEP]"}
+{"type": "sample", "index": 3, "raw_text": "[CLS]swoman said prosecutors pursuing the case had no knowledge of the killings, and he might initiate a criminal investigation. [SEP] for the first time in a year, analysts have also warned that xstran may be worth more than the current $ 3 billion of debt. [SEP] police officers were being pushed at the door of houses where the killing took place. [SEP] it provides travel and family services run by international travel company british travel ( 020 78777 ; www. explore. co. uk ), revenue & customs holidays ( 020 730000 ) and hotels and holidaymakers. [SEP] in the eight weeks since the crisis broke [SEP]", "detok_text": "[CLS]swoman said prosecutors pursuing the case had no knowledge of the killings, and he might initiate a criminal investigation. [SEP] for the first time in a year, analysts have also warned that xstran may be worth more than the current $3 billion of debt. [SEP] police officers were being pushed at the door of houses where the killing took place. [SEP] it provides travel and family services run by international travel company british travel (020 78777; www. explore. co. uk), revenue & customs holidays (020 730000) and hotels and holidaymakers. [SEP] in the eight weeks since the crisis broke [SEP]"}
+{"type": "sample", "index": 4, "raw_text": "[CLS], oversee the iraqi security forces, and provide security for american and iraqi forces. [SEP] these could be added when they return to the commons in the capital. [SEP] \" the situation is that it will be improved, \" he said. [SEP] \" normally, ideally, people would see it later in the next month, doing it at least once a month, \" said johnson. [SEP] in may, bill murray voluntarily received a mental health treatment, according to a report by his north carolina office. [SEP] but eight people have been killed by police in the region. [SEP] and having won the british olympic and european cup titles in 2003, and second [SEP]", "detok_text": "[CLS], oversee the iraqi security forces, and provide security for american and iraqi forces. [SEP] these could be added when they return to the commons in the capital. [SEP] \"the situation is that it will be improved,\" he said. [SEP] \"normally, ideally, people would see it later in the next month, doing it at least once a month,\" said johnson. [SEP] in may, bill murray voluntarily received a mental health treatment, according to a report by his north carolina office. [SEP] but eight people have been killed by police in the region. [SEP] and having won the british olympic and european cup titles in 2003, and second [SEP]"}
+{"type": "sample", "index": 5, "raw_text": "[CLS] civilian judges, acting as the court of appeal. [SEP] at the busy railway station, the pilot collapsed in the rain in the early hours of the morning. [SEP] i lost my job because some people just lost, \" and it was followed by the long days of three to four hours. [SEP] david dungy, a spokesman for the sheriff ' s department, has said the prison chief believes the drug enforcement campaign could reduce the number of drug - related crime in the region. [SEP] he crawled out of the car, with his head covered in a blanket, then tried to wave it back to finish in a safe position. [SEP] \" it [SEP]", "detok_text": "[CLS] civilian judges, acting as the court of appeal. [SEP] at the busy railway station, the pilot collapsed in the rain in the early hours of the morning. [SEP] i lost my job because some people just lost, \"and it was followed by the long days of three to four hours. [SEP] david dungy, a spokesman for the sheriff's department, has said the prison chief believes the drug enforcement campaign could reduce the number of drug - related crime in the region. [SEP] he crawled out of the car, with his head covered in a blanket, then tried to wave it back to finish in a safe position. [SEP]\" it [SEP]"}
+{"type": "sample", "index": 6, "raw_text": "[CLS] prosecutors in the mclelland case review the federal grand jury ' s findings and report into the death of stephen baker, whose body was discovered on march 2. [SEP] the government ' s last decision on the use of force was in 2007. [SEP] the children were taken from a school in sudbury, cambridgeshire, a week before 2200 bst that evening. [SEP] people in the midlands and surrounding areas have also taken part in extreme weather events. [SEP] it is also offering a working mortgage benefit scheme likely to cost £6 a week, starting at £345 a week. [SEP] if you can ' t imagine texting a baby, or [SEP]", "detok_text": "[CLS] prosecutors in the mclelland case review the federal grand jury's findings and report into the death of stephen baker, whose body was discovered on march 2. [SEP] the government's last decision on the use of force was in 2007. [SEP] the children were taken from a school in sudbury, cambridgeshire, a week before 2200 bst that evening. [SEP] people in the midlands and surrounding areas have also taken part in extreme weather events. [SEP] it is also offering a working mortgage benefit scheme likely to cost £6 a week, starting at £345 a week. [SEP] if you can't imagine texting a baby, or [SEP]"}
+{"type": "sample", "index": 7, "raw_text": "[CLS] receive a guaranteed bonus of $ 4, 000 - - and paid full - time each month. [SEP] many fear water supplies hold up to their power facilities as they prepare for a strong storm. [SEP] i could not believe that he would ever get a bank loan. [SEP] he was fired, spokeswoman said. [SEP] \" i ' ll tell you today, he ' s much more effective than now. [SEP] these institutions are not entirely strangers ; they can choose their own ways. [SEP] jones said he met with the defense minister, gen. jaullah mujahid, to discuss plans to push taliban militants from the eastern province of [SEP]", "detok_text": "[CLS] receive a guaranteed bonus of $4, 000 - - and paid full - time each month. [SEP] many fear water supplies hold up to their power facilities as they prepare for a strong storm. [SEP] i could not believe that he would ever get a bank loan. [SEP] he was fired, spokeswoman said. [SEP] \" i'll tell you today, he's much more effective than now. [SEP] these institutions are not entirely strangers; they can choose their own ways. [SEP] jones said he met with the defense minister, gen. jaullah mujahid, to discuss plans to push taliban militants from the eastern province of [SEP]"}
+{"type": "sample", "index": 8, "raw_text": "[CLS] the shooting is more likely to be the case. [SEP] an assistant is governor of alan s. rice of minnesota and the future administrator of the commission. [SEP] on wednesday, google co inc ( goo. o ), microsoft corp ( ms. n ), google inc ( gooft. o, microsoft inc ' s top customer, and electric co inc ( ge. nx : quote, profile, research, stock buzz ) have announced plans to put net sales of $ 3. 5 billion into securities trading securities related to the accounting charges. [SEP] this is an entirely new part of politics. [SEP] there was a sense among the public [SEP]", "detok_text": "[CLS] the shooting is more likely to be the case. [SEP] an assistant is governor of alan s. rice of minnesota and the future administrator of the commission. [SEP] on wednesday, google co inc (goo. o), microsoft corp (ms. n), google inc ( gooft. o, microsoft inc's top customer, and electric co inc (ge. nx: quote, profile, research, stock buzz) have announced plans to put net sales of $3. 5 billion into securities trading securities related to the accounting charges. [SEP] this is an entirely new part of politics. [SEP] there was a sense among the public [SEP]"}
+{"type": "sample", "index": 9, "raw_text": "[CLS] pakistan chief is believed to be the leading mastermind of the attacks. [SEP] but after a few weeks i stayed at my sister ' s home until it moved off. [SEP] sir mark, the long - retired air force officer of royal navy air, became the only aircraft carrier to have flown through the mediterranean to carry on his war plans for scotland. [SEP] posada was involved in three federal crimes, and was brought in a matter of months ago. [SEP] a month is usually \" on track \" for about 10 million dollars. [SEP] in 2003, microsoft refused to make a takeover bid. [SEP] the u. s. navy has launched [SEP]", "detok_text": "[CLS] pakistan chief is believed to be the leading mastermind of the attacks. [SEP] but after a few weeks i stayed at my sister's home until it moved off. [SEP] sir mark, the long - retired air force officer of royal navy air, became the only aircraft carrier to have flown through the mediterranean to carry on his war plans for scotland. [SEP] posada was involved in three federal crimes, and was brought in a matter of months ago. [SEP] a month is usually \"on track\" for about 10 million dollars. [SEP] in 2003, microsoft refused to make a takeover bid. [SEP] the u. s. navy has launched [SEP]"}
+{"type": "sample", "index": 10, "raw_text": "[CLS] air, was deputy leader in russia ' s mi - 1 programme, and built russia ' s mirov ballistic missiles in addition to russia ' s first nuclear system. [SEP] jacksonville, fla. - the florida house said wednesday they passed a bill that ended the war four years ago, followed by a vote friday that would limit president obama ' s 10 - year - old build - up of the 550 us troops in iraq and 4, 000 troops in afghanistan. [SEP] district attorney william mccready asked the witness to testify in his testimony and later dismissed the suit. [SEP] in iowa, 34 per cent of democratic voters in the state [SEP]", "detok_text": "[CLS] air, was deputy leader in russia's mi - 1 programme, and built russia's mirov ballistic missiles in addition to russia's first nuclear system. [SEP] jacksonville, fla. - the florida house said wednesday they passed a bill that ended the war four years ago, followed by a vote friday that would limit president obama's 10 - year - old build - up of the 550 us troops in iraq and 4, 000 troops in afghanistan. [SEP] district attorney william mccready asked the witness to testify in his testimony and later dismissed the suit. [SEP] in iowa, 34 per cent of democratic voters in the state [SEP]"}
+{"type": "sample", "index": 11, "raw_text": "[CLS] bank had not paid in mortgage charges, it was thought it would pay back about £54m in the quarter, which is due in full 2010. [SEP] i flew back to miami on an airlines flight. [SEP] the metropolitan police force has been investigated by three detectives and two other police officers in connection with the investigation. [SEP] the former republican presidential nominee often said the 2008 democratic presidential nominee was the father of u. s. president george w. bush ' s failed campaign. [SEP] it has been decided that stock, which may be worthless, may have been short - selling ordinary shares. [SEP] they cut off our electricity. [SEP] i ' [SEP]", "detok_text": "[CLS] bank had not paid in mortgage charges, it was thought it would pay back about £54m in the quarter, which is due in full 2010. [SEP] i flew back to miami on an airlines flight. [SEP] the metropolitan police force has been investigated by three detectives and two other police officers in connection with the investigation. [SEP] the former republican presidential nominee often said the 2008 democratic presidential nominee was the father of u. s. president george w. bush's failed campaign. [SEP] it has been decided that stock, which may be worthless, may have been short - selling ordinary shares. [SEP] they cut off our electricity. [SEP] i ' [SEP]"}
+{"type": "sample", "index": 12, "raw_text": "[CLS] 17 minutes remaining. [SEP] he also began working on wednesday and is mailing an internal psychiatric report. [SEP] the taliban have said in a statement following a meeting between the top leaders of the international human rights committee and the human rights council that there would be no international charges of violations against civilians. [SEP] b - 3 did not answer telephone calls for this article in april, the washington tribune reported. [SEP] but he is probably likely to find ground. [SEP] this ice will melt, and this won ' t be for long until you get water. [SEP] \" the difference between being a husband and being a mother now is clear. [SEP] but what [SEP]", "detok_text": "[CLS] 17 minutes remaining. [SEP] he also began working on wednesday and is mailing an internal psychiatric report. [SEP] the taliban have said in a statement following a meeting between the top leaders of the international human rights committee and the human rights council that there would be no international charges of violations against civilians. [SEP] b - 3 did not answer telephone calls for this article in april, the washington tribune reported. [SEP] but he is probably likely to find ground. [SEP] this ice will melt, and this won't be for long until you get water. [SEP] \" the difference between being a husband and being a mother now is clear. [SEP] but what [SEP]"}
+{"type": "sample", "index": 13, "raw_text": "[CLS] slomping down the street for a coffee lunch. [SEP] on saturday, fa executive chairman pat wright said : \" this is a deeply serious accident and she understood the allegations were being investigated by this side. [SEP] the television and radio station has also launched a local programme that includes many of its regular programmes including daytime tv times and evening and evening news. [SEP] omar al - karzai was allegedly married to his mother and cousin when she was accused of killing her daughter and then forcing authorities to kill her, her family said. [SEP] but senate aides said the department ' s report will not have historical significance and that \" if law [SEP]", "detok_text": "[CLS] slomping down the street for a coffee lunch. [SEP] on saturday, fa executive chairman pat wright said: \"this is a deeply serious accident and she understood the allegations were being investigated by this side. [SEP] the television and radio station has also launched a local programme that includes many of its regular programmes including daytime tv times and evening and evening news. [SEP] omar al - karzai was allegedly married to his mother and cousin when she was accused of killing her daughter and then forcing authorities to kill her, her family said. [SEP] but senate aides said the department's report will not have historical significance and that\" if law [SEP]"}
+{"type": "sample", "index": 14, "raw_text": "[CLS] a harvard student in college, was trying to come up with some sort of new idea. [SEP] nato officials said tuesday that the special representative to the u. n. security council on the 15 - nation council on afghanistan has staked the support of his staff members in a dispute with kabul over the proposed new law. [SEP] he has has been charged with blagevich ' s attempted murder. [SEP] in winter weeks, it was wet in the cold, but the area was infested with mud and cold soil. [SEP] \" when a e - mail or email address is sent to someone at birth, which i don ' t know [SEP]", "detok_text": "[CLS] a harvard student in college, was trying to come up with some sort of new idea. [SEP] nato officials said tuesday that the special representative to the u. n. security council on the 15 - nation council on afghanistan has staked the support of his staff members in a dispute with kabul over the proposed new law. [SEP] he has has been charged with blagevich's attempted murder. [SEP] in winter weeks, it was wet in the cold, but the area was infested with mud and cold soil. [SEP] \" when a e - mail or email address is sent to someone at birth, which i don't know [SEP]"}
+{"type": "sample", "index": 15, "raw_text": "[CLS] dead body in the pool at the school. [SEP] he joined the board in may 1958, retiring as a graduate professor at the university ' s college of management, where he was named a member of harvard medical school and chairman of the m. l. a. and of the international institute for health and health policy. [SEP] \" they want to... [SEP] he says that he \" has a lot of great points, \" but that he knows it is \" very good \" and does not believe this. [SEP] for all this time, it was in iceland ' s interest of nationalising its financial sector, and, of course, [SEP]", "detok_text": "[CLS] dead body in the pool at the school. [SEP] he joined the board in may 1958, retiring as a graduate professor at the university's college of management, where he was named a member of harvard medical school and chairman of the m. l. a. and of the international institute for health and health policy. [SEP] \"they want to... [SEP] he says that he\" has a lot of great points, \"but that he knows it is\" very good \" and does not believe this. [SEP] for all this time, it was in iceland's interest of nationalising its financial sector, and, of course, [SEP]"}
+{"type": "sample", "index": 16, "raw_text": "[CLS] absence of any allegations of corruption in the legal system. [SEP] during the downturn, it was unclear what his life to do with his company. [SEP] in 1969, just three years after leaving as chairman of the club, he became the first individual football figure to conceive in the club ' s executive management. [SEP] mr shapiro, who has served as a top banker at toyota in the past for 13 years as the chairman of the company ' s board, has made a $ 3 million management package. [SEP] it was claimed the man took the phone while allegedly sending the phone message to his wife. [SEP] \" there is no sense [SEP]", "detok_text": "[CLS] absence of any allegations of corruption in the legal system. [SEP] during the downturn, it was unclear what his life to do with his company. [SEP] in 1969, just three years after leaving as chairman of the club, he became the first individual football figure to conceive in the club's executive management. [SEP] mr shapiro, who has served as a top banker at toyota in the past for 13 years as the chairman of the company's board, has made a $3 million management package. [SEP] it was claimed the man took the phone while allegedly sending the phone message to his wife. [SEP] \" there is no sense [SEP]"}
+{"type": "sample", "index": 17, "raw_text": "[CLS] alaska ' s polar bears remain the most important source of information in the arctic area, and a significant source of the breeding population in the western arctic ice area. [SEP] soon after israel took over the presidency - - and a fifth head of state - - of the national arab university in 2005, israel ' s education department revoked its accreditation program. [SEP] but he has no doubt michael jones, the director of his new military team, will be meeting with the current head of the government. [SEP] officers said they took them to hospital for medical attention, but reported concerns about the identity of the man. [SEP] \" it ' s an early day [SEP]", "detok_text": "[CLS] alaska's polar bears remain the most important source of information in the arctic area, and a significant source of the breeding population in the western arctic ice area. [SEP] soon after israel took over the presidency - - and a fifth head of state - - of the national arab university in 2005, israel's education department revoked its accreditation program. [SEP] but he has no doubt michael jones, the director of his new military team, will be meeting with the current head of the government. [SEP] officers said they took them to hospital for medical attention, but reported concerns about the identity of the man. [SEP] \" it's an early day [SEP]"}
+{"type": "sample", "index": 18, "raw_text": "[CLS] [SEP] i was at 14, aged only 15 when i turned 15 when i was 22, and i became aware of the need for more breathing time and this was the first time i had ever seen a particular level of interest. [SEP] one good dream for parents was to arrive at a post - office breakfast in the morning. [SEP] it might now make a zero percent interest rate cut, which is already the fastest rate cut in more than half a century. [SEP] he needs to say this. [SEP] the incident was reported to south wales police in swomford road at 2200 bst on tuesday, police said. [SEP] but we ' [SEP]", "detok_text": "[CLS] [SEP] i was at 14, aged only 15 when i turned 15 when i was 22, and i became aware of the need for more breathing time and this was the first time i had ever seen a particular level of interest. [SEP] one good dream for parents was to arrive at a post - office breakfast in the morning. [SEP] it might now make a zero percent interest rate cut, which is already the fastest rate cut in more than half a century. [SEP] he needs to say this. [SEP] the incident was reported to south wales police in swomford road at 2200 bst on tuesday, police said. [SEP] but we ' [SEP]"}
+{"type": "sample", "index": 19, "raw_text": "[CLS] rise of new zealand ' s fast food. [SEP] in the early war his firm was based in brecon, preselbury, and it was in westminster, highgate hill and cwmbran, where i turned up in the second row of hill houses, in edinburgh in 1975. [SEP] sir paul rose was appointed chairman of the met at the age of 81 for £2. 3 million but was paid £69, 000 in salary. [SEP] there are two good things in football. [SEP] he ' d scored 16 points to help seattle give the league its first win of the regular season. [SEP] pakistan ' s authorities are saying [SEP]", "detok_text": "[CLS] rise of new zealand's fast food. [SEP] in the early war his firm was based in brecon, preselbury, and it was in westminster, highgate hill and cwmbran, where i turned up in the second row of hill houses, in edinburgh in 1975. [SEP] sir paul rose was appointed chairman of the met at the age of 81 for £2. 3 million but was paid £69, 000 in salary. [SEP] there are two good things in football. [SEP] he'd scored 16 points to help seattle give the league its first win of the regular season. [SEP] pakistan's authorities are saying [SEP]"}
+{"type": "sample", "index": 20, "raw_text": "[CLS] public freedom. \" [SEP] private sales opened last week at $ 12. 3m. [SEP] he said the decision before the new parliament is expected to make it a second session to parliament. [SEP] gordon - brown has been organized by the national museum of natural history. [SEP] the average rate again rises to 5. 3 points, falling to a peak of 5. 7 per cent in july, while the average rate on three year loans fell from 2. 7 per cent to 4. 5 per cent earlier in the year. [SEP] that ' s what is an american school of american cooking, just as it ' s all about high - tech [SEP]", "detok_text": "[CLS] public freedom. \" [SEP] private sales opened last week at $12. 3m. [SEP] he said the decision before the new parliament is expected to make it a second session to parliament. [SEP] gordon - brown has been organized by the national museum of natural history. [SEP] the average rate again rises to 5. 3 points, falling to a peak of 5. 7 per cent in july, while the average rate on three year loans fell from 2. 7 per cent to 4. 5 per cent earlier in the year. [SEP] that's what is an american school of american cooking, just as it's all about high - tech [SEP]"}
+{"type": "sample", "index": 21, "raw_text": "[CLS] one of them. [SEP] in 1989, the kazlin democratic party of the anti - soviet union leader and finance chief, nikita khrushchev, launched a military campaign to stop attacks on the ussr in europe. [SEP] mr horwood, 29, was arrested friday, was granted bail but was released last month while the case was re - examined. [SEP] i ' m a singer for several years. [SEP] 5, citing police officers. [SEP] experts say banks need to wait 10 days of payment of the cards but there may be a time when they are being forced to pay interest. [SEP] the story is still considered an accurate indicator [SEP]", "detok_text": "[CLS] one of them. [SEP] in 1989, the kazlin democratic party of the anti - soviet union leader and finance chief, nikita khrushchev, launched a military campaign to stop attacks on the ussr in europe. [SEP] mr horwood, 29, was arrested friday, was granted bail but was released last month while the case was re - examined. [SEP] i'm a singer for several years. [SEP] 5, citing police officers. [SEP] experts say banks need to wait 10 days of payment of the cards but there may be a time when they are being forced to pay interest. [SEP] the story is still considered an accurate indicator [SEP]"}
+{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring our soldiers into action, \" said col. david caldwell, vice chief for the u. s. air and air force. [SEP] the french army has more than 400 soldiers at more than 6, 000. [SEP] dein said : \" he ' s an added bonus to losing his team, but he can show that it can be done with live action, especially with steven jones. [SEP] police are pursuing a call for a man ' s arrest in connection with the murder of the 21 - year - old briton at a police station. [SEP] gen. pervez mullen, at a news conference tuesday, said [SEP]", "detok_text": "[CLS] be able to bring our soldiers into action, \"said col. david caldwell, vice chief for the u. s. air and air force. [SEP] the french army has more than 400 soldiers at more than 6, 000. [SEP] dein said:\" he's an added bonus to losing his team, but he can show that it can be done with live action, especially with steven jones. [SEP] police are pursuing a call for a man's arrest in connection with the murder of the 21 - year - old briton at a police station. [SEP] gen. pervez mullen, at a news conference tuesday, said [SEP]"}
+{"type": "sample", "index": 23, "raw_text": "[CLS] appeared in the oct. [SEP] some nato commanders in afghanistan have asked for the speed and deployment of most of the 21, 000 troops now already there. [SEP] the teenager was released on bail and bailed out following a review of the case. [SEP] he died, in 2003, but he was never able to die. [SEP] in november 2007, reflecting abundant demand in china and india, global demand for crude products more than doubled a month. [SEP] subs : hudson, fletcher, wolsay, langfield, coker, lovenk, fletcher, baird, banks, fletcher, lawes, fletcher, coker, healy, [SEP]", "detok_text": "[CLS] appeared in the oct. [SEP] some nato commanders in afghanistan have asked for the speed and deployment of most of the 21, 000 troops now already there. [SEP] the teenager was released on bail and bailed out following a review of the case. [SEP] he died, in 2003, but he was never able to die. [SEP] in november 2007, reflecting abundant demand in china and india, global demand for crude products more than doubled a month. [SEP] subs: hudson, fletcher, wolsay, langfield, coker, lovenk, fletcher, baird, banks, fletcher, lawes, fletcher, coker, healy, [SEP]"}
+{"type": "sample", "index": 24, "raw_text": "[CLS] williams, the club ' s executive chairman. [SEP] more than 1, 000 women who lost weight in 2007 have been in the uk since 2000, according to a national survey. [SEP] i like the sound of the song. [SEP] the public prosecutor later refused to open the investigation, though campbell ' s attorney said no formal charges have been filed, the times of london reported. [SEP] a change of heart. [SEP] \" we entered an open area and the driver opened a side door and then tried to get under the car as it happened while driving, \" he said. [SEP] the army also plans to buy about 300, 000 cases of the [SEP]", "detok_text": "[CLS] williams, the club's executive chairman. [SEP] more than 1, 000 women who lost weight in 2007 have been in the uk since 2000, according to a national survey. [SEP] i like the sound of the song. [SEP] the public prosecutor later refused to open the investigation, though campbell's attorney said no formal charges have been filed, the times of london reported. [SEP] a change of heart. [SEP] \"we entered an open area and the driver opened a side door and then tried to get under the car as it happened while driving,\" he said. [SEP] the army also plans to buy about 300, 000 cases of the [SEP]"}
+{"type": "sample", "index": 25, "raw_text": "[CLS] by 10 per cent. [SEP] that ' s all even more so, in their view, as they don ' t speak to their children. [SEP] the lakers didn ' t risk a loss when andrej o, a backup who had six points in four regular seasons, took a poor win against dallas and spent at least 20 minutes sitting on his left leg. [SEP] chris snyder ' s two - run homer in the eighth and the first two runs made it 4 - 5. [SEP] they also help find evidence of what happened during a bonfire in the area on thursday. [SEP] he is still miles away from using the internet as a social service [SEP]", "detok_text": "[CLS] by 10 per cent. [SEP] that's all even more so, in their view, as they don't speak to their children. [SEP] the lakers didn't risk a loss when andrej o, a backup who had six points in four regular seasons, took a poor win against dallas and spent at least 20 minutes sitting on his left leg. [SEP] chris snyder's two - run homer in the eighth and the first two runs made it 4 - 5. [SEP] they also help find evidence of what happened during a bonfire in the area on thursday. [SEP] he is still miles away from using the internet as a social service [SEP]"}
+{"type": "sample", "index": 26, "raw_text": "[CLS] up on his efforts to repeal the new people ' s law, which he says was never approved by the house and has said he will get the bill before christmas, but he opted instead to give up public responsibility for the election. [SEP] the local intelligence service had recently confirmed that the army in the area had killed militants. [SEP] it might not be the morning after that. [SEP] but his playing days were, for many, a clarion call for football this season. [SEP] she could also sell wineries and telephone jackpots on the restaurant ' s main floor in the island ' s northern corner. [SEP] little rock, ark. [SEP]", "detok_text": "[CLS] up on his efforts to repeal the new people's law, which he says was never approved by the house and has said he will get the bill before christmas, but he opted instead to give up public responsibility for the election. [SEP] the local intelligence service had recently confirmed that the army in the area had killed militants. [SEP] it might not be the morning after that. [SEP] but his playing days were, for many, a clarion call for football this season. [SEP] she could also sell wineries and telephone jackpots on the restaurant's main floor in the island's northern corner. [SEP] little rock, ark. [SEP]"}
+{"type": "sample", "index": 27, "raw_text": "[CLS] arrested on various charges, but they did not give a further date. [SEP] meanwhile, it ' s not so bad that all - rounders vaughan and swaner had already had to settle for one on the second morning in the second test. [SEP] najibullah - mujahid was under surveillance when police responded to his house after surrendering to his apartment by his security forces and security services, the times said. [SEP] the public inquiry team was unable to complete a report in both cases. [SEP] an actor in india who became the world ' s top indian film director has taken charge of the country ' s budget, dropping his [SEP]", "detok_text": "[CLS] arrested on various charges, but they did not give a further date. [SEP] meanwhile, it's not so bad that all - rounders vaughan and swaner had already had to settle for one on the second morning in the second test. [SEP] najibullah - mujahid was under surveillance when police responded to his house after surrendering to his apartment by his security forces and security services, the times said. [SEP] the public inquiry team was unable to complete a report in both cases. [SEP] an actor in india who became the world's top indian film director has taken charge of the country's budget, dropping his [SEP]"}
+{"type": "sample", "index": 28, "raw_text": "[CLS]. [SEP] her father was trapped in the front yard. [SEP] as the firefights started, people began beating up on the floor, hearing noises, an answer that was denied. [SEP] the group said the review would not be completed before the end of the current financial year and could be for a full year. [SEP] authorities reported the crash, 40 hours after a helicopter crash on the washington river. [SEP] it ' s always easy for both men to leave behind their job. [SEP] it was the first time former president nawaz sharif was available to comment. [SEP] that was to say the thrust of the series ; yes, he was [SEP]", "detok_text": "[CLS]. [SEP] her father was trapped in the front yard. [SEP] as the firefights started, people began beating up on the floor, hearing noises, an answer that was denied. [SEP] the group said the review would not be completed before the end of the current financial year and could be for a full year. [SEP] authorities reported the crash, 40 hours after a helicopter crash on the washington river. [SEP] it's always easy for both men to leave behind their job. [SEP] it was the first time former president nawaz sharif was available to comment. [SEP] that was to say the thrust of the series; yes, he was [SEP]"}
+{"type": "sample", "index": 29, "raw_text": "[CLS] are less likely to still need surgery following radical heart surgery, according to the group. [SEP] what a disgrace. [SEP] noose, the largest and most important of the leaders of the jewish state of israel, is still buried in the sanctuary of the middle eastern city of jerusalem, where st. john ' s was still buried long after his death in 2 1 / 2 years ago. [SEP] it is the final day of parliament and the prime minister ' s funeral. [SEP] the latest case has affected anyone under 18 and it was closed shortly after the crash incident. [SEP] ( ap ) - - craig johnson held up his lead and was good [SEP]", "detok_text": "[CLS] are less likely to still need surgery following radical heart surgery, according to the group. [SEP] what a disgrace. [SEP] noose, the largest and most important of the leaders of the jewish state of israel, is still buried in the sanctuary of the middle eastern city of jerusalem, where st. john's was still buried long after his death in 2 1/2 years ago. [SEP] it is the final day of parliament and the prime minister's funeral. [SEP] the latest case has affected anyone under 18 and it was closed shortly after the crash incident. [SEP] (ap) - - craig johnson held up his lead and was good [SEP]"}
+{"type": "sample", "index": 30, "raw_text": "[CLS] and you can find us and have real fun. [SEP] the visitors again appeared to settle for a scoreless goal late in the second half. [SEP] mr winehouse was arrested in 1992 and later ran the child law enforcement office established in the 1990s. [SEP] he took advantage of his lack of vision, going back for treatment. [SEP] the case is expected to be heard before the general election in july 2009. [SEP] during the summer, he has to walk more leisurely. [SEP] the state of the afghan economy has been a key element of public support and support in afghanistan ' s recent election, given \" today ' s announcement that the taliban [SEP]", "detok_text": "[CLS] and you can find us and have real fun. [SEP] the visitors again appeared to settle for a scoreless goal late in the second half. [SEP] mr winehouse was arrested in 1992 and later ran the child law enforcement office established in the 1990s. [SEP] he took advantage of his lack of vision, going back for treatment. [SEP] the case is expected to be heard before the general election in july 2009. [SEP] during the summer, he has to walk more leisurely. [SEP] the state of the afghan economy has been a key element of public support and support in afghanistan's recent election, given \" today's announcement that the taliban [SEP]"}
+{"type": "sample", "index": 31, "raw_text": "[CLS] telephone at + 800 - 877 - 2526, or 617 - 213 - 2535. w. baird & co. interested listeners should visit the company ' s investor relations website ( www. wthrewcorp. com ) to listen via the web at 8003 - 1009 or + 919 798969 for a conference call, and enter pass code 86670998. access pass code 907771. www. dresser. net. com. is available by telephone from the u. s. relations section or calling on 0800 858989. [SEP] it was [SEP]", "detok_text": "[CLS] telephone at + 800 - 877 - 2526, or 617 - 213 - 2535. w. baird & co. interested listeners should visit the company's investor relations website (www. wthrewcorp. com) to listen via the web at 8003 - 1009 or + 919 798969 for a conference call, and enter pass code 86670998. access pass code 907771. www. dresser. net. com. is available by telephone from the u. s. relations section or calling on 0800 858989. [SEP] it was [SEP]"}
+{"type": "sample", "index": 32, "raw_text": "[CLS] charges, had been dismissed because of his involvement in federal criminal investigations. [SEP] the longer the military takes power, the more danger becomes. [SEP] now i don ' t know, but i thought it could last months and years, just in the middle of a big one. [SEP] police in the state have said they have no knowledge of his conduct. [SEP] christopher heilwood, 30, and his brother, gregory have been arrested following an incident between two youths at the store in abbey road, northampton, on saturday. [SEP] the authority said it had saved about $ 100m through a payment system called the public service system ( csr [SEP]", "detok_text": "[CLS] charges, had been dismissed because of his involvement in federal criminal investigations. [SEP] the longer the military takes power, the more danger becomes. [SEP] now i don't know, but i thought it could last months and years, just in the middle of a big one. [SEP] police in the state have said they have no knowledge of his conduct. [SEP] christopher heilwood, 30, and his brother, gregory have been arrested following an incident between two youths at the store in abbey road, northampton, on saturday. [SEP] the authority said it had saved about $100m through a payment system called the public service system ( csr [SEP]"}
+{"type": "sample", "index": 33, "raw_text": "[CLS] murder and the assault was with one of the officers, authorities have said. [SEP] the finance ministry said the company had a plan to sell german products, but said it could put up many bidders for such brands. [SEP] but he denies that he has accused president zardari and others of compliciting in the election, and that he has not warned his citizens against raising confidence in the government. [SEP] that was an essential goal, she said, and it seemed that their relationship was taking on her new life. [SEP] 3, but the standard of living is likely to continue to drop. [SEP] it is a 50 - year [SEP]", "detok_text": "[CLS] murder and the assault was with one of the officers, authorities have said. [SEP] the finance ministry said the company had a plan to sell german products, but said it could put up many bidders for such brands. [SEP] but he denies that he has accused president zardari and others of compliciting in the election, and that he has not warned his citizens against raising confidence in the government. [SEP] that was an essential goal, she said, and it seemed that their relationship was taking on her new life. [SEP] 3, but the standard of living is likely to continue to drop. [SEP] it is a 50 - year [SEP]"}
+{"type": "sample", "index": 34, "raw_text": "[CLS] mr brown said it was not simply a very bad social housing regime. [SEP] his successor, gen mullah muzi, was promoted to power when he received a british passport in 2001. [SEP] there is also a sense that the experience of his death in the 1980s was the day of great \" education. \" [SEP] i don ' t remember the music, but i listen to the world. [SEP] currently, he is a two - year member of the company ' s board. [SEP] born in 1992, texas tech has never been made the a. c. a. a. tournament again in three years. [SEP] bill clinton ' s campaign [SEP]", "detok_text": "[CLS] mr brown said it was not simply a very bad social housing regime. [SEP] his successor, gen mullah muzi, was promoted to power when he received a british passport in 2001. [SEP] there is also a sense that the experience of his death in the 1980s was the day of great \"education.\" [SEP] i don't remember the music, but i listen to the world. [SEP] currently, he is a two - year member of the company's board. [SEP] born in 1992, texas tech has never been made the a. c. a. a. tournament again in three years. [SEP] bill clinton's campaign [SEP]"}
+{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need a laptop. [SEP] just three months ago, johnson was part of the team that felt the problem. [SEP] \" you ' re not able to get work, you ' re out of the workforce. [SEP] in 2009, gen. john gallimer and three co - defendants issued the district court order overturning the convictions of judge richard addington, who refused to testify in the case. [SEP] after the election, mr anwar announced that his brother had ended a management role in his charge of the police service of the state. [SEP] expect to see something similar again in the year, when the census of [SEP]", "detok_text": "[CLS]. [SEP] we do not need a laptop. [SEP] just three months ago, johnson was part of the team that felt the problem. [SEP] \" you're not able to get work, you're out of the workforce. [SEP] in 2009, gen. john gallimer and three co - defendants issued the district court order overturning the convictions of judge richard addington, who refused to testify in the case. [SEP] after the election, mr anwar announced that his brother had ended a management role in his charge of the police service of the state. [SEP] expect to see something similar again in the year, when the census of [SEP]"}
+{"type": "sample", "index": 36, "raw_text": "[CLS] to its requirements. [SEP] in september, japan they lost 0. 7 per cent. [SEP] they have given no details of their raids. [SEP] this is also a very serious issue. [SEP] david wilson, head of communication at the prison service trust union, said : \" it ' s a bit of a complete loss of confidence and confidence. [SEP] the officer, who is approved by the criminal register, said that he had no disciplinary record but was unable to answer questions until after they gave access to legal advice. [SEP] in december 1981, he was appointed chancellor of the university, and later, in 1986, a regular fellow at the university [SEP]", "detok_text": "[CLS] to its requirements. [SEP] in september, japan they lost 0. 7 per cent. [SEP] they have given no details of their raids. [SEP] this is also a very serious issue. [SEP] david wilson, head of communication at the prison service trust union, said: \" it's a bit of a complete loss of confidence and confidence. [SEP] the officer, who is approved by the criminal register, said that he had no disciplinary record but was unable to answer questions until after they gave access to legal advice. [SEP] in december 1981, he was appointed chancellor of the university, and later, in 1986, a regular fellow at the university [SEP]"}
+{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, his predecessor, was removed under an emergency army rule. [SEP] this is a good decision so that it is more clear and effective. [SEP] western officials said at the opening session that mr karzai ' s brother, mr al - karzai ' s son, the director, houthi barzani - wali was present at the time of the blast, was released on sunday, after police demanded his arrest, the dawn newspaper reported. [SEP] sir michael powell, former head of the army and navy, was once a staff member of the george w. bush administration and is now [SEP]", "detok_text": "[CLS] president pervez musharraf, his predecessor, was removed under an emergency army rule. [SEP] this is a good decision so that it is more clear and effective. [SEP] western officials said at the opening session that mr karzai's brother, mr al - karzai's son, the director, houthi barzani - wali was present at the time of the blast, was released on sunday, after police demanded his arrest, the dawn newspaper reported. [SEP] sir michael powell, former head of the army and navy, was once a staff member of the george w. bush administration and is now [SEP]"}
+{"type": "sample", "index": 38, "raw_text": "[CLS] made to land in a car driven by his brother, who was walking away when the fire broke out in an open field near the spam hotel on the wrong side of the road. [SEP] he also dismissed claims that he was not a public figure who could be thought to have claimed to have been abused by a homeless person to get his money. [SEP] great article - - and, in fact, one crucial example. [SEP] government figures say the rise in cases means record numbers of abortions have been reported during the campaign. [SEP] the national front, the pdp, has been declared the winner, and the former prime minister, abdullah [SEP]", "detok_text": "[CLS] made to land in a car driven by his brother, who was walking away when the fire broke out in an open field near the spam hotel on the wrong side of the road. [SEP] he also dismissed claims that he was not a public figure who could be thought to have claimed to have been abused by a homeless person to get his money. [SEP] great article - - and, in fact, one crucial example. [SEP] government figures say the rise in cases means record numbers of abortions have been reported during the campaign. [SEP] the national front, the pdp, has been declared the winner, and the former prime minister, abdullah [SEP]"}
+{"type": "sample", "index": 39, "raw_text": "[CLS] the american football association. [SEP] under the scheme, a phone company can frighten you to buy the phone that can cost you and those looking to buy a card could make a payment. [SEP] four afghan insurgents were killed in a u. s. military helicopter crash during the campaign that destroyed hundreds of thousands of civilians and six insurgents hiding behind it. [SEP] more than 10, 000 children attend high - school lunch programs, more than 200 state schools and many others are facing food bills. [SEP] a police investigation has been launched after a firefighter has died at a house in lincolnshire. [SEP] president barack obama announced comprehensive reform for the health care [SEP]", "detok_text": "[CLS] the american football association. [SEP] under the scheme, a phone company can frighten you to buy the phone that can cost you and those looking to buy a card could make a payment. [SEP] four afghan insurgents were killed in a u. s. military helicopter crash during the campaign that destroyed hundreds of thousands of civilians and six insurgents hiding behind it. [SEP] more than 10, 000 children attend high - school lunch programs, more than 200 state schools and many others are facing food bills. [SEP] a police investigation has been launched after a firefighter has died at a house in lincolnshire. [SEP] president barack obama announced comprehensive reform for the health care [SEP]"}
+{"type": "sample", "index": 40, "raw_text": "[CLS] finals for the first time this year. [SEP] first, this had resulted in a massive pay - out - - but it was rejected by mps. [SEP] it has cut 700 jobs in the uk between april and april. [SEP] in the early sunday, over 100 people were found in collapsed or collapsed homes and three of those missing in the northwestern town of emu state. [SEP] georgia sent two combat troops on friday, the first time some 4, 500 troops were deployed to the area after fighting broke out in april. [SEP] just a few days later kazana blara announced she was looking to use public office just a few days [SEP]", "detok_text": "[CLS] finals for the first time this year. [SEP] first, this had resulted in a massive pay - out - - but it was rejected by mps. [SEP] it has cut 700 jobs in the uk between april and april. [SEP] in the early sunday, over 100 people were found in collapsed or collapsed homes and three of those missing in the northwestern town of emu state. [SEP] georgia sent two combat troops on friday, the first time some 4, 500 troops were deployed to the area after fighting broke out in april. [SEP] just a few days later kazana blara announced she was looking to use public office just a few days [SEP]"}
+{"type": "sample", "index": 41, "raw_text": "[CLS] court in january, and one of two charges was dropped. [SEP] she has read this. [SEP] he already lives in alaska. [SEP] the australian funds rate, including bank rates, hit a five - year high for the dollar, which closed 0. 75 per cent lower at 0. 7 per cent on thursday, after dropping below 5 at an 18 - month high yesterday. [SEP] residents can call 0800 984 - 0830, and offers free £11 - a - day parking. [SEP] the u. s. military on friday accused the nato - led force of staging an air assault sunday night, saying it would send a heavy [SEP]", "detok_text": "[CLS] court in january, and one of two charges was dropped. [SEP] she has read this. [SEP] he already lives in alaska. [SEP] the australian funds rate, including bank rates, hit a five - year high for the dollar, which closed 0. 75 per cent lower at 0. 7 per cent on thursday, after dropping below 5 at an 18 - month high yesterday. [SEP] residents can call 0800 984 - 0830, and offers free £11 - a - day parking. [SEP] the u. s. military on friday accused the nato - led force of staging an air assault sunday night, saying it would send a heavy [SEP]"}
+{"type": "sample", "index": 42, "raw_text": "[CLS] a big - screen show at the american pictures international film festival. [SEP] the legal authority developed by lord sir john burrell, who was appointed and by appointment as a deputy commissioner in 1992. [SEP] american michael phelps won his world record with an incompetent run in the 200 meters last night. [SEP] a few years ago, word emerged that blagojevich had launched a facebook campaign to raise money for the service. [SEP] \" i have made only one loan in five years. [SEP] this came after a teenager was also jailed for investigating the shooting of a woman in the dundee area. [SEP] the plan for the conservation area includes [SEP]", "detok_text": "[CLS] a big - screen show at the american pictures international film festival. [SEP] the legal authority developed by lord sir john burrell, who was appointed and by appointment as a deputy commissioner in 1992. [SEP] american michael phelps won his world record with an incompetent run in the 200 meters last night. [SEP] a few years ago, word emerged that blagojevich had launched a facebook campaign to raise money for the service. [SEP] \" i have made only one loan in five years. [SEP] this came after a teenager was also jailed for investigating the shooting of a woman in the dundee area. [SEP] the plan for the conservation area includes [SEP]"}
+{"type": "sample", "index": 43, "raw_text": "[CLS] has left town. [SEP] she had no regrets, but her up - and - down routine was not quick enough. [SEP] \" it was too thick, he could not swim out because he was in the pool nearby. [SEP] sir bob woodward, the force ' s chief forces officer, said he had hoped to issue a schedule for deployment in april. [SEP] \" those who know if there is any substance to this type of information were asked to back up up, \" he said. [SEP] all are good, and are asked to give customers a number of help they really feel they might need or need it out. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] has left town. [SEP] she had no regrets, but her up - and - down routine was not quick enough. [SEP] \"it was too thick, he could not swim out because he was in the pool nearby. [SEP] sir bob woodward, the force's chief forces officer, said he had hoped to issue a schedule for deployment in april. [SEP]\" those who know if there is any substance to this type of information were asked to back up up, \" he said. [SEP] all are good, and are asked to give customers a number of help they really feel they might need or need it out. [SEP] authorities have said the [SEP]"}
+{"type": "sample", "index": 44, "raw_text": "[CLS] after allowing him to exchange text messages during his prison days. [SEP] the pandas will travel to american zoos during and after the season. [SEP] by the time he got his interview, he had helped his family and friends across the world. [SEP] his wife and children were also questioned for links in the investigation and he in aruban custody. [SEP] the chinese government said it issued $ 1. 7 billion of gold on its reserves as china, the world ' s second - largest economy, reported a five - year - long decline in gold reserves on friday. [SEP] under a five - year deal in which the club will receive £3 [SEP]", "detok_text": "[CLS] after allowing him to exchange text messages during his prison days. [SEP] the pandas will travel to american zoos during and after the season. [SEP] by the time he got his interview, he had helped his family and friends across the world. [SEP] his wife and children were also questioned for links in the investigation and he in aruban custody. [SEP] the chinese government said it issued $1. 7 billion of gold on its reserves as china, the world's second - largest economy, reported a five - year - long decline in gold reserves on friday. [SEP] under a five - year deal in which the club will receive £3 [SEP]"}
+{"type": "sample", "index": 45, "raw_text": "[CLS] $ 80 to $ 90 per month. [SEP] his high - ranking deputy, circigio berto, said that it was not necessary for constitutional renewal of power in the country ' s parliament, seven years after mr. morales was suspended, offering all his colleagues the job. [SEP] there ' s also the growing range of local barbecue and pasta salads. [SEP] officials from the united nations, nato, china and russia each voiced their concerns, and last week u. s. sen carl m. levin ( d - mich. ) said that it was time for barack obama to take his post as president. [SEP] he was [SEP]", "detok_text": "[CLS] $80 to $90 per month. [SEP] his high - ranking deputy, circigio berto, said that it was not necessary for constitutional renewal of power in the country's parliament, seven years after mr. morales was suspended, offering all his colleagues the job. [SEP] there's also the growing range of local barbecue and pasta salads. [SEP] officials from the united nations, nato, china and russia each voiced their concerns, and last week u. s. sen carl m. levin (d - mich.) said that it was time for barack obama to take his post as president. [SEP] he was [SEP]"}
+{"type": "sample", "index": 46, "raw_text": "[CLS] to adapt, and a growing number of foreign workers has been eliminated through the recruitment process. [SEP] the bank paid the bonuses this year with total bonuses of $ 100, 000 and the current bonus package worth $ 250 million. [SEP] and he too has been advised to find that his family is out of control because of its problems. [SEP] gordon smith, who was the us commander in iraq, says he believed his country was responsible for their deaths. [SEP] a spokeswoman for its petrochina unit said that \" direct complaints \" were not made and the plant ' s co - operation had to be closed. [SEP] a strasbourg court [SEP]", "detok_text": "[CLS] to adapt, and a growing number of foreign workers has been eliminated through the recruitment process. [SEP] the bank paid the bonuses this year with total bonuses of $100, 000 and the current bonus package worth $250 million. [SEP] and he too has been advised to find that his family is out of control because of its problems. [SEP] gordon smith, who was the us commander in iraq, says he believed his country was responsible for their deaths. [SEP] a spokeswoman for its petrochina unit said that \"direct complaints\" were not made and the plant's co - operation had to be closed. [SEP] a strasbourg court [SEP]"}
+{"type": "sample", "index": 47, "raw_text": "[CLS] 2, 0 - 9 in the world cup games. [SEP] more than 100, 000 people died in a major earthquake off the coast of mexico in 2005. [SEP] the application is also being submitted to the meeting and the parliamentary health committee. [SEP] \" we have already taken the measures to ensure the spread of flu is linked to improving care, \" the hpc says, adding a further analysis is being carried out and the rest of the outbreak is likely to be confirmed. [SEP] he and his men served in the regular army and were sent to their homelands in iraq. [SEP] president obama pledged that he would consider whether to accept us forces [SEP]", "detok_text": "[CLS] 2, 0 - 9 in the world cup games. [SEP] more than 100, 000 people died in a major earthquake off the coast of mexico in 2005. [SEP] the application is also being submitted to the meeting and the parliamentary health committee. [SEP] \"we have already taken the measures to ensure the spread of flu is linked to improving care,\" the hpc says, adding a further analysis is being carried out and the rest of the outbreak is likely to be confirmed. [SEP] he and his men served in the regular army and were sent to their homelands in iraq. [SEP] president obama pledged that he would consider whether to accept us forces [SEP]"}
+{"type": "sample", "index": 48, "raw_text": "[CLS] local and state sponsored public schools in phoenix, los angeles and chicago. [SEP] the case should be closed before dec. [SEP] a trial heard that he had been rejected but was quashed for three months. [SEP] at the top of the taliban, they face the battle with afghanistan ' s pashtun in the south. [SEP] \" our manager ' s job to determine how it all happened to us, \" he said. [SEP] as one collector notes, \" he ' s kept going away for just about five years, \" he said. [SEP] the brazilian later returned to action as the second half played five minutes and seven minutes. [SEP] [SEP]", "detok_text": "[CLS] local and state sponsored public schools in phoenix, los angeles and chicago. [SEP] the case should be closed before dec. [SEP] a trial heard that he had been rejected but was quashed for three months. [SEP] at the top of the taliban, they face the battle with afghanistan's pashtun in the south. [SEP] \"our manager's job to determine how it all happened to us,\" he said. [SEP] as one collector notes, \"he's kept going away for just about five years,\" he said. [SEP] the brazilian later returned to action as the second half played five minutes and seven minutes. [SEP] [SEP]"}
+{"type": "sample", "index": 49, "raw_text": "[CLS] find homes, go out of business and take a hike into the second - quarter comfort zone. [SEP] investigators were later told to give a police interview. [SEP] that will make it even harder to vote in future elections. [SEP] he became a sensation and was nominated for the award for natural science in a fellowship at the national academy of sciences in london. [SEP] palin, sarah palin ' s 2008 vice presidential pick, launched a special inquiry into gov. palin ' s selection as the presidential candidate, almost three years before the end of the summer. [SEP] starting at 15, mayes joined a group of u. s. sailors [SEP]", "detok_text": "[CLS] find homes, go out of business and take a hike into the second - quarter comfort zone. [SEP] investigators were later told to give a police interview. [SEP] that will make it even harder to vote in future elections. [SEP] he became a sensation and was nominated for the award for natural science in a fellowship at the national academy of sciences in london. [SEP] palin, sarah palin's 2008 vice presidential pick, launched a special inquiry into gov. palin's selection as the presidential candidate, almost three years before the end of the summer. [SEP] starting at 15, mayes joined a group of u. s. sailors [SEP]"}
+{"type": "sample", "index": 50, "raw_text": "[CLS] as she said they had not heard of them. [SEP] a justice chief, deputy head of the domestic state committee and chief of national affairs were present when mr biden ' s speech was heard. [SEP] but mr manzanga said the current plan to legalise the practice is unsustainable. [SEP] bartoli is the no. 1 player to make the top three after last having to play first in the under - 21 open in april. [SEP] she met her husband when she had suffered from terminal cancer. [SEP] jones limped to a 2 - 3 fifth inning after losing control in the bottom. [SEP] grey ' s \" x [SEP]", "detok_text": "[CLS] as she said they had not heard of them. [SEP] a justice chief, deputy head of the domestic state committee and chief of national affairs were present when mr biden's speech was heard. [SEP] but mr manzanga said the current plan to legalise the practice is unsustainable. [SEP] bartoli is the no. 1 player to make the top three after last having to play first in the under - 21 open in april. [SEP] she met her husband when she had suffered from terminal cancer. [SEP] jones limped to a 2 - 3 fifth inning after losing control in the bottom. [SEP] grey's \" x [SEP]"}
+{"type": "sample", "index": 51, "raw_text": "[CLS] station, is to appear in magistrates ' court after an anti - drugs programme last week, with ms ross saying she wanted to drop out of the cast of the tonight show. [SEP] \" the first half of the year in 2008 had two quarters of negative economic growth in this recession. [SEP] let ' s not forget whether he would coach the team when they reach the nfl championship. [SEP] the inquiry report also calls for a new public standard for takeovers. [SEP] what we will all know is that at £35, a week, he was being denied, at the age of 50, an early pension and decent home pay. [SEP] the [SEP]", "detok_text": "[CLS] station, is to appear in magistrates' court after an anti - drugs programme last week, with ms ross saying she wanted to drop out of the cast of the tonight show. [SEP] \" the first half of the year in 2008 had two quarters of negative economic growth in this recession. [SEP] let's not forget whether he would coach the team when they reach the nfl championship. [SEP] the inquiry report also calls for a new public standard for takeovers. [SEP] what we will all know is that at £35, a week, he was being denied, at the age of 50, an early pension and decent home pay. [SEP] the [SEP]"}
+{"type": "sample", "index": 52, "raw_text": "[CLS] [SEP] the cause of the outbreak, so far, is still providing details about the state of the supply, he said. [SEP] seven days later, he became the longest running fiction writer for television. [SEP] he has been jailed in the uk after the election in 2001, and agreed to release under the law of torture. [SEP] brian billiton, who entered the final three races in a row, was in the field along with johnson. [SEP] he said there will be no increase in the annual tax rate for five months. [SEP] then i ' m more likely to have been hit more than i ever thought. [SEP] the study also found [SEP]", "detok_text": "[CLS] [SEP] the cause of the outbreak, so far, is still providing details about the state of the supply, he said. [SEP] seven days later, he became the longest running fiction writer for television. [SEP] he has been jailed in the uk after the election in 2001, and agreed to release under the law of torture. [SEP] brian billiton, who entered the final three races in a row, was in the field along with johnson. [SEP] he said there will be no increase in the annual tax rate for five months. [SEP] then i'm more likely to have been hit more than i ever thought. [SEP] the study also found [SEP]"}
+{"type": "sample", "index": 53, "raw_text": "[CLS] provide the final scoring opportunity in the 47th minute. [SEP] he says he hopes his client will sue the government so that they can do the same. [SEP] it ' s like a movie she ' s made. [SEP] he also asked john mcguinner, the scottish government ' s executive director, to set up a trust fund of more than £20m. [SEP] south africa will make their third tri six nations with a 32 - 17 win over new zealand, and will face the u. s. in june. [SEP] wal - mart was cautious after tuesday ' s fourth - quarter performance. [SEP] but if a baby dies a few [SEP]", "detok_text": "[CLS] provide the final scoring opportunity in the 47th minute. [SEP] he says he hopes his client will sue the government so that they can do the same. [SEP] it's like a movie she's made. [SEP] he also asked john mcguinner, the scottish government's executive director, to set up a trust fund of more than £20m. [SEP] south africa will make their third tri six nations with a 32 - 17 win over new zealand, and will face the u. s. in june. [SEP] wal - mart was cautious after tuesday's fourth - quarter performance. [SEP] but if a baby dies a few [SEP]"}
+{"type": "sample", "index": 54, "raw_text": "[CLS] percent over last year, in a year - earlier period when it stood at 2, 661. [SEP] meanwhile, the european central bank kept the main interest rate at its lowest level amid concerns of the high inflation in the euro zone. [SEP] it said its cost rise was nearly 6 %, which rose to 1, 300 in 2006. [SEP] notes : joe johnson has seven points. [SEP] that way, power to a new government, or any state, should be appointed. [SEP] he had already received a letter from the public health service ' s office and told officials about the existence of the plans. [SEP] the security systems were put off [SEP]", "detok_text": "[CLS] percent over last year, in a year - earlier period when it stood at 2, 661. [SEP] meanwhile, the european central bank kept the main interest rate at its lowest level amid concerns of the high inflation in the euro zone. [SEP] it said its cost rise was nearly 6 %, which rose to 1, 300 in 2006. [SEP] notes: joe johnson has seven points. [SEP] that way, power to a new government, or any state, should be appointed. [SEP] he had already received a letter from the public health service's office and told officials about the existence of the plans. [SEP] the security systems were put off [SEP]"}
+{"type": "sample", "index": 55, "raw_text": "[CLS] douglas huber and kevin spacey. [SEP] tomlinson, who lives in the maradona living room, asked what attracted his concern. [SEP] it takes time to take the first few months off when you would want to have a baby in your room sitting on the floor. [SEP] the financial cost of this case is very small. [SEP] celtic association legend john kelly says he could find himself in the hunt. [SEP] as a member of the pan - american advisory committee of the national trade and energy council and its foreign trade committee, hahn - chun ' s comments to north american scientists have long been consistent. [SEP] not so many americans [SEP]", "detok_text": "[CLS] douglas huber and kevin spacey. [SEP] tomlinson, who lives in the maradona living room, asked what attracted his concern. [SEP] it takes time to take the first few months off when you would want to have a baby in your room sitting on the floor. [SEP] the financial cost of this case is very small. [SEP] celtic association legend john kelly says he could find himself in the hunt. [SEP] as a member of the pan - american advisory committee of the national trade and energy council and its foreign trade committee, hahn - chun's comments to north american scientists have long been consistent. [SEP] not so many americans [SEP]"}
+{"type": "sample", "index": 56, "raw_text": "[CLS] months. [SEP] in line with the national service ' s plan, announced in april, the bbc is to be offering up to 1 million per - minute programmes for about 10 % of the digital audience. [SEP] the chief of police and chief of the national human security division, mullah mohammad qalinaza, were also wounded. [SEP] every year, while around 7, 000 americans die, there are now nearly 3. 9 million deaths per person, according to britain ' s institute of public health medicine. [SEP] he told police that the tape was a threat to one of his children. [SEP] mr. dean was not released named, [SEP]", "detok_text": "[CLS] months. [SEP] in line with the national service's plan, announced in april, the bbc is to be offering up to 1 million per - minute programmes for about 10 % of the digital audience. [SEP] the chief of police and chief of the national human security division, mullah mohammad qalinaza, were also wounded. [SEP] every year, while around 7, 000 americans die, there are now nearly 3. 9 million deaths per person, according to britain's institute of public health medicine. [SEP] he told police that the tape was a threat to one of his children. [SEP] mr. dean was not released named, [SEP]"}
+{"type": "sample", "index": 57, "raw_text": "[CLS] jail after serving nine months and a half of his sentence, and suspended for three years. [SEP] although, after serving in power in the late 1980s, the british officer joined his unit in august 1975, while mr colle had spent nearly 30 years in the royal armoured service division, he was involved in the mid - morning operations and late - night operations of the military. [SEP] it appears there are people working at other sites on the channel island. [SEP] the other young man was trapped on the house ' s roof. [SEP] mccain has moved on, and he has never been a candidate in the fall. [SEP] but it gave him the [SEP]", "detok_text": "[CLS] jail after serving nine months and a half of his sentence, and suspended for three years. [SEP] although, after serving in power in the late 1980s, the british officer joined his unit in august 1975, while mr colle had spent nearly 30 years in the royal armoured service division, he was involved in the mid - morning operations and late - night operations of the military. [SEP] it appears there are people working at other sites on the channel island. [SEP] the other young man was trapped on the house's roof. [SEP] mccain has moved on, and he has never been a candidate in the fall. [SEP] but it gave him the [SEP]"}
+{"type": "sample", "index": 58, "raw_text": "[CLS] the money went down. [SEP] the board was due to vote on this issue next january. [SEP] the pakistani government has denied opposition claims that western forces are pursuing the taliban in a major border clash. [SEP] i feel very happy to make them no more. [SEP] they don ' t know - - or can ' t have kids when they want to. [SEP] it is an attempt of a sense of purpose that is part of the european parliament within the european convention of human rights. [SEP] one of the good books, \" war on evil. \" [SEP] \" you can see i had the car down on the back to myself. [SEP] \" when [SEP]", "detok_text": "[CLS] the money went down. [SEP] the board was due to vote on this issue next january. [SEP] the pakistani government has denied opposition claims that western forces are pursuing the taliban in a major border clash. [SEP] i feel very happy to make them no more. [SEP] they don't know - - or can't have kids when they want to. [SEP] it is an attempt of a sense of purpose that is part of the european parliament within the european convention of human rights. [SEP] one of the good books, \"war on evil.\" [SEP] \"you can see i had the car down on the back to myself. [SEP]\" when [SEP]"}
+{"type": "sample", "index": 59, "raw_text": "[CLS] staff, met mr. bush in january. [SEP] please, avoid the adulterous garb. [SEP] last year ' s pre - tax profits fell more than 9 per cent as a result of a weak yen, led by weaker demand. [SEP] this is currently at about £300, 000 a year - - a profit of around 2p a day on a year ago instead of the 40p pay of £7. 8 billion. [SEP] police released a short - range missile and a local television station reported that two militants had been killed in the latest rocket attack. [SEP] consider the world ' s new best - in - class car [SEP]", "detok_text": "[CLS] staff, met mr. bush in january. [SEP] please, avoid the adulterous garb. [SEP] last year's pre - tax profits fell more than 9 per cent as a result of a weak yen, led by weaker demand. [SEP] this is currently at about £300, 000 a year - - a profit of around 2p a day on a year ago instead of the 40p pay of £7. 8 billion. [SEP] police released a short - range missile and a local television station reported that two militants had been killed in the latest rocket attack. [SEP] consider the world's new best - in - class car [SEP]"}
+{"type": "sample", "index": 60, "raw_text": "[CLS] t get enough to be angry, \" he wrote in his book, four days before he took a journalism course, declaring that an e. o. k. mandate would make the difference. [SEP] the u. s. - led coalition says at least 20 militants, most of them children, on both sides and the u. s. military said several taliban fighters were killed. [SEP] the militants ' forces lost their way, and the army said a soldier was killed when insurgents launched a land mine in the area. [SEP] i only went to the garden, and must have heard the french phrase, \" long gone. \" [SEP] in a [SEP]", "detok_text": "[CLS] t get enough to be angry, \"he wrote in his book, four days before he took a journalism course, declaring that an e. o. k. mandate would make the difference. [SEP] the u. s. - led coalition says at least 20 militants, most of them children, on both sides and the u. s. military said several taliban fighters were killed. [SEP] the militants' forces lost their way, and the army said a soldier was killed when insurgents launched a land mine in the area. [SEP] i only went to the garden, and must have heard the french phrase,\" long gone. \" [SEP] in a [SEP]"}
+{"type": "sample", "index": 61, "raw_text": "[CLS] and several years after his parents were involved in the crime - - disappeared for six hours on 23 may 2007. [SEP] three of them spent 15 years in britain ' s air force prison system and there was no indication that any changes in the command of the forces were made by bush because of his concern over the operational nature of their actions. [SEP] the social security and welfare services are expected to be discussed in the european parliament. [SEP] \" despite the fact that the base rate has risen, helped by recent rate cuts, the current base interest rate is not taking any hits, \" said richard shepherd, the mpc ' s chief economist, [SEP]", "detok_text": "[CLS] and several years after his parents were involved in the crime - - disappeared for six hours on 23 may 2007. [SEP] three of them spent 15 years in britain's air force prison system and there was no indication that any changes in the command of the forces were made by bush because of his concern over the operational nature of their actions. [SEP] the social security and welfare services are expected to be discussed in the european parliament. [SEP] \"despite the fact that the base rate has risen, helped by recent rate cuts, the current base interest rate is not taking any hits,\" said richard shepherd, the mpc's chief economist, [SEP]"}
+{"type": "sample", "index": 62, "raw_text": "[CLS]. [SEP] appearing in a programme - programme on bbc ' s morning live, mr morgan compared the achievements of sir james when he was a deputy bbc northern ireland in the 1990s. [SEP] several people were evacuated on other days of the course, she said. [SEP] the former episcopal school of meningia and king ' s college of new church in inverness and king ' s church is to be sold as part of the reorganisation of the national anglican church of scotland. [SEP] the two victims were later killed in an accident in france and spain. [SEP] they said six people have also contacted police to make dna evidence for him, and he is asking [SEP]", "detok_text": "[CLS]. [SEP] appearing in a programme - programme on bbc's morning live, mr morgan compared the achievements of sir james when he was a deputy bbc northern ireland in the 1990s. [SEP] several people were evacuated on other days of the course, she said. [SEP] the former episcopal school of meningia and king's college of new church in inverness and king's church is to be sold as part of the reorganisation of the national anglican church of scotland. [SEP] the two victims were later killed in an accident in france and spain. [SEP] they said six people have also contacted police to make dna evidence for him, and he is asking [SEP]"}
+{"type": "sample", "index": 63, "raw_text": "[CLS] 1968, died and was again five days later, appearing on the bbc programme for a series of non - programmes. [SEP] if your father had a problem with my son, why didn ' t he choose to do the thing? [SEP] boston won the pac - 10 series for the first time since 1992 before winning first - round games in chicago. [SEP] but mr. finke ' s successor, ben w. c. fleming, chairman of the bank and a member of the board, backed mr. morgan. [SEP] they appealed for help. [SEP] mr. chirac was also ousted after several years in office - - he was sworn in [SEP]", "detok_text": "[CLS] 1968, died and was again five days later, appearing on the bbc programme for a series of non - programmes. [SEP] if your father had a problem with my son, why didn't he choose to do the thing? [SEP] boston won the pac - 10 series for the first time since 1992 before winning first - round games in chicago. [SEP] but mr. finke's successor, ben w. c. fleming, chairman of the bank and a member of the board, backed mr. morgan. [SEP] they appealed for help. [SEP] mr. chirac was also ousted after several years in office - - he was sworn in [SEP]"}

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p12_top64_detok_raw_samples.txt

@@ -0,0 +1,236 @@
+const_thrs_tau0p12_top64_detok
+{
+  "type": "summary",
+  "name": "const_thrs_tau0p12_top64",
+  "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt",
+  "step": 200000,
+  "decode": {
+    "kind": "categorical_fullvocab_final_sampling_push43",
+    "config": "const_thrs_tau0p12_top64",
+    "steps": 128,
+    "temp_start": 1.45,
+    "temp_end": 1.45,
+    "temp_schedule": "const",
+    "t_power": 1.0,
+    "eta0": 0.12,
+    "eta_schedule": "early_cosine",
+    "noise_conc": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "final_mode": "threshold_sample",
+    "final_temp": 1.0,
+    "top_k": 64,
+    "top_p": 0.0,
+    "uniform_mix": 0.0,
+    "sample_threshold": 0.12,
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 41.80839195562669,
+    "nll_per_token": 3.7330970838688944,
+    "tokens": 9725
+  },
+  "diversity": {
+    "sample_entropy": 4.204396875108297,
+    "unique_tokens": 1943,
+    "token_count": 8192,
+    "distinct_1": 0.2371826171875,
+    "distinct_2": 0.7140748031496063,
+    "top_token_mass": 0.0560302734375
+  }
+}
+
+===== sample 000 =====
+[CLS] the president will have to win in the next election. [SEP] it also announced bad results at some of the world's biggest credit - card companies and stripped out $6. 7 billion in the fourth quarter. [SEP] it can be due to the increased labour requirements and the change in demand, it says. [SEP] "we're very involved in policing schools, roads and buildings and we're working all over london to find incidents like this," he said. [SEP] i had a good record and i was doing his best. [SEP] washington - - attorney general michael ki. moon's appointment as a former u. n. [SEP]
+
+===== sample 001 =====
+[CLS] star, singer michael russell, has been asked to increase his licence. [SEP] the fall is a good time in school. [SEP] had he sent his dog to buy his own car, the money would have gone. [SEP] in an interview, a senior official said the senator had refused to accept donations. [SEP] tougher guy. [SEP] the defence said that the incident was a breach of procedures made by the ministry of defence's specialist civil investigations department in 2002. [SEP] more consumers can visit or join the website and be reached at www. medgreent. com /. [SEP] for more information on iridium, visit the data center. [SEP]
+
+===== sample 002 =====
+[CLS] wouldn't be a good idea to carry out a thorough review. [SEP] at a meeting on friday, the company's board voted overwhelmingly in support of president obama's plans in iraq for the next six months, leaving at least $200 billion over two months of war time. [SEP] no, he didn't know all the extra money. [SEP] the proposed changes would undermine the core of the state's constitutional law. [SEP] the spokesman said both sides would defend themselves as a matter of urgency. [SEP] during these opecunic events, many teachers, teachers, teachers and volunteers accompany men to the gym, and often [SEP]
+
+===== sample 003 =====
+[CLS]swoman said prosecutors pursuing the case had no knowledge of the killings, and he might initiate a criminal investigation. [SEP] for the first time in a year, analysts have also warned that xstran may be worth more than the current $3 billion of debt. [SEP] police officers were being pushed at the door of houses where the killing took place. [SEP] it provides travel and family services run by international travel company british travel (020 78777; www. explore. co. uk), revenue & customs holidays (020 730000) and hotels and holidaymakers. [SEP] in the eight weeks since the crisis broke [SEP]
+
+===== sample 004 =====
+[CLS], oversee the iraqi security forces, and provide security for american and iraqi forces. [SEP] these could be added when they return to the commons in the capital. [SEP] "the situation is that it will be improved," he said. [SEP] "normally, ideally, people would see it later in the next month, doing it at least once a month," said johnson. [SEP] in may, bill murray voluntarily received a mental health treatment, according to a report by his north carolina office. [SEP] but eight people have been killed by police in the region. [SEP] and having won the british olympic and european cup titles in 2003, and second [SEP]
+
+===== sample 005 =====
+[CLS] civilian judges, acting as the court of appeal. [SEP] at the busy railway station, the pilot collapsed in the rain in the early hours of the morning. [SEP] i lost my job because some people just lost, "and it was followed by the long days of three to four hours. [SEP] david dungy, a spokesman for the sheriff's department, has said the prison chief believes the drug enforcement campaign could reduce the number of drug - related crime in the region. [SEP] he crawled out of the car, with his head covered in a blanket, then tried to wave it back to finish in a safe position. [SEP]" it [SEP]
+
+===== sample 006 =====
+[CLS] prosecutors in the mclelland case review the federal grand jury's findings and report into the death of stephen baker, whose body was discovered on march 2. [SEP] the government's last decision on the use of force was in 2007. [SEP] the children were taken from a school in sudbury, cambridgeshire, a week before 2200 bst that evening. [SEP] people in the midlands and surrounding areas have also taken part in extreme weather events. [SEP] it is also offering a working mortgage benefit scheme likely to cost £6 a week, starting at £345 a week. [SEP] if you can't imagine texting a baby, or [SEP]
+
+===== sample 007 =====
+[CLS] receive a guaranteed bonus of $4, 000 - - and paid full - time each month. [SEP] many fear water supplies hold up to their power facilities as they prepare for a strong storm. [SEP] i could not believe that he would ever get a bank loan. [SEP] he was fired, spokeswoman said. [SEP] " i'll tell you today, he's much more effective than now. [SEP] these institutions are not entirely strangers; they can choose their own ways. [SEP] jones said he met with the defense minister, gen. jaullah mujahid, to discuss plans to push taliban militants from the eastern province of [SEP]
+
+===== sample 008 =====
+[CLS] the shooting is more likely to be the case. [SEP] an assistant is governor of alan s. rice of minnesota and the future administrator of the commission. [SEP] on wednesday, google co inc (goo. o), microsoft corp (ms. n), google inc ( gooft. o, microsoft inc's top customer, and electric co inc (ge. nx: quote, profile, research, stock buzz) have announced plans to put net sales of $3. 5 billion into securities trading securities related to the accounting charges. [SEP] this is an entirely new part of politics. [SEP] there was a sense among the public [SEP]
+
+===== sample 009 =====
+[CLS] pakistan chief is believed to be the leading mastermind of the attacks. [SEP] but after a few weeks i stayed at my sister's home until it moved off. [SEP] sir mark, the long - retired air force officer of royal navy air, became the only aircraft carrier to have flown through the mediterranean to carry on his war plans for scotland. [SEP] posada was involved in three federal crimes, and was brought in a matter of months ago. [SEP] a month is usually "on track" for about 10 million dollars. [SEP] in 2003, microsoft refused to make a takeover bid. [SEP] the u. s. navy has launched [SEP]
+
+===== sample 010 =====
+[CLS] air, was deputy leader in russia's mi - 1 programme, and built russia's mirov ballistic missiles in addition to russia's first nuclear system. [SEP] jacksonville, fla. - the florida house said wednesday they passed a bill that ended the war four years ago, followed by a vote friday that would limit president obama's 10 - year - old build - up of the 550 us troops in iraq and 4, 000 troops in afghanistan. [SEP] district attorney william mccready asked the witness to testify in his testimony and later dismissed the suit. [SEP] in iowa, 34 per cent of democratic voters in the state [SEP]
+
+===== sample 011 =====
+[CLS] bank had not paid in mortgage charges, it was thought it would pay back about £54m in the quarter, which is due in full 2010. [SEP] i flew back to miami on an airlines flight. [SEP] the metropolitan police force has been investigated by three detectives and two other police officers in connection with the investigation. [SEP] the former republican presidential nominee often said the 2008 democratic presidential nominee was the father of u. s. president george w. bush's failed campaign. [SEP] it has been decided that stock, which may be worthless, may have been short - selling ordinary shares. [SEP] they cut off our electricity. [SEP] i ' [SEP]
+
+===== sample 012 =====
+[CLS] 17 minutes remaining. [SEP] he also began working on wednesday and is mailing an internal psychiatric report. [SEP] the taliban have said in a statement following a meeting between the top leaders of the international human rights committee and the human rights council that there would be no international charges of violations against civilians. [SEP] b - 3 did not answer telephone calls for this article in april, the washington tribune reported. [SEP] but he is probably likely to find ground. [SEP] this ice will melt, and this won't be for long until you get water. [SEP] " the difference between being a husband and being a mother now is clear. [SEP] but what [SEP]
+
+===== sample 013 =====
+[CLS] slomping down the street for a coffee lunch. [SEP] on saturday, fa executive chairman pat wright said: "this is a deeply serious accident and she understood the allegations were being investigated by this side. [SEP] the television and radio station has also launched a local programme that includes many of its regular programmes including daytime tv times and evening and evening news. [SEP] omar al - karzai was allegedly married to his mother and cousin when she was accused of killing her daughter and then forcing authorities to kill her, her family said. [SEP] but senate aides said the department's report will not have historical significance and that" if law [SEP]
+
+===== sample 014 =====
+[CLS] a harvard student in college, was trying to come up with some sort of new idea. [SEP] nato officials said tuesday that the special representative to the u. n. security council on the 15 - nation council on afghanistan has staked the support of his staff members in a dispute with kabul over the proposed new law. [SEP] he has has been charged with blagevich's attempted murder. [SEP] in winter weeks, it was wet in the cold, but the area was infested with mud and cold soil. [SEP] " when a e - mail or email address is sent to someone at birth, which i don't know [SEP]
+
+===== sample 015 =====
+[CLS] dead body in the pool at the school. [SEP] he joined the board in may 1958, retiring as a graduate professor at the university's college of management, where he was named a member of harvard medical school and chairman of the m. l. a. and of the international institute for health and health policy. [SEP] "they want to... [SEP] he says that he" has a lot of great points, "but that he knows it is" very good " and does not believe this. [SEP] for all this time, it was in iceland's interest of nationalising its financial sector, and, of course, [SEP]
+
+===== sample 016 =====
+[CLS] absence of any allegations of corruption in the legal system. [SEP] during the downturn, it was unclear what his life to do with his company. [SEP] in 1969, just three years after leaving as chairman of the club, he became the first individual football figure to conceive in the club's executive management. [SEP] mr shapiro, who has served as a top banker at toyota in the past for 13 years as the chairman of the company's board, has made a $3 million management package. [SEP] it was claimed the man took the phone while allegedly sending the phone message to his wife. [SEP] " there is no sense [SEP]
+
+===== sample 017 =====
+[CLS] alaska's polar bears remain the most important source of information in the arctic area, and a significant source of the breeding population in the western arctic ice area. [SEP] soon after israel took over the presidency - - and a fifth head of state - - of the national arab university in 2005, israel's education department revoked its accreditation program. [SEP] but he has no doubt michael jones, the director of his new military team, will be meeting with the current head of the government. [SEP] officers said they took them to hospital for medical attention, but reported concerns about the identity of the man. [SEP] " it's an early day [SEP]
+
+===== sample 018 =====
+[CLS] [SEP] i was at 14, aged only 15 when i turned 15 when i was 22, and i became aware of the need for more breathing time and this was the first time i had ever seen a particular level of interest. [SEP] one good dream for parents was to arrive at a post - office breakfast in the morning. [SEP] it might now make a zero percent interest rate cut, which is already the fastest rate cut in more than half a century. [SEP] he needs to say this. [SEP] the incident was reported to south wales police in swomford road at 2200 bst on tuesday, police said. [SEP] but we ' [SEP]
+
+===== sample 019 =====
+[CLS] rise of new zealand's fast food. [SEP] in the early war his firm was based in brecon, preselbury, and it was in westminster, highgate hill and cwmbran, where i turned up in the second row of hill houses, in edinburgh in 1975. [SEP] sir paul rose was appointed chairman of the met at the age of 81 for £2. 3 million but was paid £69, 000 in salary. [SEP] there are two good things in football. [SEP] he'd scored 16 points to help seattle give the league its first win of the regular season. [SEP] pakistan's authorities are saying [SEP]
+
+===== sample 020 =====
+[CLS] public freedom. " [SEP] private sales opened last week at $12. 3m. [SEP] he said the decision before the new parliament is expected to make it a second session to parliament. [SEP] gordon - brown has been organized by the national museum of natural history. [SEP] the average rate again rises to 5. 3 points, falling to a peak of 5. 7 per cent in july, while the average rate on three year loans fell from 2. 7 per cent to 4. 5 per cent earlier in the year. [SEP] that's what is an american school of american cooking, just as it's all about high - tech [SEP]
+
+===== sample 021 =====
+[CLS] one of them. [SEP] in 1989, the kazlin democratic party of the anti - soviet union leader and finance chief, nikita khrushchev, launched a military campaign to stop attacks on the ussr in europe. [SEP] mr horwood, 29, was arrested friday, was granted bail but was released last month while the case was re - examined. [SEP] i'm a singer for several years. [SEP] 5, citing police officers. [SEP] experts say banks need to wait 10 days of payment of the cards but there may be a time when they are being forced to pay interest. [SEP] the story is still considered an accurate indicator [SEP]
+
+===== sample 022 =====
+[CLS] be able to bring our soldiers into action, "said col. david caldwell, vice chief for the u. s. air and air force. [SEP] the french army has more than 400 soldiers at more than 6, 000. [SEP] dein said:" he's an added bonus to losing his team, but he can show that it can be done with live action, especially with steven jones. [SEP] police are pursuing a call for a man's arrest in connection with the murder of the 21 - year - old briton at a police station. [SEP] gen. pervez mullen, at a news conference tuesday, said [SEP]
+
+===== sample 023 =====
+[CLS] appeared in the oct. [SEP] some nato commanders in afghanistan have asked for the speed and deployment of most of the 21, 000 troops now already there. [SEP] the teenager was released on bail and bailed out following a review of the case. [SEP] he died, in 2003, but he was never able to die. [SEP] in november 2007, reflecting abundant demand in china and india, global demand for crude products more than doubled a month. [SEP] subs: hudson, fletcher, wolsay, langfield, coker, lovenk, fletcher, baird, banks, fletcher, lawes, fletcher, coker, healy, [SEP]
+
+===== sample 024 =====
+[CLS] williams, the club's executive chairman. [SEP] more than 1, 000 women who lost weight in 2007 have been in the uk since 2000, according to a national survey. [SEP] i like the sound of the song. [SEP] the public prosecutor later refused to open the investigation, though campbell's attorney said no formal charges have been filed, the times of london reported. [SEP] a change of heart. [SEP] "we entered an open area and the driver opened a side door and then tried to get under the car as it happened while driving," he said. [SEP] the army also plans to buy about 300, 000 cases of the [SEP]
+
+===== sample 025 =====
+[CLS] by 10 per cent. [SEP] that's all even more so, in their view, as they don't speak to their children. [SEP] the lakers didn't risk a loss when andrej o, a backup who had six points in four regular seasons, took a poor win against dallas and spent at least 20 minutes sitting on his left leg. [SEP] chris snyder's two - run homer in the eighth and the first two runs made it 4 - 5. [SEP] they also help find evidence of what happened during a bonfire in the area on thursday. [SEP] he is still miles away from using the internet as a social service [SEP]
+
+===== sample 026 =====
+[CLS] up on his efforts to repeal the new people's law, which he says was never approved by the house and has said he will get the bill before christmas, but he opted instead to give up public responsibility for the election. [SEP] the local intelligence service had recently confirmed that the army in the area had killed militants. [SEP] it might not be the morning after that. [SEP] but his playing days were, for many, a clarion call for football this season. [SEP] she could also sell wineries and telephone jackpots on the restaurant's main floor in the island's northern corner. [SEP] little rock, ark. [SEP]
+
+===== sample 027 =====
+[CLS] arrested on various charges, but they did not give a further date. [SEP] meanwhile, it's not so bad that all - rounders vaughan and swaner had already had to settle for one on the second morning in the second test. [SEP] najibullah - mujahid was under surveillance when police responded to his house after surrendering to his apartment by his security forces and security services, the times said. [SEP] the public inquiry team was unable to complete a report in both cases. [SEP] an actor in india who became the world's top indian film director has taken charge of the country's budget, dropping his [SEP]
+
+===== sample 028 =====
+[CLS]. [SEP] her father was trapped in the front yard. [SEP] as the firefights started, people began beating up on the floor, hearing noises, an answer that was denied. [SEP] the group said the review would not be completed before the end of the current financial year and could be for a full year. [SEP] authorities reported the crash, 40 hours after a helicopter crash on the washington river. [SEP] it's always easy for both men to leave behind their job. [SEP] it was the first time former president nawaz sharif was available to comment. [SEP] that was to say the thrust of the series; yes, he was [SEP]
+
+===== sample 029 =====
+[CLS] are less likely to still need surgery following radical heart surgery, according to the group. [SEP] what a disgrace. [SEP] noose, the largest and most important of the leaders of the jewish state of israel, is still buried in the sanctuary of the middle eastern city of jerusalem, where st. john's was still buried long after his death in 2 1/2 years ago. [SEP] it is the final day of parliament and the prime minister's funeral. [SEP] the latest case has affected anyone under 18 and it was closed shortly after the crash incident. [SEP] (ap) - - craig johnson held up his lead and was good [SEP]
+
+===== sample 030 =====
+[CLS] and you can find us and have real fun. [SEP] the visitors again appeared to settle for a scoreless goal late in the second half. [SEP] mr winehouse was arrested in 1992 and later ran the child law enforcement office established in the 1990s. [SEP] he took advantage of his lack of vision, going back for treatment. [SEP] the case is expected to be heard before the general election in july 2009. [SEP] during the summer, he has to walk more leisurely. [SEP] the state of the afghan economy has been a key element of public support and support in afghanistan's recent election, given " today's announcement that the taliban [SEP]
+
+===== sample 031 =====
+[CLS] telephone at + 800 - 877 - 2526, or 617 - 213 - 2535. w. baird & co. interested listeners should visit the company's investor relations website (www. wthrewcorp. com) to listen via the web at 8003 - 1009 or + 919 798969 for a conference call, and enter pass code 86670998. access pass code 907771. www. dresser. net. com. is available by telephone from the u. s. relations section or calling on 0800 858989. [SEP] it was [SEP]
+
+===== sample 032 =====
+[CLS] charges, had been dismissed because of his involvement in federal criminal investigations. [SEP] the longer the military takes power, the more danger becomes. [SEP] now i don't know, but i thought it could last months and years, just in the middle of a big one. [SEP] police in the state have said they have no knowledge of his conduct. [SEP] christopher heilwood, 30, and his brother, gregory have been arrested following an incident between two youths at the store in abbey road, northampton, on saturday. [SEP] the authority said it had saved about $100m through a payment system called the public service system ( csr [SEP]
+
+===== sample 033 =====
+[CLS] murder and the assault was with one of the officers, authorities have said. [SEP] the finance ministry said the company had a plan to sell german products, but said it could put up many bidders for such brands. [SEP] but he denies that he has accused president zardari and others of compliciting in the election, and that he has not warned his citizens against raising confidence in the government. [SEP] that was an essential goal, she said, and it seemed that their relationship was taking on her new life. [SEP] 3, but the standard of living is likely to continue to drop. [SEP] it is a 50 - year [SEP]
+
+===== sample 034 =====
+[CLS] mr brown said it was not simply a very bad social housing regime. [SEP] his successor, gen mullah muzi, was promoted to power when he received a british passport in 2001. [SEP] there is also a sense that the experience of his death in the 1980s was the day of great "education." [SEP] i don't remember the music, but i listen to the world. [SEP] currently, he is a two - year member of the company's board. [SEP] born in 1992, texas tech has never been made the a. c. a. a. tournament again in three years. [SEP] bill clinton's campaign [SEP]
+
+===== sample 035 =====
+[CLS]. [SEP] we do not need a laptop. [SEP] just three months ago, johnson was part of the team that felt the problem. [SEP] " you're not able to get work, you're out of the workforce. [SEP] in 2009, gen. john gallimer and three co - defendants issued the district court order overturning the convictions of judge richard addington, who refused to testify in the case. [SEP] after the election, mr anwar announced that his brother had ended a management role in his charge of the police service of the state. [SEP] expect to see something similar again in the year, when the census of [SEP]
+
+===== sample 036 =====
+[CLS] to its requirements. [SEP] in september, japan they lost 0. 7 per cent. [SEP] they have given no details of their raids. [SEP] this is also a very serious issue. [SEP] david wilson, head of communication at the prison service trust union, said: " it's a bit of a complete loss of confidence and confidence. [SEP] the officer, who is approved by the criminal register, said that he had no disciplinary record but was unable to answer questions until after they gave access to legal advice. [SEP] in december 1981, he was appointed chancellor of the university, and later, in 1986, a regular fellow at the university [SEP]
+
+===== sample 037 =====
+[CLS] president pervez musharraf, his predecessor, was removed under an emergency army rule. [SEP] this is a good decision so that it is more clear and effective. [SEP] western officials said at the opening session that mr karzai's brother, mr al - karzai's son, the director, houthi barzani - wali was present at the time of the blast, was released on sunday, after police demanded his arrest, the dawn newspaper reported. [SEP] sir michael powell, former head of the army and navy, was once a staff member of the george w. bush administration and is now [SEP]
+
+===== sample 038 =====
+[CLS] made to land in a car driven by his brother, who was walking away when the fire broke out in an open field near the spam hotel on the wrong side of the road. [SEP] he also dismissed claims that he was not a public figure who could be thought to have claimed to have been abused by a homeless person to get his money. [SEP] great article - - and, in fact, one crucial example. [SEP] government figures say the rise in cases means record numbers of abortions have been reported during the campaign. [SEP] the national front, the pdp, has been declared the winner, and the former prime minister, abdullah [SEP]
+
+===== sample 039 =====
+[CLS] the american football association. [SEP] under the scheme, a phone company can frighten you to buy the phone that can cost you and those looking to buy a card could make a payment. [SEP] four afghan insurgents were killed in a u. s. military helicopter crash during the campaign that destroyed hundreds of thousands of civilians and six insurgents hiding behind it. [SEP] more than 10, 000 children attend high - school lunch programs, more than 200 state schools and many others are facing food bills. [SEP] a police investigation has been launched after a firefighter has died at a house in lincolnshire. [SEP] president barack obama announced comprehensive reform for the health care [SEP]
+
+===== sample 040 =====
+[CLS] finals for the first time this year. [SEP] first, this had resulted in a massive pay - out - - but it was rejected by mps. [SEP] it has cut 700 jobs in the uk between april and april. [SEP] in the early sunday, over 100 people were found in collapsed or collapsed homes and three of those missing in the northwestern town of emu state. [SEP] georgia sent two combat troops on friday, the first time some 4, 500 troops were deployed to the area after fighting broke out in april. [SEP] just a few days later kazana blara announced she was looking to use public office just a few days [SEP]
+
+===== sample 041 =====
+[CLS] court in january, and one of two charges was dropped. [SEP] she has read this. [SEP] he already lives in alaska. [SEP] the australian funds rate, including bank rates, hit a five - year high for the dollar, which closed 0. 75 per cent lower at 0. 7 per cent on thursday, after dropping below 5 at an 18 - month high yesterday. [SEP] residents can call 0800 984 - 0830, and offers free £11 - a - day parking. [SEP] the u. s. military on friday accused the nato - led force of staging an air assault sunday night, saying it would send a heavy [SEP]
+
+===== sample 042 =====
+[CLS] a big - screen show at the american pictures international film festival. [SEP] the legal authority developed by lord sir john burrell, who was appointed and by appointment as a deputy commissioner in 1992. [SEP] american michael phelps won his world record with an incompetent run in the 200 meters last night. [SEP] a few years ago, word emerged that blagojevich had launched a facebook campaign to raise money for the service. [SEP] " i have made only one loan in five years. [SEP] this came after a teenager was also jailed for investigating the shooting of a woman in the dundee area. [SEP] the plan for the conservation area includes [SEP]
+
+===== sample 043 =====
+[CLS] has left town. [SEP] she had no regrets, but her up - and - down routine was not quick enough. [SEP] "it was too thick, he could not swim out because he was in the pool nearby. [SEP] sir bob woodward, the force's chief forces officer, said he had hoped to issue a schedule for deployment in april. [SEP]" those who know if there is any substance to this type of information were asked to back up up, " he said. [SEP] all are good, and are asked to give customers a number of help they really feel they might need or need it out. [SEP] authorities have said the [SEP]
+
+===== sample 044 =====
+[CLS] after allowing him to exchange text messages during his prison days. [SEP] the pandas will travel to american zoos during and after the season. [SEP] by the time he got his interview, he had helped his family and friends across the world. [SEP] his wife and children were also questioned for links in the investigation and he in aruban custody. [SEP] the chinese government said it issued $1. 7 billion of gold on its reserves as china, the world's second - largest economy, reported a five - year - long decline in gold reserves on friday. [SEP] under a five - year deal in which the club will receive £3 [SEP]
+
+===== sample 045 =====
+[CLS] $80 to $90 per month. [SEP] his high - ranking deputy, circigio berto, said that it was not necessary for constitutional renewal of power in the country's parliament, seven years after mr. morales was suspended, offering all his colleagues the job. [SEP] there's also the growing range of local barbecue and pasta salads. [SEP] officials from the united nations, nato, china and russia each voiced their concerns, and last week u. s. sen carl m. levin (d - mich.) said that it was time for barack obama to take his post as president. [SEP] he was [SEP]
+
+===== sample 046 =====
+[CLS] to adapt, and a growing number of foreign workers has been eliminated through the recruitment process. [SEP] the bank paid the bonuses this year with total bonuses of $100, 000 and the current bonus package worth $250 million. [SEP] and he too has been advised to find that his family is out of control because of its problems. [SEP] gordon smith, who was the us commander in iraq, says he believed his country was responsible for their deaths. [SEP] a spokeswoman for its petrochina unit said that "direct complaints" were not made and the plant's co - operation had to be closed. [SEP] a strasbourg court [SEP]
+
+===== sample 047 =====
+[CLS] 2, 0 - 9 in the world cup games. [SEP] more than 100, 000 people died in a major earthquake off the coast of mexico in 2005. [SEP] the application is also being submitted to the meeting and the parliamentary health committee. [SEP] "we have already taken the measures to ensure the spread of flu is linked to improving care," the hpc says, adding a further analysis is being carried out and the rest of the outbreak is likely to be confirmed. [SEP] he and his men served in the regular army and were sent to their homelands in iraq. [SEP] president obama pledged that he would consider whether to accept us forces [SEP]
+
+===== sample 048 =====
+[CLS] local and state sponsored public schools in phoenix, los angeles and chicago. [SEP] the case should be closed before dec. [SEP] a trial heard that he had been rejected but was quashed for three months. [SEP] at the top of the taliban, they face the battle with afghanistan's pashtun in the south. [SEP] "our manager's job to determine how it all happened to us," he said. [SEP] as one collector notes, "he's kept going away for just about five years," he said. [SEP] the brazilian later returned to action as the second half played five minutes and seven minutes. [SEP] [SEP]
+
+===== sample 049 =====
+[CLS] find homes, go out of business and take a hike into the second - quarter comfort zone. [SEP] investigators were later told to give a police interview. [SEP] that will make it even harder to vote in future elections. [SEP] he became a sensation and was nominated for the award for natural science in a fellowship at the national academy of sciences in london. [SEP] palin, sarah palin's 2008 vice presidential pick, launched a special inquiry into gov. palin's selection as the presidential candidate, almost three years before the end of the summer. [SEP] starting at 15, mayes joined a group of u. s. sailors [SEP]
+
+===== sample 050 =====
+[CLS] as she said they had not heard of them. [SEP] a justice chief, deputy head of the domestic state committee and chief of national affairs were present when mr biden's speech was heard. [SEP] but mr manzanga said the current plan to legalise the practice is unsustainable. [SEP] bartoli is the no. 1 player to make the top three after last having to play first in the under - 21 open in april. [SEP] she met her husband when she had suffered from terminal cancer. [SEP] jones limped to a 2 - 3 fifth inning after losing control in the bottom. [SEP] grey's " x [SEP]
+
+===== sample 051 =====
+[CLS] station, is to appear in magistrates' court after an anti - drugs programme last week, with ms ross saying she wanted to drop out of the cast of the tonight show. [SEP] " the first half of the year in 2008 had two quarters of negative economic growth in this recession. [SEP] let's not forget whether he would coach the team when they reach the nfl championship. [SEP] the inquiry report also calls for a new public standard for takeovers. [SEP] what we will all know is that at £35, a week, he was being denied, at the age of 50, an early pension and decent home pay. [SEP] the [SEP]
+
+===== sample 052 =====
+[CLS] [SEP] the cause of the outbreak, so far, is still providing details about the state of the supply, he said. [SEP] seven days later, he became the longest running fiction writer for television. [SEP] he has been jailed in the uk after the election in 2001, and agreed to release under the law of torture. [SEP] brian billiton, who entered the final three races in a row, was in the field along with johnson. [SEP] he said there will be no increase in the annual tax rate for five months. [SEP] then i'm more likely to have been hit more than i ever thought. [SEP] the study also found [SEP]
+
+===== sample 053 =====
+[CLS] provide the final scoring opportunity in the 47th minute. [SEP] he says he hopes his client will sue the government so that they can do the same. [SEP] it's like a movie she's made. [SEP] he also asked john mcguinner, the scottish government's executive director, to set up a trust fund of more than £20m. [SEP] south africa will make their third tri six nations with a 32 - 17 win over new zealand, and will face the u. s. in june. [SEP] wal - mart was cautious after tuesday's fourth - quarter performance. [SEP] but if a baby dies a few [SEP]
+
+===== sample 054 =====
+[CLS] percent over last year, in a year - earlier period when it stood at 2, 661. [SEP] meanwhile, the european central bank kept the main interest rate at its lowest level amid concerns of the high inflation in the euro zone. [SEP] it said its cost rise was nearly 6 %, which rose to 1, 300 in 2006. [SEP] notes: joe johnson has seven points. [SEP] that way, power to a new government, or any state, should be appointed. [SEP] he had already received a letter from the public health service's office and told officials about the existence of the plans. [SEP] the security systems were put off [SEP]
+
+===== sample 055 =====
+[CLS] douglas huber and kevin spacey. [SEP] tomlinson, who lives in the maradona living room, asked what attracted his concern. [SEP] it takes time to take the first few months off when you would want to have a baby in your room sitting on the floor. [SEP] the financial cost of this case is very small. [SEP] celtic association legend john kelly says he could find himself in the hunt. [SEP] as a member of the pan - american advisory committee of the national trade and energy council and its foreign trade committee, hahn - chun's comments to north american scientists have long been consistent. [SEP] not so many americans [SEP]
+
+===== sample 056 =====
+[CLS] months. [SEP] in line with the national service's plan, announced in april, the bbc is to be offering up to 1 million per - minute programmes for about 10 % of the digital audience. [SEP] the chief of police and chief of the national human security division, mullah mohammad qalinaza, were also wounded. [SEP] every year, while around 7, 000 americans die, there are now nearly 3. 9 million deaths per person, according to britain's institute of public health medicine. [SEP] he told police that the tape was a threat to one of his children. [SEP] mr. dean was not released named, [SEP]
+
+===== sample 057 =====
+[CLS] jail after serving nine months and a half of his sentence, and suspended for three years. [SEP] although, after serving in power in the late 1980s, the british officer joined his unit in august 1975, while mr colle had spent nearly 30 years in the royal armoured service division, he was involved in the mid - morning operations and late - night operations of the military. [SEP] it appears there are people working at other sites on the channel island. [SEP] the other young man was trapped on the house's roof. [SEP] mccain has moved on, and he has never been a candidate in the fall. [SEP] but it gave him the [SEP]
+
+===== sample 058 =====
+[CLS] the money went down. [SEP] the board was due to vote on this issue next january. [SEP] the pakistani government has denied opposition claims that western forces are pursuing the taliban in a major border clash. [SEP] i feel very happy to make them no more. [SEP] they don't know - - or can't have kids when they want to. [SEP] it is an attempt of a sense of purpose that is part of the european parliament within the european convention of human rights. [SEP] one of the good books, "war on evil." [SEP] "you can see i had the car down on the back to myself. [SEP]" when [SEP]
+
+===== sample 059 =====
+[CLS] staff, met mr. bush in january. [SEP] please, avoid the adulterous garb. [SEP] last year's pre - tax profits fell more than 9 per cent as a result of a weak yen, led by weaker demand. [SEP] this is currently at about £300, 000 a year - - a profit of around 2p a day on a year ago instead of the 40p pay of £7. 8 billion. [SEP] police released a short - range missile and a local television station reported that two militants had been killed in the latest rocket attack. [SEP] consider the world's new best - in - class car [SEP]
+
+===== sample 060 =====
+[CLS] t get enough to be angry, "he wrote in his book, four days before he took a journalism course, declaring that an e. o. k. mandate would make the difference. [SEP] the u. s. - led coalition says at least 20 militants, most of them children, on both sides and the u. s. military said several taliban fighters were killed. [SEP] the militants' forces lost their way, and the army said a soldier was killed when insurgents launched a land mine in the area. [SEP] i only went to the garden, and must have heard the french phrase," long gone. " [SEP] in a [SEP]
+
+===== sample 061 =====
+[CLS] and several years after his parents were involved in the crime - - disappeared for six hours on 23 may 2007. [SEP] three of them spent 15 years in britain's air force prison system and there was no indication that any changes in the command of the forces were made by bush because of his concern over the operational nature of their actions. [SEP] the social security and welfare services are expected to be discussed in the european parliament. [SEP] "despite the fact that the base rate has risen, helped by recent rate cuts, the current base interest rate is not taking any hits," said richard shepherd, the mpc's chief economist, [SEP]
+
+===== sample 062 =====
+[CLS]. [SEP] appearing in a programme - programme on bbc's morning live, mr morgan compared the achievements of sir james when he was a deputy bbc northern ireland in the 1990s. [SEP] several people were evacuated on other days of the course, she said. [SEP] the former episcopal school of meningia and king's college of new church in inverness and king's church is to be sold as part of the reorganisation of the national anglican church of scotland. [SEP] the two victims were later killed in an accident in france and spain. [SEP] they said six people have also contacted police to make dna evidence for him, and he is asking [SEP]
+
+===== sample 063 =====
+[CLS] 1968, died and was again five days later, appearing on the bbc programme for a series of non - programmes. [SEP] if your father had a problem with my son, why didn't he choose to do the thing? [SEP] boston won the pac - 10 series for the first time since 1992 before winning first - round games in chicago. [SEP] but mr. finke's successor, ben w. c. fleming, chairman of the bank and a member of the board, backed mr. morgan. [SEP] they appealed for help. [SEP] mr. chirac was also ousted after several years in office - - he was sworn in [SEP]
+

LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p12_top64_raw_samples.txt

@@ -0,0 +1,236 @@
+const_thrs_tau0p12_top64
+{
+  "type": "summary",
+  "name": "const_thrs_tau0p12_top64",
+  "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt",
+  "step": 200000,
+  "decode": {
+    "kind": "categorical_fullvocab_final_sampling_push43",
+    "config": "const_thrs_tau0p12_top64",
+    "steps": 128,
+    "temp_start": 1.45,
+    "temp_end": 1.45,
+    "temp_schedule": "const",
+    "t_power": 1.0,
+    "eta0": 0.12,
+    "eta_schedule": "early_cosine",
+    "noise_conc": 1.0,
+    "concentration_max": 256.0,
+    "final_from": "state",
+    "update": "resample",
+    "final_mode": "threshold_sample",
+    "final_temp": 1.0,
+    "top_k": 64,
+    "top_p": 0.0,
+    "uniform_mix": 0.0,
+    "sample_threshold": 0.12,
+    "n_samples": 64,
+    "seed": 20260508
+  },
+  "detok_genppl": {
+    "ppl": 41.80839195562669,
+    "nll_per_token": 3.7330970838688944,
+    "tokens": 9725
+  },
+  "diversity": {
+    "sample_entropy": 4.204396875108297,
+    "unique_tokens": 1943,
+    "token_count": 8192,
+    "distinct_1": 0.2371826171875,
+    "distinct_2": 0.7140748031496063,
+    "top_token_mass": 0.0560302734375
+  }
+}
+
+===== sample 000 =====
+[CLS] the president will have to win in the next election. [SEP] it also announced bad results at some of the world ' s biggest credit - card companies and stripped out $ 6. 7 billion in the fourth quarter. [SEP] it can be due to the increased labour requirements and the change in demand, it says. [SEP] " we ' re very involved in policing schools, roads and buildings and we ' re working all over london to find incidents like this, " he said. [SEP] i had a good record and i was doing his best. [SEP] washington - - attorney general michael ki. moon ' s appointment as a former u. n. [SEP]
+
+===== sample 001 =====
+[CLS] star, singer michael russell, has been asked to increase his licence. [SEP] the fall is a good time in school. [SEP] had he sent his dog to buy his own car, the money would have gone. [SEP] in an interview, a senior official said the senator had refused to accept donations. [SEP] tougher guy. [SEP] the defence said that the incident was a breach of procedures made by the ministry of defence ' s specialist civil investigations department in 2002. [SEP] more consumers can visit or join the website and be reached at www. medgreent. com /. [SEP] for more information on iridium, visit the data center. [SEP]
+
+===== sample 002 =====
+[CLS] wouldn ' t be a good idea to carry out a thorough review. [SEP] at a meeting on friday, the company ' s board voted overwhelmingly in support of president obama ' s plans in iraq for the next six months, leaving at least $ 200 billion over two months of war time. [SEP] no, he didn ' t know all the extra money. [SEP] the proposed changes would undermine the core of the state ' s constitutional law. [SEP] the spokesman said both sides would defend themselves as a matter of urgency. [SEP] during these opecunic events, many teachers, teachers, teachers and volunteers accompany men to the gym, and often [SEP]
+
+===== sample 003 =====
+[CLS]swoman said prosecutors pursuing the case had no knowledge of the killings, and he might initiate a criminal investigation. [SEP] for the first time in a year, analysts have also warned that xstran may be worth more than the current $ 3 billion of debt. [SEP] police officers were being pushed at the door of houses where the killing took place. [SEP] it provides travel and family services run by international travel company british travel ( 020 78777 ; www. explore. co. uk ), revenue & customs holidays ( 020 730000 ) and hotels and holidaymakers. [SEP] in the eight weeks since the crisis broke [SEP]
+
+===== sample 004 =====
+[CLS], oversee the iraqi security forces, and provide security for american and iraqi forces. [SEP] these could be added when they return to the commons in the capital. [SEP] " the situation is that it will be improved, " he said. [SEP] " normally, ideally, people would see it later in the next month, doing it at least once a month, " said johnson. [SEP] in may, bill murray voluntarily received a mental health treatment, according to a report by his north carolina office. [SEP] but eight people have been killed by police in the region. [SEP] and having won the british olympic and european cup titles in 2003, and second [SEP]
+
+===== sample 005 =====
+[CLS] civilian judges, acting as the court of appeal. [SEP] at the busy railway station, the pilot collapsed in the rain in the early hours of the morning. [SEP] i lost my job because some people just lost, " and it was followed by the long days of three to four hours. [SEP] david dungy, a spokesman for the sheriff ' s department, has said the prison chief believes the drug enforcement campaign could reduce the number of drug - related crime in the region. [SEP] he crawled out of the car, with his head covered in a blanket, then tried to wave it back to finish in a safe position. [SEP] " it [SEP]
+
+===== sample 006 =====
+[CLS] prosecutors in the mclelland case review the federal grand jury ' s findings and report into the death of stephen baker, whose body was discovered on march 2. [SEP] the government ' s last decision on the use of force was in 2007. [SEP] the children were taken from a school in sudbury, cambridgeshire, a week before 2200 bst that evening. [SEP] people in the midlands and surrounding areas have also taken part in extreme weather events. [SEP] it is also offering a working mortgage benefit scheme likely to cost £6 a week, starting at £345 a week. [SEP] if you can ' t imagine texting a baby, or [SEP]
+
+===== sample 007 =====
+[CLS] receive a guaranteed bonus of $ 4, 000 - - and paid full - time each month. [SEP] many fear water supplies hold up to their power facilities as they prepare for a strong storm. [SEP] i could not believe that he would ever get a bank loan. [SEP] he was fired, spokeswoman said. [SEP] " i ' ll tell you today, he ' s much more effective than now. [SEP] these institutions are not entirely strangers ; they can choose their own ways. [SEP] jones said he met with the defense minister, gen. jaullah mujahid, to discuss plans to push taliban militants from the eastern province of [SEP]
+
+===== sample 008 =====
+[CLS] the shooting is more likely to be the case. [SEP] an assistant is governor of alan s. rice of minnesota and the future administrator of the commission. [SEP] on wednesday, google co inc ( goo. o ), microsoft corp ( ms. n ), google inc ( gooft. o, microsoft inc ' s top customer, and electric co inc ( ge. nx : quote, profile, research, stock buzz ) have announced plans to put net sales of $ 3. 5 billion into securities trading securities related to the accounting charges. [SEP] this is an entirely new part of politics. [SEP] there was a sense among the public [SEP]
+
+===== sample 009 =====
+[CLS] pakistan chief is believed to be the leading mastermind of the attacks. [SEP] but after a few weeks i stayed at my sister ' s home until it moved off. [SEP] sir mark, the long - retired air force officer of royal navy air, became the only aircraft carrier to have flown through the mediterranean to carry on his war plans for scotland. [SEP] posada was involved in three federal crimes, and was brought in a matter of months ago. [SEP] a month is usually " on track " for about 10 million dollars. [SEP] in 2003, microsoft refused to make a takeover bid. [SEP] the u. s. navy has launched [SEP]
+
+===== sample 010 =====
+[CLS] air, was deputy leader in russia ' s mi - 1 programme, and built russia ' s mirov ballistic missiles in addition to russia ' s first nuclear system. [SEP] jacksonville, fla. - the florida house said wednesday they passed a bill that ended the war four years ago, followed by a vote friday that would limit president obama ' s 10 - year - old build - up of the 550 us troops in iraq and 4, 000 troops in afghanistan. [SEP] district attorney william mccready asked the witness to testify in his testimony and later dismissed the suit. [SEP] in iowa, 34 per cent of democratic voters in the state [SEP]
+
+===== sample 011 =====
+[CLS] bank had not paid in mortgage charges, it was thought it would pay back about £54m in the quarter, which is due in full 2010. [SEP] i flew back to miami on an airlines flight. [SEP] the metropolitan police force has been investigated by three detectives and two other police officers in connection with the investigation. [SEP] the former republican presidential nominee often said the 2008 democratic presidential nominee was the father of u. s. president george w. bush ' s failed campaign. [SEP] it has been decided that stock, which may be worthless, may have been short - selling ordinary shares. [SEP] they cut off our electricity. [SEP] i ' [SEP]
+
+===== sample 012 =====
+[CLS] 17 minutes remaining. [SEP] he also began working on wednesday and is mailing an internal psychiatric report. [SEP] the taliban have said in a statement following a meeting between the top leaders of the international human rights committee and the human rights council that there would be no international charges of violations against civilians. [SEP] b - 3 did not answer telephone calls for this article in april, the washington tribune reported. [SEP] but he is probably likely to find ground. [SEP] this ice will melt, and this won ' t be for long until you get water. [SEP] " the difference between being a husband and being a mother now is clear. [SEP] but what [SEP]
+
+===== sample 013 =====
+[CLS] slomping down the street for a coffee lunch. [SEP] on saturday, fa executive chairman pat wright said : " this is a deeply serious accident and she understood the allegations were being investigated by this side. [SEP] the television and radio station has also launched a local programme that includes many of its regular programmes including daytime tv times and evening and evening news. [SEP] omar al - karzai was allegedly married to his mother and cousin when she was accused of killing her daughter and then forcing authorities to kill her, her family said. [SEP] but senate aides said the department ' s report will not have historical significance and that " if law [SEP]
+
+===== sample 014 =====
+[CLS] a harvard student in college, was trying to come up with some sort of new idea. [SEP] nato officials said tuesday that the special representative to the u. n. security council on the 15 - nation council on afghanistan has staked the support of his staff members in a dispute with kabul over the proposed new law. [SEP] he has has been charged with blagevich ' s attempted murder. [SEP] in winter weeks, it was wet in the cold, but the area was infested with mud and cold soil. [SEP] " when a e - mail or email address is sent to someone at birth, which i don ' t know [SEP]
+
+===== sample 015 =====
+[CLS] dead body in the pool at the school. [SEP] he joined the board in may 1958, retiring as a graduate professor at the university ' s college of management, where he was named a member of harvard medical school and chairman of the m. l. a. and of the international institute for health and health policy. [SEP] " they want to... [SEP] he says that he " has a lot of great points, " but that he knows it is " very good " and does not believe this. [SEP] for all this time, it was in iceland ' s interest of nationalising its financial sector, and, of course, [SEP]
+
+===== sample 016 =====
+[CLS] absence of any allegations of corruption in the legal system. [SEP] during the downturn, it was unclear what his life to do with his company. [SEP] in 1969, just three years after leaving as chairman of the club, he became the first individual football figure to conceive in the club ' s executive management. [SEP] mr shapiro, who has served as a top banker at toyota in the past for 13 years as the chairman of the company ' s board, has made a $ 3 million management package. [SEP] it was claimed the man took the phone while allegedly sending the phone message to his wife. [SEP] " there is no sense [SEP]
+
+===== sample 017 =====
+[CLS] alaska ' s polar bears remain the most important source of information in the arctic area, and a significant source of the breeding population in the western arctic ice area. [SEP] soon after israel took over the presidency - - and a fifth head of state - - of the national arab university in 2005, israel ' s education department revoked its accreditation program. [SEP] but he has no doubt michael jones, the director of his new military team, will be meeting with the current head of the government. [SEP] officers said they took them to hospital for medical attention, but reported concerns about the identity of the man. [SEP] " it ' s an early day [SEP]
+
+===== sample 018 =====
+[CLS] [SEP] i was at 14, aged only 15 when i turned 15 when i was 22, and i became aware of the need for more breathing time and this was the first time i had ever seen a particular level of interest. [SEP] one good dream for parents was to arrive at a post - office breakfast in the morning. [SEP] it might now make a zero percent interest rate cut, which is already the fastest rate cut in more than half a century. [SEP] he needs to say this. [SEP] the incident was reported to south wales police in swomford road at 2200 bst on tuesday, police said. [SEP] but we ' [SEP]
+
+===== sample 019 =====
+[CLS] rise of new zealand ' s fast food. [SEP] in the early war his firm was based in brecon, preselbury, and it was in westminster, highgate hill and cwmbran, where i turned up in the second row of hill houses, in edinburgh in 1975. [SEP] sir paul rose was appointed chairman of the met at the age of 81 for £2. 3 million but was paid £69, 000 in salary. [SEP] there are two good things in football. [SEP] he ' d scored 16 points to help seattle give the league its first win of the regular season. [SEP] pakistan ' s authorities are saying [SEP]
+
+===== sample 020 =====
+[CLS] public freedom. " [SEP] private sales opened last week at $ 12. 3m. [SEP] he said the decision before the new parliament is expected to make it a second session to parliament. [SEP] gordon - brown has been organized by the national museum of natural history. [SEP] the average rate again rises to 5. 3 points, falling to a peak of 5. 7 per cent in july, while the average rate on three year loans fell from 2. 7 per cent to 4. 5 per cent earlier in the year. [SEP] that ' s what is an american school of american cooking, just as it ' s all about high - tech [SEP]
+
+===== sample 021 =====
+[CLS] one of them. [SEP] in 1989, the kazlin democratic party of the anti - soviet union leader and finance chief, nikita khrushchev, launched a military campaign to stop attacks on the ussr in europe. [SEP] mr horwood, 29, was arrested friday, was granted bail but was released last month while the case was re - examined. [SEP] i ' m a singer for several years. [SEP] 5, citing police officers. [SEP] experts say banks need to wait 10 days of payment of the cards but there may be a time when they are being forced to pay interest. [SEP] the story is still considered an accurate indicator [SEP]
+
+===== sample 022 =====
+[CLS] be able to bring our soldiers into action, " said col. david caldwell, vice chief for the u. s. air and air force. [SEP] the french army has more than 400 soldiers at more than 6, 000. [SEP] dein said : " he ' s an added bonus to losing his team, but he can show that it can be done with live action, especially with steven jones. [SEP] police are pursuing a call for a man ' s arrest in connection with the murder of the 21 - year - old briton at a police station. [SEP] gen. pervez mullen, at a news conference tuesday, said [SEP]
+
+===== sample 023 =====
+[CLS] appeared in the oct. [SEP] some nato commanders in afghanistan have asked for the speed and deployment of most of the 21, 000 troops now already there. [SEP] the teenager was released on bail and bailed out following a review of the case. [SEP] he died, in 2003, but he was never able to die. [SEP] in november 2007, reflecting abundant demand in china and india, global demand for crude products more than doubled a month. [SEP] subs : hudson, fletcher, wolsay, langfield, coker, lovenk, fletcher, baird, banks, fletcher, lawes, fletcher, coker, healy, [SEP]
+
+===== sample 024 =====
+[CLS] williams, the club ' s executive chairman. [SEP] more than 1, 000 women who lost weight in 2007 have been in the uk since 2000, according to a national survey. [SEP] i like the sound of the song. [SEP] the public prosecutor later refused to open the investigation, though campbell ' s attorney said no formal charges have been filed, the times of london reported. [SEP] a change of heart. [SEP] " we entered an open area and the driver opened a side door and then tried to get under the car as it happened while driving, " he said. [SEP] the army also plans to buy about 300, 000 cases of the [SEP]
+
+===== sample 025 =====
+[CLS] by 10 per cent. [SEP] that ' s all even more so, in their view, as they don ' t speak to their children. [SEP] the lakers didn ' t risk a loss when andrej o, a backup who had six points in four regular seasons, took a poor win against dallas and spent at least 20 minutes sitting on his left leg. [SEP] chris snyder ' s two - run homer in the eighth and the first two runs made it 4 - 5. [SEP] they also help find evidence of what happened during a bonfire in the area on thursday. [SEP] he is still miles away from using the internet as a social service [SEP]
+
+===== sample 026 =====
+[CLS] up on his efforts to repeal the new people ' s law, which he says was never approved by the house and has said he will get the bill before christmas, but he opted instead to give up public responsibility for the election. [SEP] the local intelligence service had recently confirmed that the army in the area had killed militants. [SEP] it might not be the morning after that. [SEP] but his playing days were, for many, a clarion call for football this season. [SEP] she could also sell wineries and telephone jackpots on the restaurant ' s main floor in the island ' s northern corner. [SEP] little rock, ark. [SEP]
+
+===== sample 027 =====
+[CLS] arrested on various charges, but they did not give a further date. [SEP] meanwhile, it ' s not so bad that all - rounders vaughan and swaner had already had to settle for one on the second morning in the second test. [SEP] najibullah - mujahid was under surveillance when police responded to his house after surrendering to his apartment by his security forces and security services, the times said. [SEP] the public inquiry team was unable to complete a report in both cases. [SEP] an actor in india who became the world ' s top indian film director has taken charge of the country ' s budget, dropping his [SEP]
+
+===== sample 028 =====
+[CLS]. [SEP] her father was trapped in the front yard. [SEP] as the firefights started, people began beating up on the floor, hearing noises, an answer that was denied. [SEP] the group said the review would not be completed before the end of the current financial year and could be for a full year. [SEP] authorities reported the crash, 40 hours after a helicopter crash on the washington river. [SEP] it ' s always easy for both men to leave behind their job. [SEP] it was the first time former president nawaz sharif was available to comment. [SEP] that was to say the thrust of the series ; yes, he was [SEP]
+
+===== sample 029 =====
+[CLS] are less likely to still need surgery following radical heart surgery, according to the group. [SEP] what a disgrace. [SEP] noose, the largest and most important of the leaders of the jewish state of israel, is still buried in the sanctuary of the middle eastern city of jerusalem, where st. john ' s was still buried long after his death in 2 1 / 2 years ago. [SEP] it is the final day of parliament and the prime minister ' s funeral. [SEP] the latest case has affected anyone under 18 and it was closed shortly after the crash incident. [SEP] ( ap ) - - craig johnson held up his lead and was good [SEP]
+
+===== sample 030 =====
+[CLS] and you can find us and have real fun. [SEP] the visitors again appeared to settle for a scoreless goal late in the second half. [SEP] mr winehouse was arrested in 1992 and later ran the child law enforcement office established in the 1990s. [SEP] he took advantage of his lack of vision, going back for treatment. [SEP] the case is expected to be heard before the general election in july 2009. [SEP] during the summer, he has to walk more leisurely. [SEP] the state of the afghan economy has been a key element of public support and support in afghanistan ' s recent election, given " today ' s announcement that the taliban [SEP]
+
+===== sample 031 =====
+[CLS] telephone at + 800 - 877 - 2526, or 617 - 213 - 2535. w. baird & co. interested listeners should visit the company ' s investor relations website ( www. wthrewcorp. com ) to listen via the web at 8003 - 1009 or + 919 798969 for a conference call, and enter pass code 86670998. access pass code 907771. www. dresser. net. com. is available by telephone from the u. s. relations section or calling on 0800 858989. [SEP] it was [SEP]
+
+===== sample 032 =====
+[CLS] charges, had been dismissed because of his involvement in federal criminal investigations. [SEP] the longer the military takes power, the more danger becomes. [SEP] now i don ' t know, but i thought it could last months and years, just in the middle of a big one. [SEP] police in the state have said they have no knowledge of his conduct. [SEP] christopher heilwood, 30, and his brother, gregory have been arrested following an incident between two youths at the store in abbey road, northampton, on saturday. [SEP] the authority said it had saved about $ 100m through a payment system called the public service system ( csr [SEP]
+
+===== sample 033 =====
+[CLS] murder and the assault was with one of the officers, authorities have said. [SEP] the finance ministry said the company had a plan to sell german products, but said it could put up many bidders for such brands. [SEP] but he denies that he has accused president zardari and others of compliciting in the election, and that he has not warned his citizens against raising confidence in the government. [SEP] that was an essential goal, she said, and it seemed that their relationship was taking on her new life. [SEP] 3, but the standard of living is likely to continue to drop. [SEP] it is a 50 - year [SEP]
+
+===== sample 034 =====
+[CLS] mr brown said it was not simply a very bad social housing regime. [SEP] his successor, gen mullah muzi, was promoted to power when he received a british passport in 2001. [SEP] there is also a sense that the experience of his death in the 1980s was the day of great " education. " [SEP] i don ' t remember the music, but i listen to the world. [SEP] currently, he is a two - year member of the company ' s board. [SEP] born in 1992, texas tech has never been made the a. c. a. a. tournament again in three years. [SEP] bill clinton ' s campaign [SEP]
+
+===== sample 035 =====
+[CLS]. [SEP] we do not need a laptop. [SEP] just three months ago, johnson was part of the team that felt the problem. [SEP] " you ' re not able to get work, you ' re out of the workforce. [SEP] in 2009, gen. john gallimer and three co - defendants issued the district court order overturning the convictions of judge richard addington, who refused to testify in the case. [SEP] after the election, mr anwar announced that his brother had ended a management role in his charge of the police service of the state. [SEP] expect to see something similar again in the year, when the census of [SEP]
+
+===== sample 036 =====
+[CLS] to its requirements. [SEP] in september, japan they lost 0. 7 per cent. [SEP] they have given no details of their raids. [SEP] this is also a very serious issue. [SEP] david wilson, head of communication at the prison service trust union, said : " it ' s a bit of a complete loss of confidence and confidence. [SEP] the officer, who is approved by the criminal register, said that he had no disciplinary record but was unable to answer questions until after they gave access to legal advice. [SEP] in december 1981, he was appointed chancellor of the university, and later, in 1986, a regular fellow at the university [SEP]
+
+===== sample 037 =====
+[CLS] president pervez musharraf, his predecessor, was removed under an emergency army rule. [SEP] this is a good decision so that it is more clear and effective. [SEP] western officials said at the opening session that mr karzai ' s brother, mr al - karzai ' s son, the director, houthi barzani - wali was present at the time of the blast, was released on sunday, after police demanded his arrest, the dawn newspaper reported. [SEP] sir michael powell, former head of the army and navy, was once a staff member of the george w. bush administration and is now [SEP]
+
+===== sample 038 =====
+[CLS] made to land in a car driven by his brother, who was walking away when the fire broke out in an open field near the spam hotel on the wrong side of the road. [SEP] he also dismissed claims that he was not a public figure who could be thought to have claimed to have been abused by a homeless person to get his money. [SEP] great article - - and, in fact, one crucial example. [SEP] government figures say the rise in cases means record numbers of abortions have been reported during the campaign. [SEP] the national front, the pdp, has been declared the winner, and the former prime minister, abdullah [SEP]
+
+===== sample 039 =====
+[CLS] the american football association. [SEP] under the scheme, a phone company can frighten you to buy the phone that can cost you and those looking to buy a card could make a payment. [SEP] four afghan insurgents were killed in a u. s. military helicopter crash during the campaign that destroyed hundreds of thousands of civilians and six insurgents hiding behind it. [SEP] more than 10, 000 children attend high - school lunch programs, more than 200 state schools and many others are facing food bills. [SEP] a police investigation has been launched after a firefighter has died at a house in lincolnshire. [SEP] president barack obama announced comprehensive reform for the health care [SEP]
+
+===== sample 040 =====
+[CLS] finals for the first time this year. [SEP] first, this had resulted in a massive pay - out - - but it was rejected by mps. [SEP] it has cut 700 jobs in the uk between april and april. [SEP] in the early sunday, over 100 people were found in collapsed or collapsed homes and three of those missing in the northwestern town of emu state. [SEP] georgia sent two combat troops on friday, the first time some 4, 500 troops were deployed to the area after fighting broke out in april. [SEP] just a few days later kazana blara announced she was looking to use public office just a few days [SEP]
+
+===== sample 041 =====
+[CLS] court in january, and one of two charges was dropped. [SEP] she has read this. [SEP] he already lives in alaska. [SEP] the australian funds rate, including bank rates, hit a five - year high for the dollar, which closed 0. 75 per cent lower at 0. 7 per cent on thursday, after dropping below 5 at an 18 - month high yesterday. [SEP] residents can call 0800 984 - 0830, and offers free £11 - a - day parking. [SEP] the u. s. military on friday accused the nato - led force of staging an air assault sunday night, saying it would send a heavy [SEP]
+
+===== sample 042 =====
+[CLS] a big - screen show at the american pictures international film festival. [SEP] the legal authority developed by lord sir john burrell, who was appointed and by appointment as a deputy commissioner in 1992. [SEP] american michael phelps won his world record with an incompetent run in the 200 meters last night. [SEP] a few years ago, word emerged that blagojevich had launched a facebook campaign to raise money for the service. [SEP] " i have made only one loan in five years. [SEP] this came after a teenager was also jailed for investigating the shooting of a woman in the dundee area. [SEP] the plan for the conservation area includes [SEP]
+
+===== sample 043 =====
+[CLS] has left town. [SEP] she had no regrets, but her up - and - down routine was not quick enough. [SEP] " it was too thick, he could not swim out because he was in the pool nearby. [SEP] sir bob woodward, the force ' s chief forces officer, said he had hoped to issue a schedule for deployment in april. [SEP] " those who know if there is any substance to this type of information were asked to back up up, " he said. [SEP] all are good, and are asked to give customers a number of help they really feel they might need or need it out. [SEP] authorities have said the [SEP]
+
+===== sample 044 =====
+[CLS] after allowing him to exchange text messages during his prison days. [SEP] the pandas will travel to american zoos during and after the season. [SEP] by the time he got his interview, he had helped his family and friends across the world. [SEP] his wife and children were also questioned for links in the investigation and he in aruban custody. [SEP] the chinese government said it issued $ 1. 7 billion of gold on its reserves as china, the world ' s second - largest economy, reported a five - year - long decline in gold reserves on friday. [SEP] under a five - year deal in which the club will receive £3 [SEP]
+
+===== sample 045 =====
+[CLS] $ 80 to $ 90 per month. [SEP] his high - ranking deputy, circigio berto, said that it was not necessary for constitutional renewal of power in the country ' s parliament, seven years after mr. morales was suspended, offering all his colleagues the job. [SEP] there ' s also the growing range of local barbecue and pasta salads. [SEP] officials from the united nations, nato, china and russia each voiced their concerns, and last week u. s. sen carl m. levin ( d - mich. ) said that it was time for barack obama to take his post as president. [SEP] he was [SEP]
+
+===== sample 046 =====
+[CLS] to adapt, and a growing number of foreign workers has been eliminated through the recruitment process. [SEP] the bank paid the bonuses this year with total bonuses of $ 100, 000 and the current bonus package worth $ 250 million. [SEP] and he too has been advised to find that his family is out of control because of its problems. [SEP] gordon smith, who was the us commander in iraq, says he believed his country was responsible for their deaths. [SEP] a spokeswoman for its petrochina unit said that " direct complaints " were not made and the plant ' s co - operation had to be closed. [SEP] a strasbourg court [SEP]
+
+===== sample 047 =====
+[CLS] 2, 0 - 9 in the world cup games. [SEP] more than 100, 000 people died in a major earthquake off the coast of mexico in 2005. [SEP] the application is also being submitted to the meeting and the parliamentary health committee. [SEP] " we have already taken the measures to ensure the spread of flu is linked to improving care, " the hpc says, adding a further analysis is being carried out and the rest of the outbreak is likely to be confirmed. [SEP] he and his men served in the regular army and were sent to their homelands in iraq. [SEP] president obama pledged that he would consider whether to accept us forces [SEP]
+
+===== sample 048 =====
+[CLS] local and state sponsored public schools in phoenix, los angeles and chicago. [SEP] the case should be closed before dec. [SEP] a trial heard that he had been rejected but was quashed for three months. [SEP] at the top of the taliban, they face the battle with afghanistan ' s pashtun in the south. [SEP] " our manager ' s job to determine how it all happened to us, " he said. [SEP] as one collector notes, " he ' s kept going away for just about five years, " he said. [SEP] the brazilian later returned to action as the second half played five minutes and seven minutes. [SEP] [SEP]
+
+===== sample 049 =====
+[CLS] find homes, go out of business and take a hike into the second - quarter comfort zone. [SEP] investigators were later told to give a police interview. [SEP] that will make it even harder to vote in future elections. [SEP] he became a sensation and was nominated for the award for natural science in a fellowship at the national academy of sciences in london. [SEP] palin, sarah palin ' s 2008 vice presidential pick, launched a special inquiry into gov. palin ' s selection as the presidential candidate, almost three years before the end of the summer. [SEP] starting at 15, mayes joined a group of u. s. sailors [SEP]
+
+===== sample 050 =====
+[CLS] as she said they had not heard of them. [SEP] a justice chief, deputy head of the domestic state committee and chief of national affairs were present when mr biden ' s speech was heard. [SEP] but mr manzanga said the current plan to legalise the practice is unsustainable. [SEP] bartoli is the no. 1 player to make the top three after last having to play first in the under - 21 open in april. [SEP] she met her husband when she had suffered from terminal cancer. [SEP] jones limped to a 2 - 3 fifth inning after losing control in the bottom. [SEP] grey ' s " x [SEP]
+
+===== sample 051 =====
+[CLS] station, is to appear in magistrates ' court after an anti - drugs programme last week, with ms ross saying she wanted to drop out of the cast of the tonight show. [SEP] " the first half of the year in 2008 had two quarters of negative economic growth in this recession. [SEP] let ' s not forget whether he would coach the team when they reach the nfl championship. [SEP] the inquiry report also calls for a new public standard for takeovers. [SEP] what we will all know is that at £35, a week, he was being denied, at the age of 50, an early pension and decent home pay. [SEP] the [SEP]
+
+===== sample 052 =====
+[CLS] [SEP] the cause of the outbreak, so far, is still providing details about the state of the supply, he said. [SEP] seven days later, he became the longest running fiction writer for television. [SEP] he has been jailed in the uk after the election in 2001, and agreed to release under the law of torture. [SEP] brian billiton, who entered the final three races in a row, was in the field along with johnson. [SEP] he said there will be no increase in the annual tax rate for five months. [SEP] then i ' m more likely to have been hit more than i ever thought. [SEP] the study also found [SEP]
+
+===== sample 053 =====
+[CLS] provide the final scoring opportunity in the 47th minute. [SEP] he says he hopes his client will sue the government so that they can do the same. [SEP] it ' s like a movie she ' s made. [SEP] he also asked john mcguinner, the scottish government ' s executive director, to set up a trust fund of more than £20m. [SEP] south africa will make their third tri six nations with a 32 - 17 win over new zealand, and will face the u. s. in june. [SEP] wal - mart was cautious after tuesday ' s fourth - quarter performance. [SEP] but if a baby dies a few [SEP]
+
+===== sample 054 =====
+[CLS] percent over last year, in a year - earlier period when it stood at 2, 661. [SEP] meanwhile, the european central bank kept the main interest rate at its lowest level amid concerns of the high inflation in the euro zone. [SEP] it said its cost rise was nearly 6 %, which rose to 1, 300 in 2006. [SEP] notes : joe johnson has seven points. [SEP] that way, power to a new government, or any state, should be appointed. [SEP] he had already received a letter from the public health service ' s office and told officials about the existence of the plans. [SEP] the security systems were put off [SEP]
+
+===== sample 055 =====
+[CLS] douglas huber and kevin spacey. [SEP] tomlinson, who lives in the maradona living room, asked what attracted his concern. [SEP] it takes time to take the first few months off when you would want to have a baby in your room sitting on the floor. [SEP] the financial cost of this case is very small. [SEP] celtic association legend john kelly says he could find himself in the hunt. [SEP] as a member of the pan - american advisory committee of the national trade and energy council and its foreign trade committee, hahn - chun ' s comments to north american scientists have long been consistent. [SEP] not so many americans [SEP]
+
+===== sample 056 =====
+[CLS] months. [SEP] in line with the national service ' s plan, announced in april, the bbc is to be offering up to 1 million per - minute programmes for about 10 % of the digital audience. [SEP] the chief of police and chief of the national human security division, mullah mohammad qalinaza, were also wounded. [SEP] every year, while around 7, 000 americans die, there are now nearly 3. 9 million deaths per person, according to britain ' s institute of public health medicine. [SEP] he told police that the tape was a threat to one of his children. [SEP] mr. dean was not released named, [SEP]
+
+===== sample 057 =====
+[CLS] jail after serving nine months and a half of his sentence, and suspended for three years. [SEP] although, after serving in power in the late 1980s, the british officer joined his unit in august 1975, while mr colle had spent nearly 30 years in the royal armoured service division, he was involved in the mid - morning operations and late - night operations of the military. [SEP] it appears there are people working at other sites on the channel island. [SEP] the other young man was trapped on the house ' s roof. [SEP] mccain has moved on, and he has never been a candidate in the fall. [SEP] but it gave him the [SEP]
+
+===== sample 058 =====
+[CLS] the money went down. [SEP] the board was due to vote on this issue next january. [SEP] the pakistani government has denied opposition claims that western forces are pursuing the taliban in a major border clash. [SEP] i feel very happy to make them no more. [SEP] they don ' t know - - or can ' t have kids when they want to. [SEP] it is an attempt of a sense of purpose that is part of the european parliament within the european convention of human rights. [SEP] one of the good books, " war on evil. " [SEP] " you can see i had the car down on the back to myself. [SEP] " when [SEP]
+
+===== sample 059 =====
+[CLS] staff, met mr. bush in january. [SEP] please, avoid the adulterous garb. [SEP] last year ' s pre - tax profits fell more than 9 per cent as a result of a weak yen, led by weaker demand. [SEP] this is currently at about £300, 000 a year - - a profit of around 2p a day on a year ago instead of the 40p pay of £7. 8 billion. [SEP] police released a short - range missile and a local television station reported that two militants had been killed in the latest rocket attack. [SEP] consider the world ' s new best - in - class car [SEP]
+
+===== sample 060 =====
+[CLS] t get enough to be angry, " he wrote in his book, four days before he took a journalism course, declaring that an e. o. k. mandate would make the difference. [SEP] the u. s. - led coalition says at least 20 militants, most of them children, on both sides and the u. s. military said several taliban fighters were killed. [SEP] the militants ' forces lost their way, and the army said a soldier was killed when insurgents launched a land mine in the area. [SEP] i only went to the garden, and must have heard the french phrase, " long gone. " [SEP] in a [SEP]
+
+===== sample 061 =====
+[CLS] and several years after his parents were involved in the crime - - disappeared for six hours on 23 may 2007. [SEP] three of them spent 15 years in britain ' s air force prison system and there was no indication that any changes in the command of the forces were made by bush because of his concern over the operational nature of their actions. [SEP] the social security and welfare services are expected to be discussed in the european parliament. [SEP] " despite the fact that the base rate has risen, helped by recent rate cuts, the current base interest rate is not taking any hits, " said richard shepherd, the mpc ' s chief economist, [SEP]
+
+===== sample 062 =====
+[CLS]. [SEP] appearing in a programme - programme on bbc ' s morning live, mr morgan compared the achievements of sir james when he was a deputy bbc northern ireland in the 1990s. [SEP] several people were evacuated on other days of the course, she said. [SEP] the former episcopal school of meningia and king ' s college of new church in inverness and king ' s church is to be sold as part of the reorganisation of the national anglican church of scotland. [SEP] the two victims were later killed in an accident in france and spain. [SEP] they said six people have also contacted police to make dna evidence for him, and he is asking [SEP]
+
+===== sample 063 =====
+[CLS] 1968, died and was again five days later, appearing on the bbc programme for a series of non - programmes. [SEP] if your father had a problem with my son, why didn ' t he choose to do the thing? [SEP] boston won the pac - 10 series for the first time since 1992 before winning first - round games in chicago. [SEP] but mr. finke ' s successor, ben w. c. fleming, chairman of the bank and a member of the board, backed mr. morgan. [SEP] they appealed for help. [SEP] mr. chirac was also ousted after several years in office - - he was sworn in [SEP]
+